WO2010000161A1 - 一种基于即时通讯系统的语音通话方法及装置 - Google Patents

一种基于即时通讯系统的语音通话方法及装置 Download PDF

Info

Publication number
WO2010000161A1
WO2010000161A1 PCT/CN2009/071931 CN2009071931W WO2010000161A1 WO 2010000161 A1 WO2010000161 A1 WO 2010000161A1 CN 2009071931 W CN2009071931 W CN 2009071931W WO 2010000161 A1 WO2010000161 A1 WO 2010000161A1
Authority
WO
WIPO (PCT)
Prior art keywords
voice
tone
information
instant messaging
messaging client
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2009/071931
Other languages
English (en)
French (fr)
Inventor
李大龙
郑全战
盛馥钟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Publication of WO2010000161A1 publication Critical patent/WO2010000161A1/zh
Priority to US12/913,358 priority Critical patent/US20110044324A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04Real-time or near real-time messaging, e.g. instant messaging [IM]
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/0018Speech coding using phonetic or linguistical decoding of the source; Reconstruction using text-to-speech synthesis
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/003Changing voice quality, e.g. pitch or formants
    • G10L21/007Changing voice quality, e.g. pitch or formants characterised by the process used
    • G10L21/013Adapting to target pitch
    • G10L2021/0135Voice conversion or morphing

Definitions

  • the invention belongs to the field of communications, and in particular relates to a voice call method and device based on an instant messaging system. Background of the invention
  • the instant messaging system has many other additional functions, such as voice calling, in addition to basic instant messaging capabilities.
  • voice calling in addition to basic instant messaging capabilities.
  • the use of instant messaging systems for voice calls has become one of the communication tools used by the general public.
  • existing voice calls can only use their original voice to make calls, and cannot change the original voice of the caller.
  • the identity of the hidden party is hidden, lacking novelty and entertainment, and cannot meet the individual needs of the user.
  • Embodiments of the present invention provide a voice-switching voice call method based on an instant messaging system, which aims to solve the problem of a voice-tuned voice call method based on an instant messaging system.
  • a voice call method based on an instant messaging system comprising the steps of: establishing a tone-tuned voice call channel between at least two instant messaging clients; performing transposition processing on the input original voice information to obtain a pitch-adjusted voice;
  • the pitch voice call channel sends the tone change voice to the instant messaging client B.
  • Another object of the present invention is to provide a voice communication device based on an instant messaging system, where the device includes: a request sending unit, configured to establish a tone-tuned voice call channel;
  • a voice collection unit configured to collect input original voice information
  • a tone adjustment processing unit configured to perform transposition processing on the original voice information collected by the voice collection unit to obtain a tone-modulated voice
  • a voice sending unit configured to send the tone-tuned voice obtained by the tone changing processing unit by using the tone-tuned voice call channel established by the request sending unit.
  • the voice signal collected in the instant messaging system is first subjected to voice tone modulation processing, and the voice-changing voice call based on the instant messaging system is realized, which brings great entertainment effect to the voice communication based on the instant communication occasion.
  • bringing new value-added service growth points to traditional instant messaging services, increasing users' dependence on instant messaging products, thereby enhancing product competitiveness and providing a new business experience for voice call users.
  • FIG. 1 is a basic flowchart of a method according to an embodiment of the present invention
  • FIG. 3 is another detailed flowchart of a method according to an embodiment of the present invention.
  • FIG. 4 is a flowchart of processing, by the instant messaging client B, the tone-switched voice call data sent by the instant messaging client A according to an embodiment of the present invention
  • FIG. 5 is a basic structural diagram of an apparatus according to an embodiment of the present invention.
  • FIG. 6 is a detailed structural diagram of an apparatus according to an embodiment of the present invention. Mode for carrying out the invention
  • a tone change between at least two instant messaging clients can be established.
  • the voice call channel for example, can establish a voice-tuned voice call channel between the instant messaging client VIII, the instant messaging client B, and the instant messaging client C.
  • a variable tone voice channel is established between A and the instant messaging client B.
  • the instant messaging client A sends a voice tone change request to the instant messaging client B, and establishes a tone-adjusted voice call channel with the instant messaging client B, and then performs transposition processing on the collected original voice to obtain a corresponding voice corresponding to the original voice.
  • the tone voice is transmitted, and the tone voice is sent to the instant messaging client B through the established tone voice communication channel, thereby realizing the tone voice call between the instant messaging clients in the instant messaging system.
  • FIG. 1 is a basic flowchart of an embodiment of the present invention. As shown in FIG. 1 , this embodiment takes an example of establishing a tone-tuned voice communication channel between the instant messaging client A and the instant messaging client B. The process may include the following steps:
  • Step S101 Establish a tone-adjusted voice call channel between the instant messaging client A and the instant messaging client B.
  • Step S102 Perform transposition processing on the input original speech signal to obtain a pitch-adjusted speech.
  • Step S103 the tone-adjusted voice is sent to the instant messaging client B through the voice-adjusted voice call channel.
  • the instant messaging client A and the instant messaging client B may be implemented in multiple implementations, such as a terminal in the form of a web, or a terminal in a wireless form, which is not specifically limited in the embodiment of the present invention. .
  • the operations of the foregoing steps S102 and S103 can be performed by the instant messaging client A.
  • the instant messaging client A directly transposes the input original voice information to obtain a pitch-adjusted voice; Transmitting the tone-changing voice to the instant messaging client B through the server relay or P2P mode; or performing the preset tone-changing processing device such as a server, for example, the preset server receives the instant messaging client
  • the original voice information sent by the terminal A after which the original voice information is subjected to a tone-modulation process to obtain a tone-modulated voice; how to transmit the tone-changing voice to the instant messaging client through the voice-switched voice call channel, how to implement the embodiment of the present invention Not specifically limited.
  • the following is an example of performing a voice call operation between two clients.
  • FIG. 2 is a detailed flowchart of an embodiment of the present invention, which is described in detail as follows:
  • the instant messaging client A sends a tone-changing voice call request to the instant messaging client B.
  • the instant messaging client B After receiving the voice-tuned voice call request sent by the instant messaging client A, the instant messaging client B responds to the voice-tuned voice call request and returns the response message to the instant messaging client A.
  • the instant messaging client A receives the voice-changing voice call response returned by the instant messaging client B, a tone-tuned voice call channel is established between the instant messaging client B and the instant messaging client B.
  • the instant messaging client A and the instant messaging client B establish a tone-adjusted voice call channel under the coordination of the instant messaging server.
  • instant messaging client A can send a voice-tuned voice call request to instant messaging client B transparently or opaquely. If the instant messaging client A transparently sends a tone-change voice call request to the instant messaging client B, the process does not need to be displayed on the instant messaging client B interface.
  • the instant messaging client A performs transposition processing on the original voice collected, and obtains the pitch-adjusted voice corresponding to the original voice.
  • a plurality of voice transposition modes are provided, such as changing the pitch of the voice, the gender change sound (the male voice becomes a female voice, the female voice becomes a male voice), the age change sound (the voice of the teenager becomes the voice of the elderly), and the original voice of the user is used.
  • the voice of a famous person on the user's voice
  • the background sound is added (strictly speaking, adding a background sound to the user's voice does not belong to the voice transposition processing, but belongs to the mixing technique, but the pitch-switched voice call defined by the present invention includes such an application) and the like.
  • the speech modulating process can use a linear prediction (LP) analysis synthetic speech model to decompose the digital speech signal into a spectral envelope portion (represented by Linear predictive coding (LPC) coefficients) and excitation. Part (represented by the residual of LPC); Then, the formant frequency and the spectral tilt parameter are extracted on the LPC coefficient, and the speech conversion is realized by vector quantization code calligraphy.
  • LP linear prediction
  • the frequency envelope conversion can use vector quantization
  • the conversion of the prosody mainly the pitch period
  • TD-PSOLA time domain pitch synchronous overlap-add
  • determining the operation of the voice tone modulation mode to be currently used may include: determining current tone change information; thus, the voice tone adjustment mode currently to be used may be determined according to current tone change information.
  • the current tone change information may specifically include user selection information, and/or authorized tone change information.
  • the user selection information is a selection made by the user in the provided voice tone changing mode; and the authorized tone changing information is a tone changing information authorized by the tone changing party user in the instant messaging system.
  • the voice tone adjustment mode is determined by the tone change mode of the tone change party user in the instant messaging system, and the voice tone adjustment mode may be used as the value added service item.
  • the user sends the user's authorized tone changing mode query information to the server through the instant messaging client A, and the server returns the authorized tone changing information according to the identity of the user in the instant messaging system, that is, the user The voice transposition method available to the user.
  • the instant messaging client A further inputs the user selection information according to the authorized tone changing information returned by the server, thereby determining the usable voice tone changing mode according to the user selection information and the authorized tone changing information returned by the server.
  • the embodiment may also determine the tone change mode according to the user selection information and the authorization tone change information, and use other service selection logics. When the user has only one voice tone adjustment mode that can be used, the tone change mode may be determined only by the authorized tone change information.
  • the speech transposition method of speech transposition processing also considers the user personality characteristic information, that is, mainly the segment features in the original speech of the user.
  • the transposition mode is determined by the service selection logic according to the user selection information and the user personality characteristic information, or the user selection information, the authorization transposition information, and the user personality characteristic information.
  • the service selection logic is defined by the instant messaging service provider to clearly indicate what kind of authorized tone changing information, and what kind of voice-tuning voice service can be enjoyed by the voice communication environment (for example: "Male voice change female voice" is a voice-changing voice service. ), etc., which is used to determine the way the voice is changed.
  • the client A After receiving the user selection information, the client A analyzes the original voice signal of the user and obtains the personality feature information.
  • the personality feature information cannot meet the requirements of the voice tone modulation process, the user needs to correct the voice tone adjustment request. For example: A user's original voice is thick and hoarse, and the voice tone of his choice is "younger children". The adjustment effect will be poor (it is not easy to identify the other party as "children"), so the system should advise the user to reselect the voice tone mode.
  • the voice tone mode confirmation also considers the voice environment information of the other party.
  • the tone changing mode is determined by the service selection logic according to the user selection information and the counterpart voice environment information, or the user selection information, the authorized tone changing information, and the counterpart voice environment information.
  • Instant messaging client ⁇ to the instant messaging client ⁇ return to tone voice call response, while returning its own voice environment information.
  • the voice environment information can be selected by the instant messaging client B user, or analyzed by the instant messaging client B according to the sound signal collected by the microphone.
  • the voice tone adjustment mode of the instant messaging client A may be determined by the service selection logic by one or any combination of authorization tone information, user personality feature information, and counterpart voice environment information and user selection information.
  • the collected voice information may include signals that are not conducive to processing, transmission, and discrimination, such as echo, noise, and the like, in order to achieve a better voice-tuning voice call effect, the voice heard by the call receiver is improved.
  • Quality before performing the speech transposition processing on the digital speech information, denoising the digital speech information, that is, performing one or more combinations of echo cancellation, noise suppression, signal gain adjustment, and the like.
  • the instant messaging client A sends the changed tone voice to the instant messaging client B through the established tone voice call channel.
  • the instant messaging client A groups and packs the tone-modulated voice before transmitting the tone-tuned voice, obtains the tone-modulated voice data packet, and sends the voice-change voice data packet to the instant messaging client.
  • the tone is processed.
  • preset coding rules such as G.729, G.729A, G.723.1, etc.
  • the obtained tone-modulated speech corresponding to the original voice is compression-encoded.
  • the transcoding is obtained by using the channel coding technique.
  • the voice bit stream is subjected to redundancy enhancement processing.
  • the instant messaging client B sends a voice call request to the instant messaging client A
  • the implementation process is the same as above, and details are not described herein. It can be understood that the instant messaging client A and the instant messaging client B can perform a one-way voice call and a two-way tone voice call.
  • the above voice calls are based on an instant messaging system on a wired internet or wireless internet.
  • FIG. 3 is another detailed flowchart of the embodiment of the present invention.
  • the embodiment establishes a voice communication channel between the instant messaging client A and the instant messaging client B, and the instant messaging client A and the instant messaging client B.
  • the implementation process of the voice call method is as follows:
  • Instant messaging client A sends a voice call request to instant messaging client B.
  • the instant messaging client B After receiving the voice call request sent by the instant messaging client A, the instant messaging client B responds to the voice call request and returns the response message to the instant messaging client A. After receiving the voice call returned by the instant messaging client B, the instant messaging client A establishes a voice call channel with the instant messaging client B.
  • the voice call channel can be used for voice communication between the instant messaging client A and the instant messaging client B.
  • the instant messaging client A sends a tone-changing voice call request to the instant messaging client B. 4. After receiving the voice-tuned voice call request sent by the instant messaging client A, the instant messaging client B responds to the voice-tuned voice call request, and returns the response message to the instant messaging client A. After receiving the voice-changing voice call response returned by the instant messaging client B, the instant messaging client A establishes a tone-adjusted voice call channel with the instant messaging client B.
  • the previously established voice call channel can be released.
  • instant messaging client A can send a voice-tuned voice call request to instant messaging client B transparently or opaquely. If the instant messaging client A transparently sends a tone-changing voice call request to the instant messaging client B, the process does not need to be displayed on the instant messaging client B interface.
  • Instant messaging client A performs transposition processing on the original voice collected to obtain a tone-changing voice corresponding to the original voice.
  • the instant messaging client A sends the changed tone voice to the instant messaging client B through the established tone voice call channel.
  • a tone-tuned voice call channel is established between the instant messaging client A and the instant messaging client B.
  • the instant messaging client A receives the voice-changing voice call response returned by the instant messaging client B, it may not establish the relationship with the instant messaging client B.
  • the tone voice sent to the instant messaging client B is sent by using the voice call channel established in step 2 above with the instant messaging client B.
  • the operation of establishing a tone-tuned voice call channel in step 4 is omitted.
  • whether the bandwidth corresponding to the current voice call channel can be adapted to transmit the pitch-adjusted voice obtained in step 5 is used to determine that the voice call channel needs to be established.
  • the processing flow of the call data is the same as that in the normal voice call.
  • the processing flow is as shown in FIG. 4, and the details are as follows:
  • step S401 call data is received and unpacked
  • the packet call data is received through the established tone-tuned voice call channel, the data packet is unpacked according to the same network transmission protocol as the instant messaging client A, and the packet data is assembled to obtain a compressed code stream.
  • step S402 the unpacked data is decoded into a voice signal
  • the unpacked compressed code stream is decoded by the inverse operation of the instant messaging client A coding operation to obtain an original voice signal that can be recognized by the human ear.
  • step S403 a speech signal enhancement process
  • the signal enhancement processing may employ a Kalman filter method, a minimum mean square error estimation method for short-term spectral amplitude, or an adaptive filtering method.
  • step S404 the enhanced processed speech signal is output.
  • the processed speech signal output is enhanced by an output device such as a headphone, a speaker, a sound card, or the like.
  • the unpacked data is subjected to inverse redundancy/fault-tolerant processing, and the instant messaging client A is added to the compressed code stream. Redundant signals, modify or discard the erroneous data.
  • FIG. 5 is a basic flowchart of an apparatus according to an embodiment of the present invention.
  • the device may include a request sending unit 501, a voice collecting unit 502, and a tone modulation process.
  • the request sending unit 501 is configured to establish a tone-tuned voice call channel.
  • the voice collection unit 502 is configured to collect the input original voice information.
  • the pitch adjustment processing unit 503 is configured to perform pitch modulation processing on the original voice information collected by the voice collection unit 502 to obtain a tone-modulated voice.
  • the voice transmitting unit 504 transmits the tone-tuned voice obtained by the tone changing processing unit 503 by the tone-tuned voice call channel established by the request transmitting unit 501.
  • the voice communication device based on the instant messaging system provided by the embodiment of the present invention is implemented.
  • FIG. 6 is a detailed structural diagram of an apparatus according to an embodiment of the present invention. For convenience of description, only parts related to the embodiment of the present invention are shown.
  • the device can be used in various instant messaging client devices, such as computers, notebook computers, personal digital assistants (PDAs), smart phones, etc., and can be software units, hardware units or hardware and software running in these devices.
  • the combined unit may also be integrated into these devices or run in the application system of these devices as a separate pendant.
  • the device may include: a request sending unit 601, a voice collecting unit 602, a tone changing processing unit 603, and a voice. Transmitting unit 604.
  • the request sending unit 601 is configured to establish a tone-tuned voice call channel.
  • the voice collection unit 602 collects the input original voice information.
  • the pitch adjustment processing unit 603 performs a pitch adjustment process on the original voice information collected by the voice collection unit 602 to obtain a tone-modulated voice.
  • the voice sending unit 604 sends the tone-tuned voice obtained by the tone-modulating processing unit 603 by the tone-tuned voice call channel established by the requesting sending unit 601.
  • the request sending unit 601, the voice collecting unit 602, the tone adjusting processing unit 603, and the voice sending unit 604 may be on the same entity, such as the instant messaging client A, or may not be on the same entity, for example, the request sending unit 601.
  • the voice collection unit 602 is on the same entity as the instant messaging client A, and the tone modulation processing unit 603 and the voice sending unit 604 are on a preset tone changing processing device such as a server.
  • the specific situation requires specific analysis, which is not specifically limited in the embodiment of the present invention.
  • the request sending unit 601 establishes a tone-tuned voice call channel after receiving the tone-change voice call response; wherein the tone-change voice call response is a response to the tone-change voice call request sent by the request sending unit 601.
  • the request sending unit 601 is further configured to receive the voice-tuned voice call request information input by the user.
  • the voice collection unit 603 is also used to convert the collected voice information into digital voice information.
  • the converted digital voice information is recognized and processed by the computer.
  • the pitch adjustment processing unit 603 includes: a pitch adjustment information confirmation module 6031, a business logic module 6032, and a voice tone modulation processing module 6033.
  • the tone change information confirming module 6031 is configured to determine and output current tone change information, wherein the current tone change information includes user selection information, and/or authorization tone change information.
  • the business logic module 6032 is configured to generate service selection logic, wherein the service selection logic is used to perform voice tone modulation processing and output to the voice tone modulation processing module 6033.
  • the service selection logic is defined by the instant messaging service provider to clearly indicate what kind of tone-changing information, and what kind of voice-tuning voice service can be enjoyed by the voice communication environment (for example: "Male voice" is a tone-change voice service) Wait.
  • the voice tone processing module 6033 is configured to determine the voice tone modulation mode according to the received tone change information outputted from the tone change information receiving module 6031 and the service selection logic output by the service logic module 6032, and change the digital voice information obtained by the voice collection unit 602 according to the voice.
  • the method performs a pitch adjustment process to obtain a tone-modulated speech corresponding to the digital voice information and outputs the tone.
  • the voice tone processing module 6033 determines the voice tone modulation mode from the service selection logic according to the user selection information included in the tone change information and/or the authorized tone change information.
  • the implementation is as described above, and will not be described again.
  • the tone modulation processing unit 603 further includes: a user feature acquisition module 6034.
  • the user feature obtaining module 6034 is configured to extract personality feature information from the digital voice information obtained by the voice collecting unit 602, and generate and output the personality feature information.
  • the voice tone modulation processing module 6033 parses out the user selection information contained in the received current tone change information, and/or the authorized tone change information, and combines the received user personality feature information to determine the voice tone modulation mode by the service selection logic.
  • the tone adjustment processing unit 603 further includes: a counterpart environment acquisition module 6035.
  • the other party environment obtaining module 6035 is configured to acquire the voice environment information of the counterparty carried by the voice-switching voice call response received by the request sending unit 601.
  • the voice-switching voice call response returned by the caller includes the voice environment information
  • the request sending unit 601 generates the voice environment information of the partner according to the received voice environment information, and thus, the counterpart environment obtaining module 6035 acquires the request to send.
  • the device does not have to include the user feature acquisition module 6034 and the counterpart environment acquisition module 6035.
  • the embodiment may also include one or more of the user feature acquisition module 6034 and the counterpart environment acquisition module 6035.
  • the transposition processing unit 603 of FIG. 6 includes a user feature acquisition module 6034 and a counterpart environment acquisition module 6035 as an example.
  • the voice tone modulation processing module 6033 can use the service selection logic sent by the service logic module 6032, the current tone change information sent by the tone change information confirmation module 6031, and the user special The personalization feature information sent by the acquisition module 6034; or the service selection logic sent by the service logic module 6032, the current transposition information sent by the transposition information confirmation module 6031, and the counterpart speech environment information sent by the counterpart environment acquisition module 6035; or according to the business logic module
  • the service selection logic sent by the 6032, the current tone change information sent by the tone change information confirmation module 6031, the personality feature information sent by the user feature acquisition module 6034, and the counterpart voice environment information sent by the counterpart environment acquisition module 6035 determine the voice tone modulation mode.
  • the voice call device further includes: a denoising unit 605.
  • the denoising unit 605 receives the digital voice information obtained by the voice collecting unit 602, performs denoising processing, and obtains the denoised digital voice information.
  • the voice communication device further includes: a coding unit 606, and/or an optimization unit 607.
  • Figure 6 shows an example of a voice call device including an encoding unit 606 and an optimization unit 607.
  • the coding unit 606 compression-codes the pitch-modulated speech obtained by the pitch-modulation processing unit 603 to obtain a tone-modulated speech bit stream.
  • the optimizing unit 607 performs redundancy enhancement processing, and/or grouping and packing processing on the tone-modulated bit stream obtained by the encoding unit 606, and outputs the processed tone-modulated voice data to the voice transmitting unit 604.
  • the main purpose of the optimization unit 607 is to avoid signal distortion caused by packet loss, error, etc. during the transmission of the tone-modulated speech, or to facilitate transmission of the tuned speech.
  • the optimization unit may perform redundancy enhancement processing on the pitch-adjusted speech obtained by the transposition processing unit 603, and/or grouping and packing processing, and output the processed transposed speech data to the voice transmission. Unit 604.
  • the optimization unit 607 can include: The redundancy enhancement processing module 6071 performs redundancy enhancement processing on the tone-modulated bit stream obtained by the coding unit 606 or the tone-modulated speech obtained by the modulation processing unit 603 by using a channel coding technique, and outputs the processed tone-modulated voice bit stream.
  • the packet and packet module 6072 groups and receives the received tone voice data to obtain a tone-modulated voice data packet.
  • the packetizing and packing module 6072 can receive the pitch-modulated speech and the tuned speech bitstream output by the transcoding processing unit 603, the encoding unit 606, or the redundancy enhancement processing module 6071.
  • optimization unit 607 may include only the redundancy enhancement processing module 6071 or the grouping and packaging module 6072.
  • the voice communication device further includes:
  • the request answering unit 608 receives the voice-tuned voice call request sent by the request sending unit 601, and returns a voice-changing voice call response, generates voice receiving trigger information, and outputs the voice receiving trigger information to the voice receiving unit 609.
  • the voice receiving unit 609 after receiving the voice receiving trigger information output by the request response unit 608, if the currently received data packet is a packet processed or packetized, the data packet solution is performed according to the same network transmission protocol as the calling party.
  • the packet is assembled and the packet data is assembled to obtain a compressed code stream and output.
  • the decoding unit 610 decodes the data obtained by the voice receiving unit 609, that is, the compressed code stream, into a voice signal.
  • the speech signal enhancement processing unit 611 decodes the data obtained by the decoding unit 610, that is, decodes the speech signal, obtains the original speech signal, and performs signal enhancement processing to obtain the enhanced speech signal.
  • the voice output unit 612 outputs the obtained enhanced voice signal, which may be an earphone, a speaker, a sound card, or the like.
  • the voice call device further includes: an inverse redundancy/fault-tolerant processing unit 613.
  • the inverse redundancy/fault-tolerant processing unit 613 is configured to remove the redundant signal that the call partner obtained by the voice receiving unit 609 adds to the compressed code stream, and modify or discard the error data therein. In this way, the voice quality can be greatly improved.
  • the request response unit 608, the voice receiving unit 609, the decoding unit 610, the voice signal enhancement processing unit 611, the voice output unit 612, the inverse redundancy/fault-tolerant processing unit 613, and the entity in which the voice receiving unit 614 is removed are transmitted with the above request.
  • the unit 601, the voice collection unit 602, the tone adjustment processing unit 603, the voice sending unit 604, the denoising unit 605, the encoding unit 606, and the optimization unit 607 have different entities, for example, if the request sending unit 601, the voice collecting unit 602, The tone processing unit 603, the voice sending unit 604, the voice sending unit 604, the denoising unit 605, the encoding unit 606, and the optimizing unit 607, on the instant messaging client A, request the answering unit 608, the voice receiving unit 609, the decoding unit 610,
  • the voice signal enhancement processing unit 611, the voice output unit 612, the inverse redundancy/fault-tolerant processing unit 613, and the entity in which the voice removal unit 614 is removed may be the opposite end (receiver) of the instant messaging client A, such as the instant messaging client B.
  • the request sending unit 601 and the voice collecting unit 602 are on the same entity, such as the instant messaging client A, and the tone changing processing unit 603 and the voice sending unit 604 are on a preset tone changing processing device such as the server 1, the response unit 608 is requested.
  • the voice receiving unit 609, the decoding unit 610, the voice signal enhancement processing unit 611, the voice output unit 612, the inverse redundancy/fault-tolerant processing unit 613, and the entity in which the voice-removing unit 614 is removed may be the opposite end (receiver) of the server 1.
  • the instant messaging client is described. The foregoing is only an example and is not intended to limit the application of the embodiments of the present invention.
  • the voice signal collected in the instant messaging system is first spoken. Tone tone processing, realizes voice-changing voice call based on instant messaging system, brings great entertainment effect to voice communication based on instant messaging occasion, brings new value-added service growth point to traditional instant messaging service, increases user-to-instantaneous The dependence of communication products, thereby enhancing product competitiveness. And provide a new business experience for voice call users, for example: use variable tone voice calls to achieve the purpose of protecting user identity information.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Telephonic Communication Services (AREA)

Description

一种基于即时通讯系统的语音通话方法及装置
技术领域
本发明属于通信领域, 尤其涉及一种基于即时通讯系统的语音通话 方法及装置。 发明背景
随着即时通讯技术的发展,即时通讯系统除具备基本的即时通讯功 能外, 还具有其他诸多附加功能, 如语音通话功能。 使用即时通讯系统 进行语音通话已经成为一般社会大众所使用的沟通工具之一, 但是现有 的语音通话双方只能采用自己原来的声音进行通话, 不能改变通话者的 原始语音, 功能比较单一, 不能隐藏通话方的身份, 缺乏新颖性、 娱乐 性, 不能满足用户的个性化需求。
现在还没有基于即时通讯系统的变调语音通话方法。 发明内容
本发明实施例提供一种基于即时通讯系统的变调语音通话方法, 旨 在解决现在还没有基于即时通讯系统的变调语音通话方法的问题。
本发明实施例是这样实现的:
一种基于即时通讯系统的语音通话方法, 所述方法包括下述步骤: 建立至少两个即时通讯客户端之间的变调语音通话通道; 对输入的原始语音信息进行变调处理, 得到变调语音; 通过所述变 调语音通话通道将所述变调语音发送至即时通讯客户端 B。
本发明实施例的另一目的在于提供一种基于即时通讯系统的语音 通话装置, 所述装置包括: 请求发送单元, 用于建立变调语音通话通道;
语音采集单元, 用于采集输入的原始语音信息;
变调处理单元, 用于将所述语音采集单元采集的原始语音信息进行 变调处理, 得到变调语音;
语音发送单元, 用于通过所述请求发送单元建立的变调语音通话通 道发送所述变调处理单元得到的变调语音。
在本发明实施例中, 将即时通讯系统中采集到的语音信号先进行语 音变调处理, 实现了基于即时通讯系统的变调语音通话, 为基于即时通 讯场合下的语音通信带来极大的娱乐效果, 给传统即时通讯服务带来新 的增值服务增长点, 增加用户对即时通讯产品的依赖性, 从而提升产品 竟争力, 并且为语音通话用户提供崭新的业务体验。 附图简要说明
图 1为本发明实施例提供的方法的基本流程图;
图 2为本发明实施例提供的方法的详细流程图;
图 3为本发明实施例提供的方法的另一详细流程图;
图 4为本发明实施例提供的即时通讯客户端 B接收到即时通讯客户 端 A发送的变调语音通话数据的处理流程图;
图 5为本发明实施例提供的装置的基本结构图;
图 6为本发明实施例提供的装置的详细结构图。 实施本发明的方式
为使本发明的目的、技术方案和优点更加清楚明白,以下举实施例, 并参照附图, 对本发明进一步详细说明。
在本发明实施例中, 可以建立至少两个即时通讯客户端之间的变调 语音通话信道, 比如, 可以在即时通讯客户端八、 即时通信客户端 B以 及即时通讯客户端 C之间建立变调语音通话信道,本发明实施例为便于 描述,下述仅以在即时通讯客户端 A和即时通信客户端 B之间建立变调 语音通话信道为例, 其他情况类似, 这里不再赘述。 如此, 即时通讯客 户端 A向即时通讯客户端 B发送语音变调请求,并与即时通讯客户端 B 之间建立了变调语音通话通道后, 对采集的原始语音进行变调处理, 得 到与原始语音对应的变调语音, 并将该变调语音通过建立的变调语音通 话通道发送至即时通讯客户端 B, 从而实现即时通讯系统中各即时通讯 客户端之间的变调语音通话。
参见图 1 , 图 1为本发明实施例提供的基本流程图。 如图 1所示, 该实施例以即时通信客户端 A与即时通讯客户端 B之间建立变调语音通 话信道为例, 该流程可包括以下步骤:
步骤 S101 , 建立即时通讯客户端 A与即时通讯客户端 B之间的变 调语音通话通道。
步骤 S102, 对输入的原始语音信号进行变调处理, 得到变调语音。 步骤 S103,通过所述变调语音通话通道将所述变调语音发送至即时 通讯客户端 B。
需要说明的是,上述即时通讯客户端 A和即时通讯客户端 B具体实 现时可有多种实现形式, 比如可以为 web形式的终端, 或者为无线形式 的终端, 本发明实施例并不具体限定。
还需要说明的是, 上述步骤 S102和步骤 S103的操作可以由即时通 讯客户端 A执行, 比如, 即时通讯客户端 A直接将输入的原始语音信息 进行变调处理, 得到变调语音; 在变调语音通话通道上通过服务器中转 或者 P2P方式中转该变调语音至即时通讯客户端 B; 或者可以由预设的 变调处理设备比如服务器执行, 比如, 预设的服务器接收即时通讯客户 端 A发送的原始语音信息, 之后, 对该原始语音信息进行变调处理, 得 到变调语音; 通过所述变调语音通话通道将所述变调语音发送至即时通 讯客户端 具体如何实现, 本发明实施例并不具体限定。 为便于描述, 下述以在两个客户端之间执行语音通话操作为例。
如此, 实现了本发明实施例提供的基于即时通讯系统的语音通话基 本流程。
上述只是筒单描述了本发明实施例提供的流程, 下面结合具体实施 例对本发明实施例提供的方法进行详细描述。
参见图 2, 图 2为本发明实施例提供的详细流程图, 详述如下:
1、即时通讯客户端 A向即时通讯客户端 B发送变调语音通话请求。
2、 即时通讯客户端 B在接收到即时通讯客户端 A发送的变调语音 通话请求后, 对该变调语音通话请求作出应答, 并将应答信息返回至即 时通讯客户端 A。当即时通讯客户端 A接收到即时通讯客户端 B返回的 变调语音通话应答后, 建立与即时通讯客户端 B之间的变调语音通话通 道。
为了成功建立通话通道,即时通讯客户端 A和即时通讯客户端 B在 即时通讯服务器的协调下, 建立变调语音通话通道。 当然, 即时通讯客 户端 A可以透明或者非透明地向即时通讯客户端 B发送变调语音通话请 求。如果即时通讯客户端 A透明地向即时通讯客户端 B发送变调语音通 话请求, 此过程即时通讯客户端 B界面上不用显示。
3、 即时通讯客户端 A对采集的原始语音进行变调处理, 得到与原 始语音对应的变调语音。
在本发明实施例中,提供了多种语音变调方式,如改变语音的音调、 性别变声 (男声变女声、 女声变男声) 、 年龄变声 (青少年的声音变老 年人的声音) 、 将用户原始话音变为某著名人物的声音、 在用户声音上 加入背景声音(严格意义上, 在用户声音上加入背景声音并不属于语音 变调处理, 而属于混音技术, 但本发明所定义的变调语音通话包含此类 应用)等。
其中对采集的原始语音进行变调处理, 得到与原始语音对应的变调 语音的具体过程如下:
A、 采集用户输入的语音信息, 并将采集的语音信息处理成计算机 可以识别和处理的数字语音信息;
B、 对该数字语音信息进行变调处理, 得到与该数字语音信息对应 的变调语音。
在本实施例中,语音变调处理可以使用线性预测( Linear Prediction, LP )分析合成语音模型将数字语音信号分解为谱包络部分(由线性预测 编码( Linear predictive coding, LPC ) 系数表示 )和激励部分 (由 LPC 的残差表示); 然后在 LPC系数上提取共振峰频率和频谱倾斜参数, 再 通过矢量量化码书法来实现语音转换。 在转换函数的选择上, 频率包络 转换可以使用矢量量化法, 对韵律(主要是基音周期) 的转换可以使用 时域基音同步叠力口 ( time domain pitch synchronous overlap-add , TD-PSOLA ) 算法。
具体地, 在本实施例中, 语音变调处理操作中需要先确定当前要采 用的语音变调方式。 具体地, 确定当前要采用的语音变调方式的操作可 包括: 确定当前变调信息; 如此, 当前要采用的语音变调方式可根据当 前变调信息确定。 其中, 当前变调信息具体可包括用户选择信息, 和 / 或授权变调信息。 其中, 用户选择信息为用户在提供的语音变调方式中 所作出的选择; 而授权变调信息为变调方用户在即时通讯系统中授权的 变调信息。
优选地, 为了给传统即时通讯服务带来新的增值服务增长点, 即时 通讯服务提供商可以将语音变调或其中的部分语音变调方式作为增值 服务项目, 在本发明实施例中, 提供的语音变调方式由变调方用户在即 时通讯系统中的授权变调信息确定。在即时通讯客户端 A用户选择语音 变调方式前,用户通过即时通讯客户端 A向服务器发送用户的授权变调 方式查询信息, 服务器根据该用户在即时通讯系统中的身份标识返回授 权变调信息, 即该用户可使用的语音变调方式。 优选地, 即时通讯客户 端 A还根据服务器返回的授权变调信息输入用户选择信息,从而根据用 户选择信息和服务器返回的授权变调信息确定可使用的语音变调方式。 当然, 本实施例也可以根据用户选择信息、 授权变调信息, 用其他的业 务选择逻辑确定变调方式; 当用户只有一种可使用的语音变调方式时, 可以只由授权变调信息确定变调方式。
由于语音变调处理是以用户的原始语音信号作为基础的, 为了向用 户提供更合适的语音变调方式以保证变调后的声音能被通信对方所辨 识, 作用本发明的另一个优选实施例, 对原始语音进行变调处理的语音 变调方式还要考虑用户个性特征信息, 即主要是用户原始话音中的音段 特征。 此时, 变调方式, 根据用户选择信息及用户个性特征信息, 或者 用户选择信息、 授权变调信息及用户个性特征信息, 由业务选择逻辑确 定。 其中, 该业务选择逻辑为即时通讯服务提供商所定义, 以明确指出 何等的授权变调信息、 怎样的语音通信环境可以享受多少项变调语音服 务(例如: "男声变女声" 为一项变调语音服务)等, 其用于确定语音 变调方式。
在客户端 A接收到用户选择信息后,对用户的原始语音信号进行分 析, 得到其个性特征信息, 当其个性特征信息无法满足语音变调处理的 要求时, 需要对用户的语音变调方式请求进行修正, 例如: 某用户原始 声音较粗且嘶哑, 而其选择的语音变调方式为 "低龄儿童" , 此时的变 调效果会^艮差 (不易为对方识别为 "童音" ) , 于是系统应建议用户重 新选择语音变调方式。
为了提高通话接收方所听到的话音质量, 向用户提供更合适的语音 变调方式, 作为本发明的又一个优选实施例, 语音变调方式确认还要考 虑对方语音环境信息。 此时, 变调方式, 根据用户选择信息及对方语音 环境信息, 或者用户选择信息、 授权变调信息及对方语音环境信息, 由 业务选择逻辑确定。即时通讯客户端 Β向即时通讯客户端 Α返回变调语 音通话请求应答时, 同时返回其自身的语音环境信息。 该语音环境信息 可以由即时通讯客户端 B用户选择,或者由即时通讯客户端 B根据麦克 风采集到的声音信号分析得到等等。
在本发明实施例中, 即时通讯客户端 A的语音变调方式可以由授权 变调信息、 用户个性特征信息、 对方语音环境信息等信息的一个或任意 组合及用户选择信息, 由业务选择逻辑确定。
在本发明实施例中, 由于采集的语音信息中可能包含回音、 噪声等 不利于处理、 传输和辨别的信号, 因此, 为了达到较好的变调语音通话 效果, 改善通话接收方所听到的话音质量, 在对该数字语音信息进行语 音变调处理之前, 对数字语音信息进行去噪处理, 即进行回音抵消、 噪 声抑制、 信号增益调节等一种或者多种组合的处理。
4、 即时通讯客户端 A将得到的变调语音通过已经建立的变调语音 通话通道发送至即时通讯客户端 B。
在本发明实施例中, 为了便于传输变调语音, 即时通讯客户端 A在 发送变调语音前, 对变调语音进行分组、 打包处理, 得到变调语音数据 包, 并将变调语音数据包发送至即时通讯客户端^
在本发明实施例中, 为了降低变调语音数据传输所需要的带宽, 为 实时变调语音通话创造条件, 在对采集的原始语音进行变调处理后, 按 照预设的编码规则, 例如 G.729、 G.729A、 G.723.1等, 将得到的与原始 语音对应的变调语音进行压缩编码。
在本发明实施例中, 为了避免变调语音在网络传输过程中由于丟 包、 差错等原因造成的信号失真, 在对变调语音进行压缩编码后, 再利 用信道编码技术, 对压缩编码后得到的变调语音比特流进行冗余增强处 理。
当即时通讯客户端 B向即时通讯客户端 A发送变调语音通话请求 时, 其实现流程同上, 在此不再赘述。 可以理解, 即时通讯客户端 A和 即时通讯客户端 B可以进行单向变调语音通话, 也可以进行双向变调语 音通话。 上述语音通话基于有线互联网络或无线互联网络上的即时通讯 系统。
如果通讯即时通讯客户端 A或者即时通讯客户端 B中的任意一方提 出中断请求、 网络发生故障等时, 通话结束, 释放变调语音通话通道。
图 3为本发明实施例提供的另一详细流程图, 该实施例为即时通讯 客户端 A与即时通讯客户端 B之间建立语音通信通道,并在即时通讯客 户端 A与即时通讯客户端 B之间进行语音通话方法的实现流程,详述如 下:
1、 即时通讯客户端 A向即时通讯客户端 B发送语音通话请求。
2、 即时通讯客户端 B在接收到即时通讯客户端 A发送的语音通话 请求后, 对该语音通话请求作出应答, 并将应答信息返回至即时通讯客 户端 A。即时通讯客户端 A接收到即时通讯客户端 B返回的语音通话应 答后, 建立与即时通讯客户端 B之间的语音通话通道。
语音通话通道后,即时通讯客户端 A和即时通讯客户端 B之间可以 使用该语音通话通道进行语音通话。
3、即时通讯客户端 A向即时通讯客户端 B发送变调语音通话请求。 4、 即时通讯客户端 B在接收到即时通讯客户端 A发送的变调语音 通话请求后, 对该变调语音通话请求作出应答, 并将应答信息返回至即 时通讯客户端 A。即时通讯客户端 A接收到即时通讯客户端 B返回的变 调语音通话应答后,建立与即时通讯客户端 B之间的变调语音通话通道。
变调语音通话通道建立后, 可以释放先前建立的语音通话通道。 当 然,即时通讯客户端 A可以透明或者非透明地向即时通讯客户端 B发送 变调语音通话请求。如果即时通讯客户端 A透明地向即时通讯客户端 B 发送变调语音通话请求, 此过程即时通讯客户端 B界面上不用显示。
5、 即时通讯客户端 A对采集的原始语音进行变调处理, 得到与原 始语音对应的变调语音。
6、 即时通讯客户端 A将得到的变调语音通过已经建立的变调语音 通话通道发送至即时通讯客户端 B。
需要说明的是,本实施例是以在即时通讯客户端 A和即时通讯客户 端 B之间建立语音通话通道之后,再在即时通讯客户端 A和即时通讯客 户端 B之间建立变调语音通话通道为例。 为使本实施例更加筒单, 并且 容易实现,本实施例中, 即时通讯客户端 A接收到即时通讯客户端 B返 回的变调语音通话应答后,也可不建立与即时通讯客户端 B之间的变调 语音通话通道, 而是利用上述步骤 2中建立的与即时通讯客户端 B之间 的语音通话通道将得到的变调语音发送至即时通讯客户端 B。 这样, 省 略了步骤 4中建立变调语音通话通道的操作。 优选地, 本实施例中可以 当前的语音通话通道对应的带宽是否能够适合传输步骤 5中得到的变调 语音为原则来判断当前需不需要建立调语音通话通道。
7、 通话结束, 释放变调语音通话通道。
如果通讯即时通讯客户端 A或者即时通讯客户端 B中的任意一方提 出中断请求、 网络发生故障等时, 通话结束, 释放变调语音通话通道。 其中,即时通讯客户端 B接收到即时通讯客户端 A发送的变调语音 通话数据后, 对通话数据的处理流程与普通语音通话中的处理流程相 同, 处理流程如图 4所示, 详述如下:
在步骤 S401中, 通话数据接收、 解包;
通过已经建立的变调语音通话通道接收分组通话数据, 按照与即时 通讯客户端 A相同的网络传输协议进行数据包解包, 并将分组数据组 装, 得到压缩码流。
在步骤 S402中, 将解包后的数据解码为语音信号;
将解包后的压缩码流采用即时通讯客户端 A 编码运算的逆运算进 行解码, 得到可被人耳识别的原始语音信号。
在步骤 S403中, 语音信号增强处理;
由于网络传输、 语音信号压缩和语音变调处理等都可能造成信号的 失真, 需要对解码得到的原始语音信号进行信号增强处理。 信号增强处 理可以采用卡尔曼滤波法、 短时谱幅度的最小均方误差估计法、 或者自 适应滤波法等。
在步骤 S404中, 输出增强处理后的语音信号。
通过输出设备, 例如耳机、 音箱、 声卡等将增强处理后的语音信号 输出。
为了得到可正确解码的语音比特流, 在本发明实施例中, 在数据接 收、 组包后, 将解包后的数据进行逆冗余 /容错处理, 去除即时通讯客户 端 A加入压缩码流中的冗余信号, 修改或者丟弃其中的错误数据。
上述对本发明实施例提供的方法进行了详述, 下面对本发明实施例 提供的装置进行描述。
参见图 5 , 图 5为本发明实施例提供的装置的基本流程图。 如图 5 所示, 该装置可包括请求发送单元 501、 语音采集单元 502、 变调处理 单元 503和语音发送单元 504。
其中, 请求发送单元 501用于建立变调语音通话通道。
语音采集单元 502用于采集输入的原始语音信息。
变调处理单元 503用于将语音采集单元 502采集的原始语音信息进 行变调处理, 得到变调语音。
语音发送单元 504通过请求发送单元 501建立的变调语音通话通道 发送变调处理单元 503得到的变调语音。
如此, 实现了本发明实施例提供的基于即时通讯系统的语音通话装 置。
为使本发明实施例提供的基于即时通讯系统的语音通话装置更加 清晰, 下面详述本发明实施例提供的装置结构。
参见图 6, 图 6为本发明实施例提供的装置的详细结构图, 为了便 于说明, 仅示出了与本发明实施例相关的部分。
该装置可以用于各种即时通讯客户端设备, 例如计算机、 笔记本电 脑、 个人数字助理(Personal Digital Assistant, PDA )、 智能手机等, 可 以是运行于这些设备内的软件单元、 硬件单元或者软硬件相结合的单 元, 也可以作为独立的挂件集成到这些设备中或者运行于这些设备的应 用系统中, 具体地, 该装置可包括: 请求发送单元 601、 语音采集单元 602、 变调处理单元 603和语音发送单元 604。
其中, 请求发送单元 601用于建立变调语音通话通道。
语音采集单元 602采集输入的原始语音信息。
变调处理单元 603将语音采集单元 602采集得到的原始语音信息进 行变调处理, 得到变调语音。
语音发送单元 604, 通过请求发送单元 601建立的变调语音通话通 道发送变调处理单元 603得到的变调语音。 需要说明的是, 请求发送单元 601、 语音采集单元 602、 变调处理 单元 603 和语音发送单元 604可在同一个实体比如即时通讯客户端 A 上,也可不在同一实体上, 比如,请求发送单元 601和语音采集单元 602 在同一实体比如即时通讯客户端 A上,而变调处理单元 603和语音发送 单元 604在预设的变调处理设备比如服务器上。具体情况需要具体分析, 本发明实施例并不具体限定。
具体地, 请求发送单元 601在接收到变调语音通话应答后, 建立变 调语音通话通道;其中,所述变调语音通话应答是针对请求发送单元 601 发送的变调语音通话请求所作出的应答。本实施例中,请求发送单元 601 还可用于接收用户输入的变调语音通话请求信息。
语音采集单元 603 还用于将采集到的语音信息转化为数字语音信 息。 其中, 转化后的数字语音信息为计算机可以识别和处理的。
在本发明实施例中, 变调处理单元 603 包括: 变调信息确认模块 6031、 业务逻辑模块 6032和语音变调处理模块 6033。
其中, 变调信息确认模块 6031 用于确定并输出当前变调信息, 其 中, 当前变调信息包含用户选择信息, 和 /或授权变调信息。
业务逻辑模块 6032用于生成业务选择逻辑, 其中, 该业务选择逻 辑用于执行语音变调处理, 并输出给语音变调处理模块 6033。 这里, 业 务选择逻辑由即时通讯服务提供商所定义, 以明确指出何等的授权变调 信息、 怎样的语音通信环境可以享受多少项变调语音服务(例如: "男 声变女声" 为一项变调语音服务)等。
语音变调处理模块 6033 , 用于根据接收的来自变调信息接收模块 6031输出的变调信息和业务逻辑模块 6032输出的业务选择逻辑来确定 语音变调方式, 将语音采集单元 602得到的数字语音信息按照语音变调 方式进行变调处理, 得到与该数字语音信息对应的变调语音并输出。 具 体地, 语音变调处理模块 6033根据变调信息中包含的用户选择信息, 和 /或授权变调信息, 由业务选择逻辑确定语音变调方式。 实现方式如上 所述, 不再赘述。
为了向用户提供更合适的语音变调方式以保证变调后的声音能被 通信对方所辨识, 作用本发明的一个优选实施例, 变调处理单元 603还 包括: 用户特征获取模块 6034。
其中, 用户特征获取模块 6034用于从语音采集单元 602得到的该 数字语音信息中提取个性特征信息, 生成并输出该个性特征信息。
如此, 语音变调处理模块 6033 解析出接收到的当前变调信息中包 含的用户选择信息, 和 /或授权变调信息, 结合接收到的用户个性特征信 息, 由业务选择逻辑确定语音变调方式。
为了提高通话接收方所听到的话音质量, 向用户提供更合适的语音 变调方式,作为本发明的另一个优选实施例,变调处理单元 603还包括: 对方环境获取模块 6035。
其中, 对方环境获取模块 6035用于获取请求发送单元 601接收的 变调语音通话应答所携带的对方语音环境信息。 在本实施例中, 通话对 方返回的变调语音通话应答中包含有语音环境信息, 请求发送单元 601 根据接收到语音环境信息生成对方语音环境信息, 如此, 具体地, 对方 环境获取模块 6035获取请求发送单元 601生成的对方语音环境信息。
这里, 本装置并非必须包含用户特征获取模块 6034和对方环境获 取模块 6035; 优选地, 本实施例也可包含用户特征获取模块 6034和对 方环境获取模块 6035中的一个或者多个。 图 6以变调处理单元 603包 含用户特征获取模块 6034和对方环境获取模块 6035为例。
如此, 语音变调处理模块 6033可以根据业务逻辑模块 6032发送的 业务选择逻辑、 变调信息确认模块 6031 发送的当前变调信息和用户特 征获取模块 6034发送的个性特征信息; 或者根据业务逻辑模块 6032发 送的业务选择逻辑、 变调信息确认模块 6031 发送的当前变调信息和对 方环境获取模块 6035发送的对方语音环境信息; 或者根据业务逻辑模 块 6032发送的业务选择逻辑、 变调信息确认模块 6031发送的当前变调 信息、 用户特征获取模块 6034发送的个性特征信息和对方环境获取模 块 6035发送的对方语音环境信息来确定语音变调方式。
为了达到较好的变调语音通话效果, 改善通话接收方所听到的话音 质量, 作为本发明的再一优选实施例, 语音通话装置还包括: 去噪单元 605。
其中, 去噪单元 605接收语音采集单元 602得到的数字语音信息, 进行去噪处理, 得到去噪后的数字语音信息。
为了降低变调语音数据传输所需要的带宽, 为实时变调语音通话创 造条件, 作为本发明的再一优选实施例, 语音通话装置还包括: 编码单 元 606, 和 /或优化单元 607。 图 6以语音通话装置包括编码单元 606和 优化单元 607为例。
编码单元 606将变调处理单元 603得到的变调语音进行压缩编码, 得到的变调语音比特流。
优化单元 607, 将编码单元 606得到的变调语音比特流进行冗余增 强处理, 和 /或分组、 打包处理, 并将处理后的变调语音数据输出给语音 发送单元 604。 这里, 优化单元 607主要目的是为了避免变调语音在网 络传输过程中由于丟包、 差错等原因造成的信号失真, 或者便于传输变 调语音。 当然, 若本装置不包括编码单元 606, 则优化单元可将变调处 理单元 603得到的变调语音进行冗余增强处理, 和 /或分组、 打包处理, 并将处理后的变调语音数据输出给语音发送单元 604。
如图 6所示, 在本实施例中, 优化单元 607可包括: 冗余增强处理模块 6071 , 利用信道编码技术, 对编码单元 606得到 的变调语音比特流或者变调处理单元 603得到的变调语音进行冗余增强 处理, 输出处理后的变调语音比特流。
分组、 打包模块 6072, 将接收到的变调语音数据进行分组、 打包处 理, 得到变调语音数据包。 分组、 打包模块 6072可以接收变调处理单 元 603、 编码单元 606或者冗余增强处理模块 6071输出的变调语音、 变 调语音比特流。
需要说明的是, 优化单元 607 可以只包括冗余增强处理模块 6071 或者分组、 打包模块 6072。
如图 6所示, 为了使语音通话装置能够接收处理语音信息, 作为本 发明的再一优选实施例, 语音通话装置还包括:
请求应答单元 608, 接收请求发送单元 601发送的变调语音通话请 求, 并返回变调语音通话应答, 生成语音接收触发信息并输出给语音接 收单元 609。
语音接收单元 609, 接收到请求应答单元 608输出的语音接收触发 信息后, 若当前接收的数据包为经过分组或者打包处理后的数据包, 则 按照与通话对方相同的网络传输协议进行数据包解包, 并将分组数据组 装, 得到压缩码流并输出。
解码单元 610, 将语音接收单元 609得到的数据, 即压缩码流, 解 码为语音信号。
语音信号增强处理单元 611 , 将解码单元 610得到的数据解码, 即 将语音信号解码, 得到原始语音信号并进行信号增强处理, 得到增强处 理后的语音信号。
语音输出单元 612, 将得到的增强处理后的语音信号输出, 可以为 耳机、 音箱、 声卡等。 在本发明实施例中, 若语音接收单元 609当前接收的数据包为加入 了压缩码流的冗余信号, 则语音通话装置还包括: 逆冗余 /容错处理单元 613。
其中, 逆冗余 /容错处理单元 613 , 用于去除语音接收单元 609得到 的通话对方加入压缩码流中的冗余信号, 并修改或丟弃其中的错误数 据。 如此, 可大大改善话音质量。
优选地, 请求应答单元 608、 语音接收单元 609、 解码单元 610、 语 音信号增强处理单元 611、语音输出单元 612、逆冗余 /容错处理单元 613 和去除语音接收单元 614所在的实体与上述请求发送单元 601、 语音采 集单元 602、 变调处理单元 603、 语音发送单元 604、 去噪单元 605、 编 码单元 606和优化单元 607各个单元所在的实体不同, 比如, 若请求发 送单元 601、语音采集单元 602、 变调处理单元 603、语音发送单元 604、 语音发送单元 604、 去噪单元 605、 编码单元 606和优化单元 607在即 时通讯客户端 A上, 则请求应答单元 608、 语音接收单元 609、 解码单 元 610、 语音信号增强处理单元 611、 语音输出单元 612、 逆冗余 /容错 处理单元 613和去除语音接收单元 614所在的实体可为即时通讯客户端 A的对端 (接收端) , 比如即时通讯客户端 B。 当然, 若请求发送单元 601、 语音采集单元 602在同一实体比如即时通讯客户端 A上, 而变调 处理单元 603和语音发送单元 604在预设的变调处理设备比如服务器 1 上, 则请求应答单元 608、 语音接收单元 609、 解码单元 610、 语音信号 增强处理单元 611、 语音输出单元 612、 逆冗余 /容错处理单元 613和去 除语音接收单元 614所在的实体可为服务器 1的对端(接收端) , 比如 即时通讯客户端^ 需要说明的是, 上述只是一种举例, 并非限定本发 明实施例的应用。
在本发明实施例中, 将即时通讯系统中采集到的语音信号先进行语 音变调处理, 实现了基于即时通讯系统的变调语音通话, 为基于即时通 讯场合下的语音通信带来极大的娱乐效果, 给传统即时通讯服务带来新 的增值服务增长点, 增加用户对即时通讯产品的依赖性, 从而提升产品 竟争力。 并且为语音通话用户提供崭新的业务体验, 例如: 用变调语音 通话来达到保护用户身份信息的目的。
以上所述仅为本发明的较佳实施例而已, 并不用以限制本发明, 凡 在本发明的精神和原则之内所作的任何修改、 等同替换和改进等, 均应 包含在本发明的保护范围之内。

Claims

权利要求书
1、 一种基于即时通讯系统的语音通话方法, 其特征在于, 所述方 法包括下述步骤:
步骤 a, 建立至少两个即时通讯客户端之间的变调语音通话通道; 步骤 b, 对输入的原始语音信息进行变调处理, 得到变调语音; 通 过所述变调语音通话通道将所述变调语音发送至即时通讯客户端 B。
2、 如权利要求 1所述的方法, 其特征在于, 所述步骤 b的操作是 由即时通讯客户端 A或者预设的变调处理设备执行的, 其中, 即时通讯 客户端 A为所述步骤 a中已建立了所述变调语音通话通道的其中一个即 时通讯客户端。
3、 如权利要求 2所述的方法, 其特征在于, 所述步骤 a的操作是 在即时通讯客户端 A接收到所述即时通讯客户端 B发送的变调语音通话 应答后执行的, 其中, 变调语音通话应答是针对即时通讯客户端 A发送 的变调语音通话请求所作出的应答; 或者,
所述步骤 a中的变调语音通话通道为即时通讯客户端 A接收到即时 通讯客户端 B返回的语音通话应答后,建立的与即时通讯客户端 B之间 的语音通话通道; 其中, 所述语音通话应答为针对所述即时通讯客户端 A向即时通讯客户端 B发送语音通话请求的应答。
4、 如权利要求 1所述的方法, 其特征在于, 所述步骤 b中对输入 的原始语音信号进行变调处理包括:
采集输入的原始语音信息, 将该采集到的原始语音信息转化成数字 语音信息; 对所述数字语音信息进行变调处理。
5、 如权利要求 1至 4任一所述的方法, 其特征在于, 所述变调处 理包括: 确定语音变调方式;
根据确定出的语音变调方式执行变调处理。
6、 如权利要求 5 所述的方法, 其特征在于, 在确定语音变调方式 之前, 进一步包括: 确定当前变调信息和用于确定语音变调方式的业务 选择逻辑;
所述语音变调方式由所述业务选择逻辑根据所述当前变调信息确 定。
7、 如权利要求 6所述的方法, 其特征在于, 所述确定语音变调方 式之前, 进一步包括: 获取输入的原始语音信息对应的个性特征信息; 所述语音变调方式由所述业务选择逻辑根据获取的个性特征信息 和 /或所述当前变调信息确定。
8、 如权利要求 7 所述的方法, 其特征在于, 所述变调语音通话应 答中携带了即时通讯客户端 B的语音环境信息;
所述确定语音变调方式由所述业务选择逻辑根据所述语音环境信 息、 所述当前变调信息和所述个性特征信息中的一个或者任意一种组合 确定。
9、 如权利要求 4所述的方法, 其特征在于, 在所述数字语音信息 进行语音变调处理之前, 进一步包括:
对所述数字语音信息进行去噪处理。
10、 如权利要求 1所述的方法, 其特征在于, 在所述通过变调语音 通话通道将所述变调语音发送至即时通讯客户端 B之前, 进一步包括: 对所述变调语音进行压缩编码和 /或冗余增强处理;
和 /或,
对变调语音进行分组、 打包处理。
11、 一种基于即时通讯系统的语音通话装置, 其特征在于, 所述装 置包括:
请求发送单元, 用于建立变调语音通话通道;
语音采集单元, 用于采集输入的原始语音信息;
变调处理单元, 用于将所述语音采集单元采集的原始语音信息进行 变调处理, 得到变调语音;
语音发送单元, 用于通过所述请求发送单元建立的变调语音通话通 道发送所述变调处理单元得到的变调语音。
12、 如权利要求 11 所述的语音通话装置, 其特征在于, 所述语音 采集单元还用于将采集到的语音信息转化为数字语音信息;
所述变调处理单元包括:
变调信息确认模块, 用于确定并输出当前变调信息;
业务逻辑模块, 用于生成并输出供语音变调处理模块执行语音变调 处理的业务选择逻辑;
语音变调处理模块, 用于根据接收的所述变调信息确认模块输出的 当前变调信息和业务逻辑模块输出的业务选择逻辑来确定语音变调方 式, 将所述语音采集单元得到的数字语音信息按照所述语音变调方式进 行变调处理, 得到与所述数字语音信息对应的变调语音并输出。
13、 如权利要求 12所述的语音通话装置, 其特征在于, 所述变调 处理单元还包括: 用户特征获取模块, 和 /或对方环境获取模块; 其中, 所述用户特征获取模块用于从所述语音采集单元得到的该数字语 音信息中提取个性特征信息, 生成并输出个性特征信息;
对方环境获取模块, 用于获取并输出所述请求发送单元接收的变调 语音通话应答所携带的对方语音环境信息;
所述语音变调处理模块根据所述业务选择逻辑、 所述当前变调信息 和所述个性特征信息; 或者所述业务选择逻辑、 所述当前变调信息和所 述对方语音环境信息; 或者所述业务选择逻辑、 所述当前变调信息、 所 述个性特征信息和所述对方语音环境信息来确定语音变调方式。
14、 如权利要求 12所述的语音通话装置, 其特征在于, 该装置还 包括:
去噪单元, 接收所述语音采集单元得到的数字语音信息, 进行去噪 处理, 得到去噪后的数字语音信息;
该装置还包括: 编码单元和 /或优化单元; 其中,
所述编码单元用于将所述变调处理单元得到的变调语音进行压缩 编码, 得到变调语音比特流;
所述优化单元将所述变调处理单元得到的变调语音或者所述编码 单元得到的变调语音比特流进行冗余增强处理, 和 /或分组、 打包处理, 并将处理后的变调语音数据输出给所述语音发送单元。
PCT/CN2009/071931 2008-06-30 2009-05-22 一种基于即时通讯系统的语音通话方法及装置 Ceased WO2010000161A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/913,358 US20110044324A1 (en) 2008-06-30 2010-10-27 Method and Apparatus for Voice Communication Based on Instant Messaging System

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CNA2008100682626A CN101304391A (zh) 2008-06-30 2008-06-30 一种基于即时通讯系统的语音通话方法及系统
CN200810068262.6 2008-06-30

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US12/913,358 Continuation US20110044324A1 (en) 2008-06-30 2010-10-27 Method and Apparatus for Voice Communication Based on Instant Messaging System

Publications (1)

Publication Number Publication Date
WO2010000161A1 true WO2010000161A1 (zh) 2010-01-07

Family

ID=40114104

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2009/071931 Ceased WO2010000161A1 (zh) 2008-06-30 2009-05-22 一种基于即时通讯系统的语音通话方法及装置

Country Status (3)

Country Link
US (1) US20110044324A1 (zh)
CN (1) CN101304391A (zh)
WO (1) WO2010000161A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109272984A (zh) * 2018-10-17 2019-01-25 百度在线网络技术(北京)有限公司 用于语音交互的方法和装置

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101304391A (zh) * 2008-06-30 2008-11-12 腾讯科技(深圳)有限公司 一种基于即时通讯系统的语音通话方法及系统
US9838784B2 (en) 2009-12-02 2017-12-05 Knowles Electronics, Llc Directional audio capture
US8798290B1 (en) 2010-04-21 2014-08-05 Audience, Inc. Systems and methods for adaptive signal equalization
CN101888607A (zh) * 2010-07-15 2010-11-17 中兴通讯股份有限公司 基于widget实现手机聊天的方法及手机
US9021565B2 (en) * 2011-10-13 2015-04-28 At&T Intellectual Property I, L.P. Authentication techniques utilizing a computing device
CN104144097B (zh) * 2013-05-07 2018-09-07 北京音之邦文化科技有限公司 语音消息传输系统、发送端、接收端及语音消息传输方法
US9536540B2 (en) 2013-07-19 2017-01-03 Knowles Electronics, Llc Speech signal separation and synthesis based on auditory scene analysis and speech modeling
CN104376846A (zh) * 2013-08-16 2015-02-25 联想(北京)有限公司 一种语音调节方法、装置和电子设备
CN104780091B (zh) * 2014-01-13 2019-06-25 北京发现角科技有限公司 一种具有语音音频处理功能的即时通信方法和系统
CN104980396A (zh) * 2014-04-03 2015-10-14 北京千橡网景科技发展有限公司 一种用于社交网络的通信方法及系统
CN105208056B (zh) * 2014-06-18 2020-07-07 腾讯科技(深圳)有限公司 信息交互的方法及终端
CN104200824B (zh) * 2014-08-25 2019-05-03 努比亚技术有限公司 音频录制方法和装置
WO2016040885A1 (en) 2014-09-12 2016-03-17 Audience, Inc. Systems and methods for restoration of speech components
US20160093307A1 (en) * 2014-09-25 2016-03-31 Audience, Inc. Latency Reduction
CN107210824A (zh) 2015-01-30 2017-09-26 美商楼氏电子有限公司 麦克风的环境切换
CN106506437B (zh) * 2015-09-07 2021-03-16 腾讯科技(深圳)有限公司 一种音频数据处理方法,及设备
CN105304092A (zh) * 2015-09-18 2016-02-03 深圳市海派通讯科技有限公司 一种基于智能终端的实时变声方法
US9820042B1 (en) 2016-05-02 2017-11-14 Knowles Electronics, Llc Stereo separation and directional suppression with omni-directional microphones
CN106161218A (zh) * 2016-09-28 2016-11-23 乐视控股(北京)有限公司 实时通话中的语音处理方法及装置
CN106406809B (zh) * 2016-12-21 2023-06-23 维沃移动通信有限公司 一种声音信号处理方法及移动终端
CN107731241B (zh) * 2017-09-29 2021-05-07 广州酷狗计算机科技有限公司 处理音频信号的方法、装置和存储介质
CN111194545A (zh) * 2017-10-09 2020-05-22 深圳传音通讯有限公司 一种移动通讯设备通话时改变原始声音的方法和系统
CN108417223A (zh) * 2017-12-29 2018-08-17 申子涵 在社交网络中发送变调语音的方法
CN109404685B (zh) * 2018-09-12 2022-04-08 乐歌人体工学科技股份有限公司 增高台
US11943621B2 (en) * 2018-12-11 2024-03-26 Texas Instruments Incorporated Secure localization in wireless networks
CN111339442A (zh) * 2020-02-25 2020-06-26 北京声智科技有限公司 线上好友互动方法及装置
KR102548618B1 (ko) * 2021-01-25 2023-06-27 박상래 음성인식 및 음성합성을 이용한 무선통신장치
US12469509B2 (en) * 2023-04-04 2025-11-11 Meta Platforms Technologies, Llc Voice avatars in extended reality environments

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050043951A1 (en) * 2002-07-09 2005-02-24 Schurter Eugene Terry Voice instant messaging system
CN1719514A (zh) * 2004-07-06 2006-01-11 中国科学院自动化研究所 基于语音分析与合成的高品质实时变声方法
CN1805478A (zh) * 2005-01-14 2006-07-19 华为技术有限公司 一种实现通话中变声的系统及方法
CN101304391A (zh) * 2008-06-30 2008-11-12 腾讯科技(深圳)有限公司 一种基于即时通讯系统的语音通话方法及系统

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW430778B (en) * 1998-06-15 2001-04-21 Yamaha Corp Voice converter with extraction and modification of attribute data
US7333507B2 (en) * 2001-08-31 2008-02-19 Philip Bravin Multi modal communications system
JP2005115896A (ja) * 2003-10-10 2005-04-28 Nec Corp 通信装置及び通信方法
WO2005116992A1 (en) * 2004-05-27 2005-12-08 Koninklijke Philips Electronics N.V. Method of and system for modifying messages
WO2006080149A1 (ja) * 2005-01-25 2006-08-03 Matsushita Electric Industrial Co., Ltd. 音復元装置および音復元方法
US20060257827A1 (en) * 2005-05-12 2006-11-16 Blinktwice, Llc Method and apparatus to individualize content in an augmentative and alternative communication device
US20060116142A1 (en) * 2006-02-07 2006-06-01 Media Lab Europe (In Voluntary Liquidation) Well Behaved SMS notifications
US7983910B2 (en) * 2006-03-03 2011-07-19 International Business Machines Corporation Communicating across voice and text channels with emotion preservation
CN101046956A (zh) * 2006-03-28 2007-10-03 国际商业机器公司 交互式音效产生方法及系统
CN101175102B (zh) * 2006-11-01 2013-01-09 鸿富锦精密工业(深圳)有限公司 具有音频调变功能的通讯装置及其音频调变的方法
JP5275612B2 (ja) * 2007-07-18 2013-08-28 国立大学法人 和歌山大学 周期信号処理方法、周期信号変換方法および周期信号処理装置ならびに周期信号の分析方法
JP2009122776A (ja) * 2007-11-12 2009-06-04 Internatl Business Mach Corp <Ibm> 仮想世界における情報制御方法および装置
US8977779B2 (en) * 2009-03-31 2015-03-10 Mytalk Llc Augmentative and alternative communication system with personalized user interface and content

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050043951A1 (en) * 2002-07-09 2005-02-24 Schurter Eugene Terry Voice instant messaging system
CN1719514A (zh) * 2004-07-06 2006-01-11 中国科学院自动化研究所 基于语音分析与合成的高品质实时变声方法
CN1805478A (zh) * 2005-01-14 2006-07-19 华为技术有限公司 一种实现通话中变声的系统及方法
CN101304391A (zh) * 2008-06-30 2008-11-12 腾讯科技(深圳)有限公司 一种基于即时通讯系统的语音通话方法及系统

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109272984A (zh) * 2018-10-17 2019-01-25 百度在线网络技术(北京)有限公司 用于语音交互的方法和装置

Also Published As

Publication number Publication date
CN101304391A (zh) 2008-11-12
US20110044324A1 (en) 2011-02-24

Similar Documents

Publication Publication Date Title
WO2010000161A1 (zh) 一种基于即时通讯系统的语音通话方法及装置
US11605394B2 (en) Speech signal cascade processing method, terminal, and computer-readable storage medium
US10542136B2 (en) Transcribing audio communication sessions
JP3237566B2 (ja) 通話方法、音声送信装置及び音声受信装置
US7529675B2 (en) Conversational networking via transport, coding and control conversational protocols
US6970935B1 (en) Conversational networking via transport, coding and control conversational protocols
CN1115917C (zh) 用作因特网电话的增强型无线电电话及实现电话功能的方法
US20040267527A1 (en) Voice-to-text reduction for real time IM/chat/SMS
CN113571079B (zh) 语音增强方法、装置、设备及存储介质
EP2245826A1 (en) Method and apparatus for detecting and suppressing echo in packet networks
WO2007070860A2 (en) Intelligent codec selection to optimize audio transmission in wireless communications
CN114842857B (zh) 语音处理方法、装置、系统、设备及存储介质
Chinna Rao et al. Real-time implementation and testing of VoIP vocoders with asterisk PBX using wireshark packet analyzer
KR100465318B1 (ko) 광대역 음성신호의 송수신 장치 및 그 송수신 방법
CN111225102A (zh) 一种蓝牙音频信号传输方法和装置
US20110235632A1 (en) Method And Apparatus For Performing High-Quality Speech Communication Across Voice Over Internet Protocol (VoIP) Communications Networks
US8489216B2 (en) Sound mixing apparatus and method and multipoint conference server
FR2861247A1 (fr) Terminal de telephonie a gestion de la qualite de restituton vocale pendant la reception
JP4437011B2 (ja) 音声符号化装置
CN111385780A (zh) 一种蓝牙音频信号传输方法和装置
JP4120440B2 (ja) 通信処理装置、および通信処理方法、並びにコンピュータ・プログラム
CN101179600A (zh) 一种网络协议语音通信方法、系统和服务器
JP2002101203A (ja) 音声処理システム、音声処理方法およびその方法を記憶した記憶媒体
CN105407243B (zh) 一种Android平台上使用改进仿射投影算法的回声消除VOIP系统
WO2019071541A1 (zh) 语音翻译方法、装置和终端设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09771931

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 7159/CHENP/2010

Country of ref document: IN

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 27/07/11)

122 Ep: pct application non-entry in european phase

Ref document number: 09771931

Country of ref document: EP

Kind code of ref document: A1