CN107465518A - A kind of network more people while voice-enabled chat method and system - Google Patents

A kind of network more people while voice-enabled chat method and system Download PDF

Info

Publication number
CN107465518A
CN107465518A CN201710701608.0A CN201710701608A CN107465518A CN 107465518 A CN107465518 A CN 107465518A CN 201710701608 A CN201710701608 A CN 201710701608A CN 107465518 A CN107465518 A CN 107465518A
Authority
CN
China
Prior art keywords
user
voice
users
tone color
network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710701608.0A
Other languages
Chinese (zh)
Inventor
张航进
梁小龙
刘宝
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BEIJING DASHENG ON-LINE TECHNOLOGY CO., LTD.
Original Assignee
Beijing Dasheng On-Line Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Dasheng On-Line Technology Co Ltd filed Critical Beijing Dasheng On-Line Technology Co Ltd
Priority to CN201710701608.0A priority Critical patent/CN107465518A/en
Publication of CN107465518A publication Critical patent/CN107465518A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention discloses a kind of network more people while voice-enabled chat method and system, the described method comprises the following steps:S1, all users connect remote server by Internet, enter same voice-enabled chat room after logging in;S2, user starts voice-enabled chat, and speech data is uploaded into remote server;S3, change the tone color of each user pronunciation so that the tone color differentiation of each user;Then directly listen on the local device.The present invention is by changing the tone color of each user pronunciation so that the tone color differentiation of each user, so as to which audience can be allowed clearly to tell different people one's voice in speech in more personal voice-enabled chats simultaneously, and voice between each other without interference with;And there can be multiple spokesmans simultaneously in a chatroom so that the communication between user is more efficient.

Description

A kind of network more people while voice-enabled chat method and system
Technical field
The present invention relates to a kind of network more people while voice-enabled chat method and system, belong to multi-person speech technology neck Domain.
Background technology
Chatted on multi-person speech, current commonplace way there are two kinds:1. more people's chat systems at times;2. base In the chat system of virtual location.
However, above-mentioned existing scheme still allows user not convenient enough and experiences imperfect place:
1st, existing more people's chat systems at times can only have people's pronunciation in some period, and other people can not say Words, although ensure that the clear sound of speaker, can not realize more people's live chats;
2nd, the existing chat system based on virtual location, using the intensity of sound of simple regulation L channel and R channel Mode realized that the intensity of left and right otoacoustic emission sound is set just with the mode of spatial sound transmission attenuation, and more individuals say Still it is difficult the sound for distinguishing speaker that audience can be caused during words, and according to the acoustic feature of human ear also is difficult to recognize virtual Position.
The content of the invention
It is an object of the present invention to provide a kind of network more people voice-enabled chat method and system simultaneously, it can be with Effectively solve problems of the prior art, in particular by simple regulation L channel and the side of the intensity of sound of R channel Formula realizes that multi-person speech is chatted, the problem of still audience being caused to be difficult the sound for distinguishing speaker when more individuals speak.
In order to solve the above technical problems, the present invention adopts the following technical scheme that:A kind of network more people while language Sound chat method, comprises the following steps:
S1, all users connect remote server by Internet, enter same voice-enabled chat room after logging in;
S2, user starts voice-enabled chat, and speech data is uploaded into remote server;
S3, change the tone color of each user pronunciation so that the tone color differentiation of each user;Then directly in local device On listen to.
Preferably, in step S2, in addition to:Described speech data is compressed, is then uploaded to remote service again Device, so as to effectively save system transmission bandwidth.
Preferably, in step S3, the tone color of each user pronunciation is changed by way of interpolation, resampling so that each The tone color differentiation of user, namely by setting different interpolation to count and different resampling frequencies, realize the difference of tone color Change, algorithm is simple, and treatment effeciency is higher.
Foregoing network more people in voice-enabled chat method, are changing the sound of each user pronunciation in step S3 simultaneously Before color, in addition to:Sound using one or more of modes in noise reduction, equilibrium, addition reverberation, pressure limiting etc. to each user Modified and beautified, so as to improve the hearing enjoying of audience, and these Technical comparings taken control well, easily set Obtain relatively good auditory effect.
In the present invention, step S3 also includes:A locational space is fictionalized in the local client of each audience so that this Ground user is in home position, and other users surround an arc before local user, then passed through according to position relationship Head-related transfer function simulates different user sound to the voice data of two ear drum membranes of audience, so as to allow each tin Crowd feels other people stand in face of him to be talked, and each sound both is from different directions, is not only convenient for distinguishing Not different speaker, moreover it is possible to strengthen telepresenc.
Preferably, if in addition to local user the status of other users all equality, described other users are in local use An arc is surrounded before family, and is evenly distributed on circular arc, so as to evenly distribute can allow audience to greatest extent differentiate appoint The sound for two adjacent speakers of anticipating;If the status of other users is unequal in addition to local user, described other users An arc is surrounded before local user, and wherein the distance between responsible consumer and remaining other users are more than residue The distance between other each users so that the sound of important spokesman is easiest to be resolved;And user gets over It is important its position to be set more remote with the distance of other users, ensure that the sound of responsible consumer is easier by area with this Point.
A kind of network more people while voice chatting system, including:
Log-in module:Remote server is connected by Internet for all users, entered after logging in same Voice-enabled chat room;
Chat and data uploading module, start voice-enabled chat, and speech data is uploaded into remote server for user;
Tone color processing module, for changing the tone color of each user pronunciation so that the tone color differentiation of each user;
Voice frequency listening module, for listening to the voice data after handling.
Preferably, described chat and data uploading module also include:
Data compressing module, for being compressed to described speech data.
Preferably, in addition to:
Sound is modified and beautification module, for using noise reduction, equilibrium, the one or more of modes added in reverberation, pressure limiting The sound of each user is modified and beautified.
Network more people of the present invention while voice chatting system, in addition to:
Virtual location distribute module, for fictionalizing a locational space in the local client of each audience so that this Ground user is in home position, and other users surround an arc before local user;
Voice data analog module, for simulating different user sound by head-related transfer function according to position relationship Voice data of the sound to two ear drum membranes of audience.
Described virtual location distribute module, if the status of other users all equality in addition to local user, described Other users surround an arc before local user, and are evenly distributed on circular arc, and audience can be allowed so as to evenly distribute The sound of any two adjacent speaker is differentiated to greatest extent;If the status of other users is unequal in addition to local user, Then described other users surround an arc before local user, and wherein responsible consumer and remaining other users it Between distance be more than the distance between other remaining each users so that the sound of important spokesman be easiest to by Differentiate;And user is more important can be set its position more remote with the distance of other users, ensure responsible consumer with this Sound is more easily distinguished.
Compared with prior art, the present invention has advantages below:
1st, by changing the tone color of each user pronunciation so that the tone color differentiation of each user, so as to how personal same When voice-enabled chat when audience can be allowed clearly to tell different people one's voice in speech, and voice between each other without interference with; In addition, the present invention can greatly optimize the audio experience of audience, and there can be multiple hairs simultaneously in a chatroom Speaker so that the communication between user is more efficient;
2nd, by being compressed to described speech data, remote server is then uploaded to again, so as to effectively save About system transmission bandwidth;
3rd, the present invention considers attenuation of the structure to sound of human ear on the basis of using background technology, that is, Head-related transfer function make use of to simulate different user sound to the voice data of two ear drum membranes of audience, so as to allow Audience it is apparent tell virtual location that different people speaks and the sound of different people;
4th, the sound of each user is entered by using one or more of modes in noise reduction, equilibrium, addition reverberation, pressure limiting Row modification and beautification, so as to allow each spokesman in chatroom to have the higher beautiful timbre of identification, so as to improve The hearing enjoying of audience, at the same cause it is more personal converse simultaneously chat when, voice between each other without interference with;
Even if the 5, situation of only one spokesman, spokesman can also use the system, the sound of oneself be carried out beautiful Change and modify;
6th, the present invention is handled the audio that all remote servers transmit in local user side, so as to local visitor On the one hand family end, to ensure the differentiation of tone color, can reduce remote service by distributing different interpolation and sampling parameter The computing load of device, it on the other hand also ensure that audience can clearly tell different people one's voice in speech;
7th, in the present invention, when carrying out virtual location distribution, if the status of other users all equality in addition to local user, Described other users surround an arc before local user, and are evenly distributed on circular arc, so as to evenly distribute energy Audience is allowed to differentiate the sound of any two adjacent speaker to greatest extent;If the status of other users is not in addition to local user Equality, then described other users surround an arc before local user, and wherein responsible consumer with it is remaining other The distance between user is more than the distance between other remaining each users, so that the sound of important spokesman is most Easily it is resolved;And user is more important can be set its position more remote with the distance of other users, ensured with this important The sound of user is more easily distinguished.
Brief description of the drawings
Fig. 1 is a kind of method flow diagram of embodiment of the present invention;
Fig. 2 is a kind of schematic diagram of system architecture of the present invention;
Fig. 3 be the other users in addition to local user status all equality when user's virtual location distribution schematic diagram;
Fig. 4 is user's virtual location distribution schematic diagram when having responsible consumer.
The present invention is further illustrated with reference to the accompanying drawings and detailed description.
Embodiment
Embodiments of the invention:A kind of network more people while voice-enabled chat method, as shown in Figure 1 and Figure 2, including Following steps:
S1, all users connect remote server by Internet, enter same voice-enabled chat room after logging in;
S2, user starts voice-enabled chat, and speech data is uploaded into remote server;
S3, change the tone color of each user pronunciation so that the tone color differentiation of each user;Then directly in local device On listen to.
In step S2, in addition to:Described speech data is compressed, is then uploaded to remote server again.
In step S3, change the tone color of each user pronunciation by way of interpolation, resampling so that the sound of each user Aberration alienation.
In step S3 before the tone color of each user pronunciation is changed, noise reduction, equilibrium can be used, added in reverberation, pressure limiting One or more of modes the sound of each user is modified and beautified.
The sound of each user can also be modified and beautified by way of adding and encouraging, but this mode ratio More difficult control, sound can feel more random if control is bad.
For the ease of distinguishing that different speakers, and enhancing telepresenc, step S3 also include:In the local of each audience Client fictionalizes a locational space so that local user is in home position, and other users are enclosed before local user Into an arc, different user sound is then simulated to two ears of audience by head-related transfer function according to position relationship The voice data of eardrum.
Optionally, if in addition to local user the status of other users all equality, described other users are in local use An arc is surrounded before family, and (as shown in Figure 3) is evenly distributed on circular arc;If the other users in addition to local user Status is unequal, then described other users surround an arc, and wherein responsible consumer and residue before local user The distance between other users be more than the distance between other remaining each users, and user is more important can be by its position (as shown in Figure 4) more remote with other users distances that install.
A kind of network more people while voice chatting system, including:
Log-in module:Remote server is connected by Internet for all users, entered after logging in same Voice-enabled chat room;
Chat and data uploading module, start voice-enabled chat, and speech data is uploaded into remote server for user;
Tone color processing module, for changing the tone color of each user pronunciation so that the tone color differentiation of each user;
Voice frequency listening module, for listening to the voice data after handling.
Described chat and data uploading module also includes:
Data compressing module, for being compressed to described speech data.
Also include:
Sound is modified and beautification module, for using noise reduction, equilibrium, the one or more of modes added in reverberation, pressure limiting The sound of each user is modified and beautified.
Also include:
Virtual location distribute module, for fictionalizing a locational space in the local client of each audience so that this Ground user is in home position, and other users surround an arc before local user;
Voice data analog module, for simulating different user sound by head-related transfer function according to position relationship Voice data of the sound to two ear drum membranes of audience.
Optionally, described virtual location distribute module, if the status of other users all equality in addition to local user, Described other users surround an arc before local user, and are evenly distributed on circular arc;If remove local user The status of outer other users is unequal, then described other users surround an arc before local user, and wherein heavy The distance between user and remaining other users is wanted to be more than the distance between other remaining each users, and user is heavier Its position can be set more remote with the distance of other users.
A kind of operation principle of embodiment of the present invention:
The present invention is handled the tone color of user voice so that the tone color differentiation of each user, equivalent to we When listening the band to perform, although sound similar in many pitches (frequency) is superimposed together, as audience we still The sound of each musical instrument included in sound can clearly be told.Similarly, only need to modify each spokesman in the present invention Voice tone color, and using HRTF processing virtual scene in different speakers voice so that audience can be differentiated in face of oneself The spokesman of different azimuth, and hear the speech of different spokesmans.

Claims (10)

1. a kind of network more people while voice-enabled chat method, it is characterised in that comprise the following steps:
S1, all users connect remote server by Internet, enter same voice-enabled chat room after logging in;
S2, user starts voice-enabled chat, and speech data is uploaded into remote server;
S3, change the tone color of each user pronunciation so that the tone color differentiation of each user;Then directly receive on the local device Listen.
2. network more people according to claim 1 while voice-enabled chat method, it is characterised in that in step S2, Also include:Described speech data is compressed, is then uploaded to remote server again.
3. network more people according to claim 1 while voice-enabled chat method, it is characterised in that in step S3, Change the tone color of each user pronunciation by way of interpolation, resampling so that the tone color differentiation of each user.
4. network more people according to claim 1 simultaneously voice-enabled chat method, it is characterised in that in step S3 Before the tone color for changing each user pronunciation, in addition to:Using noise reduction, equilibrium, the one or more side added in reverberation, pressure limiting Formula is modified and beautified to the sound of each user.
5. network more people according to claim 1 while voice-enabled chat method, it is characterised in that step S3 is also wrapped Include:A locational space is fictionalized in the local client of each audience so that local user is in home position, other users An arc is surrounded before local user;Then different use are simulated by head-related transfer function according to position relationship Voice data of the family sound to two ear drum membranes of audience.
6. network more people according to claim 5 while voice-enabled chat method, it is characterised in that if except local With status all equality of outdoor other users, then described other users surround an arc before local user, and Evenly distributed on circular arc;If the status of other users is unequal in addition to local user, described other users are in local use Surround an arc before family, and wherein the distance between responsible consumer and remaining other users are more than that remaining other are each The distance between individual user.
7. a kind of network more people while voice chatting system, it is characterised in that including:
Log-in module:Remote server is connected by Internet for all users, enters same voice after logging in Chatroom;
Chat and data uploading module, start voice-enabled chat, and speech data is uploaded into remote server for user;
Tone color processing module, for changing the tone color of each user pronunciation so that the tone color differentiation of each user;
Voice frequency listening module, for listening to the voice data after handling.
8. network more people according to claim 7 while voice chatting system, it is characterised in that described chat And data uploading module also includes:
Data compressing module, for being compressed to described speech data.
9. network more people according to claim 7 while voice chatting system, it is characterised in that also include:
Sound is modified and beautification module, for using one or more of modes in noise reduction, equilibrium, addition reverberation, pressure limiting to each The sound of individual user is modified and beautified.
10. network more people according to claim 7 while voice chatting system, it is characterised in that also include:
Virtual location distribute module, for fictionalizing a locational space in the local client of each audience so that local to use Family is in home position, and other users surround an arc before local user;
Voice data analog module, arrived for simulating different user sound by head-related transfer function according to position relationship The voice data of two ear drum membranes of audience.
CN201710701608.0A 2017-08-16 2017-08-16 A kind of network more people while voice-enabled chat method and system Pending CN107465518A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710701608.0A CN107465518A (en) 2017-08-16 2017-08-16 A kind of network more people while voice-enabled chat method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710701608.0A CN107465518A (en) 2017-08-16 2017-08-16 A kind of network more people while voice-enabled chat method and system

Publications (1)

Publication Number Publication Date
CN107465518A true CN107465518A (en) 2017-12-12

Family

ID=60549840

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710701608.0A Pending CN107465518A (en) 2017-08-16 2017-08-16 A kind of network more people while voice-enabled chat method and system

Country Status (1)

Country Link
CN (1) CN107465518A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108854062A (en) * 2018-06-24 2018-11-23 广州银汉科技有限公司 A kind of voice-enabled chat module of moving game
CN110910895A (en) * 2019-08-29 2020-03-24 腾讯科技(深圳)有限公司 Sound processing method, device, equipment and medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6408327B1 (en) * 1998-12-22 2002-06-18 Nortel Networks Limited Synthetic stereo conferencing over LAN/WAN
CN101690149A (en) * 2007-05-22 2010-03-31 艾利森电话股份有限公司 Methods and arrangements for group sound telecommunication
US20110157299A1 (en) * 2009-12-24 2011-06-30 Samsung Electronics Co., Ltd Apparatus and method of video conference to distinguish speaker from participants
CN103220491A (en) * 2012-01-18 2013-07-24 哈曼贝克自动系统股份有限公司 Method for operating a conference system and device for the conference system
CN104219400A (en) * 2013-05-30 2014-12-17 华为技术有限公司 Method and device for controlling audio conference
CN104782122A (en) * 2012-10-10 2015-07-15 微软公司 Controlled three-dimensional communication endpoint
CN104836916A (en) * 2015-05-25 2015-08-12 广东欧珀移动通信有限公司 Chat information voice broadcasting method, system and mobile terminal
CN105493181A (en) * 2013-08-30 2016-04-13 格莱姆会议有限责任公司 Multidimensional virtual learning system and method

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6408327B1 (en) * 1998-12-22 2002-06-18 Nortel Networks Limited Synthetic stereo conferencing over LAN/WAN
CN101690149A (en) * 2007-05-22 2010-03-31 艾利森电话股份有限公司 Methods and arrangements for group sound telecommunication
US20110157299A1 (en) * 2009-12-24 2011-06-30 Samsung Electronics Co., Ltd Apparatus and method of video conference to distinguish speaker from participants
CN103220491A (en) * 2012-01-18 2013-07-24 哈曼贝克自动系统股份有限公司 Method for operating a conference system and device for the conference system
CN104782122A (en) * 2012-10-10 2015-07-15 微软公司 Controlled three-dimensional communication endpoint
CN104219400A (en) * 2013-05-30 2014-12-17 华为技术有限公司 Method and device for controlling audio conference
CN105493181A (en) * 2013-08-30 2016-04-13 格莱姆会议有限责任公司 Multidimensional virtual learning system and method
CN104836916A (en) * 2015-05-25 2015-08-12 广东欧珀移动通信有限公司 Chat information voice broadcasting method, system and mobile terminal

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108854062A (en) * 2018-06-24 2018-11-23 广州银汉科技有限公司 A kind of voice-enabled chat module of moving game
CN110910895A (en) * 2019-08-29 2020-03-24 腾讯科技(深圳)有限公司 Sound processing method, device, equipment and medium

Similar Documents

Publication Publication Date Title
JP6849797B2 (en) Listening test and modulation of acoustic signals
US11688401B2 (en) Transcription presentation of communication sessions
US8606249B1 (en) Methods and systems for enhancing audio quality during teleconferencing
Arweiler et al. The influence of spectral characteristics of early reflections on speech intelligibility
US20130339025A1 (en) Social network with enhanced audio communications for the Hearing impaired
US20190019495A1 (en) Sound output device, sound output method, program, and sound system
CN109120947A (en) A kind of the voice private chat method and client of direct broadcasting room
CN108235181A (en) The method of noise reduction in apparatus for processing audio
CN109218948B (en) Hearing aid system, system signal processing unit and method for generating an enhanced electrical audio signal
EP2084937B1 (en) Method and apparatus for recording, transmitting, and playing back sound events for communication applications
CN109729109A (en) Transmission method and device, storage medium, the electronic device of voice
CN104038879A (en) Hearing-aid fitting system and method
EP2009891B1 (en) Transmission of an audio signal in an immersive audio conference system
CN107465518A (en) A kind of network more people while voice-enabled chat method and system
CN106714021A (en) Earphones and electronic assembly
US20140198935A1 (en) Auditory and sensory augmentation and protection system, device and method
Einhorn Hearing aid technology for the 21st century: A proposal for universal wireless connectivity and improved sound quality
CN111951813A (en) Voice coding control method, device and storage medium
Ricketts et al. Adaptive directional benefit in the near field: Competing sound angle and level effects
CN104735582B (en) A kind of audio signal processing method, device and equipment
US20200296523A1 (en) Acoustic spot identification
EP2216975A1 (en) Telecommunication device
Au et al. Wireless binaural hearing aid technology for telephone use and listening in wind noise
CN203492199U (en) Wireless hearing aid used for listening sound accompaniment of television
CN114286274A (en) Audio processing method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20190423

Address after: Room 2001, 2nd Floor, Building 1, 17 Xijing Road, Shijingshan District, Beijing

Applicant after: Beijing Dasheng Zhixing Technology Co., Ltd.

Address before: 100085 Beijing Haidian District, No. 1, South District, 6th Floor, No. 9 Shangdi East Road

Applicant before: BEIJING DASHENG ON-LINE TECHNOLOGY CO., LTD.

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20190724

Address after: 100085 Beijing Haidian District, No. 1, South District, 6th Floor, No. 9 Shangdi East Road

Applicant after: BEIJING DASHENG ON-LINE TECHNOLOGY CO., LTD.

Address before: Room 2001, 2nd Floor, Building 1, 17 Xijing Road, Shijingshan District, Beijing

Applicant before: Beijing Dasheng Zhixing Technology Co., Ltd.

TA01 Transfer of patent application right
RJ01 Rejection of invention patent application after publication

Application publication date: 20171212

RJ01 Rejection of invention patent application after publication