CN109872727A - Voice quality assessment equipment, method and system - Google Patents

Voice quality assessment equipment, method and system Download PDF

Info

Publication number
CN109872727A
CN109872727A CN201910290416.4A CN201910290416A CN109872727A CN 109872727 A CN109872727 A CN 109872727A CN 201910290416 A CN201910290416 A CN 201910290416A CN 109872727 A CN109872727 A CN 109872727A
Authority
CN
China
Prior art keywords
speech
user
stress
voice
feature
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910290416.4A
Other languages
Chinese (zh)
Other versions
CN109872727B (en
Inventor
林晖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SHANGHAI LIULISHUO INFORMATION TECHNOLOGY Co Ltd
Original Assignee
SHANGHAI LIULISHUO INFORMATION TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHANGHAI LIULISHUO INFORMATION TECHNOLOGY Co Ltd filed Critical SHANGHAI LIULISHUO INFORMATION TECHNOLOGY Co Ltd
Priority to CN201910290416.4A priority Critical patent/CN109872727B/en
Publication of CN109872727A publication Critical patent/CN109872727A/en
Application granted granted Critical
Publication of CN109872727B publication Critical patent/CN109872727B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Telephonic Communication Services (AREA)
  • Machine Translation (AREA)

Abstract

The voice quality assessment equipment that the present invention provides a kind of based on stress, method and system, data processing equipment and method, speech processing device and method and mobile terminal, to overcome the problems, such as that existing voice technology does not consider the information in relation to voice stress when evaluating the pronunciation situation of user.Voice quality assessment equipment includes: storage unit, is suitable for storage pre-determined text and pre-determined text is corresponding with reference to stress feature, which includes one or more sentence, and each sentence includes one or more word;User speech receiving unit, the user speech for being directed to the typing of pre-determined text institute suitable for receiving user;Feature acquiring unit, suitable for obtaining user's stress feature of user speech;And voice quality computing unit, suitable for calculating the voice quality of user speech based on the correlation between reference stress feature and user's stress feature.Above-mentioned technology of the invention can be applied to voice technology field.

Description

Voice quality assessment equipment, method and system
The application be the applicant submitted on December 04th, 2014 application No. is 201410736334.5, entitled voice matter Measure the divisional application of the application for a patent for invention of valuator device, method and system.
Technical field
The present invention relates to voice technology field more particularly to a kind of voice quality assessment equipment based on stress, method and System, data processing equipment and method, speech processing device and method and mobile terminal.
Background technique
With the development of internet, language learning application Internet-based has also obtained quick development.In some languages In speech study application, application provider sends client for learning stuff by internet, and user obtains via client and learns Material is practised, and is operated on the client according to the instruction of learning stuff, such as input text, input voice or progress Selection etc., and fed back, to improve the language competence of oneself.
For language learning, other than learning grammar with vocabulary etc., an important aspect is to learn hearing for language Ability, the ability especially said.Often there is different weights of speaking for every kind of language, when speaking under different scenes Sound, for example, different sentences and different words all have the stress changed according to scene.In general, stress refers to Which word (stress of hereinafter referred to as speaking) should be read in one whole word again, or in a word should to which syllable into Row reads (hereinafter referred to as pronunciation stress) again.Therefore, user study spoken with the language when, it is also necessary to learn it is this speak and/ Or pronunciation is stressed.
In existing voice technology, user by the sound pick-up outfit recorded speech of client, system according to the voice Corresponding text, to user record voice split, and one by one word with regard to user voice and existing acoustic model It is compared, to provide a user whether the word pronunciation correctly feeds back.However, existing this voice technology is being evaluated Information in terms of having ignored when the pronunciation situation of user in relation to voice stress, therefore learner can not be allowed to learn stress of speaking And/or pronunciation stress.
Summary of the invention
It has been given below about brief overview of the invention, in order to provide about the basic of certain aspects of the invention Understand.It should be appreciated that this summary is not an exhaustive overview of the invention.It is not intended to determine pass of the invention Key or pith, nor is it intended to limit the scope of the present invention.Its purpose only provides certain concepts in simplified form, Taking this as a prelude to a more detailed description discussed later.
In consideration of it, the voice quality assessment equipment that the present invention provides a kind of based on stress, method and system, data processing Device and method, speech processing device and method and mobile terminal, at least to solve existing voice technology in evaluation user Pronunciation situation when the problem of having ignored the information in relation to voice stress.
According to an aspect of the invention, there is provided a kind of voice quality assessment equipment based on stress, comprising: storage is single Member, is suitable for storage pre-determined text and pre-determined text is corresponding with reference to stress feature, which includes one or more language Sentence, and each sentence includes one or more word;User speech receiving unit is recorded suitable for receiving user for pre-determined text The user speech entered;Feature acquiring unit, suitable for obtaining user's stress feature of user speech;And voice quality calculates list Member, suitable for calculating the voice quality of user speech based on the correlation between reference stress feature and user's stress feature.
According to another aspect of the present invention, a kind of data processing equipment is additionally provided, which is suitable in the server It executes, and includes: server storage unit, be suitable for storage pre-determined text and at least one section corresponding with pre-determined text refers to language Sound;And stress computing unit, join suitable for calculating the characteristic parameter of this section of reference voice according to reference voice, or according to this feature Number calculates the reference stress feature of at least one section reference voice to be stored in server storage unit.
According to another aspect of the present invention, a kind of speech processing device is additionally provided, which is suitable in a computer It executes, and includes: reference voice receiving unit, be used as reference for the voice of pre-determined text institute typing suitable for receiving specific user Voice;And stress computing unit, suitable for according to reference voice calculate reference voice characteristic parameter, by this feature parameter with Pre-determined text is sent to book server in association, or according to the reference stress feature of this feature gain of parameter reference voice, It is sent to book server in association so that stress feature and pre-determined text will be referred to.
According to another aspect of the present invention, a kind of voice quality assessment method based on stress, this method are additionally provided Include the following steps: to receive the user speech that user is directed to the typing of pre-determined text institute, which includes one or more Sentence, and each sentence includes one or more word;Obtain user's stress feature of user speech;And it is based on pre-determined text The corresponding correlation with reference between stress feature and user's stress feature, calculates the voice quality of user speech.
According to another aspect of the present invention, a kind of data processing method is additionally provided, this method is suitable in the server It executes, and includes the following steps: to store pre-determined text and at least one section of reference voice corresponding with pre-determined text;And according to this Reference voice calculates the characteristic parameter of this section of reference voice to save, or according to this feature gain of parameter at least one section of reference voice Reference stress feature to save.
According to another aspect of the present invention, a kind of method of speech processing is additionally provided, this method is suitable in a computer It executes, and includes the following steps: that receiving specific user is directed to the voice of pre-determined text institute typing as reference voice;And according to The reference voice calculates the characteristic parameter of reference voice, and this feature parameter and pre-determined text are sent to predetermined clothes in association Be engaged in device, or according to this feature parameter calculate reference voice reference stress feature, stress feature and pre-determined text phase will be referred to Associatedly it is sent to book server.
According to another aspect of the present invention, a kind of mobile terminal is additionally provided, including as described above based on stress Voice quality assessment equipment.
According to a further aspect of the invention, a kind of voice quality assessment system based on stress is additionally provided, including such as The upper described voice quality assessment equipment based on stress and data processing equipment as described above.
The above-mentioned voice quality assessment scheme according to an embodiment of the present invention based on stress, the user speech based on acquisition User's stress feature and with reference to the correlation between stress feature, to calculate the voice quality of user speech, can obtain to One of few following benefit: considering the information in relation to voice stress during calculating the voice quality of user speech, can Make user and know accuracy of the voice oneself recorded in terms of stress according to calculated result, and then is conducive to user's judgement Whether need to correct oneself speak stress and/or pronunciation stress;Calculating and evaluation to user speech is in client computer Or completed on client mobile terminal, so that user is carried out off-line learning;Calculation amount is smaller;Save the time;It operates simpler Singly, conveniently;It, can easily will be according to the stress information of reference voice and when the representation of user's stress feature changes Reference stress character representation calculated is at form identical with user's stress feature, so that the processing of voice quality assessment equipment More flexible, conveniently, practicability is stronger.
By the detailed description below in conjunction with attached drawing to highly preferred embodiment of the present invention, these and other of the invention is excellent Point will be apparent from.
Detailed description of the invention
The present invention can be by reference to being better understood, wherein in institute below in association with description given by attached drawing Have and has used the same or similar appended drawing reference in attached drawing to indicate same or similar component.The attached drawing is together with following It is described in detail together comprising in the present specification and forming a part of this specification, and is used to that this is further illustrated The preferred embodiment and explanation the principle of the present invention and advantage of invention.In the accompanying drawings:
Fig. 1 is the structural block diagram for schematically showing mobile terminal 100;
Fig. 2 is to schematically show the voice quality assessment equipment 200 according to an embodiment of the invention based on stress A kind of exemplary structure block diagram;
Fig. 3 is the block diagram for schematically showing a kind of possible structure of feature acquiring unit 230 shown in Fig. 2;
Fig. 4 is to schematically show the voice quality assessment equipment in accordance with another embodiment of the present invention based on stress A kind of block diagram of 400 exemplary structure;
Fig. 5 is a kind of exemplary knot for schematically showing data processing equipment 500 according to an embodiment of the invention The block diagram of structure;
Fig. 6 is a kind of exemplary knot for schematically showing speech processing device 600 according to an embodiment of the invention The block diagram of structure;
Fig. 7 is the one kind for schematically showing the voice quality assessment method based on stress of embodiment according to the present invention The flow chart of exemplary process;
Fig. 8 is the stream for schematically showing a kind of exemplary process of data processing method of embodiment according to the present invention Cheng Tu;
Fig. 9 is the stream for schematically showing a kind of exemplary process of method of speech processing of embodiment according to the present invention Cheng Tu;And
Figure 10 is another exemplary process for schematically showing the method for speech processing of embodiment according to the present invention Flow chart.
It will be appreciated by those skilled in the art that element in attached drawing is just for the sake of showing for the sake of simple and clear, And be not necessarily drawn to scale.For example, the size of certain elements may be exaggerated relative to other elements in attached drawing, with Just the understanding to the embodiment of the present invention is helped to improve.
Specific embodiment
Exemplary embodiment of the invention is described hereinafter in connection with attached drawing.For clarity and conciseness, All features of actual implementation mode are not described in the description.It should be understood, however, that developing any this actual implementation Much decisions specific to embodiment must be made during example, to realize the objectives of developer, for example, symbol Restrictive condition those of related to system and business is closed, and these restrictive conditions may have with the difference of embodiment Changed.In addition, it will also be appreciated that although development is likely to be extremely complex and time-consuming, to having benefited from the disclosure For those skilled in the art of content, this development is only routine task.
Here, and also it should be noted is that, in order to avoid having obscured the present invention because of unnecessary details, in the accompanying drawings Illustrate only with closely related apparatus structure and/or processing step according to the solution of the present invention, and be omitted and the present invention The little other details of relationship.
The embodiment of the present invention, which provides, is utilized a kind of voice quality assessment equipment based on stress, which includes: Storage unit, be suitable for storage pre-determined text and pre-determined text it is corresponding refer to stress feature, the pre-determined text include one or Multiple sentences, and each sentence includes one or more word;User speech receiving unit is suitable for receiving user for predetermined text The user speech of this institute typing;Feature acquiring unit, suitable for obtaining user's stress feature of user speech;And voice quality meter Unit is calculated, suitable for calculating the voice quality of user speech based on the correlation between reference stress feature and user's stress feature.
The above-mentioned voice quality assessment equipment based on stress of embodiment according to the present invention can be in traditional desktop The application that processing is executed in type or laptop computer (not shown) etc. is also possible in mobile terminal (as shown in Figure 1) The client application (one kind of the application 154 in mobile terminal 100 as shown in Figure 1) of processing is executed, or is also possible to The web application etc. accessed on above-mentioned traditional desktop type, laptop user or mobile terminal by browser.
Fig. 1 is the structural block diagram of mobile terminal 100.Mobile terminal 100 with multiple point touching ability may include storage Device interface 102, one or more data processors, image processor and/or central processing unit 104 and peripheral interface 106。
Memory interface 102, one or more processors 104 and/or peripheral interface 106 either discrete component, It can integrate in one or more integrated circuits.In the mobile terminal 100, various elements can pass through one or more communication Bus or signal wire couple.Sensor, equipment and subsystem may be coupled to peripheral interface 106, a variety of to help to realize Function.For example, motion sensor 110, optical sensor 112 and range sensor 114 may be coupled to peripheral interface 106, with side Just the functions such as orientation, illumination and ranging.Other sensors 116 can equally be connected with peripheral interface 106, such as positioning system (such as GPS receiver), temperature sensor, biometric sensor or other sensor devices, it is possible thereby to help to implement correlation Function.
Camera sub-system 120 and optical sensor 122 can be used for the camera of convenient such as record photos and video clips The realization of function, wherein the camera sub-system and optical sensor for example can be charge-coupled device (CCD) or complementary gold Belong to oxide semiconductor (CMOS) optical sensor.
It can help to realize communication function by one or more radio communication subsystems 124, wherein wireless communication System may include radio-frequency transmitter and transmitter and/or light (such as infrared) Receiver And Transmitter.Radio communication subsystem 124 particular design and embodiment can depend on one or more communication networks that mobile terminal 100 is supported.For example, Mobile terminal 100 may include be designed to support GSM network, GPRS network, EDGE network, Wi-Fi or WiMax network and The communication subsystem 124 of BlueboothTM network.
Audio subsystem 126 can be coupled with loudspeaker 128 and microphone 130, to help to implement to enable voice Function, such as speech recognition, speech reproduction, digital record and telephony feature.
I/O subsystem 140 may include touch screen controller 142 and/or other one or more input controllers 144.
Touch screen controller 142 may be coupled to touch screen 146.For example, the touch screen 146 and touch screen controller 142 can be used any one of a variety of touch-sensing technologies to detect the contact carried out therewith and movement or pause, Middle detection technology includes but is not limited to capacitive character, resistive, infrared and surface acoustic wave technique.
Other one or more input controllers 144 may be coupled to other input/control devicess 148, for example, one or The pointer device of multiple buttons, rocker switch, thumb wheel, infrared port, USB port, and/or stylus etc.One or Multiple buttons (not shown) may include the up/down button for controlling 130 volume of loudspeaker 128 and/or microphone.
Memory interface 102 can be coupled with memory 150.The memory 150 may include that high random access is deposited Reservoir and/or nonvolatile memory, such as one or more disk storage equipments, one or more optical storage apparatus, and/ Or flash memories (such as NAND, NOR).
Memory 150 can store an operating system 152, such as the behaviour of Android, IOS or Windows Phone etc Make system.The operating system 152 may include for handling basic system services and executing the finger of the task dependent on hardware It enables.Memory 150 can also be stored using 154.These applications in operation, can be loaded into processor 104 from memory 150 On, and run on the operating system run via processor 104, and provided using operating system and bottom hardware Interface realizes the various desired functions of user, such as instant messaging, web page browsing, pictures management.Using can be independently of behaviour System offer is provided, is also possible to what operating system carried.It include voice quality assessment equipment according to the present invention using 154 200。
Fig. 2 shows an examples of the voice quality assessment equipment 200 based on stress of embodiment according to the present invention. As shown in Fig. 2, voice quality assessment equipment 200 includes storage unit 210, user speech receiving unit 220, feature acquiring unit 230 and voice quality computing unit 240.
As described above, voice quality assessment equipment 200 is suitable for executing in computer or mobile terminal, wherein mobile Terminal for example can be mobile phone (such as smart phone) or tablet computer mobile communication equipment.
Storage unit 210 for example can be the memory 150 in mobile terminal, can store the number in mobile terminal According to, contents such as information, parameter.In this embodiment, by the pre-determined text downloaded in advance from such as book server and with it is predetermined The corresponding reference stress characteristic storage of text is in storage unit 210.Wherein, pre-determined text includes one or more sentence, And each sentence includes one or more word.Wherein, each word in sentence usually may include multiple letters or at least one A text.Book server mentioned here for example can be is stayed below in association with data processing equipment 500 described in Fig. 5 The server stayed.Calculation amount under this mode is smaller, does not need the ancillary cost time to calculate with reference to stress feature, Neng Goujie It saves time, operates also simpler, conveniently.
According to a kind of implementation, language that the language of pre-determined text is, for example, such as English etc, that word is made of letter Yan Shi, pre-determined text in addition to include one or more sentences and one or more words of each sentence these content of text it Outside, it is also an option that property include syllable and/or syllable and/or phoneme of the information such as phoneme and each word of each word etc. Corresponding relationship between information and the letter for constituting the word.It should be noted that, although the above citing is described for predetermined text The case where this language is English, but the language of practical pre-determined text is not limited to English, can be Chinese, French or German etc. Any one language.
In addition, the reference stress feature that storage unit 210 is stored is also possible to pass through local according to other implementations Calculate acquisition.For example, the feature ginseng of pre-determined text and at least one section reference voice can be downloaded in advance from book server Number, and acquisition is calculated with reference to stress feature according to this feature parameter, and be stored in storage unit 210.In this manner, It, can easily will be according to the reference calculated of the characteristic parameter of reference voice when the representation of user's stress feature changes Stress character representation at form identical with user's stress feature so that the processing of voice quality assessment equipment 200 it is more flexible, Convenient, practicability is stronger.It should be noted that the process calculated according to the characteristic parameter of reference voice with reference to stress feature can With with reference to the treatment process described below in association with Fig. 5, I will not elaborate.
Here, reference voice can be by specific user (such as using the language of pre-determined text as the user of mother tongue or with it is pre- Determine the relevant professional language teacher of language etc. of text) in advance for the voice of pre-determined text recording.Characteristic parameter can be About one section of reference voice, it is also possible to about multistage reference voice.The reference stress feature of multistage reference voice can be with It is to be obtained after being averaging by the reference stress feature to each section of reference voice.
When user starts voice quality assessment equipment 200, as described above, having had in storage unit 210 above-mentioned predetermined Text and reference stress feature corresponding with the pre-determined text.Then, pass through the touch screen 146 etc of such as mobile terminal 100 Display device, content of text corresponding to voice to be logged (i.e. above-mentioned pre-determined text) is presented to user, and prompt user Record corresponding voice.In this way, user can be by input units such as the microphones 130 of mobile terminal 100 come typing phase The voice answered as user speech, and is received the user speech by user speech receiving unit 220.
Then, received user speech is transmitted to feature acquiring unit 230 by user speech receiving unit 220, and User's stress feature of the user speech is obtained by feature acquiring unit 230.
Fig. 3 shows a kind of possible exemplary construction of feature acquiring unit 230.In this example, feature acquiring unit 230 may include alignment subelement 310 and feature calculation subelement 320.
As shown in figure 3, alignment subelement 310 can use predetermined acoustical model (acoustic model) for user speech It carries out forcing to be aligned (force alignment) with pre-determined text, to determine in each word and/or each word in pre-determined text Each syllable and/or each syllable each phoneme and user speech part between corresponding relationship.In general, acoustics Model is can to calculate input voice made of the recording training by a large amount of mother tongue speaker using acoustic model and correspond to A possibility that known text, and then input voice can be carried out forcing to be aligned with known text.Here, " input voice " can be with The reference voice that is user speech or will hereinafter mention, and " known text " can be pre-determined text.
Wherein it is possible to reference to the correlation money in http://mi.eng.cam.ac.uk/~mjfg/ASRU_talk09.pdf Material is to know the relevant technologies of acoustic model, and can refer to http://www.isip.piconepress.com/ projects/speech/software/tutorials/production/fundamentals/v1.0/section_04/ Related data in s04_04_p01.html and http://www.phon.ox.ac.uk/jcoleman/BAAP_ASR.pdf comes Know the relevant technologies for forcing alignment, or also can use other prior arts, I will not elaborate.
In addition, it should be noted that, can be determined pre- by will carry out forcing to be aligned between user speech and pre-determined text The corresponding relationship between each sentence in text and the part of speech (such as some voice segments) of user speech is determined, that is, can To determine voice segments corresponding with each sentence in pre-determined text in user speech.
In addition to this, as described above, by forcing alignment that can also obtain as needed in following three kinds of corresponding relationships Any one or more: between each word in pre-determined text and the part of speech (such as some block of speech) of user speech Corresponding relationship;The part of speech (such as some block of speech) of each syllable and user speech in each word in pre-determined text it Between corresponding relationship;And each syllable in each word in pre-determined text each phoneme and user speech part of speech Corresponding relationship between (such as some block of speech).
In this way, based on the corresponding relationship that alignment subelement 310 determines, feature calculation subelement 320 can calculate user's language User's stress feature of sound.
For example, feature calculation subelement 320 can be based on the correspondence of above-mentioned determination for each sentence in pre-determined text Relationship obtains the spy of each syllable corresponding block of speech in user speech in each word and/or each word in the sentence Parameter is levied, is then obtained using trained predetermined expert model and the characteristic parameter of each block of speech achieved above every The stressed attribute (whether reading again) of a block of speech.
According to a kind of implementation, each block of speech may include a Duan Shengbo, and the characteristic parameter example of each block of speech Such as may include at least one of following parameter: the block of speech corresponds to the wave crest and trough of acoustic waveform;The block of speech is corresponding The energy value of the wave crest of acoustic waveform and the absolute value of trough and waveform;The duration of the block of speech or the block of speech are returned One duration changed;The average value of the tone information (i.e. fundamental frequency information) obtained from the block of speech;To from the block of speech The tone information of acquisition carries out the average value of difference value obtained from difference;And the tone by will be obtained from the block of speech Multiple relating values obtained from the shape of information and predefined multiple pitch model degree of being associated calculate.
In one example, the characteristic parameter of each block of speech may include following parameter: the block of speech corresponds to sound wave wave The energy value of the wave crest of shape and the absolute value of trough and waveform;The duration of the block of speech or the block of speech it is normalized Duration;And the average value of the tone information obtained from the block of speech.By above-mentioned three kinds that obtain each block of speech Parameter carries out subsequent calculating, and calculation amount is relatively small, and due to for stress feature, three of the above parameter counterweight The calculating contribution degree of sound feature is maximum, and the opposite stress feature for utilizing other calculation of characteristic parameters of stress feature calculated is also more It is accurate.
Wherein, above-mentioned multiple relating values can for example be obtained with input tone (i.e. by the sampling of pitch model lifting/lowering The tone information obtained from the block of speech) it inputs the sequence of identical points, then two sequence degree of being associated is calculated again And obtain, wherein the technical detail of calculation of relationship degree can refer to http://en.wikipedia.org/wiki/ The open source information of Correlation_and_dependence.
In this way, the word or the syllable are existed for for each syllable in each word or each word in each sentence Information composed by the various characteristic ginseng values of corresponding block of speech in user speech (such as the spy of these characteristic ginseng values composition Levy vector), it is then, the word or the corresponding characteristic parameter information of the syllable is defeated as the characteristic parameter information of the block of speech Enter into above-mentioned trained expert model, the conclusion whether word or the syllable are read again can be obtained.It needs to illustrate It is that above-mentioned expert model can be trained acquisition according to the prior art, and which is not described herein again.
For example, for some word or some syllable, if it is decided that the word or the syllable are read again (being stress), then " 1 " can be used as the word or the stressed attribute value of the syllable;If it is determined that and it (is non-heavy that the word or the syllable, which are not read again, Sound), then " 0 " can be used as the word or the stressed attribute value of the syllable.In this way, can use in each sentence each word in user The vector that the stressed attribute value of corresponding block of speech is constituted in voice corresponding voice segments in user speech as the sentence Stress feature.
For entire user speech, using each sentence, the stress feature of corresponding voice segments can in user speech To form the stress feature of user speech, that is, user's stress feature can be formed.
As a result, based on it is pre-stored with reference to stress feature and calculate obtain user's stress feature between correlation, Voice quality computing unit 240 can calculate the voice quality of user speech.
According to a kind of implementation, voice quality computing unit 240 can be based on user's stress feature and with reference to stress spy Correlation between sign, and the score for describing the voice quality of user speech is obtained according to the correlation.
In one example, it is assumed that for the sentence A in pre-determined text, obtain sentence A and correspond to voice in user speech User's stress feature of section is that (1,0,0) (i.e. the stressed attribute of three included words respectively is stressed, non-in sentence A Stressed and anacrusis), and the reference stress feature that sentence A corresponds to voice segments in reference voice is (0,0,1), then can pass through User's stress feature (1,0,0) is calculated and with reference to the similarity between stress feature (0,0,1), and using the similarity as The score of the voice quality of the user speech is described.That is, between the user's stress feature calculated and reference stress feature Similarity it is higher, the voice quality of user speech is also higher.
In addition, in another example, can also calculate based on the phase between user's stress feature and reference stress feature Closing property calculates distance between the two, and obtains the score of the voice quality for describing user speech according to this distance.For example, It can be by the score of the voice quality reciprocal as description user speech of distance.That is, the user's stress feature calculated The distance between reference stress feature is bigger, and the voice quality of user speech is poorer.
It should be noted that for those skilled in the art, can according to common knowledge and/or open source information come Realize the calculating of distance between similarity between vectors or vector, therefore I will not elaborate.
In addition, it should be noted that, if the reference stress feature stored in storage unit 210 is not expressed as and user's weight The identical form of form (such as form of vector) of sound feature, then can be expressed as same form first, then Calculate similarity or distance etc. between the two.
In addition, it should also be noted that, voice quality computing unit 240 can calculate user's stress feature and reference sentence by sentence Correlation (i.e. similarity or distance) between stress feature, then the acquisition each sentence of pre-determined text is right in user speech sentence by sentence The voice segments answered mass fraction (namely successively obtain user speech in voice segments one by one corresponding with each sentence of pre-determined text Mass fraction).In addition, voice quality computing unit 240 obtains the quality for describing entire user speech with being also an option that property Score, that is, utilize the weighting and/or weighting of each sentence of pre-determined text mass fraction of corresponding voice segments in user speech Mass fraction of the average value as entire user speech.Wherein, the weight of each voice based on experience value or can pass through test Mode determine.
The another of the voice quality assessment equipment based on stress of embodiment according to the present invention is described below with reference to Fig. 4 A example.
In the example as depicted in fig. 4, voice quality assessment equipment 400 including storage unit 410, user speech in addition to connecing It receives except unit 420, feature acquiring unit 430 and voice quality computing unit 440, further includes output unit 450.Wherein, Storage unit 410, user speech receiving unit 420, feature acquiring unit in voice quality assessment equipment 400 shown in Fig. 4 430 and voice quality computing unit 440 can be respectively provided with above in conjunction with voice quality assessment equipment described in Fig. 2 The identical structure and function of corresponding unit in 200, and similar technical effect can be reached, which is not described herein again.
Output unit 450 can visualize the calculated result of output voice quality, for example, can pass through such as mobile terminal The calculated result of the display device of 100 touch screen 146 etc Voice Quality in user's presentation.
According to a kind of implementation, output unit 450 can export the score of reflection voice quality as voice quality Calculated result.
For example, output unit 450 can visually export in (for example exporting sentence by sentence) reflection user speech and predetermined text Originally the score of the voice quality of the corresponding each voice segments of each sentence.In this way, user can know every words described in oneself Speak stress and/or pronounce stress accuracy, especially when the score of a certain sentence is lower, user can be immediately recognized that this The stress of sentence needs to correct, and learns more targeted.
For another example, output unit 450 can visually export the score for reflecting the voice quality of entire user speech.This Whether sample, the stress that user is capable of one section of voice described in overall recognition oneself are accurate.
In addition, in other examples, output unit 450 can also visually export in reflection user speech and pre- simultaneously Determine the score of the voice quality of the corresponding each voice segments of each sentence of text and the voice quality of the entire user speech of reflection Score.
According to another implementation, output unit 450 can visually export user's stress feature and with reference to stress Difference between feature as voice quality calculated result.
For example, output unit 450 can indicate reference voice with user speech with two parallel rows, wherein overstriking is aobvious Showing indicates that the syllable in some word or some word is stressed, if stress position is identical, in typical fashion, such as green is come Display;If stress position is different, it is highlighted the stress, such as is shown with red.
In this way, shown by the output of output unit 450, user can easily know oneself speak stress and/or The difference of pronunciation stress and received pronunciation (reference voice i.e. here) spoken between stress and/or the stress that pronounces, difference have It is much etc., so as to more targetedly, more accurately correct oneself speak stress and/or pronunciation stress.
According to other implementations, output unit 450 can also visually export the score of reflection voice quality simultaneously And user's stress feature and with reference to the difference between stress feature as the calculated result of voice quality, the implementation Detail can refer to the description as described in both the above implementation, and which is not described herein again.
As can be seen from the above description, the voice quality assessment equipment based on stress of above-mentioned embodiment according to the present invention, Correlation between the user's stress feature and reference stress feature of its user speech based on acquisition, to calculate user speech Voice quality.Since the equipment considers the information in relation to voice stress during calculating the voice quality of user speech, Therefore being able to use family knows accuracy of the voice oneself recorded in terms of stress according to calculated result, and then is conducive to User judges whether to need to correct oneself speak stress and/or pronunciation stress.
In addition, the voice quality assessment equipment based on stress of above-mentioned embodiment according to the present invention corresponds to user client End, calculating and evaluation to user speech are completed on client computer or client mobile terminal, and existing Voice technology is usually to complete the calculating and evaluation to user speech, voice quality assessment equipment of the invention in server end User is set to carry out off-line learning (downloaded storage learning stuff in the case where), without must be into as the prior art Row on-line study.
In addition, the equipment is suitable for executing in the server the embodiments of the present invention also provide a kind of data processing equipment, And include: server storage unit, it is suitable for storage pre-determined text and at least one section of reference voice corresponding with pre-determined text;With And stress computing unit, suitable for the characteristic parameter of reference voice being calculated according to the reference voice to be stored in server storage unit In, or according to the reference stress feature of at least one section reference voice of this feature gain of parameter to be stored in server storage unit In.
Fig. 5 shows an example of the data processing equipment 500 of embodiment according to the present invention.As shown in figure 5, data Processing equipment 500 includes server storage unit 510 and stress computing unit 520.
Data processing equipment 500 for example can be implemented as resident application on the server.Server for example may include Web server can use http agreement and user client (such as voice quality assessment equipment 200 as described above Or it 400) is communicated, but be not only restricted to this.
Server storage unit 510 can store the text material of various language learning materials, i.e. pre-determined text.Wherein, For every kind of language, server storage unit 510 can also store and predetermined text other than it can store pre-determined text It this corresponding at least one section of reference voice or can be set from speech processing device 600 that for example will be described below etc. outside It is standby to receive and store at least one section of reference voice.It should be understood that pre-determined text mentioned here makes a reservation for above described Text is similar, other than including one or more sentences and one or more words of each sentence these content of text, also (such as the language of pre-determined text is such as English etc to the syllable and/or the information such as phoneme for including to the property of can choose each word , the language that word is made of letter when) and each word syllable and/or phoneme etc. between information and the letter for constituting the word Corresponding relationship.
Then, stress computing unit 520 can obtain the characteristic parameter of at least one section reference voice by calculating, will This feature parameter is stored in server storage unit 510.Wherein, obtain the characteristic parameter of reference voice process can with it is upper The process that the characteristic parameter of user speech is obtained described in text is similar, below will be for example, and part phase is omitted With the description of content.
According to a kind of implementation, stress computing unit 520 can join the feature of at least one section reference voice of acquisition Number is stored in server storage unit 510.In this implementation, in subsequent processing, data processing equipment 500 can be with It is (such as described above that the characteristic parameter of the pre-determined text and at least one section reference voice that are stored is supplied to user client Voice quality assessment equipment 200 or 400).
In addition, stress computing unit 520 can also refer to language according at least one section of acquisition according to another implementation The characteristic parameter of sound saves the reference stress feature of acquisition to obtain the reference stress feature of at least one section reference voice In server storage unit 510.In this implementation, in subsequent processing, data processing equipment 500 can be deposited It is (such as described above that the reference stress feature of the pre-determined text of storage and at least one section reference voice is supplied to user client Voice quality assessment equipment 200 or 400).
Wherein, the reference stress feature of each section of reference voice at least in one section of reference voice, can be used with above Described in the acquisition modes identical processing mode of user's stress feature obtain, and similar technology effect can be reached Fruit, which is not described herein again.
It should be noted that executed in the data processing equipment 500 of embodiment according to the present invention with above in conjunction with The processing of voice quality assessment equipment 200 or 400 same sections based on stress described in Fig. 2 or Fig. 4, can obtain therewith Similar technical effect, no longer repeats one by one here.
In addition, the equipment is suitable for executing in a computer the embodiments of the present invention also provide a kind of speech processing device, And include: reference voice receiving unit, suitable for receive specific user for the typing of pre-determined text institute voice as reference voice, And reference voice is sent to book server.The language processing device can also include stress computing unit, be suitable for according to ginseng Written comments on the work, etc of public of officials sound calculates the characteristic parameter of the reference voice, and this feature parameter and pre-determined text are sent to reservation service in association Device, or according to the reference stress feature of this feature gain of parameter reference voice, related to pre-determined text stress feature will be referred to It is sent to book server to connection.
Fig. 6 shows an example of the speech processing device 600 of embodiment according to the present invention.As shown in fig. 6, voice Processing equipment 600 includes reference voice receiving unit 610.Optionally, which can also include that stress calculates Unit 620.
As shown in fig. 6, according to a kind of implementation, when speech processing device 600 only includes reference voice receiving unit 610 When, can be received by reference to voice receiving unit 610 specific user (such as using pre-determined text language as the user of mother tongue or with Relevant professional language teacher of the language etc.) it is directed to the voice of pre-determined text institute typing, as reference voice, and by reference voice It is sent to book server (such as the server that above data processing equipment 500 described in conjunction with Figure 5 is resident).
In addition, according to another implementation, when speech processing device 600 can also include stress computing unit 620.Weight Sound computing unit 620 calculates the characteristic parameter of reference voice according to the received reference voice of reference voice receiving unit 610, with This feature parameter and pre-determined text are sent to book server in association, or according to this feature gain of parameter reference voice With reference to stress feature (process can be with reference to associated description above), associated with pre-determined text stress feature will be referred to Ground is sent to book server.
In practical applications, speech processing device 600 can correspond to the teacher being arranged in computer or other terminals Client, for example, it is implemented in software.
The user of teacher's client can record received pronunciation for each sentence in pre-determined text, using as reference Voice is sent to corresponding server end, executes subsequent processing by server end.In this case, it can be convenient server to pass through Internet acquires reference voice, and the processing without participating in recorded speech can save time and operation.
In addition, teacher's client can also be handled directly in the received pronunciation (i.e. reference voice) that it is recorded in local Analysis generates parameter (as referred to stress feature) corresponding with the received pronunciation, and is transferred to clothes together with pre-determined text Business device end storage, so as to reduce the processing load of server end.
In addition, the embodiments of the present invention also provide a kind of mobile terminal, including as described above based on the voice of stress Quality evaluation equipment.The mobile terminal can have possessed by the above-mentioned voice quality assessment equipment 200 or 400 based on stress Function, and similar technical effect can be reached, I will not elaborate.
In addition, the embodiments of the present invention also provide a kind of voice quality assessment system based on stress, the system include Voice quality assessment equipment 200 or 400 and data processing equipment as described above 500 based on stress as described above.
According to a kind of implementation, voice quality assessment system is in addition to including above-mentioned voice quality assessment equipment 200 or 400 Except above-mentioned data processing equipment 500, it is also an option that property include speech processing device 600 as described above.This In implementation, the voice quality assessment equipment 200 or 400 in voice quality assessment system can correspond to be set to computer Or the user client in mobile terminal, data processing equipment 500 can correspond to be set to server end, and speech processes are set Standby 600 can correspond to teacher's client.In actual treatment, teacher's client can provide reference voice to server end (can also optionally provide the characteristic parameter of reference voice or refer to stress feature), server is for storing these information and pre- Determine text, and user client can then download these information to analyze the user speech of user's input, to it from server Complete voice quality assessment.The details of processing can combine description given by Fig. 2 or 4, Fig. 5 and Fig. 6 with reference to above respectively, Which is not described herein again.
In addition, the embodiments of the present invention also provide a kind of voice quality assessment method based on stress, this method include Following steps: receiving the user speech that user is directed to the typing of pre-determined text institute, which includes one or more sentence, And each sentence includes one or more word;Obtain user's stress feature of user speech;And it is corresponding based on pre-determined text Reference stress feature and user's stress feature between correlation, calculate the voice quality of user speech.
A kind of exemplary process of the above-mentioned voice quality assessment method based on stress is described below with reference to Fig. 7.Such as Fig. 7 Shown, the exemplary process flow 700 of the voice quality assessment method according to an embodiment of the invention based on stress starts In step S710, then, step S720 is executed.
In step S720, the user speech that user is directed to the typing of pre-determined text institute is received, which includes one Or multiple sentences, and each sentence includes one or more word.Then, step S730 is executed.Wherein, in step S720 Processing for example can be identical as the processing above in conjunction with user speech receiving unit 220 described in Fig. 2, and can reach phase Similar technical effect, details are not described herein.
According to a kind of implementation, pre-determined text and it is characterized in obtaining from book server downloading in advance with reference to stress.
According to another implementation, pre-determined text is obtained from book server downloading in advance, and it is special to refer to stress Sign is obtained according to the calculation of characteristic parameters for at least one section reference voice downloaded in advance from book server.
In step S730, user's stress feature of user speech is obtained.Then, step S740 is executed.Wherein, step Processing in S730 for example can be identical as the processing above in conjunction with feature acquiring unit 230 described in Fig. 2, and can reach To similar technical effect, details are not described herein.
According to a kind of implementation, in step S730, such as predetermined acoustical model can use by user speech and pre- Determine text and carry out pressure alignment, to determine each syllable and/or each sound in each word and/or each word in pre-determined text Corresponding relationship between each phoneme of section and the part of user speech, and it is heavy based on the user that corresponding relationship obtains user speech Sound feature.
Wherein, the step of " user's stress feature of user speech being obtained based on corresponding relationship " can for example pass through such as lower section Formula is realized: for each sentence of pre-determined text: based on corresponding relationship, obtaining each sound in each word and/or each word Save the characteristic parameter of corresponding block of speech in user speech;And using trained predetermined expert model and each The characteristic parameter of block of speech obtains the stressed attribute of each block of speech.Then, each word based on each sentence obtained and/or The stressed attribute of the corresponding block of speech of each syllable in each word, forms the stress feature of user speech.
According to a kind of implementation, each block of speech includes a Duan Shengbo, and the characteristic parameter of the block of speech includes following At least one of parameter: the block of speech corresponds to the wave crest and trough of acoustic waveform;The block of speech corresponds to the wave crest of acoustic waveform With the absolute value of trough and the energy value of waveform;When the duration of the block of speech or the block of speech normalized continues It is long;The average value of the tone information obtained from the block of speech;To the tone information progress difference obtained from the block of speech The average value of obtained difference value;And the shape of the tone information by will be obtained from the block of speech and predefined multiple Multiple relating values obtained from pitch model degree of being associated calculates.
It is corresponding with reference to related between stress feature and user's stress feature based on pre-determined text in step S740 Property, calculate the voice quality of user speech.Wherein, the processing in step S740 for example can with above in conjunction with described by Fig. 2 Voice quality computing unit 240 processing it is identical, and similar technical effect can be reached, details are not described herein.Then, Process 700 is ended processing in step S750.
In addition, according to another implementation, after step S740, it is also an option that property include the following steps: can Calculated result depending on changing output voice quality.
Wherein, the calculated result of voice quality may include: the score for reflecting voice quality;And/or user's stress feature Difference between reference stress feature.
As can be seen from the above description, the voice quality assessment method based on stress of above-mentioned embodiment according to the present invention, Correlation between the user's stress feature and reference stress feature of its user speech based on acquisition, to calculate user speech Voice quality.Since this method considers the information in relation to voice stress during calculating the voice quality of user speech, Therefore being able to use family knows accuracy of the voice oneself recorded in terms of stress according to calculated result, and then is conducive to User judges whether to need to correct oneself speak stress and/or pronunciation stress.
In addition, the voice quality assessment method based on stress of above-mentioned embodiment according to the present invention corresponds to user client End, calculating and evaluation to user speech are completed on client computer or client mobile terminal, and existing Voice technology is usually to complete the calculating and evaluation to user speech, voice quality assessment method of the invention in server end User is set to carry out off-line learning (downloaded storage learning stuff in the case where), without must be into as the prior art Row on-line study.
In addition, this method is suitable for executing in the server the embodiments of the present invention also provide a kind of data processing method, And include the following steps: to store pre-determined text and at least one section of reference voice corresponding with pre-determined text;And according to reference language Sound calculates the characteristic parameter of the reference voice to save, or the reference of at least one section reference voice is calculated according to this feature parameter Stress feature is to save.
A kind of exemplary process of above-mentioned data processing method is described below with reference to Fig. 8.As shown in figure 8, according to this hair The exemplary process flow 800 of the data processing method of bright one embodiment starts from step S810, then, executes step S820。
In step S820, pre-determined text and at least one section of reference voice corresponding with pre-determined text are stored, or storage is in advance Determine text and receives and stores at least one section of reference voice from outside.Then, step S830 is executed.Wherein, in step S820 Processing for example can be identical as the processing above in conjunction with server storage unit 510 described in Fig. 5, and can reach similar As technical effect, details are not described herein.
In step S830, the characteristic parameter of at least one section reference voice is calculated to save, or according to this feature parameter meter The reference stress feature of at least one section reference voice is calculated to save.Wherein, the processing in step S830 for example can with above The processing of obtaining unit 520 described in conjunction with Figure 5 is identical, and can reach similar technical effect, and details are not described herein. Then, process 800 is ended processing in step S840.
In addition, this method is suitable for executing in a computer the embodiments of the present invention also provide a kind of method of speech processing, And include the following steps: to receive specific user for the typing of pre-determined text institute voice as reference voice, and by reference voice It is sent to book server;Or the characteristic parameter of reference voice is calculated according to the reference voice, by this feature parameter and make a reservation for Text is sent to book server in association, or according to the reference stress feature of this feature gain of parameter reference voice, with will It is sent to book server in association with reference to stress feature and pre-determined text.
A kind of exemplary process of above-mentioned method of speech processing is described below with reference to Fig. 9.As shown in figure 9, according to this hair The exemplary process flow 900 of the method for speech processing of bright one embodiment starts from step S910, then, executes step S920。
In step S920, the voice that specific user is directed to the typing of pre-determined text institute is received, as reference voice.Then, Execute step S930.
In step S930, reference voice is sent to book server.Then process is ended processing in step S940 900。
Wherein, the processing of process flow 900 for example can with above in conjunction with reference voice receiving unit described in Fig. 6 610 processing is identical, and can reach similar technical effect, and details are not described herein.
In addition, Figure 10 shows another exemplary process of above-mentioned method of speech processing.As shown in Figure 10, according to this hair The exemplary process flow 1000 of the method for speech processing of bright one embodiment starts from step S1010, then, executes step S1020。
In step S1020, the voice that specific user is directed to the typing of pre-determined text institute is received, as reference voice.Then, Execute step S1030.
According to a kind of implementation, the characteristic parameter of reference voice can be obtained in step S1030, this feature is joined It is several to be sent to book server in association with pre-determined text.Then process 1000 is ended processing in step S1040.
It, can be in step S1030 according to the reference of this feature gain of parameter reference voice according to another implementation Stress feature is sent to book server will refer to stress feature and pre-determined text in association.Then in step S1040 End processing process 1000.
Wherein, the processing of process flow 1000 for example can with above in conjunction with described in Fig. 6 reception and obtaining unit 620 processing is identical, and can reach similar technical effect, and details are not described herein.
A11: in voice quality assessment method according to the present invention, the user's stress feature for obtaining the user speech The step of include: to carry out forcing to be aligned by the user speech and the pre-determined text using predetermined acoustical model, to determine State each syllable and/or each syllable in each word and/or each word in pre-determined text each phoneme and the user Corresponding relationship between the part of voice, and obtain based on the corresponding relationship user's stress feature of the user speech. A12: in the voice quality assessment method according to A11, the use that the user speech is obtained based on the corresponding relationship The step of family stress feature includes: each sentence for the pre-determined text: being based on the corresponding relationship, obtains each word And/or the characteristic parameter of the block of speech corresponding in the user speech of each syllable in each word, and using passing through The characteristic parameter of trained predetermined expert model and each block of speech, obtains the stressed attribute of each block of speech;And it is based on The stressed attribute of each word of each sentence obtained and/or the corresponding block of speech of each syllable in each word, forms the user The stress feature of voice.A13: in the voice quality assessment method according to A12, each block of speech includes a Duan Shengbo, and The characteristic parameter of the block of speech includes at least one of following parameter: the block of speech corresponds to the wave crest and trough of acoustic waveform; The block of speech corresponds to the energy value of the wave crest of acoustic waveform and the absolute value of trough and waveform;The duration of the block of speech or The normalized duration of the block of speech;The average value of the tone information obtained from the block of speech;To from the block of speech The tone information of acquisition carries out the average value of difference value obtained from difference;And the tone by will be obtained from the block of speech Multiple relating values obtained from the shape of information and predefined multiple pitch model degree of being associated calculate.A14: according to this hair Bright voice quality assessment method, further includes: the calculated result of visualization output institute's Voice Quality.A15: according to A14 Voice quality assessment method in, the calculated result of institute's Voice Quality include: reflect institute's Voice Quality score;And/or User's stress feature and the difference with reference between stress feature.A16: voice quality assessment method according to the present invention In, the pre-determined text and described it is characterized in obtaining from book server downloading in advance with reference to stress;Or the pre-determined text Obtained in advance from book server downloading, and it is described with reference to stress be characterized according to download in advance from book server to What the calculation of characteristic parameters of few one section of reference voice obtained.A17: a kind of data processing method, this method are suitable in the server It executes, and includes the following steps: to store pre-determined text;Store at least one section of reference voice corresponding with the pre-determined text;With And the characteristic parameter of at least one section reference voice described in calculating calculates described at least one to save, and/or according to this feature parameter The reference stress feature of section reference voice is to save.A18: a kind of method of speech processing, this method are suitable for executing in a computer, And include the following steps: that receiving specific user is directed to the voice of pre-determined text institute typing as reference voice;And according to described Reference voice calculates the characteristic parameter of the reference voice, and this feature parameter and the pre-determined text are sent in association Book server, and/or according to this feature parameter calculate the reference voice reference stress feature, with by described with reference to stress Feature and the pre-determined text are sent to the book server in association.A19: a kind of mobile terminal, including according to this hair The bright voice quality assessment equipment based on stress.A20: a kind of voice quality assessment system based on stress, including according to this The voice quality assessment equipment and data processing equipment based on stress of invention.A kind of A21: voice quality assessment based on stress System, including the voice quality assessment equipment according to the present invention based on stress;Server;And at voice according to the present invention Manage equipment.
Similarly, it should be understood that in order to simplify the disclosure and help to understand one or more of the various inventive aspects, Above in the description of exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes In example, figure or descriptions thereof.However, the disclosed method should not be interpreted as reflecting the following intention: i.e. required to protect Shield the present invention claims than feature more features expressly recited in each claim.More precisely, as following As claims reflect, inventive aspect is all features less than single embodiment disclosed above.Therefore, it abides by Thus the claims for following specific embodiment are expressly incorporated in the specific embodiment, wherein each claim itself As a separate embodiment of the present invention.
Those skilled in the art should understand that the module of the equipment in example disclosed herein or unit or groups Part can be arranged in equipment as depicted in this embodiment, or alternatively can be positioned at and the equipment in the example In different one or more equipment.Module in aforementioned exemplary can be combined into a module or furthermore be segmented into multiple Submodule.
Those skilled in the art will understand that can be carried out adaptively to the module in the equipment in embodiment Change and they are arranged in one or more devices different from this embodiment.It can be the module or list in embodiment Member or component are combined into a module or unit or component, and furthermore they can be divided into multiple submodule or subelement or Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it can use any Combination is to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed All process or units of what method or apparatus are combined.Unless expressly stated otherwise, this specification is (including adjoint power Benefit require, abstract and attached drawing) disclosed in each feature can carry out generation with an alternative feature that provides the same, equivalent, or similar purpose It replaces.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments In included certain features rather than other feature, but the combination of the feature of different embodiments mean it is of the invention Within the scope of and form different embodiments.For example, in the following claims, embodiment claimed is appointed Meaning one of can in any combination mode come using.
In addition, be described as herein can be by the processor of computer system or by executing by some in the embodiment The combination of method or method element that other devices of the function are implemented.Therefore, have for implementing the method or method The processor of the necessary instruction of element forms the device for implementing this method or method element.In addition, Installation practice Element described in this is the example of following device: the device be used for implement as in order to implement the purpose of the invention element performed by Function.
As used in this, unless specifically stated, come using ordinal number " first ", " second ", " third " etc. Description plain objects, which are merely representative of, is related to the different instances of similar object, and is not intended to imply that the object being described in this way must Must have the time it is upper, spatially, sequence aspect or given sequence in any other manner.
Although the embodiment according to limited quantity describes the present invention, above description, the art are benefited from It is interior it is clear for the skilled person that in the scope of the present invention thus described, it can be envisaged that other embodiments.Additionally, it should be noted that Language used in this specification primarily to readable and introduction purpose and select, rather than in order to explain or limit Determine subject of the present invention and selects.Therefore, without departing from the scope and spirit of the appended claims, for this Many modifications and changes are obvious for the those of ordinary skill of technical field.For the scope of the present invention, to this Invent done disclosure be it is illustrative and not restrictive, it is intended that the scope of the present invention be defined by the claims appended hereto.

Claims (10)

1. a kind of voice quality assessment equipment based on stress, comprising:
Storage unit, is suitable for storage pre-determined text and the pre-determined text is corresponding with reference to stress feature, which includes One or more sentence, and each sentence includes one or more word;
User speech receiving unit, the user speech for being directed to the typing of pre-determined text institute suitable for receiving user;
Feature acquiring unit, suitable for obtaining user's stress feature of the user speech;And
Voice quality computing unit, suitable for based on the correlation with reference between stress feature and user's stress feature, Calculate the voice quality of the user speech.
2. voice quality assessment equipment according to claim 1, wherein the feature acquiring unit includes:
It is aligned subelement, suitable for the user speech is carried out forcing to be aligned with the pre-determined text using predetermined acoustical model, With each phoneme of each syllable and/or each syllable in each word and/or each word in the determination pre-determined text with Corresponding relationship between the part of the user speech;And
Feature calculation subelement, suitable for calculating user's stress feature of the user speech based on the corresponding relationship.
3. voice quality assessment equipment according to claim 2, wherein the feature calculation subelement is suitable for:
For each sentence of the pre-determined text:
Based on the corresponding relationship, it is corresponding in the user speech to obtain each syllable in each word and/or each word Block of speech characteristic parameter;And
Using trained predetermined expert model and the characteristic parameter of each block of speech, the stressed category of each block of speech is obtained Property;And
The stressed attribute of the corresponding block of speech of each syllable in each word and/or each word based on each sentence obtained is formed The stress feature of the user speech.
4. voice quality assessment equipment according to claim 3, wherein each block of speech includes a Duan Shengbo, and the language The characteristic parameter of sound block includes at least one of following parameter:
The block of speech corresponds to the wave crest and trough of acoustic waveform;
The block of speech corresponds to the energy value of the wave crest of acoustic waveform and the absolute value of trough and waveform;
The normalized duration of the duration of the block of speech or the block of speech;
The average value of the tone information obtained from the block of speech;
To the average value for carrying out difference value obtained from difference from the tone information obtained in the block of speech;And
Pass through the shape of tone information that will be obtained from the block of speech and predefined multiple pitch model degree of being associated meters Multiple relating values obtained from calculation.
5. voice quality assessment equipment according to claim 1, further includes:
Output unit, suitable for visualizing the calculated result of output institute's Voice Quality.
6. voice quality assessment equipment according to claim 5, wherein the output unit, which is suitable for exporting following result, to be come Calculated result as institute's Voice Quality:
Reflect the score of institute's Voice Quality;And/or
User's stress feature and the difference with reference between stress feature.
7. voice quality assessment equipment according to claim 1, in which:
The storage unit is suitable for downloading the pre-determined text and the reference stress feature in advance from book server to save; Or
The storage unit is suitable for downloading the spy of the pre-determined text and at least one section reference voice in advance from book server Parameter is levied, and the reference stress feature is obtained to save according to the calculation of characteristic parameters of at least one section reference voice.
8. a kind of data processing equipment, which is suitable for executing in the server, and includes:
Server storage unit is suitable for storage pre-determined text and at least one section of reference voice corresponding with the pre-determined text; And
Stress computing unit, suitable for calculating the characteristic parameter of the reference voice according at least one section of reference voice, and according to This feature parameter calculates the reference stress feature of at least one section reference voice to be stored in the server storage unit.
9. a kind of speech processing device, which is suitable for executing in a computer, and includes:
Reference voice receiving unit is directed to the voice of pre-determined text institute typing as reference voice suitable for receiving specific user;With And
Stress computing unit joins this feature suitable for calculating the characteristic parameter of the reference voice according to the reference voice It is several to be sent to book server, or the ginseng of the reference voice according to this feature gain of parameter in association with the pre-determined text Examine stress feature, to be sent to the book server in association with reference to stress feature and the pre-determined text for described.
10. a kind of voice quality assessment method based on stress, includes the following steps:
The user speech that user is directed to the typing of pre-determined text institute is received, which includes one or more sentence, and every A sentence includes one or more word;
Obtain user's stress feature of the user speech;And
Based on the corresponding correlation with reference between stress feature and user's stress feature of the pre-determined text, described in calculating The voice quality of user speech.
CN201910290416.4A 2014-12-04 2014-12-04 Voice quality evaluation device, method and system Active CN109872727B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910290416.4A CN109872727B (en) 2014-12-04 2014-12-04 Voice quality evaluation device, method and system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410736334.5A CN104485116B (en) 2014-12-04 2014-12-04 Voice quality assessment equipment, method and system
CN201910290416.4A CN109872727B (en) 2014-12-04 2014-12-04 Voice quality evaluation device, method and system

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201410736334.5A Division CN104485116B (en) 2014-12-04 2014-12-04 Voice quality assessment equipment, method and system

Publications (2)

Publication Number Publication Date
CN109872727A true CN109872727A (en) 2019-06-11
CN109872727B CN109872727B (en) 2021-06-08

Family

ID=52759655

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201910290416.4A Active CN109872727B (en) 2014-12-04 2014-12-04 Voice quality evaluation device, method and system
CN201410736334.5A Active CN104485116B (en) 2014-12-04 2014-12-04 Voice quality assessment equipment, method and system

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201410736334.5A Active CN104485116B (en) 2014-12-04 2014-12-04 Voice quality assessment equipment, method and system

Country Status (1)

Country Link
CN (2) CN109872727B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111583961A (en) * 2020-05-07 2020-08-25 北京一起教育信息咨询有限责任公司 Stress evaluation method and device and electronic equipment

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105261362B (en) * 2015-09-07 2019-07-05 科大讯飞股份有限公司 A kind of call voice monitoring method and system
CN106611603A (en) * 2015-10-26 2017-05-03 腾讯科技(深圳)有限公司 Audio processing method and audio processing device
CN106971743B (en) * 2016-01-14 2020-07-24 广州酷狗计算机科技有限公司 User singing data processing method and device
CN106847308A (en) * 2017-02-08 2017-06-13 西安医学院 A kind of pronunciation of English QA system
CN110136748A (en) * 2019-05-16 2019-08-16 上海流利说信息技术有限公司 A kind of rhythm identification bearing calibration, device, equipment and storage medium
CN110085260A (en) * 2019-05-16 2019-08-02 上海流利说信息技术有限公司 A kind of single syllable stress identification bearing calibration, device, equipment and medium
CN110085261B (en) * 2019-05-16 2021-08-24 上海流利说信息技术有限公司 Pronunciation correction method, device, equipment and computer readable storage medium
CN111951827B (en) * 2019-05-16 2022-12-06 上海流利说信息技术有限公司 Continuous reading identification correction method, device, equipment and readable storage medium
CN112309371A (en) * 2019-07-30 2021-02-02 上海流利说信息技术有限公司 Intonation detection method, apparatus, device and computer readable storage medium
CN112309429A (en) * 2019-07-30 2021-02-02 上海流利说信息技术有限公司 Method, device and equipment for explosion loss detection and computer readable storage medium
CN111508525B (en) * 2020-03-12 2023-05-23 上海交通大学 Full-reference audio quality evaluation method and device
CN112086094B (en) * 2020-08-21 2023-03-14 广东小天才科技有限公司 Method for correcting pronunciation, terminal equipment and computer readable storage medium

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1101446A (en) * 1993-01-21 1995-04-12 Dsp飒露神思国际公司 Computerized system for teching speech
JP3154725B2 (en) * 1995-01-19 2001-04-09 ジーメンス アクティエンゲゼルシャフト Method for transmitting audio information
US20080147404A1 (en) * 2000-05-15 2008-06-19 Nusuara Technologies Sdn Bhd System and methods for accent classification and adaptation
CN101251956A (en) * 2008-03-24 2008-08-27 合肥讯飞数码科技有限公司 Interactive teaching device and teaching method
CN101551952A (en) * 2009-05-21 2009-10-07 无敌科技(西安)有限公司 Device and method for evaluating pronunciation
CN101630448A (en) * 2008-07-15 2010-01-20 上海启态网络科技有限公司 Language learning client and system
CN101727903A (en) * 2008-10-29 2010-06-09 中国科学院自动化研究所 Pronunciation quality assessment and error detection method based on fusion of multiple characteristics and multiple systems
CN101751919A (en) * 2008-12-03 2010-06-23 中国科学院自动化研究所 Spoken Chinese stress automatic detection method
CN102237081A (en) * 2010-04-30 2011-11-09 国际商业机器公司 Method and system for estimating rhythm of voice
CN102436807A (en) * 2011-09-14 2012-05-02 苏州思必驰信息科技有限公司 Method and system for automatically generating voice with stressed syllables
KR101188982B1 (en) * 2011-07-20 2012-10-08 포항공과대학교 산학협력단 Stress studying system and method for studying foreign language
CN102800314A (en) * 2012-07-17 2012-11-28 广东外语外贸大学 English sentence recognizing and evaluating system with feedback guidance and method of system
CN103544311A (en) * 2013-11-04 2014-01-29 北京中搜网络技术股份有限公司 News client evaluation system and method based on mobile phone
US20140248591A1 (en) * 2013-03-04 2014-09-04 Xerox Corporation Method and system for capturing reading assessment data

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000019941A (en) * 1998-06-30 2000-01-21 Oki Hokuriku System Kaihatsu:Kk Pronunciation learning apparatus
US7571101B2 (en) * 2006-05-25 2009-08-04 Charles Humble Quantifying psychological stress levels using voice patterns
JP5528850B2 (en) * 2010-02-18 2014-06-25 Kddi株式会社 Mobile terminal device, stress estimation system, operation method, stress estimation program
CN101996635B (en) * 2010-08-30 2012-02-08 清华大学 English pronunciation quality evaluation method based on accent highlight degree
JP6263868B2 (en) * 2013-06-17 2018-01-24 富士通株式会社 Audio processing apparatus, audio processing method, and audio processing program

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1101446A (en) * 1993-01-21 1995-04-12 Dsp飒露神思国际公司 Computerized system for teching speech
JP3154725B2 (en) * 1995-01-19 2001-04-09 ジーメンス アクティエンゲゼルシャフト Method for transmitting audio information
US20080147404A1 (en) * 2000-05-15 2008-06-19 Nusuara Technologies Sdn Bhd System and methods for accent classification and adaptation
CN101251956A (en) * 2008-03-24 2008-08-27 合肥讯飞数码科技有限公司 Interactive teaching device and teaching method
CN101630448A (en) * 2008-07-15 2010-01-20 上海启态网络科技有限公司 Language learning client and system
CN101727903A (en) * 2008-10-29 2010-06-09 中国科学院自动化研究所 Pronunciation quality assessment and error detection method based on fusion of multiple characteristics and multiple systems
CN101751919A (en) * 2008-12-03 2010-06-23 中国科学院自动化研究所 Spoken Chinese stress automatic detection method
CN101551952A (en) * 2009-05-21 2009-10-07 无敌科技(西安)有限公司 Device and method for evaluating pronunciation
CN102237081A (en) * 2010-04-30 2011-11-09 国际商业机器公司 Method and system for estimating rhythm of voice
KR101188982B1 (en) * 2011-07-20 2012-10-08 포항공과대학교 산학협력단 Stress studying system and method for studying foreign language
CN102436807A (en) * 2011-09-14 2012-05-02 苏州思必驰信息科技有限公司 Method and system for automatically generating voice with stressed syllables
CN102800314A (en) * 2012-07-17 2012-11-28 广东外语外贸大学 English sentence recognizing and evaluating system with feedback guidance and method of system
US20140248591A1 (en) * 2013-03-04 2014-09-04 Xerox Corporation Method and system for capturing reading assessment data
CN103544311A (en) * 2013-11-04 2014-01-29 北京中搜网络技术股份有限公司 News client evaluation system and method based on mobile phone

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
YAOHUI QI: "Improvement of Acoustic Model in Text-independent Pronunciation Quality Assessment", 《2012 FIFTH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION》 *
李雅: "汉语层级重音分析与预测方法研究", 《中国博士学位论文全文数据库》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111583961A (en) * 2020-05-07 2020-08-25 北京一起教育信息咨询有限责任公司 Stress evaluation method and device and electronic equipment

Also Published As

Publication number Publication date
CN104485116B (en) 2019-05-14
CN109872727B (en) 2021-06-08
CN104485116A (en) 2015-04-01

Similar Documents

Publication Publication Date Title
CN104485116B (en) Voice quality assessment equipment, method and system
CN104485115B (en) Pronounce valuator device, method and system
KR102433834B1 (en) Method and apparatus for compressing a neural network model, method and apparatus for corpus translation, electronic apparatus, program and recording medium
CN104361896B (en) Voice quality assessment equipment, method and system
US10607597B2 (en) Speech signal recognition system and method
CN105940407B (en) System and method for assessing the intensity of audio password
US11790912B2 (en) Phoneme recognizer customizable keyword spotting system with keyword adaptation
CN104505103B (en) Voice quality assessment equipment, method and system
CN109767765A (en) Talk about art matching process and device, storage medium, computer equipment
CN104361895B (en) Voice quality assessment equipment, method and system
WO2021135628A1 (en) Voice signal processing method and speech separation method
US10997965B2 (en) Automated voice processing testing system and method
CN112840396A (en) Electronic device for processing user words and control method thereof
WO2021008538A1 (en) Voice interaction method and related device
CN108962231B (en) Voice classification method, device, server and storage medium
CN110827825A (en) Punctuation prediction method, system, terminal and storage medium for speech recognition text
CN107656866A (en) A kind of method, mobile terminal and computing device tested using fluency
CN109947971A (en) Image search method, device, electronic equipment and storage medium
CN108880815A (en) Auth method, device and system
CN110308886A (en) The system and method for voice command service associated with personalized task are provided
CN108597522A (en) A kind of method of speech processing and device
KR20200056754A (en) Apparatus and method for generating personalization lip reading model
US11146678B2 (en) Determining the context of calls
JP5733566B2 (en) Translation apparatus, translation method, and program
US11520687B2 (en) System and method for automated testing of an accessibility feature of a user device by emulating actions of users

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant