CN101741953A - Method and equipment to display the speech information by application of cartoons - Google Patents

Method and equipment to display the speech information by application of cartoons Download PDF

Info

Publication number
CN101741953A
CN101741953A CN200910261240A CN200910261240A CN101741953A CN 101741953 A CN101741953 A CN 101741953A CN 200910261240 A CN200910261240 A CN 200910261240A CN 200910261240 A CN200910261240 A CN 200910261240A CN 101741953 A CN101741953 A CN 101741953A
Authority
CN
China
Prior art keywords
voice
character string
cartoon
communication ends
proprietary
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN200910261240A
Other languages
Chinese (zh)
Inventor
殷浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN200910261240A priority Critical patent/CN101741953A/en
Publication of CN101741953A publication Critical patent/CN101741953A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Telephonic Communication Services (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a method and equipment to display the speech information by application of cartoons. It is applied to the displaying technology field in communications technology and the method comprises the following steps: The audio at the communication terminal is transformed to character strings according to the communication mode at the calling. The output character strings are obtained in real time and matched to the character strings stored in the emotion rule base. If the match succeeds, a cartoon corresponding to the matched character strings is shown on the screen. The method and device provided in the invention can display the cartoons related to emotion according to their speech information at the call to make the audio chat more lively and funny.

Description

Use the method and apparatus that cartoon shows voice messaging during a kind of the conversation
Technical field
The present invention relates to the Display Technique field in the mechanics of communication, use the method and apparatus that cartoon shows voice messaging when relating in particular to a kind of the conversation.
Background technology
When the cellphone subscriber uses phone at present, can only hear the other side's sound, can't see the other side's expression; Thereby aspect communication with respect to face-to-face in addition with compare vivid and interesting inadequately with the immediate communication tool text chat.
In addition, in the prior art, on call center system, call center services personnel answer a large number of users phone every day, also often have some splenetic clients and call center services personnel to can't see the other side's mood display frame, it is uninteresting to cause the call center services personnel to work.
In patent retrieval, find a similar patent CN02157471 (virtual TV communicator), this is invented based on speech analysis, and the cg animation represents the other side's whole body expression, action in real time; Because of the data volume that needs transmit relatively large, so occupying system resources also can be more.
Summary of the invention
Use method and device that cartoon shows voice messaging when the invention provides a kind of the conversation, be used for when user's communication voice-enabled chat being followed being vivid and interesting according to the relevant animation of user's voice information explicit user mood.
Use the method that cartoon shows voice messaging during a kind of the conversation, comprising:
During conversation,, the voice of described communication ends are converted into character string, and obtain the described character string of output in real time according to the call mode of communication ends;
The character string of preserving in the described character string obtained and the mood rule base is mated,, then on screen, show the cartoon of the character string correspondence that matches if the match is successful.
Use the device that cartoon shows voice messaging during a kind of the conversation, comprise character string acquisition module, matching module and display module:
The character string acquisition module was used in when conversation, according to the call mode of communication ends, the voice of communication ends is converted into character string, and obtains the character string of output in real time;
Matching module is used for the character string that the character string that will obtain and mood rule base preserve and mates, if the match is successful, the corresponding cartoon that then will match outputs to display module;
Display module is used to the cartoon that shows that described matching module is exported.
Use the method and apparatus that the embodiment of the invention provides, under occupying system resources situation seldom, a kind of cartoon that makes mobile phone, call center computer, network instant communication instrument by the tone of speaking screen display expression the other side is provided, reaches and visually strengthen the impression of user the other side's mood.
Description of drawings
Fig. 1 uses the flow chart that cartoon shows the method for voice messaging when conversing for the embodiment of the invention is a kind of;
The flow chart of Fig. 2 proprietary voice character word stock for the embodiment of the invention generates;
Fig. 3 uses the structure chart that cartoon shows the device of voice messaging when conversing for the embodiment of the invention is a kind of.
Embodiment
When providing a kind of the conversation, the embodiment of the invention uses the method that cartoon shows voice messaging, this method comprises: conversation beginning back judges whether mobile phone is headset mode or hands-free mode at present, if, the square voice of speaking during with conversation are converted into character string, and obtain the character string of output in real time; The character string of preserving in the character string obtained and the mood rule base is mated,, then on screen, show the cartoon of the character string correspondence that matches if the match is successful.
Below in conjunction with Figure of description the specific embodiment of the present invention is elaborated.
As shown in Figure 1, the embodiment of the invention is a kind of uses the method that cartoon shows voice messaging when conversing, and specifically comprises:
Step 101 according to the call mode of communication ends, loads overall voice character word stock, comprises the corresponding relation between voice commonly used and the character string in this voice character word stock.
In the concrete applied environment, after the conversation beginning, can prejudge and judge whether mobile phone is headset mode or hands-free mode at present, if then load the sub-dictionary of overall voice.
In addition, because in the application of reality, exist some users to be dialect or have some specific form of presentations, so also be provided with the proprietary voice dictionary corresponding with the specific user among the true embodiment of the present invention, the mode of using this proprietary voice character word stock can be:
Conversation beginning back judges whether mobile phone is headset mode or hands-free mode at present, if, according to address list, check whether the incoming call user has default proprietary voice character word stock to exist, if have, load described proprietary voice character word stock to internal memory, and the voice of the side of speaking will converse according to the corresponding relation of voice and words in this proprietary voice character word stock the time are converted into character string, wherein, comprise described incoming call proprietary voice and the words corresponding relation of user in the sub-dictionary of described proprietary voice.
Step 102, the voice of the side of speaking during with conversation are converted into character string, and obtain the character string of output in real time;
Wherein, the not necessarily accurately whole word of the character string that gets access to can be a few isolated words and phrases, and crucial modal particle can preferentially be resolved to;
Step 103 is mated the character string of preserving in the character string obtained and the mood rule base, if the match is successful (match immediate that as output), then changes step 104 over to; If unsuccessful, then change step 105 over to.
Step 104, the then cartoon of the character string correspondence that demonstration matches on screen.
Step 105, the cartoon of the no special emotional status of output acquiescence, wherein, the animation of the no special mood of this acquiescence can be designed as, and continuously changes the cartoon of the shape of the mouth as one speaks with the side's of speaking frequency.
Step 106, preserve the words after mating, pause duration when the side of speaking reaches preset threshold value, the character string that the current pause that then last time paused is preserved is formed sentence according to time sequencing, regular expression in sentence of forming and the sentence storehouse that prestores is mated, if the match is successful, then export the pairing cartoon of regular expression that matches, and empty the character string of preservation.
Wherein, before the words composition sentence of preserving, further also need the pause interval duration of current pause of last time is judged, if duration exceeds certain scope at interval, then directly delete the words of preserving, described generally speaking interval duration is set to the in short general required time.
In addition, for speak both sides' reciprocal process of vivider embodiment, the embodiment of the invention is all right:
On screen, show two cartoons, show the cartoon of the special mood correspondence of both call sides respectively.
The system management aspect provides user-defined function, and the user is by the proprietary voice character word stock of the more self-defined vocabulary of administration interface, and the matching feature to dialect can strengthen like this.Friend relatives to the often long-time pot phone of user, can set up a cover voice character word stock specially at each user, can strengthen the precision of coupling so greatly, more accurate with making voice arrive the conversion of character string, realize that the exemplary steps that proprietary voice character word stock is provided with is as follows:
Step 201, selected specific user from address list, input words;
Step 202 is imported the speech information of described words correspondence by microphone;
Step 203 is preserved the corresponding relation of described voice messaging and described word or speech.
In embodiments of the present invention, the character string of preserving in the mood rule base is mainly tone auxiliary word, tone group speech be the expression tone function word, be commonly used in a tail or the sentence in pause place represent all tone.Common modal particle has:,,,,.
For example:
Are you Beijing? (the query tone)
Is it fine? (the query tone)
I have no, and you are just arduous.(indicative mood)
What do you also wonder? (the query tone)
How clever this child is! (the exclamation tone)
Modal particle: attached to word, sentence finally, the expression tone.
The inquiry tone:,
Indicative mood:,
Pray and make or sigh with feeling the tone: eh,.
Also have some words and phrases commonly used in addition: not right! If heartily, giggle, aha ... so ... wait similarly the words and phrases that can embody with special cartoon.
Wherein, the concrete form of described mood rule base can be the described form of table 1:
Field name The field implication
Type of emotion Which kind of mood description is
The mood pattern Describe the words and phrases of this kind of coupling mood, available regular expression is described
Mood represents animation Describing this mood with what animation represents
Table 1
As shown in Figure 3, use the device that cartoon shows voice messaging when also providing a kind of the conversation, comprise character string acquisition module 301, matching module 302 and display module 303 according to the said method embodiment of the invention:
Character string acquisition module 301 was used in when conversation, according to the call mode of communication ends, the voice of communication ends is converted into character string, and obtains the character string of output in real time;
Matching module 302 is used for the character string that the character string that will obtain and mood rule base preserve and mates, if the match is successful, the corresponding cartoon that then will match outputs to display module 303;
Wherein, this matching module 302 also is used for if the string matching that character string of obtaining and mood rule base are preserved is unsuccessful, and then the cartoon with the communication ends shape of the mouth as one speaks outputs to display module.
In addition, this matching module 302 also is used for reaching threshold value when the duration that communication ends is paused, and the character string that the current pause that then last time paused is preserved is formed sentence according to time sequencing; The sentence of described composition and regular expression in the sentence storehouse that prestores are mated, if the match is successful, the pairing cartoon of regular expression that matches of output then, and empty the character string of preservation.
Display module 303 is used to the cartoon that shows that described matching module is exported.
In addition, in order to strengthen voice to the accuracy of changing between the words, this device also comprises:
Proprietary voice character word stock load-on module 304, be used for according to address list, check whether communication ends has default proprietary voice character word stock to exist, if have, load described proprietary voice character word stock to internal memory, and the voice of communication ends are converted into character string will converse according to the corresponding relation of voice and words in this proprietary voice character word stock the time, wherein, comprise voice and the words corresponding relation that described communication ends is proprietary in the sub-dictionary of described proprietary voice.
Further, this proprietary voice character word stock load-on module 304 also is used for importing a word or speech from the selected specific user of address list; To the word or the speech of input, by the corresponding speech information of microphone input; Preserve the corresponding relation of described voice messaging and described word or speech.
Use the method and apparatus of the embodiment of the invention, can increase user's communication enjoyment, can the other side's image by cartoon vividly change, lovelyization.In addition, owing to be based on the simple text analyzing emotional status of deriving, implement uncomplicatedly, occupying system resources is also few.This software also can be used for visual telephone, the networking telephone.Pacify the personnel's of receiving calls mood, the other side's various moods (indignation, impatient etc.) are all shown with cartoon, can make those who answer's mood be not easy to be influenced, thereby keep better state to be used for work by the other side.
Device of the present invention is not limited to the embodiment described in the embodiment, and those skilled in the art's technical scheme according to the present invention draws other execution mode, belongs to technological innovation scope of the present invention equally.Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, if of the present invention these are revised and modification belongs within the scope of claim of the present invention and equivalent technologies thereof, then the present invention also is intended to comprise these changes and modification interior.

Claims (12)

1. use the method that cartoon shows voice messaging when conversing for one kind, it is characterized in that, comprising:
During conversation,, the voice of described communication ends are converted into character string, and obtain the described character string of output in real time according to the call mode of communication ends;
The character string of preserving in the described character string obtained and the mood rule base is mated,, then on screen, show the cartoon of the character string correspondence that matches if the match is successful.
2. the method for claim 1 is characterized in that, described call mode is: headset mode or hands-free mode.
3. the method for claim 1 is characterized in that, if coupling is unsuccessful, then with the voice frequency of communication ends, shows the cartoon of the conversation shape of the mouth as one speaks.
4. the method for claim 1 is characterized in that, after the described character string of obtaining output in real time, further preserves the character string that gets access to, then
The duration that pauses when communication ends reaches threshold value, and the character string that the current pause that then last time paused is preserved is formed sentence according to time sequencing;
Regular expression in described sentence of forming and the sentence storehouse that prestores is mated,, then export the pairing cartoon of regular expression that matches, and empty the character string of preservation if the match is successful.
5. the method for claim 1 is characterized in that, during conversation, the voice messaging that obtains both call sides is converted into character string, shows on screen that then the cartoon of the emotional state correspondence that matches comprises:
On screen, show two cartoons, show the cartoon of the special mood correspondence of both call sides respectively.
6. the method for claim 1 is characterized in that, the voice of communication ends are converted into before the character string during described will the conversation, further comprise:
According to address list, check whether communication ends has default proprietary voice character word stock to exist, if have, load described proprietary voice character word stock to internal memory, and the voice of communication ends are converted into character string will converse according to the corresponding relation of voice and words in this proprietary voice character word stock the time, wherein, comprise voice and the words corresponding relation that described communication ends is proprietary in the sub-dictionary of described proprietary voice.
7. method as claimed in claim 6 is characterized in that, described proprietary voice character word stock is set comprises:
Selected specific user from address list, the input words;
Import the speech information of described words correspondence by microphone;
Preserve the corresponding relation of described voice messaging and described word or speech.
8. use the device that cartoon shows voice messaging when conversing for one kind, it is characterized in that, comprise character string acquisition module, matching module and display module:
The character string acquisition module was used in when conversation, according to the call mode of communication ends, the voice of communication ends is converted into character string, and obtains the character string of output in real time;
Matching module is used for the character string that the character string that will obtain and mood rule base preserve and mates, if the match is successful, the corresponding cartoon that then will match outputs to display module;
Display module is used to the cartoon that shows that described matching module is exported.
9. device as claimed in claim 8 is characterized in that, described matching module also is used for if the string matching that character string of obtaining and mood rule base are preserved is unsuccessful, and then the cartoon with the communication ends shape of the mouth as one speaks outputs to display module.
10. device as claimed in claim 8 is characterized in that, described matching module also is used for reaching threshold value when the duration that communication ends is paused, and the character string that the current pause that then last time paused is preserved is formed sentence according to time sequencing; The sentence of described composition and regular expression in the sentence storehouse that prestores are mated, if the match is successful, the pairing cartoon of regular expression that matches of output then, and empty the character string of preservation.
11. device as claimed in claim 8 is characterized in that, this device also comprises:
Proprietary voice character word stock load-on module, be used for according to address list, check whether communication ends has default proprietary voice character word stock to exist, if have, load described proprietary voice character word stock to internal memory, and the voice of communication ends are converted into character string will converse according to the corresponding relation of voice and words in this proprietary voice character word stock the time, wherein, comprise voice and the words corresponding relation that described communication ends is proprietary in the sub-dictionary of described proprietary voice.
12. device as claimed in claim 11 is characterized in that, described proprietary voice character word stock load-on module also is used for importing a word or speech from the selected specific user of address list; To the word or the speech of input, by the corresponding speech information of microphone input; Preserve the corresponding relation of described voice messaging and described word or speech.
CN200910261240A 2009-12-21 2009-12-21 Method and equipment to display the speech information by application of cartoons Pending CN101741953A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN200910261240A CN101741953A (en) 2009-12-21 2009-12-21 Method and equipment to display the speech information by application of cartoons

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200910261240A CN101741953A (en) 2009-12-21 2009-12-21 Method and equipment to display the speech information by application of cartoons

Publications (1)

Publication Number Publication Date
CN101741953A true CN101741953A (en) 2010-06-16

Family

ID=42464823

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200910261240A Pending CN101741953A (en) 2009-12-21 2009-12-21 Method and equipment to display the speech information by application of cartoons

Country Status (1)

Country Link
CN (1) CN101741953A (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102568023A (en) * 2010-11-19 2012-07-11 微软公司 Real-time animation for an expressive avatar
WO2013189243A1 (en) * 2012-06-20 2013-12-27 腾讯科技(深圳)有限公司 Mobile device communication method, apparatus and communication system
CN103873642A (en) * 2012-12-10 2014-06-18 北京三星通信技术研究有限公司 Method and device for recording call log
CN103905644A (en) * 2014-03-27 2014-07-02 郑明� Generating method and equipment of mobile terminal call interface
CN104144108A (en) * 2013-09-30 2014-11-12 腾讯科技(深圳)有限公司 Information response method, device and system
CN104407834A (en) * 2014-11-13 2015-03-11 腾讯科技(成都)有限公司 Message input method and device
CN104468959A (en) * 2013-09-25 2015-03-25 中兴通讯股份有限公司 Method, device and mobile terminal displaying image in communication process of mobile terminal
CN104780338A (en) * 2015-04-16 2015-07-15 美国掌赢信息科技有限公司 Method and electronic equipment for loading expression effect animation in instant video
CN104994000A (en) * 2015-06-16 2015-10-21 青岛海信移动通信技术股份有限公司 Method and device for dynamic presentation of image
CN105744090A (en) * 2014-12-09 2016-07-06 阿里巴巴集团控股有限公司 Voice information processing method and device
CN106024014A (en) * 2016-05-24 2016-10-12 努比亚技术有限公司 Voice conversion method and device and mobile terminal
CN107040452A (en) * 2017-02-08 2017-08-11 浙江翼信科技有限公司 A kind of information processing method, device and computer-readable recording medium
CN108595406A (en) * 2018-01-04 2018-09-28 广东小天才科技有限公司 User state reminding method and device, electronic equipment and storage medium
CN109768913A (en) * 2018-12-11 2019-05-17 平安科技(深圳)有限公司 Information processing method, device, computer equipment and storage medium

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102568023A (en) * 2010-11-19 2012-07-11 微软公司 Real-time animation for an expressive avatar
WO2013189243A1 (en) * 2012-06-20 2013-12-27 腾讯科技(深圳)有限公司 Mobile device communication method, apparatus and communication system
CN103516867A (en) * 2012-06-20 2014-01-15 腾讯科技(深圳)有限公司 Mobile equipment communication method, mobile equipment communication device and communication system
CN103873642A (en) * 2012-12-10 2014-06-18 北京三星通信技术研究有限公司 Method and device for recording call log
CN104468959A (en) * 2013-09-25 2015-03-25 中兴通讯股份有限公司 Method, device and mobile terminal displaying image in communication process of mobile terminal
CN104144108A (en) * 2013-09-30 2014-11-12 腾讯科技(深圳)有限公司 Information response method, device and system
CN104144108B (en) * 2013-09-30 2017-07-25 腾讯科技(深圳)有限公司 A kind of message responding method, apparatus and system
CN103905644A (en) * 2014-03-27 2014-07-02 郑明� Generating method and equipment of mobile terminal call interface
CN104407834A (en) * 2014-11-13 2015-03-11 腾讯科技(成都)有限公司 Message input method and device
CN105744090A (en) * 2014-12-09 2016-07-06 阿里巴巴集团控股有限公司 Voice information processing method and device
US10708423B2 (en) 2014-12-09 2020-07-07 Alibaba Group Holding Limited Method and apparatus for processing voice information to determine emotion based on volume and pacing of the voice
CN104780338A (en) * 2015-04-16 2015-07-15 美国掌赢信息科技有限公司 Method and electronic equipment for loading expression effect animation in instant video
CN104994000A (en) * 2015-06-16 2015-10-21 青岛海信移动通信技术股份有限公司 Method and device for dynamic presentation of image
CN106024014A (en) * 2016-05-24 2016-10-12 努比亚技术有限公司 Voice conversion method and device and mobile terminal
CN107040452A (en) * 2017-02-08 2017-08-11 浙江翼信科技有限公司 A kind of information processing method, device and computer-readable recording medium
CN107040452B (en) * 2017-02-08 2020-08-04 浙江翼信科技有限公司 Information processing method and device and computer readable storage medium
CN108595406A (en) * 2018-01-04 2018-09-28 广东小天才科技有限公司 User state reminding method and device, electronic equipment and storage medium
CN109768913A (en) * 2018-12-11 2019-05-17 平安科技(深圳)有限公司 Information processing method, device, computer equipment and storage medium

Similar Documents

Publication Publication Date Title
CN101741953A (en) Method and equipment to display the speech information by application of cartoons
US8655659B2 (en) Personalized text-to-speech synthesis and personalized speech feature extraction
CN100481851C (en) Avatar control using a communication device
US8373799B2 (en) Visual effects for video calls
CN104468959A (en) Method, device and mobile terminal displaying image in communication process of mobile terminal
CN102811284A (en) Method for automatically translating voice input into target language
CN103973877A (en) Method and device for using characters to realize real-time communication in mobile terminal
CN102821196A (en) Text-speech matching conversation method of mobile terminal as well as mobile terminal thereof
CA2539649C (en) System and method for personalized text-to-voice synthesis
CN101742726A (en) Mobile terminal and method for changing short message displaying model according to address list
EP3174052A1 (en) Method and device for realizing voice message visualization service
KR20150017662A (en) Method, apparatus and storing medium for text to speech conversion
CN111768786B (en) Deaf-mute conversation intelligent terminal platform and conversation method thereof
KR101609585B1 (en) Mobile terminal for hearing impaired person
CN108920471A (en) A kind of voice translation method and electronic equipment
CN102364965A (en) Refined display method of mobile phone communication information
JP2014167517A (en) Conversation providing system, game providing system, conversation providing method, game providing method, and program
CN108965614A (en) A kind of call interpretation method and system
KR20000072073A (en) Method of Practicing Automatic Simultaneous Interpretation Using Voice Recognition and Text-to-Speech, and System thereof
CN105227765A (en) Interactive approach in communication process and system
US20140314214A1 (en) Communication between users of a telephone system
KR20090054609A (en) Voip telephone communication system and method for providing users with telephone communication service comprising emotional contents effect
JP4232453B2 (en) Call voice text conversion system
KR20030006414A (en) Chatting method for mobile communication device using image
CN109559760A (en) A kind of sentiment analysis method and system based on voice messaging

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20100616