CN110519459A

CN110519459A - Voice processing method and device, terminal equipment and computer readable storage medium

Info

Publication number: CN110519459A
Application number: CN201910798092.5A
Authority: CN
Inventors: 张腾飞
Original assignee: Guangdong Genius Technology Co Ltd
Current assignee: Guangdong Genius Technology Co Ltd
Priority date: 2019-08-27
Filing date: 2019-08-27
Publication date: 2019-11-29

Abstract

The invention provides a voice processing method and device, terminal equipment and a computer readable storage medium, wherein the voice processing method comprises the following steps: monitoring whether the current position is in a position sharing state; if yes, further monitoring whether the position sharing page receives the voice message; if so, converting the received voice message into a text message and displaying the text message in a position sharing page for reading by a user, wherein the content displayed in the position sharing page comprises the ID of the voice message sending end and the text message obtained by converting the voice message. When the mobile terminal is in the position sharing state, the voice message is converted into the text message and displayed in the position sharing page for viewing, so that the situation that a user who cannot pay attention to the position sharing page in real time and a user who cannot hear the voice message clearly due to noisy environment can receive the voice message sent by the other side in time during position sharing is guaranteed, smooth communication is kept, the use experience of the position sharing function is improved, and convenience is brought to the user.

Description

Method of speech processing and device, terminal device, computer readable storage medium

Technical field

It is espespecially a kind of method of speech processing and device, terminal device, computer-readable the present invention relates to field of communication technology Storage medium.

Background technique

It is more and more for the application APP of Orientation on map with the fast development of the communication technology and location technology.One side Face accurately obtains the location of user by positioning methods such as the GPS positionings of intelligent terminal, on the other hand, is applying APP On the basis of provide various functions based on being positioned as user, such as the position sharing functionality in wechat.

When user wishes to know other people relativeness with oneself present position, especially short-distance and medium-distance, which are met and discussed, is looked for not When to other side, the location information of itself and the location information of other side can be shown simultaneously by the position sharing functionality in wechat In a map, the specific location and the direction of motion of the clear other side of user are helped, the time that both sides meet and discuss is estimated.In this mistake Cheng Zhong, both sides directly can also share the page in position by the intercommunication function in the sharing functionality of position and link up, convenient for entangling in time Just or confirmation other side current location.

But have the following problems in actual scene: on the one hand, user is walking, is cycling or drive etc. under states It is difficult to be always maintained at the concern of page info in shared to position, is easy to ignore the speech message that intercommunication function issues；Another party Face, if being in environment such as street, the noisy markets of clamour, user is difficult not hearing the speech message of other side's transmission.As it can be seen that In In the shared procedure of position, if both sides are talked by speech talkback function, information is difficult to effectively convey in most cases, and effect is not It is particularly evident.

Summary of the invention

The object of the present invention is to provide a kind of method of speech processing and device, terminal device, computer readable storage medium, Effectively solve the technical issues of existing user cannot receive speech message in time during existing position functions.

Technical solution provided by the invention is as follows:

A kind of method of speech processing, comprising:

It monitors current whether in the shared state in position；

If so, further monitoring position shares in the page whether receive speech message；

It is shown in the page if so, being converted to word message and sharing in the position received speech message for user's reading It takes, it includes the ID of speech message transmitting terminal and the text that speech message is converted to that the content shown in the page is shared in the position Message.

In the above-mentioned technical solutions, when sharing state in position, receiving speech message, (speech message passes through position Intercom function is mutually sent in the shared page) after be converted to word message and be shown in position and share in the page for for looking into It sees, guarantees to pay close attention to position when position is shared in real time and share the user of the page and voice can be heard because environment is noisy to disappear with this The user of breath can receive the speech message of other side's transmission in time, keep communication smooth, and raised position sharing functionality uses body It tests, provides convenience for user.

Further, received speech message is converted to word message and shared in the page in the position and shown for user In reading, further comprise:

Received speech message is converted into word message；

Judge current location to share under state and whether receives speech message for the first time；

If so, sharing the floating window of text window of the pop-up comprising the word message in the page in the position；

The click event whether having for the floating window monitored；

The text window is popped up if so, sharing in the page in the position, shows that the word message is read for user.

In the above-mentioned technical solutions, after receiving speech message for the first time and being converted to word message, position is deposited in It sets in the floating window in the shared page, with this, floating window can be clicked when user can not listen speech message in time, passes through the text of pop-up Word window checks word message, and user is avoided to be not easy to directly use position that can not connect in time when sharing intercom function in the page The case where receiving the speech message that other side sends occurs, and promotes the communication efficiency of user.

Further, it is shared in the page in the position and pops up the text window, show that the word message is read for user After taking, further includes:

The click event whether having for the text window monitored；

If so, the text window rebounds, floating window state floats on the shared page in the position, and will be in text window The word message of unmarked state is marked as read state.

In the above-mentioned technical solutions, checking when text window pop-up user's completion word message, especially cuts in user When changing to intercom function convenient to use, the click event that user can share in the page by position rebounds text window floating Window-like state realizes user speech message sink and the received free switching of word message.In addition, both sides can be recorded in text window The process that voice communication is carried out using intercom avoids user from forgeing dialog context.

Further, whether received in speech message for the first time in the case where judging that state is shared in current location, if judging current location It is not to receive speech message for the first time under shared state, then

Detect the position shares the floating window whether having in the page for word message；

If so, the word message being converted to be made an addition in floating window to the lower section for having word message, and Mark as Unread State；

If no, further detecting the position shares in the page whether show text window；

If so, the word message being converted to directly is shown in the text window, and Mark as Unread state；

If no, sharing the floating window of text window of the pop-up comprising the word message in the page into the position Step.

In the above-mentioned technical solutions, when not receiving speech message for the first time, successively detecting position and sharing in the page is No to have floating window or text window, the word message that speech message is converted to is added, and is shown when convenient for needing.

The present invention also provides a kind of voice processing apparatus, comprising:

Monitor module, for monitor it is current whether in position share state, and shared in the page for monitoring position and be No reception speech message；

The text conversion module connecting with the monitoring module is converted to for will monitor the speech message that module listens to Word message；

The display module connecting with the text conversion module, shares for showing the word message in the position It is read in the page for user, the ID and speech message that the content shown in the page includes speech message transmitting terminal are shared in the position The word message being converted to.

In the above-mentioned technical solutions, when sharing state in position, speech message that text conversion module will receive (speech message is shared intercom function in the page by position and mutually sent) is converted to word message and is shown by display module Show and shares in the page in position for the user that the page is shared in position for checking, cannot be paid close attention to when guaranteeing that position is shared with this in real time And because the noisy user that can hear speech message of environment can receive the speech message of other side's transmission in time, keep ditch clear and coherent Freely, the usage experience of raised position sharing functionality provides convenience for user.

Further, in the voice processing apparatus further include:

Whether judgment module receives speech message for judging current location to share under state for the first time；

The pop-up module being connect respectively with the judgment module and monitoring module, for the judging result according to judgment module The floating window of text window of the pop-up comprising the word message in the page is shared in the position；And according to the monitoring for monitoring module As a result it is shared in the page in the position and pops up the text window；

The module of monitoring is also used to that the click event whether having for the floating window monitored.

In the above-mentioned technical solutions, when judgment module judgement receives speech message for the first time and is converted to word message Afterwards, it is deposited in the floating window that position is shared in the page, with this, can be clicked when user can not listen speech message in time floating Window checks word message by the text window of pop-up, and user is avoided to be not easy to that position is directly used to share intercom in the page The case where speech message of other side's transmission can not be received when function in time appearance, promotes the communication efficiency of user.

Further, the module of monitoring is also used to that the click event whether having for the text window monitored；

When the monitoring module listens to the click event for the text window, the pop-up module is by the text Word window rebound floating window state float on the position share the page, and will in text window be in unmarked state word message It is marked as read state.

Further, in the voice processing apparatus further include:

The detection module being connect respectively with display module and pop-up module, for detect the position share the page in whether There is the floating window for word message, and shares in the page whether show text window for detecting the position；

When detecting that position shares and have floating window for word message, the text that the display module will be converted in the page Word message makes an addition in floating window the lower section for having word message, and Mark as Unread state；

When detect position share the page in do not have for word message floating window but show text window, the display Module directly shows the word message being converted in the text window, and Mark as Unread state；

Do not have to be directed to the floating window of word message and without display text window, the bullet in the shared page in position when detecting Window module shares the floating window of text window of the pop-up comprising the word message in the page in the position.

The present invention also provides a kind of terminal device, including memory, processor and storage are in the memory simultaneously The computer program that can be run on the processor, the processor realize any of the above-described when running the computer program The step of method of speech processing.

The present invention also provides a kind of computer readable storage medium, the computer-readable recording medium storage has calculating Machine program, when the computer program is executed by processor the step of method of speech processing described in realization any of the above-described.

In method of speech processing provided by the invention and device, terminal device, computer readable storage medium, work as user When using intercommunication function in the sharing functionality of position, speech message will be received and change into word message in real time and show and shared in position In interface, and when the word message being shown in the shared interface in position is not checked, word message suffix shows and does not check；When After word message is checked, word message suffix, which is shown, have been checked.Position cannot be paid close attention in real time by, which guaranteeing in this way, is total to The user that enjoys the page or because the noisy user that can hear speech message of environment can receive the speech message of other side's transmission in time, It keeps communication smooth, promotes the usage experience of existing position sharing functionality.

Detailed description of the invention

Below by clearly understandable mode, preferred embodiment is described with reference to the drawings, to above-mentioned characteristic, technical characteristic, excellent Point and its implementation are further described.

Fig. 1 is the flow chart of method of speech processing first embodiment in the present invention；

Fig. 2 is the flow chart of method of speech processing second embodiment in the present invention；

Fig. 3 is the flow chart of method of speech processing 3rd embodiment in the present invention；

Fig. 4 is the flow chart of method of speech processing fourth embodiment in the present invention；

Fig. 5 is the structural schematic diagram of voice processing apparatus sixth embodiment in the present invention；

Fig. 6 is the structural schematic diagram of the 7th embodiment of voice processing apparatus in the present invention；

Fig. 7 is the structural schematic diagram of the 9th embodiment of voice processing apparatus in the present invention；

Fig. 8 is the structural schematic diagram of one embodiment of terminal device in the present invention.

Drawing reference numeral explanation:

100- voice processing apparatus, 110- monitor module, 120- text conversion module, 130- display module, 140- judgement Module, 150- pop-up module, 160- detection module.

Specific embodiment

In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, Detailed description of the invention will be compareed below Specific embodiments of the present invention.It should be evident that drawings in the following description are only some embodiments of the invention, for this For the those of ordinary skill of field, without creative efforts, it can also be obtained according to these attached drawings others Attached drawing, and obtain other embodiments.

The first embodiment of the present invention, a kind of method of speech processing, comprising: whether S10 monitors current shared in position State；S20 is if so, further monitoring position shares in the page whether receive speech message；S30 is if so, received voice is disappeared Breath, which is converted to word message and shares in position, shows that, for user's reading, position shares the content shown in the page and includes in the page The word message that the ID and speech message of speech message transmitting terminal are converted to.

In the present embodiment, position sharing functionality is specially simultaneously by the location information of at least two users in same map It is shown in (sharing the page in position), convenient for the mutually clear location information of user that position is shared, is especially touched in short-distance and medium-distance Head but while can not find other side, can help the specific location of the clear other side of user (other users for removing itself are referred to as other side) And the direction of motion.Removing has except the sharing functionality of position, and the basis of the present embodiment also resides in the intercommunication in the shared page in position Machine function shares both sides or directly carries out voice communication by the intercom function in many ways, link up in time when position is shared. In practical applications, the method for speech processing that this example provides can be applied to arbitrarily include that position sharing functionality and position are shared The application APP of intercom function in the page, such as wechat, are not specifically limited here.

In speech processes, first listen to it is current whether in position share state, when listening to, to be not at position shared State does not do subsequent processing, lasting to monitor；State is shared in position when listening to, further monitors whether start intercom Function simultaneously receives speech message, if receiving speech message, speech message is converted to word message and carries out display confession User checks, with this, user can receive in time other side's hair when being not easy to and receiving speech message according to the word message of conversion The speech message sent keeps linking up smooth, the usage experience of raised position sharing functionality.

Monitoring whether current whether share in state and the shared page of monitoring position in position receives in speech message, Only listen to be currently at position share state Shi Caihui enter monitoring position share the page in whether receive speech message Program.In addition, due in this example method of speech processing be applied to apply APP, therefore only start using after APP, just into Enter to monitor current the step of whether sharing state in position.The frequency of monitoring can be set according to the actual situation, such as be set It is primary current whether in the shared state in position to be set to the monitorings such as every 10s, 20s, 30s, whether the monitorings such as every 2s, 5s once receive Speech message etc..

The method that speech message is converted to word message is not specifically limited here, arbitrarily can be realized the purpose Conversion method be included in this example.The word message being converted to shares display position and display in the page in position Form is equally not specifically limited here, the bottom section as shared the page in position is shown in a textbox be converted to Word message, when word message is excessive, user checked by way of adjusting progress bar before content etc..

For the word message of display, when word message is not checked, word message suffix shows and does not check；Work as text After message is checked, word message suffix, which is shown, have been checked, i.e., further includes according to after word message after step S30 Sew the step of judging word message reception condition.It should be noted that here the reception state of the shared square word message in position be it is synchronous, Voice message originator judges the reception state of speech message recipient's word message according to the state of corresponding word message.In Speech message recipient determines whether word message has been checked by preset mode, e.g., receives new voice and disappear After breath, phonetic incepting side clicks the text importing page, phonetic incepting side has dragged progress bar etc..Since the shared side in position is permissible For more people, therefore after a certain word message is checked by a user, it further includes this in suffix that which showed, which has checked, The ID of user；It is directed to same word message, every to increase by one and check user, what word message was shown, which checked in suffix, increases The ID of relative users.

In one example, 3 users (user A, user B and user C) share state in position simultaneously, start intercom function Can, when user A sends a speech message, user B and user C receive speech message and are converted to word message and show respectively Afterwards, when user B has checked the word message, then the suffix of the word message adds and includes in user A, user B and user C The state that user B has been checked；Hereafter, when user C has also checked the word message, then text in user A, user B and user C The suffix of message further adds the state checked comprising user C.

The second embodiment of the present invention is the optimal enforcement example of above-mentioned first embodiment, as shown in Fig. 2, the speech processes It include: whether S10 monitors currently in the shared state in position in method；S20 if so, be further in the shared page of monitoring position No reception speech message；S31 is if so, be converted to word message for received speech message；S32 judges that state is shared in current location Under whether receive speech message for the first time；S33 is if so, share the floating of the text window that pop-up in the page includes word message in position Window；S34 monitors the click event whether having for floating window；S35 pops up text window if so, sharing in position in the page, display Word message is read for user, and the content shown in text window includes that the ID of speech message transmitting terminal and speech message are converted The word message arrived.

In the present embodiment speech processes, first listens to the current position that whether is in and share state, be not at when listening to State is shared in position, does not do subsequent processing, lasting to monitor；State is shared in position when listening to, further monitors and whether opens Dynamic intercom function simultaneously receives speech message, if receiving speech message, is converted into word message immediately and judges to work as Share whether receive speech message for the first time under state in front position.If judgement is to receive voice for the first time under the shared state in current location to disappear Breath shares the floating window of text window of the pop-up comprising word message in the page in position.Whether it is directed at this point, further monitoring The click event of floating window；If there is the click event for floating window, shared in position and pop up text window in the page, shows text Message is read for user；On the contrary, continuing to disappear the voice newly received if not listening to the click event for floating window The word message being converted to is ceased to be added into the page of floating window.

It is current whether in state is shared in position, monitoring position shares in the page whether receive speech message and prison monitoring Whether listen has in the click event for floating window, only listen to be currently at position share state Shi Caihui enter monitor position It sets the step of whether receiving speech message in the shared page, only position, which is shared, whether floating window just has needle into monitoring in the page The step of to the click event of floating window.In addition, due in this example method of speech processing be applied to apply APP, therefore only start After application APP, just enters and monitor current the step of whether sharing state in position.The frequency of monitoring can be according to practical feelings Condition is set, such as is set as the primary current position that whether is in of every 10s, 20s, 30s monitoring and is shared state, every 2s, 5s etc. It monitors and once whether receives speech message, whether the monitorings such as every 1s, 2s, 3s once have the click event for floating window.

The method that speech message is converted to word message is not specifically limited here, arbitrarily can be realized the purpose Conversion method be included in this example.For the word message of display, when word message is not checked, after word message Sew display not check；After word message is checked, word message suffix, which is shown, have been checked, i.e., after step S35, also wraps Include the step of word message reception condition is judged according to the suffix of word message.It should be noted that square word message is shared in position here Reception state be it is synchronous, voice message originator judges speech message recipient text according to the state of corresponding word message The reception state of word message.In speech message recipient, determine whether word message has been checked by preset mode, Such as, after receiving new speech message, phonetic incepting side clicks the text importing page, phonetic incepting side has dragged progress bar Deng.It can work as after a certain word message checked by a user with for more people since position is shared, what which showed Checked further include in suffix the user ID；It is directed to same word message, user is checked in every increase by one, and word message is aobvious That shows has checked in suffix the ID for increasing relative users.

The floating window of pop-up may be displayed on any position that the page is shared in position, can also be switched by the drag operation of user Display position.The display position of the text window popped up by click floating window shows size, shares the mobile side of the page in position Formula, window size adjustment mode etc. can preset restrictive rule, e.g., be limited to fixed size, display in position The fixation position of the shared page passes through shift position, the adjusting window in such a way that multiconductor contacts text window by way of dragging Mouth size etc.；For another example, it limits text window and position is shared the display scale (3/4,1/2 etc.) of the page and limited text window It is shown in the center etc. that the page is shared in position.

Third embodiment of the invention is the optimal enforcement example of above-mentioned second embodiment, as shown in figure 3, the speech processes side It include: whether S10 monitors currently in the shared state in position in method；S20 if so, further monitoring position share the page in whether Receive speech message；S31 is if so, be converted to word message for received speech message；S32 judges that current location is shared under state Whether speech message is received for the first time；S33 is if so, share the floating of the text window that pop-up in the page includes word message in position Window；S34 monitors the click event whether having for floating window；S35 pops up text window if so, sharing in position in the page, display Word message is read for user, and the content shown in text window includes that the ID of speech message transmitting terminal and speech message are converted The word message arrived；S36 monitors the click event whether having for text window；S37 floating window state if so, text window rebounds Float on position and share the page, and the word message for being in unmarked state in text window is marked as read state.

In the present embodiment speech processes, first listens to the current position that whether is in and share state, be not at when listening to State is shared in position, does not do subsequent processing, lasting to monitor；State is shared in position when listening to, further monitors and whether opens Dynamic intercom function simultaneously receives speech message, if receiving speech message, is converted into word message immediately and judges to work as Share whether receive speech message for the first time under state in front position.If judgement is to receive voice for the first time under the shared state in current location to disappear Breath shares the floating window of text window of the pop-up comprising word message in the page in position.Whether it is directed at this point, further monitoring The click event of floating window；If there is the click event for floating window, shared in position and pop up text window in the page, shows text Message is read for user；On the contrary, continuing to disappear the voice newly received if not listening to the click event for floating window The word message being converted to is ceased to be added into the page of floating window.After position, which is shared, pops up text window in the page, into one Step monitors the click event whether having for text window；If so, text window rebounds, floating window state floats on the shared page in position, And the word message that unmarked state is in text window is marked as read state；If no, continuing to share page in position Text window, and the word message that continuous updating receives are shown in face.

Share in the shared page of state, monitoring position whether receive speech message, prison monitoring the current position that whether is in Whether have in click event for text window, only listen to current if listening whether to have the click event for floating window and monitor State Shi Caihui, which is shared, in position enters the step of whether receiving speech message in the shared page of monitoring position, only position There is floating window just into monitoring whether have the step of click event for floating window in the shared page, only position is shared has in the page Whether text window just has the step of click event for text window into monitoring.In addition, due in this example at voice Whether reason method is applied to using APP, therefore only start current in the shared state in position using monitoring after APP, is just entered The step of.The frequency of monitoring can be set according to the actual situation, such as to be set as every 10s, 20s, 30s monitoring once current Whether in the shared state in position, whether the monitorings such as every 2s, 5s once receive speech message, and the monitorings such as every 1s, 2s, 3s are once Whether the no click event having for floating window, the monitorings such as every 1s, 2s, 3s once have the click event for text window.

The method that speech message is converted to word message is not specifically limited here, arbitrarily can be realized the purpose Conversion method be included in this example.For the word message of display, when word message is not checked, after word message Sew display not check；After word message is checked, word message suffix, which is shown, have been checked, i.e., after step S35, also wraps Include the step of word message reception condition is judged according to the suffix of word message.It should be noted that square word message is shared in position here Reception state be it is synchronous, voice message originator judges speech message recipient text according to the state of corresponding word message The reception state of word message.In speech message recipient, determine whether word message has been checked by preset mode, In this example, when there is the click event of text window, default the text that the user has read in text window and disappear All word messages in text window are marked as read state by breath.In some special situations, (user is in noise for a long time Miscellaneous environment etc.) under, text window interface may share in the page in position for a long time to be shown, configures other simultaneously in this example Mode judges whether word message is checked, e.g., (is specially converted to word message after receiving new speech message Afterwards), phonetic incepting side clicks the text importing page, phonetic incepting side has dragged progress bar etc..Once occurring for text The click event of window judges with the presence or absence of the word message for being labeled as not checking in text window, if so, its message is marked To have read.In addition, can work as after a certain word message checked by a user, the text with for more people since position is shared What message was shown has checked further include in suffix the user ID；It is directed to same word message, user is checked in every increase by one, What word message was shown has checked in suffix the ID for increasing relative users.It is true by predetermined manner for the click event of text window It is fixed, as clicked a certain position of fixation on text window；For another example click the region etc. that text window is removed in the sharing position page.

Fourth embodiment of the invention is the optimal enforcement example of above-mentioned second embodiment, as shown in figure 4, the speech processes side It include: whether S10 monitors currently in the shared state in position in method；S20 if so, further monitoring position share the page in whether Receive speech message；S31 is if so, be converted to word message for received speech message；S32 judges that current location is shared under state Whether speech message is received for the first time；S33 is if so, share the floating of the text window that pop-up in the page includes word message in position Window；S34 monitors the click event whether having for floating window；S35 pops up text window if so, sharing in position in the page, display Word message is read for user, and the content shown in text window includes that the ID of speech message transmitting terminal and speech message are converted The word message arrived.If judging that position is shared under state in step s 32 is not to receive speech message for the first time, enter following step It is rapid: the floating window whether having in the page for word message to be shared in S38 detection position；S39 is if so, the word message that will be converted to It makes an addition in floating window and has the lower section of word message, and Mark as Unread state；If S40 does not have, it is shared further to detect position Whether text window is shown in the page；S41 if so, the word message being converted to directly is shown in text window, and Mark as Unread state；If no, going to step S33.

In the present embodiment speech processes, first listens to the current position that whether is in and share state, be not at when listening to State is shared in position, does not do subsequent processing, lasting to monitor；State is shared in position when listening to, further monitors and whether opens Dynamic intercom function simultaneously receives speech message, if receiving speech message, is converted into word message immediately and judges to work as Share whether receive speech message for the first time under state in front position.If judgement is to receive voice for the first time under the shared state in current location to disappear Breath shares the floating window of text window of the pop-up comprising word message in the page in position.Whether it is directed at this point, further monitoring The click event of floating window；If there is the click event for floating window, shared in position and pop up text window in the page, shows text Message is read for user；On the contrary, continuing to disappear the voice newly received if not listening to the click event for floating window The word message being converted to is ceased to be added into the page of floating window.In addition, judging that the position is shared when receiving speech message It is not to receive speech message for the first time under state, then detects position shares the floating window whether having in the page for word message；If so, The word message being converted to is made an addition in floating window to the lower section for having word message, and Mark as Unread state；If no, into Share in the page whether show text window in one step detection position；If so, by the word message being converted to directly in text It is shown in window, same Mark as Unread state；If no, judgement be likely to occur the system failure or artificially close floating window/ Text window then shares in the page floating window of text window of the pop-up comprising word message again in position.

For the word message of display, when word message is not checked, word message suffix shows and does not check；Work as text After message is checked, word message suffix, which is shown, have been checked, i.e., further includes according to after word message after step S35 Sew the step of judging word message reception condition.It should be noted that here the reception state of the shared square word message in position be it is synchronous, Voice message originator judges the reception state of speech message recipient's word message according to the state of corresponding word message.In Speech message recipient determines whether word message has been checked by preset mode, e.g., receives new voice and disappear After breath, phonetic incepting side clicks the text importing page, phonetic incepting side has dragged progress bar etc..Since the shared side in position is permissible For more people, therefore after a certain word message is checked by a user, it further includes this in suffix that which showed, which has checked, The ID of user；It is directed to same word message, every to increase by one and check user, what word message was shown, which checked in suffix, increases The ID of relative users.

Fifth embodiment of the invention is the optimal enforcement example of above-mentioned 3rd embodiment, in this example speech processes, first It monitors the current position that whether is in and shares state, be not at the shared state in position when listening to, do not do subsequent processing, it is lasting to supervise It listens；State is shared in position when listening to, further monitors and whether starts intercom function and receive speech message, if connecing Speech message is received, be converted into word message immediately and judges that current location shares under state whether for the first time reception voice disappears Breath.If judgement is that current location shares and receives speech message for the first time under state, pop-up is shared in the page in position and is disappeared comprising text The floating window of the text window of breath.At this point, the click event whether having for floating window further monitored；If there is the click for floating window Event is then shared in position and pops up text window in the page, and display word message is read for user；On the contrary, if not listening to There is the click event for floating window, then continues the word message that the speech message newly received is converted to being added into floating window In the page.In addition, judging that the position is shared under state when receiving speech message is not to receive speech message for the first time, then detect The floating window whether having in the page for word message shared in position；If so, the word message being converted to is made an addition in floating window The lower section of existing word message, and Mark as Unread state；If no, further whether being shown in the shared page in detection position Text window；If so, the word message being converted to directly is shown in text window, same Mark as Unread state；If No, judgement has been likely to occur the system failure or has artificially closed floating window/text window, then shares in the page again in position The floating window of text window of the pop-up comprising word message.After position, which is shared, pops up text window in the page, further monitor Whether click event for text window is had；If so, text window rebounds, floating window state floats on the shared page in position, and will be literary Word message in word window in unmarked state is marked as read state；If no, continuing to share in the page in position shows Show text window, and the word message that continuous updating receives.

The sixth embodiment of the present invention, a kind of voice processing apparatus 100, as shown in Figure 5, comprising:

Module 110 is monitored, it is current whether in the shared state in position for monitoring, and be used for monitoring position and share in the page Whether speech message is received；

The text conversion module 120 being connect with monitoring module 110, the speech message listened to for module 110 will to be monitored Be converted to word message；

The display module 130 connecting with text conversion module 120, shares in the page for showing word message in position It is read for user, it includes that the ID of speech message transmitting terminal and speech message are converted to that the content shown in the page is shared in position Word message.

In speech processes, first listens to module 110 and whether monitor currently in the shared state in position, do not locate when listening to State is shared in position, does not do subsequent processing, it is lasting to monitor；State is shared in position when listening to, further whether is monitoring Starting intercom function simultaneously receives speech message, if receiving speech message, text conversion module 120 turns speech message It is changed to word message and is shown by display module 130 and checked for user, with this, user is being not easy to receive speech message When the speech message of other side's transmission can be received in time according to the word message of conversion, keep linking up smooth, raised position is shared The usage experience of function.

Monitor whether current whether share in state and the shared page of monitoring position in position receives monitoring module 110 In speech message, only listen to be currently at position share state Shi Caihui enter monitoring position share the page in whether connect Receive the program of speech message.In addition, due in this example method of speech processing be applied to apply APP, therefore only start application After APP, just enters and monitor current the step of whether sharing state in position.The frequency of monitoring can carry out according to the actual situation Setting, such as being set as, whether every 10s, 20s, 30s monitoring is primary current in the shared state in position, and every 2s, 5s etc. monitor one It is secondary whether to receive speech message etc..

For the method that speech message is converted to word message is not specifically limited here in text conversion module 120, The conversion method that arbitrarily can be realized the purpose is included in this example.The word message being converted to shares the page in position In display position and display format be equally not specifically limited here, the bottom section of the page is such as shared in position in a text The word message that display is converted in frame, when word message is excessive, before user is checked by way of adjusting progress bar Content etc..

For the word message of display, when word message is not checked, word message suffix shows and does not check；Work as text After message is checked, word message suffix, which is shown, have been checked, i.e., further includes in voice processing apparatus 100 and display module The message sink situation determination module of 130 connections, judges word message reception condition for the suffix according to word message.It infuses Meaning, the reception state of the shared square word message in position is synchronous here, and voice message originator is according to corresponding word message State judge the reception state of speech message recipient's word message.In speech message recipient, by preset mode Determine whether word message is checked that e.g., after receiving new speech message, phonetic incepting side clicks text importing page Face, phonetic incepting side have dragged progress bar etc..A certain word message can be worked as by a user with for more people since position is shared After checking, what which showed has checked further include in suffix the user ID；It is directed to same word message, every increasing One is added to check user, what word message was shown has checked in suffix the ID for increasing relative users.

Seventh embodiment of the invention is the optimal enforcement example of above-mentioned sixth embodiment, as shown in fig. 6, the speech processes fill It sets in 100 and includes:

Module 110 is monitored, current whether in the shared state in position for monitoring, sharing in the page for monitoring position is No reception speech message, and for monitoring the click event whether having for floating window；

Whether judgment module 140 receives speech message for judging current location to share under state for the first time；

The pop-up module 150 being connect respectively with judgment module 140 and monitoring module 110, for according to judgment module 140 Judging result shares the floating window of text window of the pop-up comprising word message in the page in position；And according to monitoring module 110 Snoop results are shared in position pops up text window in the page.

In the present embodiment speech processes, first listens to module 110 and whether monitor currently in the shared state in position, work as prison Hear that being not at position shares state, does not do subsequent processing, it is lasting to monitor；State is shared in position when listening to, further It monitors and whether starts intercom function and receive speech message, if receiving speech message, text conversion module 120 will immediately It is converted to word message and judges current location to share under state by judgment module 140 whether receive speech message for the first time. If judgement is to receive speech message under the shared state in current location for the first time, pop-up module 150 is shared in position pops up packet in the page The floating window of text window containing word message.At this point, monitoring module 110 further monitors the click thing whether having for floating window Part；If there is the click event for floating window, pop-up module 150 is shared in position pops up text window in the page, and by aobvious Show that module 130 shows that word message is read for user；On the contrary, if monitoring module 110 does not listen to the click for floating window Event then continues for the word message that the speech message newly received is converted to be added into the page of floating window.

Monitor whether current whether share in the shared page of state, monitoring position in position receives monitoring module 110 Whether speech message and monitoring have in the click event for floating window, only listen to and are currently at the shared state Shi Caihui in position It enters monitoring position to share the step of whether receiving speech message in the page, only position, which is shared in the page, has floating window just to enter Whether monitor has the step of click event for floating window.In addition, due in this example method of speech processing be applied to application APP, therefore only start whether monitoring is current is in the step of state is shared in position using just entering after APP.The frequency of monitoring It can be set according to the actual situation, such as be set as whether every 10s, 20s, 30s monitoring is primary currently shares in position Whether state, the monitorings such as every 2s, 5s once receive speech message, and whether the monitorings such as every 1s, 2s, 3s once have the point for floating window Hit event.

The floating window that pop-up module 150 pops up may be displayed on any position that the page is shared in position, can also be by user's Drag operation switches display position.The display position of the text window popped up by click floating window shows size, shares page in position Move mode, the window size adjustment mode in face etc. can preset restrictive rule, e.g., be limited to fixed size, Be shown in position share the fixation position of the page, by way of dragging shift position, text window contacted by multiconductor Mode adjusts window size etc.；For another example, it limits text window and position is shared the display scale (3/4,1/2 etc.) of the page and limited Text window is shown and shares the center etc. of the page in position.

Eighth embodiment of the invention is the optimal enforcement example of above-mentioned 7th embodiment, as shown in fig. 6, the speech processes fill It sets in 100 and includes:

Module 110 is monitored, current whether in the shared state in position for monitoring, sharing in the page for monitoring position is Whether no reception speech message has for text window for monitoring the click event whether having for floating window, and for monitoring Click event；

The pop-up module 150 being connect respectively with judgment module 140 and monitoring module 110, for according to judgment module 140 Judging result shares the floating window of text window of the pop-up comprising word message in the page in position；According to the prison for monitoring module 110 It listens result to share in position and pops up text window in the page；And the click for text window is listened to when monitoring module 110 Text window floating window state of rebounding is floated on position and shares the page by event, pop-up module 150, and by text window in not marking The word message of note state is marked as read state.

In the present embodiment speech processes, first listens to module 110 and whether monitor currently in the shared state in position, work as prison Hear that being not at position shares state, does not do subsequent processing, it is lasting to monitor；State is shared in position when listening to, further It monitors and whether starts intercom function and receive speech message, if receiving speech message, text conversion module 120 will immediately It is converted to word message and judges current location to share under state by judgment module 140 whether receive speech message for the first time. If judgement is to receive speech message under the shared state in current location for the first time, pop-up module 150 is shared in position pops up packet in the page The floating window of text window containing word message.At this point, monitoring module 110 further monitors the click thing whether having for floating window Part；If there is the click event for floating window, pop-up module 150 is shared in position pops up text window in the page, and by aobvious Show that module 130 shows that word message is read for user；On the contrary, if monitoring module 110 does not listen to the click for floating window Event then continues for the word message that the speech message newly received is converted to be added into the page of floating window.When position is total It enjoys after popping up text window in the page, monitors module 110 further monitors the click event whether having for text window；If It is that text window floating window state of rebounding is floated on position and share the page by pop-up module 150, and will be in text window in unmarked The word message of state is marked as read state；If no, continuing to share in position shows text window in the page, and continues more The word message newly received.

The method that speech message is converted to word message is not specifically limited here, arbitrarily can be realized the purpose Conversion method be included in this example.For the word message of display, when word message is not checked, after word message Sew display not check；After word message is checked, word message suffix, which is shown, have been checked, i.e., in voice processing apparatus 100 In further include the message sink situation determination module being connect with display module 130, for according to the suffix of word message judge text Word message sink situation.It should be noted that the reception state of the shared square word message in position is synchronous, voice message originator here The reception state of speech message recipient's word message is judged according to the state of corresponding word message.It is received in speech message Side, determines whether word message has been checked by preset mode, in this example, when there is the point of text window Event is hit, the user is defaulted and has read word message in text window, by all word message marks in text window It is denoted as read states.In some special situations (user is in noisy environment etc. for a long time), text window interface may It shares in the page and shows in position for a long time, configuring other modes judges whether word message is looked into simultaneously in this example It sees, e.g., receives after new speech message (after being specially converted to word message), phonetic incepting side clicks text importing The page, phonetic incepting side have dragged progress bar etc..Once there is the click event for text window, judge in text window With the presence or absence of the word message for being labeled as not checking, if so, its message is marked as read.It can in addition, being shared due to position Think more people, therefore after a certain word message is checked by a user, what which showed, which has checked in suffix, further includes The ID of the user；It is directed to same word message, every to increase by one and check user, what word message was shown, which checked in suffix, increases Add the ID of relative users.It is determined for the click event of text window by predetermined manner, fixes certain on text window as clicked One position；For another example click the region etc. that text window is removed in the sharing position page.

Ninth embodiment of the invention is the optimal enforcement example of above-mentioned 7th embodiment, as shown in fig. 7, the speech processes fill It sets in 100 and includes:

The pop-up module 150 being connect respectively with judgment module 140 and monitoring module 110, for according to judgment module 140 Judging result shares the floating window of text window of the pop-up comprising word message in the page in position；And according to monitoring module 110 Snoop results are shared in position pops up text window in the page；

The detection module 160 connecting respectively with display module 130 and pop-up module 150 shares the page for detecting position In whether have floating window for word message, and share in the page whether show text window for detecting position.

In the present embodiment speech processes, first listens to module 110 and whether monitor currently in the shared state in position, work as prison Hear that being not at position shares state, does not do subsequent processing, it is lasting to monitor；State is shared in position when listening to, further It monitors and whether starts intercom function and receive speech message, if receiving speech message, text conversion module 120 will immediately It is converted to word message and judges current location to share under state by judgment module 140 whether receive speech message for the first time. If judgement is to receive speech message under the shared state in current location for the first time, pop-up module 150 is shared in position pops up packet in the page The floating window of text window containing word message.At this point, monitoring module 110 further monitors the click thing whether having for floating window Part；If there is the click event for floating window, pop-up module 150 is shared in position pops up text window in the page, and by aobvious Show that module 130 shows that word message is read for user；On the contrary, if monitoring module 110 does not listen to the click for floating window Event then continues for the word message that the speech message newly received is converted to be added into the page of floating window.In addition, when sentencing The disconnected judgement of module 140 judges that the position is shared under state when receiving speech message be not to receive speech message for the first time, then detects Module 160 detects position shares the floating window whether having in the page for word message；If so, display module 130 is by text conversion The word message that module 120 is converted to makes an addition in floating window the lower section for having word message, and Mark as Unread state；If not yet Have, detection module 160 further shares in the page whether show text window in detection position；If so, display module 130 will be literary The word message that word conversion module 120 is converted to directly shows in text window, same Mark as Unread state；If not yet Have, judgement has been likely to occur the system failure or has artificially closed floating window/text window, then pop-up module 150 shares page in position Pop-up includes the floating window of the text window of word message again in face.

Tenth embodiment of the invention is the optimal enforcement example of above-mentioned 8th embodiment, in the voice processing apparatus 100, It first listens to module 110 whether to monitor currently in the shared state in position, the shared state in position is not at when listening to, after not doing Continuous processing, it is lasting to monitor；State is shared in position when listening to, is further monitored and whether is started intercom function and receive Speech message, if receiving speech message, text conversion module 120 is converted into word message and passes through judgment module immediately Whether 140 judge current location to share under state receives speech message for the first time.If judgement is that current location is shared under state for the first time Speech message is received, pop-up module 150 shares the floating window of text window of the pop-up comprising word message in the page in position.This When, monitor module 110 further monitors the click event whether having for floating window；If having the click event for floating window, bullet Window module 150 is shared in position pops up text window in the page, and shows that word message is read for user by display module 130 It takes；On the contrary, continuing to disappear the voice newly received if monitoring module 110 does not listen to the click event for floating window The word message being converted to is ceased to be added into the page of floating window.In addition, when the judgement of judgment module 140 receives speech message Judge the position share state under be not to receive speech message for the first time, then detection module 160 detect position share the page in whether There is the floating window for word message；If so, the word message that text conversion module 120 is converted to by display module 130 adds Have the lower section of word message, and Mark as Unread state in floating window；If no, detection module 160 further detects position Whether text window is shown in the shared page；If so, the text that text conversion module 120 is converted to by display module 130 Message directly shows in text window, same Mark as Unread state；If no, judgement has been likely to occur the system failure or people To close floating window/text window, then pop-up module 150 is shared in position pops up the text comprising word message again in the page The floating window of word window.After position, which is shared, pops up text window in the page, monitoring module 110, further whether monitoring is directed to The click event of text window；If so, pop-up module 150 by text window rebound floating window state float on position share the page, and The word message that unmarked state is in text window is marked as read state；If no, continuing to share the page in position Middle display text window, and the word message that continuous updating receives.

It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each journey The division progress of sequence module can according to need and for example, in practical application by above-mentioned function distribution by different programs Module is completed, i.e., the internal structure of device is divided into different program unit or module, with complete it is described above whole or Person's partial function.Each program module in embodiment can integrate in one processing unit, can also be the independent object of each unit Reason exists, and can also be integrated in a processing unit with two or more units, above-mentioned integrated unit can both use Formal implementation of hardware can also be realized in the form of software program unit.In addition, the specific name of each program module also only It is the protection scope that is not intended to limit this application for the ease of mutually distinguishing.

Fig. 8 is the structural schematic diagram of the terminal device provided in one embodiment of the invention, as indicated, the terminal device 200 include: processor 220, memory 210 and storage in memory 210 and the computer that can run on processor 220 Program 211, such as: voice processing program.Processor 220 realizes above-mentioned each speech processes side when executing computer program 211 Step in method embodiment, alternatively, processor 220 realizes that above-mentioned each voice processing apparatus is implemented when executing computer program 211 The function of each module in example.

Terminal device 200 can be the equipment such as notebook, palm PC, Tablet PC, mobile phone.Terminal device 200 It may include, but be not limited only to processor 220, memory 210.It will be understood by those skilled in the art that Fig. 6 is only terminal device 200 example does not constitute the restriction to terminal device 200, may include than illustrating more or fewer components, or combination Certain components or different components, such as: terminal device 200 can also include input-output equipment, display equipment, network Access device, bus etc..

Processor 220 can be central processing unit (Central Processing Unit, CPU), can also be other General processor, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit (Application SpecificIntegrated Circuit, ASIC), field programmable gate array (Field- Programmable GateArray, FPGA) either other programmable logic device, discrete gate or transistor logic, Discrete hardware components etc..General processor 220 can be microprocessor or the processor is also possible to any conventional processing Device etc..

Memory 210 can be the internal storage unit of terminal device 200, such as: the hard disk of terminal device 200 is interior It deposits.Memory 210 is also possible to the External memory equipment of terminal device 200, such as: the plug-in type being equipped on terminal device 200 Hard disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card, flash card (Flash Card) etc..Further, memory 210 can also both including terminal device 200 internal storage unit and also including External memory equipment.Memory 210 for store other programs required for computer program 211 and terminal device 200 and Data.Memory 210 can be also used for temporarily storing the data that has exported or will export.

In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, is not described in some embodiment Or the part recorded, reference can be made to the related descriptions of other embodiments.

Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is executed with hardware or software, specific application and design constraint depending on technical solution.Professional technician can be with Each specific application is used different methods to achieve the described function, but this realization is it is not considered that exceed this Shen Range please.

In embodiment provided herein, it should be understood that disclosed device/terminal device and method, it can be with It realizes in other way.For example, device described above/terminal device embodiment is only schematical, for example, mould The division of block or unit, only a kind of logical function partition, there may be another division manner in actual implementation, for example, more A unit or assembly can be combined or can be integrated into another system, or some features can be ignored or not executed.It is another Point, shown or discussed mutual coupling or direct-coupling or communication connection can be through some interfaces, device or The INDIRECT COUPLING or communication connection of unit can be electrical, mechanical or other forms.

Unit may or may not be physically separated as illustrated by the separation member, shown as a unit Component may or may not be physical unit, it can and it is in one place, or may be distributed over multiple networks On unit.It can some or all of the units may be selected to achieve the purpose of the solution of this embodiment according to the actual needs.

It, can also be in addition, each functional unit in each embodiment of the application may be integrated in a processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also realize in the form of software functional units.

If integrated module/unit is realized in the form of SFU software functional unit and sells or use as independent product When, it can store in a computer readable storage medium.Based on this understanding, the present invention realizes above-described embodiment method In all or part of the process, relevant hardware can also be sent instructions to by computer program 211 and is completed, computer journey Sequence 211 can be stored in a computer readable storage medium, the computer program 211 by processor 220 execute when, it can be achieved that The step of above-mentioned each embodiment of the method.Wherein, computer program 211 includes: computer program code, computer program code It can be source code form, object identification code form, executable file or certain intermediate forms etc..Computer readable storage medium can With include: can carry 211 code of computer program any entity or device, recording medium, USB flash disk, mobile hard disk, magnetic disk, CD, computer storage, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It should be noted that computer-readable The content that storage medium includes can carry out increase and decrease appropriate, example according to the requirement made laws in jurisdiction with patent practice Such as: in certain jurisdictions, according to legislation and patent practice, computer-readable medium does not include electric carrier signal and telecommunications letter Number.

It should be noted that above-described embodiment can be freely combined as needed.The above is only of the invention preferred Embodiment, it is noted that for those skilled in the art, without departing from the principle of the present invention, Several improvements and modifications can also be made, these modifications and embellishments should also be considered as the scope of protection of the present invention.

Claims

1. a kind of method of speech processing characterized by comprising

It monitors current whether in the shared state in position；

It is shown in the page if so, being converted to word message and sharing in the position received speech message for user's reading, It includes that the ID of speech message transmitting terminal and text that speech message is converted to disappear that the content that shows in the page is shared in the position Breath.

2. method of speech processing as described in claim 1, which is characterized in that received speech message is converted to word message And it shares and shows in the page for further comprising in user's reading in the position:

Received speech message is converted into word message；

The click event whether having for the floating window monitored；

3. method of speech processing as claimed in claim 2, which is characterized in that shared in the page in the position and pop up the text Word window, after showing that the word message is read for user, further includes:

The click event whether having for the text window monitored；

If so, the text window rebounds, floating window state floats on the shared page in the position, and does not mark being in text window The word message of note state is marked as read state.

4. method of speech processing as claimed in claim 2 or claim 3, which is characterized in that be in the case where judging that state is shared in current location It is no to receive in speech message for the first time, if judging that current location is shared under state is not to receive speech message for the first time,

If no, into the step for sharing the floating window of text window of the pop-up comprising the word message in the page in the position Suddenly.

5. a kind of voice processing apparatus characterized by comprising

Module is monitored, it is current whether in the shared state in position for monitoring, and share in the page and whether connect for monitoring position Receive speech message；

The text conversion module connecting with the monitoring module is converted to text for will monitor the speech message that module listens to Message；

The display module connecting with the text conversion module shares the page in the position for showing the word message Middle to read for user, the ID that the content shown in the page includes speech message transmitting terminal and speech message conversion are shared in the position Obtained word message.

6. voice processing apparatus as claimed in claim 5, which is characterized in that in the voice processing apparatus further include:

The pop-up module being connect respectively with the judgment module and monitoring module, for the judging result according to judgment module in institute Rheme sets the floating window of text window of the pop-up comprising the word message in the shared page；And according to the snoop results for monitoring module It is shared in the page in the position and pops up the text window；

7. voice processing apparatus as claimed in claim 6, which is characterized in that

The module of monitoring is also used to that the click event whether having for the text window monitored；

When the monitoring module listens to the click event for the text window, the pop-up module is by the text window Mouth rebound floating window state float on the position share the page, and by text window be in unmarked state word message mark For read states.

8. voice processing apparatus as claimed in claims 6 or 7, which is characterized in that in the voice processing apparatus further include:

The detection module connecting respectively with display module and pop-up module shares in the page whether have needle for detecting the position Share in the page whether show text window to the floating window of word message, and for detecting the position；

When detecting the floating window having in the shared page in position for word message, the display module disappears the text being converted to Breath makes an addition in floating window the lower section for having word message, and Mark as Unread state；

When detect position share the page in do not have for word message floating window but show text window, the display module The word message being converted to directly is shown in the text window, and Mark as Unread state；

Do not have to be directed to the floating window of word message and without display text window, the pop-up mould in the shared page in position when detecting Block shares the floating window of text window of the pop-up comprising the word message in the page in the position.

9. a kind of terminal device, including memory, processor and storage are in the memory and can be on the processor The computer program of operation, which is characterized in that the processor is realized when running the computer program as in claim 1-4 The step of any one method of speech processing.

10. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists In the step of realization method of speech processing as described in any one of claim 1-4 when the computer program is executed by processor Suddenly.