CN110830368B

CN110830368B - Instant messaging message sending method and electronic equipment

Info

Publication number: CN110830368B
Application number: CN201911159719.9A
Authority: CN
Inventors: 崔来希
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2019-11-22
Filing date: 2019-11-22
Publication date: 2022-05-06
Anticipated expiration: 2039-11-22
Also published as: CN110830368A

Abstract

The embodiment of the invention provides an instant messaging message sending method and electronic equipment, wherein the method comprises the following steps: determining target background music based on the conversation characteristic information of the instant messaging conversation; generating target audio file data according to the target background music and the voice information of the target user; and then transmitting the instant messaging message containing the target audio file data. In the embodiment of the invention, the background music matched with the current instant interactive scene is intelligently recommended to the user, the target audio file data is obtained based on the background music and the voice information of the user, and then the target audio file data is sent to the message receiver as the instant communication message, so that the personalized requirement of adding the background music in the voice information of the user can be provided, the interactive diversification and the interactive pleasure of the instant communication are enhanced, the opposite side has the conversation scene introduction sense, and the use experience of the user is improved.

Description

Instant messaging message sending method and electronic equipment

Technical Field

The present invention relates to the field of electronic devices, and in particular, to a method for sending an instant messaging message and an electronic device.

Background

At present, with the rapid development of mobile communication technology, electronic devices (such as smart phones) have become indispensable electronic consumer products in people's daily life, and with the increasing popularization of smart phones, and meanwhile, the functions of smart phones are continuously upgraded and optimized, so that smart phones are integrated into various aspects of life, and users often use smart phones in various places and places.

The development of the intelligent technology also leads to higher and higher requirements of users on the functions of electronic equipment, the existing instant communication means are very rich, such as telephone, short message, instant interaction by using instant communication software, and the like, along with the continuous rich functions of the instant communication software, the instant communication software is a main chat tool used in daily life of people, at present, in the process of instant conversation by using the instant communication software, chat interaction can be carried out by means of characters, pictures, voice and the like, but the existing voice chat interaction mode is single, only the voice of the user is simply sent to the opposite party as an instant communication message, and the requirement of the current users on the individuation of the electronic equipment is difficult to meet.

Therefore, in the prior art, the voice interaction process by using the instant messaging software is relatively single in voice information form sent in the instant messaging dialog box, and cannot meet the personalized requirements of users, so that a function of enriching the voice chat mode needs to be designed.

Disclosure of Invention

The embodiment of the invention aims to provide an instant messaging message sending method and electronic equipment, and aims to solve the problems that in the prior art, voice interaction is carried out by using instant messaging software, the voice information sent in an instant messaging dialog box is single in form, and personalized requirements of users cannot be met.

In order to solve the above technical problem, the embodiment of the present invention is implemented as follows:

in a first aspect, an embodiment of the present invention provides an instant messaging message sending method, including:

determining target background music based on conversation feature information of the instant messaging conversation, wherein the conversation feature information comprises: at least one item of conversation content information, conversation group name, conversation time information and conversation position information;

generating target audio file data according to the target background music and the voice information of the target user;

and sending the instant communication message containing the target audio file data.

In a second aspect, an embodiment of the present invention provides an electronic device, including:

the background music determining module is used for determining target background music based on conversation characteristic information of the instant messaging conversation, wherein the conversation characteristic information comprises: at least one item of conversation content information, conversation group name, conversation time information and conversation position information;

the target audio file generation module is used for generating target audio file data according to the target background music and the voice information of the target user;

and the instant communication message sending module is used for sending the instant communication message containing the target audio file data.

In a third aspect, an embodiment of the present invention provides an electronic device, including: a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the instant messaging method according to the first aspect.

In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored, and when executed by a processor, the computer program implements the steps of the instant messaging method according to the first aspect.

The instant messaging message sending method and the electronic equipment in the embodiment of the invention determine the target background music based on the conversation characteristic information of the instant messaging conversation; generating target audio file data according to the target background music and the voice information of the target user; and then transmitting the instant messaging message containing the target audio file data. In the embodiment of the invention, the background music matched with the current instant interactive scene is intelligently recommended to the user, the target audio file data is obtained based on the background music and the voice information of the user, and then the target audio file data is sent to the message receiver as the instant communication message, so that the personalized requirement of adding the background music in the voice information of the user can be provided, the interactive diversification and the interactive pleasure of the instant communication are enhanced, the opposite side has the conversation scene introduction sense, and the use experience of the user is improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only some embodiments described in the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.

Fig. 1 is a first flowchart of a method for sending an instant messaging message according to an embodiment of the present invention;

fig. 2 is a schematic flowchart of a method for sending an instant messaging message according to an embodiment of the present invention;

fig. 3 is a schematic flowchart of a third method for sending an instant messaging message according to an embodiment of the present invention;

fig. 4a is a schematic diagram illustrating an implementation principle of determining alternative background music in an instant messaging method according to an embodiment of the present invention;

fig. 4b is a schematic diagram illustrating an effect of sending an instant messaging message in the instant messaging method according to the embodiment of the present invention;

fig. 5a is a schematic diagram illustrating another implementation principle of determining alternative background music in an instant messaging method according to an embodiment of the present invention;

fig. 5b is a schematic diagram illustrating another effect of sending an instant messaging message in the instant messaging message sending method according to the embodiment of the present invention;

fig. 6 is a schematic diagram illustrating a fourth flowchart of an instant messaging message sending method according to an embodiment of the present invention;

fig. 7 is a schematic flowchart of a fifth method for sending an instant messaging message according to an embodiment of the present invention;

fig. 8 is a schematic diagram of a module composition of an electronic device according to an embodiment of the present invention;

fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The embodiment of the invention provides an instant messaging message sending method and electronic equipment, which can provide personalized requirements for adding background music in user voice information by intelligently recommending the background music matched with a current instant interactive scene to a user, obtaining target audio file data based on the background music and the voice information of the user and sending the target audio file data to a message receiver as an instant messaging message, thereby enhancing the interactive diversification and interactive fun of instant messaging, leading the other party to have more conversation scene sense and improving the use experience of the user.

Fig. 1 is a first flowchart illustrating an instant messaging message sending method according to an embodiment of the present invention, where the method in fig. 1 can be executed by an electronic device, and in particular, by a program module disposed in the electronic device, as shown in fig. 1, the method at least includes the following steps:

s101, determining target background music based on conversation characteristic information of instant messaging conversation;

the session characteristic information may be original session information related to an instant messaging session, and the session characteristic information may include: at least one item of conversation content information, conversation group name, current conversation time information and conversation position information, wherein the conversation content information comprises: inputting at least one of voice, characters and pictures in the instant messaging dialog box;

specifically, determining a keyword and conversation scene information of a conversation through the conversation characteristic information of the instant messaging conversation, determining a user emotion according to the keyword and the conversation scene information of the conversation, and determining background music with the maximum matching degree with the determined user emotion as target background music; or determining a plurality of candidate background music according to the determined user emotion, and then determining the target background music according to the selection operation of the user aiming at the displayed plurality of candidate background music.

S102, generating target audio file data according to the determined target background music and the voice information of the target user;

specifically, after the target background music is determined, the voice information of the target user to be sent can be acquired, and the target background music and the voice information of the target user are directly synthesized to obtain target audio file data; or in the process of playing the target background music, synthesizing the recorded target background music and the user voice information to obtain target audio file data, namely playing the target background music, and opening the microphone to record the target user voice information and the target background music to obtain the target audio file data. The method can also be used for detecting the integrity of the audio file data, and if the audio file data is determined to be complete, the audio file data is determined to be target audio file data;

specifically, in the recording process, if it is detected that the background music recording in the generated audio file data is incomplete or the user voice recording is incomplete, the current audio file data is discarded, the microphone is turned on again, the user is prompted to re-input voice information and record, the completely recorded audio file data is determined as a target audio file, or the play-out function is turned off, and only the user voice is recorded as the target audio file data.

S103, sending an instant communication message containing target audio file data;

specifically, for the generation process of the target audio file data, synthesizing the target background music and the voice information of the target user to obtain audio file data, directly determining the synthesized audio file as the target audio file data, or performing preset processing on the synthesized audio file data, and determining the processed audio file data as the target audio file data, wherein the preset processing includes: and performing sound changing processing or denoising processing, thereby meeting the individual requirements of different users on processing the audio file data.

In the embodiment of the invention, target background music is determined based on the conversation characteristic information of the instant messaging conversation; generating target audio file data according to the target background music and the voice information of the target user; and then transmitting the instant messaging message containing the target audio file data. In the embodiment of the invention, the background music matched with the current instant interactive scene is intelligently recommended to the user, the target audio file data is obtained based on the background music and the voice information of the user, and then the target audio file data is sent to the message receiver as the instant communication message, so that the personalized requirement of adding the background music in the voice information of the user can be provided, the interactive diversification and the interactive pleasure of the instant communication are enhanced, the opposite side has the conversation scene introduction sense, and the use experience of the user is improved.

Further, for the specific process of determining the target background music, determining the target background music by first determining the dialog effective information and then determining a plurality of alternative background music according to the dialog effective information, as shown in fig. 2, in step S101, determining the target background music based on the dialog characteristic information of the instant messaging dialog specifically includes:

s1011, determining effective conversation information based on the conversation characteristic information of the instant messaging conversation;

wherein, the dialog feature information includes: at least one item of conversation content information, conversation group name, current conversation time information and conversation position information, wherein the conversation effective information comprises: conversation scenario information and/or conversation keywords, wherein the conversation scenario information comprises: at least one of the relationship, time, place and conversation environment of the conversation parties, wherein the conversation keywords comprise: at least one of keywords intelligently recognized for pictures, keywords recognized for voice and keywords recognized for characters, the dialogue environment comprising: at least one of a humorous environment, a serious environment, and a fun environment;

specifically, the dialog effective information representing the current emotion type of the target user can be extracted by analyzing the original session information related to the instant messaging session, wherein the determining process of the dialog effective information may be as follows: after obtaining the conversation feature information of the instant communication conversation, determining conversation scene information according to the conversation group name and the conversation content information, and determining a conversation keyword according to the conversation content information, thereby determining conversation effective information based on at least one of the conversation scene information and the conversation keyword.

S1012, determining a plurality of alternative background music according to the conversation effective information;

specifically, after the dialog scene information and the dialog keywords are determined, a plurality of corresponding background music can be matched in the background music library based on the dialog scene information and the dialog keywords, that is, a plurality of alternative background music is determined, and the plurality of alternative background music is displayed on a dialog interface for instant messaging, so that a user can select target background music according to requirements; considering that the number of the matched multiple alternative background music may be large, a preset number of alternative background music may be displayed in a descending order of music popularity, and if an update request of the alternative background music is received, a next batch of displayed preset number of alternative background music is selected from the alternative background music not displayed in the descending order of music popularity to implement real-time update of the displayed alternative background music as required, where the music popularity may be determined according to a click rate, a play rate, a download rate, and the like.

S1013, determining target background music based on the plurality of candidate background music;

specifically, for the determined multiple candidate background music, after receiving a selection operation of the user for a certain candidate background music, it is determined that the candidate background music is the target background music.

In order to further improve the matching accuracy of the alternative background music, the method includes introducing a user emotion type, and performing background music matching based on the user emotion type, where based on this, the step S1012, according to the dialog effective information, of determining a plurality of alternative background music specifically includes:

step one, determining a user emotion type of a target user according to effective dialogue information;

specifically, after the conversation scene information and the conversation keywords are determined, the user emotion type of the target user is determined according to the conversation scene information and the conversation keywords and is displayed in a conversation interface for instant messaging, and if the user emotion type of the target user does not meet the requirements of the current user after the user change operation is received within the preset time, another alternative user emotion type is selected as the user emotion type of the target user;

it should be noted that, the process of determining the target background music may also be: directly determining the user emotion type of a target user according to the conversation scene information and the conversation keywords, and matching background music with the highest correlation degree according to the user emotion type of the target user to directly serve as target background music;

in a specific embodiment, according to the conversation effective information, the emotion type of the target user is determined to be happy emotion, the background music birthday happy is matched based on the happy emotion, and the background music birthday happy is determined to be the target background music.

Determining a plurality of alternative background music matched with the emotion type of the user;

after the user emotion type of the target user is determined, a plurality of candidate background music are automatically matched based on the user emotion type, and the candidate background music are displayed on a conversation interface for instant messaging.

If the multiple candidate background music displayed for the first time does not meet the requirement of the user, the candidate background music needs to be re-matched, and based on this, as shown in fig. 3, the step S1013 is to determine the target background music based on the multiple candidate background music, which specifically includes:

s10131, determining whether an update request for a plurality of candidate background music is received within a preset time.

If the judgment result is yes, executing S10132, and updating a plurality of currently displayed alternative background music;

and S10133, after receiving a selection operation for the updated plurality of candidate background music, determining the candidate background music for which the selection operation is directed as the target background music;

specifically, if a touch operation of a user for a first preset position is received within a preset time period, it is determined that an update request for a plurality of candidate background music is received within the preset time period, at this time, it is indicated that none of the plurality of candidate background music currently displayed for the user meets the user requirement, the candidate background music needs to be re-determined, and the re-determined plurality of candidate background music is displayed, specifically, a predetermined number of candidate background music other than the plurality of candidate background music determined last time can be selected from the plurality of background music matched with the determined emotion type, so that the user can select the required background music as the target background music according to the actual requirement;

further, in order to improve the user experience and reduce the repeated selection time of the alternative background music, if the alternative background music recommended for the user for many times cannot meet the requirements of the user, the determined emotion type may be inaccurate, and the emotion type of the user needs to be determined again, so that the update times of the alternative background music is less than a preset time threshold, or the total number of the alternative background music displayed to the user for the determined emotion type is less than a preset number threshold;

correspondingly, if the update times of the alternative background music are greater than a preset time threshold, or the total number of the alternative background music displayed to the user for the determined emotion types is greater than a preset number threshold, or touch operation of the user for a second preset position is received within a preset time period, it is indicated that the initially determined emotion types do not meet the requirements of the user, that is, the accuracy of the identified conversation keywords is low, and at this time, the conversation feature information needs to be identified again; further, after the conversation feature information is re-identified, the emotion type of the user is determined again, the multiple candidate background music is matched according to the updated emotion type of the user and displayed on a conversation interface for instant messaging to be selected by the user, and after the selection operation for the multiple updated candidate background music is received, the candidate background music targeted by the selection operation is determined as the target background music.

If the judgment result is negative, executing S10134, and after receiving the selection operation aiming at the multiple candidate background music, determining the candidate background music aimed at by the selection operation as the target background music;

if a selection operation aiming at a certain background music in a plurality of candidate background music displayed for the first time is received within a preset time, determining the background music as a target background music;

in a specific embodiment, the determination process for the target background music, as shown in fig. 4a, in a foreign exchange project group, the conversation keyword "how to do" is identified based on the voice information in the conversation content information, the conversation keyword "fall out 7 and go to end" is identified based on the text information in the conversation content, and the conversation scene information "co-workers relationship, laugh and question and answer" is identified based on the name of the chat group; further, it is determined that the dialogue effective information of the embodiment is "how to do", "fall through 7, finish", and "co-workers relation, fun and question and answer";

determining the user emotion of a target user as an impairment emotion according to the conversation effective information, determining that 3 alternative background music which is ranked in the front are cool, good from the beginning and no crying based on the impairment emotion, displaying the three background music in a conversation interface for instant messaging, and playing the background music cool after receiving click operation of a trial listening key corresponding to the background music cool; 2 seconds after the background music cool is played, receiving a selection operation of a user for a selection key corresponding to the background music cool, explaining that the background music cool meets the requirements of the user, and determining that the background music cool is a target background music, wherein in order to facilitate the distinction of the user, an icon corresponding to the injury emotion is changed from a first color to a second color in an instant communication dialog box, and an icon corresponding to the selection key corresponding to the background music cool is changed from the first color to the second color;

it should be noted that, in fig. 4a, after a click operation of the user on a key corresponding to "re-match background music" is received within a preset time, it indicates that the user has an update request for multiple alternative background music displayed for the user, and reselects a preset number of alternative background music to be displayed from the background music matched with the emotional feeling of impairment, for example, selects 3 alternative background music that are ranked earlier except for the last displayed 3 alternative background music "cool", "come from the beginning", "do not cry", and is displayed on a conversation interface for instant messaging; correspondingly, if the click operation of the user on the key corresponding to the're-recognition of the emotion of the user' is received within the preset time, it is indicated that the emotion type determined for the first time does not meet the requirement of the user, that is, the recognized keyword does not meet the requirement of the user, for the conversation feature information in fig. 4a, the 'renminbi exchange dollar' of the text information in the conversation content information in the conversation feature information can be recognized, the emotion type of the user is determined again, a plurality of alternative background music are matched and displayed on a conversation interface for instant messaging, and after the selection operation for the updated plurality of alternative background music is received, the alternative background music targeted by the selection operation is determined as the target background music;

further, after the instant messaging message with the target background music is sent to the chat object, a novel and surprising feeling is given to the chat object to achieve the personalized chat effect, as shown in fig. 4b, based on the example given in fig. 4a, the background music "cool and cool" is taken as the target background music, and the audio file data recorded with the background music "cool and cool" and the user voice is taken as the instant messaging message to be sent to the instant messaging dialog box, so that the instant messaging message receiver has a conversation scene introduction feeling when playing the instant messaging message.

In another specific embodiment, the determination process for the target background music, as shown in fig. 5a, in a dialog with a user whose user name is "westernoconcao" in the dialog, a dialog keyword is identified as "farley" based on the picture information in the dialog content information, a dialog keyword "drift" is determined based on the dialog keyword "farley", a dialog keyword "westernoconcao" is determined based on the user name, "westernoconcao", and dialog scene information is determined as "dazzling, friend and year bottom" based on the text information in the dialog content information, and thus, it is determined that the dialog effective information of the embodiment is "farley, drift, westernoconcar" and "dazzling, friend, year bottom";

determining that the user emotion of a target user is a excited emotion according to the conversation effective information, determining that 3 alternative background music which is ranked in front are 'Lauda', 'heading d' and 'people bounce' respectively based on the excited emotion, displaying the three background music on a conversation interface for instant messaging, and playing the background music 'Lauda' after receiving click operation of a trial listening button corresponding to the background music 'Lauda'; 2 seconds after the background music Laoda is played, receiving a selection operation of a user for a selection key corresponding to the background music Laoda, indicating that the background music Laoda meets the requirements of the user, and determining that the background music Laoda is a target background music, wherein in order to facilitate the user to distinguish, icons corresponding to the injury emotion are changed from a first color to a second color in an instant communication dialog box, and icons corresponding to the selection key corresponding to the background music Laoda are changed from the first color to the second color;

it should be noted that, correspondingly, in fig. 5a, if a click operation of the user on a key corresponding to "re-match background music" is received within a preset time, it is indicated that the user has an update request for a plurality of candidate background music shown for the user, and a preset number of candidate background music to be shown is re-selected from the background music matched with the excited emotion, for example, 3 candidate background music in front of the sequence except the last shown 3 candidate background music "old man", "heading d", and "people bounce" are selected and displayed on a conversation interface for instant messaging; correspondingly, if the click operation of the user on the key corresponding to the're-recognition of the emotion of the user' is received within the preset time, it is indicated that the emotion type determined for the first time does not meet the requirement of the user, that is, the recognized keyword does not meet the requirement of the user, for the conversation feature information in fig. 5a, the 'annual terminal award' of the text information in the conversation content information in the conversation feature information can be recognized, the emotion type of the user is determined again, a plurality of alternative background music are displayed on the conversation interface in real-time communication in a matching manner, and after the selection operation for the updated plurality of alternative background music is received, the alternative background music targeted by the selection operation is determined as the target background music;

further, after the instant messaging message with the target background music is sent to the chat object, a novel and surprising feeling is given to the chat object to achieve the personalized chat effect, as shown in fig. 5b, based on the example given in fig. 5a, if the background music "old and big" is taken as the target background music, and the audio file data recorded with the song background music "old and big" and the user voice is taken as the instant messaging message to be sent to the instant messaging dialog box, so that the instant messaging message receiver has a conversation scene introduction feeling when playing the instant messaging message.

Further, in order to meet the requirement of different users for personalized processing of the target audio file data, as shown in fig. 6, based on this, in step S102, generating the target audio file data according to the determined target background music and the voice information of the target user specifically includes:

s1021, receiving a first input for representing a request for voice change;

s1022, in response to the first input, performing sound change processing on audio file data obtained based on the target background music and the voice information of the target user to obtain sound changed audio file data;

and S1023, determining the voice-changed audio file data as target audio file data.

Specifically, original audio file data are generated based on target background music and voice information of a target user, if a voice change request is detected within a preset time, voice change processing is performed on the voice information of the user according to a voice change type selected by the target user in the original audio file data, and voice changed audio file data are obtained; wherein the type of change of voice may include: and any one of Zhuang Han-Yin, Luoli-Yin, metallic-tone, thrilling-Yin and stuttering, and then sending the instant communication message containing the voice-changed audio file data to the chat object of the user.

Specifically, if the voice change request is not detected within the preset time, the original audio file data obtained based on the target background music and the voice information of the target user is determined as the target audio file data, and the instant messaging message containing the target audio file data is sent to the chat object.

In a specific embodiment, for example, in fig. 4a, if a click operation of a user on a key corresponding to "change voice" is received within a preset time, it is indicated that a target audio file generated by a user's voice original sound together with background music "cool" is not enough to be used as an instant messaging message, a change voice operation is performed on the user's voice, and if a request of the user for a user voice change type is to change the user's voice into a romantic sound at this time, target audio file data of the user's voice changed into the romantic sound is obtained, and the target audio file data is determined as an instant messaging message and sent to a chat object; correspondingly, if the click operation of the user for the button corresponding to the 'original sound' is received, the original audio file data is sent to the chat object as the instant messaging message.

Further, in the process of synthesizing the target background music and the voice information of the target user to obtain original audio file data, noise information such as voice information of other surrounding users may be included, and therefore, the original audio file data needs to be subjected to denoising operation to obtain target audio file data; wherein, the voiceprint characteristic of considering everyone has the uniqueness, and then can discern through a plurality of voiceprint characteristics to containing in the audio file data, and show the corresponding relation between voiceprint characteristic sign and the voice keyword, so that receive the voiceprint characteristic that the noise information that the user selected to this corresponding relation corresponds, again automatically based on the voiceprint characteristic that this noise information corresponds to the audio file remove noise processing, record the condition of audio file data with the noise like this, need not to record user 'S voice again, automatic noise processing of removing has been realized, on this basis, above-mentioned S102, according to the target background music of determining and target user' S voice information, generate target audio file data, specifically include:

step one, receiving a second input for representing a request for audio denoising;

responding to the second input, and determining voiceprint characteristic information corresponding to the noise audio to be eliminated;

based on the determined voiceprint characteristic information, editing audio file data obtained based on target background music and voice information of a target user to obtain the audio file data without noise;

and step four, determining the audio file data subjected to noise removal as target audio file data.

Specifically, original audio file data is generated based on target background music and voice information of a target user, and if a denoising request is detected within a preset time, a corresponding relationship between voiceprint features and keywords is displayed, wherein the corresponding relationship includes: the method comprises the steps that a plurality of voiceprint characteristic information and a keyword corresponding to each voiceprint characteristic information are contained in original audio file data; after receiving a selection operation input by a user based on the corresponding relation, determining the voiceprint characteristic information corresponding to the keyword selected by the user as target voiceprint characteristic information corresponding to the noise audio to be eliminated; and removing the noise audio corresponding to the target voiceprint characteristic information from the original audio file data to obtain the audio file data after noise removal.

In a specific embodiment, if a target user is in a noisy environment, after automatically determining that target background music is cool, playing background music cool, recording the background music cool and the user voice, and simultaneously recording the cool background music cool, the user voice and the user voice in the recording process, and displaying a plurality of voiceprint feature identifications and keywords corresponding to the voiceprint feature identifications and the keywords, for example, voiceprint features 1- "cool", voiceprint features 2- "you good", and voiceprint features 3- "haha", contained in audio file data after detecting a noise removal request of the user, determining the voiceprint feature 3 as the voiceprint feature information corresponding to noise audio to be eliminated if a selection operation aiming at the voiceprint features 3- "haha" is received, therefore, all the audio information corresponding to the voiceprint feature 3 can be determined as the noise audio, and then all the audio information corresponding to the voiceprint feature 3 is eliminated, and the audio file data after the noise audio is eliminated is determined as the target audio file data.

In a specific embodiment, as shown in fig. 7, a fifth flowchart of an instant messaging message sending method provided in an embodiment of the present invention is provided, where the instant messaging message sending method specifically includes:

s701, determining effective conversation information based on the conversation characteristic information of the instant messaging conversation;

s702, determining the user emotion type of the target user according to the effective conversation information;

s703, determining a plurality of alternative background music matched with the emotion types of the user;

s704, judging whether an updating request aiming at a plurality of alternative background music is received within a first preset time;

if the judgment result is yes, executing S705, and updating a plurality of currently displayed alternative background music;

s706, after receiving the selection operation aiming at the updated plurality of candidate background music, determining the candidate background music aimed at by the selection operation as the target background music;

if the judgment result is negative, executing S707, after receiving the selection operation for the multiple candidate background music, determining the candidate background music targeted by the selection operation as the target background music;

s708, recording the target background music and the voice information of the target user when the target background music is played to obtain original audio file data;

s709, judging whether a voice change request for the original audio file data is detected within a second preset time;

if the judgment result is yes, S710 is executed, the original audio file data is subjected to sound changing processing, and the original audio file data after sound changing is determined as target audio file data;

if the judgment result is no, executing S711, and determining the original audio file as the target audio file data;

and S712, sending the instant communication message containing the target audio file data.

The instant messaging message sending method in the embodiment of the invention determines the target background music based on the conversation characteristic information of the instant messaging conversation; generating target audio file data according to the target background music and the voice information of the target user; and then transmitting the instant messaging message containing the target audio file data. In the embodiment of the invention, the background music matched with the current instant interactive scene is intelligently recommended to the user, the target audio file data is obtained based on the background music and the voice information of the user, and then the target audio file data is sent to the message receiver as the instant communication message, so that the personalized requirement of adding the background music in the voice information of the user can be provided, the interactive diversification and the interactive pleasure of the instant communication are enhanced, the opposite side has the conversation scene introduction sense, and the use experience of the user is improved.

On the basis of the same technical concept, an embodiment of the present invention further provides an electronic device corresponding to the instant messaging message sending method provided in the foregoing embodiment, and fig. 8 is a schematic diagram illustrating a first module of the electronic device according to the embodiment of the present invention, where the electronic device is configured to execute the instant messaging message sending method described in fig. 1 to fig. 7, and as shown in fig. 8, the electronic device includes:

a background music determining module 801, configured to determine target background music based on conversation feature information of an instant messaging conversation, where the conversation feature information includes: at least one item of conversation content information, conversation group name, conversation time information and conversation position information;

a target audio file generating module 802, configured to generate target audio file data according to the target background music and the voice information of the target user;

an instant messaging message sending module 803, configured to send an instant messaging message that includes the target audio file data.

Optionally, the background music determining module 801 is specifically configured to:

determining conversation effective information based on conversation characteristic information of the instant messaging conversation, wherein the conversation effective information comprises: dialog scenario information and/or dialog keywords;

determining a plurality of alternative background music according to the conversation effective information;

and determining the target background music based on the plurality of candidate background music. "

Optionally, the background music determining module 801 is further specifically configured to:

determining the user emotion type of the target user according to the conversation effective information;

determining a plurality of alternative background music matching the user emotion type.

receiving a selection operation aiming at the plurality of candidate background music, and determining the candidate background music aiming at the selection operation as target background music;

alternatively, the first and second electrodes may be,

if an update request aiming at the alternative background music is received within a preset time period, the currently displayed alternative background music is changed, a selection operation aiming at the updated alternative background music is received, and the alternative background music aimed at by the selection operation is determined as target background music.

Optionally, the target audio file generating module 802 is specifically configured to:

receiving a first input characterizing a requested voice change;

responding to the first input, and performing sound changing processing on audio file data obtained based on the target background music and the voice information of the target user to obtain sound changed audio file data;

and determining the audio file data after the sound change as target audio file data.

Optionally, the target audio file generating module 802 is further specifically configured to:

receiving a second input characterizing a request for audio de-noising;

based on the voiceprint feature information, editing audio file data obtained based on the target background music and the voice information of the target user to obtain the audio file data without noise;

and determining the audio file data subjected to noise removal as target audio file data.

The electronic equipment in the embodiment of the invention determines the target background music based on the conversation characteristic information of the instant messaging conversation; generating target audio file data according to the target background music and the voice information of the target user; and then transmitting the instant messaging message containing the target audio file data. In the embodiment of the invention, the background music matched with the current instant interactive scene is intelligently recommended to the user, the target audio file data is obtained based on the background music and the voice information of the user, and then the target audio file data is sent to the message receiver as the instant communication message, so that the personalized requirement of adding the background music in the voice information of the user can be provided, the interactive diversification and the interactive pleasure of instant communication are enhanced, the opposite side has a conversation scene sense, and the use experience of the user is improved.

The electronic device provided by the embodiment of the present invention can implement each process in the embodiment corresponding to the above instant messaging message sending method, and is not described herein again to avoid repetition.

It should be noted that the electronic device provided in the embodiment of the present invention and the instant messaging method provided in the embodiment of the present invention are based on the same inventive concept, and therefore specific implementation of the embodiment may refer to implementation of the instant messaging method described above, and repeated details are not described herein.

On the basis of the same technical concept, an embodiment of the present invention further provides an electronic device for executing the instant messaging message sending method, where fig. 9 is a schematic diagram of a hardware structure of an electronic device implementing various embodiments of the present invention, and the electronic device 100 shown in fig. 9 includes, but is not limited to: radio frequency unit 101, network module 102, audio output unit 103, input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 9 does not constitute a limitation of the electronic device, and that the electronic device may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

A processor 110 configured to:

The embodiment of the invention provides an instant messaging message sending method and electronic equipment, which are used for determining target background music based on conversation characteristic information of instant messaging conversation; generating target audio file data according to the target background music and the voice information of the target user; and then transmitting the instant messaging message containing the target audio file data. In the embodiment of the invention, the background music matched with the current instant interactive scene is intelligently recommended to the user, the target audio file data is obtained based on the background music and the voice information of the user, and then the target audio file data is sent to the message receiver as the instant communication message, so that the personalized requirement of adding the background music in the voice information of the user can be provided, the interactive diversification and the interactive pleasure of the instant communication are enhanced, the opposite side has the conversation scene introduction sense, and the use experience of the user is improved.

Wherein, the processor 110 is further configured to:

the determining the target background music based on the conversation feature information of the instant messaging conversation comprises the following steps:

and determining the target background music based on the plurality of candidate background music.

Wherein, the processor 110 is further configured to:

alternatively, the first and second electrodes may be,

if an update request aiming at the alternative background music is received within a preset time period, updating the currently displayed alternative background music, receiving a selection operation aiming at the updated alternative background music, and determining the alternative background music aimed at by the selection operation as target background music.

Wherein, the processor 110 is further configured to:

receiving a first input characterizing a requested voice change;

responding to the first input, and carrying out sound changing processing on audio file data obtained based on the target background music and the voice information of the target user to obtain sound changed audio file data;

Wherein, the processor 110 is further configured to:

receiving a second input characterizing a request for audio de-noising;

The electronic device 100 in the embodiment of the present invention determines the target background music based on the dialog feature information of the instant messaging dialog; generating target audio file data according to the target background music and the voice information of the target user; and then transmitting the instant messaging message containing the target audio file data. In the embodiment of the invention, the background music matched with the current instant interactive scene is intelligently recommended to the user, the target audio file data is obtained based on the background music and the voice information of the user, and then the target audio file data is sent to the message receiver as the instant communication message, so that the personalized requirement of adding the background music in the voice information of the user can be provided, the interactive diversification and the interactive pleasure of the instant communication are enhanced, the opposite side has the conversation scene introduction sense, and the use experience of the user is improved.

It should be noted that the electronic device 100 provided in the embodiment of the present invention can implement each process implemented by the electronic device in the above embodiment of the instant messaging message sending method, and for avoiding repetition, details are not described here again.

It should be understood that, in the embodiment of the present invention, the radio frequency unit 101 may be used for receiving and sending signals during a message transmission or call process, and specifically, after receiving downlink data from a base station, the downlink data is processed by the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through a wireless communication system.

The electronic device provides wireless broadband internet access to the user via the network module 102, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the network module 102 or stored in the memory 109 into an audio signal and output as sound. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the electronic apparatus 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 includes a speaker, a buzzer, a receiver, and the like.

The input unit 104 is used to receive an audio or video signal. The input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, and the Graphics processor 1041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the network module 102. The microphone 1042 may receive sound and may be capable of processing such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode.

The electronic device 100 also includes at least one sensor 105, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or the backlight when the electronic device 100 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 105 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.

The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 107 includes a touch panel 1071 and other input devices 1072. Touch panel 1071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 1071 (e.g., operations by a user on or near touch panel 1071 using a finger, stylus, or any suitable object or attachment). The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and receives and executes commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. Specifically, other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.

Further, the touch panel 1071 may be overlaid on the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although in fig. 9, the touch panel 1071 and the display panel 1061 are two independent components to implement the input and output functions of the electronic device, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the electronic device, and is not limited herein.

The interface unit 108 is an interface for connecting an external device to the electronic apparatus 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic apparatus 100 or may be used to transmit data between the electronic apparatus 100 and the external device.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is a control center of the electronic device, connects various parts of the entire electronic device using various interfaces and lines, performs various functions of the electronic device and processes data by operating or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the electronic device. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The electronic device 100 may further include a power source 111 (such as a battery) for supplying power to each component, and preferably, the power source 111 may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.

In addition, the electronic device 100 includes some functional modules that are not shown, and are not described in detail herein.

Preferably, an embodiment of the present invention further provides an electronic device, which includes a processor 110, a memory 109, and a computer program stored in the memory 109 and capable of running on the processor 110, where the computer program, when executed by the processor 110, implements each process of the above embodiment of sending an instant messaging message, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.

Further, corresponding to the instant messaging message sending method provided in the foregoing embodiment, an embodiment of the present invention further provides a computer readable storage medium, where a computer program is stored, and when the computer program is executed by the processor 110, the steps of the instant messaging message sending method embodiment are implemented, and the same technical effect can be achieved, and in order to avoid repetition, details are not described here again. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

It is to be understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or any combination thereof. For a hardware implementation, the Processing units may be implemented within one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, micro-controllers, microprocessors, other electronic units designed to perform the functions described herein, or a combination thereof.

For a software implementation, the techniques described in this disclosure may be implemented with modules (e.g., procedures, functions, and so on) that perform the functions described in this disclosure. The software codes may be stored in a memory and executed by a processor. The memory may be implemented within the processor or external to the processor.

It should also be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made herein without departing from the spirit and scope of the invention as defined in the appended claims. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the scope of the claims of the present invention.

Claims

1. An instant messaging method applied to electronic equipment is characterized by comprising the following steps:

determining a user emotion type of a target user based on conversation feature information of the instant messaging conversation;

determining target background music based on the emotion type of the user, wherein the conversation feature information comprises: the method comprises the steps of obtaining dialogue content information, a name of a conversation group where the dialogue content information exists, dialogue time information and dialogue position information, wherein the name of the conversation group is used for determining the affiliated relationship of two parties of the dialogue, and the affiliated relationship of the two parties of the dialogue is one of factors used for determining the emotion type of a user;

2. The method of claim 1, wherein determining the user emotion type of the target user based on the conversation feature information of the instant messaging conversation comprises:

and determining the user emotion type of the target user according to the conversation effective information.

3. The method of claim 2, wherein determining the target background music based on the type of emotion of the user comprises:

determining a plurality of alternative background music matched with the emotion types of the users based on the emotion types of the users;

4. The method of claim 3, wherein determining the target background music based on the plurality of candidate background music comprises:

alternatively, the first and second electrodes may be,

5. The method of claim 1, wherein generating target audio file data based on the target background music and the target user's voice information comprises:

receiving a first input characterizing a requested voice change;

6. The method of claim 1, wherein generating target audio file data based on the target background music and the target user's voice information comprises:

receiving a second input characterizing a request for audio de-noising;

7. An electronic device, comprising:

the background music determining module is used for determining the user emotion type of the target user based on the conversation characteristic information of the instant messaging conversation; determining target background music based on the emotion type of the user, wherein the conversation feature information comprises: the method comprises the steps of obtaining dialogue content information, a name of a conversation group where the dialogue content information exists, dialogue time information and dialogue position information, wherein the name of the conversation group is used for determining the affiliated relationship of two parties of the dialogue, and the affiliated relationship of the two parties of the dialogue is one of factors used for determining the emotion type of a user;

8. The electronic device of claim 7, wherein the background music determination module is specifically configured to:

9. The electronic device of claim 8, wherein the background music determination module is further specifically configured to:

determining a plurality of alternative background music matched with the user emotion type based on the user emotion type;

10. The electronic device of claim 9, wherein the background music determination module is further specifically configured to:

alternatively, the first and second electrodes may be,

11. The electronic device of claim 7, wherein the target audio file generation module is specifically configured to:

receiving a first input characterizing a requested voice change;

12. The electronic device of claim 7, wherein the target audio file generation module is further specifically configured to:

receiving a second input characterizing a request for audio de-noising;

based on the voiceprint characteristic information, editing audio file data obtained based on the target background music and the voice information of the target user to obtain the audio file data without noise;

13. An electronic device, comprising: a processor, a memory and a computer program stored on and executable on the memory, the computer program, when executed by the processor, implementing the steps of the instant messaging method according to any one of claims 1 to 6.

14. A computer-readable storage medium, having stored thereon a computer program which, when executed by a processor, carries out the steps of the instant messaging method according to any one of claims 1 to 6.