CN102377692A - Method, terminal and system for mapping output of voice messages in instant messaging - Google Patents
Method, terminal and system for mapping output of voice messages in instant messaging Download PDFInfo
- Publication number
- CN102377692A CN102377692A CN2011103869496A CN201110386949A CN102377692A CN 102377692 A CN102377692 A CN 102377692A CN 2011103869496 A CN2011103869496 A CN 2011103869496A CN 201110386949 A CN201110386949 A CN 201110386949A CN 102377692 A CN102377692 A CN 102377692A
- Authority
- CN
- China
- Prior art keywords
- audio
- mapping
- instant messaging
- user
- video file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a method, terminal and system for mapping output of voice messages in instant messaging, belonging to the technical field of computers and software. The method for mapping output of the voice messages in instant messaging comprises the following steps of: firstly, building a mapping audio-visual library used for mapping out in instant messaging; secondly, specific to an instant message receiver, collecting the voice messages of a sender through the triggering of a mapping output function; then, retrieving corresponding mapping audio-visual files in the mapping audio-visual library according to the collected user voice messages; and finally, sending the corresponding mapping audio-visual files retrieved in the preceding step to an instant message receiver client side. By utilizing the method, terminal and system provided by the invention, users can provide audio clips to a system through humming by themselves or playing sound clips, and the system sends sound clips in the system conforming to the audio clips provided by the user to the receiver client side in data connection with the users through searching and comparison.
Description
Technical field
The invention belongs to computer, networking technology area.
Background technology
Network instant communication (IM) instrument develops into today, has become the communication tool that the user generally uses, becomes necessary part in network user's daily life gradually.JICQ not only is used in the network user's the work, equally also uses in the network user's free life in a large number, and the user can realize linking up timely and effectively with the contact person through the network instant communication instrument.
In present use; When the user want for one section sound clip of current contacts broadcast, mostly the mode that is adopted was to send audio files or sends the audio files link, and whole process all needs the user that this audio files is carried out the active retrieval; And when the user hope to send be certain fragment of one section sound the time; Also need do this audio files and anticipate, operating process is comparatively loaded down with trivial details, has reduced user's experience.
Summary of the invention
The object of the present invention is to provide method, terminal and the system of acoustic information mapping property output in a kind of instant messaging; Utilize the present invention; The user can hum through self or the mode of the fragment that plays sound provides audio fragment to system; System is through the search comparison, and the sound clip that will meet with the sound clip that the user provides is sent to the user and carries out recipient's client that data are connected.
The present invention provides the method for the mapping property output of acoustic information in a kind of instant messaging, comprises the steps:
Step 1 is set up the mapping video and audio bank that is used in instant messaging mapping output;
Step 2 is directed to the instant messaging recipient, through the triggering of mapping output function, gathers the acoustic information of transmit leg;
Step 3 is according to the user voice information that collects corresponding mapping audio/video file of retrieval from the mapping video and audio bank;
Step 4 is sent to instant messaging recipient client with the mapping audio/video file that retrieves in the last step.
Further, said mapping video and audio bank comprises following three one of which at least,
User terminal mapping video and audio bank is stored in the client at user's JICQ place;
System server mapping video and audio bank is stored in the pairing system server of said JICQ;
Web search data terminal mapping video and audio bank is stored in the network third party that voice data can be provided to web search.
Further, corresponding described system server mapping video and audio bank establishes the corresponding individual character video-audio data of the instant messaging identifier map listing with the user.
Further, the described individual character video-audio data map listing that is directed to specific instant messaging identifier includes respectively corresponding contact person's individual character map listing of this user's instant communication contacts.
Further, the said acoustic information sound clip that sends for the user or provide to instant messaging transmit leg client with the mode that plays sound.
Further, said mapping output function triggering mode comprises following three one of which at least,
Mode one triggers through the mapping function control in the instant messaging interactive interface, and this instant messaging interactive interface is corresponding with user-selected instant messaging recipient;
Mode two in the contacts list of instant messaging main panel, is directed to selected contact object, carries out mapping function and triggers;
Mode three when local client is in recording state, adopts specific voice messaging to trigger.
Further, above-mentioned mapping output function triggering mode three mainly comprises the steps,
Step a, the sound-recording function of unlatching local client;
Step b gathers the acoustic information that comes from the user;
Step c, identification user's acoustic information judges whether to include identification of contacts;
Steps d, trigger be directed to the aforementioned contact sign corresponding contact person's mapping output function.
Further; Be directed to the transmit leg acoustic information of being gathered in the described step 2; With the instant messaging identifier of transmit leg as index information; As by index information, it is stored in local client, instantaneous communication system server and third party's memory three at least in the one of which with the corresponding audio data.
Further, the corresponding mapping audio/video file mode of retrieval is following the two one of which at least in the said mapping video and audio bank,
Mode one, the acoustic information that the identification user provides is converted into word information relates, according to the corresponding mapping audio/video file of matching retrieval of Word message;
Mode two is discerned the acoustic information that the user provided, and obtains the audio frequency characteristics information of this sound clip,, differentiates the corresponding mapping audio/video file of retrieval in video and audio bank with the key message of this audio frequency characteristics information as retrieval according to the degree that conforms to.
Further, the audio/video file that is stored in the mapping video and audio bank need pass through digital processing in advance, comprise the steps,
Step b1, voice messaging word information relates in the identification audio/video file;
Step b2, the audio frequency characteristics information of analysis audio/video file;
Step b3 sets up mapping relations with audio/video file word information relates and this audio/video file of audio frequency characteristics information of same, and it is stored in the mapping audio/video file storehouse.
Further, after mapping was penetrated audio/video file in the video and audio bank and analyzed contrast and do not obtain corresponding mapping audio/video file, the mode that adopts network to grasp grasped the mapping audio/video file and the relevant information thereof of coupling from the Internet.
Further, retrieve corresponding target audio/video file after, intercepting is used for the transmit operation of data with the corresponding mapping audio/video file fragment of sound clip that the user provides from this mapped file.
Further, retrieve corresponding mapping audio/video file after, return result for retrieval for the transmit leg client, gather user's affirmation information after, be used for the transmit operation of data.
Further, described result for retrieval comprises title, mapping audio/video file fragment time span, the form of this mapping audio/video file.
Further, after retrieving corresponding mapping audio/video file, also comprise the steps,
Step c1, the audio frequency characteristics information of the acoustic information that analysis user provides;
Step c2 analyzes the audio frequency characteristics information of shining upon audio/video file;
Step c3 provides the audio frequency characteristics information of acoustic information according to the user, and corresponding audio frequency characteristics is made corresponding adjustment in the mapping projection sound file.
Further, the mode that the mapping audio/video file that will retrieve in the said step 4 is sent to instant messaging recipient client is following the two one of which at least,
Mode one should be shone upon audio/video file and was contained in the instant messaging chat message, was sent in recipient's instant messaging interactive interface, through playing after user's clicking trigger;
Mode two, the voice call of setting up both sides in advance connects, and should shine upon audio/video file and directly be sent to recipient's client and broadcast.
The present invention provides the terminal of the mapping property output of acoustic information in a kind of instant messaging to comprise:
The instant messaging interactive interface is the function platform that instant messaging information interchange and mapping property output associative operation are provided for the user;
User terminal mapping video and audio bank is to be positioned at user terminal, is used to store the database of the audio/video file that is used to the output of mapping property;
The sound collection module is the functional module that is used to gather the acoustic information that the user provides;
Shining upon audio-visual retrieval module, is to be used for the acoustic information that provides according to the user, from the functional module of the corresponding mapping audio/video file of mapping video and audio bank retrieval;
Audio-visual playing module is the functional module that is used to play the mapping audio/video file that receives.
Further, corresponding described mapping video and audio bank is provided with transmit leg voice screening unit, and it comprises,
Individual character phonetic feature module is the functional module that is used to store individual subscriber audio frequency characteristics data;
The user speech identification module; Be the individual subscriber audio frequency characteristics data that are used for according to individual character phonetic feature module; The acoustic information that comparative analysis collects, thus filter out the voice data that meets the individual subscriber audio frequency characteristics functional module as the acoustic information that collects.
The present invention also provides the system of the mapping property output of acoustic information in a kind of instant messaging, comprises client that the user manipulates and the server that connects both sides' client,
Wherein, said client comprises:
The instant messaging interactive interface is the function platform that instant messaging information interchange and mapping property output associative operation are provided for the user;
User terminal mapping video and audio bank is to be positioned at user terminal, is used to store the database of the audio/video file that is used to the output of mapping property;
The sound collection module is the functional module that is used to gather the acoustic information that the user provides;
Shining upon audio-visual retrieval module, is to be used for the acoustic information that provides according to the user, from the functional module of the corresponding mapping audio/video file of mapping video and audio bank retrieval;
Audio-visual playing module is the functional module that is used to play the mapping audio/video file that receives;
Said server comprises:
System server mapping video and audio bank is to be positioned at system server, is used to store the database of the audio/video file that is used to the output of mapping property;
The server data retrieval module is to be used for the acoustic information that provides according to the user, from the functional module of the corresponding mapping audio/video file of system server mapping video and audio bank retrieval;
The server data processing module is to be used for the functional module that data exchange between processing server and transmit leg, the recipient's client.
Description of drawings
Fig. 1 is the interface sketch map that the user provides sound clip in the method for acoustic information mapping property output in a kind of instant messaging of providing of first embodiment of the invention to local client.
Fig. 2 is client feedback user search result's in the method for acoustic information mapping property output in a kind of instant messaging of providing of first embodiment of the invention an interface sketch map.
Fig. 3 is the method flow diagram of acoustic information mapping property output in a kind of instant messaging of providing of second embodiment of the invention.
Fig. 4 is the terminal structure figure of acoustic information mapping property output in a kind of instant messaging of providing of third embodiment of the invention.
Fig. 5 is the system construction drawing of acoustic information mapping property output in a kind of instant messaging of providing of fourth embodiment of the invention.
Embodiment
The object of the present invention is to provide method, terminal and the system of acoustic information mapping property output in a kind of instant messaging; Utilize the present invention; The user can hum through self or the mode of the fragment that plays sound provides audio fragment to system; System is through search comparison, carries out recipient's client that data are connected with being sent to the user with sound clip that sound clip that the user provides meets in the system.
With reference to the accompanying drawings, in conjunction with specific embodiment the present invention is done further explanation.
Fig. 1, Fig. 2 are the explanatory view of acoustic information mapping property output intent in a kind of instant messaging of the present invention, have showed the software interface of user when this method of use, give expression to goal of the invention of the present invention intuitively.
Illustrate, user Mary wants to send the wherein one section content in the song that is called XXXXX through JICQ to the instant communication contacts Joy of oneself.As shown in Figure 1, Mary opens the instant messaging interactive interface 300 of the two through the instant communication contacts icon 410 of corresponding Joy on click self the instant messaging main panel 400.The mapping function control 310 that click is positioned on the instant messaging interactive interface 300 triggers corresponding mapping output function.
After the mapping output function was opened, Mary only needed to want that the one section content that comes among the song XXXXX of sending hums out, the acoustic information that system promptly can provide according to the user, retrieval comparison from self database.Sound collection control 311 shown in Fig. 1 is used for being convenient to the collection of user's control system to self acoustic information.This control is shown in mapping function control 310 right sides after the user triggers the mapping output function.
As shown in Figure 2, system is through retrieval comparison, obtain corresponding mapping output sound file after, the relevant information of this mapped file that retrieves " has been retrieved mapped file: XXXXX, MP3 format, duration 53S." be back to the two interactive interface Output bar 320.Because the file content that retrieves was Mary and wanted the information of sending this moment, user Mary clicks retrieve result request control 321 " confirming ", can this document be sent to the instant communication client of Joy.If the content false that retrieves through clicking retrieve result request control 321 " retrieval again ", can start-up system be retrieved to the acoustic information that the user provides again.
Fig. 3 is to the method flow diagram that self sends data in the instant messaging of the present invention.Below in conjunction with concrete steps, the present invention is elaborated.
In step S101, set up the mapping video and audio bank that is used in instant messaging mapping output.
For realizing the described mapping property output of acoustic information in instant messaging, at first to set up the database of the audio files of this mapping property output of storage, promptly shine upon video and audio bank.
Wherein, according to the difference of the memory location of shining upon audio/video file, the mapping video and audio bank mainly comprises following three parts:
User terminal mapping video and audio bank; Be stored in the client at user's JICQ place, this part video content is mainly the user and sets up voluntarily, according to user's oneself use hobby; Selectively setting mapping video and audio bank content, is the mapping video and audio bank that individual subscriber uses;
System server mapping video and audio bank is stored in the pairing system server of said JICQ, and this part video content is mainly system and provides, and is that system is the public mapping video and audio bank that users provide;
Web search data terminal mapping video and audio bank; Be stored in the network third party that voice data can be provided to web search; This part video and audio bank promptly refers to Internet resources, when audio files that the user need be shone upon can't be in the past retrieves in two video and audio bank, i.e. and the corresponding audio/video file of retrieval from network.
In use, adopt wherein one of which at least.
In addition; In described system server mapping video and audio bank; Have the corresponding individual character video-audio data of the instant messaging identifier map listing with the user, and in this data map tabulation, include corresponding respectively contact person's individual character map listing of this user's instant communication contacts.
Illustrate, user Mary is according to own hobby, a part of audio/video file is uploaded in the system server mapping video and audio bank preserves, as the video and audio bank of own individual's use.System is about under the file of UID that this part audio/video file is kept at respective user Mary.The video-audio data map listing that corresponding this part audio/video file is set up is exactly a UID number corresponding individual character video-audio data map listing with Mary.In addition; User Mary can also be provided with the different audio mapping relations respectively to the different contact persons in the own instant communication contacts; Promptly in the face of different contacts; The mapping audio/video file that same acoustic information is corresponding different, the corresponding relation that is provided with according to Mary generates contact person's individual character map listing of the UID of corresponding Mary.
In step S102, be directed to the instant messaging recipient, through the triggering of mapping output function, gather the acoustic information of transmit leg.
Wherein, said mapping output function triggering mode comprises following three one of which at least,
Mode one triggers through the mapping function control in the instant messaging interactive interface, and this instant messaging interactive interface is corresponding with user-selected instant messaging recipient.
For example, user Mary wants to send to user Joy the audio files of one section mapping property output, need set up in advance under the situation of good corresponding mapping video and audio bank, and triggering should the mapping output function.As shown in fig. 1, Mary at first opens the instant messaging interactive interface 300 of chatting with Joy, clicks then to be positioned at the mapping function control 310 on this instant messaging interactive interface 300, triggers corresponding mapping output function through this functionality controls 310.
Mode two in the contacts list of instant messaging main panel, is directed to selected contact object (Item), carries out mapping function and triggers.
In this mode, user Mary can directly through being positioned at the contact icon 410 on the instant messaging main panel 400, carry out mapping function and trigger under the situation of the instant messaging interactive interface 300 that need not open relative users Joy.During operation, user Mary moves to cursor on the contact icon 410 of user Joy, and a mouse click right button is chosen corresponding mapping function option from right-click menu, trigger the unlatching of mapping output function.
Mode three when local client is in recording state, adopts specific voice messaging to trigger.
This triggering mode is directed under the situation that the current computer of user has been in the recording opening, and the voice messaging specific according to the user who collects triggers the unlatching of mapping output function.Said special sound information refers to this user's instant communication contacts sign.
To this triggering mode, its trigger process mainly comprises following a few step:
Step a, the sound-recording function of unlatching local client;
Step b gathers the acoustic information that comes from the user;
Step c, identification user's acoustic information judges whether to include identification of contacts;
Steps d, trigger be directed to the aforementioned contact sign corresponding contact person's mapping function.
Illustrate; When the computer of the current use of user Mary is in the recording opening; If user Mary hopes to trigger the mapping property output to user Joy, only need say user Joy corresponding identification of contacts Joy in the instant communication contacts tabulation of user Mary, system is through identification user's acoustic information; " Joy " this information of judging has corresponding identification of contacts, and promptly activation pin is to the mapping output function of user Joy.
Wherein, the acoustic information that said transmit leg provides is used to seek mapping output sound file has following two kinds of presentation modes:
Mode one, the sound clip that the mode of sounding through user self provides to instant messaging transmit leg client.For example the user can hum one section melody, perhaps reads aloud the passage content.
Mode two, the sound clip that the mode of utilizing other device to play sound through the user provides to instant messaging transmit leg client.For example, the user can utilize musical instrument to play melody, perhaps utilizes the audio playing apparatus with outer playing function to play one section sound clip.
In addition; Acoustic information for the transmit leg that in this step, is collected; With the instant messaging identifier of transmit leg as index information; As by index information, be stored in local client, instantaneous communication system server and third party's memory three at least in the one of which with the corresponding audio data.When the transmit leg acoustic information of being stored can be used for the contrast identification of acoustic information afterwards, be convenient to the sound that system identifies the user more accurately, thereby improve the efficient of system retrieves correspondence mappings file.
In step S103, according to the user voice information that collects corresponding mapping audio/video file of retrieval from the mapping video and audio bank.
In this step, the main corresponding mapping audio/video file of coupling searching algorithm retrieval that adopts.Come the deterministic retrieval result through the matching of retrieval of content.Key content is dissimilar during according to retrieval, and the corresponding mapping audio/video file mode of retrieval is divided into following two kinds in the said mapping video and audio bank:
Mode one, the retrieval key content is the Word message of this acoustic information.At first, through speech recognition technology, the acoustic information that analysis user provides is converted into word information relates, according to the corresponding mapping audio/video file of matching retrieval of Word message.The sound clip that this retrieval mode is adapted to the user and provides comprises the situation of word content, the for example lyrics.
Mode two, the retrieval key content is the audio frequency characteristics information of this acoustic information.Discern the acoustic information that the user provided, obtain the audio frequency characteristics information of this sound clip,, differentiate, the corresponding mapping audio/video file of retrieval in video and audio bank according to the degree that conforms to as the key message of retrieval.Wherein, described audio frequency characteristics information is meant the voice data information such as music beat and note information of this section acoustic information.This retrieval mode is adapted to the situation that the user provides the sound clip of absolute music melody.
The acoustic information that provides the user had both comprised word content, when also comprising music rhythm, for example, when the user hums lyrics, can select arbitrarily above-mentioned retrieval mode one of them.Certainly, also can select two kinds of retrieval modes simultaneously, intersect and compare, can retrieve the mapping audio/video file more accurately like this.
Corresponding above-mentioned retrieval mode, when setting up the mapping video and audio bank, the audio/video file that needs will shine upon in the video and audio bank passes through digital processing in advance, and preliminary treatment is the audio/video file that comprises corresponding Word message and audio frequency characteristics information, and key step is following:
Step b1, voice messaging word information relates in the identification audio/video file;
Step b2, the audio frequency characteristics information of analysis audio/video file;
Step b3 sets up mapping relations with audio/video file word information relates and this audio/video file of audio frequency characteristics information of same, and it is stored in the mapping audio/video file storehouse.
Like this, behind the retrieval key content that extracts the acoustic information that the user provides, can compare with the corresponding key content of audio/video file in the mapping video and audio bank according to this key content, degree is differentiated selection according to conforming to.
When retrieval, retrieval comparison the preferential user terminal mapping video and audio bank from local computing.If retrieval failure, retrieval comparison from system server mapping video and audio bank again.If do not obtain satisfactory mapping audio/video file yet, the mode that then adopts the web network to grasp grasps the mapping audio/video file and the relevant information thereof of mating from the Internet, i.e. retrieval comparison from web search data terminal mapping video and audio bank.
Through the retrieval in above-mentioned a plurality of video and audio bank, after retrieving corresponding mapping audio/video file, intercepting is used for the transmit operation of data with the corresponding mapping audio/video file fragment of sound clip that the user provides from this mapped file.For example the audio files that provides of user is lyrics of a first song, and system is retrieving this first woman singer in the mode through the coupling retrieval, pairing this a part of snatch of song of these lyrics that the intercepting user is provided from this first song again.What be sent to recipient's client at last promptly is the snatch of song after the intercepting.
In addition, after retrieving corresponding mapping audio/video file, the audio frequency characteristics of the acoustic information that can also provide according to the user, corresponding audio frequency characteristics is made corresponding adjustment in the mapping projection sound file, adjusted mapping audio/video file is used for the transmit operation of data.Can better improve user experience like this, make the audio/video file that sends become personalized more, increase the enjoyment that the user uses.
In step S104, whether the user differentiates the correspondence mappings audio/video file that retrieves and meets the requirements.If differentiate for being then to change step S105 over to through the user; If be judged to be not through the user, then return step S103; The mapping audio/video file of retrieval correspondence again.
Wherein, through on after a step retrieves corresponding mapping audio/video file, return result for retrieval for the transmit leg client, wherein said result for retrieval comprise this mapping audio/video file title, shine upon audio/video file fragment time span and form.After confirming through the user, the mapping audio/video file that this retrieves promptly is used for the transmit operation of data.
As shown in Figure 2; After retrieving corresponding mapping audio/video file; In the interactive interface Output bar 320 of the instant messaging interactive interface 300 of user Mary and user Joy; System returns a result for retrieval for user Mary, and result for retrieval has demonstrated this section mapping audio/video file title, time span and form.User Mary is through clicking retrieve result request control 321---and " confirming " and " retrieving again ", come whether this document met the requirements and make response.The mapping audio/video file fragment that meets user Mary requirement promptly is used to be sent to the instant communication terminal of user Joy.
In step S105, will be sent to instant messaging recipient client through the mapping audio/video file that a last step is confirmed.
Wherein, the mode that will be sent to instant messaging recipient client through the mapping audio/video file that a last step is confirmed is following the two one of which at least,
Mode one should be shone upon audio/video file and was contained in the instant messaging chat message, was sent in recipient's instant messaging interactive interface, through playing after user's clicking trigger.
Mode two, the voice call of setting up the two in advance connects, and should shine upon audio/video file and directly be sent to recipient's client and broadcast.
Shown in Figure 4 is the structure chart of the mapping property outlet terminal of acoustic information in a kind of instant messaging according to the invention.
User terminal mapping video and audio bank 110 is to be positioned at user terminal, is used to store the database of the audio/video file that is used to the output of mapping property;
Shining upon audio-visual retrieval module 130, is to be used for the acoustic information that provides according to the user, from the functional module of the corresponding mapping audio/video file of mapping video and audio bank retrieval;
Audio-visual playing module 140 is the functional modules that are used to play the mapping audio/video file that receives.
Further, corresponding described user terminal mapping video and audio bank also is provided with transmit leg voice screening unit, and it comprises,
Individual character phonetic feature module 111 is the functional modules that are used to store individual subscriber audio frequency characteristics data;
User speech identification module 112; Be the individual subscriber audio frequency characteristics data that are used for according to individual character phonetic feature module 111; The acoustic information that comparative analysis collects, thus filter out the voice data that meets the individual subscriber audio frequency characteristics functional module as the acoustic information that collects.
Instant messaging interactive interface 300 in the JICQ among Fig. 4, it is the associative operation platform that instant messaging information interchange and the output of mapping property are provided for the user.
In the present embodiment, the user wants to use the mapping property output of acoustic information of the present invention need at first set up user terminal mapping video and audio bank 110.During practical application, sound collection module 120 is gathered the acoustic information that the user provides, and shines upon the acoustic information that audio-visual retrieval module 130 provides according to the user, from the corresponding mapping audio/video file of mapping video and audio bank retrieval.The audio/video file that retrieves is sent to recipient's client through the instant messaging chat tool.When the user receive from other users send contain the instant communication message that shine upon audio/video file the time, trigger and play afterwards audio-visual playing module 140 and promptly this mapping audio/video file is play.
Especially; The relevant acoustic information of user oneself that provides to the user also is provided with the transmit leg voice screening function to the user; The user has write down the audio frequency characteristics data of individual subscriber in advance through individual character phonetic feature module 111; After sound collection module 120 collects the acoustic information that the user provides; User speech identification module 112 is according to the audio frequency characteristics information of individual character phonetic feature module 111 record, filter out meet the individual subscriber audio frequency characteristics voice data as the acoustic information that collects.
Shown in Figure 5 is the structure chart of the mapping property output system of acoustic information in a kind of instant messaging according to the invention.By finding out that system according to the invention is made up of with the server that is connected both sides' client 100 200 two parts client 100 among the figure.
Terminal according to the invention, promptly client 100, and it comprises:
User terminal mapping video and audio bank 110 is to be positioned at user terminal, is used to store the database of the audio/video file that is used to the output of mapping property;
Shining upon audio-visual retrieval module 130, is to be used for the acoustic information that provides according to the user, from the functional module of the corresponding mapping audio/video file of mapping video and audio bank retrieval;
Audio-visual playing module 140 is the functional modules that are used to play the mapping audio/video file that receives.
Wherein, said server 200 comprises:
System server mapping video and audio bank 210 is to be positioned at system server, is used to store the database of the audio/video file that is used to the output of mapping property;
Server data retrieval module 220 is to be used for the acoustic information that provides according to the user, from the functional module of the corresponding mapping audio/video file of system server mapping video and audio bank retrieval;
Server data processing module 230 is to be used for the functional module that data exchange between processing server and transmit leg, the recipient's client.
300 is instant messaging interactive interface in the JICQ among Fig. 5, and the associative operation platform of instant messaging information interchange and the output of mapping property is provided for the user.
In the present embodiment, the user wants to use the mapping property output of acoustic information of the present invention need at first set up user terminal mapping video and audio bank 110.During practical application, sound collection module 120 is gathered the acoustic information that the user provides, and shines upon the acoustic information that audio-visual retrieval module 130 provides according to the user, from the corresponding mapping audio/video file of mapping video and audio bank retrieval.If the retrieval failure is then sent request through server data processing module 230 to server 200, server data retrieval module 220 is according to request corresponding mapping audio/video file of retrieval from system server mapping video and audio bank 210 of user.After retrieving successfully, should shine upon audio/video file through server data processing module 230 and be sent to recipient's client.After the recipient receives the instant communication message of this mapping audio/video file, play through triggering 140 pairs of these mapping audio/video files of audio-visual playing module.
More than be the description of this invention and non-limiting, based on other embodiment of inventive concept, all among protection scope of the present invention.
Claims (19)
1. the method for the mapping property output of acoustic information in the instant messaging is characterized in that said method comprises the steps:
Step 1 is set up the mapping video and audio bank that is used in instant messaging mapping output;
Step 2 is directed to the instant messaging recipient, through the triggering of mapping output function, gathers the acoustic information of transmit leg;
Step 3 is according to the user voice information that collects corresponding mapping audio/video file of retrieval from the mapping video and audio bank;
Step 4 is sent to instant messaging recipient client with the mapping audio/video file that retrieves in the last step.
2. the method for the mapping property output of acoustic information in the instant messaging according to claim 1 is characterized in that: said mapping video and audio bank comprises following three one of which at least,
User terminal mapping video and audio bank is stored in the client at user's JICQ place;
System server mapping video and audio bank is stored in the pairing system server of said JICQ;
Web search data terminal mapping video and audio bank is stored in the network third party that voice data can be provided to web search.
3. the method for the mapping property output of acoustic information in the instant messaging according to claim 2; It is characterized in that: corresponding described system server mapping video and audio bank establishes the corresponding individual character video-audio data of the instant messaging identifier map listing with the user.
4. the method for the mapping property output of acoustic information in the instant messaging according to claim 3; It is characterized in that: the described individual character video-audio data map listing that is directed to specific instant messaging identifier includes respectively corresponding contact person's individual character map listing of this user's instant communication contacts.
5. the method for the mapping property output of acoustic information in the instant messaging according to claim 1 is characterized in that: said acoustic information sends for the user or the mode to play sound, the sound clip that provides to instant messaging transmit leg client.
6. the method for the mapping property output of acoustic information in the instant messaging according to claim 1 is characterized in that: said mapping output function triggering mode comprises following three one of which at least,
Mode one triggers through the mapping function control in the instant messaging interactive interface, and this instant messaging interactive interface is corresponding with user-selected instant messaging reciever;
Mode two in the contacts list of instant messaging main panel, is directed to selected contact object, carries out mapping function and triggers;
Mode three when local client is in recording state, adopts specific voice messaging to trigger.
7. the method for the mapping property output of acoustic information in the instant messaging according to claim 6 is characterized in that: said mapping output function triggering mode three comprises following steps,
Step a1, the sound-recording function of unlatching local client;
Step a2 gathers the acoustic information that comes from the user;
Step a3, identification user's acoustic information judges whether to include identification of contacts;
Step a4, trigger be directed to the aforementioned contact sign corresponding contact person's mapping output function.
8. the method for the mapping property output of acoustic information in the instant messaging according to claim 1; It is characterized in that: be directed to the transmit leg acoustic information of being gathered in the described step 2; With the instant messaging identifier of transmit leg as index information; As by index information, it is stored in local client, instantaneous communication system server and third party's memory three at least in the one of which with the corresponding audio data.
9. the method for the mapping property output of acoustic information in the instant messaging according to claim 1 is characterized in that: the corresponding mapping audio/video file mode of retrieval is following the two one of which at least in the said mapping video and audio bank,
Mode one, the acoustic information that the identification user provides is converted into word information relates, according to the corresponding mapping audio/video file of matching retrieval of Word message;
Mode two is discerned the acoustic information that the user provided, and obtains the audio frequency characteristics information of this sound clip,, differentiates the corresponding mapping audio/video file of retrieval in video and audio bank with the key message of this audio frequency characteristics information as retrieval according to the degree that conforms to.
10. the method for the mapping property output of acoustic information in the instant messaging according to claim 9 is characterized in that: the audio/video file that is stored in the mapping video and audio bank need pass through digital processing in advance, comprise the steps,
Step b1, voice messaging word information relates in the identification audio/video file;
Step b2, the audio frequency characteristics information of analysis audio/video file;
Step b3 sets up mapping relations with audio/video file word information relates and this audio/video file of audio frequency characteristics information of same, and it is stored in the mapping audio/video file storehouse.
11. the method for the mapping property output of acoustic information in the instant messaging according to claim 1; It is characterized in that: after mapping is penetrated audio/video file in the video and audio bank and analyzed contrast and do not obtain corresponding mapping audio/video file; The mode that adopts network to grasp grasps the mapping audio/video file and the relevant information thereof of mating from the Internet.
12. the method for the mapping property output of acoustic information in the instant messaging according to claim 1; It is characterized in that: after retrieving corresponding target audio/video file; Intercepting is used for the transmit operation of data with the corresponding mapping audio/video file fragment of sound clip that the user provides from this mapped file.
13. the method for the mapping property output of acoustic information in the instant messaging according to claim 1; It is characterized in that: after retrieving corresponding mapping audio/video file; Return result for retrieval for the transmit leg client, be used for the transmit operation of data after collection user's the affirmation information.
14. the method for the mapping property output of acoustic information in the instant messaging according to claim 1 is characterized in that: described result for retrieval comprises title, mapping audio/video file fragment time span, the form of this mapping audio/video file.
15. the method for the mapping property output of acoustic information in the instant messaging according to claim 1 is characterized in that: behind the corresponding mapping audio/video file of retrieval, also comprise the steps in the said step 3,
Step c1, the audio frequency characteristics information of the acoustic information that analysis user provides;
Step c2 analyzes the audio frequency characteristics information of shining upon audio/video file;
Step c3 provides the audio frequency characteristics information of acoustic information according to the user, and corresponding audio frequency characteristics is made corresponding adjustment in the mapping projection sound file.
16. the method for the mapping property output of acoustic information in the instant messaging according to claim 1 is characterized in that: the mode that the mapping audio/video file that will retrieve in the said step 4 is sent to instant messaging recipient client is following the two one of which at least,
Mode one should be shone upon audio/video file and was contained in the instant messaging chat message, was sent in recipient's instant messaging interactive interface, through playing after user's clicking trigger;
Mode two, the voice call of setting up both sides in advance connects, and should shine upon audio/video file and directly be sent to recipient's client and broadcast.
17. the mapping property outlet terminal of acoustic information in the instant messaging is characterized in that this terminal comprises following part:
User terminal mapping video and audio bank is to be positioned at user terminal, is used to store the database of the audio/video file that is used to the output of mapping property;
The sound collection module is the functional module that is used to gather the acoustic information that the user provides;
Shining upon audio-visual retrieval module, is to be used for the acoustic information that provides according to the user, from the functional module of the corresponding mapping audio/video file of mapping video and audio bank retrieval;
Audio-visual playing module is the functional module that is used to play the mapping audio/video file that receives.
18. the terminal of the mapping property output of acoustic information in the instant messaging according to claim 17 is characterized in that: corresponding described mapping video and audio bank, be provided with transmit leg voice screening unit, it comprises,
Individual character phonetic feature module is the functional module that is used to store individual subscriber audio frequency characteristics data;
The user speech identification module; Be the individual subscriber audio frequency characteristics data that are used for according to individual character phonetic feature module; The acoustic information that comparative analysis collects, thus filter out the voice data that meets the individual subscriber audio frequency characteristics functional module as the acoustic information that collects.
19. the mapping property output system of acoustic information in the instant messaging comprises client that the user manipulates and the server that connects both sides' client, it is characterized in that:
Said client comprises,
User terminal mapping video and audio bank is to be positioned at user terminal, is used to store the database of the audio/video file that is used to the output of mapping property;
The sound collection module is the functional module that is used to gather the acoustic information that the user provides;
Shining upon audio-visual retrieval module, is to be used for the acoustic information that provides according to the user, from the functional module of the corresponding mapping audio/video file of mapping video and audio bank retrieval;
Audio-visual playing module is the functional module that is used to play the mapping audio/video file that receives;
Said server comprises,
System server mapping video and audio bank is to be positioned at system server, is used to store the database of the audio/video file that is used to the output of mapping property;
The server data retrieval module is to be used for the acoustic information that provides according to the user, from the functional module of the corresponding mapping audio/video file of system server mapping video and audio bank retrieval;
The server data processing module is to be used for the functional module that data exchange between processing server and transmit leg, the recipient's client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103869496A CN102377692A (en) | 2011-11-28 | 2011-11-28 | Method, terminal and system for mapping output of voice messages in instant messaging |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103869496A CN102377692A (en) | 2011-11-28 | 2011-11-28 | Method, terminal and system for mapping output of voice messages in instant messaging |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102377692A true CN102377692A (en) | 2012-03-14 |
Family
ID=45795683
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011103869496A Pending CN102377692A (en) | 2011-11-28 | 2011-11-28 | Method, terminal and system for mapping output of voice messages in instant messaging |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102377692A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102662704A (en) * | 2012-03-31 | 2012-09-12 | 上海量明科技发展有限公司 | Method, terminal and system for starting instant messaging interaction interface |
| CN102780653A (en) * | 2012-08-09 | 2012-11-14 | 上海量明科技发展有限公司 | Method, client and system for fast communication in instant messaging |
| CN102801646B (en) * | 2012-07-25 | 2016-05-04 | 上海量明科技发展有限公司 | By JICQ compare operation method, client and system |
| CN106559469A (en) * | 2015-09-30 | 2017-04-05 | 北京奇虎科技有限公司 | A kind of method and apparatus that music information is pushed based on instant messaging |
| CN107040452A (en) * | 2017-02-08 | 2017-08-11 | 浙江翼信科技有限公司 | A kind of information processing method, device and computer-readable recording medium |
| CN110300048A (en) * | 2018-03-23 | 2019-10-01 | 阿里巴巴集团控股有限公司 | A kind of audio message sending method, equipment and system based on instant messaging |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101329867A (en) * | 2007-06-21 | 2008-12-24 | 西门子（中国）有限公司 | Method and device for playing speech on demand |
| CN101360071A (en) * | 2008-09-16 | 2009-02-04 | 腾讯科技（深圳）有限公司 | Method and system for multimedia resource sharing based on instant chat |
| CN101567203A (en) * | 2008-04-24 | 2009-10-28 | 深圳富泰宏精密工业有限公司 | System and method for automatically searching and playing music |
| CN102014081A (en) * | 2010-12-23 | 2011-04-13 | 汉王科技股份有限公司 | Method, device and system for playing song segment in instant communication system |
-
2011
- 2011-11-28 CN CN2011103869496A patent/CN102377692A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101329867A (en) * | 2007-06-21 | 2008-12-24 | 西门子（中国）有限公司 | Method and device for playing speech on demand |
| CN101567203A (en) * | 2008-04-24 | 2009-10-28 | 深圳富泰宏精密工业有限公司 | System and method for automatically searching and playing music |
| CN101360071A (en) * | 2008-09-16 | 2009-02-04 | 腾讯科技（深圳）有限公司 | Method and system for multimedia resource sharing based on instant chat |
| CN102014081A (en) * | 2010-12-23 | 2011-04-13 | 汉王科技股份有限公司 | Method, device and system for playing song segment in instant communication system |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102662704A (en) * | 2012-03-31 | 2012-09-12 | 上海量明科技发展有限公司 | Method, terminal and system for starting instant messaging interaction interface |
| CN102801646B (en) * | 2012-07-25 | 2016-05-04 | 上海量明科技发展有限公司 | By JICQ compare operation method, client and system |
| CN102780653A (en) * | 2012-08-09 | 2012-11-14 | 上海量明科技发展有限公司 | Method, client and system for fast communication in instant messaging |
| CN102780653B (en) * | 2012-08-09 | 2016-03-09 | 上海量明科技发展有限公司 | Quick method, client and the system communicated in instant messaging |
| CN106559469A (en) * | 2015-09-30 | 2017-04-05 | 北京奇虎科技有限公司 | A kind of method and apparatus that music information is pushed based on instant messaging |
| CN106559469B (en) * | 2015-09-30 | 2021-06-18 | 北京奇虎科技有限公司 | Method and device for pushing music information based on instant messaging |
| CN107040452A (en) * | 2017-02-08 | 2017-08-11 | 浙江翼信科技有限公司 | A kind of information processing method, device and computer-readable recording medium |
| CN107040452B (en) * | 2017-02-08 | 2020-08-04 | 浙江翼信科技有限公司 | Information processing method and device and computer readable storage medium |
| CN110300048A (en) * | 2018-03-23 | 2019-10-01 | 阿里巴巴集团控股有限公司 | A kind of audio message sending method, equipment and system based on instant messaging |
| CN110300048B (en) * | 2018-03-23 | 2022-07-01 | 阿里巴巴集团控股有限公司 | Audio message sending method, equipment and system based on instant messaging |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104700835B (en) | The method and system of cable voice port is provided | |
| US9824150B2 (en) | Systems and methods for providing information discovery and retrieval | |
| US11588867B2 (en) | System and method for generating dynamic playlists utilising device co-presence proximity | |
| CN105120304B (en) | Information display method, apparatus and system | |
| US11282519B2 (en) | Voice interaction method, device and computer readable storage medium | |
| CN103403705B (en) | Loading a mobile computing device with media files | |
| US9329830B2 (en) | Music playback method, third-party application and device | |
| TWI455017B (en) | Music player connection system for enhanced playlist selection | |
| CN102377692A (en) | Method, terminal and system for mapping output of voice messages in instant messaging | |
| KR20050085783A (en) | Method and system for network downloading of music files | |
| CN107615276A (en) | Virtual assistant for media playback | |
| CN107040452B (en) | Information processing method and device and computer readable storage medium | |
| KR20070040196A (en) | System and method for providing online community service for digital contents | |
| CN102984050A (en) | Method, client and system for searching voices in instant messaging | |
| US20100235443A1 (en) | Method and apparatus of providing a locket service for content sharing | |
| CN109509472A (en) | Method, apparatus and system based on voice platform identification background music | |
| CN109710799B (en) | Voice interaction method, medium, device and computing equipment | |
| US20120117197A1 (en) | Content auto-discovery | |
| CN109903755A (en) | A kind of voice interactive method, device, storage medium and air conditioner | |
| CN100438510C (en) | Method and system for realizing synchronous receiving | |
| JP2008164759A (en) | Voice synthesis method, voice synthesis device, program and recording medium | |
| KR20130103243A (en) | Method and apparatus for providing music selection service using speech recognition | |
| JP7185712B2 (en) | Method, computer apparatus, and computer program for managing audio recordings in conjunction with an artificial intelligence device | |
| CN109377988A (en) | For the exchange method of intelligent sound box, medium, device and calculate equipment | |
| JP2001345954A (en) | Virtual pet answer system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120314 |