CN102946399A - Method, client and system for identifying streaming media interactive content in instant messaging - Google Patents
Method, client and system for identifying streaming media interactive content in instant messaging Download PDFInfo
- Publication number
- CN102946399A CN102946399A CN2012104894165A CN201210489416A CN102946399A CN 102946399 A CN102946399 A CN 102946399A CN 2012104894165 A CN2012104894165 A CN 2012104894165A CN 201210489416 A CN201210489416 A CN 201210489416A CN 102946399 A CN102946399 A CN 102946399A
- Authority
- CN
- China
- Prior art keywords
- content
- streaming media
- character
- streaming
- identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a method, a client and a system for identifying streaming media interactive content in instant messaging and belongs to the technical fields of communication and software. The method includes the following steps: collecting interacted streaming media content which is voice content or video content or multi-media content; identifying the streaming media content into characters; and when an output condition of identified characters is met, the identified characters are inserted into an original streaming media interactive frame to be output or inserted into an adjacent position of the original streaming media interactive frame to be output, or replace the original streaming media interactive frame to be output. By means of the method, the client and the system, the streaming media content in interactive communication can be identified, and loading or output operation is conducted for the identified character content corresponding to the streaming media interactive frame.
Description
Technical field
The invention belongs to communication, software technology field.
Technical background
Instant messaging (InstantMessaging is called for short IM) in most cases, refers to the business that can immediately send or receive the functions such as internet message.It has become people carry out interactive communication by network platform, comprise the interactive operation of the several data forms such as text, picture, voice, video, multimedia in order to realization, and can utilize JICQ to transmit expediently operation to existing document data.On the basis of interactive communication, the several functions such as private page, blog, microblogging, Email, music, picture, game, video display and search have also progressively been developed by JICQ.JICQ has also been realized the more widely purposes such as information, amusement, search, ecommerce, office, Web Community no longer merely as chat tool.The equipment that can realize the instant messaging access function is varied.Typical device type comprises the PC of using legacy network, and panel computer; Also comprise the smart mobile phone that uses mobile Internet, etc.
At present the type of instant communication software is also varied, typically includes the QQ of Tentent Science company or little letter, the MSN of Microsoft, the ICQ of AOL, and the rice of the Wang Wang of Taobao, POPO, Fetion, millet company is merely, etc.
Under current technical conditions, utilize the form of recording stream medium data to carry out mutual instant messaging form, use day by day universal.Such as, little letter JICQ commonly used, rice is JICQ or QQ JICQ etc. merely, can be sent to the instant communication client at contact object place after the recording audio data, and receive the voice data that contact object sends.Carry out when mutual in the recording audio data, can avoid the trouble of input character, by users are liked.The voice data of recording; usually the form with the mutual frame of Streaming Media presents; when the time span of voice data is grown; the length of the mutual frame of Streaming Media is just longer; when the time span of voice data is short; the length of the mutual frame of Streaming Media is just shorter, and usually also mark has the time span etc. of Streaming Media.After triggering the mutual frame of Streaming Media, can play corresponding stream medium data.
But when the form of utilizing the mutual frame of Streaming Media is showed streaming medium content, a disadvantage is arranged, be exactly the user when checking the Streaming Media intersection record, must play and listen to corresponding stream medium data, can check streaming medium content wherein.This mode of checking is loaded down with trivial details.
Summary of the invention
The method that the purpose of this invention is to provide Streaming Media interaction content identification in a kind of instant messaging, and corresponding client and system, utilize the present invention, can identify the streaming medium content in the interactive communication, corresponding the mutual frame of Streaming Media is written into and output function the character content of identification.
The method of Streaming Media interaction content identification in a kind of instant messaging provided by the present invention includes following steps:
Gather and finished mutual streaming medium content, this streaming medium content is voice content or video content or content of multimedia;
Aforesaid streaming medium content is identified as character;
When satisfying the output condition of identification character, will identify content and be inserted in the mutual frame of former Streaming Media and export, or be inserted into the close position output of the mutual frame of former Streaming Media, or replace the mutual frame output of former Streaming Media.
Further, described streaming medium content is identified as the operation of character, is to carry out identifying operation by aforesaid streaming medium content is pushed to identified server, and then is back to the instant communication client at place.
Further, described streaming medium content is in the situation that carry out push operation to identified server, pushes in the mode of streaming medium content set, comprises streaming medium content corresponding to the mutual frame of two or more Streaming Medias in this streaming medium content set.
Further, the output condition of described identification character, implement as follows:
The character of presetting in order to trigger identification character output presents control;
When the aforementioned character of collection acquisition presented the triggering message of control, the mutual frame of Streaming Media of the character content correspondence of having identified the place was written into and output function.
Further, described character presents control, and corresponding whole mutual frame of Streaming Media arranges, and perhaps the mutual frame of each Streaming Media in corresponding the place current window arranges, and perhaps corresponding specific wall scroll or the many mutual frames of Streaming Media arrange.
Further, when gather obtaining that the mutual frame of the Streaming Media at place triggered play operation message, after the streaming medium content of the mutual frame of Streaming Media at place identified, identification character is exported.
Further, when triggering the mutual frame of aforesaid Streaming Media, can implement as follows:
Gather the user to the triggering message of the mutual frame of specific stream media;
Get the mutual frame of Streaming Media in the adjacent N bar instant communication message, obtain corresponding character output after the identification, perhaps, in the situation that judge had identification character, gather the character output of having identified.
Further, aforesaid N elects the positive integer between the 1-4 as.
Further, the character content that corresponding identification obtains presents by the Compilatory control form;
Obtaining by the aforementioned controls collection in the situation of user to the edit file of character content, the content correspondence behind the editor the instant communication message at place and stored, as the acquiescence recognition data of the instant communication message of this streaming medium content.
Further, when the Streaming Media interaction content that carries out was carried out data search, the streaming medium content in the trigger data hunting zone carried out character recognition.
Further, for streaming medium content to be identified, the partial data in streaming medium content identification obtained character after, corresponding the mutual frame output of former Streaming Media.
Further, replace in the situation of the mutual frame of original Streaming Media in the character content that will identify acquisition, with the character data after replacing, and set up linking relationship between the streaming medium content of place instant communication message; When the triggering message that gather to obtain this arbitrary position of character data, start this linking relationship, access corresponding stream medium data and open and report.
Further, the character data that corresponding the mutual frame of former Streaming Media is exported is the partial data in the character that obtains of identification, its character amount account for total character amount 50% or below.
Further, the character content that corresponding the mutual frame of former Streaming Media is exported selects the character of particular community type to keep.
Further, the character types that keep are the noun content in the instant communication message identification character content of place.
Further, between the character data that obtains of identify and corresponding Streaming Media interaction content, set up the corresponding relation of data, when triggering the Streaming Media interaction content of ad-hoc location, the character content corresponding with it done differentiation and shown, perhaps when triggering specific character content, the Streaming Media interaction content place part corresponding with it done differentiation and shown.
Further, between the character content of the mutual frame of Streaming Media and identification acquisition, set up corresponding relation, to realize by the mode that the mutual frame of Streaming Media is cut apart, the quantity of the character that obtains according to identification is carried out cutting apart of corresponding umber to the mutual frame of Streaming Media, every a corresponding character.
The present invention also provides the client of Streaming Media interaction content identification in a kind of instant messaging, and this client comprises:
The streaming medium content collecting unit has been finished mutual streaming medium content in order to gather, and this streaming medium content is voice content or video content or content of multimedia;
The streaming medium content recognition unit is in order to be identified as character with aforesaid streaming medium content;
Identification content output unit in order to when satisfying the output condition of identification character, will identify content and be inserted in the mutual frame of former Streaming Media and export, or be inserted into the close position output of the mutual frame of former Streaming Media, or replace the mutual frame of former Streaming Media and export.
The present invention also provides the system of Streaming Media interaction content identification in a kind of instant messaging, and this system comprises:
Instant communication client, finished mutual streaming medium content in order to gather, push to following identified server and carry out character recognition, with the character content after the identification, when satisfying the output condition of identification character, be inserted in the mutual frame of former Streaming Media and export, or be inserted into the close position output of the mutual frame of former Streaming Media, or replace the mutual frame output of former Streaming Media;
Identified server, the streaming medium content that pushes in order to receive aforementioned instant communication client pushes to aforesaid instant communication client after streaming medium content is identified as character content.
Further, described instant communication client, it comprises:
The streaming medium content collecting unit has been finished mutual streaming medium content in order to gather, and this streaming medium content is voice content or video content or content of multimedia;
The streaming medium content push unit pushes to corresponding identified server in order to the streaming medium content with aforementioned collection;
Identification content reception unit, the identification character content that pushes in order to receive identified server;
Identification content output unit in order to when satisfying the output condition of identification character, will identify content and be inserted in the mutual frame of former Streaming Media and export, or be inserted into the close position output of the mutual frame of former Streaming Media, or replace the mutual frame of former Streaming Media and export.
Further, described identified server, it comprises:
The Streaming Media receiving element, the streaming medium content to be identified that pushes in order to receive aforementioned instant communication client;
The Streaming Media recognition unit, the streaming medium content that receives in order to identification is character content;
The recognition result push unit pushes to aforesaid instant communication client in order to will identify the character content that obtains.
Description of drawings
Fig. 1 is the method flow diagram of Streaming Media interaction content identification in the instant messaging of the present invention, corresponding embodiment 1.
Fig. 2 is the structured flowchart of the client of Streaming Media interaction content identification in the instant messaging of the present invention, corresponding embodiment 2.
Fig. 3 is the structured flowchart of the system of Streaming Media interaction content identification in the instant messaging of the present invention, corresponding embodiment 3.
Embodiment
Embodiment 1
In the present invention, can be to the instant messaging intersection record of user take streaming medium content as interactive form, carry out its data correspondence the streaming medium content of finishing interactive operation after the character recognition and be written into.In the specific implementation, join shown in Figure 1ly, the present embodiment has following steps:
Step S110 gathers and has finished mutual streaming medium content, and this streaming medium content is voice content or video content or content of multimedia;
Step S120 is identified as character with aforesaid streaming medium content;
Step S130 when satisfying the output condition of identification character, will identify content and be inserted in the mutual frame of former Streaming Media and export, or be inserted into the close position output of the mutual frame of former Streaming Media, or replace the mutual frame output of former Streaming Media.
As previously mentioned, streaming medium content described in the invention, it is the streaming medium content of having finished interactive communication, this streaming medium content is sent and has been carried out data transfer operation to contact object by user oneself, or the received instant communication message that comes from contact object.In current application technology, described streaming medium content is especially take the voice data of recorded speech information as main; But it is pointed out that the video data of recording can be used as streaming medium content too, such as, by recording the formed data content of lip reading, perhaps for sign language, the video data of gesture just can be used as mutual main contents.In addition, described streaming medium content also can be content of multimedia, has simultaneously audio, video data.
Under current technical conditions, the interaction content of Streaming Media form is showed with the form of bar frame in intersection record usually.The flexible form that it is pointed out that the streaming medium content displaying is various, is not limited to the frame structure of bar shaped.In the present invention, for convenience of description, will in order to express the version of Streaming Media intersection record, be referred to as the mutual frame of Streaming Media.
The RM of streaming medium content is versatile and flexible, as typical embodiment, is that the instant communication client at corresponding place arranges long-range identified server.
Default speech recognition corpus and speech recognition engine in this identified server behind the speech data that the reception instant communication client transmits, carry out identifying operation to it.The advantage of this setup is the software and hardware burden that can reduce instant communication client place terminal, and can improves discrimination; Weak point is to need network service to implement.
In the situation that utilize identified server to carry out identifying operation, the streaming medium content that selected needs is carried out character recognition transfers to identified server; In identified server, utilize default speech recognition corpus and speech recognition engine to carry out identifying operation; Then will identify the result who obtains and be back to aforesaid instant communication client.Wherein, if described streaming medium content is pre-stored in the current terminal in instant communication client place, then obtain aforementioned identification server corresponding IP address and port numbers by the place instant communication client, generate and send socket, carry out the transmit operation of data.If described streaming medium content is stored in the instantaneous communication system server, then can gather by system server the identification application of instant communication client, selected streaming medium content is transferred to aforesaid identified server, for identifying operation.
The identification content that is obtained by identified server can directly be sent to aforesaid instant communication client, also can at first transfer to the instantaneous communication system server, is forwarded to this instant communication client by the instantaneous communication system server again.
It is pointed out that also can be by the terminal equipment at instant communication client place, and default Streaming Media identification module is such as sound identification module.Be preinstalled with speech recognition corpus and speech recognition engine in this sound identification module, can receive the interactive voice content that pushes, behind identifying processing, change it into character content.
When carrying out streaming medium content to the push operation of identified server, in order to save the time quantum of initiating communication operation, be fit to the form of streaming medium content with set sent.Streaming medium content set when sending is comprising the corresponding streaming medium content of the mutual frame of the Streaming Media that two or more are arranged.The corresponding single streaming medium content of the mutual frame of each Streaming Media, corresponding the interactive information of a Streaming Media form.In the specific implementation, each streaming medium content set can comprise the number of more interactive information, such as 5 or 10 or 100, even can comprise the Streaming Media interaction content that all have been stored.
When triggering the identifying operation of streaming medium content, perhaps trigger the character content of having identified and present when operating, the form that can present by character is set control is implemented.Described character presents control, can be in the situation that this control of triggering carries out output function with corresponding identification character content.Wherein, finish if aforesaid character content has been identified, then it is gathered and exports and get final product; If aforesaid character content is not also identified and is finished, then gather the streaming medium content that all are triggered, it is carried out identifying operation.Specifically, can realize as follows:
The character of presetting in order to trigger identification character output presents control;
When the aforementioned character of collection acquisition presented the triggering message of control, the mutual frame of Streaming Media of the character content correspondence of having identified the place was written into and output function.
Aforesaid character presents control, can be corresponding whole mutual frames of Streaming Media arrange.In this case, if the mutual frame of each Streaming Media does not all carry out character recognition, then the corresponding Streaming Media interaction content of the mutual frame of whole Streaming Medias is carried out the character recognition operation, then the recognition result correspondence the mutual frame output of each Streaming Media.If there has been the streaming medium content of part to be identified, after gathering, each streaming medium content that then will not be identified carries out character recognition and output function.
Aforesaid character presents control, and the corresponding streaming medium content of the mutual frame of each Streaming Media that also can only gather in the current window of place carries out identifying operation.This is because the Streaming Media interaction content in the current observed window of user, the data paid close attention to of user just, and the Streaming Media interaction content in other window, and the user may not pay close attention to.
Further, aforesaid character presents that control also can only be directed to specific wall scroll or the many mutual frames of Streaming Media arrange.For instance, corresponding every Streaming Media interactive information when the position at trigger message promoter place, can generate corresponding character and present control.The position at described promoter place refers to present the position of promoter's data message, and this position shows the data such as promoter's head portrait data or user name usually.After having represented character for the mutual frame of the Streaming Media at place and having presented control, if obtain user's trigger message by this control collection, such as the clicking trigger message by touch-screen, perhaps pass through the click message of Genius mouse etc., can trigger the operation process of judging whether streaming medium content corresponding to the mutual frame of place Streaming Media has carried out character recognition, in the situation that do not carry out character recognition, its data are gathered, it is carried out character recognition.Then will identify the character content that obtains, carry out output function by the mutual frame of the Streaming Media at its place or on the mutual frame of this Streaming Media next door.
In addition, when triggering is carried out identifying operation to the corresponding streaming medium content of the mutual frame of Streaming Media, can also carry out like this: gather the user to the message of the triggering play operation of the mutual frame of specific stream media, so that the corresponding streaming medium content of the mutual frame of this Streaming Media enters into the report state; Meanwhile, the Streaming Media interaction content in the mutual frame of the Streaming Media at place is identified, exported after being converted to character.If the streaming medium content in the mutual frame of place Streaming Media has been carried out character recognition in advance, then directly gather this character of having identified and export.So the user also can see the character content that belongs to the mutual frame of this Streaming Media that identification obtains when reporting the stream medium data corresponding with the mutual frame of specific stream media.
Further, when triggering the mutual frame of specific Streaming Media, can also carry out like this: gather the user to the triggering message of the mutual frame of specific stream media, such as the click message to the mutual frame of specific stream media.Then, get the mutual frame of Streaming Media in the adjacent N bar instant communication message, wherein N is fit to elect as the positive integer between the 1-4.After identification, obtain the character corresponding with the mutual frame of selected Streaming Media, respectively corresponding the mutual frame output of Streaming Media at place; In addition, stream medium data in the mutual frame of Streaming Media in the selected scope may carry out data identification in advance, so, just can travel through the data corresponding with the mutual frame of selected Streaming Media, judge whether the identification character result that prestores, in the situation that have, can directly it be gathered and corresponding the separately mutual frame output of Streaming Media at place.Utilize this mode especially valuable, because for instant communication message, if the user checks current instant communication message, so, this user also might expect to inquire about adjacent instant communication message very much.
Further, aforesaid each identification character content can also present by the Compilatory control form.This control be in the situation that the output character content can also gather the user to the edit file of character content, the content correspondence behind the editor the instant communication message at place and stored, as the acquiescence recognition data of the instant communication message of this streaming medium content.
Trigger the type that factor that the Streaming Media interaction content carries out identifying operation also has other.Such as, an interaction message that has 210 streaming medium contents between user A and the contact object B, in the memory of user A, contact object B had once given an oral account the address of oneself, that is to say, user A need to be in the streaming medium content that contact object B sends the data message aspect the search address.The character recognition that just can trigger the Streaming Media interaction content in this case, operates.Can be by operation side, such as user A, the data area that selection need to be searched for is carried out the identifying operation of character according to this data area.As an example, in aforementioned 210 streaming medium contents, have 110 from the instant communication message of the streaming medium content of contact object B, so, just can gather laggard line character identifying operation to these 110 instant communication messages.
The character content that obtains of identifying needs the mutual frame of Streaming Media at corresponding place to carry out the output function of data.As previously mentioned, the way of output of typical character content comprises:
(1) will identify content is inserted in the mutual frame of former Streaming Media and exports.
As an example, show the mutual frame of Streaming Media that has between user A and the contact object B in instant communication interaction interface, the mutual frame of each Streaming Media is all to there being streaming medium content.On the next door of the mutual frame of each Streaming Media, be provided with character and present control.After having triggered this character and having presented control, can gather the corresponding streaming medium content of the mutual frame of this Streaming Media, it is carried out processing operation of character recognition.And then the character content that will identify acquisition directly is inserted in the mutual frame of Streaming Media at place.
Under this execution mode, the size of the mutual frame of described Streaming Media can be adjusted as required.Such as, when exporting content after the identification according to the font of acquiescence, if the length of the mutual frame of Streaming Media is too short, then the mutual frame of Streaming Media can be done corresponding extension; If the mutual frame length of the Streaming Media of delegation is inadequate, can also extend to the mutual frame of Streaming Media of multirow, until can put down all character content.
In addition, the size constancy that also can keep the mutual frame of original Streaming Media, if the words that the undersize of the mutual frame of original Streaming Media has been identified the character content of acquisition to insert all, the character content of display part only then, and after gathering the triggering message that obtains the character content region, generate pop-up window, the character content that complete output is all.
(2) close position that is inserted into the mutual frame of former Streaming Media is exported.
Under this mode, be that the character content that identification obtains is inserted into the position adjoining with the mutual frame of original Streaming Media, and do not insert in the position of the mutual frame of original Streaming Media.Under this embodiment, need to adjust the layout of interactive interface, coming provides the space for inserting character content.
Insert the position of character content, preferred form is to be close to the below of the mutual frame of corresponding Streaming Media, inserts with embarking on journey.
(3) replace the mutual frame output of former Streaming Media.
Under this mode, just directly will identify the character content that obtains and replace the mutual frame of original Streaming Media.It is pointed out that after having replaced the mutual frame of original Streaming Media, also be fit to give the linking functions that stream medium data is reported to the character content after replacing.That is to say, the character data after replacing, and set up linking relationship between the streaming medium content of place instant communication message, when triggering arbitrary position of this character data, can start this linking relationship, transfer the stream medium data corresponding with it, report corresponding streaming medium content after opening.
Further, because the length of the mutual frame of Streaming Media is usually limited, and the corresponding character amount of the mutual frame of Streaming Media is usually larger, in this case, if the size with the mutual frame of original Streaming Media is inserted the character content of identification, in most cases, just can't put the character content that obtains of identifying.So, can also carry out in the mutual frame of former Streaming Media, carrying out update again after content deletes processing to the character content of identification.The proportional control that accounts for total character amount such as the character amount after deleting 50% or below, in this case, facilitate and in the mutual frame of Streaming Media, insert the character content that identification obtains.When the character content of identification is deleted processing, can keep top character content.
In addition, the character attibute that needs reservation also can be set.Under normal conditions, nominal content can include many data messages, so, just can arrange that the reservation principle of character is the preferential noun content that keeps after the identification, and with other content, comprise that the content that can't effectively identify all deletes.
As an example, if the described character of streaming medium content is " thinking to go as soon as possible to play basketball ", after deleting processing, only keep nominal data, be by " basketball ", utilized this noun, after in a single day the user has seen " basketball " these two characters, what will understand the discussion of the corresponding Streaming Media interaction content of the mutual frame of Streaming Media is the thing of basketball aspect, so, also can understand the data content that the mutual frame of this Streaming Media relates to by prompting user.
Further, in the scheme that the character content of the mutual frame of Streaming Media and identification is separately carried out, because the mutual frame correspondence of Streaming Media stream medium data, and the different piece of stream medium data, corresponding the character data of identification again.Therefore, can also be between the character data that obtains of identify and corresponding Streaming Media interaction content, set up the corresponding relation of data, when triggering the Streaming Media interaction content of ad-hoc location, the character content corresponding with it done differentiation and shown, perhaps when triggering specific character content, the Streaming Media interaction content place part corresponding with it done differentiation and shown.Described differentiation shows, especially refers to the difference on the color.Further, between the character content that specific Streaming Media interaction content and corresponding identification obtain, be fit to adopt same color to express, such as, adopt simultaneously and on every side the different green of other content express, distinguish with this.
In the specific implementation, as an example, the mutual frame of whole Streaming Media can be cut apart according to the quantity of character, the character one that obtains such as identification has 18, then just the mutual frame of Streaming Media is divided into 18 parts, every a correspondence a character.Behind the position of having triggered the mutual frame of corresponding Streaming Media, judge character data corresponding to institute's trigger position.With the relevant position of the mutual frame of Streaming Media that triggers, and corresponding character data, present by itself and content on every side being carried out the mode that differentiation processes.Such as, when the content part correspondence that has triggered the mutual frame of Streaming Media in the situation of the 3rd to the 6th character, just corresponding character partly can be carried out differentiation with yellow shade and show, the part that is not triggered does not arrange this yellow shade.
Embodiment 2
Join shown in Figure 2ly, in the present embodiment, corresponding method described above provides the client 200 of Streaming Media interaction content identification in a kind of instant messaging, and this client 200 is a kind of instant communication clients, can realize various default instant communication functions.Further, described client 200 also comprises following structure:
Streaming medium content collecting unit 210 has been finished mutual streaming medium content in order to gather, and this streaming medium content is voice content or video content or content of multimedia;
Streaming medium content recognition unit 220 is in order to be identified as character with aforesaid streaming medium content;
Identification content output unit 230 in order to when satisfying the output condition of identification character, will identify content and be inserted in the mutual frame of former Streaming Media and export, or be inserted into the close position output of the mutual frame of former Streaming Media, or replace the mutual frame of former Streaming Media and export.
During implementation, at first by aforesaid streaming medium content collecting unit 210, gather the streaming medium content of having finished interactive operation.It is pointed out that this acquisition operations can also trigger by specific trigger condition, present control such as foregoing character, after triggering, can be according to the mutual frame collection of the selected Streaming Media streaming medium content corresponding with it.Described streaming medium content, typical embodiment is voice content, in addition, can be video content also, or include the content of multimedia of audio or video data.
With gathering the streaming medium content that obtains, carry out identifying operation by streaming medium content recognition unit 220, be transformed into character data.The mode of identification, can pass through this streaming medium content recognition unit 220, streaming medium content to be identified is pushed to supporting identified server identify rear reception recognition result, in addition, also can be by the default Streaming Media identification module of the terminal at place, such as sound identification module, the streaming medium content that gathers is carried out identifying operation, change it into character data.
The character identification result that obtains, by aforesaid identification content output unit 230, when satisfying the output condition of character recognition, the content of identification is inserted in the mutual frame of original Streaming Media and exports, both can all insert, also can partial insertion, perhaps, at the close position of the mutual frame of original Streaming Media, carry out update such as the position below the mutual frame of former Streaming Media is contiguous; Perhaps, directly with the mutual frame deletion of former Streaming Media, export after the character content that obtains is replaced the mutual frame of former Streaming Media with identifying.Export in the situation that replace the mutual frame of former Streaming Media, the character content of exporting can also load the link of former streaming medium content.
Embodiment 3
The present embodiment also provides the system 300 of Streaming Media interaction content identification in a kind of instant messaging.This system 300 can realize the instant communication function preset.Such as, the system server at instant communication client place is set, be provided with the login service structure by system server, obtain the current log-on message of instant communication client, the dynamic IP addressing and the port numbers that mainly comprise each instant communication client, and to the login other related instant communication client push aforesaid IP address and port number information.And be provided with the status service structure, be used for the logging status of each instant communication users of storage; Be provided with the deferred information service structure, be used for the relevant information of storage instant messaging offline user; Be provided with the User Information Database service structure, be used for storage Subscriber Number sign, or other basic document corresponding with the Subscriber Number sign, and the information such as user-dependent group, discussion group, or user's off-line data that send to contact object, that stored by system server, the off-line data that is perhaps sent by contact object, stored by system server, etc.
Further, system 300 described in the invention can also identify the streaming medium content of finishing interactive communication, changes that corresponding the mutual frame of Streaming Media is written into operation behind the character into.For realizing this purpose, to join shown in Figure 3ly, described system 300 comprises:
And non-limiting, described instant communication client 310 comprises as typical embodiment:
Streaming medium content collecting unit 311 has been finished mutual streaming medium content in order to gather, and this streaming medium content is voice content or video content or content of multimedia;
Streaming medium content push unit 312 pushes to corresponding identified server 320 in order to the streaming medium content with aforementioned collection;
Identification content reception unit 313, the identification character content that pushes in order to receive identified server 320;
Identification content output unit 314 in order to when satisfying the output condition of identification character, will identify content and be inserted in the mutual frame of former Streaming Media and export, or be inserted into the close position output of the mutual frame of former Streaming Media, or replace the mutual frame of former Streaming Media and export.
Accordingly, described identified server 320 comprises:
Streaming Media receiving element 321, the streaming medium content to be identified that pushes in order to receive aforementioned instant communication client 310;
Streaming Media recognition unit 322, the streaming medium content that receives in order to identification is character content;
Recognition result push unit 323 pushes to aforesaid instant communication client 310 in order to will identify the character content that obtains.
During implementation, by the streaming medium content collecting unit 311 in the instant communication client 310, gather between user and the contact object and finished mutual streaming medium content.Described streaming medium content especially refers to the voice data that comprises voice content here, certainly, also can be other stream medium data form, such as video content or include the content of multimedia etc. of audio ﹠ video content.With gathering the streaming medium content that obtains, via streaming medium content push unit 312, push to the identified server 320 of supporting setting.
Described identified server 320 both can arrange in the instant communication server of system, also can independently arrange.Data communication between this identified server 320 and the instant communication client 310 can be carried out data relay by the system server at place, also can directly carry out the interactive operation of data by between.By the Streaming Media receiving element 321 in the identified server 320, receive the streaming medium content to be identified that instant communication client 310 pushes, in identified server 320, be preset with Streaming Media recognition unit 322, in this Streaming Media recognition unit 322, for example and without limitation, can comprise carrying out the speech recognition corpus of speech recognition, and the speech recognition engine that carries out the voice recognition processing operation.
In identified server 320, the character content result via Streaming Media recognition unit 322 is identified by recognition result push unit 323, pushes in the aforesaid instant communication client 310.
By the identification content reception unit 313 in the instant communication client 310, receive the identification character content that identified server 320 pushes after, by identification content output unit 314, determine whether the output condition that satisfies identification character.Described output condition both can by triggering the output function that starts character content behind the default control, also can according to default condition, in case obtain the character content result of identification, namely can be exported.The form that the character content result that identification is obtained exports can be inserted into the identification content in the mutual frame of former Streaming Media and export, or be inserted into the close position output of the mutual frame of former Streaming Media, or replaces the mutual frame output of former Streaming Media.
More than be the description of this invention and non-limiting, based on other embodiment of inventive concept, also all among protection scope of the present invention.
Claims (21)
1. the method for Streaming Media interaction content identification in the instant messaging is characterized in that the method includes following steps:
Gather and finished mutual streaming medium content, this streaming medium content is voice content or video content or content of multimedia;
Aforesaid streaming medium content is identified as character;
When satisfying the output condition of identification character, will identify content and be inserted in the mutual frame of former Streaming Media and export, or be inserted into the close position output of the mutual frame of former Streaming Media, or replace the mutual frame output of former Streaming Media.
2. the method that the Streaming Media interaction content is identified in a kind of instant messaging according to claim 1, it is characterized in that: described streaming medium content is identified as the operation of character, be to carry out identifying operation by aforesaid streaming medium content is pushed to identified server, and then be back to the instant communication client at place.
3. the method that the Streaming Media interaction content is identified in a kind of instant messaging according to claim 2, it is characterized in that: described streaming medium content is in the situation that carry out push operation to identified server, mode with the streaming medium content set pushes, and comprises streaming medium content corresponding to the mutual frame of two or more Streaming Medias in this streaming medium content set.
4. the method that the Streaming Media interaction content is identified in a kind of instant messaging according to claim 1 is characterized in that: the output condition of described identification character, implement as follows,
The character of presetting in order to trigger identification character output presents control;
When the aforementioned character of collection acquisition presented the triggering message of control, the mutual frame of Streaming Media of the character content correspondence of having identified the place was written into and output function.
5. the method that the Streaming Media interaction content is identified in a kind of instant messaging according to claim 4, it is characterized in that: described character presents control, corresponding whole mutual frame of Streaming Media arranges, perhaps the mutual frame of each Streaming Media in corresponding the place current window arranges, and perhaps corresponding specific wall scroll or the many mutual frames of Streaming Media arrange.
6. the method that the Streaming Media interaction content is identified in a kind of instant messaging according to claim 1, it is characterized in that: when the collection acquisition triggers play operation message to the mutual frame of the Streaming Media at place, after the streaming medium content of the mutual frame of Streaming Media at place identified, identification character is exported.
7. the method that the Streaming Media interaction content is identified in a kind of instant messaging according to claim 1 is characterized in that: when triggering the mutual frame of aforesaid Streaming Media, can implement as follows,
Gather the user to the triggering message of the mutual frame of specific stream media;
Get the mutual frame of Streaming Media in the adjacent N bar instant communication message, obtain corresponding character output after the identification, perhaps, in the situation that judge had identification character, gather the character output of having identified.
8. the method that the Streaming Media interaction content is identified in a kind of instant messaging according to claim 7 is characterized in that: aforesaid N, elect the positive integer between the 1-4 as.
9. the method for Streaming Media interaction content identification in a kind of instant messaging according to claim 1 is characterized in that: the character content that corresponding identification obtains presents by the Compilatory control form;
Obtaining by the aforementioned controls collection in the situation of user to the edit file of character content, the content correspondence behind the editor the instant communication message at place and stored, as the acquiescence recognition data of the instant communication message of this streaming medium content.
10. the method that the Streaming Media interaction content is identified in a kind of instant messaging according to claim 1, it is characterized in that: when the Streaming Media interaction content that carries out was carried out data search, the streaming medium content in the trigger data hunting zone carried out character recognition.
11. the method for Streaming Media interaction content identification in a kind of instant messaging according to claim 1, it is characterized in that: for streaming medium content to be identified, after partial data in streaming medium content identification obtained character, corresponding the mutual frame output of former Streaming Media.
12. the method for Streaming Media interaction content identification in a kind of instant messaging according to claim 1, it is characterized in that: replace in the situation of the mutual frame of original Streaming Media in the character content that will identify acquisition, with the character data after replacing, and set up linking relationship between the streaming medium content of place instant communication message; When the triggering message that gather to obtain this arbitrary position of character data, start this linking relationship, access corresponding stream medium data and open and report.
13. the method for Streaming Media interaction content identification in a kind of instant messaging according to claim 1, it is characterized in that: the character data that corresponding the mutual frame of former Streaming Media is exported, be the partial data in the character that identification obtains, its character amount account for total character amount 50% or below.
14. the method for Streaming Media interaction content identification in a kind of instant messaging according to claim 1 is characterized in that: the character content that corresponding the mutual frame of former Streaming Media is exported, select the character of particular community type to keep.
15. the method for Streaming Media interaction content identification in a kind of instant messaging according to claim 14, it is characterized in that: the character types that keep are the noun content in the instant communication message identification character content of place.
16. the method for Streaming Media interaction content identification in a kind of instant messaging according to claim 1, it is characterized in that: between the character data that obtains of identify and corresponding Streaming Media interaction content, set up the corresponding relation of data, when triggering the Streaming Media interaction content of ad-hoc location, the character content corresponding with it done differentiation and shown, perhaps when triggering specific character content, the Streaming Media interaction content place part corresponding with it done differentiation and shown.
17. the method for Streaming Media interaction content identification in a kind of instant messaging according to claim 16, it is characterized in that: between the character content of the mutual frame of Streaming Media and identification acquisition, set up corresponding relation, to realize by the mode that the mutual frame of Streaming Media is cut apart, the quantity of the character that obtains according to identification is carried out cutting apart of corresponding umber to the mutual frame of Streaming Media, every a corresponding character.
18. the client of Streaming Media interaction content identification in the instant messaging is characterized in that this client comprises:
The streaming medium content collecting unit has been finished mutual streaming medium content in order to gather, and this streaming medium content is voice content or video content or content of multimedia;
The streaming medium content recognition unit is in order to be identified as character with aforesaid streaming medium content;
Identification content output unit in order to when satisfying the output condition of identification character, will identify content and be inserted in the mutual frame of former Streaming Media and export, or be inserted into the close position output of the mutual frame of former Streaming Media, or replace the mutual frame of former Streaming Media and export.
19. the system of Streaming Media interaction content identification in the instant messaging is characterized in that this system comprises:
Instant communication client, finished mutual streaming medium content in order to gather, push to following identified server and carry out character recognition, with the character content after the identification, when satisfying the output condition of identification character, be inserted in the mutual frame of former Streaming Media and export, or be inserted into the close position output of the mutual frame of former Streaming Media, or replace the mutual frame output of former Streaming Media;
Identified server, the streaming medium content that pushes in order to receive aforementioned instant communication client pushes to aforesaid instant communication client after streaming medium content is identified as character content.
20. the system of Streaming Media interaction content identification in a kind of instant messaging according to claim 19 is characterized in that: described instant communication client comprises,
The streaming medium content collecting unit has been finished mutual streaming medium content in order to gather, and this streaming medium content is voice content or video content or content of multimedia;
The streaming medium content push unit pushes to corresponding identified server in order to the streaming medium content with aforementioned collection;
Identification content reception unit, the identification character content that pushes in order to receive identified server;
Identification content output unit in order to when satisfying the output condition of identification character, will identify content and be inserted in the mutual frame of former Streaming Media and export, or be inserted into the close position output of the mutual frame of former Streaming Media, or replace the mutual frame of former Streaming Media and export.
21. the system of Streaming Media interaction content identification in a kind of instant messaging according to claim 19 is characterized in that: described identified server comprises,
The Streaming Media receiving element, the streaming medium content to be identified that pushes in order to receive aforementioned instant communication client;
The Streaming Media recognition unit, the streaming medium content that receives in order to identification is character content;
The recognition result push unit pushes to aforesaid instant communication client in order to will identify the character content that obtains.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012104894165A CN102946399A (en) | 2012-11-26 | 2012-11-26 | Method, client and system for identifying streaming media interactive content in instant messaging |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012104894165A CN102946399A (en) | 2012-11-26 | 2012-11-26 | Method, client and system for identifying streaming media interactive content in instant messaging |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102946399A true CN102946399A (en) | 2013-02-27 |
Family
ID=47729306
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012104894165A Pending CN102946399A (en) | 2012-11-26 | 2012-11-26 | Method, client and system for identifying streaming media interactive content in instant messaging |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102946399A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1183595B1 (en) * | 1999-02-24 | 2003-11-12 | Pipebeach AB | A voice browser and a method at a voice browser |
| CN102347913A (en) * | 2011-07-08 | 2012-02-08 | 个信互动（北京）网络科技有限公司 | Method for realizing voice and text content mixed message |
| CN102695134A (en) * | 2011-03-22 | 2012-09-26 | 富泰华工业（深圳）有限公司 | Voice short message system and processing method thereof |
| CN102750365A (en) * | 2012-06-14 | 2012-10-24 | 华为软件技术有限公司 | Retrieval method and system of instant voice messages, user device and server |
-
2012
- 2012-11-26 CN CN2012104894165A patent/CN102946399A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1183595B1 (en) * | 1999-02-24 | 2003-11-12 | Pipebeach AB | A voice browser and a method at a voice browser |
| CN102695134A (en) * | 2011-03-22 | 2012-09-26 | 富泰华工业（深圳）有限公司 | Voice short message system and processing method thereof |
| CN102347913A (en) * | 2011-07-08 | 2012-02-08 | 个信互动（北京）网络科技有限公司 | Method for realizing voice and text content mixed message |
| CN102750365A (en) * | 2012-06-14 | 2012-10-24 | 华为软件技术有限公司 | Retrieval method and system of instant voice messages, user device and server |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9824314B2 (en) | Grouping email messages into conversations | |
| US9171291B2 (en) | Electronic device and method for updating message body content based on recipient changes | |
| US9792015B2 (en) | Providing visualizations for conversations | |
| JP4995973B2 (en) | User interface for reading email conversations | |
| US8788948B2 (en) | Electronic mail display device | |
| CN102984050A (en) | Method, client and system for searching voices in instant messaging | |
| US20100312836A1 (en) | Traversing between electronic mail and real time communications | |
| US20080141146A1 (en) | Method and system for selective sharing of flagged information in a group chat environment | |
| CN105490915A (en) | Method, device and software product for filling an address field of an electronic message | |
| CN102497333B (en) | In order to export the method for contact object Weather information, client and system | |
| CN102404251A (en) | Realization method, client and system for instant messaging with remarking function | |
| EP2658189B1 (en) | Electronic device and method for updating message body content based on recipient changes | |
| CN103440247A (en) | Method and device for sending photos | |
| CN102591980A (en) | Method and system used for classifying image files in instant messaging | |
| CN105630849A (en) | Expression image recommendation system and method | |
| WO2023016536A1 (en) | Interaction method, apparatus and device, and storage medium | |
| CN109842541A (en) | Information processing method, device and storage medium | |
| CN102447744A (en) | Implementation method, client, server and system for downloading mail | |
| CN102566863A (en) | Method and system for setting auxiliary area in instant messaging tool | |
| CN103023752A (en) | Method, client-side and system for pre-installing player in instant messaging interactive interface | |
| CN101478500A (en) | Instant messaging method, server, IM customer terminal and system | |
| CN102664830A (en) | Method, client side and system for collecting communication mode data in instant messaging | |
| CN104298416B (en) | The generation method and device of message are automatically replied in instant messaging | |
| CN102694751A (en) | Method and client for displaying log information in instant communication interaction interface | |
| KR102054728B1 (en) | Method and apparatus for managing messanger related to e-mail |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20130227 |
|
| RJ01 | Rejection of invention patent application after publication |