CN102325181B - Instant audio/video interactive communication method based on sharing service and instant audio/video interactive communication system based on sharing service - Google Patents
Instant audio/video interactive communication method based on sharing service and instant audio/video interactive communication system based on sharing service Download PDFInfo
- Publication number
- CN102325181B CN102325181B CN201110267445.2A CN201110267445A CN102325181B CN 102325181 B CN102325181 B CN 102325181B CN 201110267445 A CN201110267445 A CN 201110267445A CN 102325181 B CN102325181 B CN 102325181B
- Authority
- CN
- China
- Prior art keywords
- video
- interactive terminal
- audio
- real
- video data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Telephonic Communication Services (AREA)
Abstract
The invention provides an instant audio/video interactive communication method based on sharing service and an instant audio/video interactive communication system based on sharing service, which overcome various constraints in the implementation of instant audio/video data interactive communication in the prior art. A flash media server (FMS) is utilized to provide an audio/video interaction service, a sender encodes and then uploads acquired video/audio data streaming media to the FMS by means of the real-time messaging protocol (RTMP), and the FMS merges, encodes and then downloads the video/audio data uploaded by the sender to a receiver by means of the RTMP. The instant synchronization of audio/video data from the sender to the receiver is implemented, so that the instant audio/video interactive communication between a first interaction terminal and a second interaction terminal taking part in interaction can be implemented, moreover, by means of the RTMP, the invention solves the problem that the memory spaces of the two interaction terminals are occupied, so that mobile terminals can carry out long-time instant audio/video interactive communication by means of a sharing service platform, and furthermore, the investment in services is little, which is favorable for the development of new service markets.
Description
Technical field
The present invention relates to internet technique and ICT (information and communication technology) field, particularly a kind of audio frequency and video real-time interaction communication means and system based on shared service.
Background technology
In recent years, rapidly, a lot of network gatewaies are all carried out has multi-form data information sharing business, such as data information sharing website, blog, microblogging, network individual space etc. for internet technique and mobile communication network technology development; And, along with the electronic equipments such as computer, mobile terminal are day by day universal, people have got used to gradually computer terminal or mobile terminal and have been logined shared service issue and obtained shared data message by communication network, make China progressively enter the epoch of whole people's data information sharing.Simultaneously, these progressive variation and multi-levelization of also progressively having brought data information sharing, people share data message from passing through simply the form of broadcast distribution, download/reprinting, develop step by step instantaneity, interactivity demand to data information sharing, so that realize long-range exchange of information, teleconference and job placement, the contact of long-range emotion or recreational use etc. by immediate interactive.Provide the network gateway of data information sharing also to start to utilize one after another various technology that the real-time interaction communication service of data message is provided, to meet this emerging customer demand, open up new value-added service.
At present, the data message of extensively being shared mainly comprises lteral data, image data and audio, video data three types.Although in mobile communication technology field, short message, multimedia message, voice call and video calling (being equivalent to word, picture, audio frequency and video real-time interaction communicates by letter) have all obtained ripe development and application, but because mobile communications network construction operation fund is huge, and domestic San great mobile communication carrier has possessed abundant operation experience and huge customer group at present, only rely on mobile communication technology to carry out new audio frequency and video real-time interaction communication service and be difficult to obtain business success; And the exchange and interdynamic between mobile terminal are also only supported in the real-time interaction communication of mobile communication technology platform.If the shared service platform that can provide by network gateway is realized the real-time interaction communication of data message, can utilize original communication network resource, without dropping into huge communication network development fund, and can realize between mobile terminal by shared service platform, mobile terminal communicates by letter with the real-time interaction between terminal, significantly increased business customer group; Therefore, the real-time interaction communication technology based on shared service has highly application value.
The real-time interaction of realizing lteral data and image data based on shared service is very simple, because the data volume of lteral data and image data is smaller, transfer of data time delay is very short, the successively mutual transmission of lteral data file and image data file all can enough meet people's real-time interaction demand for experience, therefore based on shared service, realizes the prior art of word, image data real-time interaction very many.And audio, video data is because its data volume is large and have time remaining, it is shared that existing shared service all only supports recording of audio, video data to upload mostly, be difficult to meet the demand of real-time interaction, and the recording of audio, video data uploaded and needed to preserve the audio, video data of recording and upload, also the audio, video data that needs download preservation to be shared while receiving broadcasting carries out this locality and reads broadcasting, therefore take respectively the memory space of transmission terminal and shared terminal, for the very limited mobile terminal of data space, cannot carry out long audio frequency and video interactive operation.
Summary of the invention
For above shortcomings in prior art, the object of the present invention is to provide a kind of audio frequency and video real-time interaction communication means based on shared service, solve on the one hand the problem that realizes audio, video data real-time interaction in shared service, solve on the other hand the problem that takies great amount of terminals memory space in audio, video data interactive communication process.For realizing this object, the present invention has adopted following technological means:
An audio frequency and video real-time interaction communication means based on shared service, comprises the steps:
A) the first interactive terminal is connected to shared portal server by communication network, and the registered user A of login shared service, carries out audio frequency and video real-time interaction to shared portal server request with the registered user B of shared service and communicate by letter; Described the first interactive terminal is support to surf the Net and possess terminal or the mobile terminal of video, audio collection function and streaming coding and playing function; Described shared portal server is to provide the WEB server of shared service service, and data communication is connected with the FMS of audio frequency and video interactive service server is provided; Described registered user A and registered user B are registered users different in shared service;
When b) sharing portal server and receive the described request from the first interactive terminal, judge whether requested registered user B has logined shared service, if not, stop carrying out this audio frequency and video real-time interaction communication; Whether if so, share portal server accepts to communicate by letter with the audio frequency and video real-time interaction of the first interactive terminal by traffic enquiry the second interactive terminal; If the second interactive terminal is not accepted, stop carrying out this audio frequency and video real-time interaction communication; If the second interactive terminal is accepted, shared portal server set up FMS server respectively with the communication connection passage of the first interactive terminal and the second interactive terminal, then notify the first interactive terminal and the second interactive terminal request success; Described the second interactive terminal is to be connected to by communication network terminal or the mobile terminal of sharing registered user B described in portal server and login shared service, and also supports to surf the Net and possess video, audio collection function and streaming coding and playing function in the second interactive terminal;
C) the first interactive terminal and the second interactive terminal are notified while asking successfully, start video, audio collection function, and the video data of collection and voice data are carried out, after streaming coding, with RTMP agreement, being uploaded to FMS server;
D) the first mutual phonetic aspect of a dialect video data that the video data that FMS server is uploaded the first interactive terminal and voice data merge, coding is treated to FLV form is buffer memory in addition, and the first mutual phonetic aspect of a dialect video data of buffer memory is sent to the second interactive terminal with RTMP agreement carries out streaming media playing; Simultaneously, the second mutual phonetic aspect of a dialect video data that the video data that FMS server is uploaded the second interactive terminal and voice data merge, coding is treated to FLV form is buffer memory in addition, and the second mutual phonetic aspect of a dialect video data of buffer memory is sent to the first interactive terminal with RTMP agreement carries out streaming media playing; Thereby realize the first interactive terminal, communicate by letter with the audio frequency and video real-time interaction of the second interactive terminal, until this audio frequency and video real-time interaction communication while stopping uploaded videos data and voice data, is finished in the first interactive terminal or the second interactive terminal.
Correspondingly, the present invention should provide a kind of audio frequency and video real-time interaction communication system that realizes said method.For realizing this object, the present invention has adopted following technological means:
An audio frequency and video real-time interaction communication system based on shared service, comprises the first interactive terminal, the second interactive terminal and shared portal server;
Described the first interactive terminal is support to surf the Net and possess terminal or the mobile terminal of video, audio collection function and streaming coding and playing function, by communication network, be connected to shared portal server, in order to login the registered user A of shared service, to shared portal server request, carrying out audio frequency and video real-time interaction with the registered user B of shared service communicates by letter, and can be in notified video, the audio collection function of starting while asking successfully, the video data of collection and voice data are carried out, after streaming coding, with RTMP agreement, being uploaded to FMS server; Described registered user A and registered user B are registered users different in shared service;
Described the second interactive terminal is support to surf the Net and possess terminal or the mobile terminal of video, audio collection function and streaming coding and playing function, by communication network, be connected to shared portal server, in order to login registered user B described in shared service, and can be notified while asking successfully, start video, audio collection function, and the video data of collection and voice data are carried out, after streaming coding, with RTMP agreement, being uploaded to FMS server;
Described shared portal server is to provide the WEB server of shared service service, and data communication is connected with the FMS of audio frequency and video interactive service server is provided;
Described shared portal server during for described request receiving from the first interactive terminal, judges whether requested registered user B has logined shared service, if not, stops carrying out this audio frequency and video real-time interaction communication; Whether if so, share portal server accepts to communicate by letter with the audio frequency and video real-time interaction of the first interactive terminal by traffic enquiry the second interactive terminal; If the second interactive terminal is not accepted, stop carrying out this audio frequency and video real-time interaction communication; If the second interactive terminal is accepted, shared portal server set up FMS server respectively with the communication connection passage of the first interactive terminal and the second interactive terminal, then notify the first interactive terminal and the second interactive terminal request success;
Described FMS server is for video data that the first interactive terminal is uploaded and voice data merge, coding is treated to FLV form the first mutual phonetic aspect of a dialect video data buffer memory in addition, and the first mutual phonetic aspect of a dialect video data of buffer memory is sent to the second interactive terminal with RTMP agreement carries out streaming media playing; Simultaneously, the second mutual phonetic aspect of a dialect video data that the video data that the second interactive terminal is uploaded and voice data merge, coding is treated to FLV form is buffer memory in addition, and the second mutual phonetic aspect of a dialect video data of buffer memory is sent to the first interactive terminal with RTMP agreement carries out streaming media playing; Thereby realizing the first interactive terminal communicates by letter with the audio frequency and video real-time interaction of the second interactive terminal, until the first interactive terminal or the second interactive terminal while stopping uploaded videos data and voice data, are finished the first interactive terminal and are communicated by letter with the audio frequency and video real-time interaction of the second interactive terminal.
Than prior art, the present invention has following beneficial effect:
1, the audio frequency and video real-time interaction communication means and the system that the present invention is based on shared service have adopted special shared transmission means, by FMS server (Flash Media Server, Flash multimedia server) provide audio frequency and video interactive service, because FMS server is generally supported the transmission of RTMP protocol data, transmit leg is by the video gathering, voice data streaming coding is later with RTMP agreement (Real Time Messaging Protocol, real-time messages transportation protocol) be uploaded to FMS server, the video that FMS server is uploaded transmit leg, voice data is issued to recipient with RTMP agreement after merging coding again, realize the instant synchronism of audio, video data from transmit leg to recipient, and participating in the first mutual interactive terminal and the second interactive terminal is the transmit leg of audio, video data, again the recipient of the other side's audio, video data simultaneously, thereby make the both sides can both be for the other side's sound, picture is made instant response and interaction, reach the effect that is similar to video calling in mobile communication technology, having realized the first interactive terminal communicates by letter with the audio frequency and video real-time interaction of two interactive terminals.
2, audio frequency and video real-time interaction communication means of the present invention and system have adopted the host-host protocol that RTMP agreement is uploaded and issued as stream medium audio and video, the streaming coding formatted data real-time Transmission that the client terminal of uploading data can directly obtain its Real-time Collection, coding by this host-host protocol is gone out, and has therefore avoided client terminal in upload procedure, to carry out audio, video data recording and has preserved processing; Simultaneously, sound, video data by RTMP agreement issue playing process, that the FMS server that issues audio, video data is set up after single communication connection passage by handshake communication with the client terminal that receives playing audio-video data, by FMS server, pronunciation video data real time propelling movement being issued to client terminal plays, and under RTMP agreement, play sequential and carry out real time remote control by FMS server, client terminal only need be play-overed the audio, video data that FMS server issues, and the audio, video data issuing without storage carries out this locality, reads play operation; Thus, solved the problem that takies mutual both sides' terminal storage space, making mobile terminal carry out the communication of long audio frequency and video real-time interaction by shared service platform becomes possibility.
3, in audio frequency and video real-time interaction communication means of the present invention and system, FMS server is treated to FLV form (Flash Video by the audio frequency of uploading, video data merging, coding, Flash video format) after, issue again, on the one hand due under RTMP agreement, issuing with Play Control of audio, video data all operated by FMS server, FMS server can complete audio frequency, audio video synchronization and process when the audio frequency of uploading, video data are merged, encoded, avoid the audio, video data generation sound that client terminal receives, the situation of drawing step-out, on the other hand, different terminals, the audio frequency that mobile terminal is uploaded, video data format is not quite similar, probably cannot be at other terminals, on mobile terminal, play-over, FMS server is merged, be encoded to FLV uniform format audio, video data issue the format standard of broadcasting, the audio-video document of FLV form can directly be play (because existing web browser is all integrated with Flash playing function) in web browser simultaneously, and support terminal and the mobile terminal of online that web browser is generally installed, thereby solved the audio frequency of the different-format of uploading, possibly of video data cannot be at other terminals, the problem of play-overing on mobile terminal, again on the one hand, the compression ratio of FLV form audio, video data is high, data volume is little, and the real-time Transmission that is suitable for audio, video data is play, and can better guarantee to adopt RTMP agreement to issue the fluency of broadcasting.
4, utilize the inventive method and system, can carry out the communication service of audio frequency and video real-time interaction by the shared service platform of existing technology maturation, thereby be conducive to reduce trade investment, open up new Service Market; Meanwhile, can also realize between mobile terminal by shared service platform, mobile terminal communicates by letter with the real-time interaction between terminal, increased business customer group; Therefore have highly application value.
Accompanying drawing explanation
Fig. 1 is the frame construction figure that the present invention is based on the audio frequency and video real-time interaction communication system of shared service;
Fig. 2 is the FB(flow block) that the present invention is based on the audio frequency and video real-time interaction communication means of shared service.
Embodiment
Due to shared services such as existing blog, microblogging, network individual spaces, mostly all only to support recording of audio, video data to upload shared, even if realize streaming media playing at shared end, still be difficult to meet transmit leg to recipient's instant synchronisation requirement, therefore be more difficult to realize the real-time interaction of audio, video data.For this present situation, the present invention proposes a kind of audio frequency and video real-time interaction communication means based on shared service that can overcome prior art constraint and corresponding to the audio frequency and video real-time interaction communication system of the method, this audio frequency and video real-time interaction communication means and system have adopted special shared transmission means, by FMS server, provide audio frequency and video interactive service, because FMS server is generally supported the transmission of RTMP protocol data, transmit leg is by the video gathering, voice data streaming coding is uploaded to FMS server with RTMP agreement later, the video that FMS server is uploaded transmit leg, voice data is issued to recipient with RTMP agreement after merging coding again, realize the instant synchronism of audio, video data from transmit leg to recipient, and participating in the first mutual interactive terminal and the second interactive terminal is the transmit leg of audio, video data, again the recipient of the other side's audio, video data simultaneously, thereby make the both sides can both be for the other side's sound, picture is made instant response and interaction, reach the effect that is similar to video calling in mobile communication technology, having realized the first interactive terminal communicates by letter with the audio frequency and video real-time interaction of two interactive terminals.
As shown in Figure 1, the audio frequency and video real-time interaction communication system that the present invention is based on shared service mainly consists of the first interactive terminal 1, the second interactive terminal 4 and shared portal server 2.The first interactive terminal 1 and the second interactive terminal 4 are support to surf the Net and possess terminal or the mobile terminal of video, audio collection function and streaming coding and playing function; Share the WEB server that portal server 2 is to provide shared service service, and data communication is connected with the FMS of audio frequency and video interactive service server 3 is provided.Wherein, the first interactive terminal 1 is connected to and is shared portal server 2 by communication network, in order to login the registered user A of shared service, to shared portal server 2 requests, carrying out audio frequency and video real-time interaction with the registered user B of shared service communicates by letter, and can when being shared portal server 2 notice request success, start video, audio collection function, the video data of collection and voice data are carried out, after streaming coding, with RTMP agreement, being uploaded to FMS server 3; Registered user A described here and registered user B refer to two different registered users in shared service.The second interactive terminal 4 is connected to and is shared portal server 2 by communication network, in order to login registered user B described in shared service, and can when being shared portal server 2 notice request success, start video, audio collection function, and the video data of collection and voice data are carried out, after streaming coding, with RTMP agreement, being uploaded to FMS server 3.While sharing portal server 2 for described request receiving from the first interactive terminal 1, judge whether requested registered user B has logined shared service, if not, stop carrying out this audio frequency and video real-time interaction communication; Whether if so, share portal server 2 accepts to communicate by letter with the audio frequency and video real-time interaction of the first interactive terminal by traffic enquiry the second interactive terminal 4; If the second interactive terminal 4 is not accepted, stop carrying out this audio frequency and video real-time interaction communication; If the second interactive terminal 4 is accepted, share 2 of portal servers set up FMS server 3 respectively with the communication connection passage of the first interactive terminal 1 and the second interactive terminal 4, then notify the first interactive terminal 1 and the second interactive terminal 4 to ask successfully.FMS server 3 is for video data that the first interactive terminal 1 is uploaded and voice data merge, coding is treated to FLV form the first mutual phonetic aspect of a dialect video data buffer memory in addition, and the first mutual phonetic aspect of a dialect video data of buffer memory is sent to the second interactive terminal 4 with RTMP agreement carries out streaming media playing; Simultaneously, the second mutual phonetic aspect of a dialect video data that the video data that the second interactive terminal 4 is uploaded and voice data merge, coding is treated to FLV form is buffer memory in addition, and the second mutual phonetic aspect of a dialect video data of buffer memory is sent to the first interactive terminal 1 with RTMP agreement carries out streaming media playing; Thereby realizing the first interactive terminal 1 communicates by letter with the audio frequency and video real-time interaction of the second interactive terminal 4, until the first interactive terminal 1 or the second interactive terminal 4 while stopping uploaded videos data and voice data, are finished the first interactive terminal 1 and are communicated by letter with the audio frequency and video real-time interaction of the second interactive terminal 4.
As shown in Figure 2, concrete grammar is as follows for the FB(flow block) that audio frequency and video real-time interaction communication system of the present invention is carried out the communication of audio frequency and video real-time interaction based on shared service:
A) the first interactive terminal is connected to shared portal server by communication network, and the registered user A of login shared service, carries out audio frequency and video real-time interaction to shared portal server request with the registered user B of shared service and communicate by letter;
When b) sharing portal server and receive the described request from the first interactive terminal, judge whether requested registered user B has logined shared service, if not, stop carrying out this audio frequency and video real-time interaction communication; Whether if so, share portal server accepts to communicate by letter with the audio frequency and video real-time interaction of the first interactive terminal by traffic enquiry the second interactive terminal; If the second interactive terminal is not accepted, stop carrying out this audio frequency and video real-time interaction communication; If the second interactive terminal is accepted, shared portal server set up FMS server respectively with the communication connection passage of the first interactive terminal and the second interactive terminal, then notify the first interactive terminal and the second interactive terminal request success;
C) the first interactive terminal and the second interactive terminal are notified while asking successfully, start video, audio collection function separately, and separately the video data of collection and voice data are carried out, after streaming coding, with RTMP agreement, being uploaded to FMS server;
D) the first mutual phonetic aspect of a dialect video data that the video data that FMS server is uploaded the first interactive terminal and voice data merge, coding is treated to FLV form is buffer memory in addition, and the first mutual phonetic aspect of a dialect video data of buffer memory is sent to the second interactive terminal with RTMP agreement carries out streaming media playing; Simultaneously, the second mutual phonetic aspect of a dialect video data that the video data that FMS server is uploaded the second interactive terminal and voice data merge, coding is treated to FLV form is buffer memory in addition, and the second mutual phonetic aspect of a dialect video data of buffer memory is sent to the first interactive terminal with RTMP agreement carries out streaming media playing; Thereby realize the first interactive terminal, communicate by letter with the audio frequency and video real-time interaction of the second interactive terminal, until this audio frequency and video real-time interaction communication while stopping uploaded videos data and voice data, is finished in the first interactive terminal or the second interactive terminal.
The host-host protocol that audio frequency and video real-time interaction communication means of the present invention and system adopt RTMP agreement to upload and issue as stream medium audio and video, because RTMP agreement is a kind of real-time streaming host-host protocol, by RTMP agreement, can directly the streaming coding real-time data transmission obtaining in real time be gone out, guaranteed the real-time that audio frequency, video data are uploaded, avoided again client terminal in upload procedure, to carry out audio, video data recording and preserved processing, simultaneously, sound by RTMP agreement, video data issues playing process, that the FMS server that issues audio, video data is set up after single communication connection passage by handshake communication with the client terminal that receives playing audio-video data, by FMS server, pronunciation video data real time propelling movement being issued to client terminal plays, can guarantee the real-time that audio, video data issues, and under RTMP agreement, play sequential and carry out real time remote control by FMS server, client terminal only need be play-overed the audio, video data that FMS server issues, and carrying out this locality, the audio, video data issuing without storage reads play operation, thus, both guaranteed that the first interactive terminal and the second interactive terminal carried out the mutual instantaneity of audio frequency and video, make both sides to make instant response and interaction for the other side's sound, picture, solve again the problem that takies mutual both sides' terminal storage space, made the mobile terminal of limited storage space also can carry out the communication of long audio frequency and video real-time interaction by shared service platform.Yet, the globality that realizes and run from system is considered, only overcome the above-mentioned constraint that exists in prior art not enough, due to the data volume of voice data and video data not reciprocity (data volume of video data is greater than voice data conventionally), if FSM server adopts RTMP agreement that audio frequency, video data are issued respectively and transmit and control broadcasting, easily the impact because of transmission rate causes client terminal sound, draws and play step-out; Simultaneously, terminal and mobile terminal are in the market multifarious, different terminals, mobile terminal collection, the audio frequency of uploading, video data format are not quite similar, if FSM server directly forwards by the audio frequency of uploading, video data the problem that likely appearance receives, the client terminal factor data form of playing audio-video data is incompatible and cannot play-over, thereby can not reach the object of real-time interaction communication.In order further to address these problems again, in audio frequency and video real-time interaction communication means of the present invention and system, FMS server is by the audio frequency of uploading, video data merges, after being treated to FLV form, coding issues again, on the one hand at FMS server to the audio frequency of uploading, video data merges, in the time of coding, can complete audio frequency, audio video synchronization is processed, synchronous processing can be passed through mark timestamp, abandoning the existing Internet Transmission simultaneous techniques means such as delayed data frame realizes, the audio, video data generation sound of avoiding client terminal to receive, draw the situation of step-out, on the other hand, FMS server by the audio frequency of uploading, video data merge, be encoded to FLV uniform format audio, video data issue the format standard of broadcasting, the audio-video document of FLV form can directly be play (because existing web browser is all integrated with Flash playing function) in web browser simultaneously, and support terminal and the mobile terminal of online that web browser is generally installed, thereby the audio frequency of the different-format of uploading, the problem that video data possibly cannot be play-overed on other terminals, mobile terminal have been solved, again on the one hand, the compression ratio of FLV form audio, video data is high, data volume is little, and the real-time Transmission that is suitable for audio, video data is play, and can better guarantee to adopt RTMP agreement to issue the fluency of broadcasting.
The microblogging visual talking business that utilizes technical solution of the present invention to realize based on microblogging shared service of take is below example, and the present invention is described further.
embodiment:
Microblogging, also referred to as micro-blog (MicroBlog), in microblogging shared service, registered user can be by its corresponding its people's of data information sharing list builder who distributes data message community, and realize data information sharing by intersection issue or the exchanging visit between different pieces of information information community, be current pandemic a kind of data information sharing business.Yet, current microblogging shared service only supports the broadcast of lteral data, image data or audio, video data, reprinting to share conventionally, constraint based on prior art, also fail to realize the real-time interaction communication of audio, video data always, thereby have no idea well to carry out microblogging visual telephone service.Utilize audio frequency and video real-time interaction communication system of the present invention, just can overcome existing constraint, realize the audio frequency and video real-time interaction communication between different microblog users.Apply the idiographic flow that audio frequency and video real-time interaction communication system of the present invention realizes microblogging video telephone in microblogging shared service as follows:
The user that a) need to carry out video call uses terminal or the mobile terminal supporting surf the Net and possess video, audio collection function and streaming coding and playing function by communication network, to be connected to the shared portal server of microblogging as the first interactive terminal, the registered user A of login microblogging shared service, carries out audio frequency and video real-time interaction to shared portal server request with its good friend's microblogging registered user B at microblogging shared service and communicates by letter.Microblogging registered user A described here and microblogging registered user B refer to two different registered users in microblogging shared service.Terminal or the mobile terminal supporting to surf the Net and possess video, audio collection function and streaming coding and playing function can pass through existing techniques in realizing, streaming coding software, streaming media playing software are for example installed and are connected with microphone and the computer of camera, or shooting smart mobile phone of streaming coding software, streaming media playing software etc. is installed; Streaming coding, playout software for computer platform enrich very much, and simultaneously the operation system of smart phone such as Symbian, Android is also to support streaming coding, broadcasting, and streaming coding, play-back technology are prior art; In the present embodiment, the streaming coding of video data has adopted H.264 coding techniques, and the streaming coding of voice data has adopted ACC coding techniques, and streaming media playing adopts Flash Technology of Multimedia Stream Playing.Microblogging is shared the WEB server that portal server is to provide the service of microblogging shared service, and data communication is connected with the FMS of audio frequency and video interactive service server is provided.
When b) microblogging is shared portal server and received the audio frequency and video real-time interaction communication request from the first interactive terminal, judge whether requested microblogging registered user B has logined shared service, if not, stop carrying out this audio frequency and video real-time interaction communication; If so, whether the shared portal server of microblogging is accepted to communicate by letter with the audio frequency and video real-time interaction of the first interactive terminal by traffic enquiry the second interactive terminal; If the second interactive terminal is not accepted, stop carrying out this audio frequency and video real-time interaction communication; If the second interactive terminal is accepted, microblogging share portal server set up FMS server respectively with the communication connection passage of the first interactive terminal and the second interactive terminal, then notify the first interactive terminal and the second interactive terminal request success.The second interactive terminal refers to terminal or the mobile terminal that is connected to microblogging registered user B in the shared portal server of microblogging and login microblogging shared service by communication network, also supports to surf the Net and possess video, audio collection function and streaming coding and playing function in the second interactive terminal; Equally, second interactive terminal of the present embodiment, the streaming coding of video data adopts H.264 coding techniques, and the streaming coding of voice data adopts ACC coding techniques, and streaming media playing adopts Flash Technology of Multimedia Stream Playing.
C) the first interactive terminal and the second interactive terminal are notified while asking successfully, start video, audio collection function separately, and separately H.264 the video data of collection is encoded, voice data carries out, after ACC coding, with RTMP agreement, being uploaded to FMS server.
D) the first mutual phonetic aspect of a dialect video data that the H.264 video data of coding and the voice data of ACC coding merge, coding is treated to FLV form that FMS server is uploaded the first interactive terminal is buffer memory in addition, the first mutual phonetic aspect of a dialect video data of buffer memory is shared to portal server with RTMP agreement by microblogging and be sent to the second interactive terminal and carry out streaming media playing; Simultaneously, the second mutual phonetic aspect of a dialect video data that the H.264 video data of coding and the voice data of ACC coding merge, coding is treated to FLV form that FMS server is uploaded the second interactive terminal is buffer memory in addition, the second mutual phonetic aspect of a dialect video data of buffer memory is shared to portal server with RTMP agreement by microblogging and be sent to the first interactive terminal and carry out streaming media playing; Thereby communicate by letter and realized both sides' video call with the audio frequency and video real-time interaction of the second interactive terminal by the first interactive terminal, until this audio frequency and video real-time interaction communication while stopping uploaded videos data and voice data, is finished in the first interactive terminal or the second interactive terminal.
By this embodiment, can see, audio frequency and video real-time interaction communication means of the present invention is after having overcome many constraints of prior art, realized the video call on microblogging shared service, by this microblogging visual talking business, user is just without only relying on mobile communication business to carry out video call, and can select to carry out video call by login microblogging; And in process of video call, the processing of audio, video data, transfer process are sightless for user, user operates and in microblogging program request, watches video equally easy with regard to similar, it is short that both sides' video call only exists audio data format coding delay and streaming media to postpone time of delay, can meet the requirement of real-time of instant messaging completely.
Above-described embodiment is that the present invention will be described as a kind of embodiment, not limitation of the present invention.In audio frequency and video real-time interaction communication means of the present invention and system, the streaming coding mode of audio frequency, video data not only limitation and above-described embodiment, also can adopt other stream encryption technology of prior art to realize.Meanwhile, audio frequency and video real-time interaction communication means of the present invention and system not only can be applied in the middle of microblogging shared service, also can be applied in the middle of the data information sharing business of the various ways such as website, blog, network individual space; And, utilize the inventive method and system, can carry out the communication service of audio frequency and video real-time interaction by the shared service platform of existing technology maturation, thereby be conducive to reduce trade investment, open up new Service Market; Meanwhile, can also realize between mobile terminal by shared service platform, mobile terminal communicates by letter with the real-time interaction between terminal, increased business customer group; Therefore have highly application value.
Finally explanation is, above embodiment is only unrestricted in order to technical scheme of the present invention to be described, although the present invention is had been described in detail with reference to preferred embodiment, those of ordinary skill in the art is to be understood that, can modify or be equal to replacement technical scheme of the present invention, and not departing from aim and the scope of technical solution of the present invention, it all should be encompassed in the middle of claim scope of the present invention.
Claims (2)
1. the audio frequency and video real-time interaction communication means based on shared service, is characterized in that, comprises the steps:
A) the first interactive terminal is connected to shared portal server by communication network, and the registered user A of login shared service, carries out audio frequency and video real-time interaction to shared portal server request with the registered user B of shared service and communicate by letter; Described the first interactive terminal is support to surf the Net and possess terminal or the mobile terminal of video, audio collection function and streaming coding and playing function; Described shared portal server is to provide the WEB server of shared service service, and data communication is connected with the FMS of audio frequency and video interactive service server is provided; Described registered user A and registered user B are registered users different in shared service;
When b) sharing portal server and receive the described request from the first interactive terminal, judge whether requested registered user B has logined shared service, if not, stop carrying out this audio frequency and video real-time interaction communication; Whether if so, share portal server accepts to communicate by letter with the audio frequency and video real-time interaction of the first interactive terminal by traffic enquiry the second interactive terminal; If the second interactive terminal is not accepted, stop carrying out this audio frequency and video real-time interaction communication; If the second interactive terminal is accepted, shared portal server set up FMS server respectively with the communication connection passage of the first interactive terminal and the second interactive terminal, then notify the first interactive terminal and the second interactive terminal request success; Described the second interactive terminal is to be connected to by communication network terminal or the mobile terminal of sharing registered user B described in portal server and login shared service, and also supports to surf the Net and possess video, audio collection function and streaming coding and playing function in the second interactive terminal;
C) the first interactive terminal and the second interactive terminal are notified while asking successfully, start video, audio collection function, and the video data of collection and voice data are carried out after streaming coding, with RTMP agreement, be uploaded to FMS server, by RTMP agreement, directly the streaming coding real-time data transmission obtaining in real time gone out;
D) the first mutual phonetic aspect of a dialect video data that the video data that FMS server is uploaded the first interactive terminal and voice data merge, coding is treated to FLV form is buffer memory in addition, the first mutual phonetic aspect of a dialect video data of buffer memory is sent to the second interactive terminal with RTMP agreement and carries out streaming media playing, guarantee the real-time that audio, video data issues; Simultaneously, the second mutual phonetic aspect of a dialect video data that the video data that FMS server is uploaded the second interactive terminal and voice data merge, coding is treated to FLV form is buffer memory in addition, the second mutual phonetic aspect of a dialect video data of buffer memory is sent to the first interactive terminal with RTMP agreement and carries out streaming media playing, guarantee the real-time that audio, video data issues; Under RTMP agreement, play sequential and carry out real time remote control by FMS server, the audio, video data that FMS server issues only need be play-overed in the first interactive terminal and the second interactive terminal, and the audio, video data issuing without storage carries out this locality, reads play operation; Thereby realize the first interactive terminal, communicate by letter with the audio frequency and video real-time interaction of the second interactive terminal, until this audio frequency and video real-time interaction communication while stopping uploaded videos data and voice data, is finished in the first interactive terminal or the second interactive terminal.
2. the audio frequency and video real-time interaction communication system based on shared service, is characterized in that, comprises the first interactive terminal, the second interactive terminal and shared portal server;
Described the first interactive terminal is support to surf the Net and possess terminal or the mobile terminal of video, audio collection function and streaming coding and playing function, by communication network, be connected to shared portal server, in order to login the registered user A of shared service, to shared portal server request, carrying out audio frequency and video real-time interaction with the registered user B of shared service communicates by letter, and can be in notified video, the audio collection function of starting while asking successfully, the video data of collection and voice data are carried out, after streaming coding, with RTMP agreement, being uploaded to FMS server; Described registered user A and registered user B are registered users different in shared service;
Described the second interactive terminal is support to surf the Net and possess terminal or the mobile terminal of video, audio collection function and streaming coding and playing function, by communication network, be connected to shared portal server, in order to login registered user B described in shared service, and can be notified while asking successfully, start video, audio collection function, and the video data of collection and voice data are carried out after streaming coding, with RTMP agreement, be uploaded to FMS server, by RTMP agreement, directly the streaming coding real-time data transmission obtaining in real time gone out;
Described shared portal server is to provide the WEB server of shared service service, and data communication is connected with the FMS of audio frequency and video interactive service server is provided;
Described shared portal server during for described request receiving from the first interactive terminal, judges whether requested registered user B has logined shared service, if not, stops carrying out this audio frequency and video real-time interaction communication; Whether if so, share portal server accepts to communicate by letter with the audio frequency and video real-time interaction of the first interactive terminal by traffic enquiry the second interactive terminal; If the second interactive terminal is not accepted, stop carrying out this audio frequency and video real-time interaction communication; If the second interactive terminal is accepted, shared portal server set up FMS server respectively with the communication connection passage of the first interactive terminal and the second interactive terminal, then notify the first interactive terminal and the second interactive terminal request success;
Described FMS server is for video data that the first interactive terminal is uploaded and voice data merge, coding is treated to FLV form the first mutual phonetic aspect of a dialect video data buffer memory in addition, the first mutual phonetic aspect of a dialect video data of buffer memory is sent to the second interactive terminal with RTMP agreement and carries out streaming media playing, guarantee the real-time that audio, video data issues; Simultaneously, the second mutual phonetic aspect of a dialect video data that the video data that the second interactive terminal is uploaded and voice data merge, coding is treated to FLV form is buffer memory in addition, the second mutual phonetic aspect of a dialect video data of buffer memory is sent to the first interactive terminal with RTMP agreement and carries out streaming media playing, guarantee the real-time that audio, video data issues; Under RTMP agreement, play sequential and carry out real time remote control by FMS server, the audio, video data that FMS server issues only need be play-overed in the first interactive terminal and the second interactive terminal, and the audio, video data issuing without storage carries out this locality, reads play operation; Thereby realizing the first interactive terminal communicates by letter with the audio frequency and video real-time interaction of the second interactive terminal, until the first interactive terminal or the second interactive terminal while stopping uploaded videos data and voice data, are finished the first interactive terminal and are communicated by letter with the audio frequency and video real-time interaction of the second interactive terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110267445.2A CN102325181B (en) | 2011-09-09 | 2011-09-09 | Instant audio/video interactive communication method based on sharing service and instant audio/video interactive communication system based on sharing service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110267445.2A CN102325181B (en) | 2011-09-09 | 2011-09-09 | Instant audio/video interactive communication method based on sharing service and instant audio/video interactive communication system based on sharing service |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102325181A CN102325181A (en) | 2012-01-18 |
| CN102325181B true CN102325181B (en) | 2014-03-05 |
Family
ID=45452850
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110267445.2A Expired - Fee Related CN102325181B (en) | 2011-09-09 | 2011-09-09 | Instant audio/video interactive communication method based on sharing service and instant audio/video interactive communication system based on sharing service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102325181B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI526041B (en) * | 2012-07-17 | 2016-03-11 | 廣達電腦股份有限公司 | Interaction system and interaction method |
| CN103179196B (en) * | 2013-03-05 | 2016-02-03 | 福建凯米网络科技有限公司 | A kind of realize singing terminal networking interaction system, method and data center |
| CN105898396A (en) * | 2015-11-13 | 2016-08-24 | 乐视云计算有限公司 | Third party video pushing method and system |
| CN106327929A (en) * | 2016-08-23 | 2017-01-11 | 北京汉博信息技术有限公司 | Visualized data control method and system for informatization |
| CN106157718A (en) * | 2016-08-23 | 2016-11-23 | 北京汉博信息技术有限公司 | A kind of visualization data interactive method for long-distance education and system |
| KR20180050943A (en) * | 2016-11-07 | 2018-05-16 | 삼성전자주식회사 | Method for providing streaming service and electronic device using the same |
| CN108234292A (en) * | 2017-12-28 | 2018-06-29 | 中国联合网络通信集团有限公司 | Communication system and communication means |
| CN109257615A (en) * | 2018-09-25 | 2019-01-22 | 视联动力信息技术股份有限公司 | A kind of method and apparatus that net cast is shown |
| CN110278402B (en) * | 2019-06-24 | 2022-05-17 | 烟台思卓实业有限责任公司 | Dual-channel audio processing method and device and computer readable storage medium |
| CN111918101B (en) * | 2020-07-17 | 2023-11-28 | 杭州博联智能科技股份有限公司 | Distributed audio and video transmission processing method, device, equipment and medium based on WiFi communication |
| CN114189717A (en) * | 2021-11-08 | 2022-03-15 | 陕西千山航空电子有限责任公司 | Multimedia stream data synchronous playback system and method based on data fusion |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101188620A (en) * | 2006-11-17 | 2008-05-28 | 张立伟 | Method for creating Internet virtual reception hall and realizing synchronous and asynchronous exchange by using flash plug-in technology |
| CN101800894A (en) * | 2009-02-09 | 2010-08-11 | 纬创资通股份有限公司 | Method and system for converting and transmitting multimedia video and audio |
-
2011
- 2011-09-09 CN CN201110267445.2A patent/CN102325181B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101188620A (en) * | 2006-11-17 | 2008-05-28 | 张立伟 | Method for creating Internet virtual reception hall and realizing synchronous and asynchronous exchange by using flash plug-in technology |
| CN101800894A (en) * | 2009-02-09 | 2010-08-11 | 纬创资通股份有限公司 | Method and system for converting and transmitting multimedia video and audio |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102325181A (en) | 2012-01-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102325181B (en) | Instant audio/video interactive communication method based on sharing service and instant audio/video interactive communication system based on sharing service | |
| CN102325182B (en) | Audio-video sharing method and system | |
| CN108055496B (en) | Live broadcasting method and system for video conference | |
| CN105144673B (en) | Reduced latency server-intervention audio-video communication | |
| CN111818004B (en) | Cloud game live broadcast method and system and computer readable storage medium | |
| US20180063556A1 (en) | Systems and methods for providing guest broadcasting on a live stream video platform | |
| CN102104762B (en) | Media recording method, equipment and system of IMS (Internet Management Specification) video conference | |
| US9282448B2 (en) | Method, system and apparatus for providing streaming media service | |
| CN102325173B (en) | Mixed audio and video sharing method and system | |
| CN102752667B (en) | Multi-stream media live broadcast interaction system and live broadcast interaction method | |
| CN105763832B (en) | A kind of video interactive, control method and device | |
| CN107027045A (en) | Pushing video streaming control method, device and video flowing instructor in broadcasting end | |
| CN107819809B (en) | Method and device for synchronizing content | |
| CN105100954A (en) | Interactive response system and method based on Internet communication and streaming media live broadcast | |
| CN105900445B (en) | The method and apparatus of steady live operation for dynamic self-adapting stream transmission | |
| CN107005729A (en) | The coffret transmitted for multimedia and file | |
| JP2016538754A (en) | Method and apparatus for content distribution | |
| CN102065339A (en) | Method and system for playing audio and video media stream | |
| CN107370714A (en) | The high efficiency communication method that facing cloud renders | |
| CN102131114B (en) | Method and system for providing playlist | |
| WO2009018738A1 (en) | A method, related service device and system for providing video content | |
| CN101242513A (en) | Dual-stream transmission method in video conference and video conference system | |
| CN104683823A (en) | Multi-screen linked audio and video synchronizing system | |
| CN101299709A (en) | Flow type medium server system based on internet | |
| WO2013170812A1 (en) | Transmission method for media data stream and thin client |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20140305 Termination date: 20160909 |