CN102325181A - Instant audio/video interactive communication method based on sharing service and instant audio/video interactive communication system based on sharing service - Google Patents
Instant audio/video interactive communication method based on sharing service and instant audio/video interactive communication system based on sharing service Download PDFInfo
- Publication number
- CN102325181A CN102325181A CN201110267445A CN201110267445A CN102325181A CN 102325181 A CN102325181 A CN 102325181A CN 201110267445 A CN201110267445 A CN 201110267445A CN 201110267445 A CN201110267445 A CN 201110267445A CN 102325181 A CN102325181 A CN 102325181A
- Authority
- CN
- China
- Prior art keywords
- video
- interactive terminal
- terminal
- audio
- audio frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Telephonic Communication Services (AREA)
Abstract
The invention provides an instant audio/video interactive communication method based on sharing service and an instant audio/video interactive communication system based on sharing service, which overcome various constraints in the implementation of instant audio/video data interactive communication in the prior art. A flash media server (FMS) is utilized to provide an audio/video interaction service, a sender encodes and then uploads acquired video/audio data streaming media to the FMS by means of the real-time messaging protocol (RTMP), and the FMS merges, encodes and then downloads the video/audio data uploaded by the sender to a receiver by means of the RTMP. The instant synchronization of audio/video data from the sender to the receiver is implemented, so that the instant audio/video interactive communication between a first interaction terminal and a second interaction terminal taking part in interaction can be implemented, moreover, by means of the RTMP, the invention solves the problem that the memory spaces of the two interaction terminals are occupied, so that mobile terminals can carry out long-time instant audio/video interactive communication by means of a sharing service platform, and furthermore, the investment in services is little, which is favorable for the development of new service markets.
Description
Technical field
The present invention relates to internet technique and ICT field, particularly a kind of audio frequency and video real-time interaction communication means and system based on shared service.
Background technology
In recent years, internet technique and mobile communication network technology development are rapid, and a lot of network gatewaies are all carried out has multi-form data information sharing professional, for example data information sharing website, blog, microblogging, network individual space etc.; And; Along with electronic equipments such as computer, portable terminal are universal day by day; People have got used to logining the shared service issue and obtaining shared data message through communication network by terminal or portable terminal gradually, make China progressively get into the epoch of whole people's data information sharing.Simultaneously; These progressive variations and multi-levelization that also progressively brought data information sharing; People are from pass through the form shared data information of broadcast distribution, download/reprinting simply; Develop the instantaneity, the interactivity demand that data information sharing step by step, so that realize long-range exchange of information, teleconference and job placement, the contact of long-range emotion or recreational use or the like through immediate interactive.Provide the network gateway of data information sharing also to begin to utilize one after another various technology that the real-time interaction communication service of data message is provided,, open up new value-added service to satisfy this emerging customer demand.
At present, mainly comprised three types of lteral data, image data and audio, video datas by the data message of extensively sharing.Though in the mobile communication technology field; Short message, multimedia message, voice call and video calling (being equivalent to literal, picture, audio frequency and video real-time interaction communicates by letter) have all obtained ripe development and application; But because mobile communications network construction operation fund is huge; And three domestic big mobile communication carriers have possessed abundant operation experience and huge customer group at present, only rely on mobile communication technology to carry out new audio frequency and video real-time interaction communication service and have been difficult to obtain business success; And the exchange and interdynamic between the portable terminal are also only supported in the real-time interaction communication of mobile communication technology platform.If the real-time interaction communication of the shared service Platform Implementation data message that can provide by network gateway; Then can utilize original communication network resource; Need not to drop into huge communication network development fund; And can by between the shared service Platform Implementation portable terminal, portable terminal communicates by letter with the real-time interaction between the terminal, significantly increased professional customer group; Therefore, the real-time interaction communication technology based on shared service has highly application value.
The real-time interaction of realizing lteral data and image data based on shared service is very simple; Because the data volume of lteral data and image data is smaller; The transfer of data time-delay is very short; People's real-time interaction demand for experience all can have enough been satisfied in the mutual one by one transmission of lteral data file and image data file, therefore realizes that based on shared service the prior art of literal, image data real-time interaction is very many.And audio, video data is big and have a time remaining property because of its data volume; It is shared that existing shared service all only supports recording of audio, video data to upload mostly; Be difficult to satisfy the demand of real-time interaction; And the recording of audio, video data uploaded and needed to preserve the audio, video data of being recorded and upload, receives also need download when playing to preserve to be carried out this locality by the audio, video data of sharing and read broadcast, therefore takies the memory space of transmission terminal and shared terminal respectively; For the very limited portable terminal of data space, then can't carry out long audio frequency and video interactive operation.
Summary of the invention
To the above-mentioned deficiency that exists in the prior art; The object of the present invention is to provide a kind of audio frequency and video real-time interaction communication means based on shared service; Solve the problem that in shared service, realizes the audio, video data real-time interaction on the one hand, solve the problem that takies the great amount of terminals memory space in the audio, video data interactive communication process on the other hand.For realizing this purpose, the present invention has adopted following technological means:
A kind of audio frequency and video real-time interaction communication means based on shared service comprises the steps:
A) first interactive terminal is connected to shared portal server through communication network, and the registered user A of login shared service carries out the audio frequency and video real-time interaction to shared portal server request with the registered user B of shared service and communicates by letter; Said first interactive terminal is terminal or the portable terminal of supporting online and possessing video, audio collection function and Streaming Media coding and playing function; Said shared portal server provides the WEB server of shared service service, and data communication is connected with the FMS of audio frequency and video interactive service is provided server; Said registered user A is registered users different in the shared service with registered user B;
When b) sharing portal server and receive the described request from first interactive terminal, judge whether requested registered user B has logined shared service, if not, then stop carrying out this audio frequency and video real-time interaction communication; If then share portal server and whether accept to communicate by letter with the audio frequency and video real-time interaction of first interactive terminal through traffic enquiry second interactive terminal; If second interactive terminal is not accepted, then stop carrying out this audio frequency and video real-time interaction communication; If second interactive terminal is accepted, shared portal server then set up the FMS server respectively with the interface channel of communicating by letter of first interactive terminal and second interactive terminal, notify first interactive terminal and the second interactive terminal successful request then; Said second interactive terminal is to be connected to terminal or the portable terminal of sharing registered user B described in portal server and the login shared service through communication network, and second interactive terminal is also supported online and possessed video, audio collection function and Streaming Media coding and playing function;
C) first interactive terminal and second interactive terminal are started video, audio collection function by notice request when success, and video data of gathering and voice data are carried out being uploaded to the FMS server with the RTMP agreement after Streaming Media encodes;
D) FMS server the video data that first interactive terminal is uploaded and voice data merges, encoding process is the FLV form first mutual phonetic aspect of a dialect video data buffer memory in addition is sent to second interactive terminal with the first mutual phonetic aspect of a dialect video data of buffer memory with the RTMP agreement and carries out streaming media playing; Simultaneously; The second mutual phonetic aspect of a dialect video data that video data that the FMS server is uploaded second interactive terminal and voice data merge, encoding process is the FLV form is buffer memory in addition, the second mutual phonetic aspect of a dialect video data of buffer memory is sent to first interactive terminal with the RTMP agreement carries out streaming media playing; Thereby realize that first interactive terminal communicates by letter with the audio frequency and video real-time interaction of second interactive terminal, when first interactive terminal or second interactive terminal stop uploaded videos data and voice data, finish this audio frequency and video real-time interaction communication.
Correspondingly, the present invention should provide a kind of audio frequency and video real-time interaction communication system that realizes said method.For realizing this purpose, the present invention has adopted following technological means:
A kind of audio frequency and video real-time interaction communication system based on shared service comprises first interactive terminal, second interactive terminal and shared portal server;
Said first interactive terminal is terminal or the portable terminal of supporting online and possessing video, audio collection function and Streaming Media coding and playing function; Be connected to shared portal server through communication network; Registered user A in order to the login shared service; Carrying out the audio frequency and video real-time interaction to shared portal server request with the registered user B of shared service communicates by letter; And can started video, audio collection function by notice request when success, video data of gathering and voice data are carried out being uploaded to the FMS server with the RTMP agreement after Streaming Media encodes; Said registered user A is registered users different in the shared service with registered user B;
Said second interactive terminal is terminal or the portable terminal of supporting online and possessing video, audio collection function and Streaming Media coding and playing function; Be connected to shared portal server through communication network; In order to registered user B described in the login shared service, and can by the notice request success time, start video, audio collection function; And video data of gathering and voice data carried out being uploaded to the FMS server with the RTMP agreement after Streaming Media encodes;
Said shared portal server provides the WEB server of shared service service, and data communication is connected with the FMS of audio frequency and video interactive service is provided server;
Said shared portal server is used for when the described request that receives from first interactive terminal, judging whether requested registered user B has logined shared service, if not, then stops carrying out this audio frequency and video real-time interaction communication; If then share portal server and whether accept to communicate by letter with the audio frequency and video real-time interaction of first interactive terminal through traffic enquiry second interactive terminal; If second interactive terminal is not accepted, then stop carrying out this audio frequency and video real-time interaction communication; If second interactive terminal is accepted, shared portal server then set up the FMS server respectively with the interface channel of communicating by letter of first interactive terminal and second interactive terminal, notify first interactive terminal and the second interactive terminal successful request then;
The first mutual phonetic aspect of a dialect video data that video data that said FMS server is used for first interactive terminal is uploaded and voice data merge, encoding process is the FLV form is buffer memory in addition, the first mutual phonetic aspect of a dialect video data of buffer memory is sent to second interactive terminal with the RTMP agreement carries out streaming media playing; Simultaneously; The second mutual phonetic aspect of a dialect video data that video data that second interactive terminal is uploaded and voice data merge, encoding process is the FLV form is buffer memory in addition, the second mutual phonetic aspect of a dialect video data of buffer memory is sent to first interactive terminal with the RTMP agreement carries out streaming media playing; Thereby realize that first interactive terminal communicates by letter with the audio frequency and video real-time interaction of second interactive terminal; When first interactive terminal or second interactive terminal termination uploaded videos data and voice data, finish first interactive terminal and communicate by letter with the audio frequency and video real-time interaction of second interactive terminal.
Than prior art, the present invention has following beneficial effect:
1, the audio frequency and video real-time interaction communication means and the system that the present invention is based on shared service have adopted special shared transmission means; Through FMS server (Flash Media Server; The Flash multimedia server) the audio frequency and video interactive service is provided; Because the FMS server is generally supported the transmission of RTMP protocol data; Transmit leg is uploaded to the FMS server with RTMP agreement (Real Time Messaging Protocol, real-time messages transportation protocol) later with the video of gathering, audio data stream media coding, and the video that the FMS server is uploaded transmit leg, voice data are issued to the recipient with the RTMP agreement after merging coding again; Realize the instant synchronism of audio, video data from transmit leg to the recipient; And participating in the first mutual interactive terminal and second interactive terminal is the transmit leg of audio, video data, is the recipient of the other side's audio, video data simultaneously again, thereby makes both sides to make instant response and interaction for the other side's sound, picture; Reach the effect that is similar to video calling in the mobile communication technology, realized that first interactive terminal communicates by letter with the audio frequency and video real-time interaction of two interactive terminals.
2, audio frequency and video real-time interaction communication means of the present invention and system have adopted the host-host protocol that the RTMP agreement is uploaded and issued as stream medium audio and video; The client terminal of uploading data transfers out by the Streaming Media coded format data in real time that this host-host protocol can be directly gathered with in fact the time, coding obtains, and has therefore avoided client terminal in upload procedure, to carry out audio, video data recording and has preserved and handle; Simultaneously; Sound, video data by the RTMP agreement issue playing process; Be the FMS server that issues audio, video data with after the client terminal that receives playing audio-video data is set up the single interface channel of communicating by letter through handshake communication; Be issued to client terminal and play by the FMS server video data real time propelling movement that will pronounce, and under the RTMP agreement, play sequential and carry out real time remote control by the FMS server; Client terminal only need be play-overed the audio, video data that the FMS server issues, and carries out this locality and reads play operation and need not to store the audio, video data that issues; Thus, solved the problem that takies mutual both sides' terminal storage space, making portable terminal carry out the communication of long audio frequency and video real-time interaction by the shared service platform becomes possibility.
3, in audio frequency and video real-time interaction communication means of the present invention and the system; The FMS server is FLV form (Flash Video with the audio frequency of uploading, video data merging, encoding process; The Flash video format) issues again after; On the one hand because under the RTMP agreement; Issue and the Play Control of audio, video data are all operated by the FMS server, and the FMS server merges, can accomplish when encoding audio frequency, audio video synchronization to audio frequency, the video data of uploading to be handled, and avoid the audio, video data generation sound that client terminal receives, the situation of drawing step-out; On the other hand; Audio frequency, video data format that different terminals, portable terminal are uploaded are not quite similar; Can't on other terminals, portable terminal, play-over probably; The FMS server with its merge, be encoded to the FLV uniform format audio, video data issue the format standard of broadcast; The audio-video document of FLV form can directly be play (because existing web browser all is integrated with the Flash playing function) in web browser simultaneously; And support the terminal and the portable terminal of online that web browser generally is installed, thereby the audio frequency of the different-format of uploading, the problem that video data possibly can't be play-overed have been solved on other terminals, portable terminal; Again on the one hand, the compression ratio of FLV form audio, video data is high, data volume is little, and the real-time Transmission that is suitable for audio, video data is play, and can better guarantee to adopt the RTMP agreement to issue the fluency of broadcast.
4, utilize the inventive method and system, can carry out the communication service of audio frequency and video real-time interaction, thereby help reducing trade investment, the new Service Market of developing by the shared service platform of existing technology maturation; Simultaneously, can also by between the shared service Platform Implementation portable terminal, portable terminal communicates by letter with the real-time interaction between the terminal, increased professional customer group; Therefore have highly application value.
Description of drawings
Fig. 1 is the frame construction figure that the present invention is based on the audio frequency and video real-time interaction communication system of shared service;
Fig. 2 is the FB(flow block) that the present invention is based on the audio frequency and video real-time interaction communication means of shared service.
Embodiment
Because it is shared that shared services such as existing blog, microblogging, network individual space all only support recording of audio, video data to upload mostly; Even if sharing end realization streaming media playing; Still be difficult to satisfy the instant synchronisation requirement of transmit leg, therefore more be difficult to realize the real-time interaction of audio, video data to the recipient.To this present situation; The present invention proposes a kind of can overcome the prior art constraint based on the audio frequency and video real-time interaction communication means of shared service and corresponding to the audio frequency and video real-time interaction communication system of this method; This audio frequency and video real-time interaction communication means and system have adopted special shared transmission means; Through the FMS server audio frequency and video interactive service is provided; Because the FMS server is generally supported the transmission of RTMP protocol data, transmit leg is uploaded to the FMS server with the RTMP agreement later with the video of gathering, audio data stream media coding, and the video that the FMS server is uploaded transmit leg, voice data are issued to the recipient with the RTMP agreement after merging coding again; Realize the instant synchronism of audio, video data from transmit leg to the recipient; And participating in the first mutual interactive terminal and second interactive terminal is the transmit leg of audio, video data, is the recipient of the other side's audio, video data simultaneously again, thereby makes both sides to make instant response and interaction for the other side's sound, picture; Reach the effect that is similar to video calling in the mobile communication technology, realized that first interactive terminal communicates by letter with the audio frequency and video real-time interaction of two interactive terminals.
As shown in Figure 1, the audio frequency and video real-time interaction communication system that the present invention is based on shared service mainly is made up of first interactive terminal 1, second interactive terminal 4 and shared portal server 2.First interactive terminal 1 and second interactive terminal 4 are terminal or portable terminals of supporting online and possessing video, audio collection function and Streaming Media coding and playing function; Share the WEB server that portal server 2 provides the shared service service, and data communication is connected with the FMS of audio frequency and video interactive service server 3 is provided.Wherein, First interactive terminal 1 is connected to through communication network shares portal server 2; In order to the registered user A of login shared service, carry out the audio frequency and video real-time interaction to shared portal server 2 requests with the registered user B of shared service and communicate by letter, and can when being shared the success of portal server 2 notice request, start video, audio collection function; Video data of gathering and voice data are carried out being uploaded to FMS server 3 with the RTMP agreement after Streaming Media encodes; Registered user A described here is meant two different registered users in the shared service with registered user B.Second interactive terminal 4 is connected to through communication network shares portal server 2; In order to registered user B described in the login shared service; And can when being shared the success of portal server 2 notice request, start video, audio collection function; And video data of gathering and voice data carried out being uploaded to FMS server 3 with the RTMP agreement after Streaming Media encodes.Share portal server 2 and be used for when the described request that receives from first interactive terminal 1, judging whether requested registered user B has logined shared service, if not, then stop carrying out this audio frequency and video real-time interaction communication; If then share portal server 2 and whether accept to communicate by letter with the audio frequency and video real-time interaction of first interactive terminal through traffic enquiry second interactive terminal 4; If second interactive terminal 4 is not accepted, then stop carrying out this audio frequency and video real-time interaction communication; If second interactive terminal 4 is accepted, share 2 of portal servers set up FMS server 3 respectively with the communicate by letter interface channel of first interactive terminal 1 with second interactive terminal 4, notify first interactive terminal 1 and second interactive terminal, 4 successful request then.The first mutual phonetic aspect of a dialect video data that video data that FMS server 3 is used for first interactive terminal 1 is uploaded and voice data merge, encoding process is the FLV form is buffer memory in addition, the first mutual phonetic aspect of a dialect video data of buffer memory is sent to second interactive terminal 4 with the RTMP agreement carries out streaming media playing; Simultaneously; The second mutual phonetic aspect of a dialect video data that video data that second interactive terminal 4 is uploaded and voice data merge, encoding process is the FLV form is buffer memory in addition, the second mutual phonetic aspect of a dialect video data of buffer memory is sent to first interactive terminal 1 with the RTMP agreement carries out streaming media playing; Thereby realize that first interactive terminal 1 communicates by letter with the audio frequency and video real-time interaction of second interactive terminal 4; When first interactive terminal 1 or second interactive terminal, 4 termination uploaded videos data and voice data, finish first interactive terminal 1 and communicate by letter with the audio frequency and video real-time interaction of second interactive terminal 4.
Audio frequency and video real-time interaction communication system of the present invention is as shown in Figure 2 based on the FB(flow block) that shared service carries out the communication of audio frequency and video real-time interaction, and concrete grammar is following:
A) first interactive terminal is connected to shared portal server through communication network, and the registered user A of login shared service carries out the audio frequency and video real-time interaction to shared portal server request with the registered user B of shared service and communicates by letter;
When b) sharing portal server and receive the described request from first interactive terminal, judge whether requested registered user B has logined shared service, if not, then stop carrying out this audio frequency and video real-time interaction communication; If then share portal server and whether accept to communicate by letter with the audio frequency and video real-time interaction of first interactive terminal through traffic enquiry second interactive terminal; If second interactive terminal is not accepted, then stop carrying out this audio frequency and video real-time interaction communication; If second interactive terminal is accepted, shared portal server then set up the FMS server respectively with the interface channel of communicating by letter of first interactive terminal and second interactive terminal, notify first interactive terminal and the second interactive terminal successful request then;
C) first interactive terminal and second interactive terminal are started separately video, audio collection function by notice request when success, and separately video data of gathering and voice data are carried out being uploaded to the FMS server with the RTMP agreement after Streaming Media encodes;
D) FMS server the video data that first interactive terminal is uploaded and voice data merges, encoding process is the FLV form first mutual phonetic aspect of a dialect video data buffer memory in addition is sent to second interactive terminal with the first mutual phonetic aspect of a dialect video data of buffer memory with the RTMP agreement and carries out streaming media playing; Simultaneously; The second mutual phonetic aspect of a dialect video data that video data that the FMS server is uploaded second interactive terminal and voice data merge, encoding process is the FLV form is buffer memory in addition, the second mutual phonetic aspect of a dialect video data of buffer memory is sent to first interactive terminal with the RTMP agreement carries out streaming media playing; Thereby realize that first interactive terminal communicates by letter with the audio frequency and video real-time interaction of second interactive terminal, when first interactive terminal or second interactive terminal stop uploaded videos data and voice data, finish this audio frequency and video real-time interaction communication.
The host-host protocol that audio frequency and video real-time interaction communication means of the present invention and system adopt the RTMP agreement to upload and issue as stream medium audio and video; Be because the RTMP agreement is a kind of real-time streaming host-host protocol; Can directly the Streaming Media coded data real-time Transmission that obtains in real time be gone out by the RTMP agreement; Promptly guaranteed the real-time that audio frequency, video data are uploaded, avoided client terminal in upload procedure, to carry out audio, video data recording again and preserved processing; Simultaneously; Sound, video data by the RTMP agreement issue playing process; Be the FMS server that issues audio, video data with after the client terminal that receives playing audio-video data is set up the single interface channel of communicating by letter through handshake communication, be issued to the client terminal broadcast, can guarantee the real-time that audio, video data issues by the FMS server video data real time propelling movement that will pronounce; And under the RTMP agreement; Play sequential and carry out real time remote control by the FMS server, client terminal only need be play-overed the audio, video data that the FMS server issues, and carries out this locality and reads play operation and need not to store the audio, video data that issues; Thus; Both guaranteed that first interactive terminal and second interactive terminal carried out the mutual instantaneity of audio frequency and video; Make both sides to make instant response and interaction for the other side's sound, picture; Solved the problem that takies mutual both sides' terminal storage space again, made the portable terminal of limited storage space also can carry out the communication of long audio frequency and video real-time interaction by the shared service platform.Yet; Consider from the globality of system's realization and operation; Only overcome the above-mentioned constraint that exists in the prior art not enough; Because the data volume of voice data and video data not reciprocity (data volume of video data is greater than voice data usually), if the FSM server adopts the RTMP agreement that audio frequency, video data are issued transmission and controls playing respectively, the influence because of transmission rate causes the client terminal sound, draws and play step-out easily; Simultaneously; In the market terminal and portable terminal are multifarious; Different terminals, portable terminal collection, the audio frequency of uploading, video data format are not quite similar; If the FSM server with the audio frequency of uploading, the direct forwarding of video data might occur receiving, the client terminal factor of playing audio-video data is incompatible according to form and the problem that can't play-over, thereby can not reach the purpose of real-time interaction communication.In order further to address these problems again; In audio frequency and video real-time interaction communication means of the present invention and system; The FMS server with the audio frequency of uploading, video data merge, encoding process is to issue behind the FLV form again;, can accomplish the FMS server audio frequency, audio video synchronization processing on the one hand when merging, encode audio frequency, the video data of uploading; Synchronous Processing can be through the mark timestamp, abandon existing Network Transmission simultaneous techniques means such as delayed data frame realizes, avoids the audio, video data generation sound that client terminal receives, the situation of drawing step-out; On the other hand; The FMS server with the audio frequency of uploading, video data merge, be encoded to the FLV uniform format audio, video data issue the format standard of broadcast; The audio-video document of FLV form can directly be play (because existing web browser all is integrated with the Flash playing function) in web browser simultaneously; And support the terminal and the portable terminal of online that web browser generally is installed, thereby the audio frequency of the different-format of uploading, the problem that video data possibly can't be play-overed have been solved on other terminals, portable terminal; Again on the one hand, the compression ratio of FLV form audio, video data is high, data volume is little, and the real-time Transmission that is suitable for audio, video data is play, and can better guarantee to adopt the RTMP agreement to issue the fluency of broadcast.
To utilize technical scheme of the present invention to realize that the microblogging visual talking business based on the microblogging shared service is an example, the present invention is done further explanation below.
Embodiment:
Microblogging; Be also referred to as microblogging visitor (MicroBlog); In the microblogging shared service; The registered user can be by its corresponding its people's of data information sharing list builder who distributes data message community, and through the intercommunal intersection issue of different pieces of information information or exchange visits and realize data information sharing, is that at present pandemic a kind of data information sharing is professional.Yet; Present microblogging shared service only supports the broadcasting of lteral data, image data or audio, video data, reprinting to share usually; Constraint based on prior art; Also fail to realize the real-time interaction communication of audio, video data always, thereby have no idea well to carry out the microblogging visual telephone service.Utilize audio frequency and video real-time interaction communication system of the present invention, just can overcome existing constraint, realize the audio frequency and video real-time interaction communication between the different microblogging users.Use audio frequency and video real-time interaction communication system of the present invention and realize that the idiographic flow of microblogging video telephone in the microblogging shared service is following:
The user that a) need carry out video call uses terminal or the portable terminal supporting online and possess video, audio collection function and Streaming Media coding and playing function to be connected to microblogging as first interactive terminal through communication network to share portal server; The registered user A of login microblogging shared service carries out the audio frequency and video real-time interaction to shared portal server request with its good friend's microblogging registered user B at the microblogging shared service and communicates by letter.Microblogging registered user A described here is meant two different registered users in the microblogging shared service with microblogging registered user B.Terminal or the portable terminal supporting online and possess video, audio collection function and Streaming Media coding and playing function can pass through existing techniques in realizing; Streaming Media encoding software, streaming media playing software for example are installed and are connected with microphone and the computer of camera, the shooting smart mobile phone of Streaming Media encoding software, streaming media playing software etc. perhaps is installed; Streaming Media coding, playout software to computer platform are profuse, and operation system of smart phone such as Symbian, Android also are to support Streaming Media coding, broadcast simultaneously, and Streaming Media coding, play-back technology are prior art; In the present embodiment, the Streaming Media of video data coding has adopted H.264 coding techniques, and the Streaming Media coding of voice data has adopted ACC coding techniques, streaming media playing then to adopt Flash streaming media playing technology.Microblogging is shared the WEB server that portal server provides the service of microblogging shared service, and data communication is connected with the FMS of audio frequency and video interactive service is provided server.
When b) microblogging is shared portal server and received the audio frequency and video real-time interaction communication request from first interactive terminal, judge whether requested microblogging registered user B has logined shared service, if not, then stop carrying out this audio frequency and video real-time interaction communication; If then whether the shared portal server of microblogging is accepted to communicate by letter with the audio frequency and video real-time interaction of first interactive terminal through traffic enquiry second interactive terminal; If second interactive terminal is not accepted, then stop carrying out this audio frequency and video real-time interaction communication; If second interactive terminal is accepted, microblogging share portal server then set up the FMS server respectively with the interface channel of communicating by letter of first interactive terminal and second interactive terminal, notify first interactive terminal and the second interactive terminal successful request then.Second interactive terminal is meant through communication network and is connected to terminal or the portable terminal that microblogging is shared microblogging registered user B in portal server and the login microblogging shared service that second interactive terminal is also supported online and possessed video, audio collection function and Streaming Media coding and playing function; Equally, second interactive terminal of present embodiment, the Streaming Media coding of video data adopts H.264 coding techniques, and the Streaming Media coding of voice data adopts the ACC coding techniques, and streaming media playing adopts Flash streaming media playing technology.
When c) first interactive terminal and second interactive terminal are by the notice request success; Start separately video, audio collection function; And separately H.264 the video data of gathering is encoded, after voice data carries out the ACC coding, is uploaded to the FMS server with the RTMP agreement.
D) the first mutual phonetic aspect of a dialect video data that voice data merges, encoding process is the FLV form of video data and the ACC coding of FMS server H.264 coding that first interactive terminal is uploaded buffer memory in addition is sent to second interactive terminal with the RTMP agreement through the shared portal server of microblogging with the first mutual phonetic aspect of a dialect video data of buffer memory and carries out streaming media playing; Simultaneously; The second mutual phonetic aspect of a dialect video data that voice data merges, encoding process is the FLV form of video data and the ACC coding of the H.264 coding that the FMS server is uploaded second interactive terminal is buffer memory in addition, the second mutual phonetic aspect of a dialect video data of buffer memory is sent to first interactive terminal with the RTMP agreement through the shared portal server of microblogging carries out streaming media playing; Thereby by the audio frequency and video real-time interaction Communication Realization of first interactive terminal and second interactive terminal both sides' video call; When first interactive terminal or second interactive terminal termination uploaded videos data and voice data, finish this audio frequency and video real-time interaction communication.
Can see through this embodiment; Audio frequency and video real-time interaction communication means of the present invention is after having overcome many constraints of prior art; Realized the video call on the microblogging shared service; By this microblogging visual talking business, the user just need not only to rely on mobile communication business to carry out video call, and can select to carry out video call through the login microblogging; And the processing of audio, video data, transfer process are sightless for the user in the process of video call; The user operates and watches video equally easy with regard to similar in the microblogging program request; Both sides' video call only exists audio data format coding delay and Streaming Media transmission delay weak point time of delay, can satisfy the real-time requirement of instant messaging fully.
The foregoing description is that the present invention will be described as a kind of embodiment, is not limitation of the present invention.In audio frequency and video real-time interaction communication means of the present invention and system, the Streaming Media coded system of audio frequency, video data is also not only limited to and the foregoing description, also can adopt other stream encryption technology of prior art to realize.Simultaneously, audio frequency and video real-time interaction communication means of the present invention and system not only can be applied in the middle of the microblogging shared service, also can be applied in the middle of the data information sharing business of various ways such as website, blog, network individual space; And, utilize the inventive method and system, can carry out the communication service of audio frequency and video real-time interaction by the shared service platform of existing technology maturation, thereby help reducing trade investment, the new Service Market of developing; Simultaneously, can also by between the shared service Platform Implementation portable terminal, portable terminal communicates by letter with the real-time interaction between the terminal, increased professional customer group; Therefore have highly application value.
Explanation is at last; Above embodiment is only unrestricted in order to technical scheme of the present invention to be described; Although with reference to preferred embodiment the present invention is specified, those of ordinary skill in the art should be appreciated that and can make amendment or be equal to replacement technical scheme of the present invention; And not breaking away from the aim and the scope of technical scheme of the present invention, it all should be encompassed in the middle of the claim scope of the present invention.
Claims (2)
1. the audio frequency and video real-time interaction communication means based on shared service is characterized in that, comprises the steps:
A) first interactive terminal is connected to shared portal server through communication network, and the registered user A of login shared service carries out the audio frequency and video real-time interaction to shared portal server request with the registered user B of shared service and communicates by letter; Said first interactive terminal is terminal or the portable terminal of supporting online and possessing video, audio collection function and Streaming Media coding and playing function; Said shared portal server provides the WEB server of shared service service, and data communication is connected with the FMS of audio frequency and video interactive service is provided server; Said registered user A is registered users different in the shared service with registered user B;
When b) sharing portal server and receive the described request from first interactive terminal, judge whether requested registered user B has logined shared service, if not, then stop carrying out this audio frequency and video real-time interaction communication; If then share portal server and whether accept to communicate by letter with the audio frequency and video real-time interaction of first interactive terminal through traffic enquiry second interactive terminal; If second interactive terminal is not accepted, then stop carrying out this audio frequency and video real-time interaction communication; If second interactive terminal is accepted, shared portal server then set up the FMS server respectively with the interface channel of communicating by letter of first interactive terminal and second interactive terminal, notify first interactive terminal and the second interactive terminal successful request then; Said second interactive terminal is to be connected to terminal or the portable terminal of sharing registered user B described in portal server and the login shared service through communication network, and second interactive terminal is also supported online and possessed video, audio collection function and Streaming Media coding and playing function;
C) first interactive terminal and second interactive terminal are started video, audio collection function by notice request when success, and video data of gathering and voice data are carried out being uploaded to the FMS server with the RTMP agreement after Streaming Media encodes;
D) FMS server the video data that first interactive terminal is uploaded and voice data merges, encoding process is the FLV form first mutual phonetic aspect of a dialect video data buffer memory in addition is sent to second interactive terminal with the first mutual phonetic aspect of a dialect video data of buffer memory with the RTMP agreement and carries out streaming media playing; Simultaneously; The second mutual phonetic aspect of a dialect video data that video data that the FMS server is uploaded second interactive terminal and voice data merge, encoding process is the FLV form is buffer memory in addition, the second mutual phonetic aspect of a dialect video data of buffer memory is sent to first interactive terminal with the RTMP agreement carries out streaming media playing; Thereby realize that first interactive terminal communicates by letter with the audio frequency and video real-time interaction of second interactive terminal, when first interactive terminal or second interactive terminal stop uploaded videos data and voice data, finish this audio frequency and video real-time interaction communication.
2. the audio frequency and video real-time interaction communication system based on shared service is characterized in that, comprises first interactive terminal, second interactive terminal and shared portal server;
Said first interactive terminal is terminal or the portable terminal of supporting online and possessing video, audio collection function and Streaming Media coding and playing function; Be connected to shared portal server through communication network; Registered user A in order to the login shared service; Carrying out the audio frequency and video real-time interaction to shared portal server request with the registered user B of shared service communicates by letter; And can started video, audio collection function by notice request when success, video data of gathering and voice data are carried out being uploaded to the FMS server with the RTMP agreement after Streaming Media encodes; Said registered user A is registered users different in the shared service with registered user B;
Said second interactive terminal is terminal or the portable terminal of supporting online and possessing video, audio collection function and Streaming Media coding and playing function; Be connected to shared portal server through communication network; In order to registered user B described in the login shared service, and can by the notice request success time, start video, audio collection function; And video data of gathering and voice data carried out being uploaded to the FMS server with the RTMP agreement after Streaming Media encodes;
Said shared portal server provides the WEB server of shared service service, and data communication is connected with the FMS of audio frequency and video interactive service is provided server;
Said shared portal server is used for when the described request that receives from first interactive terminal, judging whether requested registered user B has logined shared service, if not, then stops carrying out this audio frequency and video real-time interaction communication; If then share portal server and whether accept to communicate by letter with the audio frequency and video real-time interaction of first interactive terminal through traffic enquiry second interactive terminal; If second interactive terminal is not accepted, then stop carrying out this audio frequency and video real-time interaction communication; If second interactive terminal is accepted, shared portal server then set up the FMS server respectively with the interface channel of communicating by letter of first interactive terminal and second interactive terminal, notify first interactive terminal and the second interactive terminal successful request then;
The first mutual phonetic aspect of a dialect video data that video data that said FMS server is used for first interactive terminal is uploaded and voice data merge, encoding process is the FLV form is buffer memory in addition, the first mutual phonetic aspect of a dialect video data of buffer memory is sent to second interactive terminal with the RTMP agreement carries out streaming media playing; Simultaneously; The second mutual phonetic aspect of a dialect video data that video data that second interactive terminal is uploaded and voice data merge, encoding process is the FLV form is buffer memory in addition, the second mutual phonetic aspect of a dialect video data of buffer memory is sent to first interactive terminal with the RTMP agreement carries out streaming media playing; Thereby realize that first interactive terminal communicates by letter with the audio frequency and video real-time interaction of second interactive terminal; When first interactive terminal or second interactive terminal termination uploaded videos data and voice data, finish first interactive terminal and communicate by letter with the audio frequency and video real-time interaction of second interactive terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110267445.2A CN102325181B (en) | 2011-09-09 | 2011-09-09 | Instant audio/video interactive communication method based on sharing service and instant audio/video interactive communication system based on sharing service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110267445.2A CN102325181B (en) | 2011-09-09 | 2011-09-09 | Instant audio/video interactive communication method based on sharing service and instant audio/video interactive communication system based on sharing service |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102325181A true CN102325181A (en) | 2012-01-18 |
| CN102325181B CN102325181B (en) | 2014-03-05 |
Family
ID=45452850
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110267445.2A Expired - Fee Related CN102325181B (en) | 2011-09-09 | 2011-09-09 | Instant audio/video interactive communication method based on sharing service and instant audio/video interactive communication system based on sharing service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102325181B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103179196A (en) * | 2013-03-05 | 2013-06-26 | 福建星网视易信息系统有限公司 | System and method for achieving sing terminal networking interaction and data center |
| CN103546677A (en) * | 2012-07-17 | 2014-01-29 | 广达电脑股份有限公司 | Interaction system and interaction method |
| CN105898396A (en) * | 2015-11-13 | 2016-08-24 | 乐视云计算有限公司 | Third party video pushing method and system |
| CN106157718A (en) * | 2016-08-23 | 2016-11-23 | 北京汉博信息技术有限公司 | A kind of visualization data interactive method for long-distance education and system |
| CN106327929A (en) * | 2016-08-23 | 2017-01-11 | 北京汉博信息技术有限公司 | Visualized data control method and system for informatization |
| CN108076044A (en) * | 2016-11-07 | 2018-05-25 | 三星电子株式会社 | Service method for stream and equipment |
| CN108234292A (en) * | 2017-12-28 | 2018-06-29 | 中国联合网络通信集团有限公司 | Communication system and communication means |
| CN109257615A (en) * | 2018-09-25 | 2019-01-22 | 视联动力信息技术股份有限公司 | A kind of method and apparatus that net cast is shown |
| CN110278402A (en) * | 2019-06-24 | 2019-09-24 | 努比亚技术有限公司 | A kind of dual-channel audio processing method, equipment and computer readable storage medium |
| CN111918101A (en) * | 2020-07-17 | 2020-11-10 | 杭州博联智能科技股份有限公司 | Distributed audio and video transmission processing method, device, equipment and medium based on WiFi communication |
| CN114189717A (en) * | 2021-11-08 | 2022-03-15 | 陕西千山航空电子有限责任公司 | Multimedia stream data synchronous playback system and method based on data fusion |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101188620A (en) * | 2006-11-17 | 2008-05-28 | 张立伟 | Method for creating Internet virtual reception hall and realizing synchronous and asynchronous exchange by using flash plug-in technology |
| CN101800894A (en) * | 2009-02-09 | 2010-08-11 | 纬创资通股份有限公司 | Method and system for converting and transmitting multimedia video and audio |
-
2011
- 2011-09-09 CN CN201110267445.2A patent/CN102325181B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101188620A (en) * | 2006-11-17 | 2008-05-28 | 张立伟 | Method for creating Internet virtual reception hall and realizing synchronous and asynchronous exchange by using flash plug-in technology |
| CN101800894A (en) * | 2009-02-09 | 2010-08-11 | 纬创资通股份有限公司 | Method and system for converting and transmitting multimedia video and audio |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103546677B (en) * | 2012-07-17 | 2017-03-01 | 广达电脑股份有限公司 | Interaction system and interaction method |
| CN103546677A (en) * | 2012-07-17 | 2014-01-29 | 广达电脑股份有限公司 | Interaction system and interaction method |
| CN103179196B (en) * | 2013-03-05 | 2016-02-03 | 福建凯米网络科技有限公司 | A kind of realize singing terminal networking interaction system, method and data center |
| CN103179196A (en) * | 2013-03-05 | 2013-06-26 | 福建星网视易信息系统有限公司 | System and method for achieving sing terminal networking interaction and data center |
| CN105898396A (en) * | 2015-11-13 | 2016-08-24 | 乐视云计算有限公司 | Third party video pushing method and system |
| CN106327929A (en) * | 2016-08-23 | 2017-01-11 | 北京汉博信息技术有限公司 | Visualized data control method and system for informatization |
| CN106157718A (en) * | 2016-08-23 | 2016-11-23 | 北京汉博信息技术有限公司 | A kind of visualization data interactive method for long-distance education and system |
| CN108076044A (en) * | 2016-11-07 | 2018-05-25 | 三星电子株式会社 | Service method for stream and equipment |
| CN108234292A (en) * | 2017-12-28 | 2018-06-29 | 中国联合网络通信集团有限公司 | Communication system and communication means |
| CN109257615A (en) * | 2018-09-25 | 2019-01-22 | 视联动力信息技术股份有限公司 | A kind of method and apparatus that net cast is shown |
| CN110278402A (en) * | 2019-06-24 | 2019-09-24 | 努比亚技术有限公司 | A kind of dual-channel audio processing method, equipment and computer readable storage medium |
| CN111918101A (en) * | 2020-07-17 | 2020-11-10 | 杭州博联智能科技股份有限公司 | Distributed audio and video transmission processing method, device, equipment and medium based on WiFi communication |
| CN111918101B (en) * | 2020-07-17 | 2023-11-28 | 杭州博联智能科技股份有限公司 | Distributed audio and video transmission processing method, device, equipment and medium based on WiFi communication |
| CN114189717A (en) * | 2021-11-08 | 2022-03-15 | 陕西千山航空电子有限责任公司 | Multimedia stream data synchronous playback system and method based on data fusion |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102325181B (en) | 2014-03-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102325182B (en) | Audio-video sharing method and system | |
| CN102325181B (en) | Instant audio/video interactive communication method based on sharing service and instant audio/video interactive communication system based on sharing service | |
| CN103843301B (en) | The switching between expression during the network crossfire of decoded multi-medium data | |
| CN105144673B (en) | Reduced latency server-intervention audio-video communication | |
| US20180063556A1 (en) | Systems and methods for providing guest broadcasting on a live stream video platform | |
| CN102104762B (en) | Media recording method, equipment and system of IMS (Internet Management Specification) video conference | |
| CN102752667B (en) | Multi-stream media live broadcast interaction system and live broadcast interaction method | |
| US20070177606A1 (en) | Multimedia streaming and gaming architecture and services | |
| CN107819809B (en) | Method and device for synchronizing content | |
| US20120287231A1 (en) | Media sharing during a video call | |
| JP2016538754A (en) | Method and apparatus for content distribution | |
| EP2373051A2 (en) | Method and apparatus for providing timeshift service in digital broadcasting system and system thereof | |
| CN102811373A (en) | Method for carrying out video broadcast on Internet and mobile Internet by mobile terminal | |
| CN102065339A (en) | Method and system for playing audio and video media stream | |
| CN102131114B (en) | Method and system for providing playlist | |
| CN101242513A (en) | Dual-stream transmission method in video conference and video conference system | |
| JP5139801B2 (en) | Interactive multimedia service system and method | |
| CN101710929B (en) | Method and system for supporting mobile terminals in visualization customer service | |
| CN101299709A (en) | Flow type medium server system based on internet | |
| CN103684970A (en) | Transmission method and thin terminals for media data streams | |
| CN100414877C (en) | Realization system and method for lecture file using net broadcasted slide | |
| KR20020050903A (en) | Education, Broad Casting, Multi-User Image Conference and Chatting Service Provision Method Using Internet | |
| US20140375746A1 (en) | Platform, device and method for enabling micro video communication | |
| CN101378537B (en) | Method for shortening actuation time when playing mobile stream medium business | |
| CN101383841A (en) | Quasi-real-time stream implementing method for mobile stream media service |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20140305 Termination date: 20160909 |