New! View global litigation for patent families

CN100579080C - Method and system of information playback in immediate communication - Google Patents

Method and system of information playback in immediate communication Download PDF

Info

Publication number
CN100579080C
CN100579080C CN 200310112463 CN200310112463A CN100579080C CN 100579080 C CN100579080 C CN 100579080C CN 200310112463 CN200310112463 CN 200310112463 CN 200310112463 A CN200310112463 A CN 200310112463A CN 100579080 C CN100579080 C CN 100579080C
Authority
CN
Grant status
Grant
Patent type
Prior art keywords
communication
information
immediate
end
medium
Prior art date
Application number
CN 200310112463
Other languages
Chinese (zh)
Other versions
CN1625161A (en )
Inventor
伍海君
念 刘
波 吴
强 李
Original Assignee
腾讯科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Grant date

Links

Abstract

This invention relates to the information backing method and system in immediate communication of electric communication technology. The immediate communication tool at the send end sets the informational linkage with the immediate communication tool of the receiving end, and transmits the media information collected to the immediate communication tool of the receiving end that stores the media information, and the stored information is used by the receiving end to back it; the send end sets the record popedom of received medium information of the receiving end via immediate communication server; the immediate communication tool firstly buffers the received medium information data, via labial synchronous and interleaving processes, and writes it in the medium documents through the packaging of medium flow.

Description

一种即时通讯中信息回放的方法和系统 Instant communication information playback method and system

技术领域 FIELD

本发明涉及电通信技术,尤其涉及一种即时通讯中信息回放的方法和系统。 The present invention relates to radio communication technology, and particularly relates to an instant message communication method and system for playback.

背景技术 Background technique

网络即时通讯月艮务頂,即Instant Messenger,是一种基于互联网的通讯服务, 一般是以实现网络上即时通讯功能为主,即时通讯服务IM 在互联网上得到了广泛的应用和认可。 Instant messaging network that works to May top, ie Instant Messenger, an Internet-based communications services, and is usually implemented on a network-based instant messaging, instant messaging IM service has been widely used and recognized on the Internet. 互联网即时通信服务IM逐渐在向与网络虚拟社区结合的方向上延伸,体现了网络即时通信服务IM的发展方向,即时通信服务頂通过即时通信工具得以实现,以其速度快、功能丰富、使用稳定、小巧精干而获得广大网民的认可和喜爱。 Internet instant messaging IM service gradually extended over the network and virtual community bound direction, reflecting the development direction of networks IM instant messaging service, instant messaging service through the top instant messaging tools can be achieved, with its fast, feature-rich, stable use , small and lean and get the majority of Internet users recognized and loved. 在现有的即时通信服务中,用户可以通过这种即时通信工具进行文字信息的交互、 传送文件、发送手机短信等多种操作,但对于音/视频信息的交互、共享缺乏更完整、有效的手段,尤其是对于多种媒体共存的应用场合中, 如会议记录、讨论等需要保存交流档案的情况则无能为力。 In the existing instant messaging service, users can interact through this instant communication tool, transfer files text message, send SMS and other various operations, but for interactive audio / video information, and sharing the absence of more complete and effective situation means, especially for the coexistence of a variety of media applications, such as minutes of meetings, discussions need to save the file exchange is powerless.

发明内容 SUMMARY

本发明的目的在于提供一种即时通讯中信息回放的方法和系统,以解决现有技术中对于多种媒体共存的应用场合中缺乏有效技术手段保存交流档案的缺陷。 Object of the present invention is to provide instant communication information playback method and system to solve the drawbacks of the prior art for multi-media applications coexist in the lack of effective techniques to save the file exchange.

本发明所采用的即时通讯中信息回放的方法采用如下步骤-Av 位于发送端的即时通讯工具通过即时通讯服务器与接收端的即时通讯工具建立信息连接,并将采集到的媒体信息进行编码及压縮处理后,发送至接收端的即时通讯工具,所述的媒体信息包括文字、音频和视频数据; Method chat playback information used in the present invention, the following steps are connected to the transmit and -Av information IM is established by the instant messaging server and the receiver instant messaging tools, and the encoding compression processing and media information collected after sending to the instant messaging receiving terminal, the media information including text, audio and video data;

B、 接收端对接收到的媒体信息进行相应的解码,对媒体信息中的文字、音频和视频数据进行即时播放和显示,同时,所述的接收端的即时通讯工具首先对接收到的媒体信息数据流进行缓冲,经唇音同步及交错处理,通过媒体流封包后,将接收到的媒体信息写入媒体文件进行保存,所保存的媒体文件用于接收端对媒体信息中的文字、音频和视频数据进行回放。 B, the receiving side the received media information corresponding decoding of media information in text, audio and video data for real time playback and display, while the receiving end of the first docking IM media information received data stream buffer, and interleave processing by the lip synchronization, the packet by the media stream, the received media information is written to save the media file, media file stored on the media information for the receiving end in the text, audio and video data for playback. 所述的发送端通过即时通讯服务器设定接收端对于所接收媒体信 Setting the transmitting end by the receiving end the instant messaging server for media channels received

息的记录权限; Rights record interest rates;

所述的位于发送端的即时通讯工具通过实时传输协议RTP和实时传输控制协议RTCP与接收端的即时通讯工具完成网络传输; According to the transmit and instant messaging protocol (RTP) and Real-time Transport Control Protocol RTCP Real-time Transport through the instant messaging tool receiving end of the transmission network is completed;

所述的位于发送端的即时通讯工具将采集到的多媒体信息中的音 The instant messaging terminal is located at the transmitting multimedia information collected sound

和视频信号分离为独立的音频和视频数据,并分别进行编码压縮; And a video signal into separate video and audio data, respectively, and compression coding;

所述的位于发送端的即时通讯工具将采集到的媒体信息进行编码 IM said transmitting end is located the collected media information encoding

压縮成数据块后,将其发送至接收端,接收端的即时通讯工具对接收到 Into a compressed data block, which is transmitted to the receiving end, the receiving end the received IM

的数据块进行相应的解码,并进行即时播放和显示。 Data corresponding decoding block, and instant playback and display.

这种实现上述方法的即时通讯中信息回放的系统,包括即时通讯工 Chat information playback system which implement the above method, comprising im ENGINEERING

具、即时通讯服务器,以及网络传输系统,其特征在于:所述的即时通 With, instant messaging server, and network transmission system, wherein: said Messenger

讯工具中包括数据釆集模块、编码压縮模块、即时解码模块、数据保存 Bian communication tools include a data collection module, the encoding compression module, an instantaneous decoding module, data storage

模块和回放模块,其中:所述的数据采集模块采集包括文字、音频和视频数据的媒体信息;所述的编码压縮模块对所述的媒体信息进行编码及压縮处理;所述的即时解码模块对所述的媒体信息进行即时解码,完成即时播放和显示;所述的数据保存模块对于接收到的媒体信息数据流进行缓冲,经唇音同步及交错处理,通过媒体流封包后,将接收到的媒体信息写入媒体文件进行保存;所述的回放模块对媒体文件进行相应的解码,用于相应的播放和显示;所述的回放模块中包括交叉存取数据流分离器和回放解码模块,所述的交叉存取数据流分离器用于将媒体文件中的文字、音频和视频数据分离为独立的文字、音频和视频流数据,回放解码模块用于数据的解码及播放和显示; Module and the playback module, wherein: the data acquisition module of media information including text, audio and video data; said code compression module of the media information encoding and compression processing; decoding the instant module according to an instantaneous decoding media information, and instant playback completed display; data storage module for buffering the received media information stream, the lip sync and interleave processing, by the media stream packet received the media information is written to save the media file; the media file playback module corresponding decoding, and playing a respective display; the playback module comprises the interleaved data flow separator and playback decoding module, the interleaved data stream separator for separating the media files in text, audio and video data to separate text, audio and video stream data, and reproducing and decoding means for decoding playback and display data;

所述的即时解码模块包括文本解码器、音频解码器和视频解码器, 对接收到的文字、音频和视频信息分别进行即时解码,并进行即时播放和显示; The instant text decoder comprises a decoding module, an audio decoder and a video decoder, the received text, video and audio information respectively, an instantaneous decoding, and instant playback and display;

所述的编码压縮模块中包括文本编码器、音频编码器和视频编码器,所述的文本编码器、音频编码器和视频编码器分别对文字、音频和视频信息进行编码及压縮处理,并将信息传输至网络传输系统; The encoding module includes a text compression encoder, audio encoder and video encoder, the text encoder, audio encoder and video encoder for each word audio and video information compression and encoding process, and transmits the information to the network transmission system;

所述的回放解码模块中包括回放文本解码器、回放音频解码器和回 Decoding the playback module includes a text decoder playback, the playback audio decoder and back

放视频解码器,分别用于文字、音频和视频流数据的解码; Put the video decoder, for decoding each text, audio and video streaming data;

所述的数据采集模块中还具有分离器,该分离器将多媒体文件中的音/视频信息分离为独立的音频和视频信息数据。 The data acquisition module further includes a separator which separates the multimedia file in the audio / video information is separated into separate audio and video information data.

本发明的有益效果为:在本发明中,位于发送端的即时通讯工具通过即时通讯服务器与接收端的即时通讯工具建立信息连接,并将采集到的媒体信息发送至接收端的即时通讯工具,接收端对接收到的媒体信息进行保存,所保存的信息用于接收端对其进行回放,这样,对于多种媒体共存的应用场合中,比如会议记录、讨论等,接收端的即时通讯工具可以保存交流档案,即媒体信息,并进行回放。 Advantageous effects of the present invention is: In the present invention, the transmit and instant messaging to establish a connection via the instant messaging server and instant messaging tool receiving end, and transmits the collected media information to the instant messaging receiving terminal, the receiving side received media information is saved, the saved information for the receiving end be played back, so, for the coexistence of a variety of media applications, such as minutes of meetings, discussions, instant messaging tool receiving end exchange files can be saved, That information media, and playback. 即时通讯工具对接收到的媒体信息数据流进行缓冲,经唇音同步及交错处理,可防止对保存的媒体文件回放的时候出现唇音不同步的情况,提高本发明的实用性。 IM received media information data stream buffer, lip synchronization and staggered through the process, to prevent the situation when the lip-sync to save the media file playback appears to improve the utility of the invention. 本发明通过实时传输协议和实时传输控制协议完成网络传输和控制,保证了媒体信息实时传输的高效、连续和可靠性,总之,本发明提供了一种即时通讯中信息回放的方法和系统,使即时通讯服务适用于多种媒体共存的应用场合中需要保存交流档案的情况,扩展了即时通讯服务的应用范围。 The present invention has been completed by the network transmission and control real-time transport protocol and real time transport control protocol, to ensure real-time transmission of media information efficiently, continuous and reliable, in short, the present invention provides an instant messaging method and system information playback make instant messaging services for a variety of media applications coexist in case you need to save the file exchange, expanding the application range of instant messaging services.

附图说明 BRIEF DESCRIPTION

图1为本发明系统结构示意图; Figure 1 is a schematic system configuration of the invention;

图2为本发明中媒体信息保存、回放的构成示意图; FIG 2 of the present invention stored media information, a schematic configuration of the playback;

图3为本发明中媒体信息即时播放/显示的构成示意图; 3 of the present invention, FIG media information instant playback / display of the schematic configuration;

图4为本发明中即时通讯工具中信息接收部分的构成示意图。 FIG 4 is a schematic view of the invention, configuration information receiving section of the instant messaging tool.

具体实施方式 detailed description

下面根据附图和实施例对本发明作进一步详细说明: 根据图l、图2、图3和图4,本发明包括即时通讯工具l、即时通讯服务器2,以及网络传输系统3,即时通讯工具1中包括数据采集模块11、编码压縮模块12、即时解码模块13、数据保存模块14和回放模块15。 The following drawings and embodiments will be further detailed description of the invention: According to FIG. L, 2, 3 and 4, the present invention comprises a IM L, the instant messaging server 2, and network transmission system 3, IM 1 It includes data acquisition module 11, a compression encoding module 12, an instantaneous decoding module 13, data storage module 14 and the playback module 15.

其中:数据采集模块11采集媒体信息,如图3所示,媒体信息包括音/视频信息和发送端A与接收端B之间相应的即时通讯文字交流信息,音/视频信息的来源可以为麦克风、摄像头、摄像机或多媒体文件, 如WAV, MP3, AVI, VCD/DVD、 MPEG视频文件等,在本发明中,发送端A的即时通讯工具1将采集到的多媒体信息中的音/视频信号分离为独立的音频和视频数据,并分别进行编码压縮,如图3所示,数据采集模块ll 中具有分离器111,该分离器111将多媒体文件中的音/视频信息分离为独立的音频和视频信息数据。 Wherein: the data acquisition module collecting media information 11, as shown in FIG. 3, the media sources of information comprising data corresponding chat text communication between audio / video information transmitting terminal A and the terminal B receives information, audio / video information may be a microphone , camera, video camera or multimedia files, such as WAV, MP3, AVI, VCD / DVD, MPEG video files, etc., in the present invention, the transmitting end a of the instant messaging tool 1 the collected multimedia information in audio / video signal separation independent video and audio data, are encoded and compressed, as shown in FIG ll data acquisition module 111 having a separator 3, the separator 111 of the multimedia file in the audio / video information is separated into separate audio and video information data.

如图1、图2和图3所示,编码压縮模块12中包括文本编码器121、 音频编码器122和视频编码器123,编码压縮模块12对媒体信息进行编码、压縮处理,其中,文本编码器121、音频编码器122和视频编码器 1, 2 and 3, the compression encoding module 12 includes a text encoder 121, audio encoder 122 and video encoder 123, the compression encoding module 12 for encoding the media information, compression processing, wherein , a text encoder 121, audio encoder 122 and a video encoder

123分别对文字、音频和视频信息进行编码、压縮处理,并将信息传输至网络传输系统3。 123 respectively, text, audio and video information is encoded, the compression process, and transmits the information to the network transmission system 3.

如图2、图3和图4所示,即时通讯工具1中包括即时解码模块13, 该即时解码模块13通过其中的文本解码器131、音频解码器132和视频解码器133对接收到的音频和视频信息分别进行即时解码,并进行即时播放/显示。 2, shown in an instant messaging tool shown in Figure 3 and 4 includes an audio decoding module 13 instant, which instant the decoding module 13 through which the text decoder 131, audio decoder 132 and video decoder 133 received real-time decoding and video information separately, and instant playback / display.

如图1、图2和图4所示,数据保存模块14以媒体文件的形式保存接收到的媒体信息,并向回放模块15提供用于回放的媒体文件,回放模块15对媒体文件进行相应的解码,用于相应的播放/显示,其中, 回放模块15中包括交叉存取数据流分离器151和回放解码模块152,交叉存取数据流分离器151用于将媒体文件中的文字/音频/视频数据分离为独立的文字/音频/视频流数据,回放解码模块152用于数据的解码及播放/显示,具体而言,回放解码模块152中所包括的回放文本解码器1521、回放音频解码器1522和回放视频解码器1523,分别用于文字、 音频和视频流数据的解码。 1, 2 and 4, the data storage module 14 of the media file stored in the form of the received media information, and 15 for providing a media file playback playback module, the media playback module 15 corresponding file decoding, for a respective playback / display, which includes a playback module 15, the interleaved data stream separator 151 decoding and playback module 152, the interleaved data stream separator 151 for the media file text / audio / video data separated into separate text / audio / video data stream, the playback decoding module 152 for decoding and playing data / display, specifically, a playback decoding module 152 included in the playback text decoder 1521, audio decoder playback playback of the video decoder 1522 and 1523, respectively, for decoding the text, audio and video stream data.

如图1和图2所示,发送端A的即时通讯工具1通过即时通讯服务器2与接收端B的即时通讯工具1建立信息连接,例如,建立信息连接的过程可如下: 1 and 2, terminal A transmits an IM chat server 2 through the receiving terminal B and the instant messaging information to establish a connection, e.g., information of the connection establishment procedure may be as follows:

首先,发送端A/接收端B向即时通讯服务器2申请和接收端B/发送端A建立连接,则即时通讯服务器2在发送端A和接收端B之间建立连接,可能是直接连接,也可能通过其他服务器中转,视发送端A和接收端B之间的网络传输系统3的状况而定。 First, the transmission of the A / B 2 receiving terminal to request and receive a connection end B / A to the transmitting end the instant messaging server, the instant messaging server 2 establishes a connection between the transmitting end A and the receiving end B, it may be a direct connection, may transit through other servers, depending on the network status of the transmission system 3 between a and B depending on the receiving end of the transmission side. 如果建立连接成功,发送端A播放(采集)音/视频,同时将音/视频信息通过编码压縮模块12进行编码压縮,然后通过网络传输系统3发送到接收端B,接收端B对收到的数据进行解码,然后播放音频和显示视频,这样就完成了发送端A和接收端B之间的连接。 If a successful connection is established, audio / video player A transmitting side (collection), while the audio / video information compressed by encoding module 12 encodes compressed and then transmitted through the transmission system 3 to the network receiving terminal B, the receiving terminal B to yield to decode the data, and displaying video and playing audio, thus completing the connection between the sending end and a receiving end a B.

在发送端A和接收端B的即时通讯过程中,发送端A可通过即时通 At the transmitting end and the receiving end B A chat process, the sender A via Instant Messenger

讯服务器2设定接收端B对于所接收媒体信息的记录权限,权限可为可i己录或不可i己i。 Information server 2 receiving end B is set to the recording medium information received permission, permission may be recorded or not i i-hexyl i-hexyl.

然后,接收端B向即时通讯服务器2申请记录该会话过程中发送端A的信息,即时通讯服务器2检验接收端B的可记录权限,如果权限为可记录,则接收端B的申请成功;如果权限为不可记录,则可通过即时通讯服务器2向发送端A转发接收端B的记录请求,由发送端A决定通过或拒绝接收端B的申请。 Then, the receiving terminal B to an instant messaging server application for recording information A that session transmitting end, the instant messaging server verify the receiving terminal B may record Priv2 if the rights to be recorded, the application terminal B of the successful reception; if non-permission of the recording, the recording request may be forwarded to the receiving terminal B, terminal a transmits through the instant messaging server 2 is determined by the transmitting end a or end B receives refusal. 如果申请成功,则接收端B通过了记录文字 If successful, the receiver B via the recording text

/音频/视频会话过程的申请。 / Audio applications / video session process.

这时,如图l、图2和图4所示,发送端A将采集到的媒体信息发送至接收端B的即时通讯工具1,接收端B开始记录文字/音频/视频会话过程,即对接收到的媒体信息进行保存,所保存的信息可用于接收端B对其进行回放。 In this case, as shown in L, as shown in FIG. 2 and FIG. 4, the transmitting end A to the collected media information transmitted to the receiving terminal B IM 1, the receiver B starts recording the text / audio / video session, i.e., for the received information storage media, information stored for the receiving terminal B can be played back.

记录过程具体如下: The recording process is as follows:

接收端B即时通讯工具1中的数据保存模块14以媒体文件的形式保存接收到的媒体信息,数据保存模块14首先对接收到的媒体信息数据流进行缓冲,经唇音同步及交错处理,这样可防止对保存的媒体文件回放的时候出现唇音不同步的情况,再通过媒体流封包后,将其写入媒体文件,数据处理参数如下: Receiving terminal B in the instant messaging module 14 is a data storage media files stored in the form of the received media information, the data storage module 14 buffers the received first media information stream, the lip synchronization and interleaving process, which can prevented lip are not synchronized playback of media files saved time, and through the media stream packet, writes the media file, data processing parameters are as follows:

视频流的格式:128x96, 176x144, 352x288或其他尺寸,帧率:1~25 帧/秒。 Format video stream: 128x96, 176x144, 352x288, or other size, frame rate: 25 1 / sec.

音频流格式:样本容量8bits,单声道,采样频率16kHz,或可其他标准音频格式。 Audio stream formats: the sample size 8bits, mono, sampling frequency of 16kHz, or other standard audio format.

文字流格式:每秒最多5条,每条不超过256个字符。 Text stream format: up to 5 per second, each no more than 256 characters. 媒体流的封包格式如下:第lbyte为媒体的编码类型(编码器类型),第2〜3bytes:为数据的有效长度,第4byte开始便为有效数据。 The media stream packet format is as follows: Type of lbyte encoding (encoder type) medium, a first 2~3bytes: effective length of data, the first data valid 4byte outset. 当接收端B对所保存的媒体信息回放时,如图1、图2和图4所示: When the receiving end B of the stored media information playback, as shown in FIG. 1, 2 and 4:

1、 回放模块15打开数据保存模块14提供的媒体文件,读取文件数据,送至交叉存取数据流分离器151,将交互存储在文件里的文字/音频/视频数据分离为独立的文字/音频/视频流数据。 1, the media playback module 15 opens the file data storage module 14 is provided, read the file data, the interleaved data stream sent to separator 151, is stored in a text file interaction / audio / video data separated into separate text / The audio / video stream data.

2、 文字/音频/视频流数据分别送到对应的回放文本解码器1521、回放音频解码器1522和回放视频解码器1523中。 2, the text / audio / video stream corresponding to the playback data are sent to a text decoder 1521, audio decoder 1522, and playback of playback of the video decoder 1523.

3、 从回放音频解码器1522解码处理后的音频数据送到声卡进行播放,从回放视频解码器1523解码处理后的视频数据送到显示卡在显示屏上进行显示,从回放文本解码器1521解码以后的文字流直接在显示屏上显示。 3, audio data to the playback of the audio decoder 1522 decodes to play sound from the process, from the card to the video data playback of the video decoder 1523 decoding process on a display screen, the decoder decodes the playback text 1521 after the text flow is displayed directly on the screen.

这样,接收端B就实现了对所保存的信息进行回放。 Thus, the receiving end B is realized for the information stored in the playback. 在本发明中,如图l、图2、图3和图4所示,接收端B中的即时解码模块13可即时接收发送端A所发送的媒体信息,即时解码模块13 通过其中的文本解码器131、音频解码器132和视频解码器133对接收到的文字、音频和视频信息分别进行即时解码,并进行即时播放/显示。 In the present invention, L in FIG, 2, 3 and 4, the receiving terminal B is Instantaneous Decoding module 13 may receive real-time media information transmitting terminal A is transmitted, an instantaneous decoder module 13 which decodes the text by 131, word audio decoder 132 and video decoder 133 received, audio and video information, respectively an instantaneous decoding, and instant playback / display. 在本发明的网络传输中,发送端A将数据采集模块11采集到的音/ 视频信息通过编码压縮模块12进行编码、压縮成数据块,如,对每一帧采集到的音/视频数据编码压縮为一个单独的数据块,然后,通过网络传输系统3将其发送至接收端B即时通讯工具1中的即时解码模块13,即时解码模块13对接收到的音/视频数据块进行相应的解码解压縮处理,并进行相应的即时播放/显示,在网络传输时,发送端A的即时通讯工具1通过实时传输协议RTP,即real-time transport protocol 和实时传输控制协议RTCP,即Real-time Transport Control Protocol 与接收端B的即时通讯工具1进行数据交互、传输、控制,完成网络传输,在实时传输协议RTP中,在RTP数据包头填充帧的信息,如视频尺寸,压縮质量,序列码等信息,这些信息用于接收端B进行数据解码, 实时传输控制协议RTCP根据网络带宽控制音/ In the present invention, the network transmission, the transmitting end A data acquisition module 11 to capture audio / video compression encoded by an encoding module 12, the compressed data into blocks, e.g., each frame acquisition to the audio / video data compression coding of a single block of data, then transmitted through the network system B transmits to the receiving end of an instant messaging tool for real time decoding module 133, decoding module 13 for real time sound received / block of video data corresponding decoding decompression process, and the corresponding instant playback / display, the network transmission, the sender IM tool a 1 through real-time transport protocol RTP, i.e., real-time transport protocol and real time transport control protocol the RTCP, i.e. real -time transport control protocol and the receiving terminal B of the instant messaging tool 1 for data exchange, transmission, control, network transmission is completed, the real-time transport protocol (RTP), the RTP data packet header padding frames, such as video size, compression quality, serial number and other information, which information is used to decode the data receiving terminal B, real-time transport control protocol RTCP bandwidth according to the control sound / 频的流量,实时传输控制协议RTCP和实时传输协议RTP —起提供流量控制和拥塞控制服务, 在RTP会话期间,各参与者周期性地传送RTCP包,RTCP包中含有已发送的数据包的数量、丢失的数据包的数量等统计资料,因此,发送端A 利用这些信息动态地改变传输速率或传输质量,实时传输协议RTP和实时传输控制协议RTCP配合使用,能实现有效的反馈和最小的开销使传输效率最佳化,从而防止传送音/视频流的同时因为网络带宽的因素而影响到即时通讯服务的质量,也不会因基于保证即时通讯服务质量而浪费很多带宽,从而影响到接收端B即时通讯工具1的音/视频回放质量。 Frequency flow, and Real-time Transport Control Protocol RTCP Real-time Transport Protocol RTP - starting provide flow control and congestion control services, during a RTP session, each participant periodically transmitted RTCP packet, RTCP packet comprising the number of packets that have been sent , the lost quantity of packets statistics, therefore, the transmitting end a use this information to dynamically change transmission rate or transmission quality, real-time transport protocol (RTP) and real-time transport control protocol RTCP used in conjunction, can achieve effective feedback and minimal overhead the transmission efficiency can be optimized in order to prevent the transmission audio / video streams at the same time as network bandwidth and factors affecting the quality of instant messaging services, it will not guarantee instant messaging based on quality service and waste a lot of bandwidth, which affects the receiving end B IM 1 tone / video playback quality. 在上述的实施例中,详述了一个接收端B实现对发送端A所发送的媒体信息的保存、回放及即时播放/显示,实际上,发送端A可同时对多个接收端发送媒体信息,其他的接收端对于媒体信息的处理过程与上述接收端B的处理过程相同,此处不再赘述,总之,发送端A可同时对多个接收端发送媒体信息,所述的多个接收端可通过以上所述实现对发送端A所发送的媒体信息的保存、回放及即时播放/显示。 In the above embodiment, a detailed description of the receiving end B implements stored media information transmitting terminal A is transmitted, and playback and instant playback / display, in fact, the sender A can simultaneously transmit a plurality of media information to a receiving end , the other end for receiving the media information processing process of the receiving terminal B of the same, is not repeated here, in short, the transmitting party a may be simultaneously transmitted to a plurality of media information receiving end, said plurality of receiving terminal may be achieved by preservation of the above said media information transmitting terminal a is transmitted, and playback and instant playback / display.

Claims (10)

1.一种即时通讯中信息回放的方法,其特征在于:它采用如下步骤: A、位于发送端的即时通讯工具通过即时通讯服务器与接收端的即时通讯工具建立信息连接,并将采集到的媒体信息进行编码及压缩处理后,发送至接收端的即时通讯工具,所述的媒体信息包括文字、音频和视频数据; B、接收端对接收到的媒体信息进行相应的解码,对媒体信息中的文字、音频和视频数据进行即时播放和显示,同时,所述的接收端的即时通讯工具首先对接收到的媒体信息数据流进行缓冲,经唇音同步及交错处理,通过媒体流封包后,将接收到的媒体信息写入媒体文件进行保存,所保存的媒体文件用于接收端对媒体信息中的文字、音频和视频数据进行回放。 1. A method of instant playback of information communication, characterized in that: it uses the following steps: A, located at the end of the instant messaging tool setup information transmitted via the instant messaging server and instant messaging receiving terminal, and store the collected information media after encoding and compression processing, sent to the instant messaging receiving terminal, the media information including text, audio and video data; B, the receiving side the received media information corresponding decoding text media information, audio and video data for real time playback and display, while the receiving end of the first instant messaging received media information stream is buffered, the lip sync and interleave processing, by the media stream packet received media save the file information is written to the media, the media files stored on the media information for the receiving end in the text, audio and video data for playback.
2. 根据权利要求1所述的即时通讯中信息回放的方法,其特征在于: 所述的发送端通过即时通讯服务器设定接收端对于所接收媒体信息的记录权限。 2. The method of claim 1 chat information playback claim, wherein: said receiving end of the transmission destination information recording medium for permission received by the instant messaging server.
3. 根据权利要求1所述的即时通讯中信息回放的方法,其特征在于: 所述的位于发送端的即时通讯工具通过实时传输协议(RTP)和实时传输控制协议(RTCP)与接收端的即时通讯工具完成网络传输。 3. The method of claim 1 chat information playback claim, wherein: real-time instant messaging transport protocol (RTP) and Real-time Transport Control Protocol (RTCP) and the receiving end of the tool is transmitted to the instant messaging terminal tools complete network transmission.
4. 根据权利要求1所述的即时通讯中信息回放的方法,其特征在于-所述的位于发送端的即时通讯工具将采集到的多媒体信息中的音频和视频信号分离为独立的音频和视频数据,并分别进行编码压縮。 4. The method of claim 1 chat information playback claim, characterized in that - the separation of the transmit and IM multimedia information will be collected in separate audio and video signals to the video and audio data and compression coding separately.
5. 根据权利要求1或2或3或4所述的即时通讯中信息回放的方法,其特征在于:所述的位于发送端的即时通讯工具将采集到的媒体信息进行编码压縮成数据块后,将其发送至接收端,接收端的即时通讯工具对接收到的数据块进行相应的解码,并进行即时播放和显示。 5. The method of chat or 4 or 23 or according to a playback information claim, wherein: the transmitting end is located in the collected instant messaging media information is encoded into a compressed data block , which was transmitted to the receiving end, the receiving end of a data block received instant messaging tool to properly decode, and instant playback and display.
6. —种实现权利要求1所述方法的即时通讯中信息回放的系统,包括即时通讯工具(1)、即时通讯服务器(2),以及网络传输系统(3), 其特征在于:所述的即时通讯工具(1)中包括数据采集模块(11)、编码压縮模块(12)、即时解码模块(13)、数据保存模块(14)和回放模块(15),其中:所述的数据采集模块(11)采集包括文字、音频和视频数据的媒体信息;所述的编码压缩模块(12)对所述的媒体信息进行编码及压缩处理;所述的即时解码模块(13)对所述的媒体信息进行即时解码, 完成即时播放/显示;所述的数据保存模块(14)对于接收到的媒体信息数据流进行缓冲,经唇音同步及交错处理,通过媒体流封包后,将接收到的媒体信息写入媒体文件进行保存;所述的回放模块(15)对媒体文件进行相应的解码,用于相应的播放/显示;所述的回放模块(15)中包括 6. - The kind of instant communication method of claim 1 in the information playback system, including instant messaging (1), the instant messaging server (2), a transmission system and a network (3), characterized in that: said IM (1) comprises a data acquisition module (11), coding compression module (12), an instantaneous decoding module (13), data storage modules (14) and the playback module (15), wherein: said data acquisition module (11) comprises a media information acquired text, audio and video data; encoding said compression module (12) of the media information encoding and compression processing; instant the decoding module (13) of the an instantaneous decoding media information, complete instant playback / display; said data storage module (14) for buffering the received media information stream, the lip sync and interleave processing, by the media stream packet received media save the file information is written to the media; the playback module (15) for decoding the corresponding media file for a respective playback / display; including the playback module (15) 交叉存取数据流分离器(151)和回放解码模块(152),所述的交叉存取数据流分离器(151)用于将媒体文件中的文字、音频和视频数据分离为独立的文字、音频和视频流数据,回放解码模块(152)用于数据的解码及播放和显示。 The interleaved data stream separator (151) and playback decoding module (152), said interleaved data stream separator (151) for the text media files, separate audio and video data as independent words, audio and video data stream, the playback decoding module (152) for decoding and playback and display of data.
7. 根据权利要求6所述的即时通讯中信息回放的系统,其特征在于: 所述的即时解码模块(13 )包括文本解码器(131 )、音频解码器(132 ) 和视频解码器(133),对接收到的文字、音频和视频信息分别进行即时解码,并进行即时播放和显示。 The im claim 6 information playback system according to claim, wherein: said instantaneous decoding module (13) comprising a text decoder (131), an audio decoder (132) and a video decoder (133 ), received text, audio and video information are instantly decoded, and instant playback and display.
8. 根据权利要求6所述的即时通讯中信息回放的系统,其特征在于:所述的编码压縮模块(12)中包括文本编码器(121)、音频编码器(122)和视频编码器(123),所述的文本编码器(121)、音频编码器(122)和视频编码器(123)分别对文字、音频和视频信息进行编码及压縮处理,并将信息传输至网络传输系统(3)。 According to claim 6 in chat information playback system as claimed in claim, wherein: said code compression module (12) includes a text encoder (121), an audio encoder (122) and a video encoder (123), the text encoder (121), an audio encoder (122) and a video encoder (123) respectively to the text, audio and video encoding and compression process, and transmits the information to the network transmission system (3).
9. 根据权利要求6所述的即时通讯中信息回放的系统,其特征在于: 所述的回放解码模块(152)中包括回放文本解码器(1521)、回放音频解码器(1522)和回放视频解码器(1523),分别用于文字、音频和视频流数据的解码。 Chat information playback system according to claim 6, wherein: said playback module includes a playback decoding text decoder (1521), playback of the audio decoder (1522) and play back video (152) the decoder (1523), respectively, for decoding the text, audio and video stream data.
10. 根据权利要求6所述的即时通讯中信息回放的系统,其特征在于: 所述的数据采集模块(11)中还具有分离器(111),该分离器(111) 将多媒体文件中的音和视频信息分离为独立的音频和视频信息数据。 10. im claim 6 in information playback system according to claim, wherein: the data acquisition module (11) further having said separator (111), said separator (111) of the multimedia file voice and video information is separated into separate audio and video information data.
CN 200310112463 2003-12-02 2003-12-02 Method and system of information playback in immediate communication CN100579080C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200310112463 CN100579080C (en) 2003-12-02 2003-12-02 Method and system of information playback in immediate communication

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200310112463 CN100579080C (en) 2003-12-02 2003-12-02 Method and system of information playback in immediate communication

Publications (2)

Publication Number Publication Date
CN1625161A true CN1625161A (en) 2005-06-08
CN100579080C true CN100579080C (en) 2010-01-06

Family

ID=34759768

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200310112463 CN100579080C (en) 2003-12-02 2003-12-02 Method and system of information playback in immediate communication

Country Status (1)

Country Link
CN (1) CN100579080C (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100456683C (en) 2006-04-10 2009-01-28 腾讯科技(深圳)有限公司 Method and system for pushing the history records to the specified members in the discussion group
CN100518114C (en) * 2006-05-29 2009-07-22 腾讯科技(深圳)有限公司 Point-to-point data transmission method and system
CN101217506B (en) 2007-12-27 2011-02-02 腾讯科技(深圳)有限公司 Message processing method, system and client
CN102404304A (en) * 2010-09-16 2012-04-04 腾讯科技(深圳)有限公司 Multimedia data flow dissemination method, device, system and server
CN102694743A (en) * 2011-09-01 2012-09-26 新奥特(北京)视频技术有限公司 Method and system for transmitting multimedia file in instant messaging system
WO2014205724A1 (en) * 2013-06-27 2014-12-31 华为技术有限公司 Automatic retransmission processing method, transmitting end device and receiving end device

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1449620A (en) 2000-07-25 2003-10-15 美国在线服务公司 Video messaging

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1449620A (en) 2000-07-25 2003-10-15 美国在线服务公司 Video messaging

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
局域网会议电视系统通信平台的设计和实现. 邹晓红.大连海事大学硕士学位论文. 2003
远程MPEG4视频传输与回放设计. 徐小玲.浙江教育学院学报,第3期. 2003

Also Published As

Publication number Publication date Type
CN1625161A (en) 2005-06-08 application

Similar Documents

Publication Publication Date Title
US20060195884A1 (en) Interactive multichannel data distribution system
US20030162495A1 (en) Communication terminal, server, relay apparatus, broadcast communication system, broadcast communication method, and program
US7532231B2 (en) Video conference recorder
US20050018615A1 (en) Media transmitting method, media receiving method, media transmitter and media receiver
US20060092938A1 (en) System for broadcasting multimedia content
US20060140591A1 (en) Systems and methods for load balancing audio/video streams
US6580756B1 (en) Data transmission method, data transmission system, data receiving method, and data receiving apparatus
US20080177865A1 (en) System and method for providing real-time streaming service between terminals
US20060188096A1 (en) Systems and methods for remotely controlling computer applications
US6944136B2 (en) Two-way audio/video conferencing system
US20040170159A1 (en) Digital audio and/or video streaming system
CN101511010A (en) Method and device for sending medium stream
JP2002344880A (en) Contents distribution system
Kumar Mobile TV: DVB-H, DMB, 3G systems and rich media applications
CN101184195A (en) Audio/video living broadcast system and method
JP2002330381A (en) Data reproduction method, data receiving terminal and data receiving method
CN101271720A (en) Synchronization process for mobile phone stream media audio and video
WO2005069296A1 (en) Storage medium storing multimedia data, and method and apparatus for reproducing multimedia data
JP2007214985A (en) Media stream switching method, system and program in seamless handover
CN1960498A (en) Method for realizing multiple audio tracks in mobile multimedia broadcast system
CN1949876A (en) Method and system for supporting media data of multi-coding formats
CN1633068A (en) A method of media stream transmission in point-to-point communication
CN102510541A (en) Multi-screen interaction video and audio content switching method and media player
CN1859565A (en) Method for broadcastin stream media caption and its stream media player
CN1655609A (en) Method and system for recording videoconference data

Legal Events

Date Code Title Description
C06 Publication
C10 Request of examination as to substance
C14 Granted