CN102833241A - Streaming media service traffic record merged-processing method and device - Google Patents

Streaming media service traffic record merged-processing method and device Download PDF

Info

Publication number
CN102833241A
CN102833241A CN2012102959038A CN201210295903A CN102833241A CN 102833241 A CN102833241 A CN 102833241A CN 2012102959038 A CN2012102959038 A CN 2012102959038A CN 201210295903 A CN201210295903 A CN 201210295903A CN 102833241 A CN102833241 A CN 102833241A
Authority
CN
China
Prior art keywords
record
traffic
flow
records
same
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2012102959038A
Other languages
Chinese (zh)
Other versions
CN102833241B (en
Inventor
李娜
廖慧
王蓉
王志军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China United Network Communications Group Co Ltd
Original Assignee
China United Network Communications Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China United Network Communications Group Co Ltd filed Critical China United Network Communications Group Co Ltd
Priority to CN201210295903.8A priority Critical patent/CN102833241B/en
Publication of CN102833241A publication Critical patent/CN102833241A/en
Application granted granted Critical
Publication of CN102833241B publication Critical patent/CN102833241B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Transfer Between Computers (AREA)

Abstract

The invention provides a streaming media service traffic record merged-processing method and device. The streaming media service traffic record merged-processing method comprises the following steps of: judging media transmission protocol types of first traffic records in an original traffic record file; and carrying out merged processing on the first traffic records with same media transmission protocol type according to a judged judgment result. According to the technical scheme of the invention, the storage space is reduced and storage resources are saved.

Description

流媒体业务流量记录合并处理方法及装置Method and device for merging and processing streaming media service flow records

技术领域 technical field

本发明涉及通信技术,尤其涉及一种流媒体业务流量记录合并处理方法及装置。The invention relates to communication technology, in particular to a method and device for combining and processing stream media service flow records.

背景技术 Background technique

流媒体(Streaming Media)是指数据在网络上按时间先后次序传输和播放的连续音/视频数据流。与传统的播放方式不同,以流媒体方式播放节目时并不需要客户端下载整个节目文件,而是边接收边播放,并且只需将部分节目数据缓存,这样就节省了下载等待时间和存储空间。目前常用的流媒体业务类型为基于超文本传输协议(Hyper Text Transfer Protocol,HTTP)的流媒体业务以及基于点对点(Peer-to-Peer,P2P)协议的流媒体业务。HTTP通过请求-应答模式即客户端向服务器发送HTTP请求,服务器响应客户端所发送的HTTP请求以及将服务器存储的资源发送至客户端,在互联网上进行数据传输;P2P协议通过客户端向服务器发送资源请求,服务器响应客户端向服务器所发送的资源请求以及将可用的节点信息反馈给客户端,客户端从服务器上获取到可用的节点信息以及连接可用的节点以获取所请求资源。Streaming Media (Streaming Media) refers to the continuous audio/video data stream in which data is transmitted and played in chronological order on the network. Different from the traditional playback method, the client does not need to download the entire program file when playing the program in the streaming media mode, but plays it while receiving it, and only needs to cache part of the program data, which saves download waiting time and storage space . Currently commonly used streaming media services are streaming media services based on Hyper Text Transfer Protocol (Hyper Text Transfer Protocol, HTTP) and streaming media services based on Peer-to-Peer (P2P) protocol. HTTP uses the request-response mode, that is, the client sends an HTTP request to the server, and the server responds to the HTTP request sent by the client and sends the resources stored in the server to the client for data transmission on the Internet; the P2P protocol sends data to the server through the client. Resource request, the server responds to the resource request sent by the client to the server and feeds back the available node information to the client, the client obtains the available node information from the server and connects to the available node to obtain the requested resource.

现有技术中流媒体业务流量记录的生成过程为:通过流量采集设备获取客户端的流媒体业务流量报文,以及对所获取的客户端的流媒体业务流量报文中IP包的内容进行解析以生成客户端的流媒体业务流量记录。对于目前的流媒体业务,每次客户端向服务器发起的连接均会生成相应的一条流媒体业务流量记录。以P2P协议和HTTP为例对上述过程进行解释;对于HTTP来说,虽然客户端所发起的访问请求是某一个具体的视频资源,但是由于流媒体业务对视频资源的获取采取了缓存机制,将某一个视频资源分成若干个视频片段,这样客户端的一次视频资源请求往往对应着若干个视频片段,对应于每个视频片段至少生成一条流量记录,从而对于客户端的一次视频资源请求往往生成多条流量记录;对于P2P协议来说,若客户端的某一个所请求的视频资源对应着多个不同地址,客户端所请求的视频资源会从多个不同地址下载所请求的视频资源,每一个地址都会相应的生成一条流量记录,从而对于客户端的一次视频资源请求往往生成多条流量记录。The generation process of streaming media service flow records in the prior art is: obtain the streaming media service flow message of the client through the flow collection device, and analyze the content of the IP packet in the obtained streaming media service flow message of the client to generate the client End streaming media traffic records. For the current streaming media service, each time the client initiates a connection to the server, a corresponding streaming media service flow record will be generated. Take the P2P protocol and HTTP as examples to explain the above process; for HTTP, although the access request initiated by the client is a specific video resource, because the streaming media service adopts a caching mechanism for video resource acquisition, it will A certain video resource is divided into several video clips, so that a video resource request from the client often corresponds to several video clips, and at least one traffic record is generated corresponding to each video clip, so a video resource request from the client often generates multiple traffic Record; for the P2P protocol, if a video resource requested by the client corresponds to multiple different addresses, the video resource requested by the client will download the requested video resource from multiple different addresses, and each address will be corresponding One flow record is generated, so a video resource request from the client often generates multiple flow records.

现有技术的缺陷在于:对于客户端所发起的资源请求,会生成多条流量记录,为了方便客户端的查询,所生成的所有流量记录均会被存储起来,存储空间较大,浪费了存储资源。The defect of the existing technology is that: For the resource request initiated by the client, multiple traffic records will be generated. In order to facilitate the query of the client, all the generated traffic records will be stored. The storage space is large, which wastes storage resources. .

发明内容 Contents of the invention

本发明提供一种流媒体业务流量记录合并处理方法及装置,用于减小存储空间,节约存储资源。The present invention provides a streaming media service flow record merging method and device for reducing storage space and saving storage resources.

本发明的第一个方面是提供一种流媒体业务流量记录合并处理方法,包括:The first aspect of the present invention is to provide a method for merging streaming media service flow records, including:

判断原始流量记录文件中的第一流量记录的媒体传输协议类型;Determine the media transfer protocol type of the first traffic record in the original traffic record file;

根据所述判断的判断结果,对所述媒体传输协议类型相同的所述第一流量记录进行合并处理。According to the judging result of the judging, merge processing is performed on the first traffic records of the same media transfer protocol type.

本发明的另一个方面是提供一种流媒体业务流量记录合并处理装置,包括:Another aspect of the present invention is to provide a streaming media service flow record merging processing device, including:

判断模块,用于判断原始流量记录文件中的第一流量记录的媒体传输协议类型;A judging module, configured to judge the media transfer protocol type of the first traffic record in the original traffic record file;

合并处理模块,用于根据所述判断模块的判断结果,对所述媒体传输协议类型相同的所述第一流量记录进行合并处理。The merging processing module is configured to perform merging processing on the first traffic records of the same media transfer protocol type according to the judgment result of the judging module.

本发明提供的流媒体业务流量记录合并处理方法及装置,通过判断原始流量记录文件中的第一流量记录的媒体传输协议类型;根据所述判断的判断结果,对所述媒体传输协议类型相同的所述第一流量记录进行合并处理;用以合并媒体传输协议类型相同的原始流量记录文件中的流量记录。The streaming media service flow record merging processing method and device provided by the present invention judge the media transmission protocol type of the first flow record in the original flow record file; The first flow records are merged to merge the flow records in the original flow record files of the same media transfer protocol type.

本发明的技术效果是:减小存储空间,节约存储资源。The technical effects of the invention are: reducing storage space and saving storage resources.

附图说明 Description of drawings

图1为本发明一实施例提供的流媒体业务流量记录合并处理方法的流程图;Fig. 1 is a flowchart of a streaming media service flow record merging processing method provided by an embodiment of the present invention;

图2为本发明另一实施例提供的流媒体业务流量记录合并处理方法的流程图;FIG. 2 is a flow chart of a method for merging streaming media service flow records provided by another embodiment of the present invention;

图3为本发明另一实施例提供的流媒体业务流量记录合并处理方法的流程图;FIG. 3 is a flow chart of a method for merging streaming media service flow records according to another embodiment of the present invention;

图4为现有技术的原始流量记录文件生成装置的结构示意图;FIG. 4 is a schematic structural diagram of an original flow record file generation device in the prior art;

图5为本发明一实施例提供的流媒体业务流量记录合并处理装置的结构示意图。Fig. 5 is a schematic structural diagram of an apparatus for merging and processing streaming media service flow records according to an embodiment of the present invention.

具体实施方式 Detailed ways

图1为本发明一实施例提供的流媒体业务流量记录合并处理方法的流程图。如图1所示,本实施例的方法包括:Fig. 1 is a flowchart of a method for merging streaming media service flow records provided by an embodiment of the present invention. As shown in Figure 1, the method of the present embodiment includes:

步骤101、判断原始流量记录文件中的第一流量记录的媒体传输协议类型。Step 101. Determine the media transfer protocol type of the first traffic record in the original traffic record file.

具体地,根据所述第一流量记录包含的特征字段,判断所述第一流量记录的媒体传输协议类型。通过分析原始流量记录文件中的第一流量记录的与媒体传输协议类型相对应的特征字段,能够判断第一流量记录的媒体传输协议类型为HTTP或者为P2P协议。Specifically, the media transfer protocol type of the first traffic record is determined according to the feature field included in the first traffic record. By analyzing the feature field corresponding to the media transfer protocol type of the first traffic record in the original traffic record file, it can be determined that the media transfer protocol type of the first traffic record is HTTP or P2P protocol.

步骤102、根据所述判断的判断结果,对所述媒体传输协议类型相同的所述第一流量记录进行合并处理。Step 102: Merge the first traffic records of the same media transfer protocol type according to the judgment result of the judgment.

根据判断结果,对媒体传输协议类型相同的第一流量记录采用不同的合并处理方法进行合并处理,以生成新的流量记录;本实施例中以基于HTTP的流媒体业务和基于P2P协议的流媒体业务进行说明,但不仅仅局限于以上两种协议的流媒体业务。According to the judgment result, the first flow records with the same media transmission protocol type are combined using different merging processing methods to generate new flow records; in this embodiment, the streaming media services based on HTTP and the streaming media based on P2P The business is described, but not limited to the streaming media business of the above two protocols.

本实施例中,通过判断原始流量记录文件中的第一流量记录的媒体传输协议类型;根据判断的判断结果,对媒体传输协议类型相同的第一流量记录进行合并处理;用以合并媒体传输协议类型相同的原始流量记录文件中的流量记录,减小存储空间,节约存储资源。In this embodiment, by judging the media transfer protocol type of the first traffic record in the original traffic record file; according to the judgment result, the first traffic records with the same media transfer protocol type are merged; to merge the media transfer protocol The traffic records in the original traffic record files of the same type reduce storage space and save storage resources.

图2为本发明另一实施例提供的流媒体业务流量记录合并处理方法的流程图。如图2所示,本实施例的方法包括:Fig. 2 is a flowchart of a method for merging streaming media service flow records provided by another embodiment of the present invention. As shown in Figure 2, the method of this embodiment includes:

步骤201:生成原始流量记录文件。Step 201: Generate an original flow record file.

具体地,①按照流量采集顺序和预先设置的流量采集周期以获取GTP、IP数据报文;②对所获取的GTP、IP数据报文中的GTP及IP数据包进行识别,完成信令解析和协议解析,以使得获取原始流量记录文件中的流量记录所包含的与传输媒体协议类型相关的特征字段、与HTTP的内容类型相关的特征字段、流上网开始时间相关的特征字段等;③生成原始流量记录文件;不同用户的不同的记录根据流量采集顺序按照采集周期和单个文件大小存储在相应的原始流量记录文件中,其中采集周期和采集相对应的单个文件的大小是根据不同的需求进行设置的。Specifically, ① obtain GTP and IP data packets according to the flow collection sequence and the preset flow collection period; ② identify the GTP and IP data packets in the obtained GTP and IP data packets, and complete signaling analysis and Protocol analysis, so as to obtain the characteristic fields related to the transmission media protocol type, the characteristic field related to the HTTP content type, the characteristic field related to the start time of streaming Internet, etc. contained in the traffic record in the original traffic record file; ③ generate the original Flow record files; different records of different users are stored in the corresponding original flow record files according to the order of flow collection according to the collection cycle and the size of a single file, where the collection cycle and the size of a single file corresponding to the collection are set according to different needs of.

其中,GTP(GPRS Tunnelling Protocol,GPRS隧道协议)是一组基于IP的,用于在GSM(Global System for Mobile communications,全球移动通信系统)和UMTS(Universal Mobile Telecommunications System,通用移动通信系统)网络中支持通用分组无线服务(GPRS)的通讯协议。对于HTTP,统一资源定位符(URL,Uniform Resource Locator)是进行合并处理的一个指标,URL用于完整地描述Internet上网页和其他资源的地址。Among them, GTP (GPRS Tunneling Protocol, GPRS Tunneling Protocol) is a set of IP-based, used in GSM (Global System for Mobile communications, Global System for Mobile Communications) and UMTS (Universal Mobile Telecommunications System, Universal Mobile Communications System) network Supports the communication protocol of General Packet Radio Service (GPRS). For HTTP, Uniform Resource Locator (URL, Uniform Resource Locator) is an indicator for merge processing, and URL is used to completely describe the addresses of web pages and other resources on the Internet.

表1示出了现有技术的原始流量记录生成装置所生成的流量记录,如下所示,所有的流量记录均存储于原始流量记录文件中。Table 1 shows the flow records generated by the original flow record generation device in the prior art, as shown below, all the flow records are stored in the original flow record file.

Figure BSA00000765618800041
Figure BSA00000765618800041

Figure BSA00000765618800051
Figure BSA00000765618800051

表1Table 1

步骤202:判断原始流量记录文件中的第一流量记录的媒体传输协议类型。Step 202: Determine the MTP type of the first traffic record in the original traffic record file.

具体地,根据所述第一流量记录包含的特征字段,判断所述第一流量记录的媒体传输协议类型。Specifically, the media transfer protocol type of the first traffic record is determined according to the feature field included in the first traffic record.

例如,若与媒体传输协议类型相对应的特征字段为HTTP,则判断原始流量记录文件中的第一流量记录的媒体传输协议类型为HTTP。For example, if the feature field corresponding to the media transfer protocol type is HTTP, it is determined that the media transfer protocol type of the first traffic record in the original traffic record file is HTTP.

再例如,若与媒体传输协议类型相对应的特征字段为P2P协议,则判断原始流量记录文件中的第一流量记录的媒体传输协议类型为P2P协议。For another example, if the feature field corresponding to the media transmission protocol type is the P2P protocol, then it is determined that the media transmission protocol type of the first traffic record in the original traffic record file is the P2P protocol.

步骤203:根据所述判断的判断结果,对所述媒体传输协议类型相同的所述第一流量记录进行合并处理。本实施例中以基于超文本传输协议的流媒体业务和基于P2P协议的流媒体业务进行说明,但不仅仅局限于以上两种协议的流媒体业务。Step 203: According to the determination result of the determination, merge the first traffic records of the same media transmission protocol type. In this embodiment, the streaming media service based on the hypertext transfer protocol and the streaming media service based on the P2P protocol are used for illustration, but it is not limited to the streaming media service of the above two protocols.

其中,步骤203的一种可选实施方式包括:Wherein, an optional implementation manner of step 203 includes:

步骤2031、若所述判断结果为HTTP,则将上网账户相同,且时间段连续,且URL中的主域地址相同,且HTTP的内容类型相同的所述第一流量记录进行合并处理,以生成第二流量记录;所述第二流量记录与所述第一流量记录具有相同的上网账户,相同的URL中的主域地址,相同的HTTP的内容类型,所述第二流量记录的开始时间为所述第一流量记录中最早的开始时间,所述第二流量记录的结束时间为所述第一流量记录中最晚的结束时间;Step 2031: If the judgment result is HTTP, merge the first traffic records with the same online account, continuous time periods, the same primary domain address in the URL, and the same HTTP content type to generate The second flow record; the second flow record has the same online account as the first flow record, the same main domain address in the URL, and the same HTTP content type, and the start time of the second flow record is The earliest start time in the first flow record, and the end time of the second flow record is the latest end time in the first flow record;

需要说明的是:上网账户可以为电话号码,或者是终端的用户账户。It should be noted that: the online account may be a phone number, or a user account of a terminal.

连续的时间段是指①当前起始流量记录的结束时间与下一条流量记录的起始时间是连续的,则两条流量记录是处于同一连续的时间段;或者②若两条流量记录的时间有重叠的部分,则两条流量记录也是处于同一连续的时间段,以两条流量记录的最早的时间为连续时间段的起始时间,以两条流量记录的最晚的时间为连续时间段的结束时间;或者③若根据概率统计和实际使用的情况,可以设定两条流量记录连续的时间间隔范围,即在此时间间隔范围内,两条流量记录的时间段,可以看做是连续的时间段。Continuous time period refers to ① the end time of the current initial flow record and the start time of the next flow record are continuous, then the two flow records are in the same continuous time period; or ② if the time of the two flow records If there is overlap, the two flow records are also in the same continuous time period. The earliest time of the two flow records is the starting time of the continuous time period, and the latest time of the two flow records is the continuous time period. or ③according to probability statistics and actual usage, you can set the continuous time interval range of two flow records, that is, within this time interval range, the time period of two flow records can be regarded as continuous time period.

URL中的主域地址是代表主域的访问地址的统一资源定位符部分。HTTP的内容类型具体可以包括:video/MP2T、application/zip、application/rar、audio/mp3、audio/mp4、audio/midi、video/3gp、video/flv、video/mp4、viedo/mpeg等。The main domain address in the URL is the Uniform Resource Locator part of the access address representing the main domain. The content type of HTTP may specifically include: video/MP2T, application/zip, application/rar, audio/mp3, audio/mp4, audio/midi, video/3gp, video/flv, video/mp4, viedo/mpeg, etc.

具体地,若判断原始流量记录文件中的第一流量记录的媒体传输协议类型为HTTP,则将第一流量记录从原始流量记录文件中提取出来,并且保存到暂存流量文件中;再将上网账户相同,且时间段连续,且URL中的主域地址相同,且HTTP的内容类型相同的第一流量记录进行合并处理,对流量信息进行累加,以生成第二流量记录,将第二流量记录保存到暂存流量文件中,以及将保存在暂存流量文件中的第一流量记录删除;在原始流量记录文件中继续查询是否有媒体传输协议类型为HTTP的流量记录,直至遍历完所有的原始流量记录文件中的流量记录。Specifically, if it is judged that the media transfer protocol type of the first flow record in the original flow record file is HTTP, then the first flow record is extracted from the original flow record file and stored in the temporary storage flow file; The first traffic records with the same account, continuous time periods, the same primary domain address in the URL, and the same HTTP content type are merged, and the traffic information is accumulated to generate a second traffic record, and the second traffic record Save to the temporary traffic file, and delete the first traffic record stored in the temporary traffic file; continue to check whether there is a traffic record with the media transfer protocol type as HTTP in the original traffic record file until all the original traffic records have been traversed Traffic records in the traffic record file.

依照上述方法,逐条检测对原始流量文件中的所有其余流量记录进行合并,当原始流量文件中的所有其余流量记录全部检测完成后,对所有暂存文件中的所有第二流量记录按照开始的时间顺序逐条插入到原始流量记录文件中,以及将存储于暂存流量文件中的所有第二流量记录删除;原始流量记录文件中的其余流量记录——媒体传输协议类型不是HTTP的流量记录仍然保存在原始流量记录文件中;这样用以合并媒体传输协议类型相同的原始流量记录文件中的流量记录,减小存储空间,节约存储资源。According to the above method, all the remaining traffic records in the original traffic file are detected one by one, and after all the remaining traffic records in the original traffic file are detected, all the second traffic records in all temporary files are checked according to the starting time Sequentially insert into the original flow record file one by one, and delete all the second flow records stored in the temporary flow file; the remaining flow records in the original flow record file—the flow records whose media transfer protocol type is not HTTP are still stored in In the original traffic record file; this is used to merge the traffic records in the original traffic record file of the same media transmission protocol type, reducing storage space and saving storage resources.

步骤2032、若所述判断结果为P2P协议,则将上网账户相同,且时间段连续的所述第一流量记录进行合并处理,以生成第三流量记录;所述第三流量记录与所述第一流量记录具有相同的上网账户,所述第三流量记录的开始时间为所述第一流量记录中最早的开始时间,所述第三流量记录的结束时间为所述第一流量记录中最晚的结束时间。Step 2032: If the judgment result is a P2P protocol, merge the first traffic records with the same online account and continuous time periods to generate a third traffic record; the third traffic record is the same as the first traffic record. A flow record has the same online account, the start time of the third flow record is the earliest start time in the first flow record, and the end time of the third flow record is the latest in the first flow record end time of .

需要说明的是:上网账户可以为电话号码,或者是终端的用户账户。It should be noted that: the online account may be a phone number, or a user account of a terminal.

连续的时间段是指①当前起始流量记录的结束时间与下一条流量记录的起始时间是连续的,则两条流量记录是处于同一连续的时间段;或者②若两条流量记录的时间有重叠的部分,则两条流量记录也是处于同一连续的时间段,以两条流量记录的最早的时间为连续时间段的起始时间,以两条流量记录的最晚的时间为连续时间段的结束时间;或者③若根据概率统计和实际使用的情况,可以设定两条流量记录连续的时间间隔范围,即在此时间间隔范围内,两条流量记录的时间段,可以看做是连续的时间段。Continuous time period refers to ① the end time of the current initial flow record and the start time of the next flow record are continuous, then the two flow records are in the same continuous time period; or ② if the time of the two flow records If there is overlap, the two flow records are also in the same continuous time period. The earliest time of the two flow records is the starting time of the continuous time period, and the latest time of the two flow records is the continuous time period. or ③according to probability statistics and actual usage, you can set the continuous time interval range of two flow records, that is, within this time interval range, the time period of two flow records can be regarded as continuous time period.

P2P协议相对应的内容类型具体可以包括:PPS网络电视以及迅雷看看等。The content types corresponding to the P2P protocol may specifically include: PPS Internet TV and Xunleikankan.

具体地,若判断原始流量记录文件中的第一流量记录的媒体传输协议类型为P2P协议,则将第一流量记录从原始流量记录文件中提取出来,并且保存到暂存流量文件中;再将上网账户相同,且时间段连续的第一流量记录进行合并处理,对流量信息进行累加,以生成第三流量记录,将第三流量记录保存到暂存流量文件中,以及将保存在暂存流量文件中的第一流量记录删除;在原始流量记录文件中继续查询是否有媒体传输协议类型为P2P协议的流量记录,直至遍历完所有的原始流量记录文件中的流量记录。Specifically, if it is judged that the media transmission protocol type of the first flow record in the original flow record file is a P2P protocol, then the first flow record is extracted from the original flow record file and stored in the temporary storage flow file; Merge the first flow records with the same online account and consecutive time periods, accumulate the flow information to generate the third flow record, save the third flow record to the temporary storage flow file, and save the third flow record in the temporary storage flow file. The first flow record in the file is deleted; in the original flow record file, continue to inquire whether there is a flow record with the media transfer protocol type as the P2P protocol, until all the flow records in the original flow record file have been traversed.

依照上述方法,逐条检测对原始流量文件中的所有其余流量记录进行合并,当原始流量文件中的所有其余流量记录全部检测完成后,对所有暂存文件中的所有第三流量记录按照开始的时间顺序逐条插入到原始流量记录文件中,以及将存储于暂存流量文件中的所有第三流量记录删除;原始流量记录文件中的其余流量记录——媒体传输协议类型不是P2P协议的流量记录仍然保存在原始流量记录文件中;这样用以合并媒体传输协议类型相同的原始流量记录文件中的流量记录,减小存储空间,节约存储资源。According to the above method, all the remaining flow records in the original flow file are detected one by one, and when all the remaining flow records in the original flow file are detected, all the third flow records in all temporary files are checked according to the start time. Sequentially insert into the original flow record file one by one, and delete all the third flow records stored in the temporary storage flow file; the rest of the flow records in the original flow record file—the flow records whose media transfer protocol type is not the P2P protocol are still saved In the original traffic record file; in this way, the traffic records in the original traffic record file of the same type of media transmission protocol are merged to reduce storage space and save storage resources.

在此说明:虽然本实施例中分别对HTTP或者是P2P协议的媒体传输协议的原始流量记录文件中的流量记录分别采用不同的方法进行合并,但在实际中,可能同时存在两种协议类型,或者是更多的媒体传输协议,可以同时处理不同的媒体传输协议类型,分别获得针对不同的媒体传输协议类型合并处理后的流量记录。例如:对原始流量记录文件中的100条流量记录进行判断以及合并处理,其中,分别有HTTP、P2P协议的流量记录,最终获得符合条件的HTTP的流量记录为5条,P2P协议的流量记录为3条。It is explained here that although in this embodiment, the flow records in the original flow record files of HTTP or the media transfer protocol of the P2P protocol are respectively combined in different ways, in practice, there may be two types of protocols at the same time. Or for more media transmission protocols, different media transmission protocol types can be processed at the same time, and traffic records merged and processed for different media transmission protocol types can be respectively obtained. For example: Judging and merging 100 traffic records in the original traffic record file. Among them, there are traffic records of HTTP and P2P protocols respectively, and the traffic records of HTTP and P2P protocols that meet the conditions are finally obtained as 5. 3 articles.

本实施例中,通过判断原始流量记录文件中的第一流量记录的媒体传输协议类型;根据判断的判断结果,对媒体传输协议类型相同的第一流量记录进行合并处理;用以合并媒体传输协议类型相同的原始流量记录文件中的流量记录,减小存储空间,节约存储资源。In this embodiment, by judging the media transfer protocol type of the first traffic record in the original traffic record file; according to the judgment result, the first traffic records with the same media transfer protocol type are merged; to merge the media transfer protocol The traffic records in the original traffic record files of the same type reduce storage space and save storage resources.

为了便于更加清晰的说明本发明技术方案,以下实施例将结合基于HTTP的流媒体流量记录合并方法为例对本发明技术方案做详细说明。In order to illustrate the technical solution of the present invention more clearly, the following embodiments will describe the technical solution of the present invention in detail by taking the HTTP-based stream media flow record merging method as an example.

图3为本发明另一实施例提供的流媒体业务流量记录合并处理方法的流程图。如图3所示,本实施例的方法包括:Fig. 3 is a flow chart of a method for merging streaming media service flow records according to another embodiment of the present invention. As shown in Figure 3, the method of this embodiment includes:

步骤301:生成原始流量记录文件。Step 301: Generate an original flow record file.

通过现有技术能够生成原始流量记录文件,在这里不再赘述。所有原始的流量记录均保存在原始流量记录文件中。The original flow record file can be generated through existing technologies, and will not be repeated here. All original flow records are saved in the original flow record file.

表2为本实施例中所生成的原始流量记录文件。Table 2 shows the original flow record files generated in this embodiment.

Figure BSA00000765618800081
Figure BSA00000765618800081

Figure BSA00000765618800091
Figure BSA00000765618800091

Figure BSA00000765618800101
Figure BSA00000765618800101

表2Table 2

从表2中可以获知:对不同用户(MSISDN1和MSISDN2)的不同流量记录通过处理器的处理分别生成流量记录,上述流量记录存储于原始流量记录文件。其中,访问的类型可以包括HTTP、邮件;访问地址为完整的访问地址的统一资源定位符,协议的内容类型为预先设置的协议内容类型之一:video/MP2T。It can be known from Table 2 that different traffic records of different users (MSISDN1 and MSISDN2) are processed by the processor to generate traffic records respectively, and the above traffic records are stored in the original traffic record file. Wherein, the type of access may include HTTP and email; the access address is the uniform resource locator of the complete access address, and the content type of the protocol is one of the preset protocol content types: video/MP2T.

步骤302:生成合并后的第一条流量记录。Step 302: Generate the first merged flow record.

若检测到原始流量记录中的第一条流量记录的媒体传输协议类型为HTTP,且协议的内容类型为HTTP内容类型之一时,对第一条流量记录进行合并,生成合并后的第一条流量记录。If it is detected that the media transfer protocol type of the first traffic record in the original traffic record is HTTP, and the content type of the protocol is one of the HTTP content types, the first traffic record is merged to generate the first merged traffic Record.

其中,HTTP相对应的内容类型具体可以包括:video/MP2T、application/zip、application/rar、audio/mp3、audio/mp4、audio/midi、video/3gp、video/flv、video/mp4、viedo/mpeg等。Among them, the content types corresponding to HTTP can specifically include: video/MP2T, application/zip, application/rar, audio/mp3, audio/mp4, audio/midi, video/3gp, video/flv, video/mp4, viedo/ mpeg etc.

同时,将完整的URL修改为URL中的主域地址即URL地址中表1中“?”前的内容,以及将所生成的新的流量记录暂存于暂存流量记录文件中,同时,将原始流量记录文件中的此条流量记录删除。At the same time, modify the complete URL to the main domain address in the URL, that is, the content before "?" in Table 1 in the URL address, and temporarily store the generated new traffic records in the temporary traffic record file. This flow record in the original flow record file is deleted.

表3为本实施例中所生成的合并后的第一条流量记录。Table 3 shows the first merged flow record generated in this embodiment.

Figure BSA00000765618800111
Figure BSA00000765618800111

表3table 3

从表3中可以获知所生成的合并后的第一条流量记录的信息。From Table 3, we can know the information of the generated first traffic record after merging.

步骤303:对媒体传输协议类型为HTTP的第一流量记录进行合并处理。Step 303: Perform merging processing on the first traffic records whose media transfer protocol type is HTTP.

检测表2中原始流量文件中的其余流量记录,对媒体传输协议类型为HTTP的第一流量记录进行合并处理。Detect the rest of the traffic records in the original traffic file in Table 2, and merge the first traffic records whose media transfer protocol type is HTTP.

表4为本实施例中对媒体传输协议类型为HTTP的第一流量记录进行合并处理,存储在暂存流量记录文件中合并后新的流量记录。Table 4 shows the combined processing of the first traffic records whose media transfer protocol type is HTTP in this embodiment, and the merged new traffic records stored in the temporary traffic record file.

Figure BSA00000765618800121
Figure BSA00000765618800121

表4Table 4

将第一流量记录从原始流量记录文件中提取出来,并且保存到暂存流量文件中;再将上网账户相同,且时间段连续,且URL中的主域地址相同,且HTTP的内容类型相同的第一流量记录进行合并处理,对流量信息进行累加,以生成第二流量记录,将第二流量记录保存到暂存流量文件中,以及将保存在暂存流量文件中的第一流量记录删除;在原始流量记录文件中继续查询是否有媒体传输协议类型为HTTP的流量记录,直至遍历完所有的原始流量记录文件中的流量记录。Extract the first flow record from the original flow record file, and save it in the temporary flow file; then set the same online account, and the time period is continuous, and the main domain address in the URL is the same, and the HTTP content type is the same The first flow record is merged, and the flow information is accumulated to generate a second flow record, the second flow record is saved in the temporary flow file, and the first flow record stored in the temporary flow file is deleted; Continue to check whether there is a traffic record whose media transfer protocol type is HTTP in the original traffic record file until all the traffic records in the original traffic record file are traversed.

在此说明:连续的时间段是指①当前起始流量记录的结束时间与下一条流量记录的起始时间是连续的,则两条流量记录是处于同一连续的时间段;或者②若两条流量记录的时间有重叠的部分,则两条流量记录也是处于同一连续的时间段,以两条流量记录的最早的时间为连续时问段的起始时间,以两条流量记录的最晚的时间为连续时间段的结束时间;或者③若根据概率统计和实际使用的情况,可以设定两条流量记录连续的时间间隔范围,即在此时间间隔范围内,两条流量记录的时间段,可以看做是连续的时间段。Note here: continuous time period refers to ① the end time of the current initial flow record and the start time of the next flow record are continuous, then the two flow records are in the same continuous time period; or ② if two If the times of the flow records overlap, the two flow records are also in the same continuous time period. The earliest time of the two flow records is the starting time of the continuous time period, and the latest time of the two flow records is the starting time of the continuous time period. Time is the end time of the continuous time period; or ③ according to the probability statistics and actual use, you can set the continuous time interval range of two flow records, that is, within this time interval range, the time period of the two flow records, It can be regarded as a continuous period of time.

表5为本实施例中对媒体传输协议类型为HTTP的第一流量记录进行合并处理,将合并后新的流量记录插入到原始流量记录文件中的流量记录。Table 5 shows that in this embodiment, the first traffic record whose media transfer protocol type is HTTP is merged, and the merged new traffic record is inserted into the original traffic record file.

Figure BSA00000765618800131
Figure BSA00000765618800131

表5table 5

依照上述方法,逐条检测对原始流量文件中的所有其余流量记录进行合并,当原始流量文件中的所有其余流量记录全部检测完成后,对所有暂存流量文件中的所有经过合并处理后的流量记录按照开始的时间顺序逐条插入到原始流量记录文件中,以及将存储于暂存流量文件中的所有过合并处理后的记录删除;原始流量记录文件中的其余流量记录--媒体传输协议类型不是HTTP的流量记录仍然保存在原始流量记录文件中;这样合并了客户端的多条流量记录,减小存储空间,节约存储资源。According to the above method, all the remaining flow records in the original flow file are detected one by one, and after all the remaining flow records in the original flow file are detected, all the merged flow records in all temporary flow files Insert into the original traffic record file one by one according to the starting time sequence, and delete all merged records stored in the temporary traffic file; the rest of the traffic records in the original traffic record file -- the media transfer protocol type is not HTTP The traffic records of the client are still stored in the original traffic record file; in this way, multiple traffic records of the client are merged to reduce storage space and save storage resources.

本实施例中,通过表2中原始流量记录文件中的流量记录进行合并,将原始流量记录文件中的多条流量记录合并成一条流量记录,减小存储空间,节约存储资源。In this embodiment, by merging the flow records in the original flow record file in Table 2, multiple flow records in the original flow record file are merged into one flow record, which reduces storage space and saves storage resources.

图4为现有技术的原始流量记录文件生成装置的结构示意图;如图4所示,现有技术的原始流量记录文件生成装置包括采集模块41、解析模块42和原始流量记录文件生成模块43;Fig. 4 is a schematic structural diagram of an original flow record file generation device in the prior art; as shown in Fig. 4 , the original flow record file generation device in the prior art includes an acquisition module 41, an analysis module 42 and an original flow record file generation module 43;

采集模块41,用于按照流量采集顺序和预先设置的流量采集周期以获取GTP、IP数据报文;The collection module 41 is used to obtain GTP and IP data packets according to the flow collection sequence and the preset flow collection cycle;

解析模块42,用于对所获取的GTP、IP数据报文中的GTP及IP数据包进行识别,完成信令解析和协议解析,以使得获取原始流量记录文件中的流量记录所包含的与传输媒体协议类型相关的特征字段、与HTTP的内容类型相关的特征字段、流上网开始时间相关的特征字段等;The parsing module 42 is used to identify the GTP and IP packets in the acquired GTP and IP datagrams, and complete signaling parsing and protocol parsing, so as to obtain the information contained in the traffic records in the original traffic record files and the transmission Characteristic fields related to media protocol type, characteristic fields related to HTTP content type, characteristic fields related to streaming start time, etc.;

原始流量记录文件生成模块43,用于生成原始流量记录文件;不同用户的不同的记录根据流量采集顺序按照采集周期和单个文件大小存储在相应的原始流量记录文件中,其中采集周期和采集相对应的单个文件的大小是根据不同的需求进行设置的。The original flow record file generation module 43 is used to generate the original flow record file; different records of different users are stored in the corresponding original flow record file according to the flow collection sequence according to the collection period and the single file size, wherein the collection period corresponds to the collection The size of a single file is set according to different requirements.

图5为本发明一实施例提供的流媒体业务流量记录合并处理装置的结构示意图;如图5所示,本实施例的装置包括判断模块51和合并处理模块52。其中,FIG. 5 is a schematic structural diagram of an apparatus for merging and processing streaming media service flow records provided by an embodiment of the present invention; as shown in FIG. in,

判断模块51,用于判断原始流量记录文件中的第一流量记录的媒体传输协议类型;A judging module 51, configured to judge the media transfer protocol type of the first traffic record in the original traffic record file;

现有技术的原始流量记录文件生成装置中的原始流量记录文件生成模块43与本实施例中的装置的判断模块51通过接口相连,可以是分开的装置;也可以把在现有技术的原始流量记录文件生成装置的基础上安装上本实施例的判断模块51以及合并处理模块52。判断模块51具体用于:The original flow record file generation module 43 in the original flow record file generation device of the prior art is connected to the judging module 51 of the device in this embodiment through an interface, which can be a separate device; The judging module 51 and the merging processing module 52 of this embodiment are installed on the basis of the recording file generating device. Judgment module 51 is specifically used for:

根据所述第一流量记录包含的特征字段,判断所述第一流量记录的媒体传输协议类型。According to the feature field included in the first traffic record, determine the media transfer protocol type of the first traffic record.

合并处理模块52,用于根据所述判断模块41的判断结果,对所述媒体传输协议类型相同的所述第一流量记录进行合并处理。The merging processing module 52 is configured to perform merging processing on the first traffic records of the same media transfer protocol type according to the judgment result of the judging module 41 .

进一步地,合并处理模块52具体用于:Further, the merging processing module 52 is specifically used for:

若所述判断结果为HTTP,则将上网账户相同,且时间段连续,且URL中的主域地址相同,且HTTP的内容类型相同的所述第一流量记录进行合并处理,以生成第二流量记录;所述第二流量记录与所述第一流量记录具有相同的上网账户,相同的URL中的主域地址,相同的HTTP的内容类型,所述第二流量记录的开始时间为所述第一流量记录中最早的开始时间,所述第二流量记录的结束时间为所述第一流量记录中最晚的结束时间。将上网账户相同,且时间段连续,且URL中的主域地址相同,且HTTP的内容类型相同的第一流量记录中的HTTP的流量记录进行合并处理,生成HTTP的新的流量记录,以及将所生成的HTTP的新的流量记录暂存于暂存流量记录文件中;当第一流量记录文件中的协议类型为HTTP的所有流量记录全部逐条合并处理完成,则将暂存于暂存流量记录文件中的所生成的HTTP的第二流量记录按照开始的时间顺序逐条插入到原始流量记录文件中,获得原始流量记录的更新后的流量记录,以及将存储于暂存流量文件中的所生成的HTTP的第二流量记录删除;原始流量记录文件中的其余流量记录——媒体传输协议类型不是HTTP的流量记录仍然保存在原始流量记录文件中。If the judgment result is HTTP, the first traffic records with the same online account, continuous time periods, the same main domain address in the URL, and the same HTTP content type are merged to generate the second traffic record; the second flow record has the same online account as the first flow record, the same main domain address in the URL, and the same HTTP content type, and the start time of the second flow record is the first The earliest start time in a flow record, and the end time of the second flow record is the latest end time in the first flow record. Combine the HTTP traffic records in the first traffic records with the same online account, continuous time periods, the same main domain address in the URL, and the same HTTP content type to generate a new HTTP traffic record, and The generated new HTTP flow records are temporarily stored in the temporary flow record file; when all flow records whose protocol type is HTTP in the first flow record file are all merged and processed one by one, they will be temporarily stored in the temporary flow record The generated second traffic records of HTTP in the file are inserted into the original traffic record file one by one according to the order of start time, and the updated traffic records of the original traffic records are obtained, as well as the generated traffic records stored in the temporary storage file. The second traffic record of HTTP is deleted; the remaining traffic records in the original traffic record file—the traffic records whose media transfer protocol type is not HTTP are still stored in the original traffic record file.

若所述判断结果为P2P协议,则将上网账户相同,且时间段连续的所述第一流量记录进行合并处理,以生成第三流量记录;所述第三流量记录与所述第一流量记录具有相同的上网账户,所述第三流量记录的开始时间为所述第一流量记录中最早的开始时间,所述第三流量记录的结束时间为所述第一流量记录中最晚的结束时间。将上网账户相同,且时间段连续的第一流量记录中的P2P协议的流量记录进行合并处理,生成P2P协议的新的流量记录,以及将所生成的P2P协议的新的流量记录暂存于暂存流量记录文件中;当第一流量记录文件中的协议类型为P2P协议的所有流量记录全部逐条合并处理完成,则将暂存于暂存流量记录文件中的所生成的P2P协议的第三流量记录按照开始的时间顺序逐条插入到原始流量记录文件中,获得原始流量记录的更新后的流量记录,以及将存储于暂存流量文件中的所生成的P2P协议的第三流量记录删除;原始流量记录文件中的其余流量记录——媒体传输协议类型不是P2P协议的流量记录仍然保存在原始流量记录文件中。If the judgment result is a P2P protocol, the first traffic records with the same online account and continuous time periods are merged to generate a third traffic record; the third traffic record is the same as the first traffic record have the same online account, the start time of the third flow record is the earliest start time in the first flow record, and the end time of the third flow record is the latest end time in the first flow record . Combine the flow records of the P2P protocol in the first flow records with the same online account and continuous time periods, generate new flow records of the P2P protocol, and temporarily store the generated new flow records of the P2P protocol in the temporary stored in the traffic record file; when all the traffic records whose protocol type in the first traffic record file is P2P protocol are merged and processed one by one, the generated third traffic of the P2P protocol temporarily stored in the temporarily stored traffic record file The records are inserted into the original flow record file one by one according to the order of start time, the updated flow record of the original flow record is obtained, and the third flow record of the generated P2P protocol stored in the temporary storage flow file is deleted; the original flow The rest of the traffic records in the record file—the traffic records whose media transmission protocol type is not the P2P protocol are still saved in the original traffic record file.

在此说明:虽然本实施例中分别对HTTP或者是P2P协议的媒体传输协议的原始流量记录文件中的流量记录分别采用不同的合并处理模块进行合并,但在实际中,可能同时存在两种协议类型,或者是更多的媒体传输协议,可以同时处理不同的媒体传输协议类型,分别获得针对不同的媒体传输协议类型合并处理后的流量记录。例如:对原始流量记录文件中的100条流量记录进行判断以及合并处理,其中,分别有HTTP、P2P协议的流量记录,最终获得符合条件的HTTP的流量记录为5条,P2P协议的流量记录为3条。Note here: Although in this embodiment the flow records in the original flow record files of HTTP or P2P protocol media transfer protocols are respectively merged using different merging processing modules, in practice, there may be two kinds of protocols at the same time Types, or more media transmission protocols, can process different media transmission protocol types at the same time, and respectively obtain traffic records merged and processed for different media transmission protocol types. For example: Judging and merging 100 traffic records in the original traffic record file. Among them, there are traffic records of HTTP and P2P protocols respectively, and the traffic records of HTTP and P2P protocols that meet the conditions are finally obtained as 5. 3 articles.

本实施例的装置还可以包括流量记录存储模块,用于存储原始流量记录的更新后的流量记录;将原始流量记录文件中的第一流量记录中具有相同的协议类型的流量记录进行合并处理所获得的第二流量记录或第三流量记录去分别替换第一流量记录中相对应的合并处理前的流量记录,以获得原始流量记录的更新后的流量记录。本实施例的流媒体业务流量记录合并处理装置,通过判断模块判断原始流量记录文件中的第一流量记录的媒体传输协议类型;合并处理模块根据所述判断模块的判断结果,对所述媒体传输协议类型相同的所述第一流量记录进行合并处理;由于本实施例的装置中的判断模块可以判断原始流量记录文件中的流量记录的媒体传输协议类型,以及对具有相同媒体传输协议类型的流量记录进行合并处理,减小存储空间,节约存储资源。The device in this embodiment may further include a flow record storage module, configured to store an updated flow record of the original flow record; merge the flow records having the same protocol type in the first flow record in the original flow record file The obtained second flow record or the third flow record respectively replaces the corresponding flow record in the first flow record before merging, so as to obtain an updated flow record of the original flow record. The streaming media service flow record merging processing device of this embodiment judges the media transmission protocol type of the first flow record in the original flow record file through the judging module; The first traffic records with the same protocol type are merged; since the judging module in the device of this embodiment can judge the media transfer protocol type of the traffic record in the original traffic record file, and the traffic with the same media transfer protocol type Records are merged to reduce storage space and save storage resources.

本领域普通技术人员可以理解:实现上述各方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成。前述的程序可以存储于一计算机可读取存储介质中。该程序在执行时,执行包括上述各方法实施例的步骤;而前述的存储介质包括:ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。Those of ordinary skill in the art can understand that all or part of the steps for implementing the above method embodiments can be completed by program instructions and related hardware. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps including the above-mentioned method embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other various media that can store program codes.

最后应说明的是:以上各实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述各实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。......Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than limiting them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the various embodiments of the present invention. scope. …

本领域普通技术人员可以理解:实现上述各方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成。前述的程序可以存储于一计算机可读取存储介质中。该程序在执行时,执行包括上述各方法实施例的步骤;而前述的存储介质包括:ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。Those of ordinary skill in the art can understand that all or part of the steps for implementing the above method embodiments can be completed by program instructions and related hardware. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps including the above-mentioned method embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other various media that can store program codes.

最后应说明的是:以上各实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述各实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than limiting them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the various embodiments of the present invention. scope.

Claims (6)

1. A stream media service flow record merging processing method is characterized by comprising the following steps:
judging the type of a media transmission protocol of a first flow record in an original flow record file;
and merging the first flow records with the same media transmission protocol type according to the judged result.
2. The method according to claim 1, wherein said merging the first traffic records of the same media transport protocol type according to the judgment result of the judgment comprises:
if the judgment result is a hypertext transfer protocol (HTTP), merging the first traffic records with the same internet access account, continuous time period, the same main domain address in a Uniform Resource Locator (URL) and the same content type of the HTTP protocol to generate a second traffic record; the second traffic record and the first traffic record have the same internet access account, the same home domain address in the URL, and the same content type of HTTP, the start time of the second traffic record is the earliest start time in the first traffic record, and the end time of the second traffic record is the latest end time in the first traffic record;
if the judgment result is a point-to-point P2P protocol, merging the first flow records with the same internet surfing account and continuous time period to generate a third flow record; the third flow record and the first flow record have the same internet access account, the start time of the third flow record is the earliest start time in the first flow record, and the end time of the third flow record is the latest end time in the first flow record.
3. The method according to claim 1 or 2, wherein the determining the media transport protocol type of the first traffic record in the original traffic record file comprises:
and judging the type of the media transmission protocol of the first flow record according to the characteristic field contained in the first flow record.
4. A device for merging and processing stream media service traffic records, comprising:
the judging module is used for judging the media transmission protocol type of the first flow record in the original flow record file;
and the merging processing module is used for merging the first traffic records with the same media transmission protocol type according to the judgment result of the judgment module.
5. The apparatus of claim 4, wherein the merge processing module is specifically configured to:
if the judgment result is a hypertext transfer protocol (HTTP), merging the first traffic records with the same internet access account, continuous time period, the same main domain address in a Uniform Resource Locator (URL) and the same content type of the HTTP to generate a second traffic record; the second traffic record and the first traffic record have the same internet access account, the same home domain address in the URL, and the same content type of HTTP, the start time of the second traffic record is the earliest start time in the first traffic record, and the end time of the second traffic record is the latest end time in the first traffic record;
if the judgment result is a point-to-point P2P protocol, merging the first flow records with the same internet surfing account and continuous time period to generate a third flow record; the third flow record and the first flow record have the same internet access account, the start time of the third flow record is the earliest start time in the first flow record, and the end time of the third flow record is the latest end time in the first flow record.
6. The apparatus according to claim 4 or 5, wherein the determining module is specifically configured to: and judging the type of the media transmission protocol of the first flow record according to the characteristic field contained in the first flow record.
CN201210295903.8A 2012-08-20 2012-08-20 Streaming media service traffic record merged-processing method and device Active CN102833241B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210295903.8A CN102833241B (en) 2012-08-20 2012-08-20 Streaming media service traffic record merged-processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210295903.8A CN102833241B (en) 2012-08-20 2012-08-20 Streaming media service traffic record merged-processing method and device

Publications (2)

Publication Number Publication Date
CN102833241A true CN102833241A (en) 2012-12-19
CN102833241B CN102833241B (en) 2015-05-20

Family

ID=47336212

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210295903.8A Active CN102833241B (en) 2012-08-20 2012-08-20 Streaming media service traffic record merged-processing method and device

Country Status (1)

Country Link
CN (1) CN102833241B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103763320A (en) * 2014-01-21 2014-04-30 中国联合网络通信集团有限公司 Method and system for merging flow records
CN105718485A (en) * 2014-12-04 2016-06-29 中国移动通信集团公司 Method and device for inputting data into database
CN107103543A (en) * 2016-02-23 2017-08-29 平安科技(深圳)有限公司 Protocol data processing method and system
CN107295405A (en) * 2017-07-14 2017-10-24 深圳市海云天科技股份有限公司 The compression method and system of a kind of video tour record
CN110991880A (en) * 2019-12-03 2020-04-10 任杉元 Household power auditing system and method based on big data

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060116113A1 (en) * 2004-11-30 2006-06-01 Alcatel Hybrid call log
CN1975725A (en) * 2006-12-12 2007-06-06 华为技术有限公司 Method and system for managing journal
CN101582903A (en) * 2009-06-24 2009-11-18 杭州华三通信技术有限公司 Storing method of streaming media resource and device
CN101739455A (en) * 2009-12-24 2010-06-16 北京世纪互联宽带数据中心有限公司 Analysis method of streaming media information on demand and method thereof
CN101902365A (en) * 2009-05-26 2010-12-01 北京启明星辰信息技术股份有限公司 Method for monitoring P2P traffic of wide area network and system thereof
CN102510568A (en) * 2011-11-22 2012-06-20 联通宽带业务应用国家工程实验室有限公司 Internet access data processing system and method for mobile terminal

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060116113A1 (en) * 2004-11-30 2006-06-01 Alcatel Hybrid call log
CN1975725A (en) * 2006-12-12 2007-06-06 华为技术有限公司 Method and system for managing journal
CN101902365A (en) * 2009-05-26 2010-12-01 北京启明星辰信息技术股份有限公司 Method for monitoring P2P traffic of wide area network and system thereof
CN101582903A (en) * 2009-06-24 2009-11-18 杭州华三通信技术有限公司 Storing method of streaming media resource and device
CN101739455A (en) * 2009-12-24 2010-06-16 北京世纪互联宽带数据中心有限公司 Analysis method of streaming media information on demand and method thereof
CN102510568A (en) * 2011-11-22 2012-06-20 联通宽带业务应用国家工程实验室有限公司 Internet access data processing system and method for mobile terminal

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
李明等: "基于Hash聚合的网络流量管理研究", 《江西示范大学学报(自然科学版)》, vol. 35, no. 2, 31 March 2011 (2011-03-31), pages 175 - 2 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103763320A (en) * 2014-01-21 2014-04-30 中国联合网络通信集团有限公司 Method and system for merging flow records
CN103763320B (en) * 2014-01-21 2017-01-25 中国联合网络通信集团有限公司 Method and system for merging flow records
CN105718485A (en) * 2014-12-04 2016-06-29 中国移动通信集团公司 Method and device for inputting data into database
CN105718485B (en) * 2014-12-04 2019-08-27 中国移动通信集团公司 A method and device for entering data into a database
CN107103543A (en) * 2016-02-23 2017-08-29 平安科技(深圳)有限公司 Protocol data processing method and system
CN107103543B (en) * 2016-02-23 2021-03-30 平安科技(深圳)有限公司 Protocol data processing method and system
CN107295405A (en) * 2017-07-14 2017-10-24 深圳市海云天科技股份有限公司 The compression method and system of a kind of video tour record
CN110991880A (en) * 2019-12-03 2020-04-10 任杉元 Household power auditing system and method based on big data

Also Published As

Publication number Publication date
CN102833241B (en) 2015-05-20

Similar Documents

Publication Publication Date Title
EP2383941B1 (en) Client terminal, method and system for downloading streaming media
CN102843351B (en) A kind of processing method of streaming media service, streaming media server and system
US8635360B2 (en) Media playback point seeking using data range requests
JP5588517B2 (en) Streaming with optional broadcast delivery of data segments
CN101715004B (en) Internet video-oriented distributed acquisition method and system
US20130290465A1 (en) System and method for proxy media caching
CN108712343A (en) Distribution method, system, fringe node and the central dispatching system of streaming media resource
CN102833241B (en) Streaming media service traffic record merged-processing method and device
CN102006368B (en) Streaming media audio file play method based on mobile terminal memory card cache technology
US20130198335A1 (en) Just In Time Construct HLS Stream from HDS Live Stream
US20110246660A1 (en) Systems, Methods, and Apparatuses for Media File Streaming
US8824676B2 (en) Streaming video to cellular phones
CN102131110B (en) System and method for issuing IPTV (internet protocol television) contents
CN103813185B (en) A kind of method that segment programs are quickly distributed, server and client
CN102611945A (en) Streaming media slicing method, slicing server and streaming media demand system
WO2011143853A1 (en) Method, apparatus and system for improving synchronization efficiency of really simple syndication service
CN104506493A (en) HLS content source returning and caching realization method
WO2015000137A1 (en) Streaming media processing method, apparatus and system
CN101197840A (en) Method, system, device for downloading and storing files and method for generating identification
CN102055789B (en) Method, system and network device for realizing streaming media service based on HTTP
CN102055773A (en) Method for realizing HTTP-based stream media service, system and network equipment
CN103531218A (en) Online multimedia file editing method and system
CN108259207B (en) Traffic statistics method, client, server and system
CN104348841A (en) Content delivery method, analysis and management and control system and content delivery network system
CN103678527A (en) Video filtering method and video filtering system both based on video titles and video content

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant