CN102724024B - The data buffer storage of signal collecting and repeating method - Google Patents

The data buffer storage of signal collecting and repeating method Download PDF

Info

Publication number
CN102724024B
CN102724024B CN201210220273.8A CN201210220273A CN102724024B CN 102724024 B CN102724024 B CN 102724024B CN 201210220273 A CN201210220273 A CN 201210220273A CN 102724024 B CN102724024 B CN 102724024B
Authority
CN
China
Prior art keywords
data
signal collecting
signaling
gateway
convergence device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201210220273.8A
Other languages
Chinese (zh)
Other versions
CN102724024A (en
Inventor
叶春生
车新奕
雷果
程涛木
周毅
余茹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Broid Technology Co.,Ltd.
Original Assignee
SHENZHEN BAOAD TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHENZHEN BAOAD TECHNOLOGY Co Ltd filed Critical SHENZHEN BAOAD TECHNOLOGY Co Ltd
Priority to CN201210220273.8A priority Critical patent/CN102724024B/en
Publication of CN102724024A publication Critical patent/CN102724024A/en
Application granted granted Critical
Publication of CN102724024B publication Critical patent/CN102724024B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The present invention relates to communication technical field, have more and relate to data buffer storage in the external transmitting procedure of a kind of signaling acquisition system and repeating method.May loss of data be caused when disconnecting appears in signal collecting part and signaling assemblying part, invention increases data buffer storage and repeating method, ensure the integrality of data.Reconnect successfully, any one mode in breakpoint transmission, FTP propelling movement and offline copies can be selected to retransmit.Maintain to method maximum of the present invention the integrality of data, thus reach related application system analyze data time obtain result more accurately.

Description

The data buffer storage of signal collecting and repeating method
Technical field
The present invention relates to communication technical field, more particularly, relate to the data buffer storage in the external transmitting procedure of a kind of signaling acquisition system and repeating method.
Background technology
Along with the development of telecommunications industry data service, signaling network is as the important component part of telecommunication supporting network, and its fundamental position can not be ignored.By the signaling message carried in signaling network, the operation information of network can be obtained accurately and efficiently, whether balancedly analyze bearer network flow, network traffic statistics, accident analysis, network running quality assessment, device performance monitoring, for administering and maintaining of signaling network, the service quality of business network detects analysis provides strong support.And the range of application of these data, administer and maintain from basic, expanded to the application of some Third party system.Thus need better to control these data of distribution, and then there is acquisition gateway collecting system.This system is mainly divided into two parts (as described in Figure 1): one, acquisition gateway part: the collection (comprising No. seven signaling data and IP signaling data) of each signalling point data of primary responsibility, adopt standard time mark timestamp, and according to SDTP protocol specification, these data are repacked forwarding, and original signaling remains unchanged.Two, signaling assemblying part, the data that acquisition gateway is sent by primary responsibility gather, and according to each system requirements docked, carry out filtration and forward.If docking system is signaling monitoring system, need all data, then without the need to filtering, directly forward; If docking system only needs to control class message, then after filtering other data, forwarding data.
Acquisition gateway and signaling converge, and signaling converges at related application system and all adopts many socket connection to send data, and the socket connection data of each convergence device is decided by the interface message processor (IMP) quantity of the related system of correspondence.Each socket connects can independently specify object IP and port.The signaling data of same switch connects transmission at same socket.The structure of signaling data should be kept in convergence process, content do not change.
In network transmission process, there is the situation of packet loss or Transmission unavoidably, between convergence device and related application system, link fails, the data do not sent out that then convergence device side needs are deposited to file, in related application system whenever necessary, by initiatively transmission or opposite end extracting mode send to related application system.
But, except above situation, also may there is above problem in the transmission between acquisition gateway and signaling converge, and in existing disclosed signaling acquisition system, only have and gather forwarding capability and have no progeny in unrealized conversion link, the function how to guarantee data integrity.
Summary of the invention
The object of this invention is to provide a kind of method of signal collecting data buffer storage and data retransmission, keep the integrality of data with maximum, thus reach related application system and obtain result more accurately when analyzing data.
The technical solution used in the present invention is to achieve these goals:
The data buffer storage of signal collecting and repeating method, comprise the following steps:
Step one, signal collecting gateway judges that whether the connection between signal collecting gateway and signaling convergence device is normal.
Step 2, if abnormal, then the buffer area of the data of signal collecting write signal collecting gateway is carried out buffer memory by signal collecting gateway, and the form of employing is .pcap.The data type of signal collecting comprises IP, 2M and 64k, adopts the mode of writing direct during the write of these data, and any class not changing original signaling is held.
Step 3, judges whether successfully reconnecting between signal collecting gateway and signaling convergence device, if success, then judges that the data of buffer memory in step 2 are sent to signaling convergence device by retransmission mode, complete re-transmission.
Above-mentioned retransmission mode comprises breakpoint transmission, FTP pushes and offline copies.If to the sequential of signaling and integrity demands strict, but do not require the real-time of signaling, only do statistical analysis, then can use the method for breakpoint transmission, when namely first reading link open circuit, buffer memory is to the transfer of data of buffer area to signaling convergence device, and the real time data now collected first continues buffer memory to buffer area, after being sent completely to file, real time data no longer writes buffer area, is connected transfer to the signaling collection equipment that converges by socket.If higher to the requirement of real-time of signaling, then can select not resume, directly be sent to real time data, the data cached form by FTP or offline copies is transmitted.
Above-mentioned breakpoint transmission comprises the steps:
Judge read-write mark according to sign position, if there is file readable, then file reading is sent to signaling convergence device.
Judge whether send is last file, if so, then arranging and indicating position is read-onlyly not write.
After last file has read, arrange and indicate position for normal transmission.
The data buffer storage of signal collecting provided by the present invention and repeating method, beneficial effect is: the signaling collected when the present invention is by increasing and occurring anomaly link open circuit in treatment system signal collecting part and assemblying part link connection procedure and link reconnect the situation how this part signaling is afterwards transmitted, and guarantees that the integrality of data and user are to the independence of this part data processing method to greatest extent.
In the process that link open circuit is data cached, be .pcap by data buffer storage, such common store mode, user-friendly general utility tool (as wireshark) is to the reading of file and signaling decoding.Meanwhile, in storing process, adopt the mode of writing direct, thus ensure the consistency of write data and original signaling.
Utilize the present invention can transmit data accurately, and ensure that the integrality of data to greatest extent, the selection of multiple repeating method, ensure that the independence of user to data cached process, improve accuracy and the practicality of follow-up system data statistics.Repeating method is all realize within the scope of system processing power, can not affect normal data transfer, improves the utilance of system.
Accompanying drawing explanation
Fig. 1 is existing acquisition gateway collecting system graph of a relation;
Fig. 2 is existing acquisition gateway collecting system acquisition gateway part and convergence device link abnormality processing flow chart;
Fig. 3 is signal collecting gateway of the present invention and signaling convergence device link abnormality processing portion flow chart;
Fig. 4 is that signal collecting gateway of the present invention and signaling convergence device reconnect partial process view;
Fig. 5 is breaker point continuous transmission method partial process view of the present invention.
Embodiment
Below in conjunction with accompanying drawing, the present invention will be further described.
In order to keep the integrality of data to greatest extent when signal collecting part and assemblying part link exception, invention increases when link is abnormal the repeating method when caching method of collection signaling and link-recovery.
As shown in Figure 3, on the basis of Fig. 2 existing acquisition gateway collecting system acquisition gateway part and convergence device link abnormality processing flow process, increase data buffer storage processing method.Comprise the steps: step one, signal collecting gateway judges that whether the connection between signal collecting gateway and signaling convergence device is normal; Step 2, if abnormal, then the buffer area of the data of signal collecting write signal collecting gateway is carried out buffer memory by signal collecting gateway.
When sending unsuccessfully, according to user configuration information, judge that user is when link exception, the need of written document, if needed, then under user specifies catalogue, by set form, adopt the mode of writing direct, the writing in files when not changing original signaling content.
Conveniently digital independent, filename and file content do following regulation:
1) data of signal collecting are stored in buffer area (on disk) in binary mode.File name formats is: YYYYMMDDHHmmSS.ip.pcap.
2) file stores root is data, and by interface type difference point three subdirectories, current have IP, 2M, 64k three types, and corresponding subdirectory is respectively ip, 2m, 64k.
3) file stores by every 5 minutes or more than generating a file during 500MB.
4) file format is as following table:
Note: when link layer type is IP data, Frame data stores complete Ethernet bag.When link layer type is 2M and 64k data, Frame data stores original MSU data, comprises BSN, BIB, FSB, LT, SIO above.
5) data frame format
Sequence number Title Type Length (Byte) Value
1 time zone offset unsigned int 4 The UTC time (second)
2 time stamp accuracy unsigned int 4 Nanosecond
3 captured length unsigned int 4 The data packet length of catching
4 packet length unsigned int 4 Real data packet length
5 data char n Signaling data
Note: if link layer type is IP type, an IP bag is a Frame.If TDM(2M or 64k) data then a MSU be a Frame.
The UTC time is the actual time of origin of signaling data.
Front four types are the syllable sequence of " unsigned int " data item is Little-Endian(small end) sequence.
If signal collecting does not have loss of data, so captured length is identical with packet length, is all the length of the data of actual acquisition below, does not comprise space length shared by four data item above.
As shown in Figure 4, on the basis of Fig. 2 existing acquisition gateway collecting system acquisition gateway part and convergence device link abnormality processing flow process, increase data re-transmission processing method.Judge to reconnect whether success between signal collecting gateway and signaling convergence device, if success, then judge the retransmission mode (comprise breakpoint transmission, FTP pushes and offline copies) that user needs, according to the retransmission mode that user needs, the data of buffer area buffer memory are sent to signaling convergence device, complete re-transmission.Now mainly introduce breakpoint transmission and FTP push mode.
Breakpoint transmission pattern: by during link down and later data be all sent to signaling convergence device by soket mode, this is the best method keeping data time sequence and integrality.As shown in Figure 5, link reconnects successfully, and whether judge read-write mark according to sign position, have file readable, if had, then under arriving corresponding catalogue, file reading is sent to signaling convergence device; Whether be last file if so, then arrange indicate position be read-only do not write, sending module now judges without the need to continuing written document, by data buffer storage to be sent in internal memory according to sign position if judging to send; Until after last file read, arrange and indicated position and send for normal.At this moment, the data file being buffered in buffer area when representing link exception is sent completely, can normally send real-time signaling data.Now, breakpoint transmission completes.
FTP push mode is then simply many, if user selects FTP push mode, then need the destination address of first informing data-pushing object, often generate a file and then utilize system transfers disposal ability surplus, use FTP mode active push to destination server (convergence device).
Data buffer storage pattern of the present invention, ensure that consistency that is data cached and signaling network transmission.By reliable host-host protocol transmission data between signal collecting part and assemblying part, thus ensure that the accuracy of Message Transmission.The washability of data cached transmission mode, ensure that the independence of user to data cached process.Utilize the present invention can transmit data accurately, and ensure that the integrality of data to greatest extent, improve the practicality of system.The operation information of network can be obtained more accurately and efficiently, whether balancedly analyze bearer network flow, network traffic statistics, accident analysis, network running quality assessment, device performance monitoring, for administering and maintaining of signaling network, the service quality of business network detects analysis provides stronger support.

Claims (2)

1. the data buffer storage of signal collecting and repeating method, comprises the following steps:
Step one, signal collecting gateway judges that whether the connection between signal collecting gateway and signaling convergence device is normal;
Step 2, if abnormal, then the buffer area of the data of signal collecting write signal collecting gateway is carried out buffer memory by signal collecting gateway, and the form that wherein buffer memory adopts is .pcap;
Step 3, judges whether successfully reconnecting between signal collecting gateway and signaling convergence device, if success, then judges that the data of buffer memory in step 2 are sent to signaling convergence device by retransmission mode, complete re-transmission; Described retransmission mode comprises breakpoint transmission, FTP pushes and offline copies; Wherein breakpoint transmission comprises the steps:
Judge read-write mark according to sign position, if there is file readable, then file reading is sent to signaling convergence device;
Judge whether send is last file, if so, then arranging and indicating position is read-onlyly not write;
After last file has read, arrange and indicate position for normal transmission.
2. the data buffer storage of signal collecting and repeating method according to claim 1, is characterized in that: the write described in step 2 adopts the mode of writing direct.
CN201210220273.8A 2012-06-29 2012-06-29 The data buffer storage of signal collecting and repeating method Active CN102724024B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210220273.8A CN102724024B (en) 2012-06-29 2012-06-29 The data buffer storage of signal collecting and repeating method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210220273.8A CN102724024B (en) 2012-06-29 2012-06-29 The data buffer storage of signal collecting and repeating method

Publications (2)

Publication Number Publication Date
CN102724024A CN102724024A (en) 2012-10-10
CN102724024B true CN102724024B (en) 2015-10-14

Family

ID=46949699

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210220273.8A Active CN102724024B (en) 2012-06-29 2012-06-29 The data buffer storage of signal collecting and repeating method

Country Status (1)

Country Link
CN (1) CN102724024B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
BR112018008349A2 (en) * 2015-10-29 2018-10-30 Koninklijke Philips Nv wireless medical device, medical monitoring system, non-transient storage media, and device
CN109815164A (en) * 2018-12-18 2019-05-28 航天信息股份有限公司 A kind of method and system for realizing the data buffer storage under equipment off-line state
CN109587006A (en) * 2018-12-27 2019-04-05 深圳云博智联科技有限公司 A kind of data forward method and its system and storage medium based on Lora gateway
CN113286328A (en) * 2021-05-11 2021-08-20 博瑞得科技有限公司 Centralized data receiving method and device and computer readable storage medium
CN114185914B (en) * 2022-02-16 2022-04-29 西安热工研究院有限公司 Complementary calculation method, system, equipment and storage medium for calculating label data
CN116506205B (en) * 2023-05-15 2023-10-27 深圳智慧医学科技有限公司 Data processing method and system of intelligent medical platform

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1734997A (en) * 2004-08-11 2006-02-15 华为技术有限公司 Data transmission method
CN102131152A (en) * 2010-01-15 2011-07-20 中兴通讯股份有限公司 Method and system for maintaining continuity of instant message service

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2666799T3 (en) * 2007-10-23 2018-05-07 Nokia Technologies Oy Enhanced retransmission capability in semi-persistent transmission
CN101621368B (en) * 2009-08-13 2012-10-17 北京必创科技有限公司 Method, device and system for retransmitting data packet

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1734997A (en) * 2004-08-11 2006-02-15 华为技术有限公司 Data transmission method
CN102131152A (en) * 2010-01-15 2011-07-20 中兴通讯股份有限公司 Method and system for maintaining continuity of instant message service

Also Published As

Publication number Publication date
CN102724024A (en) 2012-10-10

Similar Documents

Publication Publication Date Title
CN102724024B (en) The data buffer storage of signal collecting and repeating method
US8238941B2 (en) System and method for determining a location for a mobile device
CN102833668B (en) Data traffic reminding method and data traffic reminding device
CN108270699B (en) Message processing method, shunt switch and aggregation network
CN204089874U (en) A kind of switch supporting packet storage
CN104486153B (en) A kind of transformer station process layer network transmission performance monitoring method based on FPGA
JP6603816B2 (en) Method and apparatus for transmitting frame data between near-end device and far-end device
KR20150007623A (en) Method and appratus for protection switching in packet transport system
CN102571451A (en) Network element and method for uploading MR (Measure Report) messages by network element
CN102014411B (en) Method and system for acquiring radio measurement report
CN104980293A (en) Method and device for quickly transmitting and detecting OAM message
CN103220188A (en) Hyper text transport protocol (HTTP) data acquisition equipment
CN101350733B (en) System for acquiring net element performance data base on preposition data server and implementing method thereof
CN111953555A (en) Link detection method, CPE (customer premises equipment) and storage medium
CN102255777A (en) Signaling data acquisition full-link delay correction method
CN101771617B (en) Method and system for following point-to-point bandwidth, remote terminal equipment and home terminal equipment
CN101754244B (en) Data acquisition processing method of time division synchronization code division multiple access (TD-SCDMA) network centralized monitoring system
CN105847073B (en) The network packet monitoring system of launch control platform is surveyed on a kind of carrier rocket ground
CN108289066A (en) The method for flexibly debugging data service in exchange chip
Cisco Displaying and Configuring UXM Cards
CN110213118B (en) FC network system and flow control method thereof
CN116723133B (en) Data transmitting and receiving equipment, network state information extraction method and device
CN102420828B (en) Method, device and system for setting protocol management status
CN102307109A (en) Signaling data acquisition single link time delay correction method
CN112311618B (en) Test method and test equipment of network switching equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CP03 Change of name, title or address

Address after: 401120 No.2, 7th floor, Fenghuang a building, No.18, Qingfeng North Road, Yubei District, Chongqing

Patentee after: Broid Technology Co.,Ltd.

Address before: 518057 No.1, area a, 3 / F, building B, Gaoxin South 7th road digital technology park, high tech Zone, Nanshan District, Shenzhen City, Guangdong Province

Patentee before: SHENZHEN BROADTECH Co.,Ltd.

CP03 Change of name, title or address