CN101174989B - Method for storing signaling tracking data by built-in database system - Google Patents
Method for storing signaling tracking data by built-in database system Download PDFInfo
- Publication number
- CN101174989B CN101174989B CN2007101761391A CN200710176139A CN101174989B CN 101174989 B CN101174989 B CN 101174989B CN 2007101761391 A CN2007101761391 A CN 2007101761391A CN 200710176139 A CN200710176139 A CN 200710176139A CN 101174989 B CN101174989 B CN 101174989B
- Authority
- CN
- China
- Prior art keywords
- signaling
- signaling message
- database
- data
- buffering area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention relates to a system which adopts an embedded database system to store signaling tracking data. The system includes a configuration parameter module, a foreground and background communication module, a signaling message processing module and a database module. The configuration parameter module is used for obtaining various configuration parameters in configuration files, the foreground and background communication module is used for constructing and maintaining communication link paths with foreground net elements, receiving signaling messages sent from the foreground net element and writing the messages into a signaling message buffer, the signaling message processing module includes a plurality of signaling message processing treads and is used for processing the signaling messages in the signaling message buffer, the database module stores received signaling data and extracts reserved signaling data. The invention improves the data processing throughput of a signaling tracing tool and avoids the large-scale alter of the original software architecture. Various editions can be conveniently changed to the database storing mode.
Description
Technical field
The present invention relates to communication field, and especially, a kind of preservation that relates to webmaster signaling tracing instrument reports the method for signaling data.
Background technology
Signaling tracing (Signaling Trace) is critical function in the communication network operation maintenance.The signaling tracing instrument presents the signaling transmission course in real time by the signaling message between track record foreground network element (Network Element) equipment, for exploitation and the attendant carries out the signaling process analysis and fault location provides important means.
The signaling tracing instrument of realizing with software mode has dual mode for the processing that receives signaling at present, and a kind of is only to do real-time demonstration, does not do data and preserves.Another kind of mode then is both to have done real-time demonstration, does data in real time again and preserves.Continuous enhancing along with the signaling tracing instrumental function, particularly in order to satisfy the demand that the user checks the historical trace data, signaling data is preserved the key that becomes a technology in real time, a outstanding signaling tracing instrument, must accomplish to preserve accurately the signaling data of all foreground reported by network elements, analyze use for the technical staff.
The signaling tracing instrument generally need not to install, and copy can use.Therefore for a large amount of signaling datas, can't use traditional system R to preserve data.The general mode of self-defined file or Access database that adopts of present signaling tracing instrument is carried out the data preservation:
Use self-defined file, advantage is and can develops specific hold function for signaling tracing; Shortcoming is, is difficult to control (for example synchronous) to the data read-write.In addition, when file surpasses 4 GB sizes, Windows operating system can't be supported.
Use the advantage of Access database to be that the windows system provides ripe database access interface, use simple and flexible, better data write control; Its shortcoming is that the Access database is simple desktop type database, can't satisfy the memory requirement of a large amount of signaling datas.And Access only provides the ODBC access mode, and the java program must reduce the efficient of data access by the mode accessing database of JDBC-ODBC bridge.
Summary of the invention
In order to address the above problem, the present invention proposes a kind of method that adopts embedded type database system to preserve the signaling tracing data, purpose is: according to the signaling tracing instrument of java code realization, adopt embedded type database system storage signaling data, this database need not configuration is installed, and can directly combine with program and finish independently data access function.
Specifically, a kind of system that adopts embedded type database system to preserve the signaling tracing data disclosed by the invention comprises:
The configuration parameter module is used for obtaining the various configuration parameters of configuration file;
The foreground net element information of described configuration parameter for preserving in the mode of XML file, described foreground net element information comprises four fields: ID numbering, element name, IP address and port numbers.
The AM/BAM communication module is used for setting up and the maintain communications link with the foreground network element, receives the signaling message that the foreground network element is sent, and message is write the signaling message buffering area;
Described signaling message buffering area also comprises and overflows the signaling message buffering area, described signaling message processing module also comprises overflows buffering area signaling message processing module, the described buffering area signaling message processing module of overflowing comprises a plurality of buffering area signaling message processing threads that overflow, be used for the signaling message that overflows in the buffering area is handled, signaling message is saved to database.
The signaling message processing module comprises a plurality of signaling message processing threads, is used for the signaling message in the signaling message buffering area is handled; Described a plurality of signaling message processing threads is created when the signaling tracing instrument start-up of backstage.
Database module is preserved signaling data that receives and the signaling data of having preserved from described embedded database extraction with embedded database;
Described database module, also be used to create new signaling tracing task, create embedded database, and set up being connected of described task and described embedded database, accept the data that described signaling message processing threads transmits, and the data of described acceptance are saved to the embedded database of described establishment.Described Database Systems adopt the Oracle Berkeley DB embedded database of java version.
The invention also discloses a kind of method that adopts embedded type database system to preserve the signaling tracing data, comprise step:
Step 1 is obtained the various configuration parameters in the configuration file;
Step 2 and foreground network element are set up and the maintain communications link, receive the signaling message that the foreground network element is sent, and message is write the signaling message buffering area;
Step 3 is handled the signaling message in the signaling message buffering area, comprises a plurality of signaling message thread process;
Step 4 adopts the signaling data of embedded database preservation reception and extract the signaling data of having preserved from described embedded database;
Described step 4 further comprises:
Create new signaling tracing task;
Create embedded database, and set up being connected of task and described embedded database;
Accept the data that the signaling processing threads transmits, the data of described acceptance are saved to described embedded database.
In the described step 1, the foreground net element information of configuration parameter for preserving in the mode of XML file, described foreground net element information comprises four fields: ID numbering, element name, IP address and port numbers.
In the described step 2 message being write the signaling message buffering area also comprises message write and overflows the signaling message buffering area.
Described step 3 further comprises:
Step 301 during the signaling tracing instrument start-up of backstage, is created a plurality of signaling message processing threads;
Step 302, each signaling process thread takes out a signaling message from the signaling message buffering area, then signaling message corresponding in the signaling message buffering area is deleted from buffering area;
Step 303, each signaling process thread process is the signaling message from buffering area just; Repeat 302 steps then.
Described step 4 further comprises:
Step 4042 is opened tracing task;
Step 4043 is opened the database of task correspondence, sets up and being connected of database;
The index value that step 4044, database root are reportedly gone into finds corresponding record, return code flow data.
Technology of the present invention is that effect had both improved the throughput that the signaling tracing tool data is handled, and has avoided the extensive change to original software architecture again, can be the database storage pattern with each version change easily.
Description of drawings
Fig. 1 is a The general frame of the present invention;
Fig. 2 is a configuration parameter module flow chart;
Fig. 3 is an AM/BAM communication module flow chart;
Fig. 4 is the process chart of signaling message processing module;
Fig. 5 is the database module flow chart.
Embodiment
Accompanying drawing is used to provide further understanding of the present invention, constitutes the application's a part, and illustrative examples of the present invention and explanation thereof are used to explain the present invention, do not constitute improper qualification of the present invention.
The present invention includes with lower module: the configuration parameter module is used for obtaining the various configuration parameters of configuration file; The AM/BAM communication module is used for setting up and the maintain communications link with the foreground network element, receives the signaling message that the foreground network element is sent; The signaling message processing module comprises a plurality of signaling message processing threads, is used for the signaling message in the signaling message buffering area is handled; Database module is used to preserve the signaling data of reception and extracts the signaling data of having preserved.
The technical scheme that the present invention proposes is: adopt the Oracle Berkeley DB embedded database of java version to realize the Core Feature that data are preserved.
Berkeley DB be aly increase income, high performance embedded type database system, it is realized based on the java language fully, adopts the data store organisation of binary tree (Btree), provides based on the storage engines of affairs mode and the data access interface of JDBC.Berkeley DB preferentially writes Java Virtual Machine (JVM) spatial cache of BerkeleyDB application with data to be stored.If the spatial cache of application uses up, then earlier the data in the buffer memory are write disk, data that again will be to be preserved write buffer memory.Compare with traditional relevant database, Berkeley DB has access speed faster to data, lower CPU and memory usage.For the signaling tracing instrument, the advantage of Berkeley DB is more obvious, and at first, it need not configuration is installed, and only needs to introduce the jar bag of not enough 4M on original code base, can finish all functions of database.Secondly, its data list structure is simple, and a bivariate table has only two fields, keyword and data, and the direct storage of support byte type array data.At last, for the signaling tracing instrument by the java exploitation, the Berkeley DB of this java version has done special optimization at the java program, has improved the efficient of data access.
Below with reference to accompanying drawing, describe the specific embodiment of the present invention in detail.
Fig. 1 is a The general frame of the present invention.As shown in Figure 1, the present invention includes with lower module: the configuration parameter module is used for obtaining the various configuration parameters of configuration file; The AM/BAM communication module, be used for setting up and the maintain communications link with the foreground network element, receive the signaling message that the foreground network element is sent, and message write the signaling message buffering area or overflow signaling message buffering area (signaling message buffering area with overflow the signaling message buffering area and can be two different signaling message buffering areas, also can in the signaling message buffering area, comprise and overflow the signaling message buffering area); The signaling message processing module comprises a plurality of signaling message processing threads, is used for the signaling message in the signaling message buffering area is handled; Overflow buffering area signaling message processing module, comprise a plurality of buffering area signaling message processing threads that overflow, be used for the signaling message that overflows in the buffering area is handled, signaling message is saved to database.Database module, the function of responsible data access.For the bit stream data that receives, preferentially it is left in the JVM virtual machine buffer memory of application, when buffer memory full, in the bit stream data one-time write database in the buffer memory, when the data that reading database is preserved, import the index key value into to database, database root returns the code stream information of preservation according to index value.These four modules are linked in sequence: signaling tracing is to handle successively according to " configuration parameter module--→ AM/BAM communication module--→ signaling message processing module--→ database module " such flow process.
Fig. 2 is a configuration parameter resume module flow chart.In this module, finish the configuration task of foreground net element information.Article one, the net element information record comprises four fields, is respectively ID numbering, element name, IP address and port numbers.Net element information is preserved in the mode of XML file, and after reading configuration information and finishing, the user can select corresponding network element to connect.
Step 21 reads the configuration information of XML form;
Step 22 is provided with the ID number information of foreground net element information configured list;
Step 23 is provided with the element name information of foreground net element information configured list;
Step 24 is provided with the IP address information of foreground net element information configured list;
Step 25 is provided with the port number information of foreground net element information configured list.
Fig. 3 is the process chart of AM/BAM communication module.
Step 301 is set up the AM/BAM communication link;
Step 302 receives the signaling message that send on the foreground;
Step 303 judges whether the signaling message buffering area is full;
Step 305 is if then write signaling message and overflow the signaling message buffering area;
Step 306 is returned step 302.
Fig. 4 is the process chart of signaling message processing module.
Step 401 during the signaling tracing instrument start-up of backstage, is created a plurality of signaling message processing threads.
Fig. 5 is the database module flow chart.The preservation of signaling data and read all and in this module, finish.
Step 501 starts the signaling tracing instrument;
Step 502 judges whether to create tracing task, if then execution in step 5031, if not, then execution in step 5041;
Step 5031 is created new signaling tracing task;
Step 5032 is created database, and sets up being connected of task and database;
Step 5033 is accepted the data that the signaling processing threads transmits;
Step 5034 is saved to database with data.
Step 5041 is opened tracing task.
Step 5042 is opened the database of task correspondence, sets up and being connected of database;
Step 5043 is sent query requests according to index value to database;
Step 5044, database extracts bit stream data, returns Query Result.
Using analogue network element to carry out in the data pressure test, adopting traditional approach to preserve signaling data, average throughput is 30000/min, and uses Berkeley DB Database Systems instead, and average throughput can reach 70000/min.Using analogue network element to carry out carrying out signaling tracing incessantly in 24 hours in system's fatigability test, adopt traditional approach, when data traffic was very high, it was bigger data preservation failed probability to occur.And use Berkeley DB Database Systems instead, even the data volume of having preserved up to three or four GB, the still normal operation of system.In sum, by above-mentioned the present invention, both having improved the throughput that the signaling tracing tool data is handled, and avoided the extensive change to original software architecture again, can be the database storage pattern with each version change easily.
Claims (11)
1. a system that adopts embedded type database system to preserve the signaling tracing data is characterized in that, comprising:
The configuration parameter module is configured the foreground net element information, obtains the various configuration parameters in the configuration file;
The AM/BAM communication module is used for setting up and the maintain communications link with the foreground network element, receives the signaling message that the foreground network element is sent, and message is write the signaling message buffering area;
The signaling message processing module comprises a plurality of signaling message processing threads, is used for the signaling message in the signaling message buffering area is handled;
Database module is preserved signaling data that receives and the signaling data of having preserved from described embedded database extraction with embedded database;
Described database module, also be used to create new signaling tracing task, create embedded database, and set up being connected of described task and described embedded database, accept the data that described signaling message processing threads transmits, and the data of described acceptance are saved to the embedded database of described establishment.
2. employing embedded type database system as claimed in claim 1 is preserved the system of signaling tracing data, it is characterized in that, the foreground net element information of described configuration parameter for preserving in the mode of XML file, described foreground net element information comprises four fields: ID numbering, element name, IP address and port numbers.
3. employing embedded type database system as claimed in claim 1 is preserved the system of signaling tracing data, it is characterized in that, described signaling message buffering area also comprises and overflows the signaling message buffering area, described signaling message processing module also comprises overflows buffering area signaling message processing module, the described buffering area signaling message processing module of overflowing comprises a plurality of buffering area signaling message processing threads that overflow, be used for the signaling message that overflows in the buffering area is handled, signaling message is saved to database.
4. employing embedded type database system as claimed in claim 1 is preserved the system of signaling tracing data, it is characterized in that described a plurality of signaling message processing threads are created when the signaling tracing instrument start-up of backstage.
5. employing embedded type database system as claimed in claim 1 is preserved the system of signaling tracing data, it is characterized in that, described Database Systems adopt the Oracle Berkeley DB embedded database of java version.
6. employing embedded type database system as claimed in claim 1 is preserved the system of signaling tracing data, it is characterized in that,
Described database module also is used to open tracing task, opens the embedded database of described tracing task correspondence, foundation is connected with described embedded database, send query requests according to index value to described embedded database, extract bit stream data, return Query Result.
7. a method that adopts embedded type database system to preserve the signaling tracing data is characterized in that, comprises step:
Step 1 is configured the foreground net element information, obtains the various configuration parameters in the configuration file;
Step 2 and foreground network element are set up and the maintain communications link, receive the signaling message that the foreground network element is sent, and message is write the signaling message buffering area;
Step 3 is handled the signaling message in the signaling message buffering area, comprises a plurality of signaling message thread process;
Step 4 adopts the signaling data of embedded database preservation reception and extract the signaling data of having preserved from described embedded database;
Described step 4 further comprises:
Create new signaling tracing task;
Create embedded database, and set up being connected of task and described embedded database;
Accept the data that the signaling processing threads transmits, the data of described acceptance are saved to described embedded database.
8. employing embedded type database system as claimed in claim 7 is preserved the method for signaling tracing data, it is characterized in that, in the described step 1, the foreground net element information of configuration parameter for preserving in the mode of XML file, described foreground net element information comprises four fields: ID numbering, element name, IP address and port numbers.
9. employing embedded type database system as claimed in claim 7 is preserved the method for signaling tracing data, it is characterized in that, in the described step 2 message is write the signaling message buffering area and also comprises message write and overflow the signaling message buffering area.
10. employing embedded type database system as claimed in claim 7 is preserved the method for signaling tracing data, it is characterized in that described step 3 further comprises:
Step 301 during the signaling tracing instrument start-up of backstage, is created a plurality of signaling message processing threads;
Step 302, each signaling process thread takes out a signaling message from the signaling message buffering area, then signaling message corresponding in the signaling message buffering area is deleted from buffering area;
Step 303, each signaling process thread process is the signaling message from buffering area just; Repeat 302 steps then.
11. employing embedded type database system as claimed in claim 7 is preserved the method for signaling tracing data, it is characterized in that described step 4 further comprises:
Step 4042 is opened tracing task;
Step 4043 is opened the database of task correspondence, sets up and being connected of database;
The index value that step 4044, database root are reportedly gone into finds corresponding record, return code flow data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2007101761391A CN101174989B (en) | 2007-10-19 | 2007-10-19 | Method for storing signaling tracking data by built-in database system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2007101761391A CN101174989B (en) | 2007-10-19 | 2007-10-19 | Method for storing signaling tracking data by built-in database system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101174989A CN101174989A (en) | 2008-05-07 |
| CN101174989B true CN101174989B (en) | 2011-08-24 |
Family
ID=39423261
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2007101761391A Expired - Fee Related CN101174989B (en) | 2007-10-19 | 2007-10-19 | Method for storing signaling tracking data by built-in database system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101174989B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103177016B (en) * | 2011-12-22 | 2016-05-25 | 北京新媒传信科技有限公司 | Relevant database access method and device |
| CN108509144B (en) * | 2017-02-27 | 2020-12-15 | 中兴通讯股份有限公司 | Data saving method and device |
| CN113836121B (en) * | 2021-11-29 | 2022-03-01 | 飞狐信息技术（天津）有限公司 | Database control method and target server |
-
2007
- 2007-10-19 CN CN2007101761391A patent/CN101174989B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN101174989A (en) | 2008-05-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107479829A (en) | A kind of Redis cluster mass datas based on message queue quickly clear up system and method | |
| CN103345518B (en) | Self-adapting data memory management method based on data block and system | |
| CN102638584B (en) | Data distributing and caching method and data distributing and caching system | |
| CN103136243B (en) | File system duplicate removal method based on cloud storage and device | |
| CN104765575B (en) | information storage processing method | |
| CN105183839A (en) | Hadoop-based storage optimizing method for small file hierachical indexing | |
| CN105045817B (en) | SQL Server database evidence-taking and analysis system and method based on transaction journal | |
| CN101375241A (en) | Efficient data management in a cluster file system | |
| CN106066890A (en) | A kind of distributed high-performance data storehouse integrated machine system | |
| US7225206B2 (en) | System and method for reorganizing stored data | |
| CN101790257A (en) | Method for memorizing data and network management system | |
| CN107967122A (en) | A kind of method for writing data of block device, device and medium | |
| CN103714163A (en) | Pattern management method and system of NoSQL database | |
| CN100449545C (en) | Method and system for accessing sector data | |
| CN103150395A (en) | Directory path analysis method of solid state drive (SSD)-based file system | |
| CN102779138A (en) | Hard disk access method of real time data | |
| CN101174989B (en) | Method for storing signaling tracking data by built-in database system | |
| CN111291022B (en) | Data storage system based on block chain | |
| CN111241090B (en) | Method and device for managing data index in storage system | |
| CN109271456A (en) | Host data library file deriving method and device | |
| CN100492994C (en) | Method for establishing equipment configuration parameter and base station single plate configuration system | |
| CN103064749B (en) | Inter-process communication method | |
| CN111427845B (en) | Interactive modeling analysis operator data exchange method | |
| Membrey et al. | A disk based stream oriented approach for storing big data | |
| CN101267338B (en) | High-performance log and behavior auditing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110824 Termination date: 20161019 |