CN108509508A - Short message big data inquiry based on Java technology and analysis system and its method - Google Patents
Short message big data inquiry based on Java technology and analysis system and its method Download PDFInfo
- Publication number
- CN108509508A CN108509508A CN201810188238.XA CN201810188238A CN108509508A CN 108509508 A CN108509508 A CN 108509508A CN 201810188238 A CN201810188238 A CN 201810188238A CN 108509508 A CN108509508 A CN 108509508A
- Authority
- CN
- China
- Prior art keywords
- data
- short message
- subsystem
- inquiry
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The short message big data inquiry that the invention discloses a kind of based on Java technology and analysis system and its implementation, the system include：Digital independent subsystem is classified, and classification results are exported to statistical disposition subsystem for reading or timing short message reading data by short message service；Statistical disposition subsystem, the sorted note data for receiving the statistical disposition subsystem output, by the way that in deposit database after channel grouping and data aggregate processing, data displaying and Data Matching are carried out for data output subsystem；Obtained inquiry, statistical result are carried out Data Matching and displaying by data output subsystem for the inquiry according to user setting, statistical condition.Using the present invention, short message big data can be analyzed and be handled, promotion data-handling efficiency solves the problems, such as that customer platform mismatches and current data analysis consumption manpower and materials are big, counts time-consuming long.
Description
Technical field
The present invention relates to data analysis and process technology more particularly to a kind of short message big data inquiries based on Java technology
With analysis system and its method.
Background technology
In recent years, the economy in China shows the situation of rapid growth, from small to large, gradually develops to profession from single.
The mode of enterprise's popularization activity and product is also varied, and short message popularization is one of them.Almost everybody has one now
Or plurality of mobile phones so that have by short message popularization, identifying code good using premise and basis.Short message is promoted to developing new visitor
Family maintains frequent customer, and precisely timely message and thoughtful information service are essential.
In order to preferably develop client and widen business channel, it is very effective using accurately data analysis and inquiry
Technological means.The more existing method by related short message statistical analysis can assist user to analyze data, but deposit
In following shortcoming and defect：For example, the accurate data degree of short message statistics is poor, the time of data analysis and statistic processes consuming is long,
The problems such as being mismatched with current platform system, the demand disruption of the data and client that cause actual count to obtain is larger, virtually
Reduce efficiency of operation.
Invention content
In view of this, the main purpose of the present invention is to provide a kind of, the short message big data based on Java technology is inquired and is divided
Analysis system and its method analyze inquiry, timing statistical data, by the way of platform page presentation statistical data using real-time, right
Short message big data is analyzed and is handled, to promote data-handling efficiency, solve customer platform mismatch and current data analysis
Consumption manpower and materials are big, statistics takes long problem.
In order to achieve the above objectives, the technical proposal of the invention is realized in this way：
A kind of inquiry of short message big data and analysis system based on Java technology, including：Digital independent subsystem, Statistics Division
Manage subsystem and data output subsystem；Wherein：
The digital independent subsystem is classified for reading or timing short message reading data in real time by short message service,
And classification results are exported to statistical disposition subsystem；
The statistical disposition subsystem, the sorted note data for receiving the statistical disposition subsystem output,
By the way that in deposit database after channel grouping and data aggregate processing, data displaying and data are carried out for data output subsystem
Match；
The data output subsystem, for the inquiry according to user setting, statistical condition, by obtained inquiry, statistics
As a result Data Matching and displaying are carried out.
Wherein：The digital independent subsystem, including timer module and SMS classified module；Wherein：
Timer module, the timed task for being configured according to server execute SMS classified algorithm to the preset period
Interior note data is classified；
SMS classified module is realized according to service numbers or SMS classified model and sorting algorithm to read short message number
According to automating sorting function.
Further include：Machine learning module, for the service numbers according to read note data, in conjunction with machine learning model
Preset data algorithm carries out accurate intelligent classification to the note data；The data algorithm, including random forests algorithm.
Preset data algorithm further includes decision Tree algorithms in the machine learning module.
The data output subsystem, including record queries module, channel grouping module and statistical form generation module；Its
In：Record queries module looks into the note data of preservation in the database for the querying condition according to input
It askes, statistical operation；
Channel grouping module, it is SMS classified as a result, to the short message for being exported according to the digital independent subsystem
Data are grouped by channel；
Statistical form generation module, for by the inquiry by the record queries module, statistical result, being converted into electronic watch
Case form.
The data output subsystem further includes：Data aggregate module is used for according to preset data aggregate model to dividing
Note data after class carries out polymerization processing, one-to-one, one-to-many data correlation is obtained, with to the sorted short message
Data are associated inquiry, association preserves and the data manipulations such as associated deletion.
The channel grouping module is additionally operable to short message grouped data the aggregating algorithm built according to data aggregate model,
Note data is further processed, precise classification result is obtained.
The data output subsystem, including：Data display module, including be shown on the page of client or export extremely
The form of printer is shown；
Data match module, for according to preset data display pattern, carrying out data conversion to match different platform, no
The correct display data of client with display pattern exports result.
A kind of inquiry of short message big data and analysis method based on Java technology, include the following steps：
A, using the real-time reading of digital independent subsystem or timing short message reading data, classify by short message service, and
The step of classification results are exported to statistical disposition subsystem；
B, the sorted note data of the statistical disposition subsystem output is received by the statistical disposition subsystem,
And by channel grouping and data aggregate processing after be deposited into database, for data output subsystem carry out data displaying and
The step of Data Matching；
C, the inquiry using data output subsystem according to user setting, statistical condition, by obtained inquiry, statistical result
The step of carrying out Data Matching and displaying.
Further include following steps：Service numbers using machine learning module according to read note data, in conjunction with machine
The preset data algorithm of learning model carries out accurate intelligent classification to the note data；The data algorithm, including it is random
Forest algorithm；And
Using the data aggregate module being arranged in data output subsystem, according to preset data aggregate model to classification after
Note data carry out polymerization processing, one-to-one, one-to-many data correlation is obtained, with to the sorted note data
It is associated inquiry, association preserves and the data manipulation of associated deletion.
Short message big data based on Java technology of the invention is inquired and analysis system and its method, has beneficial as follows imitate
Fruit：
The inquiry of short message big data and analysis system based on Java technology, carry out by using to short message branch trade
Statistics provides inquiry and function of search and carries out tables of data processing, matches customer platform, increases the kind of data analysis
Class, and the time needed for inquiry and data analysis is greatly shortened, improve promotion message excavate potential user accuracy and
Quantity saves manpower and materials to improve working efficiency.
Description of the drawings
Fig. 1 is the functional-block diagram of short message big data inquiry and analysis system of the embodiment of the present invention based on Java technology；
Fig. 2 is the short message number that the short message big data inquiry based on Java technology is obtained with analysis system using shown in FIG. 1
According to classification results schematic diagram；
Fig. 3 a~Fig. 3 g are that the short message big data inquiry based on Java technology is looked into analysis system using shown in FIG. 1
Inquiry operation is inquired or statistical result schematic diagram；
Fig. 4 a~Fig. 4 b be using it is shown in FIG. 1 based on Java technology short message big data inquiry and analysis system carry out by
The accurate inquiry operation of channel grouping is inquired or statistical result, and exports the result schematic diagram of electrical form.
Specific implementation mode
Below in conjunction with the accompanying drawings and the embodiment of the present invention the present invention is based on the short message big data of Java technology to inquiring and dividing
Analysis system and its method are described in further detail.
Fig. 1 is the functional-block diagram of short message big data inquiry and analysis system of the embodiment of the present invention based on Java technology.
Short message big data inquiry that should be based on Java technology in the embodiment of the present invention and analysis system, using based on network
Web application framework.Server uses (SuSE) Linux OS platform, is realized using MySQL as data base management system
The function of background data base.Developing instrument uses Java language, Redis data buffer storages, JavaScript, JSP etc..In the clothes
It is engaged in during device operation, according to the note data in the Timing Processing preset time period of Quartz configurations, and note data being carried out
Then grouping executes data aggregate algorithm, to realize correlation inquiry, the associated storage of note data to sorted note data
With the database manipulations function such as associated deletion.It also supports statistical result being stored in tables of data permanence, and is supplied to account inquiries,
The query/search results of related data are shown on the page.
As shown in Figure 1, short message big data inquiry that should be based on Java technology and analysis system, include mainly digital independent
System, statistical disposition subsystem and data output subsystem.Wherein：
Digital independent subsystem, including timer module, SMS classified module and machine learning module.The subsystem is main
For reading or timing short message reading data, classify by short message service, and classification results are exported to statistical disposition subsystem
System.
The timer module, the timed task for being configured according to server remove to execute SMS classified algorithm to preset
Note data in period is classified.
The SMS classified module, the SMS classified model and classification provided according to service numbers or machine learning module are calculated
Method realizes the automating sorting function to read note data.
Fig. 2 is the short message number that the short message big data inquiry based on Java technology is obtained with analysis system using shown in FIG. 1
According to classification results schematic diagram.
As shown in Fig. 2, note data is divided into industry short message, numeric messaging, unstructured supplementary data traffic
(Unstructured Supplementary Service Data, USSD) short message, telephone recharge short message, flow supplement with money short message,
Voice SMS (for example, calling record data), short chaining short message etc..
The machine learning module, it is pre- in conjunction with machine learning model for the service numbers according to read note data
If data algorithm accurate intelligent classification is carried out to the note data.Its specific implementation process includes：
According to the service numbers of note data, a part of characteristic key words are randomly selected from read note data and are executed
Short message comprising the characteristic key words is divided into N number of classification subset by random forests algorithm；When necessary, it can also further execute
Decision Tree algorithms further classify to the short message in each classification subset.In this way, obtaining for note data intelligence
The machine learning model of classification, the SMS classified module is according to the machine learning model, you can will include service numbers, feature
The note data of keyword carries out intelligent classification, in order to which subsequent statistical disposition subsystem carries out sorted note data
Further statistics, clustering processing and digging utilization.
Here, the machine learning module, can by the characteristic key words that randomly select when executing decision Tree algorithms into
Line character String matching, frequency of occurrence and participle granularity adjustment etc. automatically process, and the result of processing is stored in machine learning
In module, in this way, as the digital independent subsystem is read and the note data amount classified increases, the engineering
The training that habit module obtains is more complete, correspondingly, carrying out the speed of intelligent classification to note data using the machine learning model
Degree will be getting faster, and accuracy also can be higher and higher.
Statistical disposition subsystem, including record queries module, channel grouping module, data aggregate module and statistical form life
At module.Sorted note data for receiving the digital independent submodule output, it is poly- by channel grouping and data
After conjunction processing in deposit database, carries out data displaying for data output subsystem and Data Matching is used.Wherein：
The record queries module, for according to the querying condition of input (including Query Dates, time, selection grouping item
The contents such as part), the note data of preservation in the database is inquired, statistical operation.
The data aggregate module, for being polymerize to sorted note data according to preset data aggregate model
Change is handled, and obtains one-to-one, one-to-many data correlation, to be associated inquiry, association to the sorted note data
It preserves and the data manipulations such as associated deletion.
The channel grouping module, it is SMS classified as a result, to described for being exported according to the digital independent subsystem
Note data is grouped by channel.Preferably, can also be to the short message grouped data according in the data aggregate model
The aggregating algorithm set, is further processed note data, and then obtains further precise classification result.
The statistical form generation module, for by the inquiry by the record queries module, statistical result, being converted into electricity
Sublist case form.The electrical form can be specifically Execl form documents.
Fig. 3 a~Fig. 3 g are that the short message big data inquiry based on Java technology is looked into analysis system using shown in FIG. 1
Inquiry operation is inquired or statistical result schematic diagram.
Usually, inquiry operation is carried out to note data, the industry short message, numeric messaging, USSD short messages, telephone expenses is filled
Value, flow supplement with money, the operating process all same or similar of the inquiry of voice, short chain.
Query case as shown in Figure 3a is that " industry short message " chosen by selective power temporally condition is looked into it
Ask the process of operation.
Query case as shown in Figure 3b is that " industry short message " chosen by selective power temporally condition entry is looked into it
It askes the date and phone number carries out the process of inquiry operation.Fig. 3 c be according to the inquiry operation of Fig. 3 b obtain as a result, point
The example of note data detailed content is opened in impact.
Query case as shown in Figure 3d is that temporally condition is defeated to it for " telephone recharge " short message chosen by selective power
Enter Query Dates and phone number carries out the process of inquiry operation.
Query case as shown in Figure 3 e is that " voice record " chosen by selective power temporally condition entry is looked into it
It askes the date and phone number (caller or called number) carries out the process of inquiry operation.
Query case as illustrated in figure 3f is that " short chain " chosen by selective power inquires its input inquiry condition
The process of operation.Fig. 3 g are to click to open the operating result schematic diagram that a record therein checks details.Further, may be used also
Statistical disposition subsystem through the invention modifies to the original link content of the short chain, control collision number data
Ability, check short chain connect whether effectively.
Fig. 4 a~Fig. 4 b be using it is shown in FIG. 1 based on Java technology short message big data inquiry and analysis system carry out by
The accurate inquiry operation of channel grouping is inquired or statistical result, and exports the result schematic diagram of electrical form.
Query case as shown in fig. 4 a, be by channel be grouped down sub- channel carry out it is that precisely inquiry obtains as a result, and
Export the schematic diagram of Execl tables.
Whether query case as shown in Figure 4 b is to be connect comprising short chain by channel grouping lower template, and statistics is described short
The user click condition sample ie breakdown IE that the short chain for including in letter data connects.
Data output subsystem, including data display module and data match module.For according to the inquiry of user setting,
Obtained inquiry, statistical result are carried out Data Matching and displaying by statistical condition.Wherein：
The data display module, including be shown on the page of client or export to forms such as printers and opened up
Show.
The data match module, for showing pattern according to preset data, it is different flat to match to carry out data conversion
Platform (including Windows, ios system etc.), the client of different display modes (including mobile intelligent terminal, i.e. mobile phone, ipad,
Laptop, desktop computer display etc.) the correct display data output result.
The foregoing is only a preferred embodiment of the present invention, is not intended to limit the scope of the present invention.
Claims (10)
1. a kind of inquiry of short message big data and analysis system based on Java technology, which is characterized in that including：Digital independent subsystem
System, statistical disposition subsystem and data output subsystem；Wherein：
The digital independent subsystem is classified for reading or timing short message reading data in real time by short message service, and will
Classification results are exported to statistical disposition subsystem；
The statistical disposition subsystem, the sorted note data for receiving the statistical disposition subsystem output, passes through
Channel is grouped in deposit database after data aggregate processing, and data displaying and Data Matching are carried out for data output subsystem；
The data output subsystem, for the inquiry according to user setting, statistical condition, by obtained inquiry, statistical result
Carry out Data Matching and displaying.
2. the short message big data inquiry based on Java technology and analysis system according to claim 1, which is characterized in that described
Digital independent subsystem, including timer module and SMS classified module；Wherein：
Timer module, the timed task for being configured according to server execute SMS classified algorithm in the preset period
Note data is classified；
SMS classified module is realized according to service numbers or SMS classified model and sorting algorithm to read note data
Automating sorting function.
3. the short message big data inquiry based on Java technology and analysis system according to claim 2, which is characterized in that also wrap
It includes：
Machine learning module, for the service numbers according to read note data, in conjunction with the preset data of machine learning model
Algorithm carries out accurate intelligent classification to the note data；The data algorithm, including random forests algorithm.
4. the short message big data inquiry based on Java technology and analysis system according to claim 3, which is characterized in that described
Preset data algorithm further includes decision Tree algorithms in machine learning module.
5. the short message big data inquiry based on Java technology and analysis system according to claim 1, which is characterized in that described
Data output subsystem, including record queries module, channel grouping module and statistical form generation module；Wherein：
Record queries module looks into the note data of preservation in the database for the querying condition according to input
It askes, statistical operation；
Channel grouping module, it is SMS classified as a result, to the note data for being exported according to the digital independent subsystem
It is grouped by channel；
Statistical form generation module, for by the inquiry by the record queries module, statistical result, being converted into electronic watch trellis
Formula.
6. the short message big data inquiry based on Java technology and analysis system according to claim 5, which is characterized in that described
Data output subsystem further includes：
Data aggregate module, for carrying out polymerization processing to sorted note data according to preset data aggregate model,
One-to-one, one-to-many data correlation is obtained, to be associated inquiry to the sorted note data, association preserves and closes
Join the data manipulation deleted.
7. the short message big data inquiry based on Java technology and analysis system according to claim 5, which is characterized in that described
Channel grouping module is additionally operable to short message grouped data the aggregating algorithm built according to data aggregate model, to note data into
Row is further processed, and obtains precise classification result.
8. the short message big data inquiry based on Java technology and analysis system according to claim 1, which is characterized in that described
Data output subsystem, including：
Data display module, including be shown on the page of client or export to the form of printer and be shown；
Data match module, it is aobvious to match different platform, difference for according to preset data display pattern, carrying out data conversion
Show the correct display data output result of the client of pattern.
9. a kind of inquiry of short message big data and analysis method based on Java technology, which is characterized in that include the following steps：
A, using the real-time reading of digital independent subsystem or timing short message reading data, classify by short message service, and will divide
Class result exports the step of to statistical disposition subsystem；
B, the sorted note data of the statistical disposition subsystem output is received by the statistical disposition subsystem, and is led to
It is deposited into database after crossing channel grouping and data aggregate processing, data displaying and data is carried out for data output subsystem
The step of matching；
C, the inquiry using data output subsystem according to user setting, statistical condition carry out obtained inquiry, statistical result
The step of Data Matching and displaying.
10. the short message big data inquiry based on Java technology and analysis method according to claim 9, which is characterized in that also
Include the following steps：Service numbers using machine learning module according to read note data, it is pre- in conjunction with machine learning model
If data algorithm accurate intelligent classification is carried out to the note data；The data algorithm, including random forests algorithm；With
And
Using the data aggregate module being arranged in data output subsystem, according to preset data aggregate model to sorted short
Letter data carries out polymerization processing, obtains one-to-one, one-to-many data correlation, to be carried out to the sorted note data
Correlation inquiry, association preserve and the data manipulation of associated deletion.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810142022X | 2018-02-11 | ||
| CN201810142022 | 2018-02-11 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108509508A true CN108509508A (en) | 2018-09-07 |
Family
ID=63376264
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810188238.XA Pending CN108509508A (en) | 2018-02-11 | 2018-03-07 | Short message big data inquiry based on Java technology and analysis system and its method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108509508A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111885516A (en) * | 2020-07-09 | 2020-11-03 | 深圳市富之富信息技术有限公司 | Multi-channel access short message configuration method and device, computer equipment and storage medium |
| CN114003553A (en) * | 2021-09-27 | 2022-02-01 | 上海金慧软件有限公司 | Intelligent counting display method and device for drawing management |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120054132A1 (en) * | 2010-08-27 | 2012-03-01 | Douglas Aberdeen | Sorted Inbox with Important Message Identification Based on Global and User Models |
| CN105791543A (en) * | 2016-02-23 | 2016-07-20 | 北京奇虎科技有限公司 | Method, device, client and system for cleaning short messages |
| CN106534540A (en) * | 2016-11-17 | 2017-03-22 | 中卓信（北京）科技有限公司 | Communication information displaying method and device |
| CN107066553A (en) * | 2017-03-24 | 2017-08-18 | 北京工业大学 | A kind of short text classification method based on convolutional neural networks and random forest |
| CN107360331A (en) * | 2017-08-31 | 2017-11-17 | 江西博瑞彤芸科技有限公司 | Short message display method |
-
2018
- 2018-03-07 CN CN201810188238.XA patent/CN108509508A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120054132A1 (en) * | 2010-08-27 | 2012-03-01 | Douglas Aberdeen | Sorted Inbox with Important Message Identification Based on Global and User Models |
| CN105791543A (en) * | 2016-02-23 | 2016-07-20 | 北京奇虎科技有限公司 | Method, device, client and system for cleaning short messages |
| CN106534540A (en) * | 2016-11-17 | 2017-03-22 | 中卓信（北京）科技有限公司 | Communication information displaying method and device |
| CN107066553A (en) * | 2017-03-24 | 2017-08-18 | 北京工业大学 | A kind of short text classification method based on convolutional neural networks and random forest |
| CN107360331A (en) * | 2017-08-31 | 2017-11-17 | 江西博瑞彤芸科技有限公司 | Short message display method |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111885516A (en) * | 2020-07-09 | 2020-11-03 | 深圳市富之富信息技术有限公司 | Multi-channel access short message configuration method and device, computer equipment and storage medium |
| CN114003553A (en) * | 2021-09-27 | 2022-02-01 | 上海金慧软件有限公司 | Intelligent counting display method and device for drawing management |
| CN114003553B (en) * | 2021-09-27 | 2023-12-15 | 上海金慧软件有限公司 | Intelligent counting display method and device for drawing management |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111079022A (en) | Personalized recommendation method, device, equipment and medium based on federal learning | |
| CN104572688A (en) | Information push method and device | |
| CN106022708A (en) | Method for predicting employee resignation | |
| CN103942220A (en) | Method used for intelligently linking work orders with knowledge of knowledge base and suitable for IT operation and maintenance system | |
| CN105791543A (en) | Method, device, client and system for cleaning short messages | |
| CN103379020A (en) | Method and system for massively sending emails | |
| CN111552885A (en) | System and method for realizing automatic real-time message pushing operation | |
| CN108509508A (en) | Short message big data inquiry based on Java technology and analysis system and its method | |
| CN110213152B (en) | Method, device, server and storage medium for identifying junk mails | |
| CN107644106A (en) | The internuncial method of automatic mining business, terminal device and storage medium | |
| CN102945246A (en) | Method and device for processing network information data | |
| CN107358269B (en) | Construction method of telecom user consumption portrait for precise marketing | |
| CN111754208A (en) | Automatic screening method for recruitment resumes | |
| US20170161285A1 (en) | Computer-readable recording medium, display control method, and information processing device | |
| CN105589900A (en) | Data mining method based on multi-dimensional analysis | |
| CN111831817A (en) | Questionnaire generation and analysis method and device, computer equipment and readable storage medium | |
| CN109063063B (en) | Data processing method and device based on multi-source data | |
| CN115687788A (en) | Intelligent business opportunity recommendation method and system | |
| CN115329078A (en) | Text data processing method, device, equipment and storage medium | |
| CN110677269A (en) | Method and device for determining communication user relationship and computer readable storage medium | |
| CN115051859A (en) | Information analysis method, information analysis device, electronic apparatus, and medium | |
| CN103107936B (en) | A kind of method and device sending information | |
| CN111488369A (en) | Agricultural science and technology consultation service platform | |
| CN112860899A (en) | Label generation method and device, computer equipment and computer readable storage medium | |
| CN112507213A (en) | Method for recommending optimized system scheme based on behavior big data analysis |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180907 |