CN109542902A - A kind of data processing system and method - Google Patents
A kind of data processing system and method Download PDFInfo
- Publication number
- CN109542902A CN109542902A CN201811341787.2A CN201811341787A CN109542902A CN 109542902 A CN109542902 A CN 109542902A CN 201811341787 A CN201811341787 A CN 201811341787A CN 109542902 A CN109542902 A CN 109542902A
- Authority
- CN
- China
- Prior art keywords
- data
- database
- computation module
- data processing
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
- G06F9/485—Task life-cycle, e.g. stopping, restarting, resuming execution
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of data processing system and method, the data processing system includes database, data computation module, data control block and timing control module, the data computation module, for being analyzed and processed to the data in the database；The data control block is handled for obtaining data from the database to the data computation module, and the data obtained after data computation module processing are stored in the database in corresponding tables of data；The timing control module for setting the working hour of the data computation module, and controls within the period of setting the data control block and obtains data from the database and handled to the data computation module.Data processing system and method for the invention can save server computing resource and user can be allowed to obtain data in time.
Description
Technical field
The present invention relates to data processing field more particularly to a kind of data processing systems and method.
Background technique
With the fast development of computer and information technology, data caused by application system are in explosive increase, data
Therefore amount, seeks effective big data processing technique far beyond the processing capacity of traditional calculations technology and information system,
Especially seek effective big data statistical analysis technique, has become this field and urgently solve the problems, such as.
In order to realize that big data statisticallys analyze, it has to be possible to collect data on a large scale.Traditional data collection mode is
Data are uploaded by client, server according to corresponding interface or the type of data, by the data that client uploads save to
In corresponding tables of data.
In general, user when checking data, does not need to be immediately seen initial data itself, but wish to these
Data carry out the data that show after big data calculating and processing, however, according to the difference of user demand, big data calculate and
The mode of processing is also different.When checking data, server needs in real time calculate these initial data user accordingly,
Then it could show for user as a result, causing to consume a large amount of server computing resource, user can not be obtained in time
Desired data.
Summary of the invention
The purpose of the present invention is in view of the above-mentioned drawbacks of the prior art, server computing resource can be saved by providing one kind
And user can be allowed to obtain the data processing system and method for data in time.
In the embodiment of the present invention, a kind of data processing system is provided comprising database, data computation module, data
Control module and timing control module,
The data computation module, for being analyzed and processed to the data in the database；
The data control block is handled for obtaining data from the database to the data computation module, and
The data obtained after data computation module processing are stored in the database in corresponding tables of data；
Timing control module for setting the working hour of the data computation module, and controls institute within the period of setting
It states data control block and obtains data from the database and handled to the data computation module.
In the embodiment of the present invention, the data processing system further include:
Data display module, the data for obtaining corresponding data table from the database are shown.
In the embodiment of the present invention, the data control block carries out the database according to the SQL statement write in advance
The operation of reading data and data write-in.
In the embodiment of the present invention, the data computation module is according to the pre-set demand of user to phase in the database
The data answered carry out Data Analysis Services, obtain the data of user's needs.
In the embodiment of the present invention, the timing control module includes:
Timing unit, for the working hour of the data computation module to be arranged；
Judging unit, for judging current time whether within the working hour of the data computation module；
Control unit, for controlling the data meter when current time is not within the working hour of the data computation module
It calculates module and enters sleep state, when current time is within the working hour of the data computation module, control the data control
Molding block obtains data from the database and is handled to the data computation module.
In the embodiment of the present invention, the judging unit at interval of setting time to current time whether in the data meter
It calculates and is judged in the working hour of module.
In the embodiment of the present invention, a kind of data processing method is additionally provided comprising:
Judgment step: judge current time whether within the data processing period of setting；
Data processing step: if current time within the data processing period of setting, obtains data from database and counted
According to processing, and will be in the storage of processed data in the database corresponding tables of data.
In the embodiment of the present invention, the data processing method further include:
Sleep step: if current time not within the data processing period of setting, enters dormant state, stop carrying out data
Processing.
In the embodiment of the present invention, the data processing method further include:
Data show step: the data that corresponding data table is obtained from database are shown.
In the embodiment of the present invention, before the judgment step, further includes:
Timed step: the data processing period is configured.
Compared with prior art, in data processing system and method for the invention, the data processing period is pre-set,
If current time within the data processing period of setting, obtains data from database and carries out data processing, and will processing
The data storage crossed is in the database in corresponding tables of data, can will treated that data carry out persistent storage, be subsequent
It checks that various data provide convenience, improves user experience effect；If current time not within the data processing period of setting,
Into suspend mode shape body, stops carrying out data processing, saved server computing resource.
Detailed description of the invention
Fig. 1 is the structural schematic diagram of the data processing system of the embodiment of the present invention；
Fig. 2 is the structural schematic diagram of the timing module in Fig. 1；
Fig. 3 is the flow chart of the data processing method of the embodiment of the present invention.
Specific embodiment
As shown in Figure 1, providing a kind of data processing system in the embodiment of the present invention comprising database 11, data meter
Calculate module 12, data control block 13, timing control module 14 and data display module 15.It is illustrated separately below.
The database 11, for being stored to data.The database 11 is using different tables of data to different numbers
It is stored according to the data of format.
The data computation module 12, for being analyzed and processed to the data in the database 11.The data meter
It calculates module 12 and Data Analysis Services is carried out to data corresponding in the database 11 according to the pre-set demand of user, obtain
The data that user needs.
The data control block 13, for from the database 11 obtain data to the data computation module 12 into
Row processing, and the data obtained after the data computation module 12 processing are stored in corresponding tables of data in the database 11
In.The data control block 13 carries out reading data to the database 11 according to the SQL statement write in advance and data are write
The operation entered.
Timing control module 14, for setting the working hour of the data computation module, and within the period of setting
It controls the data control block and obtains data from the database and handled to the data computation module.
It should be noted that the database 11, the data computation module 12, the data control block 13, described
Timing control module 14 is set in special server, and the server is configured for storage and processing data.
As shown in Fig. 2, the timing control module 14 includes timing unit 141, judging unit 142 and control unit 143.
The timing unit 141, for the working hour of the data computation module 12 to be arranged.It preferably, can be by institute
The working hour for stating data computation module 12 is set as the idle period of server.
The judging unit 142, for judging current time whether within the working hour of the data computation module 12.
Whether the time that the judging unit is set at interval of one is to current time within the working hour of the data computation module
Judged, occupies and waste to reduce system resource caused by real-time judge.
Described control unit 143, for controlling when current time is not within the working hour of the data computation module 12
The data computation module 12 is made into sleep state, in current time within the working hour of the data computation module 12
When, the data control block 13 is controlled from obtaining data in the database 11 to the data computation module 12 and carrying out
Reason.
The data display module 15, the data for obtaining corresponding data table from the database are shown.
As shown in figure 3, additionally providing a kind of data processing method in the embodiment of the present invention comprising:
Step S1, timed step: being configured the data processing period, can set the data processing period to the free time of server
Period；
Step S2, judgment step: judge current time whether within the data processing period of setting；
Step S3, data processing step: if current time obtains data within the data processing period of setting from database
Data processing is carried out, and will be in the storage of processed data in the database corresponding tables of data；
Step S4, sleep step: if current time not within the data processing period of setting, enters dormant state, stop
Carry out data processing；
Step S5, data show step: the data that corresponding data table is obtained from database are shown.
In conclusion the data processing period is pre-set in data processing system and method for the invention, if currently
Time obtains data from database within the data processing period of setting, then and carries out data processing, and by processed data
Storage is in the database in corresponding tables of data, can will treated that data carry out persistent storage, for it is subsequent check it is various
Data provide convenience, improve user experience effect；If current time not within the data processing period of setting, enters suspend mode
Shape body stops carrying out data processing, has saved server computing resource.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the invention
Made any modifications, equivalent replacements, and improvements etc., should all be included in the protection scope of the present invention within mind and principle.
Claims (10)
1. a kind of data processing system, which is characterized in that including database, data computation module, data control block and timing
Control module,
The data computation module, for being analyzed and processed to the data in the database；
The data control block is handled for obtaining data from the database to the data computation module, and
The data obtained after data computation module processing are stored in the database in corresponding tables of data；
The timing control module, for setting the working hour of the data computation module, and in the period internal control of setting
It makes the data control block and obtains data from the database and handled to the data computation module.
2. data processing system as described in claim 1, which is characterized in that further include:
Data display module, the data for obtaining corresponding data table from the database are shown.
3. data processing system as described in claim 1, which is characterized in that the data control block according to writing in advance
SQL statement carries out the operation of reading data and data write-in to the database.
4. data processing system as described in claim 1, which is characterized in that the data computation module is set in advance according to user
The demand set carries out data processing to data corresponding in the database, obtains the data of user's needs.
5. data processing system as described in claim 1, which is characterized in that the timing control module includes:
Timing unit, for the working hour of the data computation module to be arranged；
Judging unit, for judging current time whether within the working hour of the data computation module；
Control unit, for controlling the data meter when current time is not within the working hour of the data computation module
It calculates module and enters sleep state, when current time is within the working hour of the data computation module, control the data control
Molding block obtains data from the database and is handled to the data computation module.
6. data processing system as claimed in claim 5, which is characterized in that time pair of the judging unit at interval of setting
Whether current time is judged within the working hour of the data computation module.
7. a kind of data processing method characterized by comprising
Judgment step: judge current time whether within the data processing period of setting；
Data processing step: if current time within the data processing period of setting, obtains data from database and counted
According to processing, and will be in the storage of processed data in the database corresponding tables of data.
8. data processing method as claimed in claim 7, which is characterized in that further include:
Sleep step: if current time not within the data processing period of setting, enters dormant state, stop carrying out data
Processing.
9. data processing method as claimed in claim 7, which is characterized in that further include:
Data show step: the data that corresponding data table is obtained from database are shown.
10. data processing method as claimed in claim 7, which is characterized in that before the judgment step, further includes:
Timed step: the data processing period is configured.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811341787.2A CN109542902A (en) | 2018-11-12 | 2018-11-12 | A kind of data processing system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811341787.2A CN109542902A (en) | 2018-11-12 | 2018-11-12 | A kind of data processing system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109542902A true CN109542902A (en) | 2019-03-29 |
Family
ID=65846829
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811341787.2A Pending CN109542902A (en) | 2018-11-12 | 2018-11-12 | A kind of data processing system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109542902A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1642097A (en) * | 2004-01-02 | 2005-07-20 | 联想(北京)有限公司 | Journal accounting method and system |
| US20090234793A1 (en) * | 2008-03-17 | 2009-09-17 | Ricoh Company, Ltd.. | Data processing apparatus, data processing method, and computer program product |
| CN102929899A (en) * | 2011-12-31 | 2013-02-13 | 网神信息技术（北京）股份有限公司 | Distributed reporting system based on intermediate table |
| CN103974394A (en) * | 2014-05-30 | 2014-08-06 | 深圳市中兴移动通信有限公司 | Mobile terminal and power consumption control method thereof |
| CN105069117A (en) * | 2015-08-11 | 2015-11-18 | 国网技术学院 | Data flow efficiency improving method based on storage process |
| CN105786956A (en) * | 2016-01-08 | 2016-07-20 | 国家电网公司 | Power business data mining method based on business application system |
| CN106446046A (en) * | 2016-08-31 | 2017-02-22 | 山东威尔数据股份有限公司 | Method for timely and rapidly analyzing records in relational database |
| CN108491467A (en) * | 2018-03-06 | 2018-09-04 | 广州微易软件有限公司 | An a kind of key generates the method and platform of analysis of financial statement report |
-
2018
- 2018-11-12 CN CN201811341787.2A patent/CN109542902A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1642097A (en) * | 2004-01-02 | 2005-07-20 | 联想(北京)有限公司 | Journal accounting method and system |
| US20090234793A1 (en) * | 2008-03-17 | 2009-09-17 | Ricoh Company, Ltd.. | Data processing apparatus, data processing method, and computer program product |
| CN102929899A (en) * | 2011-12-31 | 2013-02-13 | 网神信息技术（北京）股份有限公司 | Distributed reporting system based on intermediate table |
| CN103974394A (en) * | 2014-05-30 | 2014-08-06 | 深圳市中兴移动通信有限公司 | Mobile terminal and power consumption control method thereof |
| CN105069117A (en) * | 2015-08-11 | 2015-11-18 | 国网技术学院 | Data flow efficiency improving method based on storage process |
| CN105786956A (en) * | 2016-01-08 | 2016-07-20 | 国家电网公司 | Power business data mining method based on business application system |
| CN106446046A (en) * | 2016-08-31 | 2017-02-22 | 山东威尔数据股份有限公司 | Method for timely and rapidly analyzing records in relational database |
| CN108491467A (en) * | 2018-03-06 | 2018-09-04 | 广州微易软件有限公司 | An a kind of key generates the method and platform of analysis of financial statement report |
Non-Patent Citations (1)
| Title |
|---|
| 匿名: ""中间表方案解决大数据量报表性能问题"", 《百度URL:WWW.GEEZN.COM/ARCHIVES/2747/》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10643110B2 (en) | Systems and methods for inferential sharing of photos | |
| EP4293516A3 (en) | Method and system for enhancing a user interface for a web application | |
| EP3486769A1 (en) | Method for preloading application, terminal device, and medium | |
| CN111050280B (en) | Attendance positioning judgment method, attendance method and system and mobile terminal | |
| CN106662970B (en) | Method and device for setting interruption threshold of fingerprint identifier and terminal equipment | |
| EP3748470A1 (en) | Resource scheduling method and terminal device | |
| CN108491122B (en) | Click event response method, computer readable storage medium and terminal equipment | |
| CN109492024A (en) | Data processing method, device, computer equipment and storage medium | |
| CN108874535A (en) | A kind of task adjusting method, computer readable storage medium and terminal device | |
| CN104219747B (en) | Method, device and terminal for adjusting wake-up time according to electric quantity information | |
| CN109033472A (en) | Picture retrieval method and device, computer equipment and computer-readable medium | |
| CN105678986A (en) | Individual water consumption metering system and method | |
| CN109542902A (en) | A kind of data processing system and method | |
| CN113191891A (en) | Data processing method, device and system | |
| CN110688451A (en) | Evaluation information processing method, evaluation information processing device, computer device, and storage medium | |
| CN109241146A (en) | Student's intelligence aid method and system under cluster environment | |
| CN110083624B (en) | Stream data processing method, stream data processing apparatus, and computer medium | |
| CN106815727B (en) | Information risk assessment method and device | |
| CN109408353B (en) | Storage partition utilization rate and IOPS analysis method, system and terminal equipment | |
| CN103632238A (en) | Method and device for identifying financial difficulty students on basis of smart card consumption behavior analysis | |
| CN115915237A (en) | Energy-saving measuring and calculating method and device for base station equipment and calculating equipment | |
| CN101866459A (en) | Data acquisition method and data acquisition device | |
| CN109917916A (en) | E-book control method, electronic equipment and computer readable storage medium | |
| CN112148470A (en) | Parameter synchronization method, computer device and readable storage medium | |
| CN116697497B (en) | Method, device, equipment and storage medium for controlling ventilation air conditioning system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190329 |