CN108287890A - Data managing method and device - Google Patents
Data managing method and device Download PDFInfo
- Publication number
- CN108287890A CN108287890A CN201810046305.4A CN201810046305A CN108287890A CN 108287890 A CN108287890 A CN 108287890A CN 201810046305 A CN201810046305 A CN 201810046305A CN 108287890 A CN108287890 A CN 108287890A
- Authority
- CN
- China
- Prior art keywords
- data
- pending data
- pending
- target
- written
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2462—Approximate or statistical queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
- G06F16/24534—Query rewriting; Transformation
- G06F16/24535—Query rewriting; Transformation of sub-queries or views
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- Probability & Statistics with Applications (AREA)
- Software Systems (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Information Transfer Between Computers (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
A kind of data managing method of present invention offer and device, are related to technical field of data processing.Message queue is written by the pending data that will be obtained in this programme, contributes to the reception of follow-up data；Pending data is read from message queue, and the system list in management terminal is written into the pending data of reading；Every the first preset duration, interim table is written into as target pending data, and by target pending data in the pending data that system list is written in the second preset duration, wherein the second preset duration is less than or equal to first preset duration；By drawing to the target pending data in interim table, plotting speed is helped to improve；It is drawn based on the variable data in the target pending data in corresponding preset threshold range, contributes to Exception Filter data, to improve the accuracy and reliability that wait for draw data.
Description
Technical field
The present invention relates to technical field of data processing, in particular to a kind of data managing method and device.
Background technology
In hydrology comprehensive monitoring field, it usually needs in conjunction with satellite, air remote sensing and the monitoring on ground terminal, to realize
Various meteorological, the hydrology and the ecosystem monitorings.In monitoring process, because the region area of monitoring is wider, the sensor being related to
Type and quantity are more, and the type of obtained monitoring data is various, and data volume is big.In the prior art, usually by manually to prison
Measured data carries out classification processing, to obtain corresponding chart.However, Man Graphics inefficiency is held in data transfer process
It is error-prone, it is unfavorable for handling mass data, that is, the mode of manual work is not particularly suited for handling a large amount of monitoring data.
Invention content
It, can be to big in order to overcome above-mentioned deficiency in the prior art, a kind of data managing method of present invention offer and device
Amount pending data automatically processes to form observation report, the efficiency to data processing is helped to improve, to solve the above problems.
To achieve the goals above, the technical solution that present pre-ferred embodiments are provided is as follows：
Present pre-ferred embodiments provide a kind of data managing method, are applied to management terminal, the method includes：
Pending data is obtained, and message queue is written into the pending data；
The pending data is read from the message queue, and the management is written into the pending data of reading
System list in terminal；
Every the first preset duration, will be written in the second preset duration the pending data of the system list as
Target pending data, and interim table is written into the target pending data, wherein second preset duration is less than or waits
In first preset duration；
By variable of the variable data in the target pending data in the interim table in corresponding preset threshold range
Data, which are used as, waits for draw data, and waits for that draw data and pre-set image generation strategy generate observation report according to described, wherein institute
It includes waiting for the corresponding statistical chart of draw data with described to state observation report.
Optionally, at least one of above-mentioned management terminal and Hydrological observation system data acquisition device communicate to connect, often
The step of a data acquisition device is previously provided with identity, the acquisition pending data, including：
The pending number is obtained from at least partly data acquisition device at least one data acquisition device
According to, wherein the pending data is associated with the identity of the data acquisition device.
Optionally, above system list includes at least one sublist list, and the method further includes：
A sub- list is created every third preset duration, and is target sublist list, the target by the sublist nonoculture
Sublist is applied alone to be read to during creating new sublist list from the message queue after the establishment target sublist list certainly is written
The pending data, wherein the third preset duration be more than or equal to first preset duration.
Optionally, the step of above-mentioned system list pending data of reading being written in the management terminal it
Before, the method further includes：
Judge that the management terminal whether there is the target sublist list, if it has not, creating the target sublist list.
Optionally, the variable data in the above-mentioned target pending data by the interim table is in corresponding predetermined threshold value model
Variable data in enclosing is used as the step of waiting for draw data, including：
By variable of the variable data in the target pending data in the interim table in corresponding preset threshold range
Number is converted to the variable data of JSON formats, and the variable data of JSON formats is waited for draw data as described in.
Optionally, above-mentioned management terminal is connect with the server communication for being provided with user account in advance, and the method is also wrapped
It includes：
The observation report is converted to the observation report of PDF format, and the observation report of PDF format is sent to
The server.
Optionally, waited for described in above-mentioned basis the step of draw data and pre-set image generation strategy generate observation report it
Afterwards, the method further includes：
Remove the target pending data in the interim table.
Optionally, above-mentioned statistical chart includes：In bar shaped statistical chart, broken line graph, pictograph statistical chart and fan-shaped statistical chart
At least one statistical chart.
Present pre-ferred embodiments also provide a kind of data administrator, are applied to management terminal, the data management dress
Set including：
Writing unit is obtained, message queue is written for obtaining pending data, and by the pending data；
First reads writing unit, for reading the pending data from the message queue, and will be described in reading
The system list in the management terminal is written in pending data；
Second reads writing unit, for every the first preset duration, the system will to be written in the second preset duration
Interim table is written as target pending data, and by the target pending data in the pending data of system list, wherein institute
It states the second preset duration and is less than or equal to first preset duration；
Report generation unit, for presetting the variable data in the target pending data in the interim table corresponding
Variable data in threshold range, which is used as, waits for draw data, and waits for that draw data and pre-set image generation strategy generate according to described
Observation report, wherein the observation report includes waiting for the corresponding statistical chart of draw data with described.
Optionally, at least one of above-mentioned management terminal and Hydrological observation system data acquisition device communicate to connect, often
A data acquisition device is previously provided with identity, and the acquisition writing unit is used for：
The pending number is obtained from at least partly data acquisition device at least one data acquisition device
According to, wherein the pending data is associated with the identity of the data acquisition device.
In terms of existing technologies, data managing method and device provided by the invention at least have below beneficial to effect
Fruit：
Data managing method includes：Pending data is obtained, and message queue is written into pending data；From message queue
Pending data is read, and the system list in management terminal is written into the pending data of reading；Every the first preset duration,
The pending data of system list will be written in the second preset duration as target pending data, and target is pending
Interim table is written in data, wherein the second preset duration is less than or equal to first preset duration；Target in interim table is waited for
Variable data of the variable data in corresponding preset threshold range in processing data, which is used as, waits for draw data, and is waited for according to described
Draw data and pre-set image generation strategy generate observation report, wherein observation report includes system corresponding with draw data is waited for
Meter figure.Message queue is written by the pending data that will be obtained in this programme, contributes to the reception of follow-up data；By to interim
Target pending data in table is drawn, and plotting speed is helped to improve；Based on the change in corresponding preset threshold range
Amount data are drawn, and Exception Filter data are contributed to, to improve the accuracy and reliability that wait for draw data.
To enable the above objects, features and advantages of the present invention to be clearer and more comprehensible, present pre-ferred embodiments cited below particularly,
And coordinate appended attached drawing, it is described in detail below.
Description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be to needed in the embodiment attached
Figure is briefly described.It should be appreciated that the following drawings illustrates only certain embodiments of the present invention, therefore it is not construed as pair
The restriction of range for those of ordinary skill in the art without creative efforts, can also be according to this
A little attached drawings obtain other relevant attached drawings.
Fig. 1 is the interaction schematic diagram of management terminal and data acquisition device that present pre-ferred embodiments provide.
Fig. 2 is the flow diagram for the data managing method that present pre-ferred embodiments provide.
Fig. 3 is the friendship of management terminal, server, user terminal, data acquisition device that present pre-ferred embodiments provide
Mutual schematic diagram.
Fig. 4 is the block diagram for the data administrator that present pre-ferred embodiments provide.
Icon：10- management terminals；11- processing units；12- communication units；13- storage units；100- data managements fill
It sets；110- obtains writing unit；120- first reads writing unit；130- second reads writing unit；140- report generation lists
Member；20- data acquisition devices；30- servers；40- user terminals.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation describes.Obviously, described embodiment is only a part of the embodiment of the present invention, instead of all the embodiments.It is logical
The component for the embodiment of the present invention being often described and illustrated herein in the accompanying drawings can be arranged and be designed with a variety of different configurations.
Therefore, below the detailed description of the embodiment of the present invention to providing in the accompanying drawings be not intended to limit it is claimed
The scope of the present invention, but be merely representative of the present invention selected embodiment.Based on the embodiment of the present invention, people in the art
The every other embodiment that member is obtained without making creative work, shall fall within the protection scope of the present invention.
It should be noted that：Similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined, then it further need not be defined and explained in subsequent attached drawing in a attached drawing.In addition, term " the
One ", " second " etc. is only used for distinguishing description, is not understood to indicate or imply relative importance.
Below in conjunction with the accompanying drawings, it elaborates to some embodiments of the present invention.In the absence of conflict, following
Feature in embodiment and embodiment can be combined with each other.
Fig. 1 is please referred to, the management terminal 10 and the interaction of data acquisition device 20 provided for present pre-ferred embodiments is shown
It is intended to.Management terminal 10 provided by the invention can be established by network at least one data acquisition device 20 and be communicated to connect,
To carry out data interaction.The management terminal 10 may include processing unit 11, storage unit 13, communication unit 12 and data management
Device 100.Between the processing unit 11,100 each element of storage unit 13, communication unit 12 and data administrator directly
Or be electrically connected indirectly, to realize the transmission or interaction of data.For example, these elements can pass through one or more between each other
Communication bus or signal wire, which are realized, to be electrically connected.
Further, management terminal 10 may be, but not limited to, smart mobile phone, PC (personal
Computer, PC), tablet computer, personal digital assistant (personal digital assistant, PDA), mobile Internet access set
Standby (mobile Internet device, MID) etc..Data acquisition device 20 is the equipment for acquiring hydrological environment data,
The data acquisition device 20 is provided with instrument or sensor for acquiring corresponding data.For example, data acquisition device 20 is arranged
There are at least one of temperature sensor, humidity sensor, water flow monitor, locating module, wind speed and direction detector, it can be with
For acquiring water temperature data, soil temperature data, soil moisture data, water flow data, geographic position data, wind speed and direction number
According to etc. data.Understandably, a data acquisition device 20 can be used for acquiring a type of data, can also acquire a variety of
Different types of data (for example Soil Temperature And Moisture degrees of data, wind speed and direction data can be acquired simultaneously etc.), it is not especially limited here.
In the present embodiment, above-mentioned network may be, but not limited to, cable network or wireless network.Preferably, the network
For wireless network.
In the present embodiment, processing unit 11 is processor.The processor can be central processing unit (Central
Processing Unit, CPU), graphics processor (Graphics Processing Unit, GPU), network processing unit
(Network Processor, NP) etc.；It can also be digital signal processor (DSP), application-specific integrated circuit (ASIC), scene
Programmable gate array (FPGA) either other programmable logic device, discrete gate or transistor logic, discrete hardware group
Part.It may be implemented or execute disclosed each method, step and the logic diagram in the embodiment of the present invention.
In the present embodiment, communication unit 12 is used to establish leading to for management terminal 10 and data acquisition device 20 by network
Letter connection, and pass through the network transceiving data.Preferably, which is wireless communication module.
In the present embodiment, storage unit 13 may be, but not limited to, random access memory, read-only memory, can compile
Journey read-only memory, Erasable Programmable Read Only Memory EPROM, electrically erasable programmable read-only memory etc..In the present embodiment,
The storage unit 13 can be used for storing pending data, visual report.Certainly, the storage unit 13 can be also used for depositing
Program is stored up, the processing unit 11 executes the program after receiving and executing instruction.
Further, data administrator 100 can be deposited including at least one in the form of software or firmware (firmware)
The software work(for being stored in the storage unit 13 or being solidificated in 10 operating system of management terminal (operating system, OS)
It can module.The processing unit 11 is for executing the executable module stored in the storage unit 13, such as data management dress
Set software function module and the computer program etc. included by 100.
It is understood that 10 structure of management terminal shown in FIG. 1 is only a kind of structural schematic diagram, the management terminal 10
Can also include than more or fewer components shown in Fig. 1.Hardware, software or its group may be used in each component shown in Fig. 1
It closes and realizes.
Fig. 2 is please referred to, for the flow diagram for the data managing method that present pre-ferred embodiments provide.The present invention provides
Data managing method can be applied to above-mentioned management terminal 10, which can carry out mass data visual
Change is handled, and helps to improve the efficiency to data visualization processing, the observation formed based on pending data is checked convenient for user
Report.
Each step of data managing method provided in this embodiment will be described in detail below, in the present embodiment,
Data managing method may comprise steps of.
Step S210 obtains pending data, and message queue is written in the pending data.
In the present embodiment, 20 communication link of at least one of management terminal 10 and Hydrological observation system data acquisition device
It connects, each data acquisition device 20 is previously provided with identity, and at least one data acquisition device 20 forms the hydrology and sees
Examining system, the related data for acquiring ecological environment.For example, can be used for acquiring the related data of river and surrounding enviroment
(such as water temperature data, Soil Temperature And Moisture degrees of data etc.), for geological environment exploration, climatic study etc..Management terminal 10 can be with
Pending data is got from at least partly harvester at least one harvester, the pending number that then will be got
According to write-in message queue.The measure that pending data is written to message queue, can make data receiver and data loading need not be simultaneously
It carries out, even if storage program interrupt, only makes data accumulate in the queue, do not interfere with the reception of follow-up data.
Wherein, pending data is associated with the acquisition identity of data collection station of the pending data, so that
The information of the data collection station can be obtained based on the identity from the pending data by obtaining management terminal 10.The information can be with
The title etc. of identity information, geographic position data, data collection station including data collection station.The identity can be
The identification code of number and/or character string composition, that is, each data acquisition device 20 have unique identity.In addition,
The pending data is the data such as above-mentioned water temperature data, soil temperature data, soil moisture data.
Step S220 reads the pending data from the message queue, and the pending data of reading is write
Enter the system list in the management terminal 10.
In the present embodiment, system list can be regarded as database, may include multiple sublist lists, and each sublist list can be with
Store the pending data in a certain amount of or a period of time.It is set for example, a sub- list can be used for storing at least partly acquisition
Standby one day pending data acquired, is here not especially limited sub- list storage mode.Step S220 will be it is understood that will
Pending data in message queue carries out in-stockroom operation, to be waited for from what message queue was read by the storage record of management terminal 10
Handle data.
Step S230 will be written to the system list in the second preset duration and wait locating every the first preset duration
Data are managed as target pending data, and by the interim table of target pending data write-in, wherein it is described second it is default when
It is long to be less than or equal to first preset duration.
Understandably, at least partly data in all data data acquisition device 20 in one day acquired are as mesh
Pending data is marked, and interim table is written into target pending data, in order to draw to the data in interim table.And face
When table create in the caching of management terminal 10, interim table is written into target pending data, helps to improve drafting statistical chart
Plotting speed.Wherein, first it is default be longer than the second preset duration and can be configured as the case may be, do not limit specifically here
It is fixed.
In the present embodiment, corresponding pending data can be carried out based on the geographical location of data acquisition device 20
Grouping storage.For example, in the pending data storage to the same sublist that the data acquisition device 20 in predeterminable area is acquired,
In order to be observed statistics to the collected data of different regions institute to user.Wherein, predeterminable area can be according to actual conditions
It is configured, is not especially limited here.
Step S240, by the variable data in the target pending data in the interim table in corresponding preset threshold range
Interior variable data, which is used as, waits for draw data, and waits for that draw data and pre-set image generation strategy generate observation report according to described
It accuses, wherein the observation report includes waiting for the corresponding statistical chart of draw data with described.
In the present embodiment, variable data, which can be regarded as the data that harvester acquires, to be changed by the transformation of external environment
The data of change.Variable data includes, but are not limited to the data such as temperature data, wind speed and direction data, Soil Temperature And Moisture degrees of data, here
It is not especially limited.Management terminal 10 can be based on waiting for that draw data and pre-set image generation strategy generate observation report.
For example, for the pending data obtained from the data acquisition device 20 in same predeterminable area in one day, it can root
Classify according to the type of pending data, and the predetermined threshold value model based on every class pending data and per class pending data
It encloses, generates statistical chart corresponding with per class pending data, all statistical charts can form the observation of the same day predeterminable area
Report.Wherein, preset threshold range can be configured according to actual conditions, for filter it is pending in abnormal data or mistake
Data.For example, because abnormal (for example, above-mentioned various kinds of sensors is damaged) occurs in data acquisition device 20, acquires and fill from data
The observation for setting the pending data that 20 get is -99999, and pre-sets threshold range, can filter this kind of exception
Data, and then help to improve the accuracy and reliability of draw data so that observation includes the statistical chart of presentation closer in fact
Border situation.
In the present embodiment, statistical chart may be, but not limited to, bar shaped statistical chart, broken line graph, pictograph statistical chart and
Fan-shaped statistical chart, is not especially limited here.
Optionally, step S240 is specifically as follows：By the variable data in the target pending data in interim table right
It answers the variable number in preset threshold range to be converted to the variable data of JSON formats, and the variable data of JSON formats is made
Draw data is waited for be described.
Understandably, JSON formats be a kind of data interchange format of lightweight.By the way that variable data is converted to
The variable data of JSON formats helps to be easy to developer's reading and write, while being also easy to machine parsing and generating, and helps
In the consumption for reducing memory source, to promote drawing rate.
In the present embodiment, statistical chart corresponding with pending data is drawn based on pending data to can be regarded as treating place
It manages data and carries out visualization processing.The visualization tool usable Highcharts (statistical graph) to increase income and Highstock (when
Between sequence data show), to obtain all types of statistical charts.
Optionally, after step S240, data managing method can also include：Remove the target in the interim table
Pending data.
It understandably, can will be in interim table after the target pending data in interim table is drawn into statistical chart
Target pending data delete, to reduce the occupancy of memory source.In addition, after deleting target pending data, this is interim
Table can be also used for that the pending data in other sublists is written, using as new target pending data.
Optionally, data managing method can also include：A sub- list is created every third preset duration, and will be described
Sublist nonoculture is target sublist list, and the target sublist, which is applied alone, extremely to be created newly in write-in from after creating the target sublist list
The pending data read from the message queue during sublist list, wherein the third preset duration is more than or equal to institute
State the first preset duration.
Understandably, in the sublist list of system list, target sublist list is the list for being currently performed write operation.And
Other sublist lists are usually the sublist list that the pending data having been based in its sublist list generates observation report.In view of obtaining
The data volume of the pending data taken is big, can create a new sublist list every third preset duration, new sublist list is
As target sublist list, for being written from after creating the sublist list to creating during next new sublist list from message queue
The pending data of reading.The larger list of data volume is namely divided into the smaller list of multiple data volumes, is convenient for user
Management is checked.
In the present embodiment, judge that the management terminal 10 whether there is the target sublist list in step, if it has not, wound
Build the target sublist list.
For example, a sub- list is created daily, using as target sublist list.Pending data will be being read from message queue
Before writing system list, judge the same day whether created sublist list, if not creating sublist list, create a sub- list with
As target sublist list.If establishment has sublist list, the sublist list is written in the pending data of reading, and (the sublist list is namely
Target sublist list).
Fig. 3 is please referred to, management terminal 10, server 30, user terminal 40, the data provided for present pre-ferred embodiments
The interaction schematic diagram of harvester 20.In the present embodiment, management terminal 10 and the server 30 for being provided with user account in advance
Communication connection.Data managing method can also include after step S240：The observation report is converted into PDF format
Observation report, and the observation report of PDF format is sent to the server 30.
In the present embodiment, the file format for the observation report that management terminal 10 generates is usually Html formats, Html lattice
The observation report of formula is not easy to user and opens the content checked in observation report file.It can be by by the observation report of Html formats
The observation report for being converted to PDF format, in order to which user opens.In addition, management terminal 10 can send out the observation report of PDF format
It send to server 30, so that the storage of server 30 records the observation report.
Further, server 30 can be communicated to connect at least one user terminal 40, and user can pass through user terminal
Corresponding application program login user account on 40 is based on the user account, can be obtained from server 30 and check PDF format
Observation report.
Specifically, for example, observation report can be sent to the corresponding server 30 of subscriber mailbox, and the sight by management terminal 10
Announcement is observed and predicted to be stored in the mailbox of the user account.When user logs in the mailbox of the user by user terminal 40, Bian Kejie
The observation report for receiving the PDF format sent from server 30, facilitates user to check observation report.Wherein, management terminal 10 will
The user account that examining report is sent to server 30 is advance associated user account, can be configured according to actual conditions.
It is worth noting that user terminal 40 may be, but not limited to, smart mobile phone, personal computer, tablet computer etc.,
Here it is not especially limited.
Fig. 4 is please referred to, for the block diagram for the data administrator 100 that present pre-ferred embodiments provide.The present invention
The data administrator 100 of offer can be applied to above-mentioned management terminal 10, for executing above-mentioned data managing method, with
The treatment effeciency to pending data is improved, the observation report obtained based on pending data is checked convenient for user.Wherein, data
Managing device 100 may include obtain writing unit 110, first read writing unit 120, second read writing unit 130 and
Report generation unit 140.
Writing unit 110 is obtained, message queue is written for obtaining pending data, and by the pending data.Tool
Body, it obtains writing unit 110 and can be used for executing step S210 shown in Fig. 2, the detailed operation content specifically executed can join
According to the detailed description to above-mentioned steps S210.
Optionally, writing unit 110 is obtained to be used for：From at least partly counting at least one data acquisition device 20
According to obtaining the pending data in harvester 20, wherein the body of the pending data and the data acquisition device 20
Part mark is associated.
First reads writing unit 120, for reading the pending data from the message queue, and by the institute of reading
State the system list that pending data is written in the management terminal 10.Specifically, the first reading writing unit 120 can be used for
Step S220 shown in Fig. 2 is executed, the detailed operation content specifically executed can refer to the detailed description to above-mentioned steps S220.
Second reads writing unit 130, described for that every the first preset duration, will be written in the second preset duration
Interim table is written as target pending data, and by the target pending data in the pending data of system list, wherein
Second preset duration is less than or equal to first preset duration.Specifically, the second reading writing unit 130 can be used for
Step S230 shown in Fig. 2 is executed, the detailed operation content specifically executed can refer to the detailed description to above-mentioned steps S230.
Report generation unit 140 is used for the variable data in the target pending data in the interim table in correspondence
Variable data in preset threshold range, which is used as, waits for draw data, and waits for draw data and pre-set image generation strategy according to described
Generate observation report, wherein the observation report includes waiting for the corresponding statistical chart of draw data with described.Specifically, report life
It can be used for executing step S240 shown in Fig. 2 at unit 140, the detailed operation content specifically executed can refer to above-mentioned steps
The detailed description of S240.
Through the above description of the embodiments, those skilled in the art can be understood that the present invention can lead to
Hardware realization is crossed, the mode of necessary general hardware platform can also be added to realize by software, based on this understanding, this hair
Bright technical solution can be expressed in the form of software products, which can be stored in a non-volatile memories
In medium (can be CD-ROM, USB flash disk, mobile hard disk etc.), including some instructions are used so that a computer equipment (can be
Personal computer, server or network equipment etc.) execute method described in each implement scene of the present invention.
In conclusion a kind of data managing method of present invention offer and device.Data managing method includes：It obtains pending
Data, and message queue is written into pending data；Pending data is read from message queue, and by the pending data of reading
The system list in management terminal is written；Every the first preset duration, system list will be written in the second preset duration
Interim table is written as target pending data, and by target pending data in pending data, wherein the second preset duration is small
In or equal to first preset duration；By the variable data in the target pending data in interim table in corresponding predetermined threshold value
Variable data in range, which is used as, waits for draw data, and waits for that draw data and pre-set image generation strategy generate observation according to described
Report, wherein observation report includes statistical chart corresponding with draw data is waited for.This programme is by writing the pending data of acquisition
Enter message queue, contributes to the reception of follow-up data；By drawing to the target pending data in interim table, contribute to
Improve plotting speed；It is drawn based on the variable data in corresponding preset threshold range, contributes to Exception Filter data, from
And improve the accuracy and reliability for waiting for draw data.
The foregoing is only a preferred embodiment of the present invention, is not intended to restrict the invention, for the skill of this field
For art personnel, the invention may be variously modified and varied.All within the spirits and principles of the present invention, any made by repair
Change, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.
Claims (10)
1. a kind of data managing method is applied to management terminal, which is characterized in that the method includes：
Pending data is obtained, and message queue is written into the pending data；
The pending data is read from the message queue, and the management terminal is written into the pending data of reading
In system list；
Every the first preset duration, the pending data of the system list will be written in the second preset duration as target
Pending data, and interim table is written into the target pending data, wherein second preset duration is less than or equal to institute
State the first preset duration；
By variable data of the variable data in the target pending data in the interim table in corresponding preset threshold range
As waiting for draw data, and wait for that draw data and pre-set image generation strategy generate observation report according to described, wherein the sight
It includes waiting for the corresponding statistical chart of draw data with described to observe and predict announcement.
2. according to the method described in claim 1, it is characterized in that, the management terminal and at least one in Hydrological observation system
A data acquisition device communication connection, each data acquisition device are previously provided with identity, and the acquisition is pending
The step of data, including：
The pending data is obtained from at least partly data acquisition device at least one data acquisition device,
In, the pending data is associated with the identity of the data acquisition device.
3. described according to the method described in claim 1, it is characterized in that, the system list includes at least one sublist list
Method further includes：
A sub- list is created every third preset duration, and is target sublist list, the target sublist by the sublist nonoculture
It is applied alone after the establishment target sublist list certainly is written to the institute read from the message queue during creating new sublist list
State pending data, wherein the third preset duration is more than or equal to first preset duration.
4. according to the method described in claim 3, it is characterized in that, the pipe is written in the pending data by reading
Before the step of managing the system list in terminal, the method further includes：
Judge that the management terminal whether there is the target sublist list, if it has not, creating the target sublist list.
5. according to the method described in claim 1, it is characterized in that, in the target pending data by the interim table
Variable data of the variable data in corresponding preset threshold range as the step of waiting for draw data, including：
Variable number of the variable data in target pending data in the interim table in corresponding preset threshold range is turned
It is changed to the variable data of JSON formats, and the variable data of JSON formats is waited for into draw data as described in.
6. according to the method described in claim 1, it is characterized in that, the management terminal and the clothes for being provided with user account in advance
Business device communication connection, the method further include：
The observation report is converted to the observation report of PDF format, and the observation report of PDF format is sent to described
Server.
7. according to the method described in any one of claim 1-6, which is characterized in that waited for described in the basis draw data and
After pre-set image generation strategy generates the step of observation report, the method further includes：
Remove the target pending data in the interim table.
8. according to the method described in claim 1, it is characterized in that, the statistical chart includes：Bar shaped statistical chart, broken line statistics
At least one of figure, pictograph statistical chart and fan-shaped statistical chart statistical chart.
9. a kind of data administrator, it is applied to management terminal, which is characterized in that the data administrator includes：
Writing unit is obtained, message queue is written for obtaining pending data, and by the pending data；
First reads writing unit, for reading the pending data from the message queue, and will wait locating described in reading
The system list in the management terminal is written in reason data；
Second reads writing unit, for every the first preset duration, the system table will to be written in the second preset duration
Single pending data is as target pending data, and by the interim table of target pending data write-in, wherein described the
Two preset durations are less than or equal to first preset duration；
Report generation unit, for the variable data in the target pending data in the interim table to be corresponded to predetermined threshold value
Variable data in range, which is used as, waits for draw data, and waits for that draw data and pre-set image generation strategy generate observation according to described
Report, wherein the observation report includes waiting for the corresponding statistical chart of draw data with described.
10. data administrator according to claim 9, which is characterized in that the management terminal and Hydrological observation system
At least one of data acquisition device communication connection, each data acquisition device is previously provided with identity, described
Writing unit is obtained to be used for：
The pending data is obtained from at least partly data acquisition device at least one data acquisition device,
In, the pending data is associated with the identity of the data acquisition device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810046305.4A CN108287890B (en) | 2018-01-17 | 2018-01-17 | Data management method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810046305.4A CN108287890B (en) | 2018-01-17 | 2018-01-17 | Data management method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108287890A true CN108287890A (en) | 2018-07-17 |
| CN108287890B CN108287890B (en) | 2020-05-26 |
Family
ID=62835362
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810046305.4A Active CN108287890B (en) | 2018-01-17 | 2018-01-17 | Data management method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108287890B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021017884A1 (en) * | 2019-07-31 | 2021-02-04 | 北京金山云网络技术有限公司 | Data processing method and apparatus, and gateway server |
| CN115857826A (en) * | 2022-12-27 | 2023-03-28 | 铭派技术开发有限公司 | Ship industrial control software data storage display system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101677278A (en) * | 2008-09-17 | 2010-03-24 | 中兴通讯股份有限公司 | Method and system for monitoring availability of network information system |
| CN102402209A (en) * | 2010-09-14 | 2012-04-04 | 广州致远电子有限公司 | Embedded data acquisition and equipment control system |
| CN104331505A (en) * | 2014-11-20 | 2015-02-04 | 合一网络技术(北京)有限公司 | Distributed acquisition and storage-based monitoring system |
| CN104931101A (en) * | 2015-06-29 | 2015-09-23 | 南京邮电大学 | Android-based multi-index real-time environment monitoring terminal system, and method |
| US20170293666A1 (en) * | 2016-04-08 | 2017-10-12 | Bank Of America Corporation | Big data based predictive graph generation system |
-
2018
- 2018-01-17 CN CN201810046305.4A patent/CN108287890B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101677278A (en) * | 2008-09-17 | 2010-03-24 | 中兴通讯股份有限公司 | Method and system for monitoring availability of network information system |
| CN102402209A (en) * | 2010-09-14 | 2012-04-04 | 广州致远电子有限公司 | Embedded data acquisition and equipment control system |
| CN104331505A (en) * | 2014-11-20 | 2015-02-04 | 合一网络技术(北京)有限公司 | Distributed acquisition and storage-based monitoring system |
| CN104931101A (en) * | 2015-06-29 | 2015-09-23 | 南京邮电大学 | Android-based multi-index real-time environment monitoring terminal system, and method |
| US20170293666A1 (en) * | 2016-04-08 | 2017-10-12 | Bank Of America Corporation | Big data based predictive graph generation system |
Non-Patent Citations (1)
| Title |
|---|
| 刘蒙蒙 等: "《工程测量实验与实训》", 31 August 2012, 西南交通大学出版社 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2021017884A1 (en) * | 2019-07-31 | 2021-02-04 | 北京金山云网络技术有限公司 | Data processing method and apparatus, and gateway server |
| CN115857826A (en) * | 2022-12-27 | 2023-03-28 | 铭派技术开发有限公司 | Ship industrial control software data storage display system |
| CN115857826B (en) * | 2022-12-27 | 2023-09-22 | 铭派技术开发有限公司 | Ship industrial control software data storage and display system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108287890B (en) | 2020-05-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106886588B (en) | Method and system for displaying weather information on a timeline | |
| US8549105B1 (en) | Map tile data pre-fetching based on user activity analysis | |
| US8280414B1 (en) | Map tile data pre-fetching based on mobile device generated event analysis | |
| CN204425399U (en) | A kind of hydrometeorological operation system based on cloud computing | |
| JP6185332B2 (en) | Computer system, data output method, computer program | |
| Ye et al. | Development of a highly flexible mobile GIS-based system for collecting arable land quality data | |
| CN110703984B (en) | Data collection system and data collection method | |
| CN105592123A (en) | Storage management system, management apparatus and method | |
| CN1964284A (en) | A method to realize visual wireless sensor network | |
| CN108287890A (en) | Data managing method and device | |
| CN111061802B (en) | Power data management processing method, device and storage medium | |
| US20190068645A1 (en) | Cyber attack information processing apparatus and method | |
| CN113722369A (en) | Method, device, equipment and storage medium for predicting field monitoring data | |
| CN109032693A (en) | Method and device for loading display information, electronic equipment and readable storage medium | |
| CN109144952A (en) | Believe and examines rule file dissemination method, device and storage medium | |
| CN116185259A (en) | Geographic information display method, device, electronic equipment and computer readable medium | |
| CN106534293A (en) | Check-in method and apparatus, and client | |
| CN107169014B (en) | POI recommendation method, device, equipment and computer readable storage medium | |
| CN105577462A (en) | Mobile device flow statistical method and device | |
| CN113887813A (en) | Typhoon disaster early warning method and device, server and storage medium | |
| KR101350710B1 (en) | Server for providing information based on place | |
| CN112418631A (en) | Resource allocation method and device, electronic equipment and storage medium | |
| CN111611337A (en) | Terminal data processing system | |
| CN205692211U (en) | Travel information service based on cloud computing | |
| CN111026732B (en) | Dynamic inspection tour method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200528 Address after: 730000 No.318, Donggang West Road, Chengguan District, Lanzhou City, Gansu Province Patentee after: NORTHWEST INSTITUTE OF ECO-ENVIRONMENT AND RESOURCES, CAS Address before: 730000 Gansu city of Lanzhou province Donggang West Road No. 320 Patentee before: Institute of environment and Engineering in cold and dry areas, Chinese Academy of Sciences |
|
| TR01 | Transfer of patent right |