CN109726360A - A kind of crops monitoring data processing method and system - Google Patents
A kind of crops monitoring data processing method and system Download PDFInfo
- Publication number
- CN109726360A CN109726360A CN201811637830.XA CN201811637830A CN109726360A CN 109726360 A CN109726360 A CN 109726360A CN 201811637830 A CN201811637830 A CN 201811637830A CN 109726360 A CN109726360 A CN 109726360A
- Authority
- CN
- China
- Prior art keywords
- monitoring data
- monitoring
- crops
- data
- sparse
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 177
- 238000003672 processing method Methods 0.000 title claims abstract description 9
- 238000005070 sampling Methods 0.000 claims abstract description 24
- 230000006835 compression Effects 0.000 claims abstract description 20
- 238000007906 compression Methods 0.000 claims abstract description 20
- 230000004044 response Effects 0.000 claims abstract description 8
- 238000004891 communication Methods 0.000 claims description 25
- 238000000034 method Methods 0.000 claims description 25
- 238000011084 recovery Methods 0.000 claims description 20
- 239000011159 matrix material Substances 0.000 claims description 16
- 238000012545 processing Methods 0.000 claims description 15
- 230000006870 function Effects 0.000 claims description 12
- 238000004458 analytical method Methods 0.000 claims description 6
- 238000005457 optimization Methods 0.000 claims description 5
- 239000002689 soil Substances 0.000 claims description 5
- 229910001385 heavy metal Inorganic materials 0.000 claims description 4
- 235000015097 nutrients Nutrition 0.000 claims description 4
- 230000005540 biological transmission Effects 0.000 abstract description 15
- 238000013480 data collection Methods 0.000 abstract description 7
- 230000008569 process Effects 0.000 description 11
- 230000006855 networking Effects 0.000 description 6
- 239000003795 chemical substances by application Substances 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 238000003860 storage Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 230000000737 periodic effect Effects 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000009313 farming Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Abstract
The invention discloses a kind of crops monitoring data processing method and system, by being arranged on crops or field, there are many sensing chips, terminal starts sensing chip monitoring function, a variety of monitoring data are returned to terminal by sensing chip, data center server periodically issues monitoring data acquisition request to terminal, acquire data response starting, in such a way that the concurrently execution and merging of multiple crops monitoring data Collection agents are write, and compression sampling and reconstruct are carried out to monitoring data, it meets when monitoring data handling capacity is larger, multiple local modules are become by original unified network mode, improve acquisition and efficiency of transmission.
Description
Technical field
The present invention relates to computer big data processing technology field, in particular to a kind of crops monitoring data processing method
And system.
Background technique
Crops are China's primary industry, are the bases of national economy.In recent years, China's Economy of agriculture and countryside remains good
Good growth momentum, grain yield increase year after year.The exploration and practice of agriculture technology of Internet of things application has been carried out in some areas,
And achieve preferable effect.Currently, agriculture technology of Internet of things relies primarily on agriculture sensor technology, which supports animals and plants
Growing, process storage, transport etc. has relatively broad application, and e.g. soil monitoring, environmental monitoring, vital sign etc. is various not
With the sensor of application target.
Various chip acquisition devices, the various fingers of dynamic monitoring are set generally on crops or between field in the prior art
Mark, but existing customer end/server mode acquires data mode, is that acquisition request, acquisition are issued by data center server
Data module response, data center server are communicated by way of inquiry with each acquisition node, but since data processing amount is non-
Chang great inevitably results in two problems: acquisition data volume is big, so as to cause overload, limits acquisition scale；The big feelings of quantity
Under condition, data center server query time also increases, and transmission performance is difficult to ensure.
Summary of the invention
The embodiment of the invention provides a kind of crops monitoring data processing method and system, enable in acquisition data
When not will lead to overload, solve the problems, such as that the processing speed of crops monitoring data and efficiency of transmission are lower.
To solve the above-mentioned problems, the invention discloses following technical solutions:
In a first aspect, providing a kind of crops monitoring data processing method, comprising:
The monitoring sensing chip for being arranged on crops and between field is carried out wireless communication with terminal device and is connect；
Terminal device starting monitoring sensing chip monitoring function, the monitoring sensing chip is by multiple kinds of crops monitoring data
Return to the terminal device；
Data center server periodically issues the crops monitoring data acquisition request to the terminal device, acquires number
Start according to response；
After data center server issues the acquisition request of crops monitoring data, to main control module, protocol stack, GPRS module unit
It is initialized, the radio communication channel in scan for inquiries self communication frequency range, most suitable idle channel is selected to construct
Wireless sensor network；
The subtask number provided in file is described according to crops monitoring data acquisition tasks, and the crops monitoring data are adopted
Set task turn to parallel multiple subtasks and be delivered to it is multiple from node, it is described from node to crops monitoring data pass
Sensor terminal issues control command；
Sparse low speed sampling and compressed transform are carried out to the monitoring data, and recovery and rebuilding is carried out to sparse compressed signal；
Data center server saves the monitoring data after recovery and rebuilding in the preset database；
Monitoring data after the recovery and rebuilding are analyzed, and determine whether to provide early warning according to preset standard.
Second aspect provides a kind of crops smp data processing system, comprising:
The monitoring sensing chip being arranged on crops and between field and terminal device are carried out wireless communication company by communication module
It connects；
Terminal device starting module, the terminal device starting monitoring sensing chip monitoring function, the monitoring sensing chip will
Multiple kinds of crops monitoring data return to the terminal device；
Data center server starting module, data center server periodically issue the crops to the terminal device
Monitoring data acquisition request, acquisition data response starting；
Construct module, data center server issue crops monitoring data acquisition request after, coordinator first to main control module,
Protocol stack, GPRS module unit are initialized, and the radio communication channel scanning then carried out in self communication frequency range is looked into
It askes, selects most suitable idle channel building wireless sensor network；
Mission dispatching module describes the subtask number provided in file according to crops monitoring data acquisition tasks, the agriculture
Crop monitoring data acquisition session turn to parallel multiple subtasks and be delivered to it is multiple from node, it is described from node to agriculture
Crop monitoring data pick-up terminal issues control command；
Compression and reconstructed module carry out sparse low speed sampling and compressed transform to the monitoring data, and to sparse compressed signal
Carry out recovery and rebuilding；
Memory module, data center server save the monitoring data after recovery and rebuilding in the preset database；
Analysis module analyzes the monitoring data after the recovery and rebuilding, and according to preset standard determines whether to provide pre-
Alert prompt.
The present invention monitors the hardware system and software systems of system by building crops, can effectively realize that crops are handled
Real-time acquisition, transmission and the early warning of data, meet when monitoring data handling capacity is larger, by original unified network mode
Become multiple local modules, and the Collection agent used can improve the efficiency of operation.It is acquired by multiple crops monitoring data
Agency's concurrently executes and merges the mode write, and carries out compression sampling and reconstruct to monitoring data, meets and is monitoring
When data throughout is larger, multiple local modules are become by original unified network mode, improve acquisition and efficiency of transmission.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is the present invention
Some embodiments for those of ordinary skill in the art without creative efforts, can also basis
These attached drawings obtain other attached drawings.
Fig. 1 is the flow diagram of one embodiment of the invention middle peasant's crop monitoring data processing method.
Fig. 2 is the structural schematic diagram of another embodiment of the present invention middle peasant's crop monitoring data processing system.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments, based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
Referring to Fig. 1, one embodiment of the invention proposes a kind of flow chart of crops monitoring data processing method, leads to
Monitoring sensing chip, terminal device and data center server is crossed to carry out data transmission.Firstly, between crops and field
Arrangement monitoring sensing chip, the monitoring sensing chip can be connect by wireless communication between terminal device, can be WSN network
Mode or WIFI mode；The monitoring sensing chip has a variety of wireless sensor terminals, with environment temperature, environmental wet
The monitoring functions such as degree, atmospheric pressure, soil nutrient, heavy metal monitoring.Terminal device connects by wireless communication, starting monitoring sensing
Chip monitoring function monitors sensing chip for multiple kinds of crops monitoring data and returns to terminal device.It can also be by when if needed
Administrative staff voluntarily start monitoring sensing chip monitoring function.
Further, the acquisition request of crops monitoring data is issued to data center server timed periodic, terminal is set
It is standby to execute the acquisition of crops monitoring data.Data center server issues the acquisition request of crops monitoring data, according to crops
Monitoring data acquisition tasks describe the subtask number provided in file, crops monitoring data acquisition tasks are turned to parallel multiple
Subtask and be delivered to it is multiple from node, respectively from node receive host node distribute subtask and dispatch this node data acquisition
Specific implementation procedure is unfolded in resource, and terminal device is finally transferred to execute the acquisition of crops monitoring data.Cluster is multiple stage computers
The system that system constitutes a loose coupling by net connection, the process between each machine can be in communication with each other.Load balancing will
Key task resolves into several subtasks, then shares in multiple running nodes by certain strategy and executes, and work is completed in collaboration
Make task.It is a kind of cheap effective side by load balancing come the bandwidth of expansion service device, the handling capacity of increase whole system
Method.Network data processing ability is doubled, and flexibility and availability are significantly promoted.
Further, after data center server issues the acquisition request of crops monitoring data, coordinator is first to master
The equipment such as hardware, that is, protocol stack, the GPRS module units such as control module, serial ports are initialized, and self communication frequency model is then carried out
Interior radio communication channel scan for inquiries is enclosed, and then most suitable idle channel is selected to construct wireless sensor network.Once nothing
Line sensor network networking success can then wait multiple issue from node of surrounding that the application that networks is added, match and infuse by equipment
After volume success, final networking is completed to form stable wireless sensor network.In crops monitoring data collection process, terminal
On the one hand equipment is responsible for receiving the crops monitoring data that aggregate transmission comes from wireless sensor node, on the one hand pass through
RS232 serial ports is transmitted to ARM module and carries out subsequent processing, and crops monitoring data after the completion are long-range eventually by GPRS module
It is transmitted to data center server.In addition, terminal device also needs to be responsible for when single or multiple wireless in wireless sensor network
After sensor node sends failure, self networking and recovery are carried out to wireless sensor network, to guarantee crops monitoring data
The normal orderly work of acquisition.
Further, crops monitoring data acquisition system crops monitoring data sensor terminal can be issued control,
The order such as debugging.If service-strong application layer protocol, it is also necessary to carry out message response.In order to meet these requirements, farming
Object monitoring data acquisition system also needs to need be forwarded to back-end processing section with the ability to sensor terminal issuing message
Some redundancies are added in the message of point to support reversed message forwarding capability.As long as obtaining the source address of network data
And source port information can be completed to crops monitoring data sensor terminal and issue the order such as control, debugging.Therefore crops supervise
The communication module of measured data acquisition system needs to save the source address information of network data report for issuing the life such as control, debugging
It enables.
Further, it is increased in a memory file system on the storage of crops monitor data file system bottom
It is substantially carried out write buffer and writes merging service.Wherein write buffer provides high performance write buffer service for the file system of bottom,
To which throughput rate is write in optimization.Collected crops monitoring data are write in disk, are closed small documents using filing algorithm
And stored for big file, by the way of secondary index, big file index is placed on host node, the index of small documents is placed on
Memory node stores pressure to reduce the metadata of host node.File set is divided into multiple classes, mass file is merged into
Big file is finally written to file system and carries out persistent storage by big file.
Wherein, the merging of monitoring data is write, and mainly using the low speed sample frequency of monitoring data as means, is deposited with saving data
Storing up the resources such as space, transmission and operation is target, by merging high-speed sampling and compressed transform process, is carried out to monitoring data dilute
Low speed sampling is dredged, by corresponding reconstructing method to the recovery and rebuilding of sparse compressed signal, monitoring data collection process is effectively reduced
In data volume, improve acquisition and conevying efficiency.Wherein, N-dimensional monitoring data vector X=(x1,x2,…, xN)T ∈RNIt is sparse
It is expressed as follows and states formula:
；In formula, Ψ=[Ψ 1, Ψ 2 ..., Ψ N], Ψ ∈ RN×NIt is sparse for the orthonormal basis of N × N
Matrix, Ψ i are the vector subset of orthonormal basis sparse matrix；S is the N-dimensional rarefaction representation coefficient set of monitoring data vector X,
Si is its vector element, S=[S1, S2 ..., SN] TAnd S ∈ RN。
Monitoring data are observed by using random normal matrix, it can be seen that the sparse compression sampling of monitoring data is public
Formula is as follows:
Y=Φ X, in formula, Φ=(Φ 1, Φ 2 ..., Φ M)T ∈RM×NThe random normal distribution matrix of (0,1/M) is arranged for M row N；
Y is that M ties up sparse compression sampling monitoring data set.
Finally, the reconstruct of the monitoring data after sparse compression sampling is realized using the optimization problem solving of 0 norm meaning, it is public
Formula is as follows:
0, Φ X=Y, in formula,For the accurate or close approximation value of primary monitoring data.
Further, the detection data after recovery and rebuilding is stored in presetting database by data center server.It can also
Historical data is inquired, data are summarized, real-time research and application is as a result, and can also be used as analysis data.Receive data
Data inquiry request is matched with multiple historical queries request, data inquiry request and historical query is asked by inquiry request
The historical query in database is asked to request to be matched.It is requested according to the historical data subquery in the historical query result
Corresponding first historical query result is requested in middle inquiry first historical query.Merge the request of historical data subquery and increment
The query result of data subquery request, and using the query result after merging as the result of the data inquiry request.
Further, the result that data center server reads data inquiry request is analyzed, and according to preset standard
Determine whether to provide early warning.Terminal device can voluntarily consult the related monitoring data of crops.
The hardware system and software systems that system is monitored by building crops can effectively realize crops processing data
Acquisition in real time, transmission and early warning, meet when monitoring data handling capacity is larger, become more by original unified network mode
A local module, and the Collection agent used can improve the efficiency of operation.Multiple crops monitoring data Collection agents it is concurrent
The mode write is executed and merged, and by carrying out compression sampling and reconstruct to monitoring data, improves acquisition and efficiency of transmission.
Fig. 2 is the structural schematic diagram of big data processing system in another embodiment of the present invention, proposes a kind of big data
Processing system, comprising: communication module 201, terminal device starting module 202, data center server starting module 203, building
Module 204, mission dispatching module 205, compression and reconstructed module 206, memory module, analysis module 208.Wherein:
Link block 201, monitoring sensing chip, terminal device and data center server carry out data transmission, in crops
And arrangement monitoring sensing chip, the monitoring sensing chip can be connect by wireless communication between terminal device between field, it can
To be WSN network mode or WIFI mode；The monitoring sensing chip has a variety of wireless sensor terminals, with environment temperature
The monitoring functions such as degree, ambient humidity, atmospheric pressure, soil nutrient, heavy metal monitoring.
Terminal device starting module 202, terminal device monitor function by above-mentioned wireless connection, starting monitoring sensing chip
Can, sensing chip, which is monitored, by multiple kinds of crops monitoring data returns to terminal device.It can also be by administrative staff certainly when if needed
Row starting monitoring sensing chip monitoring function.
Data center server starting module 203 issues to data center server timed periodic crops monitoring number
It is requested according to acquisition, terminal device executes the acquisition of crops monitoring data.
Module 204 is constructed, after data center server issues the acquisition request of crops monitoring data, coordinator is right first
The equipment such as the hardware, that is, protocol stack such as main control module, serial ports, GPRS module unit are initialized, and self communication frequency is then carried out
Radio communication channel scan for inquiries in range, and then most suitable idle channel is selected to construct wireless sensor network.Once
Wireless sensor network networking success can then wait multiple issue from node of surrounding that the application that networks is added, match by equipment
After succeeding in registration, final networking is completed to form stable wireless sensor network.In crops monitoring data collection process, eventually
On the one hand end equipment is responsible for receiving the crops monitoring data that aggregate transmission comes from wireless sensor node, on the one hand pass through
RS232 serial ports is transmitted to ARM module and carries out subsequent processing, and crops monitoring data after the completion are long-range eventually by GPRS module
It is transmitted to data center server.In addition, terminal device also needs to be responsible for when single or multiple wireless in wireless sensor network
After sensor node sends failure, self networking and recovery are carried out to wireless sensor network, to guarantee crops monitoring data
The normal orderly work of acquisition.
Mission dispatching module 205, crops monitoring data acquisition system can be under crops monitoring data sensor terminals
The orders such as hair control, debugging.If service-strong application layer protocol, it is also necessary to carry out message response.It is wanted to meet these
It asks, crops monitoring data acquisition system also needs to need after being forwarded to the ability to sensor terminal issuing message
Some redundancies are added in the message of end processing node to support reversed message forwarding capability.As long as obtaining network data
Source address and source port information can be completed to crops monitoring data sensor terminal issue control, debugging etc. order.Therefore
The communication module of crops monitoring data acquisition system needs to save the source address information of network data report for issuing control, adjusting
The order such as examination.
Compression and reconstructed module 206, the merging of monitoring data is write, mainly using the low speed sample frequency of monitoring data as hand
Section, to save the resources such as data space, transmission and operation as target, by merging high-speed sampling and compressed transform process,
Sparse low speed sampling is carried out to monitoring data to be effectively reduced by corresponding reconstructing method to the recovery and rebuilding of sparse compressed signal
Data volume in monitoring data collection process improves acquisition and conevying efficiency.Wherein, N-dimensional monitoring data vector X=(x1,x2,…,
xN)T ∈RNFor example following formula of rarefaction representation:
；In formula, Ψ=[Ψ 1, Ψ 2 ..., Ψ N], Ψ ∈ RN×NIt is sparse for the orthonormal basis of N × N
Matrix, Ψ i are the vector subset of orthonormal basis sparse matrix；S is the N-dimensional rarefaction representation coefficient set of monitoring data vector X,
Si is its vector element, S=[S1, S2 ..., SN] TAnd S ∈ RN。
Monitoring data are observed by using random normal matrix, it can be seen that the sparse compression sampling of monitoring data is public
Formula is as follows:
Y=Φ X, in formula, Φ=(Φ 1, Φ 2 ..., Φ M)T ∈RM×NThe random normal distribution matrix of (0,1/M) is arranged for M row N；
Y is that M ties up sparse compression sampling monitoring data set.
Finally, the reconstruct of the monitoring data after sparse compression sampling is realized using the optimization problem solving of 0 norm meaning, it is public
Formula is as follows:
0, Φ X=Y, in formula,For the accurate or close approximation value of primary monitoring data.
Detection data after recovery and rebuilding is stored in presetting database by memory module 207, data center server.?
Historical data can be inquired, summarize data, real-time research and application is as a result, and can also be used as analysis data.Receive number
According to inquiry request, data inquiry request is matched with multiple historical queries request, by data inquiry request and historical query
Historical query request in requested database is matched.It is requested according to the historical data subquery in the historical query knot
First historical query is inquired in fruit requests corresponding first historical query result.Merge the request of historical data subquery and increases
The query result of data subquery request is measured, and using the query result after merging as the result of the data inquiry request.
Analysis module 208, the result that data center server reads data inquiry request are analyzed, and according to pre- bidding
Standard determines whether to provide early warning.Terminal device can voluntarily consult the related monitoring data of crops.
The hardware system and software systems that system is monitored by building crops can effectively realize crops processing data
Acquisition in real time, transmission and early warning, meet when monitoring data handling capacity is larger, become more by original unified network mode
A local module, and the Collection agent used can improve the efficiency of operation.Multiple crops monitoring data Collection agents it is concurrent
The mode write is executed and merged, and by carrying out compression sampling and reconstruct to monitoring data, improves acquisition and efficiency of transmission.
It should be noted that, in this document, such as first and second etc relational terms are used merely to an entity
Or operation is distinguished with another entity or operation, is existed without necessarily requiring or implying between these entities or operation
Any actual relationship or order.Moreover, the terms "include", "comprise" or its any other variant be intended to it is non-
It is exclusive to include, so that the process, method, article or equipment for including a series of elements not only includes those elements,
It but also including other elements that are not explicitly listed, or further include solid by this process, method, article or equipment
Some elements.In the absence of more restrictions, the element limited by sentence " including one ", is not arranged
Except there is also other identical factors in the process, method, article or apparatus that includes the element.
Those of ordinary skill in the art will appreciate that: realize that all or part of the steps of above method embodiment can pass through
The relevant hardware of program instruction is completed, and program above-mentioned can store in computer-readable storage medium, the program
When being executed, step including the steps of the foregoing method embodiments is executed；And storage medium above-mentioned includes: ROM, RAM, magnetic disk or light
In the various media that can store program code such as disk.
Finally, it should be noted that the foregoing is merely presently preferred embodiments of the present invention, it is merely to illustrate skill of the invention
Art scheme, is not intended to limit the scope of the present invention.Any modification for being made all within the spirits and principles of the present invention,
Equivalent replacement, improvement etc., are included within the scope of protection of the present invention.
Claims (8)
1. a kind of crops monitoring data processing method, which is characterized in that the described method includes:
The monitoring sensing chip for being arranged on crops and between field is carried out wireless communication with terminal device and is connect；
Terminal device starting monitoring sensing chip monitoring function, the monitoring sensing chip is by multiple kinds of crops monitoring data
Return to the terminal device；
Data center server periodically issues the crops monitoring data acquisition request to the terminal device, acquires number
Start according to response；
After data center server issues the acquisition request of crops monitoring data, to main control module, protocol stack, GPRS module unit
It is initialized, the radio communication channel in scan for inquiries self communication frequency range, most suitable idle channel is selected to construct
The wireless sensor network；
The subtask number provided in file is described according to crops monitoring data acquisition tasks, and the crops monitoring data are adopted
Set task turn to parallel multiple subtasks and be delivered to it is multiple from node, it is described from node to crops monitoring data pass
Sensor terminal issues control command；
Sparse low speed sampling and compressed transform are carried out to the monitoring data, and recovery and rebuilding is carried out to sparse compressed signal；
Data center server saves the monitoring data after recovery and rebuilding in the preset database；
Monitoring data after the recovery and rebuilding are analyzed, and determine whether to provide early warning according to preset standard.
2. the method according to claim 1, wherein the monitoring sensing chip have multiple sensors terminal,
It monitors monitoring function with environment temperature, ambient humidity, atmospheric pressure, soil nutrient and heavy metal.
3. the method according to claim 1, wherein the monitoring sensing chip and terminal device are wirelessly connected and lead to
Cross WSN network mode or the connection of WIFI mode.
4. the method according to claim 1, wherein wherein to the monitoring data carry out the sampling of sparse low speed with
Compressed transform, and carrying out recovery and rebuilding to sparse compressed signal includes: N-dimensional monitoring data vector X=(x1,x2,…, xN)T ∈RN
For example following formula of rarefaction representation:
；In formula, Ψ=[Ψ 1, Ψ 2 ..., Ψ N], Ψ ∈ RN×NIt is sparse for the orthonormal basis of N × N
Matrix, Ψ i are the vector subset of orthonormal basis sparse matrix；S is the N-dimensional rarefaction representation coefficient of the monitoring data vector X
Set, Si are its vector element, S=[S1, S2 ..., SN] TAnd S ∈ RN；
The monitoring data are observed by using random normal matrix, it can be seen that the sparse compression of the monitoring data is adopted
Sample formula is as follows:
Y=Φ X, in formula, Φ=(Φ 1, Φ 2 ..., Φ M)T ∈RM×NThe random normal distribution matrix of (0,1/M) is arranged for M row N；
Y is that M ties up sparse compression sampling monitoring data set；
Finally, realizing the reconstruct of the monitoring data after sparse compression sampling using the optimization problem solving of 0 norm meaning, formula is such as
Under:
0, Φ X=Y, in formula,For the accurate or close approximation value of primary monitoring data.
5. a kind of crops smp data processing system characterized by comprising
The monitoring sensing chip being arranged on crops and between field and terminal device are carried out wireless communication company by communication module
It connects；
Terminal device starting module, the terminal device starting monitoring sensing chip monitoring function, the monitoring sensing chip will
Multiple kinds of crops monitoring data return to the terminal device；
Data center server starting module, data center server periodically issue the crops to the terminal device
Monitoring data acquisition request, acquisition data response starting；
Construct module, data center server issue crops monitoring data acquisition request after, coordinator first to main control module,
Protocol stack, GPRS module unit are initialized, and the radio communication channel scanning then carried out in self communication frequency range is looked into
It askes, most suitable idle channel is selected to construct the wireless sensor network；
Mission dispatching module describes the subtask number provided in file according to crops monitoring data acquisition tasks, the agriculture
Crop monitoring data acquisition session turn to parallel multiple subtasks and be delivered to it is multiple from node, it is described from node to agriculture
Crop monitoring data pick-up terminal issues control command；
Compression and reconstructed module carry out sparse low speed sampling and compressed transform to the monitoring data, and to sparse compressed signal
Carry out recovery and rebuilding；
Memory module, data center server save the monitoring data after recovery and rebuilding in the preset database；
Analysis module analyzes the monitoring data after the recovery and rebuilding, and according to preset standard determines whether to provide pre-
Alert prompt.
6. system according to claim 5, which is characterized in that the monitoring sensing chip has multiple sensors terminal,
It monitors monitoring function with environment temperature, ambient humidity, atmospheric pressure, soil nutrient and heavy metal.
7. system according to claim 5, which is characterized in that the monitoring sensing chip and terminal device are wirelessly connected and lead to
Cross WSN network mode or the connection of WIFI mode.
8. system according to claim 5, which is characterized in that wherein to the monitoring data carry out the sampling of sparse low speed with
Compressed transform, and carrying out recovery and rebuilding to sparse compressed signal includes: N-dimensional monitoring data vector X=(x1,x2,…, xN)T ∈RN
For example following formula of rarefaction representation:
；In formula, Ψ=[Ψ 1, Ψ 2 ..., Ψ N], Ψ ∈ RN×NIt is sparse for the orthonormal basis of N × N
Matrix, Ψ i are the vector subset of orthonormal basis sparse matrix；S is the N-dimensional rarefaction representation coefficient of the monitoring data vector X
Set, Si are its vector element, S=[S1, S2 ..., SN] TAnd S ∈ RN；
The monitoring data are observed by using random normal matrix, it can be seen that the sparse compression of the monitoring data is adopted
Sample formula is as follows:
Y=Φ X, in formula, Φ=(Φ 1, Φ 2 ..., Φ M)T ∈RM×NThe random normal distribution matrix of (0,1/M) is arranged for M row N；
Y is that M ties up sparse compression sampling monitoring data set；
Finally, realizing the reconstruct of the monitoring data after sparse compression sampling using the optimization problem solving of 0 norm meaning, formula is such as
Under:
0, Φ X=Y, in formula,For the accurate or close approximation value of primary monitoring data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811637830.XA CN109726360A (en) | 2018-12-29 | 2018-12-29 | A kind of crops monitoring data processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811637830.XA CN109726360A (en) | 2018-12-29 | 2018-12-29 | A kind of crops monitoring data processing method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109726360A true CN109726360A (en) | 2019-05-07 |
Family
ID=66297922
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811637830.XA Pending CN109726360A (en) | 2018-12-29 | 2018-12-29 | A kind of crops monitoring data processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109726360A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113722369A (en) * | 2021-08-23 | 2021-11-30 | 中科锐思智感科技(苏州)有限公司 | Method, device, equipment and storage medium for predicting field monitoring data |
| CN115199916A (en) * | 2022-08-04 | 2022-10-18 | 长春理工大学 | Crop leaf nitrogen phosphorus potassium detection device and detection method |
| CN116384624A (en) * | 2023-03-13 | 2023-07-04 | 中国科学院生态环境研究中心 | Method and system for determining optimal soil tillage depth of region for deep tillage measure |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105897920A (en) * | 2016-05-27 | 2016-08-24 | 北京农业信息技术研究中心 | Crop monitoring analysis method and system |
| CN106305371A (en) * | 2016-08-24 | 2017-01-11 | 电子科技大学 | Cloud-based agricultural Internet of things production and management system |
| CN108874323A (en) * | 2018-07-04 | 2018-11-23 | 江苏农牧科技职业学院 | A kind of pet monitoring data processing method and system |
-
2018
- 2018-12-29 CN CN201811637830.XA patent/CN109726360A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105897920A (en) * | 2016-05-27 | 2016-08-24 | 北京农业信息技术研究中心 | Crop monitoring analysis method and system |
| CN106305371A (en) * | 2016-08-24 | 2017-01-11 | 电子科技大学 | Cloud-based agricultural Internet of things production and management system |
| CN108874323A (en) * | 2018-07-04 | 2018-11-23 | 江苏农牧科技职业学院 | A kind of pet monitoring data processing method and system |
Non-Patent Citations (3)
| Title |
|---|
| 肖新清: "面向冷链物流品质感知的物联网数据采集与建模方法", 《中国博士学位论文全文数据库 信息科技辑》 * |
| 郝行军: "物联网大数据存储与管理技术研究", 《中国博士学位论文全文数据库 信息科技辑（月刊）》 * |
| 陈穷，主编: "《电磁兼容性工程设计手册》", 31 October 1993, 国防工业出版社 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113722369A (en) * | 2021-08-23 | 2021-11-30 | 中科锐思智感科技(苏州)有限公司 | Method, device, equipment and storage medium for predicting field monitoring data |
| CN115199916A (en) * | 2022-08-04 | 2022-10-18 | 长春理工大学 | Crop leaf nitrogen phosphorus potassium detection device and detection method |
| CN116384624A (en) * | 2023-03-13 | 2023-07-04 | 中国科学院生态环境研究中心 | Method and system for determining optimal soil tillage depth of region for deep tillage measure |
| CN116384624B (en) * | 2023-03-13 | 2023-09-05 | 中国科学院生态环境研究中心 | Method and system for determining optimal soil tillage depth of region for deep tillage measure |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN202058147U (en) | Distribution type real-time database management system | |
| CN109726360A (en) | A kind of crops monitoring data processing method and system | |
| US8688708B2 (en) | Storing and retrieving objects on a computer network in a distributed database | |
| CN103237045B (en) | Parallel processing system and parallel processing method for large-scale real-time traffic data | |
| CN103714134B (en) | Network flow data index method and system | |
| US7512700B2 (en) | Real-time mining and reduction of streamed data | |
| CN100512118C (en) | Distributed data management system and method for dynamically subscribing data | |
| CN107038162A (en) | Real time data querying method and system based on database journal | |
| CN110166282A (en) | Resource allocation methods, device, computer equipment and storage medium | |
| CN110019267A (en) | A kind of metadata updates method, apparatus, system, electronic equipment and storage medium | |
| CN1703041A (en) | Method for parallel processing big quantities of data in a communication server | |
| US9477772B2 (en) | Storing and retrieving objects on a computer network in a distributed database | |
| CN102722355A (en) | Workflow mechanism-based concurrent ETL (Extract, Transform and Load) conversion method | |
| CN101551745A (en) | Method for greatly improving performance of workflow engine | |
| EP2767912A2 (en) | In-memory real-time synchronized database system and method | |
| CN103886508A (en) | Mass farmland data monitoring method and system | |
| CN107402926A (en) | A kind of querying method and query facility | |
| CN110427446B (en) | Method and system for rapidly publishing and browsing mass image services | |
| CN103377269A (en) | Sensor data positioning method and device | |
| US20190028501A1 (en) | Anomaly detection on live data streams with extremely low latencies | |
| CN112163001A (en) | High-concurrency query method, intelligent terminal and storage medium | |
| CN105260479A (en) | observer pattern-based real-time database real time data publishing method | |
| CN102737061A (en) | Distributed ticket query management system and method | |
| CN114710571A (en) | Data packet processing system | |
| CN112181950B (en) | Construction method of distributed object database |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190507 |