CN115292529B - Method, system, equipment and medium for automatic image processing and automatic result warehousing - Google Patents
Method, system, equipment and medium for automatic image processing and automatic result warehousing Download PDFInfo
- Publication number
- CN115292529B CN115292529B CN202211140168.3A CN202211140168A CN115292529B CN 115292529 B CN115292529 B CN 115292529B CN 202211140168 A CN202211140168 A CN 202211140168A CN 115292529 B CN115292529 B CN 115292529B
- Authority
- CN
- China
- Prior art keywords
- image
- processing
- file
- result
- automatically
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 title claims abstract description 106
- 238000000034 method Methods 0.000 title claims abstract description 51
- 238000003860 storage Methods 0.000 claims abstract description 41
- 230000006837 decompression Effects 0.000 claims abstract description 23
- 238000012216 screening Methods 0.000 claims abstract description 19
- 238000004590 computer program Methods 0.000 claims description 18
- 230000004927 fusion Effects 0.000 claims description 5
- 238000007499 fusion processing Methods 0.000 claims description 5
- 230000008569 process Effects 0.000 description 6
- 230000001960 triggered effect Effects 0.000 description 6
- 230000002354 daily effect Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000003203 everyday effect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000007726 management method Methods 0.000 description 4
- 238000013523 data management Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000009826 distribution Methods 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008092 positive effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/51—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/54—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Library & Information Science (AREA)
- Remote Sensing (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention belongs to the technical field of satellite image processing, and discloses an automatic image processing and result automatic warehousing method, system, equipment and medium. The method comprises the following steps: selecting and pushing data according to the screening conditions, and storing the screened original images in a set range into a designated distributed storage folder; automatically decompressing for multiple times according to the screened original image data; after decompression, identifying files in the current folder; automatically processing the remote sensing image to obtain a high-resolution result image; and automatically warehousing and searching the acquired result images. The invention efficiently manages mass data by utilizing distributed storage. The invention solves the problems that the original remote sensing data cannot be fully utilized, the processing efficiency is not high and the result data reuse rate is low.
Description
Technical Field
The invention belongs to the technical field of satellite image processing, and particularly relates to an automatic image processing and result warehousing method, system, equipment and medium.
Background
With the increasing development of satellite remote sensing technology, the satellite remote sensing data volume is larger and larger, about 1000 scenes of effective images can be obtained by a single satellite every day, the data volume of original images is about 1T, the data volume of corresponding result image data can reach 4T, the image number of a single satellite per year can reach about 36 thousand scenes, the data volume can reach 180T, and the data volume is extremely large. This puts unprecedented pressure on data storage, data processing, and data management.
Because the data volume is huge, the traditional data management mode only manages original images, one-by-one processing is carried out according to business requirements during processing, the storage of result images is also carried out through project results, the unified standard is not available, the storage is disordered, and the existing historical results cannot be traced. Handling according to business requirements leads to three problems: firstly, most original data cannot be fully utilized, secondly, the efficiency of data processing is not high, the required original image can be selected to be processed when the required range is reached, and the time consumption is long in the middle; thirdly, the achievements of the general projects are difficult to reuse due to the particularity of the projects. Therefore, it is highly desirable to effectively manage data by using distributed storage, and to implement real-time processing of raw data received daily by an automated means, and to manage result data according to certain rules, thereby improving the video service efficiency of business projects.
Through the above analysis, the problems and defects of the prior art are as follows:
(1) In the prior art, the real-time processing efficiency of the shot images is low, and the speed of acquiring the result images is slow;
(2) The management cost of mass data stored in the prior art is high;
(3) The prior art cannot fully utilize the original remote sensing data, has low processing efficiency and low achievement data reuse rate.
Disclosure of Invention
To overcome the problems in the related art, the embodiments of the present disclosure provide a method, system, device, and medium for automatic image processing and automatic result storage. The invention aims to solve the technical problems of how to overcome the problems of insufficient utilization of most original data, low processing efficiency and low achievement data reuse rate, and solve the problems in the management, the automatic processing and the achievement image warehousing and management of mass image data.
The technical scheme is as follows: the automatic image processing and result warehousing method comprises the following steps of:
s1: selecting and pushing data according to the screening conditions, and storing the screened original images in the set range into a designated distributed storage folder;
s2: automatically decompressing for multiple times according to the screened original image data; after decompression, generating an identification file in the current folder;
s3: automatically processing the remote sensing image to obtain a high-resolution result image and generate a processing completion identification file;
s4: and automatically warehousing and searching the result images, automatically generating an image thumbnail supporting the search for the obtained result images, and automatically warehousing.
In one embodiment, in step S1, the data selection and pushing are performed according to the screening condition, including the following steps:
(1) Determining screening conditions: setting conditions of remote sensing images needing automatic processing, wherein the conditions comprise spatial positions, shooting time and satellite types; when daily images need to be automatically processed, a range file and a satellite type are specified;
(2) Determining the path of the original image: determining a storage path of an original image by combining the satellite type according to the image shooting time in the processing condition;
(3) Judging each file one by one, and acquiring the coordinates of the central point of each scene image: taking out the longitude and latitude in the file name, removing the alphabetic characters, only reserving the numeric characters, and obtaining the coordinates of the central point of the image;
(4) Judging whether the target range is within the target range: judging whether the image is in a target range or not by using the central point coordinates and the target range file through a space superposition algorithm, and sorting the image in the target range into a to-be-processed image list;
(5) And (3) pushing the to-be-processed image list to an appointed file: when all the files are traversed, obtaining a final image list to be processed; and automatically screening out images within a specific range from the original images acquired in the same day by combining a timer, and pushing and storing the images to a designated distributed storage folder.
In one embodiment, in step (3), the naming rule of the file name is: satellite type _ sensor _ longitude _ latitude _ shooting time _ product level and product number.
In one embodiment, in step (4), the determining whether the target range is within the target range includes: calculating whether the central point is located in the range file or not according to a space superposition algorithm, and if the central point is located in the range, reserving the file name; if the center point is not within range, the file name is removed.
In one embodiment, in step S2, the automatically performing multiple decompression according to the screened original image data includes:
when the image meeting the conditions is pushed to a specified distributed storage folder, automatically starting to decompress an original data packet, performing secondary decompression, and decompressing all compressed packet files of the original image to the current folder; and after the decompression is finished, writing the decompressed identification file in the current folder.
In one embodiment, in step S3, the remote sensing image is processed automatically, including:
preparing a reference base map and reference DEM data according to the path of a folder in which the original data is positioned and the system, and processing the original image, including searching control points and connection points of the original image, performing orthoscopic processing on a panchromatic image and a multispectral image, performing fusion processing on the panchromatic image and the multispectral image, and performing bit-down and depth-reduction processing on a fusion result to obtain a high-resolution colorful orthoscopic result image with geographic coordinates; and when all the orthoscopic result images are processed, generating an identification file with the processed images in a result image folder stored in a distributed mode.
In one embodiment, in step S4, the automatic warehousing and retrieving of the result images includes the following steps:
1) Acquiring a file name of an image, and acquiring the shooting time of the image from the file name;
2) Taking the shooting time as a name, newly creating a folder: under a main directory for archiving result data, a folder named as shooting time is newly built;
3) Storing the result image file and other files with the same name into a newly-built shooting time folder;
4) Generating a thumbnail file according to the result image file;
5) The method comprises the steps of obtaining coordinates of four corner points, file names, shooting time of images and spatial resolution attributes according to the attributes of a result image file, writing all the attributes into a database by combining complete paths of files and thumbnails, wherein the coordinates of the four corner points form a polygon, recording the polygon into a spatial relation database, and supporting spatial retrieval.
Another objective of the present invention is to provide a system for implementing the method for automatically processing images and automatically warehousing results, wherein the system for automatically processing images and automatically warehousing results comprises:
the data selection and pushing module is used for selecting and pushing data according to the screening conditions;
the image decompression module is used for automatically decompressing according to the screened original image data;
the image processing remote module is used for automatically processing the remote sensing image;
and the image warehousing and retrieval module is used for automatically warehousing and retrieving the result images.
Another object of the present invention is to provide a computer device, which includes a memory and a processor, wherein the memory stores a computer program, and the computer program, when executed by the processor, causes the processor to execute the automatic image processing and automatic result warehousing method.
Another object of the present invention is to provide a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the processor executes the automatic image processing and automatic result warehousing method.
By combining all the technical schemes, the invention has the advantages and positive effects that:
first, aiming at the technical problems existing in the prior art and the difficulty in solving the problems, the technical problems to be solved by the technical scheme of the present invention are closely combined with results, data and the like in the research and development process, and how to solve the technical scheme of the present invention is deeply analyzed in detail, and some creative technical effects brought by the solution of the problems are specifically described as follows: the combination provided by the invention utilizes the timer to automatically and serially connect image screening and pushing, remote sensing image automatic processing and result image automatic warehousing, so that the real-time processing efficiency of the images shot on the same day is ensured, massive result image data is managed through a certain rule, and the result images can be quickly obtained through retrieval; and the mass data is efficiently managed by utilizing distributed storage. The invention solves the problems that the original remote sensing data cannot be fully utilized, the processing efficiency is not high and the result data reuse rate is low.
Secondly, regarding the technical solution as a whole or from the perspective of products, the technical effects and advantages of the technical solution to be protected by the present invention are specifically described as follows: the method combines a timer and various identification files, links of image processing and filing management are orderly connected in series, the server automatically triggers the processing of each link, and the manual link is completely stripped, so that the unattended operation is really realized, and the processing time efficiency of the mass images is greatly improved.
Third, as an inventive supplementary proof of the claims of the present invention, there are also presented several important aspects:
(1) The invention can reduce the personnel investment, increase the production efficiency of the achievement, and provide massive achievement image data for industrial application;
(2) The invention solves the technical problem of real-time processing of unattended data images, reduces the personnel investment and improves the production efficiency;
(3) The technical scheme of the invention solves the problem that the manual restriction cannot be avoided because the manual participation is needed to connect all the processing links in series in the traditional processing, and the method automatically circulates all the links through automatic processing.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a flowchart of a method for automatically processing satellite images and automatically warehousing results based on distributed storage according to an embodiment of the present invention;
FIG. 2 is a flowchart of screening target images according to an embodiment of the present invention;
FIG. 3 (a) is a schematic diagram illustrating an image center point falling outside the range in an image distribution situation according to an embodiment of the present invention; wherein, the square frame area is an image falling image; the black line range is the target range;
FIG. 3 (b) is a schematic diagram illustrating an image center point falling within a range in an image distribution situation according to an embodiment of the present invention; wherein, the square frame area is an image falling image; the black line range is the target range;
fig. 4 is a flowchart of a method for automatically processing satellite images and automatically warehousing results based on distributed storage according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of the module composition of a satellite image automatic processing and result automatic warehousing system based on distributed storage;
in the figure: 1. a data selection and push module; 2. an image decompression module; 3. an image processing remote module; 4. and an image warehousing and retrieval module.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein, but rather should be construed as broadly as the present invention is capable of modification in various respects, all without departing from the spirit and scope of the present invention.
1. Illustrative examples are illustrated:
example 1
As shown in fig. 1, the method for automatically processing satellite images and automatically warehousing results based on distributed storage according to the embodiment of the present invention includes the following steps:
s101: selecting and pushing data according to the screening conditions;
s102: automatically decompressing according to the screened original image data;
s103: automatically processing the remote sensing image;
s104: and (5) automatically warehousing and retrieving the result images.
Example 2
As shown in fig. 2, based on the satellite image automatic processing and result automatic warehousing method based on distributed storage provided in embodiment 1, further, in step S101, the data selection and pushing according to the screening condition includes the following steps:
(1) Determining screening conditions:
the conditions of the remote sensing image needing automatic processing are set, and the conditions comprise space position, shooting time, satellite type and the like. When the domestic images of every day need to be automatically processed, domestic range files and satellite types need to be appointed;
(2) Determining the path of the original image:
determining the shooting time of the image processed on the current day according to the shooting time difference and the system time of the current day in the processing conditions, and determining the storage path of the original image by combining the satellite type, wherein the storage format of the original image is as follows:
watch (CN)
Raw image filing path specification
| First stage | Second stage | Third stage | Fourth stage | Fifth stage |
| Satellite type | Sensor with a sensor element | Time year of image shooting | Time month of image shooting | Time day of image shooting |
(3) Judging each file one by one, and acquiring the coordinates of the central point of each scene image:
and acquiring the coordinates of the central point of the image through the name of the image, taking out the longitude and latitude in the file name, removing alphabetic characters, and only reserving the numeric characters to obtain the coordinates of the central point of the image.
The naming rule of the image file name is as follows:
GF2_PMS1_E100.9_N28.5_20190104_L1A0003736494。
satellite type _ sensor _ longitude _ latitude _ shooting time _ product level and product number.
And taking out the third and fourth digits in the file name, removing letters, and only retaining the numbers to obtain the coordinates of the central point of the image.
(4) Judging whether the target range is within the target range:
calculating whether the central point is located in a domestic range file according to a space superposition algorithm by using the obtained image central point coordinate and the target range file, and returning true if the central point is located in the range (as shown in figure 3 (b)), and reserving the file name; if the center point is not within range (as shown in FIG. 3 (a)), false is returned and the file name is removed.
(5) Adding the image to a to-be-processed image list and pushing the image to a specified file:
and when all the files are traversed, obtaining a final image list to be processed.
The above steps are used in cooperation with the timer 1, and when the timer 1 is set at 00 a day, the images within a specific range are automatically screened out from the original images acquired on the day, and are copied to a designated folder of distributed storage each day.
Example 3
Based on the method for satellite image automatic processing and result automatic warehousing based on distributed storage provided in embodiment 1, further, in step S102, according to the screened original image data, automatically decompressing includes the following steps:
after the image meeting the conditions is pushed to the specified distributed storage folder, the tar.gz packet decompression of the original data is automatically started, and because the tar.gz needs to be decompressed for the second time in the windows system, the system automatically decompresses all the compressed packet files of the original image to the current folder. After decompression is complete, the identification file (SelectEnd) is written in the current folder.
Example 4
Based on the satellite image automatic processing and result automatic warehousing method based on distributed storage provided by embodiment 1, further, in step S103, the remote sensing image automatic processing includes the following steps:
the remote sensing image processing is a series of processing to the original image according to the reference base map and the reference DEM data prepared in the path and the system of the folder where the original data is located, and comprises the steps of searching control points and connection points of the original image, performing ortho processing to the panchromatic image and the multispectral image, performing fusion processing to the panchromatic image and the multispectral image, and performing the lowering and depth reducing processing to the fused result, so that a high-resolution colorful ortho-result image with the format of tif and geographic coordinates is finally obtained.
The remote sensing image processing is triggered by matching with the timer 2, the timer 2 is set to delay about 8 hours than the timer 1, and the original image data has enough time to be copied and decompressed.
When the timer 2 is triggered, checking whether an identification file (SelectEnd) exists in a specified folder, if the identification file (SelectEnd) does not exist, indicating that decompression is not finished, delaying for half an hour and then triggering remote sensing image processing; if the identification file (SelectEnd) exists, the remote sensing image processing software is automatically triggered, the automatic processing of remote sensing image control point connection point identification, orthographic projection, fusion and lowering and depth reduction is realized, and an orthographic result image with the format of tif and geographic coordinates is obtained.
After all the orthographic result image processing is finished, an identification file (PortesEnd) is written in a result image folder of the distributed storage.
Example 5
Based on the method for satellite image automatic processing and achievement automatic warehousing based on distributed storage provided by embodiment 1, further, in step S104, the achievement automatic warehousing automatically starts image warehousing at a specific time, where the achievement automatic warehousing includes the following steps:
(1) Acquiring the file name of the image, wherein the naming rule of the file name of the image is as follows:
GF2_ PMS1_ E100.9_ N28.5_20190104_l1a0003736494_xxxx, corresponding to:
satellite type _ sensor _ longitude _ latitude _ shooting time _ product level and product number _ additional field;
where XXXX is an additional field after processing. The time taken for the image can be obtained from the file name.
(2) And taking the shooting time as a name to create a new folder. And under a main directory for archiving the result data, a folder named as shooting time is newly created.
(3) And copying the result image tif file and the tif file under the newly-built time folder in the same name.
(4) And generating a thumbnail according to the result image tif file, wherein the format is a jpg file, and the resolution is 10 times of that of the tif file.
(5) The method comprises the steps of obtaining attributes such as coordinates of four corner points, the names of finished image tif files, the shooting time of images and the spatial resolution according to the attributes of the finished image tif files, writing all the attributes into a database by combining complete paths of the finished image tif files and the thumbnail jpg files, wherein the coordinates of the four corner points form a polygon, and recording the polygon into a spatial relation database, so that space-based retrieval is facilitated.
The time of the timer 3 for automatic warehousing of the result images is set to be about 16 hours later than that of the timer 2, so that the remote sensing images have enough time for automatic processing.
When the timer 3 is triggered, whether an identification file (PortesEnd) exists under a result image folder stored in a distributed mode is checked, if the identification file does not exist, the remote sensing image is not automatically processed, and then the automatic storage module of the result image is delayed for half an hour and is triggered again; if yes, the image warehousing process is carried out.
By matching with a result image data management system, the result image can be quickly retrieved according to conditions such as resolution, shooting time, geographical position and the like.
Example 6
As shown in fig. 4, the method for automatically processing satellite images and automatically warehousing results based on distributed storage according to the embodiment of the present invention includes the following steps:
step 1: and selecting and pushing data according to the screening conditions.
The conditions of the remote sensing image needing automatic processing are set, and the conditions comprise space position, shooting time, satellite type and the like. When daily domestic images need to be automatically processed, domestic range files and satellite types need to be specified.
Step 2: and automatically decompressing according to the screened original image data.
After the image meeting the conditions is pushed to the specified distributed storage folder, the tar.gz packet decompression of the original data is automatically started, and because the tar.gz needs to be decompressed for the second time in the windows system, the system automatically decompresses all the compressed packet files of the original image to the current folder. After decompression is complete, the identification file (SelectEnd) is written in the current folder.
And step 3: and (4) automatically processing the remote sensing image.
The remote sensing image processing is a series of processing on an original image according to a reference base map and reference DEM data prepared in a path and a system of a folder where the original data is located, and comprises the steps of searching control points and connection points of the original image, performing orthoscopic processing on a panchromatic image and a multispectral image, performing fusion processing on the panchromatic image and the multispectral image, and performing downscaling and depreciation processing on a fusion result to finally obtain a high-resolution colorful orthoscopic result image with a tif format and geographic coordinates.
The remote sensing image processing is triggered by matching with the timer 2, the timer 2 is set to delay about 8 hours than the timer 1, and the original image data has enough time to be copied and decompressed.
And 4, step 4: and automatically warehousing and retrieving the result images.
The automatic image warehousing is that image warehousing is automatically started under specific time, and the image warehousing comprises the following steps:
(1) Acquiring the file name of the image, wherein the naming rule of the file name of the image is as follows:
GF2_PMS1_E100.9_N28.5_20190104_L1A0003736494_XXXX。
satellite type _ sensor _ longitude _ latitude _ shooting time _ product level and product number _ field added after processing
The time taken for the image can be obtained from the file name.
(2) And taking the shooting time as a name to create a new folder. And under a main directory for archiving the result data, a folder named as shooting time is newly created.
(3) And copying the result image tif file and the result image tif file under a newly-built time folder in the same name.
(4) And generating a thumbnail according to the result image tif file, wherein the format is a jpg file, and the resolution is 10 times of that of the result image tif file.
(5) The method comprises the steps of obtaining attributes such as coordinates of four corner points, the names of finished image tif files, the shooting time of images and the spatial resolution according to the attributes of the finished image tif files, writing all the attributes into a database by combining complete paths of the finished image tif files and the thumbnail jpg files, wherein the coordinates of the four corner points form a polygon, and recording the polygon into a spatial relation database, so that space-based retrieval is facilitated.
The time of the timer 3 for automatic warehousing of the result images is set to be about 16 hours later than that of the timer 2, so that the remote sensing images have enough time for automatic processing.
Example 7
As shown in fig. 5, the system for automatically processing satellite images and automatically warehousing results based on distributed storage according to the embodiment of the present invention includes:
and the data selecting and pushing module 1 is used for selecting and pushing data according to the screening conditions.
And the image decompression module 2 is used for automatically decompressing according to the screened original image data.
And the image processing remote control module 3 is used for automatically processing the remote sensing image.
And the image warehousing and retrieval module 4 is used for automatically warehousing and retrieving the result images.
Example 8
Based on the satellite image automatic processing and result automatic warehousing system based on distributed storage provided in embodiment 7, further, the data selection and pushing module 1 includes:
and the determining and screening condition module is used for setting conditions of the remote sensing image needing automatic processing, including spatial position, shooting time, satellite type and the like. When daily domestic images need to be automatically processed, domestic range files and satellite types need to be specified.
And the path module for determining the original image is used for determining the storage path of the original image by combining the satellite type according to the image shooting time in the processing condition.
And each file one-by-one judgment module is used for collecting the image file lists meeting the conditions and acquiring the coordinates of the central point of the image through the image name.
And the module for judging whether the image is in the target range is used for taking out the third and fourth digits in the file name, removing letters, only retaining numbers, obtaining the center point coordinate of the image and judging whether the center point coordinate is in the target range.
And adding the file name of the central point coordinate in the target range to a to-be-processed image list and pushing the file name to a specified file module, wherein the file name is used for obtaining a final to-be-processed image list after all files are traversed.
The video decompression module 2 includes:
and the secondary decompression module is used for automatically starting the tar.gz packet decompression of the original data after the image meeting the conditions is pushed to the specified distributed storage folder, and the system automatically decompresses all compressed packet files of the original image to the current folder because the tar.gz needs to be decompressed for the second time under the windows system.
And the identification file storage module is used for writing an identification file (SelectEnd) in the current folder after decompression is finished.
The image processing remote module 3 includes:
the remote sensing image processing module is used for preparing a reference base map and reference DEM data according to the path of a folder where the original data are located and in a system, and performing a series of processing on the original image, including control point and connection point searching on the original image, panchromatic image and multispectral image orthographic processing, panchromatic image and multispectral image fusion processing, and lowering depth processing on a fusion result to finally obtain a high-resolution colorful orthographic result image with a format of tif and geographic coordinates.
The original image data copying and decompressing module is used for triggering remote sensing image processing in cooperation with the timer 2, and the timer 2 is set to delay about 8 hours than the timer 1, so that the original image data has enough time to be copied and decompressed.
The image warehousing and retrieval module 4 includes:
and the image file name acquisition module is used for acquiring the file name of the image and acquiring the shooting time of the image from the file name.
And the folder newly-building module is used for building a folder by taking the shooting time as a name. And under a main directory for archiving the result data, a folder named as shooting time is newly created.
And the file homonymy copying module is used for homonymy copying the result image tif file and the result image tif file to a newly-built time folder.
And the thumbnail generation module is used for generating a thumbnail according to the result image tif file, the format is a jpg file, and the resolution is 10 times of that of the result image tif file.
And the image library module 5 is used for acquiring attributes such as coordinates of four corner points, a finished image tif file name, image shooting time, spatial resolution and the like according to the finished image tif file attributes, and writing all the attributes into the database by combining complete paths of the finished image tif file and the thumbnail jpg file.
And the retrieval module 6 is used for forming a polygon by four corner point coordinates, and recording the polygon into a spatial relation database, so that the spatial-based retrieval is facilitated.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
For the information interaction, execution process and other contents between the above devices/units, the specific functions and technical effects brought by the method embodiments of the present invention based on the same concept can be referred to the method embodiments, and are not described herein again.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
2. The application example is as follows:
application example 1
An embodiment of the present invention provides a computer device, including: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, the processor implementing the steps of any of the various method embodiments described above when executing the computer program.
Application example 2
The application embodiment of the present invention further provides a computer-readable storage medium, which stores a computer program, and the computer program can implement the steps in the above method embodiments when executed by a processor.
Application example 3
The application embodiment of the present invention further provides an information data processing terminal, where the information data processing terminal is configured to provide a user input interface to implement the steps in the above method embodiments when implemented on an electronic device, and the information data processing terminal is not limited to a mobile phone, a computer, or a switch.
Application example 4
The application embodiment of the present invention further provides a server, where the server is configured to provide a user input interface to implement the steps in the above method embodiments when implemented on an electronic device.
Application example 5
The application embodiment of the present invention provides a computer program product, which when running on an electronic device, enables the electronic device to implement the steps in the above method embodiments when executed.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments described above may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include at least: any entity or device capable of carrying computer program code to a photographing apparatus/terminal device, a recording medium, computer memory, read-only memory (ROM), random Access Memory (RAM), electrical carrier signal, telecommunications signal and software distribution medium. Such as a usb-drive, a removable hard drive, a magnetic or optical disk, etc.
3. Evidence of the relevant effects of the examples:
taking the high-resolution second image as an example, the effective data shot every day is about 1000 scenes, wherein the effective data is about 300 scenes in China. The traditional processing is that domestic data is manually selected every day, copied to a folder to be processed, copied for a certain time, then whether the copying is finished is manually determined, then the image is automatically processed, and generally, warehousing operation is carried out after work on the next day. Utilizing the techniques of this patent. The method has the advantages that domestic data are automatically screened every morning, the domestic data are pushed to a folder to be processed, the original data images are automatically processed at fixed time through the timer, the achievement data are put into a warehouse in the next morning, the achievement data can be retrieved when the next day goes to work, manual intervention is not needed in the whole process, manual participation is reduced due to the function of a server which is brought into full play, and unattended automatic processing is really achieved.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention, and the scope of the present invention should not be limited thereto, and any modifications, equivalents and improvements made by those skilled in the art within the technical scope of the present invention as disclosed in the present invention should be covered thereby.
Claims (9)
1. An automatic image processing and result warehousing method is characterized by comprising the following steps:
s1: selecting and pushing data according to the screening conditions, and storing the screened original images in the set range into a designated distributed storage folder;
s2: automatically decompressing for multiple times according to the screened original image data; after decompression, generating an identification file in the current folder;
s3: automatically processing the remote sensing image to obtain a high-resolution result image and generate a processed identification file;
s4: automatic warehousing and searching of the result images, automatically generating image thumbnails supporting searching for the obtained result images, and automatically warehousing;
in step S1, data selection and pushing are performed according to the screening condition, which includes the following steps:
(1) Determining screening conditions: setting conditions of remote sensing images needing automatic processing, wherein the conditions comprise space positions, shooting time and satellite types; when daily images need to be automatically processed, a range file and a satellite type are specified;
(2) Determining the path of the original image: determining a storage path of an original image by combining the satellite type according to the image shooting time in the processing condition;
(3) Judging each file one by one, and acquiring the coordinates of the central point of each scene image: the longitude and latitude in the file name are taken out, the alphabetic characters are removed, only the numeric characters are reserved, and the coordinates of the central point of the image are obtained;
(4) Judging whether the target range is within the target range: judging whether the image is in a target range or not by using the central point coordinates and the target range file through a space superposition algorithm, and sorting the image in the target range into a to-be-processed image list;
(5) And (3) pushing the to-be-processed image list to an appointed file: when all the files are traversed, a final image list to be processed is obtained; and automatically screening out images within a specific range from the original images acquired in the same day by combining a timer, and pushing and storing the images to a designated distributed storage folder.
2. The method according to claim 1, wherein in step (3), the naming rule of the file name is: satellite type _ sensor _ longitude _ latitude _ shooting time _ product level and product number.
3. The method of claim 1, wherein the step (4) of determining whether the result is within the target range includes: calculating whether the central point is located in the range file or not according to a space superposition algorithm, and if the central point is located in the range, reserving the file name; if the center point is not within range, the file name is removed.
4. The method as claimed in claim 1, wherein in step S2, the automatically performing multiple decompression according to the screened original image data includes:
when the image meeting the conditions is pushed to a specified distributed storage folder, automatically starting the decompression of an original data packet, carrying out secondary decompression, and decompressing all compressed packet files of the original image to the current folder; and after the decompression is finished, writing the decompressed identification file in the current folder.
5. The method according to claim 1, wherein in step S3, the remote sensing image automatic processing includes:
preparing a reference base map and reference DEM data according to the path of a folder in which the original data is positioned and the system, and processing the original image, including searching control points and connection points of the original image, performing ortho-processing on a panchromatic image and a multispectral image, performing fusion processing on the panchromatic image and the multispectral image, and performing position-lowering and depth-lowering processing on a fusion result to obtain a high-resolution colorful ortho-result image with geographic coordinates; and when all the orthographic result images are processed, generating an identification file with the image processing completed in a result image folder stored in a distributed mode.
6. The method of claim 1, wherein in step S4, the automatic image warehousing and retrieval includes the following steps:
1) Acquiring a file name of an image, and acquiring the shooting time of the image from the file name;
2) Taking the shooting time as a name, creating a new folder: under a main directory for archiving result data, a folder named as shooting time is newly created;
3) Storing the result image file and other files with the same name into a newly-built shooting time folder;
4) Generating a thumbnail file according to the result image file;
5) The method comprises the steps of obtaining coordinates of four corner points, file names, shooting time of images and spatial resolution attributes according to the attributes of a result image file, writing all the attributes into a database by combining complete paths of files and thumbnails, wherein the coordinates of the four corner points form a polygon, recording the polygon into a spatial relation database, and supporting spatial retrieval.
7. A system for implementing the method of any one of claims 1-6, wherein the system comprises:
the data selection and pushing module (1) is used for selecting and pushing data according to the screening conditions;
the image decompression module (2) is used for automatically decompressing according to the screened original image data;
the image processing remote module (3) is used for automatically processing the remote sensing image;
and the image warehousing and retrieval module (4) is used for automatically warehousing and retrieving the result images.
8. A computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the computer program, when executed by the processor, causes the processor to execute the method for automatic processing of images and automatic warehousing of results according to any one of claims 1 to 6.
9. A computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, causes the processor to execute the method for automatic image processing and automatic result warehousing according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211140168.3A CN115292529B (en) | 2022-09-20 | 2022-09-20 | Method, system, equipment and medium for automatic image processing and automatic result warehousing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211140168.3A CN115292529B (en) | 2022-09-20 | 2022-09-20 | Method, system, equipment and medium for automatic image processing and automatic result warehousing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115292529A CN115292529A (en) | 2022-11-04 |
| CN115292529B true CN115292529B (en) | 2023-03-10 |
Family
ID=83833266
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211140168.3A Active CN115292529B (en) | 2022-09-20 | 2022-09-20 | Method, system, equipment and medium for automatic image processing and automatic result warehousing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115292529B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117520436A (en) * | 2023-11-22 | 2024-02-06 | 上海市生态气象和卫星遥感中心 | Meteorological service pilot-scale product display method, device, system and medium |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030110182A1 (en) * | 2000-04-12 | 2003-06-12 | Gary Christophersen | Multi-resolution image management system, process, and software therefor |
| US7970240B1 (en) * | 2001-12-17 | 2011-06-28 | Google Inc. | Method and apparatus for archiving and visualizing digital images |
| CN1304940C (en) * | 2003-10-13 | 2007-03-14 | 南京三宝科技股份有限公司 | Red-light-running photo auto-screening method |
| JP2011210013A (en) * | 2010-03-30 | 2011-10-20 | Entaniya Co Ltd | Image filing system |
| US10089521B2 (en) * | 2016-09-02 | 2018-10-02 | VeriHelp, Inc. | Identity verification via validated facial recognition and graph database |
| CN111125080B (en) * | 2019-12-23 | 2023-09-26 | 北京航天世景信息技术有限公司 | Multi-source remote sensing image integrated management system and method based on pattern spot model |
| CN111256696B (en) * | 2020-02-24 | 2021-11-26 | 武汉大学 | Aircraft autonomous navigation method with multi-feature and multi-level scene matching |
| CN112579677B (en) * | 2020-11-27 | 2023-07-18 | 福建省星云大数据应用服务有限公司 | Automatic processing method for satellite remote sensing image |
| CN112559481A (en) * | 2020-11-27 | 2021-03-26 | 西安中科星图空间数据技术有限公司 | Data storage method and device based on distributed system and relational database |
| WO2022188151A1 (en) * | 2021-03-12 | 2022-09-15 | 深圳市大疆创新科技有限公司 | Image photographing method, control apparatus, movable platform, and computer storage medium |
| CN113781342B (en) * | 2021-07-06 | 2022-03-11 | 自然资源部国土卫星遥感应用中心 | Rapid orthographic correction management method for mass multi-source optical remote sensing images |
| CN114003755B (en) * | 2021-10-25 | 2022-10-11 | 中国自然资源航空物探遥感中心 | Multi-source satellite scene-separating image data organization storage and retrieval method, system and equipment |
| CN115033569A (en) * | 2022-06-02 | 2022-09-09 | 浙江大学 | Self-defined remote sensing image metadata warehousing method |
-
2022
- 2022-09-20 CN CN202211140168.3A patent/CN115292529B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN115292529A (en) | 2022-11-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105701104B (en) | Three-dimensional data engine system based on geographic information | |
| CN111125080B (en) | Multi-source remote sensing image integrated management system and method based on pattern spot model | |
| CN111427847B (en) | Indexing and querying method and system for user-defined metadata | |
| CN112559481A (en) | Data storage method and device based on distributed system and relational database | |
| CN109522271B (en) | Batch insertion and deletion method and device for B + tree nodes | |
| CN115292529B (en) | Method, system, equipment and medium for automatic image processing and automatic result warehousing | |
| CN102880709A (en) | Data warehouse management system and data warehouse management method | |
| CN114020756B (en) | Remote sensing image real-time map service publishing method and device | |
| CN110196847A (en) | Data processing method and device, storage medium and electronic device | |
| CN104834650A (en) | Method and system for generating effective query tasks | |
| CN111708895B (en) | Knowledge graph system construction method and device | |
| CN108334675B (en) | Artificial intelligence processing method and system for batch simulation of working condition set of digital aircraft | |
| CN107391769B (en) | Index query method and device | |
| CN113094442A (en) | Full data synchronization method, device, equipment and medium | |
| CN112632303A (en) | Distributed storage method, analysis method and device for image data | |
| CN111813773A (en) | Power grid meter reading data storage method, uploading method, device and storage device | |
| CN113779286B (en) | Method and device for managing graph data | |
| CN116150295A (en) | Local updating method, device and equipment of tile data and storage medium | |
| CN116028572A (en) | Communication service data processing method, device and computer storage medium | |
| CN113590732B (en) | Display method and device for remote sensing interpretation sample points, electronic equipment and storage medium | |
| CN110866005A (en) | Internet of things data acquisition management method and system, storage medium and terminal | |
| CN112184904B (en) | Digital integration method and device | |
| CN115061982B (en) | Case-customization-based relational graph construction method, system, terminal and medium | |
| CN114035742A (en) | Industrial Internet of things service data storage method, device and storage system | |
| CN117435589A (en) | Data transfer method, device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |