CN116719959B - Map service method and device for multiple-time-state tiles of archaeological excavation site - Google Patents
Map service method and device for multiple-time-state tiles of archaeological excavation site Download PDFInfo
- Publication number
- CN116719959B CN116719959B CN202310974653.9A CN202310974653A CN116719959B CN 116719959 B CN116719959 B CN 116719959B CN 202310974653 A CN202310974653 A CN 202310974653A CN 116719959 B CN116719959 B CN 116719959B
- Authority
- CN
- China
- Prior art keywords
- image
- tile
- mining
- orthographic
- tiles
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000009412 basement excavation Methods 0.000 title claims abstract description 57
- 238000000034 method Methods 0.000 title claims abstract description 34
- 238000005065 mining Methods 0.000 claims description 146
- 230000032683 aging Effects 0.000 claims description 66
- 230000002123 temporal effect Effects 0.000 claims description 41
- 230000003993 interaction Effects 0.000 claims description 32
- 230000008859 change Effects 0.000 claims description 24
- 230000000694 effects Effects 0.000 claims description 13
- 238000011161 development Methods 0.000 claims description 6
- 230000018109 developmental process Effects 0.000 claims description 6
- 238000012163 sequencing technique Methods 0.000 claims description 3
- 238000012545 processing Methods 0.000 abstract description 8
- 230000000875 corresponding effect Effects 0.000 description 37
- 238000007726 management method Methods 0.000 description 27
- 230000008569 process Effects 0.000 description 11
- 238000004364 calculation method Methods 0.000 description 7
- 238000004458 analytical method Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000002093 peripheral effect Effects 0.000 description 4
- 230000002596 correlated effect Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000002349 favourable effect Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000012731 temporal analysis Methods 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000019771 cognition Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/54—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/56—Information retrieval; Database structures therefor; File system structures therefor of still image data having vectorial format
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/587—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Library & Information Science (AREA)
- Remote Sensing (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention relates to the field of electronic image data processing, in particular to a map service method and a map service device for multiple time-state tiles of an archaeological excavation site.
Description
Technical Field
The invention relates to the field of electronic image data processing, in particular to a map service method and device for multiple-time-state tiles of an archaeological excavation site.
Background
Archaeological excavation is an important method for archaeological specialists to know human histories, and is the basis for development of relevant archaeological research work. The archaeological excavation data are process records and important results of archaeological excavation, and scientific archaeological excavation data comprise text data, image data, graphic data and physical data. The archaeological excavation data usually exist in the form of documents, and compared with the real world with time and space dual attributes, the archaeological excavation data need to be further arranged and processed, so that scientificity, completeness cognition, intuitiveness and true reproduction of archaeological sites are realized, and the tile map can realize the functions in archaeological excavation.
Chinese patent grant publication number CN108491427B discloses a PDF tile map and method of making. The PDF tile map adopts a tile pyramid model to store graphic information with map expression and interactable geographic information in a PDF format, has all the characteristics of the PDF map, and mainly comprises the following steps: firstly, a PDF tile map pyramid model is established, then other projected PDF maps are transformed into Web ink card support projection PDF maps through projection, finally, the Web ink card support projection PDF maps are cut based on the PDF tile map pyramid model, and PDF tile maps with the same tile coordinates are spliced, so that the PDF tile map is finally obtained.
Existing single image tile map services employ a tile map pyramid model. Although the tile map pyramid model greatly improves the access speed of map services, the existing single-image tile map services (such as WMS-C, WMTS, TMS, XYZ and other standard tile services) have most of time dimensions or cannot effectively represent continuous changes of images along with time; in order to express temporal information, different temporal information can be expressed only through a plurality of services or a plurality of layers of one service, the image tiles are divided, continuous temporal change of the same area cannot be expressed, but continuous change of different temporal states of the same area is necessary in orthographic images of archaeological mining sites.
Disclosure of Invention
Therefore, the invention provides a map service method and a map service device for multiple-time-state tiles of an archaeological excavation site, which are used for solving the technical problems that the existing tile map service cannot effectively express continuous time-state information and further cannot effectively meet the multiple-time-state analysis of the archaeological excavation site.
In order to achieve the above objective, in one aspect, the present invention provides a map service method for multiple time-state tiles in an archaeological excavation site, including:
step S1, defining a range of a mining site, carrying out map slicing to determine the space range of each tile of the 0 th layer, and carrying out global orthographic image acquisition on an orthographic image of each tile space range of the 0 th layer corresponding to the mining site by utilizing an image acquisition module to generate a 0 th layer image of an initial tile map;
step S2, an auxiliary information acquisition module acquires auxiliary information, and a central control processor judges a local orthographic image acquisition strategy of an image acquisition module according to the auxiliary information and acquires local orthographic images of the mining position tiles according to the local orthographic image acquisition strategy;
step S3, for the discovered position tiles, the central control processor executes an aging judgment strategy, determines aging time periods of the discovered position tiles, outputs the tiles marked with the aging time periods into a multi-temporal management database to be stored as temporal tiles and continuously updates the initial tile map;
S4, acquiring excavation progress information, and storing and marking the excavation progress information on a plurality of tense tiles corresponding to the positions of the cultural relics and the excavation time range in the multi-tense management database according to the positions of the cultural relics and the excavation time range;
step S5, the tile map interaction platform responds to a map query request and displays a single temporal tile map or a dynamic tile map according to the map query request or displays a single cultural relic mining related temporal tile in response to a cultural relic query request;
step S6, the tile map interaction platform combines the mining depth, the tile map and the multi-temporal management database to respond to the mining global image query request to display a cross-temporal global image corresponding to the mining depth;
the auxiliary information comprises image characteristics of a plurality of frames of continuous orthographic images within a preset period, a spatial range corresponding to the image characteristics and a mining depth, the aging judgment strategy is to compare a plurality of groups of currently acquired orthographic images with the previously acquired orthographic images within a single period to judge an aging period which can be represented by Shan Zhangzheng jet images, and the mining progress information comprises a mining cultural relic, a cultural relic position and a mining time range.
Further, in the step S2, the image acquisition module acquires a plurality of frames of continuous orthographic images of each tile space range within a preset period of time with an initial frequency and an initial resolution, the central control processor presets a feature database, the feature database includes a plurality of mining activity features of a plurality of original mining sites, and the central control processor compares the image features of each frame of continuous orthographic images with each mining activity feature to determine the tile space range corresponding to the mining position.
Further, in the step S2, for the tile space range with the exploring feature, the central control processor determines the acquisition frequency and/or the acquisition resolution of the local orthographic image in the next period according to the frame number duty ratio of the current period and the maximum continuous change frame number of the orthographic image;
the frame number ratio is a ratio of a frame number of the forward image with the extracted image characteristics to a frame number of all forward images in a preset period in a tile space range of the preset period, and the maximum continuous change frame number of the forward image is the total number of images of a plurality of frames of forward images meeting continuous change of pixel bytes of adjacent forward images in the current period.
Further, in the step S2, the central control processor detects a continuous tile range, and executes an adjacent tile image acquisition strategy for a tile space range adjacent to the continuous tile range when a characteristic area of the continuous tile range is greater than a preset area;
The continuous tile range is a spatial range covered by the interconnected tiles with continuous change images in the current period, and the adjacent tile image acquisition strategy is to acquire local orthographic images of the adjacent tile range at the acquisition resolution and the acquisition frequency of the tiles in the adjacent continuous tile range;
the adjacent tile extent is each tile space extent adjacent to the continuous tile extent.
Further, in the step S2, if the mining activity feature does not exist in the plurality of frames of images corresponding to all tiles in the mining site, the central control processor controls the image acquisition module to reduce the acquisition frequency and the acquisition resolution.
Further, in the step S3, for tiles in the excavated position and tiles in the adjacent tile range, the central control processor executes the aging determination policy in a single period of time, the aging determination policy including:
and sequencing all the collected orthographic images according to the collection time sequence in the same tile space range, and sequentially comparing the image similarity of each collected orthographic image with the image similarity of the next collected orthographic image to judge the aging period of the collected orthographic image.
Further, in the step S3, in the aging determination policy, the determination of the two adjacent orthographic images to be compared includes;
If the first variation level is the first variation level, the central control processor judges that the next orthographic image is reserved, and extends the ageing period of the next orthographic image to the ageing period corresponding to the previous orthographic image;
if the first variation level is the second variation level, the central control processor judges that two orthographic images are reserved, and records initial aging time periods of the two orthographic images as corresponding aging time periods respectively;
the initial aging period of Shan Zhangzheng shot images is from the current image acquisition time to the previous time of the next orthographic image acquisition time;
the first change level satisfies that the image similarity between the collected orthographic image and the next collected orthographic image is larger than or equal to a preset threshold value, and the second change level satisfies that the image similarity between the collected orthographic image and the next collected orthographic image is smaller than the preset threshold value.
Further, in the step S5, the 0 th layer of the singlet tile map is composed of singlet tiles, and the 0 th layer of the dynamic tile map includes a dynamic image that covers a plurality of singlet tiles of a specified query period and shows an orthographic image of a corresponding aging period continuously varying with time in a time sequence;
the single temporal tiles are temporal tiles whose aging period covers a specified query time point.
Further, in the step S6, for the mining depth of a single query request, the central control processor matches a plurality of temporal tiles corresponding to the mining depth according to the mining height data, and generates a cross-temporal global image at the mining depth of the query request according to the plurality of temporal tiles corresponding to the mining depth;
each tile in the cross-temporal global image satisfies that each tile in the image shows an orthographic image at the depth of development.
In another aspect, the present invention provides a map service device for multiple time-state tiles in an archaeological excavation site, which is characterized by comprising:
the image acquisition module is used for acquiring an overall orthographic image, a local orthographic image and a mining depth of a mining site;
the auxiliary information acquisition module is used for acquiring image features of the orthographic images, a spatial range corresponding to the image features and a mining depth;
the feature database is used for storing a plurality of mining activity features of a plurality of original mining sites;
the multi-temporal management database is used for storing each image acquired by the image acquisition module, storing a plurality of temporal tiles in a classified mode and storing the development progress information;
the tile map interaction platform is respectively connected with the image acquisition module and the multi-time management database and is used for receiving a query request of a user, generating a tile map and interacting with the user to respond to a map control instruction;
The central control processor is respectively connected with the image acquisition module, the auxiliary information acquisition module, the characteristic database, the multi-temporal management database and the tile map interaction platform, and is used for judging a local orthographic image acquisition strategy of the image acquisition module according to the auxiliary information so as to acquire the local orthographic image, executing an aging judgment strategy, outputting tiles marked with the aging period to the multi-temporal management database to be stored as temporal tiles, and generating a corresponding map according to a query request and/or a control instruction of a user and outputting the map to the tile map interaction platform.
Compared with the prior art, the method has the beneficial effects that the multi-temporal analysis requirement on the tile map in the archaeological excavation process is considered on the basis of the existing tile map technology, the tile map can represent continuous change of the archaeological excavation site along with time by establishing the multi-temporal database and the tile map interaction platform, the tile map interaction platform can display various images according to different inquiry requests, effective data support is provided for archaeological excavation, and the information quantity of the tile map is effectively improved.
Furthermore, the invention demarcates the range of the mining site and divides the mining site into a plurality of tiles, and an image acquisition module is utilized to acquire the orthographic images corresponding to the tiles of the 0 th layer and generate an initial tile map, thereby laying a foundation for the updating and inquiring service of the follow-up tile map.
Furthermore, the invention improves the recognition precision of the mining range by judging the image mining characteristics, avoids the influence of the non-mining moving images on the judging process and the acquisition strategy, reduces the calculation power consumption of equipment and improves the acquisition efficiency.
Further, the image acquisition module acquires the local orthographic images of the mining position tiles according to the local orthographic image acquisition strategy formulated by the central control processor, so that the centralized acquisition of the mining position images is facilitated, the overload of equipment caused by overlarge data volume due to blind acquisition is avoided, the calculation power consumption of the equipment is further reduced, the acquisition efficiency is improved, the timely tracking of dynamic changes of mining sites is facilitated, and the map information volume of the tiles is further effectively improved.
Further, the central control processor judges the ageing period of the tile at the excavation position according to the ageing judgment strategy, the tile marked by the ageing period is output to the multi-temporal management database to be stored as a temporal tile and updated on the initial tile map, and only one tile is stored and marked for ageing for the same images of a plurality of multi-temporal segments through judging the ageing period of the tile, so that the situation that the database stores a large number of repeated identical images in the multi-temporal management database is avoided, the situation that the blind storage causes the data volume to be too large and further causes the overload of equipment is avoided, the calculation force consumption of the equipment is further reduced, the temporal tile enables the tile map to display temporal and excavation progress changes in real time, the archaeological progress, the archaeological time range and the space range are conveniently and statistically analyzed by archaeological staff, and the information quantity of the tile map is further effectively improved.
Further, the mining progress information is acquired and stored in the multi-temporal management database in association with the position and the mining time range of the cultural relics, so that the tile map can display the mining process of the single cultural relics in real time, the targeted analysis of the single cultural relics by archaeological staff is facilitated, and the information quantity of the tile map is further effectively improved.
Further, after the mining is finished, the tile map interaction platform combines the mining depth, the tile map and the multi-temporal management database to respond to the mining global image query request to display the cross-temporal global image corresponding to the mining depth, so that the archaeological staff can conveniently conduct overall analysis on the global image corresponding to the single depth, and the information quantity of the tile map is further effectively improved.
Further, the central control processor detects the continuous tile range, and executes the adjacent tile image acquisition strategy on the tiles adjacent to the continuous tile range when the continuous tile range is larger than the preset area, when the mining range is too large, the mining can influence other peripheral positions, the influence of large-area mining on the peripheral mining site can be accurately and effectively represented through the adjacent tile image acquisition strategy, the early warning and processing of the mining influence by archaeological staff are facilitated, and the tile map information quantity is further effectively improved.
Drawings
FIG. 1 is a flow chart of a map service method for multiple time-state tiles of an archaeological excavation site according to the present invention;
FIG. 2 is a block diagram of a multi-temporal tile map service apparatus of the archaeological excavation site of the present invention;
FIG. 3 is a schematic representation of a tile map of the present invention;
wherein: 1, tile map layer 0; 2, tile map layer 1; 3, tile map layer 2.
Detailed Description
In order that the objects and advantages of the invention will become more apparent, the invention will be further described with reference to the following examples; it should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are merely for explaining the technical principles of the present invention, and are not intended to limit the scope of the present invention.
It should be noted that, in the description of the present invention, terms such as "upper," "lower," "left," "right," "inner," "outer," and the like indicate directions or positional relationships based on the directions or positional relationships shown in the drawings, which are merely for convenience of description, and do not indicate or imply that the apparatus or elements must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as limiting the present invention.
Furthermore, it should be noted that, in the description of the present invention, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be either fixedly connected, detachably connected, or integrally connected, for example; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention can be understood by those skilled in the art according to the specific circumstances.
Referring to fig. 2, which is a block diagram of a map service device for multiple time-state tiles of an archaeological excavation site according to the present invention, the map service device for multiple time-state tiles of an archaeological excavation site according to the present invention includes:
the image acquisition module is used for acquiring an overall orthographic image, a local orthographic image and a mining depth of a mining site;
optionally, the image acquisition module comprises unmanned aerial vehicle platform, navigation system, depth camera, can acquire vertical route orthographic image and overlook the image in the scene of discovery, realizes the quick global collection in the scene of discovery.
Optionally, the image acquisition module is composed of a laser three-dimensional scanner, a laser emitter, a photoelectric detector and a steering mirror, and is used for acquiring point cloud data by scanning at a mining site and generating a digital surface model to acquire three-dimensional information of the mining site.
Optionally, the image acquisition module is composed of a total station, a monitoring camera and the like, can acquire monitoring image information of the mining site, and periodically monitors the key position by DYNAMIC to realize the change tracking of the key area of the mining site.
The auxiliary information acquisition module is used for acquiring image features of the orthographic images, a spatial range corresponding to the image features and a mining depth.
And the feature database is used for storing a plurality of mining activity features of a plurality of original mining sites.
The multi-temporal management database is used for storing each image acquired by the image acquisition module, storing a plurality of temporal tiles in a classified mode and storing the development progress information.
Optionally, the multi-temporal management database is an SQL database, and the SQL language is utilized to create a mining site information database, including mining position, time, depth and image characteristic data table, for storing various information.
Optionally, the multi-time management database is a graph database, the nodes are used for representing the information of the mining position, the time and the depth, and the side is used for representing the association between the information to manage and query the information.
Optionally, the multi-temporal management database is a NoSQL database, adopts a key value pair storage structure, the key is an information type, the value is specific information, and the multi-temporal management database is a flexible storage structure without a mode and is used for storing various information.
The tile map interaction platform is respectively connected with the image acquisition module and the multi-time management database and is used for receiving a query request of a user, generating a tile map and interacting with the user to respond to a map control instruction;
optionally, the tile map interaction platform is a WebGIS system, and a geographic information system based on a Web browser is used for drawing the tile map by utilizing JS libraries such as leaf programs and the like, so that map browsing, inquiring, editing and the like can be performed.
Optionally, the tile map interaction platform is desktop GIS, such as ArcGIS, QGIS, and the like, and special GIS software has powerful space analysis and data management functions, and can efficiently manage and display tile maps and temporal information.
Optionally, the tile map interaction platform is a mobile terminal App, and the tile map App for the archaeological worker is developed by using a mobile device with space positioning and network functions, so that real-time query and interaction can be performed on a mining site to assist in archaeological work.
The central control processor is respectively connected with the image acquisition module, the auxiliary information acquisition module, the characteristic database, the multi-temporal management database and the tile map interaction platform, and is used for judging a local orthographic image acquisition strategy of the image acquisition module according to the auxiliary information so as to acquire the local orthographic image, executing an aging judgment strategy, outputting tiles marked with aging time periods into the multi-temporal management database to be stored as temporal tiles, and generating corresponding maps according to a query request and/or a control instruction of a user and outputting the maps to the tile map interaction platform.
Optionally, the central control processor is a workstation, has strong data processing and computing capabilities, is provided with image processing and GIS software, and is used for generating and updating a tile map, formulating an acquisition strategy, judging an aging period and the like.
Optionally, the central control processor is an industrial personal computer, an embedded system and can perform information acquisition, processing and control, and the central control processor is instantiated as a field acquisition terminal, so that real-time control and information acquisition of the image acquisition equipment are realized.
Optionally, the central control processor is a cloud server, and utilizes self high-performance computing and storage functions to collect, process and manage data, and provides inquiry and interaction services for the client through a network.
Referring to fig. 1, which is a flowchart of a map service method for multiple time-state tiles of an archaeological excavation site, the map service method for multiple time-state tiles of the archaeological excavation site of the present invention includes:
step S1, defining a range of a mining site, carrying out map slicing to determine the space range of each tile of the 0 th layer, and carrying out overall orthographic image acquisition on an orthographic image of the mining site corresponding to each tile space range of the 0 th layer by utilizing an image acquisition module to generate a 0 th layer image of an initial tile map;
Referring to fig. 3, which is a schematic diagram of a tile map of the present invention, a pyramid model of the tile map is a multi-resolution hierarchical model, and is stored and displayed with different resolutions according to user needs under a unified spatial reference, so as to form a pyramid structure with resolution from thick to thin and data size from small to large. The geographic range represented is unchanged, and the more detailed the pyramid is to the map information represented by the bottom layer, the larger the scale is. Firstly, determining that the number of zoom levels provided by a map service is N, taking a map picture with the highest zoom level and the largest map scale as the bottom layer of a pyramid, namely, a tile map layer 0 1, dividing the map picture into square map tiles with the same size (such as 256x256 pixels) from left to right and from top to bottom, forming a tile layer 0 matrix, generating a tile map layer 1 and 2 according to a method of synthesizing one pixel according to 2x2 pixels on the basis of the map layer 0 picture, dividing the tile map layer 1 into square map tiles with the same size as the next layer, forming the tile map layer 1, generating a tile map layer 2 and 3 … to the N-1 layers by adopting the same method, and adopting structural storage management of the tile pyramid service model for image data.
The invention demarcates the range of the mining site and divides the mining site into a plurality of tiles, and an image acquisition module is utilized to acquire the orthographic images corresponding to the tiles of the 0 th layer and generate an initial tile map, thereby laying a foundation for the updating and inquiring service of the follow-up tile map.
Step S2, an auxiliary information acquisition module acquires auxiliary information, and a central control processor judges a local orthographic image acquisition strategy of an image acquisition module according to the auxiliary information and acquires local orthographic images of the mining position tiles according to the local orthographic image acquisition strategy;
step S3, for the mining position tiles, the central control processor executes an aging judgment strategy, determines aging time periods of the mining position tiles, outputs the tiles marked with the aging time periods into a multi-temporal management database, stores the tiles as temporal tiles and continuously updates the tiles on an initial tile map;
s4, acquiring excavation progress information, storing the excavation progress information according to the position and the excavation time range of the cultural relics, and marking the excavation progress information on a plurality of temporal tiles corresponding to the position and the excavation time range of the cultural relics in a multi-temporal management database;
step S5, the tile map interaction platform responds to the map query request and displays a single temporal tile map or a dynamic tile map according to the map query request or displays a single cultural relic mining related temporal tile according to the cultural relic query request;
Step S6, the tile map interaction platform combines the mining depth, the tile map and the multi-temporal management database to respond to the mining global image query request to display a trans-temporal global image corresponding to the mining depth;
according to the invention, the multi-temporal analysis requirement on the tile map in the archaeological excavation process is considered on the basis of the existing tile map technology, the tile map can represent the continuous change of the archaeological excavation site along with time by establishing the multi-temporal database and the tile map interaction platform, the tile map interaction platform can display various images according to different inquiry requests, effective data support is provided for archaeological excavation, and the information quantity of the tile map is effectively improved.
Wherein the slice number of the slices is positively correlated with the layer number of the tile map;
the auxiliary information comprises image characteristics of a plurality of frames of continuous orthographic images within a preset period, a spatial range corresponding to the image characteristics and a mining depth, and the aging judgment strategy is to compare a plurality of groups of currently acquired orthographic images with the previously acquired orthographic images within a single period to judge an aging period which can be represented by Shan Zhangzheng jet images, wherein the mining progress information comprises a mining cultural relic, a cultural relic position and a mining time range;
The input data of the map query request comprises tile level, line number, column number, query time point and query time period, the input data of the cultural relic query request comprises excavation cultural relics, and the input data of the global image query request comprises excavation depth or excavation elevation data.
Specifically, in step S2, the image acquisition module acquires a plurality of frames of continuous orthographic images of each tile space range within a preset period of time at an initial frequency and an initial resolution, the central control processor presets a feature database, the feature database includes a plurality of mining activity features of a plurality of original mining sites, and the central control processor compares the image features of each frame of continuous orthographic images with each mining activity feature to determine the tile space range corresponding to the mining position.
Wherein the predetermined period of time is related to a mining cycle of the mining site, and the selectable predetermined period of time is 5 minutes, 10 minutes, or 15 minutes.
The feature database is established before the mining, specifically, the feature database may be established according to the following steps:
collecting original cultural relic mining site images, inputting the collected mining image data into a database, extracting features including shapes, RGB, textures, sizes and the like of the mining image data input into the database, storing the features into the database, and periodically updating cultural relic information and features in the database to ensure that the data and information in the database are accurate and complete.
The central control processor compares the image characteristics of a plurality of frames of continuous orthographic images with the characteristic database to judge a plurality of tile space ranges corresponding to the mining positions. Specifically, the central control processor firstly extracts the characteristics of a plurality of frames of continuous orthographic images in a preset period, including the characteristics of textures, RGB, shapes, sizes and the like of the images. It then compares these features to the mining activity features in the feature database. If a matching feature is found, the central processor will determine that a discovered feature exists for that tile space range and record this information for subsequent processing.
Alternatively, the feature determination process employs a neural network algorithm.
Optionally, the feature database includes non-mining features to exclude images caused by non-mining movements from affecting the decision process.
The invention improves the recognition precision of the mining range by judging the image mining characteristics, avoids the influence of the non-mining moving images on the judging process and the acquisition strategy, reduces the calculation power consumption of equipment and improves the acquisition efficiency.
Specifically, in step S2, for the tile space range with the exploring feature, the central control processor determines the acquisition frequency and/or the acquisition resolution of the partial orthographic image of the next period according to the frame number duty ratio of the current period and the maximum continuous variation frame number of the orthographic image;
Wherein, the acquisition frequency and the acquisition resolution are respectively positively correlated with the frame number ratio and the maximum continuous change frame number;
the frame number ratio is the ratio of the frame number of the forward image with the characteristics of the found image to the number of all forward image frames in the preset time period in the tile space range of the preset time period, and the maximum continuous change frame number of the forward image is the total number of the images of a plurality of frames of forward images which meet the continuous change of the pixel bytes of the adjacent forward images in the current time period.
Example 1: the frame number V0 of all the normal images of a tile in the mining site is 1000 frames within a preset period of 5min, the frame number V of the mining image features in the tile space range is 400 frames, and the maximum frame number L of the continuous change of pixel bytes of the normal images meeting the mining image features is 20 frames;
frame number ratio=400/1000=0.4;
the acquisition frequency f is calculated by equation (1),
（1）
wherein, the liquid crystal display device comprises a liquid crystal display device,and->For the conversion factor, optionally, +.>=0.05, β=5, f0=10 times/min, and the acquisition frequency f was calculated to be 20Secondary/min;
the calculation of the acquisition resolution is the same as the above steps.
Specifically, in step S2, the central control processor detects a continuous tile range and executes an adjacent tile image acquisition strategy for a tile space range adjacent to the continuous tile range when the characteristic area of the continuous tile range is greater than a preset area;
The continuous tile range is a spatial range covered by the interconnected tiles with continuous change images in the current period, the preset area is positively correlated with the area of the mining site, and the adjacent tile image acquisition strategy is to acquire local orthographic images of the adjacent tile range with the acquisition resolution and the acquisition frequency of the tiles in the adjacent continuous tile range;
an adjacent tile range is each tile space range adjacent to a contiguous tile range.
According to the invention, the central control processor detects the continuous tile range, and executes the adjacent tile image acquisition strategy on the adjacent tiles with the continuous tile range when the continuous tile range is larger than the preset area, when the mining range is overlarge, the mining can influence other peripheral positions, and the influence of large-area mining on the peripheral mining site can be accurately and effectively represented through the adjacent tile image acquisition strategy, so that the early warning and processing of the mining influence by archaeological staff are facilitated, and the tile map information quantity is further effectively improved.
Specifically, in step S2, if the mining activity feature does not exist in the plurality of frames of images corresponding to all tiles in the mining site, the central control processor controls the image acquisition module to reduce the acquisition frequency and the acquisition resolution to half of the current acquisition frequency and the acquisition resolution.
The image acquisition module acquires the local orthographic images of the tile at the mining position according to the local orthographic image acquisition strategy formulated by the central control processor, which is favorable for centralized acquisition of the image at the mining position, avoids overlarge data volume caused by blind acquisition and overload of equipment, further reduces the calculation power consumption of the equipment, improves the acquisition efficiency, is favorable for timely tracking dynamic changes of the mining site, and further effectively improves the information volume of the tile map.
Specifically, in step S3, for tiles in the excavated position and tiles in the adjacent tile range, the central control processor executes an aging determination policy for a single period of time, the aging determination policy including:
and sequencing all the collected orthographic images according to the collection time sequence in the same tile space range, and sequentially comparing the image similarity of each collected orthographic image with the image similarity of the next collected orthographic image to judge the aging period of the collected orthographic image.
Specifically, in step S3, in the aging determination policy, the determination of the two adjacent orthographic images to be compared includes;
if the first variation level is the first variation level, the central control processor judges that the next orthographic image is reserved, and extends the aging period of the next orthographic image to the aging period corresponding to the previous orthographic image;
If the first variation level is the second variation level, the central control processor judges that two orthographic images are reserved, and the initial aging time periods of the two orthographic images are recorded as corresponding aging time periods respectively;
the initial aging period of Shan Zhangzheng shot images is from the current image acquisition time to the previous time of the next orthographic image acquisition time;
the central control processor groups the reserved orthographic images and the corresponding aging time periods according to the tile space ranges, and stores the orthographic images in a multi-temporal management database in a time sequence order, wherein a single group of orthographic images are stored as temporal tiles corresponding to the tile space ranges and the corresponding temporal states;
the first change level satisfies that the image similarity between the collected orthographic image and the next collected orthographic image is larger than or equal to a preset threshold value, and the second change level satisfies that the image similarity between the collected orthographic image and the next collected orthographic image is smaller than the preset threshold value.
The central control processor judges the ageing period of the tile at the excavation position according to the ageing judgment strategy, outputs the tile marked by the ageing period as a temporal tile to the multi-temporal management database for storage and updates the tile map, only stores one and marks ageing for a plurality of images with the same time period through judging the ageing period of the tile, avoids the situation that the multi-temporal management database of the database stores a large number of repeated images with the same time, avoids overlarge data volume caused by blind storage, further reduces equipment calculation power consumption, and the temporal tile enables the tile map to display temporal and excavation progress changes in real time, thereby facilitating the statistical analysis of archaeological progress, archaeological time range and space range by archaeological staff, and further effectively improving the information quantity of the tile map.
Specifically, in step S5, the 0 th layer of the singlet tile map is composed of each singlet tile, and the 0 th layer of the dynamic tile map includes a plurality of singlet tiles covering a specified query period and displays a dynamic image of continuous changes of the orthographic image of the corresponding aging period with time in chronological order;
the single temporal tiles are temporal tiles whose aging period covers a specified query time point.
Specifically, in step S6, for the mining depth of a single query request, the central control processor matches a plurality of temporal tiles corresponding to the mining depth according to the mining elevation data, and generates a cross-temporal global image at the mining depth of the query request according to the plurality of temporal tiles corresponding to the mining depth;
the cross-temporal global image satisfies that each tile in the image shows an orthographic image at the depth of the mining.
After the mining is finished, the tile map interaction platform combines the mining depth, the tile map and the multi-temporal management database to respond to the mining global image query request to display the trans-temporal global image corresponding to the mining depth, so that the archaeological staff can conveniently conduct overall analysis on the global image corresponding to the single depth, and the information quantity of the tile map is further effectively improved.
In embodiment 2, in the process of mining a tomb in Shaanxi, archaeological technicians want to check the mining progress of the area A in the afternoon of the day, and send a period of 6 months, 1 day and 14 to the tile map interaction module: 00-6 months 1 day 18: 00. the area is a query request of the area A, and the tile map interaction module displays that the area A is 14 on 1 day of 6 months: 00-6 months 1 day 18:00, all the single-state tiles and the multi-state tiles form a tile map of the area A together, the single-state tiles indicate that the position is unchanged, the multi-state tiles are dynamic images, and archaeological technicians can check the progress of excavation at a certain moment through fast forward and pause.
In the process of digging a certain tomb in Shaanxi, archaeological technicians want to check how the B cultural relics are dug, the numbers and the names of the B cultural relics are sent to a tile map interaction module, and the tile map interaction module displays the single-temporal tile and the multi-temporal tile images of the digging of the B cultural relics in the digging area of the B cultural relics and the digging period of the B cultural relics.
In embodiment 3, after the excavation of some tomb in Shaanxi is completed, archaeological staff want to check the cultural relics with the excavation depth of 20-25 m in the whole excavation area to summarize appearance rules or check the excavation images with the excavation depth of 20-25 m in the whole excavation area compared with different areas, and send a query request with the excavation depth of 20-25 m to a tile map interaction module, wherein the tile map interaction module displays a single-time tile with the excavation depth of 20-25 m and a multi-time tile image, namely a cross-time global image, and the archaeological staff can also see cultural relic information corresponding to different depths.
Thus far, the technical solution of the present invention has been described in connection with the preferred embodiments shown in the drawings, but it is easily understood by those skilled in the art that the scope of protection of the present invention is not limited to these specific embodiments. Equivalent modifications and substitutions for related technical features may be made by those skilled in the art without departing from the principles of the present invention, and such modifications and substitutions will be within the scope of the present invention.
The foregoing description is only of the preferred embodiments of the invention and is not intended to limit the invention; various modifications and variations of the present invention will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. The map service method for the multi-temporal tiles of the archaeological excavation site is characterized by comprising the following steps of:
step S1, defining a range of a mining site, carrying out map slicing to determine the space range of each tile of the 0 th layer, and carrying out overall orthographic image acquisition on an orthographic image corresponding to each tile space range of the 0 th layer by utilizing an image acquisition module to generate a 0 th layer image of an initial tile map;
Step S2, an auxiliary information acquisition module acquires auxiliary information, and a central control processor judges a local orthographic image acquisition strategy of an image acquisition module according to the auxiliary information and acquires local orthographic images of the mining position tiles according to the local orthographic image acquisition strategy;
step S3, for the discovered position tiles, the central control processor executes an aging judgment strategy, determines aging time periods of the discovered position tiles, outputs the tiles marked with the aging time periods into a multi-temporal management database to be stored as temporal tiles and continuously updates the initial tile map;
s4, acquiring excavation progress information, and storing and marking the excavation progress information on a plurality of tense tiles corresponding to the positions and the excavation time ranges of the cultural relics in the multi-tense management database according to the positions and the excavation time ranges of the cultural relics;
step S5, the tile map interaction platform responds to the map query request and displays a single temporal tile map or a dynamic tile map according to the map query request or displays a single cultural relic mining related temporal tile according to the cultural relic query request;
step S6, the tile map interaction platform combines the mining depth, the tile map and the multi-temporal management database to respond to the mining global image query request to display a cross-temporal global image corresponding to the mining depth;
The auxiliary information comprises image characteristics of a plurality of frames of continuous orthographic images within a preset period, a spatial range corresponding to the image characteristics and a mining depth, the aging judgment strategy is to compare a plurality of groups of currently acquired orthographic images with the previously acquired orthographic images within a single period to judge an aging period which can be represented by Shan Zhangzheng jet images, and the mining progress information comprises a mining cultural relic, a cultural relic position and a mining time range.
2. The method according to claim 1, wherein in the step S2, the image acquisition module acquires a plurality of frames of continuous orthographic images of each tile space range within a preset period of time at an initial frequency and an initial resolution, the central control processor presets a feature database, the feature database includes a plurality of mining activity features of a plurality of original mining sites, and the central control processor compares the image features of each frame of continuous orthographic images with each mining activity feature to determine the tile space range corresponding to the mining position.
3. The method according to claim 2, wherein in the step S2, for a tile space range in which the exploring feature exists, the central control processor determines the acquisition frequency and/or the acquisition resolution of the partial orthographic image of the next period according to the frame number ratio of the current period and the maximum continuous variation frame number of the orthographic image;
The frame number ratio is a ratio of a frame number of the forward image with the extracted image characteristics to a frame number of all forward images in a preset period in a tile space range of the preset period, and the maximum continuous change frame number of the forward image is the total number of images of a plurality of frames of forward images meeting continuous change of pixel bytes of adjacent forward images in the current period.
4. The method according to claim 3, wherein in the step S2, the central control processor detects a continuous tile range and performs an adjacent tile image acquisition strategy for a tile space range adjacent to the continuous tile range when a characteristic area of the continuous tile range is larger than a preset area;
the continuous tile range is a spatial range covered by the interconnected tiles with continuous change images in the current period, and the adjacent tile image acquisition strategy is to acquire local orthographic images of the adjacent tile range at the acquisition resolution and the acquisition frequency of the tiles in the adjacent continuous tile range;
the adjacent tile extent is each tile space extent adjacent to the continuous tile extent.
5. The method according to claim 4, wherein in the step S2, if the feature of the mining activity does not exist in the plurality of frames of images corresponding to all tiles of the mining site, the central control processor controls the image acquisition module to reduce the acquisition frequency and the acquisition resolution.
6. The method according to claim 1, wherein in step S3, for tiles in the mining position and tiles in the adjacent tile range, the central processor executes the aging determination policy in a single time period, the aging determination policy including:
and sequencing all the collected orthographic images according to the collection time sequence in the same tile space range, and sequentially comparing the image similarity of each collected orthographic image with the image similarity of the next collected orthographic image to judge the aging period of the collected orthographic image.
7. The method according to claim 6, wherein in the step S3, the determining of the adjacent two orthographic images for comparison in the aging determination policy includes;
if the first variation level is the first variation level, the central control processor judges that the next orthographic image is reserved, and extends the ageing period of the next orthographic image to the ageing period corresponding to the previous orthographic image;
if the first variation level is the second variation level, the central control processor judges that two orthographic images are reserved, and records initial aging time periods of the two orthographic images as corresponding aging time periods respectively;
The initial aging period of Shan Zhangzheng shot images is from the current image acquisition time to the previous time of the next orthographic image acquisition time;
the first change level satisfies that the image similarity between the collected orthographic image and the next collected orthographic image is larger than or equal to a preset threshold value, and the second change level satisfies that the image similarity between the collected orthographic image and the next collected orthographic image is smaller than the preset threshold value.
8. The method according to claim 1, wherein in the step S5, the 0 th layer of the map of the single-temporal tiles is composed of single-temporal tiles, and the 0 th layer of the map of the dynamic tiles includes a plurality of single-temporal tiles covering a designated query period and displays a dynamic image of continuous change of an orthographic image of a corresponding aging period with time in a time-series order;
the single temporal tiles are temporal tiles whose aging period covers a specified query time point.
9. The method according to claim 1, wherein in the step S6, for a mining depth of a single query request, the central control processor matches a plurality of temporal tiles corresponding to the mining depth according to mining elevation data, and generates a cross-temporal global image at the mining depth of the query request according to the plurality of temporal tiles corresponding to the mining depth;
Each tile in the cross-temporal global image satisfies that each tile in the image shows an orthographic image at the depth of development.
10. An apparatus for applying the map service method of any one of claims 1 to 9, comprising:
the image acquisition module is used for acquiring an overall orthographic image, a local orthographic image and a mining depth of a mining site;
the auxiliary information acquisition module is used for acquiring image features of the orthographic images, a spatial range corresponding to the image features and a mining depth;
the feature database is used for storing a plurality of mining activity features of a plurality of original mining sites;
the multi-temporal management database is used for storing each image acquired by the image acquisition module, storing a plurality of temporal tiles in a classified mode and storing the development progress information;
the tile map interaction platform is respectively connected with the image acquisition module and the multi-time management database and is used for receiving a query request of a user, generating a tile map and interacting with the user to respond to a map control instruction;
the central control processor is respectively connected with the image acquisition module, the auxiliary information acquisition module, the characteristic database, the multi-temporal management database and the tile map interaction platform, and is used for judging a local orthographic image acquisition strategy of the image acquisition module according to the auxiliary information so as to acquire the local orthographic image, executing an aging judgment strategy, outputting tiles marked with the aging period to the multi-temporal management database to be stored as temporal tiles, and generating a corresponding map according to a query request and/or a control instruction of a user and outputting the map to the tile map interaction platform.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310974653.9A CN116719959B (en) | 2023-08-04 | 2023-08-04 | Map service method and device for multiple-time-state tiles of archaeological excavation site |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310974653.9A CN116719959B (en) | 2023-08-04 | 2023-08-04 | Map service method and device for multiple-time-state tiles of archaeological excavation site |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116719959A CN116719959A (en) | 2023-09-08 |
| CN116719959B true CN116719959B (en) | 2023-10-20 |
Family
ID=87864647
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310974653.9A Active CN116719959B (en) | 2023-08-04 | 2023-08-04 | Map service method and device for multiple-time-state tiles of archaeological excavation site |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116719959B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117934884B (en) * | 2024-03-21 | 2024-06-18 | 西安云图信息技术有限公司 | Intelligent field investigation digital recording system and method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20140099756A (en) * | 2013-02-04 | 2014-08-13 | (주)다인디지컬처 | Method for Handling 3-Dimensional Scanning Data for Excavation and Analysis of Cultural Assets |
| CN108255863A (en) * | 2016-12-29 | 2018-07-06 | 广东中科遥感技术有限公司 | Tile map and its method of servicing with time dimension |
| CN108763340A (en) * | 2018-05-14 | 2018-11-06 | 广东中科遥感技术有限公司 | Tense tile map method of servicing and electronic equipment based on multiresolution image |
| CN110706341A (en) * | 2019-09-17 | 2020-01-17 | 广州市城市规划勘测设计研究院 | High-performance rendering method and device of city information model and storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8001115B2 (en) * | 2008-10-16 | 2011-08-16 | The Curators Of The University Of Missouri | Identifying geographic-areas based on change patterns detected from high-resolution, remotely sensed imagery |
-
2023
- 2023-08-04 CN CN202310974653.9A patent/CN116719959B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20140099756A (en) * | 2013-02-04 | 2014-08-13 | (주)다인디지컬처 | Method for Handling 3-Dimensional Scanning Data for Excavation and Analysis of Cultural Assets |
| CN108255863A (en) * | 2016-12-29 | 2018-07-06 | 广东中科遥感技术有限公司 | Tile map and its method of servicing with time dimension |
| CN108763340A (en) * | 2018-05-14 | 2018-11-06 | 广东中科遥感技术有限公司 | Tense tile map method of servicing and electronic equipment based on multiresolution image |
| CN110706341A (en) * | 2019-09-17 | 2020-01-17 | 广州市城市规划勘测设计研究院 | High-performance rendering method and device of city information model and storage medium |
Non-Patent Citations (3)
| Title |
|---|
| Norzailawati, M. N. et al..FILTERING TECHNIQUES ON ANALYSIS OF ARCHEOLOGY AREAS USING RADARSAT IMAGES: CASE STUDY OF LEMBAH BUJANG, MALAYSIA.XXIII ISPRS CONGRESS, COMMISSION VI.2016,第9-14页. * |
| 刘洪江 ; 曹玉香 ; .基于ArcGIS的一种正射影像数据管理入库方法.工程勘察.2010,(12),第63-65页. * |
| 王乃生 ; 王文杰 ; 张哲 ; .基于NoSQL数据库的时态地图瓦片数据存储模型研究与实现.测绘与空间地理信息.2020,(08),第132-134，142页. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116719959A (en) | 2023-09-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Wang et al. | Machine learning-based regional scale intelligent modeling of building information for natural hazard risk management | |
| CN108564647B (en) | A method of establishing virtual three-dimensional map | |
| US9830338B2 (en) | Virtual white lines for indicating planned excavation sites on electronic images | |
| US10191635B1 (en) | System and method of generating a view for a point of interest | |
| EP2711893B1 (en) | Method and device for processing geological information | |
| CN116719959B (en) | Map service method and device for multiple-time-state tiles of archaeological excavation site | |
| CN112115198A (en) | Urban remote sensing intelligent service platform | |
| CN111949817B (en) | Crop information display system, method, equipment and medium based on remote sensing image | |
| CN112113544B (en) | Remote sensing data processing method and system based on unmanned aerial vehicle image | |
| CN114676204B (en) | Multi-attribute-based marine monitoring data three-dimensional management method and system | |
| KR20040024624A (en) | System for constructing and browsing geographic information using video data and method thereof | |
| CN115439753B (en) | DEM-based steep river bank identification method and system | |
| CN116343103B (en) | Natural resource supervision method based on three-dimensional GIS scene and video fusion | |
| CN110660125A (en) | Three-dimensional modeling device for power distribution network system | |
| CN116153140A (en) | River basin emergency unmanned aerial vehicle management method and platform | |
| CN115375868A (en) | Map display method, remote sensing map display method, computing device and storage medium | |
| KR102388777B1 (en) | System for providing adjacent building pre-survey service usign 360 degree virtual reality camera | |
| CN114283255A (en) | Underground engineering inspection panoramic image processing method matched with working condition time sequence | |
| KR101451946B1 (en) | System for estimating of waste reclamation volume based geographic information system | |
| CN111382165A (en) | Mobile homeland management system | |
| CN116229001A (en) | Urban three-dimensional digital map generation method and system based on spatial entropy | |
| CN115713603A (en) | Multi-type block building group form intelligent generation method based on building space map | |
| Garg | Understanding Geospatial Data | |
| CN112000729A (en) | Electric power engineering GIS system | |
| CN115860443B (en) | Building intelligent management method and system based on BIM technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |