CN108198243A - Forest snow melt monitors system - Google Patents

Forest snow melt monitors system Download PDF

Info

Publication number
CN108198243A
CN108198243A CN201711467098.1A CN201711467098A CN108198243A CN 108198243 A CN108198243 A CN 108198243A CN 201711467098 A CN201711467098 A CN 201711467098A CN 108198243 A CN108198243 A CN 108198243A
Authority
CN
China
Prior art keywords
module
data
snow
forest
snow melt
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711467098.1A
Other languages
Chinese (zh)
Inventor
张毓涛
李吉玫
韩燕梁
李翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
FOREST ECOLOGICAL RESEARCH INSTITUTE XINJIANG ACADEMY OF FORESTRY
Original Assignee
FOREST ECOLOGICAL RESEARCH INSTITUTE XINJIANG ACADEMY OF FORESTRY
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by FOREST ECOLOGICAL RESEARCH INSTITUTE XINJIANG ACADEMY OF FORESTRY filed Critical FOREST ECOLOGICAL RESEARCH INSTITUTE XINJIANG ACADEMY OF FORESTRY
Priority to CN201711467098.1A priority Critical patent/CN108198243A/en
Publication of CN108198243A publication Critical patent/CN108198243A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/05Geographic models
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01DMEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
    • G01D21/00Measuring or testing not otherwise provided for
    • G01D21/02Measuring two or more variables by means not covered by a single other subclass
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A90/00Technologies having an indirect contribution to adaptation to climate change
    • Y02A90/10Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Abstract

The invention discloses a kind of forest snow melts to monitor system, including human-machine operation module, snow melt data acquisition module, satellite video acquisition module, satellite thermal infrared monitoring modular, image processing module, three-dimensionalreconstruction module, snow cover area pattern recognition module, snow cover area dimensional measurement module, snow cover area area calculation module, forecast analysis module and central processing unit.The present invention realizes many-sided acquisition of forest Snowmelt information using satellite video, thermal infrared, supersonic sensing etc., pass through information fusion and comprehensive analysis, realize low cost, efficient forest snow melt monitoring, collaboration significantly reduces the workload of staff by three-dimensionalreconstruction module and the self-defined programming count for realizing forest snow melt area of each computing module;And system carries forecast analysis warning function, it is easy to use.

Description

Forest snow melt monitors system
Technical field
The present invention relates to forest management technical fields, and in particular to a kind of forest snow melt monitors system.
Background technology
At present, it is very time-consuming and complicated to collect for the process for evaluating forest snow melt status data.For this purpose, existing skill A large amount of forest snow melt monitoring system is emerged in art, but generally existing error is larger, detection cost is higher, it is impossible to big face Long-pending, more phases time use, and detected data are static numerical value, without visuality.
Invention content
To solve the above problems, the present invention provides a kind of forest snow melt monitor system, using satellite video, thermal infrared, Supersonic sensing etc. realizes many-sided acquisition of forest Snowmelt information, by information fusion and comprehensive analysis, realizes low cost, Efficient forest snow melt monitoring, collaboration realize forest by three-dimensionalreconstruction module and the self-defined of each computing module The programming count of snow melt area significantly reduces the workload of staff;And system carries forecast analysis warning function, uses It is convenient.
To achieve the above object, the technical solution taken of the present invention is:
A kind of forest snow melt monitors system, including
Human-machine operation module logs in for user, inputs the essential information data and control command of point to be monitored;
Snow melt data acquisition module passes through the ultrasonic sensor and water being embedded in certain distance around point to be monitored Flow sensor carries out the acquisition of snow melt data;
Satellite video acquisition module, for acquiring the video data of forest snow melt situation in real time, and by collected data It is sent to data processing module;
Satellite thermal infrared monitoring modular, for obtaining forest earth's surface temperature information;
Image processing module for traversing whole image, the edge in smooth snow cover region by structural element, and is incited somebody to action The brightness adjustment of image is to preset standard value;And the image for by kinect depth transducers complete image modification The depth image of acquisition is sent to three-dimensionalreconstruction module by the acquisition of data depth image;
Three-dimensionalreconstruction module for the depth image obtained to be carried out trigonometric ratio, then merges institute in scale space The depth image for having trigonometric ratio, which is built, is layered Signed Distance Field, all voxel applications entirety triangulations in field of adjusting the distance A convex closure for covering all voxels is generated, and utilizes Marching Tetrahedra algorithm construction contour surfaces, completes graphics The reconstruct of picture;
Snow cover area pattern recognition module, for accumulated snow in the 3-D view as obtained by the progress of preset graphics template The segmentation and identification of footprint shapes;
Snow cover area dimensional measurement module, for being carried out pair according to the recognition result of snow cover area pattern recognition module The calling for the scale answered is measured by the size of the scale snow cover area of calling, exports measurement result automatically;The mark Ruler can be zoomed in and out and be stretched according to the size of image, deformation;
Snow cover area area calculation module, for carrying out each region product according to preset graphics template areal calculation algorithm Avenge the calculating of area of coverage area, and area scaling according to corresponding to each image carries out the conversion of area, and by institute Some scaling results are counted, and obtain the snow cover area gross area;
Forecast analysis module, for carrying out the assessment prediction analysis of snow melt situation according to the snow melt data received, and will The mobile terminal that obtained prediction of result is sent to display screen and specifies is sent to specified data library and is stored;
Central processing unit for receiving the predictive analysis results of forecast analysis module, and is carried out according to predictive analysis results The keying of alarm module;For receiving the various control commands of man-machine operation module input, and according to preset algorithm by these Order is sent to corresponding module;For receiving the collected data of each data acquisition module institute, and by the data received by Accumulated snow geographic location information is stored in after being classified in corresponding database;For user's registration, rights management and close Code modification;
Alarm module, for sending out audio alert according to the control command that central processing unit is sent, and according to central processing The control command that device is sent sends early warning short message to specified mobile terminal;The short message of transmission includes at least monitoring point position And the data detected by current each monitoring modular.
Preferably, the ultrasonic sensor is used to carry out the acquisition of Snow Thickness, and the water flow sensing unit is used to carry out The acquisition of snow-broth flow velocity caused by snow melting.
Preferably, a data sharing module is further included, the mode for downloading or printing carries out being total to for data in database It enjoys.
Preferably, the forecast analysis module includes
Graphic plotting module, for drawing various curve graphs according to monitored data;
Comparative analysis module will draw curve and compare and analyze and predict with former measured curve, output analysis prediction knot Fruit.
Preferably, the graphic plotting module is according to the monitoring data of input, generation at any time, the space-time of spatial variations effect Curve i.e. tense curve and three-dimensional effect curve are answered, the tense curve shows the initial data or deformation data of each monitoring point Change with time situation, and the monitoring result that the three-dimensional effect curve highlights same time different measuring points is promoted with monitoring point Changing rule.
Preferably, a display screen is further included, for being monitored the broadcasting of data, it is defeated to be additionally operable to display human-machine operation module Data to be shown are needed in the various data and entire monitoring process that enter, and are become based on the data output characterization building monitored Two-dimensional result figure, the three-dimensional result figure of shape situation.
Preferably, a computation analysis module, interior imputation method editor module, for carrying out target by various algorithms are further included The acquisition of data.
The invention has the advantages that:
The many-sided of forest Snowmelt information is realized using satellite video, thermal infrared, supersonic sensing etc. to acquire, and passes through letter Breath fusion and comprehensive analysis, realize low cost, efficient forest snow melt monitoring, collaboration by three-dimensionalreconstruction module and The self-defined programming count for realizing forest snow melt area of each computing module significantly reduces the workload of staff;And System carries forecast analysis warning function, easy to use;The visualization of monitoring data is realized by the three-dimensionalreconstruction of image, is passed through Experiment is it is found that complete the three-dimensional reconstruction of target object using the different depth images of Kinect sensor acquisition, it is only necessary to 48s, and very delicate reconstruction effect can be obtained.
Description of the drawings
A kind of system block diagram of forest snow melt monitoring system of Fig. 1 embodiment of the present invention.
Specific embodiment
In order to which objects and advantages of the present invention are more clearly understood, the present invention is carried out with reference to embodiments further It is described in detail.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not used to limit this hair It is bright.
As shown in Figure 1, an embodiment of the present invention provides a kind of forest snow melts to monitor system, including
Human-machine operation module logs in for user, inputs the essential information data and control command of point to be monitored;
Snow melt data acquisition module passes through the ultrasonic sensor and water being embedded in certain distance around point to be monitored Flow sensor carries out the acquisition of snow melt data;The ultrasonic sensor is used to carry out the acquisition of Snow Thickness, and the flow passes Sensor is used to carry out the acquisition of snow-broth flow velocity caused by snow melting.
Satellite video acquisition module, for acquiring the video data of forest snow melt situation in real time, and by collected data It is sent to data processing module;
Satellite thermal infrared monitoring modular, for obtaining forest earth's surface temperature information;
Image processing module for traversing whole image, the edge in smooth snow cover region by structural element, and is incited somebody to action The brightness adjustment of image is to preset standard value;And the image for by kinect depth transducers complete image modification The depth image of acquisition is sent to three-dimensionalreconstruction module by the acquisition of data depth image;
Three-dimensionalreconstruction module for the depth image obtained to be carried out trigonometric ratio, then merges institute in scale space The depth image for having trigonometric ratio, which is built, is layered Signed Distance Field, all voxel applications entirety triangulations in field of adjusting the distance A convex closure for covering all voxels is generated, and utilizes Marching Tetrahedra algorithm construction contour surfaces, completes graphics The reconstruct of picture;
Snow cover area pattern recognition module, for accumulated snow in the 3-D view as obtained by the progress of preset graphics template The segmentation and identification of footprint shapes;
Snow cover area dimensional measurement module, for being carried out pair according to the recognition result of snow cover area pattern recognition module The calling for the scale answered is measured by the size of the scale snow cover area of calling, exports measurement result automatically;The mark Ruler can be zoomed in and out and be stretched according to the size of image, deformation;
Snow cover area area calculation module, for carrying out each region product according to preset graphics template areal calculation algorithm Avenge the calculating of area of coverage area, and area scaling according to corresponding to each image carries out the conversion of area, and by institute Some scaling results are counted, and obtain the snow cover area gross area;
Forecast analysis module, for carrying out the assessment prediction analysis of snow melt situation according to the snow melt data received, and will The mobile terminal that obtained prediction of result is sent to display screen and specifies is sent to specified data library and is stored;
Central processing unit for receiving the predictive analysis results of forecast analysis module, and is carried out according to predictive analysis results The keying of alarm module;For receiving the various control commands of man-machine operation module input, and according to preset algorithm by these Order is sent to corresponding module;For receiving the collected data of each data acquisition module institute, and by the data received by Accumulated snow geographic location information is stored in after being classified in corresponding database;For user's registration, rights management and close Code modification;
Alarm module, for sending out audio alert according to the control command that central processing unit is sent, and according to central processing The control command that device is sent sends early warning short message to specified mobile terminal;The short message of transmission includes at least monitoring point position And the data detected by current each monitoring modular.
Data sharing module, the mode for downloading or printing carry out the shared of data in database.
Display screen, for being monitored the broadcasting of data, be additionally operable to the various data of display human-machine operation module input with And data to be shown are needed in entire monitoring process, and based on the two dimension knot of data output characterization building deformation monitored Fruit figure, three-dimensional result figure.
Computation analysis module, interior imputation method editor module, for carrying out the acquisition of target data by various algorithms.
The forecast analysis module includes
Graphic plotting module, for drawing various curve graphs according to monitored data;
Comparative analysis module will draw curve and compare and analyze and predict with former measured curve, output analysis prediction knot Fruit.The graphic plotting module according to the monitoring data of input, generation at any time, the tau-effect of spatial variations curve, that is, tense Curve and three-dimensional effect curve, the tense curve show that the initial data of each monitoring point or deformation data change with time Situation, the three-dimensional effect curve highlight the changing rule that the monitoring result of same time different measuring points is promoted with monitoring point.
The above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art For member, without departing from the principle of the present invention, several improvements and modifications can also be made, these improvements and modifications also should It is considered as protection scope of the present invention.

Claims (7)

1. a kind of forest snow melt monitors system, which is characterized in that including
Human-machine operation module logs in for user, inputs the essential information data and control command of point to be monitored;
Snow melt data acquisition module is passed by the ultrasonic sensor and flow that are embedded in certain distance around point to be monitored Sensor carries out the acquisition of snow melt data;
Satellite video acquisition module for acquiring the video data of forest snow melt situation in real time, and collected data is sent To data processing module;
Satellite thermal infrared monitoring modular, for obtaining forest earth's surface temperature information;
Image processing module, for traversing whole image by structural element, the edge in smooth snow cover region, and by image Brightness adjustment to preset standard value;And the image data for by kinect depth transducers complete image modification The depth image of acquisition is sent to three-dimensionalreconstruction module by the acquisition of depth image;
Three-dimensionalreconstruction module for the depth image obtained to be carried out trigonometric ratio, then merges all three in scale space The depth image of angling, which is built, is layered Signed Distance Field, and all voxel applications entirety triangulations generate in field of adjusting the distance One convex closure for covering all voxels, and Marching Tetrahedra algorithm construction contour surfaces are utilized, complete 3-D view Reconstruct;
Snow cover area pattern recognition module, for snow cover in the 3-D view as obtained by the progress of preset graphics template The segmentation and identification of area's shape;
Snow cover area dimensional measurement module, it is corresponding for being carried out according to the recognition result of snow cover area pattern recognition module The calling of scale is measured by the size of the scale snow cover area of calling, exports measurement result automatically;The scale can It zooms in and out and stretches according to the size of image, deformation;
Snow cover area area calculation module covers for carrying out each region accumulated snow according to preset graphics template areal calculation algorithm The calculating of cover region area, and the area scaling according to corresponding to each image carries out the conversion of area, and will be all Scaling results are counted, and obtain the snow cover area gross area;
Forecast analysis module for carrying out the assessment prediction analysis of snow melt situation according to the snow melt data received, and will obtain The prediction of result mobile terminal that is sent to display screen and specifies, be sent to specified data library and stored;
Central processing unit for receiving the predictive analysis results of forecast analysis module, and is alarmed according to predictive analysis results The keying of module;For receiving the various control commands of man-machine operation module input, and these are ordered according to preset algorithm It is sent to corresponding module;For receiving the collected data of each data acquisition module institute, and by the data received by accumulated snow Geographic location information is stored in after being classified in corresponding database;It is repaiied for user's registration, rights management and password Change;
Alarm module for sending out audio alert according to the control command that central processing unit is sent, and is sent out according to central processing unit The control command sent sends early warning short message to specified mobile terminal;The short message of transmission include at least monitoring point position and Data detected by current each monitoring modular.
2. forest snow melt as described in claim 1 monitors system, which is characterized in that the ultrasonic sensor is used to be accumulated The acquisition of thickness is avenged, the water flow sensing unit is used to carry out the acquisition of snow-broth flow velocity caused by snow melting.
3. forest snow melt as described in claim 1 monitors system, which is characterized in that further includes a data sharing module, is used for It downloads or the mode of printing carries out the shared of data in database.
4. forest snow melt as described in claim 1 monitors system, which is characterized in that the forecast analysis module includes
Graphic plotting module, for drawing various curve graphs according to monitored data;
Comparative analysis module will draw curve and compare and analyze and predict with former measured curve, output analysis prediction result.
5. forest snow melt as claimed in claim 4 monitors system, which is characterized in that the graphic plotting module is according to input Monitoring data, generation at any time, the tau-effect of spatial variations curve, that is, tense curve and three-dimensional effect curve, the tense is bent Situation that line shows the initial data of each monitoring point or deformation data changes with time, the three-dimensional effect curve highlight together The changing rule that the monitoring result of one time different measuring points is promoted with monitoring point.
6. forest snow melt as described in claim 1 monitors system, which is characterized in that a display screen is further included, for being supervised The broadcasting of measured data, be additionally operable to display human-machine operation module input various data and entire monitoring process in need it is to be shown Data, and based on two-dimensional result figure, the three-dimensional result figure of data output characterization building deformation monitored.
7. forest snow melt as described in claim 1 monitors system, which is characterized in that further includes a computation analysis module, inside sets Algorithm editor module, for carrying out the acquisition of target data by various algorithms.
CN201711467098.1A 2017-12-20 2017-12-20 Forest snow melt monitors system Pending CN108198243A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711467098.1A CN108198243A (en) 2017-12-20 2017-12-20 Forest snow melt monitors system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711467098.1A CN108198243A (en) 2017-12-20 2017-12-20 Forest snow melt monitors system

Publications (1)

Publication Number Publication Date
CN108198243A true CN108198243A (en) 2018-06-22

Family

ID=62585952

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711467098.1A Pending CN108198243A (en) 2017-12-20 2017-12-20 Forest snow melt monitors system

Country Status (1)

Country Link
CN (1) CN108198243A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108932506A (en) * 2018-07-26 2018-12-04 吉林省林业科学研究院 Snow cover degree and vegetation is obtained based on image analysis to turn green the method for degree
CN109190462A (en) * 2018-07-23 2019-01-11 中国电力科学研究院有限公司 Method based on snowberg volume on oblique photograph technology measurement charged insulating

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1976749A (en) * 2004-04-28 2007-06-06 Geo2科技公司 Nonwoven composites and related products and methods
CN106485229A (en) * 2016-10-14 2017-03-08 黑龙江科技大学 Agricultural ecotone remote sensing monitoring and early warning fire system
CN106530568A (en) * 2016-10-14 2017-03-22 黑龙江科技大学 Forest fire remote sensing monitoring information intelligent service platform
CN106767562A (en) * 2016-12-30 2017-05-31 苏州西博三维科技有限公司 A kind of measuring method and human body measurement method based on machine vision and speckle
CN107049263A (en) * 2017-06-14 2017-08-18 武汉理工大学 Leucoderma condition-inference and cosmetic effect evaluating method and system based on image procossing
CN107145988A (en) * 2017-05-31 2017-09-08 北京天汇元气候科技有限公司 Forest management system
CN107463141A (en) * 2016-06-03 2017-12-12 通用汽车环球科技运作有限责任公司 Delivery vehicle intelligent perception detects road and the method and apparatus of weather condition data
CN107478805A (en) * 2017-08-10 2017-12-15 新疆林科院森林生态研究所 A kind of domatic water balance field observation procedure and device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1976749A (en) * 2004-04-28 2007-06-06 Geo2科技公司 Nonwoven composites and related products and methods
CN107463141A (en) * 2016-06-03 2017-12-12 通用汽车环球科技运作有限责任公司 Delivery vehicle intelligent perception detects road and the method and apparatus of weather condition data
CN106485229A (en) * 2016-10-14 2017-03-08 黑龙江科技大学 Agricultural ecotone remote sensing monitoring and early warning fire system
CN106530568A (en) * 2016-10-14 2017-03-22 黑龙江科技大学 Forest fire remote sensing monitoring information intelligent service platform
CN106767562A (en) * 2016-12-30 2017-05-31 苏州西博三维科技有限公司 A kind of measuring method and human body measurement method based on machine vision and speckle
CN107145988A (en) * 2017-05-31 2017-09-08 北京天汇元气候科技有限公司 Forest management system
CN107049263A (en) * 2017-06-14 2017-08-18 武汉理工大学 Leucoderma condition-inference and cosmetic effect evaluating method and system based on image procossing
CN107478805A (en) * 2017-08-10 2017-12-15 新疆林科院森林生态研究所 A kind of domatic water balance field observation procedure and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109190462A (en) * 2018-07-23 2019-01-11 中国电力科学研究院有限公司 Method based on snowberg volume on oblique photograph technology measurement charged insulating
CN108932506A (en) * 2018-07-26 2018-12-04 吉林省林业科学研究院 Snow cover degree and vegetation is obtained based on image analysis to turn green the method for degree

Similar Documents

Publication Publication Date Title
CN105045950B (en) A kind of bridge security assessment system based on 3 D laser scanning
US11393212B2 (en) System for tracking and visualizing objects and a method therefor
CN110047275A (en) Association and similarity study between the observation result of the vehicle of multiple connections
CN104330022B (en) Method and system is determined using the volume of structure from motion algorithm
JP6700752B2 (en) Position detecting device, position detecting method and program
JP6159179B2 (en) Image processing apparatus and image processing method
CN105488101B (en) A kind of system obtaining space and geographical environment information
CN205748466U (en) A kind of dust from construction sites noise supervisory systems
CN105551064B (en) A kind of method based on characteristics of image estimation windrow volume change
JP2017174125A5 (en)
EP3051810B1 (en) Surveillance
CN106463032A (en) Intrusion detection with directional sensing
CN102673609B (en) Pre-warning system and method for operation safety of railway maintenance
CN104378582A (en) Intelligent video analysis system and method based on PTZ video camera cruising
KR101988356B1 (en) Smart field management system through 3d digitization of construction site and analysis of virtual construction image
CN108198243A (en) Forest snow melt monitors system
CN106092195A (en) A kind of monitoring water environment system
CN110136378A (en) A kind of airport circumference intrusion alarm system and intrusion alarm method
CN107145988A (en) Forest management system
CN110476421A (en) Video image processing apparatus, video image analysis system, methods and procedures
CN102279974A (en) Method and system for calculating monitoring area by camera
US20220044558A1 (en) Method and device for generating a digital representation of traffic on a road
KR102499920B1 (en) BIM-based construction site control system using digital twin
JP2018077837A (en) Position recognition method and system, and abnormality determination method and system
Khalaf et al. Event triggered intelligent video recording system using MS-SSIM for smart home security

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180622

RJ01 Rejection of invention patent application after publication