CN108596076A - Wrinkle information acquisition device based on 3D imaging technique and information acquisition method - Google Patents
Wrinkle information acquisition device based on 3D imaging technique and information acquisition method Download PDFInfo
- Publication number
- CN108596076A CN108596076A CN201810357577.6A CN201810357577A CN108596076A CN 108596076 A CN108596076 A CN 108596076A CN 201810357577 A CN201810357577 A CN 201810357577A CN 108596076 A CN108596076 A CN 108596076A
- Authority
- CN
- China
- Prior art keywords
- wrinkle
- processor
- information acquisition
- images
- acquisition device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
The invention discloses a kind of wrinkle information acquisition device and information acquisition method based on 3D imaging technique, the wrinkle information acquisition device include at least a 3D video cameras, a support element and a processor, and the support element is for fixing the 3D video cameras;The 3D video cameras are used to obtain the 3D images of face;The processor is used to obtain the 3D images of 3D video cameras shooting and generates a 3D faceforms;The processor is additionally operable to obtain wrinkle information by the 3D faceforms.The wrinkle information acquisition device and information acquisition method of the present invention can obtain the wrinkle information of face by 3D video cameras, and provide prompt corresponding with wrinkle information, provide facility to the user.
Description
Technical field
The present invention relates to a kind of wrinkle information acquisition device and information acquisition method based on 3D imaging technique.
Background technology
Wrinkle refers to skin to be influenced by external environment, forms the free radical that dissociates, and free radical destroys normal cell membrane tissue
Interior collagen, active material, oxidative cell and small microgroove, the wrinkle formed.Wrinkle occurs gradually, and the sequence of appearance is general
It is forehead, upper palpebra inferior, paropia, ear proparea, cheek, neck, lower chin, mouth week.
Medical expert show that 25 years old or so canthus is likely to occur shallow small wrinkle, pouch etc. by experience;30 years old or so foreheads
Wrinkle intensification increases, the tail of the eye lower eyelid skin on crow's feet occurs and different degrees of wrinkle occurs;Then there is nasolabial groove intensification within 40 years old,
There are fine wrinkles in bicker, and Neck wrinkles also and then display;50 years old then pouch deepen and occur lower eyelid line, upperlip also goes out
Existing wrinkle;By 60 years old, then full face elastic force declined the intensification of face wrinkle.
Existing wrinkle judgement is mostly obtained by experience, can not be widely used and be quantified.
Invention content
The technical problem to be solved by the present invention is in order to overcome in the prior art wrinkle information can not obtain and be difficult to number
The defect of change provides a kind of wrinkle information that can obtain face by 3D video cameras, and provides corresponding with wrinkle information
Prompt, provides easily wrinkle information acquisition device and information acquisition method based on 3D imaging technique to the user.
The present invention is to solve above-mentioned technical problem by following technical proposals:
A kind of wrinkle information acquisition device based on 3D imaging technique, feature be, the wrinkle information acquisition device
Including at least a 3D video cameras, a support element and a processor,
The support element is for fixing the 3D video cameras;
The 3D video cameras are used to obtain the 3D images of face;
The processor is used to obtain the 3D images of 3D video cameras shooting and generates a 3D faceforms;
The processor is additionally operable to obtain wrinkle information by the 3D faceforms.
Preferably, the wrinkle information includes circumference and wrinkle depth,
The processor is used for through crumple zone in Feature point recognition 3D faceforms, according to the pixel in region
Number and the correspondence of physical length obtain wrinkle length;
The processor is additionally operable to intercept the 3D along the depth direction of wrinkle in the crumple zone by a section
Faceform, obtain section on wrinkle bottom to top pixel number and pass through pair of pixel number and physical length
Answer Relation acquisition wrinkle depth.
Preferably, the wrinkle information includes decree line information,
The processor is used for by the decree line in Feature point recognition 3D faceforms, and according to the picture of decree line longitudinal direction
The correspondence of vegetarian refreshments number and physical length obtains decree line length.
Preferably, the wrinkle information includes decree line information,
The processor is used for by the trigonum in Feature point recognition 3D faceforms, and by a section described three
Taken transverse decree line to be to obtain a sectional view in angular region,
The processor be additionally operable to by the sectional view obtain decree line angle, the one of the angle of the decree line angle
Side is the vertical line of the tangent line of the most deep position of decree line cross section profile in cross section, and the another side of the angle is by preset
The tangent line of decree line cross section profile, the preset is on the vertical line.
Preferably, the processor is additionally operable to through the section from different location with equal angular taken transverse decree line
To obtain several sectional views;
The processor is additionally operable to obtain several decree line angles by gross section figure, and takes several decree lines angle
The average value of degree is end value.
Preferably, the processor is additionally operable to obtain 3D faceforms couple according to decree line information and age-control relation table
The age information answered.
Preferably, the quantity of the 3D video cameras is two, the shape of the support element is arc, the support element it is interior
Recessed side is equipped with a sliding rail, and two 3D video cameras are set on the sliding rail.
Preferably, for two 3D images, the processor characteristic point on every 3D images for identification, and by two
3D images suture in such a way that same characteristic features point overlaps to generate 3D faceforms.
Preferably, 3D images include structure sheaf and pixel layer,
For two 3D images, the processor is used to identify at least three peak point on the structure sheaf of every 3D images,
Then the structure sheaf of two 3D images is sutured in such a way that identical peak point overlaps, the peak point includes salient point and recessed
Point, the quantity that the peak point of two 3D images overlaps are at least 3;
The processing end is additionally operable to attach pixel layer on 3D models after it has been gathered.
The present invention also provides a kind of information acquisition method realized using wrinkle information acquisition device as described above, packets
It includes:
Obtain the 3D images of face;
It obtains the 3D images of 3D video cameras shooting and generates a 3D faceforms;
Wrinkle information is obtained by the 3D faceforms.
On the basis of common knowledge of the art, above-mentioned each optimum condition can be combined arbitrarily to get each preferable reality of the present invention
Example.
The positive effect of the present invention is that:The wrinkle information acquisition device and information acquisition method of the present invention can lead to
It crosses 3D video cameras and obtains the wrinkle information of face, and provide prompt corresponding with wrinkle information, provide facility to the user.
Description of the drawings
Fig. 1 is the structural schematic diagram of the wrinkle information acquisition device of the embodiment of the present invention 1.
Fig. 2 is the flow chart of the information acquisition method of the embodiment of the present invention 1.
Specific implementation mode
It is further illustrated the present invention below by the mode of embodiment, but does not therefore limit the present invention to the reality
It applies among a range.
Embodiment 1
Referring to Fig. 1, the present embodiment provides a kind of wrinkle information acquisition device based on 3D imaging technique.
The wrinkle information acquisition device includes two 3D video cameras, a support element and a processor.
The shape of the support element 11 is arc, and the indent side of the support element is equipped with a sliding rail 12, two 3D camera shootings
Machine 13 is set on the sliding rail.
By two 3D video cameras and sliding rail can be more convenient find shooting angle accurately.
The 3D video cameras are used to obtain the 3D images of face;
The processor is used to obtain the 3D images of 3D video cameras shooting and generates a 3D faceforms;
The processor is additionally operable to obtain wrinkle information by the 3D faceforms.
The wrinkle information includes circumference and wrinkle depth.
The processor is used for through crumple zone in Feature point recognition 3D faceforms, according to the pixel in region
Number and the correspondence of physical length obtain wrinkle length;
The processor is additionally operable to intercept the 3D along the depth direction of wrinkle in the crumple zone by a section
Faceform, obtain section on wrinkle bottom to top pixel number and pass through pair of pixel number and physical length
Answer Relation acquisition wrinkle depth.
The wrinkle information includes decree line information.Decree line be positioned at wing of nose side extend and under twice lines, be allusion quotation
Skin tissue aging, the phenomenon that causing skin surface to be recessed of type.
The processor is used for by the decree line in Feature point recognition 3D faceforms, and according to the picture of decree line longitudinal direction
The correspondence of vegetarian refreshments number and physical length obtains decree line length.
The processor is used for by the trigonum in Feature point recognition 3D faceforms, and by a section described three
Taken transverse decree line is to obtain a sectional view in angular region.
The processor be additionally operable to by the sectional view obtain decree line angle, the one of the angle of the decree line angle
Side is the vertical line of the tangent line of the most deep position of decree line cross section profile in cross section, and the another side of the angle is by preset
The tangent line of decree line cross section profile, the preset is on the vertical line.
The processor is additionally operable to through the section from different location with equal angular taken transverse decree line to obtain
Several sectional views;
The processor is additionally operable to obtain several decree line angles by gross section figure, and takes several decree lines angle
The average value of degree is end value.
In the present embodiment, include two on three position acquisitions, 3 sectional views, each sectional view by the interface
Decree line angle, totally 6 decree line angles be averaged the skin condition that can preferably reflect user.
Preset can choose fixed value can also choose the position of preset according to the width of 3D faceforms, and face gets over
Wide preset is remoter apart from the most deep position of decree line cross section profile.
The processor was additionally operable to according to decree line information year corresponding with age-control relation table acquisition 3D faceforms
Age information.
In the present embodiment, for two 3D images, the processor characteristic point on every 3D images for identification, and will
Two 3D images suture in such a way that same characteristic features point overlaps to generate 3D faceforms.
Referring to Fig. 2, using above-mentioned wrinkle information acquisition device, the present embodiment also provides a kind of information acquisition method, including:
Step 100, the 3D video cameras obtain the 3D images of face.
Step 101, for two 3D images, identify the characteristic point on every 3D images, and two 3D images are passed through into phase
The mode overlapped with characteristic point is sutured to generate 3D faceforms.
Step 102, the processor are by crumple zone in Feature point recognition 3D faceforms, according to the pixel in region
The correspondence of point number and physical length obtains wrinkle length;
Step 103, the processor are by a section along described in the interception of the depth direction of wrinkle in the crumple zone
3D faceforms obtain the bottom of wrinkle on section to the pixel number at top and by pixel number and physical length
Correspondence obtains wrinkle depth.
In step 102 and 103, wrinkle length and wrinkle depth are wrinkle information, and the wrinkle length and wrinkle are deep
Degree refers specifically to crow's feet.
Step 104, the processor are and longitudinal according to decree line by the decree line in Feature point recognition 3D faceforms
Pixel number and physical length correspondence obtain decree line length.
Step 105, the processor are by the trigonum in Feature point recognition 3D faceforms, and by a section in institute
Taken transverse decree line is stated in trigonum to obtain a sectional view.
Trigonum described herein includes lip.
Step 106, the processor obtain decree line angle by the sectional view, the angle of the decree line angle
It is the vertical line of the tangent line of the most deep position of decree line cross section profile in cross section on one side, the another side of the angle is by preset
Decree line cross section profile tangent line, the preset is on the vertical line.
The decree line angle can reflect that the depth of decree line is one kind of wrinkle information.
Step 107, the processor are corresponding with age-control relation table acquisition 3D faceforms according to decree line information
Age information.
The wrinkle information acquisition device and information acquisition method of the present embodiment can obtain the wrinkle of face by 3D video cameras
Line information, and prompt corresponding with wrinkle information is provided, provide facility to the user.
Embodiment 2
The present embodiment is substantially the same manner as Example 1, the difference is that only:
3D images include structure sheaf and pixel layer,
For two 3D images, the processor is used to identify at least three peak point on the structure sheaf of every 3D images,
Then the structure sheaf of two 3D images is sutured in such a way that identical peak point overlaps, the peak point includes salient point and recessed
Point, the quantity that the peak point of two 3D images overlaps are at least 3;
The processing end is additionally operable to attach pixel layer on 3D models after it has been gathered.
Correspondingly, in the information acquisition method of the present embodiment, 3D faceforms are generated by processor, the processor
At least three peak point is identified on the structure sheaf of every 3D images, and the structure sheaf of two 3D images is then passed through into identical peak value
The mode that point overlaps is sutured to generate 3D faceforms.
Although specific embodiments of the present invention have been described above, it will be appreciated by those of skill in the art that these
It is merely illustrative of, protection scope of the present invention is defined by the appended claims.Those skilled in the art is not carrying on the back
Under the premise of from the principle and substance of the present invention, many changes and modifications may be made, but these are changed
Protection scope of the present invention is each fallen with modification.
Claims (10)
1. a kind of wrinkle information acquisition device based on 3D imaging technique, which is characterized in that the wrinkle information acquisition device packet
At least a 3D video cameras, a support element and a processor are included,
The support element is for fixing the 3D video cameras;
The 3D video cameras are used to obtain the 3D images of face;
The processor is used to obtain the 3D images of 3D video cameras shooting and generates a 3D faceforms;
The processor is additionally operable to obtain wrinkle information by the 3D faceforms.
2. wrinkle information acquisition device as described in claim 1, which is characterized in that the wrinkle information include circumference and
Wrinkle depth,
The processor is used for through crumple zone in Feature point recognition 3D faceforms, according in region pixel number with
The correspondence of physical length obtains wrinkle length;
The processor is additionally operable to intercept the 3D faces along the depth direction of wrinkle in the crumple zone by a section
Model, obtain section on wrinkle bottom to top pixel number and pass through pixel number it is corresponding with physical length pass
System obtains wrinkle depth.
3. wrinkle information acquisition device as described in claim 1, which is characterized in that the wrinkle information includes decree line letter
Breath,
The processor is used for by the decree line in Feature point recognition 3D faceforms, and according to the pixel of decree line longitudinal direction
The correspondence of number and physical length obtains decree line length.
4. wrinkle information acquisition device as described in claim 1, which is characterized in that the wrinkle information includes decree line letter
Breath,
The processor is used for by the trigonum in Feature point recognition 3D faceforms, and by a section in the trigonum
Middle taken transverse decree line to obtain a sectional view,
The processor is additionally operable to obtain decree line angle by the sectional view, and the angle of the decree line angle is on one side
The vertical line of the tangent line of the most deep position of decree line cross section profile in cross section, the another side of the angle are the decree by preset
The tangent line of line cross section profile, the preset is on the vertical line.
5. wrinkle information acquisition device as claimed in claim 4, which is characterized in that the processor is additionally operable to by described section
Face is from different location with equal angular taken transverse decree line to obtain several sectional views;
The processor is additionally operable to obtain several decree line angles by gross section figure, and takes several decree line angles
Average value is end value.
6. the wrinkle information acquisition device as described in claim 3 or 5, which is characterized in that the processor is additionally operable to according to method
Enable line information age information corresponding with age-control relation table acquisition 3D faceforms.
7. wrinkle information acquisition device as described in claim 1, which is characterized in that the quantity of the 3D video cameras is two,
The shape of the support element is arc, and the indent side of the support element is equipped with a sliding rail, and two 3D video cameras are set to described
On sliding rail.
8. wrinkle information acquisition device as described in claim 1, which is characterized in that for two 3D images, the processor
Characteristic point on every 3D images for identification, and two 3D images are sutured in such a way that same characteristic features point overlaps to generate
3D faceforms.
9. wrinkle information acquisition device as described in claim 1, which is characterized in that 3D images include structure sheaf and pixel layer,
For two 3D images, the processor is used to identify at least three peak point on the structure sheaf of every 3D images, then
The structure sheaf of two 3D images is sutured in such a way that identical peak point overlaps, the peak point includes salient point and concave point, and two
The quantity that the peak point of a 3D images overlaps is at least 3;
The processing end is additionally operable to attach pixel layer on 3D models after it has been gathered.
10. a kind of acquisition of information side realized using wrinkle information acquisition device as in one of claimed in any of claims 1 to 9
Method, including:
Obtain the 3D images of face;
It obtains the 3D images of 3D video cameras shooting and generates a 3D faceforms;
Wrinkle information is obtained by the 3D faceforms.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810357577.6A CN108596076A (en) | 2018-04-20 | 2018-04-20 | Wrinkle information acquisition device based on 3D imaging technique and information acquisition method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810357577.6A CN108596076A (en) | 2018-04-20 | 2018-04-20 | Wrinkle information acquisition device based on 3D imaging technique and information acquisition method |
Publications (1)
Publication Number | Publication Date |
---|---|
CN108596076A true CN108596076A (en) | 2018-09-28 |
Family
ID=63614078
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810357577.6A Pending CN108596076A (en) | 2018-04-20 | 2018-04-20 | Wrinkle information acquisition device based on 3D imaging technique and information acquisition method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108596076A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110001066A (en) * | 2019-05-22 | 2019-07-12 | 浙江大学 | A kind of minimum subregion filling direction of 3 D-printing determines method |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102479322A (en) * | 2010-11-30 | 2012-05-30 | 财团法人资讯工业策进会 | System, apparatus and method for analyzing facial defect by facial image with angle |
CN104318234A (en) * | 2014-10-23 | 2015-01-28 | 东南大学 | Three-dimensional extraction method of human face wrinkles shown in point cloud data and device thereof |
CN204154287U (en) * | 2014-10-23 | 2015-02-11 | 东南大学 | A kind of three-dimensional measuring apparatus of face wrinkle |
CN104794701A (en) * | 2014-01-21 | 2015-07-22 | 富士通株式会社 | Image splicing device, method and image processing equipment |
CN104966267A (en) * | 2015-07-02 | 2015-10-07 | 广东欧珀移动通信有限公司 | User image beautifying method and apparatus |
KR101627962B1 (en) * | 2015-02-09 | 2016-06-07 | 세종대학교산학협력단 | Method and apparatus for analyzing fine scale wrinkle of skin image |
KR101634461B1 (en) * | 2014-12-31 | 2016-06-28 | 세종대학교산학협력단 | Apparatus and Method for generating facial wrinkles generation using sketch |
CN107888898A (en) * | 2017-12-28 | 2018-04-06 | 盎锐(上海)信息科技有限公司 | Image capture method and camera device |
-
2018
- 2018-04-20 CN CN201810357577.6A patent/CN108596076A/en active Pending
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102479322A (en) * | 2010-11-30 | 2012-05-30 | 财团法人资讯工业策进会 | System, apparatus and method for analyzing facial defect by facial image with angle |
CN104794701A (en) * | 2014-01-21 | 2015-07-22 | 富士通株式会社 | Image splicing device, method and image processing equipment |
CN104318234A (en) * | 2014-10-23 | 2015-01-28 | 东南大学 | Three-dimensional extraction method of human face wrinkles shown in point cloud data and device thereof |
CN204154287U (en) * | 2014-10-23 | 2015-02-11 | 东南大学 | A kind of three-dimensional measuring apparatus of face wrinkle |
KR101634461B1 (en) * | 2014-12-31 | 2016-06-28 | 세종대학교산학협력단 | Apparatus and Method for generating facial wrinkles generation using sketch |
KR101627962B1 (en) * | 2015-02-09 | 2016-06-07 | 세종대학교산학협력단 | Method and apparatus for analyzing fine scale wrinkle of skin image |
CN104966267A (en) * | 2015-07-02 | 2015-10-07 | 广东欧珀移动通信有限公司 | User image beautifying method and apparatus |
CN107888898A (en) * | 2017-12-28 | 2018-04-06 | 盎锐(上海)信息科技有限公司 | Image capture method and camera device |
Non-Patent Citations (3)
Title |
---|
M. D. ILIE 等: "A robust mathematical model for simulating wrinkle activity in 3D facial animations", 《2012 10TH INTERNATIONAL SYMPOSIUM ON ELECTRONICS AND TELECOMMUNICATIONS》 * |
李丽 等: "基于形状控制函数和自适应细分的皱纹建模方法", 《重庆大学学报》 * |
蔡国超 等: "人脸皱纹三维测量与量化系统", 《中国医疗器械杂志》 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110001066A (en) * | 2019-05-22 | 2019-07-12 | 浙江大学 | A kind of minimum subregion filling direction of 3 D-printing determines method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA3003550C (en) | Real-time visual feedback for user positioning with respect to a camera and a display | |
US10089522B2 (en) | Head-mounted display with facial expression detecting capability | |
CN106056092B (en) | The gaze estimation method for headset equipment based on iris and pupil | |
US9400923B2 (en) | Patient interface identification system | |
US8957943B2 (en) | Gaze direction adjustment for video calls and meetings | |
TWI553565B (en) | Utilizing two-dimensional image to estimate its three-dimensional face angle method, and its database establishment of face replacement and face image replacement method | |
CN107392159A (en) | A kind of facial focus detecting system and method | |
CN101779218A (en) | Makeup simulation system, makeup simulation apparatus, makeup simulation method, and makeup simulation program | |
WO2020252969A1 (en) | Eye key point labeling method and apparatus, and training method and apparatus for eye key point detection model | |
CN109272579B (en) | Three-dimensional model-based makeup method and device, electronic equipment and storage medium | |
JP2015043836A (en) | Image processing apparatus, program, and image processing system | |
CN109978884A (en) | More people's image methods of marking, system, equipment and medium based on human face analysis | |
CN105913373B (en) | Image processing method and device | |
CN107028738B (en) | Vision-training system, intelligent terminal and helmet based on eye movement | |
CN109766007A (en) | A kind of the blinkpunkt compensation method and compensation device, display equipment of display equipment | |
WO2020237940A1 (en) | Fatigue detection method and device based on human eye state identification | |
CN112329727A (en) | Living body detection method and device | |
CN114187166A (en) | Image processing method, intelligent terminal and storage medium | |
CN108596076A (en) | Wrinkle information acquisition device based on 3D imaging technique and information acquisition method | |
JP3970573B2 (en) | Facial image recognition apparatus and method | |
CN109255327A (en) | Acquisition methods, face's plastic operation evaluation method and the device of face characteristic information | |
CN105809128B (en) | A kind of eye pupil localization method, system and the camera terminal of eyes image | |
CN109523628A (en) | Video generation device and method | |
WO2022254409A1 (en) | System and method for providing customized headwear based on facial images | |
JP2007097950A (en) | Lip makeup method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20180928 |
|
WD01 | Invention patent application deemed withdrawn after publication |