CN108596076A - Wrinkle information acquisition device based on 3D imaging technique and information acquisition method - Google Patents

Wrinkle information acquisition device based on 3D imaging technique and information acquisition method Download PDF

Info

Publication number
CN108596076A
CN108596076A CN201810357577.6A CN201810357577A CN108596076A CN 108596076 A CN108596076 A CN 108596076A CN 201810357577 A CN201810357577 A CN 201810357577A CN 108596076 A CN108596076 A CN 108596076A
Authority
CN
China
Prior art keywords
wrinkle
processor
information acquisition
images
acquisition device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810357577.6A
Other languages
Chinese (zh)
Inventor
吴跃华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Angrui Shanghai Information Technology Co Ltd
Original Assignee
Angrui Shanghai Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Angrui Shanghai Information Technology Co Ltd filed Critical Angrui Shanghai Information Technology Co Ltd
Priority to CN201810357577.6A priority Critical patent/CN108596076A/en
Publication of CN108596076A publication Critical patent/CN108596076A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • G06V40/171Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/166Detection; Localisation; Normalisation using acquisition arrangements

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention discloses a kind of wrinkle information acquisition device and information acquisition method based on 3D imaging technique, the wrinkle information acquisition device include at least a 3D video cameras, a support element and a processor, and the support element is for fixing the 3D video cameras;The 3D video cameras are used to obtain the 3D images of face;The processor is used to obtain the 3D images of 3D video cameras shooting and generates a 3D faceforms;The processor is additionally operable to obtain wrinkle information by the 3D faceforms.The wrinkle information acquisition device and information acquisition method of the present invention can obtain the wrinkle information of face by 3D video cameras, and provide prompt corresponding with wrinkle information, provide facility to the user.

Description

Wrinkle information acquisition device based on 3D imaging technique and information acquisition method
Technical field
The present invention relates to a kind of wrinkle information acquisition device and information acquisition method based on 3D imaging technique.
Background technology
Wrinkle refers to skin to be influenced by external environment, forms the free radical that dissociates, and free radical destroys normal cell membrane tissue Interior collagen, active material, oxidative cell and small microgroove, the wrinkle formed.Wrinkle occurs gradually, and the sequence of appearance is general It is forehead, upper palpebra inferior, paropia, ear proparea, cheek, neck, lower chin, mouth week.
Medical expert show that 25 years old or so canthus is likely to occur shallow small wrinkle, pouch etc. by experience;30 years old or so foreheads Wrinkle intensification increases, the tail of the eye lower eyelid skin on crow's feet occurs and different degrees of wrinkle occurs;Then there is nasolabial groove intensification within 40 years old, There are fine wrinkles in bicker, and Neck wrinkles also and then display;50 years old then pouch deepen and occur lower eyelid line, upperlip also goes out Existing wrinkle;By 60 years old, then full face elastic force declined the intensification of face wrinkle.
Existing wrinkle judgement is mostly obtained by experience, can not be widely used and be quantified.
Invention content
The technical problem to be solved by the present invention is in order to overcome in the prior art wrinkle information can not obtain and be difficult to number The defect of change provides a kind of wrinkle information that can obtain face by 3D video cameras, and provides corresponding with wrinkle information Prompt, provides easily wrinkle information acquisition device and information acquisition method based on 3D imaging technique to the user.
The present invention is to solve above-mentioned technical problem by following technical proposals:
A kind of wrinkle information acquisition device based on 3D imaging technique, feature be, the wrinkle information acquisition device Including at least a 3D video cameras, a support element and a processor,
The support element is for fixing the 3D video cameras;
The 3D video cameras are used to obtain the 3D images of face;
The processor is used to obtain the 3D images of 3D video cameras shooting and generates a 3D faceforms;
The processor is additionally operable to obtain wrinkle information by the 3D faceforms.
Preferably, the wrinkle information includes circumference and wrinkle depth,
The processor is used for through crumple zone in Feature point recognition 3D faceforms, according to the pixel in region Number and the correspondence of physical length obtain wrinkle length;
The processor is additionally operable to intercept the 3D along the depth direction of wrinkle in the crumple zone by a section Faceform, obtain section on wrinkle bottom to top pixel number and pass through pair of pixel number and physical length Answer Relation acquisition wrinkle depth.
Preferably, the wrinkle information includes decree line information,
The processor is used for by the decree line in Feature point recognition 3D faceforms, and according to the picture of decree line longitudinal direction The correspondence of vegetarian refreshments number and physical length obtains decree line length.
Preferably, the wrinkle information includes decree line information,
The processor is used for by the trigonum in Feature point recognition 3D faceforms, and by a section described three Taken transverse decree line to be to obtain a sectional view in angular region,
The processor be additionally operable to by the sectional view obtain decree line angle, the one of the angle of the decree line angle Side is the vertical line of the tangent line of the most deep position of decree line cross section profile in cross section, and the another side of the angle is by preset The tangent line of decree line cross section profile, the preset is on the vertical line.
Preferably, the processor is additionally operable to through the section from different location with equal angular taken transverse decree line To obtain several sectional views;
The processor is additionally operable to obtain several decree line angles by gross section figure, and takes several decree lines angle The average value of degree is end value.
Preferably, the processor is additionally operable to obtain 3D faceforms couple according to decree line information and age-control relation table The age information answered.
Preferably, the quantity of the 3D video cameras is two, the shape of the support element is arc, the support element it is interior Recessed side is equipped with a sliding rail, and two 3D video cameras are set on the sliding rail.
Preferably, for two 3D images, the processor characteristic point on every 3D images for identification, and by two 3D images suture in such a way that same characteristic features point overlaps to generate 3D faceforms.
Preferably, 3D images include structure sheaf and pixel layer,
For two 3D images, the processor is used to identify at least three peak point on the structure sheaf of every 3D images, Then the structure sheaf of two 3D images is sutured in such a way that identical peak point overlaps, the peak point includes salient point and recessed Point, the quantity that the peak point of two 3D images overlaps are at least 3;
The processing end is additionally operable to attach pixel layer on 3D models after it has been gathered.
The present invention also provides a kind of information acquisition method realized using wrinkle information acquisition device as described above, packets It includes:
Obtain the 3D images of face;
It obtains the 3D images of 3D video cameras shooting and generates a 3D faceforms;
Wrinkle information is obtained by the 3D faceforms.
On the basis of common knowledge of the art, above-mentioned each optimum condition can be combined arbitrarily to get each preferable reality of the present invention Example.
The positive effect of the present invention is that:The wrinkle information acquisition device and information acquisition method of the present invention can lead to It crosses 3D video cameras and obtains the wrinkle information of face, and provide prompt corresponding with wrinkle information, provide facility to the user.
Description of the drawings
Fig. 1 is the structural schematic diagram of the wrinkle information acquisition device of the embodiment of the present invention 1.
Fig. 2 is the flow chart of the information acquisition method of the embodiment of the present invention 1.
Specific implementation mode
It is further illustrated the present invention below by the mode of embodiment, but does not therefore limit the present invention to the reality It applies among a range.
Embodiment 1
Referring to Fig. 1, the present embodiment provides a kind of wrinkle information acquisition device based on 3D imaging technique.
The wrinkle information acquisition device includes two 3D video cameras, a support element and a processor.
The shape of the support element 11 is arc, and the indent side of the support element is equipped with a sliding rail 12, two 3D camera shootings Machine 13 is set on the sliding rail.
By two 3D video cameras and sliding rail can be more convenient find shooting angle accurately.
The 3D video cameras are used to obtain the 3D images of face;
The processor is used to obtain the 3D images of 3D video cameras shooting and generates a 3D faceforms;
The processor is additionally operable to obtain wrinkle information by the 3D faceforms.
The wrinkle information includes circumference and wrinkle depth.
The processor is used for through crumple zone in Feature point recognition 3D faceforms, according to the pixel in region Number and the correspondence of physical length obtain wrinkle length;
The processor is additionally operable to intercept the 3D along the depth direction of wrinkle in the crumple zone by a section Faceform, obtain section on wrinkle bottom to top pixel number and pass through pair of pixel number and physical length Answer Relation acquisition wrinkle depth.
The wrinkle information includes decree line information.Decree line be positioned at wing of nose side extend and under twice lines, be allusion quotation Skin tissue aging, the phenomenon that causing skin surface to be recessed of type.
The processor is used for by the decree line in Feature point recognition 3D faceforms, and according to the picture of decree line longitudinal direction The correspondence of vegetarian refreshments number and physical length obtains decree line length.
The processor is used for by the trigonum in Feature point recognition 3D faceforms, and by a section described three Taken transverse decree line is to obtain a sectional view in angular region.
The processor be additionally operable to by the sectional view obtain decree line angle, the one of the angle of the decree line angle Side is the vertical line of the tangent line of the most deep position of decree line cross section profile in cross section, and the another side of the angle is by preset The tangent line of decree line cross section profile, the preset is on the vertical line.
The processor is additionally operable to through the section from different location with equal angular taken transverse decree line to obtain Several sectional views;
The processor is additionally operable to obtain several decree line angles by gross section figure, and takes several decree lines angle The average value of degree is end value.
In the present embodiment, include two on three position acquisitions, 3 sectional views, each sectional view by the interface Decree line angle, totally 6 decree line angles be averaged the skin condition that can preferably reflect user.
Preset can choose fixed value can also choose the position of preset according to the width of 3D faceforms, and face gets over Wide preset is remoter apart from the most deep position of decree line cross section profile.
The processor was additionally operable to according to decree line information year corresponding with age-control relation table acquisition 3D faceforms Age information.
In the present embodiment, for two 3D images, the processor characteristic point on every 3D images for identification, and will Two 3D images suture in such a way that same characteristic features point overlaps to generate 3D faceforms.
Referring to Fig. 2, using above-mentioned wrinkle information acquisition device, the present embodiment also provides a kind of information acquisition method, including:
Step 100, the 3D video cameras obtain the 3D images of face.
Step 101, for two 3D images, identify the characteristic point on every 3D images, and two 3D images are passed through into phase The mode overlapped with characteristic point is sutured to generate 3D faceforms.
Step 102, the processor are by crumple zone in Feature point recognition 3D faceforms, according to the pixel in region The correspondence of point number and physical length obtains wrinkle length;
Step 103, the processor are by a section along described in the interception of the depth direction of wrinkle in the crumple zone 3D faceforms obtain the bottom of wrinkle on section to the pixel number at top and by pixel number and physical length Correspondence obtains wrinkle depth.
In step 102 and 103, wrinkle length and wrinkle depth are wrinkle information, and the wrinkle length and wrinkle are deep Degree refers specifically to crow's feet.
Step 104, the processor are and longitudinal according to decree line by the decree line in Feature point recognition 3D faceforms Pixel number and physical length correspondence obtain decree line length.
Step 105, the processor are by the trigonum in Feature point recognition 3D faceforms, and by a section in institute Taken transverse decree line is stated in trigonum to obtain a sectional view.
Trigonum described herein includes lip.
Step 106, the processor obtain decree line angle by the sectional view, the angle of the decree line angle It is the vertical line of the tangent line of the most deep position of decree line cross section profile in cross section on one side, the another side of the angle is by preset Decree line cross section profile tangent line, the preset is on the vertical line.
The decree line angle can reflect that the depth of decree line is one kind of wrinkle information.
Step 107, the processor are corresponding with age-control relation table acquisition 3D faceforms according to decree line information Age information.
The wrinkle information acquisition device and information acquisition method of the present embodiment can obtain the wrinkle of face by 3D video cameras Line information, and prompt corresponding with wrinkle information is provided, provide facility to the user.
Embodiment 2
The present embodiment is substantially the same manner as Example 1, the difference is that only:
3D images include structure sheaf and pixel layer,
For two 3D images, the processor is used to identify at least three peak point on the structure sheaf of every 3D images, Then the structure sheaf of two 3D images is sutured in such a way that identical peak point overlaps, the peak point includes salient point and recessed Point, the quantity that the peak point of two 3D images overlaps are at least 3;
The processing end is additionally operable to attach pixel layer on 3D models after it has been gathered.
Correspondingly, in the information acquisition method of the present embodiment, 3D faceforms are generated by processor, the processor At least three peak point is identified on the structure sheaf of every 3D images, and the structure sheaf of two 3D images is then passed through into identical peak value The mode that point overlaps is sutured to generate 3D faceforms.
Although specific embodiments of the present invention have been described above, it will be appreciated by those of skill in the art that these It is merely illustrative of, protection scope of the present invention is defined by the appended claims.Those skilled in the art is not carrying on the back Under the premise of from the principle and substance of the present invention, many changes and modifications may be made, but these are changed Protection scope of the present invention is each fallen with modification.

Claims (10)

1. a kind of wrinkle information acquisition device based on 3D imaging technique, which is characterized in that the wrinkle information acquisition device packet At least a 3D video cameras, a support element and a processor are included,
The support element is for fixing the 3D video cameras;
The 3D video cameras are used to obtain the 3D images of face;
The processor is used to obtain the 3D images of 3D video cameras shooting and generates a 3D faceforms;
The processor is additionally operable to obtain wrinkle information by the 3D faceforms.
2. wrinkle information acquisition device as described in claim 1, which is characterized in that the wrinkle information include circumference and Wrinkle depth,
The processor is used for through crumple zone in Feature point recognition 3D faceforms, according in region pixel number with The correspondence of physical length obtains wrinkle length;
The processor is additionally operable to intercept the 3D faces along the depth direction of wrinkle in the crumple zone by a section Model, obtain section on wrinkle bottom to top pixel number and pass through pixel number it is corresponding with physical length pass System obtains wrinkle depth.
3. wrinkle information acquisition device as described in claim 1, which is characterized in that the wrinkle information includes decree line letter Breath,
The processor is used for by the decree line in Feature point recognition 3D faceforms, and according to the pixel of decree line longitudinal direction The correspondence of number and physical length obtains decree line length.
4. wrinkle information acquisition device as described in claim 1, which is characterized in that the wrinkle information includes decree line letter Breath,
The processor is used for by the trigonum in Feature point recognition 3D faceforms, and by a section in the trigonum Middle taken transverse decree line to obtain a sectional view,
The processor is additionally operable to obtain decree line angle by the sectional view, and the angle of the decree line angle is on one side The vertical line of the tangent line of the most deep position of decree line cross section profile in cross section, the another side of the angle are the decree by preset The tangent line of line cross section profile, the preset is on the vertical line.
5. wrinkle information acquisition device as claimed in claim 4, which is characterized in that the processor is additionally operable to by described section Face is from different location with equal angular taken transverse decree line to obtain several sectional views;
The processor is additionally operable to obtain several decree line angles by gross section figure, and takes several decree line angles Average value is end value.
6. the wrinkle information acquisition device as described in claim 3 or 5, which is characterized in that the processor is additionally operable to according to method Enable line information age information corresponding with age-control relation table acquisition 3D faceforms.
7. wrinkle information acquisition device as described in claim 1, which is characterized in that the quantity of the 3D video cameras is two, The shape of the support element is arc, and the indent side of the support element is equipped with a sliding rail, and two 3D video cameras are set to described On sliding rail.
8. wrinkle information acquisition device as described in claim 1, which is characterized in that for two 3D images, the processor Characteristic point on every 3D images for identification, and two 3D images are sutured in such a way that same characteristic features point overlaps to generate 3D faceforms.
9. wrinkle information acquisition device as described in claim 1, which is characterized in that 3D images include structure sheaf and pixel layer,
For two 3D images, the processor is used to identify at least three peak point on the structure sheaf of every 3D images, then The structure sheaf of two 3D images is sutured in such a way that identical peak point overlaps, the peak point includes salient point and concave point, and two The quantity that the peak point of a 3D images overlaps is at least 3;
The processing end is additionally operable to attach pixel layer on 3D models after it has been gathered.
10. a kind of acquisition of information side realized using wrinkle information acquisition device as in one of claimed in any of claims 1 to 9 Method, including:
Obtain the 3D images of face;
It obtains the 3D images of 3D video cameras shooting and generates a 3D faceforms;
Wrinkle information is obtained by the 3D faceforms.
CN201810357577.6A 2018-04-20 2018-04-20 Wrinkle information acquisition device based on 3D imaging technique and information acquisition method Pending CN108596076A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810357577.6A CN108596076A (en) 2018-04-20 2018-04-20 Wrinkle information acquisition device based on 3D imaging technique and information acquisition method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810357577.6A CN108596076A (en) 2018-04-20 2018-04-20 Wrinkle information acquisition device based on 3D imaging technique and information acquisition method

Publications (1)

Publication Number Publication Date
CN108596076A true CN108596076A (en) 2018-09-28

Family

ID=63614078

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810357577.6A Pending CN108596076A (en) 2018-04-20 2018-04-20 Wrinkle information acquisition device based on 3D imaging technique and information acquisition method

Country Status (1)

Country Link
CN (1) CN108596076A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110001066A (en) * 2019-05-22 2019-07-12 浙江大学 A kind of minimum subregion filling direction of 3 D-printing determines method

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102479322A (en) * 2010-11-30 2012-05-30 财团法人资讯工业策进会 System, apparatus and method for analyzing facial defect by facial image with angle
CN104318234A (en) * 2014-10-23 2015-01-28 东南大学 Three-dimensional extraction method of human face wrinkles shown in point cloud data and device thereof
CN204154287U (en) * 2014-10-23 2015-02-11 东南大学 A kind of three-dimensional measuring apparatus of face wrinkle
CN104794701A (en) * 2014-01-21 2015-07-22 富士通株式会社 Image splicing device, method and image processing equipment
CN104966267A (en) * 2015-07-02 2015-10-07 广东欧珀移动通信有限公司 User image beautifying method and apparatus
KR101627962B1 (en) * 2015-02-09 2016-06-07 세종대학교산학협력단 Method and apparatus for analyzing fine scale wrinkle of skin image
KR101634461B1 (en) * 2014-12-31 2016-06-28 세종대학교산학협력단 Apparatus and Method for generating facial wrinkles generation using sketch
CN107888898A (en) * 2017-12-28 2018-04-06 盎锐(上海)信息科技有限公司 Image capture method and camera device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102479322A (en) * 2010-11-30 2012-05-30 财团法人资讯工业策进会 System, apparatus and method for analyzing facial defect by facial image with angle
CN104794701A (en) * 2014-01-21 2015-07-22 富士通株式会社 Image splicing device, method and image processing equipment
CN104318234A (en) * 2014-10-23 2015-01-28 东南大学 Three-dimensional extraction method of human face wrinkles shown in point cloud data and device thereof
CN204154287U (en) * 2014-10-23 2015-02-11 东南大学 A kind of three-dimensional measuring apparatus of face wrinkle
KR101634461B1 (en) * 2014-12-31 2016-06-28 세종대학교산학협력단 Apparatus and Method for generating facial wrinkles generation using sketch
KR101627962B1 (en) * 2015-02-09 2016-06-07 세종대학교산학협력단 Method and apparatus for analyzing fine scale wrinkle of skin image
CN104966267A (en) * 2015-07-02 2015-10-07 广东欧珀移动通信有限公司 User image beautifying method and apparatus
CN107888898A (en) * 2017-12-28 2018-04-06 盎锐(上海)信息科技有限公司 Image capture method and camera device

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
M. D. ILIE 等: "A robust mathematical model for simulating wrinkle activity in 3D facial animations", 《2012 10TH INTERNATIONAL SYMPOSIUM ON ELECTRONICS AND TELECOMMUNICATIONS》 *
李丽 等: "基于形状控制函数和自适应细分的皱纹建模方法", 《重庆大学学报》 *
蔡国超 等: "人脸皱纹三维测量与量化系统", 《中国医疗器械杂志》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110001066A (en) * 2019-05-22 2019-07-12 浙江大学 A kind of minimum subregion filling direction of 3 D-printing determines method

Similar Documents

Publication Publication Date Title
CA3003550C (en) Real-time visual feedback for user positioning with respect to a camera and a display
US10089522B2 (en) Head-mounted display with facial expression detecting capability
CN106056092B (en) The gaze estimation method for headset equipment based on iris and pupil
US9400923B2 (en) Patient interface identification system
US8957943B2 (en) Gaze direction adjustment for video calls and meetings
TWI553565B (en) Utilizing two-dimensional image to estimate its three-dimensional face angle method, and its database establishment of face replacement and face image replacement method
CN107392159A (en) A kind of facial focus detecting system and method
CN101779218A (en) Makeup simulation system, makeup simulation apparatus, makeup simulation method, and makeup simulation program
WO2020252969A1 (en) Eye key point labeling method and apparatus, and training method and apparatus for eye key point detection model
CN109272579B (en) Three-dimensional model-based makeup method and device, electronic equipment and storage medium
JP2015043836A (en) Image processing apparatus, program, and image processing system
CN109978884A (en) More people's image methods of marking, system, equipment and medium based on human face analysis
CN105913373B (en) Image processing method and device
CN107028738B (en) Vision-training system, intelligent terminal and helmet based on eye movement
CN109766007A (en) A kind of the blinkpunkt compensation method and compensation device, display equipment of display equipment
WO2020237940A1 (en) Fatigue detection method and device based on human eye state identification
CN112329727A (en) Living body detection method and device
CN114187166A (en) Image processing method, intelligent terminal and storage medium
CN108596076A (en) Wrinkle information acquisition device based on 3D imaging technique and information acquisition method
JP3970573B2 (en) Facial image recognition apparatus and method
CN109255327A (en) Acquisition methods, face's plastic operation evaluation method and the device of face characteristic information
CN105809128B (en) A kind of eye pupil localization method, system and the camera terminal of eyes image
CN109523628A (en) Video generation device and method
WO2022254409A1 (en) System and method for providing customized headwear based on facial images
JP2007097950A (en) Lip makeup method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20180928

WD01 Invention patent application deemed withdrawn after publication