CN105447480A - Face recognition game interactive system - Google Patents
Face recognition game interactive system Download PDFInfo
- Publication number
- CN105447480A CN105447480A CN201511010072.5A CN201511010072A CN105447480A CN 105447480 A CN105447480 A CN 105447480A CN 201511010072 A CN201511010072 A CN 201511010072A CN 105447480 A CN105447480 A CN 105447480A
- Authority
- CN
- China
- Prior art keywords
- face
- image
- facial
- game
- center
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/162—Detection; Localisation; Normalisation using pixel segmentation or colour matching
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/169—Holistic features and representations, i.e. based on the facial image taken as a whole
Abstract
The invention relates to a face recognition game interactive system, and belongs to the technical field of man-machine interaction. An output end of a camera is connected with an input end of a face recognition module through a data line, and the face recognition module is connected with a chartlet processing module through a face image interface; the camera collects the image of a user when the game is operated; the face recognition module analyzes the obtained image of the user, processes the image via a face segmentation method based on face symmetry, determines a face range of the user and obtains a face image of the user; and the chartlet processing module is used for laminating the face, carrying out feature recognition, central alignment and correction and image zoom lamination on the face image via a face image lamination algorithm and laminating the obtained face image of the user on a face model of a game role. No virtual reality device is necessary, so the cost is low; and the discomfort of a player caused by the first person visual angle is avoided. The face of the game role is the face of the player, the interaction has better sense of substitution, and the game interest is improved.
Description
Technical field
The present invention relates to human-computer interaction technical field, particularly a kind of recognition of face game interaction system.
Background technology
During design games, be supplied to player have substitute into sense interactive experience be the problem that development of games is focused on very much.In traditional game mode, player and the mutual of game role isolate mutually, lack and substitute into sense, thus can not play the enjoyment of game completely.At present, there are many classes to improve the exchange method substituting into sense, mainly comprise following two kinds:
The first kind, uses first person in game, and what be shown to player is the visual angle of game role controlled by player in game; Equations of The Second Kind, uses virtual reality device to carry out game interaction, as head mounted display, and action sensor etc.
Improve for existing the interactive system that game substitutes into sense, have following problem:
First kind method can cause sense of discomfort to player.When player plays the game of first person, nerve center is easily mistaken for real scene the vigorous exercise scene in game, thus produces protection mechanism, sends stimulus information to brain, makes player produce the discomfort reaction of dizzy vomiting; Equations of The Second Kind method depends on virtual reality device, present stage virtual reality device very unripe, price is high, and is not suitable for popularizing.Urgently improve.
Summary of the invention
The object of the present invention is to provide a kind of recognition of face game interaction system, solve the problems referred to above that prior art is deposited.The present invention is gathered user's image by camera, after process obtains user's face-image, the facial pinup picture of game role is replaced with the face-image of user.
Above-mentioned purpose of the present invention is achieved through the following technical solutions:
Recognition of face game interaction system, comprise camera, face recognition module, stick picture disposing block, the output terminal of described camera is connected by data line with the input end of face recognition module, and face recognition module is connected by the facial image interface provided of playing with stick picture disposing module; Described camera is used for the image gathering user when game running; User's image that described face recognition module is used for obtaining is analyzed, and utilizes the face dividing method based on facial symmetry to process, determines the facial scope of user, obtains the face-image of user; Described stick picture disposing module is for facial laminating, and algorithm carries out feature identification to facial image, align in center and rectification, image scaling are fitted to utilize facial image to fit, and is fitted on the mask of game role by the face-image of the user of acquisition.
The described face dividing method based on facial symmetry is: first, coloured image is converted to gray level image, carries out edge extracting by the sudden change detecting gray-scale value and color to image, obtains the gray level image having edge line; Then, carry out binary conversion treatment to image, arrange gray-scale value threshold value, gray-scale value is greater than threshold value and gets 1, is less than threshold value and gets 0, make edge thinning, obtain bianry image; On this basis symmetrical analysis is carried out to the bianry image obtained, determine an axis of symmetry, search for edge to the left and right sides from axis of symmetry, determine the region of face; After obtaining human face region, picture is cut out according to human face region, obtain facial image.Image is imported into the facial image interface of game.
Described facial image laminating algorithm concrete steps are:
Step 1, determines human face characteristic point: comprise left eye center El, right eye center Er, eyes mid point Em, mouth center M, face peak T, face minimum point B, face high order end L, face low order end R, nose N;
Step 2, determines face characteristic line: comprise two oculocentric line lx, the line ly of mid point between mouth mid point and two;
Step 3, calculates face characteristic data: comprise eyes size, interpupillary distance, eyes center to nose distance, mouth width and height, mouth center to nose distance, mouth center to chin distance;
Step 4, image alignment: to the facial image center alignment containing characteristic information and rotational correction, translation facial image, makes nose N and the alignment of game character facial model center;
Step 5, image rotation and angle correction: centered by nose, rotate facial image, until between the mouth mid point of facial image and two mid point line lx and game character facial model vertically in line parallel, facial image and game character facial model angle are matched, complete angle correction;
Step 6, image is fitted: the facial image after alignment being corrected carries out convergent-divergent laminating, centered by nose N, facial image is carried out convergent-divergent laminating, make eye center El and Er, eyes mid point Em, mouth center M, face peak T, face minimum point B, face high order end L, face low order end R position overlap completely with the character pair point of game character facial model respectively, complete facial model convergent-divergent laminating.
Engineering process of the present invention is as follows:
After starting game, computing machine transmits control signal to camera, and camera starts, and catches user's image, sends image to face recognition module.Face recognition module utilizes the face dividing method based on facial symmetry to obtain facial image, sends facial image to stick picture disposing module by the facial image interface of games.Stick picture disposing module utilizes facial image to fit, and algorithm carries out feature identification to the facial image got from facial image interface, align in center and rectification, image scaling are fitted, the face-image of the user of acquisition is fitted on the mask of game role, thus make the face of the exhausted role of game replace with the face of player, enhance the interest of game interaction and substitute into sense.
Beneficial effect of the present invention is: compared with needing the method for extra virtual reality device, the present invention only needs ordinary numbers camera, and digital camera popularity rate is high and with low cost, and the present invention is easier to promote with universal; The present invention does not adopt first person, avoids the sense of discomfort that first person causes player; Compared with existing method for gaming, the face of game role is replaced with the face of player, can player be made psychologically to produce lead-in tube, make the recreational raising of game, improve game-play enjoyment.
Accompanying drawing explanation
Accompanying drawing described herein is used to provide a further understanding of the present invention, forms a application's part, and illustrative example of the present invention and explanation thereof, for explaining the present invention, do not form inappropriate limitation of the present invention.
Fig. 1 is system chart of the present invention;
Fig. 2 is that the face parted pattern based on facial symmetry of the present invention is intended to;
Fig. 3 is human face characteristic point of the present invention and face characteristic line schematic diagram;
Fig. 4 is facial image of the present invention laminating algorithm flow chart.
Embodiment
Detailed content of the present invention and embodiment thereof is further illustrated below in conjunction with accompanying drawing.
See shown in Fig. 1 to Fig. 4, recognition of face game interaction system of the present invention, comprise camera, face recognition module, stick picture disposing block, the output terminal of described camera is connected by data line with the input end of face recognition module, and face recognition module is connected by the facial image interface provided of playing with stick picture disposing module; Described camera is used for the image gathering user when game running; User's image that described face recognition module is used for obtaining is analyzed, and utilizes the face dividing method based on facial symmetry to process, determines the facial scope of user, obtains the face-image of user; Described stick picture disposing module is for facial laminating, and algorithm carries out feature identification to facial image, align in center and rectification, image scaling are fitted to utilize facial image to fit, and is fitted on the mask of game role by the face-image of the user of acquisition.
Specific works flow process is as follows:
1. game starts on computers, and when needing to replace game role face, game sends data request information.Computing machine sends enabling signal by data line to camera.Camera receives enabling signal, starts working.Camera catches current color image, preserves image.Image is sent to face recognition module by data line.
2., after face recognition module receives image, recognition of face is carried out to image.
Adopt the face dividing method based on facial symmetry, first gray level image is converted to coloured image, by the sudden change detecting gray-scale value and color, edge extracting is carried out to image, obtain the gray level image having edge line.Then carry out binary conversion treatment to image, arrange gray-scale value threshold value, gray-scale value is greater than threshold value and gets 1, is less than threshold value and gets 0, make edge thinning, obtain bianry image.On this basis symmetrical analysis is carried out to the bianry image obtained, determine an axis of symmetry, search for edge to the left and right sides from axis of symmetry, determine the region of face.
After obtaining human face region, picture is cut out according to human face region, obtain facial image.Image is imported into the facial image interface of game.
3. the facial image interface of game is to facial image, and facial image adopts pinup picture algorithm to cover the face of avatar model by stick picture disposing module, makes the face of the game role of display be the face of player.
Adopt facial image laminating algorithm, first feature identification is carried out to facial image, determine human face characteristic point, comprise eye center, eyes mid point, mouth center, face's peak, face's minimum point, face's high order end, face's low order end.Determine characteristic curve, comprise two oculocentric line and the line of mid point between mouth mid point and two.
Calculate face characteristic data, comprise eyes size, interpupillary distance, eyes center to nose distance, mouth width and height, mouth center to nose distance, mouth center to chin distance
To the facial image center alignment containing characteristic information and rotational correction, by nose and the alignment of game character facial model center, carry out center alignment.Centered by nose, rotate facial image, until between the mouth mid point of facial image and two mid point line and game character facial model vertically in line parallel, facial image and game character facial model angle are matched, complete angle correction.
Facial image after alignment being corrected carries out convergent-divergent laminating, centered by nose, facial image is carried out convergent-divergent laminating, make eye center, eyes mid point, mouth center, face's peak, face's minimum point, face's high order end, face's low order end position overlap completely with the character pair point of game character facial model respectively, complete facial model convergent-divergent laminating.
The foregoing is only preferred embodiment of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.All any amendments made for the present invention, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (3)
1. a recognition of face game interaction system, it is characterized in that: comprise camera, face recognition module, stick picture disposing block, the output terminal of described camera is connected by data line with the input end of face recognition module, and face recognition module is connected by the facial image interface provided of playing with stick picture disposing module; Described camera is used for the image gathering user when game running; User's image that described face recognition module is used for obtaining is analyzed, and utilizes the face dividing method based on facial symmetry to process, determines the facial scope of user, obtains the face-image of user; Described stick picture disposing module is for facial laminating, and algorithm carries out feature identification to facial image, align in center and rectification, image scaling are fitted to utilize facial image to fit, and is fitted on the mask of game role by the face-image of the user of acquisition.
2. recognition of face game interaction system according to claim 1, it is characterized in that: the described face dividing method based on facial symmetry is: first, coloured image is converted to gray level image, by the sudden change detecting gray-scale value and color, edge extracting is carried out to image, obtain the gray level image having edge line; Then, carry out binary conversion treatment to image, arrange gray-scale value threshold value, gray-scale value is greater than threshold value and gets 1, is less than threshold value and gets 0, make edge thinning, obtain bianry image; On this basis symmetrical analysis is carried out to the bianry image obtained, determine an axis of symmetry, search for edge to the left and right sides from axis of symmetry, determine the region of face; After obtaining human face region, picture is cut out according to human face region, obtain facial image; Image is imported into the facial image interface of game.
3. recognition of face game interaction system according to claim 1, it is characterized in that: described facial image laminating algorithm is: first, feature identification is carried out to facial image, determine human face characteristic point, comprise eye center, eyes mid point, mouth center, face's peak, face's minimum point, face's high order end, face's low order end; Determine characteristic curve, comprise two oculocentric line and the line of mid point between mouth mid point and two; Calculate face characteristic data, comprise eyes size, interpupillary distance, eyes center to nose distance, mouth width and height, mouth center to nose distance, mouth center to chin distance; To the facial image center alignment containing characteristic information and rotational correction, by nose and the alignment of game character facial model center, carry out center alignment; Centered by nose, rotate facial image, until between the mouth mid point of facial image and two mid point line and game character facial model vertically in line parallel, facial image and game character facial model angle are matched, complete angle correction; Facial image after alignment being corrected carries out convergent-divergent laminating, centered by nose, facial image is carried out convergent-divergent laminating, make eye center, eyes mid point, mouth center, face's peak, face's minimum point, face's high order end, face's low order end position overlap completely with the character pair point of game character facial model respectively, complete facial model convergent-divergent laminating.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511010072.5A CN105447480A (en) | 2015-12-30 | 2015-12-30 | Face recognition game interactive system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511010072.5A CN105447480A (en) | 2015-12-30 | 2015-12-30 | Face recognition game interactive system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105447480A true CN105447480A (en) | 2016-03-30 |
Family
ID=55557640
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201511010072.5A Pending CN105447480A (en) | 2015-12-30 | 2015-12-30 | Face recognition game interactive system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105447480A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106203308A (en) * | 2016-06-30 | 2016-12-07 | 美的集团股份有限公司 | Face identification method and face identification device |
| CN106780528A (en) * | 2016-12-01 | 2017-05-31 | 广西师范大学 | Image symmetrical shaft detection method based on edge matching |
| CN107767391A (en) * | 2017-11-02 | 2018-03-06 | 北京奇虎科技有限公司 | Landscape image processing method, device, computing device and computer-readable storage medium |
| CN108525306A (en) * | 2018-03-26 | 2018-09-14 | 广东欧珀移动通信有限公司 | Game implementation method, device, storage medium and electronic equipment |
| CN108537194A (en) * | 2018-04-17 | 2018-09-14 | 谭红春 | A kind of expression recognition method of the hepatolenticular degeneration patient based on deep learning and SVM |
| CN108525307A (en) * | 2018-03-26 | 2018-09-14 | 广东欧珀移动通信有限公司 | Game implementation method, device, storage medium and electronic equipment |
| CN109350965A (en) * | 2018-10-09 | 2019-02-19 | 苏州好玩友网络科技有限公司 | A kind of game control method, device and terminal applied to mobile terminal |
| CN109954274A (en) * | 2017-12-23 | 2019-07-02 | 金德奎 | A kind of exchange method and method for gaming based on Face datection tracking |
| CN111768478A (en) * | 2020-07-13 | 2020-10-13 | 腾讯科技（深圳）有限公司 | Image synthesis method and device, storage medium and electronic equipment |
| WO2020248682A1 (en) * | 2019-06-10 | 2020-12-17 | 海信视像科技股份有限公司 | Display device and virtual scene generation method |
| CN112367578A (en) * | 2020-10-30 | 2021-02-12 | 西南交通大学 | Adjusting device for automatically adjusting height of microphone and height correction method thereof |
| CN112511849A (en) * | 2020-11-17 | 2021-03-16 | 北京达佳互联信息技术有限公司 | Game display method, device, equipment, system and storage medium |
| CN113449542A (en) * | 2020-03-24 | 2021-09-28 | 浙江宇视科技有限公司 | Face changing identification method, device, equipment and medium |
| WO2022022192A1 (en) * | 2020-07-29 | 2022-02-03 | 腾讯科技（深圳）有限公司 | Image processing method and apparatus, computer device, and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101324961A (en) * | 2008-07-25 | 2008-12-17 | 上海久游网络科技有限公司 | Human face portion three-dimensional picture pasting method in computer virtual world |
| CN104036278A (en) * | 2014-06-11 | 2014-09-10 | 杭州巨峰科技有限公司 | Extracting method for face algorithm standard face image |
| CN104778712A (en) * | 2015-04-27 | 2015-07-15 | 厦门美图之家科技有限公司 | Method and system for pasting image to human face based on affine transformation |
-
2015
- 2015-12-30 CN CN201511010072.5A patent/CN105447480A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101324961A (en) * | 2008-07-25 | 2008-12-17 | 上海久游网络科技有限公司 | Human face portion three-dimensional picture pasting method in computer virtual world |
| CN104036278A (en) * | 2014-06-11 | 2014-09-10 | 杭州巨峰科技有限公司 | Extracting method for face algorithm standard face image |
| CN104778712A (en) * | 2015-04-27 | 2015-07-15 | 厦门美图之家科技有限公司 | Method and system for pasting image to human face based on affine transformation |
Non-Patent Citations (1)
| Title |
|---|
| 李学俊 等: "基于对称性的人脸分割算法", 《第六届全国计算机应用联合学术会议论文集》 * |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106203308A (en) * | 2016-06-30 | 2016-12-07 | 美的集团股份有限公司 | Face identification method and face identification device |
| CN106203308B (en) * | 2016-06-30 | 2023-04-21 | 美的集团股份有限公司 | Face recognition method and face recognition device |
| CN106780528B (en) * | 2016-12-01 | 2019-09-17 | 广西赛联信息科技股份有限公司 | Image symmetrical shaft detection method based on edge matching |
| CN106780528A (en) * | 2016-12-01 | 2017-05-31 | 广西师范大学 | Image symmetrical shaft detection method based on edge matching |
| CN107767391A (en) * | 2017-11-02 | 2018-03-06 | 北京奇虎科技有限公司 | Landscape image processing method, device, computing device and computer-readable storage medium |
| CN109954274A (en) * | 2017-12-23 | 2019-07-02 | 金德奎 | A kind of exchange method and method for gaming based on Face datection tracking |
| CN108525306A (en) * | 2018-03-26 | 2018-09-14 | 广东欧珀移动通信有限公司 | Game implementation method, device, storage medium and electronic equipment |
| CN108525307A (en) * | 2018-03-26 | 2018-09-14 | 广东欧珀移动通信有限公司 | Game implementation method, device, storage medium and electronic equipment |
| CN108537194A (en) * | 2018-04-17 | 2018-09-14 | 谭红春 | A kind of expression recognition method of the hepatolenticular degeneration patient based on deep learning and SVM |
| CN109350965A (en) * | 2018-10-09 | 2019-02-19 | 苏州好玩友网络科技有限公司 | A kind of game control method, device and terminal applied to mobile terminal |
| WO2020248682A1 (en) * | 2019-06-10 | 2020-12-17 | 海信视像科技股份有限公司 | Display device and virtual scene generation method |
| CN113449542A (en) * | 2020-03-24 | 2021-09-28 | 浙江宇视科技有限公司 | Face changing identification method, device, equipment and medium |
| CN111768478A (en) * | 2020-07-13 | 2020-10-13 | 腾讯科技（深圳）有限公司 | Image synthesis method and device, storage medium and electronic equipment |
| WO2022022192A1 (en) * | 2020-07-29 | 2022-02-03 | 腾讯科技（深圳）有限公司 | Image processing method and apparatus, computer device, and storage medium |
| CN112367578A (en) * | 2020-10-30 | 2021-02-12 | 西南交通大学 | Adjusting device for automatically adjusting height of microphone and height correction method thereof |
| CN112367578B (en) * | 2020-10-30 | 2022-04-15 | 西南交通大学 | Adjusting device for automatically adjusting height of microphone and height correction method thereof |
| CN112511849A (en) * | 2020-11-17 | 2021-03-16 | 北京达佳互联信息技术有限公司 | Game display method, device, equipment, system and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105447480A (en) | Face recognition game interactive system | |
| CN106504751A (en) | Self adaptation lip reading exchange method and interactive device | |
| US9552467B2 (en) | Information processing device and information processing method | |
| US9415313B2 (en) | Information processing device and information processing method | |
| EP2869264B1 (en) | Information processing device and information processing method | |
| CN106182006B (en) | Chess and card interaction data processing method towards intelligent robot and device | |
| CN106774856A (en) | Exchange method and interactive device based on lip reading | |
| CN102647606B (en) | Stereoscopic image processor, stereoscopic image interaction system and stereoscopic image display method | |
| CN110688948B (en) | Method and device for transforming gender of human face in video, electronic equipment and storage medium | |
| CN104731307B (en) | A kind of body-sensing action identification method and human-computer interaction device | |
| CN102831380A (en) | Body action identification method and system based on depth image induction | |
| US9317739B2 (en) | Information processing device and information processing method | |
| CN107308638A (en) | A kind of entertaining rehabilitation training of upper limbs system and method for virtual reality interaction | |
| CN102871784A (en) | Positioning controlling apparatus and method | |
| CN109044651A (en) | Method for controlling intelligent wheelchair and system based on natural gesture instruction in circumstances not known | |
| CN106529502B (en) | Lip reading recognition methods and device | |
| CN107045385A (en) | Lip reading exchange method and lip reading interactive device based on depth image | |
| CN106598211A (en) | Gesture interaction system and recognition method for multi-camera based wearable helmet | |
| CN107115675B (en) | Kinect-based sports fitness game system and implementation method | |
| CN107329564B (en) | Man-machine finger guessing method based on gesture intelligent perception and man-machine cooperation mechanism | |
| CN106502416B (en) | A kind of driving simulation system and its control method of intelligent recognition bimanual input | |
| WO2023077660A1 (en) | Tai chi training method and system based on mixed reality, device, and storage medium | |
| CN106249901B (en) | A kind of adaptation method for supporting somatosensory device manipulation with the primary game of Android | |
| CN104408412A (en) | Three-dimensional face identification method for safe case | |
| CN106599779A (en) | Human ear recognition method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160330 |
|
| WD01 | Invention patent application deemed withdrawn after publication |