CN108335219A - AR social contact methods - Google Patents

AR social contact methods Download PDF

Info

Publication number
CN108335219A
CN108335219A CN201810232160.7A CN201810232160A CN108335219A CN 108335219 A CN108335219 A CN 108335219A CN 201810232160 A CN201810232160 A CN 201810232160A CN 108335219 A CN108335219 A CN 108335219A
Authority
CN
China
Prior art keywords
information
social
people
geographical location
personage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810232160.7A
Other languages
Chinese (zh)
Inventor
苏靖雯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kunshan Time Record Mdt Infotech Ltd
Original Assignee
Kunshan Time Record Mdt Infotech Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kunshan Time Record Mdt Infotech Ltd filed Critical Kunshan Time Record Mdt Infotech Ltd
Priority to CN201810232160.7A priority Critical patent/CN108335219A/en
Publication of CN108335219A publication Critical patent/CN108335219A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/01Social networking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29Geographical information databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • Multimedia (AREA)
  • Economics (AREA)
  • Human Resources & Organizations (AREA)
  • Human Computer Interaction (AREA)
  • Primary Health Care (AREA)
  • Computing Systems (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Remote Sensing (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present invention is AR social contact methods, and step is:Obtain the geographical location information of position;According to the geographic location information query people information;Map datum and the people information are shown according to the geographical location information;Obtain the selection instruction that the people information is clicked;According to the capture data chosen instruction and obtain person image;According to the capture data and the people information, Face datection is carried out;According to the effective identification feature extracted, facial image template database comparison is carried out;Advanced information is downloaded according to the comparison result;Show the advanced information;According to the advanced information of display, social operation is carried out.The present invention utilizes LBS positioning systems+face recognition technology, AR technologies and social activity are combined, it can not only realize traditional social activity, it realizes on identical spatial position, the social activity of different time, the more intuitive social process of impression, more extensive social activity is obtained, the social experience of people is enhanced.

Description

AR social contact methods
Technical field
The present invention relates to LBS positioning systems and face recognition technologies, specifically, a kind of its LBS positioning system of displaying and people Face identification technology realizes the AR social contact methods that social and AR is combined.
Background technology
The continuous development of mechanics of communication drives the mobile Internet in the whole world to be in rapid development.According to statistics, global mobile phone User more than 36.5 hundred million, and remain 5% annual growth, and China mobile phone user just reached 1,300,000,000.Popularity rate is high Up to 95%, and remain 8% growth rate, higher than the whole world growth.What is more important, movable mobile social user reach 5.06 hundred million, remain 26% rapid growth.But the social demand of this 5.06 hundred million user is not met really, above-mentioned described Be all it is social on line, under line it is social all can because of identity, vivid gap is excessive causes invalid social or failure social.
Therefore, it is necessary to provide a kind of AR social contact methods to solve the above problems.
Invention content
The object of the present invention is to provide a kind of AR social contact methods.
Technical solution is as follows:
A kind of AR social contact methods, include the following steps:
1) geographical location information of position is obtained:Geographical location information is to obtain system place by location technology The geographical location information (latitude and longitude coordinates) on ground, system obtain the geographical location information of position via positioning unit;
2) according to the geographic location information query people information:After obtaining geographical location information, system is according to geography Location information can also automatically be downloaded according to geographical location information in background neighbouring to the data base querying people information of server People information to system storage medium, then from system to the storage medium of local side inquire people information;
3) map datum and the people information are shown according to the geographical location information:System is obtaining geographical location After information and inquiry people information, map datum and people information are shown by the display unit of system;
4) the selection instruction that the people information is clicked is obtained:System allows user's selection to be interested in by input unit Social personage, after obtaining the selection instruction of user, the display unit of system shows map datum and people information;
5) according to the capture data chosen instruction and obtain person image:It, can be autonomous right after system obtains selection instruction Camera unit should be started, user can carry out capture by camera unit to personage, and after user completes the capture of personage, system can Therefore capture data are obtained;
6) according to the capture data and the people information, Face datection is carried out:System is according to capture data into pedestrian The pretreatment of face image extracts effective identification feature of facial image according to face recognition technology;
7) according to the effective identification feature extracted, facial image template database comparison is carried out;
8) advanced information is downloaded according to the comparison result:When comparison result is that capture data are consistent with people information, System can receive via transmission unit and download advanced information;
9) the advanced information is shown:The display unit of system shows advanced information;
10) according to the advanced information of display, social operation is carried out.
Further, location technology is specially in step 1):Positioning unit can receive GPS satellite signal, according to horizontal Positioning accuracy EPH, perpendicular positioning precision EPV values and visible satellite number etc., then be calculated by the algorithm of positioning unit;System Positioning unit can also via mobile communication network base station positioning mode, WIFI positioning modes or RFID positioning modes, arrange in pairs or groups positioning The algorithm of module obtains the geographical location information of system site.
It further,, can be by mobile phone or the screen of tablet computer when system is mobile phone or tablet computer in step 3) As display unit, map datum and people information are shown in the APP softwares of operation;Map datum can be the two dimension of map City plane map, map streetscape or 3 D stereo street image etc.;People information can be around geographical location information People information, such as name, head portrait etc.;People information can also imply certificate address information and telephone number of personage etc..
Further, in step 7), database is compared, can be system comparison can also be to be uploaded to server It is compared, and generates comparison result after comparison;The mode that characteristic value compares may be used to carry out, compare people in capture data The validity feature value of face image and the characteristic value in database, when the difference between two characteristic values is less than the thresholding of an acquiescence When, it determines that capture data are consistent with people information, generates the comparison result that a result is consistent;Difference between two characteristic values It when the different threshold value for being more than acquiescence, determines that capture data are not inconsistent with people information, generates the comparison result that a result is not inconsistent.
Further, in step 8), advanced information includes the further introduction of personage, with people information phase above-mentioned Compare, advanced information includes more careful or more detailed personage introduction, and advanced information can be written form, pattern form, move Picture form or visual form, such as video is introduced including personage, can also include the recent activity dynamic of personage etc. letter Breath.
It further,, can be by mobile phone or the screen of tablet computer when system is mobile phone or tablet computer in step 9) As display unit, the advanced information of personage is shown or plays in the APP softwares of operation.
Further, step 10) is specially advanced information of the user to display, the i.e. written form of people information, pattern When form, animation form or visual form interested, you can carry out the social operation of next step, social activity operation can be plus close The operations such as note, application plusing good friend, instant messaging.
Further, step 1) -10) be based on social intercourse system progress, the AR cloud services of social intercourse system by mobile terminal with The combination in high in the clouds realizes that images steganalysis is rendered with tracking, environment real-time reconstruction (SLAM), terminal dynamic 3D;SDK terminals obtain The image object for taking family focusing, will be uploaded to high in the clouds by pretreated picture head frame, real based on the resource obtained from high in the clouds Now local recognition and tracking and rendering;High in the clouds provides atlas retrieval and identification function, and the picture uploaded to terminal is identified and instead Feedback, while CDN provides high speed resources bank.
Compared with prior art, the present invention utilizes LBS positioning systems+face recognition technology, effectively by AR technologies and society Friendship is combined, and can not only realize traditional social activity, is also realized on identical spatial position, different time Social activity, the more intuitive social process of impression, acquisition is more extensive social, enhances the social experience of people.
Description of the drawings
Fig. 1 is the step schematic diagram of the present invention.
Fig. 2 is the composition schematic diagram of the social intercourse system of the present invention.
Specific implementation mode
Embodiment:
Referring to Fig. 1, the present invention shows a kind of AR social contact methods, include the following steps:
1) geographical location information of position is obtained:Geographical location information is to obtain system place by location technology The geographical location information (latitude and longitude coordinates) on ground, system obtain the geographical location information of position via positioning unit;
2) according to the geographic location information query people information:After obtaining geographical location information, system is according to geography Location information can also automatically be downloaded according to geographical location information in background neighbouring to the data base querying people information of server People information to system storage medium, then from system to the storage medium of local side inquire people information;
3) map datum and the people information are shown according to the geographical location information:System is obtaining geographical location After information and inquiry people information, map datum and people information are shown by the display unit of system;
4) the selection instruction that the people information is clicked is obtained:System allows user's selection to be interested in by input unit Social personage, after obtaining the selection instruction of user, the display unit of system shows map datum and people information;
5) according to the capture data chosen instruction and obtain person image:It, can be autonomous right after system obtains selection instruction Camera unit should be started, user can carry out capture by camera unit to personage, and after user completes the capture of personage, system can Therefore capture data are obtained;
6) according to the capture data and the people information, Face datection is carried out:System is according to capture data into pedestrian The pretreatment of face image extracts effective identification feature of facial image according to face recognition technology;
7) according to the effective identification feature extracted, facial image template database comparison is carried out;
8) advanced information is downloaded according to the comparison result:When comparison result is that capture data are consistent with people information, System can receive via transmission unit and download advanced information;
9) the advanced information is shown:The display unit of system shows advanced information;
10) according to the advanced information of display, social operation is carried out.
Location technology is specially in step 1):Positioning unit can receive GPS satellite signal, according to horizontal positioning accuracy EPH, perpendicular positioning precision EPV values and visible satellite number etc., then be calculated by the algorithm of positioning unit;The positioning list of system Member can also be via mobile communication network base station positioning mode, WIFI positioning modes or RFID positioning modes, the calculation for locating module of arranging in pairs or groups Method obtains the geographical location information of system site.
It, can be by the screen of mobile phone or tablet computer as display when system is mobile phone or tablet computer in step 3) Unit shows map datum and people information in the APP softwares of operation;Map datum can be the two-dimentional city plane of map Map, map streetscape or 3 D stereo street image etc.;People information can be the people information around geographical location information, Such as name, head portrait etc.;People information can also imply certificate address information and telephone number of personage etc..
In step 7), database is compared, can be system comparison can also be to be uploaded to server to be compared, And comparison result is generated after comparison;The mode that characteristic value compares may be used to carry out, compare facial image in capture data Validity feature value and the characteristic value in database are determined when the difference between two characteristic values is less than the thresholding of an acquiescence Capture data are consistent with people information, generate the comparison result that a result is consistent;When the difference between two characteristic values is more than It when the threshold value of acquiescence, determines that capture data are not inconsistent with people information, generates the comparison result that a result is not inconsistent.
In step 8), advanced information includes the further introduction of personage, advanced compared with people information above-mentioned Information includes more careful or more detailed personage introduction, advanced information can be written form, pattern form, animation form or Visual form, such as video is introduced including personage, can also include the recent activity dynamic of personage etc. information.
It, can be by the screen of mobile phone or tablet computer as display when system is mobile phone or tablet computer in step 9) Unit shows or plays the advanced information of personage in the APP softwares of operation.
Step 10) is specially advanced information of the user to display, the i.e. written form of people information, pattern form, animation When form or visual form interested, you can carry out the social operation of next step, social activity operation can be paid attention in, apply adding The operations such as good friend, instant messaging.
Step 1) -10) be based on social intercourse system progress, referring to Fig. 2, the AR cloud services of social intercourse system by mobile terminal with The combination in high in the clouds realizes that images steganalysis is rendered with tracking, environment real-time reconstruction (SLAM), terminal dynamic 3D;SDK terminals obtain The image object for taking family focusing, will be uploaded to high in the clouds by pretreated picture head frame, real based on the resource obtained from high in the clouds Now local recognition and tracking and rendering;High in the clouds provides atlas retrieval and identification function, and the picture uploaded to terminal is identified and instead Feedback, while CDN provides high speed resources bank.
Compared with prior art, the present invention utilizes LBS positioning systems+face recognition technology, effectively by AR technologies and society Friendship is combined, and can not only realize traditional social activity, is also realized on identical spatial position, different time Social activity, the more intuitive social process of impression, acquisition is more extensive social, enhances the social experience of people.
Above-described is only some embodiments of the present invention.For those of ordinary skill in the art, not Under the premise of being detached from the invention design, various modifications and improvements can be made, these belong to the protection model of the present invention It encloses.

Claims (8)

1. a kind of AR social contact methods, it is characterised in that:
Include the following steps:
1) geographical location information of position is obtained:Geographical location information is to obtain system location by location technology Geographical location information (latitude and longitude coordinates), system obtain the geographical location information of position via positioning unit;
2) according to the geographic location information query people information:After obtaining geographical location information, system is according to geographical location Information can also download neighbouring people automatically in background to the data base querying people information of server according to geographical location information Object information to system storage medium, then from system to the storage medium of local side inquire people information;
3) map datum and the people information are shown according to the geographical location information:System is obtaining geographical location information And after inquiry people information, map datum and people information are shown by the display unit of system;
4) the selection instruction that the people information is clicked is obtained:System allows user to choose interesting social activity by input unit Personage, after obtaining the selection instruction of user, the display unit of system shows map datum and people information;
5) according to the capture data chosen instruction and obtain person image:After system obtains selection instruction, can independently correspondence it open Dynamic camera unit, user can carry out capture by camera unit to personage, and after user completes the capture of personage, therefore system can be Obtain capture data;
6) according to the capture data and the people information, Face datection is carried out:System carries out face figure according to capture data The pretreatment of picture extracts effective identification feature of facial image according to face recognition technology;
7) according to the effective identification feature extracted, facial image template database comparison is carried out;
8) advanced information is downloaded according to the comparison result:When comparison result is that capture data are consistent with people information, system It can be received via transmission unit and download advanced information;
9) the advanced information is shown:The display unit of system shows advanced information;
10) according to the advanced information of display, social operation is carried out.
2. a kind of AR social contact methods according to claim 1, it is characterised in that:Location technology is specially in step 1):It is fixed Bit location can receive GPS satellite signal, according to horizontal positioning accuracy EPH, perpendicular positioning precision EPV values and visible satellite number Deng, then be calculated by the algorithm of positioning unit;The positioning unit of system can also be positioned via mobile communication network base station Method, WIFI positioning modes or RFID positioning modes, the algorithm for locating module of arranging in pairs or groups obtain the geographical location information of system site.
3. a kind of AR social contact methods according to claim 2, it is characterised in that:In step 3), system is mobile phone or tablet When computer, can by the screen of mobile phone or tablet computer as display unit, the APP softwares of operation show map datum with And people information;Map datum can be two-dimentional city plane map, map streetscape or 3 D stereo street image of map etc. Deng;People information can be people information around geographical location information, such as name, head portrait etc.;People information can be with Imply certificate address information and the telephone number etc. of personage.
4. a kind of AR social contact methods according to claim 3, it is characterised in that:In step 7), database is compared, can Can also be to be uploaded to server to be compared, and generate comparison result after comparison to be in system comparison;Spy may be used The mode that value indicative compares carries out, and the validity feature value of facial image and the characteristic value in database in capture data is compared, when two It when difference between a characteristic value is less than the thresholding of an acquiescence, determines that capture data are consistent with people information, generates a knot The comparison result that fruit is consistent;When the difference between two characteristic values is more than the threshold value of acquiescence, determine that capture data are believed with personage Breath is not inconsistent, and generates the comparison result that a result is not inconsistent.
5. a kind of AR social contact methods according to claim 4, it is characterised in that:In step 8), advanced information includes personage Further introduction, compared with people information above-mentioned, advanced information includes more careful or more detailed personage introduction, Advanced information can be written form, pattern form, animation form or visual form, such as introduce video including personage, Can also include the recent activity dynamic of personage etc. information.
6. a kind of AR social contact methods according to claim 5, it is characterised in that:In step 9), system is mobile phone or tablet When computer, personage can be shown or play in the APP softwares of operation by the screen of mobile phone or tablet computer as display unit Advanced information.
7. a kind of AR social contact methods according to claim 6, it is characterised in that:Step 10) is specially user to display When advanced information, the i.e. written form of people information, pattern form, animation form or visual form interested, you can carry out down The social operation of one step, social activity operation can be paid attention in, apply for the operations such as plusing good friend, instant messaging.
8. a kind of AR social contact methods according to claim 1-7 any one, it is characterised in that:Step 1) -10) it is based on Social intercourse system carries out, the AR cloud services of social intercourse system by the combination of mobile terminal and high in the clouds, realize images steganalysis and tracking, Environment real-time reconstruction (SLAM), terminal dynamic 3D are rendered;SDK terminals obtain the image object of user's focusing, will pass through pretreatment Picture head frame be uploaded to high in the clouds, based on the resource obtained from high in the clouds, realize local recognition and tracking and rendering;High in the clouds provides atlas Retrieval and identification function are identified and feed back to the picture that terminal uploads, while CDN provides high speed resources bank.
CN201810232160.7A 2018-03-21 2018-03-21 AR social contact methods Pending CN108335219A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810232160.7A CN108335219A (en) 2018-03-21 2018-03-21 AR social contact methods

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810232160.7A CN108335219A (en) 2018-03-21 2018-03-21 AR social contact methods

Publications (1)

Publication Number Publication Date
CN108335219A true CN108335219A (en) 2018-07-27

Family

ID=62930995

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810232160.7A Pending CN108335219A (en) 2018-03-21 2018-03-21 AR social contact methods

Country Status (1)

Country Link
CN (1) CN108335219A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109960909A (en) * 2018-08-14 2019-07-02 瞿彬 Social contact method, server and computer readable storage medium based on three-dimensional map
CN111597455A (en) * 2020-04-29 2020-08-28 腾讯科技(深圳)有限公司 Social relationship establishing method and device, electronic equipment and storage medium
CN112164258A (en) * 2019-12-26 2021-01-01 昆山时记信息科技有限公司 AR intelligent teaching method, device, teaching aid system and computer equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103412953A (en) * 2013-08-30 2013-11-27 苏州跨界软件科技有限公司 Social contact method on the basis of augmented reality
CN106250488A (en) * 2016-08-01 2016-12-21 北京奇虎科技有限公司 Social method, server, equipment and system is realized based on AR technology
CN106648322A (en) * 2016-12-21 2017-05-10 广州市动景计算机科技有限公司 Method of triggering interactive operation with virtual object and device and system
US20170337949A1 (en) * 2016-03-01 2017-11-23 Meograph, Inc. Mobile device video personalization

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103412953A (en) * 2013-08-30 2013-11-27 苏州跨界软件科技有限公司 Social contact method on the basis of augmented reality
US20170337949A1 (en) * 2016-03-01 2017-11-23 Meograph, Inc. Mobile device video personalization
CN106250488A (en) * 2016-08-01 2016-12-21 北京奇虎科技有限公司 Social method, server, equipment and system is realized based on AR technology
CN106648322A (en) * 2016-12-21 2017-05-10 广州市动景计算机科技有限公司 Method of triggering interactive operation with virtual object and device and system

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109960909A (en) * 2018-08-14 2019-07-02 瞿彬 Social contact method, server and computer readable storage medium based on three-dimensional map
CN109960909B (en) * 2018-08-14 2021-06-29 瞿彬 Social contact method based on three-dimensional map, server and computer-readable storage medium
CN112164258A (en) * 2019-12-26 2021-01-01 昆山时记信息科技有限公司 AR intelligent teaching method, device, teaching aid system and computer equipment
CN111597455A (en) * 2020-04-29 2020-08-28 腾讯科技(深圳)有限公司 Social relationship establishing method and device, electronic equipment and storage medium
CN111597455B (en) * 2020-04-29 2024-03-01 腾讯科技(深圳)有限公司 Social relation establishing method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN103635954B (en) Strengthen the system of viewdata stream based on geographical and visual information
USRE43545E1 (en) Virtual skywriting
CN104376118B (en) The outdoor moving augmented reality method of accurate interest point annotation based on panorama sketch
CN103621131B (en) The method and system being accurately positioned for carrying out space to equipment using audio-visual information
CN103297544B (en) Instant messaging application method based on augmented reality
CN103870485B (en) Method and device for achieving augmented reality application
CN105323252A (en) Method and system for realizing interaction based on augmented reality technology and terminal
CN106683195B (en) AR scene rendering method based on indoor positioning
CN105719343A (en) Method for constructing virtual streetscape map
CN106816077A (en) Interactive sandbox methods of exhibiting based on Quick Response Code and augmented reality
CN106709837A (en) Unapproved construction information high precision acquisition method based on mobile terminal
CN106170101A (en) Contents providing system, messaging device and content reproducing method
CN103514621B (en) The authentic dynamic 3D reproducting method of case, event scenarios and reconfiguration system
CN103826201A (en) Geographical position-based virtual interaction method and system thereof
US11250264B2 (en) Geographic address query with associated time of inquiry
CN108335219A (en) AR social contact methods
CN104537550A (en) Internet autonomous advertising method based on augmented reality IP map
CN110286751A (en) A kind of virtual scene digital applications exchange method
CN106371603A (en) Position service and augmented reality technology-based role positioning capturing method
TWI617931B (en) Method and system for remote management of location-based space object
JP2011123807A (en) Annotation display system, method and server device
CN108242017A (en) A kind of location-based comment interaction systems and method
CN105138569B (en) A kind of generation, application method and the geography of bubble data spit slot information system
CN116235131A (en) Augmented reality content item including user avatar to share position
CN106354742A (en) Navigation sightseeing information push method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20180727

WD01 Invention patent application deemed withdrawn after publication