SG11201906315TA - Image recognition method and apparatus based on augmented reality - Google Patents

Image recognition method and apparatus based on augmented reality

Info

Publication number
SG11201906315TA
SG11201906315TA SG11201906315TA SG11201906315TA SG11201906315TA SG 11201906315T A SG11201906315T A SG 11201906315TA SG 11201906315T A SG11201906315T A SG 11201906315TA SG 11201906315T A SG11201906315T A SG 11201906315TA SG 11201906315T A SG11201906315T A SG 11201906315TA
Authority
SG
Singapore
Prior art keywords
picture feature
augmented reality
library
international
feature sample
Prior art date
Application number
SG11201906315TA
Inventor
Linqing Wang
Xiaodong Zeng
Hong Zhang
Feng Lin
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Publication of SG11201906315TA publication Critical patent/SG11201906315TA/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/30Scenes; Scene-specific elements in albums, collections or shared content, e.g. social network photos or video
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/20Scenes; Scene-specific elements in augmented reality scenes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/5838Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/60Editing figures and text; Combining figures or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/751Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/53Network services using third party service providers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/535Tracking the activity of the user
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/55Push-based network services

Abstract

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property Organization International Bureau (43) International Publication Date 19 July 2018 (19.07.2018) WI PO I PCT Hu omit VIII OH olo offinionimoilowo Hs (10) International Publication Number WO 2018/132590 Al 101 102 103 (51) International Patent Classification: GOOK 9 / 2 0 (2006.01) GOOK 9 / 8 0 (2006.01) GOOK 9 / 4 6 (2006.01) GOOF 17/18 (2006.01) (21) International Application Number: PCT/US2018/013344 (22) International Filing Date: 11 January 2018 (11.01.2018) (25) Filing Language: English (26) Publication Language: English (30) Priority Data: 201710018395.1 11 January 2017 (11.01.2017) CN 15/864,572 08 January 2018 (08.01.2018) US (71) Applicant: ALIBABA GROUP HOLDING LIMITED [ /US]; Fourth Floor, One Capital Place, P.O. Box 847, George Town (KY). (72) Inventors: WANG, Linqing; c/o Ants Patent Team, 17F Building B, Huanglong Times Plaza, No.18 Wantang Road, Hangzhou, 310099 (CN). ZENG, Xiaodong; c/o Ants Patent Team, 17F Building B, Huanglong Times Plaza, No.18 Wantang Road, Hangzhou, 310099 (CN). ZHANG, Hong; c/o Ants Patent Team, 17F Building B, Huanglong Times Plaza, No.18 Wantang Road, Hangzhou, 310099 (CN). LIN, Feng; c/o Ants Patent Team, 17F Building B, Huanglong Times Plaza, No.18 Wantang Road, Hangzhou, 310099 (CN). (74) Agent: STALFORD, Terry, J.; Fish & Richardson P.C., P.O. Box 1022, Minneapolis, MN 55440-1022 (US). (81) Designated States (unless otherwise indicated, for every kind of national protection available): AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JO, JP, KE, KG, KH, KN, KP, (54) Title: IMAGE RECOGNITION METHOD AND APPARATUS BASED ON AUGMENTED REALITY Gather user information uploaded by an augmented reality client terminal v Screen out picture feature samples associated with the user information from a preset picture feature sample library • Generate, on the basis of the screened-out picture feature samples, a picture feature sample sub-library corresponding to the user information, and push the picture feature sample sub-library to the augmented reality client terminal, so that during image scanning in an offline environment of a user, the AR client terminal performs image recognition on the scanned image information on the basis of the picture feature sample sub-library FIG. 1 O (57) : The present application provides an image recognition method based on augmented reality, which includes: gathering user information uploaded by an augmented reality client terminal; screening out picture feature samples associated with the user information from a preset picture feature sample library; and generating, on the basis of the screened-out picture feature samples, a picture feature sample sub-library corresponding to the user information, and pushing the picture feature sample sub- library to the augmented reality client terminal, so that during image scanning in an offline environment of the user, the augmented reality client 00 terminal performs image recognition on the scanned image information on the basis of the picture feature sample sub-library. The O present application can improve the image recognition efficiency of an AR client terminal. C [Continued on next page] WO 2018/132590 Al MIDEDIMOMOIDEIREEMOMOMMOHINEOMMEHOIS KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. (84) Designated States (unless otherwise indicated, for every kind of regional protection available): ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). Published: — with international search report (Art. 21(3))
SG11201906315TA 2017-01-11 2018-01-11 Image recognition method and apparatus based on augmented reality SG11201906315TA (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201710018395.1A CN107038408A (en) 2017-01-11 2017-01-11 Image-recognizing method and device based on augmented reality
US15/864,572 US10614341B2 (en) 2017-01-11 2018-01-08 Image recognition based on augmented reality
PCT/US2018/013344 WO2018132590A1 (en) 2017-01-11 2018-01-11 Image recognition method and apparatus based on augmented reality

Publications (1)

Publication Number Publication Date
SG11201906315TA true SG11201906315TA (en) 2019-08-27

Family

ID=59530481

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201906315TA SG11201906315TA (en) 2017-01-11 2018-01-11 Image recognition method and apparatus based on augmented reality

Country Status (9)

Country Link
US (2) US10614341B2 (en)
EP (1) EP3568805A4 (en)
JP (1) JP6736145B2 (en)
KR (1) KR102222087B1 (en)
CN (1) CN107038408A (en)
PH (1) PH12019501599A1 (en)
SG (1) SG11201906315TA (en)
TW (1) TWI691934B (en)
WO (1) WO2018132590A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107038408A (en) 2017-01-11 2017-08-11 阿里巴巴集团控股有限公司 Image-recognizing method and device based on augmented reality
CN109062523B (en) * 2018-06-14 2021-09-24 北京三快在线科技有限公司 Augmented reality data display method and device, electronic equipment and storage medium
US10725629B2 (en) * 2018-06-25 2020-07-28 Google Llc Identifying and controlling smart devices
WO2020022780A1 (en) * 2018-07-25 2020-01-30 Samsung Electronics Co., Ltd. Method and apparatus for establishing device connection
CN109260705A (en) * 2018-08-06 2019-01-25 光锐恒宇(北京)科技有限公司 Implementation method, device, intelligent terminal and the computer readable storage medium of game
WO2020086055A1 (en) * 2018-10-22 2020-04-30 Hewlett-Packard Development Company, L.P. Displaying data related to objects in images
WO2020163218A1 (en) * 2019-02-04 2020-08-13 Beam Therapeutics Inc. Systems and methods for implemented mixed reality in laboratory automation
CN110020981A (en) * 2019-03-27 2019-07-16 阿里巴巴集团控股有限公司 A kind of image information processing method, device and electronic equipment
CN113923252B (en) * 2021-09-30 2023-11-21 北京蜂巢世纪科技有限公司 Image display device, method and system

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7522163B2 (en) 2004-08-28 2009-04-21 David Holmes Method and apparatus for determining offsets of a part from a digital image
US7945099B2 (en) * 2005-05-09 2011-05-17 Like.Com System and method for use of images with recognition analysis
US20090237546A1 (en) * 2008-03-24 2009-09-24 Sony Ericsson Mobile Communications Ab Mobile Device with Image Recognition Processing Capability
US8190604B2 (en) * 2008-04-03 2012-05-29 Microsoft Corporation User intention modeling for interactive image retrieval
US8819172B2 (en) 2010-11-04 2014-08-26 Digimarc Corporation Smartphone-based methods and systems
US20110279445A1 (en) 2010-05-16 2011-11-17 Nokia Corporation Method and apparatus for presenting location-based content
KR101746838B1 (en) * 2010-06-14 2017-06-27 주식회사 비즈모델라인 Method for Operating Augmented Reality by using Display Stand
JP2015062090A (en) 2011-12-15 2015-04-02 日本電気株式会社 Video processing system, video processing method, video processing device for portable terminal or server, and control method and control program of the same
US8654149B2 (en) 2011-12-20 2014-02-18 Honeywell International Inc. System and method for displaying enhanced vision and synthetic images
JP6168303B2 (en) 2012-01-30 2017-07-26 日本電気株式会社 Information processing system, information processing method, information processing apparatus and control method and control program thereof, communication terminal and control method and control program thereof
US9678617B2 (en) 2013-01-14 2017-06-13 Patrick Soon-Shiong Shared real-time content editing activated by an image
US9338603B2 (en) 2013-09-30 2016-05-10 Qualcomm Incorporated Location based brand detection
JP2015090553A (en) 2013-11-05 2015-05-11 株式会社ソニー・コンピュータエンタテインメント Terminal apparatus, additional information management apparatus, and additional information management method
JP6435779B2 (en) 2014-10-30 2018-12-12 富士ゼロックス株式会社 Information processing apparatus and information processing program
CN104834375A (en) * 2015-05-05 2015-08-12 常州恐龙园股份有限公司 Amusement park guide system based on augmented reality
JP2017016466A (en) 2015-07-02 2017-01-19 富士通株式会社 Terminal control method, image generation method, terminal control program, and terminal
US20170103440A1 (en) * 2015-08-01 2017-04-13 Zhou Tian Xing Wearable augmented reality eyeglass communication device including mobile phone and mobile computing via virtual touch screen gesture control and neuron command
CN105243142A (en) * 2015-10-10 2016-01-13 安徽尚舟电子科技有限公司 Intelligent information push method based on augmented reality and visual computation
CN105227448B (en) * 2015-10-30 2019-09-17 Tcl集团股份有限公司 A kind of information-pushing method and system
US10052170B2 (en) 2015-12-18 2018-08-21 MediLux Capitol Holdings, S.A.R.L. Mixed reality imaging system, apparatus and surgical suite
US20170352282A1 (en) 2016-06-03 2017-12-07 International Business Machines Corporation Image-based feedback for assembly instructions
CN107038408A (en) 2017-01-11 2017-08-11 阿里巴巴集团控股有限公司 Image-recognizing method and device based on augmented reality
US20190005724A1 (en) * 2017-06-30 2019-01-03 Microsoft Technology Licensing, Llc Presenting augmented reality display data in physical presentation environments
US10565764B2 (en) * 2018-04-09 2020-02-18 At&T Intellectual Property I, L.P. Collaborative augmented reality system
US20180350144A1 (en) * 2018-07-27 2018-12-06 Yogesh Rathod Generating, recording, simulating, displaying and sharing user related real world activities, actions, events, participations, transactions, status, experience, expressions, scenes, sharing, interactions with entities and associated plurality types of data in virtual world

Also Published As

Publication number Publication date
US10614341B2 (en) 2020-04-07
TW201826225A (en) 2018-07-16
WO2018132590A1 (en) 2018-07-19
US10762382B2 (en) 2020-09-01
PH12019501599A1 (en) 2020-02-24
JP2020507173A (en) 2020-03-05
US20180197043A1 (en) 2018-07-12
TWI691934B (en) 2020-04-21
KR20190107069A (en) 2019-09-18
EP3568805A4 (en) 2020-01-15
KR102222087B1 (en) 2021-03-05
EP3568805A1 (en) 2019-11-20
CN107038408A (en) 2017-08-11
US20200234077A1 (en) 2020-07-23
JP6736145B2 (en) 2020-08-05

Similar Documents

Publication Publication Date Title
SG11201906315TA (en) Image recognition method and apparatus based on augmented reality
SG11201906476TA (en) Login information processing method and device
SG11201903452SA (en) User location determination based on augmented reality
SG11201908886TA (en) Consensus node selection method and apparatus, and server
SG11201901334SA (en) Convolutional neural network-based mode selection and defect classification for image fusion
SG11201907679TA (en) Business verification method and apparatus
SG11201903141QA (en) Business processing method and apparatus
SG11201907394UA (en) Two-dimensional code generation method and device, and two-dimensional code recognition method and device
SG11201906753UA (en) Digital certificate management method and apparatus, and electronic device
SG11201907320YA (en) Trusted login method, server, and system
SG11201901550WA (en) Method and apparatus for data processing
SG11201903275SA (en) Offline-service multi-user interaction based on augmented reality
SG11201906418PA (en) Blockchain-based data processing method and device
SG11201906824QA (en) Apparatus, method, and system for alignment of 3d datasets
SG11201906524TA (en) Word vector processing method and apparatus
SG11201903582UA (en) Settlement method, entrance control method, and apparatus
SG11201903895XA (en) Blockchain data processing method and apparatus
SG11201909154SA (en) Bispecific antibodies specifically binding to pd1 and lag3
SG11201900240WA (en) Superpixel methods for convolutional neural networks
SG11201903310UA (en) Service control and user identity authentication based on virtual reality
SG11201903137XA (en) Three-dimensional graphical user interface for informational input in virtual reality environment
SG11201901866TA (en) Collection probe and methods for the use thereof
SG11201805281YA (en) Resource allocation for computer processing
SG11201906236XA (en) Narrowband time-division duplex frame structure for narrowband communications
SG11201908675PA (en) Computer-implemented system and method for performing transaction mixing on a blockchain