SG11201906315TA - Image recognition method and apparatus based on augmented reality - Google Patents
Image recognition method and apparatus based on augmented realityInfo
- Publication number
- SG11201906315TA SG11201906315TA SG11201906315TA SG11201906315TA SG11201906315TA SG 11201906315T A SG11201906315T A SG 11201906315TA SG 11201906315T A SG11201906315T A SG 11201906315TA SG 11201906315T A SG11201906315T A SG 11201906315TA SG 11201906315T A SG11201906315T A SG 11201906315TA
- Authority
- SG
- Singapore
- Prior art keywords
- picture feature
- augmented reality
- library
- international
- feature sample
- Prior art date
Links
- 230000003190 augmentative effect Effects 0.000 title abstract 8
- 238000000034 method Methods 0.000 title abstract 3
- 241000257303 Hymenoptera Species 0.000 abstract 4
- 230000008520 organization Effects 0.000 abstract 1
- 238000012216 screening Methods 0.000 abstract 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/30—Scenes; Scene-specific elements in albums, collections or shared content, e.g. social network photos or video
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/5838—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/131—Protocols for games, networked simulations or virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/53—Network services using third party service providers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/535—Tracking the activity of the user
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/55—Push-based network services
Abstract
INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property Organization International Bureau (43) International Publication Date 19 July 2018 (19.07.2018) WI PO I PCT Hu omit VIII OH olo offinionimoilowo Hs (10) International Publication Number WO 2018/132590 Al 101 102 103 (51) International Patent Classification: GOOK 9 / 2 0 (2006.01) GOOK 9 / 8 0 (2006.01) GOOK 9 / 4 6 (2006.01) GOOF 17/18 (2006.01) (21) International Application Number: PCT/US2018/013344 (22) International Filing Date: 11 January 2018 (11.01.2018) (25) Filing Language: English (26) Publication Language: English (30) Priority Data: 201710018395.1 11 January 2017 (11.01.2017) CN 15/864,572 08 January 2018 (08.01.2018) US (71) Applicant: ALIBABA GROUP HOLDING LIMITED [ /US]; Fourth Floor, One Capital Place, P.O. Box 847, George Town (KY). (72) Inventors: WANG, Linqing; c/o Ants Patent Team, 17F Building B, Huanglong Times Plaza, No.18 Wantang Road, Hangzhou, 310099 (CN). ZENG, Xiaodong; c/o Ants Patent Team, 17F Building B, Huanglong Times Plaza, No.18 Wantang Road, Hangzhou, 310099 (CN). ZHANG, Hong; c/o Ants Patent Team, 17F Building B, Huanglong Times Plaza, No.18 Wantang Road, Hangzhou, 310099 (CN). LIN, Feng; c/o Ants Patent Team, 17F Building B, Huanglong Times Plaza, No.18 Wantang Road, Hangzhou, 310099 (CN). (74) Agent: STALFORD, Terry, J.; Fish & Richardson P.C., P.O. Box 1022, Minneapolis, MN 55440-1022 (US). (81) Designated States (unless otherwise indicated, for every kind of national protection available): AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JO, JP, KE, KG, KH, KN, KP, (54) Title: IMAGE RECOGNITION METHOD AND APPARATUS BASED ON AUGMENTED REALITY Gather user information uploaded by an augmented reality client terminal v Screen out picture feature samples associated with the user information from a preset picture feature sample library • Generate, on the basis of the screened-out picture feature samples, a picture feature sample sub-library corresponding to the user information, and push the picture feature sample sub-library to the augmented reality client terminal, so that during image scanning in an offline environment of a user, the AR client terminal performs image recognition on the scanned image information on the basis of the picture feature sample sub-library FIG. 1 O (57) : The present application provides an image recognition method based on augmented reality, which includes: gathering user information uploaded by an augmented reality client terminal; screening out picture feature samples associated with the user information from a preset picture feature sample library; and generating, on the basis of the screened-out picture feature samples, a picture feature sample sub-library corresponding to the user information, and pushing the picture feature sample sub- library to the augmented reality client terminal, so that during image scanning in an offline environment of the user, the augmented reality client 00 terminal performs image recognition on the scanned image information on the basis of the picture feature sample sub-library. The O present application can improve the image recognition efficiency of an AR client terminal. C [Continued on next page] WO 2018/132590 Al MIDEDIMOMOIDEIREEMOMOMMOHINEOMMEHOIS KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. (84) Designated States (unless otherwise indicated, for every kind of regional protection available): ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). Published: — with international search report (Art. 21(3))
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710018395.1A CN107038408A (en) | 2017-01-11 | 2017-01-11 | Image-recognizing method and device based on augmented reality |
US15/864,572 US10614341B2 (en) | 2017-01-11 | 2018-01-08 | Image recognition based on augmented reality |
PCT/US2018/013344 WO2018132590A1 (en) | 2017-01-11 | 2018-01-11 | Image recognition method and apparatus based on augmented reality |
Publications (1)
Publication Number | Publication Date |
---|---|
SG11201906315TA true SG11201906315TA (en) | 2019-08-27 |
Family
ID=59530481
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
SG11201906315TA SG11201906315TA (en) | 2017-01-11 | 2018-01-11 | Image recognition method and apparatus based on augmented reality |
Country Status (9)
Country | Link |
---|---|
US (2) | US10614341B2 (en) |
EP (1) | EP3568805A4 (en) |
JP (1) | JP6736145B2 (en) |
KR (1) | KR102222087B1 (en) |
CN (1) | CN107038408A (en) |
PH (1) | PH12019501599A1 (en) |
SG (1) | SG11201906315TA (en) |
TW (1) | TWI691934B (en) |
WO (1) | WO2018132590A1 (en) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107038408A (en) | 2017-01-11 | 2017-08-11 | 阿里巴巴集团控股有限公司 | Image-recognizing method and device based on augmented reality |
CN109062523B (en) * | 2018-06-14 | 2021-09-24 | 北京三快在线科技有限公司 | Augmented reality data display method and device, electronic equipment and storage medium |
US10725629B2 (en) * | 2018-06-25 | 2020-07-28 | Google Llc | Identifying and controlling smart devices |
WO2020022780A1 (en) * | 2018-07-25 | 2020-01-30 | Samsung Electronics Co., Ltd. | Method and apparatus for establishing device connection |
CN109260705A (en) * | 2018-08-06 | 2019-01-25 | 光锐恒宇(北京)科技有限公司 | Implementation method, device, intelligent terminal and the computer readable storage medium of game |
WO2020086055A1 (en) * | 2018-10-22 | 2020-04-30 | Hewlett-Packard Development Company, L.P. | Displaying data related to objects in images |
WO2020163218A1 (en) * | 2019-02-04 | 2020-08-13 | Beam Therapeutics Inc. | Systems and methods for implemented mixed reality in laboratory automation |
CN110020981A (en) * | 2019-03-27 | 2019-07-16 | 阿里巴巴集团控股有限公司 | A kind of image information processing method, device and electronic equipment |
CN113923252B (en) * | 2021-09-30 | 2023-11-21 | 北京蜂巢世纪科技有限公司 | Image display device, method and system |
Family Cites Families (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7522163B2 (en) | 2004-08-28 | 2009-04-21 | David Holmes | Method and apparatus for determining offsets of a part from a digital image |
US7945099B2 (en) * | 2005-05-09 | 2011-05-17 | Like.Com | System and method for use of images with recognition analysis |
US20090237546A1 (en) * | 2008-03-24 | 2009-09-24 | Sony Ericsson Mobile Communications Ab | Mobile Device with Image Recognition Processing Capability |
US8190604B2 (en) * | 2008-04-03 | 2012-05-29 | Microsoft Corporation | User intention modeling for interactive image retrieval |
US8819172B2 (en) | 2010-11-04 | 2014-08-26 | Digimarc Corporation | Smartphone-based methods and systems |
US20110279445A1 (en) | 2010-05-16 | 2011-11-17 | Nokia Corporation | Method and apparatus for presenting location-based content |
KR101746838B1 (en) * | 2010-06-14 | 2017-06-27 | 주식회사 비즈모델라인 | Method for Operating Augmented Reality by using Display Stand |
JP2015062090A (en) | 2011-12-15 | 2015-04-02 | 日本電気株式会社 | Video processing system, video processing method, video processing device for portable terminal or server, and control method and control program of the same |
US8654149B2 (en) | 2011-12-20 | 2014-02-18 | Honeywell International Inc. | System and method for displaying enhanced vision and synthetic images |
JP6168303B2 (en) | 2012-01-30 | 2017-07-26 | 日本電気株式会社 | Information processing system, information processing method, information processing apparatus and control method and control program thereof, communication terminal and control method and control program thereof |
US9678617B2 (en) | 2013-01-14 | 2017-06-13 | Patrick Soon-Shiong | Shared real-time content editing activated by an image |
US9338603B2 (en) | 2013-09-30 | 2016-05-10 | Qualcomm Incorporated | Location based brand detection |
JP2015090553A (en) | 2013-11-05 | 2015-05-11 | 株式会社ソニー・コンピュータエンタテインメント | Terminal apparatus, additional information management apparatus, and additional information management method |
JP6435779B2 (en) | 2014-10-30 | 2018-12-12 | 富士ゼロックス株式会社 | Information processing apparatus and information processing program |
CN104834375A (en) * | 2015-05-05 | 2015-08-12 | 常州恐龙园股份有限公司 | Amusement park guide system based on augmented reality |
JP2017016466A (en) | 2015-07-02 | 2017-01-19 | 富士通株式会社 | Terminal control method, image generation method, terminal control program, and terminal |
US20170103440A1 (en) * | 2015-08-01 | 2017-04-13 | Zhou Tian Xing | Wearable augmented reality eyeglass communication device including mobile phone and mobile computing via virtual touch screen gesture control and neuron command |
CN105243142A (en) * | 2015-10-10 | 2016-01-13 | 安徽尚舟电子科技有限公司 | Intelligent information push method based on augmented reality and visual computation |
CN105227448B (en) * | 2015-10-30 | 2019-09-17 | Tcl集团股份有限公司 | A kind of information-pushing method and system |
US10052170B2 (en) | 2015-12-18 | 2018-08-21 | MediLux Capitol Holdings, S.A.R.L. | Mixed reality imaging system, apparatus and surgical suite |
US20170352282A1 (en) | 2016-06-03 | 2017-12-07 | International Business Machines Corporation | Image-based feedback for assembly instructions |
CN107038408A (en) | 2017-01-11 | 2017-08-11 | 阿里巴巴集团控股有限公司 | Image-recognizing method and device based on augmented reality |
US20190005724A1 (en) * | 2017-06-30 | 2019-01-03 | Microsoft Technology Licensing, Llc | Presenting augmented reality display data in physical presentation environments |
US10565764B2 (en) * | 2018-04-09 | 2020-02-18 | At&T Intellectual Property I, L.P. | Collaborative augmented reality system |
US20180350144A1 (en) * | 2018-07-27 | 2018-12-06 | Yogesh Rathod | Generating, recording, simulating, displaying and sharing user related real world activities, actions, events, participations, transactions, status, experience, expressions, scenes, sharing, interactions with entities and associated plurality types of data in virtual world |
-
2017
- 2017-01-11 CN CN201710018395.1A patent/CN107038408A/en active Pending
- 2017-11-09 TW TW106138738A patent/TWI691934B/en active
-
2018
- 2018-01-08 US US15/864,572 patent/US10614341B2/en active Active
- 2018-01-11 JP JP2019558338A patent/JP6736145B2/en active Active
- 2018-01-11 EP EP18739418.4A patent/EP3568805A4/en not_active Withdrawn
- 2018-01-11 WO PCT/US2018/013344 patent/WO2018132590A1/en unknown
- 2018-01-11 KR KR1020197023416A patent/KR102222087B1/en active IP Right Grant
- 2018-01-11 SG SG11201906315TA patent/SG11201906315TA/en unknown
-
2019
- 2019-07-08 PH PH12019501599A patent/PH12019501599A1/en unknown
-
2020
- 2020-04-06 US US16/841,467 patent/US10762382B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
US10614341B2 (en) | 2020-04-07 |
TW201826225A (en) | 2018-07-16 |
WO2018132590A1 (en) | 2018-07-19 |
US10762382B2 (en) | 2020-09-01 |
PH12019501599A1 (en) | 2020-02-24 |
JP2020507173A (en) | 2020-03-05 |
US20180197043A1 (en) | 2018-07-12 |
TWI691934B (en) | 2020-04-21 |
KR20190107069A (en) | 2019-09-18 |
EP3568805A4 (en) | 2020-01-15 |
KR102222087B1 (en) | 2021-03-05 |
EP3568805A1 (en) | 2019-11-20 |
CN107038408A (en) | 2017-08-11 |
US20200234077A1 (en) | 2020-07-23 |
JP6736145B2 (en) | 2020-08-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
SG11201906315TA (en) | Image recognition method and apparatus based on augmented reality | |
SG11201906476TA (en) | Login information processing method and device | |
SG11201903452SA (en) | User location determination based on augmented reality | |
SG11201908886TA (en) | Consensus node selection method and apparatus, and server | |
SG11201901334SA (en) | Convolutional neural network-based mode selection and defect classification for image fusion | |
SG11201907679TA (en) | Business verification method and apparatus | |
SG11201903141QA (en) | Business processing method and apparatus | |
SG11201907394UA (en) | Two-dimensional code generation method and device, and two-dimensional code recognition method and device | |
SG11201906753UA (en) | Digital certificate management method and apparatus, and electronic device | |
SG11201907320YA (en) | Trusted login method, server, and system | |
SG11201901550WA (en) | Method and apparatus for data processing | |
SG11201903275SA (en) | Offline-service multi-user interaction based on augmented reality | |
SG11201906418PA (en) | Blockchain-based data processing method and device | |
SG11201906824QA (en) | Apparatus, method, and system for alignment of 3d datasets | |
SG11201906524TA (en) | Word vector processing method and apparatus | |
SG11201903582UA (en) | Settlement method, entrance control method, and apparatus | |
SG11201903895XA (en) | Blockchain data processing method and apparatus | |
SG11201909154SA (en) | Bispecific antibodies specifically binding to pd1 and lag3 | |
SG11201900240WA (en) | Superpixel methods for convolutional neural networks | |
SG11201903310UA (en) | Service control and user identity authentication based on virtual reality | |
SG11201903137XA (en) | Three-dimensional graphical user interface for informational input in virtual reality environment | |
SG11201901866TA (en) | Collection probe and methods for the use thereof | |
SG11201805281YA (en) | Resource allocation for computer processing | |
SG11201906236XA (en) | Narrowband time-division duplex frame structure for narrowband communications | |
SG11201908675PA (en) | Computer-implemented system and method for performing transaction mixing on a blockchain |