SG11201903452SA - User location determination based on augmented reality - Google Patents

Abstract

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property :::` , Organization 1#11101111 0 11101 HOE 3E1 0 10111111111101011111011001111011110111111 International Bureau (10) International Publication Number (43) International Publication Date ......P' WO 2018/081433 Al 03 May 2018 (03.05.2018) WIP0 I PCT (51) International Patent Classification: DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, G08B 1/08 (2006.01) GOOK 9/00 (2006.01) HR, HU, ID, IL, IN, IR, IS, JO, JP, KE, KG, KH, KN, KP, (21) International Application Number: KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, PCT/US2017/058542 MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, (22) International Filing Date: SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, 26 October 2017 (26.10.2017) TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. (25) Filing Language: English (84) Designated States (unless otherwise indicated, for every (26) Publication Language: English kind of regional protection available): ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, (30) Priority Data: UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, 201610950767.X 26 October 2016 (26.10.2016) CN TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, 15/792,611 24 October 2017 (24.10.2017) US EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, (71) Applicant: ALIBABA GROUP HOLDING LIMITED MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, [ /US]; Fourth Floor, One Capital Place, P.O. Box 847, KM, ML, MR, NE, SN, TD, TG). George Town, Grand Cayman (KY). (72) Inventor: ZENG, Xiaodong; c/o Ants Patent Team, 17F Published: Building B, Huanglong Times Plaza, No. 18 Wantang Road, — with international search report (Art. 21(3)) Hangzhou, 310099 (CN). (74) Agent: STALFORD, Terry, J. et al.; Fish & Richardson = P.C., P.O. Box 1022, Minneapolis, MN 55440-1022 (US). = _ (81) Designated States (unless otherwise indicated, for every kind of national protection available): AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, = CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, = (54) Title: USER LOCATION DETERMINATION BASED ON AUGMENTED REALITY (57) : An augmented reality (AR) client terminal identifies ini- - _ 200 tial location information for a location of a user. A scene picture asso- ciated with the location of the user is captured. Image matching is per- = — 6 REFINE THE COARSE LOCATION formed between the captured scene picture and scene pictures in a scene = 6TH FLOOR OF DUN'AN DEVELOPMENT picture set. The scene picture set is generated based on the initial lo- = BUILDING BINJIANG DISTRICT, HANGZHOU cation information. Each scene picture in the scene picture set is asso- = _ 2 UPLOAD A COARSE ciated with detailed location information. In response to the captured = = _ ='\"'C O., __------- LTD. SCENE LOCATION AND THE INDOOR PICTURE scene picture matching a particular scene picture in the scene picture set, refined location information for the location of the user is determined based on the detailed location information of the particular scene pic- = _ 5. RETURN FLOOR INFORMATION'6TH FLOOR OF ture. DUN'AN DEVELOPMENT BUILDING = 3. IMAGE MATCHING 11 -'(-- 1 CAPTURING AN en INDOOR SCENE PICTURE SCENE PICTURE SET (INDOOR PICTURE AR CLIENT en TERMINAL + FLOOR INFORMATION) 71' ,-, DEEVTAET NGI GC Y IANG DISTRICT, HANGZHOU 4, ACQUIRE FLOOR INFORMATION 6TH FLOOR OF DUN'AN ....... DUN'AN DEVELOPMENT BUILDING GC 11 0 FIG. 2 ei C