201221912 _ 六、發明說明： 【發明所屬之技術領域】 本心明係種將興趣點（P0im 〇f Interest，ρ〇ι)資訊顯示 於智慧型行動裝置鏡頭影像中的系統與方法特別是指一種 透過智慧型行動裝置的拍攝鏡頭、計算所得狀使用者虚盥 離、相對方位及興趣點經緯度座標，以達成在鏡頭 衫像中“示興趣點資訊的方法。 【先前技術】 通Λ技術日新月異，許多行動通訊公司分別於行動電話裝 統與羅盤功能，或提供行動電話得以外接GP; 二仃，話可以結合衛星定位並提供導航功能。目前 服路I I f用仃動電洁定位的服務例如網路平台上的LBS 服務與手機上的導航服務等。 不難看出’目前市面上的確已有許多透過手機取得資 2的方法，但多以平面、靜態的文字加地圖的方式呈現從 視“象結合環境空間的概念，以較為貼近人們 覺的方式來呈現周遭各種興趣點資訊。 【發明内容】 過置目定的位在中於/用智慧型行動襄置定位技術之優勢，透 鏡頭旦MM w 者所在位置，並將興趣點資訊顯示於 身訊，並計算使用者盘座趣·而’、趣-占 等，以^ 趣關的距離、相對方位及經緯度 寺以圖文框的方式標示於鏡頭影像上。 為了達成上述發明目的，需先利用GPS(Gl〇bal ·ηα201221912 _ VI. Description of the invention: [Technical field of invention] The system and method for displaying information of interest points (P0im 〇f Interest, ρ〇ι) in the lens image of a smart mobile device, especially Through the shooting lens of the smart mobile device, calculating the illusion of the user, the relative orientation and the latitude and longitude coordinates of the interest point, the method of displaying the information of the interest point in the lens image is achieved. [Prior Art] The overnight technology is changing with each passing day. Many mobile communication companies are equipped with mobile phones and mobile phones, or provide mobile phones with external GPs. Secondly, they can be combined with satellite positioning and provide navigation functions. Currently, service II f uses services such as smashing and cleaning. The LBS service on the road platform and the navigation service on the mobile phone, etc. It is not difficult to see that there are indeed many ways to obtain the capital 2 through the mobile phone, but most of them use the flat and static text plus the map to present the image. Combined with the concept of environmental space, the information of various points of interest around the world is presented in a way that is closer to people's perceptions. [Summary of the Invention] The position of the over-targeting is in the advantage of the smart-type action positioning technology, the position of the lens head MM w, and the information of the interest point is displayed on the body, and the user seat is calculated. Interesting and ', interesting-occupying, etc., the distance, relative orientation and latitude and longitude temple of the interest are marked on the lens image in a frame. In order to achieve the above object, GPS (Gl〇bal · ηα) must be used first.
System)或 AGPS ( Assist ⑼0bal Pos山0麵g 用者座標附近的興趣點（P()int 〇f疋 者座標，檢索出使 興趣點資訊顯示於=ΓΡ0Ι)資訊，然後將 汛顯示於鏡頭影像中，先 *趣占貝 貝无。卞异出各項必要資訊一距離、 201221912 方位、座標’所以本發明的挑戰在於利用使用者目前座伊， 透過檢索技術取得所需之興趣點資訊，並計算各項影像^曼 所需資訊，藉由影像套疊技術，將檢索結果顯示於鏡頭影像 中。 【實施方式】 請參閱圖-，係為本發明架構，其各模組功能分述如下： 首先，在系統中會先使用到查詢參數組合模組（l〇i卜查 询參數組合模組（101)是將手機使用者所要查詢的資料條件， 以參數的方式組合並且送出，可能的參數有：經緯度、類別、 距離、關鍵字等’此組合參數提供給搜尋引擎檢索模組（103) 使用。 GPS定位模組（102)利用智慧型手機的Gps或AGps定位 裝置，將使用者的經緯度座標提供給搜尋引擎檢索模組（1〇3) 使用。 搜尋引擎檢索模組（丨03 ) ’結合查詢參數組合模組（丨〇丨）及 GPS定位模組（102)進行興趣點資訊資料庫的搜尋，首先將 GPS定位模組（1〇2)取得的經緯度轉換成TWD97二度分帶座 ‘（x,y) ’然後將搜哥引擎檢索模組（1 〇3)取得之所有興趣點資 訊的經緯度轉換成TWD97二度分帶座標（00,透過計算式 D - ν’〔λ X )+ (y - y )‘取得使用者目前位置與各興趣點資訊 間的距離，並透過計算式取得各興趣點資訊與正北方的夾角 a 〇 除圖一外，請合併參閱圖二，丨.先算α (興趣點資料與定 位點、正東或正西的失角），slope= | h/w i , Pi=3.14159265358 ’ a=Atan( siope) /(pi/18〇)。2 再看興趣 點資料所屬象限，第ι象限a=( 9〇_α)，第η象限a=( 27〇+α)， 第III象限a= ( 270-α )，第IV象限a= ( 9〇+α )，計算結果將提 供給資sfl框綠製模組（106)、雷達繪製模組（1 〇7)使用。 201221912 除圖一外，請合併參閱圖三，方位擷取模組（1〇4)，透過 搜尋引擎檢索模組（1G3)所提供的a，並減去智g型行動裝置 電子羅盤給的方位為X，可計算出所有興趣點與智慧型行動 裝置之相對方位z，此計鼻結果提供給資訊框繪製模组（1〇6) 及雷料製模組（1()7)使用。店家資訊框樣式設定模組〇〇5)， 透過參數設定檔來設定資訊框樣式的參數，如：資訊框的邊框 顏色、資訊框内字體大小 '資訊框邊框大小等，此模組供資 訊框繪製模組（1〇6)使用。 /'、 除了圖一及圖三外，請再參閱附件一，資訊框繪製模組 (1 〇6) ’利用檢索出來的興趣點，先設定好鏡頭涵蓋的角度範 圍B，若方位擷取模組（1〇4)提供的值丨z丨小於等於B/2則顯示資 訊框，且位移值a=Z+(B/2V透過計算興趣點（x,y)，取得興趣 點於智慧型行動裝置螢幕，其中，X=a*w/B，y=H_ ( (d D，） *H/ I D-D，I ) 〇 其中，W :螢幕寬pixel，H :螢幕高pixel，B :螢幕涵蓋 角度的範圍，z:方位擷取模組（104)值，a: z+(B/2)，D : 最遠興趣點距離值，D，：最近興趣點距離值，d:目標興趣點 距離值，x=a*W/B，y=H- ( (d-D，）*H/ | D-D，| )若興趣點 的方位落在E範圍内，則將資訊框繪製於鏡頭影像上，若興趣 點方位不在B範圍内，則不顯示資訊框於鏡頭影像中。 除圖一外，請合併參閱圖四，雷達繪製模組（1〇7)是以36〇 度平面空間顯示所有興趣點資訊分佈的方法，以目前位置為 圓心，到最遠興趣點的距離為半徑晝一個圓代表雷達，將所 有興趣點以（x，y)坐騎製於雷達圖上，其巾（xy)是透過計算 式 X 如（radians ( m-a)) *D/R，y=c〇s ( radians ( m-a)) D/R取侍。其中m :手機羅盤之方位，a :搜尋引擎檢索模組 (103 )值，d :興趣點距離，R :比例。 為汛框分群模組(1 〇8) ’透過此模組將距離及方向相近的 201221912 興趣點資料加以分群，讓鏡頭影像中的畫面不會過於雜亂， 使用的方法為先將興趣點資料由近到遠排：：：亂 興趣點資料與手機方位角的角度小於e並且距離小於 同-群組’直至全料興趣,fif料分群結束；請參閱圖〜 小於e’ & A，B兩點會分群在同—群組，當計料叩 小於“旦1250·i 50j大於e ’則c與A，B兩點無分群同一群组。 =像套疊模組⑽），將資訊框分群模組（ ，點=及雷達繪製模組⑽)計算出的所有興趣點分佈位 置刀別以興趣點資訊框及雷達圖套疊於鏡頭影像令。 資訊框觸控模組⑴0)，讓使用者能夠針對套疊在鏡頭影 像中之興趣點資訊框，進行點選、拖拉等操作。 下述以、桃園縣揚梅鎮民族路五段551巷"附近為例說 :;該：點位置以及週遭實景如附件二，附件二係為攝影影 像1 0，亦即圖一的攝影影像1 〇。 1.查尋參數擷取： 使用者透過查尋參數組合模組（101)設定搜尋條件為 '、便 利商店"，搭配手機傳回之GPS $位t訊（經緯度： m66551，24.957867，由 GPS 定位模組（102)取得），一併送 至搜尋引擎檢索模組（103)。 2.興趣點資訊框繪製及資訊框分群： 透過興趣點搜尋檢索模組⑽)將資料交由f訊框繪製模 組（岡進行繪製’繪製結果如圖五，#景係錢影影像1〇, 其中興趣點資訊框於鏡頭影像上的位置，可由計算式 x=a* W/B，y=H_ ( ( d-D’）*H/ 丨 D_D，丨）算出，由公式可得 出每-個興趣點的(x，y)值，並且透過興趣點分群模組依序比 較後，得出如圖五的興趣點（89,52)、興趣點（89 66)、興趣點 (89,70)興趣點（53,89)、興趣點⑴3122)、興趣點（Mm)。 201221912 3 ·興趣點資訊框樣式設定模組： 透過設定檔，可決定出興趣點資訊框的樣式，如附件三姐 趣點資訊框樣式（401)，背景係為攝影影像丨〇。 —、 4.興趣點資訊影像套疊： 將計算後資訊與手機鏡頭影像進行套疊，包括右 分布雷達圖（5(H)及鏡頭上店家資訊框⑽）兩個部分， 四。其中’背景係為攝影影像】〇,雷達圓（5〇1)是 模組⑽7)透過計算式 x=sin(radians(m_a) (radianS(m-a) ”D/R，計算繪製出，由公式可得出每一個 興趣點於雷達圖上的位置（x，y)如㈣四，興趣點⑽ 興趣點（302,453)、興趣點（3G2,458)、興趣點（312,468)。 本發明所提供之興趣點資訊套疊於智 頭影像中的方法，與盆他f用技#;|: ·、 裝置之鏡 之優點： …、他W技★相互比較時，更具有下列 透過鏡頭即時影像與周遭各種興趣點資訊的結合讓使用 用者;境與虚㈣訊間的空間關係’進而導引使 料操:的觸控提供使用者一種更為簡單直覺的資 訊内】與互動方式，透過此方式幫助使用者取得更多有用資 方法本案不但在技術思想上確屬創新，並能較習知 定發==項功效’應已充分符合新賴性及進步性之法 明法提出申請’懇請貴局核准本件發 甲叫案’以勵發明，至感德便。 【圖式簡單說明】 圖一為實施本發明之模組架構示意圖； 圓二為興趣點資料與正北方的灸角a計算示意圖； 201221912 圖三為興趣點與智慧型行動裝置之相對方位z計算不ω 圖； 圖四為興趣點以（x，y)坐標繪製於雷達圖之示意圖； 圖五為本發明之興趣點資訊框繪制示意圖；以及 圖六為本發明之資訊框分群模組之範例示意圖。 【附件】 附件一為興趣點於智慧型行動裝置螢幕之（x,y)計算示意 圖； 附件二為實施案例之周遭環境示意圖； 附件三為本發明之興趣點資訊框樣式示意圖；以及 · 附件四為本發明之興趣點資訊影像套疊示意圖。 【主要元件符號說明】 101查詢參數組合模組 102 GPS定位模組 103搜尋引擎檢索模組 104方位截取模組 105店家資訊框樣式設定模組 106資訊框繪製模組 107雷達繪製模組 籲 108資訊框分群模組 109影像套疊模組 110資訊框觸控模組 10 攝影影像 301店家資訊框 401店家資訊框樣式 501店家分布雷達圖 § 8System) or AGPS (Assist (9)0bal Pos mountain 0 side g user points near the point of interest (P () int 〇 疋 疋 疋 , , , , , 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索 检索In the first place, the first interest is in Beibei. It is different from the necessary information, distance, 201221912, and coordinates. Therefore, the challenge of the present invention is to use the user's current seat to obtain the desired information of interest through retrieval technology. The information required for each image is calculated, and the search result is displayed in the lens image by the image nesting technique. [Embodiment] Please refer to the figure - the architecture of the present invention, and the functions of each module are as follows: First of all, in the system, the query parameter combination module will be used first. The query parameter combination module (101) is a combination of the data conditions to be queried by the mobile phone user, and is combined and sent out by parameters. Possible parameters are : latitude and longitude, category, distance, keyword, etc. 'This combination parameter is provided to the search engine retrieval module (103). The GPS positioning module (102) uses the Gps or AGps positioning of the smart phone. Set the user's latitude and longitude coordinates to the search engine search module (1〇3). Search engine search module (丨03) 'Combined query parameter combination module (丨〇丨) and GPS positioning module (102 To search for the information base of interest points, first convert the latitude and longitude obtained by the GPS positioning module (1〇2) into TWD97 second-degree zoning '(x,y)' and then search the search engine module (1 〇 3) The latitude and longitude of all the points of interest information obtained is converted into TWD97 second-degree zoning coordinates (00, and the current position of the user and the information of each interest point are obtained through the calculation formula D - ν'[λ X )+ (y - y )' Distance, and obtain the information of each point of interest through the calculation formula and the angle between the north and the north. In addition to Figure 1, please refer to Figure 2, 丨. First calculate α (point of interest and positioning point, Zhengdong or Zhengxi loss Angle), slope= | h/wi , Pi=3.14159265358 ' a=Atan( siope) /(pi/18〇). 2 Look at the quadrant of the point of interest data, the ι quadrant a=( 9〇_α), η quadrant a = ( 27 〇 + α), the third quadrant a = ( 270 - α ), the fourth quadrant a = ( 9 〇 + α ), the calculation results will be provided The sfl box green module (106) and the radar drawing module (1 〇 7) are used. 201221912 In addition to Figure 1, please refer to Figure 3, the orientation capture module (1〇4), and search the module through the search engine. (1G3) provides a, and subtracts the position of the electronic compass from the intelligent g-type mobile device to X, and can calculate the relative position z of all the points of interest and the smart mobile device, and the result of the calculation is provided to the information frame drawing mode. Group (1〇6) and mine material module (1()7) are used. Store information box style setting module 〇〇 5), through the parameter settings file to set the information box style parameters, such as: information box border color, information box font size 'information box border size, etc., this module for information box Drawing module (1〇6) is used. /', In addition to Figure 1 and Figure 3, please refer to Appendix I, Information Frame Drawing Module (1 〇 6) 'Using the retrieved points of interest, first set the angle range B covered by the lens, if the orientation is captured The value provided by the group (1〇4) is less than or equal to B/2, and the information box is displayed, and the displacement value a=Z+ (B/2V is calculated by calculating the point of interest (x, y) to obtain the point of interest in the smart mobile device. Screen, where X=a*w/B, y=H_ ( (d D,) *H/ I DD,I ) 〇 where W: screen width pixel, H: screen height pixel, B: screen angle Range, z: azimuth capture module (104) value, a: z+(B/2), D: farthest interest point distance value, D,: nearest interest point distance value, d: target interest point distance value, x =a*W/B,y=H- ( (dD,)*H/ | DD,| ) If the orientation of the point of interest falls within the E range, the information frame is drawn on the lens image, if the point of interest is not In the B range, the information frame is not displayed in the lens image. In addition to Figure 1, please refer to Figure 4, the radar drawing module (1〇7) is a method for displaying the distribution of information of all points of interest in a 36-degree plane space. Current position Heart, the distance to the farthest point of interest is the radius 昼 a circle represents the radar, all points of interest are mounted on the radar chart with (x, y) mounts, and the towel (xy) is calculated by X (radians (ma) *D/R, y=c〇s (radians (ma)) D/R, where m: the direction of the phone compass, a: search engine search module (103) value, d: point of interest distance, R :Proportion. For the frame grouping module (1 〇8) 'This module will be used to group the 201221912 points of interest with similar distance and direction, so that the picture in the lens image will not be too messy. Point data from near to far::: The angle of interest point data and the azimuth of the mobile phone is less than e and the distance is less than the same-group' until the whole interest, the fif material group ends; see figure ~ less than e' & A , B two points will be grouped in the same group, when the metering is less than "den 1250 · i 50j is greater than e ' then c and A, B two points without the same group. = like the nesting module (10)), will Information frame grouping module (, point = and radar drawing module (10)) calculated the distribution of all points of interest to the point of interest information The frame and the radar image are stacked on the lens image. The information frame touch module (1)0) allows the user to perform the operations of clicking, dragging, etc. for the information box of the interest points nested in the lens image. The vicinity of 551 Lane, Section 5, Minzu Road, Yangmei Town, County County, for example:; the location and surrounding real scene are as shown in Annex II, and Annex 2 is the photographic image 1 0, which is the photographic image of Figure 1. Search parameter acquisition: The user sets the search condition to ', convenience store' through the search parameter combination module (101), and the GPS $bit t message transmitted by the mobile phone (latitude and longitude: m66551, 24.957867, by GPS positioning module ( 102) Acquired), and sent to the search engine search module (103). 2. Interest point information frame drawing and information box grouping: Through the point of interest search and retrieval module (10)), the data is submitted to the f-frame drawing module (the drawing is performed by the image of the image of the image), and the result is shown in Figure 5, #景系钱影影像1〇 , where the position of the interest point information frame on the lens image can be calculated by the formula x=a* W/B, y=H_ ( ( d-D')*H/ 丨D_D, 丨), which can be derived from the formula - The (x, y) value of the point of interest, and through the point of interest grouping module to compare sequentially, the points of interest (89, 52), points of interest (89 66), points of interest (89, 70) Points of interest (53, 89), points of interest (1) 3122), points of interest (Mm). 201221912 3 ·Point of interest information frame style setting module: Through the setting file, the style of the information frame of interest points can be determined, such as the attachment information box style (401), and the background is the photography image. —, 4. Point of Interest Information Image Overlay: The calculated information is nested with the camera lens image, including the right distribution radar map (5 (H) and the store information box (10) on the lens). The 'background is the photographic image】 〇, the radar circle (5〇1) is the module (10) 7) calculated by the calculation formula x=sin(radians(m_a) (radianS(ma) ”D/R, calculated by the formula The position (x, y) of each point of interest on the radar chart is obtained as (4) 4, points of interest (10) points of interest (302, 453), points of interest (3G2, 458), points of interest (312, 468). Interests provided by the present invention The method of arranging the information in the image of the wisdom head, and the technique of using the pot#;|: ·, the mirror of the device: ..., his W technology ★ when comparing with each other, the following images through the lens and various interests around the lens The combination of point information allows the user to use; the spatial relationship between the environment and the virtual (four) message 'and then guides the touch: the touch provides the user with a simpler and more intuitive information】 and the interactive mode, which helps to use The applicant has obtained more useful methods. This case is not only innovative in terms of technical thinking, but also can be applied in accordance with the law of the new law and the law of the new law. This piece of hair is called "to invent, to the sense of virtue." BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a schematic diagram of a module architecture for implementing the present invention; circle 2 is a schematic diagram of the calculation of the point of interest data and the moxibustion angle a of the north; 201221912 Fig. 3 is the relative orientation of the point of interest and the intelligent mobile device. Figure 4 is a schematic diagram of the interest point plotted on the radar chart with (x, y) coordinates; Figure 5 is a schematic diagram of the information frame of the interest point of the present invention; and Figure 6 is a schematic diagram of an example of the information frame grouping module of the present invention. Attachment] Attachment 1 is a schematic diagram of the (x,y) calculation of the smart mobile device screen; Annex 2 is a schematic diagram of the surrounding environment of the implementation case; Annex III is a schematic diagram of the information frame of the interest point of the present invention; and · Annex IV Schematic diagram of the information point of the present invention. [Main component symbol description] 101 query parameter combination module 102 GPS positioning module 103 search engine search module 104 orientation interception module 105 store information frame style setting module 106 information frame Drawing module 107 radar drawing module call 108 information frame grouping module 109 image nesting module 110 information frame touch module 10 photography image 301 store information box 401 store information frame style 501 store home distribution radar chart § 8