TW201740346A - Corresponding method and system in between panorama image and message on Internet platform which is viewed at a viewing angle and operated in a cloud server - Google Patents
Corresponding method and system in between panorama image and message on Internet platform which is viewed at a viewing angle and operated in a cloud server Download PDFInfo
- Publication number
- TW201740346A TW201740346A TW105114013A TW105114013A TW201740346A TW 201740346 A TW201740346 A TW 201740346A TW 105114013 A TW105114013 A TW 105114013A TW 105114013 A TW105114013 A TW 105114013A TW 201740346 A TW201740346 A TW 201740346A
- Authority
- TW
- Taiwan
- Prior art keywords
- message
- scene image
- image
- network platform
- angle
- Prior art date
Links
Landscapes
- User Interface Of Digital Computer (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
本發明係有關一種在網路平台上之影像與留言互相對應之技術,特別是指一種於網路平台上環景影像與留言之間的對應方法及其系統。The invention relates to a technology for matching images and messages on a network platform, in particular to a corresponding method and system between a scene image and a message on a network platform.
隨著網路發展及攝影技術的進步,特別是手機也可以拍攝影片並輕易上傳到網路後,愈來愈多人喜歡將生活的點點滴滴以錄影方式記錄下來,並上傳到網路平台與大眾分享,而環景影像更是目前最新穎的記錄模式,其利用至少二台裝設有魚眼鏡頭的攝影裝置或更多台一般攝影機,大範圍擷取周遭影像,將這些攝影機所擷取的影片經過影像處理技術製作出來的成品便是環景影像。With the development of the Internet and the advancement of photographic technology, especially after the mobile phone can also take pictures and upload it to the Internet, more and more people like to record the life of the video and upload it to the Internet platform. Sharing with the public, and the surround view image is the most novel recording mode at present. It uses at least two photographic devices equipped with fisheye lenses or more general cameras to capture the surrounding images on a large scale. The finished product produced by the image processing technology is a panoramic image.
用電腦觀看環景影像時,將拖曳影像畫面上下、左右移動,可360度無死角觀看周圍環境。當環景影像上傳到網路平台後,其他使用者在觀看影片時可能會針對某一時間點、某一角度的畫面想要評論,例如影片時間軸進行到2:30時,將畫面向右旋轉某一角度的位置有人在跳舞,但不知道此角度為何,而留言者想要對這個舞者評論,目前網路平台可針對時間軸留言,留言後,在評論區的留言上會出現2:30的字樣,其他使用者點擊2:30會自動連結到環景影像,並自動跳到時間軸2:30開始播放,但畫面會是未移動旋轉前的原點畫面,而不是留言者想要大家看的那個舞者的位置,使用者也不知道應該旋轉多少角度才行,需要使用者自己去找尋2:30的時間點哪裡有舞者,無法達到留言和環景影像完整呼應的效果。When viewing a panoramic image with a computer, drag the image to the top and bottom and left and right to view the surrounding environment at 360 degrees without a dead angle. When the scene image is uploaded to the web platform, other users may want to comment on the screen at a certain point in time and at a certain angle when watching the movie. For example, when the timeline of the movie is 2:30, the screen is turned to the right. Someone is dancing at a certain angle, but I don’t know why this angle, and the commenter wants to comment on this dancer. Currently, the web platform can leave a message for the timeline. After the message, it will appear on the comment in the comment area. :30 words, other users will automatically connect to the scene image when they click 2:30, and automatically jump to the timeline 2:30 to start playback, but the screen will be the origin screen before the rotation is rotated, instead of the message The position of the dancer that everyone wants to see, the user does not know how many angles should be rotated, the user needs to find the 2:30 time point where there is a dancer, can not achieve the full response of the message and the panoramic image .
因此,本發明即提出一種於網路平台上環景影像與留言之間的對應方法及其系統,有效解決上述該等問題,具體架構及其實施方式將詳述於下:Therefore, the present invention proposes a corresponding method and system for a scene image and a message on a network platform, which effectively solves the above problems, and the specific architecture and implementation manner thereof will be described in detail below:
本發明之主要目的在提供一種於網路平台上環景影像與留言之間的對應方法及其系統,其係讓留言者在針對環景影像的某一個觀看角度的環景影像畫面進行留言評論時,可同時將該環景影像畫面的時間及旋轉資訊儲存在雲端伺服器中,當其他使用者在網路上觀看此環景影像,並點擊留言時,會自動呈現該第一時間、該觀看角度之環景影像畫面,不需使用者自行操作客戶端裝置才能找到該環景影像畫面。The main purpose of the present invention is to provide a corresponding method and system for a scene image and a message on a network platform, which is to enable a commenter to comment on a scene image of a viewing angle of a scene image. The time and rotation information of the scene image can be stored in the cloud server at the same time. When other users view the scene image on the network and click the message, the first time and the viewing angle are automatically presented. The panoramic image screen can be found by the user without operating the client device.
本發明之另一目的在提供一種於網路平台上環景影像與留言之間的對應方法及其系統,其係依據游標定位模組的操作過程搭配查詢一對照表,得到對應環景影像轉動角度之角度值。Another object of the present invention is to provide a corresponding method and system for a scene image and a message on a network platform, which is matched with a comparison table according to the operation process of the cursor positioning module to obtain a rotation angle of the corresponding scene image. The angle value.
本發明之再一目的在提供一種於網路平台上環景影像與留言之間的對應方法及其系統,其中該游標定位模組為滑鼠或觸控板時,依據滑鼠或手指滑動的距離查表得到角度值,若游標定位模組為鍵盤上的方向鍵或螢幕上的一組方向鍵,則是依據點擊方向鍵的次數和停留時間來查表得到角度值。A further object of the present invention is to provide a method and system for matching a scene image and a message on a network platform, wherein the cursor positioning module is a mouse or a touchpad, and the distance is slid according to a mouse or a finger. Look up the table to get the angle value. If the cursor positioning module is the direction key on the keyboard or a set of direction keys on the screen, the angle value is obtained by looking up the table according to the number of times the button is clicked and the dwell time.
為達上述目的,本發明提供一種於網路平台上環景影像與留言之間的對應方法,至少一環景影像係儲存於一雲端伺服器上,且可在一客戶端裝置上透過一網路平台觀看環景影像並進行評論,對應方法包括下列步驟:一留言者在客戶端裝置上操作一游標定位模組,以變換在網路平台上觀看環景影像之觀看角度,當留言者欲對一第一時間的一環景影像畫面進行評論時,撰寫一留言並發送儲存於雲端伺服器中;客戶端裝置中之一軟體計算器依據留言者操作游標定位模組之過程,計算到第一時間為止,該觀看角度之環景影像畫面之旋轉資訊,並將旋轉資訊及第一時間儲存在雲端伺服器中之一雲端資料庫;以及留言顯示於網路平台上環景影像附近之一評論區,當至少一使用者點擊留言時,利用一雲端軟體計算器從雲端資料庫中取得旋轉資訊及第一時間,並計算尋找環景影像中該第一時間、觀看角度之環景影像畫面,並呈現給使用者觀看。To achieve the above objective, the present invention provides a method for mapping a scene image and a message on a network platform. At least one scene image is stored on a cloud server and can be transmitted through a network platform on a client device. Viewing the panoramic image and commenting, the corresponding method includes the following steps: a message user operates a cursor positioning module on the client device to change the viewing angle of viewing the panoramic image on the network platform, when the message person wants to When commenting on a scene image of the first time, a message is written and sent to be stored in the cloud server; one of the software devices in the client device calculates the first time according to the process of the message operator operating the cursor positioning module. The rotation information of the panoramic image of the viewing angle, and the rotation information and the first time are stored in one cloud database in the cloud server; and the message is displayed in a comment area near the surrounding image on the network platform, when At least one user clicks on the message, and uses a cloud software calculator to obtain the rotation information and the first time from the cloud database, and counts Looking for the first time panorama images, viewing angle of the panorama image screen, and presented to the user to watch.
本發明另提供一種於網路平台上環景影像與留言之間的對應系統,包括:至少一環景影像,儲存於一雲端伺服器中;至少一客戶端裝置,與雲端伺服器連線,操作一游標定位模組可變換環景影像之觀看角度,當一留言者欲對一第一時間及該觀看角度的一環景影像畫面進行評論時,留言者在客戶端裝置上撰寫一留言並發送儲存於雲端伺服器中,以供一使用者點擊留言,並在客戶端裝置上呈現第一時間、觀看角度之環景影像畫面;一軟體計算器,設於客戶端裝置中,依據留言者操作游標定位模組之過程,計算到第一時間為止,該觀看角度之環景影像畫面之一旋轉資訊;一雲端資料庫,儲存環景影像、留言、旋轉資訊及第一時間;以及一雲端軟體計算器,設於雲端伺服器中,依據旋轉資訊計算尋找第一時間及該觀看角度的環景影像畫面。The present invention further provides a corresponding system between a scene image and a message on a network platform, comprising: at least one scene image stored in a cloud server; at least one client device connected to the cloud server, and operating one The cursor positioning module can change the viewing angle of the panoramic image. When a commenter wants to comment on a scene image of the first time and the viewing angle, the message writer writes a message on the client device and sends it to the message. In the cloud server, a user clicks on a message and presents a scene image of the first time and the viewing angle on the client device; a software calculator is disposed in the client device, and the cursor is operated according to the message. The process of the module calculates a rotation information of the scene image of the viewing angle until the first time; a cloud database, storing the scene image, the message, the rotation information and the first time; and a cloud software calculator Set in the cloud server, calculate the scene image of the first time and the viewing angle according to the rotation information.
其中,當旋轉資訊為該觀看角度的環景影像畫面之一座標值時,軟體計算器計算座標值之方法係包括下列步驟:留言者每一次操作該游標定位模組後,該軟體計算器會得到一角度變化值;軟體計算器持續將每次操作游標定位模組後之角度變化值累加,得到觀看角度之一角度值;以及利用角度值計算觀看角度之座標值。Wherein, when the rotation information is a coordinate value of the panoramic image of the viewing angle, the method for calculating the coordinate value by the software calculator includes the following steps: after each operation of the cursor positioning module, the software calculator will Obtaining an angle change value; the software calculator continuously accumulates the angle change value after each operation of the cursor positioning module to obtain an angle value of the viewing angle; and calculates the coordinate value of the viewing angle by using the angle value.
其中,當旋轉資訊為該觀看角度的環景影像畫面所旋轉之一角度值時,包括下列步驟:留言者每一次操作該游標定位模組後,該軟體計算器會得到一角度變化值;該軟體計算器持續將每次操作該游標定位模組後之該角度變化值累加,得到該觀看角度之該角度值,以做為該旋轉資訊儲存在該雲端資料庫中;以及該使用者點擊該留言後,該雲端軟體計算器利用該角度值計算該觀看角度之該環景影像畫面對應該環景影像之一球座標中的一座標值。Wherein, when the rotation information is an angle value rotated by the landscape image of the viewing angle, the method includes the following steps: the software calculator obtains an angle change value after each operation of the cursor positioning module; The software calculator continuously accumulates the angle change value after each operation of the cursor positioning module to obtain the angle value of the viewing angle, as the rotation information is stored in the cloud database; and the user clicks the After the message is sent, the cloud software calculator uses the angle value to calculate the scene image of the viewing angle corresponding to a target value in one of the spherical coordinates of the scene image.
或者,留言者每一次操作游標定位模組後,軟體計算器會直接取得該觀看角度之環景影像畫面對應環景影像之球座標中的一座標值,並儲存在雲端伺服器中。Alternatively, after each operation of the cursor positioning module, the software calculator directly obtains a value in the spherical coordinates of the panoramic image corresponding to the viewing angle of the viewing angle image, and stores it in the cloud server.
留言者每一次操作游標定位模組後,會在球座標上產生一變化向量,角度變化值包含變化向量與一水平XY軸之一水平夾角及變化向量與一Z軸之一垂直夾角。Each time the message operator operates the cursor positioning module, a change vector is generated on the ball coordinate. The angle change value includes a horizontal angle between the change vector and a horizontal XY axis and a vertical angle between the change vector and a Z axis.
本發明提供一種於網路平台上環景影像與留言之間的對應方法及其系統,第1圖為本發明於網路平台上環景影像與留言之間的對應系統之一實施例之方塊圖,第2圖為本發明於網路平台上環景影像與留言之間的對應方法中呼應第1圖之流程圖。The invention provides a corresponding method and system for a scene image and a message on a network platform, and FIG. 1 is a block diagram of an embodiment of a corresponding system between a scene image and a message on a network platform according to the present invention. FIG. 2 is a flow chart corresponding to FIG. 1 in the corresponding method between the surrounding image and the message on the network platform.
請參考第1圖,本發明之於網路平台上環景影像與留言之間的對應系統包括一雲端伺服器10及至少一客戶端裝置20,其中雲端伺服器10為一個可播放影片的網路平台,如YouTube,其中儲存至少一環景影像13,此環景影像可為靜態之360度環景照片或動態之360度環景影片;雲端伺服器10包括一雲端播放軟體12、一雲端資料庫14及一雲端軟體計算器16;客戶端裝置20為智慧型手機、平板電腦、桌上型電腦、筆記型電腦或其他智慧型電子裝置,其中包括一裝置端播放軟體22、一游標定位模組24、一軟體計算器26、一評論模組27、一暫存記憶體28及一通訊模組29。客戶端裝置20利用通訊模組29與雲端伺服器10連線,當客戶端裝置20中的裝置端播放軟體22播放一環景影像13時,雲端播放軟體12會控制環景影像13的串流下載到裝置端播放軟體22;游標定位模組24為滑鼠、觸控板、觸控螢幕或一組方向鍵,此方向鍵可為鍵盤上的上、下、左、右鍵,或是在客戶端裝置20的螢幕上顯示的方向鍵圖案,舉例而言,此方向鍵圖案可設在環景影像的左上角;當一個人在客戶端裝置20操作游標定位模組24時,會變換環景影像之觀看角度,以滑鼠為例,按住滑鼠左鍵後以拖曳方式移動滑鼠,可改變環景影像的觀看角度,而以觸控板為例,也要一隻手指按住觸控板,另一隻手指在觸控板上滑動,可改變環景影像的觀看角度。Referring to FIG. 1 , the corresponding system between the surround image and the message on the network platform includes a cloud server 10 and at least one client device 20, wherein the cloud server 10 is a network capable of playing a movie. The platform, such as YouTube, stores at least one surround image 13 , which may be a static 360-degree panoramic photo or a dynamic 360-degree panoramic movie; the cloud server 10 includes a cloud-playing software 12 and a cloud database. 14 and a cloud software calculator 16; the client device 20 is a smart phone, a tablet computer, a desktop computer, a notebook computer or other smart electronic devices, including a device-side playback software 22 and a cursor positioning module. 24. A software calculator 26, a comment module 27, a temporary memory 28, and a communication module 29. The client device 20 is connected to the cloud server 10 by using the communication module 29. When the device-side playing software 22 in the client device 20 plays a ring image 13, the cloud playing software 12 controls the streaming download of the ring image 13 The device 22 is played to the device end; the cursor positioning module 24 is a mouse, a touchpad, a touch screen or a set of direction keys, and the direction keys can be up, down, left, right keys on the keyboard, or on the client side. The direction key pattern displayed on the screen of the device 20, for example, the direction key pattern can be set in the upper left corner of the scene image; when a person operates the cursor positioning module 24 in the client device 20, the scene image is changed. For viewing angles, for example, by holding down the left mouse button and dragging the mouse to change the viewing angle of the surround image, taking the touchpad as an example, also holding the touchpad with one finger. The other finger slides on the touchpad to change the viewing angle of the surround image.
評論模組27供留言者輸入留言,留言者可針對某一第一時間、某一觀看角度的環景影像畫面進行評論,留言會儲存在雲端伺服器10中,而軟體計算器26用以計算操作游標定位模組24後環景影像被旋轉的角度值及座標值;雲端資料庫14係儲存環景影像、留言、座標值、角度值及第一時間。從客戶端裝置20上看,留言會顯示於環景影像附近的一評論區中,而下載的環景影像13的影音串流、輸入留言的第一時間、留言及軟體計算器26所算出之座標值、角度值都會暫存在暫存記憶體28中。The comment module 27 is used for the commenter to input a message, and the commenter can comment on the scene image of a certain time and a certain viewing angle, the message is stored in the cloud server 10, and the software calculator 26 is used for calculation. The angle value and the coordinate value of the image of the ring image after the cursor positioning module 24 are operated; the cloud database 14 stores the image of the ring image, the message, the coordinate value, the angle value and the first time. Viewed from the client device 20, the message is displayed in a comment area near the surround image, and the downloaded video stream 13 video stream, the first time the message is input, the message and the software calculator 26 calculate The coordinate value and the angle value are temporarily stored in the temporary memory 28.
請同時參考第1圖及第2圖,當留言者要針對環景影像中的某一個畫面進行評論留言時,首先如步驟S10,留言者在客戶端裝置20上開啟裝置端播放軟體22,選擇欲觀看的環景影像;步驟S12中,當環景影像開始播放後,留言者可操作游標定位模組24以變換環景影像之觀看角度;步驟S14,當留言者欲對一第一時間、一觀看角度的環景影像畫面進行評論時,在評論模組27上輸入一留言,留言可為文字、語音、圖片或影像;步驟S16,客戶端裝置20計算到第一時間為止,該觀看角度之環景影像畫面之一旋轉資訊,例如該觀看角度之環景影像畫面係將環景影像向右旋轉90度,此即為旋轉資訊,並將旋轉資訊及第一時間儲存在雲端資料庫14中;以及步驟S18所述,當使用者點擊該則留言時,雲端軟體計算器16從該雲端資料庫14中取得旋轉資訊及第一時間,並於步驟S19中,利用旋轉資訊及第一時間去計算尋找環景影像中第一時間、觀看角度之環景影像畫面,並呈現在客戶端裝置20上給使用者觀看。 第3圖為本發明一實施例之詳細流程圖,步驟S20,留言者在客戶端裝置上開啟裝置端播放軟體,選擇欲觀看的360度環景影像;步驟S22中,選好環景影像後,當環景影像開始播放,客戶端裝置的軟體計算器會同時啟動,留言者操作客戶端裝置的游標定位模組以變換環景影像之觀看角度,且軟體計算器會得到每一次操作游標定位模組後的角度變化值,請同時參考第4圖之球座標示意圖,假設環景影像開始播放時間為t0 ,第一時間為tn ,P_t0 =(x, y, z)為時間 t0 時的畫面座標值,P_tn =(X_tn , Y_tn , Z_tn )為第一時間tn 時的畫面座標值,;留言者每一次操作游標定位模組後,會在球座標上產生一變化向量V_tn ,變化向量V_tn 投射在一水平XY平面上、與X軸或Y軸之夾角為ψtn ,變化向量與Z軸之夾角為θtn 。步驟S24,當留言者欲對一第一時間、一觀看角度的環景影像畫面進行評論時,在評論模組上輸入一留言;步驟S26,客戶端裝置中的軟體計算器持續將角度變化值累加到第一時間為止,舉例而言,若留言者操作滑鼠將環景影片以水平方向向右旋轉了1公分、2公分、1公分等三次操作,加總為向右旋轉了4公分,再以垂直方向向上旋轉了1公分、2公分、1公分等三次操作,加總為向上旋轉了4公分,每一次旋轉都會有一個包含水平向量和垂直向量的角度變化值,將三次角度變化值加總即為最後觀看角度的角度值ψtn 和θtn ;接著步驟S27,利用角度值計算得到該觀看角度之該環景影像畫面的一座標值,該座標值P_tn =(X_tn , Y_tn , Z_tn )=(r*sinθtn *cosψtn , r*sinθtn *sinψtn , r*cosθtn ),並將座標值P_tn 及第一時間儲存在雲端資料庫中,因此座標值在此實施例中就是旋轉資訊;步驟S28所述,當使用者點擊該則留言時,雲端軟體計算器從該雲端資料庫中取得座標值及第一時間,並於步驟S29中,利用座標值及第一時間去計算尋找環景影像中第一時間、觀看角度之環景影像畫面,並直接呈現在客戶端裝置上給使用者觀看,如此一來,使用者就不需要自行旋轉畫面到留言者指定的位置。Please refer to FIG. 1 and FIG. 2 at the same time. When the commenter wants to comment on a certain picture in the panoramic image, first, in step S10, the message user opens the device-side playing software 22 on the client device 20, and selects The scene image to be viewed; in step S12, after the scene image starts playing, the message user can operate the cursor positioning module 24 to change the viewing angle of the scene image; in step S14, when the message person wants to be a first time, When commenting on the panoramic image of the viewing angle, a comment is input on the comment module 27, and the message can be text, voice, picture or image; in step S16, the client device 20 calculates the viewing angle until the first time. One of the surrounding image images rotates information, for example, the panoramic image of the viewing angle rotates the panoramic image 90 degrees to the right, which is the rotation information, and stores the rotation information and the first time in the cloud database 14 And in step S18, when the user clicks on the message, the cloud software calculator 16 obtains the rotation information and the first time from the cloud database 14, and in step S19, Rotational information and calculates a first time to look for a first time in the panorama image, the viewing angle of the panorama image screen, and in the view presented to the user client device 20. FIG. 3 is a detailed flowchart of an embodiment of the present invention. In step S20, the message user opens the device to play the software on the client device, and selects a 360-degree panoramic image to be viewed. In step S22, after selecting the ring image, When the scene image starts to play, the software calculator of the client device starts at the same time, the message operator operates the cursor positioning module of the client device to change the viewing angle of the ring image, and the software calculator obtains the cursor positioning mode for each operation. For the angle change value after the group, please refer to the ball coordinate diagram in Figure 4, assuming that the ring scene image starts playing time t 0 , the first time is t n , P_t 0 = (x, y, z) is time t 0 when the screen coordinates, P_t n = (X_t n, Y_t n, Z_t n) is a first coordinate value at time t of the picture n, Each time the message operator operates the cursor positioning module, a change vector V_t n is generated on the ball coordinate, and the variation vector V_t n is projected on a horizontal XY plane, and the angle between the X axis or the Y axis is ψt n , the change vector The angle with the Z axis is θt n . Step S24, when the commenter wants to comment on the scene image of the first time and the viewing angle, input a message on the comment module; in step S26, the software calculator in the client device continues to change the angle. Adding to the first time, for example, if the commenter operates the mouse to rotate the surround movie to the right in the horizontal direction by 1 cm, 2 cm, 1 cm, etc., the total is 4 cm rotated to the right. Then rotate the vertical direction upwards by 1 cm, 2 cm, 1 cm, etc., and add up to 4 cm upwards. Each rotation will have an angle change value including the horizontal vector and the vertical vector, and the angle change value will be three times. The summation is the angle values ψt n and θt n of the last viewing angle; then, in step S27, a target value of the scene image of the viewing angle is calculated by using the angle value, the coordinate value P_t n = (X_t n , Y_t n , Z_t n )=(r*sinθt n *cosψt n , r*sinθt n *sinψt n , r*cosθt n ), and store the coordinate value P_t n and the first time in the cloud database, so the coordinate value is In this embodiment, it is a spin Information; in step S28, when the user clicks on the message, the cloud software calculator obtains the coordinate value and the first time from the cloud database, and in step S29, uses the coordinate value and the first time to calculate the search. The scene image of the first time and the viewing angle in the scene image is directly presented on the client device for viewing by the user, so that the user does not need to rotate the screen to the position specified by the message holder.
一般而言,已知的旋轉資訊為座標值時,可直接在環景影像的球座標上找到該環景影像畫面。In general, when the known rotation information is a coordinate value, the scene image can be directly found on the ball coordinates of the scene image.
第5圖為本發明另一實施例之詳細流程圖,步驟S30,留言者在客戶端裝置上開啟裝置端播放軟體,選擇欲觀看的360度環景影像;步驟S32中,選好環景影像後,當環景影像開始播放,客戶端裝置的軟體計算器會同時啟動,留言者操作客戶端裝置的游標定位模組以變換環景影像之觀看角度,請同時參考第4圖之球座標示意圖,假設環景影像開始播放時間為t0 ,第一時間為tn ,P_t0 =(X_t0 , Y_t0 , Z_t0 )為時間 t0 時的畫面座標值,P_tn =(X_tn , Y_tn , Z_tn )為第一時間tn 時的畫面座標值,留言者每一次操作游標定位模組後,會在球座標上產生一變化向量V_tn ,變化向量V_tn 與一水平XY軸的水平夾角為ψtn ,變化向量V_tn 與一Z軸之垂直夾角為θtn 。步驟S34,當留言者欲對一第一時間、一觀看角度的環景影像畫面進行評論時,在評論模組上輸入一留言;步驟S36,客戶端裝置中的軟體計算器持續將角度變化值累加到第一時間為止,舉例而言,若留言者操作滑鼠將環景影片以水平方向向右旋轉了1公分、2公分、1公分等三次操作,加總為向右旋轉了4公分,再以垂直方向向上旋轉了1公分、2公分、1公分等三次操作,加總為向上旋轉了4公分,每一次旋轉都會有一個包含水平向量和垂直向量的角度變化值,將三次角度變化值加總即為最後觀看角度的角度值ψtn 和θtn ,並將角度值與第一時間儲存到雲端資料庫中,因此角度值是此實施例中的旋轉資訊;接著步驟S38中,當使用者點擊該則留言時,雲端軟體計算器從該雲端資料庫中取得角度值及第一時間,並於步驟S39,利用角度值去計算該觀看角度之該環景影像畫面的座標值,該座標值P_tn =(X_tn , Y_tn , Z_tn )=(r*sinθtn *cosψtn , r*sinθtn *sinψtn , r*cosθtn ),再計算尋找第一時間環景影像中該座標值的觀看角度之環景影像畫面,並呈現在客戶端裝置上給使用者觀看。FIG. 5 is a detailed flowchart of another embodiment of the present invention. In step S30, the message user opens the device-side playing software on the client device, and selects a 360-degree panoramic image to be viewed; in step S32, after selecting the ring-view image When the scene image starts to play, the software calculator of the client device will start at the same time, and the message operator operates the cursor positioning module of the client device to change the viewing angle of the ring image, please refer to the ball coordinate diagram in FIG. views assuming the video playback start time t 0, a first time t n, P_t 0 = (X_t 0, Y_t 0, Z_t 0) to time t 0 of the screen coordinates, P_t n = (X_t n, Y_t n , Z_t n ) is the coordinate value of the picture at the first time t n , and each time the message operator operates the cursor positioning module, a change vector V_t n is generated on the ball coordinate, and the level of the change vector V_t n and a horizontal XY axis is generated. The angle is ψt n , and the vertical angle between the variation vector V_t n and a Z axis is θt n . Step S34, when the commenter wants to comment on the scene image of the first time and the viewing angle, input a message on the comment module; in step S36, the software calculator in the client device continues to change the angle. Adding to the first time, for example, if the commenter operates the mouse to rotate the surround movie to the right in the horizontal direction by 1 cm, 2 cm, 1 cm, etc., the total is 4 cm rotated to the right. Then rotate the vertical direction upwards by 1 cm, 2 cm, 1 cm, etc., and add up to 4 cm upwards. Each rotation will have an angle change value including the horizontal vector and the vertical vector, and the angle change value will be three times. The sum is the angle values ψt n and θt n of the last viewing angle, and stores the angle value and the first time into the cloud database, so the angle value is the rotation information in this embodiment; then, in step S38, when used When the user clicks on the message, the cloud software calculator obtains the angle value and the first time from the cloud database, and in step S39, uses the angle value to calculate the scene angle of the viewing angle. Like the coordinate value of the picture, the coordinate value P_t n =(X_t n , Y_t n , Z_t n )=(r*sinθt n *cosψt n , r*sinθt n *sinψt n , r*cosθt n ), and then calculate the search The panoramic image of the viewing angle of the coordinate value in the scene image is displayed on the client device for viewing by the user.
第6圖為本發明另一實施例之詳細流程圖,步驟S40,留言者在客戶端裝置上開啟裝置端播放軟體,選擇欲觀看的360度環景影像;步驟S42中,選好環景影像後,當環景影像開始播放,客戶端裝置的軟體計算器會同時啟動,留言者操作客戶端裝置的游標定位模組以變換環景影像之觀看角度,但在此步驟中,軟體計算器會直接取得每一次操作游標定位模組時的座標值,不需取得角度變化值後再去加總計算,因為有些環景影像會內建球座標。步驟S44,當留言者欲對一第一時間、一觀看角度的環景影像畫面進行評論時,在評論模組上輸入一留言;步驟S46,客戶端裝置中的軟體計算器得到留言當下的座標值,並將座標值與第一時間儲存到雲端資料庫中,因此座標值是此實施例中的旋轉資訊;接著步驟S48中,當使用者點擊該則留言時,雲端軟體計算器從該雲端資料庫中取得座標值及第一時間,並於步驟S49,利用座標值及第一時間去計算尋找環景影像中第一時間、觀看角度之環景影像畫面,並直接呈現在客戶端裝置上給使用者觀看。FIG. 6 is a detailed flowchart of another embodiment of the present invention. In step S40, the message user opens the device-side playing software on the client device, and selects a 360-degree panoramic image to be viewed; in step S42, after selecting the ring-view image When the scene image starts to play, the software calculator of the client device starts at the same time, and the message operator operates the cursor positioning module of the client device to change the viewing angle of the ring image, but in this step, the software calculator directly Obtain the coordinate value of each operation of the cursor positioning module, and then do not need to obtain the angle change value and then add the total calculation, because some scene images will have built-in ball coordinates. Step S44, when the commenter wants to comment on the scene image of the first time and the viewing angle, input a message on the comment module; in step S46, the software calculator in the client device obtains the current coordinate of the message. Value, and store the coordinate value and the first time in the cloud database, so the coordinate value is the rotation information in this embodiment; then in step S48, when the user clicks on the message, the cloud software calculator from the cloud The coordinate value and the first time are obtained in the database, and in step S49, the coordinate image and the first time are used to calculate the panoramic image of the first time and the viewing angle in the panoramic image, and are directly presented on the client device. Show it to the user.
因此,在本發明中客戶端裝置的軟體計算器依據游標定位模組所取得並儲存在雲端資料庫中的旋轉資訊可包括第一時間該觀看角度之角度值,或是以角度值計算出之座標值,當軟體計算器已算出座標值時,若之後有其他使用者點擊留言,雲端軟體計算器就可直接用座標值找出第一時間該座標值的環景影像畫面;若軟體計算器只算出角度值,則若之後有其他使用者點擊留言,雲端軟體計算器還需用角度值去算出座標值,再利用座標值找出第一時間該座標值的環景影像畫面,亦即座標值可由客戶端裝置的軟體計算器計算,也可由雲端軟體計算器計算。Therefore, in the present invention, the software calculator of the client device according to the cursor positioning module and the rotation information stored in the cloud database may include the angle value of the viewing angle at the first time, or calculated by the angle value. Coordinate value, when the software calculator has calculated the coordinate value, if other users click on the message, the cloud software calculator can directly use the coordinate value to find the scene image of the coordinate value at the first time; if the software calculator Only calculate the angle value, then if other users click on the message, the cloud software calculator needs to calculate the coordinate value by the angle value, and then use the coordinate value to find the scene image of the coordinate value at the first time, that is, the coordinate The value can be calculated by the software calculator of the client device or by the cloud software calculator.
在本發明中,當游標定位模組為滑鼠、觸控板或觸控螢幕時,軟體計算器依據留言者的手指在觸控板、觸控螢幕上移動的距離,或滑鼠之游標移動的距離,查詢一對照表後,可得到距離對應環景影像轉動角度之角度變化值,對照表係預先訓練出操作游標定位模組移動的距離與環景影像轉動角度之角度變化值之關係。舉例而言,觸控螢幕上手指接觸的位置直接對應到畫面的位置座標,經過手指拖移的動作,畫面的位置座標產生相對的位移,手指向右移動代表環景影像逆時針旋轉,當手指在觸控螢幕上移動9公分,相當於環景影像的畫面旋轉90度,或是滑鼠的游標移動3公分相當於環景影像旋轉30度,這些對應關係事先建立對照表,如此一來,計算手指在觸控板、觸控螢幕上移動的距離,或滑鼠之游標移動的距離,便可查表得到角度變化值。In the present invention, when the cursor positioning module is a mouse, a touchpad or a touch screen, the software calculator moves according to the distance of the finger of the message on the touchpad or the touch screen, or the cursor movement of the mouse. The distance, after querying a comparison table, can obtain the angle change value of the rotation angle of the corresponding scene image, and the comparison table pre-trains the relationship between the distance moved by the operation cursor positioning module and the angle change value of the rotation angle of the landscape image. For example, the position of the finger touch on the touch screen directly corresponds to the position coordinate of the screen. After the finger is dragged, the position coordinate of the screen produces a relative displacement, and the movement of the finger to the right represents the rotation of the scene image counterclockwise, when the finger Move 9 cm on the touch screen, which is equivalent to 90 degrees of the scene image, or 3 cm of the mouse cursor is equivalent to 30 degrees of the scene image rotation. These correspondences are pre-established in the comparison table. Calculate the distance the finger moves on the touchpad, touch screen, or the distance the mouse cursor moves, and you can look up the table to get the angle change value.
若游標定位模組為方向鍵時,軟體計算器則是依據留言者點擊方向鍵的次數和停留時間,查詢一對照表後,可得到對應環景影像轉動角度之角度變化值,對照表係預先訓練出點擊方向鍵的次數和停留時間與環景影像轉動角度之角度變化值之關係。舉例而言,先預設方向鍵快速點擊一下可使環景影像的畫面旋轉15度,而若長按方向鍵2秒可使環景影像的畫面旋轉一周,將此關係式建立對照表,則只要得到留言者點擊方向鍵的次數和停留時間,便可查表得到角度變化值。If the cursor positioning module is a direction key, the software calculator is based on the number of times the visitor clicks the direction key and the dwell time. After querying a comparison table, the angle change value of the rotation angle of the corresponding scene image can be obtained, and the comparison table is pre- The relationship between the number of times the click direction key is clicked and the angle of change of the dwell time and the angle of rotation of the landscape image is trained. For example, the preset direction key can be quickly clicked to rotate the picture of the scene image by 15 degrees, and if the direction key is pressed for 2 seconds, the picture of the scene image can be rotated for one week, and the relationship is established. As long as you get the number of times the message is clicked and the dwell time, you can check the table to get the angle change value.
當留言顯示在評論區時,會同時顯示一標示,以供使用者點擊,點擊標示後可顯示留言者留言時第一時間及觀看角度之環景影像畫面,而標示可內含第一時間及座標值、只內含第一時間或只內含座標值,此部分為留言者在撰寫留言時可自行選擇的,且留言者還可選擇同時顯示標示和留言,或只顯示留言,例如留言者可選擇只在評論區呈現留言,而不顯示標示,但當使用者點擊留言時,同樣會導向該觀看角度的環景影像畫面。When the message is displayed in the comment area, a mark is displayed at the same time for the user to click. After clicking the mark, the image of the scene at the first time and the viewing angle when the message is posted can be displayed, and the mark can contain the first time and The coordinate value, only the first time or only the coordinate value, this part is the message holder can choose when writing the message, and the message can also choose to display the logo and message at the same time, or only display the message, such as the message You can choose to present the message only in the comment area without displaying the mark, but when the user clicks on the message, it will also lead to the panoramic image of the viewing angle.
第一時間的判定可有至少兩種方法,其一為在環景影像暫停時,暫停時間就是第一時間,其二為留言者輸入留言時,環景影像繼續播放,第一時間即為留言者開始輸入留言之一起始時間。There may be at least two methods for determining the first time. One is that when the landscape image is paused, the pause time is the first time, and the other is that when the message is input by the message, the scene image continues to play, and the first time is the message. The person begins to enter a start time for the message.
此外,留言者更可在環景影像畫面上標示一物件,而當環景影像畫面呈現給使用者觀看時,物件還可做置中處理或其他醒目提示,如在物件外增加方形、圓形外框等。舉例而言,環景影像畫面為很多人的合照,留言者想要標示出其中的某一個人,則給予該人頭一個物件標示,當使用者點擊留言時,不但裝置端播放軟體呈現旋轉到該角度的環景影像畫面,且會自動將該人頭移到螢幕中央,或是人頭位置不變但用紅色虛框標示出那個人,便可一目了然知道留言者所指何人。In addition, the message person can mark an object on the scene image, and when the scene image is presented to the user, the object can also be centered or other eye-catching prompts, such as adding a square or a circle outside the object. Frame and so on. For example, the scene image is a group photo of a lot of people. If the message person wants to mark one of the people, the person is given the first object label. When the user clicks on the message, not only the device-side playback software is rotated to the The angle of the image of the scene, and will automatically move the head to the center of the screen, or the position of the head is unchanged but the person is marked with a red frame, you can know at a glance who the message is.
因此,本發明舉例而言,當留言者在線上(雲端伺服器)觀看一部駕駛飛機的環景影像,畫面一直是朝著機長的正前方,假設留言者將環景影像旋轉到可看到右側窗戶,並在時間1:06的時候留言「窗戶外有一隻鳥」。其他使用者在觀看同一部環景影像時,看到了評論區的這一則留言,只要點擊留言或旁邊的標示,就可以將環景影像的時間軸直接跳至1:06,並且畫面不再是朝向機長前方,而是留言者在1:06時的觀看角度,亦即右側窗戶,讓使用者不需要自行將畫面旋轉到右側窗戶;此外,若留言者有標示「鳥」這個物件,則使用者不但可直接看到右側窗戶的環景影像畫面,且還能看到被方框標出的「鳥」,或是鳥被移到畫面的正中央等等,可更清楚地瞭解留言者在此環景影像畫面中要表達的是什麼意思。Therefore, in the present invention, for example, when a commenter is watching a panoramic image of a flying aircraft on the line (cloud server), the picture is always facing the front of the captain, and it is assumed that the message person rotates the ring image to be visible. On the right side of the window, and at 1:06, there is a message "There is a bird outside the window." When other users watch the same scene image, they can see this message in the comment area. Just click the message or the icon next to it, you can jump the timeline of the scene image directly to 1:06, and the picture is no longer Facing the front of the captain, it is the viewing angle of the message at 1:06, that is, the right window, so that the user does not need to rotate the screen to the right window by himself; in addition, if the message person has the object labeled "bird", then use Not only can you directly see the panoramic image of the right window, but you can also see the "bird" marked by the box, or the bird is moved to the center of the picture, etc., to get a clearer understanding of the message. What do you mean by this scene image?
綜上所述,本發明提供一種於網路平台上環景影像與留言之間的對應方法及其系統,其應用在客戶端裝置為電腦、平板電腦、智慧型手機等由使用者操作旋轉螢幕畫面之裝置上,操作游標定位模組可得到環景影像的角度變化值,再以此計算出旋轉後環景影像畫面的座標值,或是操作當下就直接取得座標值,且這些旋轉資訊儲存在雲端伺服器,因此,本發明將留言與當下的環景影像畫面的時間點及觀看角度產生連結,當其他使用者點擊該留言時,環景影像就會自動跳到該時間點,且還會依據該座標值自動將畫面旋轉到該觀看角度,讓使用者不用再操作滑鼠游標、點擊觸控等游標定位模組,就可直接看到留言者所指的環景影像畫面。In summary, the present invention provides a method and system for matching a scene image and a message on a network platform, and the application is performed on a client device, such as a computer, a tablet computer, a smart phone, etc., by a user operating a rotating screen screen. On the device, the cursor positioning module can obtain the angle change value of the ring image, and then calculate the coordinate value of the rotated landscape image, or directly obtain the coordinate value when the operation is performed, and the rotation information is stored in The cloud server, therefore, the present invention links the message with the time point and the viewing angle of the current scene image, and when other users click the message, the scene image will automatically jump to the time point, and According to the coordinate value, the screen is automatically rotated to the viewing angle, so that the user can directly see the ring image image pointed by the commenter without using the cursor cursor and clicking the cursor positioning module.
唯以上所述者,僅為本發明之較佳實施例而已,並非用來限定本發明實施之範圍。故即凡依本發明申請範圍所述之特徵及精神所為之均等變化或修飾,均應包括於本發明之申請專利範圍內。The above is only the preferred embodiment of the present invention and is not intended to limit the scope of the present invention. Therefore, any changes or modifications of the features and spirits of the present invention should be included in the scope of the present invention.
10‧‧‧雲端伺服器
12‧‧‧雲端播放軟體
13‧‧‧環景影像
14‧‧‧雲端資料庫
16‧‧‧雲端軟體計算器
20‧‧‧客戶端裝置
22‧‧‧裝置端播放軟體
24‧‧‧游標定位模組
26‧‧‧軟體計算器
27‧‧‧評論模組
28‧‧‧暫存記憶體
29‧‧‧通訊模組10‧‧‧Cloud Server
12‧‧‧Cloud Play Software
13‧‧‧Outdoor image
14‧‧‧Cloud database
16‧‧‧Cloud Software Calculator
20‧‧‧Client device
22‧‧‧Device-side playback software
24‧‧‧ cursor positioning module
26‧‧‧Software Calculator
27‧‧‧Comment Module
28‧‧‧Scratch memory
29‧‧‧Communication Module
第1圖為本發明於網路平台上環景影像與留言之間的對應系統中一實施例之方塊圖。 第2圖為本發明於網路平台上環景影像與留言之間的對應方法中一實施例之流程圖。 第3圖為本發明於網路平台上環景影像與留言之間的對應方法中一實施例之詳細流程圖。 第4圖為第一時間tn環景影像畫面的座標在環景影像球座標上之示意圖。 第5圖為本發明於網路平台上環景影像與留言之間的對應方法中另一實施例之詳細流程圖。 第6圖為本發明於網路平台上環景影像與留言之間的對應方法中再一實施例之詳細流程圖。FIG. 1 is a block diagram of an embodiment of a corresponding system between a scene image and a message on a network platform according to the present invention. FIG. 2 is a flow chart of an embodiment of a method for mapping a scene image and a message on a network platform according to the present invention. FIG. 3 is a detailed flowchart of an embodiment of a method for mapping a scene image and a message on a network platform according to the present invention. Figure 4 is a schematic diagram of the coordinates of the ring image image at the first time tn on the coordinates of the surrounding image sphere. FIG. 5 is a detailed flowchart of another embodiment of a method for mapping a scene image and a message on a network platform according to the present invention. FIG. 6 is a detailed flowchart of still another embodiment of a method for mapping a scene image and a message on a network platform according to the present invention.
Claims (37)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW105114013A TW201740346A (en) | 2016-05-05 | 2016-05-05 | Corresponding method and system in between panorama image and message on Internet platform which is viewed at a viewing angle and operated in a cloud server |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW105114013A TW201740346A (en) | 2016-05-05 | 2016-05-05 | Corresponding method and system in between panorama image and message on Internet platform which is viewed at a viewing angle and operated in a cloud server |
Publications (1)
Publication Number | Publication Date |
---|---|
TW201740346A true TW201740346A (en) | 2017-11-16 |
Family
ID=61022837
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW105114013A TW201740346A (en) | 2016-05-05 | 2016-05-05 | Corresponding method and system in between panorama image and message on Internet platform which is viewed at a viewing angle and operated in a cloud server |
Country Status (1)
Country | Link |
---|---|
TW (1) | TW201740346A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110826385A (en) * | 2018-06-07 | 2020-02-21 | 皇家飞利浦有限公司 | Rehabilitation device and method |
-
2016
- 2016-05-05 TW TW105114013A patent/TW201740346A/en unknown
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110826385A (en) * | 2018-06-07 | 2020-02-21 | 皇家飞利浦有限公司 | Rehabilitation device and method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11380362B2 (en) | Spherical video editing | |
US12079942B2 (en) | Augmented and virtual reality | |
CN109313812B (en) | Shared experience with contextual enhancements | |
US9699375B2 (en) | Method and apparatus for determining camera location information and/or camera pose information according to a global coordinate system | |
JP6493471B2 (en) | Video playback method, computer processing system, and video playback program | |
US20130250048A1 (en) | Method of capture, display and sharing of orientation-based image sets | |
US20210289147A1 (en) | Images with virtual reality backgrounds | |
US20230043683A1 (en) | Determining a change in position of displayed digital content in subsequent frames via graphics processing circuitry | |
US20220350650A1 (en) | Integrating overlaid digital content into displayed data via processing circuitry using a computing memory and an operating system memory | |
TW201740346A (en) | Corresponding method and system in between panorama image and message on Internet platform which is viewed at a viewing angle and operated in a cloud server | |
US20230308603A1 (en) | Dynamic virtual background for video conference | |
TWM589834U (en) | Augmented Reality Integration System | |
TW201738649A (en) | Corresponding method between panorama video and message and system thereof having cloud software calculator to obtain an angle value and a first time point from the cloud database, and calculate and search a picture of panorama video corresponding to the message | |
TWI762830B (en) | System for displaying hint in augmented reality to play continuing film and method thereof | |
US20230326094A1 (en) | Integrating overlaid content into displayed data via graphics processing circuitry and processing circuitry using a computing memory and an operating system memory | |
US20230334792A1 (en) | Interactive reality computing experience using optical lenticular multi-perspective simulation | |
US20240185546A1 (en) | Interactive reality computing experience using multi-layer projections to create an illusion of depth | |
US20230334790A1 (en) | Interactive reality computing experience using optical lenticular multi-perspective simulation | |
US20230334791A1 (en) | Interactive reality computing experience using multi-layer projections to create an illusion of depth | |
WO2024039885A1 (en) | Interactive reality computing experience using optical lenticular multi-perspective simulation | |
WO2023215637A1 (en) | Interactive reality computing experience using optical lenticular multi-perspective simulation | |
WO2024039887A1 (en) | Interactive reality computing experience using optical lenticular multi-perspective simulation | |
WO2023205145A1 (en) | Interactive reality computing experience using multi-layer projections to create an illusion of depth |