TW201740346A - Corresponding method and system in between panorama image and message on Internet platform which is viewed at a viewing angle and operated in a cloud server - Google Patents

Corresponding method and system in between panorama image and message on Internet platform which is viewed at a viewing angle and operated in a cloud server Download PDF

Info

Publication number
TW201740346A
TW201740346A TW105114013A TW105114013A TW201740346A TW 201740346 A TW201740346 A TW 201740346A TW 105114013 A TW105114013 A TW 105114013A TW 105114013 A TW105114013 A TW 105114013A TW 201740346 A TW201740346 A TW 201740346A
Authority
TW
Taiwan
Prior art keywords
message
scene image
image
network platform
angle
Prior art date
Application number
TW105114013A
Other languages
Chinese (zh)
Inventor
Yun-Hong Shen
Yun-Yong Shen
Original Assignee
Yun-Hong Shen
Yun-Yong Shen
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yun-Hong Shen, Yun-Yong Shen filed Critical Yun-Hong Shen
Priority to TW105114013A priority Critical patent/TW201740346A/en
Publication of TW201740346A publication Critical patent/TW201740346A/en

Links

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The present invention provides a corresponding method and a system in between a panorama image and a message on an Internet platform, the at least one panoramic image is stored in a cloud server, the messenger views the panoramic image of the Internet platform on the client device and operates a cursor positioning module to change the viewing angle of the panoramic image, when the messenger wants to comment on the panoramic image at a first time and writes a message, a software calculator in the client device calculates, according to the process of the messenger manipulating the cursor positioning module, and stops at a first time, the rotation information of the panoramic image at a viewing angle in conjunction with a first time are stored in a cloud database; when at least one user clicks on the message, the cloud software calculator will access the rotation information and a first time from the cloud database, and calculates and searches for the panoramic image page of the panoramic image in association with the message, and present it to the user for viewing.

Description

於網路平台上環景影像與留言之間的對應方法及其系統Corresponding method and system between scene image and message on network platform

本發明係有關一種在網路平台上之影像與留言互相對應之技術,特別是指一種於網路平台上環景影像與留言之間的對應方法及其系統。The invention relates to a technology for matching images and messages on a network platform, in particular to a corresponding method and system between a scene image and a message on a network platform.

隨著網路發展及攝影技術的進步,特別是手機也可以拍攝影片並輕易上傳到網路後,愈來愈多人喜歡將生活的點點滴滴以錄影方式記錄下來,並上傳到網路平台與大眾分享,而環景影像更是目前最新穎的記錄模式,其利用至少二台裝設有魚眼鏡頭的攝影裝置或更多台一般攝影機,大範圍擷取周遭影像,將這些攝影機所擷取的影片經過影像處理技術製作出來的成品便是環景影像。With the development of the Internet and the advancement of photographic technology, especially after the mobile phone can also take pictures and upload it to the Internet, more and more people like to record the life of the video and upload it to the Internet platform. Sharing with the public, and the surround view image is the most novel recording mode at present. It uses at least two photographic devices equipped with fisheye lenses or more general cameras to capture the surrounding images on a large scale. The finished product produced by the image processing technology is a panoramic image.

用電腦觀看環景影像時,將拖曳影像畫面上下、左右移動,可360度無死角觀看周圍環境。當環景影像上傳到網路平台後,其他使用者在觀看影片時可能會針對某一時間點、某一角度的畫面想要評論,例如影片時間軸進行到2:30時,將畫面向右旋轉某一角度的位置有人在跳舞,但不知道此角度為何,而留言者想要對這個舞者評論,目前網路平台可針對時間軸留言,留言後,在評論區的留言上會出現2:30的字樣,其他使用者點擊2:30會自動連結到環景影像,並自動跳到時間軸2:30開始播放,但畫面會是未移動旋轉前的原點畫面,而不是留言者想要大家看的那個舞者的位置,使用者也不知道應該旋轉多少角度才行,需要使用者自己去找尋2:30的時間點哪裡有舞者,無法達到留言和環景影像完整呼應的效果。When viewing a panoramic image with a computer, drag the image to the top and bottom and left and right to view the surrounding environment at 360 degrees without a dead angle. When the scene image is uploaded to the web platform, other users may want to comment on the screen at a certain point in time and at a certain angle when watching the movie. For example, when the timeline of the movie is 2:30, the screen is turned to the right. Someone is dancing at a certain angle, but I don’t know why this angle, and the commenter wants to comment on this dancer. Currently, the web platform can leave a message for the timeline. After the message, it will appear on the comment in the comment area. :30 words, other users will automatically connect to the scene image when they click 2:30, and automatically jump to the timeline 2:30 to start playback, but the screen will be the origin screen before the rotation is rotated, instead of the message The position of the dancer that everyone wants to see, the user does not know how many angles should be rotated, the user needs to find the 2:30 time point where there is a dancer, can not achieve the full response of the message and the panoramic image .

因此,本發明即提出一種於網路平台上環景影像與留言之間的對應方法及其系統,有效解決上述該等問題,具體架構及其實施方式將詳述於下:Therefore, the present invention proposes a corresponding method and system for a scene image and a message on a network platform, which effectively solves the above problems, and the specific architecture and implementation manner thereof will be described in detail below:

本發明之主要目的在提供一種於網路平台上環景影像與留言之間的對應方法及其系統,其係讓留言者在針對環景影像的某一個觀看角度的環景影像畫面進行留言評論時,可同時將該環景影像畫面的時間及旋轉資訊儲存在雲端伺服器中,當其他使用者在網路上觀看此環景影像,並點擊留言時,會自動呈現該第一時間、該觀看角度之環景影像畫面,不需使用者自行操作客戶端裝置才能找到該環景影像畫面。The main purpose of the present invention is to provide a corresponding method and system for a scene image and a message on a network platform, which is to enable a commenter to comment on a scene image of a viewing angle of a scene image. The time and rotation information of the scene image can be stored in the cloud server at the same time. When other users view the scene image on the network and click the message, the first time and the viewing angle are automatically presented. The panoramic image screen can be found by the user without operating the client device.

本發明之另一目的在提供一種於網路平台上環景影像與留言之間的對應方法及其系統,其係依據游標定位模組的操作過程搭配查詢一對照表,得到對應環景影像轉動角度之角度值。Another object of the present invention is to provide a corresponding method and system for a scene image and a message on a network platform, which is matched with a comparison table according to the operation process of the cursor positioning module to obtain a rotation angle of the corresponding scene image. The angle value.

本發明之再一目的在提供一種於網路平台上環景影像與留言之間的對應方法及其系統,其中該游標定位模組為滑鼠或觸控板時,依據滑鼠或手指滑動的距離查表得到角度值,若游標定位模組為鍵盤上的方向鍵或螢幕上的一組方向鍵,則是依據點擊方向鍵的次數和停留時間來查表得到角度值。A further object of the present invention is to provide a method and system for matching a scene image and a message on a network platform, wherein the cursor positioning module is a mouse or a touchpad, and the distance is slid according to a mouse or a finger. Look up the table to get the angle value. If the cursor positioning module is the direction key on the keyboard or a set of direction keys on the screen, the angle value is obtained by looking up the table according to the number of times the button is clicked and the dwell time.

為達上述目的,本發明提供一種於網路平台上環景影像與留言之間的對應方法,至少一環景影像係儲存於一雲端伺服器上,且可在一客戶端裝置上透過一網路平台觀看環景影像並進行評論,對應方法包括下列步驟:一留言者在客戶端裝置上操作一游標定位模組,以變換在網路平台上觀看環景影像之觀看角度,當留言者欲對一第一時間的一環景影像畫面進行評論時,撰寫一留言並發送儲存於雲端伺服器中;客戶端裝置中之一軟體計算器依據留言者操作游標定位模組之過程,計算到第一時間為止,該觀看角度之環景影像畫面之旋轉資訊,並將旋轉資訊及第一時間儲存在雲端伺服器中之一雲端資料庫;以及留言顯示於網路平台上環景影像附近之一評論區,當至少一使用者點擊留言時,利用一雲端軟體計算器從雲端資料庫中取得旋轉資訊及第一時間,並計算尋找環景影像中該第一時間、觀看角度之環景影像畫面,並呈現給使用者觀看。To achieve the above objective, the present invention provides a method for mapping a scene image and a message on a network platform. At least one scene image is stored on a cloud server and can be transmitted through a network platform on a client device. Viewing the panoramic image and commenting, the corresponding method includes the following steps: a message user operates a cursor positioning module on the client device to change the viewing angle of viewing the panoramic image on the network platform, when the message person wants to When commenting on a scene image of the first time, a message is written and sent to be stored in the cloud server; one of the software devices in the client device calculates the first time according to the process of the message operator operating the cursor positioning module. The rotation information of the panoramic image of the viewing angle, and the rotation information and the first time are stored in one cloud database in the cloud server; and the message is displayed in a comment area near the surrounding image on the network platform, when At least one user clicks on the message, and uses a cloud software calculator to obtain the rotation information and the first time from the cloud database, and counts Looking for the first time panorama images, viewing angle of the panorama image screen, and presented to the user to watch.

本發明另提供一種於網路平台上環景影像與留言之間的對應系統,包括:至少一環景影像,儲存於一雲端伺服器中;至少一客戶端裝置,與雲端伺服器連線,操作一游標定位模組可變換環景影像之觀看角度,當一留言者欲對一第一時間及該觀看角度的一環景影像畫面進行評論時,留言者在客戶端裝置上撰寫一留言並發送儲存於雲端伺服器中,以供一使用者點擊留言,並在客戶端裝置上呈現第一時間、觀看角度之環景影像畫面;一軟體計算器,設於客戶端裝置中,依據留言者操作游標定位模組之過程,計算到第一時間為止,該觀看角度之環景影像畫面之一旋轉資訊;一雲端資料庫,儲存環景影像、留言、旋轉資訊及第一時間;以及一雲端軟體計算器,設於雲端伺服器中,依據旋轉資訊計算尋找第一時間及該觀看角度的環景影像畫面。The present invention further provides a corresponding system between a scene image and a message on a network platform, comprising: at least one scene image stored in a cloud server; at least one client device connected to the cloud server, and operating one The cursor positioning module can change the viewing angle of the panoramic image. When a commenter wants to comment on a scene image of the first time and the viewing angle, the message writer writes a message on the client device and sends it to the message. In the cloud server, a user clicks on a message and presents a scene image of the first time and the viewing angle on the client device; a software calculator is disposed in the client device, and the cursor is operated according to the message. The process of the module calculates a rotation information of the scene image of the viewing angle until the first time; a cloud database, storing the scene image, the message, the rotation information and the first time; and a cloud software calculator Set in the cloud server, calculate the scene image of the first time and the viewing angle according to the rotation information.

其中,當旋轉資訊為該觀看角度的環景影像畫面之一座標值時,軟體計算器計算座標值之方法係包括下列步驟:留言者每一次操作該游標定位模組後,該軟體計算器會得到一角度變化值;軟體計算器持續將每次操作游標定位模組後之角度變化值累加,得到觀看角度之一角度值;以及利用角度值計算觀看角度之座標值。Wherein, when the rotation information is a coordinate value of the panoramic image of the viewing angle, the method for calculating the coordinate value by the software calculator includes the following steps: after each operation of the cursor positioning module, the software calculator will Obtaining an angle change value; the software calculator continuously accumulates the angle change value after each operation of the cursor positioning module to obtain an angle value of the viewing angle; and calculates the coordinate value of the viewing angle by using the angle value.

其中,當旋轉資訊為該觀看角度的環景影像畫面所旋轉之一角度值時,包括下列步驟:留言者每一次操作該游標定位模組後,該軟體計算器會得到一角度變化值;該軟體計算器持續將每次操作該游標定位模組後之該角度變化值累加,得到該觀看角度之該角度值,以做為該旋轉資訊儲存在該雲端資料庫中;以及該使用者點擊該留言後,該雲端軟體計算器利用該角度值計算該觀看角度之該環景影像畫面對應該環景影像之一球座標中的一座標值。Wherein, when the rotation information is an angle value rotated by the landscape image of the viewing angle, the method includes the following steps: the software calculator obtains an angle change value after each operation of the cursor positioning module; The software calculator continuously accumulates the angle change value after each operation of the cursor positioning module to obtain the angle value of the viewing angle, as the rotation information is stored in the cloud database; and the user clicks the After the message is sent, the cloud software calculator uses the angle value to calculate the scene image of the viewing angle corresponding to a target value in one of the spherical coordinates of the scene image.

或者,留言者每一次操作游標定位模組後,軟體計算器會直接取得該觀看角度之環景影像畫面對應環景影像之球座標中的一座標值,並儲存在雲端伺服器中。Alternatively, after each operation of the cursor positioning module, the software calculator directly obtains a value in the spherical coordinates of the panoramic image corresponding to the viewing angle of the viewing angle image, and stores it in the cloud server.

留言者每一次操作游標定位模組後,會在球座標上產生一變化向量,角度變化值包含變化向量與一水平XY軸之一水平夾角及變化向量與一Z軸之一垂直夾角。Each time the message operator operates the cursor positioning module, a change vector is generated on the ball coordinate. The angle change value includes a horizontal angle between the change vector and a horizontal XY axis and a vertical angle between the change vector and a Z axis.

本發明提供一種於網路平台上環景影像與留言之間的對應方法及其系統,第1圖為本發明於網路平台上環景影像與留言之間的對應系統之一實施例之方塊圖,第2圖為本發明於網路平台上環景影像與留言之間的對應方法中呼應第1圖之流程圖。The invention provides a corresponding method and system for a scene image and a message on a network platform, and FIG. 1 is a block diagram of an embodiment of a corresponding system between a scene image and a message on a network platform according to the present invention. FIG. 2 is a flow chart corresponding to FIG. 1 in the corresponding method between the surrounding image and the message on the network platform.

請參考第1圖,本發明之於網路平台上環景影像與留言之間的對應系統包括一雲端伺服器10及至少一客戶端裝置20,其中雲端伺服器10為一個可播放影片的網路平台,如YouTube,其中儲存至少一環景影像13,此環景影像可為靜態之360度環景照片或動態之360度環景影片;雲端伺服器10包括一雲端播放軟體12、一雲端資料庫14及一雲端軟體計算器16;客戶端裝置20為智慧型手機、平板電腦、桌上型電腦、筆記型電腦或其他智慧型電子裝置,其中包括一裝置端播放軟體22、一游標定位模組24、一軟體計算器26、一評論模組27、一暫存記憶體28及一通訊模組29。客戶端裝置20利用通訊模組29與雲端伺服器10連線,當客戶端裝置20中的裝置端播放軟體22播放一環景影像13時,雲端播放軟體12會控制環景影像13的串流下載到裝置端播放軟體22;游標定位模組24為滑鼠、觸控板、觸控螢幕或一組方向鍵,此方向鍵可為鍵盤上的上、下、左、右鍵,或是在客戶端裝置20的螢幕上顯示的方向鍵圖案,舉例而言,此方向鍵圖案可設在環景影像的左上角;當一個人在客戶端裝置20操作游標定位模組24時,會變換環景影像之觀看角度,以滑鼠為例,按住滑鼠左鍵後以拖曳方式移動滑鼠,可改變環景影像的觀看角度,而以觸控板為例,也要一隻手指按住觸控板,另一隻手指在觸控板上滑動,可改變環景影像的觀看角度。Referring to FIG. 1 , the corresponding system between the surround image and the message on the network platform includes a cloud server 10 and at least one client device 20, wherein the cloud server 10 is a network capable of playing a movie. The platform, such as YouTube, stores at least one surround image 13 , which may be a static 360-degree panoramic photo or a dynamic 360-degree panoramic movie; the cloud server 10 includes a cloud-playing software 12 and a cloud database. 14 and a cloud software calculator 16; the client device 20 is a smart phone, a tablet computer, a desktop computer, a notebook computer or other smart electronic devices, including a device-side playback software 22 and a cursor positioning module. 24. A software calculator 26, a comment module 27, a temporary memory 28, and a communication module 29. The client device 20 is connected to the cloud server 10 by using the communication module 29. When the device-side playing software 22 in the client device 20 plays a ring image 13, the cloud playing software 12 controls the streaming download of the ring image 13 The device 22 is played to the device end; the cursor positioning module 24 is a mouse, a touchpad, a touch screen or a set of direction keys, and the direction keys can be up, down, left, right keys on the keyboard, or on the client side. The direction key pattern displayed on the screen of the device 20, for example, the direction key pattern can be set in the upper left corner of the scene image; when a person operates the cursor positioning module 24 in the client device 20, the scene image is changed. For viewing angles, for example, by holding down the left mouse button and dragging the mouse to change the viewing angle of the surround image, taking the touchpad as an example, also holding the touchpad with one finger. The other finger slides on the touchpad to change the viewing angle of the surround image.

評論模組27供留言者輸入留言,留言者可針對某一第一時間、某一觀看角度的環景影像畫面進行評論,留言會儲存在雲端伺服器10中,而軟體計算器26用以計算操作游標定位模組24後環景影像被旋轉的角度值及座標值;雲端資料庫14係儲存環景影像、留言、座標值、角度值及第一時間。從客戶端裝置20上看,留言會顯示於環景影像附近的一評論區中,而下載的環景影像13的影音串流、輸入留言的第一時間、留言及軟體計算器26所算出之座標值、角度值都會暫存在暫存記憶體28中。The comment module 27 is used for the commenter to input a message, and the commenter can comment on the scene image of a certain time and a certain viewing angle, the message is stored in the cloud server 10, and the software calculator 26 is used for calculation. The angle value and the coordinate value of the image of the ring image after the cursor positioning module 24 are operated; the cloud database 14 stores the image of the ring image, the message, the coordinate value, the angle value and the first time. Viewed from the client device 20, the message is displayed in a comment area near the surround image, and the downloaded video stream 13 video stream, the first time the message is input, the message and the software calculator 26 calculate The coordinate value and the angle value are temporarily stored in the temporary memory 28.

請同時參考第1圖及第2圖,當留言者要針對環景影像中的某一個畫面進行評論留言時,首先如步驟S10,留言者在客戶端裝置20上開啟裝置端播放軟體22,選擇欲觀看的環景影像;步驟S12中,當環景影像開始播放後,留言者可操作游標定位模組24以變換環景影像之觀看角度;步驟S14,當留言者欲對一第一時間、一觀看角度的環景影像畫面進行評論時,在評論模組27上輸入一留言,留言可為文字、語音、圖片或影像;步驟S16,客戶端裝置20計算到第一時間為止,該觀看角度之環景影像畫面之一旋轉資訊,例如該觀看角度之環景影像畫面係將環景影像向右旋轉90度,此即為旋轉資訊,並將旋轉資訊及第一時間儲存在雲端資料庫14中;以及步驟S18所述,當使用者點擊該則留言時,雲端軟體計算器16從該雲端資料庫14中取得旋轉資訊及第一時間,並於步驟S19中,利用旋轉資訊及第一時間去計算尋找環景影像中第一時間、觀看角度之環景影像畫面,並呈現在客戶端裝置20上給使用者觀看。 第3圖為本發明一實施例之詳細流程圖,步驟S20,留言者在客戶端裝置上開啟裝置端播放軟體,選擇欲觀看的360度環景影像;步驟S22中,選好環景影像後,當環景影像開始播放,客戶端裝置的軟體計算器會同時啟動,留言者操作客戶端裝置的游標定位模組以變換環景影像之觀看角度,且軟體計算器會得到每一次操作游標定位模組後的角度變化值,請同時參考第4圖之球座標示意圖,假設環景影像開始播放時間為t0 ,第一時間為tn ,P_t0 =(x, y, z)為時間 t0 時的畫面座標值,P_tn =(X_tn , Y_tn , Z_tn )為第一時間tn 時的畫面座標值,;留言者每一次操作游標定位模組後,會在球座標上產生一變化向量V_tn ,變化向量V_tn 投射在一水平XY平面上、與X軸或Y軸之夾角為ψtn ,變化向量與Z軸之夾角為θtn 。步驟S24,當留言者欲對一第一時間、一觀看角度的環景影像畫面進行評論時,在評論模組上輸入一留言;步驟S26,客戶端裝置中的軟體計算器持續將角度變化值累加到第一時間為止,舉例而言,若留言者操作滑鼠將環景影片以水平方向向右旋轉了1公分、2公分、1公分等三次操作,加總為向右旋轉了4公分,再以垂直方向向上旋轉了1公分、2公分、1公分等三次操作,加總為向上旋轉了4公分,每一次旋轉都會有一個包含水平向量和垂直向量的角度變化值,將三次角度變化值加總即為最後觀看角度的角度值ψtn 和θtn ;接著步驟S27,利用角度值計算得到該觀看角度之該環景影像畫面的一座標值,該座標值P_tn =(X_tn , Y_tn , Z_tn )=(r*sinθtn *cosψtn , r*sinθtn *sinψtn , r*cosθtn ),並將座標值P_tn 及第一時間儲存在雲端資料庫中,因此座標值在此實施例中就是旋轉資訊;步驟S28所述,當使用者點擊該則留言時,雲端軟體計算器從該雲端資料庫中取得座標值及第一時間,並於步驟S29中,利用座標值及第一時間去計算尋找環景影像中第一時間、觀看角度之環景影像畫面,並直接呈現在客戶端裝置上給使用者觀看,如此一來,使用者就不需要自行旋轉畫面到留言者指定的位置。Please refer to FIG. 1 and FIG. 2 at the same time. When the commenter wants to comment on a certain picture in the panoramic image, first, in step S10, the message user opens the device-side playing software 22 on the client device 20, and selects The scene image to be viewed; in step S12, after the scene image starts playing, the message user can operate the cursor positioning module 24 to change the viewing angle of the scene image; in step S14, when the message person wants to be a first time, When commenting on the panoramic image of the viewing angle, a comment is input on the comment module 27, and the message can be text, voice, picture or image; in step S16, the client device 20 calculates the viewing angle until the first time. One of the surrounding image images rotates information, for example, the panoramic image of the viewing angle rotates the panoramic image 90 degrees to the right, which is the rotation information, and stores the rotation information and the first time in the cloud database 14 And in step S18, when the user clicks on the message, the cloud software calculator 16 obtains the rotation information and the first time from the cloud database 14, and in step S19, Rotational information and calculates a first time to look for a first time in the panorama image, the viewing angle of the panorama image screen, and in the view presented to the user client device 20. FIG. 3 is a detailed flowchart of an embodiment of the present invention. In step S20, the message user opens the device to play the software on the client device, and selects a 360-degree panoramic image to be viewed. In step S22, after selecting the ring image, When the scene image starts to play, the software calculator of the client device starts at the same time, the message operator operates the cursor positioning module of the client device to change the viewing angle of the ring image, and the software calculator obtains the cursor positioning mode for each operation. For the angle change value after the group, please refer to the ball coordinate diagram in Figure 4, assuming that the ring scene image starts playing time t 0 , the first time is t n , P_t 0 = (x, y, z) is time t 0 when the screen coordinates, P_t n = (X_t n, Y_t n, Z_t n) is a first coordinate value at time t of the picture n, Each time the message operator operates the cursor positioning module, a change vector V_t n is generated on the ball coordinate, and the variation vector V_t n is projected on a horizontal XY plane, and the angle between the X axis or the Y axis is ψt n , the change vector The angle with the Z axis is θt n . Step S24, when the commenter wants to comment on the scene image of the first time and the viewing angle, input a message on the comment module; in step S26, the software calculator in the client device continues to change the angle. Adding to the first time, for example, if the commenter operates the mouse to rotate the surround movie to the right in the horizontal direction by 1 cm, 2 cm, 1 cm, etc., the total is 4 cm rotated to the right. Then rotate the vertical direction upwards by 1 cm, 2 cm, 1 cm, etc., and add up to 4 cm upwards. Each rotation will have an angle change value including the horizontal vector and the vertical vector, and the angle change value will be three times. The summation is the angle values ψt n and θt n of the last viewing angle; then, in step S27, a target value of the scene image of the viewing angle is calculated by using the angle value, the coordinate value P_t n = (X_t n , Y_t n , Z_t n )=(r*sinθt n *cosψt n , r*sinθt n *sinψt n , r*cosθt n ), and store the coordinate value P_t n and the first time in the cloud database, so the coordinate value is In this embodiment, it is a spin Information; in step S28, when the user clicks on the message, the cloud software calculator obtains the coordinate value and the first time from the cloud database, and in step S29, uses the coordinate value and the first time to calculate the search. The scene image of the first time and the viewing angle in the scene image is directly presented on the client device for viewing by the user, so that the user does not need to rotate the screen to the position specified by the message holder.

一般而言,已知的旋轉資訊為座標值時,可直接在環景影像的球座標上找到該環景影像畫面。In general, when the known rotation information is a coordinate value, the scene image can be directly found on the ball coordinates of the scene image.

第5圖為本發明另一實施例之詳細流程圖,步驟S30,留言者在客戶端裝置上開啟裝置端播放軟體,選擇欲觀看的360度環景影像;步驟S32中,選好環景影像後,當環景影像開始播放,客戶端裝置的軟體計算器會同時啟動,留言者操作客戶端裝置的游標定位模組以變換環景影像之觀看角度,請同時參考第4圖之球座標示意圖,假設環景影像開始播放時間為t0 ,第一時間為tn ,P_t0 =(X_t0 , Y_t0 , Z_t0 )為時間 t0 時的畫面座標值,P_tn =(X_tn , Y_tn , Z_tn )為第一時間tn 時的畫面座標值,留言者每一次操作游標定位模組後,會在球座標上產生一變化向量V_tn ,變化向量V_tn 與一水平XY軸的水平夾角為ψtn ,變化向量V_tn 與一Z軸之垂直夾角為θtn 。步驟S34,當留言者欲對一第一時間、一觀看角度的環景影像畫面進行評論時,在評論模組上輸入一留言;步驟S36,客戶端裝置中的軟體計算器持續將角度變化值累加到第一時間為止,舉例而言,若留言者操作滑鼠將環景影片以水平方向向右旋轉了1公分、2公分、1公分等三次操作,加總為向右旋轉了4公分,再以垂直方向向上旋轉了1公分、2公分、1公分等三次操作,加總為向上旋轉了4公分,每一次旋轉都會有一個包含水平向量和垂直向量的角度變化值,將三次角度變化值加總即為最後觀看角度的角度值ψtn 和θtn ,並將角度值與第一時間儲存到雲端資料庫中,因此角度值是此實施例中的旋轉資訊;接著步驟S38中,當使用者點擊該則留言時,雲端軟體計算器從該雲端資料庫中取得角度值及第一時間,並於步驟S39,利用角度值去計算該觀看角度之該環景影像畫面的座標值,該座標值P_tn =(X_tn , Y_tn , Z_tn )=(r*sinθtn *cosψtn , r*sinθtn *sinψtn , r*cosθtn ),再計算尋找第一時間環景影像中該座標值的觀看角度之環景影像畫面,並呈現在客戶端裝置上給使用者觀看。FIG. 5 is a detailed flowchart of another embodiment of the present invention. In step S30, the message user opens the device-side playing software on the client device, and selects a 360-degree panoramic image to be viewed; in step S32, after selecting the ring-view image When the scene image starts to play, the software calculator of the client device will start at the same time, and the message operator operates the cursor positioning module of the client device to change the viewing angle of the ring image, please refer to the ball coordinate diagram in FIG. views assuming the video playback start time t 0, a first time t n, P_t 0 = (X_t 0, Y_t 0, Z_t 0) to time t 0 of the screen coordinates, P_t n = (X_t n, Y_t n , Z_t n ) is the coordinate value of the picture at the first time t n , and each time the message operator operates the cursor positioning module, a change vector V_t n is generated on the ball coordinate, and the level of the change vector V_t n and a horizontal XY axis is generated. The angle is ψt n , and the vertical angle between the variation vector V_t n and a Z axis is θt n . Step S34, when the commenter wants to comment on the scene image of the first time and the viewing angle, input a message on the comment module; in step S36, the software calculator in the client device continues to change the angle. Adding to the first time, for example, if the commenter operates the mouse to rotate the surround movie to the right in the horizontal direction by 1 cm, 2 cm, 1 cm, etc., the total is 4 cm rotated to the right. Then rotate the vertical direction upwards by 1 cm, 2 cm, 1 cm, etc., and add up to 4 cm upwards. Each rotation will have an angle change value including the horizontal vector and the vertical vector, and the angle change value will be three times. The sum is the angle values ψt n and θt n of the last viewing angle, and stores the angle value and the first time into the cloud database, so the angle value is the rotation information in this embodiment; then, in step S38, when used When the user clicks on the message, the cloud software calculator obtains the angle value and the first time from the cloud database, and in step S39, uses the angle value to calculate the scene angle of the viewing angle. Like the coordinate value of the picture, the coordinate value P_t n =(X_t n , Y_t n , Z_t n )=(r*sinθt n *cosψt n , r*sinθt n *sinψt n , r*cosθt n ), and then calculate the search The panoramic image of the viewing angle of the coordinate value in the scene image is displayed on the client device for viewing by the user.

第6圖為本發明另一實施例之詳細流程圖,步驟S40,留言者在客戶端裝置上開啟裝置端播放軟體,選擇欲觀看的360度環景影像;步驟S42中,選好環景影像後,當環景影像開始播放,客戶端裝置的軟體計算器會同時啟動,留言者操作客戶端裝置的游標定位模組以變換環景影像之觀看角度,但在此步驟中,軟體計算器會直接取得每一次操作游標定位模組時的座標值,不需取得角度變化值後再去加總計算,因為有些環景影像會內建球座標。步驟S44,當留言者欲對一第一時間、一觀看角度的環景影像畫面進行評論時,在評論模組上輸入一留言;步驟S46,客戶端裝置中的軟體計算器得到留言當下的座標值,並將座標值與第一時間儲存到雲端資料庫中,因此座標值是此實施例中的旋轉資訊;接著步驟S48中,當使用者點擊該則留言時,雲端軟體計算器從該雲端資料庫中取得座標值及第一時間,並於步驟S49,利用座標值及第一時間去計算尋找環景影像中第一時間、觀看角度之環景影像畫面,並直接呈現在客戶端裝置上給使用者觀看。FIG. 6 is a detailed flowchart of another embodiment of the present invention. In step S40, the message user opens the device-side playing software on the client device, and selects a 360-degree panoramic image to be viewed; in step S42, after selecting the ring-view image When the scene image starts to play, the software calculator of the client device starts at the same time, and the message operator operates the cursor positioning module of the client device to change the viewing angle of the ring image, but in this step, the software calculator directly Obtain the coordinate value of each operation of the cursor positioning module, and then do not need to obtain the angle change value and then add the total calculation, because some scene images will have built-in ball coordinates. Step S44, when the commenter wants to comment on the scene image of the first time and the viewing angle, input a message on the comment module; in step S46, the software calculator in the client device obtains the current coordinate of the message. Value, and store the coordinate value and the first time in the cloud database, so the coordinate value is the rotation information in this embodiment; then in step S48, when the user clicks on the message, the cloud software calculator from the cloud The coordinate value and the first time are obtained in the database, and in step S49, the coordinate image and the first time are used to calculate the panoramic image of the first time and the viewing angle in the panoramic image, and are directly presented on the client device. Show it to the user.

因此,在本發明中客戶端裝置的軟體計算器依據游標定位模組所取得並儲存在雲端資料庫中的旋轉資訊可包括第一時間該觀看角度之角度值,或是以角度值計算出之座標值,當軟體計算器已算出座標值時,若之後有其他使用者點擊留言,雲端軟體計算器就可直接用座標值找出第一時間該座標值的環景影像畫面;若軟體計算器只算出角度值,則若之後有其他使用者點擊留言,雲端軟體計算器還需用角度值去算出座標值,再利用座標值找出第一時間該座標值的環景影像畫面,亦即座標值可由客戶端裝置的軟體計算器計算,也可由雲端軟體計算器計算。Therefore, in the present invention, the software calculator of the client device according to the cursor positioning module and the rotation information stored in the cloud database may include the angle value of the viewing angle at the first time, or calculated by the angle value. Coordinate value, when the software calculator has calculated the coordinate value, if other users click on the message, the cloud software calculator can directly use the coordinate value to find the scene image of the coordinate value at the first time; if the software calculator Only calculate the angle value, then if other users click on the message, the cloud software calculator needs to calculate the coordinate value by the angle value, and then use the coordinate value to find the scene image of the coordinate value at the first time, that is, the coordinate The value can be calculated by the software calculator of the client device or by the cloud software calculator.

在本發明中,當游標定位模組為滑鼠、觸控板或觸控螢幕時,軟體計算器依據留言者的手指在觸控板、觸控螢幕上移動的距離,或滑鼠之游標移動的距離,查詢一對照表後,可得到距離對應環景影像轉動角度之角度變化值,對照表係預先訓練出操作游標定位模組移動的距離與環景影像轉動角度之角度變化值之關係。舉例而言,觸控螢幕上手指接觸的位置直接對應到畫面的位置座標,經過手指拖移的動作,畫面的位置座標產生相對的位移,手指向右移動代表環景影像逆時針旋轉,當手指在觸控螢幕上移動9公分,相當於環景影像的畫面旋轉90度,或是滑鼠的游標移動3公分相當於環景影像旋轉30度,這些對應關係事先建立對照表,如此一來,計算手指在觸控板、觸控螢幕上移動的距離,或滑鼠之游標移動的距離,便可查表得到角度變化值。In the present invention, when the cursor positioning module is a mouse, a touchpad or a touch screen, the software calculator moves according to the distance of the finger of the message on the touchpad or the touch screen, or the cursor movement of the mouse. The distance, after querying a comparison table, can obtain the angle change value of the rotation angle of the corresponding scene image, and the comparison table pre-trains the relationship between the distance moved by the operation cursor positioning module and the angle change value of the rotation angle of the landscape image. For example, the position of the finger touch on the touch screen directly corresponds to the position coordinate of the screen. After the finger is dragged, the position coordinate of the screen produces a relative displacement, and the movement of the finger to the right represents the rotation of the scene image counterclockwise, when the finger Move 9 cm on the touch screen, which is equivalent to 90 degrees of the scene image, or 3 cm of the mouse cursor is equivalent to 30 degrees of the scene image rotation. These correspondences are pre-established in the comparison table. Calculate the distance the finger moves on the touchpad, touch screen, or the distance the mouse cursor moves, and you can look up the table to get the angle change value.

若游標定位模組為方向鍵時,軟體計算器則是依據留言者點擊方向鍵的次數和停留時間,查詢一對照表後,可得到對應環景影像轉動角度之角度變化值,對照表係預先訓練出點擊方向鍵的次數和停留時間與環景影像轉動角度之角度變化值之關係。舉例而言,先預設方向鍵快速點擊一下可使環景影像的畫面旋轉15度,而若長按方向鍵2秒可使環景影像的畫面旋轉一周,將此關係式建立對照表,則只要得到留言者點擊方向鍵的次數和停留時間,便可查表得到角度變化值。If the cursor positioning module is a direction key, the software calculator is based on the number of times the visitor clicks the direction key and the dwell time. After querying a comparison table, the angle change value of the rotation angle of the corresponding scene image can be obtained, and the comparison table is pre- The relationship between the number of times the click direction key is clicked and the angle of change of the dwell time and the angle of rotation of the landscape image is trained. For example, the preset direction key can be quickly clicked to rotate the picture of the scene image by 15 degrees, and if the direction key is pressed for 2 seconds, the picture of the scene image can be rotated for one week, and the relationship is established. As long as you get the number of times the message is clicked and the dwell time, you can check the table to get the angle change value.

當留言顯示在評論區時,會同時顯示一標示,以供使用者點擊,點擊標示後可顯示留言者留言時第一時間及觀看角度之環景影像畫面,而標示可內含第一時間及座標值、只內含第一時間或只內含座標值,此部分為留言者在撰寫留言時可自行選擇的,且留言者還可選擇同時顯示標示和留言,或只顯示留言,例如留言者可選擇只在評論區呈現留言,而不顯示標示,但當使用者點擊留言時,同樣會導向該觀看角度的環景影像畫面。When the message is displayed in the comment area, a mark is displayed at the same time for the user to click. After clicking the mark, the image of the scene at the first time and the viewing angle when the message is posted can be displayed, and the mark can contain the first time and The coordinate value, only the first time or only the coordinate value, this part is the message holder can choose when writing the message, and the message can also choose to display the logo and message at the same time, or only display the message, such as the message You can choose to present the message only in the comment area without displaying the mark, but when the user clicks on the message, it will also lead to the panoramic image of the viewing angle.

第一時間的判定可有至少兩種方法,其一為在環景影像暫停時,暫停時間就是第一時間,其二為留言者輸入留言時,環景影像繼續播放,第一時間即為留言者開始輸入留言之一起始時間。There may be at least two methods for determining the first time. One is that when the landscape image is paused, the pause time is the first time, and the other is that when the message is input by the message, the scene image continues to play, and the first time is the message. The person begins to enter a start time for the message.

此外,留言者更可在環景影像畫面上標示一物件,而當環景影像畫面呈現給使用者觀看時,物件還可做置中處理或其他醒目提示,如在物件外增加方形、圓形外框等。舉例而言,環景影像畫面為很多人的合照,留言者想要標示出其中的某一個人,則給予該人頭一個物件標示,當使用者點擊留言時,不但裝置端播放軟體呈現旋轉到該角度的環景影像畫面,且會自動將該人頭移到螢幕中央,或是人頭位置不變但用紅色虛框標示出那個人,便可一目了然知道留言者所指何人。In addition, the message person can mark an object on the scene image, and when the scene image is presented to the user, the object can also be centered or other eye-catching prompts, such as adding a square or a circle outside the object. Frame and so on. For example, the scene image is a group photo of a lot of people. If the message person wants to mark one of the people, the person is given the first object label. When the user clicks on the message, not only the device-side playback software is rotated to the The angle of the image of the scene, and will automatically move the head to the center of the screen, or the position of the head is unchanged but the person is marked with a red frame, you can know at a glance who the message is.

因此,本發明舉例而言,當留言者在線上(雲端伺服器)觀看一部駕駛飛機的環景影像,畫面一直是朝著機長的正前方,假設留言者將環景影像旋轉到可看到右側窗戶,並在時間1:06的時候留言「窗戶外有一隻鳥」。其他使用者在觀看同一部環景影像時,看到了評論區的這一則留言,只要點擊留言或旁邊的標示,就可以將環景影像的時間軸直接跳至1:06,並且畫面不再是朝向機長前方,而是留言者在1:06時的觀看角度,亦即右側窗戶,讓使用者不需要自行將畫面旋轉到右側窗戶;此外,若留言者有標示「鳥」這個物件,則使用者不但可直接看到右側窗戶的環景影像畫面,且還能看到被方框標出的「鳥」,或是鳥被移到畫面的正中央等等,可更清楚地瞭解留言者在此環景影像畫面中要表達的是什麼意思。Therefore, in the present invention, for example, when a commenter is watching a panoramic image of a flying aircraft on the line (cloud server), the picture is always facing the front of the captain, and it is assumed that the message person rotates the ring image to be visible. On the right side of the window, and at 1:06, there is a message "There is a bird outside the window." When other users watch the same scene image, they can see this message in the comment area. Just click the message or the icon next to it, you can jump the timeline of the scene image directly to 1:06, and the picture is no longer Facing the front of the captain, it is the viewing angle of the message at 1:06, that is, the right window, so that the user does not need to rotate the screen to the right window by himself; in addition, if the message person has the object labeled "bird", then use Not only can you directly see the panoramic image of the right window, but you can also see the "bird" marked by the box, or the bird is moved to the center of the picture, etc., to get a clearer understanding of the message. What do you mean by this scene image?

綜上所述,本發明提供一種於網路平台上環景影像與留言之間的對應方法及其系統,其應用在客戶端裝置為電腦、平板電腦、智慧型手機等由使用者操作旋轉螢幕畫面之裝置上,操作游標定位模組可得到環景影像的角度變化值,再以此計算出旋轉後環景影像畫面的座標值,或是操作當下就直接取得座標值,且這些旋轉資訊儲存在雲端伺服器,因此,本發明將留言與當下的環景影像畫面的時間點及觀看角度產生連結,當其他使用者點擊該留言時,環景影像就會自動跳到該時間點,且還會依據該座標值自動將畫面旋轉到該觀看角度,讓使用者不用再操作滑鼠游標、點擊觸控等游標定位模組,就可直接看到留言者所指的環景影像畫面。In summary, the present invention provides a method and system for matching a scene image and a message on a network platform, and the application is performed on a client device, such as a computer, a tablet computer, a smart phone, etc., by a user operating a rotating screen screen. On the device, the cursor positioning module can obtain the angle change value of the ring image, and then calculate the coordinate value of the rotated landscape image, or directly obtain the coordinate value when the operation is performed, and the rotation information is stored in The cloud server, therefore, the present invention links the message with the time point and the viewing angle of the current scene image, and when other users click the message, the scene image will automatically jump to the time point, and According to the coordinate value, the screen is automatically rotated to the viewing angle, so that the user can directly see the ring image image pointed by the commenter without using the cursor cursor and clicking the cursor positioning module.

唯以上所述者,僅為本發明之較佳實施例而已,並非用來限定本發明實施之範圍。故即凡依本發明申請範圍所述之特徵及精神所為之均等變化或修飾,均應包括於本發明之申請專利範圍內。The above is only the preferred embodiment of the present invention and is not intended to limit the scope of the present invention. Therefore, any changes or modifications of the features and spirits of the present invention should be included in the scope of the present invention.

10‧‧‧雲端伺服器
12‧‧‧雲端播放軟體
13‧‧‧環景影像
14‧‧‧雲端資料庫
16‧‧‧雲端軟體計算器
20‧‧‧客戶端裝置
22‧‧‧裝置端播放軟體
24‧‧‧游標定位模組
26‧‧‧軟體計算器
27‧‧‧評論模組
28‧‧‧暫存記憶體
29‧‧‧通訊模組
10‧‧‧Cloud Server
12‧‧‧Cloud Play Software
13‧‧‧Outdoor image
14‧‧‧Cloud database
16‧‧‧Cloud Software Calculator
20‧‧‧Client device
22‧‧‧Device-side playback software
24‧‧‧ cursor positioning module
26‧‧‧Software Calculator
27‧‧‧Comment Module
28‧‧‧Scratch memory
29‧‧‧Communication Module

第1圖為本發明於網路平台上環景影像與留言之間的對應系統中一實施例之方塊圖。 第2圖為本發明於網路平台上環景影像與留言之間的對應方法中一實施例之流程圖。 第3圖為本發明於網路平台上環景影像與留言之間的對應方法中一實施例之詳細流程圖。 第4圖為第一時間tn環景影像畫面的座標在環景影像球座標上之示意圖。 第5圖為本發明於網路平台上環景影像與留言之間的對應方法中另一實施例之詳細流程圖。 第6圖為本發明於網路平台上環景影像與留言之間的對應方法中再一實施例之詳細流程圖。FIG. 1 is a block diagram of an embodiment of a corresponding system between a scene image and a message on a network platform according to the present invention. FIG. 2 is a flow chart of an embodiment of a method for mapping a scene image and a message on a network platform according to the present invention. FIG. 3 is a detailed flowchart of an embodiment of a method for mapping a scene image and a message on a network platform according to the present invention. Figure 4 is a schematic diagram of the coordinates of the ring image image at the first time tn on the coordinates of the surrounding image sphere. FIG. 5 is a detailed flowchart of another embodiment of a method for mapping a scene image and a message on a network platform according to the present invention. FIG. 6 is a detailed flowchart of still another embodiment of a method for mapping a scene image and a message on a network platform according to the present invention.

Claims (37)

一種於網路平台上環景影像與留言之間的對應方法,至少一環景影像係儲存於一雲端伺服器上,且可在一客戶端裝置上透過一網路平台觀看該環景影像並進行評論,該對應方法包括下列步驟: 一留言者在該客戶端裝置上操作一游標定位模組,以變換在該網路平台上觀看該環景影像之觀看角度,當該留言者欲對一第一時間的一環景影像畫面進行評論時,撰寫一留言並發送儲存於該雲端伺服器中; 該客戶端裝置中之一軟體計算器依據該留言者操作該游標定位模組之過程,計算到該第一時間為止,該觀看角度之該環景影像畫面之一旋轉資訊,並將該旋轉資訊及該第一時間儲存在該雲端伺服器中之一雲端資料庫;以及 該留言顯示於該網路平台上該環景影像附近之一評論區,當至少一使用者點擊該留言時,利用一雲端軟體計算器從該雲端資料庫中取得該旋轉資訊及該第一時間,並利用該旋轉資訊計算尋找該環景影像中該第一時間、該觀看角度之該環景影像畫面,並呈現給該使用者觀看。A method for matching a scene image and a message on a network platform, wherein at least one scene image is stored on a cloud server, and the scene image can be viewed and commented on a client device through a network platform. The corresponding method includes the following steps: a commenter operates a cursor positioning module on the client device to change a viewing angle of viewing the panoramic image on the network platform, when the messageer wants to When commenting on a scene image of time, a message is written and sent to the cloud server; one of the software devices of the client device calculates the number according to the process of the message operator operating the cursor positioning module. At one time, one of the scene images of the viewing angle rotates information, and the rotation information and the first time are stored in one cloud database in the cloud server; and the message is displayed on the network platform. In a comment area near the image of the scene, when at least one user clicks on the message, the cloud software calculator is used to obtain the rotation from the cloud database. And the first time information, and the information is calculated by using the rotation of the ring looking for the first time to view the image, the viewing angle of the panorama image of the picture, and presented to the user to view. 如請求項1所述之於網路平台上環景影像與留言之間的對應方法,其中該游標定位模組為一滑鼠、一觸控板、一觸控螢幕或一組方向鍵,該組方向鍵為該客戶端裝置的一螢幕上的一方向鍵圖形,或該客戶端裝置的一鍵盤上的方向鍵按鍵。The method for responding to the image between the scene image and the message on the network platform, wherein the cursor positioning module is a mouse, a touch panel, a touch screen or a set of direction keys, the group The direction key is a direction key graphic on a screen of the client device, or a direction key button on a keyboard of the client device. 如請求項1所述之於網路平台上環景影像與留言之間的對應方法,其中該留言者每一次操作該游標定位模組後,該軟體計算器會得到一角度變化值;該軟體計算器持續將每次操作該游標定位模組後之該角度變化值累加,得到該觀看角度之一角度值;以及利用該角度值計算該觀看角度之該環景影像畫面對應該環景影像之一球座標的一座標值,並做為該旋轉資訊儲存在該雲端資料庫中。The method for responding to the image between the scene image and the message on the network platform as claimed in claim 1, wherein the software calculator obtains an angle change value after the message operator operates the cursor positioning module; the software calculation Continuously accumulating the angle change value after each operation of the cursor positioning module to obtain an angle value of the viewing angle; and calculating the panoramic image corresponding to the viewing angle by using the angle value A value of the ball coordinates is stored in the cloud database as the rotation information. 如請求項1所述之於網路平台上環景影像與留言之間的對應方法,其中該留言者每一次操作該游標定位模組後,該軟體計算器會得到一角度變化值;該軟體計算器持續將每次操作該游標定位模組後之該角度變化值累加,得到該觀看角度之一角度值,並做為該旋轉資訊儲存在該雲端資料庫中;以及該使用者點擊該留言後,該雲端軟體計算器利用該角度值計算該觀看角度之該環景影像畫面對應該環景影像之一球座標中的一座標值。The method for responding to the image between the scene image and the message on the network platform as claimed in claim 1, wherein the software calculator obtains an angle change value after the message operator operates the cursor positioning module; the software calculation Continuously accumulating the angle change value after each operation of the cursor positioning module to obtain an angle value of the viewing angle, and storing the rotation information in the cloud database; and the user clicking the message The cloud software calculator uses the angle value to calculate the scene image of the viewing angle corresponding to a target value in one of the spherical coordinates of the scene image. 如請求項1所述之於網路平台上環景影像與留言之間的對應方法,其中該留言者每一次操作該游標定位模組後,該軟體計算器直接取得該觀看角度之該環景影像畫面對應該環景影像之一球座標中的一座標值,並做為該旋轉資訊儲存在該雲端資料庫中。The method for responding to the scene image and the message on the network platform as claimed in claim 1, wherein the software calculator directly obtains the scene image of the viewing angle after the message operator operates the cursor positioning module. The picture corresponds to a value in one of the ball coordinates of the scene image, and is stored in the cloud database as the rotation information. 如請求項3或4所述之於網路平台上環景影像與留言之間的對應方法,其中該游標定位模組為該滑鼠、該觸控板或該觸控螢幕時,該軟體計算器依據該留言者的手指在該觸控板或該觸控螢幕上移動的距離,或該滑鼠之游標移動的距離,查詢一對照表後,可得到該距離對應該環景影像轉動角度之該角度變化值。The method for responding to the scene image and the message on the network platform, wherein the cursor positioning module is the mouse, the touch panel or the touch screen, the software calculator According to the distance moved by the finger of the message on the touchpad or the touch screen, or the distance moved by the cursor of the mouse, after querying a comparison table, the distance corresponding to the rotation angle of the scene image can be obtained. Angle change value. 如請求項3或4所述之於網路平台上環景影像與留言之間的對應方法,其中該游標定位模組為該組方向鍵時,該軟體計算器依據該留言者點擊該組方向鍵的次數和停留時間,查詢一對照表後,可得到對應該環景影像轉動角度之該角度變化值。The method for responding to the scene image and the message on the network platform as described in claim 3 or 4, wherein when the cursor positioning module is the group of direction keys, the software calculator clicks the group direction button according to the message user The number of times and the dwell time, after querying a comparison table, the angle change value corresponding to the rotation angle of the ring image can be obtained. 如請求項3所述之於網路平台上環景影像與留言之間的對應方法,其中該留言者每一次操作該游標定位模組後,會在該球座標上產生一變化向量,該角度變化值包含該變化向量投射在一水平XY平面與一X軸或一Y軸之一夾角及該變化向量與一Z軸之一夾角。The method for responding to the scene image and the message on the network platform, as described in claim 3, wherein each time the message operator operates the cursor positioning module, a change vector is generated on the ball coordinate, and the angle changes. The value includes the angle at which the variation vector is projected at an angle between one of the horizontal XY planes and one of the X-axis or the Y-axis and the variation vector is at an angle to one of the Z-axis. 如請求項6所述之於網路平台上環景影像與留言之間的對應方法,其中該對照表係預先訓練出操作該游標定位模組移動的該距離與該環景影像轉動角度之該角度變化值之關係。The method for responding to the scene image and the message on the network platform, as described in claim 6, wherein the comparison table pre-trains the angle at which the cursor positioning module moves and the angle of rotation of the scene image The relationship between the values of change. 如請求項7所述之於網路平台上環景影像與留言之間的對應方法,其中該對照表係預先訓練出點擊該組方向鍵的次數和停留時間與該環景影像轉動角度之該角度變化值之關係。The method for responding to the scene image and the message on the network platform as claimed in claim 7, wherein the comparison table pre-trains the number of times the click of the group of direction keys and the dwell time and the angle of rotation of the ring image are The relationship between the values of change. 如請求項1所述之於網路平台上環景影像與留言之間的對應方法,其中該留言顯示在該評論區時,可同時顯示一標示以供該使用者點擊,點擊該標示或點擊該留言後,可顯示該第一時間時該觀看角度之該環景影像畫面。The method for responding to the scene image and the message on the network platform as claimed in claim 1, wherein when the message is displayed in the comment area, a mark may be simultaneously displayed for the user to click, click the mark or click the After the message is posted, the scene image of the viewing angle at the first time can be displayed. 如請求項11所述之於網路平台上環景影像與留言之間的對應方法,其中該標示可內含該第一時間及該旋轉資訊、只內含該第一時間或只內含該旋轉資訊。The corresponding method between the image of the scene and the message on the network platform, as described in claim 11, wherein the identifier may include the first time and the rotation information, only the first time or only the rotation News. 如請求項11或12所述之於網路平台上環景影像與留言之間的對應方法,其中該留言者撰寫該留言時,可選擇同時顯示該標示和該留言,或只顯示該留言。The method for responding to the scene image and the message on the network platform as claimed in claim 11 or 12, wherein when the message is written by the message, the message and the message may be displayed at the same time, or only the message may be displayed. 如請求項1所述之於網路平台上環景影像與留言之間的對應方法,其中該留言儲存於該雲端資料庫中,或是儲存於與該雲端資料庫對應連結之另一資料庫中。The method for responding to the image between the scene image and the message on the network platform, wherein the message is stored in the cloud database or stored in another database corresponding to the cloud database. . 如請求項1所述之於網路平台上環景影像與留言之間的對應方法,其中該雲端伺服器上設有一雲端播放軟體,以將該環景影像的串流下載到該客戶端裝置中播放。The method for responding to the scene image and the message on the network platform, wherein the cloud server is provided with a cloud playing software to download the stream of the ring image to the client device. Play. 如請求項1所述之於網路平台上環景影像與留言之間的對應方法,其中該客戶端裝置上係設有一裝置端播放軟體,以開啟該雲端伺服器上之該環景影像。The method for responding to the scene image and the message on the network platform, wherein the client device is provided with a device-side playback software to enable the scene image on the cloud server. 如請求項1所述之於網路平台上環景影像與留言之間的對應方法,其中該留言係在該環景影像暫停時輸入,該第一時間即為該環景影像暫停的時間。The method for responding to the scene image and the message on the network platform, wherein the message is input when the scene image is paused, and the first time is the time when the scene image is paused. 如請求項1所述之於網路平台上環景影像與留言之間的對應方法,其中該留言者輸入該留言時,該環景影像繼續播放,該第一時間即為該留言者開始輸入該留言之一起始時間。The corresponding method between the scene image and the message on the network platform, as described in claim 1, wherein when the message input is the message, the scene image continues to play, and the first time is that the message user starts to input the One of the start times of the message. 如請求項1所述之於網路平台上環景影像與留言之間的對應方法,其中該客戶端裝置為智慧型手機、平板電腦、桌上型電腦、筆記型電腦或其他智慧型電子裝置。The method of claim 1, wherein the client device is a smart phone, a tablet computer, a desktop computer, a notebook computer, or other smart electronic device. 如請求項1所述之於網路平台上環景影像與留言之間的對應方法,其中該留言者更可在該環景影像畫面上標示一物件,而當該環景影像畫面呈現給該使用者觀看時,該環景影像畫面在該客戶端裝置上所呈現的範圍會有位移,使該物件置中。The method for responding to the image between the scene image and the message on the network platform, wherein the message user can mark an object on the scene image, and the scene image is presented to the user. When viewed, the range of the scene image displayed on the client device is displaced to center the object. 如請求項1所述之於網路平台上環景影像與留言之間的對應方法,其中該留言者更可在該環景影像畫面上標示一物件,而當該環景影像畫面呈現給該使用者觀看時,該物件係予以醒目提示。The method for responding to the image between the scene image and the message on the network platform, wherein the message user can mark an object on the scene image, and the scene image is presented to the user. The object is highlighted when viewed. 如請求項19所述之於網路平台上環景影像與留言之間的對應方法,其中該醒目提示係在該物件外增加一外框。The corresponding method between the scene image and the message on the network platform as claimed in claim 19, wherein the eye-catching prompt adds a frame outside the object. 一種於網路平台上環景影像與留言之間的對應系統,包括: 至少一環景影像,儲存於一雲端伺服器中; 至少一客戶端裝置,與該雲端伺服器連線,操作一游標定位模組可變換該環景影像之觀看角度,當一留言者欲對一第一時間及該觀看角度的一環景影像畫面進行評論時,該留言者在該客戶端裝置上撰寫一留言並發送儲存於該雲端伺服器中,以供一使用者點擊該留言,並在該客戶端裝置上呈現該第一時間、該觀看角度之該環景影像畫面; 一軟體計算器,設於該客戶端裝置中,依據該留言者操作該游標定位模組之過程,計算到該第一時間為止,該觀看角度之該環景影像畫面之一旋轉資訊; 一雲端資料庫,設於該雲端伺服器中,儲存該環景影像、該留言、該旋轉資訊及該第一時間;以及 一雲端軟體計算器,設於該雲端伺服器中,依據該旋轉資訊計算尋找該第一時間及該觀看角度的該環景影像畫面。A corresponding system between a scene image and a message on a network platform, comprising: at least one scene image stored in a cloud server; at least one client device connected to the cloud server, operating a cursor positioning module The group can change the viewing angle of the panoramic image. When a commenter wants to comment on a scene image of the first time and the viewing angle, the messageer composes a message on the client device and sends it to the message. In the cloud server, a user clicks on the message, and presents the scene image of the first time and the viewing angle on the client device; a software calculator is disposed in the client device. According to the process of the message locator operating the cursor positioning module, calculating one rotation information of the scene image of the viewing angle until the first time; a cloud database, located in the cloud server, storing The scene image, the message, the rotation information, and the first time; and a cloud software calculator, disposed in the cloud server, and calculating according to the rotation information Look for the first time and the viewing angle of the panorama image screen. 如請求項23所述之於網路平台上環景影像與留言之間的對應系統,其中該游標定位模組為一滑鼠、一觸控板、一觸控螢幕或一組方向鍵,該組方向鍵為該客戶端裝置的一螢幕上的一方向鍵圖形,或該客戶端裝置的一鍵盤上的方向鍵按鍵。The corresponding system between the scene image and the message on the network platform, wherein the cursor positioning module is a mouse, a touch panel, a touch screen or a set of direction keys, the group The direction key is a direction key graphic on a screen of the client device, or a direction key button on a keyboard of the client device. 如請求項24所述之於網路平台上環景影像與留言之間的對應系統,其中該游標定位模組為該滑鼠、該觸控板或該觸控螢幕時,該軟體計算器依據該留言者的手指在該觸控板或該觸控螢幕上移動的距離,或該滑鼠之游標移動的距離,查詢一對照表後,可得到該距離對應該環景影像轉動角度之一角度變化值。The corresponding system between the scene image and the message on the network platform, wherein the cursor positioning module is the mouse, the touch panel or the touch screen, the software calculator is The distance that the finger of the messageer moves on the touchpad or the touch screen, or the distance that the cursor of the mouse moves, after querying a comparison table, the distance change corresponding to the rotation angle of the image of the scene can be obtained. value. 如請求項24所述之於網路平台上環景影像與留言之間的對應系統,其中該游標定位模組為該組方向鍵時,該軟體計算器依據該留言者點擊該組方向鍵的次數和停留時間,查詢一對照表後,可得到對應該環景影像轉動角度之一角度變化值。The corresponding system between the scene image and the message on the network platform, wherein the cursor positioning module is the group of direction keys, the software calculator is based on the number of times the message user clicks the group direction key. And the dwell time, after querying a comparison table, an angle change value corresponding to the rotation angle of the surrounding image can be obtained. 如請求項23所述之於網路平台上環景影像與留言之間的對應系統,其中該留言顯示於該環景影像附近的一評論區,同時並在該留言上顯示一標示以供該使用者點擊,點擊該標示後可顯示該第一時間、該觀看角度之該環景影像畫面。The corresponding system between the scene image and the message on the network platform, as described in claim 23, wherein the message is displayed in a comment area near the scene image, and an indication is displayed on the message for the use. Clicking on the icon displays the scene image of the scene at the first time and the viewing angle. 如請求項27所述之於網路平台上環景影像與留言之間的對應系統,其中該標示可內含該第一時間及該旋轉資訊、只內含該第一時間或只內含該旋轉資訊。The corresponding system between the scene image and the message on the network platform, as claimed in claim 27, wherein the identifier may include the first time and the rotation information, only the first time or only the rotation News. 如請求項27或28所述之於網路平台上環景影像與留言之間的對應系統,其中該留言者撰寫該留言時,可選擇同時顯示該標示和該留言,或只顯示該留言。The corresponding system between the scene image and the message on the network platform as claimed in claim 27 or 28, wherein when the message is written by the message, the message and the message may be displayed at the same time, or only the message may be displayed. 如請求項23所述之於網路平台上環景影像與留言之間的對應系統,其中該留言儲存於該雲端資料庫中,或是儲存於與該雲端資料庫對應連結之另一資料庫中。The corresponding system between the scene image and the message on the network platform, as described in claim 23, wherein the message is stored in the cloud database or stored in another database corresponding to the cloud database. . 如請求項23所述之於網路平台上環景影像與留言之間的對應系統,其中該雲端伺服器上設有一雲端播放軟體,以將該環景影像的串流下載到該客戶端裝置中播放。The corresponding system between the scene image and the message on the network platform, as described in claim 23, wherein the cloud server is provided with a cloud playing software to download the stream of the ring image to the client device. Play. 如請求項23所述之於網路平台上環景影像與留言之間的對應系統,其中該客戶端裝置上係設有一裝置端播放軟體,以開啟該雲端伺服器上之該環景影像。The corresponding system between the scene image and the message on the network platform, as described in claim 23, wherein the client device is provided with a device-side playback software to enable the scene image on the cloud server. 如請求項23所述之於網路平台上環景影像與留言之間的對應系統,其中該客戶端裝置為智慧型手機、平板電腦、桌上型電腦、筆記型電腦或其他智慧型電子裝置。The corresponding system between the scene image and the message on the network platform, as described in claim 23, wherein the client device is a smart phone, a tablet computer, a desktop computer, a notebook computer or other smart electronic device. 如請求項23所述之於網路平台上環景影像與留言之間的對應系統,其中該留言為文字、語音、圖片或影像。The corresponding system between the scene image and the message on the network platform, as described in claim 23, wherein the message is a text, a voice, a picture or an image. 如請求項23所述之於網路平台上環景影像與留言之間的對應系統,其中該環景影像畫面上可包括該留言者所標示之一物件,該留言者對該物件進行評論,當該環景影像畫面呈現給該使用者觀看時,該物件係置中處理或醒目提示。The corresponding system between the scene image and the message on the network platform, as described in claim 23, wherein the scene image may include an object marked by the message, and the commenter comments on the object. When the scene image is presented to the user for viewing, the object is processed or highlighted. 如請求項23所述之於網路平台上環景影像與留言之間的對應系統,其中該環景影像為靜態之360度環景照片或動態之360度環景影片。The corresponding system between the scene image and the message on the network platform as claimed in claim 23, wherein the scene image is a static 360 degree scene photo or a dynamic 360 degree scene film. 如請求項23所述之於網路平台上環景影像與留言之間的對應系統,其中該旋轉資訊為該環景影像所旋轉之一角度值,或該環景影像畫面對應該環景影像之一球座標中的一座標值。The corresponding system between the scene image and the message on the network platform, wherein the rotation information is an angle value of the rotation of the scene image, or the scene image corresponding to the scene image A value in a ball coordinate.
TW105114013A 2016-05-05 2016-05-05 Corresponding method and system in between panorama image and message on Internet platform which is viewed at a viewing angle and operated in a cloud server TW201740346A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW105114013A TW201740346A (en) 2016-05-05 2016-05-05 Corresponding method and system in between panorama image and message on Internet platform which is viewed at a viewing angle and operated in a cloud server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW105114013A TW201740346A (en) 2016-05-05 2016-05-05 Corresponding method and system in between panorama image and message on Internet platform which is viewed at a viewing angle and operated in a cloud server

Publications (1)

Publication Number Publication Date
TW201740346A true TW201740346A (en) 2017-11-16

Family

ID=61022837

Family Applications (1)

Application Number Title Priority Date Filing Date
TW105114013A TW201740346A (en) 2016-05-05 2016-05-05 Corresponding method and system in between panorama image and message on Internet platform which is viewed at a viewing angle and operated in a cloud server

Country Status (1)

Country Link
TW (1) TW201740346A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110826385A (en) * 2018-06-07 2020-02-21 皇家飞利浦有限公司 Rehabilitation device and method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110826385A (en) * 2018-06-07 2020-02-21 皇家飞利浦有限公司 Rehabilitation device and method

Similar Documents

Publication Publication Date Title
US11380362B2 (en) Spherical video editing
US12079942B2 (en) Augmented and virtual reality
CN109313812B (en) Shared experience with contextual enhancements
US9699375B2 (en) Method and apparatus for determining camera location information and/or camera pose information according to a global coordinate system
JP6493471B2 (en) Video playback method, computer processing system, and video playback program
US20130250048A1 (en) Method of capture, display and sharing of orientation-based image sets
US20210289147A1 (en) Images with virtual reality backgrounds
US20230043683A1 (en) Determining a change in position of displayed digital content in subsequent frames via graphics processing circuitry
US20220350650A1 (en) Integrating overlaid digital content into displayed data via processing circuitry using a computing memory and an operating system memory
TW201740346A (en) Corresponding method and system in between panorama image and message on Internet platform which is viewed at a viewing angle and operated in a cloud server
US20230308603A1 (en) Dynamic virtual background for video conference
TWM589834U (en) Augmented Reality Integration System
TW201738649A (en) Corresponding method between panorama video and message and system thereof having cloud software calculator to obtain an angle value and a first time point from the cloud database, and calculate and search a picture of panorama video corresponding to the message
TWI762830B (en) System for displaying hint in augmented reality to play continuing film and method thereof
US20230326094A1 (en) Integrating overlaid content into displayed data via graphics processing circuitry and processing circuitry using a computing memory and an operating system memory
US20230334792A1 (en) Interactive reality computing experience using optical lenticular multi-perspective simulation
US20240185546A1 (en) Interactive reality computing experience using multi-layer projections to create an illusion of depth
US20230334790A1 (en) Interactive reality computing experience using optical lenticular multi-perspective simulation
US20230334791A1 (en) Interactive reality computing experience using multi-layer projections to create an illusion of depth
WO2024039885A1 (en) Interactive reality computing experience using optical lenticular multi-perspective simulation
WO2023215637A1 (en) Interactive reality computing experience using optical lenticular multi-perspective simulation
WO2024039887A1 (en) Interactive reality computing experience using optical lenticular multi-perspective simulation
WO2023205145A1 (en) Interactive reality computing experience using multi-layer projections to create an illusion of depth