TWI762257B - Method for recommending viewing directions in virtyal reality video and computer readable medium thereof - Google Patents

Method for recommending viewing directions in virtyal reality video and computer readable medium thereof Download PDF

Info

Publication number
TWI762257B
TWI762257B TW110111322A TW110111322A TWI762257B TW I762257 B TWI762257 B TW I762257B TW 110111322 A TW110111322 A TW 110111322A TW 110111322 A TW110111322 A TW 110111322A TW I762257 B TWI762257 B TW I762257B
Authority
TW
Taiwan
Prior art keywords
virtual reality
video
angle
recommended
playback device
Prior art date
Application number
TW110111322A
Other languages
Chinese (zh)
Other versions
TW202239199A (en
Inventor
王鐘逸
高曉雯
Original Assignee
中華電信股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中華電信股份有限公司 filed Critical 中華電信股份有限公司
Priority to TW110111322A priority Critical patent/TWI762257B/en
Application granted granted Critical
Publication of TWI762257B publication Critical patent/TWI762257B/en
Publication of TW202239199A publication Critical patent/TW202239199A/en

Links

Images

Abstract

The present invention is a method for recommending the viewing directions in a virtual reality video. During the process of playing a video information on a virtual reality playback device and displaying the virtual reality video by a head-mounted display. A recommended angle from the video information and a viewing angle from the head-mounted display are obtained by the virtual reality playback device. A recommended direction is calculated after comparing the recommended angle and the viewing angle, and the recommended direction is displayed in the virtual reality video. Therefore, the present invention can prompt the direction of the recommended screen when the user watches the virtual reality video, thereby quickly and precisely providing the user with a better viewing effect. A computer-readable medium for implementing a method for recommending viewing directions in a virtual reality movie is further provided in the present invention.

Description

於虛擬實境影片中推薦觀看方向之方法及電腦可讀媒介 Method and computer readable medium for recommending viewing direction in virtual reality video

本發明係一種推薦影片觀看視角之技術,尤指一種於虛擬實境影片中推薦觀看方向之方法。 The present invention relates to a technology for recommending viewing angles of videos, especially a method for recommending viewing directions in virtual reality videos.

以往影片僅能利用電視、電腦或手機之液晶顯示螢幕進行播放,僅能觀看到平面之二維(Two-Dimensional,2D)影片,然隨著科技進步,現今虛擬實境(Virtual Reality,VR)設備之發展已相當成熟,使用者只需要戴上VR眼鏡或相關設備,即可播放VR影片,享受VR所帶來的擬真觀影感受。 In the past, videos could only be played on the LCD screen of a TV, computer or mobile phone, and only two-dimensional (Two-Dimensional, 2D) videos could be viewed. However, with the advancement of technology, virtual reality (Virtual Reality, VR) The development of equipment is quite mature, users only need to wear VR glasses or related equipment to play VR videos and enjoy the immersive viewing experience brought by VR.

VR影片係透過VR設備播放呈等距柱狀圖格式之VR影片,使用者透過VR眼鏡觀看到的影像,即為360°全景圍繞之影片,藉以模擬身歷其境的體驗。據此,VR影片之導演亦需依照等距柱狀圖格式拍攝VR影片,且VR影片中,於不同之播影時間點,通常會有特定區域是導演欲推薦給使用者觀看,惟使用者於穿戴VR眼鏡後,往往沈浸於VR影片之虛擬環境中,或失去方向而無法即時發現該特定區域,因而遺漏掉該特定區域所呈現之精采畫面,導致使用者無法感受該段虛擬影片的重要之處。 VR video is a VR video in the isometric histogram format played through VR equipment. The video users watch through VR glasses is a video surrounded by a 360° panorama to simulate an immersive experience. According to this, the director of the VR movie also needs to shoot the VR movie according to the isometric histogram format, and in the VR movie, at different time points of the movie, there is usually a specific area that the director wants to recommend for the user to watch, but the user can only watch it. After wearing VR glasses, people are often immersed in the virtual environment of the VR video, or lose their direction and cannot find the specific area immediately, thus missing the wonderful picture presented by the specific area, so that the user cannot feel the importance of the virtual video. place.

因此,若能找出一種推薦影片觀看視角之技術,能在使用者透過VR設備觀賞影片時,提供觀看影片之推薦角度,讓使用者於觀影過程中立即獲得提示,藉以轉動或移動到該推薦角度所對應之推薦畫面,以避免使用者在觀看時遺漏精彩畫面,此將成為本技術領域人員努力追求解決方案之目標。 Therefore, if a technology for recommending viewing angles of videos can be found, it can provide recommended viewing angles for videos when users watch videos through VR devices, so that users can get prompts immediately during the viewing process, so as to rotate or move to the video viewing angle. The recommended images corresponding to the recommended angles are used to prevent users from missing wonderful images when viewing, which will be the goal of those skilled in the art to strive for solutions.

有鑑於上述問題,本發明提出一種於虛擬實境影片中推薦觀看方向之方法,係包括:令虛擬實境播放設備接收影片資訊,以於與該虛擬實境播放設備訊號連結之頭戴裝置中播放相對應之虛擬實境影片;令該虛擬實境播放設備於播放該虛擬實境影片時,自該影片資訊中取得推薦角度以及自該頭戴裝置中取得觀看角度;令該虛擬實境播放設備比對該推薦角度及該觀看角度,以依據比對結果產生推薦方向資訊;以及令該虛擬實境播放設備將該推薦方向資訊顯示於該虛擬實境影片中。 In view of the above-mentioned problems, the present invention provides a method for recommending a viewing direction in a virtual reality video, which includes: enabling a virtual reality playback device to receive video information, so that the headset is connected to the virtual reality playback device. Play the corresponding virtual reality video; make the virtual reality playback device obtain the recommended angle from the video information and obtain the viewing angle from the head-mounted device when playing the virtual reality video; make the virtual reality play The device compares the recommended angle and the viewing angle to generate recommended direction information according to the comparison result; and causes the virtual reality playback device to display the recommended direction information in the virtual reality video.

於一實施例中,該影片資訊係包括影音片段以及推薦角度字幕檔,其中,該影音片段係供該虛擬實境播放設備於該頭戴裝置中播放該虛擬實境影片,而該推薦角度字幕檔係供該虛擬實境播放設備取得該推薦角度。 In one embodiment, the video information includes an audio and video clip and a recommended angle subtitle file, wherein the video clip is used by the virtual reality playback device to play the virtual reality video in the head-mounted device, and the recommended angle subtitles The file is for the virtual reality playback device to obtain the recommended angle.

於另一實施例中,復包括於播放該虛擬實境影片時,於每週期時間獲取該推薦角度及該觀看角度。 In another embodiment, when the virtual reality video is played, acquiring the recommended angle and the viewing angle at each cycle time.

於另一實施例中,該週期時間為該虛擬實境影片之幀率的倒數。 In another embodiment, the cycle time is the inverse of the frame rate of the virtual reality video.

於另一實施例中,比對該推薦角度及該觀看角度係包括計算該推薦角度與該觀看角度之間的角度差,以於該角度差超過預設角度閾值時,顯示該推薦方向資訊。 In another embodiment, comparing the recommended angle and the viewing angle includes calculating an angle difference between the recommended angle and the viewing angle, so as to display the recommended direction information when the angle difference exceeds a predetermined angle threshold.

於另一實施例中,該比對該推薦角度及該觀看角度之步驟,係包括:計算該推薦角度與該觀看角度之間的角度差;計算該角度差之同界角;以及判斷該同界角是否超過180度,以據之顯示該推薦方向資訊。 In another embodiment, the step of comparing the recommended angle and the viewing angle includes: calculating the angle difference between the recommended angle and the viewing angle; calculating the same boundary angle of the angle difference; and judging the same angle. Whether the boundary angle exceeds 180 degrees, according to which the recommended direction information is displayed.

於另一實施例中,該影片資訊為串流影音或是該虛擬實境播放設備內存之影片檔案。 In another embodiment, the video information is streaming video or video files stored in the virtual reality playback device.

於另一實施例中,該頭戴裝置為用於虛擬實境之頭戴顯示器。 In another embodiment, the head mounted device is a head mounted display for virtual reality.

於又一實施例中,該頭戴裝置包含行動裝置單元以及用以供該行動裝置單元設置且提供穿戴之頭戴單元,該行動裝置單元係與該虛擬實境播放設備訊號連結,以播放該虛擬實境影片。 In yet another embodiment, the head-mounted device includes a mobile device unit and a head-mounted unit for the mobile device unit to set and provide for wearing, and the mobile device unit is connected with the virtual reality playback device signal to play the Virtual reality video.

本發明復提出一種電腦可讀媒介,應用於計算裝置或電腦中,係儲存有指令,以執行如前述任一者之於虛擬實境影片中推薦觀看方向之方法。 The present invention further proposes a computer-readable medium used in a computing device or a computer and storing instructions for executing the method for recommending a viewing direction in a virtual reality video as described above.

綜上,本發明提出之於虛擬實境影片中推薦觀看方向之方法,係透過虛擬實境播放設備自影片資訊中取得推薦角度以及由頭戴裝置中取得觀看角度,經比對該推薦角度及該觀看角度以產生比對結果,據此,該虛擬實境播放設備能依據比對結果於虛擬實境影片中顯示推薦方向,故本發明能達到提示使用者於虛擬實境影片中欲推薦之畫面的目的,讓使用者能藉由推薦方向將視野角度轉動至影片中當下觀看重點方向,避免錯過影片呈現之重要處,以令使用者觀看虛擬實境影片時能具備較佳操作體驗。 To sum up, the method for recommending a viewing direction in a virtual reality video proposed by the present invention is to obtain the recommended angle from the video information and the viewing angle from the headset through the virtual reality playback device, and compare the recommended angle and the viewing angle. The viewing angle is used to generate a comparison result. Accordingly, the virtual reality playback device can display the recommended direction in the virtual reality video according to the comparison result. Therefore, the present invention can prompt the user to recommend the recommended direction in the virtual reality video. The purpose of the screen is to allow the user to rotate the viewing angle to the current focus direction in the video through the recommended direction, so as to avoid missing the important point of the video presentation, so that the user can have a better operating experience when watching the virtual reality video.

10:虛擬實境播放設備 10: Virtual reality playback device

20:頭戴裝置 20: Headset

30:影片資訊 30: Video Information

601-608:流程 601-608: Process

S101-S104:步驟 S101-S104: Steps

S1031-S1035:步驟 S1031-S1035: Steps

S501-S505:步驟 S501-S505: Steps

圖1係本發明之於虛擬實境影片中推薦觀看方向之方法的步驟圖。 FIG. 1 is a step diagram of a method for recommending a viewing direction in a virtual reality video according to the present invention.

圖2係本發明所述方法執行時的架構圖。 FIG. 2 is an architecture diagram when the method of the present invention is executed.

圖3係本發明所述方法的運作架構圖。 FIG. 3 is an operational architecture diagram of the method of the present invention.

圖4係本發明執行比對角度的步驟圖。 FIG. 4 is a step diagram of the present invention for performing comparison of angles.

圖5係本發明所述方法另一實施例的步驟圖。 FIG. 5 is a step diagram of another embodiment of the method of the present invention.

圖6係執行本發明方法的流程圖。 Figure 6 is a flow chart for carrying out the method of the present invention.

圖7係本發明之推薦角度字幕檔之檔案內容的示意圖。 FIG. 7 is a schematic diagram of the file content of the recommended angle subtitle file of the present invention.

圖8係本發明之觀看角度與推薦角度之相對位置關係的示意圖。 FIG. 8 is a schematic diagram of the relative positional relationship between the viewing angle and the recommended angle of the present invention.

以下藉由特定的具體實施形態說明本發明之技術內容,熟悉此技藝之人士可由本說明書所揭示之內容輕易地瞭解本發明之優點與功效。然本發明亦可藉由其他不同的具體實施形態加以施行或應用。 The following describes the technical content of the present invention through specific embodiments, and those skilled in the art can easily understand the advantages and effects of the present invention from the content disclosed in this specification. However, the present invention can also be implemented or applied by other different specific embodiments.

圖1為本發明之於虛擬實境影片中推薦觀看方向之方法的步驟圖,圖2為本發明所述方法執行時的架構圖。如圖1及圖2所示,本發明利用虛擬實境播放設備10以及與該虛擬實境播放設備10訊號連接且用以顯示虛擬實境影片之頭戴裝置20,以執行於虛擬實境影片中推薦觀看方向之方法。具體而言,本發明以HTTP即時串流(Http Live Stream,HLS)影音服務之運作架構為例,本發明之虛擬實境播放設備10能處理例如HLS影音列表M3U8格式之影片資訊30,並由影片資訊30中取得推薦角度以及由頭戴裝置20取得觀看角度,之後於使用者所穿戴之頭戴裝置20的顯示介面上顯示出推薦方向及/或其推薦方向資訊。 FIG. 1 is a step diagram of a method for recommending a viewing direction in a virtual reality video according to the present invention, and FIG. 2 is an architecture diagram of the method of the present invention during execution. As shown in FIG. 1 and FIG. 2 , the present invention utilizes a virtual reality playback device 10 and a head-mounted device 20 that is signal-connected to the virtual reality playback device 10 and used to display a virtual reality video, so as to execute the virtual reality video Recommended viewing direction method. Specifically, the present invention takes the operation structure of HTTP Live Stream (HLS) video and audio service as an example. The virtual reality playback device 10 of the present invention can process video information 30 in M3U8 format, such as HLS video list The recommended angle is obtained from the video information 30 and the viewing angle is obtained from the head-mounted device 20 , and then the recommended direction and/or its recommended direction information is displayed on the display interface of the head-mounted device 20 worn by the user.

如圖1及圖2所示,於HLS的串流URL中,該影片資訊30包含主要之影音列表M3U8文件、多個TS影音片段以及一個如WEBVTT之推薦角度字幕 檔,其中,推薦角度字幕檔中儲存多個一段時間範圍內對應之角度,即為推薦角度。而該虛擬實境播放設備10可讀取該頭戴裝置20於面對一個方位時所對應之角度資訊,即為觀看角度。據此,透過虛擬實境播放設備10比對兩個角度後,可獲得推薦方向,之後再判斷推薦方向係位於目前頭戴裝置20所觀看之方位或角度的左方或右方,最後藉由具有指標性質之符號,例如箭頭,呈現在頭戴裝置20的顯示介面上,以導引使用者轉動頭戴裝置20至該推薦角度之範圍內,藉以達到快速且精準地提升使用者於虛擬實境之觀看體驗。有關本發明所述的步驟,詳如下述。 As shown in FIG. 1 and FIG. 2 , in the streaming URL of HLS, the video information 30 includes the main video list M3U8 file, a plurality of TS video clips, and a recommended angle subtitle such as WEBVTT The recommended angle subtitle file stores a plurality of corresponding angles within a certain period of time, that is, the recommended angle. The virtual reality playback device 10 can read the angle information corresponding to the head-mounted device 20 when it faces an orientation, that is, the viewing angle. Accordingly, after comparing the two angles through the virtual reality playback device 10, a recommended direction can be obtained, and then it is determined whether the recommended direction is located at the left or right of the current direction or angle viewed by the headset 20, and finally by Symbols with index properties, such as arrows, are displayed on the display interface of the headset 20 to guide the user to rotate the headset 20 to the recommended angle range, so as to quickly and accurately improve the user's experience in virtual reality. The viewing experience of the environment. The steps described in the present invention are detailed as follows.

如圖1及圖2所示,於步驟S101,令虛擬實境播放設備接收影片資訊,以於與該虛擬實境播放設備訊號連結之頭戴裝置中播放相對應之虛擬實境影片。本步驟係透過虛擬實境播放設備10接收影片資訊30,並於與該虛擬實境播放設備10訊號連結之頭戴裝置20中播放虛擬實境影片,其中,影片資訊30可為串流影音或該虛擬實境播放設備10所儲存之影片檔案,亦即,虛擬實境播放設備10播放影片的方式,可為播放本地端(Local)影片,例如但不限於MP4、AVI等檔案格式之影片,或者是播放串流影音格式,該串流影音格式常以URL表示式,例如前述之HLS。易言之,虛擬實境播放設備10能播放儲存於內部記憶體或外部資料庫之影音資料,或者透過網路連結至影音平台,例如Youtube,接收影音平台所提供之影音串流進行播放。 As shown in FIG. 1 and FIG. 2 , in step S101 , the virtual reality playback device is made to receive video information, so as to play the corresponding virtual reality video in the headset connected to the signal of the virtual reality playback device. In this step, the video information 30 is received through the virtual reality playback device 10 , and the virtual reality video is played on the head-mounted device 20 connected with the signal of the virtual reality playback device 10 , wherein the video information 30 may be streaming video or audio. The video file stored by the virtual reality playback device 10, that is, the way of playing the video by the virtual reality playback device 10, can be a local video, such as but not limited to MP4, AVI and other file formats. Or play a streaming video format, which is often represented by a URL, such as the aforementioned HLS. In other words, the virtual reality playback device 10 can play the audio and video data stored in the internal memory or an external database, or connect to an audio and video platform, such as Youtube, through a network, and receive the audio and video stream provided by the audio and video platform for playback.

另外,頭戴裝置20可為VR設備之頭戴式顯示器,其能與虛擬實境播放設備10訊號連結,並由頭戴裝置20中顯示播放VR影片。另外,頭戴裝置20亦可為包括例如智慧型手機之行動裝置單元以及用以供該行動裝置單元設置且可提供使用者穿戴之頭戴單元,頭戴裝置20可透過行動裝置單元與虛擬實境 播放設備10訊號連結,以於虛擬實境播放設備10播放虛擬實境影片時,由行動裝置單元之顯示螢幕顯示所播放之虛擬實境影片的畫面。 In addition, the head-mounted device 20 can be a head-mounted display of the VR device, which can be connected to the virtual reality playback device 10 with a signal, and the VR video can be displayed and played in the head-mounted device 20 . In addition, the head-mounted device 20 can also be a mobile device unit including, for example, a smart phone, and a head-mounted unit used for setting the mobile device unit and provided for the user to wear. The head-mounted device 20 can communicate with the virtual reality device through the mobile device unit territory The playing device 10 is connected with a signal, so that when the virtual reality playing device 10 plays the virtual reality video, the display screen of the mobile device unit displays the screen of the played virtual reality video.

於步驟S102,令該虛擬實境播放設備於該虛擬實境影片播放時,自該影片資訊中取得推薦角度以及自該頭戴裝置中取得觀看角度。本步驟係說明該虛擬實境播放設備10自該影片資訊30中取得推薦角度以及自該頭戴裝置20中取得觀看角度,其中,影片資訊30包括影音片段及推薦角度字幕檔,以於播放影片時,令虛擬實境播放設備10嘗試讀取影音片段以及取得字幕檔案之相對位置,使該虛擬實境播放設備10將影音片段於頭戴裝置20中播放虛擬實境影片,對應當時片段,自推薦角度字幕檔中取得推薦角度。 In step S102 , when the virtual reality video is played, the virtual reality playback device obtains the recommended angle from the video information and the viewing angle from the head-mounted device. This step illustrates that the virtual reality playback device 10 obtains the recommended angle from the video information 30 and obtains the viewing angle from the head-mounted device 20 , wherein the video information 30 includes video clips and recommended angle subtitle files for playing the video when the virtual reality playback device 10 tries to read the video and audio clips and obtain the relative position of the subtitle file, so that the virtual reality playback device 10 plays the video and audio clips in the headset 20 to play the virtual reality video, corresponding to the current clip, and automatically The recommended angle is obtained from the recommended angle subtitle file.

具體來說,虛擬實境影片為等距柱狀圖之格式,透過虛擬實境播放設備10播放為對應等距柱狀圖的360°全景影像,而於頭戴裝置20進行播放時,頭戴裝置20中之螢幕則播放螢幕範圍所及之部分影像。於虛擬實境播放設備10播放虛擬實境影片時,因為影片資訊包含影音片段和對應字幕檔,故推薦角度可記載於字幕檔內,當播放到某一片段時,透過其對應字幕檔即可取得所需推薦角度。另外,使用者戴上頭戴裝置20進行觀影時,該頭戴裝置20之螢幕會顯示當下360°全景影像中之部分影像,可透過預先設定該部分影像對應於全景影像為某一角度,進而可定義出頭載裝置之觀看角度。在一實施例中,針對一整個全景影像,假設第一部分影像係位於全景影像中的右手邊30°-60°之間,第二部分影像係位於全景影像中的右手邊60°-90°之間,當知道使用者觀看的為哪一個部分影像以及觀看中心點為該部分影像何處時,即可推知頭載裝置當下的觀看角度。又,智慧型手機中通常具備陀螺儀,其可偵測智慧型手機於空間中的移動或轉動情況,是以,於頭載裝置為具有行動裝置單元之實施例中,亦 可透過行動裝置單元之陀螺儀感測角度之變化程度,對應全景影像中之角度,以作為頭戴裝置20之觀看角度。 Specifically, the virtual reality video is in the format of an isometric histogram, and is played through the virtual reality playback device 10 as a 360° panorama image corresponding to the isometric histogram. The screen in the device 20 plays part of the image within the range of the screen. When the virtual reality playback device 10 plays a virtual reality video, because the video information includes audio and video clips and corresponding subtitle files, the recommended angle can be recorded in the subtitle file, and when a certain clip is played, the corresponding subtitle file can be used. Obtain the desired recommended angle. In addition, when the user wears the head-mounted device 20 to watch a movie, the screen of the head-mounted device 20 will display a part of the current 360° panoramic image, and the part of the image can be preset to correspond to the panoramic image at a certain angle, Then, the viewing angle of the head-mounted device can be defined. In one embodiment, for an entire panoramic image, it is assumed that the first part of the image is located between 30°-60° on the right-hand side of the panoramic image, and the second part of the image is located between 60°-90° on the right-hand side of the panoramic image. During this time, when the user knows which part of the image the user is viewing and where the viewing center point is the part of the image, the current viewing angle of the head-mounted device can be inferred. In addition, the smart phone is usually equipped with a gyroscope, which can detect the movement or rotation of the smart phone in space. Therefore, in the embodiment in which the head-mounted device has a mobile device unit, it is also The degree of change of the angle can be sensed through the gyroscope of the mobile device unit, which corresponds to the angle in the panoramic image and is used as the viewing angle of the head-mounted device 20 .

於步驟S103,令該虛擬實境播放設備比對該推薦角度及該觀看角度,以依據比對結果產生推薦方向及/或其推薦方向資訊。本步驟係使該虛擬實境播放設備10比對該推薦角度及該觀看角度,藉由計算兩者角度差,進而產生推薦方向及/或其推薦方向資訊,亦即虛擬實境播放設備10透過計算推薦角度及觀看角度之間的角度差,判斷使用者之頭戴裝置20目前所面對的方位資訊,以形成建議使用者要向左轉動或向右轉動之推薦方向及/或其推薦方向資訊。 In step S103, the virtual reality playback device is made to compare the recommended angle and the viewing angle, so as to generate a recommended direction and/or its recommended direction information according to the comparison result. In this step, the virtual reality playback device 10 compares the recommended angle and the viewing angle, and calculates the difference between the two angles, thereby generating the recommended direction and/or its recommended direction information, that is, the virtual reality playback device 10 passes through Calculate the angle difference between the recommended angle and the viewing angle, determine the orientation information that the user's headset 20 is currently facing, so as to form a recommended direction and/or its recommended direction that the user should turn left or right News.

於步驟S104,令該虛擬實境播放設備將該推薦方向及/或其推薦方向資訊顯示於該虛擬實境影片中。本步驟係讓虛擬實境播放設備10將推薦方向及/或其推薦方向資訊於該頭戴裝置20內顯示推薦方向及/或其推薦方向資訊,亦即,該虛擬實境播放設備10於比對兩者角度後,會獲得建議向左轉動或向右轉動之比對結果,即於頭戴裝置20之顯示螢幕上產生推薦方向之提示,讓使用者能依推薦方向轉動至推薦內容之角度進行觀看。藉此,本發明提供使用者觀影時之便利性,且於使用者轉動至推薦內容之角度時,基於即時運算,當判斷使用者的觀看角度已落入推薦角度範圍內,即停止推薦方向之提示,以避免干擾使用者之觀影感受。 In step S104, the virtual reality playback device is made to display the recommended direction and/or its recommended direction information in the virtual reality video. This step is for the virtual reality playback device 10 to display the recommended direction and/or its recommended direction information in the headset 20 , that is, the virtual reality playback device 10 displays the recommended direction and/or its recommended direction information in the headset 20 . After comparing the two angles, a comparison result of the recommended rotation to the left or to the right will be obtained, that is, a prompt of the recommended direction will be generated on the display screen of the head-mounted device 20, so that the user can rotate according to the recommended direction to the angle of the recommended content to watch. In this way, the present invention provides convenience for the user to watch movies, and when the user rotates to the angle of the recommended content, based on real-time calculation, when it is determined that the user's viewing angle has fallen within the recommended angle range, the recommended direction is stopped. to avoid disturbing the user's viewing experience.

圖3為本發明所述方法的運作架構圖。如圖所示,HTTP即時串流(Http Live Stream,HLS)影音列表M3U8中係記載影音片段TS以及推薦角度WEBVTT,進一步地,WEBVTT字幕文本即是記載一段時間內對應之角度,此資訊可由虛擬實境播放設備取得,即為推薦角度,另一方面,使用者使用之頭戴裝置,例如虛擬實境頭戴顯示器(VR HMD)或是行動裝置,可基於使用者觀看 虛擬實境影片之角度取得觀看角度,並傳送給虛擬實境播放設備,虛擬實境播放設備將兩個角度進行比對運算,進而得到推薦方向,亦即於頭戴裝置之顯示幕所顯示的虛擬實境影片中顯示推薦方向,立即提示使用者當下觀看影片的較佳畫面內容之角度。 FIG. 3 is an operational architecture diagram of the method of the present invention. As shown in the figure, the Http Live Stream (HLS) video list M3U8 records the video clip TS and the recommended angle WEBVTT. Further, the WEBVTT subtitle text records the corresponding angle within a period of time. This information can be obtained by virtual On the other hand, the head-mounted device used by the user, such as a virtual reality head-mounted display (VR HMD) or a mobile device, can be viewed based on the user's viewing angle. The viewing angle of the virtual reality video is obtained and sent to the virtual reality playback device. The virtual reality playback device compares the two angles, and then obtains the recommended direction, which is displayed on the display screen of the headset. The recommended direction is displayed in the virtual reality video, which immediately prompts the user to watch the best angle of the content of the video at the moment.

圖4為本發明執行比對角度的步驟圖。如圖所示,係說明前述步驟S103進一步包括下列子步驟。 FIG. 4 is a step diagram of performing a comparison of angles according to the present invention. As shown in the figure, it is illustrated that the aforementioned step S103 further includes the following sub-steps.

於步驟S1031,判斷播放虛擬實境影片之時間是否包含推薦角度。若有,則進至步驟S1032;如果沒有,則結束本回合,且不需提供提示角度。具體而言,影片播放過程中,虛擬實境播放設備會有絕對時間(PT),代表該影片已經進行的位置,藉著由字幕檔中尋找此時是否有存在推薦角度,其中,絕對時間係虛擬實境影片於播放時之時間軸所呈現之播放時間,亦即,虛擬實境播放設備10判斷當時所播放的虛擬實境影片之時間點,並由推薦角度字幕檔中尋找是否有對應之推薦角度,若無,則結束而不執行角度推薦,表示當時並無推薦角度可提供,也就是無推薦角度表示當時播放之虛擬實境影片中不具備推薦內容,是以,虛擬實境播放設備10無須進行任何程序,反之,若存在推薦角度,則需進一步進行角度差之計算。 In step S1031, it is determined whether the time of playing the virtual reality video includes the recommended angle. If yes, go to step S1032; if no, end the round, and do not need to provide a prompt angle. Specifically, during the video playback process, the virtual reality playback device will have an absolute time (PT), which represents the position where the video has been played. By looking for a recommended angle in the subtitle file at this time, the absolute time is The playback time of the virtual reality video displayed on the time axis of the playback, that is, the virtual reality playback device 10 determines the time point of the virtual reality video being played at the time, and searches for the corresponding subtitle file from the recommended angle. If there is no recommended angle, it will end without performing the angle recommendation, which means that there is no recommended angle to provide at that time, that is, no recommended angle means that there is no recommended content in the virtual reality video played at that time. Therefore, the virtual reality playback device 10 There is no need to carry out any procedure. On the contrary, if there is a recommended angle, further calculation of the angle difference is required.

於步驟S1032,計算推薦角度與觀看角度之間的角度差。本步驟係虛擬實境播放設備計算推薦角度與觀看角度之間角度的差值,藉以獲得角度差。其計算式為Sa=Ta-Va,其中,Sa為角度差、Ta為推薦角度以及Va為觀看角度,據此,計算角度差為推薦角度減去觀看角度,以產生角度差。 In step S1032, the angle difference between the recommended angle and the viewing angle is calculated. In this step, the virtual reality playback device calculates the angle difference between the recommended angle and the viewing angle, so as to obtain the angle difference. The calculation formula is Sa=Ta-Va, where Sa is the angle difference, Ta is the recommended angle, and Va is the viewing angle. Accordingly, the calculated angle difference is the recommended angle minus the viewing angle to generate the angle difference.

於步驟S1033,判斷角度差是否超過預設角度閾值,以決定是否顯示該推薦方向。本步驟主要目的在於判別是否需要提供推薦方向之建議,具 體而言,判斷方法係透過計算兩視角之小角度夾角(Ma)是否超過需提供建議之角度閾值(Na),以決定是否提供建議,其計算式如下: In step S1033, it is determined whether the angle difference exceeds a preset angle threshold to determine whether to display the recommended direction. The main purpose of this step is to determine whether it is necessary to provide a recommendation for the direction of recommendation. In general, the judgment method is to determine whether to provide advice by calculating whether the small angle (Ma) of the two viewing angles exceeds the angle threshold (Na) that needs to provide advice. The calculation formula is as follows:

Ma=360-ABS(Sa),If ABS(Sa)>=180 Ma=360-ABS(Sa), If ABS(Sa)>=180

Ma=ABS(Sa),If ABS(Sa)<180 Ma=ABS(Sa), If ABS(Sa)<180

其中,ABS(Sa)為角度差之絕對值函式。據此,在確定小角度夾角(Ma)後,進一步決定是否提供建議之判斷如下: Among them, ABS(Sa) is the absolute value function of the angle difference. Accordingly, after determining the small angle (Ma), the further decision on whether to provide advice is as follows:

Result=Yes,If Ma>=Na Result=Yes, If Ma>=Na

Result=No,If Ma<Na Result=No, If Ma<Na

亦即,於小角度夾角大於等於需提供建議之角度閾值時,始進行推薦方向之提示,反之,表示兩者角度差不超過預定閾值,使用者沒有轉動之需求,故無須顯示推薦角度。 That is, when the included angle of the small angle is greater than or equal to the angle threshold for which a suggestion needs to be provided, the suggested direction will be prompted. On the contrary, it means that the difference between the two angles does not exceed the predetermined threshold, and the user does not need to rotate, so there is no need to display the recommended angle.

如上,於進行角度差之計算後,可先判斷是否需要進行推薦方向之提示,亦即,如果推薦角度與觀看角度之角度差相去甚微,即角度差未超過所預先設定之角度閾值(例如30°、45°或60°等),表示使用者之觀看角度很接近推薦角度,無須特別轉動方向仍可看到推薦內容,則無須於顯示畫面上提示建議轉動之方向,避免干擾使用者觀看影片,相反地,若角度差超過所預先設定之角度閾值,則虛擬實境播放設備進一步分析應建議轉動之推薦方向。 As above, after calculating the angle difference, it is possible to first determine whether it is necessary to prompt the recommended direction, that is, if the angle difference between the recommended angle and the viewing angle is very small, that is, the angle difference does not exceed the preset angle threshold (for example, 30°, 45° or 60°, etc.), it means that the viewing angle of the user is very close to the recommended angle, and the recommended content can still be seen without special rotation, so there is no need to prompt the recommended rotation direction on the display screen to avoid disturbing the user’s viewing. For the video, on the contrary, if the angle difference exceeds the preset angle threshold, the virtual reality playback device further analyzes the recommended direction of rotation that should be suggested.

於步驟S1034中,計算該角度差之同界角。依上述,若需進行推薦方向之建議時,會進一步計算應向使用者之左方或右方進行轉動,其中,先依上述之角度差計算度差之同界角(Sa’),其計算式如下: In step S1034, the congruent angle of the angle difference is calculated. According to the above, if the recommendation of the recommended direction is required, it will be further calculated to rotate to the left or right of the user. Among them, the same boundary angle (Sa') of the degree difference is first calculated according to the above angle difference, and the calculation The formula is as follows:

Sa’=Sa+360,If Sa<0 Sa'=Sa+360, If Sa<0

Sa’=Sa,If Sa>=0 Sa’=Sa, If Sa>=0

於步驟S1035,判斷該同界角是否超過180°,以顯示該推薦方向。進一步地,依據前一步驟計算得到之同界角,判斷應給予向左或向右之推薦方向的提式,其判斷式如下所示: In step S1035, it is determined whether the co-boundary angle exceeds 180° to display the recommended direction. Further, according to the same boundary angle calculated in the previous step, it is judged that the formula for the recommended direction to the left or the right should be given, and the judgment formula is as follows:

Result=Left,If Sa’>180° Result=Left, If Sa’>180°

Result=Right,If Sa’<=180° Result=Right, If Sa’<=180°

據此,若判斷結果為同界角大於180°,則建議轉動方向為向左轉動,反之,則提供向右之建議轉動方向。 Accordingly, if the judgment result is that the co-boundary angle is greater than 180°, the recommended rotation direction is leftward, otherwise, the rightward rotation is recommended.

圖5為本發明所述方法另一實施例的步驟圖。如圖所示,於本實施例中,步驟S501、S503-S505與圖1中步驟S101-S104所述相同,於此不再贅述,本實施例與前一實施例之差別在於步驟S501後執行步驟S502,即於播放該虛擬實境影片後,本發明復包括確認週期,以依據該週期獲取推薦角度及觀看角度進行角度比對。在一實施例中,前述之週期為虛擬實境影片之幀率(Frame Rate)的倒數,舉例而言,虛擬實境播放設備依據影片資訊於播放虛擬實境影片時,取得影片之幀率,可作為確認週期的時間,例如影片幀率為30fps,則推薦週期為每1/30毫秒(ms)的週期執行一次角度比對,以判斷是否需提供推薦方向。 FIG. 5 is a step diagram of another embodiment of the method of the present invention. As shown in the figure, in this embodiment, steps S501, S503-S505 are the same as those described in steps S101-S104 in FIG. 1, which will not be repeated here. The difference between this embodiment and the previous embodiment is that steps S501 are executed after step S501. Step S502, after the virtual reality video is played, the present invention further includes a confirmation cycle, so as to obtain the recommended angle and the viewing angle according to the cycle for angle comparison. In one embodiment, the aforementioned period is the reciprocal of the frame rate of the virtual reality video. For example, the virtual reality playback device obtains the frame rate of the video when playing the virtual reality video according to the video information, It can be used as the time for the confirmation period. For example, the frame rate of the video is 30fps, and the recommended period is to perform an angle comparison every 1/30 millisecond (ms) period to determine whether the recommended direction needs to be provided.

圖6為執行本發明方法的流程圖。如圖所示,於流程601,取得影片資訊,本發明之虛擬實境播放設備於播放影片時,嘗試讀取影音片段以及字幕檔案的相對位置(即該字幕檔案要對應哪一段影音片段)。於流程602,讀取推薦角度字幕檔,其中,字幕檔內以特殊字串,例如以「TargetAngle:」開始之字串,表示某一時間範圍內要包含有推薦角度之內容。於流程603,開始進行影片播放。於流程604,確認週期,亦即於虛擬實境影片播放過程中,虛擬實境播放設備會有絕對時間,絕對時間即為虛擬實境影片已經進行的時間,進一步地, 虛擬實境播放設備依據影片資訊,取得播放之影片的幀率,幀率之數值可作為確認週期之時間,如幀率為30fps,則可設定執行角度比對之週期為每1/30毫秒(ms)執行一次。於流程605,從推薦角度字幕檔中取得推薦角度,即依據目前絕對時間,讀取推薦角度字幕檔中對應之推薦角度,於流程606,自頭戴裝置取得觀看角度,即取得頭戴裝置當下所面對的平面角度,作為觀看角度。於流程607,比對角度,其中,有關比對角度之流程,詳如圖4所示,據此,虛擬實境播放設備透過比對推薦角度以及觀看角度,以產生推薦方向及/或其推薦方向資訊。於流程608,更新呈現推薦方向及/或其推薦方向資訊,虛擬實境播放設備依據比對結果之建議,於頭戴裝置之顯示介面上顯示推薦方向及/或其推薦方向資訊,亦即於虛擬實境影片上顯示該推薦方向,讓使用者於觀看中能直觀地知道要往哪邊轉動,具體地,可利用箭頭指示之方式呈現,以提示推薦方向,即顯示往左或往右。在執行完流程608後,會持續檢查週期,即確認週期時間為每幾毫秒一次,並繼續取得兩個角度並比對差異,藉以確認是否再提供推薦方向及/或其推薦方向資訊。 FIG. 6 is a flow chart for carrying out the method of the present invention. As shown in the figure, in process 601, video information is obtained, and the virtual reality playback device of the present invention tries to read the relative position of the video clip and the subtitle file (ie which video clip the subtitle file corresponds to) when playing the video. In the process 602, the recommended angle subtitle file is read, wherein a special character string in the subtitle file, such as a character string starting with "TargetAngle:", indicates that the content of the recommended angle should be included in a certain time range. In process 603, video playback is started. In the process 604, the confirmation period, that is, during the virtual reality video playback process, the virtual reality playback device will have an absolute time, and the absolute time is the time when the virtual reality video has been performed. Further, The virtual reality playback device obtains the frame rate of the video being played according to the video information, and the value of the frame rate can be used as the time of the confirmation period. ms) is executed once. In the process 605, the recommended angle is obtained from the recommended angle subtitle file, that is, according to the current absolute time, the corresponding recommended angle in the recommended angle subtitle file is read. In the process 606, the viewing angle is obtained from the head-mounted device, that is, the current head-mounted device is obtained. The angle of the plane facing, as the viewing angle. In the process 607, compare the angles, wherein, the process of comparing the angles is shown in FIG. 4 in detail. According to this, the virtual reality playback device generates the recommended direction and/or its recommendation by comparing the recommended angle and the viewing angle. Orientation information. In the process 608, the recommended direction and/or its recommended direction information are updated and presented, and the virtual reality playback device displays the recommended direction and/or its recommended direction information on the display interface of the head-mounted device according to the suggestion of the comparison result, that is, on the display interface of the headset. The recommended direction is displayed on the virtual reality video, so that the user can intuitively know which direction to turn while watching. Specifically, it can be displayed in the form of arrows to prompt the recommended direction, that is, display left or right. After the process 608 is executed, the cycle is continuously checked, that is, the cycle time is confirmed to be every few milliseconds, and two angles are continuously obtained and the difference is compared, so as to confirm whether to provide the recommended direction and/or its recommended direction information again.

依據上述本發明之於虛擬實境影片中推薦觀看方向之方法,以HLS之串流影音為例具體說明。首先,虛擬實境播放設備取得影片資訊,以取得影音片段以及與其對應字幕檔案(WEBVTT)。接著,虛擬實境播放設備讀取推薦角度字幕檔,其中,推薦角度字幕檔之檔案內容可如圖7所示,其中,推薦角度字幕檔內包含推薦角度之關鍵字串,即「TargetAngle」,於其他實施例中亦可依需求替換成其他字串,而該字串後方之數字代表指定時間範圍內的推薦角度,如圖所示,以編號447為例,其範圍時間為00:23:07.776到00:23:08.616,而推薦角度即為69°,另外,以編號449為例,其範圍時間為 00:43:07.776到00:43:08.616,而推薦角度為129°,其餘以此類推。進一步地,虛擬實境播放設備依據影片資訊所播放之虛擬實境影片以確認週期,亦即,設若影片之幀率(Frame Rate)為30fps,則其週期即為1/30毫秒。 According to the method for recommending a viewing direction in a virtual reality video according to the present invention, the HLS streaming video and audio are taken as an example for specific description. First, the virtual reality playback device obtains video information to obtain video clips and corresponding subtitle files (WEBVTT). Next, the virtual reality playback device reads the recommended angle subtitle file, wherein the file content of the recommended angle subtitle file is as shown in FIG. 7 , wherein the recommended angle subtitle file contains the keyword string of the recommended angle, namely "TargetAngle" In other embodiments, it can be replaced with other strings according to requirements, and the number behind the string represents the recommended angle within the specified time range. As shown in the figure, taking the number 447 as an example, the range time is 00:23: 07.776 to 00:23:08.616, and the recommended angle is 69°. In addition, taking the number 449 as an example, the range time is 00:43:07.776 to 00:43:08.616, while the recommended angle is 129°, and so on for the rest. Further, the virtual reality playback device confirms the cycle according to the virtual reality video played by the video information, that is, if the frame rate of the video is 30fps, the cycle is 1/30 millisecond.

下面透過具體實施例以說明本發明。VR播放設備依據所取得之推薦角度及觀看角度進行角度比對,於角度比對時,先確認字幕檔中是否包含對應之推薦角度,以前述推薦角度字幕檔中編號447之例,即「00:23:07.776-00:23:08.616」之推薦角度為69°,再於取得觀看角度方面,請進一步參考下面表1,於前述「00:23:08.000」之絕對時間中,自頭戴裝置上取得之觀看角度假設為10°,於進行角度差之計算後,得到Sa=69°-10°=59°,再計算小角度夾角Ma,作為是否提供方向建議之依據,其中,ABS(Sa)<180°,因而Ma=ABS(Sa)=59°,本例之需提供建議之角度Na假定為30°,是以,小角度夾角Ma大於等於需提供建議之角度Na,故判斷結果為提供建議,反之,若如為表1之觀看角度10°且推薦角度5°之情況下,則不需要提供建議。 The present invention is described below through specific embodiments. The VR playback device performs angle comparison according to the obtained recommended angle and viewing angle. When comparing the angles, first confirm whether the corresponding recommended angle is included in the subtitle file. For example, the number 447 in the recommended angle subtitle file is "00". : 23: 07.776-00: 23: 08.616”, the recommended angle is 69°, and for obtaining the viewing angle, please refer to Table 1 below. The viewing angle obtained above is assumed to be 10°. After the calculation of the angle difference, Sa=69°-10°=59°, and then the small angle Ma is calculated as the basis for whether to provide direction suggestions. Among them, ABS (Sa )<180°, so Ma=ABS(Sa)=59°, the angle Na that needs to be suggested in this example is assumed to be 30°, so the angle Ma of the small angle is greater than or equal to the angle Na that needs to be suggested, so the judgment result is Provide advice, on the contrary, if the viewing angle in Table 1 is 10° and the recommended angle is 5°, no advice is required.

Figure 110111322-A0101-12-0012-2
Figure 110111322-A0101-12-0012-2

承上所述,再進一步計算角度差之同界角,如下表2所示,其中,角度差之同界角Sa’=Sa=59°,據此,由於Sa’小於等於180°,故回傳 Right(往右)之提示建議,反之,若為第一筆資料,則角度差之同界角Sa’大於180°,則回傳Left(往左)。 Continuing from the above, further calculate the co-boundary angle of the angle difference, as shown in Table 2 below, where the co-boundary angle of the angular difference Sa'=Sa=59°, according to this, since Sa' is less than or equal to 180°, the return pass Right (to the right) prompt suggestion, on the contrary, if it is the first data, the same boundary angle Sa' of the angle difference is greater than 180°, then return Left (to the left).

Figure 110111322-A0101-12-0013-3
Figure 110111322-A0101-12-0013-3

圖8為本發明之觀看角度與推薦角度之相對位置關係的示意圖。為清楚說明前述範例,於此透過繪圖來加以說明,使用者面對角度為10°,當下推薦之角度為69°,由於小角度夾角已經大於預設之角度閾值(例如30°),因此,使用者之頭戴裝置的顯示介面上應給予向右之提示,以引導使用者觀看有價值之內容角度。 FIG. 8 is a schematic diagram of the relative positional relationship between the viewing angle and the recommended angle of the present invention. In order to clearly illustrate the above-mentioned example, the drawing is used to illustrate that the user faces an angle of 10°, and the currently recommended angle is 69°. A prompt to the right should be given on the display interface of the user's headset to guide the user to view valuable content angles.

另外,本發明還揭示一種電腦可讀媒介,係應用於具有處理器(例如CPU、GPU等)及/或記憶體的計算裝置或電腦中,且儲存有指令,並可利用此計算裝置或電腦透過處理器及/或記憶體執行此電腦可讀媒介,以於執行此電腦可讀媒介時執行上述之方法及各步驟。 In addition, the present invention also discloses a computer-readable medium, which is applied to a computing device or computer having a processor (such as a CPU, GPU, etc.) and/or memory, stores instructions, and can utilize the computing device or computer The computer-readable medium is executed by a processor and/or a memory, so as to execute the above-mentioned methods and steps when the computer-readable medium is executed.

本發明所揭示之各單元、模組可於包括微處理器及記憶體之電腦設備或伺服器中運行,演算法、資料、程式等係儲存記憶體或晶片內,微處理器可從記憶體或晶片載入資料或演算法或程式進行資料分析或計算等處理,在此不予贅述。 The units and modules disclosed in the present invention can run in computer equipment or servers including microprocessors and memories. Algorithms, data, programs, etc. are stored in memories or chips. Or the chip loads data or algorithms or programs for data analysis or calculation, which will not be repeated here.

綜上所述,本發明提出一種於虛擬實境影片中推薦觀看方向之方法及電腦可讀媒介,係利用虛擬實境播放設備取得影片資訊中的推薦角度以及頭戴裝置觀影當時之觀看角度,經比對角度後,依據比對結果以於頭戴裝置之顯示介面上提供推薦方向之建議,以提示使用者影片資訊中推薦畫面與使用者所面向之方位兩者之間的相對位置,俾可達到快速且精準地提升使用者於虛擬實境之觀影效果。另外,本發明可應用於各種影音服務方案,如本地端虛擬實境影片播放或串流虛擬實境影音服務,據此,只要播放之影片資訊中具有現有字幕儲存格式(如srt、vtt、webvtt等),即可套用本發明之方法,據以達成推薦視角之目的。是以,本發明係具有如下特色。 To sum up, the present invention provides a method and a computer-readable medium for recommending a viewing direction in a virtual reality video, using a virtual reality playback device to obtain the recommended angle in the video information and the viewing angle of the head-mounted device at the time of viewing the movie , after comparing the angles, according to the comparison result, a suggestion of the recommended direction is provided on the display interface of the head-mounted device, so as to remind the user of the relative position between the recommended screen in the video information and the direction the user is facing, In this way, the user's viewing effect in the virtual reality can be improved quickly and accurately. In addition, the present invention can be applied to various video and audio service solutions, such as local-end virtual reality video playback or streaming virtual reality video and audio services. Accordingly, as long as the video information to be played has existing subtitle storage formats (such as srt, vtt, webvtt, etc.) etc.), the method of the present invention can be applied to achieve the purpose of recommending a viewing angle. Therefore, the present invention has the following features.

第一,本發明之虛擬實境播放設備可讀取包含推薦角度字幕檔且於使用者觀看VR影片時取得觀看角度,即可據以獲得建議使用者之推薦方向。 First, the virtual reality playback device of the present invention can read a subtitle file including a recommended angle and obtain the viewing angle when the user watches the VR video, so as to obtain the recommended direction for the user.

第二,本發明之虛擬實境播放設備於任一時間範圍內,皆會比對角度,即比對推薦角度字幕檔提供之推薦角度以及使用者當下所面對之角度,於使用者介面上顯示推薦之角度。 Second, the virtual reality playback device of the present invention will compare the angles within any time range, that is, compare the recommended angle provided by the recommended angle subtitle file with the angle that the user is currently facing, on the user interface Displays the recommended angle.

第三,本發明於引導過程中,如若使用者已將觀看視角移至推薦之角度範圍內,則會停止提示,降低對使用者的干擾。 Thirdly, during the guidance process of the present invention, if the user has moved the viewing angle to within the recommended angle range, the prompt will be stopped to reduce interference to the user.

第四,本發明利用現有的字幕檔案作為載體以儲存推薦角度內容,故實作之影音平台及遞送系統無須進行修改,仍可進行服務。 Fourth, the present invention uses the existing subtitle file as a carrier to store the recommended angle content, so the implemented video and audio platform and delivery system can still provide services without modification.

上述之實施案例僅為舉例性之具體說明,而非為限制本發明之範圍,凡任何對其進行之等效修改或變更者,皆未脫離本發明之精神與範疇,均應包含於本案專利範圍中。 The above-mentioned implementation cases are only illustrative and specific descriptions, rather than limiting the scope of the present invention. Any equivalent modifications or changes made to them do not depart from the spirit and scope of the present invention, and should be included in the patent of this case. in the range.

S101-S104:步驟 S101-S104: Steps

Claims (9)

一種於虛擬實境影片中推薦觀看方向之方法,係包括:令虛擬實境播放設備接收影片資訊,以於與該虛擬實境播放設備訊號連結之頭戴裝置中播放相對應之虛擬實境影片;令該虛擬實境播放設備於播放該虛擬實境影片時,自該影片資訊中取得推薦角度以及自該頭戴裝置中取得觀看角度;令該虛擬實境播放設備比對該推薦角度及該觀看角度,以依據比對結果產生推薦方向資訊;以及令該虛擬實境播放設備將該推薦方向資訊顯示於該虛擬實境影片中,其中,該影片資訊係包括影音片段以及推薦角度字幕檔,其中,該影音片段係供該虛擬實境播放設備於該頭戴裝置中播放該虛擬實境影片,而該推薦角度字幕檔係供該虛擬實境播放設備取得該推薦角度。 A method for recommending a viewing direction in a virtual reality video, comprising: making a virtual reality playback device receive video information, so as to play a corresponding virtual reality video in a headset connected with a signal of the virtual reality playback device ; make the virtual reality playback device obtain the recommended angle from the video information and obtain the viewing angle from the head-mounted device when playing the virtual reality video; make the virtual reality playback device compare the recommended angle with the viewing angle viewing angle, so as to generate recommended direction information according to the comparison result; and make the virtual reality playback device display the recommended direction information in the virtual reality video, wherein the video information includes video clips and recommended angle subtitle files, Wherein, the video clip is for the virtual reality playback device to play the virtual reality video in the head-mounted device, and the recommended angle subtitle file is for the virtual reality playback device to obtain the recommended angle. 一種於虛擬實境影片中推薦觀看方向之方法,係包括:令虛擬實境播放設備接收影片資訊,以於與該虛擬實境播放設備訊號連結之頭戴裝置中播放相對應之虛擬實境影片;令該虛擬實境播放設備於播放該虛擬實境影片時,自該影片資訊中取得推薦角度以及自該頭戴裝置中取得觀看角度,其中,於播放該虛擬實境影片時,於每週期時間獲取該推薦角度及該觀看角度;令該虛擬實境播放設備比對該推薦角度及該觀看角度,以依據比對結果產生推薦方向資訊;以及令該虛擬實境播放設備將該推薦方向資訊顯示於該虛擬實境影片中。 A method for recommending a viewing direction in a virtual reality video, comprising: making a virtual reality playback device receive video information, so as to play a corresponding virtual reality video in a headset connected with a signal of the virtual reality playback device ; Make the virtual reality playback device obtain the recommended angle from the video information and obtain the viewing angle from the head-mounted device when playing the virtual reality video, wherein, when playing the virtual reality video, every cycle Time to obtain the recommended angle and the viewing angle; make the virtual reality playback device compare the recommended angle and the viewing angle to generate recommended direction information according to the comparison result; and make the virtual reality playback device the recommended direction information shown in the virtual reality video. 如請求項2之於虛擬實境影片中推薦觀看方向之方法,其中,該週期時間為該虛擬實境影片之幀率的倒數。 The method for recommending a viewing direction in a virtual reality video according to claim 2, wherein the cycle time is the inverse of the frame rate of the virtual reality video. 一種於虛擬實境影片中推薦觀看方向之方法,係包括:令虛擬實境播放設備接收影片資訊,以於與該虛擬實境播放設備訊號連結之頭戴裝置中播放相對應之虛擬實境影片;令該虛擬實境播放設備於播放該虛擬實境影片時,自該影片資訊中取得推薦角度以及自該頭戴裝置中取得觀看角度;令該虛擬實境播放設備比對該推薦角度及該觀看角度,以依據比對結果產生推薦方向資訊;以及令該虛擬實境播放設備將該推薦方向資訊顯示於該虛擬實境影片中,其中,比對該推薦角度及該觀看角度係包括計算該推薦角度與該觀看角度之間的角度差,以於該角度差超過預設角度閾值時,顯示該推薦方向資訊。 A method for recommending a viewing direction in a virtual reality video, comprising: making a virtual reality playback device receive video information, so as to play a corresponding virtual reality video in a headset connected with a signal of the virtual reality playback device ; make the virtual reality playback device obtain the recommended angle from the video information and obtain the viewing angle from the head-mounted device when playing the virtual reality video; make the virtual reality playback device compare the recommended angle with the viewing angle a viewing angle to generate recommended direction information according to the comparison result; and causing the virtual reality playback device to display the recommended direction information in the virtual reality video, wherein comparing the recommended angle and the viewing angle includes calculating the The angle difference between the recommended angle and the viewing angle, so that when the angle difference exceeds a preset angle threshold, the recommended direction information is displayed. 一種於虛擬實境影片中推薦觀看方向之方法,係包括:令虛擬實境播放設備接收影片資訊,以於與該虛擬實境播放設備訊號連結之頭戴裝置中播放相對應之虛擬實境影片;令該虛擬實境播放設備於播放該虛擬實境影片時,自該影片資訊中取得推薦角度以及自該頭戴裝置中取得觀看角度;令該虛擬實境播放設備比對該推薦角度及該觀看角度,以依據比對結果產生推薦方向資訊;以及令該虛擬實境播放設備將該推薦方向資訊顯示於該虛擬實境影片中,其中,該比對該推薦角度及該觀看角度之步驟,係包括下列子步驟:計算該推薦角度與該觀看角度之間的角度差; 計算該角度差之同界角;及判斷該同界角是否超過180度,以據之顯示該推薦方向資訊。 A method for recommending a viewing direction in a virtual reality video, comprising: making a virtual reality playback device receive video information, so as to play a corresponding virtual reality video in a headset connected with a signal of the virtual reality playback device ; make the virtual reality playback device obtain the recommended angle from the video information and obtain the viewing angle from the head-mounted device when playing the virtual reality video; make the virtual reality playback device compare the recommended angle with the viewing angle a viewing angle, so as to generate recommended direction information according to the comparison result; and causing the virtual reality playback device to display the recommended direction information in the virtual reality video, wherein the step of comparing the recommended angle and the viewing angle, The system includes the following sub-steps: calculating the angle difference between the recommended angle and the viewing angle; Calculate the congruent angle of the angle difference; and determine whether the congruent angle exceeds 180 degrees, so as to display the recommended direction information accordingly. 一種於虛擬實境影片中推薦觀看方向之方法,係包括:令虛擬實境播放設備接收影片資訊,以於與該虛擬實境播放設備訊號連結之頭戴裝置中播放相對應之虛擬實境影片;令該虛擬實境播放設備於播放該虛擬實境影片時,自該影片資訊中取得推薦角度以及自該頭戴裝置中取得觀看角度;令該虛擬實境播放設備比對該推薦角度及該觀看角度,以依據比對結果產生推薦方向資訊;以及令該虛擬實境播放設備將該推薦方向資訊顯示於該虛擬實境影片中,其中,該影片資訊為串流影音或是該虛擬實境播放設備內存之影片檔案。 A method for recommending a viewing direction in a virtual reality video, comprising: making a virtual reality playback device receive video information, so as to play a corresponding virtual reality video in a headset connected with a signal of the virtual reality playback device ; make the virtual reality playback device obtain the recommended angle from the video information and obtain the viewing angle from the head-mounted device when playing the virtual reality video; make the virtual reality playback device compare the recommended angle with the viewing angle viewing angle, so as to generate recommended direction information according to the comparison result; and make the virtual reality playback device display the recommended direction information in the virtual reality video, wherein the video information is streaming video or the virtual reality Play the video file in the device's internal memory. 一種於虛擬實境影片中推薦觀看方向之方法,係包括:令虛擬實境播放設備接收影片資訊,以於與該虛擬實境播放設備訊號連結之頭戴裝置中播放相對應之虛擬實境影片;令該虛擬實境播放設備於播放該虛擬實境影片時,自該影片資訊中取得推薦角度以及自該頭戴裝置中取得觀看角度;令該虛擬實境播放設備比對該推薦角度及該觀看角度,以依據比對結果產生推薦方向資訊;以及令該虛擬實境播放設備將該推薦方向資訊顯示於該虛擬實境影片中,其中,該頭戴裝置為用於虛擬實境之頭戴式顯示器。 A method for recommending a viewing direction in a virtual reality video, comprising: making a virtual reality playback device receive video information, so as to play a corresponding virtual reality video in a headset connected with a signal of the virtual reality playback device ; make the virtual reality playback device obtain the recommended angle from the video information and obtain the viewing angle from the head-mounted device when playing the virtual reality video; make the virtual reality playback device compare the recommended angle with the viewing angle viewing angle, so as to generate recommended direction information according to the comparison result; and make the virtual reality playback device display the recommended direction information in the virtual reality video, wherein the head-mounted device is a head-mounted device for virtual reality type display. 一種於虛擬實境影片中推薦觀看方向之方法,係包括: 令虛擬實境播放設備接收影片資訊,以於與該虛擬實境播放設備訊號連結之頭戴裝置中播放相對應之虛擬實境影片;令該虛擬實境播放設備於播放該虛擬實境影片時,自該影片資訊中取得推薦角度以及自該頭戴裝置中取得觀看角度;令該虛擬實境播放設備比對該推薦角度及該觀看角度,以依據比對結果產生推薦方向資訊;以及令該虛擬實境播放設備將該推薦方向資訊顯示於該虛擬實境影片中,其中,該頭戴裝置包含行動裝置單元以及用以供該行動裝置單元設置且提供穿戴之頭戴單元,該行動裝置單元係與該虛擬實境播放設備訊號連結,以播放該虛擬實境影片。 A method for recommending a viewing direction in a virtual reality video, comprising: Make the virtual reality playback device receive video information, so as to play the corresponding virtual reality video in the headset connected with the signal of the virtual reality playback device; make the virtual reality playback device play the virtual reality video when , obtain the recommended angle from the video information and obtain the viewing angle from the head-mounted device; make the virtual reality playback device compare the recommended angle and the viewing angle to generate recommended direction information according to the comparison result; The virtual reality playback device displays the recommended direction information in the virtual reality video, wherein the head-mounted device includes a mobile device unit and a head-mounted unit for the mobile device unit to set and provide for wearing, and the mobile device unit It is connected with the virtual reality playback device signal to play the virtual reality video. 一種電腦可讀媒介,應用於計算裝置或電腦中,係儲存有指令,以執行如請求項1至8之任一者所述之於虛擬實境影片中推薦觀看方向之方法。 A computer-readable medium used in a computing device or a computer and storing instructions for executing the method for recommending a viewing direction in a virtual reality video as described in any one of claims 1 to 8.
TW110111322A 2021-03-29 2021-03-29 Method for recommending viewing directions in virtyal reality video and computer readable medium thereof TWI762257B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW110111322A TWI762257B (en) 2021-03-29 2021-03-29 Method for recommending viewing directions in virtyal reality video and computer readable medium thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW110111322A TWI762257B (en) 2021-03-29 2021-03-29 Method for recommending viewing directions in virtyal reality video and computer readable medium thereof

Publications (2)

Publication Number Publication Date
TWI762257B true TWI762257B (en) 2022-04-21
TW202239199A TW202239199A (en) 2022-10-01

Family

ID=82198998

Family Applications (1)

Application Number Title Priority Date Filing Date
TW110111322A TWI762257B (en) 2021-03-29 2021-03-29 Method for recommending viewing directions in virtyal reality video and computer readable medium thereof

Country Status (1)

Country Link
TW (1) TWI762257B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110418110A (en) * 2019-07-25 2019-11-05 浙江钧普科技股份有限公司 A kind of video frequency tracking system and algorithm based on UWB technology
CN111510785A (en) * 2020-04-16 2020-08-07 Oppo广东移动通信有限公司 Video playing control method, device, terminal and computer readable storage medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110418110A (en) * 2019-07-25 2019-11-05 浙江钧普科技股份有限公司 A kind of video frequency tracking system and algorithm based on UWB technology
CN111510785A (en) * 2020-04-16 2020-08-07 Oppo广东移动通信有限公司 Video playing control method, device, terminal and computer readable storage medium

Also Published As

Publication number Publication date
TW202239199A (en) 2022-10-01

Similar Documents

Publication Publication Date Title
JP6944564B2 (en) Equipment and methods for gaze tracking
US10834454B2 (en) Personalized presentation enhancement using augmented reality
US10056115B2 (en) Automatic generation of video and directional audio from spherical content
US9189818B2 (en) Association of comments with screen locations during media content playback
US10020025B2 (en) Methods and systems for customizing immersive media content
US9213986B1 (en) Modified media conforming to user-established levels of media censorship
US20210211476A1 (en) Methods, systems, and media for recommending content based on network conditions
KR102025334B1 (en) Determining user interest through detected physical indicia
US10115433B2 (en) Section identification in video content
US8875212B2 (en) Systems and methods for remote control of interactive video
US10770113B2 (en) Methods and system for customizing immersive media content
US10622017B1 (en) Apparatus, a system, and a method of dynamically generating video data
US9558784B1 (en) Intelligent video navigation techniques
US20140344661A1 (en) Personalized Annotations
US9564177B1 (en) Intelligent video navigation techniques
US20140331246A1 (en) Interactive content and player
WO2011051959A1 (en) Method and apparatus for use with video sequences
US10739944B1 (en) System and method for generating user interface data to provide indicators associated with content
TWI762257B (en) Method for recommending viewing directions in virtyal reality video and computer readable medium thereof
US11825170B2 (en) Apparatus and associated methods for presentation of comments
US11592906B2 (en) Ocular focus sharing for digital content
WO2018004933A1 (en) Apparatus and method for gaze tracking
EP3596628B1 (en) Methods, systems and media for transforming fingerprints to detect unauthorized media content items
WO2023133155A1 (en) Implementations and methods for using mobile devices to communicate with a neural network semiconductor
US10191629B2 (en) Systems and methods for processing of visual content using affordances