TWM548794U - Head mounted display and display system - Google Patents

Head mounted display and display system Download PDF

Info

Publication number
TWM548794U
TWM548794U TW106202495U TW106202495U TWM548794U TW M548794 U TWM548794 U TW M548794U TW 106202495 U TW106202495 U TW 106202495U TW 106202495 U TW106202495 U TW 106202495U TW M548794 U TWM548794 U TW M548794U
Authority
TW
Taiwan
Prior art keywords
head mounted
display
target object
mounted display
input image
Prior art date
Application number
TW106202495U
Other languages
Chinese (zh)
Inventor
黃榆君
陳志誠
Original Assignee
宏碁股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 宏碁股份有限公司 filed Critical 宏碁股份有限公司
Priority to TW106202495U priority Critical patent/TWM548794U/en
Publication of TWM548794U publication Critical patent/TWM548794U/en

Links

Landscapes

  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

A head mounted display (HMD) is provided. The HMD includes: a display panel; a motion sensor; and a display controller. The motion sensor is configured to detect motion of the HMD to generate sensor data. The display controller is configured to retrieve an input image from a host, and obtain a target object from the input image. The display controller calculates a motion pattern of the target object in the input image according to the sensor data and predicts a motion trajectory of the target object. When the display controller determines that the trajectory is larger than a predetermined threshold, the display controller updates a sub-image associated with the target object in the input image, and displays the updated input image on the display panel.

Description

頭戴式顯示器及顯示系統 Head mounted display and display system

本創作係有關於顯示裝置,特別是有關於一種頭戴式顯示器及顯示系統。 This creation relates to display devices, and more particularly to a head mounted display and display system.

隨著技術發展,頭戴式顯示器(Head Mounted Display)亦常被用來觀賞虛擬實境之影像畫面。然而,頭戴式顯示器通常需要從一主控端接收虛擬實境之影像畫面,且頭戴式顯示器與主控端之間係透過一資料傳輸線(例如HDMI線)進行連接。此外,使用者在配戴一頭戴式顯示器觀看虛擬實境畫面時,因為使用者之頭部並非完全靜止,可能會有位移或是轉動的情況。此時,主控端需視情況以重新計算相應於上述移動的虛擬實境畫面,並再透過資料傳輸線傳送畫面至頭戴式顯示器。無論是重新計算畫面以及透過資料傳輸線傳送畫面均會耗費相當的時間,意即有可能會產生畫面延遲的情況。 With the development of technology, Head Mounted Display is also often used to view virtual reality images. However, a head-mounted display usually needs to receive a virtual reality image from a host, and the head-mounted display and the host are connected through a data transmission line (for example, an HDMI cable). In addition, when the user wears a head-mounted display to view the virtual reality picture, the user's head may not be completely stationary, and there may be displacement or rotation. At this time, the master needs to recalculate the virtual reality picture corresponding to the above movement according to the situation, and then transmit the picture to the head mounted display through the data transmission line. It takes a considerable amount of time to recalculate the picture and transfer the picture through the data transmission line, which means that there may be a picture delay.

因為,使用者在配戴頭戴式顯示器時,其眼睛離顯示面板相當近,故更易查察出有畫面延遲的情況。 Because the user's eyes are quite close to the display panel when wearing the head-mounted display, it is easier to check the picture delay.

因此,需要一種頭戴式顯示器及顯示系統以解決上述問題。 Therefore, there is a need for a head mounted display and display system to solve the above problems.

本創作係提供一種頭戴式顯示器,包括:一顯示面板;一移動感測器,用以偵測該頭戴式顯示器之移動以產生一感測器資料;一顯示控制器,用以從一主控端取得一輸入影像,並取得該輸入影像中之一目標物件,其中,該顯示控制器更依據來自該移動感測器之該感測器資料計算在該輸入影像中之該目標物件之一移動樣式,並預測該目標物件之一移動軌跡;其中當該顯示控制器判斷該移動軌跡超過一預定閥值時,該顯示控制器係本地更新在該輸入影像中關於該目標物件之子影像,並在該顯示面板播放更新後之輸入影像。 The present invention provides a head mounted display comprising: a display panel; a motion sensor for detecting movement of the head mounted display to generate a sensor data; and a display controller for The master obtains an input image and obtains one of the target objects in the input image, wherein the display controller further calculates the target object in the input image according to the sensor data from the motion sensor. a moving pattern, and predicting a movement trajectory of the target object; wherein when the display controller determines that the movement trajectory exceeds a predetermined threshold, the display controller locally updates the sub-image of the target object in the input image, And the updated input image is played on the display panel.

本創作更提供一種顯示系統,包括:一主控端;以及一頭戴式顯示器,其中該主控端係透過一資料傳輸線與該頭戴式顯示器相連接;其中該頭戴式顯示器係從一主控端取得一輸入影像,並取得該輸入影像中之一目標物件,其中該頭戴式顯示器更依據來自頭戴式顯示器中之一移動感測器所產生之一感測器資料計算在該輸入影像中之該目標物件之一移動樣式,並預測該目標物件之一移動軌跡;其中當該頭戴式顯示器判斷該移動軌跡超過一預定閥值時,該頭戴式顯示器係本地更新在該輸入影像中關於該目標物件之子影像,並在該頭戴式顯示器播放更新後之輸入影像。 The present invention further provides a display system comprising: a main control terminal; and a head mounted display, wherein the main control terminal is connected to the head mounted display through a data transmission line; wherein the head mounted display is from a The master obtains an input image and obtains one of the target objects in the input image, wherein the head mounted display is further calculated according to one sensor data generated by one of the mobile sensors in the head mounted display. Inputting a movement pattern of the target object in the image, and predicting a movement trajectory of the target object; wherein when the head mounted display determines that the movement trajectory exceeds a predetermined threshold, the head mounted display is locally updated Input a sub-image of the target object in the image, and play the updated input image on the head-mounted display.

100‧‧‧顯示系統 100‧‧‧Display system

110‧‧‧主控端 110‧‧‧Master

111‧‧‧處理器 111‧‧‧ Processor

112‧‧‧記憶體單元 112‧‧‧ memory unit

112A‧‧‧揮發性記憶體 112A‧‧‧ volatile memory

112B‧‧‧非揮發性記憶體 112B‧‧‧Non-volatile memory

113‧‧‧資料傳輸介面 113‧‧‧Data transmission interface

120‧‧‧頭戴式顯示器 120‧‧‧ head mounted display

121‧‧‧顯示控制器 121‧‧‧Display controller

122‧‧‧記憶體單元 122‧‧‧ memory unit

123‧‧‧資料傳輸介面 123‧‧‧Data transmission interface

124‧‧‧顯示面板 124‧‧‧ display panel

124L‧‧‧左眼顯示面板 124L‧‧‧Left eye display panel

124R‧‧‧右眼顯示面板 124R‧‧‧right eye display panel

125‧‧‧左眼鏡頭 125‧‧‧left eye lens

126‧‧‧右眼鏡頭 126‧‧‧right eye lens

127‧‧‧移動感測器 127‧‧‧Mobile Sensor

130‧‧‧資料傳輸線 130‧‧‧ data transmission line

131‧‧‧外殼 131‧‧‧Shell

210-214‧‧‧目標物件 210-214‧‧‧ Target object

S310-S350‧‧‧步驟 S310-S350‧‧‧Steps

第1圖係顯示依據本創作一實施例中之顯示系統的方塊圖。 BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a block diagram showing a display system in accordance with an embodiment of the present invention.

第2圖係顯示依據本創作一實施例中之一目標物件在畫面中移動的示意圖。 Figure 2 is a diagram showing the movement of a target object in a picture in accordance with an embodiment of the present invention.

第3圖係顯示依據本創作一實施例中用於儲存裝置之資料映射方法的流程圖。 Figure 3 is a flow chart showing a method of data mapping for a storage device in accordance with an embodiment of the present invention.

為使本創作之上述目的、特徵和優點能更明顯易懂,下文特舉一較佳實施例,並配合所附圖式,作詳細說明如下。 In order to make the above objects, features and advantages of the present invention more comprehensible, the following detailed description of the preferred embodiments and the accompanying drawings are set forth below.

第1圖係顯示依據本創作一實施例中之顯示系統的方塊圖。 BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a block diagram showing a display system in accordance with an embodiment of the present invention.

如第1圖所示,顯示系統100包括一主控端110及一頭戴式顯示器120,其中主控端110及頭戴式顯示器120係透過一資料傳輸線130連接。舉例來說,顯示系統100可用於虛擬實境(virtual reality)或模擬實境(simulated reality)之畫面顯示。例如主控端110可產生或從一影像來源取得欲播放之影像(例如可為立體影像、全景影像等等),並透過資料傳輸線130傳送欲播放之影像之頭戴式顯示器進行播放。 As shown in FIG. 1 , the display system 100 includes a main control terminal 110 and a head mounted display 120 . The main control terminal 110 and the head mounted display 120 are connected through a data transmission line 130 . For example, display system 100 can be used for visual display of virtual reality or simulated reality. For example, the host 110 can generate or capture an image to be played (for example, a stereoscopic image, a panoramic image, etc.) from an image source, and transmit the head-mounted display of the image to be played through the data transmission line 130 for playback.

在一實施例中,主控端110係包括一處理器111、一記憶體單元112、及一資料傳輸介面113。記憶體單元112係可儲存一或多個影像檔,且處理器111可選擇其中一影像檔,並對該影像檔進行相應之影像/視訊處理以得到欲播放之虛擬實境視訊畫面。舉例來說,記憶體單元112可包括一揮發性記憶體112A及一非揮發性記憶體112B。其中,揮發性記憶體例如可 為靜態隨機存取記憶體(SRAM)或動態隨機存取記憶體(DRAM),非揮發性記憶體112B例如可為一硬碟機、一固態硬碟、或一快閃記憶體,但本創作並不限於此。 In an embodiment, the host 110 includes a processor 111, a memory unit 112, and a data transmission interface 113. The memory unit 112 can store one or more image files, and the processor 111 can select one of the image files, and perform corresponding image/video processing on the image file to obtain a virtual reality video picture to be played. For example, the memory unit 112 can include a volatile memory 112A and a non-volatile memory 112B. Among them, volatile memory can be, for example For a static random access memory (SRAM) or a dynamic random access memory (DRAM), the non-volatile memory 112B can be, for example, a hard disk drive, a solid state hard disk, or a flash memory, but this creation Not limited to this.

資料傳輸介面113係用以從主控端110之處理器111接收影像資料(例如包括左眼影像及右眼影像,例如為RGB影像),並將影像資料透過顯示控制器121於頭戴式顯示器120進行播放。舉例來說,資料傳輸介面113可為高解析度多媒體介面(High Definition Multimedia Interface,HDMI)、或顯示埠(DisplayPort,DP)介面,但本創作並不限於此。 The data transmission interface 113 is configured to receive image data (for example, a left eye image and a right eye image, for example, an RGB image) from the processor 111 of the host 110, and transmit the image data to the head mounted display through the display controller 121. 120 to play. For example, the data transmission interface 113 can be a High Definition Multimedia Interface (HDMI) or a DisplayPort (DP) interface, but the creation is not limited thereto.

頭戴式顯示器120係包括一顯示控制器121、一記憶體單元122、一資料傳輸介面123、一顯示面板124、左眼鏡頭125、右眼鏡頭126、移動感測器127、以及一外殼131。顯示面板124、左眼鏡頭125、右眼鏡頭126係以一預定光學排列方式安置於外殼131中,用以讓頭戴式顯示器120之使用者可感受到虛擬實境之畫面。記憶體單元122例如可為一靜態隨機存取記憶體(SRAM)或動態隨機存取記憶體(DRAM),用以儲存來自主控端之輸入影像,並可做為輸出影像之影像緩衝器。 The head mounted display 120 includes a display controller 121, a memory unit 122, a data transmission interface 123, a display panel 124, a left lens head 125, a right lens 126, a motion sensor 127, and a housing 131. . The display panel 124, the left lens head 125, and the right lens head 126 are disposed in the housing 131 in a predetermined optical arrangement for allowing the user of the head mounted display 120 to feel the virtual reality picture. The memory unit 122 can be, for example, a static random access memory (SRAM) or a dynamic random access memory (DRAM) for storing input images from the host and serving as an image buffer for outputting images.

外殼131可包括一束帶或其他輔助裝置(未繪示)以供使用者戴於頭上以透過頭戴式顯示器120觀賞畫面。在一些實施例中,顯示面板124更可包括一左眼顯示面板124L及一右眼顯示面板124R,分別用於播放左眼影像及右眼影像。 The housing 131 can include a strap or other auxiliary device (not shown) for the user to wear on the head to view the screen through the head mounted display 120. In some embodiments, the display panel 124 further includes a left-eye display panel 124L and a right-eye display panel 124R for playing the left-eye image and the right-eye image, respectively.

顯示控制器121係用以控制在顯示面板124之顯示畫面。舉例來說,顯示控制器121係經由資料傳輸介面123從主控端110接收影像資料,例如包括左眼影像及右眼影像。一般 而言,在頭戴式顯示器120所播放的畫面幀率需達到60幀/秒,使用者才不會在使用頭戴式顯示器120觀賞虛擬實境影片或進行遊戲時明顯感受到畫面之跳動或延遲。 The display controller 121 is for controlling the display screen on the display panel 124. For example, the display controller 121 receives image data from the host terminal 110 via the data transmission interface 123, for example, including a left eye image and a right eye image. general In this case, the frame rate of the screen played by the head mounted display 120 needs to reach 60 frames/second, so that the user does not obviously feel the jitter of the screen when viewing the virtual reality movie or playing the game using the head mounted display 120. delay.

資料傳輸介面123係用以從主控端110之資料傳輸介面接收影像資料(例如包括左眼影像及右眼影像,例如為RGB影像),並將影像資料透過顯示控制器121於頭戴式顯示器120之顯示面板124進行播放。舉例來說,資料傳輸介面113可為高解析度多媒體介面(High Definition Multimedia Interface,HDMI)、或顯示埠(DisplayPort,DP)介面,但本創作並不限於此。 The data transmission interface 123 is configured to receive image data (for example, a left eye image and a right eye image, for example, an RGB image) from the data transmission interface of the host 110, and transmit the image data to the head mounted display through the display controller 121. The display panel 124 of 120 plays. For example, the data transmission interface 113 can be a High Definition Multimedia Interface (HDMI) or a DisplayPort (DP) interface, but the creation is not limited thereto.

需注意的是,資料傳輸線130係符合資料傳輸介面113及123所支援之資料傳輸協定及多媒體傳輸協定,且資料傳輸介面113及123可為相同的資料傳輸協定介面,例如同為HDMI或DisplayPort介面,亦或是可透過資料傳輸線130轉換為相容之介面,例如可由HDMI介面轉為DisplayPort、或是由DisplayPort轉換為HDMI介面。 It should be noted that the data transmission line 130 is compliant with the data transmission protocol and multimedia transmission protocol supported by the data transmission interfaces 113 and 123, and the data transmission interfaces 113 and 123 can be the same data transmission protocol interface, for example, the same HDMI or DisplayPort interface. Or can be converted to a compatible interface through the data transmission line 130, for example, can be converted from HDMI interface to DisplayPort, or converted from DisplayPort to HDMI interface.

移動感測器127係可偵測頭戴式顯示器120之移動,並將偵測到之頭戴式顯示器120之移動資訊回報至顯示控制器121及主控端110。舉例來說,移動感測器127可偵測頭戴式顯示器120在9軸之移動,意即針對在x軸、y軸、及z軸之位移及轉動(即分別為roll/pitch/yaw旋轉)。 The mobile sensor 127 detects the movement of the head mounted display 120 and reports the detected movement information of the head mounted display 120 to the display controller 121 and the host terminal 110. For example, the motion sensor 127 can detect the movement of the head mounted display 120 on the 9-axis, that is, the displacement and rotation on the x-axis, the y-axis, and the z-axis (ie, roll/pitch/yaw rotation, respectively). ).

第2圖係顯示依據本創作一實施例中之一目標物件在畫面中移動的示意圖。在一實施例中,若在場景200中係包括一目標物件210在場景200中從左至右移動,則在不同播放 時間之場景200之影像,則會看到在不同位置的物件211、212、213、214等等。實際上,這些物件210~214可能是屬於同一目標物件。 Figure 2 is a diagram showing the movement of a target object in a picture in accordance with an embodiment of the present invention. In an embodiment, if a target object 210 is included in the scene 200 to move from left to right in the scene 200, then the game is played differently. The image of the scene of time 200 will see objects 211, 212, 213, 214, etc. at different locations. In fact, these objects 210~214 may belong to the same target object.

更進一步而言,顯示控制器121係可從場景200之畫面中辨識出目標物件210,並預測其移動軌跡。在一些實施例中,目標物件210可為場景200之影像中所切割出之複數個區段(segment)之其中一者。 Furthermore, the display controller 121 can recognize the target object 210 from the screen of the scene 200 and predict its movement trajectory. In some embodiments, the target object 210 can be one of a plurality of segments cut in the image of the scene 200.

舉例來說,要預測各個區段之移動軌跡,係依據先前區域之位置及速度。換言之,各個區段之軌跡T係可表示為其先前位置L及先前速度V之一函式:T(t)=L(t0)+V(t-t0) For example, to predict the movement trajectory of each segment, based on the location and speed of the previous region. In other words, the trajectory T of each segment can be expressed as one of its previous position L and the previous velocity V: T(t)=L(t 0 )+V(tt 0 )

其中t0為先前時間之標籤(tag),t為未來時間之標籤。意即可利用目前時間t0的目標物件之位置及速度以預測該目標物件在未來時間點t之移動軌跡。 Where t 0 is the tag of the previous time and t is the tag of the future time. It is possible to use the position and velocity of the target object at the current time t0 to predict the movement trajectory of the target object at a future time point t.

一般而言,因為有尺寸、重量、散熱等等的考量,頭戴式顯示器120之運算能力及系統資源往往會比主控端110少,且頭戴式顯示器120之顯示控制器121例如可用現場可程式化閘陣列(field-programmable gate array,FPGA)搭配相應的數位信號處理器及相關電路來實現。在一些實施例中,頭戴式顯示器120之顯示控制器121亦可用一晶片系統(system-on-chip,SOC)來實現。 In general, because of the size, weight, heat dissipation, etc., the computing power and system resources of the head mounted display 120 tend to be less than that of the host terminal 110, and the display controller 121 of the head mounted display 120 can be used, for example, on site. A field-programmable gate array (FPGA) is implemented with a corresponding digital signal processor and associated circuitry. In some embodiments, the display controller 121 of the head mounted display 120 can also be implemented using a system-on-chip (SOC).

在一些實施例中,顯示控制器121係可分析來自主控端110之輸入影像,並從輸入影像中取得目標物件,例如可透過前景/背景分離(foreground/background segmentation)處 理。在一些實施例中,主控端110透過資料傳輸線130傳送輸入影像至頭戴式顯示器120時,亦會伴隨著傳送該影像中相應的物件資訊,例如可依據該輸入影像相應之一深度圖或一二元遮罩影像(binary mask image)來取得影像中之至少一目標物件。在取得目標物件後,顯示控制器121即可依據來自移動感測器127之感測器資料來計算目標物件之移動樣式(motion pattern)或移動量。移動樣式例如可為該目標物件之移動向量或是相對的移動速度、轉動速度、或位移。 In some embodiments, the display controller 121 can analyze the input image from the host 110 and retrieve the target object from the input image, such as through foreground/background segmentation. Reason. In some embodiments, when the host 110 transmits the input image to the head mounted display 120 through the data transmission line 130, the corresponding object information in the image is also transmitted, for example, according to the corresponding depth image of the input image or A binary mask image is used to obtain at least one target object in the image. After the target object is obtained, the display controller 121 can calculate the motion pattern or the amount of movement of the target object based on the sensor data from the motion sensor 127. The movement pattern can be, for example, a motion vector of the target object or a relative movement speed, rotational speed, or displacement.

接著,顯示控制器121係預測目標物件之一移動軌跡。若在單位時間間隔(例如16ms,但非限定)之內目標物件的移動量/轉動量大於一預定閥值,則顯示控制器121會以來自主控端110之影像為準,並將其播放於顯示面板124。若在單位時間間隔(例如16ms,但非限定)之內目標物件的移動量/轉動量並未大於一預定閥值,則顯示控制器121則會進行本地端之畫面更新。 Next, the display controller 121 predicts a movement trajectory of one of the target objects. If the amount of movement/rotation of the target object is greater than a predetermined threshold within a unit time interval (eg, 16 ms, but not limited), the display controller 121 will control the image of the self-control terminal 110 and play it. On the display panel 124. If the amount of movement/rotation of the target object within a unit time interval (for example, 16 ms, but not limited) is not greater than a predetermined threshold, the display controller 121 performs a screen update of the local end.

舉例來說,因為主控端110在接收到來自移動感測器127之感測器資料後,需要再花時間計算相應於頭戴式顯示器120之移動的畫面。此外,透過資料傳輸線130傳送資料亦有些微延遲,視資料傳輸線130之長度而定。再加上使用者利用頭戴式顯示器120觀看影像時,因為影像離眼睛之距離相當近,故使用者會較易察覺畫面產生延遲的情況。也因此,顯示控制器121可在目標物件移動較小時進行本地端之畫面更新,利用較低運算量之目標物件移動軌跡預測,並僅在畫面中更新關於該目標物件之區域的畫面,且可在使用者無法察覺畫面延 遲的情況下進行畫面更新,意即在頭戴式顯示器120之顯示面板124播放在頭戴式顯示器120本地端之更新影像。 For example, because the master 110 receives the sensor data from the motion sensor 127, it takes time to calculate a picture corresponding to the movement of the head mounted display 120. In addition, there is a slight delay in transmitting data through the data transmission line 130, depending on the length of the data transmission line 130. In addition, when the user views the image by using the head mounted display 120, since the distance between the image and the eye is relatively close, the user can easily detect that the picture is delayed. Therefore, the display controller 121 can perform the screen update of the local end when the target object moves less, move the trajectory prediction with the target object of a lower computation amount, and update only the image of the region of the target object in the screen, and Can not be noticed by the user The screen update is performed in the late case, that is, the updated image on the local end of the head mounted display 120 is played on the display panel 124 of the head mounted display 120.

第3圖係顯示依據本創作一實施例中之用於頭戴式顯示器之畫面更新方法的流程圖。 Figure 3 is a flow chart showing a method of updating a picture for a head mounted display in accordance with an embodiment of the present invention.

在步驟S310,從頭戴式顯示器之移動感測器取得感測器資料。 At step S310, sensor data is taken from the motion sensor of the head mounted display.

在步驟S320,計算來自主控端中之一目標物件的移動量。 At step S320, the amount of movement from one of the target objects in the master is calculated.

在步驟S330,預測目標物件之一移動軌跡。 In step S330, one of the target objects is predicted to move the trajectory.

在步驟S335,判斷該移動軌跡是否超過一預定閥值。若是,則執行步驟S350,若否,則執行步驟S340。顯示控制器121可在目標物件移動較小時進行本地端之畫面更新,利用較低運算量之目標物件移動軌跡預測,並僅在畫面中更新關於該目標物件之區域的畫面,且可在使用者無法察覺畫面延遲的情況下進行畫面更新。若移動軌跡太大(即超過該預定閥值),已超出顯示控制器121所能計算之範圍,此時顯示控制器121係直接在頭戴式顯示器播放來自主控端之輸入影像。 In step S335, it is determined whether the movement trajectory exceeds a predetermined threshold. If yes, go to step S350, if no, go to step S340. The display controller 121 can perform the local-end picture update when the target object moves less, move the trajectory prediction with the target object with a lower computational amount, and update the picture about the target object only in the picture, and can be used. The screen update can be performed without being aware of the screen delay. If the movement trajectory is too large (ie, exceeds the predetermined threshold), the range that can be calculated by the display controller 121 is exceeded, and the display controller 121 plays the input image from the main control directly on the head mounted display.

在步驟S340,由頭戴式顯示器更新在輸入影像中之目標物件,並在頭戴式顯示器播放更新後之影像。 In step S340, the target object in the input image is updated by the head mounted display, and the updated image is played on the head mounted display.

在步驟S350,在頭戴式顯示器直接播放來自主控端之輸入影像。 In step S350, the input image from the host terminal is directly played on the head mounted display.

本創作雖以較佳實施例揭露如上,然其並非用以限定本創作的範圍,任何所屬技術領域中具有通常知識者,在不脫離本創作之精神和範圍內,當可做些許的更動與潤飾,因 此本創作之保護範圍當視後附之申請專利範圍所界定者為準。 The present invention is disclosed in the above preferred embodiments, and is not intended to limit the scope of the present invention. Any person having ordinary skill in the art can make some changes without departing from the spirit and scope of the present invention. Retouching The scope of protection of this creation is subject to the definition of the scope of the patent application.

100‧‧‧顯示系統 100‧‧‧Display system

110‧‧‧主控端 110‧‧‧Master

111‧‧‧處理器 111‧‧‧ Processor

112‧‧‧記憶體單元 112‧‧‧ memory unit

113‧‧‧資料傳輸介面 113‧‧‧Data transmission interface

112A‧‧‧揮發性記憶體 112A‧‧‧ volatile memory

112B‧‧‧非揮發性記憶體 112B‧‧‧Non-volatile memory

120‧‧‧頭戴式顯示器 120‧‧‧ head mounted display

121‧‧‧顯示控制器 121‧‧‧Display controller

122‧‧‧記憶體單元 122‧‧‧ memory unit

123‧‧‧資料傳輸介面 123‧‧‧Data transmission interface

124‧‧‧顯示面板 124‧‧‧ display panel

124L‧‧‧左眼顯示面板 124L‧‧‧Left eye display panel

124R‧‧‧右眼顯示面板 124R‧‧‧right eye display panel

125‧‧‧左眼鏡頭 125‧‧‧left eye lens

126‧‧‧右眼鏡頭 126‧‧‧right eye lens

127‧‧‧移動感測器 127‧‧‧Mobile Sensor

130‧‧‧資料傳輸線 130‧‧‧ data transmission line

131‧‧‧外殼 131‧‧‧Shell

Claims (10)

一種頭戴式顯示器,包括:一顯示面板;一移動感測器,用以偵測該頭戴式顯示器之移動以產生一感測器資料;一顯示控制器,用以從一主控端取得一輸入影像,並取得該輸入影像中之一目標物件,其中,該顯示控制器更依據來自該移動感測器之該感測器資料計算在該輸入影像中之該目標物件之一移動樣式,並預測該目標物件之一移動軌跡;其中當該顯示控制器判斷該移動軌跡超過一預定閥值時,該顯示控制器係本地更新在該輸入影像中關於該目標物件之子影像,並在該顯示面板播放更新後之輸入影像。 A head mounted display comprising: a display panel; a motion sensor for detecting movement of the head mounted display to generate a sensor data; and a display controller for obtaining from a master Inputting an image and obtaining a target object in the input image, wherein the display controller further calculates a movement pattern of the target object in the input image according to the sensor data from the motion sensor. And predicting a movement trajectory of the target object; wherein when the display controller determines that the movement trajectory exceeds a predetermined threshold, the display controller locally updates the sub-image of the target object in the input image, and displays the sub-image on the target object The panel plays the updated input image. 如申請專利範圍第1項所述之頭戴式顯示器,其中該顯示控制器係依據該目標物件在該輸入影像中之一位置及一速度以預測在一預定時間間隔後之該目標物件之該移動軌跡。 The head mounted display of claim 1, wherein the display controller is configured to predict the target object after a predetermined time interval according to a position and a speed of the target object in the input image. Move the track. 如申請專利範圍第1項所述之頭戴式顯示器,其中該顯示控制器係執行一前景/背景分離處理以從該輸入影像中取得該目標物件。 The head mounted display of claim 1, wherein the display controller performs a foreground/background separation process to retrieve the target object from the input image. 如申請專利範圍第1項所述之頭戴式顯示器,其中該顯示控制器係依據來自該主控端之該輸入影像相應之一深度圖或一二元遮罩影像以取得該目標物件。 The head mounted display of claim 1, wherein the display controller obtains the target object according to a corresponding depth map or a binary mask image of the input image from the main control end. 如申請專利範圍第1項所述之頭戴式顯示器,其中當該顯示控制器更判斷該移動軌跡未超過一預定閥值時,該顯示控制器係直接在該顯示面板上播放該輸入影像。 The head mounted display of claim 1, wherein the display controller plays the input image directly on the display panel when the display controller further determines that the movement trajectory does not exceed a predetermined threshold. 一種顯示系統,包括:一主控端;以及一頭戴式顯示器,其中該主控端係透過一資料傳輸線與該頭戴式顯示器相連接;其中該頭戴式顯示器係從一主控端取得一輸入影像,並取得該輸入影像中之一目標物件,其中該頭戴式顯示器更依據來自頭戴式顯示器中之一移動感測器所產生之一感測器資料計算在該輸入影像中之該目標物件之一移動樣式,並預測該目標物件之一移動軌跡;其中當該頭戴式顯示器判斷該移動軌跡超過一預定閥值時,該頭戴式顯示器係本地更新在該輸入影像中關於該目標物件之子影像,並在該頭戴式顯示器播放更新後之輸入影像。 A display system includes: a master terminal; and a head mounted display, wherein the master terminal is connected to the head mounted display through a data transmission line; wherein the head mounted display is obtained from a master terminal Inputting an image and obtaining a target object in the input image, wherein the head mounted display is further calculated in the input image according to one sensor data generated by a mobile sensor in the head mounted display One of the target objects moves the pattern and predicts a movement trajectory of the target object; wherein when the head mounted display determines that the movement trajectory exceeds a predetermined threshold, the head mounted display is locally updated in the input image A sub-image of the target object, and the updated input image is played on the head mounted display. 如申請專利範圍第6項所述之顯示系統,其中該頭戴式顯示器係依據該目標物件在該輸入影像中之一位置及一速度以預測在一預定時間間隔後之該目標物件之該移動軌跡。 The display system of claim 6, wherein the head mounted display predicts the movement of the target object after a predetermined time interval according to a position and a speed of the target object in the input image. Track. 如申請專利範圍第6項所述之顯示系統,其中該頭戴式顯示器係執行一前景/背景分離處理以從該輸入影像中取得該目標物件。 The display system of claim 6, wherein the head mounted display performs a foreground/background separation process to retrieve the target object from the input image. 如申請專利範圍第6項所述之顯示系統,其中該頭戴式顯示器係依據來自該主控端之該輸入影像相應之一深度圖或一二元遮罩影像以取得該目標物件。 The display system of claim 6, wherein the head mounted display obtains the target object according to a corresponding depth map or a binary mask image of the input image from the main control end. 如申請專利範圍第6項所述之顯示系統,其中當該頭戴式顯示器判斷該移動軌跡未超過一預定閥值時,該頭戴式顯示器係直接在該顯示面板上播放該輸入影像。 The display system of claim 6, wherein the head mounted display directly plays the input image on the display panel when the head mounted display determines that the movement trajectory does not exceed a predetermined threshold.
TW106202495U 2017-02-21 2017-02-21 Head mounted display and display system TWM548794U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW106202495U TWM548794U (en) 2017-02-21 2017-02-21 Head mounted display and display system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW106202495U TWM548794U (en) 2017-02-21 2017-02-21 Head mounted display and display system

Publications (1)

Publication Number Publication Date
TWM548794U true TWM548794U (en) 2017-09-11

Family

ID=60764882

Family Applications (1)

Application Number Title Priority Date Filing Date
TW106202495U TWM548794U (en) 2017-02-21 2017-02-21 Head mounted display and display system

Country Status (1)

Country Link
TW (1) TWM548794U (en)

Similar Documents

Publication Publication Date Title
CN107801045B (en) Method, device and system for automatically zooming when playing augmented reality scene
US9904056B2 (en) Display
US9781356B1 (en) Panoramic video viewer
US11350156B2 (en) Method and apparatus for implementing video stream overlays
JP2018139102A (en) Method and apparatus for determining interested spot in immersive content
US11086395B2 (en) Image processing apparatus, image processing method, and storage medium
JP6130478B1 (en) Program and computer
US10499066B2 (en) Method and apparatus for improving efficiency of content delivery based on consumption data relative to spatial data
JP2017528947A (en) System and method for use in playback of panoramic video content
KR102336997B1 (en) Server, display apparatus and control method thereof
TWI572203B (en) Media streaming system, control method and non-transitory computer readable storage medium
KR20170003441A (en) Method and device for processing a part of an immersive video content according to the position of reference parts
JP2019531038A (en) Display device and control method thereof
KR20210024567A (en) Apparatus and method for generating image data stream
WO2019019232A1 (en) Method for playing video based on vr head-mounted device, and vr head-mounted device
US11099392B2 (en) Stabilized and tracked enhanced reality images
JP2017121082A (en) Program and computer
US20180350125A1 (en) Method and apparatus for inciting a viewer to rotate toward a reference direction when consuming an immersive content item
JP2022051978A (en) Image processing device, image processing method, and program
US11187895B2 (en) Content generation apparatus and method
US11917011B2 (en) Resilient rendering for augmented-reality devices
TWM548794U (en) Head mounted display and display system
WO2022004422A1 (en) Information processing device, information processing method, and recording medium
TWM630947U (en) Stereoscopic image playback apparatus
US11782666B1 (en) Aggregate view of image information on display devices