TWI757727B - Method for compensating visual field defects, electronic device, smart glasses, computer readable storage medium - Google Patents

Method for compensating visual field defects, electronic device, smart glasses, computer readable storage medium Download PDF

Info

Publication number
TWI757727B
TWI757727B TW109112900A TW109112900A TWI757727B TW I757727 B TWI757727 B TW I757727B TW 109112900 A TW109112900 A TW 109112900A TW 109112900 A TW109112900 A TW 109112900A TW I757727 B TWI757727 B TW I757727B
Authority
TW
Taiwan
Prior art keywords
visual field
light sensitivity
specific
value
center point
Prior art date
Application number
TW109112900A
Other languages
Chinese (zh)
Other versions
TW202141234A (en
Inventor
嚴介琳
呂熙庭
Original Assignee
宏達國際電子股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 宏達國際電子股份有限公司 filed Critical 宏達國際電子股份有限公司
Priority to TW109112900A priority Critical patent/TWI757727B/en
Publication of TW202141234A publication Critical patent/TW202141234A/en
Application granted granted Critical
Publication of TWI757727B publication Critical patent/TWI757727B/en

Links

Images

Landscapes

  • Eye Examination Apparatus (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Liquid Crystal (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

The invention provides a method for compensating visual field defects, electronic device, smart glasses, and a computer readable storage medium. The method includes: obtaining a visual field graph of a wearer, and identifying a visual field defect area in the visual field graph; obtaining a visual content, and identifying a specific area in the visual content corresponding to the visual field defect area, where the specific area includes a plurality of specific pixels; adjusting the brightness value of each specific pixel according to the corresponding light sensitivity value to adjust the visual content; display the adjusted visual content.

Description

補償視野缺損的方法、電子裝置、智慧型眼鏡及電腦可讀儲存媒體Method, electronic device, smart glasses, and computer-readable storage medium for compensating visual field defect

本發明是有關於一種視覺輔助技術,且特別是有關於一種補償視野缺損的方法、電子裝置、智慧型眼鏡及電腦可讀儲存媒體。The present invention relates to a visual aid technology, and more particularly, to a method for compensating for visual field defect, an electronic device, smart glasses and a computer-readable storage medium.

對於具有青光眼的患者而言,其視野將因眼睛在某些區域的感光能力不佳而出現視野缺損區域,而此視野缺損區域對患者的生活帶來一定程度的困擾。For patients with glaucoma, their visual field will appear a visual field defect area due to the poor photosensitive ability of the eye in some areas, and this visual field defect area will bring a certain degree of trouble to the patient's life.

隨著虛擬實境(virtual reality,VR)/擴增實境(augmented reality,AR)技術的成熟,市面上也已出現各式應用VR/AR來對使用者提供視覺輔助的技術,但尚未有能夠對具有青光眼或有視野缺損的患者提供視覺輔助的技術。With the maturity of virtual reality (VR)/augmented reality (AR) technologies, various VR/AR technologies have appeared on the market to provide visual assistance to users, but there are no such technologies yet. Technology capable of providing visual assistance to patients with glaucoma or visual field defects.

有鑑於此,本發明提供一種補償視野缺損的方法、電子裝置、智慧型眼鏡及電腦可讀儲存媒體,其可用於解決上述技術問題。In view of this, the present invention provides a method, electronic device, smart glasses, and computer-readable storage medium for compensating for visual field defect, which can be used to solve the above-mentioned technical problems.

本發明提供一種補償視野缺損的方法,所述方法包括:取得一穿戴者的一視野圖;識別出視野圖中的一視野缺損區域,其中視野缺損區域包括多個光敏感度值,且各光敏感度值低於一預設門限值;取得一視覺內容,並在視覺內容中識別出對應於視野缺損區域的一特定區域,其中特定區域包括多個特定像素,且各特定像素對應於前述光敏感度值的其中之一;依據對應的光敏感度值調整各特定像素的亮度值,以調整視覺內容;顯示調整後的視覺內容。The present invention provides a method for compensating visual field defect, the method comprising: obtaining a visual field map of a wearer; identifying a visual field defect area in the visual field map, wherein the visual field defect area includes a plurality of light sensitivity values, and each light sensitivity The value is lower than a preset threshold value; a visual content is obtained, and a specific area corresponding to the visual field defect area is identified in the visual content, wherein the specific area includes a plurality of specific pixels, and each specific pixel corresponds to the aforementioned light sensitivity value One of them; adjust the brightness value of each specific pixel according to the corresponding light sensitivity value to adjust the visual content; display the adjusted visual content.

本發明提供一種電子裝置,包括儲存電路及處理器。儲存電路儲存多個模組。處理器耦接儲存電路,並存取前述模組以執行下列步驟:取得一穿戴者的一視野圖;識別出視野圖中的一視野缺損區域,其中視野缺損區域包括多個光敏感度值,且各光敏感度值低於一預設門限值;取得一視覺內容,並在視覺內容中識別出對應於視野缺損區域的一特定區域,其中特定區域包括多個特定像素,且各特定像素對應於前述光敏感度值的其中之一;依據對應的光敏感度值調整各特定像素的亮度值,以調整視覺內容;顯示調整後的視覺內容。The present invention provides an electronic device including a storage circuit and a processor. The storage circuit stores a plurality of modules. The processor is coupled to the storage circuit, and accesses the aforementioned module to perform the following steps: obtaining a visual field map of a wearer; identifying a visual field defect area in the visual field map, wherein the visual field defect area includes a plurality of light sensitivity values, and Each light sensitivity value is lower than a preset threshold value; a visual content is obtained, and a specific area corresponding to the visual field defect area is identified in the visual content, wherein the specific area includes a plurality of specific pixels, and each specific pixel corresponds to the aforementioned One of the light sensitivity values; adjust the brightness value of each specific pixel according to the corresponding light sensitivity value to adjust the visual content; display the adjusted visual content.

本發明提供一種補償視野缺損的方法,適於具有一前鏡頭的一智慧型眼鏡,所述方法包括:取得一穿戴者的一視野圖;識別出視野圖中的一視野缺損區域,其中視野缺損區域包括多個光敏感度值,且各光敏感度值低於一預設門限值;取得由前鏡頭拍攝的一視覺內容及穿戴者的一注視中心點,並依據注視中心點在視覺內容中識別出對應於視野缺損區域的一特定區域,其中特定區域包括多個特定像素,且各特定像素對應於前述光敏感度值的其中之一;依據對應的光敏感度值調整各特定像素的亮度值,以調整特定區域;依據注視中心點呈現調整後的特定區域。The present invention provides a method for compensating visual field defect, which is suitable for a smart glasses with a front lens. The method includes: obtaining a visual field map of a wearer; identifying a visual field defect area in the visual field map, wherein the visual field defect is The area includes a plurality of light sensitivity values, and each light sensitivity value is lower than a preset threshold value; obtains a visual content captured by the front lens and a gaze center point of the wearer, and identifies the visual content according to the gaze center point A specific area corresponding to the visual field defect area, wherein the specific area includes a plurality of specific pixels, and each specific pixel corresponds to one of the aforementioned light sensitivity values; adjust the brightness value of each specific pixel according to the corresponding light sensitivity value to adjust Specific area; renders the adjusted specific area based on the gaze center point.

本發明提供一種智慧型眼鏡,包括儲存電路、前鏡頭及處理器。儲存電路儲存多個模組。處理器耦接儲存電路及前鏡頭,並存取前述模組以執行下列步驟:取得一穿戴者的一視野圖;識別出視野圖中的一視野缺損區域,其中視野缺損區域包括多個光敏感度值,且各光敏感度值低於一預設門限值;取得由前鏡頭拍攝的一視覺內容及穿戴者的一注視中心點,並依據注視中心點在視覺內容中識別出對應於視野缺損區域的一特定區域,其中特定區域包括多個特定像素,且各特定像素對應於前述光敏感度值的其中之一;依據對應的光敏感度值調整各特定像素的亮度值,以調整特定區域;依據注視中心點呈現調整後的特定區域。The present invention provides smart glasses, including a storage circuit, a front lens and a processor. The storage circuit stores a plurality of modules. The processor is coupled to the storage circuit and the front lens, and accesses the aforementioned module to perform the following steps: obtaining a visual field map of a wearer; identifying a visual field defect area in the visual field map, wherein the visual field defect area includes a plurality of light sensitivities and each light sensitivity value is lower than a preset threshold value; obtain a visual content shot by the front lens and a gaze center point of the wearer, and identify the visual field corresponding to the visual field defect area in the visual content according to the gaze center point a specific area, wherein the specific area includes a plurality of specific pixels, and each specific pixel corresponds to one of the aforementioned light sensitivity values; the brightness value of each specific pixel is adjusted according to the corresponding light sensitivity value to adjust the specific area; according to the gaze center Points render a specific area after adjustment.

本發明提供一種電腦可讀儲存媒體,其嵌入有一可執行電腦程式機制,可執行電腦程式機制包括指令用於:取得一穿戴者的一視野圖;識別出視野圖中的一視野缺損區域,其中視野缺損區域包括多個光敏感度值,且各光敏感度值低於一預設門限值;取得一視覺內容,並在視覺內容中識別出對應於視野缺損區域的一特定區域,其中特定區域包括多個特定像素,且各特定像素對應於前述光敏感度值的其中之一;依據對應的光敏感度值調整各特定像素的亮度值,以調整視覺內容;顯示調整後的視覺內容。The present invention provides a computer-readable storage medium embedded with an executable computer program mechanism, wherein the executable computer program mechanism includes instructions for: obtaining a visual field map of a wearer; identifying a visual field defect area in the visual field map, wherein The visual field defect area includes a plurality of light sensitivity values, and each light sensitivity value is lower than a preset threshold value; a visual content is obtained, and a specific area corresponding to the visual field defect area is identified in the visual content, wherein the specific area includes multiple Each specific pixel corresponds to one of the aforementioned light sensitivity values; the brightness value of each specific pixel is adjusted according to the corresponding light sensitivity value to adjust the visual content; the adjusted visual content is displayed.

本發明提供一種電腦可讀儲存媒體,其嵌入有一可執行電腦程式機制,可執行電腦程式機制包括指令用於:取得一穿戴者的一視野圖;識別出視野圖中的一視野缺損區域,其中視野缺損區域包括多個光敏感度值,且各光敏感度值低於一預設門限值;取得由前鏡頭拍攝的一視覺內容及穿戴者的一注視中心點,並依據注視中心點在視覺內容中識別出對應於視野缺損區域的一特定區域,其中特定區域包括多個特定像素,且各特定像素對應於視野缺損區域中前述光敏感度值的其中之一;依據對應的光敏感度值調整各特定像素的亮度值,以調整特定區域;依據注視中心點呈現調整後的特定區域。The present invention provides a computer-readable storage medium embedded with an executable computer program mechanism, wherein the executable computer program mechanism includes instructions for: obtaining a visual field map of a wearer; identifying a visual field defect area in the visual field map, wherein The visual field defect area includes a plurality of light sensitivity values, and each light sensitivity value is lower than a preset threshold value; a visual content photographed by the front lens and a gaze center point of the wearer are obtained, and according to the gaze center point in the visual content Identifying a specific area corresponding to the visual field defect area, wherein the specific area includes a plurality of specific pixels, and each specific pixel corresponds to one of the aforementioned light sensitivity values in the visual field defect area; adjust each specific pixel according to the corresponding light sensitivity value to adjust the specific area; the adjusted specific area is presented according to the center of gaze.

基於上述,本發明可對具視野缺損區域的穿戴者提供一定程度的視覺輔助,以讓穿戴者能夠順利觀察到位於視野缺損區域內的視覺內容。Based on the above, the present invention can provide a certain degree of visual assistance to the wearer with a visual field defect area, so that the wearer can smoothly observe the visual content located in the visual field defect area.

請參照圖1,其是依據本發明之一實施例繪示的電子裝置與頭戴式顯示器的示意圖。在圖1中,電子裝置110例如是連接於頭戴式顯示器120的個人電腦、智慧型裝置或其他可用於產生/提供視覺內容(例如VR/AR內容)予頭戴式顯示器120(例如是VR/AR頭盔、VR/AR智慧型眼鏡)的裝置,但可不限於此。Please refer to FIG. 1 , which is a schematic diagram of an electronic device and a head-mounted display according to an embodiment of the present invention. In FIG. 1 , the electronic device 110 is, for example, a personal computer connected to the head-mounted display 120 , a smart device, or other devices that can be used to generate/provide visual content (eg, VR/AR content) to the head-mounted display 120 (eg, VR/AR content) /AR helmet, VR/AR smart glasses), but not limited to this.

如圖1所示,電子裝置110可包括儲存電路112及處理器114,其中儲存電路112例如是任意型式的固定式或可移動式隨機存取記憶體(Random Access Memory,RAM)、唯讀記憶體(Read-Only Memory,ROM)、快閃記憶體(Flash memory)、硬碟或其他類似裝置或這些裝置的組合,而可用以記錄多個程式碼或模組。As shown in FIG. 1 , the electronic device 110 may include a storage circuit 112 and a processor 114 , wherein the storage circuit 112 is, for example, any type of fixed or removable random access memory (Random Access Memory, RAM), read-only memory Read-Only Memory (ROM), flash memory (Flash memory), hard disk or other similar devices or a combination of these devices can be used to record multiple code or modules.

處理器114耦接於儲存電路112,並可為一般用途處理器、特殊用途處理器、傳統的處理器、數位訊號處理器、多個微處理器(microprocessor)、一個或多個結合數位訊號處理器核心的微處理器、控制器、微控制器、特殊應用積體電路(Application Specific Integrated Circuit,ASIC)、現場可程式閘陣列電路(Field Programmable Gate Array,FPGA)、任何其他種類的積體電路、狀態機、基於進階精簡指令集機器(Advanced RISC Machine,ARM)的處理器以及類似品。The processor 114 is coupled to the storage circuit 112 and can be a general purpose processor, a special purpose processor, a conventional processor, a digital signal processor, a plurality of microprocessors, one or more combined digital signal processors Microprocessors, controllers, microcontrollers, Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs), any other kind of integrated circuits , state machines, Advanced RISC Machine (ARM)-based processors, and the like.

在本發明的實施例中,頭戴式顯示器120可具有前鏡頭122,其可用於拍攝位於頭戴式顯示器120的穿戴者前方的景觀,並將其提供予電子裝置110作為視覺內容VC。概略而言,在本發明的實施例中,電子裝置110可在取得穿戴者的視野缺損區域之後,相應地調整視覺內容VC中對應於視野缺損區域的特定區域的亮度,並將調整後的視覺內容VC’提供予頭戴式顯示器120,以由頭戴式顯示器120將調整後的視覺內容VC’呈現予穿戴者觀看。藉此,可讓原本無法正常觀察位於視野缺損區域內景觀的穿戴者能夠順利地觀察位於視野缺損區域內的景觀,相關細節將在之後詳述。In an embodiment of the present invention, the head mounted display 120 may have a front lens 122, which may be used to capture the landscape in front of the wearer of the head mounted display 120 and provide it to the electronic device 110 as the visual content VC. Roughly speaking, in the embodiment of the present invention, the electronic device 110 can adjust the brightness of a specific area in the visual content VC corresponding to the visual field defect area correspondingly after obtaining the wearer's visual field defect area, and adjust the adjusted visual field. The content VC' is provided to the head mounted display 120, so that the adjusted visual content VC' is presented by the head mounted display 120 to the wearer for viewing. In this way, the wearer who could not normally observe the landscape located in the visual field defect area can smoothly observe the landscape located in the visual field defect area, and the relevant details will be described in detail later.

此外,在其他實施例中,當頭戴式顯示器120實現為一體機(all-in-one)的態樣時,上述調整視覺內容VC的機制亦可由頭戴式顯示器120自行執行,並可將調整後的視覺內容VC’呈現予穿戴者觀看,以提供穿戴者視覺上的輔助,但可不限於此。In addition, in other embodiments, when the head-mounted display 120 is implemented in an all-in-one form, the above-mentioned mechanism for adjusting the visual content VC can also be performed by the head-mounted display 120 itself, and the The adjusted visual content VC' is presented to the wearer for viewing, so as to provide the wearer with visual assistance, but not limited to this.

為便於說明,以下將暫假設上述調整視覺內容VC的機制係由圖1的電子裝置110執行,但其並非用以限定本發明可能的實施方式。For the convenience of description, the following will temporarily assume that the above-mentioned mechanism for adjusting the visual content VC is executed by the electronic device 110 in FIG. 1 , but it is not intended to limit possible implementations of the present invention.

在本發明的實施例中,處理器114可存取儲存電路112中記錄的模組、程式碼來實現本發明提出的補償視野缺損的方法,其細節詳述如下。In the embodiment of the present invention, the processor 114 can access the modules and program codes recorded in the storage circuit 112 to implement the method for compensating for visual field defect proposed by the present invention, the details of which are described in detail below.

請參照圖2,其是依據本發明之一實施例繪示的補償視野缺損的方法流程圖。本實施例的方法可由圖1的電子裝置110執行,以下即搭配圖1所示的元件說明圖2各步驟的細節。Please refer to FIG. 2 , which is a flowchart of a method for compensating for visual field defect according to an embodiment of the present invention. The method of this embodiment can be executed by the electronic device 110 in FIG. 1 , and the details of each step in FIG. 2 will be described below in conjunction with the elements shown in FIG. 1 .

首先,在步驟S210中,處理器114可取得穿戴者的視野圖,並識別出視野圖中的視野缺損區域。一般而言,穿戴者的視野圖可由相關醫療人員以相關儀器(例如Humphrey視野計)對穿戴者實施視野檢測而產生,並可由穿戴者或其他相關人員儲存於處理器114可存取的特定儲存位置(例如某個雲端資料庫或是儲存電路112)中。基此,處理器114即可直接存取上述特定儲存位置以取得穿戴者的視野圖,但可不限於此。First, in step S210, the processor 114 may obtain a visual field map of the wearer, and identify the visual field defect area in the visual field map. Generally speaking, the visual field map of the wearer can be generated by relevant medical personnel performing visual field detection on the wearer with related instruments (eg, Humphrey perimeter), and can be stored by the wearer or other relevant personnel in a specific storage accessible by the processor 114 . in a location (eg, a cloud database or storage circuit 112 ). Based on this, the processor 114 can directly access the above-mentioned specific storage location to obtain the wearer's visual field, but it is not limited to this.

請參照圖3,其是依據本發明實施例繪示的視野圖。在本實施例中,假設視野圖300即為頭戴式顯示器120穿戴者的視野圖,其中橫軸對應於穿戴者的橫向視角,縱軸對應於穿戴者的縱向視角,原點O1則對應於穿戴者的視野中心點。在視野圖300中,所繪示的各個點具有一光敏感度值(單位為dB),而其可用以表徵穿戴者在對應視角的感光能力。Please refer to FIG. 3 , which is a view diagram according to an embodiment of the present invention. In this embodiment, it is assumed that the visual field map 300 is the visual field map of the wearer of the head-mounted display 120, wherein the horizontal axis corresponds to the wearer's lateral viewing angle, the vertical axis corresponds to the wearer's longitudinal viewing angle, and the origin O1 corresponds to The center point of the wearer's field of vision. In the visual field map 300 , each point shown has a light sensitivity value (unit: dB), which can be used to represent the wearer's light sensitivity at a corresponding viewing angle.

在本發明的實施例中,假設越低的光敏感度值對應於越深的顏色,因此,由圖3可看出,在穿戴者視野中心點的左下方及左上方存在多塊感光能力較弱的視野區域。In the embodiment of the present invention, it is assumed that a lower light sensitivity value corresponds to a darker color. Therefore, it can be seen from FIG. 3 that there are multiple pieces of weak light sensitivity in the lower left and upper left of the center point of the wearer's visual field. field of view.

在一實施例中,在處理器114在取得穿戴者的視野圖後,可在其中識別出低於一預設門限值(其可由設計者依需求而定)的一或多個光敏感度值,並將這些光敏感度值所形成的區域定義為視野缺損區域。以圖3為例,假設區域310及320中的光敏感度值皆低於上述預設門限值,則處理器114可相應地將區域310及320定義為穿戴者的視野缺損區域,但可不限於此。在另一實施例中,處理器114在取得穿戴者的視野圖的同時,也可同時取得視野缺損區域的資訊。In one embodiment, after the processor 114 obtains the wearer's visual field map, it can identify one or more light sensitivity values therein that are lower than a predetermined threshold value (which can be determined by the designer according to needs), The area formed by these light sensitivity values was defined as the visual field defect area. Taking FIG. 3 as an example, if the light sensitivity values in the areas 310 and 320 are both lower than the above-mentioned preset threshold, the processor 114 can accordingly define the areas 310 and 320 as the wearer's visual field defect area, but it is not limited thereto. . In another embodiment, the processor 114 can obtain the information of the visual field defect area at the same time when obtaining the wearer's visual field map.

之後,在步驟S220中,處理器114可取得視覺內容VC,並在視覺內容VC中識別出對應於視野缺損區域的特定區域。如先前提及的,視覺內容VC可以是由頭戴式顯示器120的前鏡頭122拍攝穿戴者前方的景觀而得,但可不限於此。Afterwards, in step S220, the processor 114 may obtain the visual content VC, and identify a specific area corresponding to the visual field defect area in the visual content VC. As mentioned earlier, the visual content VC may be obtained by photographing the landscape in front of the wearer by the front lens 122 of the head mounted display 120, but it is not limited thereto.

在一實施例中,處理器114可取得視野缺損區域(即區域310、320)與視野中心點(即,原點O1)之間的第一相對位置。之後,處理器114可取得穿戴者在視覺內容VC上的注視中心點,並依據第一相對位置及注視中心點在視覺內容VC中定義特定區域,其中特定區域與注視中心點之間的第二相對位置對應於視野缺損區域與視野中心點之間的第一相對位置,且各特定區域可包括多個特定像素。在一實施例中,穿戴者的注視中心點可藉由例如眼球追蹤的技術追蹤眼球的動作,進而計算出穿戴者的注視中心點。In one embodiment, the processor 114 may obtain the first relative position between the visual field defect region (ie, the regions 310 , 320 ) and the center point of the visual field (ie, the origin O1 ). Afterwards, the processor 114 can obtain the gaze center point of the wearer on the visual content VC, and define a specific area in the visual content VC according to the first relative position and the gaze center point, wherein the second point between the specific area and the gaze center point is The relative position corresponds to the first relative position between the visual field defect area and the center point of the visual field, and each specific area may include a plurality of specific pixels. In one embodiment, the wearer's gaze center point can be tracked by a technique such as eye tracking to track the movement of the eyeball, and then the wearer's gaze center point can be calculated.

為便於理解,以下將另輔以圖4A至圖4B說明,其中圖4A是依據本發明實施例繪示的視覺內容示意圖,而圖4B是取得對應於視野缺損區域的特定區域的示意圖。For ease of understanding, the following description will be supplemented with FIGS. 4A to 4B , wherein FIG. 4A is a schematic diagram of visual content according to an embodiment of the present invention, and FIG. 4B is a schematic diagram of obtaining a specific area corresponding to the visual field defect area.

在圖4A中,視覺內容VC例如是前鏡頭122所拍攝的前方景觀。在圖4B中,假設穿戴者在觀看視覺內容VC時具有注視中心點405,則處理器114可依據上述第一相對位置及注視中心點405在視覺內容VC中定義特定區域410及420。In FIG. 4A , the visual content VC is, for example, the front landscape captured by the front lens 122 . In FIG. 4B , assuming that the wearer has a gaze center point 405 when viewing the visual content VC, the processor 114 can define specific regions 410 and 420 in the visual content VC according to the above-mentioned first relative position and gaze center point 405 .

在一實施例中,處理器114可將注視中心點405視為圖3的原點O1(即視野中心點),再依據圖3中區域310與原點O1之間的相對位置在視覺內容VC中識別出對應於區域310的特定區域410,其中特定區域410與注視中心點405之間的相對位置對應於圖3中區域310與原點O1之間的相對位置。同理,處理器114可再依據圖3中區域320與原點O1之間的相對位置在視覺內容VC中識別出對應於區域320的特定區域420,其中特定區域420與注視中心點405之間的相對位置對應於圖3中區域320與原點O1之間的相對位置。In one embodiment, the processor 114 may regard the gaze center point 405 as the origin O1 of FIG. 3 (ie, the center of the field of view), and then according to the relative position between the area 310 and the origin O1 in FIG. A specific area 410 corresponding to the area 310 is identified in FIG. 3 , wherein the relative position between the specific area 410 and the gaze center point 405 corresponds to the relative position between the area 310 and the origin O1 in FIG. 3 . Similarly, the processor 114 can further identify a specific area 420 corresponding to the area 320 in the visual content VC according to the relative position between the area 320 and the origin O1 in FIG. 3 , wherein the specific area 420 is between the gaze center point 405 The relative position of corresponds to the relative position between the region 320 and the origin O1 in FIG. 3 .

在識別出對應於視野缺損區域的特定區域410、420之後,在步驟S230中,處理器114可依據對應的光敏感度值調整各特定像素的亮度值,以調整視覺內容VC。After identifying the specific areas 410 and 420 corresponding to the visual field defect area, in step S230, the processor 114 may adjust the brightness value of each specific pixel according to the corresponding light sensitivity value to adjust the visual content VC.

舉例而言,假設區域310中的一第一位置具有一第一光敏感度值,而特定區域410中具有位置對應於區域310中的上述第一位置的一第一特定像素,進而對應上述第一位置的第一光敏感度值。之後,處理器114可取得第一特定像素的原始亮度值(即第一特定像素原本的亮度值),並依據第一光敏感度值將此原始亮度值增加為第一亮度值。For example, it is assumed that a first position in the area 310 has a first light sensitivity value, and the specific area 410 has a first specific pixel whose position corresponds to the above-mentioned first position in the area 310, and further corresponds to the above-mentioned first pixel The first light sensitivity value for the location. Afterwards, the processor 114 may obtain the original luminance value of the first specific pixel (ie, the original luminance value of the first specific pixel), and increase the original luminance value to the first luminance value according to the first light sensitivity value.

在一實施例中,第一亮度值可表示為原始亮度值與一亮度差值的總和,而此亮度差值可負相關於第一光敏感度值。亦即,第一特定像素在區域310中對應的第一光敏感度值越低,上述亮度差值即越高,反之亦然。In one embodiment, the first luminance value may be expressed as the sum of the original luminance value and a luminance difference value, and the luminance difference value may be negatively related to the first light sensitivity value. That is, the lower the first light sensitivity value corresponding to the first specific pixel in the area 310 is, the higher the above-mentioned luminance difference value is, and vice versa.

簡言之,處理器114可將特定區域410、420中的各特定像素依據對應位置的光敏感度值調高各特定像素的亮度值,從而令特定區域410、420在調整後的視覺內容VC’中可具有較高的亮度,但可不限於此。In short, the processor 114 can increase the brightness value of each specific pixel in the specific area 410, 420 according to the light sensitivity value of the corresponding position, so that the specific area 410, 420 is in the adjusted visual content VC' may have higher brightness, but may not be limited to this.

之後,在步驟S240中,處理器114可顯示調整後的視覺內容VC’。在一實施例中,處理器114可將調整後的視覺內容VC’發送至頭戴式顯示器120,以由頭戴式顯示器120將調整後的視覺內容VC’顯示予穿戴者觀看。Thereafter, in step S240, the processor 114 may display the adjusted visual content VC'. In one embodiment, the processor 114 may send the adjusted visual content VC' to the head-mounted display 120, so that the head-mounted display 120 displays the adjusted visual content VC' to the wearer for viewing.

請參照圖4C,其是依據圖4A及圖4B繪示的調整後的視覺內容的示意圖。如圖4C所示,在調整後的視覺內容VC’中,由於特定區域410’及420’(其分別為調高亮度值後的特定區域410、420)具有較高的亮度,因而能夠讓具有圖3所示的視野缺損區域的穿戴者順利地觀察到在特定區域410’及420’中的內容。此外,由於視覺內容VC為穿戴者前方的景觀,故穿戴者可藉由觀看調整後的視覺內容VC’來觀看完整的前方景觀,而不會受限於自身的視野缺損區域。Please refer to FIG. 4C , which is a schematic diagram of the adjusted visual content according to FIGS. 4A and 4B . As shown in FIG. 4C , in the adjusted visual content VC′, since the specific regions 410 ′ and 420 ′ (which are the specific regions 410 and 420 after the brightness value has been increased, respectively) have higher brightness, it is possible to have The wearer in the visual field-deficient area shown in FIG. 3 smoothly observes the content in the specific areas 410' and 420'. In addition, since the visual content VC is the landscape in front of the wearer, the wearer can view the complete front landscape by viewing the adjusted visual content VC' without being limited by the defected area of his own visual field.

由上可知,本發明可藉由增加視覺內容中對應於視野缺損區域的特定區域的亮度值來調整視覺內容,從而讓具有視野缺損區域的穿戴者在觀看調整後的視覺內容時,不會因本身的視野缺損而無法觀賞到完整的視覺內容(例如前方景觀)。As can be seen from the above, the present invention can adjust the visual content by increasing the brightness value of a specific area corresponding to the visual field defect area in the visual content, so that the wearer with the visual field defect area will not be affected by the adjusted visual content when viewing the adjusted visual content. Defects in their own visual field and unable to appreciate the complete visual content (such as the landscape ahead).

此外,如先前所提及的,圖2中的各步驟亦可由實現為一體機態樣的頭戴式顯示器120獨立完成,但本發明可不限於此。In addition, as mentioned above, the steps in FIG. 2 can also be independently completed by the head-mounted display 120 implemented in an all-in-one mode, but the present invention is not limited thereto.

在其他實施例中,本發明還可由智慧型眼鏡來實現所提出的補償視野缺損的方法,以下將作進一步說明。In other embodiments, the present invention can also use smart glasses to implement the proposed method for compensating for visual field defect, which will be further described below.

請參照圖5,其是依據本發明實施例繪示的智慧型眼鏡示意圖。在本發明的實施例中,智慧型眼鏡500例如是AR眼鏡或其他具類似功能的眼鏡,但可不限於此。Please refer to FIG. 5 , which is a schematic diagram of smart glasses according to an embodiment of the present invention. In the embodiment of the present invention, the smart glasses 500 are, for example, AR glasses or other glasses with similar functions, but not limited thereto.

如圖5所示,智慧型眼鏡500可包括儲存電路510、處理器502、前鏡頭503、顯示介面504及/或投影模組505。在不同的實施例中,儲存電路510及處理器502的可能的實施方式可參照圖1中儲存電路112及處理器114的相關說明,於此不另贅述。As shown in FIG. 5 , the smart glasses 500 may include a storage circuit 510 , a processor 502 , a front lens 503 , a display interface 504 and/or a projection module 505 . In different embodiments, for possible implementations of the storage circuit 510 and the processor 502 , reference may be made to the related descriptions of the storage circuit 112 and the processor 114 in FIG. 1 , and details are not described herein.

前鏡頭503例如可用於拍攝位於智慧型眼鏡500穿戴者前方的景觀以作為視覺內容VC。顯示介面504例如是智慧型眼鏡500的鏡片或其他可用於呈現視覺內容(例如AR內容)予穿戴者的元件。投影模組505例如可用於將視覺內容投射至穿戴者的雙眼或是智慧型眼鏡500的鏡片,以供穿戴者觀看視覺內容,但可不限於此。The front lens 503 can be used, for example, to photograph the landscape in front of the wearer of the smart glasses 500 as the visual content VC. The display interface 504 is, for example, a lens of the smart glasses 500 or other elements that can be used to present visual content (eg, AR content) to the wearer. For example, the projection module 505 can be used to project the visual content to the eyes of the wearer or the lenses of the smart glasses 500 for the wearer to view the visual content, but it is not limited thereto.

應了解的是,對於智慧型眼鏡500的穿戴者而言,其本就能夠透過智慧型眼鏡500的鏡片直接觀察到前方的景觀,惟穿戴者因本身具有視野缺損區域而無法完整地觀察到前方景觀。It should be understood that, for the wearer of the smart glasses 500, they can directly observe the landscape in front of them through the lenses of the smart glasses 500, but the wearer cannot fully observe the front because of their own vision defect area. landscape.

概略而言,本實施例的處理器502可在取得穿戴者的視野缺損區域之後,相應地調視覺內容VC中對應於視野缺損區域的特定區域的亮度,並將調整後的特定區域予顯示介面504及/或投影模組505,以由顯示介面504及/或投影模組505將調整後的視覺內容VC’呈現予穿戴者觀看。藉此,可讓原本無法正常觀察位於視野缺損區域內景觀的穿戴者能夠順利地觀察位於視野缺損區域內的景觀,相關細節將在之後詳述。Roughly speaking, the processor 502 of the present embodiment can adjust the brightness of a specific area in the visual content VC corresponding to the visual field defect area accordingly after acquiring the visual field defect area of the wearer, and display the adjusted specific area to the display interface. 504 and/or the projection module 505, so that the adjusted visual content VC' is presented to the wearer for viewing by the display interface 504 and/or the projection module 505. In this way, the wearer who could not normally observe the landscape located in the visual field defect area can smoothly observe the landscape located in the visual field defect area, and the relevant details will be described in detail later.

在本發明的實施例中,處理器502可存取儲存電路501中記錄的模組、程式碼來實現本發明提出的補償視野缺損的方法,其細節詳述如下。In the embodiment of the present invention, the processor 502 can access the modules and program codes recorded in the storage circuit 501 to implement the method for compensating for visual field defect proposed by the present invention, the details of which are described below.

請參照圖6,其是依據本發明之一實施例繪示的補償視野缺損的方法流程圖。本實施例的方法可由圖5的智慧型眼鏡500執行,以下即搭配圖5所示的元件說明圖6各步驟的細節。Please refer to FIG. 6 , which is a flowchart of a method for compensating for visual field defect according to an embodiment of the present invention. The method of this embodiment can be performed by the smart glasses 500 in FIG. 5 , and the details of each step in FIG. 6 will be described below with the elements shown in FIG. 5 .

在步驟S610中,處理器502可取得穿戴者的視野圖,並識別出視野圖中的視野缺損區域。步驟S610的相關細節可參照步驟S210的相關說明,於此不另贅述。為便於說明,本實施例仍假設穿戴者具有圖3所示的視野圖300,亦即穿戴者具有區域310、320等視野缺損區域,但本發明可不限於此。In step S610, the processor 502 may obtain a visual field map of the wearer, and identify the visual field defect area in the visual field map. For the relevant details of step S610, reference may be made to the relevant description of step S210, which will not be repeated here. For convenience of description, this embodiment still assumes that the wearer has the visual field map 300 shown in FIG. 3 , that is, the wearer has visual field defect regions such as regions 310 and 320 , but the present invention is not limited thereto.

之後,在步驟S620中,處理器502可取得由前鏡頭503拍攝的視覺內容VC及穿戴者的注視中心點,並依據注視中心點在視覺內容VC中識別出對應於視野缺損區域的特定區域。為便於說明,以下仍以圖4A至圖4C所示情境作說明,但本發明可不限於此。Then, in step S620, the processor 502 can obtain the visual content VC captured by the front lens 503 and the wearer's gaze center point, and identify a specific area corresponding to the visual field defect area in the visual content VC according to the gaze center point. For the convenience of description, the scenarios shown in FIG. 4A to FIG. 4C are still described below, but the present invention may not be limited thereto.

在一實施例中,處理器502可取得視野缺損區域(例如圖3的區域310、320)與視野中心點(例如圖3的原點O1)之間的第一相對位置,並依據第一相對位置及注視中心點405在視覺內容VC中定義特定區域410、420。In one embodiment, the processor 502 can obtain the first relative position between the visual field defect area (eg, the areas 310 and 320 in FIG. 3 ) and the center point of the visual field (eg, the origin O1 in FIG. 3 ), and according to the first relative position The position and gaze center point 405 define specific areas 410, 420 in the visual content VC.

更具體而言,處理器502可將注視中心點405視為圖3的原點O1(即視野中心點),再依據圖3中區域310與原點O1之間的相對位置在視覺內容VC中識別出對應於區域310的特定區域410,其中特定區域410與注視中心點405之間的相對位置對應於圖3中區域310與原點O1之間的相對位置。同理,處理器502可再依據圖3中區域320與原點O1之間的相對位置在視覺內容VC中識別出對應於區域320的特定區域420,其中特定區域420與注視中心點405之間的相對位置對應於圖3中區域320與原點O1之間的相對位置。More specifically, the processor 502 may regard the gaze center point 405 as the origin O1 of FIG. 3 (ie, the center of the field of view), and then according to the relative position between the area 310 and the origin O1 in FIG. 3 in the visual content VC A specific area 410 corresponding to area 310 is identified, wherein the relative position between the specific area 410 and the gaze center point 405 corresponds to the relative position between the area 310 and the origin O1 in FIG. 3 . Similarly, the processor 502 can further identify the specific area 420 corresponding to the area 320 in the visual content VC according to the relative position between the area 320 and the origin O1 in FIG. 3 , wherein the specific area 420 is between the gaze center point 405 The relative position of corresponds to the relative position between the region 320 and the origin O1 in FIG. 3 .

之後,在步驟S630中,處理器502可依據對應的光敏感度值調整顯示或投影各特定像素的亮度值,以調整特定區域410、420。本實施例中步驟S630的細節可參照圖2步驟S230的相關說明,於此不另贅述。Afterwards, in step S630, the processor 502 may adjust the display or projection brightness value of each specific pixel according to the corresponding light sensitivity value, so as to adjust the specific areas 410 and 420. For details of step S630 in this embodiment, reference may be made to the relevant description of step S230 in FIG. 2 , and details are not described herein.

接著,在步驟S640中,處理器502可依據注視中心點405呈現調整後的特定區域410’、420’。在一實施例中,處理器502可控制顯示介面504顯示調整後的特定區域410’、420’,或是控制投影模組505將調整後的特定區域410’、420’投射至穿戴者的眼睛內。而在另一實施例中,也可利用投射的方式,將調整後的特定區域410’、420’ 投射至智慧型眼鏡500的鏡片上供使用者觀察。Next, in step S640, the processor 502 may present the adjusted specific regions 410', 420' according to the gaze center point 405. In one embodiment, the processor 502 can control the display interface 504 to display the adjusted specific areas 410', 420', or control the projection module 505 to project the adjusted specific areas 410', 420' to the eyes of the wearer Inside. In another embodiment, the adjusted specific areas 410', 420' can also be projected onto the lenses of the smart glasses 500 by means of projection for the user to observe.

詳細而言,由於穿戴者本身即可透過智慧型眼鏡500的鏡片觀察到一部分的前方景觀,而在處理器502透過步驟S640將調整後的特定區域410’、420’(即,穿戴者原本無法正常觀察到的視野區域)呈現予穿戴者之後,形同智慧型眼鏡500將對應於視野缺損區域的部分前方景觀補入了穿戴者的視野中,從而讓穿戴者能夠觀察到完整的前方景觀(例如圖4C所示態樣),不再受限於自身的視野缺損區域。In detail, since the wearer can observe a part of the front view through the lenses of the smart glasses 500, the processor 502 adjusts the adjusted specific areas 410', 420' through the step S640 (that is, the wearer cannot After the normally observed visual field area) is presented to the wearer, the smart glasses 500 add part of the front view corresponding to the visual field defect area into the wearer's field of vision, so that the wearer can observe the complete front view ( For example, as shown in Figure 4C), it is no longer limited by its own visual field defect area.

本發明更提供一種執行上述補償視野缺損的方法的電腦可讀儲存媒體。電腦可讀儲存媒體由嵌於其中的多個程式指令(例如設定程式指令以及部署程式指令)構成。這些程式指令可以載入電子裝置及/或智慧型眼鏡中,並且執行與上述相同的補償視野缺損的方法、電子裝置及智慧型眼鏡的功能。The present invention further provides a computer-readable storage medium for implementing the above-mentioned method for compensating for visual field defect. A computer-readable storage medium consists of a plurality of program instructions, such as setup program instructions and deployment program instructions, embedded therein. These program instructions can be loaded into the electronic device and/or smart glasses, and perform the same functions of the method for compensating for visual field defect, the electronic device and the smart glasses as described above.

綜上所述,本發明的方法、電子裝置、智慧型眼鏡及電腦可讀儲存媒體可依據穿戴者的視野缺損區域在視覺內容中識別出對應的特定區域,並調高特定區域的亮度,從而讓穿戴者能夠順利地觀察到位於其視野缺損區域內的視覺內容。藉此,可讓具有視野缺損區域的穿戴者(例如青光眼患者)能夠順利地觀察到完整的視覺內容(例如前方景觀),進而改善穿戴者的生活品質。To sum up, the method, electronic device, smart glasses and computer-readable storage medium of the present invention can identify the corresponding specific area in the visual content according to the wearer's visual field defect area, and increase the brightness of the specific area, thereby Allows the wearer to smoothly observe the visual content located in the area of his visual field defect. In this way, a wearer with a visual field defect area (such as a glaucoma patient) can smoothly observe the complete visual content (such as the front view), thereby improving the wearer's quality of life.

雖然本發明已以實施例揭露如上,然其並非用以限定本發明,任何所屬技術領域中具有通常知識者,在不脫離本發明的精神和範圍內,當可作些許的更動與潤飾,故本發明的保護範圍當視後附的申請專利範圍所界定者為準。Although the present invention has been disclosed above by the embodiments, it is not intended to limit the present invention. Anyone with ordinary knowledge in the technical field can make some changes and modifications without departing from the spirit and scope of the present invention. Therefore, The protection scope of the present invention shall be determined by the scope of the appended patent application.

110:電子裝置 112,501:儲存電路 114,502:處理器 120:頭戴式顯示器 122,503:前鏡頭 300:視野圖 310,320:區域 405:注視中心點 410,420,410’,420’:特定區域 500:智慧型眼鏡 504:顯示介面 505:投影模組 O1:原點 S210~S240,S610~S640:步驟 VC,VC’:視覺內容110: Electronic Devices 112,501: Storage Circuits 114,502: Processor 120: Head Mounted Display 122,503: Front Lens 300: View Map 310,320: Area 405: Look at the center point 410, 420, 410', 420': specific area 500: Smart Glasses 504: Display interface 505: Projection Module O1: origin S210~S240, S610~S640: Steps VC,VC': visual content

圖1是依據本發明之一實施例繪示的電子裝置與頭戴式顯示器的示意圖。 圖2是依據本發明之一實施例繪示的補償視野缺損的方法流程圖。 圖3是依據本發明實施例繪示的視野圖。 圖4A是依據本發明實施例繪示的視覺內容示意圖。 圖4B是取得對應於視野缺損區域的特定區域的示意圖。 圖4C是依據圖4A及圖4B繪示的調整後的視覺內容的示意圖。 圖5是依據本發明實施例繪示的智慧型眼鏡示意圖。 圖6是依據本發明之一實施例繪示的補償視野缺損的方法流程圖。FIG. 1 is a schematic diagram of an electronic device and a head-mounted display according to an embodiment of the present invention. FIG. 2 is a flowchart of a method for compensating for visual field defect according to an embodiment of the present invention. FIG. 3 is a view diagram according to an embodiment of the present invention. FIG. 4A is a schematic diagram of visual content according to an embodiment of the present invention. FIG. 4B is a schematic diagram of acquiring a specific area corresponding to the visual field defect area. FIG. 4C is a schematic diagram of the adjusted visual content according to FIGS. 4A and 4B . FIG. 5 is a schematic diagram of smart glasses according to an embodiment of the present invention. FIG. 6 is a flowchart of a method for compensating for visual field defect according to an embodiment of the present invention.

S210~S240:步驟S210~S240: Steps

Claims (20)

一種補償視野缺損的方法,所述方法包括:取得一穿戴者的一視野圖;識別出該視野圖中的一視野缺損區域,其中該視野缺損區域包括多個光敏感度值,且各該光敏感度值低於一預設門限值;取得一視覺內容,並在該視覺內容中識別出對應於該視野缺損區域的一特定區域,其中該特定區域包括多個特定像素,且各該特定像素對應於該些光敏感度值的其中之一;依據對應的該光敏感度值調整各該特定像素的亮度值,以調整該視覺內容;顯示調整後的該視覺內容,其中該些光敏感度值包括一第一光敏感度值,該些特定像素包括對應於該第一光敏感度值的一第一特定像素,且依據對應的該光敏感度值調整各該特定像素的該亮度值的步驟包括:取得該第一特定像素的一原始亮度值,並依據該第一光敏感度值將該原始亮度值增加為一第一亮度值,其中該原始亮度值與該第一亮度值之間的一亮度差值負相關於該第一光敏感度值。 A method for compensating visual field defect, the method comprises: obtaining a visual field map of a wearer; identifying a visual field defect area in the visual field map, wherein the visual field defect area includes a plurality of light sensitivity values, and each of the light sensitivity values The value is lower than a preset threshold value; a visual content is obtained, and a specific area corresponding to the visual field defect area is identified in the visual content, wherein the specific area includes a plurality of specific pixels, and each of the specific pixels corresponds to one of the light sensitivity values; adjusting the brightness value of each specific pixel according to the corresponding light sensitivity value to adjust the visual content; displaying the adjusted visual content, wherein the light sensitivity values include a first light sensitivity values, the specific pixels include a first specific pixel corresponding to the first light sensitivity value, and the step of adjusting the luminance value of each specific pixel according to the corresponding light sensitivity value includes: obtaining the first specific pixel an original brightness value of the pixel, and the original brightness value is increased to a first brightness value according to the first light sensitivity value, wherein a brightness difference value between the original brightness value and the first brightness value is negatively related to the The first light sensitivity value. 如請求項1所述的方法,其中該視野圖具有一視野中心點,且在該視覺內容中識別出對應於該視野缺損區域的該特定區域的步驟包括:取得該視野缺損區域與該視野中心點之間的一第一相對位置; 取得該穿戴者在該視覺內容上的一注視中心點,並依據該第一相對位置及該注視中心點在該視覺內容中定義該特定區域,其中該特定區域與該注視中心點之間的一第二相對位置對應於該視野缺損區域與該視野中心點之間的該第一相對位置。 The method of claim 1, wherein the visual field map has a visual field center point, and the step of identifying the specific area corresponding to the visual field defect area in the visual content includes: obtaining the visual field defect area and the visual field center a first relative position between the points; Obtain a gaze center point of the wearer on the visual content, and define the specific area in the visual content according to the first relative position and the gaze center point, wherein a point between the specific area and the gaze center point The second relative position corresponds to the first relative position between the visual field defect area and the central point of the visual field. 如請求項1所述的方法,其中該視覺內容係由一頭戴式顯示器的一前鏡頭拍攝而得。 The method of claim 1, wherein the visual content is captured by a front lens of a head mounted display. 一種電子裝置,包括:一儲存電路,其儲存多個模組;一處理器,耦接該儲存電路,並存取該些模組以執行下列步驟:取得一穿戴者的一視野圖;識別出該視野圖中的一視野缺損區域,其中該視野缺損區域包括多個光敏感度值,且各該光敏感度值低於一預設門限值;取得一視覺內容,並在該視覺內容中識別出對應於該視野缺損區域的一特定區域,其中該特定區域包括多個特定像素,且各該特定像素對應於該些光敏感度值的其中之一;依據對應的該光敏感度值調整各該特定像素的亮度值,以調整該視覺內容;顯示調整後的該視覺內容,其中該些光敏感度值包括一第一光敏感度值,該些特定像素包括對應於該第一光敏感度值的一第一特定像素,且該處理器經配置以: 取得該第一特定像素的一原始亮度值,並依據該第一光敏感度值將該原始亮度值增加為一第一亮度值,其中該原始亮度值與該第一亮度值之間的一亮度差值負相關於該第一光敏感度值。 An electronic device, comprising: a storage circuit, which stores a plurality of modules; a processor, coupled to the storage circuit, and accessing the modules to perform the following steps: obtaining a visual field of a wearer; identifying A visual field defect area in the visual field map, wherein the visual field defect area includes a plurality of light sensitivity values, and each of the light sensitivity values is lower than a preset threshold value; obtain a visual content, and identify the corresponding visual content in the visual content in a specific area of the visual field defect area, wherein the specific area includes a plurality of specific pixels, and each of the specific pixels corresponds to one of the light sensitivity values; adjusting the specific pixels according to the corresponding light sensitivity value brightness values to adjust the visual content; displaying the adjusted visual content, wherein the light sensitivity values include a first light sensitivity value, and the specific pixels include a first specific pixel corresponding to the first light sensitivity value , and the processor is configured to: Obtaining an original brightness value of the first specific pixel, and increasing the original brightness value into a first brightness value according to the first light sensitivity value, wherein a brightness difference between the original brightness value and the first brightness value The value is negatively related to the first light sensitivity value. 如請求項4所述的電子裝置,其中該視野圖具有一視野中心點,且該處理器經配置以:取得該視野缺損區域與該視野中心點之間的一第一相對位置;取得該穿戴者在該視覺內容上的一注視中心點,並依據該第一相對位置及該注視中心點在該視覺內容中定義該特定區域,其中該特定區域與該注視中心點之間的一第二相對位置對應於該視野缺損區域與該視野中心點之間的該第一相對位置。 The electronic device of claim 4, wherein the visual field map has a visual field center point, and the processor is configured to: obtain a first relative position between the visual field defect area and the visual field center point; obtain the wearer a gaze center point on the visual content, and define the specific area in the visual content according to the first relative position and the gaze center point, wherein a second relative distance between the specific area and the gaze center point The position corresponds to the first relative position between the visual field defect area and the central point of the visual field. 如請求項4所述的電子裝置,其中該視覺內容係由一頭戴式顯示器的一前鏡頭拍攝而得。 The electronic device of claim 4, wherein the visual content is captured by a front lens of a head-mounted display. 一種補償視野缺損的方法,適於具有一前鏡頭的一智慧型眼鏡,所述方法包括:取得一穿戴者的一視野圖;識別出該視野圖中的一視野缺損區域,其中該視野缺損區域包括多個光敏感度值,且各該光敏感度值低於一預設門限值;取得由該前鏡頭拍攝的一視覺內容及該穿戴者的一注視中心點,並依據該注視中心點在該視覺內容中識別出對應於該視野缺損區域的一特定區域,其中該特定區域包括多個特定像素,且各該特定像素對應於該視野缺損區域中該些光敏感度值的其中之 一;依據對應的該光敏感度值調整各該特定像素的亮度值,以調整該特定區域;依據該注視中心點呈現調整後的該特定區域。 A method for compensating visual field defect, suitable for a smart glasses with a front lens, the method comprising: obtaining a visual field map of a wearer; identifying a visual field defect area in the visual field map, wherein the visual field defect area Including a plurality of light sensitivity values, and each of the light sensitivity values is lower than a preset threshold value; obtaining a visual content captured by the front lens and a gaze center point of the wearer, and according to the gaze center point in the visual A specific area corresponding to the visual field defect area is identified in the content, wherein the specific area includes a plurality of specific pixels, and each specific pixel corresponds to one of the light sensitivity values in the visual field defect area 1. Adjust the brightness value of each specific pixel according to the corresponding light sensitivity value to adjust the specific area; present the adjusted specific area according to the gaze center point. 如請求項7所述的方法,其中該視野圖具有一視野中心點,且依據該注視中心點在該視覺內容中識別出對應於該視野缺損區域的該特定區域的步驟包括:取得該視野缺損區域與該視野中心點之間的一第一相對位置;依據該第一相對位置及該注視中心點在該視覺內容中定義該特定區域,其中該特定區域與該注視中心點之間的一第二相對位置對應於該視野缺損區域與該視野中心點之間的該第一相對位置。 The method of claim 7, wherein the visual field map has a visual field center point, and the step of identifying the specific area corresponding to the visual field defect area in the visual content according to the gaze center point includes: obtaining the visual field defect area A first relative position between the area and the center point of the visual field; the specific area is defined in the visual content according to the first relative position and the center point of gaze, wherein a first relative position between the specific area and the center point of gaze The two relative positions correspond to the first relative position between the visual field defect area and the central point of the visual field. 如請求項7所述的方法,其中該些光敏感度值包括一第一光敏感度值,該些特定像素包括對應於該第一光敏感度值的一第一特定像素,且依據對應的該光敏感度值調整各該特定像素的該亮度值的步驟包括:取得該第一特定像素的一原始亮度值,並依據該第一光敏感度值將該原始亮度值增加為一第一亮度值,其中該原始亮度值與該第一亮度值之間的一亮度差值負相關於該第一光敏感度值。 The method of claim 7, wherein the light sensitivity values comprise a first light sensitivity value, the specific pixels comprise a first specific pixel corresponding to the first light sensitivity value, and the corresponding light sensitivity The step of adjusting the brightness value of each specific pixel includes: obtaining an original brightness value of the first specific pixel, and increasing the original brightness value to a first brightness value according to the first light sensitivity value, wherein the original brightness value A luminance difference value between the luminance value and the first luminance value is negatively related to the first light sensitivity value. 如請求項7所述的方法,其中該智慧型眼鏡更包括一顯示介面,且依據該注視中心點呈現調整後的該特定區域的步驟包括:依據該注視中心點在該顯示介面中呈現調整後的該特定區域。 The method of claim 7, wherein the smart glasses further include a display interface, and the step of presenting the adjusted specific area according to the gaze center point comprises: displaying the adjusted specific area in the display interface according to the gaze center point of that particular area. 如請求項7所述的方法,其中該智慧型眼鏡更包括一投影模組,且依據該注視中心點呈現調整後的該特定區域的步驟包括:控制該投影模組依據該注視中心點將調整後的該特定區域投射至該穿戴者的眼睛。 The method of claim 7, wherein the smart glasses further include a projection module, and the step of presenting the adjusted specific area according to the gaze center point includes: controlling the projection module to adjust the adjusted area according to the gaze center point of the specific area projected to the wearer's eyes. 如請求項7所述的方法,其中該智慧型眼鏡更包括一投影模組,且依據該注視中心點呈現調整後的該特定區域的步驟包括:控制該投影模組依據該注視中心點將調整後的該特定區域投射至該智慧型眼鏡的鏡片。 The method of claim 7, wherein the smart glasses further include a projection module, and the step of presenting the adjusted specific area according to the gaze center point includes: controlling the projection module to adjust the adjusted area according to the gaze center point The specific area of is projected to the lens of the smart glasses. 一種智慧型眼鏡,包括:一儲存電路,其儲存多個模組;一前鏡頭;一處理器,耦接該儲存電路及該前鏡頭,並存取該些模組以執行下列步驟:取得一穿戴者的一視野圖; 識別出該視野圖中的一視野缺損區域,其中該視野缺損區域包括多個光敏感度值,且各該光敏感度值低於一預設門限值;取得由該前鏡頭拍攝的一視覺內容及該穿戴者的一注視中心點,並依據該注視中心點在該視覺內容中識別出對應於該視野缺損區域的一特定區域,其中該特定區域包括多個特定像素,且各該特定像素對應於該些光敏感度值的其中之一;依據對應的該光敏感度值調整各該特定像素的亮度值,以調整該特定區域;依據該注視中心點呈現調整後的該特定區域。 A smart glasses, comprising: a storage circuit, which stores a plurality of modules; a front lens; a processor, which is coupled to the storage circuit and the front lens, and accesses the modules to perform the following steps: obtaining a a view of the wearer; Identify a visual field defect area in the visual field map, wherein the visual field defect area includes a plurality of light sensitivity values, and each of the light sensitivity values is lower than a preset threshold value; Obtain a visual content and the A gaze center point of the wearer, and according to the gaze center point, a specific area corresponding to the visual field defect area is identified in the visual content, wherein the specific area includes a plurality of specific pixels, and each of the specific pixels corresponds to the one of the light sensitivity values; adjust the brightness value of each specific pixel according to the corresponding light sensitivity value to adjust the specific area; present the adjusted specific area according to the gaze center point. 如請求項13所述的智慧型眼鏡,其中該視野圖具有一視野中心點,且該處理器經配置以:取得該視野缺損區域與該視野中心點之間的一第一相對位置;依據該第一相對位置及該注視中心點在該視覺內容中定義該特定區域,其中該特定區域與該注視中心點之間的一第二相對位置對應於該視野缺損區域與該視野中心點之間的該第一相對位置。 The smart glasses of claim 13, wherein the visual field map has a visual field center point, and the processor is configured to: obtain a first relative position between the visual field defect area and the visual field center point; The first relative position and the gaze center point define the specific area in the visual content, wherein a second relative position between the specific area and the gaze center point corresponds to the distance between the visual field defect area and the visual field center point. the first relative position. 如請求項13所述的智慧型眼鏡,其中該些光敏感度值包括一第一光敏感度值,該些特定像素包括對應於該第一光敏感度值的一第一特定像素,且該處理器經配置以: 取得該第一特定像素的一原始亮度值,並依據該第一光敏感度值將該原始亮度值增加為一第一亮度值,其中該原始亮度值與該第一亮度值之間的一亮度差值負相關於該第一光敏感度值。 The smart glasses of claim 13, wherein the light sensitivity values include a first light sensitivity value, the specific pixels include a first specific pixel corresponding to the first light sensitivity value, and the processor Configure to: Obtaining an original brightness value of the first specific pixel, and increasing the original brightness value into a first brightness value according to the first light sensitivity value, wherein a brightness difference between the original brightness value and the first brightness value The value is negatively related to the first light sensitivity value. 如請求項13所述的智慧型眼鏡,其中該智慧型眼鏡更包括一顯示介面,且該處理器經配置以:依據該注視中心點在該顯示介面中呈現調整後的該特定區域。 The smart glasses of claim 13, wherein the smart glasses further comprise a display interface, and the processor is configured to: present the adjusted specific area in the display interface according to the gaze center point. 如請求項13所述的智慧型眼鏡,其中該智慧型眼鏡更包括一投影模組,且該處理器經配置以:控制該投影模組依據該注視中心點將調整後的該特定區域投射至該穿戴者的眼睛。 The smart glasses of claim 13, wherein the smart glasses further comprise a projection module, and the processor is configured to: control the projection module to project the adjusted specific area to the gaze center point according to the gaze center point the wearer's eyes. 如請求項13所述的智慧型眼鏡,其中該智慧型眼鏡更包括一投影模組,且該處理器經配置以:控制該投影模組依據該注視中心點將調整後的該特定區域投射至該智慧型眼鏡的鏡片。 The smart glasses of claim 13, wherein the smart glasses further comprise a projection module, and the processor is configured to: control the projection module to project the adjusted specific area to the gaze center point according to the gaze center point Lenses for smart glasses. 一種電腦可讀儲存媒體,其嵌入有一可執行電腦程式機制,該可執行電腦程式機制包括指令用於:取得一穿戴者的一視野圖;識別出該視野圖中的一視野缺損區域,其中該視野缺損區域包括多個光敏感度值,且各該光敏感度值低於一預設門限值;取得一視覺內容,並在該視覺內容中識別出對應於該視野缺損區域的一特定區域,其中該特定區域包括多個特定像素,且各 該特定像素對應於該些光敏感度值的其中之一;依據對應的該光敏感度值調整各該特定像素的亮度值,以調整該視覺內容;顯示調整後的該視覺內容,其中該些光敏感度值包括一第一光敏感度值,該些特定像素包括對應於該第一光敏感度值的一第一特定像素,且依據對應的該光敏感度值調整各該特定像素的該亮度值包括:取得該第一特定像素的一原始亮度值,並依據該第一光敏感度值將該原始亮度值增加為一第一亮度值,其中該原始亮度值與該第一亮度值之間的一亮度差值負相關於該第一光敏感度值。 A computer-readable storage medium embedded with an executable computer program mechanism, the executable computer program mechanism comprising instructions for: obtaining a visual field map of a wearer; identifying a visual field defect area in the visual field map, wherein the The visual field defect area includes a plurality of light sensitivity values, and each of the light sensitivity values is lower than a preset threshold value; a visual content is obtained, and a specific area corresponding to the visual field defect area is identified in the visual content, wherein the A specific area includes a plurality of specific pixels, and each The specific pixel corresponds to one of the light sensitivity values; adjust the brightness value of each specific pixel according to the corresponding light sensitivity value to adjust the visual content; display the adjusted visual content, wherein the light sensitivities The value includes a first light sensitivity value, the specific pixels include a first specific pixel corresponding to the first light sensitivity value, and adjusting the brightness value of each specific pixel according to the corresponding light sensitivity value includes: obtaining the an original brightness value of a first specific pixel, and the original brightness value is increased to a first brightness value according to the first light sensitivity value, wherein a brightness difference between the original brightness value and the first brightness value is negative relative to the first light sensitivity value. 一種電腦可讀儲存媒體,其嵌入有一可執行電腦程式機制,該可執行電腦程式機制包括指令用於:取得一穿戴者的一視野圖;識別出該視野圖中的一視野缺損區域,其中該視野缺損區域包括多個光敏感度值,且各該光敏感度值低於一預設門限值;取得由該前鏡頭拍攝的一視覺內容及該穿戴者的一注視中心點,並依據該注視中心點在該視覺內容中識別出對應於該視野缺損區域的一特定區域,其中該特定區域包括多個特定像素,且各該特定像素對應於該視野缺損區域中該些光敏感度值的其中之一;依據對應的該光敏感度值調整各該特定像素的亮度值,以調 整該特定區域;依據該注視中心點呈現調整後的該特定區域。 A computer-readable storage medium embedded with an executable computer program mechanism, the executable computer program mechanism comprising instructions for: obtaining a visual field map of a wearer; identifying a visual field defect area in the visual field map, wherein the The visual field defect area includes a plurality of light sensitivity values, and each of the light sensitivity values is lower than a preset threshold value; a visual content captured by the front lens and a gaze center point of the wearer are obtained, and according to the gaze center point Identifying a specific area in the visual content corresponding to the visual field defect area, wherein the specific area includes a plurality of specific pixels, and each of the specific pixels corresponds to one of the light sensitivity values in the visual field defect area; Adjust the brightness value of each specific pixel according to the corresponding light sensitivity value to adjust Adjust the specific area; present the adjusted specific area according to the gaze center point.
TW109112900A 2020-04-17 2020-04-17 Method for compensating visual field defects, electronic device, smart glasses, computer readable storage medium TWI757727B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW109112900A TWI757727B (en) 2020-04-17 2020-04-17 Method for compensating visual field defects, electronic device, smart glasses, computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW109112900A TWI757727B (en) 2020-04-17 2020-04-17 Method for compensating visual field defects, electronic device, smart glasses, computer readable storage medium

Publications (2)

Publication Number Publication Date
TW202141234A TW202141234A (en) 2021-11-01
TWI757727B true TWI757727B (en) 2022-03-11

Family

ID=80783233

Family Applications (1)

Application Number Title Priority Date Filing Date
TW109112900A TWI757727B (en) 2020-04-17 2020-04-17 Method for compensating visual field defects, electronic device, smart glasses, computer readable storage medium

Country Status (1)

Country Link
TW (1) TWI757727B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI468841B (en) * 2012-06-27 2015-01-11
TW201800804A (en) * 2016-06-15 2018-01-01 威亞視覺科技股份有限公司 Head-mounted personal multimedia systems and visual assistance devices thereof
US20180259776A1 (en) * 2014-06-24 2018-09-13 Microsoft Technology Licensing, Llc Display devices with transmittance compensation mask
TW201904509A (en) * 2017-04-25 2019-02-01 美商壯生和壯生視覺關懷公司 Refractive error processing tracking method and system
US20190222817A1 (en) * 2017-09-27 2019-07-18 University Of Miami Vision defect determination and enhancement
US20190223716A1 (en) * 2017-09-27 2019-07-25 University Of Miami Visual enhancement for dynamic vision defects

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI468841B (en) * 2012-06-27 2015-01-11
US20180259776A1 (en) * 2014-06-24 2018-09-13 Microsoft Technology Licensing, Llc Display devices with transmittance compensation mask
TW201800804A (en) * 2016-06-15 2018-01-01 威亞視覺科技股份有限公司 Head-mounted personal multimedia systems and visual assistance devices thereof
TW201904509A (en) * 2017-04-25 2019-02-01 美商壯生和壯生視覺關懷公司 Refractive error processing tracking method and system
US20190222817A1 (en) * 2017-09-27 2019-07-18 University Of Miami Vision defect determination and enhancement
US20190223716A1 (en) * 2017-09-27 2019-07-25 University Of Miami Visual enhancement for dynamic vision defects

Also Published As

Publication number Publication date
TW202141234A (en) 2021-11-01

Similar Documents

Publication Publication Date Title
CN111511318B (en) Digital therapeutic correcting glasses
US10271042B2 (en) Calibration of a head mounted eye tracking system
US10048750B2 (en) Content projection system and content projection method
TWI516804B (en) Head mounted display apparatus and backlight adjustment method thereof
US9867532B2 (en) System for detecting optical parameter of eye, and method for detecting optical parameter of eye
JP5415948B2 (en) Gaze detection apparatus and gaze detection method
US20160165205A1 (en) Holographic displaying method and device based on human eyes tracking
JP7388349B2 (en) Information processing device, information processing method, and program
JP6953247B2 (en) Goggles type display device, line-of-sight detection method and line-of-sight detection system
JP2011203446A (en) Head-mounted display device
WO2015024327A1 (en) Eyesight-protection imaging apparatus and eyesight-protection imaging method
CN108605120A (en) Viewing equipment adjustment based on the eye adjusting about display
TW201814356A (en) Head-mounted display apparatus and lens position adjusting method thereof
CN110770636A (en) Wearable image processing and control system with functions of correcting visual defects, enhancing vision and sensing ability
US20210382316A1 (en) Gaze tracking apparatus and systems
JP7081599B2 (en) Information processing equipment, information processing methods, and programs
US20190204597A1 (en) Image processing method and apparatus in virtual reality device
JP6501389B2 (en) Head mounted display device, photographing control method, and program
WO2019073689A1 (en) Information processing device, information processing method, and program
WO2022205770A1 (en) Eyeball tracking system and method based on light field perception
TWI757727B (en) Method for compensating visual field defects, electronic device, smart glasses, computer readable storage medium
KR101817436B1 (en) Apparatus and method for displaying contents using electrooculogram sensors
JP2003287708A (en) Vision expansion device and display system
Jung et al. Photographic depiction of the field of view with spectacles-mounted low vision aids
US11327313B2 (en) Method and system for rendering an image with a pupil enhanced accommodation of the eye