TWI580396B - Head-mounted system for visual physology - Google Patents
Head-mounted system for visual physology Download PDFInfo
- Publication number
- TWI580396B TWI580396B TW104117635A TW104117635A TWI580396B TW I580396 B TWI580396 B TW I580396B TW 104117635 A TW104117635 A TW 104117635A TW 104117635 A TW104117635 A TW 104117635A TW I580396 B TWI580396 B TW I580396B
- Authority
- TW
- Taiwan
- Prior art keywords
- data
- eye
- module
- subject
- visual
- Prior art date
Links
- 230000000007 visual effect Effects 0.000 title claims description 41
- 210000001508 eye Anatomy 0.000 claims description 85
- 210000001747 pupil Anatomy 0.000 claims description 47
- 230000000638 stimulation Effects 0.000 claims description 28
- 238000012545 processing Methods 0.000 claims description 21
- 238000004458 analytical method Methods 0.000 claims description 18
- 238000001914 filtration Methods 0.000 claims description 14
- 210000003128 head Anatomy 0.000 claims description 14
- 230000008859 change Effects 0.000 claims description 13
- 210000003205 muscle Anatomy 0.000 claims description 12
- 230000035479 physiological effects, processes and functions Effects 0.000 claims description 12
- 230000004424 eye movement Effects 0.000 claims description 10
- 210000004556 brain Anatomy 0.000 claims description 8
- 230000004936 stimulating effect Effects 0.000 claims description 5
- 230000001886 ciliary effect Effects 0.000 claims description 4
- 210000002820 sympathetic nervous system Anatomy 0.000 claims description 3
- 210000004289 cerebral ventricle Anatomy 0.000 claims description 2
- 238000010191 image analysis Methods 0.000 description 6
- 238000003384 imaging method Methods 0.000 description 6
- 238000011156 evaluation Methods 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 210000005252 bulbus oculi Anatomy 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 238000000034 method Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000007405 data analysis Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000001939 inductive effect Effects 0.000 description 2
- 230000003183 myoelectrical effect Effects 0.000 description 2
- 230000001179 pupillary effect Effects 0.000 description 2
- 206010041349 Somnolence Diseases 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 230000008602 contraction Effects 0.000 description 1
- 238000010219 correlation analysis Methods 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 230000007831 electrophysiology Effects 0.000 description 1
- 238000002001 electrophysiology Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 210000003016 hypothalamus Anatomy 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000004508 polar body Anatomy 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Landscapes
- Eye Examination Apparatus (AREA)
Description
本發明是有關於一種眼部功能評估系統，特別是指一種視覺生理用頭戴式系統。 The present invention relates to an eye function evaluation system, and more particularly to a visual physiological head mounted system.
眼動追蹤器常用於例如閱讀廣告或書籍時的視覺注意力焦點位置，藉此分析人眼與外部資訊的關係，然而，目前未有進一步連結分析眼動追蹤功能及生理回饋功能的評估設備，無法得知例如最視覺焦點是否對應在生理回饋也產生具有意義的關聯性。 Eye trackers are often used, for example, to focus on the visual focus of an advertisement or book, thereby analyzing the relationship between the human eye and external information. However, there is currently no further evaluation device that analyzes the eye tracking function and the physiological feedback function. It is not known, for example, whether the most visual focus corresponds to a physiological feedback that also produces meaningful relevance.
另外，瞳孔計常用於追蹤瞳孔大小變化，目前未有進一步連結分析眼動追蹤功能、瞳孔計及生理回饋功能的評估設備，無法得知例如最視覺焦點、瞳孔變化是否對應在生理回饋也產生具有意義的關聯性。 In addition, the pupil meter is often used to track the pupil size change. Currently, there is no further evaluation device for analyzing the eye tracking function, the pupil meter and the physiological feedback function. It is impossible to know, for example, whether the most visual focus and pupil change correspond to physiological feedback. The relevance of meaning.
已知現有技術包括如JINS MEME智慧型眼鏡以眼電圖分析眼球運動模式推算疲勞與睡意程度，或FOVE公司的頭戴式顯示器(HMD)採用攝影機的眼球追蹤技術等，不是以電生理信號就是以眼部影像單一化分析，並未有眼部影像及電生理信號兩者關聯運算分析的技術。 It is known that the prior art includes, for example, JINS MEME smart glasses to estimate the degree of fatigue and drowsiness by analyzing the eye movement mode with an electrooculogram, or FOVE's head-mounted display (HMD) using a camera's eye tracking technology, etc., not by electrophysiological signals. With the singularity analysis of eye images, there is no technology for correlation analysis between eye images and electrophysiological signals.
另外，相關研究指出說謊、吸毒、疲勞等異常 眼部藉由瞳孔變化或控制眼球的睫狀肌有其相關性。卻沒有一套科學化的系統可以精確地進行相關實驗並且量化量測數據以進行後續評估。 In addition, related research points to abnormalities such as lying, drug use, and fatigue. The ciliary muscles of the eye that change or control the eye by the pupil have their relevance. There is no scientific system that can accurately perform relevant experiments and quantify the measured data for subsequent evaluation.
因此，本發明之其中一目的，即在提供一種改善先前技術的整合型視覺生理用頭戴式系統。 Accordingly, it is an object of the present invention to provide an integrated visual physiology head mounted system that improves upon the prior art.
於是，本發明視覺生理用頭戴式系統包含一頭戴式固定裝置、一眼部影像擷取設備、一電生理信號擷取裝置及一運算裝置。 Therefore, the visual physiological head mounted system of the present invention comprises a head mounted fixing device, an eye image capturing device, an electrophysiological signal capturing device and an arithmetic device.
該頭戴式固定裝置安裝於一受測者頭部。該眼部影像擷取設備安裝於該頭戴式固定裝置以產生該受測者的一眼部影像資料。該電生理信號擷取裝置安裝於該受測者頭部以於擷取該受測者的眼部影像資料同時產生該受測者頭部的一電生理回饋資料。該運算裝置電性連接該眼部影像擷取設備及該電生理信號擷取裝置，並依據該眼部影像資料及該電生理回饋資料進行運算分析該眼部影像資料及該電生理回饋資料的關聯性。 The head mounted fixture is mounted to a subject's head. The eye image capturing device is mounted on the head mounted device to generate an eye image of the subject. The electrophysiological signal acquisition device is mounted on the subject's head to capture the subject's eye image data while generating an electrophysiological feedback data of the subject's head. The computing device is electrically connected to the eye image capturing device and the electrophysiological signal capturing device, and performs operation analysis on the eye image data and the electrophysiological feedback data according to the eye image data and the electrophysiological feedback data. Relevance.
在一些實施態樣中，該電生理信號擷取裝置具有一腦電感測器及/或一肌電感測器。 In some embodiments, the electrophysiological signal acquisition device has a brain sensor and/or a muscle sensor.
在一些實施態樣中，該肌電感測器是偵測該受測者的眼睛的睫狀肌產生的肌電信號。 In some embodiments, the muscle sensor is an electromyographic signal generated by a ciliary muscle that detects the subject's eye.
在一些實施態樣中，該腦電感測器為測量該受測者的下腦丘的交感神經系統的腦電信號。 In some embodiments, the brain electrical sensor is an electroencephalogram signal that measures the sympathetic nervous system of the lower cerebral ventricle of the subject.
在一些實施態樣中，該眼部影像擷取設備包括 一刺激感測器，該刺激感測器具有一光源模組及一影像感測模組。該光源模組安裝於該頭戴式固定裝置上以投射光源單眼刺激或雙眼刺激該受測者的眼部，且該雙眼刺激包括左右眼同步刺激或左右眼非同步刺激。該影像感測模組安裝於該頭戴式固定裝置上以於投射光源時感測該受測者的瞳孔影像。該運算裝置依據該光源模組以單眼刺激或雙眼刺激該受測者的眼部獲得的該瞳孔影像運算出一瞳孔資料以供該運算裝置依據該瞳孔資料及該電生理回饋資料運算分析該瞳孔資料及該電生理回饋資料運算的關聯性。 In some implementations, the ocular image capturing device includes A stimulation sensor has a light source module and an image sensing module. The light source module is mounted on the head mounted fixture to project a light source with a single eye stimulus or both eyes to stimulate the subject's eye, and the binocular stimulation includes left and right eye sync stimulation or left and right eye asynchronous stimulation. The image sensing module is mounted on the head mounted fixture to sense the pupil image of the subject when the light source is projected. The computing device calculates a pupil data according to the pupil image obtained by the single-eye stimulation or both eyes stimulating the eye of the subject, for the computing device to calculate and analyze the pupil data according to the pupil data and the electrophysiological feedback data. The correlation between the pupil data and the operation of the electrophysiological feedback data.
在一些實施態樣中，該影像感測模組用以接收 該光源模組照射該受測者的眼睛所反射的反射光。 In some implementations, the image sensing module is configured to receive The light source module illuminates the reflected light reflected by the subject's eyes.
在一些實施態樣中，該運算裝置包括一驅動該 光源模組發出不同波段光線、不同發光強度或不同頻率發光的光刺激驅動模組。 In some implementations, the computing device includes a driver The light source module emits a light stimulation driving module that emits light of different wavelengths, different luminous intensity or different frequency.
在一些實施態樣中，該光源模組具有一發光二 極體、一雷射光二極體、一結合螢光燈及濾光片之組合元件，或一結合白熾燈及濾光片之組合元件。 In some implementations, the light source module has a light emitting A combination of a polar body, a laser diode, a combination of a fluorescent lamp and a filter, or a combination of an incandescent lamp and a filter.
在一些實施態樣中，該眼部影像擷取設備包括 一眼動追蹤器，該眼動追蹤器安裝於該頭戴式固定裝置上，具有一向外攝影模組與一向內攝影模組，該向外攝影模組擷取該受測者觀看的一外界影像，該向內攝影模組擷取該受測者的眼部影像，該運算裝置運算分析該外界影像和該眼部影像以產生該受測者的一視焦資料，且運算分析該 視焦資料及該電生理回饋資料的關聯性。 In some implementations, the ocular image capturing device includes An eye tracker is mounted on the head mounted fixture and has an outward camera module and an inward camera module, wherein the outward camera module captures an external image viewed by the subject The inward camera module captures an eye image of the subject, and the computing device calculates and analyzes the external image and the eye image to generate a view data of the subject, and the operation analyzes the image The correlation between the focus data and the electrophysiological feedback data.
在一些實施態樣中，該向外攝影模組所擷取的 影像範圍涵蓋水平視角至少60度至180度之間以及垂直視角至少55度至180度之間。 In some implementations, the outward photographic module captures The image range covers a horizontal viewing angle of at least 60 degrees to 180 degrees and a vertical viewing angle of at least 55 degrees to 180 degrees.
本發明之功效在於：透過眼部影像擷取設備產 生受測者的眼部影像資料，電生理信號擷取裝置產生受測者頭部的電生理回饋資料，且運算裝置依據眼部影像資料及電生理回饋資料進行運算分析眼部影像資料及電生理回饋資料的關聯性，可進一步科學化評估瞳孔變化、視覺焦點變化及電生理信號的關聯性。 The effect of the invention is: through the eye image capture device production The eye image data of the subject is measured, and the electrophysiological signal capturing device generates electrophysiological feedback data of the subject's head, and the computing device performs operation analysis on the eye image data and electricity according to the eye image data and the electrophysiological feedback data. The relevance of physiological feedback data can further scientifically assess the correlation between pupillary changes, visual focus changes and electrophysiological signals.
1‧‧‧刺激感測器 1‧‧‧Stimulus sensor
10、100‧‧‧視覺生理用頭戴式系統 10,100‧‧‧Visual physiological head-mounted system
200‧‧‧眼部影像擷取設備 200‧‧‧Eye image capture device
101‧‧‧光源模組 101‧‧‧Light source module
102‧‧‧影像感測模組 102‧‧‧Image Sensing Module
11‧‧‧光刺激驅動模組 11‧‧‧Light Stimulation Drive Module
12‧‧‧瞳孔影像擷取模組 12‧‧‧ pupil image capture module
13‧‧‧變化數據分析模組 13‧‧‧Change data analysis module
2‧‧‧眼動追蹤器 2‧‧‧ eye tracker
201‧‧‧向外攝影模組 201‧‧‧Outward photography module
202‧‧‧向內攝影模組 202‧‧‧Inward photography module
21‧‧‧外界影像分析模組 21‧‧‧ External image analysis module
22‧‧‧眼部影像分析模組 22‧‧‧Eye image analysis module
23‧‧‧視野焦點對應模組 23‧‧‧Vision focus corresponding module
3‧‧‧電生理信號擷取裝置 3‧‧‧Electrophysiological signal acquisition device
30‧‧‧處理裝置 30‧‧‧Processing device
301‧‧‧瞳孔變化波形 301‧‧‧ pupil change waveform
302‧‧‧光刺激波形 302‧‧‧Light Stimulation Waveform
31‧‧‧腦電感測器 31‧‧‧ Brain Inductance Detector
32‧‧‧肌電感測器 32‧‧‧Muscle Inductance Detector
34‧‧‧濾波模組 34‧‧‧Filter module
340‧‧‧分析模組 340‧‧‧Analysis module
341‧‧‧低頻濾波模組 341‧‧‧Low frequency filter module
342‧‧‧中頻濾波模組 342‧‧‧Intermediate frequency filter module
343‧‧‧高頻濾波模組 343‧‧‧High frequency filter module
35‧‧‧頻域分析模組 35‧‧‧Frequency Domain Analysis Module
36‧‧‧時域分析模組 36‧‧‧Time Domain Analysis Module
4‧‧‧儲存裝置 4‧‧‧Storage device
41‧‧‧眼部資料庫 41‧‧‧Eye database
411‧‧‧眼動資料庫 411‧‧‧ Eye Movement Database
412‧‧‧瞳孔資料庫 412‧‧‧ pupil database
413‧‧‧視覺調節資料庫 413‧‧•Visual Adjustment Database
42‧‧‧視焦資料庫 42‧‧·Visual Focus Database
43‧‧‧生理回饋資料庫 43‧‧‧Physical Feedback Database
5‧‧‧運算裝置 5‧‧‧ arithmetic device
501‧‧‧處理單元 501‧‧‧Processing unit
502‧‧‧處理模組 502‧‧‧Processing module
503‧‧‧處理電路 503‧‧‧Processing circuit
504‧‧‧運算電路 504‧‧‧Operating circuit
51‧‧‧整合資料庫 51‧‧‧Integrated database
6‧‧‧頭戴式固定裝置 6‧‧‧ head mounted fixtures
7‧‧‧外部物體 7‧‧‧External objects
8‧‧‧受測者 8‧‧‧ Subjects
81‧‧‧瞳孔 81‧‧‧瞳孔
82‧‧‧眼球 82‧‧‧ eyeballs
S21~S29‧‧‧步驟 S21~S29‧‧‧Steps
本發明之其他的特徵及功效，將於參照圖式的實施例詳細說明中清楚地呈現，其中：圖1是一系統示意圖，說明本發明視覺生理用頭戴式系統的第一實施例；圖2是一波形圖，說明光刺激波形及瞳孔直徑變化波形；圖3是一系統示意圖，說明本發明視覺生理用頭戴式系統的第二實施例；圖4是一流程示意圖，說明本發明視覺生理用頭戴式系統的光源驅動及交互運算方法的實施例。 The other features and advantages of the present invention will be apparent from the detailed description of the embodiments of the present invention, wherein: FIG. 1 is a system schematic diagram illustrating a first embodiment of the visual physiological head mounted system of the present invention; 2 is a waveform diagram illustrating a light stimulation waveform and a pupil diameter variation waveform; FIG. 3 is a system diagram illustrating a second embodiment of the visual physiological head mounted system of the present invention; and FIG. 4 is a flow diagram illustrating the vision of the present invention An embodiment of a light source driving and interactive computing method for a physiological head mounted system.
在本發明被詳細描述之前，應當注意在以下的 說明內容中，類似的元件是以相同的編號來表示。 Before the present invention is described in detail, it should be noted in the following In the description, similar elements are denoted by the same reference numerals.
參閱圖1，本發明之第一實施例中，視覺生理用 頭戴式系統100包含一配戴於一受測者8的頭戴式固定裝置6、一光刺激驅動模組11、一光源模組101、一電生理信號擷取裝置3、一處理裝置30及一儲存裝置4。各元件的作用原理說明如下。 Referring to Figure 1, in the first embodiment of the present invention, visual physiology The head mounted system 100 includes a head mounted fixture 6 attached to a subject 8, a light stimulation driving module 11, a light source module 101, an electrophysiological signal capturing device 3, and a processing device 30. And a storage device 4. The principle of operation of each component is explained below.
光刺激驅動模組11驅動光源模組101發出不同 波段光線、不同發光強度或不同頻率發光。電生理信號擷取裝置3安裝於受測者8頭部以產生受測者8頭部的一電生理回饋資料，且電生理回饋資料包括腦電資料、肌電資料或類似的生理信號資料，皆屬於本發明範疇。 The light stimulation driving module 11 drives the light source module 101 to issue different Band light, different luminous intensity or different frequencies. The electrophysiological signal acquisition device 3 is mounted on the head of the subject 8 to generate an electrophysiological feedback data of the head of the subject 8, and the electrophysiological feedback data includes EEG data, myoelectric data or similar physiological signal data. All belong to the scope of the invention.
處理裝置30具有一分析模組340、一低頻濾波 模組341、一中頻濾波模組342及一高頻濾波模組343。低頻濾波模組341用以對前述的生理信號資料濾波以取得低頻濾波資料，中頻濾波模組342用以對前述的生理信號資料濾波以取得中頻濾波資料，高頻濾波模組343用以對前述的生理信號資料濾波以取得高頻濾波資料。分析模組340對前述低頻、中頻及高頻濾波資料進行分析處理，藉此獲得一關聯於低頻率的眼睛動作的眼動資料、一關聯於瞳孔變化的中頻率的瞳孔資料及一關聯於高頻率的視覺調節資料。儲存裝置4具有一眼動資料庫411、一瞳孔資料庫412及一視覺調節資料庫413，眼動資料庫411、瞳孔資料庫412及視覺調節資料庫413分別用以儲存前述的眼動資料、瞳孔資料及視覺調節資料。 The processing device 30 has an analysis module 340 and a low frequency filter. The module 341, an intermediate frequency filter module 342 and a high frequency filter module 343. The low frequency filtering module 341 is configured to filter the physiological signal data to obtain low frequency filtering data, and the intermediate frequency filtering module 342 is configured to filter the physiological signal data to obtain intermediate frequency filtering data, and the high frequency filtering module 343 is used for The aforementioned physiological signal data is filtered to obtain high frequency filtered data. The analysis module 340 analyzes and processes the low frequency, intermediate frequency and high frequency filter data, thereby obtaining an eye movement data associated with a low frequency eye motion, a pupil frequency associated with a pupil frequency change, and an association with High frequency visual adjustment data. The storage device 4 has an eye movement database 411, a pupil database 412 and a visual adjustment database 413. The eye movement database 411, the pupil database 412 and the visual adjustment database 413 are respectively used to store the aforementioned eye movement data and pupils. Data and visual adjustment data.
參閱圖2，為一光刺激波形301及一瞳孔變化波 形302，本例中是在第5秒產生光刺激波形301，光刺激波形301的閃光持續時間為10毫秒，可觀察到瞳孔變化波形在閃光結束後的瞳孔直徑變化幅度約為0.13毫米左右。 Referring to FIG. 2, a light stimulation waveform 301 and a pupil change wave In the case of the shape 302, in this example, the light stimulation waveform 301 is generated in the 5th second, and the flash duration of the light stimulation waveform 301 is 10 milliseconds. It can be observed that the pupil diameter change waveform has a variation width of about 0.13 mm after the end of the flash.
參閱圖3，本發明之第二實施例中，視覺生理用 頭戴式系統10包含一眼部影像擷取設備200、一電生理信號擷取裝置3、一儲存裝置4、一運算裝置5及一頭戴式固定裝置6。儲存裝置4具有一眼部資料庫41、一視焦資料庫42及一生理回饋資料庫43及一整合資料庫51。另外，運算裝置5具有一處理單元501、一處理模組502、一處理電路503及一運算電路504。 Referring to Figure 3, in a second embodiment of the present invention, visual physiology The head mounted system 10 includes an eye image capturing device 200, an electrophysiological signal capturing device 3, a storage device 4, an arithmetic device 5, and a head mounted fixture 6. The storage device 4 has an eye database 41, a focus database 42 and a physiological feedback database 43 and an integrated database 51. In addition, the computing device 5 has a processing unit 501, a processing module 502, a processing circuit 503, and an arithmetic circuit 504.
茲將各元件結構及原理詳細介紹如下。 The structure and principle of each component are described in detail below.
頭戴式固定裝置6於本實施例是一安裝於一受 測者8頭部的眼鏡，然而，頭戴式固定裝置6於其他實施例也可以是頭巾、帽子、頭套等可固定於頭部之裝置，不以眼鏡為限制。 The head mounted fixture 6 is mounted on a subject in this embodiment. In other embodiments, the headgear, the headgear, and the like can be fixed to the head, and the glasses are not limited.
眼部影像擷取設備200安裝於頭戴式固定裝置 6以產生受測者8的一眼部影像資料，且眼部影像資料包括瞳孔81或眼球82的相關資料，皆屬於本發明範疇。電生理信號擷取裝置3安裝於受測者8頭部以產生受測者8頭部的一電生理回饋資料，且電生理回饋資料包括腦電資料、肌電資料或類似的生理信號資料，皆屬於本發明範疇。 The eye image capturing device 200 is mounted on the head mounted fixture 6 to generate an eye image data of the subject 8 and the eye image data including the pupil 81 or the eyeball 82 related information are all within the scope of the present invention. The electrophysiological signal acquisition device 3 is mounted on the head of the subject 8 to generate an electrophysiological feedback data of the head of the subject 8, and the electrophysiological feedback data includes EEG data, myoelectric data or similar physiological signal data. All belong to the scope of the invention.
眼部影像擷取設備200包括一刺激感測器1及 一眼動追蹤器2。 The eye image capturing device 200 includes a stimulation sensor 1 and One eye tracker 2.
刺激感測器1具有一光源模組101及一影像感 測模組102。處理單元501包括一光刺激驅動模組11、一瞳孔影像擷取模組12，及一變化數據分析模組13。 The stimulation sensor 1 has a light source module 101 and an image sense Test module 102. The processing unit 501 includes a light stimulation driving module 11 , a pupil image capturing module 12 , and a change data analyzing module 13 .
光源模組101安裝於頭戴式固定裝置6上，具 有一發光二極體、一雷射光二極體、一結合螢光燈及濾光片之組合元件，或一結合白熾燈及濾光片之組合元件，用以投射光源單眼刺激或雙眼刺激受測者8的瞳孔81，且雙眼刺激包括左右眼同步刺激或左右眼非同步刺激。 The light source module 101 is mounted on the head mounted fixture 6 a combination of a light-emitting diode, a laser diode, a combination of a fluorescent lamp and a filter, or a combination of an incandescent lamp and a filter for projecting a single eye stimulus or binocular stimulation The pupil 81 of the subject 8 and the binocular stimulation include left and right eye synchronized stimulation or left and right eye asynchronous stimulation.
光刺激驅動模組11驅動光源模組101發出不同 波段光線、不同發光強度或不同頻率發光。 The light stimulation driving module 11 drives the light source module 101 to issue different Band light, different luminous intensity or different frequencies.
影像感測模組102安裝於頭戴式固定裝置6上 ，用以接收光源模組101照射受測者8的眼睛所反射的反射光並感測受測者8的瞳孔影像。 The image sensing module 102 is mounted on the head mounted fixture 6 The light source module 101 is configured to receive the reflected light reflected by the eye of the subject 8 and sense the pupil image of the subject 8 .
瞳孔影像擷取模組12取得影像感測模組102獲 得的瞳孔影像，變化數據分析模組13依據瞳孔影像運算出一瞳孔資料後，將瞳孔資料儲存於眼部資料庫41，供運算電路504依據瞳孔資料及電生理回饋資料運算分析瞳孔資料及電生理回饋資料運算的關聯性後，將瞳孔資料及電生理回饋資料運算的關聯性數據資料儲存於整合資料庫51。 The pupil image capturing module 12 obtains the image sensing module 102 The obtained pupil image, the change data analysis module 13 calculates a pupil data according to the pupil image, and stores the pupil data in the eye database 41, and the arithmetic circuit 504 calculates and analyzes the pupil data and the electricity according to the pupil data and the electrophysiological feedback data. After the relevance of the physiological feedback data operation, the related data of the pupil data and the electrophysiological feedback data calculation are stored in the integrated database 51.
眼動追蹤器2安裝於頭戴式固定裝置6上，具 有一向外攝影模組201與一向內攝影模組202，向外攝影模組201擷取受測者8觀看一外部物體7的一外界影像，向內攝影模組202擷取受測者8的眼部影像。處理模組502具有一外界影像分析模組21、一眼部影像分析模組22及一 視野焦點對應模組23。 The eye tracker 2 is mounted on the head mounted fixture 6 There is an outward photographic module 201 and an inward photographic module 202. The external photographic module 201 captures an external image of the external object 7 from the subject 8, and the inward photographic module 202 captures the subject 8 Eye image. The processing module 502 has an external image analysis module 21, an eye image analysis module 22, and a The field of view corresponds to the module 23.
當受測者8注視外部物體7時，外界影像分析 模組21處理包含外部物體7的外界影像，眼部影像分析模組22處理受測者8的眼部影像，視野焦點對應模組23用以依據前述外界影像及眼部影像產生受測者8相關於外部物體7的一視焦資料，然後，視焦資料儲存於視焦資料庫42。運算電路504運算分析視焦資料及電生理回饋資料的關聯性。然後，視焦資料及電生理回饋資料的關聯性數據資料儲存於整合資料庫51。 When the subject 8 looks at the external object 7, external image analysis The module 21 processes the external image including the external object 7, and the eye image analysis module 22 processes the eye image of the subject 8. The visual field focus corresponding module 23 generates the subject according to the external image and the eye image. A focus data associated with the external object 7 is then stored in the focus data library 42. The arithmetic circuit 504 calculates the correlation between the analysis focus data and the electrophysiological feedback data. Then, the related data of the focus data and the electrophysiological feedback data are stored in the integrated database 51.
本實施例中，向外攝影模組201所擷取的影像 範圍涵蓋受測者8的眼部前方的水平視角至少60度至180度之間以及垂直視角至少55度至180度之間。 In this embodiment, the image captured by the outward photography module 201 The range covers a horizontal viewing angle in front of the eye of the subject 8 of at least 60 degrees to 180 degrees and a vertical viewing angle of at least 55 degrees to 180 degrees.
電生理信號擷取裝置3具有一腦電感測器31、 一肌電感測器32，處理電路503具有一濾波模組34、一頻域分析模組35及一時域分析模組36。 The electrophysiological signal acquisition device 3 has a brain inductance detector 31, A muscle sensor 32, the processing circuit 503 has a filter module 34, a frequency domain analysis module 35 and a time domain analysis module 36.
肌電感測器32是偵測受測者8的眼睛的睫狀肌 產生的肌電信號。腦電感測器31為測量受測者8的下腦丘的交感神經系統的腦電信號。濾波模組34具有數個對應腦電感測器31及肌電感測器32的濾波器(圖未示)以分別取得濾除雜訊的電生理信號，該等電生理信號並分別通過頻域分析模組35及時域分析模組36的運算處理而得到相關於頻率及時間的電生理回饋資料而記錄於生理回饋資料庫43。 The muscle sensor 32 is a ciliary muscle that detects the eye of the subject 8 The resulting EMG signal. The brain electrical sensor 31 is an electroencephalogram signal that measures the sympathetic nervous system of the hypothalamus of the subject 8. The filter module 34 has a plurality of filters (not shown) corresponding to the brain inductive detector 31 and the muscle inductive detector 32 to respectively obtain electrophysiological signals for filtering noise, and the electrophysiological signals are respectively analyzed by frequency domain. The module 35 performs the arithmetic processing of the time domain analysis module 36 to obtain the electrophysiological feedback data related to the frequency and time, and records it in the physiological feedback database 43.
運算電路504電性連接眼部資料庫41、視焦資 料庫42及生理回饋資料庫43，並依據眼部資料庫41、視焦資料庫42及生理回饋資料庫43其中的眼部影像資料及電生理回饋資料進行運算分析眼部影像資料及電生理回饋資料的關聯性。其他實施例中，運算電路504也可以電性連接處理單元501及處理模組502以即時取得的資料直接運算分析，也屬於本發明範疇。 The operation circuit 504 is electrically connected to the eye database 41 The library 42 and the physiological feedback database 43 perform and analyze the eye image data and electrophysiology according to the eye image data and the electrophysiological feedback data of the eye database 41, the focus database 42 and the physiological feedback database 43. The relevance of the feedback material. In other embodiments, the arithmetic circuit 504 can also be electrically connected to the processing unit 501 and the processing module 502 for direct calculation and analysis of the data obtained in real time, and is also within the scope of the present invention.
參閱圖4，並配合圖3，本發明視覺生理用頭戴 式系統10的光源驅動及交互運算方法包括下述步驟。 Referring to Figure 4, and in conjunction with Figure 3, the visual physiology wearing head of the present invention The light source driving and interactive computing method of system 10 includes the following steps.
首先，光刺激驅動模組11驅動光源模組101發 出不同波長之光源(步驟S21)、發出不同強度之光源(步驟S22)、或者發出不同時間長短之光源(步驟S23)；然後，刺激感測器1擷取瞳孔影像、電生理信號擷取裝置3擷取生理回饋信號，及眼動追蹤器2擷取視覺焦點信號(步驟S24)；然後，運算裝置5的處理單元501分析瞳孔影像以產生瞳孔大小及收縮速率的瞳孔分析數據(步驟S25)、處理電路503分析生理回饋信號以產生生理回饋數據(步驟S26)，及處理模組502分析視覺焦點信號以產生視覺焦點數據(步驟S27)；最後，運算裝置5依據前述數據進行交互運算(步驟S28)以得到前述數據中的至少二者的關聯性資料。 First, the light stimulation driving module 11 drives the light source module 101 to send Light sources of different wavelengths (step S21), emitting light sources of different intensities (step S22), or emitting light sources of different lengths of time (step S23); then, stimulating sensor 1 captures pupil images, electrophysiological signal extraction device 3 extracting the physiological feedback signal, and the eye tracker 2 captures the visual focus signal (step S24); then, the processing unit 501 of the computing device 5 analyzes the pupil image to generate the pupil size data of the pupil size and the contraction rate (step S25) The processing circuit 503 analyzes the physiological feedback signal to generate physiological feedback data (step S26), and the processing module 502 analyzes the visual focus signal to generate visual focus data (step S27); finally, the computing device 5 performs an interactive operation according to the aforementioned data (step S28) to obtain association data of at least two of the foregoing data.
補充說明的是，受測者8的單眼評估分析係將 眼部影像擷取設備200的影像感測模組102、向外攝影模組201、向內攝影模組202的數量各為一組配置於待分析的單眼附近，雙眼評估分析則是二組影像感測模組102、二組向外攝影模組201及二組向內攝影模組202，且各影像感測模 組102、各向外攝影模組201及各向內攝影模組202分別配置於待分析的各眼部附近。 In addition, the subject's monocular assessment analysis will be The image sensing module 102, the outward imaging module 201, and the inward imaging module 202 of the eye image capturing device 200 are each disposed in a group near the single eye to be analyzed, and the binocular evaluation analysis is two groups. The image sensing module 102, the two groups of outward photography modules 201 and the two groups of inward imaging modules 202, and each image sensing module The group 102, each of the outward photography modules 201 and the inward imaging modules 202 are respectively disposed in the vicinity of each eye to be analyzed.
綜上所述，本發明之功效在於：如第一實施例 透過眼部影像擷取設備100的光源模組101產生光刺激，配合電生理信號擷取裝置3產生受測者8的電生理回饋資料，且運算裝置5依據電生理回饋資料進行運算分析，可進一步科學化評估眼動資料、瞳孔資料及視覺調節資料。 如第二實施例透過眼部影像擷取設備200的影像感測模組102、向外攝影模組201、向內攝影模組202產生受測者8的眼部影像資料，電生理信號擷取裝置3產生受測者8的電生理回饋資料，且運算裝置5依據眼部影像資料及電生理回饋資料進行運算分析眼部影像資料及電生理回饋資料的關聯性，可進一步科學化評估瞳孔變化、視覺焦點變化及電生理信號的關聯性，故確實能達成本發明之目的。 In summary, the effect of the present invention lies in: as in the first embodiment The light source module 101 of the eye image capturing device 100 generates light stimulation, and the electrophysiological signal capturing device 3 generates the electrophysiological feedback data of the subject 8 , and the computing device 5 performs operation analysis according to the electrophysiological feedback data. Further scientific assessment of eye movement data, pupil data and visual adjustment data. As shown in the second embodiment, the image sensing module 102, the outward imaging module 201, and the inward imaging module 202 of the eye image capturing device 200 generate eye image data of the subject 8, and the electrophysiological signal is captured. The device 3 generates electrophysiological feedback data of the subject 8, and the computing device 5 performs an operation to analyze the correlation between the ocular image data and the electrophysiological feedback data according to the ocular image data and the electrophysiological feedback data, and can further scientifically evaluate the pupillary change. The change in visual focus and the correlation of electrophysiological signals make it possible to achieve the object of the present invention.
惟以上所述者，僅為本發明之實施例而已，當 不能以此限定本發明實施之範圍，即大凡依本發明申請專利範圍及專利說明書內容所作之簡單的等效變化與修飾，皆仍屬本發明專利涵蓋之範圍內。 However, the above is only an embodiment of the present invention, when The scope of the present invention is not limited thereto, that is, the simple equivalent changes and modifications made by the present invention in the scope of the invention and the patent specification are still within the scope of the invention.
100‧‧‧視覺生理用頭戴式系統 100‧‧‧Visual Physiology Headset System
101‧‧‧光源模組 101‧‧‧Light source module
11‧‧‧光刺激驅動模組 11‧‧‧Light Stimulation Drive Module
3‧‧‧電生理信號擷取裝置 3‧‧‧Electrophysiological signal acquisition device
30‧‧‧處理裝置 30‧‧‧Processing device
340‧‧‧分析模組 340‧‧‧Analysis module
341‧‧‧低頻濾波模組 341‧‧‧Low frequency filter module
342‧‧‧中頻濾波模組 342‧‧‧Intermediate frequency filter module
343‧‧‧高頻濾波模組 343‧‧‧High frequency filter module
4‧‧‧儲存裝置 4‧‧‧Storage device
411‧‧‧眼動資料庫 411‧‧‧ Eye Movement Database
412‧‧‧瞳孔資料庫 412‧‧‧ pupil database
413‧‧‧視覺調節資料庫 413‧‧•Visual Adjustment Database
6‧‧‧頭戴式固定裝置 6‧‧‧ head mounted fixtures
8‧‧‧受測者 8‧‧‧ Subjects
81‧‧‧瞳孔 81‧‧‧瞳孔
82‧‧‧眼球 82‧‧‧ eyeballs
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW104117635A TWI580396B (en) | 2015-06-01 | 2015-06-01 | Head-mounted system for visual physology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW104117635A TWI580396B (en) | 2015-06-01 | 2015-06-01 | Head-mounted system for visual physology |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW201642800A TW201642800A (en) | 2016-12-16 |
| TWI580396B true TWI580396B (en) | 2017-05-01 |
Family
ID=58055734
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW104117635A TWI580396B (en) | 2015-06-01 | 2015-06-01 | Head-mounted system for visual physology |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TWI580396B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109008947A (en) * | 2018-09-10 | 2018-12-18 | 昆明依利科特科技有限公司 | A kind of drug addict's instrument for examining pupil of high accurate verification and measurement ratio |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040196433A1 (en) * | 2001-08-15 | 2004-10-07 | Durnell L.Aurence | Eye tracking systems |
| TW201100064A (en) * | 2009-06-26 | 2011-01-01 | Alcon Res Ltd | Electrical amplification of physiologic signals for accommodative IOL control |
| US20120293773A1 (en) * | 2011-05-20 | 2012-11-22 | Eye-Com Corporation | Systems and methods for measuring reactions of head, eyes, eyelids and pupils |
| CN202665556U (en) * | 2012-07-05 | 2013-01-16 | 西南交通大学 | Eyeglass type truck driver fatigue parameter acquiring device |
| TW201505021A (en) * | 2013-07-30 | 2015-02-01 | Univ Nat Chiao Tung | Head-mount eye tracking system |
-
2015
- 2015-06-01 TW TW104117635A patent/TWI580396B/en not_active IP Right Cessation
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040196433A1 (en) * | 2001-08-15 | 2004-10-07 | Durnell L.Aurence | Eye tracking systems |
| TW201100064A (en) * | 2009-06-26 | 2011-01-01 | Alcon Res Ltd | Electrical amplification of physiologic signals for accommodative IOL control |
| US20120293773A1 (en) * | 2011-05-20 | 2012-11-22 | Eye-Com Corporation | Systems and methods for measuring reactions of head, eyes, eyelids and pupils |
| CN202665556U (en) * | 2012-07-05 | 2013-01-16 | 西南交通大学 | Eyeglass type truck driver fatigue parameter acquiring device |
| TW201505021A (en) * | 2013-07-30 | 2015-02-01 | Univ Nat Chiao Tung | Head-mount eye tracking system |
Also Published As
| Publication number | Publication date |
|---|---|
| TW201642800A (en) | 2016-12-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10314485B2 (en) | Portable google based VOG system with comparative left and right eye ocular response analysis with MTBI analysis using percent of saccade function of smooth pursuit test | |
| JP6530239B2 (en) | Binocular measurement apparatus, binocular measurement method, and binocular measurement program | |
| US9370302B2 (en) | System and method for the measurement of vestibulo-ocular reflex to improve human performance in an occupational environment | |
| JP6129161B2 (en) | System and method for measuring head, eye, eyelid and pupil response | |
| US20150223683A1 (en) | System For Synchronously Sampled Binocular Video-Oculography Using A Single Head-Mounted Camera | |
| Otero-Millan et al. | Knowing what the brain is seeing in three dimensions: A novel, noninvasive, sensitive, accurate, and low-noise technique for measuring ocular torsion | |
| US20180249941A1 (en) | Oculometric Neurological Examination (ONE) Appliance | |
| WO2022101785A1 (en) | Improvements in acquisition and analysis of imaging photoplethysmogram signals | |
| Roig et al. | Pupil detection and tracking for analysis of fixational eye micromovements | |
| US20210076970A1 (en) | Device and method to determine objectively visual memory of images | |
| KR20200003094A (en) | Head mountable device | |
| JP2005143684A (en) | Pupil's light reaction measuring instrument for evaluating relax feeling | |
| Velichkovsky et al. | Measurement-related issues in the investigation of active vision | |
| CN104739366A (en) | Portable binocular pupil detection device | |
| Cotrina et al. | A SSVEP-BCI setup based on depth-of-field | |
| TWI580396B (en) | Head-mounted system for visual physology | |
| JP6761976B2 (en) | How to use and system of autonomic nervous fluctuation | |
| TWM522700U (en) | Laser ranging perspective oblique angle measurement device | |
| US10188292B2 (en) | Device for screening convergence insufficiency and related computer implemented methods | |
| Saavedra-Peña | Saccade latency determination using video recordings from consumer-grade devices | |
| WO2022109858A1 (en) | Eye movement tracking apparatus and method | |
| Guo | A wearable non-contact optical system based on muscle tracking for ultra-long-term and indirect eyetracking | |
| Lazar et al. | DEVELOPMENT OF EYE TRACKING PROCEDURES USED FOR THE ANALYSIS OF VISUAL BEHAVIOR-STATE OF ART | |
| WO2023107642A1 (en) | Methods, systems, and computer readable media for biometric ocular photometry | |
| CN114748035A (en) | Pupil light reflection data acquisition system based on single camera |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| MM4A | Annulment or lapse of patent due to non-payment of fees |