TWM588291U - Optical detecting system using head-mounted display - Google Patents

Optical detecting system using head-mounted display Download PDF

Info

Publication number
TWM588291U
TWM588291U TW108209819U TW108209819U TWM588291U TW M588291 U TWM588291 U TW M588291U TW 108209819 U TW108209819 U TW 108209819U TW 108209819 U TW108209819 U TW 108209819U TW M588291 U TWM588291 U TW M588291U
Authority
TW
Taiwan
Prior art keywords
optical detection
image
image processing
head
processing device
Prior art date
Application number
TW108209819U
Other languages
Chinese (zh)
Inventor
陳奕志
許嘉佑
Original Assignee
威盛電子股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 威盛電子股份有限公司 filed Critical 威盛電子股份有限公司
Priority to TW108209819U priority Critical patent/TWM588291U/en
Publication of TWM588291U publication Critical patent/TWM588291U/en

Links

Abstract

本創作提供一種包括光學檢測裝置、影像處理裝置以及頭戴式顯像裝置的使用頭戴式顯像裝置的光學檢測系統。光學檢測裝置對待測物體進行光學檢測以產生對應的檢測影像,影像處理裝置從光學檢測裝置獲取檢測影像並對檢測影像進行影像辨識操作而產生辨識後影像,頭戴式顯像裝置適於由使用者穿戴在頭上並從光學檢測裝置獲取辨識後影像及將辨識後影像投射在使用者的眼前以供使用者觀視。The present invention provides an optical detection system using a head-mounted development device including an optical detection device, an image processing device, and a head-mounted development device. The optical detection device performs optical detection on the object to be detected to generate a corresponding detection image. The image processing device obtains the detection image from the optical detection device and performs image recognition operation on the detection image to generate a recognized image. The post-recognition image is obtained on the head and from the optical detection device, and the post-recognition image is projected in front of the user's eyes for viewing by the user.

Description

使用頭戴式顯像裝置的光學檢測系統Optical detection system using head-mounted imaging device

本新型是有關於一種光學檢測系統,特別是有關於一種使用頭戴式顯像裝置的光學檢測系統。The present invention relates to an optical detection system, and more particularly to an optical detection system using a head-mounted display device.

光學檢查是工業製程中常見的代表性檢測手法,其先利用光學儀器取得被檢測物的表面狀態,再以電腦影像處理而將被檢測物的表面狀態顯示在檢測場所所設置的顯示器上。在具體的操作過程中,檢測人員必須先將被檢測物擺置在適當的位置,然後再到顯示器上確認被檢測物的表面是否存在異物或圖案異常等瑕疵。Optical inspection is a typical detection method commonly used in industrial processes. It first uses optical instruments to obtain the surface state of the object to be detected, and then uses computer image processing to display the surface state of the object on the display set at the inspection site. In the specific operation process, the inspector must first place the object to be inspected in an appropriate position, and then go to the display to confirm whether there are defects such as foreign objects or abnormal patterns on the surface of the object.

然而,上述的操作過程使得檢測人員必須在擺放被檢測物與觀察顯示器上的顯示畫面之間來回的進行操作,對於檢測人員來說是很不方便的一件事。However, the above-mentioned operation process makes the inspector have to operate back and forth between placing the object to be detected and the display screen on the observation display, which is a very inconvenient thing for the inspector.

有鑑於此,本創作提供了一種使用頭戴式顯像裝置的光學檢測系統,其可使檢測人員輕鬆的完成光學檢測程序。In view of this, the present invention provides an optical inspection system using a head-mounted display device, which can allow inspectors to easily complete the optical inspection procedure.

從一方面來看,本創作提供了一種使用頭戴式顯像裝置的光學檢測系統。此光學檢測系統包括光學檢測裝置、影像處理裝置以及頭戴式顯像裝置。其中,光學檢測裝置對待測物體進行光學檢測以產生對應的檢測影像,影像處理裝置從光學檢測裝置獲取檢測影像並對檢測影像進行影像辨識操作而產生辨識後影像,頭戴式顯像裝置適於由使用者穿戴在頭上並從光學檢測裝置獲取辨識後影像及將辨識後影像投射在使用者的眼前以供使用者觀視。From one aspect, the present invention provides an optical inspection system using a head-mounted imaging device. The optical detection system includes an optical detection device, an image processing device, and a head-mounted display device. The optical detection device performs optical detection on the object to be measured to generate a corresponding detection image. The image processing device obtains a detection image from the optical detection device and performs an image recognition operation on the detection image to generate a recognized image. The head-mounted display device is suitable for use The user wears the head and obtains the recognized image from the optical detection device and projects the recognized image in front of the user's eyes for viewing by the user.

在一個實施例中,光學檢測系統更包括了語音控制裝置。語音控制裝置可以接收使用者的語音、辨識此語音並獲得對應的操作指令,並將操作指令傳遞至影像處理裝置或光學檢測裝置以使影像處理裝置或光學檢測裝置根據操作指令進行操作。In one embodiment, the optical detection system further includes a voice control device. The voice control device can receive a user's voice, recognize the voice, and obtain a corresponding operation instruction, and transmit the operation instruction to the image processing device or the optical detection device so that the image processing device or the optical detection device operates according to the operation instruction.

在一個實施例中,上述的語音控制裝置以有線方式連接到光學檢測裝置或影像處理裝置以傳遞操作指令至光學檢測裝置或影像處理裝置。In one embodiment, the above-mentioned voice control device is connected to the optical detection device or the image processing device in a wired manner to transmit an operation instruction to the optical detection device or the image processing device.

在一個實施例中,上述的語音控制裝置以無線方式連接到光學檢測裝置或影像處理裝置以傳遞操作指令至光學檢測裝置或影像處理裝置。In one embodiment, the above-mentioned voice control device is wirelessly connected to the optical detection device or the image processing device to transmit operation instructions to the optical detection device or the image processing device.

在一個實施例中,光學檢測裝置以有線方式連接到影像處理裝置。In one embodiment, the optical detection device is connected to the image processing device in a wired manner.

在一個實施例中,光學檢測裝置以無線方式連接到影像處理裝置。In one embodiment, the optical detection device is wirelessly connected to the image processing device.

在一個實施例中,影像處理裝置是頭戴式顯像裝置的一部份。In one embodiment, the image processing device is part of a head-mounted display device.

在一個實施例中,影像處理裝置以串流方式將辨識後影像傳遞至頭戴式顯像裝置。In one embodiment, the image processing device transmits the recognized image to the head-mounted display device in a streaming manner.

根據上述,本創作對光學檢測裝置檢測出的影像進行辨識,並將辨識所得的結果傳遞到可被戴在使用者頭上的頭戴式顯像裝置上,因此辨識所得的結果可以直接被顯示在使用者的眼前,使得使用者可以專心的調整被檢測物的擺放位置並直接在眼前看到檢測的結果,減少了使用者必須在擺放被檢測物與從顯示裝置上檢視檢測結果這兩者之間來回移動的需要。According to the above, this creation recognizes the image detected by the optical detection device and transmits the recognition result to a head-mounted display device that can be worn on the user's head, so the recognition result can be directly displayed on the user In front of the eyes, the user can adjust the placement position of the test object and see the test result directly in front of the eyes, reducing the user's need to place the test object and view the test result from the display device. The need to move back and forth between times.

請參照圖1,其為根據本創作一實施例的使用頭戴式顯像裝置的光學檢測系統的電路方塊圖。本實施例中的光學檢測系統10主要包括了一個光學檢測裝置100、一個影像處理裝置110以及一個頭戴式顯像裝置120。其中,光學檢測裝置100以有線方式連接到影像處理裝置110以在光學檢測裝置100與影像處理裝置110之間傳遞資料,頭戴式顯像裝置120也以有線方式連接到影像處理裝置110以在頭戴式顯像裝置120與影像處理裝置110之間傳遞資料。Please refer to FIG. 1, which is a circuit block diagram of an optical detection system using a head-mounted display device according to an embodiment of the present invention. The optical detection system 10 in this embodiment mainly includes an optical detection device 100, an image processing device 110, and a head-mounted display device 120. Among them, the optical detection device 100 is connected to the image processing device 110 in a wired manner to transfer data between the optical detection device 100 and the image processing device 110, and the head-mounted display device 120 is also connected to the image processing device 110 in a wired manner to display the data in the head-mounted display. Data is transmitted between the image device 120 and the image processing device 110.

具體的,使用者可以將待測物體安置在光學檢測裝置100的適當位置上,以使光學檢測裝置100能夠對待測物體進行適當的光學檢測操作。光學檢測裝置100藉由檢測待測物體而產生對應的檢測影像,並且檢測影像會被經由光學檢測裝置100與影像處理裝置110之間的連線而傳送到影像處理裝置110。影像處理裝置110在從光學檢測裝置100獲取檢測影像之後,會對檢測影像進行影像辨識操作並產生對應的辨識後影像。然後,影像處理裝置110所產生的辨識後影像將藉由頭戴式顯像裝置120與影像處理裝置110之間的連線而被傳遞至頭戴式顯像裝置120。最後,頭戴式顯像裝置120會將所接收到的辨識後影像投射在該使用者的眼前以供該使用者觀視。Specifically, the user may place the object to be measured at an appropriate position of the optical detection device 100 so that the optical detection device 100 can perform an appropriate optical detection operation on the object to be measured. The optical detection device 100 generates a corresponding detection image by detecting the object to be measured, and the detection image is transmitted to the image processing device 110 via a connection between the optical detection device 100 and the image processing device 110. After the image processing device 110 acquires a detection image from the optical detection device 100, it performs an image recognition operation on the detection image and generates a corresponding recognized image. Then, the identified image generated by the image processing device 110 is transmitted to the head-mounted display device 120 through a connection between the head-mounted display device 120 and the image processing device 110. Finally, the head-mounted display device 120 projects the received identified image in front of the user's eyes for viewing by the user.

在上述的實施例中,光學檢測裝置100可以是現有技術中經常使用並且可以產生檢測影像的各種光學檢測儀器;影像處理裝置110可以是桌上型電腦或筆記型電腦等具有強力運算功能的裝置;頭戴式顯像裝置可以是具有擴增實境(Augmented Reality,AR)功能的裝置,例如:擴增實境眼鏡。In the above embodiments, the optical detection device 100 may be various optical detection instruments often used in the prior art and capable of generating detection images; the image processing device 110 may be a device with a powerful computing function such as a desktop computer or a notebook computer ; The head-mounted display device may be a device with Augmented Reality (AR) function, for example: augmented reality glasses.

在一個實施例中,頭戴式顯像裝置可以是具有一個可以設置小型投影設備的空間以及一個半反射半透射的鏡片的頭戴裝置。其中,小型投影設備的空間中可以安裝一個影像顯示元件以及一個投影元件,影像顯示元件接收並顯示前述的辨識後影像,所顯示的辨識後影像經過投影元件的投射而成像於半反射半透射的鏡片上。當使用者將頭戴式顯像裝置戴在頭上的時候,鏡片可以被設置在使用者的眼前以使使用者可以同時檢視到現實中待測元件的位置以及待測元件經過檢測而得到的影像。In one embodiment, the head-mounted display device may be a head-mounted device having a space where a small projection device can be installed and a semi-reflective lens. Among them, an image display element and a projection element can be installed in the space of the small projection device. The image display element receives and displays the aforementioned identified image, and the displayed identified image is projected by the projection element to be imaged on a semi-reflective and transflective image. On the lens. When the user wears the head-mounted imaging device on the head, the lens can be set in front of the user's eyes so that the user can simultaneously view the position of the device under test and the image obtained by the device under test.

在另一個實施例中,上述的影像顯示元件可以是智慧型手機的螢幕,而智慧型手機與影像處理裝置110之間可以利用串流方式來傳遞上述的辨識後影像。In another embodiment, the image display device may be a screen of a smart phone, and the smart phone and the image processing device 110 may use a streaming method to transmit the identified image.

更進一步的,光學檢測系統10還可以包括一個語音控制裝置130。如圖所示,語音控制裝置130以有線的方式分別連接到光學檢測裝置100以及影像處理裝置110。語音控制裝置130可以接收使用者發出的語音,並且對所接收到的語音進行分析而獲得對應的操作指令;然後,語音控制裝置130可以根據操作指令的執行對象而將操作指令傳遞到光學檢測裝置100或影像處理裝置110;最後,接收到操作指令的光學檢測裝置100或影像處理裝置110就可以根據操作指令來進行對應的操作。例如:使用者可以藉由語音來控制光學檢測裝置100移動位置以對待測物體的其它部位進行檢測;或者,使用者也可以藉由語音來控制影像處理裝置110將辨識後影像的特定部位放大,以使觀察視野能夠更為清晰。Furthermore, the optical detection system 10 may further include a voice control device 130. As shown, the voice control device 130 is connected to the optical detection device 100 and the image processing device 110 in a wired manner. The voice control device 130 may receive a voice issued by the user, and analyze the received voice to obtain a corresponding operation instruction; then, the voice control device 130 may transmit the operation instruction to the optical detection device according to the execution object of the operation instruction 100 or the image processing device 110; finally, the optical detection device 100 or the image processing device 110 that received the operation instruction can perform a corresponding operation according to the operation instruction. For example: the user can control the moving position of the optical detection device 100 to detect other parts of the object to be detected by voice; or the user can also control the image processing device 110 to enlarge a specific part of the recognized image by voice. In order to make the observation field more clear.

應注意的是,雖然圖1所示的實施例中的光學檢測裝置100、影像處理裝置110、頭戴式顯像裝置120及語音控制裝置130之間的連線是以有線方式為之,但實作時也可以將這些連線完全或部分以無線方式替代,藉此提高裝置的可移動性並降低因為踩絆到線路而造成裝置故障或人員受傷的可能性。It should be noted that although the connection between the optical detection device 100, the image processing device 110, the head-mounted display device 120, and the voice control device 130 in the embodiment shown in FIG. 1 is wired, the implementation is You can also replace all or part of these connections wirelessly, thereby improving the mobility of the device and reducing the possibility of device failure or injury due to tripping on the line.

根據上述,採用本創作所提供的使用頭戴式顯像裝置的光學檢測系統,可以將辨識所得的結果直接顯示在使用者的眼前,使得使用者能夠專心的調整被檢測物的擺放位置並直接在眼前看到檢測的結果,以及減少使用者必須在擺放被檢測物與從顯示裝置上檢視檢測結果這兩者之間來回移動的需要。According to the above, the optical detection system using a head-mounted display device provided by this creation can directly display the recognition result in front of the user's eyes, so that the user can adjust the placement position of the detected object directly and directly Seeing the test results in front of the eyes, and reducing the need for the user to move back and forth between placing the test object and viewing the test results from the display device.

10‧‧‧光學檢測系統
100‧‧‧光學檢測裝置
110‧‧‧影像處理裝置
120‧‧‧頭戴式顯像裝置
130‧‧‧語音控制裝置
10‧‧‧ Optical Inspection System
100‧‧‧Optical detection device
110‧‧‧Image processing device
120‧‧‧ Head Mounted Imaging Device
130‧‧‧Voice control device

圖1為根據本創作一實施例的使用頭戴式顯像裝置的光學檢測系統的電路方塊圖。FIG. 1 is a circuit block diagram of an optical detection system using a head-mounted display device according to an embodiment of the present invention.

Claims (8)

一種使用頭戴式顯像裝置的光學檢測系統,其特徵在於包括:
一光學檢測裝置,對一待測物體進行光學檢測以產生對應的一檢測影像;
一影像處理裝置,從該光學檢測裝置獲取該檢測影像,並對該檢測影像進行影像辨識操作後產生一辨識後影像;以及
一頭戴式顯像裝置,適於由一使用者穿戴在頭上,該頭戴式顯像裝置從該光學檢測裝置獲取該辨識後影像並將該辨識後影像投射在該使用者的眼前以供該使用者觀視。
An optical detection system using a head-mounted display device is characterized in that it includes:
An optical detection device for optically detecting an object to be measured to generate a corresponding detection image;
An image processing device obtains the detection image from the optical detection device and performs an image recognition operation on the detection image to generate a recognized image; and a head-mounted display device suitable for being worn on a head by a user, the head The wearable imaging device obtains the identified image from the optical detection device and projects the identified image in front of the user's eyes for viewing by the user.
如申請專利範圍第1項所述的光學檢測系統,更包括:
一語音控制裝置,該語音控制裝置接收該使用者的一語音、辨識該語音並獲得對應的一操作指令,並將該操作指令傳遞至該影像處理裝置或該光學檢測裝置以使該影像處理裝置或該光學檢測裝置根據該操作指令進行操作。
The optical detection system described in item 1 of the patent application scope further includes:
A voice control device that receives a voice of the user, recognizes the voice and obtains a corresponding operation instruction, and transmits the operation instruction to the image processing device or the optical detection device so that the image processing device Or the optical detection device operates according to the operation instruction.
如申請專利範圍第2項所述的光學檢測系統,其中該語音控制裝置以有線方式連接到該光學檢測裝置或該影像處理裝置以傳遞該操作指令至該光學檢測裝置或該影像處理裝置。The optical detection system according to item 2 of the patent application scope, wherein the voice control device is connected to the optical detection device or the image processing device in a wired manner to transmit the operation instruction to the optical detection device or the image processing device. 如申請專利範圍第2項所述的光學檢測系統,其中該語音控制裝置以無線方式連接到該光學檢測裝置或該影像處理裝置以傳遞該操作指令至該光學檢測裝置或該影像處理裝置。The optical detection system according to item 2 of the patent application scope, wherein the voice control device is wirelessly connected to the optical detection device or the image processing device to transmit the operation instruction to the optical detection device or the image processing device. 如申請專利範圍第1項所述的光學檢測系統,其中該光學檢測裝置以有線方式連接到該影像處理裝置。The optical detection system according to item 1 of the patent application scope, wherein the optical detection device is connected to the image processing device in a wired manner. 如申請專利範圍第1項所述的光學檢測系統,其中該光學檢測裝置以無線方式連接到該影像處理裝置。The optical detection system according to item 1 of the patent application scope, wherein the optical detection device is wirelessly connected to the image processing device. 如申請專利範圍第1項所述的光學檢測系統,其中該影像處理裝置是該頭戴式顯像裝置的一部份。The optical detection system according to item 1 of the patent application scope, wherein the image processing device is a part of the head-mounted display device. 如申請專利範圍第1項所述的光學檢測系統,其中該影像處理裝置以串流方式將該辨識後影像傳遞至該頭戴式顯像裝置。The optical detection system according to item 1 of the patent application scope, wherein the image processing device transmits the identified image to the head-mounted display device in a streaming manner.
TW108209819U 2019-07-26 2019-07-26 Optical detecting system using head-mounted display TWM588291U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW108209819U TWM588291U (en) 2019-07-26 2019-07-26 Optical detecting system using head-mounted display

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW108209819U TWM588291U (en) 2019-07-26 2019-07-26 Optical detecting system using head-mounted display

Publications (1)

Publication Number Publication Date
TWM588291U true TWM588291U (en) 2019-12-21

Family

ID=69585964

Family Applications (1)

Application Number Title Priority Date Filing Date
TW108209819U TWM588291U (en) 2019-07-26 2019-07-26 Optical detecting system using head-mounted display

Country Status (1)

Country Link
TW (1) TWM588291U (en)

Similar Documents

Publication Publication Date Title
US10413177B2 (en) Eyeball observation device, eyewear terminal, line-of-sight detection method, and program
JP5099182B2 (en) Confirmation work support system, server device, head mounted display device, wearable terminal, confirmation work support method and program
US20180032133A1 (en) Eye-gaze detection system, displacement detection method, and displacement detection program
US9916650B2 (en) In-process fault inspection using augmented reality
WO2018030515A1 (en) Line-of-sight detection device
US10950057B2 (en) Virtual spatially registered video overlay display
US20170344112A1 (en) Gaze detection device
JP7005224B2 (en) Information processing equipment, systems, image processing methods, computer programs, and storage media
JP6485819B2 (en) Gaze detection system, deviation detection method, deviation detection program
JP5307407B2 (en) Endoscope apparatus and program
TWM588291U (en) Optical detecting system using head-mounted display
TW200525140A (en) Defect detector and defect detection method
JP6742272B2 (en) Wafer abnormality location detection device and wafer abnormality location identification method
WO2022092762A1 (en) Stereo matching method and image processing device performing same
JP2009224476A (en) Defect relevance displaying apparatus, substrate testing apparatus, and defect relevance displaying method
CN109584226B (en) Quality inspection system and method
US11875757B2 (en) Information processing system
US11023771B2 (en) Information processing apparatus, information processing method, and recording medium
JP2017055233A (en) Display device, display system, and control method of display device
JP2017032870A (en) Image projection device and image display system
JP2009015648A (en) Image processor and image processing method
JPWO2020136831A1 (en) measuring device
WO2018225867A1 (en) Visual function test device, and visual function training device and method
Runji et al. Automatic optical inspection aided augmented reality-based PCBA inspection: a development
JP7300657B2 (en) Ultrasonic probe distance/tilt information remote transmission system