TWM596351U - Augmented reality and artificial intelligence integrated interactive display platform - Google Patents

Augmented reality and artificial intelligence integrated interactive display platform Download PDF

Info

Publication number
TWM596351U
TWM596351U TW108217529U TW108217529U TWM596351U TW M596351 U TWM596351 U TW M596351U TW 108217529 U TW108217529 U TW 108217529U TW 108217529 U TW108217529 U TW 108217529U TW M596351 U TWM596351 U TW M596351U
Authority
TW
Taiwan
Prior art keywords
augmented reality
artificial intelligence
touch screen
head
interactive display
Prior art date
Application number
TW108217529U
Other languages
Chinese (zh)
Inventor
蘇愷宏
賴彥廷
王常松
紀百宏
張仁正
Original Assignee
亞達科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 亞達科技股份有限公司 filed Critical 亞達科技股份有限公司
Priority to TW108217529U priority Critical patent/TWM596351U/en
Publication of TWM596351U publication Critical patent/TWM596351U/en
Priority to NL2027188A priority patent/NL2027188B1/en
Priority to GB2020687.6A priority patent/GB2594121B/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16—ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16M—FRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
    • F16M11/00—Stands or trestles as supports for apparatus or articles placed thereon ; Stands for scientific apparatus such as gravitational force meters
    • F16M11/02—Heads
    • F16M11/04—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand
    • F16M11/043—Allowing translations
    • F16M11/046—Allowing translations adapted to upward-downward translation movement
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16—ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16M—FRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
    • F16M11/00—Stands or trestles as supports for apparatus or articles placed thereon ; Stands for scientific apparatus such as gravitational force meters
    • F16M11/02—Heads
    • F16M11/04—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand
    • F16M11/06—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand allowing pivoting
    • F16M11/08—Means for attachment of apparatus; Means allowing adjustment of the apparatus relatively to the stand allowing pivoting around a vertical axis, e.g. panoramic heads
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16—ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16M—FRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
    • F16M11/00—Stands or trestles as supports for apparatus or articles placed thereon ; Stands for scientific apparatus such as gravitational force meters
    • F16M11/02—Heads
    • F16M11/18—Heads with mechanism for moving the apparatus relatively to the stand
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F16—ENGINEERING ELEMENTS AND UNITS; GENERAL MEASURES FOR PRODUCING AND MAINTAINING EFFECTIVE FUNCTIONING OF MACHINES OR INSTALLATIONS; THERMAL INSULATION IN GENERAL
    • F16M—FRAMES, CASINGS OR BEDS OF ENGINES, MACHINES OR APPARATUS, NOT SPECIFIC TO ENGINES, MACHINES OR APPARATUS PROVIDED FOR ELSEWHERE; STANDS; SUPPORTS
    • F16M11/00—Stands or trestles as supports for apparatus or articles placed thereon ; Stands for scientific apparatus such as gravitational force meters
    • F16M11/20—Undercarriages with or without wheels
    • F16M11/24—Undercarriages with or without wheels changeable in height or length of legs, also for transport only, e.g. by means of tubes screwed into each other
    • F16M11/26—Undercarriages with or without wheels changeable in height or length of legs, also for transport only, e.g. by means of tubes screwed into each other by telescoping, with or without folding
    • F16M11/28—Undercarriages for supports with one single telescoping pillar
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/64—Constructional details of receivers, e.g. cabinets or dust covers
    • H04N5/655—Construction or mounting of chassis, e.g. for varying the elevation of the tube

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Optics & Photonics (AREA)
  • Databases & Information Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Processing Or Creating Images (AREA)

Abstract

A platform includes a head-mounted device, a multifunctional base, a touch screen and a computer system. The head-mounted device is configured to provide augmented reality content. The touch screen is set on the multifunctional base. The computer system is configured to provide streaming data to the touch screen. Users can experience augmented reality and artificial intelligence functions through this platform.

Description

結合擴增實境與人工智慧的機動型互動式 展示平台 Mobile interactive type combining augmented reality and artificial intelligence Display platform

本新型是有關於一種結合擴增實境與人工智慧的機動型互動式展示平台，讓使用者可以體驗擴增實境與人工智慧功能。 The present invention relates to a mobile interactive display platform combining augmented reality and artificial intelligence, so that users can experience augmented reality and artificial intelligence functions.

目前市面上的擴增實境(augmented reality，AR)體驗裝置都僅有有限移動範圍，在固定設計情境下以簡單載具來讓使用者體驗擴增實境功能。且市面上的人工智慧(artificial intelligence，AI)異常偵測體驗都需搭配大型場域設計，大型場域設計因尺寸過大而無法輕易移動，且缺乏應用彈性。 At present, augmented reality (AR) experience devices on the market all have a limited range of movement. In a fixed design scenario, a simple vehicle is used to allow users to experience augmented reality functions. Moreover, the artificial intelligence (AI) anomaly detection experience on the market needs to be equipped with a large-scale field design. The large-scale field design cannot be easily moved due to its large size, and it lacks application flexibility.

本新型的實施例提出一種結合擴增實境與人工智慧的機動型互動式展示平台，包括頭戴式裝置、多功能底座、觸控螢幕與電腦系統。頭戴式裝置用以提供擴增實境內容。觸 控螢幕設置於多功能底座上，電腦系統用以提供一串流資料給觸控螢幕。 The embodiment of the present invention proposes a mobile interactive display platform combining augmented reality and artificial intelligence, including a head-mounted device, a multi-function base, a touch screen and a computer system. The head-mounted device is used to provide augmented reality content. touch The control screen is set on the multifunctional base, and the computer system is used to provide a stream of data to the touch screen.

在一些實施例中，觸控螢幕用以在多功能底座上旋轉。 In some embodiments, the touch screen is used to rotate on the multifunctional base.

在一些實施例中，電腦系統用以傳送旋轉訊號至多功能底座，藉此旋轉觸控螢幕，使得串流資料所對應的視角軸線與頭戴式裝置的視角軸線相同。 In some embodiments, the computer system is used to transmit a rotation signal to the multi-function base, thereby rotating the touch screen so that the viewing axis corresponding to the streaming data is the same as the viewing axis of the head mounted device.

在一些實施例中，多功能底座還包括無線通訊模組。 In some embodiments, the multi-function base further includes a wireless communication module.

為讓本新型的上述特徵和優點能更明顯易懂，下文特舉實施例，並配合所附圖式作詳細說明如下。 In order to make the above-mentioned features and advantages of the present invention more obvious and understandable, the embodiments are specifically described below and described in detail in conjunction with the accompanying drawings.

110‧‧‧頭戴式裝置 110‧‧‧Head-mounted device

120‧‧‧觸控螢幕 120‧‧‧Touch screen

130‧‧‧電腦系統 130‧‧‧ Computer system

141‧‧‧螢幕控制單元 141‧‧‧ screen control unit

142‧‧‧無線通訊模組 142‧‧‧Wireless communication module

140‧‧‧多功能底座 140‧‧‧Multifunctional base

301~311‧‧‧步驟 301~311‧‧‧Step

[圖1]是根據一實施例繪示結合擴增實境與人工智慧的機動型互動式展示平台。 [FIG. 1] A mobile interactive display platform combining augmented reality and artificial intelligence according to an embodiment.

[圖2]是根據一實施例繪示平台系統架構圖。 [FIG. 2] is a diagram illustrating a platform system architecture according to an embodiment.

[圖3]是根據一實施例繪示平台內容設計流程圖。 [FIG. 3] A flow chart of platform content design according to an embodiment.

圖1是根據一實施例繪示結合擴增實境與人工智慧的機動型互動式展示平台，請參照圖1，此平台包括了頭戴式裝置110、觸控螢幕120、電腦系統130與多功能底座140。使用者可戴上頭戴式裝置110來體驗擴增實境與人工智慧，因 此電腦系統130也可稱為體驗擴增實境與人工智慧(artificial intelligence and augmented reality，AIR)主機。 1 is a mobile interactive display platform combining augmented reality and artificial intelligence according to an embodiment. Please refer to FIG. 1. This platform includes a head-mounted device 110, a touch screen 120, a computer system 130 and multiple Functional base 140. Users can wear the headset 110 to experience augmented reality and artificial intelligence, because The computer system 130 may also be referred to as an artificial intelligence and augmented reality (AIR) host.

具體來說，圖2是根據一實施例繪示平台系統架構圖。請參照圖1與圖2，觸控螢幕120是設置在多功能底座140上此多功能底座140包括一螢幕控制單元141(例如馬達與馬達控制器)，使得觸控螢幕120可在多功能底座140上旋轉，在一些實施例中可旋轉360度。在一些實施例中，多功能底座140中還包括無線通訊模組142，例如為WiFi模組，用以連接至電腦系統130與頭戴式裝置110，另外多功能底座140也電性連接至觸控螢幕120。 Specifically, FIG. 2 is a diagram illustrating a platform system architecture according to an embodiment. 1 and 2, the touch screen 120 is set on the multi-function base 140. The multi-function base 140 includes a screen control unit 141 (such as a motor and a motor controller) so that the touch screen 120 can be on the multi-function base Rotate up 140, in some embodiments 360 degrees. In some embodiments, the multi-function base 140 further includes a wireless communication module 142, such as a WiFi module, for connecting to the computer system 130 and the head-mounted device 110, and the multi-function base 140 is also electrically connected to the touch控屏120。 Control screen 120.

頭戴式裝置110用以提供擴增實境內容，此擴增實境內容是關於標準作業流程，例如用以檢查或維修機械設備。頭戴式裝置110也具有導航功能，會將自身的位置資訊傳送給電腦系統130，電腦系統130用以提供一串流資料給觸控螢幕120此串流資料例如是關於模擬場域的三維數值模型，例如為一機台的模擬畫面，用以模擬機台異常的情形，也就是說使用者可以把觸控螢幕120當作是機台來執行標準作業流程，藉此可以提供將異常項目修正的互動式體驗。此外，電腦系統130用以傳送一旋轉訊號至多功能底座140中的螢幕控制單元141，藉此旋轉觸控螢幕120，並且使得上述串流資料所對應的一視角軸線與頭戴式裝置110的視角軸線相同，例如當使用者旋轉頭部或移動時，觸控螢幕120上顯示的機台也會跟著改變視角，讓使用者可以模擬實際作業時圍繞標的物的環境。在此平台中，由於觸控螢幕120可以360度旋轉，因此使用者能 體驗完整圍繞示範載具一周。在一些實施例中，電腦系統130可提供人工智慧模組，例如用以偵測物件、辨識物件、異常偵測等等，頭戴式裝置110上可包括影像感測器，所感測的影像可以傳送至電腦系統130上執行偵測、辨識等程序後再將結果回傳至頭戴式裝置110。例如，上述的人工智慧模組可偵測機台的異常，並在頭戴式裝置110上顯示如何修復此異常的各步驟。 The head-mounted device 110 is used to provide augmented reality content. The augmented reality content relates to standard operating procedures, for example, to inspect or repair mechanical equipment. The head-mounted device 110 also has a navigation function, and transmits its position information to the computer system 130. The computer system 130 is used to provide a stream of data to the touch screen 120. The stream of data is, for example, a three-dimensional value related to the simulated field The model, for example, a simulated screen of a machine, is used to simulate the abnormal situation of the machine, that is to say, the user can use the touch screen 120 as a machine to perform the standard operation process, thereby providing correction of abnormal items Interactive experience. In addition, the computer system 130 is used to transmit a rotation signal to the screen control unit 141 in the multi-function base 140, thereby rotating the touch screen 120, and enabling a viewing angle axis corresponding to the streaming data and the viewing angle of the head mounted device 110 The axes are the same. For example, when the user rotates the head or moves, the machine displayed on the touch screen 120 will also change the angle of view, so that the user can simulate the environment surrounding the target during actual operation. In this platform, since the touch screen 120 can rotate 360 degrees, the user can The experience completely revolves around demonstration vehicles for a week. In some embodiments, the computer system 130 may provide artificial intelligence modules, such as for detecting objects, recognizing objects, anomaly detection, etc. The head-mounted device 110 may include an image sensor, and the sensed image may be After being sent to the computer system 130 to perform detection, identification and other procedures, the result is returned to the head mounted device 110. For example, the above-mentioned artificial intelligence module can detect the abnormality of the machine and display on the head-mounted device 110 how to repair the abnormality.

在一些實施例中，頭戴式裝置110、觸控螢幕120、電腦系統130與多功能底座140都可以收納成一航空箱移動，藉此使用者可以攜帶此航空箱，在任何地方都可以體驗人工智慧與擴增實境的結合。 In some embodiments, the head-mounted device 110, the touch screen 120, the computer system 130, and the multi-function base 140 can be stored in an air box to move, so that the user can carry the air box, and can experience manual labor anywhere The combination of wisdom and augmented reality.

圖3是根據一實施例繪示平台內容設計流程圖。請參照圖3，在步驟301中進行場域需求分析，分析要模擬場域中那些項目跟這些項目有關的人機物料細節。在步驟302中進行程序流程分析，決定要模擬的項目之後將這個項目的步驟拆解分析。在步驟303中進行場域設計，決定要如何設計模擬場域以給予使用者接近真實狀況的體驗。在步驟304中進行場域取樣，對目標場域進行拍攝作業取得場域素材。在步驟305中進行人工智慧異常樣本取樣，針對異常項目進行拍攝作業以取得樣本素材。在步驟306中進行人工智慧異常樣本訓練，將異常樣本分類標示後輸入機器人進行深度學習訓練。在步驟307中進行擴增實境流程分析，依照步驟拆解的結果設計擴增實境流程。在步驟308中進行擴增實境使用者介面設計，根據使用者需求及場域客觀條件，如光線、溫度、天氣、能見度等 條件設計使用者介面。在步驟309中進行擴增實境程式設計，依照前述流程及使用者介面設計撰寫擴增實境程式。在步驟310中進行系統整合，將擴增實境程式、人工智慧程式整合到頭戴式裝置與電腦主機。在步驟311中進行系統驗證，在平台上測試系統整合結果，驗證程式是否達到設計目標。 FIG. 3 is a flow chart of platform content design according to an embodiment. Referring to FIG. 3, in step 301, a field demand analysis is performed to analyze the details of man-machine materials related to these items in the field to be simulated. In step 302, program flow analysis is performed, and the steps of this item are disassembled and analyzed after the item to be simulated is determined. In step 303, the field design is performed to determine how to design the simulated field to give the user an experience close to the real situation. In step 304, field sampling is performed, and a shooting operation is performed on the target field to obtain field materials. In step 305, an artificial intelligence abnormal sample is sampled, and a shooting operation is performed on the abnormal item to obtain sample material. In step 306, artificial intelligence abnormal sample training is performed, and the abnormal samples are classified and input to the robot for deep learning training. In step 307, an augmented reality process analysis is performed, and the augmented reality process is designed according to the result of the disassembly in the step. In step 308, an augmented reality user interface design is performed, based on user needs and objective conditions of the field, such as light, temperature, weather, visibility, etc. Conditional design user interface. In step 309, augmented reality programming is performed, and the augmented reality programming is written according to the foregoing process and user interface design. In step 310, system integration is performed to integrate the augmented reality program and artificial intelligence program into the head-mounted device and the host computer. In step 311, system verification is performed, and the system integration result is tested on the platform to verify whether the program meets the design goals.

上述平台給使用者360度環繞實景還原的擴增實境(AR)體驗，且具備人工智慧(AI)異常偵測演示功能，同時異常項目修復模擬功能也整合在本平台上。本平台導入360度旋轉螢幕讓使用者能體驗完整圍繞示範載具一周。並且具備AI異常偵測功能模擬載具發生異常情境，完整模擬AIR功能體驗。同時本平台搭配互動式觸控螢幕以模擬對異常項目的處置。 The above-mentioned platform provides users with an augmented reality (AR) experience of 360-degree surround reality restoration, and has artificial intelligence (AI) anomaly detection and demonstration functions. At the same time, anomalous item repair simulation functions are also integrated on this platform. This platform introduces a 360-degree rotating screen to allow users to experience a complete round of demonstration vehicles. And with AI anomaly detection function to simulate the abnormal situation of the vehicle, a complete simulation of AIR function experience. At the same time, the platform is equipped with an interactive touch screen to simulate the handling of abnormal items.

雖然本新型已以實施例揭露如上，然其並非用以限定本新型，任何所屬技術領域中具有通常知識者，在不脫離本新型的精神和範圍內，當可作些許的更動與潤飾，故本新型的保護範圍當視後附的申請專利範圍所界定者為準。 Although the present invention has been disclosed as above with examples, it is not intended to limit the present invention. Anyone who has ordinary knowledge in the technical field can make some changes and retouching without departing from the spirit and scope of the present invention. The scope of protection of this new model shall be subject to the scope defined in the appended patent application.

110‧‧‧頭戴式裝置 110‧‧‧Head-mounted device

120‧‧‧觸控螢幕 120‧‧‧Touch screen

130‧‧‧電腦系統 130‧‧‧ Computer system

140‧‧‧多功能底座 140‧‧‧Multifunctional base

Claims (3)

一種結合擴增實境與人工智慧的機動型互動式展示平台，包括：一頭戴式裝置，用以提供擴增實境內容；一多功能底座，包括一無線通訊模組以連接至該頭戴式裝置；一觸控螢幕，設置於該多功能底座上；以及一電腦系統，用以提供一串流資料給該觸控螢幕。 A mobile interactive display platform combining augmented reality and artificial intelligence, including: a head-mounted device for providing augmented reality content; a multi-functional base, including a wireless communication module to connect to the head A wearable device; a touch screen set on the multifunctional base; and a computer system for providing a stream of data to the touch screen. 如申請專利範圍第1項所述之結合擴增實境與人工智慧的機動型互動式展示平台，其中該觸控螢幕用以在該多功能底座上旋轉。 The mobile interactive display platform combining augmented reality and artificial intelligence as described in item 1 of the patent application scope, wherein the touch screen is used to rotate on the multifunctional base. 如申請專利範圍第1項所述之結合擴增實境與人工智慧的機動型互動式展示平台，其中該電腦系統用以傳送一旋轉訊號至該多功能底座，藉此旋轉該觸控螢幕，使得該串流資料所對應的一視角軸線與該頭戴式裝置的視角軸線相同。 As described in item 1 of the patent application scope, a mobile interactive display platform combining augmented reality and artificial intelligence, in which the computer system is used to transmit a rotation signal to the multifunctional base, thereby rotating the touch screen, Therefore, a viewing axis corresponding to the streaming data is the same as the viewing axis of the head-mounted device.
TW108217529U 2019-12-31 2019-12-31 Augmented reality and artificial intelligence integrated interactive display platform TWM596351U (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
TW108217529U TWM596351U (en) 2019-12-31 2019-12-31 Augmented reality and artificial intelligence integrated interactive display platform
NL2027188A NL2027188B1 (en) 2019-12-31 2020-12-21 Augmented reality and artificial intelligence integrated interactive display platform
GB2020687.6A GB2594121B (en) 2019-12-31 2020-12-29 Augmented reality and artificial intelligence integrated interactive display platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW108217529U TWM596351U (en) 2019-12-31 2019-12-31 Augmented reality and artificial intelligence integrated interactive display platform

Publications (1)

Publication Number Publication Date
TWM596351U true TWM596351U (en) 2020-06-01

Family

ID=72177131

Family Applications (1)

Application Number Title Priority Date Filing Date
TW108217529U TWM596351U (en) 2019-12-31 2019-12-31 Augmented reality and artificial intelligence integrated interactive display platform

Country Status (3)

Country Link
GB (1) GB2594121B (en)
NL (1) NL2027188B1 (en)
TW (1) TWM596351U (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10809173B2 (en) 2017-12-15 2020-10-20 Analog Devices, Inc. Smoke detector chamber boundary surfaces
US10921367B2 (en) 2019-03-06 2021-02-16 Analog Devices, Inc. Stable measurement of sensors methods and systems
USD918756S1 (en) 2018-11-06 2021-05-11 Analog Devices, Inc. Smoke detector boundary
USD920825S1 (en) 2018-11-06 2021-06-01 Analog Devices, Inc. Smoke detector chamber
US11796445B2 (en) 2019-05-15 2023-10-24 Analog Devices, Inc. Optical improvements to compact smoke detectors, systems and apparatus

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI327657B (en) * 2006-03-16 2010-07-21 Qisda Corp Display panel and elevation adjusting base of the same
TW201349844A (en) * 2012-05-23 2013-12-01 Univ Nat Taiwan Method for creating a naked-eye 3D effect
US10477168B2 (en) * 2017-01-27 2019-11-12 Otoy, Inc. Headphone based modular VR/AR platform with vapor display
CN109309873B (en) * 2017-07-28 2021-05-25 腾讯科技（深圳）有限公司 Screen angle adjusting method and device and storage medium

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10809173B2 (en) 2017-12-15 2020-10-20 Analog Devices, Inc. Smoke detector chamber boundary surfaces
USD918756S1 (en) 2018-11-06 2021-05-11 Analog Devices, Inc. Smoke detector boundary
USD920825S1 (en) 2018-11-06 2021-06-01 Analog Devices, Inc. Smoke detector chamber
US10921367B2 (en) 2019-03-06 2021-02-16 Analog Devices, Inc. Stable measurement of sensors methods and systems
US11796445B2 (en) 2019-05-15 2023-10-24 Analog Devices, Inc. Optical improvements to compact smoke detectors, systems and apparatus

Also Published As

Publication number Publication date
NL2027188A (en) 2021-08-23
GB2594121B (en) 2022-05-25
GB2594121A (en) 2021-10-20
NL2027188B1 (en) 2021-10-28
GB202020687D0 (en) 2021-02-10

Similar Documents

Publication Publication Date Title
TWM596351U (en) Augmented reality and artificial intelligence integrated interactive display platform
US9940223B2 (en) Human-machine interface test system
CA3023417C (en) Systems, methods, and tools for spatially-registering virtual content with physical environment in augmented reality platforms
CN108711326A (en) A kind of automobile educational training system based on virtual emulation
US9283672B1 (en) Robotic testing device and method for more closely emulating human movements during robotic testing of mobile devices
CN105373011B (en) Detect the real-time emulation system and computer of electro-optical tracking device
US11529737B2 (en) System and method for using virtual/augmented reality for interaction with collaborative robots in manufacturing or industrial environment
US11487350B2 (en) Dynamically representing a changing environment over a communications channel
KR20050102803A (en) Apparatus, system and method for virtual user interface
Collett et al. Developer oriented visualisation of a robot program
KR20180064153A (en) Furnace process virtual reality training system
CN106777602B (en) Simulation experiment method for pulverized coal explosion
Collett et al. Augmented reality visualisation for player
Horejsi et al. USING KINECT TECHNOLOGY EQUIPMENT FOR ERGONOMICS.
Marino et al. Assessing user performance in augmented reality assembly guidance for industry 4.0 operators
CN114116435A (en) Game testing method, system, electronic device and computer readable storage medium
CN101932981A (en) Method and device for visualizing an installation of automation systems together with a workpiece
Thoo et al. Online and offline robot programming via augmented reality workspaces
Redžepagić et al. A sense of quality for augmented reality assisted process guidance
TW202307620A (en) Control of semiconductor manufacturing equipment in mixed reality environments
US20210248845A1 (en) Maintenance prediction system for a vehicle
KR102518465B1 (en) Virtual reality simulator and method for experience of aerodynamic environment in pig house
US10282909B2 (en) Virtual reality system, operating method for mobile device, and non-transitory computer readable storage medium
CN113593314A (en) Equipment virtual disassembly and assembly training system and training method thereof
Redzepagic et al. A sense of quality for augmented reality assisted process guidance