TWI622026B - Interactive teaching system - Google Patents

Interactive teaching system Download PDF

Info

Publication number
TWI622026B
TWI622026B TW106116874A TW106116874A TWI622026B TW I622026 B TWI622026 B TW I622026B TW 106116874 A TW106116874 A TW 106116874A TW 106116874 A TW106116874 A TW 106116874A TW I622026 B TWI622026 B TW I622026B
Authority
TW
Taiwan
Prior art keywords
operation interface
image
interface
user
image scene
Prior art date
Application number
TW106116874A
Other languages
Chinese (zh)
Other versions
TW201837882A (en
Inventor
Zheng-Da Yang
Original Assignee
Tutor Group Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/485,876 external-priority patent/US10872535B2/en
Application filed by Tutor Group Ltd filed Critical Tutor Group Ltd
Application granted granted Critical
Publication of TWI622026B publication Critical patent/TWI622026B/en
Publication of TW201837882A publication Critical patent/TW201837882A/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

一種互動式教學系統,包括用以供複數使用者透過網路連線登入之伺服器端。伺服器端藉由執行軟體程式,可對應各使用者產生呈現可供操作之相同3D影像場景之操作介面,且各操作介面依據不同使用者以形成教學者操作介面及至少一學習者操作介面。教學者操作介面或學習者操作介面可接收針對3D影像場景之操作指令,且將3D影像場景依據操作指令執行對應影像處理後,同步更新各操作介面原本所呈現之3D影像場景。An interactive teaching system includes a server end for a plurality of users to log in through a network connection. By executing software programs, the server end can generate operation interfaces corresponding to the same 3D image scenes that can be operated by each user, and each operation interface forms a teacher operation interface and at least one learner operation interface according to different users. The instructor interface or the learner interface can receive operation instructions for the 3D image scene, and after the 3D image scene performs corresponding image processing according to the operation instruction, the 3D image scene originally presented by each operation interface is updated synchronously.

Description

互動式教學系統Interactive teaching system

本發明係關於一種互動式教學系統,尤指一種結合3D同步影像之互動式教學系統。The invention relates to an interactive teaching system, in particular to an interactive teaching system combining 3D synchronous images.

現代人如果想要學習任何語言,除了可以透過閱讀書籍、去學校或補習班參加相關語言課程等方式以外,也能透過網路學習之方式,使得學習者不用受限於任何時間及地點,只要利用具有網路連線功能之設備,就能進行語言之學習;對於生活忙碌之現代人而言,大幅提高學習上之便利性及實用性。雖然學習者可以透過觀看授課者預錄的語言教學影片,或利用一些具有視訊功能的軟體來進行與授課者之間的交談來進行學習,然而這些傳統學習方式之學習效果仍然有限,且存在著學習者與授課者之間的互動性不佳等問題。If modern people want to learn any language, in addition to reading books, going to school or taking related language courses, etc., they can also learn online, so that learners are not limited to any time and place, as long as Language-learning can be carried out by using a device with network connection function. For modern people who are busy in life, it greatly improves the convenience and practicality of learning. Although learners can learn by watching pre-recorded language instruction videos or using some software with video functions to conduct conversations with the lecturers, the learning effects of these traditional learning methods are still limited and exist. Problems such as poor interaction between learners and lecturers.

此外,3D影像處理技術為目前熱門的話題之一,例如虛擬實境(VR)或3D影像場景之呈現,多應用於遊戲或動態展示之展場。如果能將3D影像處理技術與語言學習相結合,藉由動態之3D影像呈現將更能提起學習者之學習興趣。惟,如何能讓多個使用者在利用操作介面進行雙向或多向學習時,達到3D影像同步呈現之技術,實為一值得研究之課題。In addition, 3D image processing technology is currently one of the hot topics, such as the presentation of virtual reality (VR) or 3D image scenes, and it is mostly used in games or dynamic exhibition venues. If 3D image processing technology can be combined with language learning, the dynamic 3D image presentation will raise the interest of learners. However, how to allow multiple users to achieve synchronous 3D image presentation when using a user interface for two-way or multi-directional learning is a topic worthy of research.

本發明之目的在於提供一種互動式教學系統,能藉由操作介面產生可供操作之3D影像場景並使各操作介面所呈現之3D影像場景達到同步效果。An object of the present invention is to provide an interactive teaching system capable of generating 3D video scenes that can be operated through an operation interface and synchronizing the 3D image scenes presented by the operation interfaces.

為達上述目的,本發明之互動式教學系統包括供複數使用者透過網路連線登入之伺服器端。伺服器端包括處理器及與處理器電性連接之記憶體,記憶體包括可藉由處理器執行之軟體程式。軟體程式包括3D影像模組、介面產生模組及同步模組。3D影像模組用以產生可供操作之3D影像場景;介面產生模組用以對應各使用者產生可呈現相同3D影像場景之操作介面,操作介面依據不同使用者以形成教學者操作介面及至少一學習者操作介面,其中教學者操作介面或學習者操作介面可接收針對3D影像場景之操作指令,並通知3D影像模組依據操作指令執行對應影像處理;同步模組用以依據經對應影像處理後之3D影像場景同步更新各操作介面原本所呈現之3D影像場景。To achieve the above object, the interactive teaching system of the present invention includes a server end for a plurality of users to log in through a network connection. The server end includes a processor and a memory electrically connected to the processor, and the memory includes a software program executable by the processor. The software program includes a 3D image module, an interface generation module, and a synchronization module. The 3D image module is used to generate an operable 3D image scene; the interface generation module is used to generate an operation interface corresponding to each user that can present the same 3D image scene. The operation interface is based on different users to form an instructor operation interface and at least A learner operation interface, wherein the instructor operation interface or the learner operation interface can receive operation instructions for a 3D image scene, and notify the 3D image module to perform corresponding image processing according to the operation instructions; the synchronization module is used to perform corresponding image processing according to the corresponding image processing. The subsequent 3D image scenes simultaneously update the 3D image scenes originally presented by each operation interface.

在本發明之一實施例中,教學者操作介面預設有3D影像場景之控制權及移轉權,移轉權用以將控制權移轉至任一學習者操作介面或移回教學者操作介面,使得具有控制權之教學者操作介面或學習者操作介面可接收操作指令以執行對應影像處理。In one embodiment of the present invention, the teaching user operation interface is preset with the control right and the transfer right of the 3D image scene. The transfer right is used to transfer the control right to any learner operation interface or return to the teacher operation operation. The interface enables a teaching operator operating interface or a learner operating interface having control rights to receive operation instructions to perform corresponding image processing.

在本發明之一實施例中,於同一時間點控制權僅存在於教學者操作介面及任一學習者操作介面之其中一者。In one embodiment of the present invention, at the same time, the control right only exists in one of the operator's operation interface and any learner's operation interface.

在本發明之一實施例中,操作介面依據不同使用者之個人設定值以對應形成教學者操作介面或學習者操作介面。In an embodiment of the present invention, the operation interface is formed according to the personal setting values of different users to form a teacher operation interface or a learner operation interface.

在本發明之一實施例中,互動式教學系統更包括複數使用者端,各使用者端係供單一使用者經由網路連接伺服器端,其中個人設定值係儲存於使用者端,並於使用者端顯示對應之操作介面以供操作。In one embodiment of the present invention, the interactive teaching system further includes a plurality of user terminals, each user terminal is for a single user to connect to the server terminal through a network, and the personal setting value is stored in the user terminal, and The user terminal displays a corresponding operation interface for operation.

在本發明之一實施例中,各使用者端包括對應同步模組,對應同步模組與伺服器端之同步模組藉由傳輸協定維持雙向傳輸以執行資料同步更新。In one embodiment of the present invention, each user terminal includes a corresponding synchronization module, and the corresponding synchronization module and the server-side synchronization module maintain bidirectional transmission through a transmission protocol to perform data synchronization update.

在本發明之一實施例中,對應同步模組為應用程式或具資料同步功能之瀏覽器。In one embodiment of the present invention, the corresponding synchronization module is an application program or a browser with a data synchronization function.

在本發明之一實施例中,同步模組包括介面資料同步模組,用以同步更新於各操作介面呈現之平面影音串流資料、圖文資料或使用者資訊。In one embodiment of the present invention, the synchronization module includes an interface data synchronization module, which is used to synchronize and update the plane video stream data, graphic data, or user information presented on each operation interface.

在本發明之一實施例中,對應影像處理包括3D影像場景變化、3D影像場景移動、3D影像場景視角改變、3D影像場景中之物件狀態變化、物件移動、物件旋轉或產生3D遊戲介面。In one embodiment of the present invention, the corresponding image processing includes 3D image scene change, 3D image scene movement, 3D image scene perspective change, object state change in the 3D image scene, object movement, object rotation, or 3D game interface generation.

在本發明之一實施例中,對應影像處理結合一音訊資料,使得依據該對應影像處理同步更新各該操作介面所呈現之該3D影像場景時一併輸出該音訊資料。In one embodiment of the present invention, the corresponding image processing is combined with audio data, so that the 3D image scenes presented by the operation interfaces are simultaneously updated and output according to the corresponding image processing.

據此,本發明之互動式教學系統可提供操作介面讓複數使用者進行互動式語言教學,且藉由操作介面可結合3D影像之應用,並同時執行3D影像資料及非3D影像資料之同步更新。According to this, the interactive teaching system of the present invention can provide an operation interface for plural users to carry out interactive language teaching, and the operation interface can be combined with the application of 3D images, and simultaneously perform synchronous update of 3D image data and non-3D image data .

由於各種態樣與實施例僅為例示性且非限制性,故在閱讀本說明書後,具有通常知識者在不偏離本發明之範疇下,亦可能有其他態樣與實施例。根據下述之詳細說明與申請專利範圍,將可使該等實施例之特徵及優點更加彰顯。Since the various aspects and embodiments are merely illustrative and non-limiting, after reading this specification, those with ordinary knowledge may have other aspects and embodiments without departing from the scope of the present invention. According to the following detailed description and patent application scope, the features and advantages of these embodiments will be more prominent.

於本文中,用語「包括」、「具有」或其他任何類似用語意欲涵蓋非排他性之包括物。舉例而言,含有複數要件的元件或結構不僅限於本文所列出之此等要件而已,而是可以包括未明確列出但卻是該元件或結構通常固有之其他要件。In this article, the terms "including", "having" or any other similar language are intended to cover non-exclusive inclusions. For example, an element or structure containing a plurality of elements is not limited to only those elements listed herein, but may include other elements that are not explicitly listed but are generally inherent to the element or structure.

請先參考圖1。圖1為本發明之互動式教學系統1之系統示意圖。如圖1所示,本發明之互動式教學系統1包括伺服器端10,用以供複數使用者透過網路連線登入;各使用者可各自利用具有網路連線功能之使用者端20,透過網際網路30連線至伺服器端10並執行登入操作後,使用本發明之互動式教學系統1進行互動式教學。伺服器端10可以是執行整合功能之單一電腦裝置或將由分別執行前述整合功能之至少一部分之多個電腦裝置所建構而成;使用者端20可以是桌上型電腦、平板電腦、智慧型手機或其他具有網路連線功能之類似電腦裝置。Please refer to Figure 1 first. FIG. 1 is a system diagram of the interactive teaching system 1 of the present invention. As shown in FIG. 1, the interactive teaching system 1 of the present invention includes a server end 10 for multiple users to log in through a network connection; each user can use a user end 20 having a network connection function. After connecting to the server 10 through the Internet 30 and performing a login operation, the interactive teaching system 1 of the present invention is used for interactive teaching. The server end 10 may be a single computer device that performs an integrated function or will be constructed by a plurality of computer devices that respectively perform at least a part of the foregoing integrated function; the user end 20 may be a desktop computer, a tablet computer, or a smartphone Or other similar computer devices with network connectivity.

伺服器端10包括處理器11及記憶體12,記憶體12與處理器11電性連接。記憶體12包括作業系統(圖未示)及軟體程式12a,藉由處理器11可載入作業系統並於作業系統環境下執行軟體程式12a。此處處理器11可以是電腦裝置之中央處理單元、微處理器或其他具類似處理功能之處理器,而記憶體12可以是一般記憶體、硬碟或其他具類似儲存功能之儲存單元。在本實施例中,軟體程式12a係利用flash語法所編寫,因此各使用者僅需執行使用者端20預載之瀏覽器相關應用程式,透過網際網路30連線登入本發明之互動式教學系統1之伺服器端10,即可於使用者端20產生並顯示相關操作介面,以利於各使用者進行操作;藉此,使用者無須於使用者端20額外安裝其他對應軟體,即可連線登入伺服器端10,以方便各使用者使用,但本發明不以此為限。舉例來說,當使用者端20為智慧型手機時,也可預先下載經執行後會與伺服器端10連線並產生相關操作介面之手機應用程式(application, APP),使得使用者經執行使用者端20之該手機應用程式後透過操作介面進行後續互動操作。The server end 10 includes a processor 11 and a memory 12. The memory 12 is electrically connected to the processor 11. The memory 12 includes an operating system (not shown) and a software program 12a. The processor 11 can load the operating system and execute the software program 12a under the operating system environment. Here, the processor 11 may be a central processing unit of a computer device, a microprocessor, or other processors with similar processing functions, and the memory 12 may be a general memory, a hard disk, or other storage units with similar storage functions. In this embodiment, the software program 12a is written using the flash syntax, so each user only needs to execute the browser-related application program preloaded on the client 20 and log in to the interactive teaching of the present invention through the Internet 30 connection The server end 10 of the system 1 can generate and display the relevant operation interface on the user end 20 to facilitate the operation of each user; therefore, the user does not need to install additional corresponding software on the user end 20 to connect Log in to the server terminal 10 online for convenience of users, but the present invention is not limited thereto. For example, when the user terminal 20 is a smart phone, a mobile phone application (application, APP) that will be connected to the server terminal 10 and generate a related operation interface after execution can also be downloaded in advance, so that the user can execute The mobile phone application on the user terminal 20 performs subsequent interactive operations through the operation interface.

以下請一併參考圖2及圖3。圖2係本發明之互動式教學系統之軟體程式12a及使用者端20組成架構示意圖;圖3係本發明之互動式教學系統建立連線狀態之示意圖。如圖2及圖3所示,於各使用者端20內儲存有對應之使用者資訊,當任一使用者a藉由使用者端20登入伺服器端10後,軟體程式12a會透過使用者端20取得其使用者資訊以比對一課程分組資料,來分配該名使用者a進入已決定的教學群組A內,該課程分組資料是預先載入記憶體12中;因應所登入使用者a的數量、程度或身份,將妥善分配各使用者a並產生至少一教學群組A,各教學群組A由複數使用者a組成,其中各教學群組A包括一教學者a1及至少一學習者a2。前述有關於利用使用者資訊以分配使用者a之相關技術,已揭露於發明人於台灣公告第I249112號發明專利案中,在此不多加贅述。Please refer to FIG. 2 and FIG. 3 together. FIG. 2 is a schematic diagram of the structure of the software program 12a and the user terminal 20 of the interactive teaching system of the present invention; FIG. 3 is a schematic diagram of the connection state of the interactive teaching system of the present invention. As shown in FIG. 2 and FIG. 3, corresponding user information is stored in each user terminal 20. When any user a logs in to the server terminal 10 through the user terminal 20, the software program 12 a passes through the user. The terminal 20 obtains its user information to compare a course grouping data, and assigns the user a to the determined teaching group A. The course grouping data is pre-loaded into the memory 12; The quantity, degree or identity of a will properly allocate each user a and generate at least one teaching group A, each teaching group A is composed of a plurality of users a, where each teaching group A includes a teaching person a1 and at least one Learner a2. The aforementioned related technology of using user information to allocate user a has been disclosed in the inventor's invention patent case in Taiwan Announcement No. I249112, and will not be repeated here.

軟體程式12a包括彼此電性連接之3D影像模組121、介面產生模組122及同步模組123。3D影像模組121用以產生可供操作之3D影像場景。此處所述之3D影像場景可以是一般常見之3D立體影像,其可支援WebGL技術,以便各使用者透過使用者端20之瀏覽器即可於相應產生之操作介面上呈現該3D影像場景。3D影像場景也可以是應用虛擬實境(virtual reality, VR)、擴增實境(augmented reality, AR)或混合實境(mixed reality, MR)技術產生之3D互動影像,供使用者透過肉眼或電性連接使用者端20之相應外接配備(例如頭戴式顯示器或其他輔助顯示裝置)觀看並產生互動效果。The software program 12a includes a 3D image module 121, an interface generation module 122, and a synchronization module 123 electrically connected to each other. The 3D image module 121 is used to generate an operable 3D image scene. The 3D image scene described here can be a common 3D stereo image, which can support WebGL technology, so that each user can present the 3D image scene on the corresponding operation interface through the browser of the user terminal 20. The 3D image scene can also be a 3D interactive image generated by applying virtual reality (VR), augmented reality (AR) or mixed reality (MR) technology, for users to see through the naked eye or Corresponding external equipment (such as a head-mounted display or other auxiliary display device) electrically connected to the user terminal 20 is used for viewing and generating interactive effects.

如圖2及圖3所示,介面產生模組122用以依據每一教學群組A產生對應的操作介面200,以供各教學群組A進行互動教學。前述各使用者a之使用者資訊包括對應該名使用者a之個人設定值,在操作介面200產生後,操作介面200會對應載入各使用者a之個人設定值,而依據所載入之個人設定值不同,將形成對應之個人化操作介面200a並顯示於使用者端20,因此各使用者a能透過個人化操作介面200a與同一教學群組A的其他使用者進行溝通學習。此外教學模組121依據所載入之個人設定值不同,例如對應不同使用者身份,所形成之個人化操作介面200a可區分為教學者操作介面或學習者操作介面,以因應開啟不同之介面使用權限。As shown in FIG. 2 and FIG. 3, the interface generation module 122 is configured to generate a corresponding operation interface 200 according to each teaching group A for interactive teaching by each teaching group A. The user information of each user a includes the personal setting value corresponding to the user a. After the operation interface 200 is generated, the operation interface 200 will correspondingly load the personal setting value of each user a, and according to the loaded Different personal settings will form a corresponding personalized operation interface 200a and display it on the user terminal 20. Therefore, each user a can communicate and learn with other users in the same teaching group A through the personalized operation interface 200a. In addition, the teaching module 121 can be divided into a teacher's operation interface or a learner's operation interface according to different personal settings, for example, corresponding to different user identities, so as to open different interface to use Permissions.

介面產生模組122可結合3D影像模組121,針對同一教學群組A內之各使用者產生之個人化操作介面200a呈現相同3D影像場景。使用者a可以藉由使用者端20輸入針對3D影像場景之操作指令,使得對應之教學者操作介面或學習者操作介面可接收該操作指令,並通知3D影像模組121依據操作指令執行對應影像處理。此處所述之操作指令可以是使用者透過使用者端20之各類輸入裝置所輸入,例如觸控面板、滑鼠、鍵盤、遙控裝置、聲音輸入裝置等,但本發明不以此為限,例如也可以透過電性連接使用者端20之感測裝置(例如光感測器、動態感測器、加速度計等)感測使用者之動作或手勢以完成操作指令之輸入。操作指令之類型可以是直接針對3D影像場景之點擊、拖曳、圈選、觸發相應功能鍵、聲控或所感測到之手勢或動作等。The interface generation module 122 can be combined with the 3D image module 121 to present the same 3D image scene to the personalized operation interface 200a generated by each user in the same teaching group A. The user a can input an operation instruction for the 3D image scene through the user terminal 20, so that the corresponding instructor operation interface or learner operation interface can receive the operation instruction, and notify the 3D image module 121 to execute the corresponding image according to the operation instruction. deal with. The operation instructions described herein may be input by a user through various input devices of the user terminal 20, such as a touch panel, a mouse, a keyboard, a remote control device, a sound input device, etc., but the present invention is not limited thereto. For example, a sensing device (such as a light sensor, a motion sensor, an accelerometer, etc.) electrically connected to the user terminal 20 can also be used to sense the user's actions or gestures to complete the input of operation instructions. The types of operation instructions can be click, drag, circle, directly trigger the corresponding function keys, sound control or sensed gestures or actions on the 3D video scene.

同步模組123用以依據經對應影像處理後之3D影像場景同步更新各操作介面原本所呈現之3D影像場景,其同樣支援WebGL技術。當前述3D影像模組121依據已輸入之任一操作指令針對原本3D影像場景執行對應影像處理後,3D影像場景會隨著不同之對應影像處理產生變化,此時同步模組123將變化之3D影像場景於各操作介面進行同步更新,讓同一教學群組內之所有使用者能夠同步看到所呈現3D影像場景之變化。此處所述之對應影像處理包括3D影像場景變化、3D影像場景移動、3D影像場景視角改變、3D影像場景中之物件狀態變化、物件移動、物件旋轉或產生3D遊戲介面。The synchronization module 123 is used to synchronously update the 3D image scenes originally presented by each operation interface according to the 3D image scenes after corresponding image processing, and it also supports WebGL technology. After the aforementioned 3D image module 121 performs corresponding image processing on the original 3D image scene according to any operation instruction that has been input, the 3D image scene will change with different corresponding image processing. At this time, the synchronization module 123 will change the 3D image. The image scenes are updated synchronously on each operation interface, so that all users in the same teaching group can synchronously see the changes in the 3D image scenes presented. The corresponding image processing described here includes 3D image scene change, 3D image scene movement, 3D image scene perspective change, object state change in the 3D image scene, object movement, object rotation, or 3D game interface generation.

前述3D影像場景變化、3D影像場景移動或3D影像場景視角改變較偏向3D影像場景之整體變動。3D影像場景變化可以是依據操作指令進行不同3D影像場景之間的切換,例如從室內場景切換到戶外場景;3D影像場景移動可以是依據操作指令進行在3D影像場景內相應之不同方向移動,例如於目前3D影像場景內之前後左右移動;3D影像場景視角改變可以是依據操作指令進行在3D影像場景內目前呈現相應視角之調整或改變,例如朝上下左右等不同方向調整視角。The aforementioned 3D image scene change, 3D image scene movement, or 3D image scene perspective change is more biased towards the overall change of the 3D image scene. The 3D image scene change can be switched between different 3D image scenes according to operation instructions, such as switching from indoor scenes to outdoor scenes; the 3D image scene movement can be moved in corresponding directions in the 3D image scene according to operation instructions, such as Move forward and backward in the current 3D image scene; the angle of view change of the 3D image scene can be adjusted or changed according to the operation instruction to present the corresponding angle of view in the 3D image scene, such as adjusting the angle of view in different directions such as up, down, left and right.

而前述3D影像場景中之物件狀態變化、物件移動或物件旋轉則偏向3D影像場景中之單一或部分物件變動。3D影像場景中之物件狀態變化可以是依據操作指令進行目前3D影像場景中現有物件之狀態改變,例如物件發光、爆破、變形、物件更換等;物件移動可以是依據操作指令進行目前3D影像場景中現有物件之位置移動,例如將物件自3D影像場景左方移動至右方;物件旋轉可以是依據操作指令進行目前3D影像場景中現有物件之旋轉,例如將3D影像場景之物件背面旋轉至正面。此外,因應所輸入之操作指令,3D影像模組121也能產生3D遊戲介面並同步呈現於各操作介面,以供使用者透過該3D遊戲介面體驗遊戲內容並提高學習樂趣。And the change of the state of the object, the movement of the object, or the rotation of the object in the aforementioned 3D image scene is biased toward the change of a single or a part of the object in the 3D image scene. The state change of the object in the 3D image scene can be based on the operation instruction to change the current state of the existing object in the 3D image scene, such as object lighting, blasting, deformation, object replacement, etc .; object movement can be based on the operation instruction in the current 3D image scene. The position of the existing object is moved, for example, the object is moved from the left to the right of the 3D image scene; the rotation of the object may be the rotation of the existing object in the current 3D image scene according to the operation instruction, such as rotating the back of the object of the 3D image scene to the front. In addition, in response to the input operation instructions, the 3D image module 121 can also generate a 3D game interface and present it simultaneously on each operation interface, so that the user can experience the game content and improve the learning fun through the 3D game interface.

對應影像處理也可以結合音訊資料,使得依據對應影像處理同步更新各操作介面所呈現之3D影像場景時,一併輸出音訊資料,以呈現視覺及聽覺之雙重效果。舉例來說,當對應影像處理為3D影像場景移動時,可配合移動場景輸出腳步聲之音效,以增加使用者在3D影像場景內移動之臨場感;又,當對應影像處理為3D影像場景中之物件狀態變化(例如物件發光)時,可配合物件狀態變化輸出蜂鳴聲或其他音效,提供使用者在介面操作時之不同感受。Corresponding image processing can also be combined with audio data, so that when the 3D image scene presented by each operation interface is updated synchronously according to the corresponding image processing, audio data is output together to present the dual effects of visual and auditory. For example, when the corresponding image processing is 3D image scene movement, the sound effects of footsteps can be output in conjunction with the moving scene to increase the user's sense of presence in the 3D image scene; and when the corresponding image processing is 3D image scene When the state of an object changes (for example, the object is illuminated), a beep sound or other sound effects can be output in accordance with the change in the state of the object to provide users with different feelings when operating the interface.

前述同步模組123不僅具有同步更新各操作介面中所呈現之3D影像場景之功能,更可執行操作介面中其他資料之同步更新介面。在本發明之一實施例中,同步模組123包括介面資料同步模組123a,其支援flash技術,用以同步更新於各操作介面所呈現前述3D影像場景以外之其他資料,例如各操作介面所呈現之平面影音串流資料(例如視訊影像資料)、圖文資料(例如教學教材)或使用者資訊(例如目前使用者狀態)等。The aforementioned synchronization module 123 not only has the function of synchronously updating the 3D image scene presented in each operation interface, but also can perform the synchronization update interface of other data in the operation interface. In one embodiment of the present invention, the synchronization module 123 includes an interface data synchronization module 123a, which supports flash technology to synchronize and update other data other than the aforementioned 3D image scene presented on each operation interface, such as each operation interface. Presentation of flat video streaming data (such as video image data), graphic data (such as teaching materials) or user information (such as the current user status).

又如圖2所示,而為了配合伺服器端10之同步模組123,於各使用者端20包括對應同步模組21,對應同步模組21與伺服器端10之同步模組123藉由傳輸協定維持雙向傳輸以執行資料同步更新。其中對應同步模組21為可安裝於智慧型手機之應用程式或具資料同步功能之瀏覽器。舉例來說,在本發明之一實施例中,對應同步模組21可包括平面影音串流單元211及3D影像資料處理單元212,其中平面影音串流單元211負責處理與伺服器端10之間之平面影音串流,例如採用Flash Media Server架構;而3D影像資料處理單元212則負責處理與伺服器端10之間之3D影像資料同步,例如採用支援3D影像場景之WebGL技術,而前述傳輸協定可以採用支援WebGL之WebSocket。據此,使用者端20能透過對應同步模組21進行前述平面影音串流資料及3D影像場景之同步更新,但對應同步模組21之架構不以此為限。As shown in FIG. 2, in order to cooperate with the synchronization module 123 of the server 10, each user terminal 20 includes a corresponding synchronization module 21, and the corresponding synchronization module 21 and the synchronization module 123 of the server 10 The transport protocol maintains two-way transmission to perform data synchronization updates. The corresponding synchronization module 21 is an application program that can be installed on a smart phone or a browser with a data synchronization function. For example, in one embodiment of the present invention, the corresponding synchronization module 21 may include a flat video streaming unit 211 and a 3D video data processing unit 212, wherein the flat video streaming unit 211 is responsible for processing between the video streaming unit 211 and the server 10 For example, the flat video streaming uses Flash Media Server architecture; and the 3D image data processing unit 212 is responsible for processing 3D image data synchronization with the server 10, such as using WebGL technology that supports 3D image scenes, and the aforementioned transmission protocol WebSocket can be used. According to this, the user terminal 20 can synchronize and update the aforementioned flat video stream data and 3D video scenes through the corresponding synchronization module 21, but the structure of the corresponding synchronization module 21 is not limited thereto.

以下請一併參考圖4及圖5。圖4係本發明之互動式教學系統1之個人化操作介面200a示意圖;圖5係本發明之互動式教學系統藉由個人化操作介面200a呈現3D影像場景之示意圖。如圖2至圖4所示,當使用者a藉由使用者端20登入伺服器端10後,將一併載入使用者a之個人設定值,以依據個人設定值產生客製化之個人化操作介面200a,讓使用者a能夠以最熟悉的介面模式進行互動教學。而使用者a於個人化操作介面200a之指令輸入權限,會依據登入伺服器端10時所載入之個人設定值不同而有所差異。舉例來說,當使用者a為教學者a1時,為了教學方便,系統會預設其指令輸入權限之各項權限設定為開啟狀態;而當使用者a為學習者a2時,部分指令輸入權限將預設為關閉狀態。前述指令輸入權限設定端視系統不同需求而調整預設值,本發明並不以此為限。Please refer to FIG. 4 and FIG. 5 together. FIG. 4 is a schematic diagram of the personalized operation interface 200a of the interactive teaching system 1 of the present invention; FIG. 5 is a schematic diagram of the interactive teaching system of the present invention presenting a 3D image scene through the personalized operation interface 200a. As shown in FIG. 2 to FIG. 4, when user a logs in to server 10 through user terminal 20, the personal setting value of user a will be loaded together to generate a customized individual based on the personal setting value. The operation interface 200a enables the user a to perform interactive teaching in the most familiar interface mode. The command input authority of the user a in the personalized operation interface 200a will vary according to the personal setting value loaded when logging in to the server 10. For example, when user a is a learner a1, for the convenience of teaching, the system will preset the permissions of its instruction input permissions to be turned on; and when user a is a learner a2, some instruction input permissions The preset is off. The foregoing command input permission setting end adjusts preset values according to different requirements of the system, and the present invention is not limited thereto.

如圖2及圖4所示,介面產生模組122所產生之各個人化操作介面200a包括狀態顯示區210、即時通訊區220、視訊顯示區230、介面功能設定區240及互動展示區250。狀態顯示區210用以顯示各使用者之狀態資訊,包括各使用者之連線狀態、身份識別狀態或輸入權限狀態等,但狀態顯示區210所顯示之狀態資訊不以前述項目為限。即時通訊區220用以顯示同一教學群組中各使用者所輸入之文字資訊,以進行雙方或多方的文字溝通。視訊顯示區230用以顯示自教學者處所取得之視訊資訊,例如利用網路攝影機取得教學者之即時影像,且視訊顯示區230包括可切換影音開閉及調整等功能之影音功能列231。介面功能設定區240用以提供部分介面功能之即時選擇及顯示,包括時間訊息顯示241、介面功能選項242及輔助通訊功能選項243等。As shown in FIG. 2 and FIG. 4, each personalized operation interface 200 a generated by the interface generation module 122 includes a status display area 210, an instant communication area 220, a video display area 230, an interface function setting area 240, and an interactive display area 250. The status display area 210 is used to display status information of each user, including the connection status, identity status, or input permission status of each user, but the status information displayed in the status display area 210 is not limited to the foregoing items. The instant messaging area 220 is used to display text information input by each user in the same teaching group for text communication between two or more parties. The video display area 230 is used to display the video information obtained from the instructor, for example, using a webcam to obtain the real-time image of the instructor, and the video display area 230 includes an audio and video function bar 231 that can switch the functions of audio and video on and off and adjustment. The interface function setting area 240 is used to provide real-time selection and display of some interface functions, including time information display 241, interface function option 242, and auxiliary communication function option 243.

互動展示區250提供類似數位白板的功能,藉由個人化操作介面200a可載入一教學展示資訊(例如文件檔案、網頁資料或影音資料等),並顯示於互動展示區250中。教學展示資訊一般為由具有互動輸入權限之教學者所提供,透過互動展示區250之功能列251進行教學展示資訊之選擇及操作(例如輸入文字、於教學展示資訊上註記或畫線等),以做為教學時的輔助教材或說明,但互動輸入權限設為開啟狀態之學習者亦可使用此互動展示區250之相關功能。此外,對應各教學群組之教學展示資訊可藉由系統設定預先載入個人化操作介面200a之互動展示區250中,以供先行登入的使用者預覽學習。需注意的是,前述所提及有關個人化操作介面200a之相關介面顯示資料,均可透過同步模組123之介面資料同步模組123a進行同步更新。The interactive display area 250 provides a function similar to a digital whiteboard. Through the personalized operation interface 200a, a teaching display information (such as a file file, webpage data or audiovisual data, etc.) can be loaded and displayed in the interactive display area 250. Teaching display information is generally provided by a teacher with interactive input authority. The function and selection of teaching display information (such as entering text, noting or drawing a line on the teaching display information) is performed through the function bar 251 of the interactive display area 250. It is used as a supplementary teaching material or instruction for teaching, but learners with interactive input permission set to on can also use the related functions of this interactive display area 250. In addition, the teaching display information corresponding to each teaching group can be pre-loaded into the interactive display area 250 of the personalized operation interface 200a by the system setting, so that users who log in first can preview and learn. It should be noted that the aforementioned related interface display data of the personalized operation interface 200a can be updated synchronously through the interface data synchronization module 123a of the synchronization module 123.

在本發明之互動式教學系統1中,使用者藉由個人化操作介面200a之互動展示區250可執行3D影像場景之開啟與關閉功能。如圖4所示,在本發明之一實施例中,於個人化操作介面200a之互動展示區250提供之功能列251包括3D影像場景之切換鍵251a,當使用者藉由操作滑鼠或觸控面板按壓切換鍵251a後,即可於互動展示區250呈現3D影像場景(如圖5所示)或關閉3D影像場景。同樣地,使用者在互動教學開始之前,可藉由互動展示區250之切換鍵251a顯示3D影像場景以進行預覽學習。而當使用者透過個人化操作介面200a輸入針對3D影像場景之操作指令後(例如針對互動展示區250所呈現3D影像場景之物件或功能列以滑鼠游標進行點擊、拖曳或以按壓鍵盤之對應功能鍵等),3D影像模組121會依據操作指令執行前述任一對應影像處理而產生3D影像場景之變化,此時即藉由同步模組123將已變化之3D影像場景於各操作介面進行同步更新。藉由3D影像場景之變化結合語言學習之相關功能,使得使用者在透過本發明之互動式教學系統1進行語言學習時將能增加學習興趣及新鮮感,進而產生更佳之學習效果。In the interactive teaching system 1 of the present invention, the user can perform the opening and closing functions of the 3D image scene through the interactive display area 250 of the personalized operation interface 200a. As shown in FIG. 4, in one embodiment of the present invention, the function row 251 provided in the interactive display area 250 of the personalized operation interface 200 a includes a 3D image scene switching key 251 a. When the user operates the mouse or touches After the control panel presses the switch key 251a, the 3D image scene (as shown in FIG. 5) can be presented in the interactive display area 250 or the 3D image scene can be closed. Similarly, before the interactive teaching starts, the user can display the 3D video scene through the switching key 251a of the interactive display area 250 for preview learning. After the user inputs an operation instruction for the 3D image scene through the personalized operation interface 200a (for example, the object or function bar for the 3D image scene presented in the interactive display area 250 is clicked, dragged with a mouse cursor, or pressed to correspond to the keyboard Function keys, etc.), the 3D image module 121 performs any of the foregoing corresponding image processing according to the operation instruction to generate a 3D image scene change. At this time, the changed 3D image scene is performed on each operation interface by the synchronization module 123. Synchronization Update. By changing the 3D image scene and related functions of language learning, the user can increase learning interest and freshness when performing language learning through the interactive teaching system 1 of the present invention, thereby generating better learning effects.

在本發明之互動式教學系統1中,如果想要透過任一操作介面輸入針對3D影像場景之操作指令來控制該3D影像場景,則該操作介面必須具有針對3D影像場景之控制權,才能使該操作介面具有可接收針對3D影像場景之操作指令之權限。在本發明之一實施例中,僅針對教學者操作介面預設有3D影像場景之前述控制權及移轉權,此處移轉權用以將控制權移轉至任一學習者操作介面或自任一學習者操作介面移回教學者操作介面;而具有控制權之教學者操作介面或學習者操作介面可接收針對3D影像場景之操作指令以執行對應影像處理。In the interactive teaching system 1 of the present invention, if one wants to input an operation instruction for a 3D image scene through any operation interface to control the 3D image scene, the operation interface must have control rights for the 3D image scene in order to enable The operation interface has the authority to receive operation instructions for 3D video scenes. In one embodiment of the present invention, the aforementioned control right and transfer right of the 3D image scene are preset only for the teaching user operation interface. Here, the transfer right is used to transfer the control right to any learner operation interface or Return from the learner operation interface to the learner operation interface; and the instructor operation interface or learner operation interface with control rights can receive operation instructions for 3D image scenes to perform corresponding image processing.

以下請一併參考圖6A至圖6C。圖6A至圖6C為本發明之互動式教學系統1之3D影像場景之控制權移轉之不同實施例示意圖。本發明之互動式教學系統1將3D影像場景之控制權及移轉權預設於身分為教學者之使用者端20之操作介面,使得教學者在正常狀況下可以輸入3D影像場景之操作指令以透過教學者操作介面控制3D影像場景。如圖6A所示,在此第一實施例中,當教學者認為有需要時,可以透過使用者端20之教學者操作介面發送控制權之移轉指令至伺服器端10,而伺服器端10會依據此移轉指令將控制權移轉至教學者所選定之任一學習者之對應使用者端20,使得該學習者之學習者操作介面取得執行針對3D影像場景之控制權,進而透過其學習者操作介面輸入3D影像場景之操作指令以控制3D影像場景。Please refer to FIGS. 6A to 6C together below. FIG. 6A to FIG. 6C are schematic diagrams of different embodiments of control rights transfer of a 3D video scene of the interactive teaching system 1 of the present invention. The interactive teaching system 1 of the present invention presets the control and transfer rights of the 3D image scene to the operation interface of the user terminal 20 as the instructor, so that the instructor can input the operation instructions of the 3D image scene under normal conditions. To control the 3D image scene through the operator's interface. As shown in FIG. 6A, in this first embodiment, when the instructor thinks that it is necessary, he can send a transfer instruction of control right to the server end 10 through the instructor operation interface of the user end 20, and the server end 10 will transfer control to the corresponding user terminal 20 of any learner selected by the instructor according to this transfer instruction, so that the learner's learner operation interface obtains the control right for the 3D image scene, and then The learner operates the interface to input 3D image scene operation instructions to control the 3D image scene.

如圖6B所示,在此第二實施例中,當教學者認為該名學習者已完成該次對3D影像場景之控制後,教學者可以再次透過使用者端20之教學者操作介面發送控制權之移轉指令至伺服器端10,而伺服器端10會依據此移轉指令將控制權移轉回教學者之使用者端20,使得教學者操作介面重新取得執行針對3D影像場景之控制權;或者,如圖6C所示,在此第三實施例中,伺服器端10會依據此移轉指令將控制權移轉至教學者所選定之另一學習者之對應使用者端20,使得另一學習者之學習者操作介面取得執行針對3D影像場景之控制權,進而透過其學習者操作介面輸入3D影像場景之操作指令以控制3D影像場景。As shown in FIG. 6B, in this second embodiment, when the learner thinks that the learner has completed the control of the 3D image scene, the learner can send the control again through the instructor operation interface of the user terminal 20 The right transfer instruction to the server end 10, and the server end 10 will transfer control back to the user end 20 of the instructor according to the transfer instruction, so that the instructor operation interface regains and executes the control for the 3D image scene Alternatively, as shown in FIG. 6C, in this third embodiment, the server end 10 will transfer the control right to the corresponding user end 20 of another learner selected by the instructor according to the transfer instruction. The learner operation interface of another learner is made to obtain the execution control right for the 3D image scene, and then the learner operation interface is used to input the operation instruction of the 3D image scene to control the 3D image scene.

需注意的是,前述控制權於同一時間點僅存在於教學者操作介面及任一學習者操作介面之其中一者,以避免多個操作介面均具有控制權時, 3D影像模組需同時執行多個對應影像處理而容易導致3D影像同步出現錯誤之可能性。It should be noted that the aforementioned control right only exists in one of the teaching user's operation interface and any learner's operation interface at the same point in time. To avoid that multiple operation interfaces have control rights, the 3D image module needs to be executed simultaneously. Multiple corresponding image processing may easily lead to the possibility of 3D image synchronization error.

綜上所述,本發明之互動式教學系統1可因應不同使用者產生相應之操作介面,並於操作介面上結合3D影像場景之呈現。一方面透過伺服器端10之同步模組123配合各使用者端20之對應同步模組21,同步更新各使用者端20之各操作介面所呈現之3D影像場景;另一方面透過伺服器端10之同步模組123之介面資料同步模組123a配合各使用者端20之對應同步模組21,同步更新各使用者端20之各操作介面中除了3D影像場景以外之其他介面資料(例如平面影音串流資料等),使得本發明之互動式教學系統1可針對操作介面同時進行3D影像資料及平面影音資料之串流更新,改善操作介面之資料同步更新效果,並提高使用者之學習興趣。In summary, the interactive teaching system 1 of the present invention can generate a corresponding operation interface according to different users, and combine the presentation of 3D video scenes on the operation interface. On the one hand, the synchronization module 123 of the server 10 cooperates with the corresponding synchronization module 21 of each user terminal 20 to synchronize and update the 3D image scene presented by each operation interface of each user terminal 20; on the other hand, through the server terminal The interface data synchronization module 123a of the synchronization module 123 of 10 cooperates with the corresponding synchronization module 21 of each user terminal 20 to synchronously update other interface data (such as planes) in each operation interface of each user terminal 20 except the 3D image scene. Audio and video stream data, etc.), so that the interactive teaching system 1 of the present invention can simultaneously update the 3D image data and plane audio and video data for the operation interface, improve the synchronization update effect of the operation interface data, and increase the user's learning interest .

以上實施方式本質上僅為輔助說明,且並不欲用以限制申請標的之實施例或該等實施例的應用或用途。此外,儘管已於前述實施方式中提出至少一例示性實施例,但應瞭解本發明仍可存在大量的變化。同樣應瞭解的是,本文所述之實施例並不欲用以透過任何方式限制所請求之申請標的之範圍、用途或組態。相反的,前述實施方式將可提供本領域具有通常知識者一種簡便的指引以實施所述之一或多種實施例。再者,可對元件之功能與排列進行各種變化而不脫離申請專利範圍所界定的範疇,且申請專利範圍包含已知的均等物及在本專利申請案提出申請時的所有可預見均等物。The above implementations are merely auxiliary descriptions in nature, and are not intended to limit the subject matter of the application or the applications or uses of the embodiments. In addition, although at least one illustrative example has been proposed in the foregoing embodiments, it should be understood that the present invention may be subject to numerous variations. It should also be understood that the embodiments described herein are not intended to limit the scope, use, or configuration of the subject matter of the application requested in any way. Rather, the foregoing embodiments will provide a simple guide for those of ordinary skill in the art to implement one or more of the embodiments described. Furthermore, various changes can be made to the function and arrangement of the elements without departing from the scope defined by the scope of the patent application, and the scope of the patent application includes known equivalents and all foreseeable equivalents when the application for this patent is filed.

1‧‧‧互動式教學系統1‧‧‧ Interactive Teaching System

10‧‧‧伺服器端10‧‧‧Server

11‧‧‧處理器11‧‧‧ processor

12‧‧‧記憶體12‧‧‧Memory

12a‧‧‧軟體程式12a‧‧‧software program

121‧‧‧3D影像模組121‧‧‧3D image module

122‧‧‧介面產生模組122‧‧‧Interface generation module

123‧‧‧同步模組123‧‧‧Sync Module

123a‧‧‧介面資料同步模組123a‧‧‧Interface data synchronization module

20‧‧‧使用者端20‧‧‧user

21‧‧‧對應同步模組21‧‧‧corresponding synchronization module

211‧‧‧平面影音串流單元211‧‧‧ flat video streaming unit

212‧‧‧3D影像資料處理單元212‧‧‧3D image data processing unit

30‧‧‧網際網路30‧‧‧Internet

200‧‧‧操作介面200‧‧‧ operation interface

200a‧‧‧個人化操作介面200a‧‧‧ Personalized operation interface

210‧‧‧狀態顯示區210‧‧‧Status display area

220‧‧‧即時通訊區220‧‧‧IM

230‧‧‧視訊顯示區230‧‧‧Video display area

231‧‧‧影音功能列231‧‧‧Video function bar

240‧‧‧介面功能設定區240‧‧‧ Interface Function Setting Area

241‧‧‧時間訊息顯示241‧‧‧Time information display

242‧‧‧介面功能選項242‧‧‧Interface function options

243‧‧‧輔助通訊功能選項243‧‧‧Auxiliary communication function options

250‧‧‧互動展示區250‧‧‧ Interactive Display Area

251‧‧‧功能列251‧‧‧Function Bar

251a‧‧‧切換鍵251a‧‧‧Switch key

A‧‧‧教學群組A‧‧‧ Teaching Group

a‧‧‧使用者a‧‧‧user

a1‧‧‧教學者a1‧‧‧Teacher

a2‧‧‧學習者a2‧‧‧Learner

圖1為本發明之互動式教學系統之系統示意圖。 圖2為本發明之互動式教學系統之軟體程式及使用者端之組成架構示意圖。 圖3為本發明之互動式教學系統之建立連線狀態之示意圖。 圖4為本發明之互動式教學系統之操作介面示意圖。 圖5為本發明之互動式教學系統之操作介面顯示3D影像場景之示意圖。 圖6A為本發明之互動式教學系統之3D影像場景之控制權移轉之第一實施例示意圖。 圖6B為本發明之互動式教學系統之3D影像場景之控制權移轉之第二實施例示意圖。 圖6C為本發明之互動式教學系統之3D影像場景之控制權移轉之第三實施例示意圖。FIG. 1 is a system diagram of the interactive teaching system of the present invention. FIG. 2 is a schematic diagram of a software program and a client structure of the interactive teaching system of the present invention. FIG. 3 is a schematic diagram of a connection state of the interactive teaching system of the present invention. FIG. 4 is a schematic diagram of an operation interface of the interactive teaching system of the present invention. FIG. 5 is a schematic diagram showing a 3D image scene displayed on the operation interface of the interactive teaching system of the present invention. FIG. 6A is a schematic diagram of a first embodiment of the control right transfer of a 3D video scene of the interactive teaching system of the present invention. FIG. 6B is a schematic diagram of a second embodiment of the control right transfer of the 3D video scene of the interactive teaching system of the present invention. FIG. 6C is a schematic diagram of the third embodiment of the control right transfer of the 3D video scene of the interactive teaching system of the present invention.

Claims (9)

一種互動式教學系統,用以結合3D同步影像之呈現,該互動式教學系統包括:一伺服器端,用以供複數使用者透過網路連線登入,該伺服器端包括:一處理器;以及一記憶體,係與該處理器電性連接,該記憶體包括一軟體程式,藉由該處理器以執行該軟體程式,該軟體程式包括:一3D影像模組,用以產生可供操作之3D影像場景;一介面產生模組,用以對應各該使用者產生可呈現相同該3D影像場景之一操作介面,該操作介面依據不同該使用者以形成一教學者操作介面及至少一學習者操作介面,其中該教學者操作介面或該學習者操作介面可接收針對該3D影像場景之一操作指令,並通知該3D影像模組依據該操作指令執行一對應影像處理;以及一同步模組,用以依據經該對應影像處理後之該3D影像場景同步更新各該操作介面原本所呈現之該3D影像場景;其中該教學者操作介面預設有該3D影像場景之一控制權及一移轉權,該移轉權用以將該控制權移轉至任一該學習者操作介面或移回該教學者操作介面,使得具有該控制權之該教學者操作介面或該學習者操作介面可接收該操作指令以執行該對應影像處理。 An interactive teaching system for combining the presentation of 3D synchronized images. The interactive teaching system includes: a server end for multiple users to log in through a network connection, the server end including: a processor; And a memory, which is electrically connected with the processor, the memory includes a software program for executing the software program by the processor, the software program includes: a 3D image module for generating operable 3D image scene; an interface generation module is used to generate an operation interface corresponding to each user that can present the same 3D image scene, and the operation interface is based on different users to form an instructor operation interface and at least one learning User operation interface, wherein the teacher operation interface or the learner operation interface may receive an operation instruction for the 3D image scene, and notify the 3D image module to perform a corresponding image processing according to the operation instruction; and a synchronization module For synchronously updating the 3D image scenes originally presented by each operation interface according to the 3D image scenes after the corresponding image processing; wherein the teaching The scholar operation interface presets a control right and a transfer right of the 3D image scene, and the transfer right is used to transfer the control right to any of the learner operation interface or back to the instructor operation interface, so that The teaching operator operation interface or the learner operation interface having the control right may receive the operation instruction to perform the corresponding image processing. 如請求項1所述之互動式教學系統,其中於同一時間點該控制權僅存在於該教學者操作介面及任一該學習者操作介面之其中一者。 The interactive teaching system according to claim 1, wherein at the same time, the control right only exists in one of the teaching user's operation interface and any one of the learner's operation interfaces. 如請求項1所述之互動式教學系統,其中該操作介面依據不同該使用者之一個人設定值以對應形成該教學者操作介面或該學習者操作介面。 The interactive teaching system according to claim 1, wherein the operation interface is corresponding to the personal setting value of one of the users to form the teaching user operation interface or the learner operation interface. 如請求項3所述之互動式教學系統,更包括複數使用者端,各該使用者端係供單一該使用者經由網路連接該伺服器端,其中該個人設定值係儲存於該使用者端,並於該使用者端顯示對應之該操作介面以供操作。 The interactive teaching system as described in claim 3, further comprising a plurality of users, each of which is provided for a single user to connect to the server through a network, wherein the personal setting value is stored in the user Terminal, and the corresponding operation interface is displayed on the user terminal for operation. 如請求項4所述之互動式教學系統,其中各該使用者端包括一對應同步模組,該對應同步模組與該伺服器端之該同步模組藉由一傳輸協定維持雙向傳輸以執行資料同步更新。 The interactive teaching system according to claim 4, wherein each of the user terminals includes a corresponding synchronization module, and the corresponding synchronization module and the server-side synchronization module maintain two-way transmission through a transmission protocol for execution. Data synchronization update. 如請求項5所述之互動式教學系統,其中該對應同步模組為一應用程式或具資料同步功能之一瀏覽器。 The interactive teaching system according to claim 5, wherein the corresponding synchronization module is an application program or a browser with a data synchronization function. 如請求項1所述之互動式教學系統,其中該同步模組包括一介面資料同步模組,用以同步更新於各該操作介面呈現之一平面影音串流資料、一圖文資料或一使用者資訊。 The interactive teaching system according to claim 1, wherein the synchronization module includes an interface data synchronization module for synchronizing and updating a plane video stream data, a graphic data or a use presented on each operation interface. Information. 如請求項1所述之互動式教學系統,其中該對應影像處理包括一3D影像場景變化、一3D影像場景移動、一3D影像場景視角改變、3D影像場景中之一物件狀態變化、一物件移動、一物件旋轉或產生一3D遊戲介面。 The interactive teaching system according to claim 1, wherein the corresponding image processing includes a 3D image scene change, a 3D image scene movement, a 3D image scene perspective change, an object state change in the 3D image scene, and an object movement 1. An object rotates or generates a 3D game interface. 如請求項1所述之互動式教學系統,其中該對應影像處理結合一音訊資料,使得依據該對應影像處理同步更新各該操作介面所呈現之該3D影像場景時一併輸出該音訊資料。The interactive teaching system according to claim 1, wherein the corresponding image processing is combined with audio data, so that the 3D image scenes presented by the operation interfaces are simultaneously output in accordance with the corresponding image processing.
TW106116874A 2017-04-12 2017-05-22 Interactive teaching system TWI622026B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/485,876 2017-04-12
US15/485,876 US10872535B2 (en) 2009-07-24 2017-04-12 Facilitating facial recognition, augmented reality, and virtual reality in online teaching groups

Publications (2)

Publication Number Publication Date
TWI622026B true TWI622026B (en) 2018-04-21
TW201837882A TW201837882A (en) 2018-10-16

Family

ID=59997887

Family Applications (2)

Application Number Title Priority Date Filing Date
TW106207287U TWM549381U (en) 2017-04-12 2017-05-22 Interactive teaching system
TW106116874A TWI622026B (en) 2017-04-12 2017-05-22 Interactive teaching system

Family Applications Before (1)

Application Number Title Priority Date Filing Date
TW106207287U TWM549381U (en) 2017-04-12 2017-05-22 Interactive teaching system

Country Status (3)

Country Link
JP (1) JP3212833U (en)
CN (2) CN207037604U (en)
TW (2) TWM549381U (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10586296B2 (en) 2009-07-24 2020-03-10 Tutor Group Limited Facilitating diagnosis and correction of operational problems
US10755592B2 (en) 2009-07-24 2020-08-25 Tutor Group Limited Facilitating diagnosis and correction of operational problems
TWI714362B (en) * 2019-11-22 2020-12-21 中國科技大學 Ecosystem learning device
US10872535B2 (en) 2009-07-24 2020-12-22 Tutor Group Limited Facilitating facial recognition, augmented reality, and virtual reality in online teaching groups

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWM549381U (en) * 2017-04-12 2017-09-21 Tutor Group Ltd Interactive teaching system
US10791082B2 (en) * 2017-11-21 2020-09-29 D8AI Inc. Systems and methods for delivery and use of interactive objects
CN108831216B (en) * 2018-06-12 2022-01-14 辽宁向日葵教育科技有限公司 True three-dimensional virtual simulation interaction method and system
CN109889900A (en) * 2019-01-18 2019-06-14 北京睿峰文化发展有限公司 A kind of method and apparatus that instructional video arbitrarily selects performance scene
TWI714235B (en) * 2019-03-25 2020-12-21 必揚實境科技股份有限公司 Virtual reality teaching system
TWI729747B (en) * 2020-03-27 2021-06-01 東南科技大學 Virtual reality training method applied to computer assembly
US11887365B2 (en) 2020-06-17 2024-01-30 Delta Electronics, Inc. Method for producing and replaying courses based on virtual reality and system thereof
CN112068752B (en) * 2020-08-28 2022-01-11 北京五八信息技术有限公司 Space display method and device, electronic equipment and storage medium
CN112802373A (en) * 2021-02-07 2021-05-14 中国石油化工股份有限公司 Information entertainment teaching integrated simulation teaching system in petrochemical industry
CN117813579A (en) * 2022-07-29 2024-04-02 京东方科技集团股份有限公司 Model control method, device, equipment, system and computer storage medium
WO2024101521A1 (en) * 2022-11-11 2024-05-16 주식회사 겁쟁이사자들 System for video conference and video learning services, and method for providing video conference and video learning services

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10333538A (en) * 1997-05-29 1998-12-18 Fujitsu Ltd Network type education system, record medium recording instructor side program of network type education system and record medium recording participant side program
US6652287B1 (en) * 2000-12-21 2003-11-25 Unext.Com Administrator and instructor course management application for an online education course
TW201104645A (en) * 2009-07-24 2011-02-01 Cheng-Ta Yang Internet interactive learning and managing system
US20150199912A1 (en) * 2013-12-31 2015-07-16 FreshGrade Education, Inc. Methods and systems for a student guide, smart guide, and teacher interface
TWI570677B (en) * 2015-07-20 2017-02-11 籃玉如 Interactive language learning apparatus for virtual reality
TWM549381U (en) * 2017-04-12 2017-09-21 Tutor Group Ltd Interactive teaching system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5727950A (en) * 1996-05-22 1998-03-17 Netsage Corporation Agent based instruction system and method
US7675862B2 (en) * 2006-08-17 2010-03-09 Belkin International, Inc. Networking hardware element to couple computer network elements and method of displaying a network layout map thereon
JP5889559B2 (en) * 2011-07-13 2016-03-22 ソニー株式会社 Information processing method and information processing system
CN104980686A (en) * 2015-06-26 2015-10-14 广东亿迅科技有限公司 Method for controlling scenes in video conference

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10333538A (en) * 1997-05-29 1998-12-18 Fujitsu Ltd Network type education system, record medium recording instructor side program of network type education system and record medium recording participant side program
US6652287B1 (en) * 2000-12-21 2003-11-25 Unext.Com Administrator and instructor course management application for an online education course
TW201104645A (en) * 2009-07-24 2011-02-01 Cheng-Ta Yang Internet interactive learning and managing system
US20150199912A1 (en) * 2013-12-31 2015-07-16 FreshGrade Education, Inc. Methods and systems for a student guide, smart guide, and teacher interface
TWI570677B (en) * 2015-07-20 2017-02-11 籃玉如 Interactive language learning apparatus for virtual reality
TWM549381U (en) * 2017-04-12 2017-09-21 Tutor Group Ltd Interactive teaching system

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10586296B2 (en) 2009-07-24 2020-03-10 Tutor Group Limited Facilitating diagnosis and correction of operational problems
US10755592B2 (en) 2009-07-24 2020-08-25 Tutor Group Limited Facilitating diagnosis and correction of operational problems
US10872535B2 (en) 2009-07-24 2020-12-22 Tutor Group Limited Facilitating facial recognition, augmented reality, and virtual reality in online teaching groups
TWI714362B (en) * 2019-11-22 2020-12-21 中國科技大學 Ecosystem learning device

Also Published As

Publication number Publication date
CN108693960A (en) 2018-10-23
TW201837882A (en) 2018-10-16
CN207037604U (en) 2018-02-23
JP3212833U (en) 2017-10-05
TWM549381U (en) 2017-09-21

Similar Documents

Publication Publication Date Title
TWI622026B (en) Interactive teaching system
US11460970B2 (en) Meeting space collaboration in augmented reality computing environments
US10838574B2 (en) Augmented reality computing environments—workspace save and load
US20210306595A1 (en) System and Method for Interactive Video Conferencing
WO2018098720A1 (en) Virtual reality-based data processing method and system
US9049482B2 (en) System and method for combining computer-based educational content recording and video-based educational content recording
US20180356942A1 (en) METHOD FOR DISPLAYING 360º MEDIA ON BUBBLES INTERFACE
WO2019199569A1 (en) Augmented reality computing environments
JP2023501553A (en) Information reproduction method, apparatus, computer-readable storage medium and electronic equipment
KR102031739B1 (en) Interactive whiteboard supporting real-time internet broadcasting by constructing a lecture screen according to the class progress mode separately from the display screen
US20130038674A1 (en) System and method for distributing and interacting with images in a network
JP6683864B1 (en) Content control system, content control method, and content control program
US20220254114A1 (en) Shared mixed reality and platform-agnostic format
CN112384972A (en) System and method for multi-screen display and interaction
WO2020248682A1 (en) Display device and virtual scene generation method
US9513776B2 (en) Providing wireless control of a visual aid based on movement detection
CN115129280A (en) Virtual reality equipment and screen-casting media asset playing method
JP7047168B1 (en) Content provision system, content provision method, and content provision program
US20210224525A1 (en) Hybrid display system with multiple types of display devices
US20220417449A1 (en) Multimedia system and multimedia operation method
CN117130710A (en) Method and device for generating colored egg file
Zambon Mixed Reality-based Interaction for the Web of Things
KR20210011046A (en) A device and method for displaying a user interface(ui) of virtual input device based on motion rocognition
CN116266090A (en) Virtual reality equipment and focus operation method