WO2020045837A1 - Procédé pour donner des cours à distance de manière intelligente à l'aide d'une technologie de transition de scène automatique ayant une fonction d'intelligence artificielle dans une salle de cours virtuelle et à réalité augmentée - Google Patents

Procédé pour donner des cours à distance de manière intelligente à l'aide d'une technologie de transition de scène automatique ayant une fonction d'intelligence artificielle dans une salle de cours virtuelle et à réalité augmentée Download PDF

Info

Publication number
WO2020045837A1
WO2020045837A1 PCT/KR2019/009449 KR2019009449W WO2020045837A1 WO 2020045837 A1 WO2020045837 A1 WO 2020045837A1 KR 2019009449 W KR2019009449 W KR 2019009449W WO 2020045837 A1 WO2020045837 A1 WO 2020045837A1
Authority
WO
WIPO (PCT)
Prior art keywords
virtual
instructor
lecture
scene
classroom
Prior art date
Application number
PCT/KR2019/009449
Other languages
English (en)
Korean (ko)
Inventor
김영대
Original Assignee
김영대
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 김영대 filed Critical 김영대
Publication of WO2020045837A1 publication Critical patent/WO2020045837A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education
    • G06Q50/205—Education administration or guidance
    • G06Q50/2057—Career enhancement or continuing education service
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Definitions

  • the present invention relates to a smart-remote lecture method and apparatus using an automatic scene change technology of an artificial intelligence function in virtual and augmented reality classrooms, and more particularly, instructors can use the AR chroma key in comparison with a conventional lecture apparatus.
  • Smart lecture apparatus and method using automatic scene change technology that can greatly improve the efficiency of space and time by realizing a similar VR environment that can automatically switch scenes to highlight areas that you want to emphasize
  • the present invention relates to a method and apparatus for real-time lecture recording and remote lecture, which is used in conjunction with a conventional video conference.
  • FIG. 1 shows an example of a conventional lecture recording apparatus.
  • the first method is to record lecture data only, screen or PPT screen and record voice. More than 80% of the Internet lectures are invisible in this way. It consists of a simple material screen and a greening lecture of a pen. Khan's Academy is a prime example. This is a simple and comfortable way to learn extracurricular meals focused on how to understand the problem rather than the motivation of the instructor's facial training.
  • the e-learning method in which the instructor such as the USB camera of the instructor is shown in the corner on the first screen, which is a method such as WebEx and Connect Pro, which are frequently used in webinars. This method secures the first part, but the small part of the material screen and the instructor continue to exist in the same position, and eventually they do not see the instructor.
  • the third method which requires a broadcast technician rather than a self-shooting technique, is a multi-camera switching method based on a so-called switcher mixer that alternates lecture materials, sometimes lecture boards, sometimes composite screens.
  • a switcher mixer that alternates lecture materials, sometimes lecture boards, sometimes composite screens.
  • the lecture synthesis scene method through the lecture synthesizer and the existing switcher mixer lecture system has a problem in the switching of the recording screen and the scene configuration. Therefore, in the classroom, problems such as teachers and blackboard projectors need to be distracted to determine where the students are concentrated.
  • the present invention aims to solve the problems of the prior art as described above and the technical problems that have been requested from the past.
  • the smart lecture apparatus and the remote lecture method and apparatus according to the present invention have similar effects by combining special effects and multiple layers of 2D / 3D as described below.
  • Scenes showing the lecturer in a virtual or augmented reality classroom or scenes centered on presentation materials are automatically converted into scenes that students should see by recognizing the speaker's voice, gesture, location, and pointer environment.
  • the device of the present invention solves the problem of broadcasting equipment, which requires the operator of the equipment by inventing a smart PD function that allows the device to change scenes like a broadcasting PD function for selecting a broadcast scene without a separate equipment operator.
  • a smart PD function that allows the device to change scenes like a broadcasting PD function for selecting a broadcast scene without a separate equipment operator.
  • the instructor focuses on the lecture and the automatic scene transition that students should see automatically creates the VR classroom scene where the instructor highlights and the virtual monitor or virtual copyboard in the virtual classroom that simultaneously performs the function of the virtual copyboard.
  • Real-time VR / AR lecture device using automatic scene change technology that integrates the technology to make a video
  • real-time lecture recording device to record the output screen of the device
  • smart-remote lecture method and device that sends the screen to a remote place for lecture To provide.
  • the lecture method for showing the lecturer and the lecture material in the virtual classroom of the VR / AR technology according to the present invention, the lecture recording device for recording it, the real-time remote VR / AR lecture method and apparatus for showing these scenes to the remote place Is a new teaching method and a new teaching device that radically changes the teaching method of the classroom, which makes classroom teaching more efficient using the blackboards, tables, electronic blackboards, and electronic teaching tables used in the existing classrooms.
  • the real-time recombination screen of the VR / AR virtual classroom is shown on the screen instead of the PPT screen on the screen of the past method as a lecture showing the VR / AR virtual classroom lecture scene of the main unit of the classroom where the real teacher lectures.
  • Virtual desks, floors, blackboards, ceilings, and classrooms are created by constructing virtual classrooms of 2D and 3D graphics that enable the synthesis of lecturers and lecture materials in virtual classrooms by means of graphics and VR for AR.
  • a plurality of virtual cameras for selectively outputting a plurality of virtual classroom scenes by arranging a plurality of virtual cameras in which at least one of position, rotation, and field of view (FOV) is freely defined in the virtual classroom;
  • FOV field of view
  • Switcher button setting that defines a plurality of cameras as virtual switcher buttons like buttons of general broadcast switcher and arranges them as tile button GUI, and defines ICON of these buttons as preview button to show the scene. Arranging such that the instructor can intuitively switch scenes using only a mouse or pointer button without looking at the GUI switching screen with only a mouse button through the process;
  • An artificial intelligence PD function that remotely or automatically switches the function of the broadcasting PD that presses the selection switching buttons of the GUIs arranged in the plurality of virtual cameras according to the lecture situation, so that the instructor gestures, pointers, sounds, language, Various scene changes and virtual copyboards automatically by the automatic PD function that recognizes the scene by recognizing at least one or more of the voice, the direction of the gazing of the instructor's motion, and the students' voice and direction. It may include a step of automatically performing the content conversion to provide a function to output the lecture scene in real time.
  • the virtual camera track moves to each virtual camera position as the actual tracking camera (or like the camera movement of the crane) when the output scene is changed to the required scene while the set scenes of the plurality of virtual cameras are selected as the necessary scenes during the lecture.
  • the track size of the instructor image set in each virtual camera and the position size of the virtual copyboards are synchronized with the camera movement to automatically track each track. Or create a preset track so that each virtual camera change track movement and each instructor image and virtual copyboard are transitioned to a natural animation together.
  • Student with transition of screen Steps are provided automatically or manually track generation feature that allows the furnace to concentrate without hitting the scene to look natural and see; And
  • the judgment of selecting a camera scene is a function of PD, and at least one or more recognition methods of a gesture, a pointer, a sound, a language, and a voice of an instructor It automatically performs various scene changes and virtual copyboard contents conversion by AI PD function that recognizes the scene by gazing direction instructor's view and students' sound and direction recognition.
  • Providing a function to output the lecture scene in real time may include.
  • the mouse or the pointer is displayed on the output screen when the content output to the virtual copyboard is at least one of the plurality of cameras, notebooks, video lists and picture lists.
  • the list is predefined so that external cameras, images, and images placed on the copyboard's contents list can be switched in order, and the following contents are selected through the mouse or the pointer to view the switcher menu.
  • the playlist control can be performed for each corresponding virtual copyboard without having to change the contents or slides such as PPT; and the virtual virtual blackboard selection, characterized in that it further comprises One-touch access to copyboard content scenes with mouse / pointer controls
  • the switching technology may include a function of automatically switching the scene to the corresponding scene while the pictures of the pointer drawn during the content switching are automatically deleted.
  • the automatic scene change that is, the automatic PD in the function of switching to automatically detect the stop if there is no movement of the pointer to increase the size of the instructor
  • PPT slide is changed
  • the virtual copyboard is spontaneously highlighted and becomes a phone in a scene that appears to be large, if the mouse or the pointer is constantly moving the presentation, the virtual copyboard grows somewhat or in a way that is time consuming on a boring screen.
  • the method may further include providing and setting a timer function provided with a function for changing to a similar scene.
  • the presenter in addition to the above-described automatic and pointer position or gesture recognition, the presenter can easily change the scene of each virtual camera while the presenter wants the scene easily by forcing the presenter to lecture.
  • a device such as a control panel is a broadcasting device that requires an expert.
  • the standard template is provided to make it easy for the instructor to change this.
  • anyone can see this template by intuitively changing the scenes with the mouse button. If you press the right button, you can click the butt (virtual camera) in that row, and turn the wheel.
  • Three virtual copyboards that can be used in general through the function of changing up and down to be manually adjusted only by clicking the mouse without looking at the menu are added to the virtual camera switcher, that is, the graphic control panel provided in the GUI of the present invention. Allows three or four scene layouts for each virtual copyboard to show virtual copyboards of varying sizes, automatically or manually change scenes, give lectures, change required virtual copyboards, and other presentations. In order to easily switch the function to show a lecture and show the lecturer, it is possible to provide a function to freely arrange the switcher scene, that is, the virtual cameras, with the switcher button of the graphical GUI.
  • the scene of each virtual camera is captured and shown as an icon on the virtual switcher button.
  • the preview button is provided on the button itself, and the output is immediately output without pressing the preview of the general switcher to check and output.
  • Real-time lectures can be provided by providing the function to program out.
  • the arrangement of the virtual cameras of the virtual control panel can be freely determined and arranged on the icons of the switcher GUI in each scene setting step. It is natural that the function is provided.
  • the virtual camera is arranged in the virtual classroom as if the cameras are placed left and right, and back and forth.
  • the tiles can be arranged as tiles 1x4, 2x3, 3x4, 4x5, etc.
  • the position of the camera that is, the instructor is shown large or small, but the instructor is large.
  • a 3D object in addition to the instructor and the virtual copyboard shown in the virtual camera in the virtual classroom, a 3D object is called to display the virtual object animation using real-time 3D render technology. It can be freely placed in each virtual camera scene to adjust its size and position, and its animation and interactive controls allow real-time 3D virtual experiments and experiences of heavy and large objects or very small DNS-like objects that cannot be experimented or experienced in actual classrooms.
  • the method may further include controlling the learning using a joystick or a keyboard.
  • the virtual copyboard 3D is adapted to adjust the distortion of the virtual screen to a curved curve screen as well as adjusting the size of the virtual copyboard and cropping of unnecessary portions.
  • the ability to adjust the degree of curvature of each virtual copyboard to show beautiful immersive virtual copyboards so that they can be placed in the scene of each virtual camera and the size of the frames of these virtual copyboards together Providing a function of allowing a curved surface and adjusting a frame color and size so that a beautiful virtual camera output screen can be created.
  • each virtual copyboard constitutes a main scene of the output screen, and provides a virtual frame, that is, the outer frame of the copyboard as a variety of external graphics so that it can be beautifully displayed in the virtual classroom. It can be selected and used, and the ability to adjust the thickness, color, and transparency of these frames to provide the ability to adjust in real time to match the virtual classroom.
  • such a frame function and the outer cropping (cutting) function are provided not only for the virtual blackboard, but also for the instructor's image, and the cropping of the instructor's image frame and the virtual blackboard is performed.
  • Various shapes such as rectangle or ellipse can be selected, and the AR function is processed through the transparency function of the outer border area even if the frame is not selected so that the background and the virtual copyboard or the lecturer's image are infused.
  • the virtual electronic blackboard includes an electronic pen function capable of marking by a mouse or a pointer, wherein at least one of thickness, color and transparency of the electronic pen is controlled and drawn by the pen function.
  • a function may be provided that allows the part to be automatically erased when the copyboard content is changed or the PowerPoint scene is switched.
  • the virtual electronic blackboard like a pointer used in a general classroom to increase the concentration of lectures in the present invention, includes a virtual electronic pen function that can be marked by a mouse or a pointer, and among the thickness, color, and transparency of the electronic pen.
  • a virtual graphics pointer that allows at least one to be controlled so that the mouse or gyro pointer can be visualized on the virtual copyboard, allowing the size of the virtual pointer graphic to be scaled and colored externally. Providing is an important function of the present invention of the virtual teaching method.
  • the slide notes of the presentation contents may include a function of automatically providing a caption function that is provided as a caption on the virtual camera output screen so that the presentation and the caption are output together.
  • using the camera to recognize the instructor tracking and the face rotation angle through at least one of the instructor's face recognition, direction recognition and facial expression recognition it is used for switching of the virtual camera, and shown in the virtual camera The ability to automatically display the corresponding content, such as blackboard writing, projector images, or students asking questions, on the virtual copyboard.
  • the virtual camera scene switching and the instructor facial image expression extracted from the camera may include a function of generating and using an instructor image without a chroma key by allowing the character to be used in place of the instructor camera image in real time.
  • the application provides a change screen of a virtual camera scene and a change of material to show lecture material, in particular a change of a PPT file, to a PPT file of an external input notebook or a virtual copyboard of a PPT file.
  • a remote lecture controller to watch the remote scene transmitted through the video conferencing function and control the device of the invention through a remote controller that can be controlled remotely using a smart phone linked with a wireless signal
  • the image of the instructor is input to a Tele Precence system in which the instructor sends a lecturer video and a lecture notebook at a remote location using a remote camera image received through a remote camera.
  • the smart-remote lecture method which is received and output, is natural, and the instructor does not come to the apparatus of the present invention and transmits his image to the apparatus of the invention by video conferencing and receives the image of the apparatus by video conferencing.
  • the cloud service may be provided to a remote presenter lecture device that uses and transmits ppt presentations to and from the device.
  • the function of automatically operating the device of the present invention only by using the pointer used in the actual lecture to move the PPT page to the next or previous page.
  • the button When the button is selected, the function of enabling the virtual switcher to select the virtual camera showing the scene at the same time as switching the PPT screen and the pen function for drawing the virtual pointer in conjunction with the function of the pointer, the pointer or the mouse Allows you to control the function of intuitively selecting a button according to the position of the virtual switcher of the virtual camera by using the left mouse button, the right mouse button, and the rotation wheel provided to the user, and by rotating the rotation wheel on the mouse or the pointer Scenes that cause the switcher to switch up and down
  • This function which enables a straightforward Switching with just all the various scenes, such as 12, 16 are provided are important to the ability to be a ring only a pointer without a control panel, such as a particular broadcast switcher one button is provided.
  • the instructor when using a general blackboard or a real electronic blackboard, notebook, TV, etc. in the classroom during lectures, the instructor indicates the position, posture, and the angle and body position of the instructor to select and describe them.
  • Tracking image processing Considering the information of the camera, the direction that the face looks through the instructor's face recognition, and the position pointed by the hand through the gesture, the corresponding content, that is, the contents of the projector screen, the writing on the blackboard, and the student's question scene camera It is possible to add various artificial intelligence information so that the automatic switching of virtual camera selection switching and the function to intelligently and automatically set the contents of the corresponding virtual copyboard can be used. Switching is provided precisely and precisely. Image processing for measuring angles of various sensors, video cameras, and instructors, and automatic scenes using actual rotation sensors may be switched.
  • the apparatus of the present invention through the step of receiving an image of a camera of the present invention in a lecture room is automatically provided with a function of allowing a lecture recording device, a remote lecture device, and a lecture broadcasting device to broadcast it on the Internet.
  • video lectures record the same lectures used in actual classrooms. Unlike the previous video recording methods, lectures recorded in the lecture room are recorded as they are, and are shown in the classrooms. TelePresentation devices that have been shown to be impossible It can be configured.
  • the apparatus of the present invention is used to set up the cameras of these video conferencing programs using existing video conferencing S / W, that is, Skype of Microsoft or Hangout of Google, for the function of making a two-way question and answer with a remote place.
  • the lecture device which makes the lecture efficient in the classroom, is a lecture device that allows students to take the same lesson outside the classroom with water. Lecture hall to become smart classroom lecturer to hear In the meantime, the class will be a smart lecture device that allows students to take the same class even if they are not in class.
  • the instructor when the public presenting the device of the present invention, such as a general presentation room, a large lecture room, a conference hotel, etc., the instructor will show the virtual classroom composite screen of the method in the conference room.
  • the lecture scene of the synthesizer is synthesized in a conference scene where only the material is displayed on a relatively large screen and the material is not large.
  • the instructor can be used as a large lecture room or conference lecture device that can be used to change the lecture scenes with a single pointer, so that complicated broadcasting devices for large lecture halls or hotel conferences cannot be relayed on the large screen.
  • a large conference / conference relay system used as a device to create a site, and even a remote conference device, so that you can see a conference that goes beyond the field conference without having to go to the venue conference.
  • a relay device, and even a virtual camera from a remote location can be used for remote conferences, which can be seen in other conference venues, so that the cost of attending the conference can be seen remotely and simultaneously in multiple locations, cities and countries. It will be used as the remote VR conference technology of the new BM model that enables charging.
  • the business field can be made by a bi-directional multi-regional / classroom conference relaying model where the Q & A discussion will be conducted simultaneously with the remote site and the field, and these presentations will be recorded to resell the content after the conference. Losing ways can be included.
  • the smart-remote teaching method is provided as a system mounted inside the electronic teaching board or electronic blackboard that makes it easy for the direct lecturer to lecture in the classroom,
  • chroma key function can be provided so that the lecture can be shown in a way that shows the composite scene of the lecture with the lecturer and the presentation material. It can be recorded or watched in a remote lecture.
  • the present invention using the above method, the lecturer at the remote site to the lecture through the Tele Presence (Tele Presence), and synthesized the lecturer and the lecture materials and send to the lecturer, where the lecture in real time, the lecture in the remote location Provides a remote lecture device using TelePresentation.
  • Tele Presence Tele Presence
  • the lecturer and the presentation material by interlocking the camera of the instructor tracking function by providing the function to the device mounted inside the electronic teaching table or copyboard, and to provide a chroma key function if necessary
  • It may be a smart lecture apparatus electronic table or an electronic blackboard to be a classroom lesson of the electronic teaching table or electronic blackboard equipped with the lecture apparatus function of the present invention shown together.
  • the remote lecture apparatus may be placed in any position in the classroom, for example, the students behind the classroom not only in the classroom method in front of the classroom,
  • the teacher or teacher looks upside down and sees the students together, and the class is held upside down so that the teacher can always use it as a teaching device.
  • the teacher's eye is looking at the camera from the instructor tracking camera so that the students in the classroom can see each other at the same time with the teacher.
  • Classes and methods that maximize lecture concentration Even in remote classrooms may be two concurrent virtual lessons eyes Justify how the teaching method that simultaneously Justify eyes with infinite students.
  • more screen space is secured in front of the classroom so that an additional screen or projector screen is mounted in the additional space and the plurality of remote classrooms are located on the screen or projector screen. Shows the listeners together and allows the instructor and the listeners to conduct lectures in synchronizing the lecturer's lecture screen and the remote listeners with each other. You can proceed.
  • the instructor camera uses a chroma key environment, which is extracted only by the instructor, at the back of the instructor to use a virtual screen synthesis method or when the instructor is not a chroma key environment.
  • AR or VR to make a graphic 3D character look like an instructor using the instructor face recognition method, which can be used as a virtual lecturer or a remote class lecturer.
  • the lecturer is teaching in front of the lecture device, when the instructor looks at the presentation material screen, the virtual electronic blackboard showing the material screen becomes larger and the screen becomes smaller so that the instructor is smaller. Automatic inversion of the instructor's camera is possible while looking at the blackboard It is easy to provide a feature that allows the instructor's face orientation to take a look at the lecture material together, by providing the ability to make the teacher's eyes look.
  • the remote lecture apparatus is configured as a lecture studio of an All in One studio apparatus that provides a camera, which is equipped with a camera, which is equipped with a background, lighting, and a monitor.
  • a lecture-only broadcasting station By providing a package, users can provide a lecture-only broadcasting station as a DIY within 1 hour without difficulty, such as construction.
  • the smart-remote lecture method and apparatus using the automatic scene change technology is a method of producing a virtual classroom in a more specific and convenient manner, such as a special effect, a method of generating a similar effect by combining multiple layers of 2D,
  • the above techniques can be used as a way to create a feeling of a similar VR environment without using AR-type chroma key, and above all, the transition of these methods is automatically converted so that the instructor does not need an operator.
  • Smart-remote teaching method and apparatus using automatic scene change technology is a new teaching method and classroom to more efficiently use classroom teaching using blackboards, teaching tables, electronic blackboards and electronic teaching tables used in the existing classrooms
  • the classroom as well as the remote class will be able to watch the lecture like the real classroom and will be able to listen to the lectures on the smart devices around the world in the same way.
  • the limitation of being able to take the class correctly and listening to remote video lectures that everyone knows has the effect of providing a better environment than the lecture of the instructor in the classroom.
  • Fig. 3 are conventional online lecture recording scenes and synthesis screens
  • 2 is a virtual classroom authoring tool concept and component-specific studio production screen according to an embodiment of the present invention
  • 3 to 5 are screens showing arrangement scenes for virtual cameras in a virtual classroom according to an embodiment of the present invention.
  • FIG. 6 is a screen switching and screen highlighting method using the direction keys according to an embodiment of the present invention.
  • FIGS. 10 are screens illustrating automatic scene change according to artificial intelligence according to an embodiment of the present invention.
  • FIG. 11 is a screen illustrating a flip teaching method according to an embodiment of the present invention.
  • FIG. 12 is a screen showing a remote presentation according to an embodiment of the present invention.
  • FIG. 13 is a scene of a tele presentation system according to an embodiment of the present invention.
  • FIG. 14 is a screen illustrating a scene through a multi-screen configuration using a video will according to an embodiment of the present invention
  • 15 is a conceptual view illustrating a configuration capable of bidirectional simultaneous lessons according to an embodiment of the present invention.
  • FIG. 16 is a conceptual diagram of a VR and AR classroom presentation apparatus operating according to an embodiment of the present invention.
  • 17 to 18 illustrate an implementation of AR studio according to an embodiment of the present invention
  • 19 is a lecture recording function screen according to an embodiment of the present invention.
  • 20 is a block diagram of a self-learning mobile assembled studio device according to an embodiment of the present invention.
  • 21 is a block diagram of an all-in-one mobile server using a studio device according to an embodiment of the present invention.
  • 22 is a conceptual diagram of a virtual output screen capture driver technique according to an embodiment of the present invention.
  • FIG. 23 is a block diagram of a classroom lecture scene according to an embodiment of the present invention.
  • a method of creating a virtual classroom in a more specific and convenient manner such as a method of generating a similar effect by combining special effects and multiple layers of 3D / 2D, and a method of creating a feeling of a similar VR environment without using an AR method chroma key.
  • the lecturer in the virtual classroom to show the scene to emphasize the lecture material when the lecturer needs to show the necessary lecture material when the instructor knows the intention of the instructor in the device of the invention without such a professional broadcast technician
  • virtual classroom shots (3D space / or 2D layered composite virtual compositing), which relocate the lecture materials and show the necessary scenes with virtual cameras in this virtual classroom and automatically select various scenes for them.
  • the AI PD function provides a way to automatically create the required screen without the need for equipment operators.
  • the VR / AR method of using the broadcasting technology in the classroom in real time, and furthermore, the MR recording technology can be used to improve the recorded video of the classroom than the actual classroom, which is more than the actual lecture. If it is improved, it is impossible to make eye contact, which is a problem of existing classroom lectures, because the classroom is used as a lecture device to show the lecture in the classroom by the invention method instead of the existing lecture method, and the classroom is not enough for students to see the lecturer. It can be a new lecture device that solves the problems of such a big case, the problem of not being able to decorate the room beautifully and the limitation of taking a class from a remote place.
  • Instructors can output larger than they actually are and sometimes the material screens are made in beautiful virtual or augmented reality spaces for lectures, and the same screens can be recorded and sent to remote locations, giving lecture videos beautiful and real-time immersion.
  • the device of the invention first synthesizes a lecture room into a virtual or augmented reality to create a beautiful lecture room, and assembles a desk, a wall, and a floor directly in a virtual space.
  • Lectures of floors, walls, desks and ornaments are arranged in a multi-layered manner, or in a multi-layered manner, in the form of classroom studios that are given in various ways.
  • the instructor and the virtual chariot blackboards output by the virtual cameras various scenes can be freely configured into beautifully necessary scenes.
  • a lecture device that uses a blackboard, a projector, and the like to synthesize lecturers and lecture materials and displays the composite screen on the screen of a projector, which shows lecture materials in real time. Students alternate between lecturers and lecture materials. It is a device that lectures by watching a composite screen instead of listening to lectures. The lecture recording, remote lectures, two-way simultaneous classes, presentation meetings, etc. do not have to be taken by the actual instructor, and do not see the class from the classroom. It allows students in the classroom to take lectures more intensively than in the traditional way,
  • the present invention is invented so that the lecturer and the lecture material can be shown to show the lecturer largely when the student needs to see the lecturer, and sometimes the lecture material is sometimes shown together when viewing the lecture material.
  • the lecturer synthesizes the lecture screen in such a way that the students can show the scenes by using the artificial intelligence function judged by the device of the invention as the students judge the scenes to be shown through the lecturer's gesture, voice, etc.
  • Lecture materials, and beautiful classroom background-Real time synthesis and scene switching can be done by synthesizing it into virtual classroom.
  • camera images and lecture material screens (PPT, notebook, blackboard, electronic blackboard, question student, real imager, etc.) that take lecturers are input to show the composite screen of the lecture.
  • a layer composition method VR instructor removes the background and extracts only the instructor image, or VR classroom method using edge recognition, or edge method
  • the virtual classroom can be virtually photographed through a virtual camera that can be freely placed in a virtual classroom, such as an AR classroom that synthesizes a part of the background and synthesizes a part of the background and synthesizes a real classroom image and a virtual space.
  • Virtual classroom screens moving these cameras to different positions, Freely place virtual blackboards or instructor images for each virtual camera location so you can place virtual blackboards, virtual desks, and lecturer sizes in the virtual classroom to show lectures that students can focus on on the virtual shooting screen. Automatically output their virtual cameras and show them as projectors or smart devices.
  • the apparatus of the present invention enables a virtual classroom to be composed of 2D multi-layer or 3D graphics, and allows a plurality of virtual cameras that can be freely positioned at various positions in the virtual classroom of the graphic, For each virtual camera, a camera image of a real lecturer is placed along with a virtual desk, and a virtual copyboard showing the lecturer's image and the lecture material image to be displayed from the virtual camera is placed on the virtual camera. Freely create scenes that the composite screen displays to the students to show, and virtual switchers that select these scenes, or multiple virtual cameras (placed in a virtual classroom as shown by switching multiple cameras into real switchers in a real classroom).
  • One virtual cameras in the device of the invention Switch to the virtual switcher function to show the lecture scene, but the device of the invention automatically recognizes the instructor's gesture, voice, writing, pointer position, and student's question.
  • the AI feature allows the optimal virtual camera scene to be shown to the students. This switching can be activated by the instructor or operations assistant as needed.
  • one virtual camera is set to a desired position, that is, a position where the instructor and the classroom are shown in a required size (ie, a keyframe position), and for each camera position.
  • a desired position that is, a position where the instructor and the classroom are shown in a required size (ie, a keyframe position)
  • the free placement of the virtual copyboards on which the virtual copyboards to be displayed are placed and the tracks that set their settings and automatically display in real time in the size or angle set to the corresponding position
  • the number of camera tracks is 132 (12x11), and two corresponding virtual copyboards are additional 2x132, it is impossible to manually set the tracks of them in real time.
  • This simultaneous function is important, in which case various cases of track generation As to the form and time, and freely set to generate a variety of animation effects beautify the image and make the Amy animation, and is also provided with a function that allows to be able to see such as students grow blackboard or instructor's face to focus the lecture.
  • the program input function of the screen is provided so that the image of the student in the remote classroom is displayed on the virtual electronic board.
  • the screen showing the presenter and the questioner together is provided as another classroom.
  • the various output screens of the plurality of virtual cameras are pre-arranged to show the instructor and the virtual copyboards in various VR cameras as shown in Fig. 4 by setting the necessary main scenes in advance and defining them as key frames of the virtual cameras.
  • the location of the virtual camera and the corresponding virtual camera to focus on one of the instructor scenes and lecture materials that the instructor focuses on, and to show various virtual scenes of the scenes that make the corresponding virtual copyboard scene larger and make the instructor relatively less visible.
  • the scenes are set to a certain rule and the virtual cameras are tiled and the instructor is upward.
  • the virtual camera setting switcher is arranged so that even the beginner can understand the scenes output by the virtual cameras intuitively by using the alignment method that makes the virtual blackboard 1 on the left and 2,3 on the right.
  • You can see the switcher button without looking at it, and you can see the current scene and intuitively move the necessary scene by pressing the set button, or by pressing the left, middle, or right button to move the mouse Includes a feature that allows the instructor to simply move the wheel by moving the wheel or move the scene with simple arrow key buttons, etc.
  • the scene transition basically recognizes the movement of the mouse pointer so that the mouse pointer moves as illustrated in Figure 6. When you go up to the virtual copyboard on the output screen, you create a scene that enlarges the chalkboard.
  • the upper camera button is operated automatically, and if the mouse / pointer does not move for a certain time on the virtual blackboard, the instructor is automatically moved to the upper direction button, which makes the instructor larger.
  • the instructor shows the entire studio scene again, and when the mouse moves with the pointer over a specific virtual copyboard, it causes the virtual copyboard to move to the largely placed scene. If the mouse pointer moves on the virtual copyboard for a long time, the virtual copyboard moves to a larger scene and then moves to a different scene again after a certain amount of time.
  • Auto chapter in way to the scene The ability to make this transition, it is important that the ability to be a pointer to how the artificial intelligence built-in progress.
  • the function of the mouse pointer and pen is sensed as in the case of claim 5, and the network is sensed by the device of the invention to change the scene. It includes losing.
  • the instructor When the instructor does not use the pointer and is not recognized by the device of the invention as a laser pointer, the instructor is greatly instructed when the instructor's viewing direction is through the image processing of the instructor's face and gaze direction that enters the instructor camera / or instructor tracking camera.
  • the instructor looks at the blackboard or projector screen, he uses the method of enlarging the projector screen, and the position sensor (xyx) reads the direction of the instructor's face and the position of the lecturer's classroom to know the instructor's position in the classroom.
  • the tracking of the instructor can be precise and the multi-position sensor is attached to each microphone to move the virtual camera scene using the microphone voice and the position of the questioner's tracking camera and to display the scene where the instructor looks.
  • Tracking camera displays instructor size and lecture materials by position and angle
  • when writing a blackboard by recognizing the direction of the instructor's position face through time and posture as in the case of claim 5 when viewing a projector screen, when viewing a student, when a student asks a question, Automatic lecture recording and automatic remote recording with the function of enabling camera tracking and scene switching at the same time by recognizing the voice, starting, ending, and viewing the scene. Make classes possible.
  • the students Like this, it is as if the students judge the place to see and see the teacher's gestures. Based on movement / gestures / questions, the students automatically select the virtual camera scenes that should be automatically output to the AI function of the device of the invention using the information as if they were looking at the lecturer, the blackboard, and the question student. It is a lecture device that allows the presenter's device to create a virtual camera screen of a scene for students to see in an artificial intelligence method once the speaker announces it. Remote classroom interactive lessons for meetings, It could be a tele-presentation conferencing device for video conferences, or a web conference / webinar for webinars that broadcast these lectures worldwide.
  • the device of the present invention in a general classroom so that lecturers and lecture materials can be seen in a remote classroom so that lectures can be automatically transferred to a remote location, and students can be seen in a classroom with an instructor.
  • the remote class method that is, the two-way class or the multi-class class, that is, the Tele-Class solution. It becomes the device that makes the teaching system.
  • the instructor When the instructor stares at the camera using the device of the present invention, the instructor stares at the camera and the instructor looks at the projector screen. The lecturer's eyes look at all the students in the classroom and the class becomes a simultaneous eye-catching lecture, maximizing the concentration of lectures, and further, the instructor teaches behind the classroom (Flipped Teaching). It's a class where the instructor sees the class scenes that the students see in the class that is taught after the class, and the virtual distance class where the students see the faces and gestures and the presentation materials and the remote class students together. And remote classrooms are the same as on-site classrooms with instructors. Sharing the ups and new remote classroom lessons joint that enables simultaneous multi-classroom lessons with students in multiple classrooms can be made. At this time, the use of a response system that allows a remote student to answer a smartphone via the Internet to perfect immersion is a high-tech VR classroom that maximizes immersion and enables perfect remote immersion class through the technology used together. To be.
  • the composite screen of the present invention is a video input to recognize the camera of the existing device to become a presentation conference, presentation webinar, or telepresentation system.
  • the videoconferencing scene is a feature that allows direct output from broadcasts such as YouTube or Facebook to be performed without additional encoder devices.
  • the output of the device of the invention to the existing TelePresence system is inputted to the notebook of the telepresence system.
  • the instructor camera of the existing telepresence system is used as the instructor camera of the device.
  • Present the presentation while viewing the output screen make the other team's meeting team visible on the additional screen, watch the same presentation on the other side, and watch the attendees on additional channels, perfect for the immersive presentation of the TelePresence device.
  • the video wall is used together to effectively view a plurality of participants and the presenter effectively configures the screen when multiple devices are used.
  • the output screen is displayed on the projector's projector screen so that the instructor's facial expressions can be shown effectively to multiple people. It can be viewed as another large classroom or classroom, enabling a large conference presentation device and a relay joint conference system that renews the way in which existing large conference venues are inefficient.
  • the virtual classroom is streamed to the 360 screen to view it remotely from the 360's HMD, and the 3D classroom of the virtual classroom is sent to each client in advance so that the client can stream instructor cameras and lecture materials, and downgrade their virtual camera locations together. It allows you to show the scene from the 360 reference point of the virtual camera scene, render it on the client at an additional HMD client position and angle, and have a high quality experience. It's no surprise that it's a 360 HMD device that provides a way to pre-provide and switch their scenes from the client rather than auto-switching.
  • This lecture device is mounted as a lecture table, cameras, lecture computers, and student tracking devices that track lecturers in the classroom are interlocked, and when the lecturer lectures with the device of claim 1, the lecture is automatically shown on the screen in a virtual lecture manner, and recorded. It becomes the electronic VR classroom which becomes the VR classroom which becomes the classroom with several external classrooms.
  • the lecture recording studio will be recorded when the lecturer is watching the screen outputted by the lecture apparatus in the classroom with the device of the present invention.
  • the slide notes of the presentation slide program such as PPT are seen.
  • the device of the present invention it is shown as the title subtitle so that the instructor can present the lecture while watching the subtitle, and when the pointer becomes the next slide, the slide is changed to the virtual camera screen where the lecture material becomes larger.
  • the slide notes While reading and presenting the slide notes, the slide notes are closed and the caption is finished, and the instructor turns the scenes so that the instructor looks larger when the instructor finishes the slide material.
  • the slide recorder, the scene change, and the presentation slide notes are automatically subtitled.
  • the subtitles when finished, it includes a function that makes the scene move to a scene that enlarges the instructor.
  • the subtitle scrolling speed recognizes the instructor's speech and automatically adjusts the subtitle speed, scrolling subtitle speed, and presenter presentation speed, and the instructor adds descriptions even after the slide notes.
  • it is natural to provide a function to make the voice recognition.
  • the text scroll of the framter is made transparent so that the background of the slide note subtitle is made larger on the screen so that the front of the output screen is visible and the note text is read aloud. It provides the ability to make lectures by automatically adjusting the time, such as the ability to make the lectures disappear automatically after scrolling, or to manually turn on and off the lectures.
  • the lecture scene will be automatically changed to the lecture and the lecture scene will be displayed in the lecture room.
  • the lecture using the present invention is automatically performed in a manner that shows the synthesis scene of the device of the invention by showing the synthesis scene by using the pointer on the screen and using the pointer on the screen to recognize the motion of the pointer mouse. You can make the composite screen switch.
  • Lecture recording system that provides studio as a system and provides lecture recording as a VR lecture device at any place without studio construction.
  • the studio provides a monitor-mounted and camera-mounted kit as shown in Figure 24.
  • the automatic function of the apparatus of the present invention includes a technology for providing a DIY studio installation that allows anyone to make advanced presentation lectures and a kit that enables a DIY lecture recording studio.
  • the technology of the present invention outputs the lecture scene directly to the scene by an automatic or manual simple operation to receive a real-time synthesis screen on the existing classroom projector by using a conventional projector and the presentation computer screen as input in a general lecture scene, such as a movie theater.
  • a general lecture scene such as a movie theater.
  • It is a device that can record high-quality recordings of high-quality recordings that solve difficult problems of the existing recording service and problems that recording lectures do not have much more than actual classroom classes by using the (Lecture Capture) device.
  • Such a device receives an instructor presentation computer input, a camera photographing an instructor, a camera photographing an instructor, and a camera photographing a student.
  • the lecturer's material is made of one-touch recording to show the virtual camera setting when the lecturer's material is enlarged.
  • the visible device is made. (See Figure 21)
  • the instructor's gestures and facial expressions instead of using the instructor's gestures and facial expressions to synthesize the camera image of the instructor, they express the face recognition as other characters to compose the actual face and hand movements into characters and use them on the composite screen instead of the instructor.
  • the facial expressions as well as the voices are generated similarly so that the actual camera expresses the expressions and gestures of the characters so that the actual instructor uses more than the characters moving on the lecture screen
  • the character replaces the facial expression with the character instead of the actual instructor's video, and creates a virtual character lecture through face recognition and gesture recognition instead of the actual instructor.
  • a lecture method that makes expressions appear in real time as characters.
  • the facial expression gesture recognition allows the expression of the character of the virtual lecturer by making the facial expression gesture of the Carrier instructor without the chroma key. It is possible to express it and use it as a virtual instructor so that it can be synthesized like a perfect chroma key without chroma key.In this case, if face recognition is difficult to process in real time, lecturer face recognition is lectured for post-editing and new precision recognition and processing You can make a lecture video with a more accurate look.
  • FIG. 23 illustrates a lecture apparatus environment in a general classroom environment in which the lecture apparatus is used. Tracking can be provided when the instructor moves the instructor camera to take the instructor first. Chroma key can be easily moved in the chroma key color area behind the instructor. The composition of the lecturer will be used on the lecture screen.
  • the PPT file or notebook input is used as the instructor's presentation. The two materials are screens made by resynthesizing a virtual camera placed in a space selected or created as a 2D or 3D graphic virtual classroom in a virtual classroom. It will be shown through the projector or TV in the classroom.
  • a variety of virtual camera scenes will be shown automatically or manually as the switcher scene specified in 4, and the lecture device draws or shows pointers and lectures on the virtual copyboard on the presentation screen.
  • the virtual copyboard that shows the data can be displayed simultaneously by using additional cameras that show additional students so that various inputs can be simultaneously displayed using multiple boards instead of just one. If necessary, a large number of scenes such as student questions will be enlarged to show a virtual camera scene to show their screen.
  • FIG. 2 is provided with a virtual classroom authoring tool for selecting and using a basic virtual classroom for lectures according to an embodiment of the present invention and allowing anyone to easily and conveniently make or use these modified virtual classrooms. This is very important and the concept of their authoring tools and studio production screens for each component are shown.
  • FIG. 2 as an example of the screen configuration of the device of the invention, a plurality of virtual (VR) copyboards to show virtual desks and lecture materials in a virtual classroom, and three virtual copyboards freely positioned in the above scene.
  • the lectures can be arranged by adjusting the angle and setting various scenes that allow the instructor to enlarge or enlarge the screen for each of these layouts, and arrange the virtual cameras to make various output screens in real time. It allows the instructor to make the instructor large or the material to be displayed large by sending the scene to the projector, recording, or remote location.These scenes can be explained using the pointer (virtual graphics) while viewing the screen and the instructor's gesture or hand.
  • 3 to 5 are screens showing the layout scenes for each virtual camera in the virtual classroom according to an embodiment of the present invention.
  • FIG. 3 illustrates an assembly studio method of a basic concept, which illustrates a concept of a classroom authoring tool that prefabricates a ceiling, a wall, and desks of a virtual classroom, and various studio productions by adjusting position colors of assembly components.
  • the existing patented technology gives the user the ability to easily change the color of the shader function and adjust the color of each shader for each component.
  • the free placement, size, and rotation of the virtual classroom walls, floors, and decoration 3D objects can be scaled with water so that they can be placed freely.
  • the color of each background or the surface of the 3D object is HSV. It provides color erection, or RGB color adjustment, which allows you to design according to your feeling and provides a shader function that allows you to make adjustments without any other program.
  • the board 4 is an example of scenes arranged for each of the 12 virtual cameras in the virtual lecture room of the device of the present invention.
  • the board is placed in such a way that it can be enlarged to make it easy to recognize where the scenes are switched intuitively, so that it is possible to intuitively switch things by button or mouse operation. Intuitive switching comes with the ability to adjust with the mouse button.
  • FIG. 4 is a scene in which the scenes of each of the twelve virtual cameras are represented in the form of tile switcher buttons in the device of the present invention.
  • the virtual blackboard is relatively small and large so that when the instructor sees the instructor, the lecturer makes the lecture material larger and the virtual copyboard 1 on the left side is 3 on the right side and 2 virtual electronics on the center.
  • the scenes can be arranged in such a way that the board can show them, allowing the instructor to move to another scene from the scene as soon as necessary, allowing intuitive scene selection with mouse or keyboard buttons. This is an important feature that enables without the need to learn special device operation during lectures, where scene selection is manual without operator.
  • the scene of the switch button of the device of the invention in which 12 scenes are arranged in this way is automatically set to the scene of the device of the invention
  • the scene of the button is displayed.
  • the intuitive button provides a way of pre-screening the scene to show the output scene without a free part.
  • FIG. 5 illustrates a function of detecting a mouse motion and a position of a function of automatically instructing the instructor to move the mouse / pointer to the corresponding virtual camera so that the corresponding virtual copyboard is made larger by viewing the output screen of the corresponding virtual camera scene.
  • the artificial intelligence function that automatically switches the scenes of each virtual camera to the instructor's pointers, postures, blackboards, etc., firstly detects the movement of the pointer or mouse during the lecturer's lecture to show the scene. Demonstrating the function.
  • the instructor's posture-the camera's posture tracks the writing of the blackboard by detecting the posture for writing, the position of the hand, the gesture, and the facial orientation of the face. It provides the ability of artificial intelligence to show scenes that are synthesized.
  • the scene change setting can automatically move to various scenes when the mouse pointer is not moving.
  • the output scene is displayed without looking at the operation menu, and the scene is arranged as shown in FIG. 3 by pressing the mouse wheel or button or using the arrow direction on the keyboard. It can be operated with a mouse or keyboard button that allows the instructor to operate directly while viewing the bay.
  • FIG. 6 is a screen illustrating a screen change and screen emphasis method using a direction key according to an embodiment of the present invention.
  • the instructor can intuitively determine the necessary scene manually even during AI switching, and use the mouse to use as a pointer or the arrow keys on the keyboard and the key button arrangement for the left hand used in the game to view the current scene and other scenes.
  • To position the virtual camera in a tiled arrangement highlighting the virtual copyboard to the left and right, and placing the switcher buttons in a manner such that the instructor size and the virtual blackboard size are adjusted up and down. You can change scenes with only mouse button or arrow button.
  • This method of manual switching is a function that utilizes the functions of the previous patent together to enable manual switching with a single mouse click even when automatic.
  • the contents of the virtual copyboard of the scene that is, the external input, the video list, and the pictures are defined in order so that they can be switched to the next or previous contents. It adds the ability to rotate or use the special F1, F2 keys to automatically modify the contents of the copyboard during lectures, and allows the user to look at the scene switching of this function by voice or gestures, as a student looking at the virtual electronics.
  • the chalkboard content will be provided in an AI way that will automatically display it.
  • the number of virtual cameras is three or four, eight, twelve, etc., if necessary, and the necessary buttons are created and arranged in the left and right up and down directions of FIG. 4 so that their arrangement is tiled in the virtual classroom.
  • the position of the tiled virtual camera and the switcher mixer's buttons that make it possible to predict the placement scene by recognizing it as if it is placed with the switcher are the functions that allow the instructor to manually operate the menu when the operation is required without knowing the equipment. It is important.
  • the virtual copyboards can be edited to be automatically placed in the corresponding scene so that the virtual cameras can be placed at the most camera position and the corresponding virtual camera. If you set the key frame, the various speeds and tracks are generated so that each virtual camera scene, that is, each keyframe, is automatically generated as a virtual camera movement track of the virtual camera cutaway by animation instead of switching.
  • the blackboards also automatically generate animation time and tracks so that students can focus on the scenes that they need to see slowly when switching scenes. very important.
  • the device of the invention is a 3D object that can display real-time interactive 3D animation objects that provide the ability to perform real-time 3D animation, not just 2D images and PPTs, which are seen as external presentation materials, but to move to a virtual experiment or space. It is a function that can load the data of the data and place them in each scene and show them the actual experiment. It overcomes physical constraints, namely size and weight, and shows 3D objects or animations in real time. Providing is a way of becoming an important virtual / or augmented reality presentation. To do this, 3D editors such as 3D Max and Maya read data of animated objects and place them in a virtual classroom (see FIG. 8).
  • FIG. 8 shows an AR / VR presentation scene showing a 3D object and an animation scene / virtual interactive experiment, and a scene that is effectively shown by showing differently in 12 scenes for each virtual camera.
  • This method of displaying 3D virtual objects will enable new lecture apparatuses that enable the 3D virtual classroom lecture apparatus to make impossible part of lecture recording or lecture apparatus.
  • 132 camera tracks are moved from 12 virtual camera tracks to 11 different virtual camera positions, respectively. If 3 copyboards are used and 1 virtual 3D object is used, the total tracking passes will be 132x 6 total, and 792 paths will be generated automatically.
  • the onset device provides the ability to automatically animate each scene with the location of the virtual carema, the location of the virtual copyboards, and the virtual 3D object.
  • FIG. 5 is a scene of a classroom in which a device of such a method is arranged in a classroom to display a screen output through a projector in a manner in which each virtual camera scene is displayed.
  • FIG. 9 shows a virtual classroom in which the instructor and the lecture material are synthesized in a virtual or augmented reality technology in real time in a device of the present invention, in which the instructor shows the material when the instructor looks large when the teacher looks large.
  • the device of the invention judges the lectures in a cool virtual classroom on the screen. This composite screen is recorded and transmitted in such a way as to show the scene to be shown so that the class can be made like the classroom in the classroom as well as in the remote classroom.
  • a posture recognition function as a function of an artificial intelligence that allows the scene to be automatically changed to the scene and the contents of the virtual electronic board to show the projector or the blackboard with the gesture of the instructor, the attitude of the instructor, the angle of view, and the voice recognition. It shows the scene that is automatically converted to scene by enabling the location recognition to use an image or an external sensor.
  • two virtual copyboards are used to cut out the outer part of the part that the instructor sees by using an ellipse rather than the chroma key method, and gradually process the transparent part of the part of the cut out part.
  • An instructor's input is a combination of an area and a virtual electronic blackboard-graphic frame with a real instructor's camera input. The following shows an example of switching scenes that are variously arranged and displayed in virtual cameras that are arranged freely.
  • a virtual camera scene is output that enlarges the laptop screen shown in the projector, and relatively small instructor's video while composing the background scene with AR concept on the background. This allows the switching of the laptop's screen to be displayed on the virtual copyboard automatically.
  • the tracking camera on the blackboard screen captures that portion. Move the camera and show the screen on the virtual copyboard, using a technique that automatically displays the virtual camera scene.
  • the instructor places the instructor's camera on the table or in the direction of the student in the classroom, or places the instructor camera at the back of the classroom and sees the output screen in this area. If you take a lecture while staring at the output screen, you will be able to make eye contact with the entire class at the same time as the instructor's eyes always look at the students.
  • classroom lessons become virtual eye-catching virtual classroom lessons with maximum immersion.
  • the class that the lecturer makes the lecturer behind the scenes becomes the actual lecture video class, and when the class is recorded, the video can be played after the class or in another classroom class.
  • the lecture screen in the remote classroom is the same as the field class with the instructor.
  • the remote classroom will be a remote classroom that completely solves the problem of technology that is worse than the field class.
  • the screen shows a flipped teaching screen in which a lecturer looks at a lecture scene and a student and a remote classroom behind a lecture room in which a lecturer looks at a virtual classroom screen of the invention.
  • an output screen camera for linking a two-way interactive video conferencing function to the device of the present invention to recognize an output screen camera that sets the composite screen of the device of the present invention as a video conference input so that the output screen acts as an instructor camera during the video conference.
  • Driver mode is provided so that any videoconferencing or direct output from broadcasts like YouTube or Facebook can be performed without additional encoder devices, allowing you to use existing webinar programs like WebEx or ConnectPro, video conferencing programs like Skype and Zoom.
  • the remote lecture meeting and presentation webinar is made in the virtual classroom method of VR / AR technology. Take a look at the synthesized virtual classroom screen This allows you remote classroom, Webinar, presentation broadcast of new virtual technologies. This approach allows the use of existing Tele-Presence video conferencing presentation systems together, enabling the TelePresentation system, or remote presentation, which has not been possible.
  • FIG. 12 shows a device that uses the apparatus of the present invention in conjunction with an existing internet conference, webinar, webconference and telepresence conference system so that an eye-taking lecture at a remote location feels like an instructor comes to the lecture.
  • FIG. 13 shows a scene of a tele presentation system in which a presenter and a presentation data are sent from a conventional TelePresence system and the presenter is synthesized by a device of the invention and sent to a single screen. .
  • the TelePreseence device displays two inputs, the instructor camera and the instructor notebook, respectively, on two remote monitors. Send it to a channel, or laptop input, and the instructor camera lets you show attendees and send them remotely so that both instructors and attendees are shown remotely.
  • the video conference output is made by using the video wall technology to display a plurality of remote screens in various ways. It enables a Tele-Presentation Multi-conference system.
  • FIG. 14 shows an example of using a scene through a multi-screen configuration using a video wall.
  • the remote relay class that uses the device of the present invention to the existing classroom can enable the effective class to be more immersed in the remote classroom than the field. Since the recording is performed by the device method of the AR method, even if the lecture is not well understood, the recording can be viewed again so that the lecture can be recorded as well as the actual classroom.
  • the remote virtual lecture system uses a projector screen in a large existing classroom, and if the instructor is small and the projector screen is large, the instructor does not brighten the room light by the brightness of the screen, and thus the instructor is dark and small, and only the presentation materials on the screen are raised.
  • Large classroom lecture equipment used in the lecture room enables lecturers and lecture materials to be effectively used as a device that can be seen in the large classroom.At the same time, large lecture lectures in the remote classroom where the lectures are sent to the remote classroom and the remote cameras are shown to each other in the classroom. As a device, the problems of the existing lecture room and the large lecture room can be linked to the classroom.
  • FIG. 15 shows a concept of using a lecturer, which is a problem of a large classroom lecture, to make a lecturer and lecture materials appear on a large screen in a dark and small lecture room, and to simultaneously record two-way classes with other large classrooms through recording and real-time transmission.
  • the video presentation system which sees each other for two-way question and answer during the remote class, enables the perfect remote class by interworking with the real-time participant question and answer system that asks questions on the laptop screen such as PowerPoint, receives the answers in real time, and displays them in a table. do.
  • This lecture device is used to make a stereoScopic image using two virtual cameras in a virtual classroom and to make a stereo lecture device that sees a stereoscopic 3D screen in each classroom, and in particular, to send a virtual classroom scene to a 360 screen through a 360-screen HMD. Students will be able to control the view from side to side or back and forth on their favorite VR screen.
  • the 3D data of the virtual classroom of the device of the present invention is downloaded in order to improve the quality of the actual 360 screen, and the lecture data and the instructor camera video are transmitted to the student HMD device for real-time rendering. It is possible to maximize the immersion by implementing the HMD linkage method with.
  • This type of lecture is a simultaneous eye-to-learn device that enables simultaneous eye contact with all students in the classroom, the Internet, and remote classrooms, and the output screen becomes a beautiful teacher lecture in a virtual classroom. Even if you do not judge the lecture materials with the lecturer, you can see the necessary scenes by looking at the projector screen, which becomes a state-of-the-art classroom that makes the existing classroom classes more immersive, and the lectures on the VR / AR composite screen are recorded in real time.
  • the instructor combines the chroma key processing of the instructor camera, the external input camera, and the student tracking cameras that capture the student's position according to the instructor's position and the instructor's position and the camera's position.
  • the teacher looks at the students and explains them, the teacher enlarges them.
  • the material screen is synthesized together.
  • frames are added to the instructor's camera output by cropping the edges of the cropped edges and providing them with transparency and color change functions to combine the screen with the background.
  • Fig. 17 shows the composition of the VR classroom, AR classroom scene and AR classroom by combining the background with the method of composing transparency and frame transparent parts on the elliptical crop (cut) and the edge (around the crop) of the instructor camera. A scene showing an AR studio is shown.
  • FIG. 18 illustrates an AR studio technique in which a peripheral frame (elliptical shape) of an instructor camera image and an elliptical frame at a cut edge of the instructor are smoothly combined with a background virtual classroom through transparency processing. After cutting the ellipse around the instructor's camera, add an edge frame at the edge and adjust the transparency and color of the part to make it look natural with the background.
  • a peripheral frame elliptical shape
  • FIG. 19 shows a function of recording a lecture while viewing a slide note such as a PPT with a prompt screen and subtitle scrolling. Specifically, when the instructor turns over the PPT slide, the slide notes automatically appear as subtitles and prompter screens, and the lectures are read with the subtitles as the subtitles (these screens are displayed on the output screen. Function included).
  • FIG. 20 shows an example of a DIY e-learning mobile prefabricated studio
  • FIG. 21 shows a lecture relay / recording / VR / AR switcher environment using the mobile prefabricated studio-a laptop mobile system and an all in one mobile server configuration diagram
  • FIG. 22 shows a virtual output screen capture driver that uses a plurality of applications such as video conferencing, youtube, and facebook at the same time so that the lecture composition screen of the invention can be used without additional devices for broadcasting a video conferencing program or YouTube.
  • the technique is shown as an example.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Tourism & Hospitality (AREA)
  • Human Resources & Organizations (AREA)
  • Strategic Management (AREA)
  • Architecture (AREA)
  • Biomedical Technology (AREA)
  • Primary Health Care (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Marketing (AREA)
  • Economics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • General Business, Economics & Management (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

Par comparaison avec un appareil de cours selon l'état de la technique, la présente invention fournit une caractéristique, dans laquelle une opération d'un appareil, c'est-à-dire une transition de scène, est automatique et basée sur une fonction d'intelligence artificielle (IA) de façon à permettre à un professeur de se concentrer sur un cours, et une caractéristique d'un programme de traitement des bords basé sur la composition de réalité augmentée sans effectuer d'incrustation de couleur dans un environnement de studio limité à réaliser une technique d'incrustation de couleur, ce qui permet d'obtenir un appareil de cours basé sur un procédé de salle de cours à réalité augmentée. En conséquence, une scène permettant de donner un cours plus immersif par comparaison avec le procédé de cours existant peut être créée dans n'importe quelle salle de classe ou emplacement de cours de telle sorte qu'une technique peut être fournie pour mettre en œuvre parfaitement un appareil de cours en temps réel, un appareil d'enregistrement de cours en temps réel, un cours à distance en temps réel et un appareil de conférence de présentation de cours qui permettent à un cours d'être donné dans un emplacement de cours, sur la base du procédé de la présente invention.
PCT/KR2019/009449 2018-08-28 2019-07-29 Procédé pour donner des cours à distance de manière intelligente à l'aide d'une technologie de transition de scène automatique ayant une fonction d'intelligence artificielle dans une salle de cours virtuelle et à réalité augmentée WO2020045837A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2018-0101119 2018-08-28
KR1020180101119A KR20200024441A (ko) 2018-08-28 2018-08-28 가상 및 증강 현실 강의실에서 인공지능 기능의 자동 장면 전환 기술을 이용한 스마트-원격 강의 방법 및 그 장치

Publications (1)

Publication Number Publication Date
WO2020045837A1 true WO2020045837A1 (fr) 2020-03-05

Family

ID=69642986

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2019/009449 WO2020045837A1 (fr) 2018-08-28 2019-07-29 Procédé pour donner des cours à distance de manière intelligente à l'aide d'une technologie de transition de scène automatique ayant une fonction d'intelligence artificielle dans une salle de cours virtuelle et à réalité augmentée

Country Status (2)

Country Link
KR (1) KR20200024441A (fr)
WO (1) WO2020045837A1 (fr)

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111401244A (zh) * 2020-03-16 2020-07-10 安博思华智能科技有限责任公司 自适应控制多媒体黑板的方法、装置、介质和电子设备
CN111860365A (zh) * 2020-07-24 2020-10-30 中国平安人寿保险股份有限公司 课室灯光调节方法、装置、计算机设备及存储介质
CN112053085A (zh) * 2020-09-16 2020-12-08 四川大学 一种基于数字孪生的机场场面运行管理系统及方法
CN112081422A (zh) * 2020-09-21 2020-12-15 彭程 智慧教室系统
CN112634467A (zh) * 2021-01-05 2021-04-09 东方电气集团科学技术研究院有限公司 装备制造装配过程中的ar指导方法
CN112732075A (zh) * 2020-12-30 2021-04-30 佛山科学技术学院 一种面向教学实验的虚实融合机器教师教学方法及系统
CN112802372A (zh) * 2021-01-11 2021-05-14 中国人民解放军联勤保障部队第九〇〇医院 一种vr手术示教投影设备
CN112908048A (zh) * 2021-01-22 2021-06-04 唐山职业技术学院 基于人工智能的旅游管理教学装置
CN112969022A (zh) * 2021-01-29 2021-06-15 新东方教育科技集团有限公司 摄像头调整方法、系统、存储介质及电子设备
CN113286162A (zh) * 2021-05-20 2021-08-20 成都威爱新经济技术研究院有限公司 一种基于混合现实的多机位画面直播方法及系统
CN113784077A (zh) * 2021-09-24 2021-12-10 联想(北京)有限公司 一种信息处理方法、装置和电子设备
CN113965793A (zh) * 2021-10-12 2022-01-21 上海赛连信息科技有限公司 一种智能录制布局切换的方法和装置
CN114173021A (zh) * 2022-02-14 2022-03-11 中国传媒大学 基于高清多屏的虚拟演播方法、系统
CN114697755A (zh) * 2022-03-31 2022-07-01 北京百度网讯科技有限公司 虚拟场景信息交互方法、装置、设备以及存储介质
CN114786032A (zh) * 2022-06-17 2022-07-22 深圳市必提教育科技有限公司 一种培训视频管理方法及系统
CN114898409A (zh) * 2022-07-14 2022-08-12 深圳市海清视讯科技有限公司 数据处理方法和设备
CN115086548A (zh) * 2022-04-13 2022-09-20 中国人民解放军火箭军工程大学 一种双光谱虚拟摄像头合成方法及装置
CN115379278A (zh) * 2022-03-31 2022-11-22 深圳职业技术学院 一种基于xr技术沉浸式微课的录制方法及系统
US20230130528A1 (en) * 2021-10-27 2023-04-27 Wiseup Co., Ltd. Ai studio systems for online lectures and a method for controlling them
CN116469292A (zh) * 2023-06-20 2023-07-21 长沙图灵教育科技有限公司 一种电商仿真教学管理系统及教学培训方法
CN117055724A (zh) * 2023-05-08 2023-11-14 华中师范大学 虚拟教学场景中生成式教学资源系统及其工作方法
WO2024019608A3 (fr) * 2022-07-21 2024-05-02 Doukkali Abdelali Cartable digital

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102382021B1 (ko) * 2020-06-09 2022-04-01 주식회사 스마트아이디어 화상강의시스템
KR102229715B1 (ko) * 2020-07-06 2021-03-18 김상현 개인 방송 시스템
KR102672930B1 (ko) * 2020-10-07 2024-06-05 동서대학교 산학협력단 온-오프라인 공간 복합연동형 인공지능 기반 온택트 실감형 건축공학 구조역학 3d/4d 교육플랫폼 시스템
KR102580354B1 (ko) 2020-11-17 2023-09-20 하대석 비디오북 서비스 제공 장치
KR102571677B1 (ko) * 2020-12-08 2023-08-28 (주)와이즈업 온라인 강의를 위한 ai 스튜디오
KR102359253B1 (ko) * 2021-02-10 2022-02-28 (주)에듀슨 360도 xr 디지털 영상을 이용한 비대면 영어 교육 컨텐츠 제공 방법
KR102387355B1 (ko) * 2021-05-21 2022-04-18 주식회사 버드핸드 증강현실 기반 공연 컨텐츠 제공 방법 및 장치
KR102398897B1 (ko) 2021-08-24 2022-05-17 주식회사 소풍앤컴퍼니 가상현실(vr)과 레고를 이용한 에듀테크 교육컨텐츠 지원 시스템 및 그 구동방법
KR20230127464A (ko) 2022-02-25 2023-09-01 하대석 영상 서비스 제공 장치
KR102619761B1 (ko) * 2022-04-27 2024-01-03 (주)다림시스템 텔레프리젠테이션 화상 회의 시스템을 위한 서버
KR102517090B1 (ko) * 2022-12-22 2023-04-03 (주) 아하 Ptz 카메라를 이용한 발표자 자동 인식 추적 방법 및 장치

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020196327A1 (en) * 2001-06-14 2002-12-26 Yong Rui Automated video production system and method using expert video production rules for online publishing of lectures
JP2012089092A (ja) * 2010-10-22 2012-05-10 Nippon Telegr & Teleph Corp <Ntt> 携帯端末会議システム及び方法
KR20120092921A (ko) * 2011-02-14 2012-08-22 김영대 가상 강의실 강의 방법 및 장치
KR20150055862A (ko) * 2013-11-14 2015-05-22 주식회사 다림비젼 가상공간 강의 영상 서비스 및 가상 스튜디오 영상 컨텐츠 제공방법 및 시스템
KR20170029725A (ko) * 2015-09-07 2017-03-16 주식회사 다림비젼 영상 합성을 이용한 강의 영상 생성 방법 및 그 장치

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100839953B1 (ko) 2006-11-15 2008-06-20 삼성전자주식회사 비디오 월 디스플레이시스템 및 그 제어방법
KR101037797B1 (ko) 2009-04-03 2011-05-27 주식회사 다림비젼 복수의 입력 비디오(디지털,아날로그,ｉｐ 압축 비디오)들을 가상 그래픽 3차원 비디오 월의 가상모니터에 비디오 택스쳐링의 방식을 이용하여 표현하고 이를 가상 3차원 그래픽 공간에 배치한 가상카메라를 통해 실시간 3차원 렌더링을 통해 실시간으로 모니터에 보여 주는 매트릭스 및 스위처/믹서 기능을 갖는 3차원 공간속의 비디오 월을 보여 주는 멀티뷰 시스템

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020196327A1 (en) * 2001-06-14 2002-12-26 Yong Rui Automated video production system and method using expert video production rules for online publishing of lectures
JP2012089092A (ja) * 2010-10-22 2012-05-10 Nippon Telegr & Teleph Corp <Ntt> 携帯端末会議システム及び方法
KR20120092921A (ko) * 2011-02-14 2012-08-22 김영대 가상 강의실 강의 방법 및 장치
KR20150055862A (ko) * 2013-11-14 2015-05-22 주식회사 다림비젼 가상공간 강의 영상 서비스 및 가상 스튜디오 영상 컨텐츠 제공방법 및 시스템
KR20170029725A (ko) * 2015-09-07 2017-03-16 주식회사 다림비젼 영상 합성을 이용한 강의 영상 생성 방법 및 그 장치

Cited By (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111401244A (zh) * 2020-03-16 2020-07-10 安博思华智能科技有限责任公司 自适应控制多媒体黑板的方法、装置、介质和电子设备
CN111401244B (zh) * 2020-03-16 2023-06-02 安博思华智能科技有限责任公司 自适应控制多媒体黑板的方法、装置、介质和电子设备
CN111860365A (zh) * 2020-07-24 2020-10-30 中国平安人寿保险股份有限公司 课室灯光调节方法、装置、计算机设备及存储介质
CN111860365B (zh) * 2020-07-24 2024-02-06 中国平安人寿保险股份有限公司 课室灯光调节方法、装置、计算机设备及存储介质
CN112053085B (zh) * 2020-09-16 2023-04-07 四川大学 一种基于数字孪生的机场场面运行管理系统及方法
CN112053085A (zh) * 2020-09-16 2020-12-08 四川大学 一种基于数字孪生的机场场面运行管理系统及方法
CN112081422A (zh) * 2020-09-21 2020-12-15 彭程 智慧教室系统
CN112732075A (zh) * 2020-12-30 2021-04-30 佛山科学技术学院 一种面向教学实验的虚实融合机器教师教学方法及系统
CN112732075B (zh) * 2020-12-30 2023-06-02 佛山科学技术学院 一种面向教学实验的虚实融合机器教师教学方法及系统
CN112634467A (zh) * 2021-01-05 2021-04-09 东方电气集团科学技术研究院有限公司 装备制造装配过程中的ar指导方法
CN112802372A (zh) * 2021-01-11 2021-05-14 中国人民解放军联勤保障部队第九〇〇医院 一种vr手术示教投影设备
CN112908048A (zh) * 2021-01-22 2021-06-04 唐山职业技术学院 基于人工智能的旅游管理教学装置
CN112969022A (zh) * 2021-01-29 2021-06-15 新东方教育科技集团有限公司 摄像头调整方法、系统、存储介质及电子设备
CN112969022B (zh) * 2021-01-29 2023-09-01 新东方教育科技集团有限公司 摄像头调整方法、系统、存储介质及电子设备
CN113286162A (zh) * 2021-05-20 2021-08-20 成都威爱新经济技术研究院有限公司 一种基于混合现实的多机位画面直播方法及系统
CN113784077B (zh) * 2021-09-24 2023-03-21 联想(北京)有限公司 一种信息处理方法、装置和电子设备
CN113784077A (zh) * 2021-09-24 2021-12-10 联想(北京)有限公司 一种信息处理方法、装置和电子设备
CN113965793A (zh) * 2021-10-12 2022-01-21 上海赛连信息科技有限公司 一种智能录制布局切换的方法和装置
US20230130528A1 (en) * 2021-10-27 2023-04-27 Wiseup Co., Ltd. Ai studio systems for online lectures and a method for controlling them
CN114173021A (zh) * 2022-02-14 2022-03-11 中国传媒大学 基于高清多屏的虚拟演播方法、系统
CN114173021B (zh) * 2022-02-14 2022-06-24 中国传媒大学 基于高清多屏的虚拟演播方法、系统
CN115379278B (zh) * 2022-03-31 2023-09-05 深圳职业技术学院 基于扩展现实（xr）技术沉浸式微课的录制方法及系统
CN115379278A (zh) * 2022-03-31 2022-11-22 深圳职业技术学院 一种基于xr技术沉浸式微课的录制方法及系统
CN114697755A (zh) * 2022-03-31 2022-07-01 北京百度网讯科技有限公司 虚拟场景信息交互方法、装置、设备以及存储介质
CN115086548A (zh) * 2022-04-13 2022-09-20 中国人民解放军火箭军工程大学 一种双光谱虚拟摄像头合成方法及装置
CN114786032A (zh) * 2022-06-17 2022-07-22 深圳市必提教育科技有限公司 一种培训视频管理方法及系统
CN114786032B (zh) * 2022-06-17 2022-08-23 深圳市必提教育科技有限公司 一种培训视频管理方法及系统
CN114898409B (zh) * 2022-07-14 2022-09-30 深圳市海清视讯科技有限公司 数据处理方法和设备
CN114898409A (zh) * 2022-07-14 2022-08-12 深圳市海清视讯科技有限公司 数据处理方法和设备
WO2024019608A3 (fr) * 2022-07-21 2024-05-02 Doukkali Abdelali Cartable digital
CN117055724A (zh) * 2023-05-08 2023-11-14 华中师范大学 虚拟教学场景中生成式教学资源系统及其工作方法
CN117055724B (zh) * 2023-05-08 2024-05-28 华中师范大学 虚拟教学场景中生成式教学资源系统的工作方法
CN116469292A (zh) * 2023-06-20 2023-07-21 长沙图灵教育科技有限公司 一种电商仿真教学管理系统及教学培训方法
CN116469292B (zh) * 2023-06-20 2023-08-25 长沙图灵教育科技有限公司 一种电商仿真教学管理系统及教学培训方法

Also Published As

Publication number Publication date
KR20200024441A (ko) 2020-03-09

Similar Documents

Publication Publication Date Title
WO2020045837A1 (fr) Procédé pour donner des cours à distance de manière intelligente à l&#39;aide d&#39;une technologie de transition de scène automatique ayant une fonction d&#39;intelligence artificielle dans une salle de cours virtuelle et à réalité augmentée
KR101270780B1 (ko) 가상 강의실 강의 방법 및 장치
KR101367260B1 (ko) 강의자가 강의 중에 강의 화면을 구성할 수 있는 가상 강의실 강의 장치
KR20170029725A (ko) 영상 합성을 이용한 강의 영상 생성 방법 및 그 장치
KR101351085B1 (ko) 실물화상기
US8831505B1 (en) Method and apparatus for effectively capturing and broadcasting a traditionally delivered classroom or a presentation
US8300078B2 (en) Computer-processor based interface for telepresence system, method and computer program product
US20110123972A1 (en) System for automatic production of lectures and presentations for live or on-demand publishing and sharing
Zettl Television production handbook
CN110349456B (zh) 互动课堂的智能控制系统、远程控制终端及教室终端
US20070122786A1 (en) Video karaoke system
US11799677B2 (en) Annotation layer permissions
US20230328200A1 (en) Compositing Content From Multiple Users Of A Conference
CN101827207A (zh) 一种主持人可视化的三维虚拟演播室互动控制的系统
KR20180052494A (ko) 대형 강의실 컨퍼런스 시스템
Agamanolis et al. Reflection of Presence: Toward more natural and responsive telecollaboration
KR102470050B1 (ko) 프로젝터를 활용한 동영상 촬영을 위한 장치 및 방법
Fukaya et al. An effective interaction tool for performance in the virtual studio-invisible light projection system
KR101776839B1 (ko) 휴대용 강의저장 및 방송 시스템
Chagas et al. Exploring Practices and Systems for Remote Teaching
Muench An Evening at the Ballroom: Whatever Happened to Televanilla?
KR102619761B1 (ko) 텔레프리젠테이션 화상 회의 시스템을 위한 서버
BE1029675B1 (nl) Systeem voor het verrijken van een online meeting
JP4565855B2 (ja) 放送番組制作装置
CN109862311B (zh) 视频内容的实时制作方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19853778

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19853778

Country of ref document: EP

Kind code of ref document: A1