KR102620284B1 - System for providing metaverse based education platform service - Google Patents

Abstract

A metaverse-based education platform service provision system is provided, and a user terminal connects to the metaverse-based education platform after selecting an avatar, an instructor terminal connected to the user terminal and connected to the metaverse-based education platform, and a metaverse-based education platform. A construction unit that builds, a connection unit that provides multiple access-based connection when selecting an avatar on the user terminal and instructor terminal and accessing the metaverse-based education platform, a sharing management unit that provides a sharing option for screen or cam video, The store department, which maps and sets up an online store to at least one object within the metaverse-based education platform, displays emojis on the avatar of the user terminal or instructor terminal, or sets the emotion to be expressed as a gesture of the avatar. It includes a platform service providing server that includes an emotion expression unit, a video management unit that supports multiple video chats between user terminals and instructor terminals, and a chat support unit that supports public and secret chats between user terminals and instructor terminals.

Description

Metaverse-based education platform service provision system {SYSTEM FOR PROVIDING METAVERSE BASED EDUCATION PLATFORM SERVICE}

The present invention relates to a metaverse-based education platform service provision system, and provides a platform that can provide telepresence, a feeling of immersion similar to taking an offline class.

Various types of educational methods are being attempted, such as online classes using video platforms, video education, and blended learning that can be implemented in a non-face-to-face situation between instructors and students through digital technology. Metaverse is effective in eliciting learners’ proactive and active participation in communication. In the metaverse, one participates in the interaction process through an entity called an avatar. The avatar can move freely within the metaverse space and communicate on an equal footing with various fellow avatars. In other words, rather than the instructor taking the lead in delivering educational content or leading activities as in the traditional class method, the instructor also participates in the communication scene as an avatar and dynamic interaction is possible. Therefore, learners can actively lead their learning within the metaverse, which can be accessed at all times without limitations of time and space. Metaverse is a technology that can provide telepresence, a feeling of immersion that can be felt offline, and has the advantage of providing a realistic context for classes.

At this time, a method of providing a metaverse-based learning management system (LMS) or creating a virtual lecture space and avatar was researched and developed. In this regard, Korean Patent No. 10-2382385 (April 8, 2022), which is a prior art, was researched and developed. In Japan and Korea Patent No. 10-2368616 (announced on March 2, 2022), online classes are opened in a metaverse-based virtual classroom, learning content is provided on a screen, and attendance is recorded through a learning management system. In order to perform confirmation, connection confirmation, and class performance management, and to create a virtual lecture space in the metaverse, a lecture space is created based on the profile information of the learner who applied for the lecture, and instructor and student avatars are created to teach the lecture. Each configuration for outputting data to space is disclosed.

However, in the former case, it is nothing more than building a learning management system using virtual reality, and in the latter case, it has no meaning beyond entering an avatar object into the virtual content called Metaverse. In order to teach within the metaverse space, a map corresponding to a space similar to an educational institution such as a school must be prepared, and an interface such as writing, document sharing, and writing functions similar to those used in classes at school must be provided. It must be provided with features such as screen sharing and cam sharing between instructors and users, as well as support for multiple connections to minimize delays and provide options for expressing emotions as well as appearance, such as providing customized avatars. do. Accordingly, research and development of a metaverse-based educational platform that can provide a sense of immersion that can be felt offline is required.

One embodiment of the present invention overcomes space-time limitations based on the metaverse, maintains a stable network by supporting multiple access, provides cloud and various types of sharing functions for real-time collaboration, and provides education such as schools. In order to support maps that correspond to spaces similar to institutions, we provide various types of maps such as counseling rooms, study rooms, group classrooms, and science rooms in addition to classrooms, as well as annotation functions and document sharing functions similar to those used in classes at school. It supports interfaces such as handwriting functions, provides options to express emotions as well as appearance by providing customized avatars, supports an online store so that books and writing supplies needed for class can be purchased, and provides classroom We can provide a metaverse-based educational platform service provision system that provides learning effects through play by arranging my minigames as edugames. However, the technical challenge that this embodiment aims to achieve is not limited to the technical challenges described above, and other technical challenges may exist.

As a technical means for achieving the above-described technical problem, one embodiment of the present invention includes a user terminal that selects an avatar and connects to the metaverse-based education platform, and an instructor connected to the user terminal and connected to the metaverse-based education platform. Construction unit that builds terminal and metaverse-based education platform, connection unit that provides multiple access-based connection when selecting an avatar on the user terminal and instructor terminal and accessing the metaverse-based education platform, screen or cam video A sharing management section that provides sharing options, a store section that maps and sets the online store to at least one object within the metaverse-based education platform, and an emoji or emotion on the avatar of the user terminal or instructor terminal. A platform service providing server that includes an emotional expression unit that is set to express with avatar gestures, an image management unit that supports multiple video chats between user terminals and instructor terminals, and a chat support unit that supports public and secret chats between user terminals and instructor terminals. Includes.

According to one of the above-described means of solving the problems of the present invention, it overcomes space-time limitations based on the metaverse, maintains a stable network by supporting multiple access, and provides a cloud or various types of sharing functions for real-time collaboration. In order to support maps corresponding to spaces similar to educational institutions such as schools, we provide various types of maps such as counseling rooms, study rooms, group classrooms, and science rooms in addition to classrooms, and provide maps similar to those taught in schools. It supports interfaces such as functions, document sharing functions, and writing functions, and provides options to express emotions as well as external appearance by providing customized avatars. It supports an online store to sell books and writing supplies needed for class. Make it available for purchase, and arrange mini games in the classroom as edu games to provide learning effects through play.

Figure 1 is a diagram for explaining a metaverse-based education platform service provision system according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating a platform service providing server included in the system of FIG. 1.
Figures 3 and 4 are diagrams for explaining an embodiment in which a metaverse-based education platform service is implemented according to an embodiment of the present invention.
Figure 5 is an operation flowchart illustrating a method of providing a metaverse-based education platform service according to an embodiment of the present invention.

Below, with reference to the attached drawings, embodiments of the present invention will be described in detail so that those skilled in the art can easily implement the present invention. However, the present invention may be implemented in many different forms and is not limited to the embodiments described herein. In order to clearly explain the present invention in the drawings, parts that are not related to the description are omitted, and similar parts are given similar reference numerals throughout the specification.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected," but also the case where it is "electrically connected" with another element in between. . In addition, when a part is said to "include" a certain component, this does not mean excluding other components unless specifically stated to the contrary, but may further include other components, and one or more other features. It should be understood that it does not exclude in advance the presence or addition of numbers, steps, operations, components, parts, or combinations thereof.

The terms "about", "substantially", etc. used throughout the specification are used to mean at or close to that value when manufacturing and material tolerances inherent in the stated meaning are presented, and are used to enhance the understanding of the present invention. Precise or absolute figures are used to assist in preventing unscrupulous infringers from taking unfair advantage of stated disclosures. The term “step of” or “step of” as used throughout the specification of the present invention does not mean “step for.”

In this specification, 'part' includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Additionally, one unit may be realized using two or more pieces of hardware, and two or more units may be realized using one piece of hardware. Meanwhile, '~ part' is not limited to software or hardware, and '~ part' may be configured to reside in an addressable storage medium or may be configured to reproduce one or more processors. Therefore, as an example, '~ part' refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, and procedures. , subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functions provided within the components and 'parts' may be combined into a smaller number of components and 'parts' or may be further separated into additional components and 'parts'. Additionally, components and 'parts' may be implemented to regenerate one or more CPUs within a device or a secure multimedia card.

In this specification, some of the operations or functions described as being performed by a terminal, apparatus, or device may instead be performed on a server connected to the terminal, apparatus, or device. Likewise, some of the operations or functions described as being performed by the server may also be performed in a terminal, apparatus, or device connected to the server.

In this specification, some of the operations or functions described as mapping or matching with the terminal mean mapping or matching the terminal's unique number or personal identification information, which is identifying data of the terminal. It can be interpreted as

Hereinafter, the present invention will be described in detail with reference to the attached drawings.

Figure 1 is a diagram for explaining a metaverse-based education platform service provision system according to an embodiment of the present invention. Referring to FIG. 1, the metaverse-based education platform service providing system 1 may include at least one user terminal 100, a platform service providing server 300, and at least one instructor terminal 400. However, since the metaverse-based education platform service providing system 1 of FIG. 1 is only an embodiment of the present invention, the present invention is not limited to the interpretation of FIG. 1.

At this time, each component of FIG. 1 is generally connected through a network (Network, 200). For example, as shown in FIG. 1, at least one user terminal 100 may be connected to the platform service providing server 300 through the network 200. In addition, the platform service providing server 300 may be connected to at least one user terminal 100 and at least one instructor terminal 400 through the network 200. Additionally, at least one instructor terminal 400 may be connected to the platform service providing server 300 through the network 200.

Here, the network refers to a connection structure that allows information exchange between each node, such as a plurality of terminals and servers. Examples of such networks include a local area network (LAN) and a wide area network (WAN). Wide Area Network, Internet (WWW: World Wide Web), wired and wireless data communication network, telephone network, wired and wireless television communication network, etc. Examples of wireless data communication networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), 5th Generation Partnership Project (5GPP), Long Term Evolution (LTE), World Interoperability for Microwave Access (WIMAX), and Wi-Fi. , Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), RF (Radio Frequency), Bluetooth network, NFC ( It includes, but is not limited to, Near-Field Communication (Near-Field Communication) network, satellite broadcasting network, analog broadcasting network, and DMB (Digital Multimedia Broadcasting) network.

In the following, the term at least one is defined as a term including singular and plural, and even if the term at least one does not exist, each component may exist in singular or plural, and may mean singular or plural. This should be self-explanatory. In addition, whether each component is provided in singular or plural form may be changed depending on the embodiment.

At least one user terminal 100 may be a student terminal that selects an avatar and accesses the metaverse-based education platform using a web page, app page, program, or application related to the metaverse-based education platform service.

Here, at least one user terminal 100 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, a laptop equipped with a navigation system and a web browser, a desktop, a laptop, etc. At this time, at least one user terminal 100 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one user terminal 100 is, for example, a wireless communication device that guarantees portability and mobility, and includes navigation, personal communication system (PCS), global system for mobile communications (GSM), personal digital cellular (PDC), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) ) It may include all types of handheld-based wireless communication devices such as terminals, smartphones, smartpads, and tablet PCs.

The platform service providing server 300 may be a server that provides a metaverse-based education platform service web page, app page, program, or application. And, the platform service providing server 300 builds a metaverse-based education platform and, when setting avatars on the user terminal 100 and the instructor terminal 400, grants preset permissions to the user and instructor, and grants the permissions to the user and the instructor. Depending on this, it may be a server that sets each option to use.

Here, the platform service providing server 300 may be implemented as a computer that can connect to a remote server or terminal through a network. Here, the computer may include, for example, a laptop equipped with a navigation system and a web browser, a desktop, a laptop, etc.

At least one instructor terminal 400 may be an instructor terminal that uses a web page, app page, program, or application related to the metaverse-based education platform service.

Here, at least one instructor terminal 400 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, a laptop equipped with a navigation system and a web browser, a desktop, a laptop, etc. At this time, at least one instructor terminal 400 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one instructor terminal 400 is, for example, a wireless communication device that ensures portability and mobility, and includes navigation, Personal Communication System (PCS), Global System for Mobile communications (GSM), Personal Digital Cellular (PDC), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) ) It may include all types of handheld-based wireless communication devices such as terminals, smartphones, smartpads, and tablet PCs.

Figure 2 is a block diagram for explaining the platform service providing server included in the system of Figure 1, and Figures 3 and 4 show an embodiment in which a metaverse-based education platform service is implemented according to an embodiment of the present invention. This is a drawing for explanation.

Referring to FIG. 2, the platform service providing server 300 includes a construction unit 310, a connection unit 320, a sharing management unit 330, a store unit 340, an emotional expression unit 350, and an image management unit 360. , chat support unit (370), movement control unit (380), mini game unit (390), space provision unit (391), written note unit (392), voice group activity support unit (393), custom character unit (394), tools It may include a support unit 395 and a 3D provision unit 396.

The platform service providing server 300 or another server (not shown) operating in conjunction with an embodiment of the present invention provides a metaverse-based education platform with at least one user terminal 100 and at least one instructor terminal 400. When transmitting a service application, program, app page, web page, etc., at least one user terminal 100 and at least one instructor terminal 400 transmit the metaverse-based education platform service application, program, app page, web page, etc. etc. can be installed or opened. Additionally, a service program may be run on at least one user terminal 100 and at least one instructor terminal 400 using a script executed in a web browser. Here, a web browser is a program that allows the use of web (WWW: World Wide Web) services and refers to a program that receives and displays hypertext written in HTML (Hyper Text Mark-up Language), for example, Netscape. , Explorer, Chrome, etc. Additionally, an application refers to an application on a terminal and includes, for example, an app running on a mobile terminal (smartphone).

Referring to FIG. 2, the construction unit 310 may build a metaverse-based education platform. At this time, the most credible attribute definitions for MetaVerse are the ASFMetaverse Roadmap and Matthew Ball presented by the Acceleration Studies Foundation (ASF), an American non-profit research organization. By definition, these are the 7 core properties of the metaverse. Metuball created The Ball Metaverse Index, also known as the Metaverse Benchmark Score, and presented the essential and core properties that the Metaverse should have through the 7 properties of the Metaverse. The seven properties of the metaverse defined by Matthew Ball are ① persistence, ② real-time, ③ unlimited, ④ economic efficiency, ⑤ transcendence, ⑥ interoperability, and ⑦ content. ① Continuity is the concept that the service must be provided indefinitely without reset or termination and must exist regardless of whether the user connects or not, and ② Real-time means that it must be processed in real time, just like in real life. ③ Unlimited refers to the concept that anyone can participate, and each individual has a presence, while there should be no restrictions on simultaneous participation. ④ Economic efficiency refers to the concept that individuals, organizations, and companies participating in the metaverse create value recognized by others. The concept is that you should be able to own, invest, sell, and receive compensation. ⑤ Transcendence refers to the concept of connecting the real world and online space, providing an experience that can encompass the digital and physical worlds and platforms. ⑥ Interoperability means supporting exchange between metaverse platforms, and ⑦ Content must be filled with content and experiences through the activities of various users such as individuals, organizations, and companies.

At this time, an embodiment of the present invention provides a multiple access environment to satisfy ② real-time and ③ unlimitedness. To this end, edge computing is used to distribute the load and provide a multiple access environment to minimize delay. While doing so, it can satisfy real-time and unlimited nature. At this time, streaming-based interactive content such as games have different key performance indicators from video streaming services. Streaming of multimedia content such as video uses network bandwidth as a key indicator, while for interactive content, not only network bandwidth but also response time to user input is a very important performance indicator. Game users want the results of their inputs or actions, such as keystrokes or IMU (Inertial Measurement Unit) results, to be immediately displayed on the screen, but the input response time includes the time to exchange data with the cloud server, that is, network delay. It takes up the largest part.

Edge computing is a concept in which computing entities located at the edge of the network share some of the operations performed by the cloud server, and is expanding its technological influence by solving the delay time problem, which was a drawback of the cloud communication model. Cloud VR's latency issue can also be addressed to some extent if it is based on edge computing. However, edge computing environments have inherent limitations, such as being composed of relatively insufficient and distributed computing resources compared to data centers. Therefore, in order to support metaverse services that require high-level computing and networking workloads in an edge computing network, content characteristics and various resources within the edge domain must be comprehensively considered. Accordingly, in one embodiment of the present invention, an edge network for metaverse content can be configured. From a network perspective, various considerations for metaverse content based on multiple users and configuration algorithms can be used to reduce network congestion while maintaining the average network distance from increasing when deploying edge servers.

<Edge server placement>

For example, if a set of N clients and M edge servers is called a VCN (Virtual Content Network), the location of the clients in the network is fixed, so the delay time of the VCN can be reduced by specifying the operation location of the edge servers of each VCN. In addition, it can achieve traffic load reduction and computing resource balance in the entire network. A two-step algorithm can be used to place a VCN's edge server on an appropriate edge node. In the first step, candidate edge server placement sites are identified for each VCN. Candidates for deployment can be any node in the network, and candidates for deployment are sorted based on the expected network cost when deployed to a specific node. In the second step, edge servers of all VCNs in the network are virtually placed on the highest candidate nodes. At this time, if the available computing resources of a specific node cannot meet the sum of the resource requirements of all edge servers that will enter that node, some of the VCN's edge servers are relocated to other nodes. Here, computing resources can be abstracted into workload units to facilitate summation and comparison. In this way, all VCN's edge servers can be placed within the network while taking network and computing load into consideration together.

For example, in order to create a list of candidate nodes for deploying an edge server of a random VCN, the expected traffic load for each candidate is obtained using the client set C constituting the VCN and τapp, the traffic factor for each link of the VCN application. The traffic factor for each link refers to the traffic load required for each link on the network path between the edge server and the client. For each node n in the set of all nodes N in the network, the expected traffic load t of candidate node n is obtained as the product of the traffic factor and the sum of the shortest path between that node and each client. In other words, the traffic load expected to occur when the VCN's edge server is placed on node n is t. The candidate nodes obtained in this way are sorted in ascending order based on the expected traffic load to form the VCN candidate list. In the same way, each candidate list is created for every VCN in the network.

Additionally, in order to select VCN candidates considering computing resources, it would be best to place edge servers on the best candidate nodes of all VCNs, but it may not be possible to place all edge servers on a specific node due to insufficient computing resources. It may be possible. P represents the candidate node selection situation for each VCN and is called the deployment plan. Initially, all VCNs are initialized with the best candidate nodes selected. The variables considered may then be the number of types of computing resources under consideration, the ith computing resource of node n, and the sum of the ith computing resource requirements of all edge servers that selected node n as a candidate in plan P. If there are no nodes with excess resources, the algorithm is terminated, plan P is confirmed, and the VCN edge server can actually be deployed to the corresponding candidate node. However, if there is a node with excess resources, some of the edge servers scheduled to be deployed on that node must be replaced.

The replacement node selection method can use W-VBP (Weighted Vector Bin Packing). The VBP-based replacement technique is a method of replacing the server with the largest difference between the node's resource composition ratio and the edge server's resource composition ratio. Because it is vector-based, there is no limit to the number of resources, and it minimizes the side effect of not being able to use other types of resources even if only some resources are depleted. If all candidates for a VCN to be replaced are depleted, the algorithm is considered to have ultimately failed. Therefore, the ratio of remaining candidates for each VCN can be considered as a weight to prevent a situation where only candidates for a specific VCN are continuously depleted. The edge server with the largest result of multiplying the vector angle and weight, which is the result of VBP, is subject to replacement.

The VCN whose edge server is subject to replacement removes the currently selected candidate node from P and selects the next candidate node from its candidate list. Then, the presence of excess nodes is checked again based on the current state of P. Algorithm failure may occur when the computing resource requirements of metaverse contents within the network approach or exceed the total available resources. This situation can involve adding hardware or applying measures to reduce the level of offloading of content to edge computing. Of course, in addition to the above-mentioned methods, it is of course possible to use various methods to distribute the load when networking resources and computing resources are insufficient.

The connection unit 320 may provide multiple access-based connection when an avatar is selected on the user terminal 100 and the instructor terminal 400 and accessed a metaverse-based education platform. The user terminal 100 can access the metaverse-based education platform after selecting an avatar. In addition, the instructor terminal 400 is connected to the user terminal 100 and can be connected to the metaverse-based education platform.

The sharing management unit 330 may provide options for sharing screen or cam images. The sharing management unit 360 displays the screen or cam video of the instructor terminal 400 on the blackboard in the classroom within the metaverse-based education platform, or shares the screen or cam video of the user terminal 100 on the instructor terminal 400. When selecting an option, the screen or cam image of the user terminal 100 can be set to be displayed on the blackboard. At this time, a typical video conferencing solution basically shares video with each participant through a cam and, if necessary, shares the screen of the host device. Typically, when holding an online meeting with content, the host's screen is shared. While the host's screen is shared and the content is explained, there is not much change in the screen, but video conferencing solutions continuously transmit video even when the screen changes are not significant, so not only the host but also each participant must pay traffic costs for this. . Additionally, in video sharing, the host transmits the screen to participants in one direction, making it impossible for participants to interact through the screen to share content. Meeting content for delivering content can be provided in a variety of ways, such as text, images, and video, and this is fully possible with HTML5, the current web technology. HTML5's Web Socket is a technology that can dynamically control HTML, which is static content, using two-way communication. Therefore, if content composed of HTML is controlled as needed using web sockets, unnecessary traffic can be reduced. Additionally, since the system can be used only using a web browser that acts as an HTML parser, it has the advantage of being platform-independent and can be used without installing plug-ins or other programs. Accordingly, in one embodiment of the present invention, a host and a user (Host) control content with a web browser using HTML5 web sockets and transmit voice and video using WebRTC (Web Real-Time Communication). A system that allows users to interact with shared screens can be applied.

<HTML5 and WebSockets>

The traditional web based on the HTTP protocol is a one-way communication method in which the server responds and transmits data only when the client requests it. W3C confirmed HTML5 as the next-generation web standard technology in 2014, which provides various extended APIs to provide functions that were not possible with basic web technologies. In particular, WebSocket complements the shortcomings of HTTP protocol communication and enables two-way communication. Standard web browsers are connected to servers through web sockets and can send and receive real-time two-way messages with the web server without installing a separate plug-in. Therefore, by analyzing the received message and manipulating Javascript, CSS3, etc., it is possible to change the web browser screen without refreshing. HTML5 is standardized among web browsers by adopting HTML5 as a common standard technology in the five major global standard web browsers, Edge, Chrome, Safari, Opera, and Firefox. Through the functions of and WebSocket, you can create various applications that can communicate using only a web browser.

<WebRTC>

WebRTC (Web Real-Time Communication) is a technology that allows audio or video media to be streamed and data exchanged between web browsers without an intermediary. Data is exchanged through a P2P connection between web browsers without installing a third-party program or plug-in. . WebRTC is an open source-based web standard, and although Chrome, Firefox, and Opera actively support the WebRTC standard, cross-browsing issues exist because WebRTC specifications are not fully complied with on all platforms or web browsers to date. To solve this, you can solve the compatibility issue by using the Adapter.js library together. WebRTC is widely used in the development of video conferencing solutions and has been recognized for its excellence in performance.

The store unit 340 can set the online store by mapping it to at least one object in the metaverse-based education platform. For example, you can use a method of displaying recommended books or related reference books first, or you can configure the page by displaying necessary materials or school supplies first. It can be configured differently for each class.

The emotion expression unit 350 can be set to display an emoji or express an emotion as a gesture of the avatar on the avatar of the user terminal 100 or the instructor terminal 400. At this time, facial expressions or gestures can be provided by tracking the facial features of the user or instructor and then overlaying them on the avatar. In the case of emotions, OpenPose can be used to recognize each part of the skeleton and place it on an avatar. In this case, it is possible to determine whether the user or instructor is actually angry, smiling, or dozing off, so it is easy to express emotions and is advantageous for the instructor to observe the user as a learner.

The video management unit 360 can support multiple video chatting between the user terminal 100 and the instructor terminal 400. The chat support unit 370 can support public chat and secret chat between the user terminal 100 and the instructor terminal 400.

The movement control unit 380 may provide options for moving or jumping the avatar of the user terminal 100 or the instructor terminal 400.

The minigame unit 390 connects a minigame to at least one object in the metaverse-based education platform, and when a minigame is selected on the user terminal 100, the minigame can be set to be played on the user terminal 100. . At this time, the minigame may be an edu-based game or a game that promotes interest in learning, such as gamification, but it does not exclude that it is a simple fun-oriented game.

The space provision department 391 builds a classroom, study room, counseling room, group classroom, and science room within the metaverse-based education platform and sets them as a metaverse space where the avatars of the user terminal 100 and the instructor terminal 400 move. You can. Of course, the type of map is not limited to this.

The handwritten note unit 392 may provide a user interface for writing notes in a notepad using the note-taking option during class on the user terminal 100 or the instructor terminal 400. At this time, the default is a notepad using a typewriter, but in the case of instructors, there are cases where the teacher writes directly in a book and shares the screen, or writes with an electronic pen on materials such as PPT, so this can be used as a CNN-based model, for example, Additional options can be provided to provide text data after recognition using Conv2D, AlexNet, VGG, GoogLeNET, ResNet, etc. For example, for letters handwritten by a user or instructor, basic information about the stroke is first extracted and then R (Rectangle) and SR (Surrounding Rectangle) are calculated based on this. Afterwards, vowel candidates are found based on straight strokes, and then [initial consonant - middle consonant - final consonant] are distinguished. Finally, the CNN-based learning model can be applied to identify consonant vowels and finally recognize letters.

Online handwriting can extract coordinate information for each stroke. Based on this, SR, which is the minimum square surrounding each stroke, is calculated. Once [Extracting stroke information] is completed, [Extracting vowel candidates and identifying consonants and vowels] must be performed. Hangul has one [Initial-Medium-Final consonant]. Among these, the neutral consonant is used as a vowel and is usually written in a straight line. Accordingly, straight lines are found among the SRs obtained from stroke information extraction. Afterwards, vowel candidates are created by combining each straight line with lines in similar positions. Each letter in Hangul can be divided into a number of cases depending on the presence or absence of vowels and final consonants, and for the identified vowel candidates, the thread finds the vowel that matches each position. That is, we assume that thread number 1 will be a letter with an initial consonant, a vowel to the right, and no final consonant. For example, if the user writes [Gan], the [ㅏ] strokes identified by straight lines are determined as vowel candidates. After dividing the remaining strokes into initial and final consonants, the thread corresponding to the number in each case searches for the stroke in the letter it is responsible for and selects the most accurate search result. Instead of sending the handwriting data to the platform service providing server 300 according to an embodiment of the present invention and receiving a recognition result, the handwriting data can be preprocessed as soon as it is written on the user terminal 100 or the instructor terminal 400 and then set to identify the vowel. . The recognition model can use the most basic CNN model. The initial input is an image corresponding to each initial, middle, and final consonant that has been preprocessed. LeLU can be used as an activation function for each layer, and Max Pooling can be performed. Handwriting data for learning can use data from the Korea Institute for the Advancement of Intelligence and Information Society. Since Korean handwriting data is provided in units of characters, a dataset can be built by dividing it into [initial consonant - middle consonant - final consonant].

The voice group activity support unit 393 can receive voices from a plurality of user terminals 100 and transmit them to the plurality of user terminals 100 so that group activities can be performed by voice in the group classroom within the metaverse-based education platform. At this time, the user terminal 100 may be a plurality of user terminals 100 belonging to different entities.

<Multiple speaker identification>

Since not only one person in a group classroom may speak, there may be cases where multiple speakers speak at the same time or their speech overlaps. For this purpose, a voice recognition method based on voice frequency correlation can be used to recognize voice utterances and speakers using STT (Speech to Text). It is possible to extract only the voice from mixed audio, analyze it in the frequency domain, and remove residual noise remaining in the voice through correlation calculation of the frequency component. By distinguishing between voice signals and noise signals through correlation operations in the frequency domain between voice signals, the STT recognition rate can be increased and voice signals can be extracted more efficiently.

<STFT>

Since audio signals are expressed as a change in the intensity of a one-dimensional signal according to a change in time, when various signals are mixed, it is difficult to distinguish the characteristics of each signal only by the change in signal intensity in the time domain. Due to the nature of audio signals, which have very large dimensions and are made up of the sum of multiple frequencies, there are limits to recognizing features in the time domain.

Equation 1 is the Fourier Transform, which is an operation that converts a function in the time domain to the frequency domain by expressing it as the sum of periodic functions with various frequencies. f(x) represents a signal in the time domain, F(u) represents a signal in the frequency domain, and Equation 2 represents Euler's formula. When Equation 1 is applied to an audio signal, the frequency domain components of the corresponding signal can be obtained. For example, when signals with multiple frequencies are mixed and overlapped, it is difficult to distinguish each signal, but when Fourier transform is performed, it is possible to distinguish the size according to each frequency.

STFT (Short-Time-Fourier-Transform) is a method of dividing data into small time sections and performing Fourier transformation. STFT is used to efficiently analyze information of signals whose frequency components change with time. Equation 3 is the STFT transformation equation, where w(t) represents the window function. The result of applying STFT to an audio signal is a three-dimensional graph in which time and frequency are set as the horizontal and vertical axes, respectively, and the intensity of each frequency is expressed as a color change in dB units, called a spectrogram. For example, when an audio signal to which STFT is applied is expressed as a spectrogram, the spectrogram is color-coded according to the intensity of the frequency. The closer to yellow, the stronger the frequency, and the closer to purple, the weaker the frequency. You can examine the intensity of frequencies in a spectrogram using a graph.

<Deep Learning>

A spectrogram divides a one-dimensional audio signal into sections of a certain length and then applies Fourier transform to each section to express a two-dimensional image with time information on the horizontal axis and frequency magnitude in dB on the vertical axis. It is possible to use it as learning data for a deep learning program based on CNN (Convolutional Neural Network) used for processing.

<SVS>

SVS (Singing Voice Separation) uses two types of audio signals, one in which the singer's voice is recorded together, and the other in which only the sound of the instrument is recorded before recording the voice. It is a deep learning network trained to separate signals. By converting the audio signal into a spectrogram and detecting the spectrum change, the sound source is fragmented using the point at which the spectral changes rapidly as the starting point, then voice separation is performed using the learned information, and the separated spectrogram data is divided into pieces. The sound source separation process is completed through the process of restoring the audio signal.

<Voice frequency based noise filtering>

In the process of separating the audio signal into music and voice using SVS, there are residual noises that cannot be completely removed, and there is a limitation in that new noises are created due to distortion in the process of reconstructing the separated sound sources. Therefore, in order to increase the STT recognition rate, such noises are removed. A removal process is required. Therefore, to improve the problem of the STT recognition rate being lowered by non-speech elements, a residual noise removal filter using correlation in the frequency domain can be used. SVS can be used to separate a speaker's voice signal from an audio signal in which multiple voice signals are mixed. By applying STFT to a separated voice signal and converting it to the frequency domain, the frequency component of each section of the voice signal can be found, and voices other than the speaker's voice can be filtered using a filter implemented through correlation calculation in the frequency domain. . The filtered voice and the voice utterances of the separated speakers can be recorded as text and provided in the chat window. Of course, it goes without saying that in addition to the above-mentioned methods, various methods can be used to distinguish multiple speakers and identify each participant.

The custom character unit 394 may provide at least one avatar option to customize the avatar in the user terminal 100 or the instructor terminal 400. At this time, a high degree of freedom can be provided so that the user's personality can be visualized when creating an avatar. To achieve this, the shape and position of the face can be learned through various appearance databases, and a 3D image can be created by analyzing the eyes, nose, mouth, and hairstyle using deep learning-based facial recognition technology. In addition, the position values of the thousands of facial expressions and various clothing and accessories displayed by the avatar can be automatically adjusted. In addition, instead of facial recognition, users can also create their own avatar using their own photo.

The tool support unit 395 supports the writing function of the instructor terminal 400 and can support a viewer for at least one document, photo, image, and video. At this time, it is possible to provide functions such as reading a book together by sharing the screen on which the textbook is printed with the student, and to provide an interface for functions such as drawing lines or writing in a book.

<First person perspective>

Viewpoint means the point of view from which an object is viewed, and in games, it refers to the user's viewpoint from which characters, objects, and other backgrounds are viewed. In the game, there is a character that represents the user, and the perspective of this character and the user is the same as the first-person perspective. Third-person and omniscient perspectives are different from the perspectives of the character and the user. Third-person perspective is when the perspective changes according to the movements of a specific character, and omniscient perspective is when the perspective illuminates a wide area independently of the movement of the character. Therefore, when using a first-person perspective, the character's appearance is not reflected in the field of view, whereas when using a third-person perspective, the character's appearance is displayed on the screen. Lastly, omniscient perspective illuminates the ground from above, allowing you to see many units at a glance.

point of view Almost remote first person Same point of view for user and character. Only the character's hands, feet, or tools are shown on the screen. The viewpoint of the user and the character is the same, but the distance between the camera and the character does not exist. 3rd person This is a perspective that shows the character's upper body or entire body in a larger view, allowing you to feel the character's movements vividly by using various compositions. Compared to third-person melee, the character appears smaller and the map is convenient to use, making it easy to identify nearby enemies and necessary items. omniscient This is a point that only a very few people use because it is difficult to quickly identify the actions that many characters can take. Characters appear very small and multiple characters can be controlled simultaneously or alternately.

The viewpoints commonly used in games are first-person close-up, third-person close-up, third-person remote, and omniscient remote. In first-person close-up perspective, the character's and the user's perspectives are the same, and the character's appearance is not visible except for hands, feet, or tools. When the character moves, the camera shakes and the field of view is narrower than other viewpoints, so you have to rotate the camera frequently to look at the surroundings. However, because the viewpoint is the same as that of the character, it feels more realistic than other viewpoints, and because the user feels like they are inside the game, it is a viewpoint often used in simulations based on virtual reality. Third-person close-up, third-person remote, and omniscient remote viewpoints have the characteristic that the character and the user are separated, so the character's observation field of view is different from the user's field of view. In the third-person close-up view, the character appears large on the screen, making it easy to observe the character in various compositions with the camera. Therefore, it can express depth and dynamic movement well and can be used in action games. On the other hand, the third-person remote view has the advantage of being relatively farther between the camera and the character than the third-person close view, making it easier to examine the overall terrain or structure, making it convenient to move around the map or search for items. Lastly, the omniscient remote viewpoint is the furthest from the character among the four viewpoints and is positioned so that the camera illuminates the ground from above. Therefore, it is good for exploring a very wide map or understanding the movements of many characters at once. Instead, it is difficult to freely control each character, and there is a strong feeling of observing rather than being in the game. First-person remote and omniscient close-up perspectives are perspectives that either do not exist in reality or are rarely used. First-person remote perspective is conceptually a perspective where the user's and the character's viewpoints are the same and the camera is away from the character, but it does not exist because the user's viewpoint is always the same as the camera's viewpoint. Omniscient close-up perspective is a perspective where the camera is very close and can handle multiple characters, and is only used in a very small number of games. At this time, in one embodiment of the present invention, various viewpoints suitable for the situation, such as when moving around each map or taking a class, can be used.

The 3D provider 396 can provide a metaverse-based education platform in 3D. At this time, 3D content can be created based on Unreal or Unity. Unity Engine is a game engine developed by Unity Technology that supports 2D and 3D graphics, drag and drop functionality, and scripting through the C# development language. Using this, we can provide solutions in various fields such as games, extended reality, architectural design, movies, animation, automobiles, transportation, and manufacturing. Additionally, the Unity Engine supports various virtual reality platforms such as Oculus and OpenXR, providing an environment suitable for developing virtual reality content. Unreal Engine is a game engine developed by Epic Games that supports 3D computer graphics, drag-and-drop functionality, C++ development language, and node-based visual scripting. Using this, we provide solutions in various fields such as games, movies, animation, and simulation. Unreal Engine also supports various extended reality platforms such as Oculus, Microsoft HoloLens, and HTC Vive, providing an environment suitable for developing virtual reality content.

Hereinafter, the operation process according to the configuration of the platform service providing server of FIG. 2 described above will be described in detail using FIGS. 3 and 4 as an example. However, it will be apparent that the embodiment is only one of various embodiments of the present invention and is not limited thereto.

Figures 3A to 4D are diagrams showing introduction videos of a platform (tentative name, Meta School) captured by function according to an embodiment of the present invention. Currently, this video is posted on the applicant's company website (https://www.codestory.biz/about-9) and YouTube (https://www.youtube.com/watch?v=Tz7srQvLlho), respectively. You can log in as a student on the user terminal 100 as shown in Figure 3a, set an avatar as shown in Figure 3c on the screen shown in Figure 3b, return to the home screen as shown in Figure 3d, and enter the classroom as shown in Figures 3e and 3f. You can move to a desired location by moving or jumping, and the viewpoint can be enlarged or reduced as shown in Figures 3g and 3h. Multiple access is possible as shown in Figure 4i, and the user terminal 100 can play mini games as shown in Figures 3j and 3k, and connect to an online store as shown in Figure 3l to purchase or view a desired book. In the case of an instructor, he or she can log in as a teacher by checking the teacher in Figure 3m. After moving to the classroom from the home screen as shown in Figure 3n, he or she can share the teacher's cam as shown in Figure 3o, or share the student's cam as shown in Figure 3p. After sharing, the student's cam video can be displayed on the blackboard as shown in Figure 3q. As shown in Figure 3r, the screen, cam, and files can be shared. When a file is selected as shown in Figure 3s, the shared file is displayed on the blackboard as shown in Figure 3t, and the shared file is displayed using the writing function as shown in Figure 3u. You can write on the screen. It provides a first-person perspective as shown in Figure 3v, and also provides an emoji function as shown in Figure 3w or an emotion function where the avatar expresses emotions as shown in Figure 3x through gestures. Also, if you have something to say to the teacher without other students knowing, as shown in Figure 3y, you can use the whisper function, or you can use the map to move to the study room, as shown in Figure 3z, or to the counseling room, as shown in Figure 4a. As shown in Figures 4b and 4c, multi-video chatting is supported, and the screen can also be shared in multi-video chatting as shown in Figure 4d. Figure 4e is a screen capture of a homepage introducing a platform according to an embodiment of the present invention, and Figures 4f to 4o are screen captures of a proposal introducing the functions and effects of the platform of the present invention.

Matters that are not explained about the method of providing metaverse-based education platform services in FIGS. 2 to 4 are the same as or can be easily explained from the contents of the method of providing metaverse-based education platform services through FIG. 1. Since inference is possible, the description below will be omitted.

FIG. 5 is a diagram illustrating a process in which data is transmitted and received between each component included in the metaverse-based education platform service provision system of FIG. 1 according to an embodiment of the present invention. Hereinafter, an example of the process of transmitting and receiving data between each component will be described with reference to FIG. 5, but the present application is not limited to this embodiment, and the process shown in FIG. 5 according to the various embodiments described above It is obvious to those skilled in the art that the process of transmitting and receiving data can be changed.

Referring to Figure 5, the platform service providing server builds a metaverse-based education platform (S5100), selects an avatar from the user terminal and instructor terminal, and connects to the metaverse-based education platform based on multiple access. Provides connectivity (S5200).

In addition, the platform service providing server provides a screen or cam video sharing option (S5300), and sets the online store by mapping it to at least one object in the metaverse-based education platform (S5400).

In addition, the platform service providing server sets the avatar of the user terminal or instructor terminal to display an emoji or express an emotion as a gesture of the avatar (S5500), and multi-video chatting between the user terminal and the instructor terminal is performed. Supports (S5600).

In addition, the platform service providing server supports public chat and secret chat between user terminals and instructor terminals (S5700).

The sequence between the above-described steps (S5100 to S5700) is only an example and is not limited thereto. That is, the order between the above-described steps (S5100 to S5700) may change, and some of the steps may be executed simultaneously or deleted.

Matters not explained regarding the method of providing the metaverse-based education platform service of FIG. 5 are the same as or can be easily explained from the content described above regarding the method of providing the metaverse-based education platform service through FIGS. 1 to 4. Since inference is possible, the description below will be omitted.

The method of providing a metaverse-based education platform service according to an embodiment described through FIG. 5 can also be implemented in the form of a recording medium containing instructions executable by a computer, such as an application or program module executed by a computer. there is. Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and non-volatile media, removable and non-removable media. Additionally, computer-readable media may include all computer storage media. Computer storage media includes both volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data.

The method of providing a metaverse-based education platform service according to an embodiment of the present invention described above can be executed by an application installed by default on the terminal (this may include programs included in the platform or operating system, etc., installed by default on the terminal). It may be executed by an application (i.e., a program) that the user installs directly on the master terminal through an application providing server such as an application store server, an application, or a web server related to the service. In this sense, the method of providing a metaverse-based education platform service according to an embodiment of the present invention described above is implemented as an application (i.e., a program) installed by default in the terminal or directly installed by the user and readable by a computer such as in the terminal. It can be recorded on any recording medium that can be recorded.

The description of the present invention described above is for illustrative purposes, and those skilled in the art will understand that the present invention can be easily modified into other specific forms without changing the technical idea or essential features of the present invention. will be. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive. For example, each component described as unitary may be implemented in a distributed manner, and similarly, components described as distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims described below rather than the detailed description above, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention. do.

Claims (10)

A user terminal that selects an avatar and then accesses the metaverse-based education platform;
An instructor terminal connected to the user terminal and connected to the metaverse-based education platform; and
A construction unit that builds a metaverse-based education platform, a connection unit that provides multiple access-based connection when selecting an avatar on the user terminal and the instructor terminal and accessing the metaverse-based education platform, a screen or cam video A sharing management unit that provides sharing options, a store unit that maps and sets an online store to at least one object in the metaverse-based education platform, and an emoji (emoji) is displayed or an emotion (emoji) is displayed on the avatar of the user terminal or instructor terminal. Emotion), an emotional expression unit configured to express the avatar through gestures, an image management unit that supports multiple video chatting between the user terminal and the instructor terminal, and a chat support unit that supports public chat and secret chat between the user terminal and the instructor terminal. , a platform service providing server including a custom character unit that provides at least one avatar option to perform customization of the avatar in the user terminal or instructor terminal;
Including,
The platform service providing server is,
It provides a multiple access environment to satisfy some of the properties of the metaverse, such as real-time and unlimited, but uses edge computing to distribute the load to satisfy some of the properties while minimizing delay. Provide a connection environment,
In order to enable the edge computing network to support metaverse services that require computing and networking workloads above a preset level, an edge network for metaverse content is configured through edge server deployment, and the average Using an algorithm to reduce network congestion while keeping the network distance from increasing,
When a set consisting of N clients and M edge servers is called a VCN (Virtual Content Network), the location of the clients within the network is fixed, so the delay time of the VCN is reduced by specifying the edge server operation location of each VCN, Ensure that the traffic load of the entire network is reduced and computing resources are balanced,
In order to place the VCN's edge server on a specific edge node, the above algorithm finds edge server placement candidates for each VCN, ensures that the candidate placement sites are all nodes in the network, and determines the expected location when the edge server is placed on a specific node. The first step algorithm is to sort deployment candidates based on network cost, and virtually deploy edge servers of all VCNs in the network to the highest candidate node, but the available computing resources of a specific node are used to determine the number of edge servers entering that node. If the sum of resource requirements cannot be met, some of the VCN's edge servers are relocated to other nodes, and computing resources are abstracted by workload for convenience of summation and comparison during deployment. By using a two-step algorithm including the algorithm, all VCN's edge servers are placed within the network while considering network and computing load together,
In the process of deploying an edge server, in order to create a list of candidate nodes on which to deploy an edge server of a random VCN, a link-specific traffic factor refers to the traffic load required for each link on the network path between the edge server and the client, The expected traffic load for each candidate is obtained by using the client set C constituting the VCN and τapp, the traffic factor for each link of the VCN application, and for each node n of all node sets N in the network, the shortest path between that node and each client is calculated. The expected traffic load t of candidate node n, which means the traffic load expected to occur when the VCN's edge server is placed on node n, is calculated by multiplying the sum and the traffic factor. Then, the candidate node obtained based on the expected traffic load is calculated as By organizing the candidate list of VCNs by sorting them in ascending order, each candidate list is generated for every VCN in the network.
When selecting candidates for a VCN considering computing resources, considering that a specific node may not have enough computing resources to deploy all edge servers on that node, all candidate nodes for the VCN are initially set to be selected; The following variables are the number of types of computing resources under consideration, the ith computing resource of node n, and the sum of the ith computing resource requirements of all edge servers that select node n as a candidate in P, a deployment plan representing the candidate node selection situation for each VCN. Considering, if there are no nodes with excess resources, the algorithm is terminated to ensure that the deployment plan, P, is confirmed, so that the VCN edge server is actually placed on the corresponding candidate node, and if there are nodes with excess resources, among the edge servers scheduled to be placed on the node Replace some,
When performing the replacement, W-VBP (Weighted Vector Bin Packing) is a vector-based replacement node selection method that has no restrictions on the number of resources and can minimize the side effect of not being able to use other types of resources even if only some resources are depleted. By using , the server with the largest difference between the node's resource composition ratio and the edge server's resource composition ratio is replaced,
When all candidates for a VCN to be replaced are depleted, the algorithm is considered to have ultimately failed. In order to prevent a situation where only candidates for a specific VCN are continuously depleted, the remaining candidate ratio for each VCN is considered as a weight, and the result of VBP is The edge server with the largest result of multiplying the vector angle and the weight is selected for replacement.
Let the VCN, which holds the edge server subject to replacement, remove the currently selected candidate node from P and select the next candidate node from its candidate list, and then check again for the presence of excess nodes based on the current state of P.
If an algorithm failure occurs as the computing resource requirements of metaverse contents within the network exceed the total available resources, measures to add hardware or reduce the level of offloading of contents to edge computing are applied,
The store section organizes pages so that recommended books or related reference books are displayed first, or necessary preparations or school supplies are displayed first, but the pages are configured differently for each class,
The custom character part,
When creating an avatar, in order to make the user's personality visible and provide a certain level of freedom, the shape and position of the face are learned through multiple appearance databases, and deep learning-based facial recognition technology is used to Create a three-dimensional image by analyzing the nose, mouth, and hairstyle, automatically adjust the position values for the facial expressions, clothing, and accessories displayed by the avatar, and create an avatar using facial recognition or the user's own photo. Let this happen,
The platform service providing server further includes a handwritten note unit that provides a user interface to take notes on a notepad using a note-taking option during class on the user terminal or instructor terminal,
The written note section,
The above notepad is considered as a basic notepad using a typewriter, but considering that there are cases where the instructor writes directly in a book and shares the screen or writes with an electronic pen on PPT materials, the instructor's handwriting information is converted into Conv2D, Further providing the option of recognizing using at least one CNN-based model among AlexNet, VGG, GoogLeNET, and ResNet and then providing it as text data,
When the above option is provided, the instructor extracts basic information about the strokes of the handwritten letters, calculates R (Rectangle) and SR (Surrounding Rectangle) based on the extracted basic information, and then collects them based on straight strokes. A metaverse-based education platform service provision system that recognizes letters by finding candidates, distinguishing initial, medial, and final consonants, and then applying the classified information to the CNN-based model to identify consonants and vowels.
According to claim 1,
The sharing management department,
When the screen or cam video of the instructor terminal is displayed on the blackboard in the classroom within the metaverse-based education platform, or the instructor terminal selects the option to share the screen or cam video of the user terminal, the screen or cam video of the user terminal is selected. A metaverse-based education platform service provision system characterized by setting an image to be displayed on the blackboard.
According to claim 1,
The platform service providing server is,
a movement control unit that provides options to move or jump the avatar of the user terminal or instructor terminal;
A metaverse-based education platform service provision system further comprising:
According to claim 1,
The platform service providing server is,
a mini-game unit that connects a mini-game to at least one object in the metaverse-based education platform and sets the mini-game to be played on the user terminal when the mini-game is selected on the user terminal;
A metaverse-based education platform service provision system further comprising:
According to claim 1,
The platform service providing server is,
A space providing unit that builds classrooms, study rooms, counseling rooms, group classrooms, and science rooms within the metaverse-based education platform and sets them as metaverse spaces where avatars of the user terminal and instructor terminal move;
A metaverse-based education platform service provision system further comprising:
delete According to claim 1,
The user terminal is a plurality of user terminals belonging to different entities,
The platform service providing server is,
A voice group activity support unit that receives voices from the plurality of user terminals and transmits them to the plurality of user terminals so that group activities can be performed by voice in the group classroom within the metaverse-based education platform;
A metaverse-based education platform service provision system further comprising:
delete According to claim 1,
The platform service providing server is,
a tool support unit that supports a writing function of the instructor terminal and a viewer of at least one document, photo, image, and video;
A metaverse-based education platform service provision system further comprising:
According to claim 1,
The platform service providing server is,
A 3D provider that provides the metaverse-based education platform in 3D;
A metaverse-based education platform service provision system further comprising:

Images