KR102672930B1 - Ontact education platform system based on artificial intelligence - Google Patents

Abstract

The present invention provides an artificial intelligence-based on-tact realistic architectural engineering structural mechanics 3D/4D education platform system that is interconnected between online and offline spaces. The on-offline space complex interconnection artificial intelligence-based on-tact realistic architectural engineering structural mechanics 3D/4D education platform system according to the present invention includes mixed reality (MR) content, VR/AR content, hologram content, etc. A studio space capable of producing realistic architectural engineering structural mechanics 3D/4D educational content, a non-face-to-face education center space capable of multi-person communication based on multi-face-to-face multi-monitors, and realistic architectural engineering structural mechanics 3D/4D educational content in real or expanded form. An MR-hologram experience space displayed at the specified size is built offline, and an online platform is established to connect educational content providers and recipients online by linking to the studio space/non-face-to-face education center space/MR-hologram experience space, Artificial intelligence techniques have been introduced into the content operation process of educational content providers and the management process of educational content recipients, enabling non-face-to-face and non-contact online education to be provided in a more three-dimensional and dynamic form than offline education, and through this, university education, etc. It can be effectively applied to the higher education system and has technical characteristics that enable complex two-way communication and high-intensity lectures to be provided, thereby improving learning effectiveness.

Description

On-offline space complex interconnection artificial intelligence-based on-tact realistic architectural engineering structural mechanics 3D/4D education platform system {Ontact education platform system based on artificial intelligence}

The present invention relates to an on-offline spatial complex interconnected artificial intelligence-based on-tact realistic architectural engineering structural mechanics 3D/4D education platform system, and more specifically, mixed reality (MR) content, VR/AR content, Studio space capable of producing realistic architectural engineering structural mechanics 3D/4D educational content such as holographic content, non-face-to-face education center space capable of multi-person communication based on multi-face-to-face multi-monitors, realistic architectural engineering structural mechanics 3D/4D educational content An MR-hologram experience space displayed in real or expanded size is built offline, and is linked to the studio space/non-face-to-face education center space/MR-hologram experience space, and is an online platform that connects educational content providers and recipients online. This will be built, and artificial intelligence techniques will be introduced into the content operation process of educational content providers and the management process of educational content recipients, allowing non-face-to-face and non-contact online education to be provided in a more three-dimensional and dynamic form than offline education. Through this, It can be effectively applied to higher education systems such as university education, and can provide complex two-way communication and highly focused lectures, improving learning effectiveness. It is an artificial intelligence-based on-tact realistic architectural engineering with complex interconnection between online and offline spaces. This is about the structural mechanics 3D/4D education platform system.

At the end of 2019, more than 4.3 million people were infected worldwide by COVID-19, which originated in Wuhan, China, and more than 300,000 of them died. COVID-19 has a low fatality rate due to its strong contagiousness through droplets and limitations in drug treatment in addition to natural healing, but a lot of time and human resources are consumed for complete cure.

In Korea, the large-scale spread of COVID-19 has occurred through various activities such as social distancing campaigns, everyone wearing masks when going out, online school openings by postponing the opening of schools (including elementary schools, middle schools, high schools, and universities), restrictions on visits to nursing hospitals, and continuous and frequent quarantine activities. A lot of effort is being made to prevent this.

In particular, as the recent prolongation of COVID-19 is expected, the government continues to promote social distancing and non-face-to-face activities, which limits the ability of elementary school, middle and high school students, and college students to acquire knowledge through field trips, leading to many problems in career and academic achievement. has occurred and preparation measures for this are being required.

However, existing online education platforms cannot ensure high academic achievement because they consist of cramming education that relies on the learner's knowledge acquisition ability through one-way knowledge transfer, and when conducting real-time lectures, it is impossible to check the students' concentration in class. There is a problem in determining whether knowledge has been acquired through lectures.

In other words, the existing online education platform consists of cramming education that relies on the learner's knowledge acquisition ability through one-way knowledge transfer, making it impossible to secure high academic achievement, and when conducting real-time lectures, it is impossible to check the students' concentration in class. As a result, it is difficult to determine whether knowledge has been acquired through lectures.

Additionally, there is a need for an invention that can solve the problem of making educational content difficult to produce unless the content provider is an editing expert.

Republic of Korea Patent Publication No. 10-1934503 “Non-face-to-face/face-to-face convergence assembly robot program education system”

The present invention improves the problems of the prior art and provides a studio space where realistic architectural engineering structural mechanics 3D/4D educational content is produced, a non-face-to-face education center space equipped with multiple monitors, and a realistic architectural engineering structural mechanics 3D / MR-hologram experience space where 4D educational content is displayed, and an online platform that connects educational content providers and recipients online are built to be interconnected, and artificial intelligence is provided to the educational content provider's content operation process and the management process for educational content recipients. By introducing intelligent techniques, non-face-to-face and non-contact online education can be provided in a more three-dimensional and dynamic form than offline education, and through this, it can be effectively applied to higher education systems such as university education, and provides complex two-way communication and highly focused lectures. The purpose is to provide a new type of artificial intelligence-based on-tact realistic architectural engineering structural mechanics 3D/4D education platform system that can improve learning effectiveness as it becomes possible to provide it.

In addition, the present invention aims to improve students' class concentration by analyzing facial expressions and eyes using artificial intelligence functions to determine students' class attitude, which is a chronic problem in online education platforms, and schedules eye contact with the camera so that students can actively concentrate on class. A new type of online-offline space that aims to provide high-quality education by sending an alarm warning to the student's screen when the time is out and providing learning content such as a review test after class to students who have received warnings more than three times. The purpose is to provide a complex interlocking artificial intelligence-based on-tact realistic architectural engineering structural mechanics 3D/4D education platform system.

According to the characteristics of the present invention for achieving the above-described object, the present invention is provided with a content production facility 110 and a content storage device 120 to produce VR content, AR content, MR (Mixed Reality) content, and holograms. An offline-studio space unit 100 in which realistic architectural engineering structural mechanics 3D/4D educational content implemented as one selected from the content group is produced and stored; It is equipped with a multi-face-to-face multi-monitor 210 linked to an offline management server 600 that receives video information, audio information, and text information transmitted from the client terminal 500, and provides multi-client interaction including educational content providers and recipients. Offline-non-face-to-face education center space unit (200) that mediates communication; A content output device 310 is provided to display the realistic architectural engineering structural mechanics 3D/4D educational content in a size selected from the group consisting of actual size, an expanded size at a set ratio, and a reduced size at a set ratio, wherein the VR An offline-MR-hologram experience space unit (offline-MR-hologram experience space unit) that outputs realistic architectural engineering structural mechanics 3D/4D educational content implemented as one selected from the group of content, AR content, MR (Mixed Reality) content, and hologram content. 300); An online web server 600' is provided to connect the client terminal 500, the offline management server 600, the field space photography device 700, and the field space communication device 800 through online communication, so that educational content providers and recipients can It is connected online, and any one of the content storage device 120 of the offline-studio space unit 100 and the content output device 310 of the offline-MR-hologram experience space unit 300 and the online web server (600') is linked to enable the provision and experience of educational content linked to offline and online spaces; an online platform (400); 3D/4D realistic architectural engineering structural mechanics that can be actually participated in. It provides an on-tact, realistic architectural engineering structural mechanics 3D/4D education platform system based on artificial intelligence that is characterized by providing educational content.

delete

delete

delete

delete

delete

According to the on-offline space complex interconnection artificial intelligence-based on-tact realistic architectural engineering structural mechanics 3D/4D education platform system according to the present invention, a studio space, a non-face-to-face education center space, an MR-hologram experience space, and an online platform are constructed. Meanwhile, as artificial intelligence techniques are introduced into the content operation process of educational content providers and the management process of educational content recipients, the effect of non-face-to-face and non-contact online education can be expected to be provided in a more three-dimensional and dynamic form than offline education. Through this, the on-offline spatial complex interconnected artificial intelligence-based on-tact realistic architectural engineering structural mechanics 3D/4D education platform system according to the present invention is expected to be effectively applied to higher education systems such as university education, and provides complex two-way communication and As more intensive lectures become available, learning effectiveness is expected to improve.

1 is a block diagram of an on-offline spatial hybrid artificial intelligence-based on-tact realistic architectural engineering structural mechanics 3D/4D education platform system according to an embodiment of the present invention;
Figure 2 is a block diagram of a module that can be provided for analysis in an online web server and an offline management server according to an embodiment of the present invention;
Figure 3 is an exemplary diagram of an offline-non-face-to-face education center space unit equipped with multi-face-to-face multiple monitors according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail based on the attached drawings. Meanwhile, in drawings and detailed explanations, general artificial intelligence, mixed reality (MR) content, VR/AR content, hologram content, realistic architectural engineering structural mechanics 3D/4D educational content, and multi-face-to-face multi-monitor are used in this field. Illustrations and references to structures and functions that practitioners can easily understand are simplified or omitted. In particular, in the illustrations and detailed descriptions of the drawings, detailed descriptions and illustrations of specific technical configurations and operations of elements that are not directly related to the technical features of the present invention are omitted, and only the technical configurations related to the present invention are briefly shown or described. did.

The on-offline spatial complex interconnected artificial intelligence-based on-tact realistic architectural engineering structural mechanics 3D/4D education platform system according to an embodiment of the present invention consists of an offline-studio space unit 100 and an offline-non-face-to-face as shown in FIG. 1. It consists of an education center space unit (200), an offline-MR-hologram experience space unit (300), and an online platform (400). It is a space built offline and built online to connect educational content providers and recipients. Shiki's online platforms are linked together to enable an on-tact education process.

The offline-studio space unit 100 is composed of a studio space built offline, a content production facility 110, and a content storage device 120 provided in the space, and is comprised of VR content, AR content, and MR (mixed reality: This is a unit where realistic architectural engineering structural mechanics 3D/4D educational content that can be implemented as Mixed Reality (Mixed Reality) content, hologram content, etc. is produced and stored.

Here, the problems of virtual reality (VR) and augmented reality (AR) that can cause vomiting and dizziness can be solved by applying holographic content, and additional equipment to implement virtual reality (VR) and augmented reality (AR) can be solved. Purchases can be minimized. Meanwhile, it is also possible to produce hologram-based AR content to improve learning efficiency. Through this, realistic on-tact lectures become possible.

The offline-non-face-to-face education center space unit 200 is composed of a non-face-to-face education center built offline and a multi-face-to-face multi-monitor 210 provided in the non-face-to-face education center. The multi-face-to-face multi-monitor 210 is a client It is linked to the offline management server 600, which receives video information, audio information, and text information transmitted from the terminal 500. The offline-non-face-to-face education center space unit 200 mediates mutual communication between multiple clients, including educational content providers and recipients.

Through this multi-face-to-face multi-monitor 210, the educational content provider can view all of the trainees (students) at a glance. Existing single monitor-based online education has small student faces in the window, making it difficult to check each student's face and their level of concentration. However, in the case of realistic on-tact lecture facilities, multi-face-to-face hardware can be used, providing a more realistic experience. Communication with students becomes possible and visibility can increase as it is distributed across multiple monitors.

In particular, the multi-face-to-face multi-monitor 210 of the offline-non-face-to-face education center space unit 200 according to an embodiment of the present invention ensures that the monitor area allocated per client has a size greater than the set value, as shown in FIG. 3. Enables detection of the recipient's current face characteristic information.

In response to this, the offline management server 600 or the online web server 600' includes a learning attitude evaluation management module 610, a learning attitude evaluation information input module 620, and a poor attitude warning management module 630, as shown in FIG. 2. This may be included.

The learning attitude evaluation management module 610 is equipped with an artificial intelligence-based image analysis algorithm 611 and an artificial intelligence-based learning attitude evaluation algorithm 612 to provide educational content providers with recipient learning attitude evaluation information.

The artificial intelligence-based image analysis algorithm 611 is an algorithm that detects current face characteristic information from the recipient image information generated by the camera 510 of the client terminal 500. This artificial intelligence-based image analysis algorithm 611 detects the recipient's eye pattern information, facial expression pattern information, etc. as current face characteristic information, and the current face characteristic information can be detected based on a deep learning process.

The artificial intelligence-based learning attitude evaluation algorithm 612 is an algorithm that calculates the recipient's learning attitude evaluation information from the detected current face characteristic information. This artificial intelligence-based learning attitude evaluation algorithm 612 detects learning concentration, learning attitude excellence, etc. as the recipient learning attitude evaluation information, and the recipient learning attitude evaluation information can be calculated based on a deep learning process.

The learning attitude evaluation information input module 620 is a module that receives the learning attitude evaluation information of the educational content provider regarding the recipient's image information from the educational content provider's client terminal 500.

The poor attitude warning management module 630 detects whether the recipient makes eye contact from the video information of the recipient generated by the camera 510 of the client terminal 500, and if the duration of the recipient's eye contact is longer than the set time, the learning attitude This is a module that generates a defective warning signal and transmits it to the recipient's client terminal (500).

Meanwhile, when on-site situations such as construction sites are necessary for training, personnel equipped with realistic field support devices capable of two-way communication can transmit the on-site situation in real time and use it for training. By building such a realistic on-site support device environment, on-site situations can be filmed in real time, allowing content consumers to check the real thing in 3D form anywhere using mixed reality.

To this end, the offline-non-face-to-face education center space unit (200) includes an on-site space filming device (700), an on-site space communication device (800), a client terminal (500), and This is a unit that enables on-site distance education through communication between offline site space and clients through multiple monitors (210). Here, the field space imaging device 700 and the field space communication device 800 are devices capable of transmitting and receiving real-time two-way information.

The offline-MR-hologram experience space unit 300 is equipped with a content output device 310 to provide realistic architectural engineering structural mechanics 3D/4D educational content in actual size, expanded size at the set ratio, reduced size at the set ratio, etc. This is the unit displayed as .

The online platform 400 is equipped with an online web server 600' through which a client terminal 500, an offline management server 600, a field space photography device 700, and a field space communication device 800 are connected through online communication. The educational content provider and the recipient are connected online, and the content storage device 120 of the offline-studio space unit 100 or the content output device 310 of the offline-MR-hologram experience space unit 300 and the online web server ( 600') are linked to enable the provision and experience of educational content linked to offline and online spaces.

Meanwhile, you can perform your own paper test after finishing the class through the online platform. If the correct answer rate is less than 70%, a summary of the lecture content may be provided. Afterwards, a review test will be conducted when participating in the class. If you do not pass the review test, You can configure the system so that yellow cards are sent to instructors and reflected in grades.

In addition, by configuring multiple rooms in the form of separate conference rooms within the online classroom where groups can enter to enable real-time discussion, a process can be established where group presentations are conducted in the online classroom after organizing the discussion content.

In addition, the online platform can provide a function to change the classroom background by specifying a lecture participant, a function to change the background of a participant, and a function to decorate a lecture participant's character (but limited to the face part). In addition, it is possible to implement the function by specifying a command, Before the lecture begins, you can provide a simple game to utilize the break time.

The online-offline spatial complex interconnected artificial intelligence-based on-tact realistic architectural engineering structural mechanics 3D/4D education platform system according to the embodiment of the present invention provides actual participatory educational content that goes beyond the one-sided form of cramming education. . For example, in the field of architectural engineering at universities, structural mechanics content can be implemented as a three-dimensional representation of various objects using holograms to maximize visual effects, and the decomposition/combining process on the actual object structure can be directly performed through hologram manipulation. In addition, real-time feedback can be delivered by supporting structural mechanics design through holograms or transmitting and receiving data in real time. To this end, the offline-studio space unit 100 produces one selected among structure MR content and structure hologram content for understanding the composition and operation of the structure, supporting design and analysis of the structure, and training on assembly and disassembly of the structure. - The MR-hologram experience space unit 300 implements one selected among structure MR content and structure hologram content in an offline space and performs structure learning, structure design, structure analysis, and structure assembly/disassembly training of the recipient. It can be done as much as possible.

In addition, by broadcasting the construction site in real time, it is possible to connect structural mechanics majors to employment sites so that they can consider ways to utilize the academic knowledge they have learned in the field. To this end, the offline-non-face-to-face education center space unit (200) is used offline through the construction site's field space photography device (700), field space communication device (800), client terminal (500), and multi-face-to-face multi-monitor (210). On-site distance education can be made possible through communication between the on-site space and clients.

And the online-offline spatial complex interconnected artificial intelligence-based on-tact realistic architectural engineering structural mechanics 3D/4D education platform system according to an embodiment of the present invention builds a platform that satisfies an environment without multi-device, real-time streaming, and usage country restrictions. In this way, questions/discussions are shared through multilingual real-time translation, lecture content is recognized through instructor voice recognition, and multilingual voices are generated using voice synthesis technology, making it possible to take lectures without restrictions on nationality. In other words, it can support multilingual real-time translation and speech synthesis (TTS) for questions and discussions when taking a lecture.

In addition, the on-offline spatial complex interconnected artificial intelligence-based on-tact realistic architectural engineering structural mechanics 3D/4D education platform system according to an embodiment of the present invention can provide an artificial intelligence-based learning system for flipped learning and real-time translation. and analysis of students' educational activities, and enables curation and recommendation of learning content through analysis of student educational activities based on xAPI (Experience API) (international standard). Through this, optimized educational content can be recommended to increase learning understanding, and it is also possible to collect structured/unstructured activity data of students and develop an educational competency model. In addition, a customized educational content recommendation model for students can be developed according to educational capabilities.

The on-offline space complex interconnection artificial intelligence-based on-tact realistic architectural engineering structural mechanics 3D/4D education platform system according to the embodiment of the present invention configured as described above is a non-face-to-face-non-contact online education that is more three-dimensional and dynamic than offline education. It can be provided in a form that allows it to be effectively applied to higher education systems such as university education, and the learning effect can be improved by providing complex two-way communication and highly focused lectures.

As described above, the on-offline spatial complex interconnected artificial intelligence-based on-tact realistic architectural engineering structural mechanics 3D/4D education platform system according to the embodiment of the present invention is shown according to the above description and drawings, but this is an example. Those skilled in the art will be able to understand that this is merely an explanation and that various changes and modifications can be made without departing from the technical spirit of the present invention.

100: Offline-studio space unit
110: Content production equipment
120: Content storage device
200: Offline-non-face-to-face education center space unit
210: Multi-face-to-face multi-monitor
300: Offline-MR-Hologram Experience Space Unit
310: Content output device
400: Online platform
500: client terminal
510: Camera
600: Offline management server
600': Online web server
610: Learning attitude evaluation management module
611: Artificial intelligence-based image analysis algorithm
612: Artificial intelligence-based learning attitude evaluation algorithm
620: Learning attitude evaluation information input module
630: Bad attitude warning management module
700: Field space filming device
800: Field space communication device

Claims (5)

A content production facility (110) and a content storage device (120) are provided, and realistic architectural engineering structural mechanics 3D/4D educational content implemented as holographic content is produced and stored, including understanding the composition and operation of the structure, designing the structure, and An offline-studio space unit (100) in which structure hologram content is produced for analysis support and structure assembly and disassembly training;
It is equipped with a multi-face-to-face multi-monitor 210 linked to an offline management server 600 that receives video information, audio information, and text information transmitted from the client terminal 500, and provides multi-client interaction including educational content providers and recipients. It mediates communication, but the multi-face-to-face multi-monitor 210 ensures that the monitor area allocated to each client has a size greater than the set value so that the educational content provider can view all of the trainees at a glance, so that the current status of the recipient is displayed. Offline-non-face-to-face education center space unit 200 that enables detection of face characteristic information;
A realistic architecture provided with a content output device 310 in which the realistic architectural engineering structural mechanics 3D/4D educational content is displayed in a size selected from the following: actual size, an expanded size at a set ratio, and a reduced size at a set ratio. Engineering structural mechanics 3D/4D educational content is printed, and realistic architectural engineering structural mechanics 3D/4D educational content implemented as structural hologram content is implemented in an offline space, allowing recipients to learn about structures, structure design, structure analysis, and structure assembly/disassembly. An offline-MR-hologram experience space unit 300 that allows training to be performed;
An online web server 600' is provided to connect the client terminal 500, the offline management server 600, the field space photography device 700, and the field space communication device 800 through online communication, so that educational content providers and recipients can It is connected online, and any one of the content storage device 120 of the offline-studio space unit 100 and the content output device 310 of the offline-MR-hologram experience space unit 300 and the online web server As (600') is linked, it becomes possible to provide and experience educational content that is linked to offline and online spaces, and by filming the situation at the construction site in real time, educational content recipients can use mixed reality wherever they are to create a 3D version of the content. It consists of an online platform (400) that allows you to check the actual object, and provides realistic architectural engineering structural mechanics 3D/4D educational content that you can actually participate in,
The offline management server 600 and the online web server 600' include a learning attitude evaluation management module 610, a learning attitude evaluation information input module 620, and a poor attitude warning management module 630. The evaluation management module 610 is equipped with an artificial intelligence-based image analysis algorithm 611 and an artificial intelligence-based learning attitude evaluation algorithm 612 to provide evaluation information on the recipient's learning attitude to the educational content provider, and inputs the learning attitude evaluation information. The module 620 receives the educational content provider's learning attitude evaluation information regarding the recipient's image information from the educational content provider's client terminal 500, and the poor attitude warning management module 630 uses the camera of the client terminal 500 Detect whether or not the recipient makes eye contact from the recipient's image information generated by (510), and if the duration of the recipient's eye contact is longer than a set time, a warning signal of poor learning attitude is generated and transmitted to the recipient's client terminal (500). After the class ends, a self-inquiry test is conducted, and if the correct answer rate is below the set percentage, a summary of the lecture content is provided. Additionally, a review test is conducted when participating in the class, and if the review test is not passed, a yellow card is sent to the instructor and the grade is given. However, the artificial intelligence-based image analysis algorithm 611 converts the recipient's eye pattern information and facial expression pattern information from the recipient's image information generated by the camera 510 of the client terminal 500 into the current face characteristic information. It is detected based on a deep learning process, and the artificial intelligence-based learning attitude evaluation algorithm 612 calculates learning concentration and learning attitude excellence from the detected current pace characteristic information based on a deep learning process as the recipient's learning attitude evaluation information. And do it,
The offline management server 600 and the online web server 600' perform their own message test after finishing the class through the online platform 400, and if the correct answer rate is 70% or less, they provide lecture summary content and review it when participating in the class. If you do not pass the test and review it, a yellow card will be sent to the instructor to be reflected in your grade. In addition, multiple rooms in the form of separate conference rooms will be created within the online classroom where groups can enter to allow for real-time discussion. After organizing the discussion content, group presentations are made in the online classroom, and the online platform 400 provides a function to change the classroom background by designating the lecture participant, a function to change the background of the participant, and a function to decorate the character of the lecture participant. Before the lecture begins, An artificial intelligence-based on-tact realistic architectural engineering structural mechanics 3D/4D education platform system that provides games to utilize break time. delete delete delete delete

Images