WO2024085829A1

WO2024085829A1 - A system for learning to play old in a meta verse environment using virtual reality technology

Info

Publication number: WO2024085829A1
Application number: PCT/TR2023/050113
Authority: WO
Inventors: Ercan AYKUT; Sena TAŞ
Original assignee: İstanbul Geli̇şi̇m Üni̇versi̇tesi̇
Priority date: 2022-10-17
Filing date: 2023-02-08
Publication date: 2024-04-25

Abstract

The present invention relates to a system that enables people who want to play a musical instrument to learn to play the instrument interactively in a metaverse environment using virtual reality technology.

Description

A SYSTEM FOR LEARNING TO PLAY OLD IN A META VERSE ENVIRONMENT USING VIRTUAL REALITY TECHNOLOGY

Technical Field:

This invention relates to a system and simulation for learning and teaching oud playing in a virtual reality and metaverse environment developed for people who want to play a musical instrument to perform interactive learning in a virtual universe.

State of the Art:

Human beings are in a continuous development process in order to meet their various needs since the day they were on the earth. However, today, people who want to play musical instruments prefer face-to-face training especially for the instruments they want to learn. Similarly, there are multiple approaches to providing students with a learning experience and providing a better learning experience. Traditionally, students go to major education institutions, schools and the like for learning. There are also multiple approaches, such as learning by reading a textbook, watching videos, or going through PowerPoint Presentations, in a situation where students learn from home. However, such multiple approaches lead to a low retention rate, as such multiple approaches do not make learning fun and interesting.

Today, fretless musical instruments are relatively difficult to learn, and play compared to fretted instruments. For this reason, as a result of the fact that the places of the sounds in a cheap instrument are not exactly correct, the student cannot play properly, and this causes the musical instrument to quit. A quality instrument is needed for the education and learning process to be efficient. Since this will create a high cost, it creates an obstacle for people from all walks of life to learn to play an instrument. One of the biggest problems encountered in stringed musical instruments such as oud is that the strings cannot be adjusted to the required frequency by stretching and loosening the strings. If this process, which is called the tuning process, is not done in accordance with the procedure, the sounds do not sound correctly, and the learner cannot play the oud correctly because he cannot hear the sounds correctly. For this reason, since efficient learning cannot take place, time loss and unnecessary workload occur. At the same time, since performing the tuning process correctly requires a certain experience, an expert in the field is needed for any tuning and distortion process, and it makes playing the oud obligatory by being dependent on an expert in the field.

" Virtual reality music singing training equipment " is described in the patent application numbered CN112435532. Invention; describes virtual reality music singing training equipment and relates to the field of teaching devices. The equipment consists of VR glasses and a lens case. VR glasses consist of a glasses frame, a glasses bracket, and a screen. The lens cover is provided with a microphone and a data port for connecting external storage equipment. Thus, musical knowledge can be taught and learned visually; improving the teaching and learning efficiency of teachers and students.

In the patent application described above, it is about teaching the ability to sing using the intuition of the person using the equipment for the purpose of intuitive singing training with VR glasses. With the invention described, it is not entirely possible to gain the ability to sing intuitively. Trying to transfer music information only visually reduces the efficiency and quality of the system.

"Language teaching system" is described in the patent application numbered CN104715640. The invention of virtual reality display system module for downloading resources, and a resource-sharing module, an administrator terminal, Terminal a teacher, student terminals, a data retrieval unit, a comparison unit, a display unit and a display unit that includes the teaching of a language describes winder unit and the second winder unit, and the charging cable is fixed before passing between the first winder unit and the second winder unit. Thanks to the virtual reality display system module, various scenes are shown in front of the students in three dimensions.

In the patent application described above, a learning environment is created by using music for individuals who want to learn a different language, and the traditional English learning process is tried to be improved. Since the person's learning ability and area of interest are different with the invention described, it is not possible to get full efficiency and there is only a theoretical learning for English development.

As a result, it has been developed for the realization of interactive learning, which can overcome the disadvantages mentioned above, is low in cost, supports physical and cognitive learning, provides a high system efficiency, provides permanent learning, does not require a physical instrument, prevents time loss and unnecessary workload due to tuning problems, and eliminates the need for experience, there is a need for a new technology that can be customized, appeals to students from all walks of life, reduces dependency on an expert, and provides an effective learning process with the right guide.

Description of the Invention:

This invention is a system and simulation for learning and teaching how to play the oud in a metaverse environment with virtual reality, the feature of which is; specially developed for the realization of interactive learning in a virtual universe, the interaction between teachers and students to enhance learning and increase efficiency, less costs, physical, and cognitive learning support system, high efficiency, permanent learning, providing an effective learning process that enables us to appeal to every student with the right technology is a new manual.

The invention in order to realize all the objectives mentioned above and which will emerge from the detailed description below; For a better and more efficient oud education and learning in a quality learning environment, students are enabled to learn to play musical instruments interactively with the instrument modeled in virtual reality and metaverse environment.

Thanks to the inventive system, the learner does not need to have a physical oud. Considering the high cost of a well-stringed instrument, students are primarily saved from a great deal of cost.

Thanks to the system subject to the invention, there will be no need for a physical oud, so there is no need for tuning adjustment, there is no problem such as tuning distortion. At the same time, the knowledge and experience required for tuning is eliminated. For this reason, the loss of time and unnecessary workload caused by the tuning process is prevented and the dependence on an expert person is reduced.

In the system that is the subject of the invention, it is ensured that the student makes the right pressure at the appropriate time by showing which point the fingers should press during the education and learning process. While performing various exercises in the education and learning process, the points that need to be pressed on the oud are shown with any stimulus, such as a light, to confirm whether the learner is doing it correctly, and by facilitating comprehension, the learning process is ensured to be permanent.

In the system that is the subject of the invention, notes are placed in front of the student as if there is a physical oud in the metaverse environment, and the note to be played is shown with a colored stimulus during the duration. In this way, a permanent learning environment is created for the student's comprehension.

The invention is not only geared towards learning, but also provides a metaverse environment in which an advanced person can play the oud, allowing her/him to practice continuously.

Thanks to the fact that the oud to be played in the system of the invention can be selected in different colors or tones, it is ensured that the person can customize the oud to be played in the metaverse environment. This eliminates the problem of buying more than one instrument with different features and the expense of this situation.

The system, which is the subject of the invention, is supported by the integration of methods such as games, awards, scoring, and it is ensured that people are more involved and encouraged in the education and learning process.

In an exemplary embodiment of the invention, it is possible to choose the oud to be played, such as solo oud, group oud, group strings (oud, binding, qanun). Even if the person is playing the oud, he feels as if he is playing in a stringed orchestra. This increases the quality of the music and ensures that the learning process of the person takes place in a lively and immersive way.

The training planned in the system that is the subject of the invention has not been thought to include the training of only one person, and it also makes it possible to play with the participation of many people in the metaverse environment.

The structural and characteristic features and all advantages of the product subject to the invention will be understood more clearly thanks to the figures given below and the detailed explanation written by making reference to these figures, and therefore the evaluation should be made by taking these figures and detailed explanation into consideration.

Description of the Figures:

The invention will be described with reference to the accompanying figures, so that the features of the invention will be more clearly understood and appreciated, but the purpose of this is not to limit the invention to these certain regulations. On the contrary, it is intended to cover all alternatives, changes and equivalences that can be included in the area of the invention defined by the accompanying claims. The details shown should be understood that they are shown only for the purpose of describing the preferred embodiments of the present invention and are presented in order to provide the most convenient and easily understandable description of both the shaping of methods and the rules and conceptual features of the invention. In these drawings.

Figure 1 Schematic view of the system.

The figures to help understand the present invention are numbered as indicated in the attached image and are given below along with their names.

Description of References:

1. Server

2. Memory Unit

3. Transmitter Module

4. VR Rail

5. Processor

6. Evaluation Module

Detailed Description of The Invention:

Invention; The server (1), where bidirectional communication between many modules is controlled over a network and at least one student is included in the system, the memory unit (2) where the registration data of the students is stored over the network, the oud visual in the virtual universe with the student wearing virtual glasses, and As a result of the creation of the pick of the oud instrument in the virtual environment, the transmitter module (3), which shows these images to the student, the VR rail (4), which is used to make sense of the finger pressures applied to the instrument created by the transmitter module (3), and the VR rail (4), which is used by the students' hand and a processor (5), which interprets the movements of the instrument, includes the evaluation module (6), in which the way the student plays the instrument is interpreted and the score is created during the education process. Invention; it includes an evaluation module (6) that shows the point where the student's fingers should press during the education and determines the student's pressure on the oud instrument by the VR rail (4).

Invention; it contains a transmitter module (3) that generates any colored stimuli such as light, which allows the student to confirm the functions performed correctly for the points that need to be pressed on the instrument while playing various exercises and songs.

Invention; it contains a processor (5) that allows the student to choose different colors or tones for the oud instrument.

Invention; it includes the evaluation module (6), which determines the level of participation of one or more students in the learning content or makes recommendations by applying a predefined educational model using an artificial intelligence-based technique of more participation-related parameters.

Invention; where meta store library has lots of models, lots of images, lots of animations, lots of sound files, lots of templates, lots of textures, lots of assets including at least one of lots of simulations and lots of videos corresponding to learning content contains the memory unit (2).

Claims

CLAIMS - The invention is related to the system and its simulation for learning and teaching to play the oud in the metaverse environment with virtual reality, and its feature; a server (1), where bidirectional communication between many modules is controlled over a network and at least one student is included in the system, a memory unit (2) where the registration data of the students are stored over the network, a transmitter module (3) that shows these images to the student as a result of creating the oud image and the pen belonging to the oud instrument in the virtual environment in the virtual universe together with the student wearing virtual glasses, a VR fingerboard, which is used to make sense of finger pressures applied to the instrument created by the transmitter module (3) and detects finger pressures (4), a processor (5), which interprets the hand movements of the students by the VR rail (4), an evaluation module (6), in which the way the student plays the instrument is interpreted and the score is created during the education process. - As mentioned in claim 1, it is a system and simulation for learning and teaching to play the oud in a metaverse environment with virtual reality, and its feature; it is characterized by the fact that it contains the evaluation module (6), which shows which point the student's fingers should press during the training and detects the correct pressure of the student's virtual oud instrument by the VR rail (4). - As mentioned in claim 1, it is a system and simulation for learning and teaching to play the oud in a metaverse environment with virtual reality, and its feature; It is characterized by the fact that it contains a transmitter module (3) that creates any colored stimuli such as light, which allows the student to confirm the functions that he/she has done correctly for the points that need to be pressed on the instrument while playing various exercises and songs. - As mentioned in claim 1, it is a system and simulation for learning and teaching to play the oud in a metaverse environment with virtual reality, and its feature; It is characterized by the fact that it contains a processor (5) that allows the student to choose different colors or tones for the oud instrument. - As mentioned in claim 1, it is a system and simulation for learning and teaching to play the oud in a metaverse environment with virtual reality, and its feature; It is characterized by determining the level of participation of one or more students in the learning progress of one or more students and the learning content, or it includes an evaluation module (6), which advises more participation-related parameters by applying a predefined education model using an artificial intelligence-based technique. - As mentioned in claim 1, it is a system and simulation for learning and teaching to play the oud in a metaverse environment with virtual reality, and its feature; it is characterized by the inclusion of meta data repository for the library, so many models, too many images, too many animations, numerous audio file, a number of templates, numerous tissue from numerous numerous simulations that contain at least one memory unit (2) that corresponds to the learning content with numerous video assets.