KR102448000B1 - Apparatus, method and program for music education for the hearing impaired using vibration and visual data - Google Patents

Abstract

Disclosed is an apparatus for music education for the hearing impaired, using vibration and visual data. The apparatus for music education comprises: at least one processor; and a memory for storing instructions instructing the at least one processor to perform at least one operation. The at least one processor receives voice data, and provides at least one of text data, image data, and a vibration control signal for pitch and size corresponding to the received voice data. An objective of the present invention is to provide an apparatus for music education capable of allowing the hearing impaired to learn pitch, sound intensity and tempo through vibration and visual data.

Description

Apparatus, method, and program for music education for the hearing impaired using vibration and visual data

The present invention relates to a music education apparatus for the hearing impaired using vibration and visual data.

The most influential sense in perceiving music is hearing. Therefore, music is a relatively difficult medium for people with hearing impairments.

In many cases, the music subject is included in the curriculum for teaching students, and the majority of students are taught using only educational methods developed for students with normal hearing. However, when teaching the hearing impaired using the above education method, it is difficult to provide normal education.

In addition, as non-face-to-face education is on the rise, when music education is conducted through non-face-to-face education, it is difficult to provide normal education for the deaf who learns by relying on senses other than hearing.

In addition, although devices for allowing the hearing impaired to recognize music through a sense other than hearing have been developed, there is a problem in that accessibility is poor due to a relatively high price.

SUMMARY OF THE INVENTION An object of the present invention for solving the above problems is to provide a music education apparatus capable of learning a pitch, a sound intensity, and a time signature to a hearing impaired person through vibration and visual data.

Another object of the present invention for solving the above problems is to provide a music education method capable of learning a pitch, a sound strength, and a time signature to a hearing impaired person through vibration and visual data.

Another object of the present invention for solving the above problems is to provide a music education program that can teach the hearing impaired to pitch, sound intensity, and beat through vibration and visual data.

One aspect of the present invention for achieving the above object provides a music education apparatus for the hearing impaired using vibration and visual data.

In addition, the music education apparatus, at least one processor (processor); and a memory for storing instructions instructing the at least one processor to perform at least one operation.

In addition, the at least one processor receives the voice data, and provides at least one of text data, image data, and a vibration control signal for a pitch and a size corresponding to the received voice data.

In addition, the vibration control signal includes frequency data and magnitude data, the frequency data includes any one of a plurality of different frequencies, and the magnitude data includes any one of a plurality of different sound levels, A combination of the frequency data and the magnitude data may correspond to a plurality of different pitches.

In addition, the music education device is communicatively connected to a vibration device including a vibration module disposed in each of a plurality of regions, and the vibration control signal includes position data corresponding to a plurality of different pitches and a plurality of different sounds. Size data corresponding to the size may be included, and the location data may include a location of any one of the plurality of areas.

In addition, the vibration control signal may include frequency data corresponding to a plurality of different octaves, and the frequency data may include any one of the plurality of frequencies.

In addition, the music education apparatus is communicatively connected to a vibration apparatus including a plurality of vibration modules disposed in each of a plurality of regions, and the vibration control signal includes first position data corresponding to a plurality of different pitches and different It includes second position data corresponding to a plurality of loudnesses, the first position data includes a position of any one of the plurality of regions, and the second position data includes any one of the plurality of vibration modules It may contain one location.

In addition, the plurality of vibration modules may be arranged from one side toward the other side opposite to the one side, and a corresponding sound level may increase from the one side toward the other side.

In addition, the at least one processor determines whether the voice data matches all the notes of at least one octave, and, if the match, text data corresponding to pitch data and preset size data for the at least one octave; At least one of image data and a vibration control signal may be provided.

In addition, the at least one processor provides at least one of text data, image data, video data, and a vibration control signal related to a sheet music composed of a plurality of pitches, sizes, and beats that allow overlap, and corresponding to the voice data. It provides at least one of text data, image data, and vibration control signal for pitch and size, and at least one of text data, image data, video data, and vibration control signal related to the sheet music, and a pitch and size corresponding to the voice data. An evaluation score may be derived by comparing at least one of text data, image data, and a vibration control signal for , and a recommended song may be calculated based on the evaluation score.

In addition, another aspect of the present invention for achieving the above object provides a method for educating the hearing impaired using vibration and visual data, performed by a computer.

The music education method may include: receiving voice data; and providing at least one of text data, image data, and a vibration control signal for pitch and magnitude corresponding to the received voice data, wherein the vibration control signal includes frequency data and magnitude data, and the frequency data includes any one of a plurality of different frequencies, the magnitude data includes any one of a plurality of different sounds, and a combination of the frequency data and the magnitude data corresponds to a plurality of different pitches.

In addition to this, another method for implementing the present invention, another apparatus, and a computer-readable recording medium for recording a computer program for executing the method may be further provided.

In the case of using the music education apparatus for the hearing impaired using vibration and visual data in the present invention as described above, it is possible to learn the pitch, size, and tempo of a sound using tactile and visual sensations.

In addition, since learning is performed by using a vibration generating device having a relatively low cost or by using vibration that may be generated in a music education device, the cost required for learning is reduced, and thus, there is an advantage of high accessibility.

In addition, there is an advantage in that the learning effect is increased because it is possible to provide learning for a matching recommendation song based on the evaluation score for at least one of the pitch, the size, and the time signature.

In addition, the selected song is corrected based on the evaluation score for at least one of the pitch, the size, and the tempo, and learning of the corrected song can be provided, so that the effect of learning is increased.

1 is a schematic diagram of a music education apparatus for the hearing impaired according to an embodiment.
FIG. 2 is a block diagram exemplarily showing a functional module of the music education apparatus according to FIG. 1 .
FIG. 3 is a diagram illustrating an embodiment of vibration generated by the voice data conversion unit according to FIG. 2 .
FIG. 4 is a diagram illustrating another embodiment of vibration generated by the voice data conversion unit according to FIG. 2 .
FIG. 5 is a diagram illustrating another embodiment of vibration generated by the voice data conversion unit according to FIG. 2 .
FIG. 6 is a conceptual diagram illustrating a function of the sound learning unit according to FIG. 2 .
FIG. 7 is a conceptual diagram for explaining the function of the sound learning unit according to FIG. 2 .
FIG. 8 is a conceptual diagram for explaining the function of the sound learning unit according to FIG. 2 .
9 is a conceptual diagram illustrating a function of the sound learning unit according to FIG. 2 .
FIG. 10 is a conceptual diagram for explaining the function of the sound learning evaluation unit according to FIG. 2 .
11 is a flowchart illustrating a process of a music education method using the music education apparatus according to FIG. 1 .
12 is a flowchart illustrating the process of the sound learning step S10 according to FIG. 11 .
13 is a flowchart illustrating the process of the song selection step ( S60 ) according to FIG. 11 .
14 is a diagram exemplarily illustrating a hardware configuration of the music education apparatus according to FIG. 1 .

Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention. In describing each figure, like reference numerals have been used for like elements.

Terms such as first, second, A, and B may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

When a component is referred to as being “connected” or “connected” to another component, it may be directly connected or connected to the other component, but it is understood that other components may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It is to be understood that this does not preclude the possibility of the presence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic diagram of a music education apparatus 100 for the hearing impaired according to an embodiment.

Referring to FIG. 1 , the music education apparatus 100 may provide at least one of vibration and visual data for music education for the hearing impaired to the user 200 .

The music education apparatus 100 may include an output interface device configured to generate vibration in a preset frequency range. Also, the music education apparatus 100 may control a device communicatively connected to the music education apparatus 100 to generate vibrations in a preset frequency range.

The music education apparatus 100 may include an output interface device that displays visual data including at least one of an image, text, and video for music education of the hearing impaired. Also, the music education apparatus 100 may control a device communicatively connected to the music education apparatus 100 to generate vibrations in a preset frequency range.

Also, the music education apparatus 100 may receive analog voice data generated by the user 200's utterance.

The music education apparatus 100 may include an input interface device configured to detect analog voice data. Also, the music education apparatus 100 may receive voice data through a device that is communicatively connected to the music education apparatus 100 and configured to detect analog voice data.

Also, the music education apparatus 100 may convert analog voice data into digital data and generate a vibration control signal based on the converted digital data.

The music education apparatus 100 may vibrate based on the vibration control signal. Also, the music education apparatus 100 may transmit a vibration control signal to a device communicatively connected to the music education apparatus 100 and control the device to vibrate.

Also, the music education apparatus 100 may generate a control signal and a visual data based on the converted digital data.

The music education apparatus 100 may generate visual data based on the visual data control signal. Also, the music education apparatus 100 may transmit a visual data control signal to a device communicatively connected to the music education apparatus 100 .

FIG. 2 is a block diagram exemplarily showing a functional module of the music education apparatus 100 according to FIG. 1 . Also, FIGS. 3 to 9 are conceptual diagrams for explaining the operation of the functional module of the music education apparatus 100 .

Hereinafter, a functional module of the music education apparatus 100 will be described with reference to FIGS. 2 to 10 .

Referring to FIG. 2 , the music education apparatus 100 includes a voice data conversion unit 101 , a tone learning unit 102 , a tone learning evaluation unit 103 , a recommended song learning unit 104 , and a selection song learning unit 105 . ) is included. The voice data conversion unit 101 , the tone learning unit 102 , the tone learning evaluation unit 103 , the recommended song learning unit 104 , and the selected song learning unit 105 may be configured as at least one processor.

The voice data converter 101 converts analog voice data received from the user into digital data, and generates at least one of a vibration control signal and a visual data control signal based on the converted digital data.

In an embodiment, the vibration control signal may include first position data related to the pitch and first magnitude data related to the volume. The first location data may include information on at least one location among a plurality of locations each corresponding to a different pitch. The first size data may include information on any one of a plurality of different intensities. In addition, in relation to the sound level, second position data other than the first size data may be included. The second location data may include information on at least one location among a plurality of locations corresponding to a plurality of intensities, each of which is different from each other.

Referring to FIG. 3 , the music education apparatus 100 is communicatively connected to a device to which a vibration module is attached to a plurality of regions of the hand. The vibration module attached to each area matches the sound included in the preset octave. When the learning sound region is set to do, re, mi, par, sol, la, and si, the vibration module is matched to match each of the seven regions. However, the present invention is not limited thereto, and various numbers of regions may be set. The first location data includes information on any one of the seven areas. In addition, in the not-shown embodiment, one vibration module may be disposed in each region, and generates vibration of a magnitude corresponding to a preset sound volume. That is, when the first magnitude data is classified into a weak vibration, a medium vibration, and a strong vibration, the strong vibration is a vibration having a relatively strong magnitude compared to the medium vibration.

Referring back to FIG. 3 , a plurality of vibration modules are disposed in each area. A plurality of vibration modules disposed in each area are matched with a preset sound level. In the illustrated embodiment, three vibration modules are arranged in the little finger region, and the three vibration modules are matched with preset three sound levels. In this case, the second location data may include information on the location of any one of the three vibration modules. In addition, in all areas, a plurality of vibration modules disposed in each area may be arranged from one side to the other side opposite to each other. As the arrangement direction of the plurality of vibration modules is unified, the effect of matching the pitch with the visual and tactile senses and recognizing the user can be maximized.

In another embodiment, the vibration control signal may include first position data related to a pitch, first frequency data related to a pitch, and first magnitude data related to a sound level. The first location data may include information on at least one location among a plurality of locations each corresponding to a different pitch. The first frequency data may include information on at least one of a plurality of frequencies corresponding to different octaves, respectively. The first size data may include information on any one of a plurality of different intensities. In addition, in relation to the sound level, second position data other than the first size data may be included. The second location data may include information on at least one location among a plurality of locations corresponding to a plurality of intensities, each of which is different from each other.

Referring to FIG. 4 , unlike in the case of FIG. 3 where different octaves are recognized through different devices, in the device according to FIG. 4 , vibration modules at the same location may express different octaves. The first frequency data includes information about a frequency corresponding to any one octave among different octaves. In the illustrated embodiment, 1 octave may be classified as 1 vibration, 2 octaves may be classified as 2 vibrations, and 3 octaves may be classified as 3 vibrations. However, the present invention is not limited thereto, and an octave may be expressed with various frequencies. That is, the device according to FIG. 4 may be controlled by a vibration control signal including first position data, first size data, and first frequency data. In addition, the device according to FIG. 4 may be controlled by a vibration control signal including first position data, second position data, and first frequency data.

In another embodiment, the vibration control signal may include first frequency data and first magnitude data related to a pitch. The first frequency data includes information on a plurality of different frequencies, and the first magnitude data includes information on a plurality of different intensities. A combination of the first frequency data and the first magnitude data matches at least one of different pitches, respectively.

Referring to FIG. 5 , the music education apparatus 100 includes an output interface device configured to generate vibration. The output interface device expresses the pitch of the preset range through a combination of the frequency included in the preset range and the volume included in the preset range. In the illustrated embodiment, combinations of frequencies 1 to 6 and magnitudes 1 to 4 match pitches from one octave degree to three octave hours. However, the present invention is not limited thereto, and combinations of various ranges and pitches of various ranges may be matched. The output interface device may be controlled by a vibration control signal including a combination of the first frequency data and the first magnitude data.

In an embodiment, the visual data control signal may include text data for a pitch and a size matching the converted digital data, and image data for a pitch and a size matching the converted digital data.

Referring back to FIG. 2 , the sound learning unit 102 provides sound recognition data to the user so that the hearing impaired user can recognize the pitch and size corresponding to the voice uttered.

The sound recognition data may include at least one of text data and image data for a pitch and a size corresponding to the voice uttered by the user.

Also, the sound recognition data may include a vibration control signal for a pitch and a size corresponding to the voice uttered by the user.

When the user speaks, the voice data conversion unit 101 generates a visual data control signal and a vibration control signal, and the tone learning unit 102 generates a pitch and a pitch corresponding to the voice uttered by the user based on the visual data control signal. At least one of text data and image data for the size is generated. At least one of the generated text data and image data is displayed by an output interface device included in the music education apparatus 100 or a device communicatively connected to the music education apparatus 100 . The generated vibration control signal is converted into vibration by an output interface device included in the music education apparatus 100 or a device communicatively connected to the music education apparatus 100 .

Since the pitch and size of the sound uttered by the user are provided as vibration, text data, and image data, the user can recognize the pitch and size of the voice uttered by the user.

Referring to FIG. 6 , text information and image information included in sound recognition data are exemplarily illustrated. The text information may include an octave, a pitch, a frequency, and a magnitude. The image information may include an image indicating the position of the pitch in the musical scale and an image indicating the position of the matching vibration module in the device.

Referring back to FIG. 2 , the sound learning unit 102 may provide sound learning data to the user.

The sound learning data may include at least one of text data, image data, and vibration for a sound corresponding to any one of pitches of a preset range and any one of sizes of a preset range.

When a user who recognizes at least one of text data, image data, and vibration included in the sound learning data utters a voice matching it, the sound learning unit 102 is text data for the pitch and size corresponding to the uttered voice. , and provides at least one of image data and vibration to the user.

At least one of text data, image data, and vibration for a pitch and a size corresponding to the spoken voice may be provided simultaneously with the sound learning data.

Through this, the user can compare the correct answer with his or her voice through visual and tactile sense. As a result, the user can gradually learn about pitch and volume through sight and touch.

Referring to FIG. 7 , text information and image information included in sound learning data are exemplarily illustrated. The text information may include an octave and a pitch suggested as a problem, and a pitch and a magnitude corresponding to the user's voice. The image information may include an image indicating the position of the pitch suggested as a problem in the scale and the position of the pitch corresponding to the user's voice, and an image indicating the position of the vibration module matching the pitch suggested as a problem in the device and the pitch corresponding to the user's voice. can

Referring back to FIG. 2 , the sound learning unit 102 provides beat recognition data to the user so that the hearing impaired user can recognize the beat.

The beat recognition data includes at least one of text data, image data, video data, and a vibration control signal related to at least one of preset beats.

The user is provided with text data, image data, video data, and vibration related to at least one of preset beats through an output interface device included in the music education apparatus 100 or a device communicatively connected to the music education apparatus 100 . . Through this, the user may recognize at least one of the preset beats.

Referring to FIG. 8 , text information, image information, and video information included in beat recognition data are exemplarily illustrated. The text information includes information about the beat presented in question. The image information may include sheet music matching the beat presented as a problem. The video information may include an animation that overlaps with the matched sheet music to indicate the passage of time.

Referring back to FIG. 2 , the sound learning unit 102 may provide beat learning data to the user.

The beat learning data includes at least one of text data, image data, and video data related to at least one of preset beats.

When a user who recognizes at least one of text data, image data, and video data included in the beat learning data utters a voice to match it, the sound learning unit 102 displays a text for a pitch and a size corresponding to the uttered voice. at least one of data, image data, and vibration is provided to the user.

At least one of text data, image data, and vibration for a pitch and a magnitude corresponding to the spoken voice may be provided simultaneously with the beat learning data.

Through this, the user can compare the correct answer with his/her beat (voice) through visual and tactile sense. As a result, the user can gradually learn about the beat through sight and touch.

Referring to FIG. 9 , text information, image information, and video information included in beat learning data are exemplarily illustrated.

Referring back to FIG. 2 , the sound learning evaluation unit 103 provides the user with evaluation data that can be evaluated for at least one of a pitch, a size, and a time signature learned by the user through the sound learning unit 102 .

The evaluation data may include at least one of text data, image data, video data, and a vibration control signal related to sheet music composed of a plurality of pitches, strengths, and beats that allow overlap.

When a user who recognizes at least one of text data, image data, video data, and a vibration control signal included in the evaluation data utters a voice matching it, the sound learning evaluation unit 103 performs a pitch and At least one of text data, image data, and vibration for size is provided to the user.

At least one of text data, image data, moving picture data, and vibration control signals included in the evaluation data, and at least one of text data, image data, and vibration for a pitch and size corresponding to the uttered voice may be provided at the same time.

Referring to FIG. 10 , at least one of text data, image data, and vibration about the pitch and size corresponding to at least one of text data, image data, video data, and vibration control signals included in the evaluation data, and the uttered voice A process provided at the same time is illustrated by way of example.

Also, the tone learning evaluation unit 103 calculates a pitch evaluation score by comparing a pitch included in the evaluation data with a pitch corresponding to the uttered voice. The sound learning evaluation unit 103 calculates a loudness evaluation score by comparing the loudness of the sound included in the evaluation data with the sound level corresponding to the uttered voice. The sound learning evaluation unit 103 calculates a beat evaluation score by comparing a beat included in the evaluation data with a beat corresponding to the uttered voice. The calculated evaluation score may be included in text data and provided to the user.

Referring back to FIG. 2 , the recommended song learning unit 104 calculates a recommended song based on the calculated evaluation score, and provides the calculated recommended song learning data to the user.

The recommended song learning data may include at least one of text data, image data, video data, and a vibration control signal related to sheet music composed of a plurality of pitches, strengths, and beats included in the recommended songs.

When a user who recognizes at least one of text data, image data, video data, and a vibration control signal included in the recommended song learning data utters a voice matching it, the recommended song learning unit 104 responds to the uttered voice At least one of text data, image data, and vibration for pitch and size is provided to the user.

At least one of text data, image data, video data, and vibration control signals included in the recommended song learning data, and at least one of text data, image data and vibration for the pitch and size corresponding to the uttered voice can be provided at the same time have.

The selected song learning unit 105 receives the selected song from the user. The music education apparatus 100 includes an input interface device configured to receive a selection for a selection song from a user.

In one embodiment, the music education device 100 includes a first selection for elementary school, middle school, and high school curriculum, a second selection for a grade of the selected curriculum, a third selection for a textbook of the selected grade, and included in the selected textbook may receive a fourth selection for the song that has been made.

The selection song learning unit 105 provides the selection song learning data for the selection song to the user.

The selection song learning data may include at least one of text data, image data, video data, and a vibration control signal related to sheet music composed of a plurality of pitches, strengths, and beats included in the selection song.

In an embodiment, the selection song learning unit 105 compares a plurality of pitches, strengths, and beats included in the selection song with the user's pitch evaluation score, size evaluation score, and beat evaluation score, and selects a song based on the comparison result. You can correct a plurality of pitches, strengths, and beats included in .

When a user who recognizes at least one of text data, image data, video data, and a vibration control signal included in the selected song learning data utters a voice matching it, the selected song learning unit 105 responds to the uttered voice At least one of text data, image data, and vibration for pitch and size is provided to the user.

At least one of text data, image data, video data, and vibration control signals included in the selected song learning data and at least one of text data, image data, and vibration for the pitch and size corresponding to the uttered voice can be provided at the same time have.

Next, a process of the music education method S1 according to an embodiment of the present invention will be described in detail with reference to FIGS. 11 to 13 .

Referring to FIG. 11 , the music education apparatus 100 provides sound learning so that the user can learn about at least one of a pitch, a size, and a beat ( S10 ).

Referring to FIG. 12 , a detailed flow of providing sound learning ( S10 ) is shown.

First, the music education apparatus 100 receives the user's voice data (S11).

When the user's voice data is received, the music education apparatus 100 determines whether the received voice data matches all notes of at least one octave (S12).

When all sounds of at least one octave are matched, the music education apparatus 100 provides pitch and magnitude learning for at least one octave among the matched octaves (S13).

In one embodiment, when the received voice data is matched with 1 octave and 2 octaves of do, re, mi, fah, sol, la, and si, the music education apparatus 100 stores at least one of 1 octave and 2 octaves. Provides pitch and magnitude learning for A description of pitch and magnitude learning is replaced by a description of the tone learning unit 102 .

Since the user provides learning about the pitch and the size while recognizing the pitch of at least one octave, the learning effect may be improved.

The music education apparatus 100 provides rhythm learning to the user (S14). The description of the beat learning is replaced by the description of the note learning unit 102 .

Referring back to FIG. 11 , when sound learning is completed, the music education apparatus 100 provides a sound learning evaluation to the user ( S20 ). The description of the sound learning evaluation replaces the description of the sound learning evaluation unit 103 .

When the sound learning evaluation is completed, the music education apparatus 100 determines whether to recommend a song (S30).

When the song recommendation is performed, the music education apparatus 100 calculates a recommended song based on the user's pitch evaluation score, size evaluation score, and time signature score ( S40 ).

In an embodiment, a recommended song may be calculated based on the user's sound range information, a pitch evaluation score, a size evaluation score, and a time signature evaluation score.

In another embodiment, different addition coefficients are calculated based on the user's preference information for sound range, pitch, size, and tempo, and the user's range information, pitch evaluation score, size evaluation score, and beat evaluation score and the matching degree of the song Multiplied by different addition factors can be summed together. A song having the highest sum value may be selected as a recommended song.

When the recommended song is calculated, the music education apparatus 100 provides the recommended song learning to the user ( S50 ). The description of the recommended song learning replaces the description of the recommended song learning unit 104 .

When the song recommendation is not performed, the music education apparatus 100 receives a selected song from the user (S60).

Referring to FIG. 13 , an exemplary embodiment of the selection song receiving step ( S60 ) of the music education apparatus 100 is illustrated.

The music education apparatus 100 receives a selection song from the user (S61).

The music education apparatus 100 compares the user's pitch range information, pitch evaluation score, size evaluation score, and tempo evaluation score with the selected song (S62), and if there is something greater than the error range (S63), select based on the comparison result It is possible to correct the song (S63).

In an embodiment, when the sound range of the selected song is higher than the user's sound range, the sound range of the selected song may be corrected according to the user's sound range. For example, when the user's time evaluation score for the time used in the selected song is low, the playback speed (tempo) of the selected song may be corrected to be slow.

By correcting the selection song according to the user's ability, the learning effect for the selection song may be improved.

Referring back to FIG. 11 , the music education apparatus 100 provides the user with the selection song learning ( S70 ). The description of the selection song learning replaces the description of the selection song learning unit 105 .

In an embodiment, the music education apparatus 100 divides the sheet music of the selected song for each measure, and selects a measure in which at least one of a pitch evaluation score, a size evaluation score, and a beat evaluation score is greater than or equal to a preset error range among the divided measures. . The music education apparatus 100 may generate selective learning data including all of the selected measures, and provide selective learning to the user based on the selected learning data.

FIG. 14 is a diagram exemplarily illustrating a hardware configuration of the music education apparatus 100 according to FIG. 1 .

Referring to FIG. 14 , the music education apparatus 100 stores at least one processor 110 and instructions for instructing the at least one processor 110 to perform at least one operation. It may include a memory (memory).

The at least one operation may include the components 101 to 105 of the above-described music education apparatus 100 or other functions or operation methods.

Here, the at least one processor 110 may mean a central processing unit (CPU), a graphics processing unit (GPU), or a dedicated processor on which methods according to embodiments of the present invention are performed. can Each of the memory 120 and the storage device 160 may be configured as at least one of a volatile storage medium and a non-volatile storage medium.

For example, the memory 120 may be one of a read only memory (ROM) and a random access memory (RAM), and the storage device 160 is a flash-memory. , a hard disk drive (HDD), a solid state drive (SSD), or various memory cards (eg, micro SD card).

Also, the music education apparatus 100 may include a transceiver 130 that performs communication through a wireless network. Also, the music education apparatus 100 may further include an input interface device 140 , an output interface device 150 , a storage device 160 , and the like. Each of the components included in the music education apparatus 100 may be connected by a bus 170 to communicate with each other.

For example, the music education device 100, a communicable desktop computer (desktop computer), a laptop computer (laptop computer), a notebook (notebook), a smart phone (smart phone), a tablet PC (tablet PC), a mobile phone (mobile) phone), smart watch, smart glass, e-book reader, PMP (portable multimedia player), portable game console, navigation device, digital camera, DMB (digital multimedia broadcasting) ) player, digital audio recorder, digital audio player, digital video recorder, digital video player, PDA (Personal Digital Assistant), and the like.

The methods according to the present invention may be implemented in the form of program instructions that can be executed by various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the computer readable medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the art of computer software.

Examples of computer-readable media may include hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions may include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as at least one software module to perform the operations of the present invention, and vice versa.

In addition, the above-described method or apparatus may be implemented by combining all or part of its configuration or function, or may be implemented separately.

Although the above has been described with reference to preferred embodiments of the present invention, those skilled in the art can variously modify and change the present invention within the scope without departing from the spirit and scope of the present invention as set forth in the claims below. You will understand that it can be done.

Claims (5)

As a music education device for the hearing impaired using vibration and visual data,
at least one processor; and
and a memory for storing instructions instructing the at least one processor to perform at least one operation,
The at least one operation is
receiving voice data from a user;
generating at least one of text data, image data, and a vibration control signal corresponding to a pitch and a size of the received voice data; and
Displaying at least one of the generated text data and the image data to the user, or providing a vibration corresponding to the vibration control signal to the user,
The music education device is communicatively connected to a vibration device including a plurality of vibration modules disposed in each of a plurality of regions,
The vibration control signal includes position data corresponding to a plurality of different pitches and magnitude data corresponding to a plurality of different pitches,
The location data indicates the location of any one of the plurality of areas,
The music education device is communicatively connected to a vibration device including a plurality of vibration modules disposed in each of the plurality of regions of the user,
The vibration control signal includes position data corresponding to a plurality of different pitches and magnitude data corresponding to a plurality of different pitches,
The location data indicates the location of any one of the plurality of areas, the music education apparatus. delete delete In claim 1,
The vibration control signal includes frequency data corresponding to a plurality of different octaves,
The frequency data includes any one of a plurality of frequencies, music education apparatus. In claim 1,
The vibration control signal includes first position data corresponding to a plurality of different pitches and second position data corresponding to a plurality of different sound levels,
The first location data indicates the location of any one of the plurality of areas,
The second location data indicates the location of any one of the plurality of vibration modules, music education device.

Images