KR102148867B1 - System for providing art integarated education service with singing and drawing - Google Patents

Abstract

Provided is a system for providing an educational service linking singing with drawing, comprising: a learner terminal in which the age of a learner is inputted and which selects a learning program stored in advance for each stage corresponding to the inputted age, outputs singing contents corresponding to the selected learning program, and receives a drawing corresponding to the lyric text of the singing contents; and an educational service providing server. The educational service providing server comprises: an input unit which receives the age from the learner terminal; a transmission unit which transmits to the learner terminal the learning program stored in advance for each stage corresponding to the inputted age; a contents providing unit which transmits to the learner terminal singing contents and drawing contents corresponding to the learning program selected by the learner terminal; a determination unit which determines, when the inputted drawing contents and singing contents are being outputted by the learner terminal, whether or not the similarity with a pre-stored configuration figure template corresponding to the lyric text of the singing contents is higher than a predetermined reference value; and a replay unit which replays, when the similarity does not satisfy the predetermined level of similarity, the part of the singing contents including the lyric text corresponding to the configuration figure template. Therefore, the learner′s creativity and understanding can be improved.

Description

System for providing education service linking song and drawing {SYSTEM FOR PROVIDING ART INTEGARATED EDUCATION SERVICE WITH SINGING AND DRAWING}

The present invention relates to a system for providing an education service linking songs and drawings, and provides a platform capable of reminiscent of texts including figures, Korean characters, foreign languages and numbers from songs.

Traditional play songs that occur naturally in children's lives and come down to the oral tradition represent the basic musical characteristics of each ethnic group in the easiest form. Also, as it is like a play tool for children, lyrics and music do not exist independently, but are combined with play to become a component of play. In addition to the children's environment and play method, there are differences according to ethnic groups in traditional play songs. For example, handwriting is the majority of Japanese traditional nori songs, and among them, picture-song nori has been handed down a lot, compared to only one or two examples in Asian ethnic groups. On the other hand, while there are differences in how to play and songs depending on the people, even if the people are different or in different environments or customs, we can find common points in the rules of play, musicality, and paintings.

At this time, multiplication play using sweets was researched and developed to understand the mechanism of multiplication through music of the genre of rap. In this regard, Korean Patent Publication No. 2018-0047029 (published on May 10, 2018), a prior art, relates to multiplication play using sweets, and listens to a multiplication multiplication table song in a wrap so that learners can understand it easily. It is possible to understand the mechanism of multiplication by placing a corresponding amount of confectionery beads, and a multiplication game body constructed so that multiplication results from 1 to 9 can appear in a square, and the number of multiplication results is displayed so that the result of the multiplication is expressed as a number. The number of multiplication results organized so that you can see the number of confectionery beads in the same amount as the picture of confectionery beads. A picture of confectionery beads composed of a picture frame so that confectionery can be placed as many as the number of multiplication results. A multiplication table composed of a multiplication table, a multiplication multiplication table composed of a QR code, and a multiplication table made of grain so that you can place the confectionery beads corresponding to the multiplication result while listening to the multiplication multiplication table song in Rap. It includes confectionery beads formed so that the shape of the confectionery can be expressed so that it can be seen.

However, even if the above-described configuration is used, the result of the calculation performed by simply memorizing the multiplication table without understanding the principle is no different from that of the calculator, so the thinking or the depth of understanding does not increase. In addition, in addition to numbers, there are various concepts of objects or the meanings or forms of words to be learned in infancy, and it is not solved at all by memorizing the abbreviated multiplication table table. Moreover, there is a need to develop a textbook or platform that can use the brain in a balanced manner without the absence of textbooks or contents that can use art and thinking skills together so that the left and right brains can be used together.

In one embodiment of the present invention, it is possible to recognize the shape of an object from the lyrics of music, or to learn concepts such as the name and principle of the object, and through a song, various concepts or meanings from figures, objects, Korean, mathematical thinking skills, and foreign languages. The song helps you to understand intuitively, and to use the right and left brain together by integrating the art area using the right brain and the thinking area using the left brain, and helping to increase the depth of understanding as well as creativity with rich contents. It is possible to provide an educational service provision system that links with drawing. However, the technical problem to be achieved by the present embodiment is not limited to the technical problem as described above, and other technical problems may exist.

As a technical means for achieving the above-described technical problem, an embodiment of the present invention includes inputting a learner's age, selecting a learning program pre-stored step by step at the input age, and providing song content corresponding to the selected learning program. A learner terminal that outputs and receives a picture corresponding to the lyrics text of the song content, an input unit that receives an age from the learner's terminal, a transmission unit that transmits a learning program previously stored in stages at the input age to the learner terminal, and a learner terminal A content providing unit that transmits the song content and picture content corresponding to the learning program selected from to the learner's terminal, the picture content input from the learner's terminal, and a pre-stored configuration figure template corresponding to the lyrics text of the song content when the song content is output. Including a determination unit that determines whether the similarity of with is greater than or equal to a preset reference value, and, when the similarity does not satisfy the preset similarity, replays the song content of the portion including the lyrics text corresponding to the constituent figure template. It includes an education service providing server.

According to any one of the above-described problem solving means of the present invention, it is possible to recognize the shape of an object from the lyrics of music or to learn concepts such as the name and principle of the object, and through a song, a figure, an object, Korean, mathematical thinking ability and Intuitive understanding of various concepts and meanings up to foreign languages, combining the right-brained art area and the left-brained thinking area to enable the use of the right and left brains together, and rich contents to the depth of understanding as well as creativity It can help you grow.

1 is a diagram for explaining a system for providing an education service linking a song and a drawing according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating an education service providing server included in the system of FIG. 1.
FIG. 3 is a diagram for explaining an embodiment in which a drawing activity for infants is implemented among educational services linking songs and drawing according to an embodiment of the present invention.
4 is a view for explaining an embodiment in which a Hangul game to learn by drawing is implemented among the educational services linked to a song and drawing according to an embodiment of the present invention.
FIG. 5 is a diagram for explaining an embodiment in which thinking ability mathematics learning by drawing is implemented among educational services linking songs and drawing according to an embodiment of the present invention.
6 is a view for explaining an exemplary embodiment in which English learning by drawing is implemented among educational services linked to a song and drawing according to an exemplary embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are assigned to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, it means that other components may be further included, and one or more other features, not excluding other components, unless specifically stated to the contrary. It is to be understood that it does not preclude the presence or addition of any number, step, action, component, part, or combination thereof.

The terms "about", "substantially" and the like, as used throughout the specification, are used in or close to the numerical value when manufacturing and material tolerances specific to the stated meaning are presented, and are used in the sense of the present invention. To assist, accurate or absolute figures are used to prevent unfair use of the stated disclosure by unscrupulous infringers. As used throughout the specification of the present invention, the term "step (to)" or "step of" does not mean "step for".

In the present specification, the term "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Further, one unit may be realized using two or more hardware, or two or more units may be realized using one hardware.

In this specification, some of the operations or functions described as being performed by the terminal, device, or device may be performed instead in a server connected to the terminal, device, or device. Likewise, some of the operations or functions described as being performed by the server may also be performed by a terminal, device, or device connected to the server.

In this specification, some of the operations or functions described as mapping or matching with the terminal means mapping or matching the unique number of the terminal or the identification information of the individual, which is the identification information of the terminal. Can be interpreted as.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram for explaining a system for providing an education service linking a song and a drawing according to an embodiment of the present invention. Referring to FIG. 1, an education service providing system 1 linking a song and a drawing may include at least one learner terminal 100, an education service providing server 300, and at least one other learner terminal 400. have. However, since the education service providing system 1 linking the song and drawing of FIG. 1 is only an embodiment of the present invention, the present invention is not limitedly interpreted through FIG. 1.

In this case, each component of FIG. 1 is generally connected through a network 200. For example, as shown in FIG. 1, at least one learner terminal 100 may be connected to the education service providing server 300 through the network 200. In addition, the education service providing server 300 may be connected to at least one learner terminal 100 and at least one other learner terminal 400 through the network 200. In addition, at least one other learner terminal 400 may be connected to the education service providing server 300 through the network 200.

Here, the network refers to a connection structure in which information exchange is possible between respective nodes such as a plurality of terminals and servers, and examples of such networks include RF, 3rd Generation Partnership Project (3GPP) network, and Long Term (LTE). Evolution) network, 5GPP (5th Generation Partnership Project) network, WIMAX (World Interoperability for Microwave Access) network, Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network) , Personal Area Network (PAN), Bluetooth (Bluetooth) network, NFC network, satellite broadcasting network, analog broadcasting network, Digital Multimedia Broadcasting (DMB) network, and the like, but are not limited thereto.

In the following, the term “at least one” is defined as a term including the singular number and the plural number, and even if the term “at least one” does not exist, each component may exist in the singular or plural, and may mean the singular or plural. It will be self-evident. In addition, it will be possible to change according to the embodiment that each component is provided in a singular or plural.

The at least one learner terminal 100 outputs content for learning by selecting a desired type of program and a step-by-step program of the program by using an educational service-related web page, app page, program, or application linking songs and drawing. , It may be a terminal that receives the learner's content and transmits it to the education service providing server 300. In this case, the at least one learner terminal 100 may be a terminal that plays back song content, adjusts a speed, or performs a function such as pause so as to correspond to the input picture content. In addition, the at least one learner terminal 100 may be a terminal that receives each associated text or figure, such as pictures, Korean, math, and English (foreign language), through a song. Here, the at least one learner terminal 100 may download each selected program from the education service providing server 300 and execute it, or may be a terminal that transmits and receives data in real time through real-time streaming, which is at least one learner. It may vary according to networking resources or computing resources of the terminal 100. In addition, at least one learner terminal 100 receives a picture including a song, a figure corresponding to it, text, etc. by itself, synchronizes and stores each picture, etc. with time so as to correspond to the lyrics text of the song, It may be a terminal shared with the education service providing server 300.

Here, the at least one learner terminal 100 may be implemented as a computer that can access a remote server or terminal through a network. Here, the computer may include, for example, a navigation system, a notebook equipped with a web browser, a desktop, a laptop, and the like. In this case, the at least one learner terminal 100 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one learner terminal 100, for example, as a wireless communication device that is guaranteed portability and mobility, navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS(Personal Handyphone System), PDA(Personal Digital Assistant), IMT(International Mobile Telecommunication)-2000, CDMA(Code Division Multiple Access)-2000, W-CDMA(W-Code Division Multiple Access), Wibro(Wireless Broadband Internet) ) All types of handheld-based wireless communication devices such as terminals, smartphones, smartpads, and tablet PCs may be included.

The education service providing server 300 may be a server that provides an education service web page, an app page, a program, or an application in association with a song and a drawing. And, the education service providing server 300, when selecting the type and stage of the program in the learner terminal 100, to stream or transmit the song content corresponding to the selected program and stage to the learner terminal 100 in real time. It could be a server. And, the education service providing server 300, when the song content is played in the learner terminal 100, outputs a pre-stored configuration figure template corresponding to the lyrics text of the part to be played, and is input from the learner terminal 100 It may be a server that checks whether the picture content is similar to a pre-stored configuration figure template, and if it does not satisfy a preset standard similarity, replays or stops the song of the corresponding part, thereby giving the learner time to draw. In addition, the education service providing server 300, in addition to the programs and steps selected by the learner, when the learner inputs songs, figures, text, etc., receives them, stores them as self-composed content, and stores them as at least one other learner terminal 400 It can be a server shared by

Here, the education service providing server 300 may be implemented as a computer that can access a server or terminal in a remote location through a network. Here, the computer may include, for example, a navigation system, a notebook equipped with a web browser, a desktop, a laptop, and the like.

The at least one other learner terminal 400 may be an education service-related web page, an app page, a program, or a terminal of another learner using an application. At this time, the function of the learner terminal 100 may be performed in at least one other learner terminal 400, but for the convenience of explanation of the present invention, the other learner terminal 400 is a self-composed content shared by the learner terminal 100. Is limited to the shared role. However, as described above, it will be apparent that the function of the learner terminal 100 can be performed in the other learner terminal 400 and the function of the other learner terminal 400 can be performed in the learner terminal 100 as well. .

Here, the at least one other learner terminal 400 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, a navigation system, a notebook equipped with a web browser, a desktop, a laptop, and the like. In this case, the at least one other learner terminal 400 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one other learner terminal 400, for example, as a wireless communication device that is guaranteed portability and mobility, navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular) , PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband) Internet) terminal, smart phone (smartphone), smart pad (smartpad), such as a tablet PC (Tablet PC) may include all kinds of handheld-based wireless communication devices.

FIG. 2 is a block diagram illustrating an education service providing server included in the system of FIG. 1, and FIG. 3 is a block diagram illustrating an embodiment in which an education service linking a song and a drawing is implemented according to an embodiment of the present invention. It is a drawing for.

Referring to FIG. 2, the education service providing server 300 includes an input unit 310, a transmission unit 320, a content providing unit 330, a determination unit 340, a playback unit 350, and a database unit 360. , It may include a self-composed song management unit 370, a sharing unit 380 and a guide unit 390.

The education service providing server 300 according to an embodiment of the present invention or another server (not shown) operated in conjunction with the song and drawing with at least one learner terminal 100 and at least one other learner terminal 400 In the case of transmitting an education service application, program, app page, web page, etc. linked to, at least one learner terminal 100, and at least one other learner terminal 400, an education service application, program linking song and drawing , App pages, web pages, etc. can be installed or opened. In addition, a service program may be driven in at least one learner terminal 100 and at least one other learner terminal 400 by using a script executed in a web browser. Here, the web browser is a program that enables you to use the web (WWW: world wide web) service, and refers to a program that receives and displays hypertext described in HTML (hyper text mark-up language). For example, Netscape , Explorer, chrome, etc. In addition, the application means an application on the terminal, and includes, for example, an app that is executed on a mobile terminal (smartphone).

Referring to FIG. 2, the input unit 310 may receive an age input from the learner terminal 100. At this time, the learner terminal 100 inputs the learner's age, selects a learning program pre-stored step by step at the input age, outputs song content corresponding to the selected learning program, and corresponds to the lyrics text of the song content. Pictures can be input. For example, if the song content is "it was drawn by drawing two large circle dates", "○" should be input from the learner terminal 100 in the part corresponding to "large circle". And, in the "Date Two Dates" part, two dates (│) must be drawn like 『││』. When a circle is placed on the two dates in this way, a tree-like shape appears. At the time when the song content corresponding to the lyrics text of "Large Circle" comes out, "○" must be entered, and "Two Dates" At the time when song content corresponding to the lyrics text appears, "││" must be entered. Unless you only need to draw two simple figures like the above song, once you miss the beat, the drawing will be out of order, so you will have to listen again or complete a strange picture. Therefore, the content providing unit 330 to the playback unit 350, which will be described later, checks whether a figure suitable for each lyrics is input at the corresponding time, and if it is not input or is not properly input (such as (Displayed, etc.), the corresponding part is played again so that the figure or text (Korean, number, foreign language, etc.) corresponding to the lyrics text is input, and the input is not possible or incorrect even if the preset number of times is repeated (the similarity is less than the standard value). For example, the guide line is overlaid so that you can draw along the guide line.

The transmission unit 320 may transmit a learning program pre-stored step by step at the input age to the learner terminal 100. For example, at the age of 4, as shown in Fig. 3A, the basic song art 1 (Song Art 1)-the basic song song art 2 (Song Art 2)-the basic song song art 3 (Song Art 3)-the basic song song art 4 (Song Art 4)-Basic Song As with Song Art 5, when age is selected, a curriculum may be created to select each level. Of course, it is not limited thereto, and even if the age is 4, a 5-year-old curriculum may be provided to learners who have learned all of the 4-year-old curriculum, and vice versa.

Returning to FIG. 2 again, the content providing unit 330 may transmit song content and picture content corresponding to the learning program selected by the learner terminal 100 to the learner terminal 100. At this time, the content providing unit 330 stores the melody content to be synchronized with the lyrics text and time when the melody content excluding the lyrics text from the song content is generated in the learner terminal 100, and stores the lyrics text of the generated melody content Configuration figure templates can be mapped and saved so that they are synchronized with and time. Here, the picture content may be a background content for a learner to input a figure or text corresponding to the song lyrics, a picture drawn by another learner, or a picture in which an object corresponding to the song lyrics is a subject. For example, if the text of the lyrics of the song “Become a Ship” is "It has become a three-way, three-way rocking wave. I draw a square on the wave and draw a flag on it to become a ship", the objects at this time are the wave and the ship on the wave. It may be a method of transmitting a picture as picture content to the learner terminal 100 to give a hint, transmitting a picture content drawn by another learner to the learner terminal 100, or transmitting background content such as a seagull, but is not limited thereto. .

The determination unit 340 determines whether the similarity between the picture content input from the learner terminal 100 and a pre-stored configuration figure template corresponding to the lyrics text of the song content when the song content is output is greater than or equal to a preset reference value. I can judge. For example, if the lyric text of the song content is "I put a triangle on the square and became a house", when the song content corresponding to the lyrics text of "The square" is output, "□" should be entered, and "Put a triangle on top". When song content corresponding to the lyrics text is displayed, "△" should be drawn on the square. At this time, the constituent figure template of “□” is mapped to the lyrics text “square” and stored, and the constituent figure template of “△” is mapped and stored in the lyrics text “Put the triangle on top”. Accordingly, the square (corresponding branch on the score)-square (lyric text)-``□'' are mapped and saved, and the triangle (corresponding branch on the score)-triangle (lyric text)-``△'' can be mapped and saved. , Check whether the picture entered by the learner is a figure or text corresponding to the lyrics. Here, when measuring the similarity, if the shape is similar, it is determined that there is a similarity, and its size or deformation is ignored. This is because even if you draw a triangle or square, you can draw in a different shape or size according to each learner (infant or elementary school student, etc.). Accordingly, in the case of a triangle, if three vertices and three vertices are connected to each other by a closed loop, it can be determined that the similarity is greater than or equal to the reference value. Similarly, even in the case of a square, if there are four vertices and line segments between the four vertices are connected to each other by closed lines, it can be determined that the similarity is greater than or equal to the reference value. Here, even if it is not connected by a completely closed line, it may be determined that it is more than the reference value. As such, if the shape is similar, it can be determined that an error such as whether the size or angle straight line is completely connected to each vertex does not affect the degree of similarity. At this time, as the grade increases, the required standard may be strict, so it is obvious that the type and degree of error processing may change according to age or level (level).

When the similarity degree does not satisfy a preset similarity, the playback unit 350 may replay the song content of a portion including the lyrics text corresponding to the constituent figure template. For example, suppose there is a song content in which the lyrics text "In a large circle~ A small circle with a tail attached to it, and a floating balloon" exists. At this time, if the circle is not drawn at the time point corresponding to the "large circle", there is a high possibility that even the small circle at the time point of the "small circle" misses the beat and cannot draw. Therefore, when the picture content corresponding to the circle is not input from the learner terminal 100 at the time point corresponding to the "large circle", the song content corresponding to the "large circle" is replayed, or the playback is stopped to draw a picture. You can give it time to spare. Alternatively, replay may be performed in a manner that repeats a song after all of the songs are finished, but the present invention is not limited thereto and may be variously modified according to exemplary embodiments.

The database unit 360 may extract lyrics text from song content as STT (Speak Text) and map and store a constituent figure template corresponding to the extracted lyrics text. As described above, song content includes melody, pitch, beat, and lyrics, extracting lyrics from the voice, and converting the extracted lyrics into text, and keywords (nouns, pronouns, etc.) included in the text are stored figures It can be mapped and saved with a template, or a template obtained by extracting only the outline from a picture or picture, which is the result of web crawling a keyword as a search word, can be mapped and saved. In this case, since the method of extracting the outline can be easily extracted through boundary line extraction (outline extraction, Edge & Edge Detection), a detailed description will be omitted. For example, suppose the lyrics text of the song content is "A big circle twinkling sun, where is the twinkling sun? A small circle turned into a long circle cloud". The nouns at this time are sun, cloud, and sun and cloud Can be extracted as a keyword. At this time, web crawling using the sun and clouds as search words may be performed, and photos, illustrations, or pictures corresponding to the sun and clouds may be collected. When configuring an image template through the extraction of the boundary line between the sun and the cloud, it is possible to check whether the picture content input by the learner is a picture corresponding to each lyrics. In this case, a digital image process may be used, or processes such as image input, pre-processing, feature extraction, recognition and interpretation, and determination may be performed, but are not limited thereto. Here, in addition to the method for determining similarity using template matching, a method using a threshold value or a mosaic detection algorithm may be used, but the present invention is not limited thereto.

The self-written song management unit 370 stores the self-written content received from the learner terminal 100, separates the music content and the drawing content included in the self-written content, and configures drawing content corresponding to the lyrics text of the separated music content. At least one frame may be stored in synchronization with time, and sheet music content may be generated from music content and stored as self-composed content to correspond to lyric text, drawing content, and at least one frame. For example, if a learner has completed a song melody, lyrics, and picture, it is digitalized so that it can be shared, and the other learner terminal 400 also shares it so that it can be used like a general learning program. For example, a learner named "A draws a tall square, draws a tall square, draws a tall square, turns into an apartment, where is the window, where is the doorway, where is the street?" And it is assumed that a figure corresponding to each lyrics text is completed. In this case, a melody including a pitch and a beat, such as a pitch, etc., is extracted from the learner's utterance, and a figure is mapped and stored by extracting a boundary line from picture content input corresponding to each lyric text. Here, since the learner's song content does not have an accompaniment in most cases, the administrator manually includes the accompaniment separately or automatically generates the accompaniment with a basic harmony corresponding to each pitch according to an embodiment of the present invention. You can also share.

At this time, for automatic accompaniment, the method according to an embodiment of the present invention may use reinforcement learning. Of course, techniques such as probability model, Markov Chain, Formal Grammar, Finite State Machine, Fractal, etc., which are various mathematical algorithms, can also be used in the existing music composition field. have. Here, reinforcement learning is a learning method in which there is an agent that searches for a certain environment, and the agent finds a policy defined as a series of actions that maximize the rewards accumulated in the future. For real-time music composition based on reinforcement learning, the agent must recognize the progress of the current music and generate an accompaniment code accordingly. Then, by determining how appropriate the generated accompaniment music is in the next state, appropriate compensation is obtained. Here, the system learns and develops whether the action taken in each state is appropriate through the given reward value.

To this end, the reinforcement learning model includes an agent, an environment, and a policy, and may consist of a set of state, action, and reward. The accompaniment code of one bar generated for one bar is classified according to the state, the current state is analyzed to predict the melody that may appear in the next state, and the accompaniment code is generated accordingly. The accompaniment chords of can be defined as actions. At this time, there is a method of determining whether the generated accompaniment chords match well with the expected melody in the following state and allocating the appropriate compensation. After learning the received code and saving it as a probability table using a Markov chain, you can use this method. Evaluate the degree to which the melody and accompaniment code match is manually evaluated by a person, or automatically according to the harmonological basic code. It can also be evaluated as. In addition, the next state to be transferred from the current state is represented by each probability value according to the code progression rule, and state transformation is learned using the Monte Carlo method. In other words, it analyzes how well the new code generated in each state matches the melody and assigns an appropriate compensation value according to the degree of matching. The allocated compensation value is reflected back to the value of the probability table, and since the sum of the probability values of each state must be 1, all probability values of the corresponding states are normalized.

In order to accurately define musically the degree of harmony between the melody received as an input from the learner and the accompaniment code obtained through reinforcement learning, various musical understandings, such as the mode theory such as the Available Note, are required. . j However, in one embodiment of the present invention, for example, if the chord name is C, types of chords (C6, CM7, etc., if you want to play with a jazz-like feel) depending on the genre of music or the player The part considering such a genre is simplified without considering it in an embodiment of the present invention. However, the above-described genre is not excluded. The most basic and efficient way to harmonize melody and accompaniment chords well is to create chordles using the notes present in the melody. If you have a melody composed of Do, Mi, and Solo, C chords are most suitable. Specifically, a histogram can be used to analyze the notes constituting the melody. When there are notes that make up a melody of a bar, these notes are compared with the histogram of each chord after defining the histogram generated by calculating the frequency of 12 notes in each chromatic scale, that is, 12 pitch classes. And analyze how well it harmonizes. In addition, when generating accompaniment chords, if only the optimal chord is used, the same chord may be repeated over and over again and become boring. Therefore, it is necessary to allow exchange within this chord group (Cluster, Group) in consideration of the generated chord group. May be. In this case, even a song uttered with a simple melody can generate rich accompaniment codes with various feelings in real time, or can have the same quality as the actual music produced when it is automatically generated and shared later.

Meanwhile, as a method of converting a melody, which is a premise of automatic accompaniment, to sheet music, an Automatic Chord Generating Program (ACGP) may be used, but is not limited thereto. The work of creating a chord score based on a melody is an important score work that is directly connected to the writing and arrangement of music. However, since a rich harmonological background knowledge is required for natural chord score generation, it is very difficult for beginners to perform. Therefore, according to an embodiment of the present invention, a melody score is received and a chord score is automatically generated, and based on a genetic algorithm, various harmonological factors and a user's desired mood of the song can be efficiently considered. It makes it possible to generate more harmonically stable chord scores. In addition, it is possible to automatically evaluate the appropriateness of the program by comparing and analyzing the chord score generated by ACGP with the commonly used chord score. Of course, it will be apparent that in addition to the above-described method, various methods for automatically recording sheet music may be modified and used according to embodiments.

The sharing unit 380 may upload and share the self-written music content to a platform provided by the education service providing server 300. In this case, it is also possible to provide a preset reward to the learner terminal 100 shared by the shared number. Alternatively, it is possible to provide a reward through the score evaluated in addition to the shared number.

When the song content is output from the learner terminal 100, the guide unit 390 allows an outline of a pre-stored configuration figure template corresponding to the lyrics text of the song content to be overlaid on the screen of the learner terminal 100. Can be controlled. Here, the pre-stored configuration figure template may include a text template including numbers, Korean, foreign languages, and figures. Accordingly, it may not be applied in the case of drawing a picture in which creativity is emphasized, but it may be applied in a field in which a fixed number of strokes, order, or shape is fixed, such as numbers, Korean, or foreign languages. Of course, the application is not excluded even in the case of drawing.

Hereinafter, an operation process according to the configuration of the education service providing server of FIG. 2 will be described in detail with reference to FIGS. 3 to 6 as an example. However, it will be apparent that the embodiment is only any one of various embodiments of the present invention, and is not limited thereto.

Referring to FIG. 3A, it can be seen that there are various programs and stages including Korean, mathematical thinking, cognition, and brain development as well as pictures through songs. In addition, referring to FIG. 3B, it is possible to learn the concept of basic figures and words while singing songs from 4 to 6 years old, and referring to FIG. 3C, it is possible to measure cognitive development, through which communication and counseling tools Make it available as. Referring to FIG. 3D, a program from 3 years old (4 years old) to 5 years old (6 years old) is shown. At each age, it is possible to measure the listening and awareness seen in drawing representations, and check the infant's psychology, temperament, and disposition recorded in the essays and discussion classes. Of course, as age and stage increase, the complexity of drawing or the required accuracy may increase. Referring to Figure 3e, each song includes an identification code (bar code, NFC tag, etc.) including a QR code, so when you want to listen to only each song, if you scan the identification code, it is configured to output the song from another terminal. .

3f shows the score of the theme song, and the theme song includes basic shapes such as triangles, squares, and circles, and lyrics indicating how to draw objects (apartments, balloons, eyes, waves) by arranging the basic shapes. have. Of course, in addition to the melodies and lyrics of the above sheet music, various versions of melodies and lyrics can be included, and what kind of lyrics that tells the concept of the basic figure and what object can be drawn when the basic figure is arranged in what array. It will also be possible. Referring to FIG. 3G, with the theme of running or running in a longer circle by attaching a circle, a sticker or the like is attached or picture contents corresponding to the sticker are arranged on the screen, and various objects can be drawn using this. Likewise, it is possible to provide basic objects such as a long side date or red-collar chopa-nambo, and leave the rest to the imagination of learners such as infants and fill them. 3H, the All Brain class is a method of listening to the motivation of a leader (teacher), arranging the map, and then drawing an opinion with a picture. The learner terminal 100 receives picture content from the learner. Can be input. For example, it is possible to describe four concepts that can extend out of one word, sunim, and to input picture content corresponding to each concept.

4A to 4C are programs for learning Korean through various contents including songs. It is possible to provide a process that enables students to grasp concepts that are the basis of thinking from various subjects, and to infer Hangul from pictures. Likewise, FIGS. 5A to 5C are programs for learning math through various contents including songs. And, Figure 6 is a program that allows you to learn English by grafting songs and pictures into English. As described above, by grafting the thinking area using the left brain with the art area using the right brain, as well as developing the brain, each concept can be intuitively understood by learning through intuitive songs or pictures, such as the ancient idioms It can provide rich content to learners of infancy or elementary school who catch the concept and help them to grasp the correct concept.

The matters not described for the method of providing the education service linking the song and drawing of FIGS. 2 to 6 are the same as or from the description of the method of providing the education service linking the song and drawing through FIG. Since it can be easily inferred, the following description will be omitted.

The education service providing system linking songs and drawings according to the exemplary embodiment described with reference to FIGS. 1 to 6 is in the form of a recording medium including instructions executable by a computer such as an application or program module executed by a computer. Can also be implemented. Computer-readable media can be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. Further, the computer-readable medium may include all computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The above-described education service providing system linking songs and drawings according to an embodiment of the present invention is provided by an application basically installed in a terminal (this may include a program included in a platform or an operating system basically installed in the terminal). It may be executed, and may be executed by an application (ie, a program) directly installed on the master terminal by a user through an application providing server such as an application store server, an application, or a web server related to the service. In this sense, the education service providing system linking songs and drawings according to an embodiment of the present invention described above is implemented as an application (i.e., a program) that is basically installed on a terminal or directly installed by a user, and is implemented on a computer such as a terminal. It can be recorded on a readable recording medium.

The above description of the present invention is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains will be able to understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative and non-limiting in all respects. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

Claims (7)

A learner terminal that inputs the learner's age, selects a learning program previously stored in stages at the input age, outputs song content corresponding to the selected learning program, and receives a picture corresponding to the lyrics text of the song content ; And
An input unit that receives an age from the learner terminal, a transmission unit that transmits a learning program pre-stored step by step at the input age to the learner terminal, and a song content and picture content corresponding to the learning program selected in the learner terminal. Whether the similarity between the picture content input from the learner's terminal and the picture content inputted from the learner's terminal and a pre-stored constitution figure template corresponding to the lyrics text of the song content is greater than or equal to a preset reference value when the song content is output An education service providing server including a determining unit for determining the similarity, and a playback unit for replaying the song content of a portion including lyric text corresponding to the constituent figure template when the similarity does not satisfy a preset similarity; and
The education service providing server includes: a database unit which extracts lyrics text from the song content as STT (Speak Text), maps and stores a constituent figure template corresponding to the extracted lyrics text; Stores the self-written content received from the learner's terminal, separates the music content and the drawing content included in the self-written content, and sets at least one frame constituting the drawing content corresponding to the lyrics text of the separated music content in time. A self-composed music management unit that synchronizes and stores, generates music content from the music content, and stores it as self-composed content to correspond to the lyrics text, drawing content, and at least one frame; And a sharing unit for uploading and sharing the self-written music content to a platform provided by the education service providing server.
delete delete delete The method of claim 1,
A guide unit controlling an outline of a pre-stored configuration figure template corresponding to the lyrics text of the song content to be overlaid on the screen of the learner terminal when the song content is output from the learner terminal;
An educational service providing system linking songs and drawing, characterized in that it further comprises.
The method of claim 1,
The pre-stored configuration figure template includes a text template including numbers, Korean, foreign languages, and figures.
The method of claim 1,
The content providing unit,
When the melody content excluding the lyric text from the song content is generated in the learner's terminal, the melody content is stored in synchronization with the lyric text and time, and the configuration figure is synchronized with the lyric text and time of the generated melody content An educational service providing system linking songs and drawings, characterized in that the template is mapped and stored.

Images