KR102184378B1 - Artificial intelligence musical instrument service providing system - Google Patents

Abstract

The system for providing an artificial intelligent musical instrument service according to the present invention includes a plurality of musical instruments, at least one driving module that is disposed on each of the plurality of musical instruments and drives a performance operation of the musical instrument, and the musical instrument's performance driven by the driving module. At least one voice module for collecting sound, and a musical instrument performance control module for controlling the playing operation of the plurality of instruments through the driving module, and controlling to remotely transmit the performance sounds of the musical instruments collected through the voice module. Include.

Description

Artificial intelligence instrument service provision system {ARTIFICIAL INTELLIGENCE MUSICAL INSTRUMENT SERVICE PROVIDING SYSTEM}

The present invention relates to an artificial intelligence musical instrument service providing system in which robotics, artificial intelligence (AI), and IT technologies are fused to provide a new musical instrument performance service.

Existing musical instrument performance is difficult for individuals to learn by self-study, and repeated practice is required to master musical instrument performance on their own.

In addition, there was a difficulty in learning to play an existing instrument only after a long time and cost. In addition, there is a difficulty in not being able to ensemble with other players in the case of practicing the performance alone.

Therefore, there is a need for a new musical instrument performance service that can draw interest and interest not only to professional music lovers but also to the general public.

The matters described in this background are prepared to enhance an understanding of the background of the invention, and may include matters not known in the prior art to those of ordinary skill in the field to which this technology belongs.

The present invention intends to propose an artificial intelligence instrument service providing system capable of innovating the future music industry by converging robotics, artificial intelligence (AI) and IT technologies and providing new musical instrument performance services.

The artificial intelligence instrument service providing system of the present invention comprises a plurality of instruments, at least one driving module that is disposed on each of the plurality of instruments, and drives a performance operation of the instrument, and the playing sound of the instrument driven by the driving module. At least one vocal module for collecting, and a musical instrument performance control module for controlling the playing operation of the plurality of instruments through the driving module, and remotely transmitting the musical instrument performance collected through the vocal module do.

Remote performance control for synchronizing a plurality of driving modules by being connected online with the musical instrument performance control module, and remotely controlling the plurality of driving modules to simultaneously play the plurality of musical instruments by transmitting a ready-made song or a song composed by artificial intelligence. It may further include a server.

The remote performance control server may include an artificial intelligence taste analysis and composition module that analyzes users' music taste and music trend, and composes a song according to the music taste or the music trend for each user through an artificial intelligence composition program. .

The remote performance control server includes a remote ensemble providing module that provides a remote player pairing function to a user terminal so that a user can perform a remote ensemble with the plurality of instruments, and the remote player pairing function includes the instrument played by the user. It is possible to stop the playing operation of the same type of musical instrument, but only operate the instrument and other types of instruments played by the user, and provide the playing sound played by the different types of instruments to the user terminal.

The remote performance control server includes a band interface providing module that provides an interface for a user to configure his or her own band, and the band interface providing module, wherein the user terminal of the user is at least one of the plurality of musical instruments. You can control the playing behavior of the instrument.

The plurality of musical instruments may include at least one of a keyboard instrument, a string instrument, a wind instrument, or a percussion instrument.

When the musical instrument is a keyboard instrument, a plurality of driving modules are arranged to be spaced apart for each predetermined number of keys, and when the musical instrument is a string instrument, a driving module and a vocal module are arranged for each string, and when the instrument is a wind instrument, A driving module may be arranged for each key of the main building of the wind instrument.

It may further include a fingering module disposed on each of the plurality of musical instruments and fixing the driving module to the musical instrument.

According to the present invention, by arranging a driving module, a fingering module, and a vocal sound module in an existing musical instrument to control the playing operation of a plurality of instruments, and controlling the playing sound of the instrument to be transmitted remotely, not only professional music lovers but also the general public It provides an environment to provide a new musical instrument performance service that can draw interest and interest into a new artistic field.

In addition, the present invention synchronizes a plurality of driving devices arranged in a plurality of musical instruments, and transmits a performance song to remotely control the plurality of driving devices to play a plurality of instruments simultaneously, so that more people can enjoy music and performance. Provide an environment that can be used.

In addition, the present invention analyzes the music tastes and music trends of users, composes songs according to music tastes and music trends for each user through an artificial intelligence composition program, and allows a plurality of driving devices to play songs composed by artificial intelligence. By controlling, it provides an environment in which new songs and performance styles suitable for each user's taste and trend can be provided, and a new musical instrument performance service that can attract users' interest and interest is provided.

In addition, the present invention provides a remote player pairing function to the user terminal so that the user can perform remote ensemble with a plurality of instruments, thereby helping to perform and ensemble even if everyone is not good at playing music. It provides an environment where you can enjoy music and performance.

In addition, the present invention provides an interface through which a user can compose his or her own band and provides an environment in which remote education, remote ensemble, remote studio connection, and remote concert can be provided by connecting through a real-time stream.

In addition, the present invention provides an environment in which a remote ensemble with another player or a performance of a famous player from a distance can be heard from a remote location, as in real life.

1 is a schematic diagram of a system for providing an artificial intelligence musical instrument service according to an embodiment of the present invention.
2 is a block diagram showing a schematic configuration of an apparatus for controlling musical instrument performance according to an embodiment of the present invention.
3 is a block diagram showing a schematic configuration of a remote performance control server according to an embodiment of the present invention.
4 is a flowchart briefly showing a process of playing a performance song by synchronizing driving devices arranged on a musical instrument according to the first embodiment of the present invention.
5 is a flowchart briefly showing a process of providing a remote player pairing function to a user terminal by a remote performance control server according to a second embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are assigned to similar parts throughout the specification.

Throughout the specification, when a part "includes" a certain component, it means that other components may be further included rather than excluding other components unless otherwise stated. In addition, terms such as "... unit", "... group", and "module" described in the specification mean units that process at least one function or operation, which can be implemented by hardware or software or a combination of hardware and software. have.

In this specification, the terminal is a general PC such as a general desktop or notebook, a smart phone, a portable terminal, a mobile terminal, a personal digital assistant (PDA), and a PMP ( Portable Multimedia Player) terminal, telematics terminal, navigation terminal, personal computer, notebook computer, slate PC, tablet PC, ultrabook, wearable Device (Wearable Device, for example, Smartwatch, Smart Glass, HMD (Head Mounted Display), etc.), Wibro terminal, IPTV (Internet Protocol Television) terminal, smart It can be applied to various terminals such as TV, digital broadcasting terminal, AVN (Audio Video Navigation) terminal, A/V (Audio/Video) system, and flexible terminal.

Now, an artificial intelligence musical instrument service providing system according to an embodiment of the present invention will be described in detail with reference to FIGS. 1 to 5.

1 is a schematic diagram of a system for providing an artificial intelligence musical instrument service according to an embodiment of the present invention. In this case, the system for providing an artificial intelligence musical instrument service only shows a schematic configuration necessary for explanation according to an embodiment of the present invention, but is not limited to this configuration.

Referring to FIG. 1, in the system for providing an artificial intelligence instrument service according to an embodiment of the present invention, a driving module, a fingering module, and a vocal sound module are arranged in an existing instrument to control the playing operation of a plurality of instruments, and Control to transmit sound remotely.

The system for providing an artificial intelligence instrument service according to an embodiment of the present invention is a technology for fusion of an existing instrument with robotics, artificial intelligence, and big data technologies, and enhancing its functions and capabilities with a new artificial intelligence instrument. The system for providing an artificial intelligence instrument service according to an embodiment of the present invention is implemented in such a way that a robot module in which an actuator is combined is attached to an existing instrument, and the corresponding module is connected online, so that the artificial intelligence directly plays.

The artificial intelligence instrument service providing system according to an embodiment of the present invention is connected to the user's online account to manage the instruments, and the user creates his own new robot band and performs remote ensemble with other players, or is a famous player from a distance. You can also listen to the performance of the player remotely.

In addition, the artificial intelligence instrument service providing system according to an embodiment of the present invention can be applied to remote education, remote ensemble, remote studio connection, and remote concert by being connected to a real-time stream, and artificial intelligence controls and supplements everything, and each user You can provide new songs and playing styles by analyzing your tastes and trends.

The artificial intelligence instrument service providing system according to an embodiment of the present invention enables an existing acoustic instrument to be connected to the Internet, so that even if everyone is not good at playing, it helps to play and ensemble, and to allow more people to play with music. Help you enjoy.

An artificial intelligence musical instrument service providing system according to an embodiment of the present invention includes a musical instrument performance control device 100 and a remote performance control server 200.

The instrument playing control apparatus 100 controls the playing operation of the plurality of musical instruments through a driving module disposed on the musical instrument. The musical instrument performance control device 100 collects performance sounds by the musical instruments through a vocal sound module disposed on the musical instrument, and controls to remotely transmit the collected performance sounds.

The remote performance control server 200 is connected online with the musical instrument performance control device 100 to synchronize a plurality of driving modules disposed on the musical instrument. And, the remote performance control server 200 transmits a ready-made song or a song composed by artificial intelligence to the instrument performance control device 100, and the ready-made song or the song composed by the artificial intelligence through a plurality of driving modules arranged on the musical instrument. Control to play.

In this case, the remote performance control server 200 may remotely control the musical instrument performance control device 100 so that a plurality of synchronized driving modules simultaneously play a plurality of musical instruments. Here, the plurality of musical instruments may include at least one of a keyboard instrument, a string instrument, a wind instrument, or a percussion instrument.

2 is a block diagram showing a schematic configuration of an apparatus for controlling musical instrument performance according to an embodiment of the present invention. In this case, the apparatus for controlling musical instrument performance is not limited to this configuration, but only shows a schematic configuration necessary for description according to an embodiment of the present invention.

1 and 2, a musical instrument performance control device 100 according to an embodiment of the present invention includes a musical instrument performance control module 110, a keyboard instrument performance module 120, a string instrument performance module 130, and a wind instrument performance. It includes a module 140, a percussion instrument playing module 150, and a communication module 160.

The musical instrument playing control module 110 controls the playing operation of the driving module disposed on the musical instrument. For example, the instrument performance control module 110 is controlled to play each instrument through the keyboard instrument playing module 120, the string instrument playing module 130, the wind instrument playing module 140, and the percussion instrument playing module 150 do.

In addition, the musical instrument performance control module 110 controls to collect the sound played by the musical instruments through the vocal sound module disposed on the musical instrument. Then, the musical instrument performance control module 110 controls to transmit the collected performance sound to the remote performance control server 200 or the user terminal 10 through the communication module 160.

Here, the keyboard instrument playing module 120 is disposed on a keyboard instrument such as a piano. The keyboard instrument playing module 120 plays a keyboard instrument under the control of the instrument playing control module 110 and collects the playing sound played on the keyboard instrument.

The keyboard instrument playing module 120 includes a keyboard instrument fingering module 122, a keyboard instrument driving module 124, a keyboard instrument vocal module 126, and a keyboard instrument control module 128 according to an embodiment of the present invention. do.

The keyboard instrument fingering module 122 fixes the keyboard instrument driving module 124 to the keyboard instrument, and moves the keyboard instrument driving module 124 left and right or up and down. For example, in the case where the keyboard instrument is a piano, the present invention minimizes the time required by the left and right movement of the keyboard instrument fingering module 122 by arranging about ten left and right keyboard instrument driving modules 124 on the piano.

Further, the keyboard instrument driving module 124 plays the keyboard instrument under the control of the keyboard instrument control module 128. In addition, the keyboard instrument vocal sound module 126 collects the playing sound of the keyboard instrument according to the playing operation of the keyboard instrument driving module 124.

The keyboard instrument control module 128 controls the operation of the keyboard instrument fingering module 122, the keyboard instrument driving module 124, and the keyboard instrument vocal sound module 126.

And, the string instrument playing module 130 is disposed on a string instrument such as a guitar (Guitar). The string instrument playing module 130 plays a string instrument under the control of the instrument playing control module 110 and collects the playing sound played on the string instrument.

The string instrument playing module 130 includes a string instrument fingering module 132, a string instrument driving module 134, a string instrument vocal module 136, and a string instrument control module 138 according to an embodiment of the present invention.

The string instrument fingering module 132 fixes the string instrument driving module 134 to the string instrument. Further, the string instrument driving module 134 plays the string instrument under the control of the string instrument control module 138. In addition, the string instrument vocal sound module 136 collects the playing sound of the string instrument according to the playing operation of the string instrument driving module 134.

For example, when the string instrument is a guitar, the present invention minimizes the stroke or stroke change of the string instrument driving module 134 by arranging the string instrument fingering module 132 and the string instrument vocal module 136 for each string.

The string instrument control module 138 controls the operation of the string instrument fingering module 132, the string instrument driving module 134, and the string instrument vocal module 136.

And, the wind instrument playing module 140 is disposed on a wind instrument such as a saxophone. The wind instrument performance module 140 plays a wind instrument under the control of the instrument performance control module 110 and collects the performance sound played on the wind instrument.

The wind instrument playing module 140 includes a wind instrument fingering module 142, a wind instrument driving module 144, a wind instrument vocal module 146, and a wind instrument control module 148 according to an embodiment of the present invention.

The wind instrument fingering module 142 fixes the wind instrument driving module 144 to the wind instrument and moves the wind instrument driving module 144 left and right or up and down.

In addition, the wind instrument driving module 144 plays the wind instrument under the control of the wind instrument control module 148. In addition, the wind instrument vocal module 146 collects the playing sound of the wind instrument according to the playing operation of the wind instrument driving module 124.

For example, when the wind instrument is a saxophone, the present invention eliminates the movement of the wind instrument driving module 144 along the complex appearance of the saxophone by arranging the wind instrument fingering module 142 for each key of the main building of the sax.

The wind instrument control module 148 controls the operation of the wind instrument fingering module 142, the wind instrument driving module 144, and the wind instrument vocal module 146.

Further, the percussion instrument playing module 150 is disposed on percussion instruments such as drums, cymbals, toms, and bass drums. The percussion instrument playing module 150 plays a percussion instrument under the control of the instrument playing control module 110 and collects the playing sound played on the percussion instrument.

The percussion instrument playing module 150 includes a percussion instrument fingering module 152, a percussion instrument driving module 154, a percussion instrument voice module 156, and a percussion instrument control module 158 according to an embodiment of the present invention.

The percussion instrument fingering module 152 fixes the percussion instrument driving module 154 to the percussion instrument. Further, the percussion drive module 154 plays a percussion instrument under the control of the percussion control module 158. In addition, the percussion instrument vocal sound module 156 collects the playing sound of the percussion instrument according to the playing operation of the percussion instrument driving module 154. For example, when the percussion instrument is a drum, the present invention may arrange the percussion vocal module 156 for each percussion instrument such as a cymbal, a tom, and a bass drum.

The percussion control module 158 controls the operation of the percussion drive module 154 and the percussion voice module 156.

3 is a block diagram showing a schematic configuration of a remote performance control server according to an embodiment of the present invention. At this time, the remote performance control server only shows a schematic configuration necessary for explanation according to an embodiment of the present invention, but is not limited to this configuration.

Referring to FIG. 3, the remote performance control server 200 according to an embodiment of the present invention includes an artificial intelligence taste analysis and composition module 210, a remote ensemble providing module 220, a band interface providing module 230, and It includes a remote performance control module 240.

The artificial intelligence taste analysis and composition module 210 analyzes the music taste and music trend of users. In addition, the artificial intelligence taste analysis and composition module 210 composes a song according to the music taste for each user or the music trend through an artificial intelligence composition program, and the composed song is transmitted to the user terminal 10 or the instrument performance control device 100 ).

The remote ensemble providing module 220 provides a remote player pairing function to the user terminal 10 so that the user can perform remote ensemble with the plurality of instruments. Here, the remote player pairing function stops the playing operation of the same type of instrument as the instrument played by the user, but operates only instruments of a different type from the instrument played by the user. Further, the remote ensemble providing module 220 provides the user terminal 10 with the sound played by the different types of instruments.

The band interface providing module 230 provides an interface for a user to configure his or her own band. For example, the band interface providing module 230 may provide an interface through which the user terminal 10 of the user controls the playing operation of at least one of a plurality of instruments.

In addition, the remote performance control module 240 synchronizes a plurality of driving modules arranged on the musical instrument, and transmits a performance song to be played by the synchronized driving module to the musical instrument performance control device 100. In addition, the remote performance control module 240 controls to provide the performance sound collected by the musical instrument performance control device 100 to the user terminal 10.

In addition, the remote performance control module 240 configures the robot orchestra user community social service, sign-up, bulletin board, real-time chat, real-time studio opening, real-time performance and ensemble request configuration, uploading my original songs, purchasing ready-made songs, purchasing original songs, or It can provide functions such as purchasing artificial intelligence compositions.

4 is a flowchart schematically illustrating a process of playing a performance song by synchronizing driving devices disposed on a musical instrument according to the first embodiment of the present invention. In this case, the following flowchart will be described using the same reference numerals in connection with the configurations of FIGS. 1 to 3.

Referring to FIG. 4, in the system for providing an artificial intelligence musical instrument service according to the first embodiment of the present invention, the remote performance control server 200 synchronizes driving devices disposed on a plurality of musical instruments (S102). Here, the plurality of musical instruments may include at least one of a keyboard instrument, a string instrument, a wind instrument, or a percussion instrument.

Then, the remote performance control server 200 transmits the music to the musical instrument performance control device 100 (S104). For example, the remote performance control server 200 may synchronize a driving device that will play a specific performance song among the driving devices.

Then, the musical instrument performance control device 100 plays a performance song by controlling the operation of the driving devices (S106). Here, the driving devices may include at least one of a keyboard instrument driving module 124, a string instrument driving module 134, a wind instrument driving module 144, and a percussion instrument driving module 154.

The musical instrument performance control device 100 collects the performance sounds and transmits the collected performance sounds to the remote performance control server 200 through the communication module 160 (S108).

5 is a flowchart briefly illustrating a process of providing a remote player pairing function to a user terminal by a remote performance control server according to a second embodiment of the present invention. In this case, the following flowchart will be described using the same reference numerals in connection with the configurations of FIGS. 1 to 3.

Referring to FIG. 5, in the system for providing an artificial intelligence instrument service according to the second embodiment of the present invention, the user terminal 10 receives a selection of musical instruments and music pieces that the user intends to play (S202).

The remote performance control server 200 synchronizes only the musical instrument selected by the user terminal 10 with other types of instruments, and releases synchronization of the same type of musical instrument as the musical instrument selected by the user terminal 10 (S204). For example, when a plurality of musical instruments includes a piano, guitar, saxophone, drum, etc., and the user selects a guitar, the remote performance control server 200 synchronizes a piano, a saxophone, a drum, etc. excluding the guitar.

And, when the remote performance control server 200 transmits the music selected by the user terminal 10 to the musical instrument performance control device 100, the musical instrument performance control device 100 is a different kind from the instrument selected by the user terminal 10. Controls the playing operation of the driving modules synchronized so that the musical instruments play the music piece (S206).

Then, the musical instrument performance control device 100 collects the performance sounds played by the different types of instruments, and transmits the collected performance sounds to the remote performance control server 200 (S208).

Further, the remote performance control server 200 transmits the musical instrument selected by the user terminal 10 and the performance sound collected from different types of instruments to the user terminal 10 in real time (S210).

As described above, in the system for providing an artificial intelligence instrument service according to an embodiment of the present invention, a driving device, a fingering device, and a voice sound device are arranged in an existing musical instrument to control the playing operation of a plurality of musical instruments, and remotely control the playing sound of the musical instrument. By controlling the transmission to be transmitted, it provides an environment in which not only professional music lovers but also the general public can provide a new musical instrument performance service that can draw interest and interest into a new area of art.

In addition, the present invention synchronizes a plurality of driving devices arranged in a plurality of musical instruments, and transmits a performance song to remotely control the plurality of driving devices to play a plurality of instruments simultaneously, so that more people can enjoy music and performance. Provide an environment that can be used.

In addition, the present invention analyzes the music tastes and music trends of users, composes songs according to music tastes and music trends for each user through an artificial intelligence composition program, and allows a plurality of driving devices to play songs composed by artificial intelligence. By controlling, it provides an environment in which new songs and performance styles suitable for each user's taste and trend can be provided, and a new musical instrument performance service that can attract users' interest and interest is provided.

In addition, the present invention provides a remote player pairing function to the user terminal so that the user can perform remote ensemble with a plurality of instruments, thereby helping to perform and ensemble even if everyone is not good at playing music. It provides an environment where you can enjoy music and performance.

In addition, the present invention provides an interface through which a user can compose his or her own band and provides an environment in which remote education, remote ensemble, remote studio connection, and remote concert can be provided by connecting through a real-time stream.

In addition, the present invention provides an environment in which a remote ensemble with another player or a performance of a famous player from a distance can be heard from a remote location, as in real life.

The embodiments of the present invention described above are not implemented only through an apparatus and a method, but may be implemented through a program that realizes a function corresponding to the configuration of the embodiment of the present invention or a recording medium on which the program is recorded. Such a recording medium can be executed not only on the server but also on the customer terminal.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements by those skilled in the art using the basic concept of the present invention defined in the following claims are also provided. It belongs to the scope of rights.

Claims (8)

A plurality of musical instruments including keyboard instruments, string instruments, wind instruments, and percussion instruments,
A plurality of driving modules disposed on each of the plurality of musical instruments and driving a performance operation of the musical instrument,
A plurality of vocal sound modules for collecting the playing sound of the musical instrument driven by the driving module,
A fingering module disposed on each of the plurality of musical instruments and fixing the driving module to the musical instrument,
An instrument performance control module for controlling the playing operation of the plurality of musical instruments through the driving module, and controlling to remotely transmit the performance sounds of the musical instruments collected through the voice sound module, and
It is connected online with the instrument performance control module to synchronize a plurality of driving modules, provides an interface for the user to manage the instruments connected to the online account, and analyzes the music tastes and trends of users to create songs composed by artificial intelligence. And a remote performance control server for remotely controlling the transmission so that the plurality of driving modules simultaneously play the plurality of musical instruments, and remotely transmitting the performance sounds collected by the plurality of voice sound modules to a user terminal,
In the keyboard instrument, a plurality of keyboard instrument driving modules are arranged to be spaced apart for each predetermined number of keys, the string instrument is arranged for a string instrument driving module and a string instrument vocal module for each string, and the wind instrument is driven by a wind instrument for each key of the main building of the wind instrument. An artificial intelligence instrument service providing system, characterized in that the module is arranged. delete In claim 1,
The remote performance control server,
An artificial intelligence taste analysis and composition module that analyzes users' music tastes and music trends, and composes songs according to each user's music taste or the above music trends through an artificial intelligence composition program
Artificial intelligence instrument service providing system comprising a. In claim 1,
The remote performance control server,
A remote ensemble providing module for providing a remote player pairing function to a user terminal so that a user can perform remote ensemble with the plurality of instruments,
The remote performer pairing function,
Stops the operation of playing the same type of instrument as the instrument played by the user, but operates only instruments of a different type from the instrument played by the user, and transmits the playing sound played by the different types of instruments to the user terminal. Provided artificial intelligence instrument service provision system. In claim 1,
The remote performance control server,
It includes a band interface providing module that provides an interface for users to configure their own band,
The band interface providing module,
An artificial intelligence musical instrument service providing system, wherein the user terminal of the user provides an interface for controlling a performance of at least one musical instrument among the plurality of musical instruments. delete delete delete

Images