WO2020168709A1

WO2020168709A1 - Musical instrument assisted intelligent teaching system and teaching method thereof

Info

Publication number: WO2020168709A1
Application number: PCT/CN2019/106622
Authority: WO
Inventors: 江超; 张向东
Original assignee: 苏州缪斯谈谈科技有限公司
Priority date: 2019-02-24
Filing date: 2019-09-19
Publication date: 2020-08-27
Also published as: CN109671332A

Abstract

Provided are a musical instrument assisted intelligent teaching system and teaching method thereof, the musical instrument assisted intelligent teaching system at least comprises a signal collection device for collecting signals and a signal analysis device for receiving the signals and performing analysis, feedback and teaching guidance, which are connected, the signal collection device comprises at least one vibration pickup (1), and the signal analysis device is a computer (2) or a mobile phone. The teaching method has the advantages of universality, convenience and accuracy by directly analyzing the picked-up vibration signals and using the deep neural network model to extract the player key information.

Description

A musical instrument assisted intelligent teaching system and teaching method thereof

Technical field

The invention relates to the field of musical instrument teaching, in particular to a musical instrument assisted intelligent teaching system and a teaching method thereof.

Background technique

The piano is a keyboard instrument that uses the keys to pull the hammers to strike the strings. A piano usually consists of pedals, tuning nails, hammers, dampers, action, soundboard and keys. When the keys on the piano are pressed, the hammers inside the piano will strike the corresponding strings, and the vibrations of the strings are coupled to the soundboard to produce sound. The entire keyboard is composed of black keys and white keys, usually including 36 black keys and 52 white keys, a total of 88. The performance of a piece of music can be seen as a process in which one or more hammer combinations strike the strings with different strengths and speeds to make sounds.

With the continuous development of technology, modern pianos are constantly being combined with new technologies, and new requirements are constantly being put forward on how to use new technologies to help piano performance and to guide piano teaching. The Chinese patent filed on March 6, 2018 with the application number CN201710912292.X, a smart piano performance evaluation method and system, discloses a smart piano performance evaluation method, which is collected by midi and used as system input and master data Conduct analysis, comparison and evaluation, give feedback, and conduct music education. However, this method requires the user to play on a dedicated midi keyboard or electronic piano, and the scope of application is narrow. The Chinese patent filed on June 27, 2017, with the application number CN201710497916.6, is an intelligent piano learning machine and its control method. It discloses an intelligent piano learning machine that uses a photodiode-type tool to press keys. Detection, the learning machine can be placed on any piano keyboard, through the photodiode to detect the key press / release state for analysis and evaluation, and give feedback. The disadvantage of this learning machine is that it is placed on the keys and takes up the space of the keys, which affects the playing. At the same time, it can only detect whether it is pressed or not, and cannot detect force.

The learning of musical instruments requires a lot of repetitive exercises. How to better provide teaching aids for musical instrument practitioners is a technical problem to be solved urgently by those skilled in the art.

Summary of the invention

The purpose of the present invention is to provide a musical instrument-assisted intelligent teaching system and its teaching method. By directly analyzing vibration signals and using a deep learning method to extract player key information, it has the advantages of universality, convenience and accuracy.

In order to solve the above technical problems, the technical solution of the present invention is:

A musical instrument-assisted intelligent teaching system includes at least a signal acquisition device and a signal analysis device. The signal acquisition device is used for collecting signals, and the signal analysis device is used for receiving signals and performing analysis, feedback and teaching guidance. The signal acquisition device is connected to the signal analysis device in a wired or wireless manner. The signal acquisition device includes at least one vibration pickup. The signal analysis device is a computer or a mobile phone.

When the signal acquisition device is connected to the signal analysis device in a wired manner, the signal acquisition device is electrically connected to the signal analysis device. When the signal acquisition device and the signal analysis device are connected in a wireless manner, the signal acquisition device and the signal analysis device are connected through Bluetooth, infrared, WiFi, WiMAX, and radio waves.

A speaker is arranged between the signal acquisition device and the signal analysis device. The signal acquisition device, the sound box and the signal analysis device are connected in a wired manner, the signal acquisition device is electrically connected to the sound box, and the sound box is electrically connected to the signal analysis device. The signal acquisition device, the sound box and the signal analysis device are connected in a wired manner and a wireless manner. Specifically, the signal acquisition device is electrically connected to the sound box, and the sound box is connected to the signal analysis device. It is connected in a wireless manner, and further, the speaker and the signal analysis device are connected through Bluetooth, infrared, WiFi, WiMAX and radio waves.

The present invention also discloses the teaching method of the musical instrument assisted intelligent teaching system, and the steps are as follows:

Step 1: Install the signal acquisition device on the playing musical instrument, and establish a connection between the signal acquisition device and the signal analysis device to construct a signal transmission system.

Step 2: The signal acquisition device picks up the performance vibration signal, converts it into a performance electrical signal, and outputs it to the signal analysis device.

Step 3: The signal analysis device divides the performance electrical signal into several segments of equal length, and inputs each segment into the deep neural network model to extract signals such as rhythm, strength, and key press.

Step 4: The computer compares the extracted signal with the standard signal, and outputs the comparison result.

Preferably, the electrical performance signal is stored in the signal analysis device, and the recorded data serves as a basis for later checking the performance pitch of the player, and can also be used to track the performance of the player.

Compared with the prior art, the present invention has the following advantages: the instrument assisted intelligent teaching system of the present invention directly analyzes the picked up vibration signals and uses a deep neural network model to extract player key information, providing a universal, Convenient and accurate intelligent piano learning system. The musical instrument assisted intelligent teaching system has a simple structure and a wide range of applications.

Description of the drawings

The drawings described herein are only for explanatory purposes, and are not intended to limit the scope of the present disclosure in any way. In addition, the shape and proportional size of each component in the figure are only schematic and are used to help the understanding of the present invention, and do not specifically limit the shape and proportional size of each component of the present invention. Under the teaching of the present invention, those skilled in the art can choose various possible shapes and proportional sizes according to specific conditions to implement the present invention. In the attached picture:

Figure 1 is a schematic structural diagram of a musical instrument-assisted intelligent teaching system according to the first embodiment of the present invention;

Figure 2 is a schematic structural diagram of a musical instrument assisted intelligent teaching system according to the second embodiment of the present invention;

Fig. 3 is a schematic diagram of the teaching method of the musical instrument assisted intelligent teaching system according to the second embodiment of the present invention.

Shown in the picture: 1- Vibration pickup, 2- Computer, 3- Speaker.

detailed description

In order to enable those skilled in the art to better understand the technical solutions of the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described The embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

It should be noted that when an element is referred to as being "disposed on" another element, it may be directly on the other element or a central element may also exist. When an element is considered to be "connected" to another element, it can be directly connected to the other element or an intermediate element may also exist. The terms "vertical", "horizontal", "left", "right" and similar expressions used herein are for illustrative purposes only and are not meant to be the only embodiments.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field of the present invention. The terms used in the description of the present invention herein are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The term "and/or" as used herein includes any and all combinations of one or more related listed items.

Example one

Please refer to Figure 1, a musical instrument assisted intelligent teaching system, including a signal acquisition device and a signal analysis device, the signal acquisition device is used to collect performance vibration signals, the signal analysis device is used to receive performance vibration signals, and analyze, Feedback and teaching guidance. The signal acquisition device is connected to the signal analysis device in a wired or wireless manner. In this embodiment, the signal acquisition device includes at least one vibration pickup 1. The signal analysis device is a computer 2.

Each of the vibration pickups 1 is attached to the surface of the piano board to pick up the piano vibration signal, and each of the vibration pickups 1 is electrically connected to the computer 2 or connected via Bluetooth. The computer 2 is provided with a trained deep neural network model, and the computer 2 is provided with a standard signal.

The teaching method of the musical instrument assisted intelligent teaching system is as follows:

Step 1: Install the vibration pickup 1 on the piano, and establish a connection between the vibration pickup 1 and the computer 2 to construct a signal transmission system.

Step 2: The vibration pickup 1 picks up the performance vibration signal, converts it into an electrical performance signal, and outputs it to the computer 2.

Step 3: The computer 2 divides the performance electrical signal into several segments of equal length, and inputs each segment into the deep neural network model to extract signals such as rhythm, strength, and key press.

Step 4: The computer 2 compares the extracted signal with the standard signal, and outputs the comparison result.

Step 5: The performance electrical signal is stored in the computer 2, and the recorded data is used as a basis for checking the performance pitch of the performer later, and can also be used to track the performance of the performer.

Example two

Please refer to FIG. 2, a musical instrument-assisted intelligent teaching system, which includes a signal acquisition device, a speaker 3 and a signal analysis device connected in sequence. In this embodiment, the signal acquisition device includes at least one vibration pickup 1. The signal analysis device is a computer 2. The signal collection device is used to collect performance signals, the signal analysis device is used to receive performance signals, and perform analysis, feedback, and teaching guidance, and the speaker 3 is used to play teaching guidance voice, accompaniment, and accompaniment transmitted by the computer. Information such as beats for teaching guidance.

Each of the vibration pickups 1 is attached to the surface of the piano board to pick up the piano vibration signal, each of the vibration pickups 1 is electrically connected to the sound box 3, and the sound box 3 is electrically connected to the computer 2 or connected via Bluetooth. The performance vibration signal picked up by each vibration pickup 1 is transmitted to the computer 2 via the sound box 3. The computer 2 is provided with a trained deep neural network model, and the computer 2 is provided with a standard signal.

Please refer to Figure 3, the teaching method of the musical instrument assisted intelligent teaching system is as follows:

Step 1: Install the vibration pickup 1 on the piano, and establish the connection between the vibration pickup 1, the sound box 3 and the computer 2 to construct a signal transmission system.

Step 2: The computer 2 outputs audio signals that need to be output, such as teaching guidance voice, accompaniment, and beats, to the speaker 3 for playback. At the same time, the vibration pickup 1 picks up the performance vibration signal, converts it into a performance electrical signal, and outputs it to the computer 2 through the speaker 3.

Step 3: The computer 2 divides the performance electrical signal into several segments of equal length, and inputs each segment into the deep neural network model to extract signals such as rhythm, strength, and keystrokes.

It should be understood that the above description is for illustration and not for limitation. By reading the above description, many embodiments and many applications beyond the examples provided will be apparent to those skilled in the art. Therefore, the scope of the present teaching should not be determined with reference to the above description, but should be determined with reference to the foregoing claims and the full range of equivalents possessed by these claims. For comprehensive purposes, all articles and references, including patent applications and publications, are incorporated herein by reference. The omission of any aspect of the subject matter disclosed herein in the foregoing claims is not to abandon the subject matter, nor should it be deemed that the applicant has not considered the subject matter as part of the disclosed subject matter of the invention.

Claims

A musical instrument assisted intelligent teaching system is characterized in that it includes at least a connected signal acquisition device for collecting signals and a signal analysis device for receiving signals and performing analysis, feedback and teaching guidance.
The musical instrument assisted intelligent teaching system according to claim 1, wherein the signal acquisition device and the signal analysis device are connected in a wired manner.
The musical instrument assisted intelligent teaching system of claim 1, wherein the signal acquisition device and the signal analysis device are connected in a wireless manner.
The musical instrument assisted intelligent teaching system according to claim 1, wherein a loudspeaker is arranged between the signal acquisition device and the signal analysis device, and the signal acquisition device, the loudspeaker and the signal analysis device are connected in sequence.
The musical instrument assisted intelligent teaching system according to claim 4, wherein the signal acquisition device and the speaker are connected in a wired manner, and the speaker and the signal analysis device are connected in a wired manner.
The musical instrument assisted intelligent teaching system of claim 4, wherein the signal collection device and the speaker are connected in a wired manner, and the speaker and the signal analysis device are connected in a wireless manner.
The musical instrument assisted intelligent teaching system according to claim 1, wherein the signal acquisition device comprises at least one vibration pickup.
The musical instrument assisted intelligent teaching system of claim 1, wherein the signal analysis device is a computer or a mobile phone.
A teaching method for a musical instrument-assisted intelligent teaching system according to any one of claims 1 to 8, wherein the steps are as follows:

Step 1: Install the signal acquisition device on the playing musical instrument, and establish a connection between the signal acquisition device and the signal analysis device to construct a signal transmission system;

Step 2: The signal collection device collects performance vibration signals, converts them into performance electrical signals, and outputs them to the signal analysis device;

Step 3: The signal analysis device divides the performance electrical signal into several segments of equal length, and inputs each segment into the deep neural network model to extract signals such as rhythm, strength, and key press;

Step 4: The signal analysis device compares the extracted signal with the standard signal, and outputs the comparison result.
The teaching method according to claim 9, characterized in that it further comprises the following steps:

Step 5: The electric performance signal is stored in the signal analysis device.