CN111415688A - Intelligent recording method for musical instrument - Google Patents
Intelligent recording method for musical instrument Download PDFInfo
- Publication number
- CN111415688A CN111415688A CN202010257485.8A CN202010257485A CN111415688A CN 111415688 A CN111415688 A CN 111415688A CN 202010257485 A CN202010257485 A CN 202010257485A CN 111415688 A CN111415688 A CN 111415688A
- Authority
- CN
- China
- Prior art keywords
- module
- data
- voice data
- processing unit
- transmitted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/0033—Recording/reproducing or transmission of music for electrophonic musical instruments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Abstract
The invention discloses an intelligent recording method for musical instruments, which comprises the following steps: s1, signal data acquisition; s2, generating voice data; s3, judging voice activity; s4, recording voice data; s5, judging the end of recording; and S6, voice data transmission. The intelligent recording and measuring method for the musical instrument can effectively record the musical instrument performance, performs related processing on the musical tone, provides support for the evaluation of the musical instrument, and has wide applicability.
Description
Technical Field
The invention relates to the technical field of intelligent management of musical instruments, in particular to an intelligent recording method for musical instruments.
Background
In the prior art, the performance quality of the musical instrument is generally judged in an artificial mode, and the judgment result is greatly influenced by human factors; meanwhile, the musical instrument can generate intonation deviation along with the time change of playing, particularly, the wood musical instrument is greatly influenced by temperature and humidity, and the tightness of wood can be influenced when the temperature and the humidity of air change, so that the intonation of the musical instrument is influenced; in the prior art, no corresponding product is available for comprehensively and intelligently managing musical instruments.
Application number 201610859490.X discloses a universal real-time musical instrument playing evaluation system, which comprises a main control module, a database, a music selection module, an electronic music score analysis module, a music score composing display module, an audio acquisition module, a music score tracking module, a musical instrument playing correctness evaluation module and a score calculation module; through analyzing the electronic music score, carrying out real-time music score tracking and automatic music transcription on musical instrument playing, a performance correctness evaluation result is obtained and displayed in real time, and the score is calculated on the performance level of a user.
Application No. 201520553923.X discloses a wireless intelligent device and a wireless monitoring system for musical instruments, wherein the wireless intelligent device for musical instruments comprises the following circuit modules: the intelligent terminal comprises a temperature sensor for detecting temperature information, a humidity sensor for detecting humidity information, a processing chip for processing detection information and a wireless transmission module for sending the detection information to the intelligent terminal, wherein the wireless transmission module, the temperature sensor and the humidity sensor are connected with the processing chip. Detect temperature information through temperature sensor, detect humidity information through humidity transducer, and via handling chip, wireless transmission module with above-mentioned temperature information, humidity information transfer to intelligent terminal, can preserve above-mentioned data through intelligent terminal, and when the temperature that detects and humidity surpassed and set for the threshold value, give the suggestion through intelligent terminal, remind the user to carry out corresponding cooling, drying operation, avoid the musical instrument temperature, the too big problem of humidity.
Disclosure of Invention
The invention aims to solve the technical problem that intelligent recording of musical instruments cannot be realized in the prior art, and provides an intelligent recording method for musical instruments, which can effectively record musical instrument performance, perform related processing on music, provide support for evaluation of musical instruments and have wide applicability.
The invention provides an intelligent recording method for musical instruments, which comprises the following steps:
s1, signal data acquisition: starting an intelligent management system, and acquiring analog signals of musical instruments in real time by a microphone in intelligent hardware equipment and transmitting the analog signals to an audio codec in real time;
s2, voice data generation: the audio codec converts the analog signals into digital signals in real time, generates voice data by filtering and amplifying the digital signals and transmits the voice data to an AMR processing unit;
s3, voice activity judgment: the AMR processing unit judges whether the voice data is music, if so, the step S4 is carried out, otherwise, the step S1 is carried out;
s4, voice data recording: the AMR processing unit sends a driving instruction to the SD card high-capacity access module, and the SD card high-capacity access module starts to record music;
s5, judging the end of recording: ending the recording after keeping for 10s after the tone stops;
s6, voice data transmission: after the music is recorded, the AMR processing unit transmits the voice data to the cloud server through the communication module.
The voice activity judgment is carried out through Voice Activity Detection (VAD) algorithm and instrument playing voice detection (ASR), only the instrument user plays the music and records the voice, and various sounds do not trigger the recording at ordinary times. The end of recording is also performed by detecting VAD and ASR, and the recording is finished after 10s of keeping. The VAD algorithm is determined by combining a short-time zero-crossing rate threshold value and a frame energy threshold value. Typically, the threshold setting will be relatively easy, avoiding filtering out useful information. ASR adopts MFCC + DTW algorithm to realize, extracts the MFCC characteristic coefficient of musical instrument in advance, leave the factory and burn in the flash access module of intelligent hardware equipment, judge whether it is a voice activity frame through VAD, if it is, record 1s audio data and preliminary processing promptly, then calculate the MFCC coefficient of the current frame, compare with the MFCC characteristic coefficient of musical instrument through DTW algorithm, if judge that passes through, it is the musical instrument sound of playing, can open the recording procedure.
The invention relates to an intelligent recording method for musical instruments, which is a preferable mode, and a system for realizing the intelligent recording method comprises the following steps: intelligent hardware equipment: the system comprises a cloud server, a music instrument, a music center and a music center, wherein the cloud server is arranged on the music instrument and used for collecting data information of the music instrument and transmitting the data information to the music center; the intelligent hardware device comprises:
a microphone: the audio coder-decoder is electrically connected with the audio coder-decoder, is used for collecting analog signals and transmitting the analog signals to the audio coder-decoder;
an audio codec: the system comprises a microphone, an ARM processing unit, a processing unit and a processing unit, wherein the processing unit is electrically connected with the microphone and the ARM processing unit, and is used for receiving an analog signal transmitted by the microphone, converting the analog signal into a digital signal, filtering and amplifying the digital signal and generating voice data, transmitting the voice data to the ARM processing unit, and receiving a control instruction transmitted by the ARM processing unit;
an ARM processing unit: the device comprises an audio codec, a flash access module, an SD card high-capacity access module, a sram memory module and a temperature and humidity sensor, wherein the audio codec, the flash access module, the SD card high-capacity access module, the sram memory module and the temperature and humidity sensor are electrically connected, and the device is used for receiving voice data transmitted by the audio codec, receiving temperature and humidity data transmitted by the temperature and humidity sensor, transmitting the voice data and the temperature and humidity data to the SD card high-capacity access module, transmitting the voice data and the temperature and humidity data to a communication module, and transmitting a control instruction to the audio codec, the flash access module, the SD card high-capacity; the temperature and humidity data grids are packaged into a JSON format by the ARM processing unit;
a flash access module: the ARM processing unit is electrically connected with the computer system, is used for accessing the firmware of the intelligent hardware equipment and receiving the control instruction transmitted by the ARM processing unit;
SD card large capacity access module: the system is electrically connected with the ARM processing unit, is used for receiving the stored audio data transmitted by the ARM processing unit, and is used for receiving the control instruction transmitted by the ARM processing unit; the SD card is loaded with a FATFS file system to facilitate file management and reading and writing;
a sram memory module: the ARM processing unit is electrically connected with the audio data processing unit, is used for caching the audio data and is used for receiving a control instruction transmitted by the ARM processing unit;
temperature and humidity sensor: the temperature and humidity data acquisition unit is electrically connected with the ARM processing unit, is used for acquiring temperature and humidity data of an environment, transmitting the temperature and humidity data to the ARM processing unit and receiving a control instruction transmitted by the ARM processing unit;
a communication module: the system comprises an ARM processing unit, a cloud server and a processing unit, wherein the ARM processing unit is used for receiving voice data and temperature and humidity data transmitted by the ARM processing unit and transmitting the voice data and the temperature and humidity data to the cloud server;
a power supply module: the device is electrically connected with the microphone, the audio codec, the ARM processing unit, the flash access module, the SD card high-capacity access module, the sram memory module and the temperature and humidity sensor and is used for providing power for the microphone, the audio decoder, the ARM processing unit, the flash access module, the SD card high-capacity access module, the sram memory module and the temperature and humidity sensor;
cloud server: the system comprises a communication module, a client and a data processing module, wherein the communication module is used for receiving voice data and temperature and humidity data transmitted by the communication module, processing and storing the voice data and the temperature and humidity data, and generating a report according to a data processing result and transmitting the report to the client; the protocol adopted in network transmission is based on two data link layer protocols of HTTPS and WEBSOCKET of TCP/IP, and part of the protocol is self-defined to support breakpoint continuous transmission;
a client: the report is transmitted by the cloud server and is used for feeding back the report to the client.
The invention relates to an intelligent recording method for musical instruments, which is characterized in that as a preferred mode, a cloud server comprises the following steps:
a data receiving module: the voice data and the temperature and humidity data are transmitted by the communication module, the voice data are transmitted to the classification compression module, and the temperature and humidity data are transmitted to the rating module and the frequency drift detection module;
a classification compression module: the voice data processing module is used for receiving the voice data transmitted by the data receiving module, classifying and compressing the voice data and transmitting the compressed voice data to the data processing module;
a data processing module: the system comprises a classification compression module, a rating module, a drift detection module, a database module and a voice data processing module, wherein the classification compression module is used for compressing voice data, receiving the compressed voice data transmitted by the classification compression module, performing noise reduction processing on the voice data, performing track identification according to the noise-reduced voice data and track information stored in the database module, and transmitting the noise-reduced voice data and an identification result to the rating module and the drift detection module;
a rating module: the voice recognition module is used for receiving the voice data and the recognition result after noise reduction transmitted by the data processing module, receiving the temperature and humidity data transmitted by the data receiving module, rating and generating a rating result according to the voice data after noise reduction, the recognition result, the temperature and humidity data and the musical instrument rating standard stored in the database module, and transmitting the rating result to the report generating module;
frequency drift detection module: the voice data processing module is used for receiving the voice data after noise reduction transmitted by the data processing module, receiving the temperature and humidity data transmitted by the data receiving module, generating a detection result according to the voice data after noise reduction, the temperature and humidity data and the instrument sound fixing standard stored in the database module, and transmitting the detection result to the report generating module;
a report generation module: the system comprises a database module, a frequency drift detection module, a database module and a client, wherein the frequency drift detection module is used for detecting the frequency drift of the data stream, receiving a rating result transmitted by the rating module, receiving a detection result transmitted by the frequency drift detection module, generating a report according to the rating result and the detection result, and transmitting the report to the database module and the client;
a database module: the system is used for storing the song information, the musical instrument rating standard and the musical instrument tuning standard and receiving and storing the report transmitted by the report generating module.
According to the intelligent recording method for the musical instrument, the microphone comprises a left channel microphone and a right channel microphone, and the left channel microphone and the right channel microphone are electrically connected with the audio codec.
As an optimal mode, the audio codec and the ARM processing unit communicate in a 12S bus mode. The ARM processor can start a 12S DMA interrupt mode to perform data response.
The invention relates to an intelligent recording method for musical instruments, which is characterized in that as an optimal mode, an ARM processing unit receives audio data transmitted by an audio codec through a double DMA (ping pong DMA) and a ringbuff mode, and when the ringbuff data is full, an SD card large-capacity access module is started to access real-time audio data into the SD card large-capacity access module.
As an optimal mode, the temperature and humidity sensor is an SHT30 high-precision digital temperature and humidity sensor.
According to the intelligent recording method for the musical instrument, as a preferred mode, the power module is a lithium battery.
According to the intelligent recording method for the musical instrument, as a preferable mode, the microphone is an electret microphone or a silicon microphone MEMS.
The method can record the content of musical instrument playing, the playing time, the temperature and humidity inside the musical instrument and other information with high resolution, transmits data to the cloud server through the WIFI communication module, deploys an algorithm on the cloud server, identifies the collected audio file tracks, provides data support without full intellectualization of musical instrument use and management, and has wide applicability.
Drawings
FIG. 1 is a flow chart of an intelligent recording method for a musical instrument;
FIG. 2 is a block diagram of a management system for implementing the intelligent recording method for musical instruments;
FIG. 3 is a diagram of the intelligent hardware device of the management system for implementing the intelligent recording method of musical instruments;
FIG. 4 is a schematic diagram of an installation of an intelligent hardware device of a management system for implementing an intelligent recording method for musical instruments;
fig. 5 is a composition diagram of a management system cloud server for implementing the intelligent recording method for musical instruments.
Reference numerals:
1. musical instruments; 2. an intelligent hardware device; 3. a cloud server; 31. a data receiving module; 32. a classification compression module; 33. a data processing module; 34. a rating module; 35. a report generation module; 36. a database module; 37. a frequency drift detection module; 4. a client; 5. a power supply module; 6. a left channel microphone; 7. a right channel microphone; 8. an audio codec; 9. a flash access module; 10. a SD card high-capacity access module; 11. a sram memory module; 12. a temperature and humidity sensor; 13. an ARM processing module; 14. and a communication module.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
Example 1
As shown in fig. 1, an intelligent recording method for musical instruments includes the steps of:
s1, signal data acquisition: starting an intelligent management system, and acquiring analog signals of the musical instrument 1 in real time by a microphone in the intelligent hardware device 2 and transmitting the analog signals to the audio codec 8 in real time;
s2, voice data generation: the audio codec 8 converts the analog signal into a digital signal in real time, generates voice data by filtering and amplifying the digital signal, and transmits the voice data to the AMR processing unit 13;
s3, voice activity judgment: the AMR processing unit 13 judges whether or not the voice data is a musical sound, if yes, proceeds to step S4, if no, proceeds to return to step S1;
s4, voice data recording: the AMR processing unit 13 sends a driving instruction to the SD card large-capacity access module 10, and the SD card large-capacity access module 13 starts to record music;
s5, judging the end of recording: ending the recording after keeping for 10s after the tone stops;
s6, voice data transmission: after the tone recording is completed, the AMR processing unit 13 transmits the voice data to the cloud server 3 through the communication module 14.
As shown in fig. 2, a management system for implementing an intelligent recording method for musical instruments includes:
intelligent hardware device 2: as shown in fig. 3, the device is disposed on the musical instrument 1 (e.g., mounted on the lower side of the bottom plate of the upper cover of the piano or inside the box cover of the head of the koto, inside the resonator of the dulcimer, etc., and fixed by using a double-sided tape) for collecting data information of the musical instrument 1 and transmitting the data information to the cloud server 3; the intelligent hardware device 2 is a cylinder, the diameter of the intelligent hardware device is 68mm, and the height of the intelligent hardware device is 24 mm; as shown in fig. 4, the intelligent hardware device 2 includes:
a microphone: is electrically connected with the audio codec 8, is used for collecting analog signals and transmitting the analog signals to the audio codec 8; the microphones comprise a left channel microphone 6 and a right channel microphone 7, and the left channel microphone 6 and the right channel microphone 7 are electrically connected with an audio codec 8; the sampling rate of the microphone is 44.1KHz, the sampling bit is 16bits, the number of sound channels is 2 (stereo left and right sound channels), and the gain is 0 bottom plate 0 dB;
the audio codec 8: the microphone and ARM processing unit 13 is electrically connected, and is used for receiving an analog signal transmitted by the microphone, converting the analog signal into a digital signal, filtering and amplifying the digital signal and generating voice data, transmitting the voice data to the ARM processing unit 13, and receiving a control instruction transmitted by the ARM processing unit 13;
the ARM processing unit 13: the device is electrically connected with the audio codec 8, the flash access module 9, the SD card high-capacity access module 10, the sram memory module 11 and the temperature and humidity sensor 12, and is used for receiving voice data transmitted by the audio codec 8, receiving temperature and humidity data transmitted by the temperature and humidity sensor 12, transmitting the voice data to the SD card high-capacity access module 10, transmitting the voice data and the temperature and humidity data to the communication module 14, and transmitting a control instruction to the audio codec 8, the flash access module 9, the SD card high-capacity access module 10, the sram memory module 11 and the temperature and humidity sensor 12; the ARM processing unit 13 packages the temperature and humidity data grids into a JSON format; the audio codec 8 communicates with the ARM processing unit 13 in a 12S bus mode; the ARM processor 13 can start a 12S DMA interrupt mode to perform data response; the ARM processing unit 13 receives the audio data transmitted by the audio codec 8 through a dual dma (ping pong dma) + ringbuff manner, and when the ringbuff data is full, the SD card large-capacity access module 10 is opened, and the real-time audio data is accessed into the SD card large-capacity access module 10;
the flash access module 9: the hardware access control device is electrically connected with the ARM processing unit 13, is used for accessing the firmware of the intelligent hardware equipment, and is used for receiving the control instruction transmitted by the ARM processing unit 13; wherein the firmware comprises MFCC characteristic coefficients of the piano corresponding to 88 keys of the piano or the piano corresponding to 21 strings of the Chinese zither or the piano corresponding to 12 tones of the dulcimer;
SD card large capacity access module 10: the audio data storage device is electrically connected with the ARM processing unit 13, and is used for receiving the stored audio data transmitted by the ARM processing unit 13 and receiving the control instruction transmitted by the ARM processing unit 13; the SD card high-capacity access module 10 is loaded with a FATFS file system to facilitate file management and reading and writing;
the sram memory module 11: the system is electrically connected with the ARM processing unit 13, is used for caching audio data, and is used for receiving a control instruction transmitted by the ARM processing unit 13;
temperature and humidity sensor 12: the temperature and humidity data acquisition unit is electrically connected with the ARM processing unit 13, is used for acquiring temperature and humidity data of an environment, transmitting the temperature and humidity data to the ARM processing unit 13, and is used for receiving a control instruction transmitted by the ARM processing unit 13; the temperature and humidity sensor 12 is an SHT30 high-precision digital temperature and humidity sensor;
the communication module 14: the system is used for receiving the voice data and the temperature and humidity data transmitted by the ARM processing unit 13 and transmitting the voice data and the temperature and humidity data to the cloud server 3;
the power supply module 5: the device is electrically connected with the microphone, the audio codec 8, the ARM processing unit 13, the flash access module 9, the SD card high-capacity access module 10, the sram memory module 11 and the temperature and humidity sensor 12, and is used for providing power for the microphone, the audio codec 8, the ARM processing unit 13, the flash access module 9, the SD card high-capacity access module 10, the sram memory module 11 and the temperature and humidity sensor 12; the power module 12 is a lithium battery;
the cloud server 3: the system is used for receiving the voice data and the temperature and humidity data transmitted by the communication module 14, processing and storing the voice data and the temperature and humidity data, and generating a report according to a data processing result and transmitting the report to the client 4; the protocol adopted in network transmission is based on two data link layer protocols of HTTPS and WEBSOCKET of TCP/IP, and part of the protocol is self-defined to support breakpoint continuous transmission; as shown in fig. 5, the cloud server 3 includes:
the data receiving module 31: the voice data and the temperature and humidity data are transmitted by the communication module 14, the voice data is transmitted to the classification compression module 32, the temperature and humidity data is transmitted to the rating module 34 and the frequency drift detection module 37;
the classification compression module 32: the voice data receiving module 31 is used for receiving the voice data transmitted by the data receiving module 31, classifying and compressing the voice data, and transmitting the compressed voice data to the data processing module 33;
the data processing module 33: the system is used for receiving the compressed voice data transmitted by the classification compression module 32, performing noise reduction processing on the voice data, performing track identification according to the noise-reduced voice data and track information stored in the database module 36, and transmitting the noise-reduced voice data and an identification result to the rating module 34 and the drift detection module 37;
the rating module 34: the voice recognition module is used for receiving the voice data and the recognition result after noise reduction transmitted by the data processing module 33, receiving the temperature and humidity data transmitted by the data receiving module 31, rating and generating a rating result according to the voice data after noise reduction, the recognition result, the temperature and humidity data and the musical instrument rating standard stored in the database module 36, and transmitting the rating result to the report generating module 35;
frequency drift detection module 37: the voice data processing module 33 is used for receiving the noise-reduced voice data transmitted by the data processing module 33, receiving the temperature and humidity data transmitted by the data receiving module 31, generating a detection result according to the noise-reduced voice data, the temperature and humidity data and the instrument sound fixing standard stored in the database module 36, and transmitting the detection result to the report generating module 35;
the report generation module 35: for receiving the rating result transmitted by the rating module 34, for receiving the detection result transmitted by the frequency drift detection module 37, for generating a report according to the rating result and the detection result, and for transmitting the report to the database module 36 and the client 4;
database module 36: the system comprises a report generation module, a music score storage module and a music instrument rating standard, wherein the report generation module is used for generating a report according to music score information, music instrument rating standard and music instrument tuning standard;
the client 4: for receiving the report transmitted by the cloud server 3, and for feeding back the report to the client.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.
Claims (10)
1. An intelligent recording method for musical instruments is characterized in that: the method comprises the following steps:
s1, signal data acquisition: starting an intelligent management system, and acquiring analog signals of musical instruments in real time by a microphone in intelligent hardware equipment (2) and transmitting the analog signals to an audio codec (8) in real time;
s2, voice data generation: the audio codec (8) converts the analog signals into digital signals in real time, generates voice data by filtering and amplifying the digital signals and transmits the voice data to an AMR processing unit (13);
s3, voice activity judgment: the AMR processing unit (13) judges whether the voice data is a musical sound, if so, the step S4 is carried out, and if not, the step S1 is carried out;
s4, voice data recording: the AMR processing unit (13) sends a driving instruction to the SD card large-capacity access module (10), and the SD card large-capacity access module (13) starts to record the musical tones;
s5, judging the end of recording: ending the recording after keeping for 10s after the tone stops;
s6, voice data transmission: after the music is recorded, the AMR processing unit (13) transmits the voice data to the cloud server (3) through the communication module (14).
2. The intelligent recording method for musical instruments according to claim 1, characterized in that: the system for realizing the intelligent recording method comprises the following steps:
intelligent hardware device (2): the system comprises a cloud server (3), a data processing unit and a data processing unit, wherein the cloud server is arranged on a musical instrument (1) and is used for collecting data information of the musical instrument (1) and transmitting the data information to the cloud server; the intelligent hardware device (2) comprises:
a microphone: is electrically connected with the audio codec (8) and is used for collecting analog signals and transmitting the analog signals to the audio codec (8);
audio codec (8): the system is electrically connected with a microphone and an ARM processing unit (13), is used for receiving the analog signal transmitted by the microphone, converting the analog signal into a digital signal, filtering and amplifying the digital signal and generating voice data, transmitting the voice data to the ARM processing unit (13), and receiving a control instruction transmitted by the ARM processing unit (13);
an ARM processing unit (13): the high-capacity SD card access module is electrically connected with the audio codec (8), the flash access module (9), the SD card high-capacity access module (10), the sram memory module (11) and the temperature and humidity sensor (12), and is used for receiving the voice data transmitted by the audio codec (8), receiving the temperature and humidity data transmitted by the temperature and humidity sensor (12), transmitting the voice data to the SD card high-capacity access module (10), transmitting the voice data and the temperature and humidity data to the communication module (14), and transmitting the control instruction to the audio codec (8), the flash access module (9), the SD card high-capacity access module (10), the sram memory module (11) and the temperature and humidity sensor (12);
flash access module (9): the system is electrically connected with the ARM processing unit (13), is used for accessing the firmware of the intelligent hardware device (2), and is used for receiving the control instruction transmitted by the ARM processing unit (13);
SD card high capacity access module (10): the audio data storage device is electrically connected with the ARM processing unit (13), and is used for receiving the audio data stored in the audio data transmitted by the ARM processing unit (13) and receiving the control instruction transmitted by the ARM processing unit (13);
a sram memory module (11): the system is electrically connected with the ARM processing unit (13), is used for caching the audio data, and is used for receiving the control instruction transmitted by the ARM processing unit (13);
temperature and humidity sensor (12): the temperature and humidity data acquisition unit is electrically connected with the ARM processing unit (13), is used for acquiring temperature and humidity data of an environment, transmitting the temperature and humidity data to the ARM processing unit (13), and is used for receiving the control instruction transmitted by the ARM processing unit (13);
communication module (14): the voice data and the temperature and humidity data are received and transmitted by the ARM processing unit (13), and the voice data and the temperature and humidity data are transmitted to a cloud server (3);
power module (5): the microphone, the audio codec (8), the ARM processing unit (13), the flash access module (9), the SD card high-capacity access module (10), the psram memory module (11) and the temperature and humidity sensor (12) are electrically connected, and are used for providing power for the microphone, the audio decoder (8), the ARM processing unit (13), the flash access module (9), the SD card high-capacity access module (10), the psram memory module (11) and the temperature and humidity sensor (12);
cloud server (3): the voice data and the temperature and humidity data are received and transmitted by the communication module (14), the voice data and the temperature and humidity data are processed and stored, and a report is generated and transmitted to a client (4) according to a data processing result;
client (4): for receiving the report transmitted by the cloud server (3) for feeding back the report to a customer.
3. The intelligent recording method for musical instruments according to claim 2, characterized in that: the cloud server (3) comprises:
data reception module (31): the voice data and the temperature and humidity data are received and transmitted by the communication module (14), the voice data are transmitted to a classification compression module (32), and the temperature and humidity data are transmitted to a rating module (34);
a classification compression module (32): the voice data receiving module (31) is used for receiving the voice data transmitted by the data receiving module, classifying and compressing the voice data, and transmitting the compressed voice data to the data processing module (33);
data processing module (33): the voice recognition module is used for receiving the compressed voice data transmitted by the classification compression module (32), performing noise reduction processing on the voice data, performing track recognition according to the noise-reduced voice data and track information stored in the database module (36) and transmitting the noise-reduced voice data and the recognition result to the rating module (34);
rating module (34): the voice data and the recognition result after noise reduction transmitted by the data processing module (33) are received, the temperature and humidity data transmitted by the data receiving module (31) are received, and the voice data, the recognition result, the temperature and humidity data after noise reduction and the instrument rating standard stored in the database module are rated and generated to generate a rating result which is transmitted to the report generating module (35);
report generation module (35): for receiving the rating results transmitted by the rating module (34), for generating the report according to the rating results, for transmitting the report to the database module (36) and to the client (4);
database module (36): for storing track information and instrument rating criteria for receiving and storing the report transmitted by the report generation module (35).
4. The intelligent recording method for musical instruments according to claim 3, characterized in that: the cloud server further comprises:
frequency drift detection module (37): the voice data processing module is used for receiving the voice data after noise reduction transmitted by the data processing module (33), receiving the temperature and humidity data transmitted by the data receiving module (31), generating a detection result according to the voice data after noise reduction, the temperature and humidity data and an instrument sound fixing standard stored in the database module (36), and transmitting the detection result to the report generating module (35).
5. An intelligent management system for musical instruments according to claim 2, wherein: the microphone comprises a left channel microphone (6) and a right channel microphone (7), and the left channel microphone (6) and the right channel microphone (7) are electrically connected with the audio codec (8).
6. An intelligent management system for musical instruments according to claim 2, wherein: the audio codec (8) and the ARM processing unit (13) communicate in a 12S bus mode.
7. An intelligent management system for musical instruments according to claim 2, wherein: and the ARM processing unit (13) receives the audio data transmitted by the audio codec (8) in a double DMA + ringbuff mode.
8. An intelligent management system for musical instruments according to claim 2, wherein: the temperature and humidity sensor (12) is an SHT30 high-precision digital temperature and humidity sensor.
9. An intelligent management system for musical instruments according to claim 2, wherein: the power module (5) is a lithium battery.
10. An intelligent management system for musical instruments according to claim 2, wherein: the microphone is an electret microphone or a silicon microphone MEMS.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010257485.8A CN111415688A (en) | 2020-04-03 | 2020-04-03 | Intelligent recording method for musical instrument |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010257485.8A CN111415688A (en) | 2020-04-03 | 2020-04-03 | Intelligent recording method for musical instrument |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111415688A true CN111415688A (en) | 2020-07-14 |
Family
ID=71494816
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010257485.8A Pending CN111415688A (en) | 2020-04-03 | 2020-04-03 | Intelligent recording method for musical instrument |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111415688A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002050943A (en) * | 2000-08-04 | 2002-02-15 | Sony Corp | Studio sound recording device and method |
| CN102163448A (en) * | 2010-02-24 | 2011-08-24 | 三洋电机株式会社 | Sound recording device |
| CN202472624U (en) * | 2011-12-22 | 2012-10-03 | 成都众询科技有限公司 | Voice frequency collecting card |
| CN103780670A (en) * | 2012-10-04 | 2014-05-07 | 芬德乐器公司 | System and method for storing and visiting musical performance on remote server |
| CN204808564U (en) * | 2015-07-28 | 2015-11-25 | 陈文震 | A wireless Intelligence device and musical instrument wireless monitoring system for musical instrument |
| CN106340286A (en) * | 2016-09-27 | 2017-01-18 | 华中科技大学 | Universal real-time musical instrument playing evaluation system |
| CN106448636A (en) * | 2016-09-27 | 2017-02-22 | 安徽克洛斯威智能乐器科技有限公司 | Internet intelligent voice piano system capable of recording and scoring |
| CN107884006A (en) * | 2017-10-25 | 2018-04-06 | 江苏觉创科技有限公司 | Multifunctional intellectual piano monitoring system |
| CN109841203A (en) * | 2019-01-25 | 2019-06-04 | 得理乐器(珠海)有限公司 | A kind of electronic musical instrument music harmony determines method and system |
| CN110915220A (en) * | 2017-07-13 | 2020-03-24 | 杜比实验室特许公司 | Audio input and output device with streaming capability |
-
2020
- 2020-04-03 CN CN202010257485.8A patent/CN111415688A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002050943A (en) * | 2000-08-04 | 2002-02-15 | Sony Corp | Studio sound recording device and method |
| CN102163448A (en) * | 2010-02-24 | 2011-08-24 | 三洋电机株式会社 | Sound recording device |
| CN202472624U (en) * | 2011-12-22 | 2012-10-03 | 成都众询科技有限公司 | Voice frequency collecting card |
| CN103780670A (en) * | 2012-10-04 | 2014-05-07 | 芬德乐器公司 | System and method for storing and visiting musical performance on remote server |
| CN204808564U (en) * | 2015-07-28 | 2015-11-25 | 陈文震 | A wireless Intelligence device and musical instrument wireless monitoring system for musical instrument |
| CN106340286A (en) * | 2016-09-27 | 2017-01-18 | 华中科技大学 | Universal real-time musical instrument playing evaluation system |
| CN106448636A (en) * | 2016-09-27 | 2017-02-22 | 安徽克洛斯威智能乐器科技有限公司 | Internet intelligent voice piano system capable of recording and scoring |
| CN110915220A (en) * | 2017-07-13 | 2020-03-24 | 杜比实验室特许公司 | Audio input and output device with streaming capability |
| CN107884006A (en) * | 2017-10-25 | 2018-04-06 | 江苏觉创科技有限公司 | Multifunctional intellectual piano monitoring system |
| CN109841203A (en) * | 2019-01-25 | 2019-06-04 | 得理乐器(珠海)有限公司 | A kind of electronic musical instrument music harmony determines method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109275084A (en) | Test method, device, system, equipment and the storage medium of microphone array | |
| CN110415681B (en) | Voice recognition effect testing method and system | |
| US6910005B2 (en) | Recording apparatus including quality test and feedback features for recording speech information to a subsequent off-line speech recognition | |
| WO2020155490A1 (en) | Method and apparatus for managing music based on speech analysis, and computer device | |
| US20110208330A1 (en) | Sound recording device | |
| CN101023469A (en) | Digital filtering method, digital filtering equipment | |
| CN103354445A (en) | Adaptive environment music playing apparatus and method thereof | |
| CN109195090A (en) | Test method and system for microphone electro mechanical parameter in product | |
| CN108449688A (en) | Studio broadcast audio-frequency processing method, apparatus and system | |
| CN108449691A (en) | A kind of sound pick up equipment and sound source distance determine method | |
| CN213691420U (en) | Intelligent management system for musical instrument | |
| CN111415682A (en) | Intelligent evaluation method for musical instrument | |
| CN108389569B (en) | Bridge, string instrument and string vibration detection method | |
| CN111415688A (en) | Intelligent recording method for musical instrument | |
| CN111477249A (en) | Intelligent scoring method for musical instrument | |
| CN105632523B (en) | Adjust the method and apparatus and terminal of the volume output valve of audio data | |
| CN102322928B (en) | Electronic scale, mobile equipment, body weight measuring system and wireless transmission method | |
| TWI358717B (en) | Apparatus, server, method, and computer readabe me | |
| CN207854178U (en) | A kind of line control earphone test device | |
| CN111292708A (en) | Intelligent management system for musical instrument | |
| CN113257247A (en) | Test method and system | |
| CN214799862U (en) | Product sound pickup apparatus | |
| CN115691556B (en) | Method for detecting multichannel voice quality of equipment side | |
| CN212230068U (en) | Language storage and playback system | |
| EP3879184A1 (en) | Noise reduction method and apparatus for household appliance, household appliance, and cooker hood |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200714 |
|
| RJ01 | Rejection of invention patent application after publication |