WO2020088695A1 - 一种音乐控制系统和方法 - Google Patents

一种音乐控制系统和方法 Download PDF

Info

Publication number
WO2020088695A1
WO2020088695A1 PCT/CN2019/125899 CN2019125899W WO2020088695A1 WO 2020088695 A1 WO2020088695 A1 WO 2020088695A1 CN 2019125899 W CN2019125899 W CN 2019125899W WO 2020088695 A1 WO2020088695 A1 WO 2020088695A1
Authority
WO
WIPO (PCT)
Prior art keywords
music
music control
processing unit
control terminal
control
Prior art date
Application number
PCT/CN2019/125899
Other languages
English (en)
French (fr)
Inventor
牛亚锋
洪文博
Original Assignee
北京戴乐科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京戴乐科技有限公司 filed Critical 北京戴乐科技有限公司
Publication of WO2020088695A1 publication Critical patent/WO2020088695A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/32—Constructional details
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/32—Constructional details
    • G10H1/34—Switch arrangements, e.g. keyboards or mechanical switches specially adapted for electrophonic musical instruments
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/391—Angle sensing for musical purposes, using data from a gyroscope, gyrometer or other angular velocity or angular movement sensing device
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/395—Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing.
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/401—3D sensing, i.e. three-dimensional (x, y, z) position or movement sensing.
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/405—Beam sensing or control, i.e. input interfaces involving substantially immaterial beams, radiation, or fields of any nature, used, e.g. as a switch as in a light barrier, or as a control device, e.g. using the theremin electric field sensing principle
    • G10H2220/425—Radio control, i.e. input or control device involving a radio frequency signal

Definitions

  • the invention relates to the technical field of electronic terminals, in particular to a music control system and method.
  • the purpose of the present invention is to overcome the deficiencies of the prior art and provide a music control system and method.
  • a music control system including:
  • Each of the music control terminals is provided with a control processing unit and an inertial navigation action recognition module;
  • the inertial navigation action recognition module is used to recognize the collected actions of the music control terminal and transmit the recognition result to the control processing unit, so that the control processing unit obtains the corresponding command according to the recognition result Code and send the command code to an external smart device, so that the external smart device plays corresponding music according to the command code.
  • the inertial navigation action recognition module includes:
  • a gyro sensor used to collect angular velocity information of the music control terminal moving in space
  • An acceleration sensor used to collect acceleration information of the music control terminal moving in space
  • Geomagnetic sensor used to collect geomagnetic information of the music control terminal moving in space
  • the digital motion processor is used to process the angular velocity information collected by the gyro sensor, the acceleration information collected by the acceleration sensor and the geomagnetic information collected by the geomagnetic sensor to obtain a recognition result, and transmit the recognition result to the The control processing unit is described.
  • the music control system includes two of the music control terminals, and each of the music control terminals includes a body shaped like a drumstick;
  • Each of the bodies is provided with the control processing unit and the inertial navigation action recognition module;
  • Each of the inertial navigation action recognition modules collects the movement trajectory of the corresponding body, recognizes the movement of the body according to the movement trajectory, and transmits the recognition result to the control processing unit.
  • the body is provided with a drumstick head, a drumstick connecting portion and a drumstick grip portion in sequence;
  • a plurality of first LED display lamps are evenly arranged on the outer surface of the drumstick connection portion, and the first LED display lamps are used to display lights that change with the action under the control of the control processing unit.
  • a first button is further provided on the drumstick connection portion, and the first button is used to control the on / off of the music control terminal;
  • a breathing lamp for displaying the working state of the music control terminal is provided on the surface of the drumstick connecting portion and close to the first key.
  • the music control system includes more than two music control terminals, and each of the music control terminals includes a ring;
  • Each of the finger rings is provided with the control processing unit and the inertial navigation action recognition module;
  • Each of the inertial navigation action recognition modules collects the movement trajectory of the ring where it is located, and recognizes the movement of the ring according to the movement trajectory, and transmits the recognition result to the control processing unit.
  • a plurality of second LED display lights are evenly arranged on the outer surface of the finger ring, and the second LED display lights are used to display lights that change with action under the control of the control processing unit;
  • a second button is also provided on the outer surface of the finger ring, and the second button is used to control the on / off of the music control terminal.
  • the system further includes: a motor driver and a motor provided inside the music control terminal;
  • the motor driver is used to drive the motor to vibrate under the control of the control processing unit.
  • the system further includes: a rechargeable lithium battery and a power management module provided inside the music control terminal;
  • the rechargeable lithium battery supplies power to the control system
  • the power management module is used to detect the power of the rechargeable lithium battery, and when the power of the rechargeable lithium battery is lower than the power threshold, send a signal of low power to the control processing unit.
  • the invention also provides a music control method, including:
  • the music control system includes: a plurality of music control terminals; each of the music control terminals is provided with a control processing unit and an inertial navigation action recognition module; the inertial navigation action recognition module is used for To identify the collected actions of the music control terminal, and transmit the recognition result to the control processing unit, so that the control processing unit obtains the corresponding command code according to the recognition result, and sends the command code To an external smart device, so that the external smart device plays corresponding music according to the command code.
  • the present invention recognizes the actions performed by the user holding the music control terminal through the inertial navigation action recognition module, and controls the external smart device to play the corresponding music according to the actions performed by the music control terminal under the control of the control processing unit.
  • the music control system described in the present invention can be used in place of bulky musical instruments in combination with external intelligent equipment adapted to it, as long as the user knows the rhythm of the music, the instrument can be played, avoiding the high entry threshold of existing musical instruments and requiring a lot of time And lack of energy;
  • the music control system of the present invention supports a multi-node control mode, through which a user can simulate the effects of musical instruments for drumming and playing piano, and the system supports a multi-person control mode, that is, each person holds A music control terminal, multiple people cooperate to complete the performance of the music; this system can allow users to better experience the melody of the music; in addition, the present invention makes the music control terminal into a drumstick shape or finger ring shape, which is convenient for users to carry and Use, so that users can experience the charm of music anytime, anywhere.
  • FIG. 1 is a schematic structural connection diagram provided by Embodiment 1 of the music control system of the present invention.
  • FIG. 2 is a schematic diagram of the overall structure provided by the second embodiment of the music control system of the present invention.
  • Embodiment 2 is a schematic structural connection diagram provided by Embodiment 2 of the music control system of the present invention.
  • FIG. 4 is a schematic diagram of the overall structure provided by the third embodiment of the music control system of the present invention.
  • Embodiment 3 is a schematic structural connection diagram provided by Embodiment 3 of the music control system of the present invention.
  • FIG. 7 is a schematic diagram of dividing the horizontal direction into several areas according to the heading angle
  • FIG. 8 is a schematic diagram of dividing a vertical area into several areas according to a pitch angle.
  • FIG. 1 is a schematic structural connection diagram provided by Embodiment 1 of the music control system of the present invention.
  • the music control system described in this embodiment includes:
  • Each of the music control terminals 1 is provided with a control processing unit 2 and an inertial navigation action recognition module 3;
  • the inertial navigation action recognition module 3 is used for recognizing the collected actions of the music control terminal 1 and transmitting the recognition result to the control processing unit 2, so that the control processing unit 2 according to the recognition result Obtain the corresponding command code, and send the command code to the external smart device 20, so that the external smart device 20 plays the corresponding music according to the command code.
  • the inertial navigation action recognition module 3 includes:
  • the gyro sensor 31 is used to collect angular velocity information of the music control terminal 1 moving in space;
  • the acceleration sensor 32 is used to collect acceleration information of the music control terminal 1 moving in space;
  • the geomagnetic sensor 33 is used to collect geomagnetic information of the music control terminal 1 moving in space;
  • the digital motion processor 34 is used to process the angular velocity information collected by the gyro sensor 31, the acceleration information collected by the acceleration sensor 33, and the geomagnetic information collected by the geomagnetic sensor 33 to obtain a recognition result and recognize The result is transferred to the control processing unit 2.
  • control processing unit 2 may be a single-chip computer or a module with a CPU chip capable of data processing and control.
  • the music control terminal 1 described in this embodiment is small and compact, which is convenient for the user to hold or wear. When used alone, a user can hold or wear multiple music control terminals 1, and the user performs according to the rhythm of the music to be played.
  • the music control terminal 1 will send a command code to the external smart device 20 according to the user's actions To enable external smart devices to play corresponding music. For example, if the user wants to play a piano piece of "Moonlight", the user only needs to connect the system to the external smart device 20 in advance, and set the type of musical instrument to be played on the external smart device 20 to perform.
  • the external smart device 20 includes at least one of the following items:
  • a smart phone is taken as an example.
  • An application software matching the music control system is installed on the smart phone.
  • Each music control terminal 1 is provided with a wireless communication module 19, such as a Bluetooth module, through the In the wireless communication module 19, the music control terminal 1 is wirelessly connected to the smartphone. After the connection is successful, the user sets the type of musical instrument to be played on the smartphone, such as a piano.
  • the music control terminals 1 are fixed on different fingers, and they can dance their fingers in the air according to the rhythm of "Moonlight".
  • the inertial navigation action recognition module 3 collects acceleration information, angular velocity information, and geomagnetic information of the music control terminal 1 in the three-axis direction of space X, Y, and Z, and collects
  • the angular velocity information, acceleration information and geomagnetic information are processed to obtain the recognition result (for example, up, down, horizontal left or horizontal right), and the recognition result is transmitted to the corresponding control processing unit 2 (belonging to the same Inertial navigation action recognition module 3 and control processing unit 2 of a music control terminal 1);
  • the control processing unit 2 obtains the corresponding command code according to the recognition result (for example, the corresponding command code for moving up is 0xaa, and the corresponding command for moving down
  • the code is 0xbb, the command code corresponding to horizontal left shift is 0xcc, the command code corresponding to horizontal right shift is 0xdd, etc.), and the command code is wirelessly sent to the smartphone; after the smartphone receives the command code, According to the preset
  • the preset musical instrument type is a piano
  • 0xaa represents raising the finger upwards
  • 0xbb represents pressing the fingers
  • the command code is agreed in advance by the control processing unit 2 and the smartphone.
  • the smart phone receives the command code 0xbb
  • the smart phone according to the preset musical instrument type is a piano, and can obtain the command code 0xaa corresponding to pressing the finger, that is, the smart phone plays the sound corresponding to the piano.
  • the external smart device 20 stores audio files corresponding to various musical instruments.
  • the music control system described in this embodiment can be used in conjunction with a smart phone adapted to replace a bulky musical instrument. As long as the user knows the rhythm of the music, the instrument can be played, avoiding the high entry threshold of existing musical instruments and requiring a lot of time And lack of energy, the music control system described in this embodiment can allow users to better experience the melody of music; the music control system described in this embodiment supports a multi-node control mode, and a user can simulate through the system The effect of musical instruments for drumming and playing piano; this system can let users feel the melody of music better.
  • FIGS 2 and 3 are schematic diagrams of the structure provided by Embodiment 2 of the music control system of the present invention.
  • the music control system described in this embodiment includes:
  • Each of the bodies is provided with the control processing unit 2 and the inertial navigation action recognition module 3;
  • Each of the inertial navigation action recognition modules 3 collects the movement trajectory of the corresponding body, recognizes the movement of the body according to the movement trajectory, and transmits the recognition result to the control processing unit 2 to enable the control
  • the unit 2 obtains the corresponding command code according to the recognition result, and sends the command code to the external smart device 20, so that the external smart device 20 plays the corresponding music according to the command code.
  • the user can perform the performance by cooperating with the two music control terminals 1, for example, playing the music for drumming by holding one music control terminal 1 in each of the left and right hands.
  • the body is provided with a drumstick head 5, a drumstick connecting portion 6 and a drumstick grip portion 7 in sequence;
  • a plurality of first LED display lights 8 are evenly arranged on the outer surface of the drumstick connecting portion 6, and the first LED display lights 8 are used to display lights that change with action under the control of the control processing unit 2 .
  • Each action can correspond to a color of light.
  • the first LED display lamp 8 described in this embodiment can blink under the control of the control processing unit 2 according to the change of the user's action to realize the first LED display
  • the light 8 shows a light effect that changes with the action, providing the user with a visual experience that changes with the rhythm, so that the user can feel the cool light effect while feeling the music melody, which is conducive to improving the user experience.
  • a first key 9 is further provided on the drumstick connecting portion 6, and the first key 9 is used to control the on / off of the music control terminal 1;
  • a breathing lamp 10 for displaying the working state of the music control terminal 1 is provided on the surface of the drumstick connecting portion 6 near the first key 9.
  • system further includes: a motor driver 14 and a motor 15 provided inside the music control terminal 1;
  • the motor driver 14 is used to drive the motor 15 under the control of the control processing unit 2 to vibrate.
  • the motor driver 14 drives the motor 15 to vibrate under the control of the control processing unit 2, including:
  • the control processing unit 2 determines the vibration intensity level according to the acceleration information collected by the acceleration sensor 32, and controls the motor driver 14 to drive the motor 15 to vibrate according to the vibration intensity level.
  • the vibration intensity level is proportional to the magnitude of the acceleration. In other words, the greater the acceleration, the greater the vibration intensity of the motor 15.
  • the vibration intensity level is set by the magnitude of acceleration, and the vibration intensity of the motor 15 is controlled by the PWM of the motor driver.
  • vibration frequency of the motor 15 is consistent with the frequency of changes in the user's playing movement.
  • the user holds a drumstick-shaped body 4 with his left and right hands, or two users. Each user holds a drumstick-shaped body 4, and the music control terminal 1 and external intelligence After the device 20 is successfully connected and the setting of the type of musical instrument to be played is completed, the user can start to dance the body in the hand following the rhythm of the music to be played. During the performance, every time the user makes a performance action, in addition to playing a sound corresponding to a musical instrument on the external smart device 20, the motor 15 inside the music control terminal 1 will also generate a vibration to increase the user's performance The movement of the musical instrument allows users to experience the rhythm of the music personally.
  • the system further includes: a rechargeable lithium battery 16 and a power management module 17 provided inside the music control terminal 1;
  • the rechargeable lithium battery 16 supplies power to the control system
  • a charging socket 18 is provided at the bottom of the drumstick grip 7, and the rechargeable lithium battery 16 is powered through the charging socket 18.
  • the power management module 17 is used to detect the power of the rechargeable lithium battery 16 and send a low power signal to the control processing unit 2 when the power of the rechargeable lithium battery 16 is lower than the power threshold. After receiving the low battery signal, the control processing unit 2 can control the first LED display lamp 8 to send a signal to remind charging (for example, the first LED display lamp 8 emits a continuously flashing red light to represent the rechargeable lithium battery 16 Low battery).
  • the user only needs to hold the music control terminal 1 described in this embodiment, and connect with the external smart device 20 (which may be a wireless connection or a wired connection, preferably a wireless connection), the user can The smart device 20 selects the type of musical instrument to be played. After the selection is completed, the user can wave the music control terminal 1 in hand according to the rhythm of the music he wants to play.
  • the inertial navigation action recognition module 3 inside the music control terminal 1 Identify the actions performed by the user (that is, the actions of the music control terminal 1), and obtain the corresponding command code according to the recognition result, and then send the command code to the external smart device 20, so that the external smart device 20 The command code plays the corresponding music.
  • the motor 15 on the music control terminal 1 held by the user will also vibrate according to the change of the user's playing movement in accordance with the rhythm of the performance, and the first LED display lamp 8 will also flash according to the change of the user's movement to achieve
  • the first LED display light 8 displays a lighting effect consistent with the rhythm of the performance, increases the user's dynamic sense of playing the instrument, and provides the user with a visual experience that changes with the rhythm.
  • the music control system described in this embodiment enables the user to easily play the instrument At the same time, it also gives users feedback on power perception and vision, which allows users to better experience the melody of music, which is conducive to improving the user experience.
  • Embodiment 3 of the music control system of the present invention.
  • the music control system in this embodiment includes:
  • Each of the finger rings 11 is provided with the control processing unit 2 and the inertial navigation action recognition module 3;
  • Each of the inertial navigation action recognition modules 3 collects the movement trajectory of the corresponding body, recognizes the movement of the body according to the movement trajectory, and transmits the recognition result to the control processing unit 2 to enable the control process
  • the unit 2 obtains the corresponding command code according to the recognition result, and sends the command code to the external smart device 20, so that the external smart device 20 plays the corresponding music according to the command code.
  • the user can put the finger ring 11 on each finger to perform piano performance, and through the cooperation of the multiple finger rings 11, the sound of the played piano music can be played on the external smart device 2.
  • a plurality of second LED display lights 12 are evenly arranged on the outer surface of the finger ring 11, and the second LED display lights 12 are used to display lights that change with action under the control of the control processing unit 2 ;
  • a second button 13 is also provided on the outer surface of the finger ring 11, and the second button 13 is used to control the on / off of the music control terminal 1.
  • system further includes: a motor driver 14 and a motor 15 provided inside the music control terminal 1;
  • the motor driver 14 is used to drive the motor 15 under the control of the control processing unit 2 to vibrate.
  • the motor driver 14 drives the motor 15 to vibrate under the control of the control processing unit 2, including:
  • the control processing unit 2 determines the vibration intensity level according to the acceleration information collected by the acceleration sensor 32, and controls the motor driver 14 to drive the motor 15 to vibrate according to the vibration intensity level.
  • the system further includes: a rechargeable lithium battery 16 and a power management module 17 provided inside the music control terminal 1;
  • the rechargeable lithium battery 16 supplies power to the control system
  • the power management module 17 is configured to detect the power of the rechargeable lithium battery 16 and send a signal of low power to the control processing unit 2 when the power of the rechargeable lithium battery 16 is lower than the power threshold.
  • Embodiment 1 of the music control method of the present invention.
  • the music control method described in this embodiment includes:
  • S61 Collect the action data of each music control terminal 1 separately;
  • the motion data of the music control terminal 1 includes: angular velocity information, acceleration information, and geomagnetic information of the music control terminal 1 moving in space.
  • identifying the action type according to the action data includes:
  • S63 Acquire the corresponding command code according to the action type, and send the command code to the external smart device 20, so that the external smart device 20 plays the corresponding music according to the command code.
  • the method described in this embodiment may further include: for each music control terminal 1, determining the vibration intensity level according to the collected acceleration information, and controlling the motor 15 in the music control terminal 1 to vibrate according to the vibration intensity level ;
  • the LED display light on the surface of the music control terminal 1 is controlled to blink according to the recognized action type, so that the LED display light can display the lighting effect that changes with the action.
  • the vibration intensity level is proportional to the magnitude of the acceleration. In other words, the greater the acceleration, the greater the vibration intensity of the motor 15.
  • the vibration intensity level is set by the magnitude of acceleration, and the vibration intensity of the motor 15 is controlled by the PWM of the motor driver.
  • vibration frequency of the motor 15 is consistent with the frequency of changes in the user's playing movement.
  • the corresponding music control terminal 1 when the user is holding or wearing the music control terminal 1, when the user makes a performance action, in addition to playing a sound corresponding to a musical instrument on the external smart device 20, the corresponding music control terminal 1
  • the internal motor 15 will also generate a vibration to increase the user's dynamic sense of playing the instrument, allowing the user to experience the rhythm of the music personally.
  • the LED display lamp can display a lighting effect that changes with movement under the control of the control processing unit 2.
  • Each action can correspond to a color of light.
  • the LED display light can blink according to the change of the user's movements, so that the LED display light displays the lighting effect that changes with the movement, and provides the user with a visual experience that changes with the rhythm , So that users can feel cool lighting effects while feeling the melody of music, which is conducive to improving the user experience.
  • the gyro sensor 31 inside the music control terminal 1 collects the angular velocity information of the user in each action in the three-axis direction of space X, Y, and Z through the acceleration sensor 32 Collect the acceleration information of the user in the three-axis direction of the space X, Y, and Z in each action, and collect the geomagnetic information of the user in the three-axis direction of the space, X, Y, and Z in each action by the geomagnetic sensor 33, and perform the above information Multiple filtering processing, the processed data is solved using Mahony algorithm to obtain quaternion and Euler angle, the Euler angle includes roll angle, heading angle and pitch angle; according to the Euler angle, it can be identified The type of action, such as horizontal movement, only horizontal acceleration has no angular velocity, and if it is flicked around the wrist, there will be acceleration and angular velocity.
  • the control processing unit 2 inside the music control terminal 1 acquires the corresponding command code according to the recognition result, and wirelessly sends the command code to the external smart device 20; after the external smart device 20 receives the command code, the Set the type of instrument to play and play the sound corresponding to the command code.
  • the preset musical instrument type is a piano
  • 0xaa represents raising the finger upwards
  • 0xbb represents pressing the fingers
  • the command code is agreed in advance by the control processing unit 2 and the smartphone.
  • the smart phone receives the command code 0xbb
  • the smart phone according to the preset musical instrument type is a piano, and can obtain the command code 0xaa corresponding to pressing the finger, that is, the smart phone plays the sound corresponding to the piano.
  • Cartesian coordinate system block method is used to calibrate and classify different scales.
  • the so-called Cartesian coordinate system block method is: as shown in FIG. 7, the horizontal direction can be divided into several regions according to the heading angle The area can represent a scale; as shown in Figure 8, the vertical area can be divided into several areas according to the pitch angle, and each area represents a different scale or loudness.
  • the external smart device 20 stores audio files corresponding to various musical instruments.
  • the music control method described in this embodiment collects the action data of the music control terminal 1 and controls the external smart device 20 to play the corresponding music according to the action of the music control terminal 1.
  • the method described in this embodiment enables users to perform musical instruments as long as they know the rhythm of the music, avoiding the high entry threshold of existing musical instruments and the lack of time and effort required. A good personal experience of the melody of music allows users to experience the charm of music anytime, anywhere.
  • the motor 15 on the music control terminal 1 held or worn by the user can emit vibrations consistent with the rhythm of the performance according to the change of the user's performance, and the LED display light will also flash according to the change of the user's movement to realize the LED display light display
  • a lighting effect that is consistent with the rhythm of the performance, increases the user's dynamic sense of playing the instrument, and provides the user with a visual experience that changes with the rhythm. Giving feedback to users can enable users to better experience the melody of music, which is conducive to improving the user experience.
  • Any process or method description in a flowchart or otherwise described herein may be understood as representing a module, segment, or portion of code that includes one or more executable instructions for implementing specific logical functions or steps of a process
  • the scope of the preferred embodiment of the present invention includes additional implementations, in which the functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, which shall It is understood by those skilled in the art to which the embodiments of the present invention belong.
  • each part of the present invention may be implemented by hardware, software, firmware, or a combination thereof.
  • multiple steps or methods may be implemented with software or firmware stored in memory and executed by a suitable instruction execution system.
  • a logic gate circuit for implementing a logic function on a data signal
  • PGA programmable gate arrays
  • FPGA field programmable gate arrays
  • a person of ordinary skill in the art can understand that all or part of the steps carried in the method of the above embodiments can be completed by instructing relevant hardware through a program.
  • the program can be stored in a computer-readable storage medium. When executed, it includes one of the steps of the method embodiment or a combination thereof.
  • each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units may be integrated into one module.
  • the above integrated modules may be implemented in the form of hardware or software function modules. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.
  • the storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Electrophonic Musical Instruments (AREA)

Abstract

一种音乐控制系统和方法，所述音乐控制系统包括：多个音乐控制终端（1）；每个音乐控制终端（1）内部均设置有控制处理单元（2）和惯性导航动作识别模块（3）；通过惯性导航动作识别模块（3）识别用户手持音乐控制终端（1）所做的动作，并根据音乐控制终端（1）的动作控制外部智能设备（20）播放对应的音乐。所述的音乐控制系统支持多节点控制方式；所述的音乐控制系统和与其适配的外部智能设备（20）相结合使用能够代替笨重的乐器，只要用户知晓乐曲的节奏就可进行乐器演奏，避免了现有乐器入门门槛高，需要花费大量时间和精力的不足；此外，通过将音乐控制终端（1）做成鼓槌状或指环状，便于用户随身携带和使用，使用户随时随地体验音乐的魅力。

Description

一种音乐控制系统和方法 技术领域
本发明涉及电子终端技术领域，具体涉及一种音乐控制系统和方法。
背景技术
现有技术中，无论是要演奏电子乐器，还是传统的管弦敲打乐器，都需要演奏者具有一定的乐理知识，并且还要不断地反复练习才能演奏出一首完整的曲子。比如，一个吉他初学者想要用吉他弹奏一首歌曲，初学者需要掌握一定的乐理知识，如音乐节奏、音调、拨弦技巧等，还要不断地练习以熟悉吉他的使用方法，在练习的过程中还存在将手指头磨破的风险，可见，初学者想要快速的演奏出一首吉他曲目是很困难的，学习过程投入的时间长、成本高。该问题使得初学者很难入门，使很多人不能享受到演奏乐器的乐趣。对于大多数人来说，还仅限于以歌唱的方式来表达一首歌曲，不能更好的切身感受音乐的旋律。
此外，由于大多数乐器(如吉他、架子鼓或古筝等)体积大、重量重，结构复杂，造成携带不方便；并且大多数乐器对演奏的地点要求限制多，不能满足用户随时随地演奏的需求。
发明内容
有鉴于此，本发明的目的在于克服现有技术的不足，提供一种音乐控制系统和方法。
为实现以上目的，本发明采用如下技术方案：一种音乐控制系统，包括：
多个音乐控制终端；
每个所述音乐控制终端内部均设置有控制处理单元和惯性导航动作识别模块；
所述惯性导航动作识别模块，用于对采集到的所述音乐控制终端的动作进行识别，并将识别结果传送给所述控制处理单元，以使所述控制处理单元根据识别结果获取对应的命令码，并将所述命令码发送给外部智能设备，以使所述外部智能设备根据所述命令码播放对应的音乐。
可选的，所述惯性导航动作识别模块，包括：
陀螺仪传感器，用于采集所述音乐控制终端在空间移动的角速度信息；
加速度传感器，用于采集所述音乐控制终端在空间移动的加速度信息；
地磁传感器，用于采集所述音乐控制终端在空间移动的地磁信息；
数字运动处理器，用于对所述陀螺仪传感器采集的角速度信息、所述加速度传感器采集的加速度信息和所述地磁传感器采集的地磁信息进行处理，以得到识别结果，并将识别结果传送给所述控制处理单元。
可选的，所述音乐控制系统包括两个所述音乐控制终端，每一个所述音乐控制终端包括一外型呈鼓槌状的本体；
每一个所述本体内部均设置有所述控制处理单元和所述惯性导航动作识别模块；
每一个所述惯性导航动作识别模块采集所对应本体的移动轨迹，并根据所述移动轨迹识别所述本体的动作，并将识别结果传送给所述控制处理单元。
可选的，所述本体上依次设置有鼓槌头、鼓槌连接部和鼓槌手握部；
在所述鼓槌连接部的外表面上均匀设置有多个第一LED显示灯，所述第一LED显示灯用于在所述控制处理单元的控制下显示随动作变化的灯光。
可选的，在所述鼓槌连接部上还设有第一按键，所述第一按键用于控制所述音乐控制终端的开启/关闭；
在所述鼓槌连接部的表面且靠近所述第一按键的位置设置有用于显示所述音乐控制终端工作状态的呼吸灯。
可选的，所述音乐控制系统包括两个以上所述音乐控制终端，每一个所述音乐控制终端包括一个指环；
每一个所述指环内均设置有所述控制处理单元和所述惯性导航动作识别模块；
每一个所述惯性导航动作识别模块采集所在指环的移动轨迹，并根据所述移动轨迹识别所述指环的动作，并将识别结果传送给所述控制处理单元。
可选的，在所述指环的外表面上均匀设置有多个第二LED显示灯，所述第二LED显示灯用于在所述控制处理单元的控制下显示随动作变化的灯光；
在所述指环的外表面上还设置有第二按键，所述第二按键用于控制所述音乐控制终端的开启/关闭。
可选的，所述系统还包括：设置在所述音乐控制终端内部的马达驱动器和马达；
所述马达驱动器用于在所述控制处理单元的控制下驱动所述马达进行震动。
可选的，所述系统还包括：设置在所述音乐控制终端内部的充电锂电池和电源管理模块；
所述充电锂电池为所述控制系统供电；
所述电源管理模块用于对所述充电锂电池的电量进行检测，并当所述充电锂电池的电量低于电量阈值时，向所述控制处理单元发送电量低的信号。
本发明还提供了一种音乐控制方法，包括：
分别采集每个音乐控制终端的动作数据；
根据每个音乐控制终端的动作数据识别出该音乐控制终端的动作类型；
根据所述动作类型获取对应的命令码，并将所述命令码发送给外部智能设 备，以使所述外部智能设备根据所述命令码播放对应的音乐。
本发明采用以上技术方案，所述音乐控制系统包括：多个音乐控制终端；每个所述音乐控制终端内部均设置有控制处理单元和惯性导航动作识别模块；所述惯性导航动作识别模块，用于对采集到的所述音乐控制终端的动作进行识别，并将识别结果传送给所述控制处理单元，以使所述控制处理单元根据识别结果获取对应的命令码，并将所述命令码发送给外部智能设备，以使所述外部智能设备根据所述命令码播放对应的音乐。本发明通过所述惯性导航动作识别模块识别用户手持音乐控制终端所做的动作，并在所述控制处理单元的控制下根据音乐控制终端所做的动作控制外部智能设备播放对应的音乐。本发明所述的音乐控制系统和与其适配的外部智能设备相结合使用能够代替笨重的乐器，只要用户知晓乐曲的节奏就可进行乐器演奏，避免了现有乐器入门门槛高，需要花费大量时间和精力的不足；本发明所述的音乐控制系统支持多节点控制方式，通过所述系统一个用户可模拟出敲鼓、弹钢琴的乐器效果，并且该系统支持多人控制方式，即每人手持一个音乐控制终端，多人协同完成乐曲的演奏；本系统能够让用户更好的切身感受音乐的旋律；此外，本发明通过将音乐控制终端做成鼓槌状或指环状，便于用户随身携带和使用，使用户随时随地体验音乐的魅力。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本发明音乐控制系统实施例一提供的结构连接示意图；
图2是本发明音乐控制系统实施例二提供的整体结构示意图；
图3是本发明音乐控制系统实施例二提供的结构连接示意图；
图4是本发明音乐控制系统实施例三提供的整体结构示意图；
图5是本发明音乐控制系统实施例三提供的结构连接示意图；
图6是本发明音乐控制方法实施例一提供的流程示意图；
图7为根据航向角将水平方向分为若干区域的示意图；
图8为根据俯仰角将垂直区域分为若干区域的示意图。
图中：1、音乐控制终端；2、控制处理单元；3、惯性导航动作识别模块；31、陀螺仪传感器；32、加速度传感器；33、地磁传感器；34、数字运动处理器；4、鼓槌状的本体；5、鼓槌头；6、鼓槌连接部；7、鼓槌手握部；8、第一LED显示灯；9、第一按键；10、呼吸灯；11、指环；12、第二LED显示灯；13、第二按键；14、马达驱动器；15、马达；16、充电锂电池；17、电源管理模块；18、充电插口；19、无线通信模块；20、外部智能设备。
具体实施方式
为使本发明的目的、技术方案和优点更加清楚，下面将对本发明的技术方案进行详细的描述。显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动的前提下所得到的所有其它实施方式，都属于本发明所保护的范围。
图1是本发明音乐控制系统实施例一提供的结构连接示意图。
如图1所示，本实施例所述的音乐控制系统包括：
多个音乐控制终端1；
每个所述音乐控制终端1内部均设置有控制处理单元2和惯性导航动作识别模块3；
所述惯性导航动作识别模块3，用于对采集到的所述音乐控制终端1的动作进行识别，并将识别结果传送给所述控制处理单元2，以使所述控制处理单 元2根据识别结果获取对应的命令码，并将所述命令码发送给外部智能设备20，以使所述外部智能设备20根据所述命令码播放对应的音乐。
进一步的，所述惯性导航动作识别模块3，包括：
陀螺仪传感器31，用于采集所述音乐控制终端1在空间移动的角速度信息；
加速度传感器32，用于采集所述音乐控制终端1在空间移动的加速度信息；
地磁传感器33，用于采集所述音乐控制终端1在空间移动的地磁信息；
数字运动处理器34，用于对所述陀螺仪传感器31采集的角速度信息、所述加速度传感器33采集的加速度信息和所述地磁传感器33采集的地磁信息进行处理，以得到识别结果，并将识别结果传送给所述控制处理单元2。
可以理解的是，所述控制处理单元2可以是单片机或带有cpu芯片能够进行数据处理和控制的模块。
本实施例所述的音乐控制终端1形状小巧，便于用户手持或穿戴。一个用户单独使用时，可以分别手持或穿戴上多个音乐控制终端1，用户根据要演奏的乐曲的节奏进行演奏，所述音乐控制终端1会根据用户的动作来向外部智能设备20发送命令码，以使外界智能设备播放相应的音乐。比如用户想要弹奏一首《月光》的钢琴曲，用户只需要事先将该系统与外部智能设备20连接，并在外部智能设备20上设置好要演奏的乐器类型，即可进行演奏。
所述外部智能设备20包括如下项中的至少一项：
智能手机、平板电脑、智能音响、智能电视。
本实施例中以智能手机为例，在智能手机上安装有与所述音乐控制系统相匹配的应用软件，每一个所述音乐控制终端1内部设置有无线通信模块19，比如蓝牙模块，通过所述无线通信模块19，所述音乐控制终端1与所述智能手机无线连接，连接成功后，用户在智能手机上设置即将要演奏的乐器类型，比如钢琴，设置完成后，用户将多个所述音乐控制终端1分别固定在不同的手指上，就可按照《月光》的节奏在空气中舞动手指。
在所述音乐控制终端1移动的过程中，所述惯性导航动作识别模块3采集所述音乐控制终端1在空间X、Y、Z三轴方向的加速度信息、角速度信息和地磁信息，并对采集的角速度信息、加速度信息和地磁信息进行处理，得到识别结果(比如，上移、下移、水平左移或水平右移)，并将识别结果传送给对应的所述控制处理单元2(属于同一个音乐控制终端1的惯性导航动作识别模块3和控制处理单元2)；所述控制处理单元2根据识别结果获取对应的命令码(比如，上移对应的命令码是0xaa，下移对应的命令码是0xbb，水平左移对应的命令码是0xcc，水平右移对应的命令码是0xdd等等)，并将所述命令码无线发送给智能手机；所述智能手机接收到该命令码后，根据预先设置的演奏乐器类型，播放出所述命令码对应的声音。比如，预先设置的演奏乐器类型是钢琴时，则0xaa代表向上抬起手指，0xbb代表按下手指；该命令码是由控制处理单元2和智能手机事先约定好的。当智能手机接收到命令码0xbb后，智能手机根据预先设置的演奏乐器类型是钢琴，可以获取到命令码0xaa对应的是按下手指，即智能手机播放出钢琴对应的声音。
可以理解的是，所述外部智能设备20中存储有与各种乐器相对应的音频文件。
本实施例所述的音乐控制系统和与其适配的智能手机相结合使用能够代替笨重的乐器，只要用户知晓乐曲的节奏就可进行乐器演奏，避免了现有乐器入门门槛高，需要花费大量时间和精力的不足，本实施例所述的音乐控制系统能够让用户更好的切身感受音乐的旋律；本实施例所述的音乐控制系统支持多节点控制方式，通过所述系统一个用户可模拟出敲鼓、弹钢琴的乐器效果；本系统能够让用户更好的切身感受音乐的旋律。
图2和图3是本发明音乐控制系统实施例二提供的结构示意图。
如图2和图3所示，本实施例所述的音乐控制系统包括：
两个所述音乐控制终端1，每一个所述音乐控制终端1包括一外型呈鼓槌 状的本体4；
每一个所述本体内部均设置有所述控制处理单元2和所述惯性导航动作识别模块3；
每一个所述惯性导航动作识别模块3采集所对应本体的移动轨迹，并根据所述移动轨迹识别所述本体的动作，并将识别结果传送给所述控制处理单元2，以使所述控制处理单元2根据识别结果获取对应的命令码，并将所述命令码发送给外部智能设备20，以使所述外部智能设备20根据所述命令码播放对应的音乐。
需要说明的是，用户可通过两个所述音乐控制终端1相互配合来进行演奏，比如通过左右手分别手持一个音乐控制终端1来演奏敲鼓的乐曲。
所述本体上依次设置有鼓槌头5、鼓槌连接部6和鼓槌手握部7；
在所述鼓槌连接部6的外表面上均匀设置有多个第一LED显示灯8，所述第一LED显示灯8用于在所述控制处理单元2的控制下显示随动作变化的灯光。可以是每种动作对应一种灯光的颜色。
在用户手持所述音乐控制终端1进行演奏时，本实施例所述的第一LED显示灯8能够在所述控制处理单元2的控制下根据用户动作的变化进行闪烁，以实现第一LED显示灯8显示出随动作变化的灯光效果，为用户提供随节奏变换的视觉体验，使用户在感受音乐旋律的同时，还能感受到炫酷的灯光效果，有利于提高用户体验。
进一步的，在所述鼓槌连接部6上还设有第一按键9，所述第一按键9用于控制所述音乐控制终端1的开启/关闭；
在所述鼓槌连接部6的表面且靠近所述第一按键9的位置设置有用于显示所述音乐控制终端1工作状态的呼吸灯10。
进一步的，所述系统还包括：设置在所述音乐控制终端1内部的马达驱动器14和马达15；
所述马达驱动器14用于在所述控制处理单元2的控制下驱动所述马达15进行震动。
进一步的，所述马达驱动器14在所述控制处理单元2的控制下驱动所述马达15进行震动，包括：
所述控制处理单元2根据所述加速度传感器32采集的加速度信息来确定震动强度等级，并按照所述震动强度等级来控制所述马达驱动器14驱动所述马达15进行震动。
其中，所述震动强度等级与所述加速度的大小成正比。即加速度越大的动作对应的马达15震动强度就越大。由加速度的大小设定震动强度等级，并通过电机驱动器的PWM控制马达15的震动强度。
进一步的，所述马达15的震动频率与用户演奏动作变化的频率相一致。
本实施例在使用时，用户左右手分别手持一个鼓槌状的本体4，也可以是两个一个用户，其中每个用户分别手持一个鼓槌状的本体4，所述音乐控制终端1与外部智能设备20连接成功后，并完成要演奏的乐器类型的设置后，用户即可开始跟随要演奏的乐曲的节奏舞动手中的本体。在演奏的过程中，每当用户做出一个演奏动作后，在外部智能设备20播放一个乐器对应的声音之外，所述音乐控制终端1内部的马达15还会产生一次震动，以增加用户演奏乐器的动感，让用户切身感受音乐的律动。
进一步的，所述系统还包括：设置在所述音乐控制终端1内部的充电锂电池16和电源管理模块17；
所述充电锂电池16为所述控制系统供电；
在所述鼓槌手握部7的底部设有充电插口18，通过所述充电插口18为所述充电锂电池16供电。
所述电源管理模块17用于对所述充电锂电池16的电量进行检测，并当所述充电锂电池16的电量低于电量阈值时，向所述控制处理单元2发送电量低的 信号，所述控制处理单元2接收到电量低的信号后，能够控制所述第一LED显示灯8发出提醒充电的信号(如所述第一LED显示灯8发出不断闪烁的红色灯光代表所述充电锂电池16电量不足)。
在实际使用中，用户只需手持本实施例所述的音乐控制终端1，并与外部智能设备20连接(可以是无线连接，也可以是有线连接，优选无线连接方式)后，用户可通过外部智能设备20选定要演奏的乐器类型，选定完成后，用户即可按照自己想要演奏的乐曲的节奏挥动手中的音乐控制终端1，所述音乐控制终端1内部的惯性导航动作识别模块3识别用户所做的动作(即所述音乐控制终端1的动作)，并根据识别结果获取对应的命令码，然后将所述命令码发送给外部智能设备20，以使所述外部智能设备20根据所述命令码播放对应的音乐。同时，用户手持的音乐控制终端1上的马达15还会根据用户的演奏动作变化发出与演奏节奏相一致的震动，所述第一LED显示灯8也会根据用户动作的变化进行闪烁，以实现第一LED显示灯8显示出随演奏节奏相一致的灯光效果，增加用户演奏乐器的动感，为用户提供随节奏变换的视觉体验，本实施例所述的音乐控制系统在实现用户轻松能够演奏乐器的同时，还在力觉和视觉上给用户以反馈，能够让用户更好的切身感受音乐的旋律，有利于提高用户体验。
图4和图5是本发明音乐控制系统实施例三提供的结构示意图。
如图4和图5所示，本实施例所述的音乐控制系统包括：
两个以上所述音乐控制终端1，每一个所述音乐控制终端1包括一个指环11；
每一个所述指环11内均设置有所述控制处理单元2和所述惯性导航动作识别模块3；
每一个所述惯性导航动作识别模块3采集所对应本体的移动轨迹，并根据所述移动轨迹识别所述本体的动作，并将识别结果传送给所述控制处理单元2，以使所述控制处理单元2根据识别结果获取对应的命令码，并将所述命令码发 送给外部智能设备20，以使所述外部智能设备20根据所述命令码播放对应的音乐。
需要说明的是，用户可将指环11分别套在每个手指上进行钢琴演奏，通过多个指环11的相互配合，在外部智能设备2上播放出演奏的钢琴乐曲声音。
进一步的，在所述指环11的外表面上均匀设置有多个第二LED显示灯12，所述第二LED显示灯12用于在所述控制处理单元2的控制下显示随动作变化的灯光；
在所述指环11的外表面上还设置有第二按键13，所述第二按键13用于控制所述音乐控制终端1的开启/关闭。
进一步的，所述系统还包括：设置在所述音乐控制终端1内部的马达驱动器14和马达15；
所述马达驱动器14用于在所述控制处理单元2的控制下驱动所述马达15进行震动。
进一步的，所述马达驱动器14在所述控制处理单元2的控制下驱动所述马达15进行震动，包括：
所述控制处理单元2根据所述加速度传感器32采集的加速度信息来确定震动强度等级，并按照所述震动强度等级来控制所述马达驱动器14驱动所述马达15进行震动。
进一步的，所述系统还包括：设置在所述音乐控制终端1内部的充电锂电池16和电源管理模块17；
所述充电锂电池16为所述控制系统供电；
所述电源管理模块17用于对所述充电锂电池16的电量进行检测，并当所述充电锂电池16的电量低于电量阈值时，向所述控制处理单元2发送电量低的信号。
本实施例所述的控制系统的工作原理与实施例二相同，在此不再赘述。
图6是本发明音乐控制方法实施例一提供的流程示意图。
如图6所示，本实施例所述的音乐控制方法包括：
S61：分别采集每个音乐控制终端1的动作数据；
进一步的，所述音乐控制终端1的动作数据，包括：音乐控制终端1在空间移动的角速度信息、加速度信息和地磁信息。
S62：根据每个音乐控制终端1的动作数据识别出该音乐控制终端1的动作类型；
进一步的，对于每个控制终端来说，根据所述动作数据识别出动作类型，包括：
对采集的角速度信息、加速度信息和地磁信息进行滤波处理；
对滤波处理后的数据采用姿态解算算法进行处理；
根据姿态解算结果，识别出动作的类型。
S63：根据所述动作类型获取对应的命令码，并将所述命令码发送给外部智能设备20，以使所述外部智能设备20根据所述命令码播放对应的音乐。
本实施例所述的方法还可以包括：对于每一个音乐控制终端1，根据采集的加速度信息来确定震动强度等级，并按照所述震动强度等级来控制该音乐控制终端1内的马达15进行震动；
根据识别出的动作类型控制该音乐控制终端1表面上的LED显示灯进行闪烁，以使所述LED显示灯能够显示出随动作变化的灯光效果。
进一步的，所述震动强度等级与所述加速度的大小成正比。即加速度越大的动作对应的马达15震动强度就越大。由加速度的大小设定震动强度等级，并通过电机驱动器的PWM控制马达15的震动强度。
进一步的，所述马达15的震动频率与用户演奏动作变化的频率相一致。
本实施例在用户手持或穿戴所述音乐控制终端1演奏的过程中，每当用户做出一个演奏动作后，在外部智能设备20播放一个乐器对应的声音之外，对应 的所述音乐控制终端1内部的马达15还会产生一次震动，以增加用户演奏乐器的动感，让用户切身感受音乐的律动。
进一步的，在演奏状态下，所述LED显示灯能够在所述控制处理单元2的控制下显示随动作变化的灯光效果。可以是每种动作对应一种灯光的颜色。
在用户手持或穿戴所述音乐控制终端1进行演奏时，LED显示灯能够根据用户动作的变化进行闪烁，以实现LED显示灯显示出随动作变化的灯光效果，为用户提供随节奏变换的视觉体验，使用户在感受音乐旋律的同时，还能感受到炫酷的灯光效果，有利于提高用户体验。
本实施例所述的方法在实际运行中，通过所述音乐控制终端1内部的陀螺仪传感器31采集用户在做每一个动作在空间X、Y、Z三轴方向的角速度信息，通过加速度传感器32采集用户在每一个动作在空间X、Y、Z三轴方向的加速度信息，通过所述地磁传感器33采集用户在每一个动作在空间X、Y、Z三轴方向的地磁信息，对以上信息进行多重滤波处理，处理后的数据运用Mahony算法进行解算，得到四元数和欧拉角，所述欧拉角包括横滚角、航向角和俯仰角；依据所述欧拉角，就能识别出动作的类型，比如水平移动就只有水平加速度没有角速度，绕着手腕甩动的话就会有加速度和角速度。所述音乐控制终端1内部的控制处理单元2根据识别结果获取对应的命令码，并将所述命令码无线发送给外部智能设备20；所述外部智能设备20接收到该命令码后，根据预先设置的演奏乐器类型，播放出所述命令码对应的声音。比如，预先设置的演奏乐器类型是钢琴时，则0xaa代表向上抬起手指，0xbb代表按下手指；该命令码是由控制处理单元2和智能手机事先约定好的。当智能手机接收到命令码0xbb后，智能手机根据预先设置的演奏乐器类型是钢琴，可以获取到命令码0xaa对应的是按下手指，即智能手机播放出钢琴对应的声音。因为基本音级有七个，它们分别是“do、re、mi、fa、sol、la、si”。对于不同的乐器，可以相应增加音级数量。最终达到模拟乐器的目的。这里使用笛卡尔坐标系分块法对 不同的音阶进行标定和分级，所谓的笛卡尔坐标系分块法就是：如图7所示，根据航向角可以将水平方向分割成若干个区域，每一个区域就可以代表一个阶；如图8所示，根据俯仰角可以将垂直区域分为若干个区域，每一个区域代表不同的音阶或响度。
可以理解的是，所述外部智能设备20中存储有与各种乐器相对应的音频文件。
本实施例所述的音乐控制方法通过采集音乐控制终端1的动作数据，并根据音乐控制终端1的动作控制外部智能设备20播放对应的音乐。本实施例所述的方法能够实现用户只要知晓乐曲的节奏就可进行乐器演奏，避免了现有乐器入门门槛高，需要花费大量时间和精力的不足，本实施例所述的方法能够让用户更好的切身感受音乐的旋律，使用户随时随地体验音乐的魅力。
此外，用户手持或穿戴的音乐控制终端1上的马达15能够根据用户的演奏动作变化发出与演奏节奏相一致的震动，LED显示灯也会根据用户动作的变化进行闪烁，以实现LED显示灯显示出随演奏节奏相一致的灯光效果，增加用户演奏乐器的动感，为用户提供随节奏变换的视觉体验，本实施例所述的方法在实现用户轻松能够演奏乐器的同时，还在力觉和视觉上给用户以反馈，能够让用户更好的切身感受音乐的旋律，有利于提高用户体验。
可以理解的是，上述各实施例中相同或相似部分可以相互参考，在一些实施例中未详细说明的内容可以参见其他实施例中相同或相似的内容。
需要说明的是，在本发明的描述中，术语“第一”、“第二”等仅用于描述目的，而不能理解为指示或暗示相对重要性。此外，在本发明的描述中，除非另有说明，“多个”的含义是指至少两个。
流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为，表示包括一个或更多个用于实现特定逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分，并且本发明的优选实施方式的范围包括另外的实现，其 中可以不按所示出或讨论的顺序，包括根据所涉及的功能按基本同时的方式或按相反的顺序，来执行功能，这应被本发明的实施例所属技术领域的技术人员所理解。
应当理解，本发明的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中，多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。例如，如果用硬件来实现，和在另一实施方式中一样，可用本领域公知的下列技术中的任一项或他们的组合来实现：具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路，具有合适的组合逻辑门电路的专用集成电路，可编程门阵列(PGA)，现场可编程门阵列(FPGA)等。
本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成，所述的程序可以存储于一种计算机可读存储介质中，该程序在执行时，包括方法实施例的步骤之一或其组合。
此外，在本发明各个实施例中的各功能单元可以集成在一个处理模块中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时，也可以存储在一个计算机可读取存储介质中。
上述提到的存储介质可以是只读存储器，磁盘或光盘等。
在本说明书的描述中，参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中，对上述术语的示意性表述不一定指的是相同的实施例或示例。而且，描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施例或示例中以合适的方式结合。
尽管上面已经示出和描述了本发明的实施例，可以理解的是，上述实施例是示例性的，不能理解为对本发明的限制，本领域的普通技术人员在本发明的范围内可以对上述实施例进行变化、修改、替换和变型。

Claims (10)

  1. 一种音乐控制系统，其特征在于，包括：
    多个音乐控制终端；
    每个所述音乐控制终端内部均设置有控制处理单元和惯性导航动作识别模块；
    所述惯性导航动作识别模块，用于对采集到的所述音乐控制终端的动作进行识别，并将识别结果传送给所述控制处理单元，以使所述控制处理单元根据识别结果获取对应的命令码，并将所述命令码发送给外部智能设备，以使所述外部智能设备根据所述命令码播放对应的音乐。
  2. 根据权利要求1所述的系统，其特征在于，所述惯性导航动作识别模块，包括：
    陀螺仪传感器，用于采集所述音乐控制终端在空间移动的角速度信息；
    加速度传感器，用于采集所述音乐控制终端在空间移动的加速度信息；
    地磁传感器，用于采集所述音乐控制终端在空间移动的地磁信息；
    数字运动处理器，用于对所述陀螺仪传感器采集的角速度信息、所述加速度传感器采集的加速度信息和所述地磁传感器采集的地磁信息进行处理，以得到识别结果，并将识别结果传送给所述控制处理单元。
  3. 根据权利要求1所述的系统，其特征在于，所述音乐控制系统包括两个所述音乐控制终端，每一个所述音乐控制终端包括一外型呈鼓槌状的本体；
    每一个所述本体内部均设置有所述控制处理单元和所述惯性导航动作识别模块；
    每一个所述惯性导航动作识别模块采集所对应本体的移动轨迹，并根据所述移动轨迹识别所述本体的动作，并将识别结果传送给所述控制处理单元。
  4. 根据权利要求3所述的系统，其特征在于，所述本体上依次设置有鼓槌头、鼓槌连接部和鼓槌手握部；
    在所述鼓槌连接部的外表面上均匀设置有多个第一LED显示灯，所述第一LED显示灯用于在所述控制处理单元的控制下显示随动作变化的灯光。
  5. 根据权利要求4所述的系统，其特征在于，在所述鼓槌连接部上还设有第一按键，所述第一按键用于控制所述音乐控制终端的开启/关闭；
    在所述鼓槌连接部的表面且靠近所述第一按键的位置设置有用于显示所述音乐控制终端工作状态的呼吸灯。
  6. 根据权利要求1所述的系统，其特征在于，所述音乐控制系统包括两个以上所述音乐控制终端，每一个所述音乐控制终端包括一个指环；
    每一个所述指环内均设置有所述控制处理单元和所述惯性导航动作识别模块；
    每一个所述惯性导航动作识别模块采集所在指环的移动轨迹，并根据所述移动轨迹识别所述指环的动作，并将识别结果传送给所述控制处理单元。
  7. 根据权利要求6所述的系统，其特征在于，在所述指环的外表面上均匀设置有多个第二LED显示灯，所述第二LED显示灯用于在所述控制处理单元的控制下显示随动作变化的灯光；
    在所述指环的外表面上还设置有第二按键，所述第二按键用于控制所述音乐控制终端的开启/关闭。
  8. 根据权利要求3至7任一项所述的系统，其特征在于，还包括：设置在所述音乐控制终端内部的马达驱动器和马达；
    所述马达驱动器用于在所述控制处理单元的控制下驱动所述马达进行震动。
  9. 根据权利要求8所述的系统，其特征在于，还包括：设置在所述音乐控制终端内部的充电锂电池和电源管理模块；
    所述充电锂电池为所述控制系统供电；
    所述电源管理模块用于对所述充电锂电池的电量进行检测，并当所述充电 锂电池的电量低于电量阈值时，向所述控制处理单元发送电量低的信号。
  10. 一种音乐控制方法，其特征在于，包括：
    分别采集每个音乐控制终端的动作数据；
    根据每个音乐控制终端的动作数据识别出该音乐控制终端的动作类型；
    根据所述动作类型获取对应的命令码，并将所述命令码发送给外部智能设备，以使所述外部智能设备根据所述命令码播放对应的音乐。
PCT/CN2019/125899 2018-10-31 2019-12-17 一种音乐控制系统和方法 WO2020088695A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811292883.2A CN109147742A (zh) 2018-10-31 2018-10-31 一种音乐控制系统和方法
CN201811292883.2 2018-10-31

Publications (1)

Publication Number Publication Date
WO2020088695A1 true WO2020088695A1 (zh) 2020-05-07

Family

ID=64807414

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/125899 WO2020088695A1 (zh) 2018-10-31 2019-12-17 一种音乐控制系统和方法

Country Status (2)

Country Link
CN (1) CN109147742A (zh)
WO (1) WO2020088695A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109147742A (zh) * 2018-10-31 2019-01-04 北京戴乐科技有限公司 一种音乐控制系统和方法
CN111462718A (zh) * 2020-05-22 2020-07-28 北京戴乐科技有限公司 一种乐器模拟系统
CN117979211A (zh) * 2024-03-29 2024-05-03 深圳市戴乐体感科技有限公司 集成音箱系统及其控制方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070149361A1 (en) * 2005-12-02 2007-06-28 Samsung Electronics Co., Ltd. System and method for manipulating portable equipment using foot motion
CN105867656A (zh) * 2016-04-27 2016-08-17 牛亚锋 一种体感音乐穿戴设备及其演奏动作识别方法
CN105931627A (zh) * 2016-04-07 2016-09-07 百度在线网络技术（北京）有限公司 基于人工智能的动作识别的乐器模拟方法和装置
CN109147742A (zh) * 2018-10-31 2019-01-04 北京戴乐科技有限公司 一种音乐控制系统和方法

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3879583B2 (ja) * 2001-05-08 2007-02-14 ヤマハ株式会社 楽音発生制御システム、楽音発生制御方法、楽音発生制御装置、操作端末、楽音発生制御プログラム及び楽音発生制御プログラムを記録した記録媒体
JP3948242B2 (ja) * 2001-10-17 2007-07-25 ヤマハ株式会社 楽音発生制御システム
CN103928018A (zh) * 2014-04-18 2014-07-16 山西四和创想科技有限公司 一种练习用无线智能电子鼓槌
US9418639B2 (en) * 2015-01-07 2016-08-16 Muzik LLC Smart drumsticks

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070149361A1 (en) * 2005-12-02 2007-06-28 Samsung Electronics Co., Ltd. System and method for manipulating portable equipment using foot motion
CN105931627A (zh) * 2016-04-07 2016-09-07 百度在线网络技术（北京）有限公司 基于人工智能的动作识别的乐器模拟方法和装置
CN105867656A (zh) * 2016-04-27 2016-08-17 牛亚锋 一种体感音乐穿戴设备及其演奏动作识别方法
CN109147742A (zh) * 2018-10-31 2019-01-04 北京戴乐科技有限公司 一种音乐控制系统和方法

Also Published As

Publication number Publication date
CN109147742A (zh) 2019-01-04

Similar Documents

Publication Publication Date Title
WO2020088695A1 (zh) 一种音乐控制系统和方法
US11298551B2 (en) Spherical input and output methods and devices
US10895914B2 (en) Methods, devices, and methods for creating control signals
US9542920B2 (en) Modular wireless sensor network for musical instruments and user interfaces for use therewith
US9224377B2 (en) Computerized percussion instrument
US20220172638A1 (en) Method and apparatus for an adaptive and interactive teaching of playing a musical instrument
CN105867656B (zh) 一种基于体感音乐穿戴设备的演奏动作识别方法
CN105741639B (zh) 一种模拟弓弦类乐器的微感掌上乐器
JP2020058659A (ja) ゲームシステム、ゲーム処理方法、ゲームプログラム、ゲーム装置、およびゲームコントローラ
CN109147741A (zh) 一种音乐演奏方法和装置
US9418639B2 (en) Smart drumsticks
CN105845119B (zh) 一种智能掌上乐器及演奏方法
CN105096691A (zh) 钢琴仿真学习设备及其使用方法
CN1961349A (zh) 乐器
CN107126697A (zh) 一种非接触式的音乐玩具
US20180137770A1 (en) Musical instrument indicator apparatus, system, and method to aid in learning to play musical instruments
CN205680441U (zh) 一种虚拟演奏系统
Torre The design of a new musical glove: a live performance approach
WO2022237362A1 (zh) 基于音乐节拍检测用户动作的方法和设备
US10319352B2 (en) Notation for gesture-based composition
CN214344200U (zh) 一种人体肢体运动和器械运动模拟声音增强运动能力装置
KR102397835B1 (ko) 음악회상기법 기반 인지능력 향상 시스템
CN206524180U (zh) 一种多功能智能乐器
CN203746412U (zh) 悬浮电子琴
Overholt Advancements in violin-related human-computer interaction

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19878535

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19878535

Country of ref document: EP

Kind code of ref document: A1