WO2018013549A1 - Musical activity monitor - Google Patents

Musical activity monitor Download PDF

Info

Publication number
WO2018013549A1
WO2018013549A1 PCT/US2017/041507 US2017041507W WO2018013549A1 WO 2018013549 A1 WO2018013549 A1 WO 2018013549A1 US 2017041507 W US2017041507 W US 2017041507W WO 2018013549 A1 WO2018013549 A1 WO 2018013549A1
Authority
WO
WIPO (PCT)
Prior art keywords
sensor
musical instrument
instrument
casing
activity monitor
Prior art date
Application number
PCT/US2017/041507
Other languages
French (fr)
Inventor
Steve Skillings
Meng Ru KUOK
Original Assignee
Steve Skillings
Kuok Meng Ru
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Steve Skillings, Kuok Meng Ru filed Critical Steve Skillings
Publication of WO2018013549A1 publication Critical patent/WO2018013549A1/en

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B15/00Teaching music
    • G09B15/02Boards or like means for providing an indication of notes
    • G09B15/04Boards or like means for providing an indication of notes with sound emitters
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/0008Associated control or indicating means
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/02Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos
    • G10H1/04Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation
    • G10H1/053Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation during execution only
    • G10H1/055Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos by additional modulation during execution only by switches with variable impedance elements
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G10H2210/076Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for extraction of timing, tempo; Beat detection
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G10H2210/091Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155User input interfaces for electrophonic musical instruments
    • G10H2220/351Environmental parameters, e.g. temperature, ambient light, atmospheric pressure, humidity, used as input for musical purposes
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155User input interfaces for electrophonic musical instruments
    • G10H2220/351Environmental parameters, e.g. temperature, ambient light, atmospheric pressure, humidity, used as input for musical purposes
    • G10H2220/355Geolocation input, i.e. control of musical parameters based on location or geographic position, e.g. provided by GPS, WiFi network location databases or mobile phone base station position databases
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155User input interfaces for electrophonic musical instruments
    • G10H2220/391Angle sensing for musical purposes, using data from a gyroscope, gyrometer or other angular velocity or angular movement sensing device
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155User input interfaces for electrophonic musical instruments
    • G10H2220/395Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing.
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/461Transducers, i.e. details, positioning or use of assemblies to detect and convert mechanical vibrations or mechanical strains into an electrical signal, e.g. audio, trigger or control signal
    • G10H2220/525Piezoelectric transducers for vibration sensing or vibration excitation in the audio range; Piezoelectric strain sensing, e.g. as key velocity sensor; Piezoelectric actuators, e.g. key actuation in response to a control voltage
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/171Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
    • G10H2240/201Physical layer or hardware aspects of transmission to or from an electrophonic musical instrument, e.g. voltage levels, bit streams, code words or symbols over a physical link connecting network nodes or instruments
    • G10H2240/211Wireless transmission, e.g. of music parameters or control data by radio, infrared or ultrasound

Definitions

  • This invention generally relates to devices for management of musical instruments, and in particular, to devices for monitoring activity of musical instruments .
  • the invention features a musical-instrument activity monitor having a sensor and a processor coupled to the sensor.
  • the sensor is disposed to detect a signal indicative of activity of the musical instrument.
  • the senor is an environmental sensor.
  • Other embodiments include those in which the sensor is an accelerometer , a temperature sensor, a humidity sensor, a photo-sensor, a piezoelectric sensor, an EMI sensor, a
  • gyroscopic sensor a tuner, and a GPS unit.
  • the sensor attaches to an actuator of the musical instrument.
  • actuators include a drumstick, a bow, a mallet, and a plectrum.
  • the senor attaches to the body of the musical instrument.
  • Sensors also include those that detect an acoustic signal produced by the musical instrument, those that are disposed in a microphone, in which case the musical instrument would be the singer's vocal cords, those that detect motion of the musical instrument, and those that record an acoustic signal produced by the musical instrument.
  • a variety of ways are available to attach the sensor, including a clamp, a suction device, a magnet, glue, a hook- and-loop fastener, or a screw.
  • the sensor can also be an internal sensor. These internal sensors sense something about the state of the activity monitor itself. Examples include a sensor that measures an available power level for the activity monitor, and a sensor that measures an internal temperature the activity monitor.
  • Some embodiments also have a communication interface for establishing communication between the activity monitor and an external device.
  • a communication interface for establishing communication between the activity monitor and an external device.
  • Such an interface can establish wireless communication between the activity monitor and an external device. Alternatively, it can establish communication between the activity monitor and an external device over a wire.
  • the communication interface can establish
  • Examples of devices with which the activity monitor could communicate include a personal computer, a tuning actuator, a smart phone, and even a cloud-based platform.
  • Information shared can include information representative of musical instrument activity.
  • the embodiments are those that also have a display for displaying information derived from a signal provided to the processor by the sensor.
  • the musical-instrument activity monitor has a battery for providing power to the sensor and the processor.
  • the battery can be either rechargeable or
  • the processor is configured to determine one or more states of the instrument. For example, in some embodiments, the processor determines, from data provided by the sensor, that the instrument is at rest. In others, it determines, from data provided by the sensor, that the instrument is in motion. In yet others, it determines, from data provided by the sensor, that the instrument is being played.
  • the processor is also useful for identifying a potential source of damage to an instrument. For example, in some embodiments, the processor determines, from data provided by the sensor, that the instrument has sustained a shock in excess of a predetermined shock threshold, or that it has been stored in an environment having a humidity that is outside a desired range of humidity, or that it has been stored in an environment having a temperature that is outside a desired range of temperature .
  • the processor is configured to calculate a tempo of the music based on a signal from the sensor .
  • a casing encloses the musical-instrument activity monitor.
  • a variety of casings are possible. Some casings are made of a material that is transparent to electromagnetic radiation having wavelengths in a GPS communication band. Others are made of a material that is transparent to electromagnetic radiation having wavelengths in a band designated for wireless networks. Yet others are configured such that, when the casing is vibrated by vibration of a first amplitude, the musical-instrument activity monitor is vibrated at a second amplitude that is less than the first amplitude. These would be shock-proof or essentially shock- proof casings.
  • Casings can be made of a wide variety of materials including metal, plastic, wood, rubber, and
  • casing configured such that a value of relative humidity outside the casing is higher than a value of relative humidity inside the casing.
  • Other casings are water-resistant or waterproof.
  • the casing is configured such that water outside the casing fails to penetrate the casing.
  • the casing is attachable to a first musical instrument by mating the modular attachment to a first universal attachment that is attached to the first musical instrument. It is then detachable from the first musical instrument and attachable to a second musical
  • the instrument by mating the modular attachment to a second universal attachment that is attached to the second musical instrument.
  • the second universal attachment is identical in structure to the first universal attachment.
  • Some embodiments feature a metronome.
  • the processor is configured to compare a signal from the sensor with a signal provided by the metronome to evaluate maintenance of correct tempo.
  • Embodiments further include those in which the processor is configured to determine a frequency response of the musical instrument to a stimulus and those in which it is configured to determine an impulse response of the musical instrument to a stimulus .
  • the device may also act as an actuator, in that it may change some aspect of the musical instrument, as desired by the musician, teacher, or manufacturer.
  • the device may send data to automated tuner motors, for a musical instrument with that capability on the musical instrument, so that a musician can have multiple tuning templates and styles, called "alternate tunings" that are hard to do quickly by hand.
  • the device may work in concert with other devices connected to the musical instrument, such as an electronic magnetic pickup system for a guitar, a mechanical proximity sensor for a bass drum pedal, a vibration sensor for a cymbal, a microphone preamp, or another sensor system, and work with a plurality of device's data to share, store, process, compound, report, transmit and receive data to help the musical instrument, such as an electronic magnetic pickup system for a guitar, a mechanical proximity sensor for a bass drum pedal, a vibration sensor for a cymbal, a microphone preamp, or another sensor system, and work with a plurality of device's data to share, store, process, compound, report, transmit and receive data to help the
  • the devices may work with other band members' devices to record group/band related data during a practice or live performance.
  • the devices may share information device-to-device, through a smart phone or computer, or a "cloud" platform.
  • a device connected to a microphone, or microphone system provides for a novel way to collect musician activity data via a microphone, humidity sensor, vibration sensors,
  • accelerometers and other sensors.
  • High quality microphones are sensitive to saliva accidentally projected into the microphone capsule, and a sensor could give a musician, or club owner, data about the humidity level inside the microphone to ensure it gets cleaned and dried at appropriate intervals.
  • the device may be connected to a "cloud" platform that can provide advanced analytics of their data to do predictive analysis on replaceable components like strings, reeds, and drum heads .
  • Drum heads and strings fail catastrophically by breaking without warning, rendering the musical instrument significantly impaired or unusable, forcing musicians to stop a performance, or to change strings and heads well before their duty cycle is complete, so as to avoid a catastrophic failure at an inopportune time. Since each musician has different techniques, it is impossible for manufacturers to predict a mean time before failure for their replaceable parts, but with a sensor, data collection and computer resources, a user can start to develop a usage profile for each of their musical instrument s and save money by not changing replaceable items ahead too soon in their duty cycle.
  • the device may also be connected to a recording system that captures audio and "tags" it with the appropriate metadata for the recording session including, but not limited to, which musical instrument is used in recording the song, a date stamp, geotagging, and a plurality of other useful data that is associated with the recording being made via the musical instrument .
  • Alerts and notifications can be set to automatically be sent to the device, to a smart phone or to a "cloud” platform from a plurality of systems, from within the device's own system, from a smart phone or computer, or a "cloud” platform.
  • the alerts may be design to alert a musician, parent, teacher, or other interested party, to different states, trends, recommendations, or artificial intelligence insights.
  • the user, or their parent, teacher, or interested party may be able to send notifications to the user's smart phone, computer or "cloud” platform account to alert, encourage or reward a user, or any plurality of notification types and methods that are useful for the user at the device, their smart phone, tablet, computer, smart television, social network, etc.
  • the device when transmitting data to a musical instrument manufacturer's data systems, provides information about environmental history like humidity and temperature, and user induced events like drops or string breakage frequency that can help determine a product' s recommended repair regiment, improve quality of the design of the product, and provide other innovative ways to improve musical instrument quality.
  • various structures and shapes may be designed and configured to optimize, the performance of the sensors, the mounting location for data transmission, the attachment scheme, the musical instrument aesthetics, and other aspects, such that the device is performing at its best for each users' particular needs.
  • the data collected can be shared by the user on a social network for general and fan viewership, "gamification"
  • the musical instrument's identity and history may be stored for maintenance purposes and to improve resale value.
  • a device and system that allows a musician to monitor their activity level, track their musical instrument s usage, provide environmental data, alert/notify them of a plurality of things has advantages for musicians, music teachers and more.
  • the device By connecting the device to a musical instrument, or installing it in a musical instrument, or a musical instrument tool like a drum stick, the device enables a musician to retrieve and use data about their playing and progress.
  • FIG. 1 shows the components of a representative activity monitor
  • FIG. 2 shows the activity monitor of FIG. 1 in
  • FIGS. 3-5 shows the activity monitor of FIG. 1 connected to different kinds of musical instruments
  • FIG. 1 shows an activity monitor 100 that has a power section 200, a control section 300, and an I/O section 400, all of which are integrated within a case 102.
  • the power section 200 converts AC into DC via a transformer.
  • an AC to DC transformer is outside the casing 102, in which case the power section 200 processes DC power.
  • the power section 200 has an internal battery, such as a rechargeable battery pack, or a replaceable battery like a "AA" or "coin cell” style, that supplies a suitable DC voltage for powering the activity monitor 100 .
  • the control section 300 includes an environmental sensor 301 and an internal sensor 302 .
  • the use of a singular form "sensor” for referring to the environmental sensor 301 and the internal sensor 302 is for syntactic convenience and is not intended to mean that the sensor is limited to sensing only a single variable. For example, it is quite possible to refer to an apparatus that senses n variables to be a single sensor that measures n variables rather than n separate sensors each of which measures one of n variables.
  • An environmental sensor 301 senses one or more external variables. These are often indicative of the musical
  • an environmental sensor 301 examples include any one or more sensors selected from a set that comprises a vibration sensor, an accelerometer , a temperature sensor, a humidity sensor, a photo-sensor, a gyroscope, and a GPS unit.
  • An environmental sensor 301 that senses vibrations is useful since vibrations, particularly those that are within the range of the musical instrument, are indicative of a musician' s playing time. Depending on their amplitude or frequency distribution, certain vibrations may be indicative of a shock associated with dropping the musical instrument.
  • An environmental sensor 301 that senses acceleration is useful since acceleration is indicative of musical activity.
  • acceleration is indicative of musical activity.
  • an accelerometer on a bow, drumstick, a plectrum, or a trombone slide would certainly provide information on a musician's total playing time.
  • Certain acceleration profiles may also be indicative of a shock associated with dropping the musical instrument.
  • An environmental sensor 301 that measures temperature and humidity is also useful since such information is indicative of conditions under which the musical instrument has been stored. This is particularly important for acoustic instruments that are made of wood, including guitars, violins and the like, and woodwinds .
  • An environmental sensor 301 that senses light, such as a photo-sensor, is also useful because an extended period of darkness is indicative of time during which the musical instrument has not been in use.
  • An environmental sensor 301 such as a gyroscope, that senses attitude also provides information regarding playing time as well as information on the musician' s posture, which may be useful in correcting certain bad habits and posture. For example, many wind instruments are best held in a particular orientation to maximize available lung volume.
  • An environmental sensor 301 can also include a GPS unit. This type of environmental sensor 301 is especially useful for detecting a musical instrument' s perambulations in case it is lost or stolen.
  • environmental sensors 301 include piezoelectric sensors and EMI sensors.
  • the environmental sensor 310 is one that is sensitive to audio signals. In such cases, the
  • environmental sensor 310 may also be one that records the audio signals so that signal processing algorithms may be applied to them. Or, the environmental sensor 310 can act as a tuner and provide information on whether the instrument is in tune and remains in tune, and if not, the rate of change of pitch of the instrument. This information on stability of pitch may be useful in diagnosing difficulties with the instrument.
  • An internal sensor 302 monitors internal variables .
  • An example of an internal sensor 302 is a battery-level sensor.
  • Another example of an internal sensor 302 is a temperature sensor that measures how warm the activity monitor 100 is.
  • These internal sensors 302 are in communication with an onboard CPU 303 and provide useful feedback for assisting use by the CPU 303 in controlling the activity monitor 100 .
  • the CPU 303 connects to a display 304 .
  • the CPU 303 provides information from the environmental sensor 301 and the internal sensor 302 to the user via the display 304 .
  • Examples of a suitable display 304 include LED displays and LCD displays. Examples of such
  • information include pitch, which enables the activity monitor 100 to act as a pitch tuner.
  • Other information includes
  • the CPU 303 connects to a transceiver 305 for exchanging data with another digital information- processing device 500 , as shown in FIG. 2. Examples of a
  • digital information-processing device 500 include a smart phone 501 , computer 503 , a tablet 502 , or a network device.
  • the digital information-processing device 500 controls operation of the activity monitor 100 .
  • Communication between the digital information-processing device 500 and the activity monitor 100 can be established by a wired connection 701 or a wireless connection 700 .
  • user- operable control elements 306 include knobs, buttons, and a touch-screen interface .
  • the transceiver 305 functions as an actuator.
  • certain musical instruments have motorized tuning heads.
  • the CPU 303 could use the transceiver 305 to instruct the tuning heads to rotate based on some user desired state. For example, if an
  • the CPU 303 may use the transceiver 305 to send an instruction to a motorized tuning head to sharpen the pitch.
  • the I/O section includes one or more input jacks 401 , 403 .
  • the control section 300 controls the input jacks 401 , 403 to permit different input options. Examples of different input options include receiving power from an external power supply or another activity monitor 100 , or causing data transmission via a wire using an input jack 401 , 403 .
  • the data can be manipulated locally within the digital information-processing device 500 .
  • it can be further transmitted to a cloud-based platform 600 , either via a wireless connection 700 or a wired connection 701 .
  • the cloud-based platform 600 can then be used for backing up data, for carrying out additional computations, and for any other data processing.
  • the activity monitor 100 bypasses the digital information-processing device 500 and communicates directly with the cloud-based platform 600 .
  • This connection can be established via a wireless connection 700 or a wired connection 701 with a network router or other communication device connected to the activity monitor 100 .
  • the activity monitor 100 may act as its own network router and connect directly to the cloud-based platform 600 .
  • This connection can be established via a wireless connection 700 or a wired connection 701 .
  • the user can carry out numerous data-processing tasks based on that data.
  • Software backups of states and function preferences can be saved to either the digital information-processing device 500 or to the cloud-based platform 600 for recall and reloading on any activity monitor 100 .
  • the settings stored on the digital information-processing device 500 and/or the cloud-based platform 600 can be transmitted to a plurality of activity monitors 100 , to one or more digital information-processing devices 500 , and to a social network to be made available for sharing with other users and collaborators, such as other musicians, band members, teachers, coaches, professors, and instrument manufacturers .
  • the digital information-processing device 500 or the cloud-based platform 600 can be used as a vehicle for providing updates to the software on the activity monitor 100 . These updates can provide bug fixes or add new features .
  • the activity monitor 100 thus provides the user with useful feedback, either directly via its own display 304 or via the display of a digital information-processing device 500 .
  • feedback information includes information about status of the activity monitor 100 itself.
  • the user can set a particular battery minimum level.
  • the activity monitor 100 alerts the user via the display of the digital information-processing device 500 .
  • the cloud-based platform 600 can analyze data over time and make recommendations to the user via a display of a digital information-processing device 500 or via the device's feedback systems 304 , 402 . Examples include recommendations pertaining to sharing player time, technique feedback, and other performance analytics.
  • the activity monitor 100 thus permits a musician to create data that can be used immediately, or at a later date to help musicians improve, enjoy, or log their playing. Likewise, the activity monitor 100 permits a musical instrument to collect usage data, data concerning its condition, and other
  • the activity monitor 100 creates activity data in
  • FIGS. 3-5 there are three classes of musical instruments, shown in FIGS. 3-5.
  • FIG. 3 shows a first class in which the musical instrument is an essentially unitary body that produces a vibration representative of music.
  • the body of the musical instrument provides amplification. Examples include the acoustic guitar 801 , the acoustic piano 804 , and the saxophone 805 .
  • the amplification is electrical. Examples include the electric guitar 802 and the electric bass 803 .
  • the sound itself is idiophonic but indicative of at least the rhythmic component of music. This is the case with the drum set 806 .
  • the processor 303 it is useful for the processor 303 to analyze various spectral properties of a detected acoustic signal, such as frequency response of the instrument to a particular note or a particular chord, or its impulse response. These can be used to provide early warnings of an incipient defect. For example, a wooden body that is beginning to split can sometimes alter the spectrum of a
  • the activity monitor 100 is mounted directly on the musical instrument.
  • the mounting can be achieved by using a clamp, tape, glue, micro-suction, or hook-and-loop fasteners.
  • a second class of musical instruments does not have an easily accessed analog signal representative of music. These musical instruments make music by creating or modifying electrical signals. Examples shown in FIG. 4 include an amplifier 826 , and an electric piano 828 . Also among these musical instruments are those, like the microphone 827 , that convert acoustic information to electronic information for amplification or signal processing.
  • the activity monitor 100 For this second class of musical instruments, the activity monitor 100 generates activity data based on the electronic signals generated by the musical instrument, vibration data, musical-instrument motion data, and combinations thereof.
  • a third class of musical instruments is similar to the first class but with the addition of an easily accessible actuator.
  • Examples of such musical instruments include a violin 851 and its bow 852, a drum 806 and its drumstick 853, and a guitar with its guitar pick.
  • a violin 851 may have an activity monitor
  • the bow 852 has its own sensor 100a mounted thereof for collecting a second set of activity data.
  • the first and second sets provide insight into how each of the components is being used by the musician, or their overall condition, such as the hair of the bow, or the humidity of the wood that the violin is made of.
  • a first sensor 100b couples to a cymbal
  • a second and third sensors 100c, lOOd couple to different tom-toms
  • a fifth sensor lOOe couples to a bass drum
  • a sixth sensor lOOf couples to a drumstick.
  • Activity data sets collected from the drums of the drum kit 806 and the drum sticks 853 can provide a variety of useful individual and group data sets. For example, using such data, one might learn that a drum stick 853 hits a second drum more frequently than it hits a first drum. From this, one can then infer that that the first drum' s wear is lower than that of the second drum. This information is useful for scheduling maintenance.
  • the activity monitor 100 it is useful for the activity monitor 100 to have a metronome that keeps time. Using this metronome and data provided by the sensor, the processor is able to identify a fundamental frequency of what is being played and determine an extent to which the drummer, or any other musician for that matter, is maintaining a correct tempo.
  • useful group data can be collected and analyzed while the band plays together, whether in performance or during a practice session.
  • Sensors can be mounted on a musical instrument in a variety of ways, including using mechanical fasteners like screws, tapes, clamps, micro-suction, magnets, tape, glue, or hook-and-loop fasteners.
  • Embodiments also include those in which the casing 102 is any one or more of waterproof, sweat proof, durable, and light.
  • the casing 102 has a modular
  • the casing 102 can be attached and detached from each of those musical instruments.
  • the casing 102 can be made of plastic, wood, rubber, or any of a variety of materials either alone or in combination.
  • the materials that comprise the casing 102 are selected for any of a variety of reasons, including aesthetic appeal and reduced weight.
  • the materials from which the casing 102 is made are selected for their transparency to radio waves. This promotes wireless communications, and in the case of embodiments that include a GPS receiver, the ability to receive a GPS signal.
  • the casing 102 is configured to protect internal components from excessive motion, vibration, and humidity. In other embodiments, the casing 102 is

Abstract

A musical-instrument activity monitor having a sensor and a processor coupled to said sensor. The sensor detects a signal indicative of activity of the musical instrument.

Description

MUSICAL ACTIVITY MONITOR
CROSS REFERENCE TO RELATED APPLICATIONS
This application claims priority to U.S. Provisional
Application No. 62/360,591 filed July 11, 2016, the contents of which are hereby incorporated by reference in its entirety.
FIELD OF INVENTION
This invention generally relates to devices for management of musical instruments, and in particular, to devices for monitoring activity of musical instruments .
BACKGROUND
Musicians at all skill levels seek to improve their
abilities and to maintain their muscular dexterity and stamina. A known way of improving such abilities is to engage in regular practice sessions.
In addition, many musical instrument manufacturers warrant their products against manufacturer's defects. However, it can be difficult to distinguish between manufacturer' s defects and customer misuse.
Retail musical instrument stores stock different
instruments. In the course of shopping for an instrument, customers will try different instruments. A retail store does not have an effective way to determine which instruments are being tried out the most .
SUMMARY
In one aspect, the invention features a musical-instrument activity monitor having a sensor and a processor coupled to the sensor. The sensor is disposed to detect a signal indicative of activity of the musical instrument.
In some embodiments, the sensor is an environmental sensor. Other embodiments include those in which the sensor is an accelerometer , a temperature sensor, a humidity sensor, a photo-sensor, a piezoelectric sensor, an EMI sensor, a
gyroscopic sensor, a tuner, and a GPS unit.
The sensor, in some embodiments, attaches to an actuator of the musical instrument. Examples of actuators include a drumstick, a bow, a mallet, and a plectrum.
In other embodiments, the sensor attaches to the body of the musical instrument.
Sensors also include those that detect an acoustic signal produced by the musical instrument, those that are disposed in a microphone, in which case the musical instrument would be the singer's vocal cords, those that detect motion of the musical instrument, and those that record an acoustic signal produced by the musical instrument.
A variety of ways are available to attach the sensor, including a clamp, a suction device, a magnet, glue, a hook- and-loop fastener, or a screw.
The sensor can also be an internal sensor. These internal sensors sense something about the state of the activity monitor itself. Examples include a sensor that measures an available power level for the activity monitor, and a sensor that measures an internal temperature the activity monitor.
Some embodiments also have a communication interface for establishing communication between the activity monitor and an external device. Such an interface can establish wireless communication between the activity monitor and an external device. Alternatively, it can establish communication between the activity monitor and an external device over a wire.
Regardless of the nature of the link, whether it is wired or wireless, the communication interface can establish
communication between the activity monitor and many other devices. Examples of devices with which the activity monitor could communicate include a personal computer, a tuning actuator, a smart phone, and even a cloud-based platform.
Information shared can include information representative of musical instrument activity.
Among the embodiments are those that also have a display for displaying information derived from a signal provided to the processor by the sensor.
In some embodiments, the musical-instrument activity monitor has a battery for providing power to the sensor and the processor. The battery can be either rechargeable or
replaceable .
The processor is configured to determine one or more states of the instrument. For example, in some embodiments, the processor determines, from data provided by the sensor, that the instrument is at rest. In others, it determines, from data provided by the sensor, that the instrument is in motion. In yet others, it determines, from data provided by the sensor, that the instrument is being played.
The processor is also useful for identifying a potential source of damage to an instrument. For example, in some embodiments, the processor determines, from data provided by the sensor, that the instrument has sustained a shock in excess of a predetermined shock threshold, or that it has been stored in an environment having a humidity that is outside a desired range of humidity, or that it has been stored in an environment having a temperature that is outside a desired range of temperature .
In some embodiments, the processor is configured to calculate a tempo of the music based on a signal from the sensor . Among the embodiments are those in which a casing encloses the musical-instrument activity monitor. A variety of casings are possible. Some casings are made of a material that is transparent to electromagnetic radiation having wavelengths in a GPS communication band. Others are made of a material that is transparent to electromagnetic radiation having wavelengths in a band designated for wireless networks. Yet others are configured such that, when the casing is vibrated by vibration of a first amplitude, the musical-instrument activity monitor is vibrated at a second amplitude that is less than the first amplitude. These would be shock-proof or essentially shock- proof casings. Casings can be made of a wide variety of materials including metal, plastic, wood, rubber, and
combinations thereof.
Some casings protect against humidity. These are
configured such that a value of relative humidity outside the casing is higher than a value of relative humidity inside the casing. Other casings are water-resistant or waterproof. In these embodiments, the casing is configured such that water outside the casing fails to penetrate the casing.
Among the embodiments that have a casing are those that also have a modular attachment configured to couple to a universal attachment that is common to plural musical
instruments. In these embodiments, the casing is attachable to a first musical instrument by mating the modular attachment to a first universal attachment that is attached to the first musical instrument. It is then detachable from the first musical instrument and attachable to a second musical
instrument by mating the modular attachment to a second universal attachment that is attached to the second musical instrument. In this embodiment, the second universal attachment is identical in structure to the first universal attachment. Some embodiments feature a metronome. In these embodiments, the processor is configured to compare a signal from the sensor with a signal provided by the metronome to evaluate maintenance of correct tempo.
Embodiments further include those in which the processor is configured to determine a frequency response of the musical instrument to a stimulus and those in which it is configured to determine an impulse response of the musical instrument to a stimulus .
The device may also act as an actuator, in that it may change some aspect of the musical instrument, as desired by the musician, teacher, or manufacturer. For example, the device may send data to automated tuner motors, for a musical instrument with that capability on the musical instrument, so that a musician can have multiple tuning templates and styles, called "alternate tunings" that are hard to do quickly by hand.
In some embodiments, the device may work in concert with other devices connected to the musical instrument, such as an electronic magnetic pickup system for a guitar, a mechanical proximity sensor for a bass drum pedal, a vibration sensor for a cymbal, a microphone preamp, or another sensor system, and work with a plurality of device's data to share, store, process, compound, report, transmit and receive data to help the
musician with their performance or practice, or to protect the musical instrument from damage, or a plurality of benefits for a musician.
Some musicians play in groups/bands, and the devices may work with other band members' devices to record group/band related data during a practice or live performance. The devices may share information device-to-device, through a smart phone or computer, or a "cloud" platform. A device connected to a microphone, or microphone system, provides for a novel way to collect musician activity data via a microphone, humidity sensor, vibration sensors,
accelerometers , and other sensors. High quality microphones are sensitive to saliva accidentally projected into the microphone capsule, and a sensor could give a musician, or club owner, data about the humidity level inside the microphone to ensure it gets cleaned and dried at appropriate intervals.
The device may be connected to a "cloud" platform that can provide advanced analytics of their data to do predictive analysis on replaceable components like strings, reeds, and drum heads . Drum heads and strings fail catastrophically by breaking without warning, rendering the musical instrument significantly impaired or unusable, forcing musicians to stop a performance, or to change strings and heads well before their duty cycle is complete, so as to avoid a catastrophic failure at an inopportune time. Since each musician has different techniques, it is impossible for manufacturers to predict a mean time before failure for their replaceable parts, but with a sensor, data collection and computer resources, a user can start to develop a usage profile for each of their musical instrument s and save money by not changing replaceable items ahead too soon in their duty cycle.
The device may also be connected to a recording system that captures audio and "tags" it with the appropriate metadata for the recording session including, but not limited to, which musical instrument is used in recording the song, a date stamp, geotagging, and a plurality of other useful data that is associated with the recording being made via the musical instrument .
Alerts and notifications can be set to automatically be sent to the device, to a smart phone or to a "cloud" platform from a plurality of systems, from within the device's own system, from a smart phone or computer, or a "cloud" platform. The alerts may be design to alert a musician, parent, teacher, or other interested party, to different states, trends, recommendations, or artificial intelligence insights. Likewise, the user, or their parent, teacher, or interested party may be able to send notifications to the user's smart phone, computer or "cloud" platform account to alert, encourage or reward a user, or any plurality of notification types and methods that are useful for the user at the device, their smart phone, tablet, computer, smart television, social network, etc.
The device, when transmitting data to a musical instrument manufacturer's data systems, provides information about environmental history like humidity and temperature, and user induced events like drops or string breakage frequency that can help determine a product' s recommended repair regiment, improve quality of the design of the product, and provide other innovative ways to improve musical instrument quality.
In some embodiments, various structures and shapes may be designed and configured to optimize, the performance of the sensors, the mounting location for data transmission, the attachment scheme, the musical instrument aesthetics, and other aspects, such that the device is performing at its best for each users' particular needs.
The data collected can be shared by the user on a social network for general and fan viewership, "gamification"
applications where a user challenges a friend to a game such as "playing time per week." The musical instrument's identity and history may be stored for maintenance purposes and to improve resale value.
A device and system that allows a musician to monitor their activity level, track their musical instrument s usage, provide environmental data, alert/notify them of a plurality of things has advantages for musicians, music teachers and more. By connecting the device to a musical instrument, or installing it in a musical instrument, or a musical instrument tool like a drum stick, the device enables a musician to retrieve and use data about their playing and progress. Connecting the device to other devices, smart phones, computers and/or a "cloud" platform, and backing up the data, analyzing the data and sharing the data to a social network, brings new types of collaboration, coaching and "competition" to musicians that can greatly enhance their time spent with their musical instrument, improving their skills, building their stamina, and increasing their understanding of their performance characteristics and musical instrument's general "health."
These and other aspects of the invention will be apparent from the following detailed description and the accompanying drawings, in which:
BRIEF DESCRIPTION OF DRAWINGS
FIG. 1 shows the components of a representative activity monitor;
FIG. 2 shows the activity monitor of FIG. 1 in
communication with a digital information-processing device that is in communication with a cloud-based platform; and
FIGS. 3-5 shows the activity monitor of FIG. 1 connected to different kinds of musical instruments;
DETAILED DESCRIPTION OF EMBODIMENTS
FIG. 1 shows an activity monitor 100 that has a power section 200, a control section 300, and an I/O section 400, all of which are integrated within a case 102.
In some embodiments, the power section 200 converts AC into DC via a transformer. In other embodiments, an AC to DC transformer is outside the casing 102, in which case the power section 200 processes DC power. In yet other embodiments, the power section 200 has an internal battery, such as a rechargeable battery pack, or a replaceable battery like a "AA" or "coin cell" style, that supplies a suitable DC voltage for powering the activity monitor 100 .
The control section 300 includes an environmental sensor 301 and an internal sensor 302 . The use of a singular form "sensor" for referring to the environmental sensor 301 and the internal sensor 302 is for syntactic convenience and is not intended to mean that the sensor is limited to sensing only a single variable. For example, it is quite possible to refer to an apparatus that senses n variables to be a single sensor that measures n variables rather than n separate sensors each of which measures one of n variables.
An environmental sensor 301 senses one or more external variables. These are often indicative of the musical
instrument's activity or its storage conditions. Examples of an environmental sensor 301 include any one or more sensors selected from a set that comprises a vibration sensor, an accelerometer , a temperature sensor, a humidity sensor, a photo-sensor, a gyroscope, and a GPS unit.
An environmental sensor 301 that senses vibrations is useful since vibrations, particularly those that are within the range of the musical instrument, are indicative of a musician' s playing time. Depending on their amplitude or frequency distribution, certain vibrations may be indicative of a shock associated with dropping the musical instrument.
An environmental sensor 301 that senses acceleration is useful since acceleration is indicative of musical activity. For example, an accelerometer on a bow, drumstick, a plectrum, or a trombone slide would certainly provide information on a musician's total playing time. Certain acceleration profiles may also be indicative of a shock associated with dropping the musical instrument.
An environmental sensor 301 that measures temperature and humidity is also useful since such information is indicative of conditions under which the musical instrument has been stored. This is particularly important for acoustic instruments that are made of wood, including guitars, violins and the like, and woodwinds .
An environmental sensor 301 that senses light, such as a photo-sensor, is also useful because an extended period of darkness is indicative of time during which the musical instrument has not been in use.
An environmental sensor 301 , such as a gyroscope, that senses attitude also provides information regarding playing time as well as information on the musician' s posture, which may be useful in correcting certain bad habits and posture. For example, many wind instruments are best held in a particular orientation to maximize available lung volume.
An environmental sensor 301 can also include a GPS unit. This type of environmental sensor 301 is especially useful for detecting a musical instrument' s perambulations in case it is lost or stolen.
Other examples of environmental sensors 301 include piezoelectric sensors and EMI sensors.
In some embodiments, the environmental sensor 310 is one that is sensitive to audio signals. In such cases, the
environmental sensor 310 may also be one that records the audio signals so that signal processing algorithms may be applied to them. Or, the environmental sensor 310 can act as a tuner and provide information on whether the instrument is in tune and remains in tune, and if not, the rate of change of pitch of the instrument. This information on stability of pitch may be useful in diagnosing difficulties with the instrument.
An internal sensor 302 monitors internal variables . An example of an internal sensor 302 is a battery-level sensor.
Another example of an internal sensor 302 is a temperature sensor that measures how warm the activity monitor 100 is.
These internal sensors 302 are in communication with an onboard CPU 303 and provide useful feedback for assisting use by the CPU 303 in controlling the activity monitor 100 .
In some embodiments, the CPU 303 connects to a display 304 . In these embodiments, the CPU 303 provides information from the environmental sensor 301 and the internal sensor 302 to the user via the display 304 . Examples of a suitable display 304 include LED displays and LCD displays. Examples of such
information include pitch, which enables the activity monitor 100 to act as a pitch tuner. Other information includes
activity time and recording state.
In some embodiments, the CPU 303 connects to a transceiver 305 for exchanging data with another digital information- processing device 500 , as shown in FIG. 2. Examples of a
digital information-processing device 500 include a smart phone 501 , computer 503 , a tablet 502 , or a network device.
In some embodiments, the digital information-processing device 500 controls operation of the activity monitor 100 .
Communication between the digital information-processing device 500 and the activity monitor 100 can be established by a wired connection 701 or a wireless connection 700 .
Since there may be times when a digital information- processing device 500 is neither available nor convenient, it is useful to integrate, into the control section 300 , user- operable control elements 306 . Examples of such user-operable control elements 306 include knobs, buttons, and a touch-screen interface .
In other embodiments, the transceiver 305 functions as an actuator. For example, certain musical instruments have motorized tuning heads. In such cases, the CPU 303 could use the transceiver 305 to instruct the tuning heads to rotate based on some user desired state. For example, if an
environmental sensor 301 detects a pitch that is flat, the CPU 303 may use the transceiver 305 to send an instruction to a motorized tuning head to sharpen the pitch.
The I/O section includes one or more input jacks 401 , 403 . The control section 300 controls the input jacks 401 , 403 to permit different input options. Examples of different input options include receiving power from an external power supply or another activity monitor 100 , or causing data transmission via a wire using an input jack 401 , 403 .
Once the data is transferred to a digital information- processing device 500 it can be manipulated locally within the digital information-processing device 500 . Alternatively, it can be further transmitted to a cloud-based platform 600 , either via a wireless connection 700 or a wired connection 701 . The cloud-based platform 600 can then be used for backing up data, for carrying out additional computations, and for any other data processing.
In some embodiments, the activity monitor 100 bypasses the digital information-processing device 500 and communicates directly with the cloud-based platform 600 . This connection can be established via a wireless connection 700 or a wired connection 701 with a network router or other communication device connected to the activity monitor 100 .
In some embodiments, the activity monitor 100 may act as its own network router and connect directly to the cloud-based platform 600 . This connection can be established via a wireless connection 700 or a wired connection 701 .
As described in further detail below, once data is stored on either the cloud-based platform 600 or the digital
information-processing device 500 , the user can carry out numerous data-processing tasks based on that data.
Software backups of states and function preferences can be saved to either the digital information-processing device 500 or to the cloud-based platform 600 for recall and reloading on any activity monitor 100 . The settings stored on the digital information-processing device 500 and/or the cloud-based platform 600 can be transmitted to a plurality of activity monitors 100 , to one or more digital information-processing devices 500 , and to a social network to be made available for sharing with other users and collaborators, such as other musicians, band members, teachers, coaches, professors, and instrument manufacturers .
In some embodiments, the digital information-processing device 500 or the cloud-based platform 600 can be used as a vehicle for providing updates to the software on the activity monitor 100 . These updates can provide bug fixes or add new features .
The activity monitor 100 thus provides the user with useful feedback, either directly via its own display 304 or via the display of a digital information-processing device 500 . Thus, feedback information includes information about status of the activity monitor 100 itself.
For instance, in those embodiments in which the power section 200 relies on a battery, the user can set a particular battery minimum level. When the battery discharges to this level, the activity monitor 100 alerts the user via the display of the digital information-processing device 500 . Additionally, the cloud-based platform 600 can analyze data over time and make recommendations to the user via a display of a digital information-processing device 500 or via the device's feedback systems 304 , 402 . Examples include recommendations pertaining to sharing player time, technique feedback, and other performance analytics.
The activity monitor 100 thus permits a musician to create data that can be used immediately, or at a later date to help musicians improve, enjoy, or log their playing. Likewise, the activity monitor 100 permits a musical instrument to collect usage data, data concerning its condition, and other
information that is helpful in ascertaining the overall condition of the musical instrument.
The activity monitor 100 creates activity data in
different ways based on the kind of musical instrument it is intended to monitor. In general, there are three classes of musical instruments, shown in FIGS. 3-5.
FIG. 3 shows a first class in which the musical instrument is an essentially unitary body that produces a vibration representative of music. In some cases, the body of the musical instrument provides amplification. Examples include the acoustic guitar 801 , the acoustic piano 804 , and the saxophone 805 . In other cases, the amplification is electrical. Examples include the electric guitar 802 and the electric bass 803 . In other cases, the sound itself is idiophonic but indicative of at least the rhythmic component of music. This is the case with the drum set 806 .
In the foregoing types of instruments, it is useful for the processor 303 to analyze various spectral properties of a detected acoustic signal, such as frequency response of the instrument to a particular note or a particular chord, or its impulse response. These can be used to provide early warnings of an incipient defect. For example, a wooden body that is beginning to split can sometimes alter the spectrum of a
waveform in a subtle way that is not immediately perceptible.
In all the foregoing cases, there is an easily accessible analog signal that is representative of music. In these cases, the activity monitor 100 is mounted directly on the musical instrument. The mounting can be achieved by using a clamp, tape, glue, micro-suction, or hook-and-loop fasteners.
A second class of musical instruments, shown in FIG. 4, does not have an easily accessed analog signal representative of music. These musical instruments make music by creating or modifying electrical signals. Examples shown in FIG. 4 include an amplifier 826 , and an electric piano 828 . Also among these musical instruments are those, like the microphone 827 , that convert acoustic information to electronic information for amplification or signal processing.
For this second class of musical instruments, the activity monitor 100 generates activity data based on the electronic signals generated by the musical instrument, vibration data, musical-instrument motion data, and combinations thereof.
For example, some electronic keyboards 828 or electronic drum kits do not make musically useful acoustic sound when played or struck. Nevertheless, the motion of the keys and the striking of a drum pad provide information indicative of
playing time and overall activity level
Many electronic musical instruments also produce musically useful frequency signals that are ultimately turned into sound. Many such musical instruments have a built-in output that is normally connected to an amplifier or recording device. The musical-instrument activity monitor 100 receives such
electronic signals using a cable connected to such an output. This provides another source of activity data. A similar signal is available from a microphone 827, which captures air vibrations and converts them to electronic signals . These electronic signals may be useful for the activity monitor 100. Mounting the activity monitor 100 inside the microphone, on the external casing 102, or integrating it within a cable thus creates a way to capture activity data for musical
instruments for which the actual source of vibrations is
difficult to access. This is the case for a vocalist, as well as for certain kinds of musical instruments, such as a steel drum.
A third class of musical instruments is similar to the first class but with the addition of an easily accessible actuator. Examples of such musical instruments, as shown in FIG. 5, include a violin 851 and its bow 852, a drum 806 and its drumstick 853, and a guitar with its guitar pick.
For example, a violin 851 may have an activity monitor
100 mounted upon or within it to collecting a first set of activity data. Meanwhile, the bow 852 has its own sensor 100a mounted thereof for collecting a second set of activity data. The first and second sets provide insight into how each of the components is being used by the musician, or their overall condition, such as the hair of the bow, or the humidity of the wood that the violin is made of.
In the case of a drum kit 806, independent but connected sensors 100b, 100c, lOOd, lOOe couple to different components of the drum kit 806. For example, a first sensor 100b couples to a cymbal, a second and third sensors 100c, lOOd couple to different tom-toms, a fifth sensor lOOe couples to a bass drum, and a sixth sensor lOOf couples to a drumstick. Activity data sets collected from the drums of the drum kit 806 and the drum sticks 853 can provide a variety of useful individual and group data sets. For example, using such data, one might learn that a drum stick 853 hits a second drum more frequently than it hits a first drum. From this, one can then infer that that the first drum' s wear is lower than that of the second drum. This information is useful for scheduling maintenance.
By collecting and analyzing data across a plurality of sensors, a drummer can review performance data, like tempo repeatability and accuracy. To facilitate accuracy in
maintaining tempo, it is useful for the activity monitor 100 to have a metronome that keeps time. Using this metronome and data provided by the sensor, the processor is able to identify a fundamental frequency of what is being played and determine an extent to which the drummer, or any other musician for that matter, is maintaining a correct tempo.
By collecting and analyzing the combined data from all of the sensors of an entire band, and combining that with each band member's musical instrument, for example guitar, bass, drums and vocals, useful group data can be collected and analyzed while the band plays together, whether in performance or during a practice session.
Sensors can be mounted on a musical instrument in a variety of ways, including using mechanical fasteners like screws, tapes, clamps, micro-suction, magnets, tape, glue, or hook-and-loop fasteners.
Embodiments also include those in which the casing 102 is any one or more of waterproof, sweat proof, durable, and light.
In some embodiments, the casing 102 has a modular
attachment 103 that engages a universal attachment. Each musical instrument in a set of instruments is coupled to a universal attachment. As a result, the casing 102 can be attached and detached from each of those musical instruments. The casing 102 can be made of plastic, wood, rubber, or any of a variety of materials either alone or in combination.
The materials that comprise the casing 102 are selected for any of a variety of reasons, including aesthetic appeal and reduced weight. In some embodiments, the materials from which the casing 102 is made are selected for their transparency to radio waves. This promotes wireless communications, and in the case of embodiments that include a GPS receiver, the ability to receive a GPS signal.
In some embodiments, the casing 102 is configured to protect internal components from excessive motion, vibration, and humidity. In other embodiments, the casing 102 is
configured to optimize performance for a sensor or sensor group.
It is to be understood that the foregoing description is intended to illustrate and not to limit the scope of the
invention, which is defined by the scope of the appended claims. Other embodiments are within the scope of the following claims.

Claims

1. An apparatus comprising a musical-instrument activity
monitor, said musical-instrument activity monitor
comprising a sensor and a processor coupled to said sensor, said sensor being disposed to detect a signal indicative of activity of said musical instrument.
2. The apparatus of claim 1, wherein said sensor comprises an environmental sensor.
3. The apparatus of claim 1, wherein said sensor comprises an accelerometer .
4. The apparatus of claim 1, wherein said sensor comprises a temperature sensor.
5. The apparatus of claim 1, wherein said sensor comprises a humidity sensor.
6. The apparatus of claim 1, wherein said sensor comprises a light sensor.
7. The apparatus of claim 1, wherein said sensor comprises a piezoelectric sensor.
8. The apparatus of claim 1, wherein said sensor comprises an EMI sensor.
9. The apparatus of claim 1, wherein said sensor comprises a gyroscopic sensor.
10. The apparatus of claim 1, wherein said sensor comprises a GPS unit.
11. The apparatus of claim 1, wherein said sensor is
configured for attachment to an actuator of said musical instrument . The apparatus of claim 11 , wherein said actuator comprises a drumstick. The apparatus of claim 11 , wherein said actuator comprises a bow . The apparatus of claim 11 , wherein said actuator comprises a mallet. The apparatus of claim 11 , wherein said actuator comprises a plectrum. The apparatus of claim 1 , wherein said sensor is
configured for attachment to a body of said musical
instrument . The apparatus of claim 1 , wherein said sensor is
configured to detect an acoustic signal produced by said musical instrument. The apparatus of claim 1 , wherein said sensor is disposed in a microphone and said musical instrument is a pair of vocal cords. The apparatus of claim 1 , wherein said sensor is
configured to detect motion of said musical instrument. The apparatus of claim 1 , wherein said sensor is
configured to record an acoustic signal produced by said musical instrument. The apparatus of claim 1 , further comprising a clamp for mounting said sensor to said musical instrument. The apparatus of claim 1 , further comprising a suction device for mounting said sensor to said musical instrument. The apparatus of claim 1 , further comprising a magnet for mounting said sensor to said musical instrument. The apparatus of claim 1 , further comprising glue for causing said sensor to adhere to said musical instrument. The apparatus of claim 1 , further comprising tape for taping said sensor to said musical instrument. The apparatus of claim 1 , further comprising a hook-and- loop fastener for fastening said sensor to said musical instrument . The apparatus of claim 1 , further comprising a screw for fastening said sensor to said musical instrument. The apparatus of claim 1 , wherein said sensor is
configured to measure an available power level for said activity monitor. The apparatus of claim 1 , wherein said sensor is
configured to measure an internal temperature said activity monitor. The apparatus of claim 1 , further comprising a
communication interface for establishing communication between said activity monitor and an external device. The apparatus of claim 1 , further comprising a
communication interface for establishing wireless communication between said activity monitor and an external device. The apparatus of claim 1 , further comprising a
communication interface for establishing communication between said activity monitor and an external device over a wire. The apparatus of claim 1 , further comprising a
communication interface configured to establish communication between said activity monitor and a personal computer . The apparatus of claim 1 , further comprising a
communication interface configured to establish
communication between said activity monitor and a tuning actuator . The apparatus of claim 1 , further comprising a
communication interface configured to establish
communication between said activity monitor and a smart phone . The apparatus of claim 1 , further comprising a
communication interface configured to establish
communication between said activity monitor and a cloud- based platform. The apparatus of claim 1 , further comprising a display for displaying information derived from a signal provided to said processor by said sensor. The apparatus of claim 1 , wherein said musical-instrument activity monitor further comprises a battery for providing power to said sensor and said processor. The apparatus of claim 38 , wherein said battery is
rechargeable . The apparatus of claim 38 , wherein said battery is
replaceable .
The apparatus of claim 1 , wherein said processor is
configured to determine, from data provided by said sensor, that said instrument is at rest. The apparatus of claim 1 , wherein said processor is
configured to determine, from data provided by said sensor, that said instrument is in motion. The apparatus of claim 1 , wherein said processor is
configured to determine, from data provided by said sensor, that said instrument is being played. The apparatus of claim 1 , wherein said processor is
configured to determine, from data provided by said sensor, that said instrument has sustained a shock in excess of a predetermined shock threshold. The apparatus of claim 1 , wherein said processor is
configured to determine, from data provided by said sensor, that said instrument is in an environment having a
humidity that is outside a desired range of humidity. The apparatus of claim 1 , wherein said processor is
configured to determine, from data provided by said sensor, that said instrument is in an environment having a
temperature that is outside a desired range of temperature. The apparatus of claim 1 , wherein said processor is
configured to calculate a tempo of said music based on a signal from said sensor. The apparatus of claim 1 , further comprising a casing that encloses said musical-instrument activity monitor. The apparatus of claim 48 , wherein said casing is made of a material that is transparent to electromagnetic
radiation having wavelengths in a GPS communication band. The apparatus of claim 48 , wherein said casing is made of a material that is transparent to electromagnetic
radiation having wavelengths in a band designated for wireless networks. The apparatus of claim 48 , wherein said casing is
configured such that, when said casing is vibrated by vibration of a first amplitude, said musical-instrument activity monitor is vibrated at a second amplitude that is less than said first amplitude. The apparatus of claim 48 , wherein said casing comprises plastic . The apparatus of claim 48 , wherein said casing comprises wood . The apparatus of claim 48 , wherein said casing comprises rubber . The apparatus of claim 48 , wherein said casing is
configured such that a value of relative humidity outside said casing is higher than a value of relative humidity inside said casing. The apparatus of claim 48 , wherein said casing is
configured such that water outside said casing fails to penetrate said casing. The apparatus of claim 48 , wherein said casing comprises a modular attachment configured to couple to a universal attachment that is common to plural musical instruments, wherein said casing is attachable to a first musical instrument by mating said modular attachment to a first universal attachment that is attached to said first musical instrument, wherein said casing is detachable from said first musical instrument, wherein said casing is attachable to a second musical instrument by mating said modular attachment to a second universal attachment that is attached to said second musical instrument, and wherein said second universal attachment is identical in structure to said first universal attachment. The apparatus of claim 1 , further comprising a metronome, wherein said processor is configured to compare a signal from said sensor with a signal provided by said metronome to evaluate maintenance of correct tempo. The apparatus of claim 1 , wherein said processor is configured to determine a frequency response of said musical instrument to a stimulus. The apparatus of claim 1 , wherein said processor is configured to determine an impulse response of said musical instrument to a stimulus. The apparatus of claim 1 , further comprising a
communication interface, wherein said processor is configured to use said communication interface to share information representative of musical instrument activity on via said communication interface. The apparatus of claim 1 , wherein said environmental sensor comprises a tuner.
PCT/US2017/041507 2016-07-11 2017-07-11 Musical activity monitor WO2018013549A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201662360591P 2016-07-11 2016-07-11
US62/360,591 2016-07-11

Publications (1)

Publication Number Publication Date
WO2018013549A1 true WO2018013549A1 (en) 2018-01-18

Family

ID=60953364

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2017/041507 WO2018013549A1 (en) 2016-07-11 2017-07-11 Musical activity monitor

Country Status (1)

Country Link
WO (1) WO2018013549A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111739494A (en) * 2020-05-26 2020-10-02 孙华 Electronic musical instrument with intelligent algorithm capable of blowing transversely and vertically
CN112863295A (en) * 2021-01-13 2021-05-28 西安石油大学 Saxophone teaching is with supplementary intonation orthotic devices of intelligence

Citations (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4649784A (en) * 1985-01-31 1987-03-17 Robert G. Fulks Method and apparatus for sensing activity for a keyboard and the like
US6148280A (en) * 1995-02-28 2000-11-14 Virtual Technologies, Inc. Accurate, rapid, reliable position sensing using multiple sensing technologies
US6162981A (en) * 1999-12-09 2000-12-19 Visual Strings, Llc Finger placement sensor for stringed instruments
EP0764003B1 (en) * 1994-06-06 2001-10-17 University of Washington System and method for measuring acoustic reflectance
US20040074379A1 (en) * 1998-05-15 2004-04-22 Ludwig Lester F. Functional extensions of traditional music keyboards
US20040170444A1 (en) * 2002-11-11 2004-09-02 Masaaki Yamada Electrophotographic image forming apparatus having a humidity control function
US20050051022A1 (en) * 2002-01-09 2005-03-10 Benjamin Hodder Detection of sound waves produced by a musical instrument
US20050126375A1 (en) * 2003-12-16 2005-06-16 David Hosler Sensor array for a musical instrument
US20080173162A1 (en) * 2007-01-11 2008-07-24 David Williams Musical Instrument/Computer Interface And Method
US20090320672A1 (en) * 2006-09-12 2009-12-31 Hubertus Georgius Petrus Rasker Percussion assembly, as well as drumsticks and input means for use in said percussion assembly
US20140033893A1 (en) * 2012-07-31 2014-02-06 Luis Villaran-Valdivia Automatic guitar tuner
US20140131236A1 (en) * 2011-11-09 2014-05-15 Daniel Watson Kushner Musical instrument case with protective boot
US20140210309A1 (en) * 2011-09-30 2014-07-31 Fujifilm Corporation Electroacoustic converter film, flexible display, vocal cord microphone, and musical instrument sensor
WO2015025152A1 (en) * 2013-08-19 2015-02-26 Arm Ip Limited Placement of an antenna in a wrist worn device
US20150082970A1 (en) * 2012-12-03 2015-03-26 Petar Chekardzhikov Vibration-sensing music instrument mountable device
US20150122109A1 (en) * 2013-11-05 2015-05-07 Jeffrey James Hsu Stringless bowed musical instrument
US20150143977A1 (en) * 2012-08-16 2015-05-28 Clevx, Llc System for calculating the tempo of music
WO2015085092A1 (en) * 2013-12-04 2015-06-11 Bean Robert Warren Protection system for individual mobile objects
US20160042726A1 (en) * 2014-08-08 2016-02-11 Best Case Scenario, LLC Networked sensor for musical instrument or for musical instrument case
US20160140945A1 (en) * 2013-06-21 2016-05-19 Parsek Lab S.R.L. Electronic Musical Instrument Percussion System with Electromagnetic Sensor

Patent Citations (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4649784A (en) * 1985-01-31 1987-03-17 Robert G. Fulks Method and apparatus for sensing activity for a keyboard and the like
EP0764003B1 (en) * 1994-06-06 2001-10-17 University of Washington System and method for measuring acoustic reflectance
US6148280A (en) * 1995-02-28 2000-11-14 Virtual Technologies, Inc. Accurate, rapid, reliable position sensing using multiple sensing technologies
US20040074379A1 (en) * 1998-05-15 2004-04-22 Ludwig Lester F. Functional extensions of traditional music keyboards
US6162981A (en) * 1999-12-09 2000-12-19 Visual Strings, Llc Finger placement sensor for stringed instruments
US20050051022A1 (en) * 2002-01-09 2005-03-10 Benjamin Hodder Detection of sound waves produced by a musical instrument
US20040170444A1 (en) * 2002-11-11 2004-09-02 Masaaki Yamada Electrophotographic image forming apparatus having a humidity control function
US20050126375A1 (en) * 2003-12-16 2005-06-16 David Hosler Sensor array for a musical instrument
US20090320672A1 (en) * 2006-09-12 2009-12-31 Hubertus Georgius Petrus Rasker Percussion assembly, as well as drumsticks and input means for use in said percussion assembly
US20080173162A1 (en) * 2007-01-11 2008-07-24 David Williams Musical Instrument/Computer Interface And Method
US20140210309A1 (en) * 2011-09-30 2014-07-31 Fujifilm Corporation Electroacoustic converter film, flexible display, vocal cord microphone, and musical instrument sensor
US20140131236A1 (en) * 2011-11-09 2014-05-15 Daniel Watson Kushner Musical instrument case with protective boot
US20140033893A1 (en) * 2012-07-31 2014-02-06 Luis Villaran-Valdivia Automatic guitar tuner
US20150143977A1 (en) * 2012-08-16 2015-05-28 Clevx, Llc System for calculating the tempo of music
US20150082970A1 (en) * 2012-12-03 2015-03-26 Petar Chekardzhikov Vibration-sensing music instrument mountable device
US20160140945A1 (en) * 2013-06-21 2016-05-19 Parsek Lab S.R.L. Electronic Musical Instrument Percussion System with Electromagnetic Sensor
WO2015025152A1 (en) * 2013-08-19 2015-02-26 Arm Ip Limited Placement of an antenna in a wrist worn device
US20150122109A1 (en) * 2013-11-05 2015-05-07 Jeffrey James Hsu Stringless bowed musical instrument
WO2015085092A1 (en) * 2013-12-04 2015-06-11 Bean Robert Warren Protection system for individual mobile objects
US20160042726A1 (en) * 2014-08-08 2016-02-11 Best Case Scenario, LLC Networked sensor for musical instrument or for musical instrument case

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
GROSSHAUSER ET AL.: "finger Position and Pressure sensing T echniques for string and - Keyboard Instruments", NIME, 30 May 2013 (2013-05-30), XP055455080, Retrieved from the Internet <URL:https://www.researchgate.net/profile/Tobias_Grosshauser/publication/281595743_Finger_position_and_pressure_sensing_techniques_for_string_and_keyboard_instruments/links/55f2ef2708ae1d9803923979.pdf> *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111739494A (en) * 2020-05-26 2020-10-02 孙华 Electronic musical instrument with intelligent algorithm capable of blowing transversely and vertically
CN112863295A (en) * 2021-01-13 2021-05-28 西安石油大学 Saxophone teaching is with supplementary intonation orthotic devices of intelligence
CN112863295B (en) * 2021-01-13 2022-10-25 西安石油大学 Saxophone teaching is with supplementary intonation orthotic devices of intelligence

Similar Documents

Publication Publication Date Title
US9454912B2 (en) Stringed instrument practice device and system
US8246461B2 (en) Methods and apparatus for stringed controllers and/or instruments
CN102129798B (en) Digital stringed instrument controlled by microcomputer
US10140967B2 (en) Musical instrument with intelligent interface
CN111602193B (en) Information processing method and apparatus for processing performance of musical composition
CN108292496A (en) Bulging tuning
US20140260916A1 (en) Electronic percussion device for determining separate right and left hand actions
US20150206521A1 (en) Device, method and system for making music
CA2842520A1 (en) Device, method and system for making music
WO2007135791A1 (en) Data computing unit for music game, data computing program for music game, and data computing method for music game
WO2018013549A1 (en) Musical activity monitor
JP7307906B2 (en) musical instrument tuner
US20200279544A1 (en) Techniques for controlling the expressive behavior of virtual instruments and related systems and methods
US10446128B2 (en) Interval-based musical instrument
US9824670B1 (en) Musical instrument activity monitoring system
JP2008242285A (en) Performance device and program for attaining its control method
KR101410966B1 (en) A learning equipments for playing the stringed instruments
Neupert et al. Isochronous control+ audio streams for acoustic interfaces
US10325579B1 (en) Means and method for informing a stringed instrument player of the mechanical status of their instrument&#39;s strings and when and whether the strings need to be replaced
Overholt Advancements in violin-related human-computer interaction
KR20160075280A (en) Stringed instrument touch screen and voice recognition function is mounted
JP2008008924A (en) Electric stringed instrument system
JP6690446B2 (en) Acoustic analysis device and acoustic analysis method
WO2016039465A1 (en) Acoustic analysis device
US9483956B2 (en) Stringed musical instrument performance feedback system and method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17828294

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17828294

Country of ref document: EP

Kind code of ref document: A1