WO2010092139A3 - Dispositif et procede d'interpretation de gestes musicaux - Google Patents

Dispositif et procede d'interpretation de gestes musicaux Download PDF

Info

Publication number
WO2010092139A3
WO2010092139A3 PCT/EP2010/051761 EP2010051761W WO2010092139A3 WO 2010092139 A3 WO2010092139 A3 WO 2010092139A3 EP 2010051761 W EP2010051761 W EP 2010051761W WO 2010092139 A3 WO2010092139 A3 WO 2010092139A3
Authority
WO
WIPO (PCT)
Prior art keywords
musical
gestures
microsensors
user
music
Prior art date
Application number
PCT/EP2010/051761
Other languages
English (en)
Other versions
WO2010092139A2 (fr
Inventor
Dominique David
Original Assignee
Movea S.A
Commissariat A L'energie Atomique Et Aux Energies Alternatives
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from FR0950916A external-priority patent/FR2942345A1/fr
Priority claimed from FR0950919A external-priority patent/FR2942344B1/fr
Application filed by Movea S.A, Commissariat A L'energie Atomique Et Aux Energies Alternatives filed Critical Movea S.A
Priority to US13/201,420 priority Critical patent/US9171531B2/en
Priority to EP10703477A priority patent/EP2396711A2/fr
Publication of WO2010092139A2 publication Critical patent/WO2010092139A2/fr
Publication of WO2010092139A3 publication Critical patent/WO2010092139A3/fr

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/18—Selecting circuits
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/36—Accompaniment arrangements
    • G10H1/40—Rhythm
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G10H2210/076—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for extraction of timing, tempo; Beat detection
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/375—Tempo or beat alterations; Music timing control
    • G10H2210/385—Speed change, i.e. variations from preestablished tempo, tempo change, e.g. faster or slower, accelerando or ritardando, without change in pitch
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/135—Musical aspects of games or videogames; Musical instrument-shaped game input interfaces
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/201—User input interfaces for electrophonic musical instruments for movement interpretation, i.e. capturing and recognizing a gesture or a specific kind of movement, e.g. to control a musical instrument
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/201—User input interfaces for electrophonic musical instruments for movement interpretation, i.e. capturing and recognizing a gesture or a specific kind of movement, e.g. to control a musical instrument
    • G10H2220/206—Conductor baton movement detection used to adjust rhythm, tempo or expressivity of, e.g. the playback of musical pieces
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/395—Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Electrophonic Musical Instruments (AREA)

Abstract

L'invention s'applique à un dispositif d'interprétation de gestes musicaux ou gestes agissant sur ou comme des instruments de musique. Des dispositifs de l'art antérieur permettent à un utilisateur de produire de la musique en effectuant des gestes sur un instrument adapté ou en accompagnement d'un contenu musical pré enregistré. Aucun dispositif de l'art antérieur n'est cependant suffisamment fiable et robuste pour assurer un rendu musical satisfaisant. L'invention procure un rendu musical remarquable grâce à l'utilisation de micro capteurs, en particulier des accéléromètres et des magnétomètres ou des gyromètres, et à un traitement adapté des signaux des micro capteurs. En particulier, le traitement utilise une fusion des données en sortie des micro capteurs pour éliminer les fausses alarmes constituées par les mouvements de l'utilisateur sans rapport avec la musique. La vélocité des frappes musicales est également mesurée par le dispositif de l'invention. L'invention permet également le contrôle du défilement de fichiers de musique à reproduire de type mp3 ou wav.
PCT/EP2010/051761 2009-02-13 2010-02-12 Dispositif et procede d'interpretation de gestes musicaux WO2010092139A2 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/201,420 US9171531B2 (en) 2009-02-13 2010-02-12 Device and method for interpreting musical gestures
EP10703477A EP2396711A2 (fr) 2009-02-13 2010-02-12 Dispositif et procede d'interpretation de gestes musicaux

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
FR0950919 2009-02-13
FR0950916A FR2942345A1 (fr) 2009-02-13 2009-02-13 Dispositif et procede d'interpretation de gestes musicaux
FR0950916 2009-02-13
FR0950919A FR2942344B1 (fr) 2009-02-13 2009-02-13 Dispositif et procede de controle du defilement d'un fichier de signaux a reproduire

Publications (2)

Publication Number Publication Date
WO2010092139A2 WO2010092139A2 (fr) 2010-08-19
WO2010092139A3 true WO2010092139A3 (fr) 2011-01-13

Family

ID=42289805

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2010/051761 WO2010092139A2 (fr) 2009-02-13 2010-02-12 Dispositif et procede d'interpretation de gestes musicaux

Country Status (3)

Country Link
US (1) US9171531B2 (fr)
EP (1) EP2396711A2 (fr)
WO (1) WO2010092139A2 (fr)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9171531B2 (en) * 2009-02-13 2015-10-27 Commissariat À L'Energie et aux Energies Alternatives Device and method for interpreting musical gestures
FR3008217A1 (fr) * 2013-07-04 2015-01-09 Lucas Daniel Sharp Module de detection de mouvements pour instruments de musique
EP2835769A1 (fr) 2013-08-05 2015-02-11 Movea Procédé, dispositif et système de capture annotée de données de capteurs et de modélisation de la foule d'activités
US9172343B2 (en) 2013-08-06 2015-10-27 Apple Inc. Volume adjustment based on user-defined curve
US10156907B2 (en) * 2015-12-14 2018-12-18 Invensense, Inc. Device for analyzing the movement of a moving element and associated method
GB201602436D0 (en) * 2016-02-11 2016-03-30 Univ London Queen Mary Use of human gesture and separation of data (Animation) and process (Model) in he design of generative audio for interactive applications
FR3050540B1 (fr) * 2016-04-26 2018-04-13 Commissariat A L'energie Atomique Et Aux Energies Alternatives Procede d'identification des gestes elementaires d'un mouvement et systeme mettant en œuvre un tel procede
US9847079B2 (en) * 2016-05-10 2017-12-19 Google Llc Methods and apparatus to use predicted actions in virtual reality environments
US10802711B2 (en) 2016-05-10 2020-10-13 Google Llc Volumetric virtual reality keyboard methods, user interface, and interactions
US9542919B1 (en) * 2016-07-20 2017-01-10 Beamz Interactive, Inc. Cyber reality musical instrument and device
WO2018016638A1 (fr) * 2016-07-22 2018-01-25 ヤマハ株式会社 Procédé de commande et dispositif de commande
JP6631714B2 (ja) * 2016-07-22 2020-01-15 ヤマハ株式会社 タイミング制御方法、及び、タイミング制御装置
US10846519B2 (en) * 2016-07-22 2020-11-24 Yamaha Corporation Control system and control method
EP3489945B1 (fr) * 2016-07-22 2021-04-14 Yamaha Corporation Procédé d'analyse d'exécution musicale, procédé d'exécution musicale automatique et système d'exécution musicale automatique
US10775941B2 (en) * 2016-12-30 2020-09-15 Jason Francesco Heath Sensorized spherical input and output device, systems, and methods
US10319352B2 (en) * 2017-04-28 2019-06-11 Intel Corporation Notation for gesture-based composition
FR3075428B1 (fr) * 2017-12-15 2020-02-28 Enhancia Bague et module d'interface
US10991349B2 (en) 2018-07-16 2021-04-27 Samsung Electronics Co., Ltd. Method and system for musical synthesis using hand-drawn patterns/text on digital and non-digital surfaces

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0747851A2 (fr) * 1995-06-07 1996-12-11 International Business Machines Corporation Filtre numérique récursif utilisant l'arithmétique à point fixe à utiliser dans un dispositif de pointage
US5663514A (en) * 1995-05-02 1997-09-02 Yamaha Corporation Apparatus and method for controlling performance dynamics and tempo in response to player's gesture
US5819206A (en) * 1994-01-21 1998-10-06 Crossbow Technology, Inc. Method and apparatus for determining position and orientation of a moveable object using accelerometers
US20060028446A1 (en) * 2004-04-30 2006-02-09 Hillcrest Communications, Inc. Methods and devices for removing unintentional movement in free space pointing devices
US20070118241A1 (en) * 2005-12-16 2007-05-24 Outland Research, Llc Shake Jamming Portable Media Player
US20070113726A1 (en) * 2005-11-23 2007-05-24 Microsoft Corporation Using music to influence a person's exercise performance
EP1837858A2 (fr) * 2000-01-11 2007-09-26 Yamaha Corporation Dispositif et méthode pour détecter le mouvement d'un artiste et commander une interprétation musicale de manière interactive
EP1850318A2 (fr) * 2006-04-25 2007-10-31 Nintendo Co., Ltd. Support de stockage stockant un programme de musique et appareil de musique correspondant

Family Cites Families (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR755244A (fr) 1933-05-06 1933-11-21 Petro Flex Tubing Cy Ltd Tubes perfectionnés et dispositif pour leur fabrication
US5170002A (en) * 1987-12-24 1992-12-08 Yamaha Corporation Motion-controlled musical tone control apparatus
US5166463A (en) * 1991-10-21 1992-11-24 Steven Weber Motion orchestration system
JPH086549A (ja) * 1994-06-17 1996-01-12 Hitachi Ltd 旋律合成方法
US5746640A (en) * 1994-12-05 1998-05-05 Meadows; Michael R. Motion-activated musical device
US5648627A (en) * 1995-09-27 1997-07-15 Yamaha Corporation Musical performance control apparatus for processing a user's swing motion with fuzzy inference or a neural network
US6011212A (en) * 1995-10-16 2000-01-04 Harmonix Music Systems, Inc. Real-time music creation
US5808219A (en) * 1995-11-02 1998-09-15 Yamaha Corporation Motion discrimination method and device using a hidden markov model
JP2000501033A (ja) * 1995-11-30 2000-02-02 ヴァーチャル テクノロジーズ インコーポレイテッド 触覚をフィードバックする人間／機械インターフェース
USRE37654E1 (en) * 1996-01-22 2002-04-16 Nicholas Longo Gesture synthesizer for electronic sound device
US6066794A (en) * 1997-01-21 2000-05-23 Longo; Nicholas C. Gesture synthesizer for electronic sound device
US6720949B1 (en) * 1997-08-22 2004-04-13 Timothy R. Pryor Man machine interfaces and applications
US6005181A (en) * 1998-04-07 1999-12-21 Interval Research Corporation Electronic musical instrument
US6150947A (en) * 1999-09-08 2000-11-21 Shima; James Michael Programmable motion-sensitive sound effects device
US6867361B2 (en) * 2000-09-05 2005-03-15 Yamaha Corporation System and method for generating tone in response to movement of portable terminal
DE60132963T2 (de) * 2000-09-05 2009-04-16 Yamaha Corporation, Hamamatsu Vorrichtung und Verfahren zur Tonerzeugung in Abhängigkeit der Bewegung eines tragbares Terminals
US6388183B1 (en) * 2001-05-07 2002-05-14 Leh Labs, L.L.C. Virtual musical instruments with user selectable and controllable mapping of position input to sound output
JP3873654B2 (ja) * 2001-05-11 2007-01-24 ヤマハ株式会社 オーディオ信号生成装置、オーディオ信号生成システム、オーディオシステム、オーディオ信号生成方法、プログラムおよび記録媒体
US20030188627A1 (en) * 2002-04-05 2003-10-09 Longo Nicholas C. Interactive performance interface for electronic sound device
US20030196542A1 (en) * 2002-04-16 2003-10-23 Harrison Shelton E. Guitar effects control system, method and devices
JP4144269B2 (ja) * 2002-06-28 2008-09-03 ヤマハ株式会社 演奏処理装置
US7854655B2 (en) * 2002-07-27 2010-12-21 Sony Computer Entertainment America Inc. Obtaining input for controlling execution of a game program
KR100668298B1 (ko) * 2004-03-26 2007-01-12 삼성전자주식회사 움직임에 기반한 소리 발생 방법 및 장치
TWI261525B (en) * 2004-12-24 2006-09-11 Giga Byte Tech Co Ltd Motion analyzing device and method for mobile product
US7489979B2 (en) * 2005-01-27 2009-02-10 Outland Research, Llc System, method and computer program product for rejecting or deferring the playing of a media file retrieved by an automated process
JP4457983B2 (ja) * 2005-06-27 2010-04-28 ヤマハ株式会社 演奏操作援助装置及びプログラム
WO2007092238A2 (fr) * 2006-02-02 2007-08-16 Xpresense Llc Dispositif de télécommande sans fil sensible à un état détecté, utilisant une durée entre les messages pour indiquer une lecture du détecteur
US7622663B2 (en) * 2008-02-14 2009-11-24 Casillas Mark J Kinesthetic musical instrument position trainer, corrector, and up-motion muscle strengthener for fingers, hands, wrists, and arms, and practice device simulator
US9171531B2 (en) * 2009-02-13 2015-10-27 Commissariat À L'Energie et aux Energies Alternatives Device and method for interpreting musical gestures
FR2942344B1 (fr) * 2009-02-13 2018-06-22 Movea Dispositif et procede de controle du defilement d'un fichier de signaux a reproduire
US8222507B1 (en) * 2009-11-04 2012-07-17 Smule, Inc. System and method for capture and rendering of performance on synthetic musical instrument
JP5316818B2 (ja) * 2010-10-28 2013-10-16 カシオ計算機株式会社 入力装置およびプログラム
US8772621B2 (en) * 2010-11-09 2014-07-08 Smule, Inc. System and method for capture and rendering of performance on synthetic string instrument
US8987571B2 (en) * 2011-04-12 2015-03-24 Shmuel Ur Method and apparatus for providing sensory information related to music
US20130032023A1 (en) * 2011-08-04 2013-02-07 Andrew William Pulley Real time control of midi parameters for live performance of midi sequences using a natural interaction device
GB201119447D0 (en) * 2011-11-11 2011-12-21 Fictitious Capital Ltd Computerised percussion instrument

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5819206A (en) * 1994-01-21 1998-10-06 Crossbow Technology, Inc. Method and apparatus for determining position and orientation of a moveable object using accelerometers
US5663514A (en) * 1995-05-02 1997-09-02 Yamaha Corporation Apparatus and method for controlling performance dynamics and tempo in response to player's gesture
EP0747851A2 (fr) * 1995-06-07 1996-12-11 International Business Machines Corporation Filtre numérique récursif utilisant l'arithmétique à point fixe à utiliser dans un dispositif de pointage
EP1837858A2 (fr) * 2000-01-11 2007-09-26 Yamaha Corporation Dispositif et méthode pour détecter le mouvement d'un artiste et commander une interprétation musicale de manière interactive
US20060028446A1 (en) * 2004-04-30 2006-02-09 Hillcrest Communications, Inc. Methods and devices for removing unintentional movement in free space pointing devices
US20070113726A1 (en) * 2005-11-23 2007-05-24 Microsoft Corporation Using music to influence a person's exercise performance
US20070118241A1 (en) * 2005-12-16 2007-05-24 Outland Research, Llc Shake Jamming Portable Media Player
EP1850318A2 (fr) * 2006-04-25 2007-10-31 Nintendo Co., Ltd. Support de stockage stockant un programme de musique et appareil de musique correspondant

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"Movea unveils the latest in motion-sensing Technology for consumer products", BUSINESS WIRE 2009, 8 January 2009 (2009-01-08), Las Vegas, XP002551642, Retrieved from the Internet <URL:http://www.reuters.com/article/pressRelease/idUS58386+08-Jan-2009+BW20090108> [retrieved on 20091020] *
STEPHEN TOTILO: "One on one with Shigeru Miyamoto: from WII Music to Bowser to...Motion Plus?", 27 October 2008 (2008-10-27), XP002592172, Retrieved from the Internet <URL:http://multiplayerblog.mtv.com/2008/10/27/one-on-one-with-shigeru-miyamoto/> [retrieved on 20100708] *

Also Published As

Publication number Publication date
EP2396711A2 (fr) 2011-12-21
US9171531B2 (en) 2015-10-27
US20120062718A1 (en) 2012-03-15
WO2010092139A2 (fr) 2010-08-19

Similar Documents

Publication Publication Date Title
WO2010092139A3 (fr) Dispositif et procede d&#39;interpretation de gestes musicaux
WO2013090831A3 (fr) Instrument de musique à cordes multiples synthétique à signaux d&#39;effet de performance codés par partition et/ou capture de geste de son de corde
US8626324B2 (en) Altering sound output on a virtual music keyboard
WO2010006276A3 (fr) Interface d&#39;ordinateur pour des instruments à cordes polyphoniques
JP5790642B2 (ja) 入力装置、入力方法及びプログラム
WO2011030225A3 (fr) Système et procédé pour améliorer l&#39;enseignement de la musique
WO2015113457A1 (fr) Appareil et méthode pour améliorer les qualités expressives de la musique numérique
WO2010142297A3 (fr) Système de jeu de correspondance audio génératif
WO2009108029A3 (fr) Dispositif et procédé d&#39;affichage de touches de guitare virtuelle sur un dispositif mobile
WO2007092239A3 (fr) Télécommande dynamique à radiofréquence pour dispositifs d&#39;introduction d&#39;effets sonores ou analogues
EP4246516A3 (fr) Dispositif et procédé de réduction du bruit de quantification dans un décodeur dans le domaine temporel
EP2159785A3 (fr) Procédé d&#39;écriture de chansons et appareil utilisant un écran tactile dans un terminal mobile
ATE546958T1 (de) Vorrichtung und verfahren zur datenverarbeitung
CN103885663A (zh) 一种生成和播放音乐的方法及其对应终端
AU2012282089A8 (en) String instrument, system and method of using same
JP2016071029A5 (fr)
JP2014202857A5 (fr)
WO2006060022A3 (fr) Procede et appareil d&#39;adaptation de bandes musicales originales pour une utilisation karaoke
WO2010092140A3 (fr) Dispositif et procede de controle du defilement d&#39;un fichier de signaux a reproduire
CN105389013A (zh) 一种基于手势的虚拟弹奏系统
GB2483046A (en) Method of obtaining a user selection
JP2009515260A5 (fr)
EP2629295A3 (fr) Système et procédé d&#39;estimation du bruit avec détection de musique
WO2007133971A3 (fr) Procédé et système permettant de traiter de la musique sur un dispositif informatique
WO2012015956A3 (fr) Procédés et appareil destinés à la réalité augmentée et à la détermination de la localisation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10703477

Country of ref document: EP

Kind code of ref document: A2

REEP Request for entry into the european phase

Ref document number: 2010703477

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2010703477

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 13201420

Country of ref document: US