WO2019234424A1 - Input device - Google Patents
Input device Download PDFInfo
- Publication number
- WO2019234424A1 WO2019234424A1 PCT/GB2019/051560 GB2019051560W WO2019234424A1 WO 2019234424 A1 WO2019234424 A1 WO 2019234424A1 GB 2019051560 W GB2019051560 W GB 2019051560W WO 2019234424 A1 WO2019234424 A1 WO 2019234424A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- music production
- input device
- joystick
- production system
- controller
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0338—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F4/00—Methods or devices enabling patients or disabled persons to operate an apparatus or a device not forming part of the body
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/0033—Recording/reproducing or transmission of music for electrophonic musical instruments
- G10H1/0041—Recording/reproducing or transmission of music for electrophonic musical instruments in coded form
- G10H1/0058—Transmission between separate instruments or between individual components of a musical system
- G10H1/0066—Transmission between separate instruments or between individual components of a musical system using a MIDI interface
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/0091—Means for obtaining special acoustic effects
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/155—User input interfaces for electrophonic musical instruments
- G10H2220/315—User input interfaces for electrophonic musical instruments for joystick-like proportional control of musical input; Videogame input devices used for musical input or control, e.g. gamepad, joysticks
Definitions
- the invention relates to an input device, and particularly to an input device for controlling music production software.
- Creating music often provides an avenue through which many people choose to express themselves, exercise their creative abilities, and/or provide cathartic entertainment both for those creating the music and those listening to the finished product.
- Music, music production and musical instrument lessons also form part of the educational curriculum for many schools, particularly in the UK, and may include learning to identify different instruments, tempos, and rhythms, as well as learning about the cultural history surrounding the music.
- music lessons in school aim to teach students how to create and produce pieces of music, instil confidence in those students in their music production and encourage them to build on their skills.
- Musical and creative expression can provide a form of therapy and becomes increasingly important for people who might be non-verbal, or who have disabilities which prevent them from being able to freely
- Music production is often done through software on a computer, tablet or mobile device, and the software may be hosted on the computing device itself, or on an online platform.
- input devices for such music production include a mouse-and-keyboard set-up, a touchscreen, and/or a MIDI Controller device.
- the input device is connected, wirelessly or via a cable, to a computer on which music production software is running or hosted.
- the music production software interprets the signals from the input device and displays them in a user-friendly format (for example, in the form of musical notation on a score, or in a graphical format) and then the user can use the mouse and/or other features of the input device to manipulate the input signals in order to create the sound they require.
- the input device may be configured such that the actuation of a particular key or button equates to a musical note of a certain pitch and frequency.
- the input device will have a plurality of keys (e.g. a computer keyboard or a musical keyboard) wherein the software will interpret the input from each key differently. How the input from each key is interpreted may be set by the user.
- the richness, tone, reverb, fade, and length of note can be configured within the software to create a note that sounds like it is being played using a real an instrument, such as a guitar.
- the user may manipulate the overall sound of a plurality of recorded inputs using the software. This provides the user with a large amount of creative control.
- Conventional input devices for this type of software and process are not easily accessible by persons having certain disabilities, in particular those with limited limb movement and control, learning disabilities, and conditions such as autism.
- Such disabilities mean that manipulating a plurality of different keys (and types of keys/buttons) can be impossible, and this may prevent the person from being able to exercise their full creative abilities, and/or engage with music lessons.
- This can be particularly disadvantageous where the activity of engaging with music production could, in fact, provide significant therapeutic effects for that person. Therefore, there is a need for an input device which is adapted to enable people with certain disabilities to engage with music production and, where that person is in education, engage with music lessons and/or therapeutic creative sessions.
- Input devices adapted for music production and/or music creation and for use by a person having a disability are known in the art.
- eyetracking technology has enabled the development of software which allows the user to play a melody by looking at certain“buttons” or“keys” displayed on a display unit in a particular pattern or order.
- such technology does not provide the full breadth of creative control that is enabled by interacting with existing music production software.
- one of the primary problems with using such new technologies is that the user must input time and energy into learning how to use the new devices. This can be time-consuming and frustrating, and may ultimately result in that person becoming upset, losing interest and missing out on the above-mentioned benefits.
- an input device communicably couplable to a remote computing device for enabling a user, in use, to generate input signals configured to control functions of a computer program running on said remote computing device, the input device comprising a main body and a joystick configured to cause input signals to be generated when operated.
- the main body may comprise a first body portion having a first planar surface, wherein said joystick protrudes from said first body portion and may extend substantially perpendicularly to said first planar surface.
- the main body may further comprise a second body portion having a second planar surface.
- the second body portion may comprise at least one push button mechanism operable from said second planar surface and configured to cause an input signal to be generated when operated.
- the first and second planar surfaces may be adjacent and at an obtuse angle relative to each other.
- the second body portion may comprise a plurality of push button mechanisms.
- the input device may comprise a printed circuit board which may have a microcontroller mounted thereon, wherein the joystick and the at least one push button mechanism may be communicably coupled to the printed circuit
- a USB cable may be coupled to said printed circuit board.
- the generated input signals may be configured to control music production software.
- an input device communicable coupleable to a remote computing device for enabling a user, in use, to generate input signals configured to control functions of a computer program running on said remote computing device
- the input device comprising a main body comprising a joystick configured to cause input signals to be generated when operated, said main body comprising a first body portion having a first planar surface, wherein said joystick protrudes from said first body portion, said main body further comprising an attachment member having an adjustable grip member at one end thereof for releasably securing said main body to a chair, in use.
- the main body further may comprise a second body portion which may have a second planar surface.
- the second planar surface may comprise at least one push button mechanism which may be operable from the second planar surface and configured to cause an input signal to be generate when operated.
- the input device may comprise a printed circuit board having a microcontroller mounted thereon, wherein the joystick may be communicably coupled to the printed circuit board.
- the input device may comprise a USB cable which may be coupled to said printed circuit board.
- the attachment member may comprise an armature which may have a grip member at a first end thereof and a mounting plate at a second end thereof, the mounting plate may be shaped and configured to be removably fixed to a surface of the main body which may be diametrically opposite the first planar surface.
- an input device communicably coupleable to a remote computing device for enabling a user to generate input signals, in use, configured to control functions of a computer program running on said remote computing device
- the input device comprising a main body and a joystick configured to cause input signals to be generated when operated, said main body comprising a first body portion having a first planar surface, wherein said joystick protrudes from said first body portion and extends substantially perpendicularly to said first planar surface said main body further comprising a second body portion having a second planar surface, said second body portion comprising at least one push button mechanism operable from said second planar surface and configured to cause an input signal to be generated when operated, and wherein said first and said second planar surfaces are adjacent and at an obtuse angle relative to each other, said input device further comprising an attachment member having an adjustable grip member at one end thereof for releasably securing said main body to a chair, in use.
- the second planar surface may comprise a plurality of buttons.
- the input device may further comprise a printed circuit board which may have a microcontroller mounted thereon, wherein the joystick and the at least one push button mechanism may be communicably coupled to the printed circuit board.
- the input device may further comprise a USB cable which may be coupled to the printed circuit board.
- the attachment member may comprise an armature which may have a grip member at a first end thereof and a mounting plate at a second end thereof, the mounting plate may be shaped and configured to be removably fixed to a surface of the main body which may be diametrically opposite the first planar surface.
- the input signals may be configured to control music production software.
- the sensor output may received by a controller of the input device and the controller may generate a corresponding signal output to control one or more music production function of the music production software.
- the music production function may be a music composition function or other production function that alters/amends the music, e.g. as opposed to a simple playback function.
- Figure 1 is a schematic side-view of an input device according to an exemplary embodiment of the invention.
- Figure 2 is a schematic perspective view of the input device of Figure 1 ;
- Figure 3 is a schematic plan view of the input device of Figure 1 ;
- Figure 4 is a schematic side view of the input device of Figure 1 including a table-top adaptor;
- Figure 5 is a schematic plan view of the input device of Figure 1 showing the electrical components exposed;
- Figure 6 shows a alternative casing of the input device
- Figure 7 shows a schematic zonal mapping scheme for a joystick input
- Figure 8 shows an alternative zonal mapping scheme for a joystick input
- Figure 9 shows a flow diagram for a note (MIDI) signal generated by the input device.
- Figure 10 shows a flow diagram for a control change signal generated by the input device.
- FIG. 1 there is illustrated an input device according to an exemplary embodiment of the invention shaped and configured to look similar to a
- the illustrated input device comprises a generally cuboidal main body with a first body portion 10 having a joystick 12 mounted on a surface thereof.
- the joystick 12 comprises a shaft 1 1 extending through an aperture (not shown) in the surface of said first body portion 10.
- the shaft 11 is constructed from a rigid material and may have a generally circular cross-section. Alternatively, the shaft 1 1 may, for example, have a polygonal cross-section and the present invention is not intended to be limited in this regard.
- the illustrated joystick 12 may comprise a handle or knob portion 11 a at the distal end of the shaft 11 (i.e. the point furthest from the first body portion 10).
- the knob portion 1 1 a can have a number of attachment types to suit the needs of the user.
- the joystick is received within a socket which allows for pivotal movement of the shaft in a plurality of directions in and/or around an active input region defined, in part, by the aperture.
- the aperture (not shown) through which the shaft 1 1 extends is larger than the diameter of the shaft 1 1 to allow for movement.
- the aperture may be circular, to allow for full 360 degrees of pivotal movement.
- the aperture may comprise a number of barriers to prevent movement in certain directions, or the aperture may be polygonal to help guide the user to move the joystick in certain directions.
- the joystick 12 may optionally comprise a rubber dust washer 13 which is flexible to allow for movement in any required direction.
- the joystick 12 is communicably coupled to a plurality of electronic components housed within the main body.
- the electronic components will be described in more detail hereinafter, and with reference to Figure 5 of the drawings.
- the joystick 12 comprises a biasing mechanism which acts against the direction of movement from the equilibrium position, wherein the equilibrium position is where the shaft 1 1 is substantially perpendicular to the plane of the surface of the first body portion 10 from which it extends.
- the equilibrium position is detected by the device as a“central dead-zone”.
- a central dead-zone is defined as detection of no joystick movement.
- the biasing mechanism may be of a similar strength to provide the same tactile feedback to the user as they would expect from using a wheelchair controller device.
- a tapered platform 14, or second body portion forms the rest of the main body.
- the platform 14 extends from a surface of said first body portion 10, adjacent to the surface on which the joystick 12 is located, and at an angle thereto.
- the platform 14 comprises a planar surface 16 on one side and a generally convex surface 18 on the opposing side.
- the planar surface 16 is formed integrally with the surface of the first body portion 10 on which the joystick 12 is located, but protrudes at an obtuse angle thereto such that the distal end of the platform 14 is approximately aligned vertically with the top of the joystick 12.
- the surface of the first body portion and the planar surface of the second body portion combine to form a single operable surface having a bend therein.
- the distal end of the platform is rounded.
- the overall shape of the planar surface 16 may be described as“U”-shaped.
- the base of the convex surface 18 is formed integrally with the opposing surface of the first body portion 10 on which the joystick 12 is located.
- the parts of the convex surface 18 which face in opposing directions are formed integrally 5 with two opposing side surfaces of the first body portion 10.
- the input device will be oriented such that the platform 14 is directed away from the user and the joystick 12 is directed upwardly.
- the input device comprises a plurality of other manual inputs.
- a plurality of push button caps 24 protrude from the planar surface 16 of the platform 14.
- Each push button cap 24 is communicably coupled to the electronic components housed within the main body 12.
- the push button caps 24 are comprise a rubber, and/or a pliable/deformable material. This kind of material will absorb any high impact forces applied to the surface thereof, protecting the electrical circuitry within the device. This may be particularly advantageous where the user has a disability which has symptoms including spontaneous or uncontrolled limb movements.
- An input/output port 20 is located generally centrally within the convex surface 18.
- a wired connection 22 joins the input/output port 20 to a music production system (not shown).
- the music production system may comprise dedicated music production hardware/software (e.g. a sequencer). Additionally or alternatively, the music production system comprises a conventional computing device (e.g. a desktop computer, a laptop, a tablet computer device, or a mobile device, such as a mobile phone) running music production software (i.e. Digital Audio
- the input device in the drawings is illustrated as having a physical wire connection to the music production system, it will be apparent to those skilled in the art that a wireless connection may be made between the input device and the music production system receiving the input data, for example by using RF (radio frequency) waves, Wifi, Bluetooth® or other wireless technology.
- the wired connection may be electrical wiring or, optionally, comprise optical wires (e.g. TOSLINK).
- TOSLINK optical wires
- buttons and joystick is familiar with known wheelchair input devices used to control movement of an electric wheelchair.
- This has the unique advantage of being suitable for use by people with certain disabilities. Many people with disabilities already use an input device shaped and configured in a similar way to the above-described exemplary embodiment of the invention, therefore they are familiar with the controls and do not need to spend much time in learning a different set of controls.
- the input device may comprise or include an attachment member, such as a bracket or clamp to allow the device to be fixed to a secondary surface, such as a table, desk, or similar, or even to the arm of a user’s wheelchair.
- an attachment member such as a bracket or clamp to allow the device to be fixed to a secondary surface, such as a table, desk, or similar, or even to the arm of a user’s wheelchair.
- the input device having an attachment member indicated generally at 26.
- the input device comprises a recess 30 shaped and configured to receive a connector plate 32.
- the connector plate 32 is removably fixed to a surface of the recess 30 such that the connector plate 32 is substantially parallel with the surface of the first body portion 10 on which the joystick 12 is located.
- the connector plate 32 may be fixed in place using known fixing means such as nut and bolt assemblies 34.
- Other suitable means for fixing the connector plate 32 within the recess 30 may be known in the art and the present invention is not necessarily intended 5 to be limited
- the connector plate 32 may be formed integrally with the first body portion 10 of the input device.
- An armature 28 formed integrally with the connector plate 32 extends away from the first body portion 10 of the input device.
- a foot plate 36 extends from a distal end of the armature 28, substantially perpendicular thereto.
- the foot plate 36 is substantially parallel to the connector plate 32.
- the foot plate 36 is mechanically coupled to a grip plate 38 by a screw 39 and rotatable knob 40.
- the screw 39 protrudes through an aperture in the grip plate 38 and a corresponding, vertically-aligned aperture in the foot plate 36.
- the aperture in the foot plate 36 comprises a complimentary screw thread which engages with the screw thread of the screw 39.
- the grip plate 38 is fixedly mounted on the screw 39. This may be achieved by applying an adhesive substance to the inside of the aperture.
- the rotatable knob 40 which is fitted to the lower end of the screw 39, can be rotated in a first direction to cause the screw 39 to be drawn upwardly. This decreases the distance between the foot plate 36 and the grip plate 38.
- the rotatable knob 40 can be rotated in a second direction to cause the screw to be drawn downwardly through the aperture in the foot plate 36. This increases the distance between the foot plate 36 and the grip plate 38. Therefore, in this manner, the attachment member 26 can be fitted to any surface.
- the length of the screw 39 limits the maximum distance between the foot plate 36 and the grip plate 38. Therefore, the screw 39 length may be chosen according to the requirements of use.
- the armature 28 may be connected to the foot plate 36 or input device/connection plate 32 via a joint.
- the joint may be lockable and releasable to allow alteration to the position and/or orientation of the input device to suit the user.
- the attachment member 26 comprises a pivoting type clamp (e.g. a claw grip).
- the attachment member comprises a stem rotatable with respective to the clamp, to allow rotation of the input device.
- the stem may be connected to the clamp via a first joint having a first ball and socket arrangement or the like.
- the attachment member comprises a plate configured to attach to the input device.
- the plate is connected to the stem via a second joint (e.g. having a first ball and socket arrangement) to a permit a further axis of movement.
- the first joint and/or second clamp comprise a securing means to fix the angle of the joint(s).
- the clamp comprises a screw or the like to allow to variation of the distance/angle between individual clamp members.
- FIG. 5 a schematic exemplary embodiment of the inner electrical components is illustrated.
- a joystick base 42 Within the first body portion 10, directly below the joystick shaft 12, there is provided 5 a joystick base 42. This is wired to a printed circuit board (PCB) 44.
- PCB printed circuit board
- Push button switches 48 are mounted on the PCB 44 and are located to align with the push button caps 24 present on the tapered platform 14 when the
- the push button switches 48 send signals to the microcontroller 46 when the push button caps 24 are pressed.
- the input device comprises other manual inputs, for example, rocker switches or rotatable dials (e.g. potentiometers).
- the rotatable dial may be rotationally incremented to selection from plurality of discrete outputs.
- the microcontroller 46 is configured to receive and interpret the signals from each of the inputs accordingly.
- the joystick base 42 transfers data representative of the joystick movement in an analogue format to the PCB via electronic signals through electrical wiring 43.
- a microcontroller/microprocessor 46 is mounted on said PCB 44 and electrically communicable therewith.
- the microcontroller/microprocessor 46 may be any suitable microcontroller/microprocessor as is known in the art.
- the present embodiment uses an ARDUINO® microcontroller board which is particularly suited to receiving inputs and generating output signals in a different format.
- the microcontroller/microprocessor 46 converts the analogue signals into a suitable computer-readable format (e.g. digital signals) ready for transmission to a computer/music production system via the USB cable 22.
- the USB cable 22 is also electrically communicable with the PCB and connected therewith.
- the microcontroller may be particularly configured to disregard certain
- the joystick 12 might be accidentally momentarily moved in a direction.
- the joystick base 42 may still transmit the movement signal to the PCB 44, and subsequently the microcontroller 46, however the microcontroller 46 may disregard the signal if it has a time period of less than a pre-determined length of time. Therefore, the user does not accidentally cause changes in the software which might otherwise result in frustration.
- the sensitivity of the detected movements can be adjusted according to the user. For example, where a user has good limb control, but lacks in strength, the sensitivity may be set to high in order to provide the full range of interaction with the computer and computer software.
- the USB 22 may allow for two- way communication between the computer and the input device. Therefore, the microcontroller may comprise a bank of assignments for each joystick 12 movement and button switch 48 between which it may select the suitable assignments according to the software being run on the computer.
- the microcontroller may only comprise a single set of assignments which are readable by a number of different software applications.
- the input device comprises a plurality of lights (e.g. LEDs) to provide an indication of the operation of the device.
- lights e.g. LEDs
- One or more lights may be associated and/or formed integrally with a respective push button 48.
- the lights may illuminate when the button 48 is pushed/toggled into a depressed state, thereby indicating activation of the button 48.
- one or more of the lights may illuminate to provide an indication to user to press the associated button. This may guide the user to press a desired button at a particular time and/or in a particular sequence.
- One or more of the lights may be changeable in emitted colour (e.g.“RGB” type LEDs).
- One or more of the lights may illuminate intermittently with a predetermined period of time between illuminations to provide a metronome for the user. The period of time is variable and may be determined by the music production system.
- FIG. 6 shows an alternative casing for the body portion 10.
- the casing a comprises a plurality of apertures 49 to allow access to a plurality of respective switches 48.
- the apertures 49 are arranged in a 2x4 array, however, it can be appreciated that any such arrangement is suitable depending on the needs of the user.
- a second aperture 49a is provided to allow the joystick to protrude therefrom.
- the joystick 12 and/or the associated electronics delineate the position of the joystick into a plurality of discrete zones 50.
- the zones 50 may be labelled as“up” (i.e. pushing the joystick 12 away from the user),“down” (i.e. pulling the joystick 12 toward the user),“left”, and“right” (i.e. moving the joystick 12 left and right respectively).
- the device may be configured to detect a higher resolution of movement. For example, if the user directs the joystick 12 to a point between a wholly“up” direction and a wholly“left” direction, then the movement may be detected as a sub-category of movement, namely,“up-left”. Similarly, movements such as“up-right”,“down-left” and“down right” may also be detected. It can be appreciated that any number of zones may be delineated and the
- position/orientation/size/shape of the zones may vary according to the
- the joystick 12 is divided into eight zones,
- the dead-zone 68 is provided at a central portion thereof.
- An intermediate zone 70 may be provided between adjacent zones 50 and provides either an overlap region or spatial separation thereof. The intermediate zone 70 may be used to create a different output signal at the interface between the two adjacent zones. Alternatively the intermediate zone 70 may comprise a further deadzone to prevent the user inadvertently switching between two adjacent zones if the joystick lies on a boundary thereof.
- An intermediate/dead zone may send a reset for all other zones.
- the size and/or arrangement of intermediate/dead zones may be tailored to different users with restricted movement.
- the zones 50 extending outwardly from the central dead-zone 68 in a substantially radial configuration (e.g. to define a plurality of radial sectors).
- the zones 50 are arranged in a substantially rectangular array with divisions between respective zones 50 provided in the up, down, left, right cardinal directions.
- the intermediate zone 70 extends between: the top-left zone 66, and the top zone 52 and the left zone 64; the top-right zone 54, and the top zone 52 and the right zone 56; the down-right zone 58, and the right zone 56 and the down zone 60; and the down-left zone 62, and the down zone 60 and the left zone 64.
- the device may be configured to detect a separate movement category for each degree (or plurality of degrees) of rotation around a circle.
- Each movement which can be detected by the input device can be divided into 128“sub-movements”.
- Each sub-movement detected can result in a different input signal being generated.
- Each of the zones 50 is operatively associated with one or more function to control the operation of the music production system.
- the input device therefore allows a user to select a number of discrete outputs using the joystick 12, thereby providing control of the music production system.
- the zonal inputs can be mapped to different input signals or types.
- the input device is used to create/compose a musical sequence using the music production system, i.e. a composition mode of use.
- the input device is configured generate an output signal according to the selected zone.
- the signal comprises a predetermined musical note and/or chord 72 generated according to the selected zone 50 (i.e. the input device is programmed to output a musical note/chord 72).
- the musical note is received by the music production system.
- the input device may be configured such that each zone 50 is associated with a corresponding note on musical scale (e.g. a major, minor, diatonic or chromatic scale).
- Each zone 50 may correspond to a chord separated by a predetermined musical interval (e.g. 3 rd major/minor).
- zones 50 may be arranged about a C-minor scale (e.g.
- each of the zones 50 may correspond to an individual note in a predetermined scale.
- a simple movement of the joystick into a zone may trigger a zone selection signal indicating that a corresponding note/chord is to be played in the music production system.
- the note 72 is provided in a Musical Instrument Digital Interface (MIDI) format.
- MIDI Musical Instrument Digital Interface
- any suitable format or digital music representation may be used.
- the note 72 may be received by a sampler 74.
- the sound generated will depend on which musical preset has been chosen, which channel is selected, and/or where the potentiometer is set to. This allows a wide range of performance options that can be selected on the device.
- the sampler 74 transforms the received note into a transformed note.
- the transformed note may comprise one or more of: a chord; a suspended note/chord 76; a plurality of notes/chords (e.g. a sequence); a sampled instrument phrase 80; an altered pitch note; or an arpeggiated sequence 78.
- the note 72 may be received by a synthesizer 82.
- the synthesizer 82 generates a musical sequence according to the received note.
- the synthesiser may comprise a plurality of pre-stored samples and/or musical sequences.
- the musical may comprise one or more of: a MIDI sequence; or a suspended note/chord.
- the synthesiser may have a plurality of pre-defined settings to produce a musical sequence with one or more pre-defined timbres (e.g. different musical instruments, or effects etc.)
- the user may use the input device to select a plurality of notes in sequence to create a musical composition.
- the musical composition may be recorded onto one or more channels (e.g. a bass track, a drum track, a melody track etc.), thereby allowing concurrent playback of a number of individual compositions.
- the tracking of the manner in which the joystick is moved may also be used by the input device to denote additional information accompanying the zone selection.
- the speed, acceleration and/or direction of movement of the joystick or the duration for which the joystick is held within the zone may be logged and transmitted to provide further information about the selected note, i.e. a quality or duration for the note, to the music production software.
- the information converted into an input signal for the music production system may comprise not only the zone selection/activation signal component, but also an accompanying/concurrent control signal element.
- Each channel can play a single note (with any articulation), a MIDI sequence, a sampled instrument phrase or an arpeggiated pattern.
- Each can be decided at the top level of the song selection process and varies between pieces of music.
- the control change information adds an additional layer of dynamic to a solo instrument or a change effects across a whole mix. This may be decided and pre-programmed, e.g. into the song templates.
- Some examples could include the volume, reverb and amount of voices of a solo violin (additional voices could include Viola and Cello). In an example, it could adapt the speed of a filter LFO on a bass line. In an example it could adapt an arpeggiated pattern between percussion instruments.
- the input device is configured to provide control of the music production system.
- the input device is configured an output signal according to the selected zone 50 and a predetermined control value 88 is generated.
- the control value 88 may be received by a playback controller 90 configured to control the playback of the musical sequence/composition.
- a playback controller 90 configured to control the playback of the musical sequence/composition.
- the zones 50 on the input device are configured to signal the playback controller 90 to:
- pause pause
- play increase the playback speed (e.g. fast forward or rewind);
- the control value 88 may be received by an effects controller 90 configured to apply sound effects to the sequence/composition.
- the effects controller 98 applies one or more‘audio filter’ 100 configured to alter the sequence/composition and change the aural properties thereof (e.g. the timbre).
- the filter may comprise: a modulation effect (e.g. chorus, tremolo, flanger and phaser); a time- base effect (e.g. reverb, delay and echo); spectral effects (e.g. equalisation and panning); dynamic effects (e.g. compression and distortion); low, high or mid-band filtering; the number of voices of a particular instrument; and/or any other conventional sound effects.
- the zones 50 of the input device are therefore mapped to select to select an appropriate sound effect.
- the sound effect may be applied to single sequence, an individual channel, or across the entire composition.
- the switches 48 may comprise a“left” and“right” switches to allow lateral navigation of the composition/playback hierarchy, for example, to allow selection to of the appropriate filter or the type of sample generated. Additionally or alternatively, the switches may comprise an“up” and “down” switches to allow vertical navigation of the composition/control hierarchy.
- the joystick may be switched to a“navigation mode”, whereby the“up”,“down”,“left”,“right” zones 50 permit navigation through the hierarchy.
- the joystick may then be switched back to a“composition/control” where the zones 50 are configured to generate a composition/control command.
- the switches 48 and/or joystick 12 on the input device may be configured to navigate between and/or select one or more of the channels for composition and/or control thereof.
- the lights associated with the switch comprises certain colours associated with a respective composition/control output.
- a first filter/note is associated with a first colour
- a second filter/note is associated with a second colour etc. This allows intuitive selection of one or more options using a colour-coded scheme.
- joystick 12 and the switches 48 will act in concert to allow control of the music production system, and either of the joystick 12 and the switches 48 may be used to select between the various options during play
- a plurality of input devices may be operatively connected to the music production system to allow collaborative composition of music by a plurality of respective users.
- Each input device may be allocated an individual channel, thereby allowing each user to generate an individual track, which can then be combined with other trackers to provide the overall composition.
- the users may be assigned different musical instruments, thus allowing the plurality of users to act as a virtual orchestra.
- buttons allow for an additional level of control and the ability to play, stop, record etc. depending on the programming of the software.
- This controller aims to allow musicians, e.g. having reduced mobility, to create complex musical changes with only small movements.
- Using a joystick-type controller and dedicated programming of the resulting signals it has been possible to create a musical controller that allows users with restricted movement to perform more easily and with greater sophistication than has been hitherto possible.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Acoustics & Sound (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Health & Medical Sciences (AREA)
- Vascular Medicine (AREA)
- Life Sciences & Earth Sciences (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Heart & Thoracic Surgery (AREA)
- Biomedical Technology (AREA)
- Position Input By Displaying (AREA)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/972,313 US11900903B2 (en) | 2018-06-06 | 2019-06-05 | Input device |
EP19730499.1A EP3803547B1 (de) | 2018-06-06 | 2019-06-05 | Eingabevorrichtung |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GB1809245.2A GB2574429B (en) | 2018-06-06 | 2018-06-06 | Input device |
GB1809245.2 | 2018-06-06 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019234424A1 true WO2019234424A1 (en) | 2019-12-12 |
Family
ID=62975393
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/GB2019/051560 WO2019234424A1 (en) | 2018-06-06 | 2019-06-05 | Input device |
Country Status (4)
Country | Link |
---|---|
US (1) | US11900903B2 (de) |
EP (1) | EP3803547B1 (de) |
GB (1) | GB2574429B (de) |
WO (1) | WO2019234424A1 (de) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2574429B (en) * | 2018-06-06 | 2022-07-20 | Digit Music Ltd | Input device |
US11617945B2 (en) * | 2020-11-13 | 2023-04-04 | Qtech Innovations Llc | Game controller with scroll wheel |
CN113041605A (zh) * | 2021-04-22 | 2021-06-29 | 深圳市智旭科技有限公司 | 一种游戏手柄的功能键模组 |
US20230178056A1 (en) * | 2021-12-06 | 2023-06-08 | Arne Schulze | Handheld musical instrument with control buttons |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4469330A (en) * | 1982-01-07 | 1984-09-04 | Atari, Inc. | Controller unit for video game |
US5763804A (en) * | 1995-10-16 | 1998-06-09 | Harmonix Music Systems, Inc. | Real-time music creation |
US20010021668A1 (en) * | 1995-05-10 | 2001-09-13 | Genyo Takeda | Operating device for an image processing apparatus |
US6327367B1 (en) * | 1999-05-14 | 2001-12-04 | G. Scott Vercoe | Sound effects controller |
US6464585B1 (en) * | 1997-11-20 | 2002-10-15 | Nintendo Co., Ltd. | Sound generating device and video game device using the same |
Family Cites Families (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB1600170A (en) * | 1977-04-06 | 1981-10-14 | Texas Instruments Inc | Digital control system |
US6011212A (en) * | 1995-10-16 | 2000-01-04 | Harmonix Music Systems, Inc. | Real-time music creation |
JP2000189465A (ja) * | 1998-12-25 | 2000-07-11 | Matsushita Electric Ind Co Ltd | 電動車椅子 |
JP2004065826A (ja) * | 2002-08-09 | 2004-03-04 | Mikuni Makino Kogyo Kk | 電動車いすの走行操作装置 |
AU2003274939A1 (en) * | 2002-08-29 | 2004-03-19 | Dept. Of Veterans Affairs | Variable compliance joystick with compensation algorithms |
US20070080003A1 (en) * | 2005-10-11 | 2007-04-12 | Sunrise Medical Hhg, Inc. | Mode selection for wheelchairs |
US20070242042A1 (en) * | 2006-04-12 | 2007-10-18 | Honeywell International Inc. | Free standing joystick |
US20080223199A1 (en) * | 2007-03-16 | 2008-09-18 | Manfred Clynes | Instant Rehearseless Conducting |
KR20080100651A (ko) * | 2007-05-14 | 2008-11-19 | 학교법인 영광학원 | 장애인을 위한 컴퓨터 제어장치 |
GB2456542B (en) * | 2008-01-17 | 2009-12-16 | Karma Medical Prod Co Ltd | Controller structure for an electric wheelchair |
GB0901858D0 (en) * | 2009-02-05 | 2009-03-11 | Schoegler Benjaman W | Data input device and sound generating device |
US8344914B2 (en) * | 2009-12-23 | 2013-01-01 | Tzu-Yuan Yeh | Intelligent multi-axial intuitive joystick suitable for use by both left-handers and right-handers |
GB2506208A (en) * | 2012-09-25 | 2014-03-26 | Penny & Giles Controls Ltd | Control module for electric wheelchair |
US9069396B2 (en) * | 2013-03-12 | 2015-06-30 | Lightlab Imaging, Inc. | Controller and user interface device, systems, and methods |
US10108273B2 (en) * | 2016-03-07 | 2018-10-23 | Microsoft Technology Licensing, Llc | Movement space mapping for control sticks in user input devices |
TWI692707B (zh) * | 2016-04-29 | 2020-05-01 | 姚秉洋 | 操控裝置 |
US10088915B2 (en) * | 2016-07-01 | 2018-10-02 | Deere & Company | Method and system with sensors for sensing hand or finger positions for adjustable control |
US10969878B2 (en) * | 2017-08-20 | 2021-04-06 | Pixart Imaging Inc. | Joystick with light emitter and optical sensor within internal chamber |
IL259059A (en) * | 2018-04-30 | 2018-06-28 | Arcana Instr Ltd | A musical instrument with a joystick with variable voltage and a variable range of motion and a method of using it |
GB2574429B (en) * | 2018-06-06 | 2022-07-20 | Digit Music Ltd | Input device |
-
2018
- 2018-06-06 GB GB1809245.2A patent/GB2574429B/en active Active
-
2019
- 2019-06-05 WO PCT/GB2019/051560 patent/WO2019234424A1/en unknown
- 2019-06-05 US US16/972,313 patent/US11900903B2/en active Active
- 2019-06-05 EP EP19730499.1A patent/EP3803547B1/de active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4469330A (en) * | 1982-01-07 | 1984-09-04 | Atari, Inc. | Controller unit for video game |
US20010021668A1 (en) * | 1995-05-10 | 2001-09-13 | Genyo Takeda | Operating device for an image processing apparatus |
US5763804A (en) * | 1995-10-16 | 1998-06-09 | Harmonix Music Systems, Inc. | Real-time music creation |
US6464585B1 (en) * | 1997-11-20 | 2002-10-15 | Nintendo Co., Ltd. | Sound generating device and video game device using the same |
US6327367B1 (en) * | 1999-05-14 | 2001-12-04 | G. Scott Vercoe | Sound effects controller |
Also Published As
Publication number | Publication date |
---|---|
US11900903B2 (en) | 2024-02-13 |
GB201809245D0 (en) | 2018-07-25 |
EP3803547A1 (de) | 2021-04-14 |
GB2574429A (en) | 2019-12-11 |
EP3803547C0 (de) | 2024-08-07 |
EP3803547B1 (de) | 2024-08-07 |
US20210248984A1 (en) | 2021-08-12 |
GB2574429B (en) | 2022-07-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3803547B1 (de) | Eingabevorrichtung | |
US10783865B2 (en) | Ergonomic electronic musical instrument with pseudo-strings | |
US11011145B2 (en) | Input device with a variable tensioned joystick with travel distance for operating a musical instrument, and a method of use thereof | |
US7598449B2 (en) | Musical instrument | |
US20060123982A1 (en) | Wearable sensor matrix system for machine control | |
US8796529B2 (en) | Ergonomic electronic musical instrument with pseudo-strings | |
US6501011B2 (en) | Sensor array MIDI controller | |
US8242344B2 (en) | Method and apparatus for composing and performing music | |
JP2014523004A (ja) | 弦楽器と同様の装置を使用する弦楽器、システム及び方法 | |
MX2014000912A (es) | Dispositivo, método y sistema para producir música. | |
US20180350337A1 (en) | Electronic musical instrument with separate pitch and articulation control | |
US20190385577A1 (en) | Minimalist Interval-Based Musical Instrument | |
Wanderley et al. | On the choice of transducer technologies for specific musical functions | |
WO2008019089A2 (en) | Musical instrument | |
Vertegaal | An Evaluation of input devices for timbre space navigation | |
Schiesser et al. | On making and playing an electronically-augmented saxophone | |
WO2018159829A1 (ja) | 演奏支援装置及び方法 | |
Goudeseune | A violin controller for real-time audio synthesis | |
WO2024044720A2 (en) | Devices and methods for advanced musical instrument systems | |
Bernreiter et al. | Evaluating Dextoria-A modular, embedded system to control electric guitar effects via sound-producing gestures | |
JP3048217U (ja) | 携帯式楽譜読取装置 | |
Rothman | The Ghost: An Open-Source, User Programmable MIDI Performance Controller. | |
JP2012211954A (ja) | 楽曲データ入力装置 | |
Boulanger et al. | Developing a Windows and Macintosh Graphical User Interface for the Mathews Radio-Baton System. | |
Moroni et al. | InstrumentALL: a Virtual Instrument |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19730499 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2019730499 Country of ref document: EP Effective date: 20210111 |