EP2045796A1 - Portable chord output device, computer program and recording medium - Google Patents
Portable chord output device, computer program and recording medium Download PDFInfo
- Publication number
- EP2045796A1 EP2045796A1 EP07768354A EP07768354A EP2045796A1 EP 2045796 A1 EP2045796 A1 EP 2045796A1 EP 07768354 A EP07768354 A EP 07768354A EP 07768354 A EP07768354 A EP 07768354A EP 2045796 A1 EP2045796 A1 EP 2045796A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- chord
- sound
- produced
- manipulator
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000004590 computer program Methods 0.000 title claims description 7
- 238000004519 manufacturing process Methods 0.000 claims abstract description 56
- 230000007246 mechanism Effects 0.000 claims abstract description 43
- 230000015654 memory Effects 0.000 claims description 32
- 230000008859 change Effects 0.000 claims description 27
- 238000001514 detection method Methods 0.000 claims description 26
- 230000004044 response Effects 0.000 claims description 7
- 238000000034 method Methods 0.000 description 47
- 230000008569 process Effects 0.000 description 31
- 238000012545 processing Methods 0.000 description 28
- 230000006870 function Effects 0.000 description 21
- 230000003534 oscillatory effect Effects 0.000 description 19
- 210000003811 finger Anatomy 0.000 description 12
- 241001422033 Thestylus Species 0.000 description 9
- 230000002459 sustained effect Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 7
- 238000003825 pressing Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 4
- 230000010365 information processing Effects 0.000 description 3
- 241001342895 Chorus Species 0.000 description 2
- HAORKNGNJCEJBX-UHFFFAOYSA-N cyprodinil Chemical compound N=1C(C)=CC(C2CC2)=NC=1NC1=CC=CC=C1 HAORKNGNJCEJBX-UHFFFAOYSA-N 0.000 description 2
- 230000036651 mood Effects 0.000 description 2
- 238000011017 operating method Methods 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000002592 echocardiography Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000005562 fading Methods 0.000 description 1
- 244000144992 flock Species 0.000 description 1
- 210000004936 left thumb Anatomy 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000033001 locomotion Effects 0.000 description 1
- 238000004020 luminiscence type Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 210000004935 right thumb Anatomy 0.000 description 1
- 230000009291 secondary effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10G—REPRESENTATION OF MUSIC; RECORDING MUSIC IN NOTATION FORM; ACCESSORIES FOR MUSIC OR MUSICAL INSTRUMENTS NOT OTHERWISE PROVIDED FOR, e.g. SUPPORTS
- G10G7/00—Other auxiliary devices or accessories, e.g. conductors' batons or separate holders for resin or strings
- G10G7/02—Tuning forks or like devices
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/0008—Associated control or indicating means
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/36—Accompaniment arrangements
- G10H1/361—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
- G10H1/368—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems displaying animated or moving pictures synchronized with the music or audio part
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/36—Accompaniment arrangements
- G10H1/38—Chord
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/005—Non-interactive screen display of musical or status data
- G10H2220/011—Lyrics displays, e.g. for karaoke applications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/091—Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith
- G10H2220/096—Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith using a touch screen
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
- G10H2220/091—Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith
- G10H2220/101—Graphical user interface [GUI] specifically adapted for electrophonic musical instruments, e.g. interactive musical displays, musical instrument icons or menus; Details of user interactions therewith for graphical creation, edition or control of musical data or parameters
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2230/00—General physical, ergonomic or hardware implementation of electrophonic musical tools or instruments, e.g. shape or architecture
- G10H2230/005—Device type or category
- G10H2230/015—PDA [personal digital assistant] or palmtop computing devices used for musical purposes, e.g. portable music players, tablet computers, e-readers or smart phones in which mobile telephony functions need not be used
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2250/00—Aspects of algorithms or signal processing methods without intrinsic musical character, yet specifically adapted for or used in electrophonic musical processing
- G10H2250/541—Details of musical waveform synthesis, i.e. audio waveshape processing from individual wavetable samples, independently of their origin or of the sound they represent
- G10H2250/641—Waveform sampler, i.e. music samplers; Sampled music loop processing, wherein a loop is a sample of a performance that has been edited to repeat seamlessly without clicks or artifacts
Definitions
- This invention relates to a portable chord producing device and a related product that can simulate the chord timbres of real musical instruments such as guitars and pianos under the player's control.
- Electronic musical instrument devices that simulate the timbre of real musical instruments using electronics.
- Electronic musical instrument devices of the type described are made up of, for example, a housing that mimics the contours of a real musical instrument, a plurality of sensors, a sound producing unit and a control unit.
- the sensors are provided at positions where a player is to touch, and produce a predetermined data in response to a detection of a certain operation by the player.
- the control unit stores a program and a data for producing musical sounds. It generates a sound source data according to the sensor output (s) and makes a sound producing unit which includes a speaker produce it.
- Some electronic musical instrument devices have a display unit such as light-emitting elements or a display screen.
- an operating procedure is successively provided on the display unit, and the player operates the device and provides an input to the device according to the procedure, thereby to make the device produce musical sounds similar to those produced by a real musical instrument.
- some electronic musical instrument devices have lyrics appear on screen as in the case of "karaoke". More specifically, lyrics data which is associated with operation instruction data representing what the player should operate is stored on a memory within the device. When producing the lyrics data on the display unit, the operation instruction data is also produced thereon along with it, to link the display of the lyrics with what the player should operate.
- conventional electronic musical instrument devices have an advantage that musical sounds can be produced at low costs in place of expensive real musical instruments or karaokes.
- these electronic musical instrument devices can be operated easily to play even by a person who cannot play a real musical instrument when he or she can learn unique operating procedures of the device.
- chords using three notes are C, Dm, Em, F, G, Am, Bm, etc.
- Chords using four notes are Cmaj7, Dm7, Em7, Fmaj7, G7, Am7, Bm7flat5, etc.
- Some chords are triads or tetrads with an added note such as the note nine or eleven scale degrees from the root of a chord.
- chord forms to play a guitar depending on where to position your fingers on the fingerboard. That is, in the case of the C chord, the fingering at the low position is different from the fingering at the high position or the fingering at the middle position between them.
- chord data may previously be prepared and an expected configuration is that the device directs the player to provide operation inputs for the chords.
- the player is inconveniently required to learn details of the operation to produce chord sounds if this is intended to be achieved by using an electronic musical instrument device having no display screen.
- Even using an electronic musical instrument device having a display screen a lot of skill is required for the operation because an operation instruction for the chords should be entered according to the device-driven display progress.
- the operation instruction cannot be entered at a singer's own pace. Therefore, it is impossible to sing an identical song slowly or at a quick tempo depending on the mood at a given time. In addition, it is impossible to play a musical instrument and sing a song at the same time.
- An object of the present invention is to provide a portable chord producing device which a player can play easily and freely at his or her own pace anywhere, regardless of the level of his or her skill and which allows the player to play the device and sing a song at the same time and to accompany many fellows singing in chorus, under the player's control.
- a chord producing device has a housing of a portable size, the housing having a plurality of manipulators formed thereon each of which can be selected by a player with his or her finger of one hand, and a touch sensor formed therein or thereon which can be touched by the player directly with his or her finger of the other hand or indirectly, said housing including a data memory, a control mechanism, and a sound production mechanism, which are connected to each other, said data memory having a plurality of chord data files recorded thereon along with chord IDs for use in identifying chord sounds, the chord data file being for producing chord sounds that have characteristics of sounds on a real musical instrument, through said sound production mechanism, either one of said chord IDs being assigned to each of said plurality of manipulators.
- Said control mechanism comprises manipulator selection state detection means that detects which manipulator is being selected by the player and when he or she cancels the selection; specific operation detection means that detects details of the operation including the timing to start touching said touch sensor; and chord production control means adapted to read the chord data file identified by said chord ID that is assigned to the manipulator detected by said manipulator selection state detection means, from said data memory, to supply it to said sound production mechanism, and to let the chord sound that is made producible as a result of it be produced through said sound production mechanism in a manner that is associated with the details of the operation detected by said operation detection means.
- said specific operation detection means is for detecting, for example, in addition to said the timing to start touching, a direction of the touch operation to one of said touch sensors, a touch operation speed, and a touch operation position.
- said chord production control means lets a chord sound determined according to the detected direction or the detected speed be produced through said sound production mechanism when said direction of the touch operation or the touch operation speed is detected, changes an output frequency thereof depending on the change direction when a change in the subject direction of the touch operation is detected, changes an output intensity thereof depending on the speed of change when a change in touch operation speed is detected, and causes production in an output manner that is previously assigned to the detected position when said touch operation position is detected.
- Said chord data file is, for example, a data file obtained by means of recording chord sounds on a real musical instrument.
- the real musical instruments is a stringed musical instrument on which said chord sound is produced when a plurality of strings are strummed almost together.
- the chord producing device comprises a memory loading-and-unloading mechanism for use in removably connecting said data memory to said control mechanism and the sound production mechanism.
- This data memory has said data files recorded thereon for each of real musical instruments including said stringed musical instrument-using musical instrument.
- the data memory has an image data for use in presenting a musical composition consisted of a series of measures, each measure being associated with one or a plurality of said chord IDs that are assigned for the subject real musical instrument.
- said control mechanism further comprises display control means adapted to let a musical composition image for one or a plurality of measures be presented on a predetermined image display pane according to the image data for use in presenting said musical composition, and let a next musical composition image including one or a plurality of measures be presented on said image display pane in place of the musical composition image being presented when the chord data file identified on the basis of said chord ID that is associated with the measure (s) of the musical composition image being presented is produced through said sound production mechanism, and said control mechanism conducts change of presentation of the musical composition images on said image display pane in response to the selection of said manipulator and operation of said touch sensor by a player.
- the musical composition image presented on said image display pane accompanies, for example, at least one of a lyric of the subject musical composition, information which guides the timing of operating said touch sensor for producing a chord sound, and information which guides the generation of a chord sound on saidmusical instrument, which are assigned to the subj ect one or a plurality of measures.
- Said control mechanism may further comprise history recording means on which a progress log that keeps track of changing the presentation of said musical composition image, a selection log that keeps track of which said manipulator is selected for the presentation of said musical composition image, and a touch operation log for said touch sensor, are recorded in a mutually associated manner.
- the chord producing device having such a control mechanism is adapted to supply, in response to the input of an instruction from a player, said progress log out of the information recorded on said history recording means to said display control means, thereby to cause said display control means to reproduce the change in presentation of the musical composition image on said image display pane, and supply said selection log and said touch operation log to said chord production control means, thereby to cause said chord production control means to reproduce the production of a chord sound associated with said change in presentation and change in aspect thereof.
- Said data memory has a vibration image data recorded thereon that is for representing a sound vibration image
- said control mechanism may further comprise vibration image display control means adapted to let a vibration image file that is read from said data memory be presented on a vibration image display pane which is different from said image display pane, change the vibration image being presented according to the production of said chord sound, and stop it at the time point when the output intensity reaches zero.
- the present invention provides a computer program for use in causing a computer which is mounted in a housing of a portable size to be held with one hand to operate as a portable chord producing device.
- Said housing has a plurality of manipulators formed thereon each of which can be selected by a player with his or her finger of one hand, and a touch sensor formed therein or thereon which can be touched by the player directly with his or her finger of the other hand or indirectly,
- said computer being provided with a data memory and a sound production mechanism, said data memory having a plurality of chord data files recorded thereon along with chord IDs for use in identifying chord sounds, the chord data file being for producing chord sounds that have characteristics of sounds on a real musical instrument, through said sound production mechanism.
- the computer program causes said computer to work as: assigning means for assigning either one of said chord IDs to each of said plurality of manipulators; manipulator selection state detection means that detects which manipulator is being selected by the player and when he or she cancels the selection; specific operation detection means that detects details of the operation including the timing to start touching said touch sensor; and chord production control means adapted to read the chord data file identified by said chord ID that is assigned to the manipulator detected by said manipulator selection state detection means, from said data memory, to supply it to said sound production mechanism, and to let the chord sound that is made producible as a result of it be produced through said sound production mechanism in a manner that is associated with the details of the operation detected by said touch operation detection means.
- Such a computer program is recorded on a computer readable recording medium.
- Fig. 1 is a view illustrating a structure of a chord producing device according to this embodiment.
- (a) is a front elevation view
- (b) is an upper bottom view
- (c) is a lower bottom view.
- This chord producing device comprises a housing 10 having a size that allows for grasping with one hand.
- a memory card 20 can be removably contained within this housing 10.
- a display screen 11 which serves as a touch sensor panel is provided at or near the center of the housing 10.
- the display screen 11 (touch sensor panel) is a display panel made up of, for example, an LCD (Liquid Crystal Display) or an EL (Electronic Luminescence) covered with a touch sensor.
- the display screen 11 has a slight dent along its outer periphery relative to the surface of the housing 10 in order to allow for a player to trace the outer periphery with a stylus pen which is described below.
- the touch sensor may be either of resistive, optical (infrared) and capacitive coupled type.
- the display screen 11 transmits, to a control unit which will be described later, details of the operations including the timing to start touching by the stylus pen and the like, coordinates of the touched position, and change thereof, by means of touching such as pressing or stroking the top surface of the touch panel by using the tip of the stylus pen or a finger (hereinafter, also referred to as a "stylus pen and the like").
- the housing 10 has operation switches 121, 122 on the surf ace thereof and sound passage holes 141, 142 formed in the surface thereof, both at generally symmetrical positions with respect to the perpendicular bisector of a longitudinal side.
- the operation switch 121 serves as a digital joystick. It has eight manipulators. When a player holds down one of these manipulators, up to eight different data can selectively be entered only during the player's holding down of the manipulator. In other words, which manipulator is being selected by the player and when he or she cancels the selection can be detected by a control unit 40 which is described below.
- the operation switch 122 serves as a digital switch. It has eight terminal contacts and permits entering up to eight different data by means of holding down one of these eight terminal contacts.
- the operation switch 121 on the left side of the drawing is used as a directional switch across which the player can slide his or her left thumb from the center to one of the eight directions, i.e., 0 degrees , 45 degrees , 90 degrees , 135 degrees , 180 degrees , 225 degrees , 270 degrees, 315 degrees, and press in the switch there.
- the operation switch 122 on the right side of the drawing is used as a selection switch across which the player can slide his or her right thumb for selecting operation modes, optional functions, and other motions. The functions of these switches 121 and 122 can be reversed for use by both right-handed and left-handed players.
- both the operation switches 121, 122 may be configured for use as digital joysticks and a player may be allowed to determine which one of the operation switches is used as the directional switch and which one as the selection switch.
- the operation switch 122 does not necessarily have eight terminal contacts. Instead, two to four contacts may be shared.
- a power supply switch 15 is provided above the sound passage holes 141.
- a start switch 161 and a function switch 162 are provided above the sound passage holes 142. These switches 15, 161, 162 may be embodied as, for example, push buttons.
- the start switch 161 is pressed by the player to start (restart) or stop (pause) the operation.
- the function switch 162 is pressed to, for example, select menu items such as various preference settings and controls for chords production.
- a pair of extended operation switches 131, 132 is provided on the top surface of the housing 10 at generally symmetrical positions with respect to the perpendicular bisector of a longitudinal side.
- a holder space for a stylus pen 30 and a locking member 17 for the stylus pen 30 are provided at around the center.
- the extended operation switch 131 is for switching a group of eight directions which can be designated by using the operation switch 121, into a predetermined other group. It is provided at a position where the player can use with his or her left index finger or middle finger when the player holds the housing 10 in his or her left hand. Depending on whether the player holds down the extended operation switch 131 or not, up to sixteen directions can be directed by the control with only the left hand.
- the extended operation switch 132 can be used to switch a group of up to eight choices to be selected by using the operation switch 122, into another group. This means that the subject chord producing device can produce up to (16 x 8) different chord timbres.
- a slot space 18 for a memory card 20 is formed in the lower surface of the housing 10.
- An external output terminal 19 is also provided thereon for transmitting chord data produced from the chord producing device to an external amplifier to which a speaker is connected.
- the chord producing device comprises, within the housing 10, a control unit which is a kind of a computer and peripheral electronic components therefore.
- Fig. 2 shows an internal configuration diagram of the housing 10 and connections among various components.
- the control unit 40 shown in Fig. 2 has a connector 41 for allowing the memory card 20 to be contained in a removable manner, a CPU (Central Processing Unit) core 42 including a main processor, a RAM (Random Access Memory) 43 which functions as a cache memory, an SPU (Sound Processing Unit) 44 which performs sound processing, two GPUs (Graphic Processor Units) 451, 452 for image processing, a display controller 47 which allows production of images on two image panes 11a, 11b, and I/O (Input/Output) interface 48, all of which are connected to each other via an internal bus B1.
- a CPU Central Processing Unit
- RAM Random Access Memory
- SPU Sound Processing Unit
- GPUs GPUs
- I/O Input/Output
- the SPU 44 and the GPUs 451, 452 may be implemented by, for example, a single chip ASIC.
- the SPU 44 receives a sound command from the CPU core 42, and performs sound processing according to this sound command.
- the "sound processing" is, specifically, information processing in order to produce stereo chords that can be reproduced by each of the two sound producing units 241, 242.
- the GPUs 451, 452 receive a draw command from the CPU core 42 and generates an image data according to the draw command.
- the CPU core 42 supplies an instruction for image generation which is necessary for the generation of the image data to each of the GPUs 451, 452, in addition to the draw command.
- the content of the draw command from the CPU core 42 to each of the GPUs 451, 452 varies significantly depending on situations, so this will be described later.
- the two GPUs 451, 452 are each connected to VRAMs (Video Random Access Memories) 461, 462 to render the image data.
- VRAMs Video Random Access Memories
- the GPU 451 renders, into the VRAM 461, the image data to be presented on a first display pane 11a of the display screen 11.
- the GPU 452 renders, into the VRAM 462, the image data to be presented on a second display pane 11b of the display screen 11.
- the content of the image data will be described later.
- the display controller 47 reads the image data rendered into the VRAMs 461, 462 and performs a predetermined display control process.
- the display controller 47 includes a register.
- the register stores data values of "00", “01", “10", and "11" in response to the instruction from the CPU core 42.
- the data values are determined according to, for example, an instruction from the player selected through the function switch 162.
- the display controller 47 performs, for example, the following control depending on the data value in the register.
- the image data rendered into the VRAMs 461, 462 is not produced on each of the display panes 11a, 11b.
- the function switch 162 can be used to let this data value be produced onto the display controller 47.
- the second display pane 11b is the entire display pane for the display screen 11.
- the first display pane 11a is the entire display pane for the display screen 11.
- the display pane for the display screen 11 is divided into two pieces, i.e., the first display pane 11a and the second display pane 11b, and the image data rendered onto the VRAM 461 is produced on the first display pane 11a while the image data rendered onto the VRAM 462 is produced on the second display pane 11b.
- the memory card 20 has a ROM (Read Only Memory) 21 and an EEPROM (Electronically Erasable and Programmable Read Only Memory) 22 mounted thereon.
- a flash memory or other non-volatile memory may be used in place of the EEPROM.
- the ROM 21 and the EEPROM 22 are connected to each other via a bus (not shown), and the bus is joined to the internal bus B1 of the control unit 40 through the connector 41. With this, the CPU core 42, the SPU 44, and the GPUs 451, 452 can directly access to the ROM 21 and the EEPROM 22 in the memory card 20.
- the I/O interface 48 is supplied with press operation data from the aforementioned various switches 121, 122, 131, 132, 15, 161, and 162 and touch operation data from the display screen 11.
- the press operation data is a data indicating which one of the buttons the player pressed, while the touch operation data is a data indicating details of the touch operation by the player.
- the switches 121, 122, 131, 132, 15, 161, and 162 are activated, the corresponding data is supplied to the CPU core 42 via the I/O interface 48.
- chord data is supplied to the sound producing units 241, 242.
- the chord data is a sound data generated by the CPU core 42 and the SPU 44 which are cooperated with each other.
- the sound producing units 241, 242 amplify this sound data by using an amplifier and reproduce it through a speaker.
- the ROM 21 in the memory card 20 records various image data, chord data files and a program for producing chord timbres.
- the program for producing chord timbres is for establishing various functions to be used to make the control unit 40 operate as the chord producing device such as, for example, a function to detect the state of manipulator selection by the player, a function to detect details of the operation including the timing to start touching the touch sensor, a function to produce a chord sound associated with a manipulator in a manner that is associated with how the touch sensor has operated, and a history management function, and is carried out by the CPU core 42.
- the image data can be generally classified into a vibration image data for presenting sound vibration images, a musical composition image data for presenting musical composition images including lyrics, an initial display image data for presenting initialimages, and image data for various settings. Description is first made about these data.
- the vibration image data is a data for presenting vibration images that represent the attack of the notes during the time when the sound data is supplied from the control unit 40 to the sound producing units 241, 242.
- vibration images having three different amplitude values of "weak”, “moderate”, and “strong” can be presented.
- Fig. 3 shows presentation examples of these vibration images.
- Fig. 3 (a) is an initial vibration image 50.
- Vibration image 51 in Fig. 3(b) , a vibration image 52 in Fig. 3(c) , and a vibration image 53 in Fig. 3(d) represent amplitude values of the "moderate”, “strong", and “weak", respectively.
- the absolute value of the amplitude is actually varied at a frequency suitable for the timing of the sound production.
- the initial vibration image 50 and the vibration images 51, 52, 53 are presented on the display screen 11 when an oscillatory waveform mode which is described below is selected.
- the direction of the broken line indicates the direction along which the player touches and slides the stylus pen and the like across the display screen 11.
- the thickness of the broken line indicates the velocity (touch operation velocity) when the stylus pen and the like is touched. In practice, the broken line is not presented.
- Which one of the "moderate”, “strong”, and “weak” is active is determined by means of, for example, receiving detection data about details of the operation including the timing to start touching which is detected by the touch sensor of the display screen 11, coordinates of the touched position, and the speed of its variation, by the CPU core 42 through the I/O interface 48, and comparing these detection data with a predetermined reference data which is recorded on a table not shown.
- the representations of the vibration images are not limited to the three patterns of the "moderate”, “strong”, and “weak”. They may be represented in four or more patterns. Alternatively, a single vibration image data may be used to represent a plurality of amplitude values and frequencies by means of image processing.
- the musical composition image data is provided for every musical composition.
- Fig. 4 whish shows an example of a display image on the display screen 11, the musical composition image is made up of, for example, a continuous series of measures 61, music progress bar 62, a manipulator image 63 for a chord guide, and a guide image 64 which indicates fingering positions for each chord on a guitar, a real musical instrument.
- a lyric 611 and chord symbol indications 612 are provided near their corresponding measure 61. It should be noted that the timing information may also be provided for each measure in order to show the timing of operating manipulators, or the lyric 611 may be omitted. The minimum required is the chord symbol indications 612.
- Each measure is identified by using measure IDs, and each measure ID is associated with the data corresponding to the chord symbol indications 612, the manipulator image 63, and the guide image 64 as well as lyrics data.
- each chord symbol indication 612 is associated with a chord ID for use in identifying the subject chord.
- the musical composition image is selectively rendered onto the VRAM 462 by means of, for example, the GPU 452, and is presented on the second display pane 11b through the display controller 47.
- Fig. 5 is an example of a display image during a guidance mode which will be described later. Shown is an example where only the manipulator image 63 and the guide image 64 are read and presented along with the vibration image 51 shown in Fig. 3(b) .
- the initial display image data is an image to be presented on the display screen 11 when the power supply is turned on.
- the image data for settings is a data for presenting the images of the various switches 121, 122, 131, 132, 15, 161, and 162 as well as a screen on which functions assigned thereto are displayed. These image data are rendered onto the VRAM 462 by, for example, the GPU 452 when "set” is selected with the function switch 162, and are presented on the second display pane 11b through the display controller 47. During the "set" period, the display screen 11 provides what is presented on the second display pane 11b.
- Fig. 6 is an example of a screen through which a player can assign chords to the eight manipulators of the extended switch 131 (or overwrite the existing chord(s)).
- Fig. 7 is an example of a screen through which a player can check the current settings.
- the image data for settings can be presented by, for example, hitting the function switch 162 at a predetermined number of times.
- the upper left part of Fig. 6 shows an image of an arrangement of the manipulators to which up to eight different chords can be assigned that can be selected by using the operation switch 121 without holding down the extended switch 131.
- the upper right part shows an image of an arrangement of the manipulators to which up to eight different chords can be assigned that can be selected by using the operation switch 121 while holding down the extended switch 131.
- the table in the lower part represents an image to show the chords which can be assigned to each manipulator. The player selects a manipulator on the upper left or right in Fig.
- each of "music tune #1" to "music tune #4", and "user setting 1" to “user setting 4" is assigned to the eight manipulators of the selection switch 122 at default.
- the sixteen different chords shown in Fig. 6 are assigned to each of the "music tune #1" to "music tune #4". If the player wants to modify it, he or she can press the "edit” on the lower part of the screen shown in Fig. 6 and overwrite it according to the aforementioned procedure.
- Each of the "user setting 1" to "user setting 4" is for setting player's preferences through the display image as shown in Fig. 6 .
- Figs. 8(a) to (c) show the chords that can be selectively entered by using the operation switch 121 after being assigned (edited) as described above.
- the EEPROM 22 records the settings of the aforementioned chord ID for the manipulators, the settings for the operation modes after the initial screen has presented, and various pieces of history information.
- the operation modes in this embodiment are the following three: an oscillatory waveform mode, a guidance mode, and a karaoke mode.
- the oscillatory waveform mode is a mode during which the vibration images 50 to 53 in Figs. 3(a) to (d) are presented on the entire display screen 11.
- the guidance mode is the guidance mode is a mode during which the image as shown in Fig. 5 is presented on the entire display screen 11.
- the karaoke mode is a mode during which the image as shown in Fig. 4 is presented on the entire display screen 11. Details of these operation modes will be described later.
- the history information is made up of a data representing a progress log that keeps track of the presentation of the musical composition image, a selection log that keeps track of which manipulator is selected for the presentation of the musical composition image, and a touch operation log, a time instant data generated by each data, and a serial number data which is kept until it is erased.
- the time instant data is measured by using a timer which is not shown.
- the serial number data is numbered when the data representing the history is recorded.
- the chord data file recorded on the ROM 21 is not the one that is electronically created. Instead, it is a data file obtained when a so-called virtuoso player records the chord sounds actually produced on a guitar which is a real musical instrument.
- Each chord timbre is picked up in the direction from top to bottom of a guitar sound hole (the aforementioned first direction), from bottom to top (the aforementioned second direction), the "weak” (first level), the "moderate” (second level), and the “strong” (third level), and each is compiled as a single data file which is identified by the aforementioned chord ID and a lower file ID. Therefore, six files are prepared for a single chord (e.g., Am).
- a major reason why a plurality of data files are prepared for every single chord timbre is to prevent the tones of the real chord sounds from being changed as much as possible by means of reducing post-waveform processing as much as possible. Another reason lies to cause a secondary effect of increasing information processing by the CPU cure 42 and the SPU 44 or making it possible to achieve the function of producing chord sounds without requiring much processing capacity, by reducing the waveform processing.
- chord ID and the file ID are managed in a hierarchical manner by using a table which is not shown.
- Fig. 9 is a view illustrating the content of this table.
- the entry “c10100” is a chord ID for identifying the "Am”.
- File IDs "c101001” to “c101006” follows at a lower level.
- the "c101001” is a file ID for identifying the chord data file for the chord Am in the first direction (from top to bottom) at the level 1 (weak).
- the "c101006” is a file ID for identifying the chord data file for the chord Am in the second direction (from bottom to top) at the level 13 (strong).
- the IDs are assigned according to a similar rule.
- the chord producing device becomes operable when a player holds the housing 10 with his or her left hand, operates (presses/releases) the operation switch 121 and the like with his or her left hand finger, holds the stylus pen 30 with his or her right hand or merely with his or her finger(s), and touches the display screen 11 with the tip of the pen or the tip of his or her finger.
- the control unit 40 (the CPU core 42) accesses the ROM 21 in the memory card 20 and starts execution of the program for producing chords.
- the control unit 40 loads the data recorded on the ROM 21 and the EEPROM 22 in the memory card 20 as well as a part or all of the table onto the RAM 43. This completes the establishment of the operational environment for a player to play this device as a musical instrument.
- the control unit 40 Immediately after the power supply is turned on, the control unit 40 presents the initial screen on the entire display screen 11.
- the initial screen includes the options for the operation modes selected by the player.
- the control unit 40 switches the initial screen into an operation screen for the selected operation mode to perform a process under each operation mode.
- Fig. 10 is a procedure chart for the oscillatory waveform mode.
- the control unit 40 When the oscillatory waveform mode is selected, the control unit 40 presents an initial oscillatory waveform image on the entire display screen 11 (S101). This process is achieved by means of sending a draw command and an image data from the CPU core 42 to the GPU 451, and sending the aforementioned data value "10" to the display controller 47.
- the control unit 40 Upon sending that either one of the manipulators of the operation switch 121 (or along with the extended switch 131) is pressed by the player (S102: Yes), the control unit 40 reads the chord data file identified by the chord ID that is assigned to the subject manipulator from the RAM 43 or the ROM 21 and makes it be available for the sound processing by the SPU 44 (S103). At this time, no chord sound is produced.
- the control unit 40 reads the chorddata file identified by the chord ID that is assigned to that manipulator from the RAM 43 or the ROM 21 and makes it be available for the sound processing by the SPU 44 (S103).
- a chord sound is produced only during the time when the manipulator is pressed, and the production of the chord sound is stopped when the manipulator is released, so that the user can easily control the time interval during which the chord sound is produced.
- Various forms may be achieved such as other forms in which the SPU 44 is allowed to perform the sound processing until a predetermined period of time has passed after the manipulator is released (in this case, the sound may be muted and fade out after the manipulator is released).
- the control unit 40 Upon sensing the specific touch operation according to the output data supplied from the touch sensor (S104: Yes), the control unit 40 performs the sound processing for the chord data in a manner that is associated with the specific touch operation, to let the chord sound be produced (S105). If no specific touch operation is sensed (S104: No), the step S104 is repeated until the specific touch operation is sensed.
- direction the touch operation is made, is determined by means of detecting the direction in which the touch operation continues, triggered by the detection of the position where the touch operation is started.
- the touch operation speed is determined by means of detecting the amount of continuous touch operation per a unit period of time.
- the change in directions of operation is determined by, for example, pattern matching of the change in positions of the touch operation. In order to facilitate these detections, it is preferable that the position where the touch operation is started be temporarily stored on the RAM 43.
- a basic pattern is prepared that serves as an indicator for the pattern matching.
- the step S105 is achieved by means of selecting one of the chord data files illustrated in Fig. 9 according to the file ID, and sending it to the SPU 44.
- a chord sound is produced from the SPU 44 in the aforementioned manner, the amplitude value for the oscillatory waveform image being presented on the display screen 11 is varied (vibrated) depending on how the chord sound is produced such as the attack of the notes (level 1 to level 3) (S106).
- the process goes back to the process at the step S102 (S107:Yes). If the manipulator is not released (S107: No), the process at and after the step S106 is repeated (S108: No) until the level of the chord sound output reaches zero. This keeps providing sustained sound for a predetermined period of time. When the sustained sound disappears and the level of the chord sound output reaches zero, the process goes back to the step S102 (S108: Yes).
- the player in the oscillatory waveform mode, the player can operate the chord producing device while enjoying the sustained sound of the chords, looking at the oscillatory waveforms.
- the chord sounds are produced only through free and easy operations at a player's pace, so that it becomes easier to sing a song while at the same time playing the device unlike conventional electronic musical instrument devices.
- the player can accompany many fellows singing in chorus under the player's control.
- first chord sound first chord sound
- second chord sound another chord sound
- possible processes include: “as to the first chord sound, the first chord sound is muted (weakened until it disappears) and only the second chord sound is produced", “the first chord sound output is continued as in the case where no second chord sound is produced and it is combined with the second chord sound", “the first chord sound is made fade out and is combined with the second chord sound output”.
- FIGs. 11A and B an example is given for a process for each of the first and second chord sounds in which the first chord sound is produced and subsequently the second chord sound is produced.
- the control unit 40 when the oscillatory waveform mode is selected, the control unit 40 presents an initial oscillatory waveform image on the entire display screen 11 (T101). This process is achieved by means of sending a draw command and an image data from the CPU core 42 to the GPU 451, and sending the aforementioned data value "10" to the display controller 47.
- the control unit 40 Upon sending that either one of the manipulators of the operation switch 121 (or along with the extended switch 131) is pressed by the player (T102: Yes), the control unit 40, reads a first chord data file identified by the chord ID that is assigned to the subject manipulator from the RAM 43 or the ROM 21 and makes it be available for the sound processing by the SPU 44 (T103), only during the time when the manipulator is pressed, and during the time when it is required to produce a chord sound or sounds after the release of the manipulator in the case when two chord sounds are combined which will be described later. At this time, no first chord sound is produced.
- the control unit 40 Upon sensing the specific touch operation according to the output data supplied from the touch sensor (T104: Yes), the control unit 40 performs the sound processing for the first chord data in a manner that is associated with the specific touch operation, to let the first chord sound be produced (T105).
- the control unit 40 reads the chord data file identified by the chord ID that is assigned to the manipulator from the RAM 43 or the ROM 21 and makes it be available for the sound processing by the SPU 44 for each one of the channels.
- the control unit performs sound processing for the chord data based on an aspect which is associated with the specific touch operation to let the chord sound be produced.
- step T104 is repeated until the specific touch operation is sensed.
- the step T105 is achieved by means of selecting one of the chord data files illustrated in Fig. 9 according to the file ID, and sending it to the SPU 44.
- a chord sound is produced from the SPU 44 in the aforementioned manner, the amplitude value for the oscillatory waveform image being presented on the display screen 11 is varied (vibrated) depending on how the chord sound is produced such as the attack of the notes (level 1 to level 3) (T106).
- T107: No it is detected whether or not the chord output level is equal to zero. If it is equal to zero (T108: Yes), the process goes back to T102. If it is not equal to zero (T108: No), it is determined whether the touch operation is performed or not. If the touch operation is not performed (T109: No), the process goes back to T107.
- T109 If the touch operation is detected at T109 (T109: Yes), it is detected whether or not that touch operation is performed in the direction opposite to the direction of the touch operation performed at T104. If the touch operation is performed in the opposite direction (T110: Yes), the chord sound (second chord sound) corresponding to the touch operation in the opposite direction at T108 is produced through the channel B in addition to the first chord sound (in this example, the chord sound of the chord C that is produced through the touch operation in the first direction) producedthroughthechannelA. In this example, the touch operation is performed in the first direction for the C chord at T104, so that the touch operation performed in the second direction for the same C chord is detected, and the chord data associated with this can be read as the second chord sound, out of the chord data files that are recorded on the ROM 21. The control unit 40 performs the sound processing for this chord data, and let the second chord sound be produced (T111) and then the process goes to T106.
- Fig. 12 (a) shows an explanatory diagram for chord sounds that are produced through each of the channel A (in the figure, Ch.A) and the channel B (in the figure, Ch.B) in this case.
- the second chord sound is produced through the channel B, in addition to the first chord sound output through the channel A.
- the production of the second chord sound through the channel B does not affects the chord sound produced through the channel A.
- sustained sound is produced for the aforementioned predetermined period of time as in the case where no output is made through the channel B. Accordingly, in this case, the first chord sound produced through the channel A and the second chord sound produced through the channel B are mixed and come out through a speaker.
- the first chord sound and the second chord sound are mixed and produced as described above, so that the first chord sound is overlapped and produced with the second chord sound as in a case of the real musical instrument. This reduces the possibility of giving the user an acoustically unnatural feeling.
- the touch operation detected at T109 is not the touch operation performed in the direction opposite to the direction of the touch operation performed at T104, (T110: No), that is, when it is the touch operation performed in the same direction as in the touch operation at T104 for the identical chord, the corresponding chord, i.e., the C chord touched in the first direction in this example, is produced as the second chord sound through the channel B (T112), and the process goes to the step T106. Accordingly, the first chord sound produced through the channel A is the same chord sound as the second chord sound produced through the channel B.
- the time point when the touch operation in the direction same as the direction in the touch operation at T104 is detected is assumed to be to.
- the sound is caused to gradually become weaker from to and the volume is caused to reach zero at the time t 1 .
- the chord sound produced through the channel B has the lowest volume at to, gradually becomes higher in volume, and reaches a predetermined volume at the time point t 1 .
- the time duration from to to t 1 can be determined arbitrarily. In this example, it is equal to two thousandths of a second (0.002 seconds) so that it sounds natural to the user's ear.
- this time duration may appropriately be determined to be longer or shorter than 0.002 seconds.
- this time duration may be varied dynamically depending on, for example, the sound pitch, the force in the touch operation, and the interval between a given touch operation and the subsequent touch operation. This control can be performed by the SPU 44.
- cross-fade The technique that gradually fades out the sound on the channel A while fading in the sound on the channel B during a short period of time (in this example, about 0.002 seconds) is referred to as "cross-fade".
- a possible time lag between the time point when the output of the first chord sound is terminated and the time point when the second chord sound is produced can result in a time duration during which no sound is generated. Even if such a time lag can be eliminated, it sounds acoustically unnatural if there is no time duration during which the first and the second chord sounds are produced simultaneously.
- the cross-fade causes it to sound acoustically naturally.
- the sum of the volumes on the channels A and B may be controlled to always have a value that is the same as a volume value from the channel A at to.
- the sound produced through the channel B is controlled to have a higher volume so that the sum of the volumes on the channels A and B becomes larger than the volume value on the channel A at to.
- the sum of the volumes on the channels A and B is not limited specifically. It can be determined according to various procedures.
- T107 when the release of the manipulator is sensed, that is, when the operation is stopped or another manipulator is designated, it is determined whether or not another manipulator is pressed immediately after it and the touch operation is performed. It requires a certain amount of time for a user to release and press again the manipulator, and if operation is made within this time period, then it is considered that "the manipulator is pressed immediately after it". If another manipulator is pressed immediately after, and when the touch operation is performed (T113: Yes), the chord sound (second chord sound) associated with this manipulator and the direction of the touch operation are read from the chord data file recorded on the ROM 21, the first chord sound and the second chord sound are cross-faded as described above (T114), and the process goes back to the step T106. At T113, if another manipulator is pressed immediately after it, and when it is not determined that the touch operation is performed (T113: No), the process goes back to T102.
- T113 if another manipulator is pressed immediately after it, and when it is not determined that the touch operation
- chord sounds are produced which is closer to those on a real musical instrument by means of distinguishing the situation where the second chord sound has the same chord as the first chord sound but the direction of the touch operation (the direction of strumming with a stroke on a real musical instrument such as a guitar) is reversed and any other situations, to change the way for the chord output processing.
- first chord sound when the first chord sound is produced and subsequently the second chord sound is produced which is identical to the first one for the same chord notes in the same direction of the touch operation except for the attack of the notes, these two chord sounds are mixed. Otherwise, the first chord sound and the second chord sound are cross-faded before production. This achieves more natural chord sound production.
- chord producing devices In conventional chord producing devices, the necessity for the aforementioned distinguishment is not recognized, and the sounds are produced regardless of the types of the first chord sound and the subsequent second chord sound. Accordingly, a user would possibly feel that the produced chord sounds are acoustically unnatural. However, in this embodiment, such unnaturalness is overcome.
- ongoing echo effect processing can be performed that varies the tone quality of ongoing echoes of the chords by means of changing the direction of operation of the stylus pen and the like.
- Figs. 14(a) to (d) show examples where the stylus pen and the like is moved in the downward direction and then moved in the lateral direction.
- Figs. 14(e) to (h) show examples where it is moved in the upward direction and then moved in the lateral direction.
- the procedure for the processing by the control unit 40 under such operations is as shown in Fig. 15 . More specifically, when the change in direction of operation of the stylus pen and the like is detected (A101: Yes), and if it is in the right direction (A102: Yes), the pitch of the sustained sounds is narrowed before the production (A103). This slightly raises the frequency of the sustained sounds.
- the initial guidance image is an image obtained by replacing the vibration image 51 in Fig. 5 with the initial vibration image 50 shown in Fig. 3(a) , and is provided by means of sending the aforementioned data value "11" to the display controller 47.
- the control unit 40 Upon sensing a certain manipulator is pressed (B102: Yes), the control unit 40 reads the chord data file assigned to the manipulator as in the case of the oscillatory waveform mode and makes it be available for the sound processing (B103).
- the indication of the image associated with the chord that is assigned to the pressed manipulator is changed (B104). For example, as shown in Fig. 5 , the indication is changed so that the pressed manipulator becomes more noticeable than the other unpressed manipulators in order to allow a user to visually distinguish the pressed manipulator.
- the remaining operations are similar to those in the case of the oscillatory waveform mode. More specifically, upon sensing the touch operation (B105: Yes), the sound processing for the chord data is performed in a manner that is associated with the specific touch operation to let the chord sound be produced (B106). In addition, the amplitude value for the oscillatory waveform image being presented is varied (vibrated) depending on how the chord sound is produced (B107). When the manipulator is released, the process goes back to the step B102 (B108: Yes). If the manipulator is not released (B108: No), the process at and after the step B107 is repeated (B109: No) until the level of the chord sound output reaches zero. When the level of the chord sound output reaches zero, the process goes back to the step B102 (B109: Yes). This guidance mode facilitates the operation because operation can be done while looking at the manipulator image 63 and the guide image 64 for the chord guide.
- the musical composition image is presented (K101).
- the musical composition image may be, for example, as shown in Fig. 4 .
- the chord data file assigned to the manipulator is read as in the case of the oscillatory waveform mode, and is made available for the sound processing (K103).
- the indication of the image associated with the chord that is assigned to the pressed manipulator is changed (K104).
- the sound processing for the chord data is performed in a manner that is associated with the specific touch operation to let the chord sound be produced (K106).
- the amplitude value for the oscillatory waveform image being presented is varied (vibrated) depending on how the chord sound is produced.
- the musical composition image proceeds in a predetermined direction when the chord can be specified correctly.
- the current position on the progress bar 62 is varied depending on the status. When you want to sing slowly, it is enough to perform touch operations while specifying chords slowly. This makes it possible to conduct music for player's purpose rather than in a device-driven manner.
- wrong operation does not cause the musical composition image to proceed, so that the player can easily find where he or she made a mistake.
- the chord symbol indication 66 to be operated as in the case where the musical composition image is like the upper portion of Fig. 18 (in which the guide image 64 is omitted)
- the measure proceeds as shown in the middle portion of Fig. 18 .
- the chord is not specified according to the chord symbol indication 66 (failure)
- the musical composition image does not proceed.
- Fig. 19 shows an example of a display image on the display screen 11 presented when both mix and cross-fade are used depending on directions of operation for a manipulator by using a plurality of channels in the aforementioned example.
- the musical composition image is made up of, for example, bars 71 each having the length indicating the time interval between a given touch operation and a next touch operation (in the figure, individual bars 71 are represented as b1, b2, ... b12) and manipulator images 73 for the chord guide.
- a lyric 711 and a chord symbol indicator 722 are provided in appropriate areas in each bar 71.
- a timing symbol (represented by v in the figure) 714 indicating the touch operation in the downward direction and a timing symbol (represented by an inverted v in the figure) 715 indicating the touch operation in the upward direction are also presented.
- Each bar 71 in Fig. 19 has the length that indicates the time interval between a given touch operation and a next touch operation. Accordingly, a user can easily find the timing at which the touch operation should be performed and the direction of the touch operation (the direction of strokes on a real guitar), through the visual presentation by using the length of the bar 71 and the timing symbol(s).
- the touch operation is performed downward at same intervals from b1 to b9. The touch operation is performed upward at the head of bars b4 and b7, and downward at the head of other bars.
- the touch operation is performed in the downward direction at the head of the bar b10 and then the touch operation is performed in the upward direction after the elapse of the time that is half the past time. Since the bar b11 has a length 1.5 times as long as those of the bars b1 to b9, and the v is given as the timing symbol at the head of the bar b12, the touch operation is performed in the downward direction after the elapse of the time that is 1.5 times longer than the time for the bars b1 to b9.
- FIG. 4 is an example where an 8-way button is used as the manipulator
- this example uses a plus button as the manipulators for the chord producing device and is presented as a manipulator image 73.
- the bar b1 indicates that the chord C is selected by means of pressing the left of the manipulator (left of the plus button).
- the bar b3 indicates that the chord F is selected by means of pressing the right of the manipulator.
- the bar b6 indicates that the chord Dm7 is selected by means of pressing the top of the manipulator (top of the plus button).
- the bar b9 indicates that the chord G is selected by means of pressing the bottom of the manipulator (bottom of the plus button).
- the manipulator image 73 is not given in the remaining bars, which indicates that the previously-shown button is kept pressed. For example, in b2, the left portion of the manipulator that is pressed in b1 is kept pressed because the manipulator image 73 in b1 indicates that the left portion of the manipulator is pressed.
- each bar is associated with the chord symbol indication 712, the manipulator 73, and lyrics data like the measured ID in the example shown in Fig. 4 .
- each chord symbol indication 712 is associated with the chord ID which is used to identify the chord in question.
- the musical composition image is selectively rendered into the VRAM 462 by, for example, the GPU 452 and is presented on the second display pane 11b through the display controller 47.
- the control unit 40 has a function to track the steps a player takes.
- This function is mainly effective for the karaoke mode. More specifically, a progress log that keeps track of changing the presentation of the musical composition image, a selection log that keeps track of which manipulator is selected for the presentation of the musical composition image and a touch operation log that keeps track of a player' s touch to the display screen 11 are mutually associated and recorded on the EEPROM 22.
- the information recorded on the EEPROM 22 can be reproduced anytime in response to, for example, an instruction from the player.
- the progress log for the musical composition image can be reproduced by means of, for example, supplying it to the GPU 452.
- the manipulator selection log and the touch operation log can be reproduced by means of sending them to the SPU 44.
- This function is used when, for example, the player confirms the current capacity of his or her device or uses it as an "automatic karaoke".
- chord symbol indication 612 in Fig. 4 or the chord symbol indication 712 in Fig. 17 may be presented on the display screen 11 during the play.
- manipulator image 63 in Fig. 4 or the manipulator image 73 in Fig. 17 may be presented.
- the chord producing device is the size to be held with one hand and thus can be carried to anywhere.
- a chord sound is produced when the player holds the housing 10 with his or her left hand, operates the operation switch 121 with his or her left finger, and touch it with his or her right hand or a stylus pen.
- This is very easy and not always requires skill.
- the player can operate it at his or her own pace rather than being device-driven, so that the player can sing slowly or at a quick tempo depending on the mood at a given time. It is easy to play the device and sing a song at the same time.
- chord sounds are produced based on the actual timbres of a real musical instrument. Therefore, beginners and skilled players both can enjoy in their own way.
- control unit 40 may be configured to detect, as operations, the position of the touch operation as well as the timing to start touching, the direction of the touch operation, and the touch operation speed. More specifically, a chord symbol indication and a chord ID are previously assigned to a predetermined position of the touch operation. Then, it may be configured to function like the pressing operation for the operation switch 121 when a player selects a position of the chord symbol indication on the display screen 11.
- a wrong operation will also produce a chord sound in the karaoke mode.
- the corresponding chord sound may not be produced upon the wrong operation. This makes it possible to immediately determine any wrong operation.
- the vibration image and the like is presented on the first display pane 11a while the musical composition image and the like is presented on the second display pane 11b.
- these display panes may be changed appropriately.
- the first display pane 11a and the second pane 11b are switched to provide a single display screen 11.
- two display screens may be provided and one of the first display pane 11a and the second pane 11b may be provided on either one of these display screens, and another one of the first display pane 11a and the second pane 11b may be provided on the other one of these display screens.
- the present invention can also be applied to cases where chord sounds that simulate timbres of other musical instruments than a guitar, such as a piano are produced.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Electrophonic Musical Instruments (AREA)
- Auxiliary Devices For Music (AREA)
Abstract
Description
- This invention relates to a portable chord producing device and a related product that can simulate the chord timbres of real musical instruments such as guitars and pianos under the player's control.
- Development of sound processing and other information processing technologies has provided electronic musical instrument devices that simulate the timbre of real musical instruments using electronics. Electronic musical instrument devices of the type described are made up of, for example, a housing that mimics the contours of a real musical instrument, a plurality of sensors, a sound producing unit and a control unit. The sensors are provided at positions where a player is to touch, and produce a predetermined data in response to a detection of a certain operation by the player. The control unit stores a program and a data for producing musical sounds. It generates a sound source data according to the sensor output (s) and makes a sound producing unit which includes a speaker produce it.
- Some electronic musical instrument devices have a display unit such as light-emitting elements or a display screen. In such an electronic musical instrument device, an operating procedure is successively provided on the display unit, and the player operates the device and provides an input to the device according to the procedure, thereby to make the device produce musical sounds similar to those produced by a real musical instrument. In addition, some electronic musical instrument devices have lyrics appear on screen as in the case of "karaoke". More specifically, lyrics data which is associated with operation instruction data representing what the player should operate is stored on a memory within the device. When producing the lyrics data on the display unit, the operation instruction data is also produced thereon along with it, to link the display of the lyrics with what the player should operate.
- As apparent from the aforementioned example, conventional electronic musical instrument devices have an advantage that musical sounds can be produced at low costs in place of expensive real musical instruments or karaokes. In addition, these electronic musical instrument devices can be operated easily to play even by a person who cannot play a real musical instrument when he or she can learn unique operating procedures of the device.
- Music is not of the kind that cannot be enjoyed unless you can play a musical instrument well. Music is familiar. Taking a guitar as an example, you can enjoy music easily anywhere as long as you can play chords even when you cannot play melodies regardless of whether you are alone or in flocks. However, there are many different chords and it is hard to learn them. For example, chords using three notes are C, Dm, Em, F, G, Am, Bm, etc. Chords using four notes are Cmaj7, Dm7, Em7, Fmaj7, G7, Am7, Bm7flat5, etc. Some chords are triads or tetrads with an added note such as the note nine or eleven scale degrees from the root of a chord. Furthermore, you can use different chord forms to play a guitar depending on where to position your fingers on the fingerboard. That is, in the case of the C chord, the fingering at the low position is different from the fingering at the high position or the fingering at the middle position between them. Some attempts havebeenmadeto show proper fingering for these enormous amounts of chords on a piece of paper for each musical composition. However, paper products themselves are bulky and not easy for handling. In addition, usability is bad because it is necessary to flip pages in order to know a fingering position for a specific desired chord.
- In the aforementioned conventional electronic musical instrument device, chord data may previously be prepared and an expected configuration is that the device directs the player to provide operation inputs for the chords. However, the player is inconveniently required to learn details of the operation to produce chord sounds if this is intended to be achieved by using an electronic musical instrument device having no display screen. Even using an electronic musical instrument device having a display screen, a lot of skill is required for the operation because an operation instruction for the chords should be entered according to the device-driven display progress. In an electronic musical instrument device such as a karaoke, the operation instruction cannot be entered at a singer's own pace. Therefore, it is impossible to sing an identical song slowly or at a quick tempo depending on the mood at a given time. In addition, it is impossible to play a musical instrument and sing a song at the same time.
- In addition, in the conventional electronic musical instrument devices, only predetermined musical sounds are produced once the player has learned how to operate the device. Accordingly, skilled players are less and less attracted to the device and will eventually get bored.
- These problems are common not just to guitars but to small electronic musical instrument devices that electronically produce sounds of other real musical instruments such as a piano capable of producing the chord sounds.
- An object of the present invention is to provide a portable chord producing device which a player can play easily and freely at his or her own pace anywhere, regardless of the level of his or her skill and which allows the player to play the device and sing a song at the same time and to accompany many fellows singing in chorus, under the player's control.
- A chord producing device according to the present invention has a housing of a portable size, the housing having a plurality of manipulators formed thereon each of which can be selected by a player with his or her finger of one hand, and a touch sensor formed therein or thereon which can be touched by the player directly with his or her finger of the other hand or indirectly, said housing including a data memory, a control mechanism, and a sound production mechanism, which are connected to each other, said data memory having a plurality of chord data files recorded thereon along with chord IDs for use in identifying chord sounds, the chord data file being for producing chord sounds that have characteristics of sounds on a real musical instrument, through said sound production mechanism, either one of said chord IDs being assigned to each of said plurality of manipulators.
- Said control mechanism comprises manipulator selection state detection means that detects which manipulator is being selected by the player and when he or she cancels the selection; specific operation detection means that detects details of the operation including the timing to start touching said touch sensor; and chord production control means adapted to read the chord data file identified by said chord ID that is assigned to the manipulator detected by said manipulator selection state detection means, from said data memory, to supply it to said sound production mechanism, and to let the chord sound that is made producible as a result of it be produced through said sound production mechanism in a manner that is associated with the details of the operation detected by said operation detection means.
- In the chord producing device according to the present invention, said specific operation detection means is for detecting, for example, in addition to said the timing to start touching, a direction of the touch operation to one of said touch sensors, a touch operation speed, and a touch operation position. In this case, said chord production control means lets a chord sound determined according to the detected direction or the detected speed be produced through said sound production mechanism when said direction of the touch operation or the touch operation speed is detected, changes an output frequency thereof depending on the change direction when a change in the subject direction of the touch operation is detected, changes an output intensity thereof depending on the speed of change when a change in touch operation speed is detected, and causes production in an output manner that is previously assigned to the detected position when said touch operation position is detected.
- Said chord data file is, for example, a data file obtained by means of recording chord sounds on a real musical instrument. The real musical instruments is a stringed musical instrument on which said chord sound is produced when a plurality of strings are strummed almost together. By using such data files, it is possible to produce chord sounds having characteristics very close to those on a real musical instrument.
- In a certain aspect, the chord producing device comprises a memory loading-and-unloading mechanism for use in removably connecting said data memory to said control mechanism and the sound production mechanism. This data memory has said data files recorded thereon for each of real musical instruments including said stringed musical instrument-using musical instrument. In addition, the data memory has an image data for use in presenting a musical composition consisted of a series of measures, each measure being associated with one or a plurality of said chord IDs that are assigned for the subject real musical instrument. In the chord producing device that allows access to such a data memory, said control mechanism further comprises display control means adapted to let a musical composition image for one or a plurality of measures be presented on a predetermined image display pane according to the image data for use in presenting said musical composition, and let a next musical composition image including one or a plurality of measures be presented on said image display pane in place of the musical composition image being presented when the chord data file identified on the basis of said chord ID that is associated with the measure (s) of the musical composition image being presented is produced through said sound production mechanism, and said control mechanism conducts change of presentation of the musical composition images on said image display pane in response to the selection of said manipulator and operation of said touch sensor by a player.
- This makes it possible to advance the musical composition image under the player' s control rather than being device-driven.
- The musical composition image presented on said image display pane accompanies, for example, at least one of a lyric of the subject musical composition, information which guides the timing of operating said touch sensor for producing a chord sound, and information which guides the generation of a chord sound on saidmusical instrument, which are assigned to the subj ect one or a plurality of measures.
- Said control mechanism may further comprise history recording means on which a progress log that keeps track of changing the presentation of said musical composition image, a selection log that keeps track of which said manipulator is selected for the presentation of said musical composition image, and a touch operation log for said touch sensor, are recorded in a mutually associated manner. The chord producing device having such a control mechanism is adapted to supply, in response to the input of an instruction from a player, said progress log out of the information recorded on said history recording means to said display control means, thereby to cause said display control means to reproduce the change in presentation of the musical composition image on said image display pane, and supply said selection log and said touch operation log to said chord production control means, thereby to cause said chord production control means to reproduce the production of a chord sound associated with said change in presentation and change in aspect thereof.
- Said data memory has a vibration image data recorded thereon that is for representing a sound vibration image, and said control mechanism may further comprise vibration image display control means adapted to let a vibration image file that is read from said data memory be presented on a vibration image display pane which is different from said image display pane, change the vibration image being presented according to the production of said chord sound, and stop it at the time point when the output intensity reaches zero.
- The present invention provides a computer program for use in causing a computer which is mounted in a housing of a portable size to be held with one hand to operate as a portable chord producing device. Said housing has a plurality of manipulators formed thereon each of which can be selected by a player with his or her finger of one hand, and a touch sensor formed therein or thereon which can be touched by the player directly with his or her finger of the other hand or indirectly, said computer being provided with a data memory and a sound production mechanism, said data memory having a plurality of chord data files recorded thereon along with chord IDs for use in identifying chord sounds, the chord data file being for producing chord sounds that have characteristics of sounds on a real musical instrument, through said sound production mechanism. In such a thing, the computer program according to the present invention causes said computer to work as: assigning means for assigning either one of said chord IDs to each of said plurality of manipulators; manipulator selection state detection means that detects which manipulator is being selected by the player and when he or she cancels the selection; specific operation detection means that detects details of the operation including the timing to start touching said touch sensor; and chord production control means adapted to read the chord data file identified by said chord ID that is assigned to the manipulator detected by said manipulator selection state detection means, from said data memory, to supply it to said sound production mechanism, and to let the chord sound that is made producible as a result of it be produced through said sound production mechanism in a manner that is associated with the details of the operation detected by said touch operation detection means. Such a computer program is recorded on a computer readable recording medium.
-
-
Fig. 1 is a view illustrating a structure showing an example of an embodiment of a chord producing device according to the present invention, in which (a) is a front elevation view, (b) is an upper bottom view, and (c) is a lower bottom view; -
Fig. 2 is an internal configuration diagram of the housing and a connection diagram of various components; - in
Fig. 3, (a), (b), (c), and (d) are examples of an initial vibration image, a vibration image for a "moderate" level, a vibration image for a "strong" level, and a vibration image for a "weak" level, respectively; -
Fig. 4 is a display image showing an example of a musical composition image; -
Fig. 5 is a display image showing an example of a guidance image; -
Fig. 6 is an example of a screen through which a player can assign chords to the eight manipulators of an operation switch and an extended switch (or overwrite the existing chord(s)); -
Fig. 7 is an example of a screen through which a player can check the current settings; - in
Fig. 8, (a) to (c) are views showing the chords that can be selectively entered by using the operation switch after being assigned (edited); -
Fig. 9 is a view illustrating the content of a table for use in managing chord IDs and file IDs; -
Fig. 10 is a procedure chart for an oscillatory waveform mode; -
Fig. 11A is a procedure chart showing an example of a process for each of first and second chord sounds when the first chord sound is produced and subsequently the second chord sound is produced; -
Fig. 11B is a procedure chart showing an example of a process for each of first and second chord sounds when the first chord sound is produced and subsequently the second chord sound is produced; - in
Fig. 12, (a) to (c) are explanatory diagrams for chord sounds that are produced through each of channels A and B; - in
Fig. 13, (a) is an explanatory diagram showing an output transition of a chord sound produced through a channel A , (b) is an explanatory diagram showing an output transition of a chord sound produced through a channel B; - in
Fig. 14, (a) to (d) show examples where a stylus pen and the like is moved in the downward direction and then moved in the lateral direction, (e) to (h) show examples where it is moved in the upward direction and then moved in the lateral direction; -
Fig. 15 is a procedure chart for ongoing echo effect processing; -
Fig. 16 is a procedure chart in a guidance mode; -
Fig. 17 is a procedure chart in a karaoke mode; -
Fig. 18 is a view showing a difference in screens presented when succeeded and when failed in a karaoke mode; and -
Fig. 19 shows an example of a display image on adisplay screen 11 presented when both mix and cross-fade are used depending on directions of operation for a manipulator by using a plurality of channels. - Now, an example of an embodiment is described for a case where the present invention is applied to a chord producing device that produces the chord sounds of an acoustic guitar.
-
Fig. 1 is a view illustrating a structure of a chord producing device according to this embodiment. (a) is a front elevation view, (b) is an upper bottom view, and (c) is a lower bottom view. This chord producing device comprises ahousing 10 having a size that allows for grasping with one hand. Amemory card 20 can be removably contained within thishousing 10. - A
display screen 11 which serves as a touch sensor panel is provided at or near the center of thehousing 10. The display screen 11 (touch sensor panel) is a display panel made up of, for example, an LCD (Liquid Crystal Display) or an EL (Electronic Luminescence) covered with a touch sensor. Thedisplay screen 11 has a slight dent along its outer periphery relative to the surface of thehousing 10 in order to allow for a player to trace the outer periphery with a stylus pen which is described below. The touch sensor may be either of resistive, optical (infrared) and capacitive coupled type. Thedisplay screen 11 transmits, to a control unit which will be described later, details of the operations including the timing to start touching by the stylus pen and the like, coordinates of the touched position, and change thereof, by means of touching such as pressing or stroking the top surface of the touch panel by using the tip of the stylus pen or a finger (hereinafter, also referred to as a "stylus pen and the like"). - The
housing 10 has operation switches 121, 122 on the surf ace thereof and sound passage holes 141, 142 formed in the surface thereof, both at generally symmetrical positions with respect to the perpendicular bisector of a longitudinal side. Theoperation switch 121 serves as a digital joystick. It has eight manipulators. When a player holds down one of these manipulators, up to eight different data can selectively be entered only during the player's holding down of the manipulator. In other words, which manipulator is being selected by the player and when he or she cancels the selection can be detected by acontrol unit 40 which is described below. Theoperation switch 122 serves as a digital switch. It has eight terminal contacts and permits entering up to eight different data by means of holding down one of these eight terminal contacts. - In this embodiment, the
operation switch 121 on the left side of the drawing is used as a directional switch across which the player can slide his or her left thumb from the center to one of the eight directions, i.e., 0 degrees , 45 degrees , 90 degrees , 135 degrees , 180 degrees , 225 degrees , 270 degrees, 315 degrees, and press in the switch there. On the other hand, theoperation switch 122 on the right side of the drawing is used as a selection switch across which the player can slide his or her right thumb for selecting operation modes, optional functions, and other motions. The functions of theseswitches - It should be noted that both the operation switches 121, 122 may be configured for use as digital joysticks and a player may be allowed to determine which one of the operation switches is used as the directional switch and which one as the selection switch. In addition, the
operation switch 122 does not necessarily have eight terminal contacts. Instead, two to four contacts may be shared. - A
power supply switch 15 is provided above the sound passage holes 141. Astart switch 161 and afunction switch 162 are provided above the sound passage holes 142. Theseswitches start switch 161 is pressed by the player to start (restart) or stop (pause) the operation. Thefunction switch 162 is pressed to, for example, select menu items such as various preference settings and controls for chords production. - A pair of extended operation switches 131, 132 is provided on the top surface of the
housing 10 at generally symmetrical positions with respect to the perpendicular bisector of a longitudinal side. A holder space for astylus pen 30 and a lockingmember 17 for thestylus pen 30 are provided at around the center. Theextended operation switch 131 is for switching a group of eight directions which can be designated by using theoperation switch 121, into a predetermined other group. It is provided at a position where the player can use with his or her left index finger or middle finger when the player holds thehousing 10 in his or her left hand. Depending on whether the player holds down theextended operation switch 131 or not, up to sixteen directions can be directed by the control with only the left hand. The same applies to theextended operation switch 132 and theoperation switch 122. That is, theextended operation switch 132 can be used to switch a group of up to eight choices to be selected by using theoperation switch 122, into another group. This means that the subject chord producing device can produce up to (16 x 8) different chord timbres. - A
slot space 18 for amemory card 20 is formed in the lower surface of thehousing 10. Anexternal output terminal 19 is also provided thereon for transmitting chord data produced from the chord producing device to an external amplifier to which a speaker is connected. - The chord producing device according to this embodiment comprises, within the
housing 10, a control unit which is a kind of a computer and peripheral electronic components therefore. -
Fig. 2 shows an internal configuration diagram of thehousing 10 and connections among various components. - The
control unit 40 shown inFig. 2 has aconnector 41 for allowing thememory card 20 to be contained in a removable manner, a CPU (Central Processing Unit)core 42 including a main processor, a RAM (Random Access Memory) 43 which functions as a cache memory, an SPU (Sound Processing Unit) 44 which performs sound processing, two GPUs (Graphic Processor Units) 451, 452 for image processing, adisplay controller 47 which allows production of images on twoimage panes interface 48, all of which are connected to each other via an internal bus B1. - The
SPU 44 and theGPUs SPU 44 receives a sound command from theCPU core 42, and performs sound processing according to this sound command. The "sound processing" is, specifically, information processing in order to produce stereo chords that can be reproduced by each of the twosound producing units GPUs CPU core 42 and generates an image data according to the draw command. TheCPU core 42 supplies an instruction for image generation which is necessary for the generation of the image data to each of theGPUs CPU core 42 to each of theGPUs - The two
GPUs GPU 451 renders, into theVRAM 461, the image data to be presented on afirst display pane 11a of thedisplay screen 11. On the other hand, theGPU 452 renders, into theVRAM 462, the image data to be presented on asecond display pane 11b of thedisplay screen 11. The content of the image data will be described later. - The
display controller 47 reads the image data rendered into theVRAMs display controller 47 includes a register. The register stores data values of "00", "01", "10", and "11" in response to the instruction from theCPU core 42. The data values are determined according to, for example, an instruction from the player selected through thefunction switch 162. Thedisplay controller 47 performs, for example, the following control depending on the data value in the register. - Data Value "00" ... the image data rendered into the
VRAMs display panes display screen 11, thefunction switch 162 can be used to let this data value be produced onto thedisplay controller 47. - Data Value "01" ... only the image data rendered onto the
VRAM 462 is produced on thesecond display pane 11b. Thesecond display pane 11b is the entire display pane for thedisplay screen 11. - Data Value "10" ... only the image data rendered onto the
VRAM 461 is produced on thefirst display pane 11a. Thefirst display pane 11a is the entire display pane for thedisplay screen 11. - Data Value "11" ... the display pane for the
display screen 11 is divided into two pieces, i.e., thefirst display pane 11a and thesecond display pane 11b, and the image data rendered onto theVRAM 461 is produced on thefirst display pane 11a while the image data rendered onto theVRAM 462 is produced on thesecond display pane 11b. - The
memory card 20 has a ROM (Read Only Memory) 21 and an EEPROM (Electronically Erasable and Programmable Read Only Memory) 22 mounted thereon. A flash memory or other non-volatile memory may be used in place of the EEPROM. TheROM 21 and theEEPROM 22 are connected to each other via a bus (not shown), and the bus is joined to the internal bus B1 of thecontrol unit 40 through theconnector 41. With this, theCPU core 42, theSPU 44, and theGPUs ROM 21 and theEEPROM 22 in thememory card 20. - The I/
O interface 48 is supplied with press operation data from the aforementionedvarious switches display screen 11. The press operation data is a data indicating which one of the buttons the player pressed, while the touch operation data is a data indicating details of the touch operation by the player. When theswitches CPU core 42 via the I/O interface 48. From the I/O interface 48, chord data is supplied to thesound producing units CPU core 42 and theSPU 44 which are cooperated with each other. Thesound producing units - The
ROM 21 in thememory card 20 records various image data, chord data files and a program for producing chord timbres. The program for producing chord timbres is for establishing various functions to be used to make thecontrol unit 40 operate as the chord producing device such as, for example, a function to detect the state of manipulator selection by the player, a function to detect details of the operation including the timing to start touching the touch sensor, a function to produce a chord sound associated with a manipulator in a manner that is associated with how the touch sensor has operated, and a history management function, and is carried out by theCPU core 42. - The image data can be generally classified into a vibration image data for presenting sound vibration images, a musical composition image data for presenting musical composition images including lyrics, an initial display image data for presenting initialimages, and image data for various settings. Description is first made about these data.
- The vibration image data is a data for presenting vibration images that represent the attack of the notes during the time when the sound data is supplied from the
control unit 40 to thesound producing units Fig. 3 shows presentation examples of these vibration images.Fig. 3 (a) is aninitial vibration image 50.Vibration image 51 inFig. 3(b) , avibration image 52 inFig. 3(c) , and avibration image 53 inFig. 3(d) represent amplitude values of the "moderate", "strong", and "weak", respectively. Using these amplitude values as the maximum absolute values, the absolute value of the amplitude is actually varied at a frequency suitable for the timing of the sound production. - The
initial vibration image 50 and thevibration images display screen 11 when an oscillatory waveform mode which is described below is selected. InFigs. 3(b) to (d) , the direction of the broken line indicates the direction along which the player touches and slides the stylus pen and the like across thedisplay screen 11. The thickness of the broken line indicates the velocity (touch operation velocity) when the stylus pen and the like is touched. In practice, the broken line is not presented. Which one of the "moderate", "strong", and "weak" is active is determined by means of, for example, receiving detection data about details of the operation including the timing to start touching which is detected by the touch sensor of thedisplay screen 11, coordinates of the touched position, and the speed of its variation, by theCPU core 42 through the I/O interface 48, and comparing these detection data with a predetermined reference data which is recorded on a table not shown. - The representations of the vibration images are not limited to the three patterns of the "moderate", "strong", and "weak". They may be represented in four or more patterns. Alternatively, a single vibration image data may be used to represent a plurality of amplitude values and frequencies by means of image processing.
- The musical composition image data is provided for every musical composition. Referring to
Fig. 4 whish shows an example of a display image on thedisplay screen 11, the musical composition image is made up of, for example, a continuous series ofmeasures 61,music progress bar 62, amanipulator image 63 for a chord guide, and aguide image 64 which indicates fingering positions for each chord on a guitar, a real musical instrument. Alyric 611 andchord symbol indications 612 are provided near theircorresponding measure 61. It should be noted that the timing information may also be provided for each measure in order to show the timing of operating manipulators, or thelyric 611 may be omitted. The minimum required is thechord symbol indications 612. Each measure is identified by using measure IDs, and each measure ID is associated with the data corresponding to thechord symbol indications 612, themanipulator image 63, and theguide image 64 as well as lyrics data. In addition, eachchord symbol indication 612 is associated with a chord ID for use in identifying the subject chord. - The musical composition image is selectively rendered onto the
VRAM 462 by means of, for example, theGPU 452, and is presented on thesecond display pane 11b through thedisplay controller 47. - Only a part of the musical composition image data can be read and presented. For example,
Fig. 5 is an example of a display image during a guidance mode which will be described later. Shown is an example where only themanipulator image 63 and theguide image 64 are read and presented along with thevibration image 51 shown inFig. 3(b) . - The initial display image data is an image to be presented on the
display screen 11 when the power supply is turned on. - The image data for settings is a data for presenting the images of the
various switches VRAM 462 by, for example, theGPU 452 when "set" is selected with thefunction switch 162, and are presented on thesecond display pane 11b through thedisplay controller 47. During the "set" period, thedisplay screen 11 provides what is presented on thesecond display pane 11b. - For example,
Fig. 6 is an example of a screen through which a player can assign chords to the eight manipulators of the extended switch 131 (or overwrite the existing chord(s)).Fig. 7 is an example of a screen through which a player can check the current settings. The image data for settings can be presented by, for example, hitting thefunction switch 162 at a predetermined number of times. - The upper left part of
Fig. 6 shows an image of an arrangement of the manipulators to which up to eight different chords can be assigned that can be selected by using theoperation switch 121 without holding down theextended switch 131. The upper right part shows an image of an arrangement of the manipulators to which up to eight different chords can be assigned that can be selected by using theoperation switch 121 while holding down theextended switch 131. The table in the lower part represents an image to show the chords which can be assigned to each manipulator. The player selects a manipulator on the upper left or right inFig. 6 by using theselection switch 122, presses the "assign" button, determines, by using theselection switch 122, the chord to be selectively entered with the manipulator in question, and again presses the "assign" on the lower part ofFig. 6 . This is repeated. As a result, the settings are recorded on theEEPROM 22 in thememory card 20, are read upon the startup of the device, and chord IDs are assigned to the manipulators of theoperation switch 121. The order of assigning the settings may be discretionary, and the order of the selection of the manipulator and the selection of the chord may be reversed from those described above. - Referring to
Fig. 7 , each of "music tune # 1" to "music tune # 4", and "user setting 1" to "user setting 4" is assigned to the eight manipulators of theselection switch 122 at default. The sixteen different chords shown inFig. 6 are assigned to each of the "music tune # 1" to "music tune # 4". If the player wants to modify it, he or she can press the "edit" on the lower part of the screen shown inFig. 6 and overwrite it according to the aforementioned procedure. Each of the "user setting 1" to "user setting 4" is for setting player's preferences through the display image as shown inFig. 6 . -
Figs. 8(a) to (c) show the chords that can be selectively entered by using theoperation switch 121 after being assigned (edited) as described above. - The
EEPROM 22 records the settings of the aforementioned chord ID for the manipulators, the settings for the operation modes after the initial screen has presented, and various pieces of history information. The operation modes in this embodiment are the following three: an oscillatory waveform mode, a guidance mode, and a karaoke mode. The oscillatory waveform mode is a mode during which thevibration images 50 to 53 inFigs. 3(a) to (d) are presented on theentire display screen 11. The guidance mode is the guidance mode is a mode during which the image as shown inFig. 5 is presented on theentire display screen 11. The karaoke mode is a mode during which the image as shown inFig. 4 is presented on theentire display screen 11. Details of these operation modes will be described later. - The history information is made up of a data representing a progress log that keeps track of the presentation of the musical composition image, a selection log that keeps track of which manipulator is selected for the presentation of the musical composition image, and a touch operation log, a time instant data generated by each data, and a serial number data which is kept until it is erased. The time instant data is measured by using a timer which is not shown. The serial number data is numbered when the data representing the history is recorded.
- The chord data file recorded on the
ROM 21 is not the one that is electronically created. Instead, it is a data file obtained when a so-called virtuoso player records the chord sounds actually produced on a guitar which is a real musical instrument. Each chord timbre is picked up in the direction from top to bottom of a guitar sound hole (the aforementioned first direction), from bottom to top (the aforementioned second direction), the "weak" (first level), the "moderate" (second level), and the "strong" (third level), and each is compiled as a single data file which is identified by the aforementioned chord ID and a lower file ID. Therefore, six files are prepared for a single chord (e.g., Am). - A major reason why a plurality of data files are prepared for every single chord timbre is to prevent the tones of the real chord sounds from being changed as much as possible by means of reducing post-waveform processing as much as possible. Another reason lies to cause a secondary effect of increasing information processing by the
CPU cure 42 and theSPU 44 or making it possible to achieve the function of producing chord sounds without requiring much processing capacity, by reducing the waveform processing. - The chord ID and the file ID are managed in a hierarchical manner by using a table which is not shown.
Fig. 9 is a view illustrating the content of this table. The entry "c10100" is a chord ID for identifying the "Am". File IDs "c101001" to "c101006" follows at a lower level. The "c101001" is a file ID for identifying the chord data file for the chord Am in the first direction (from top to bottom) at the level 1 (weak). The "c101006" is a file ID for identifying the chord data file for the chord Am in the second direction (from bottom to top) at the level 13 (strong). For the other chord IDs and file IDs, the IDs are assigned according to a similar rule. - Next, an operation of the chord producing device that is configured as described above is described.
- For example, the chord producing device becomes operable when a player holds the
housing 10 with his or her left hand, operates (presses/releases) theoperation switch 121 and the like with his or her left hand finger, holds thestylus pen 30 with his or her right hand or merely with his or her finger(s), and touches thedisplay screen 11 with the tip of the pen or the tip of his or her finger. - When the player turns on the
power supply switch 15 with thememory card 20 mounted into thehousing 10, the control unit 40 (the CPU core 42) accesses theROM 21 in thememory card 20 and starts execution of the program for producing chords. In addition, thecontrol unit 40 loads the data recorded on theROM 21 and theEEPROM 22 in thememory card 20 as well as a part or all of the table onto theRAM 43. This completes the establishment of the operational environment for a player to play this device as a musical instrument. - Immediately after the power supply is turned on, the
control unit 40 presents the initial screen on theentire display screen 11. The initial screen includes the options for the operation modes selected by the player. When the player selects one of the aforementioned oscillatory waveform mode, the guidance mode, and the karaoke mode through thefunction key 162, and presses thestart button 161, thecontrol unit 40 switches the initial screen into an operation screen for the selected operation mode to perform a process under each operation mode. Now, referring toFigs. 10 to 15 , operation procedures for the respective operation modes are described. -
Fig. 10 is a procedure chart for the oscillatory waveform mode. - When the oscillatory waveform mode is selected, the
control unit 40 presents an initial oscillatory waveform image on the entire display screen 11 (S101). This process is achieved by means of sending a draw command and an image data from theCPU core 42 to theGPU 451, and sending the aforementioned data value "10" to thedisplay controller 47. - Upon sending that either one of the manipulators of the operation switch 121 (or along with the extended switch 131) is pressed by the player (S102: Yes), the
control unit 40 reads the chord data file identified by the chord ID that is assigned to the subject manipulator from theRAM 43 or theROM 21 and makes it be available for the sound processing by the SPU 44 (S103). At this time, no chord sound is produced. - In this example, only during the time when the manipulator is pressed, the
control unit 40 reads the chorddata file identified by the chord ID that is assigned to that manipulator from theRAM 43 or theROM 21 and makes it be available for the sound processing by the SPU 44 (S103). As a result, a chord sound is produced only during the time when the manipulator is pressed, and the production of the chord sound is stopped when the manipulator is released, so that the user can easily control the time interval during which the chord sound is produced. Various forms may be achieved such as other forms in which theSPU 44 is allowed to perform the sound processing until a predetermined period of time has passed after the manipulator is released (in this case, the sound may be muted and fade out after the manipulator is released). - Upon sensing the specific touch operation according to the output data supplied from the touch sensor (S104: Yes), the
control unit 40 performs the sound processing for the chord data in a manner that is associated with the specific touch operation, to let the chord sound be produced (S105). If no specific touch operation is sensed (S104: No), the step S104 is repeated until the specific touch operation is sensed. - As an example of the "aspect associated with the specific touch operation", an example is given in which the tone and attack(s) of output chord notes are varied depending on the direction of the touch operation, the touch operation speed, and their changes. That is, even when the identical chord is specified, the frequency is slightly higher when touched in the downward direction (first direction), and it is lower when touched in the upward direction (second direction). This is because a similar result will be obtained on the strings of a guitar which is a real musical instrument. In addition, a higher touch operation speed rather than a lower one will provide a higher output intensity (
level 3 > level 1). At a touch operation speed of the degree of a light touch, faint sound (level 1) is produced. - In which direction the touch operation is made, is determined by means of detecting the direction in which the touch operation continues, triggered by the detection of the position where the touch operation is started. The touch operation speed is determined by means of detecting the amount of continuous touch operation per a unit period of time. The change in directions of operation is determined by, for example, pattern matching of the change in positions of the touch operation. In order to facilitate these detections, it is preferable that the position where the touch operation is started be temporarily stored on the
RAM 43. In addition, a basic pattern is prepared that serves as an indicator for the pattern matching. - The step S105 is achieved by means of selecting one of the chord data files illustrated in
Fig. 9 according to the file ID, and sending it to theSPU 44. When a chord sound is produced from theSPU 44 in the aforementioned manner, the amplitude value for the oscillatory waveform image being presented on thedisplay screen 11 is varied (vibrated) depending on how the chord sound is produced such as the attack of the notes (level 1 to level 3) (S106). - When it is sensed that the pressed manipulator is released, that is, when operation is stopped or another manipulator is designated, the process goes back to the process at the step S102 (S107:Yes). If the manipulator is not released (S107: No), the process at and after the step S106 is repeated (S108: No) until the level of the chord sound output reaches zero. This keeps providing sustained sound for a predetermined period of time. When the sustained sound disappears and the level of the chord sound output reaches zero, the process goes back to the step S102 (S108: Yes).
- As apparent from the above, in the oscillatory waveform mode, the player can operate the chord producing device while enjoying the sustained sound of the chords, looking at the oscillatory waveforms. In addition, the chord sounds are produced only through free and easy operations at a player's pace, so that it becomes easier to sing a song while at the same time playing the device unlike conventional electronic musical instrument devices. The player can accompany many fellows singing in chorus under the player's control.
- Next, described is a process to be performed when a certain chord sound (first chord sound) is produced first and then another chord sound (second chord sound) is produced by means of the touch operation performed again. For the production of the first chord sound and the production of the second chord sound, various processes can be done. For example, possible processes include: "as to the first chord sound, the first chord sound is muted (weakened until it disappears) and only the second chord sound is produced", "the first chord sound output is continued as in the case where no second chord sound is produced and it is combined with the second chord sound", "the first chord sound is made fade out and is combined with the second chord sound output".
- In addition, as to the second chord sound, various processes can be expected such as "it is produced first as in the case where no first chord sound is produced", "the volume at the beginning of the output is set to low and is graduallymade stronger (fade in) to combine with the first chord sound". The process for the production of the first chord sound can be appropriately combined and performed with the process for the production of the second chord sound.
- Now, referring to
Figs. 11A and B , an example is given for a process for each of the first and second chord sounds in which the first chord sound is produced and subsequently the second chord sound is produced. - In
Figs. 11A and B , when the oscillatory waveform mode is selected, thecontrol unit 40 presents an initial oscillatory waveform image on the entire display screen 11 (T101). This process is achieved by means of sending a draw command and an image data from theCPU core 42 to theGPU 451, and sending the aforementioned data value "10" to thedisplay controller 47. - Upon sending that either one of the manipulators of the operation switch 121 (or along with the extended switch 131) is pressed by the player (T102: Yes), the
control unit 40, reads a first chord data file identified by the chord ID that is assigned to the subject manipulator from theRAM 43 or theROM 21 and makes it be available for the sound processing by the SPU 44 (T103), only during the time when the manipulator is pressed, and during the time when it is required to produce a chord sound or sounds after the release of the manipulator in the case when two chord sounds are combined which will be described later. At this time, no first chord sound is produced. Upon sensing the specific touch operation according to the output data supplied from the touch sensor (T104: Yes), thecontrol unit 40 performs the sound processing for the first chord data in a manner that is associated with the specific touch operation, to let the first chord sound be produced (T105). - At that time, in the embodiment shown in
Figs. 11A and B , there are two channels, channels A and B, through which the chord sounds are produced. Either an identical chord sound or different chord sounds may be produced through these channels. At T105, the chord sound is produced through the channel A. It should be noted that, although two channels A and B are used in this example, the chord sounds may be produced through three or more channels such as channels A , B, and C ... In addition, thecontrol unit 40 reads the chord data file identified by the chord ID that is assigned to the manipulator from theRAM 43 or theROM 21 and makes it be available for the sound processing by theSPU 44 for each one of the channels. When the specific touch operation is detected, the control unit performs sound processing for the chord data based on an aspect which is associated with the specific touch operation to let the chord sound be produced. - In this example, description is made under the assumption that the first chord sound corresponds to the C chord and the touch operation is performed in the downward direction (first direction).
- If no specific touch operation is sensed (T104: No), the step T104 is repeated until the specific touch operation is sensed.
- As to the "aspect associated with the specific touch operation", as in the case shown in
Fig. 10 , it is possible to use different frequencies or different sound levels for the cases where the touch operation is performed in the downward direction (first direction) and in the upward direction (second direction) . - The step T105 is achieved by means of selecting one of the chord data files illustrated in
Fig. 9 according to the file ID, and sending it to theSPU 44. When a chord sound is produced from theSPU 44 in the aforementioned manner, the amplitude value for the oscillatory waveform image being presented on thedisplay screen 11 is varied (vibrated) depending on how the chord sound is produced such as the attack of the notes (level 1 to level 3) (T106). - Next; it is determined whether the manipulator that has kept pressed is released or not. If the manipulator is not released (T107: No), it is detected whether or not the chord output level is equal to zero. If it is equal to zero (T108: Yes), the process goes back to T102. If it is not equal to zero (T108: No), it is determined whether the touch operation is performed or not. If the touch operation is not performed (T109: No), the process goes back to T107.
- If the touch operation is detected at T109 (T109: Yes), it is detected whether or not that touch operation is performed in the direction opposite to the direction of the touch operation performed at T104. If the touch operation is performed in the opposite direction (T110: Yes), the chord sound (second chord sound) corresponding to the touch operation in the opposite direction at T108 is produced through the channel B in addition to the first chord sound (in this example, the chord sound of the chord C that is produced through the touch operation in the first direction) producedthroughthechannelA. In this example, the touch operation is performed in the first direction for the C chord at T104, so that the touch operation performed in the second direction for the same C chord is detected, and the chord data associated with this can be read as the second chord sound, out of the chord data files that are recorded on the
ROM 21. Thecontrol unit 40 performs the sound processing for this chord data, and let the second chord sound be produced (T111) and then the process goes to T106. -
Fig. 12 (a) shows an explanatory diagram for chord sounds that are produced through each of the channel A (in the figure, Ch.A) and the channel B (in the figure, Ch.B) in this case. As shown in this figure, the second chord sound is produced through the channel B, in addition to the first chord sound output through the channel A. The production of the second chord sound through the channel B does not affects the chord sound produced through the channel A. For the chord sound produced through the channel A, sustained sound is produced for the aforementioned predetermined period of time as in the case where no output is made through the channel B. Accordingly, in this case, the first chord sound produced through the channel A and the second chord sound produced through the channel B are mixed and come out through a speaker. - In a situation where a real musical instrument such as a guitar is played, when a player strums a certain chord with a stroke in a predetermined direction and then strums again the same chord with a stroke in the opposite direction, the sound of the previous chord strummed with a stroke in the predetermined direction sounds like overlapping with the sound of the chord strummed with a stroke in the opposite direction even after the chord is strummed with a stroke in the opposite direction, due to the effects of, for example, the resonance of the body of the musical instrument and sound reverberation.
- On the contrary, when an electronic chord sound is produced through a speaker, no resonance effect of the body of the musical instrument as described above can be obtained. Therefore, if the second chord sound is merely produced after the first chord sound is produced, a user would find that "it has a different sound from the one obtained on a real musical instrument" and feel it is acoustically unnatural.
- In this example, the first chord sound and the second chord sound are mixed and produced as described above, so that the first chord sound is overlapped and produced with the second chord sound as in a case of the real musical instrument. This reduces the possibility of giving the user an acoustically unnatural feeling.
- Next, if the touch operation detected at T109 is not the touch operation performed in the direction opposite to the direction of the touch operation performed at T104, (T110: No), that is, when it is the touch operation performed in the same direction as in the touch operation at T104 for the identical chord, the corresponding chord, i.e., the C chord touched in the first direction in this example, is produced as the second chord sound through the channel B (T112), and the process goes to the step T106. Accordingly, the first chord sound produced through the channel A is the same chord sound as the second chord sound produced through the channel B.
- In this example, as shown in
Fig. 13(a) , for the chord sound produced through the channel A, the time point when the touch operation in the direction same as the direction in the touch operation at T104 is detected is assumed to be to. The sound is caused to gradually become weaker from to and the volume is caused to reach zero at the time t1. On the other hand, as shown inFig. 13(b) , the chord sound produced through the channel B has the lowest volume at to, gradually becomes higher in volume, and reaches a predetermined volume at the time point t1. The time duration from to to t1 can be determined arbitrarily. In this example, it is equal to two thousandths of a second (0.002 seconds) so that it sounds natural to the user's ear. However, this time duration may appropriately be determined to be longer or shorter than 0.002 seconds. In addition, this time duration may be varied dynamically depending on, for example, the sound pitch, the force in the touch operation, and the interval between a given touch operation and the subsequent touch operation. This control can be performed by theSPU 44. - The technique that gradually fades out the sound on the channel A while fading in the sound on the channel B during a short period of time (in this example, about 0.002 seconds) is referred to as "cross-fade". Without using the cross-fade, a possible time lag between the time point when the output of the first chord sound is terminated and the time point when the second chord sound is produced can result in a time duration during which no sound is generated. Even if such a time lag can be eliminated, it sounds acoustically unnatural if there is no time duration during which the first and the second chord sounds are produced simultaneously. The cross-fade causes it to sound acoustically naturally.
- In the cross-fade, the sum of the volumes on the channels A and B may be controlled to always have a value that is the same as a volume value from the channel A at to. In this example, in order to clearly notify the user that the touch operation has performed at T109 and the corresponding chord sound is produced, the sound produced through the channel B is controlled to have a higher volume so that the sum of the volumes on the channels A and B becomes larger than the volume value on the channel A at to. The sum of the volumes on the channels A and B is not limited specifically. It can be determined according to various procedures.
- Next, at T107, when the release of the manipulator is sensed, that is, when the operation is stopped or another manipulator is designated, it is determined whether or not another manipulator is pressed immediately after it and the touch operation is performed. It requires a certain amount of time for a user to release and press again the manipulator, and if operation is made within this time period, then it is considered that "the manipulator is pressed immediately after it". If another manipulator is pressed immediately after, and when the touch operation is performed (T113: Yes), the chord sound (second chord sound) associated with this manipulator and the direction of the touch operation are read from the chord data file recorded on the
ROM 21, the first chord sound and the second chord sound are cross-faded as described above (T114), and the process goes back to the step T106. At T113, if another manipulator is pressed immediately after it, and when it is not determined that the touch operation is performed (T113: No), the process goes back to T102. - As apparent from the above, natural chord sounds are produced which is closer to those on a real musical instrument by means of distinguishing the situation where the second chord sound has the same chord as the first chord sound but the direction of the touch operation (the direction of strumming with a stroke on a real musical instrument such as a guitar) is reversed and any other situations, to change the way for the chord output processing.
- In particular in this embodiment, when the first chord sound is produced and subsequently the second chord sound is produced which is identical to the first one for the same chord notes in the same direction of the touch operation except for the attack of the notes, these two chord sounds are mixed. Otherwise, the first chord sound and the second chord sound are cross-faded before production. This achieves more natural chord sound production.
- In conventional chord producing devices, the necessity for the aforementioned distinguishment is not recognized, and the sounds are produced regardless of the types of the first chord sound and the subsequent second chord sound. Accordingly, a user would possibly feel that the produced chord sounds are acoustically unnatural. However, in this embodiment, such unnaturalness is overcome.
- It should be noted that, in this embodiment, ongoing echo effect processing can be performed that varies the tone quality of ongoing echoes of the chords by means of changing the direction of operation of the stylus pen and the like.
- For example,
Figs. 14(a) to (d) show examples where the stylus pen and the like is moved in the downward direction and then moved in the lateral direction.Figs. 14(e) to (h) show examples where it is moved in the upward direction and then moved in the lateral direction. The procedure for the processing by thecontrol unit 40 under such operations is as shown inFig. 15 . More specifically, when the change in direction of operation of the stylus pen and the like is detected (A101: Yes), and if it is in the right direction (A102: Yes), the pitch of the sustained sounds is narrowed before the production (A103). This slightly raises the frequency of the sustained sounds. On the other hand, if the change in direction is in the left direction (A102: No), the pitch of the sustained sounds is broadened before the production (A104). This slightly lowers the frequency of the sustained sounds. The aforementioned procedures are continued as long as the sustained sounds last (A105 : Yes). As a result, even on an acoustic guitar, vibrato on an electric guitar can be produced, which expands the range of operation. - Next, referring to
Fig. 16 , an operation procedure for the guidance mode is described. - When the guidance mode is selected, an initial guidance image is presented (B101). The initial guidance image is an image obtained by replacing the
vibration image 51 inFig. 5 with theinitial vibration image 50 shown inFig. 3(a) , and is provided by means of sending the aforementioned data value "11" to thedisplay controller 47. - Upon sensing a certain manipulator is pressed (B102: Yes), the
control unit 40 reads the chord data file assigned to the manipulator as in the case of the oscillatory waveform mode and makes it be available for the sound processing (B103). In addition, the indication of the image associated with the chord that is assigned to the pressed manipulator is changed (B104). For example, as shown inFig. 5 , the indication is changed so that the pressed manipulator becomes more noticeable than the other unpressed manipulators in order to allow a user to visually distinguish the pressed manipulator. - The remaining operations are similar to those in the case of the oscillatory waveform mode. More specifically, upon sensing the touch operation (B105: Yes), the sound processing for the chord data is performed in a manner that is associated with the specific touch operation to let the chord sound be produced (B106). In addition, the amplitude value for the oscillatory waveform image being presented is varied (vibrated) depending on how the chord sound is produced (B107). When the manipulator is released, the process goes back to the step B102 (B108: Yes). If the manipulator is not released (B108: No), the process at and after the step B107 is repeated (B109: No) until the level of the chord sound output reaches zero. When the level of the chord sound output reaches zero, the process goes back to the step B102 (B109: Yes). This guidance mode facilitates the operation because operation can be done while looking at the
manipulator image 63 and theguide image 64 for the chord guide. - Next, referring to
Figs. 17 and18 , an operation procedure for the karaoke mode is described. - When the karaoke mode is selected, the musical composition image is presented (K101). The musical composition image may be, for example, as shown in
Fig. 4 . Upon sensing a certain manipulator is pressed (K102: Yes), the chord data file assigned to the manipulator is read as in the case of the oscillatory waveform mode, and is made available for the sound processing (K103). In addition, as in the case of the guidance mode, the indication of the image associated with the chord that is assigned to the pressed manipulator is changed (K104). - When touched (K105: Yes), the sound processing for the chord data is performed in a manner that is associated with the specific touch operation to let the chord sound be produced (K106). In addition, the amplitude value for the oscillatory waveform image being presented is varied (vibrated) depending on how the chord sound is produced.
- It is determined whether the manipulator is pressed correctly by the player (K108). This determination is made by means of, for example, checking the match between the output for a chord symbol indication (current
chord symbol indication 66 inFig. 4 ) and the chord ID assigned to the pressed manipulator. If pressed correctly, the progress of the musical composition image being presented proceeds (K108: Yes, K109). On the other hand, if not pressed correctly, the process at K109 is bypassed (K108: No). When the manipulator is released, the process goes back to the step K102 (K110: Yes). If the manipulator is not released (K110: No), the process at and after the step K107 is repeated (K111: No) until the level of the chord sound output reaches zero. When the level of the chord sound output reaches zero, the process goes back to the step K102 (K111: Yes). - In the image presented on the
display screen 11 after the aforementioned process, the musical composition image proceeds in a predetermined direction when the chord can be specified correctly. The current position on theprogress bar 62 is varied depending on the status. When you want to sing slowly, it is enough to perform touch operations while specifying chords slowly. This makes it possible to conduct music for player's purpose rather than in a device-driven manner. On the other hand, wrong operation does not cause the musical composition image to proceed, so that the player can easily find where he or she made a mistake. For example, when the player correctly operates thechord symbol indication 66 to be operated (succeed) as in the case where the musical composition image is like the upper portion ofFig. 18 (in which theguide image 64 is omitted), the measure proceeds as shown in the middle portion ofFig. 18 . On the other hand, when the chord is not specified according to the chord symbol indication 66 (failure), the musical composition image does not proceed. -
Fig. 19 shows an example of a display image on thedisplay screen 11 presented when both mix and cross-fade are used depending on directions of operation for a manipulator by using a plurality of channels in the aforementioned example. The musical composition image is made up of, for example, bars 71 each having the length indicating the time interval between a given touch operation and a next touch operation (in the figure,individual bars 71 are represented as b1, b2, ... b12) andmanipulator images 73 for the chord guide. Alyric 711 and a chord symbol indicator 722 are provided in appropriate areas in eachbar 71. In addition, a timing symbol (represented by v in the figure) 714 indicating the touch operation in the downward direction and a timing symbol (represented by an inverted v in the figure) 715 indicating the touch operation in the upward direction are also presented. - Each
bar 71 inFig. 19 has the length that indicates the time interval between a given touch operation and a next touch operation. Accordingly, a user can easily find the timing at which the touch operation should be performed and the direction of the touch operation (the direction of strokes on a real guitar), through the visual presentation by using the length of thebar 71 and the timing symbol(s). In the example shown inFig. 17 , the touch operation is performed downward at same intervals from b1 to b9. The touch operation is performed upward at the head of bars b4 and b7, and downward at the head of other bars. Since the length of the bar b10 is half the length of each of the bars b1 to b9, and the inverted v is given as the timing symbol at the head of thebar 11, the touch operation is performed in the downward direction at the head of the bar b10 and then the touch operation is performed in the upward direction after the elapse of the time that is half the past time. Since the bar b11 has a length 1.5 times as long as those of the bars b1 to b9, and the v is given as the timing symbol at the head of the bar b12, the touch operation is performed in the downward direction after the elapse of the time that is 1.5 times longer than the time for the bars b1 to b9. - Although the example shown in
Fig. 4 is an example where an 8-way button is used as the manipulator, this example uses a plus button as the manipulators for the chord producing device and is presented as amanipulator image 73. The bar b1 indicates that the chord C is selected by means of pressing the left of the manipulator (left of the plus button). Likewise, the bar b3 indicates that the chord F is selected by means of pressing the right of the manipulator. The bar b6 indicates that the chord Dm7 is selected by means of pressing the top of the manipulator (top of the plus button). The bar b9 indicates that the chord G is selected by means of pressing the bottom of the manipulator (bottom of the plus button). Themanipulator image 73 is not given in the remaining bars, which indicates that the previously-shown button is kept pressed. For example, in b2, the left portion of the manipulator that is pressed in b1 is kept pressed because themanipulator image 73 in b1 indicates that the left portion of the manipulator is pressed. - These indications clearly tell the user the timing at which the touch operation is performed (strumwith a stroke on a guitar), the direction of a stroke, and the manipulator to be pressed. In addition, each bar is associated with the chord symbol indication 712, the
manipulator 73, and lyrics data like the measured ID in the example shown inFig. 4 . Furthermore, each chord symbol indication 712 is associated with the chord ID which is used to identify the chord in question. - The musical composition image is selectively rendered into the
VRAM 462 by, for example, theGPU 452 and is presented on thesecond display pane 11b through thedisplay controller 47. - The
control unit 40 has a function to track the steps a player takes. This function is mainly effective for the karaoke mode. More specifically, a progress log that keeps track of changing the presentation of the musical composition image, a selection log that keeps track of which manipulator is selected for the presentation of the musical composition image and a touch operation log that keeps track of a player' s touch to thedisplay screen 11 are mutually associated and recorded on theEEPROM 22. The information recorded on theEEPROM 22 can be reproduced anytime in response to, for example, an instruction from the player. Forexample, the progress log for the musical composition image can be reproduced by means of, for example, supplying it to theGPU 452. The manipulator selection log and the touch operation log can be reproduced by means of sending them to theSPU 44. This function is used when, for example, the player confirms the current capacity of his or her device or uses it as an "automatic karaoke". - In addition, when a play is reproduced by using the operation log, the
chord symbol indication 612 inFig. 4 or the chord symbol indication 712 inFig. 17 may be presented on thedisplay screen 11 during the play. Furthermore, themanipulator image 63 inFig. 4 or themanipulator image 73 inFig. 17 may be presented. - This makes it possible to check the chord(s) being played during the reproduction and which button of the manipulator is pressed during recording.
- As apparent from the above, the chord producing device according to this embodiment is the size to be held with one hand and thus can be carried to anywhere. Upon usage, for example, a chord sound is produced when the player holds the
housing 10 with his or her left hand, operates theoperation switch 121 with his or her left finger, and touch it with his or her right hand or a stylus pen. This is very easy and not always requires skill. In addition, the player can operate it at his or her own pace rather than being device-driven, so that the player can sing slowly or at a quick tempo depending on the mood at a given time. It is easy to play the device and sing a song at the same time. - A beginner can operate it even when he or she has not learned the chords by means of, for example, selecting the guidance mode or the karaoke mode. The chord sounds are produced based on the actual timbres of a real musical instrument. Therefore, beginners and skilled players both can enjoy in their own way.
- The present invention is not limited to the aforementioned embodiment example. Instead, various modifications can be made in configuration. For example, the
control unit 40 may be configured to detect, as operations, the position of the touch operation as well as the timing to start touching, the direction of the touch operation, and the touch operation speed. More specifically, a chord symbol indication and a chord ID are previously assigned to a predetermined position of the touch operation. Then, it may be configured to function like the pressing operation for theoperation switch 121 when a player selects a position of the chord symbol indication on thedisplay screen 11. - In this embodiment, a wrong operation will also produce a chord sound in the karaoke mode. However, the corresponding chord sound may not be produced upon the wrong operation. This makes it possible to immediately determine any wrong operation.
- In this embodiment, the vibration image and the like is presented on the
first display pane 11a while the musical composition image and the like is presented on thesecond display pane 11b. However, these display panes may be changed appropriately. In addition, in this embodiment, thefirst display pane 11a and thesecond pane 11b are switched to provide asingle display screen 11. However two display screens may be provided and one of thefirst display pane 11a and thesecond pane 11b may be provided on either one of these display screens, and another one of thefirst display pane 11a and thesecond pane 11b may be provided on the other one of these display screens. - The present invention can also be applied to cases where chord sounds that simulate timbres of other musical instruments than a guitar, such as a piano are produced.
Claims (13)
- A portable chord producing device having a housing of a portable size to be held with one hand, the housing having a plurality of manipulators formed thereon each of which can be selected by a player with his or her finger of one hand, and a touch sensor formed therein or thereon which can be touched by the player directly with his or her finger of the other hand or indirectly,
said housing including a data memory, a control mechanism, and a sound production mechanism, which are connected to each other,
said data memory having a plurality of chord data files recorded thereon along with chord IDs for use in identifying chord sounds, the chord data file being for producing chord sounds that have characteristics of sounds on a real musical instrument, through said sound production mechanism,
either one of said chord IDs being assigned to each of said plurality of manipulators,
said control mechanism comprising:manipulator selection state detection means that detects which manipulator is being selected by the player and when he or she cancels the selection;specific operation detection means that detects details of the operation including the timing to start touching said touch sensor; andchord production control means adapted to read the chord data file identified by said chord ID that is assigned to the manipulator detected by said manipulator selection state detection means, from said data memory only during the time when the subject manipulator is selected, to supply it to said sound production mechanism, and to let the chord sound that is made producible as a result of it be produced through said sound production mechanism in a manner that is associated with the details of the operation detected by said operation detection means. - The portable chord producing device as claimed in Claim 1, wherein said specific operation detection means is for detecting, in addition to said timing to start touching, at least one of a direction of the touch operation to said touch sensor, a touch operation speed, and a touch operation position,
said chord production control means being adapted to let a chord sound determined according to the detected direction or the detected speed be produced through said sound production mechanism when said direction of the touch operation or the touch operation speed is detected, change an output frequency thereof depending on the change direction when a change in the subject direction of the touch operation is detected, change an output intensity thereof depending on the speed of change when a change in touch operation speed is detected, and cause production in an output manner that is previously assigned to the detected position when said touch operation position is detected. - The portable chord producing device as claimed in Claim 2, wherein said specific operation detection means is for detecting, in addition to said timing to start touching, a direction of the touch operation to said touch sensor,
said chord production control means being adapted to produce, when said specific operation detection means detects that said touch sensor is touched again after a first chord sound is produced through said sound production mechanism in a manner that is associated with said details of the operation, a chord sound that is made producible by said chord ID that is assigned to the manipulator detected in said situation of operation at the time of re-touch, as a second chord sound through said sound production mechanism in a manner that is associated with said details of the operation, and
adapted to compare said first chord sound with said second chord sound, and compare a direction of the touch operation in said first chord sound with a direction of the touch operation in said second chord sound, to change, in association with the results of these comparisons, the volume of the first chord sound that is produced in a manner that is associated with said details of the operation, the time during which the sound is produced, the volume of the second chord sound that is produced in a manner that is associated with said details of the operation, and the time during which the sound is produced. - The portable chord producing device as claimed in Claim 3, wherein said specific operation detection means is adapted to let the first chord sound that is produced in a manner that is associated with said details of the operation be synthesized for the production with the second chord sound produced in a manner that is associated with said details of the operation when said first chord sound is identical to said second chord sound, and when the direction of the touch operation in said first chord sound is opposite to the direction of the touch operation in said second chord sound, and
in other cases, to lower the first chord sound produced in a manner that is associated with said details of the operation from the time point of said re-touch, let the sound disappear over a predetermined period of time, let the second chord sound produced in a manner that is associated with said details of the operation have the minimum volume at the time point of said re-touch, and thereafter increase the volume thereof over a predetermined period of time to produce it. - The portable chord producing device as claimed in any one of Claims 1 to 4, wherein said chord data file is a data file obtained by means of recording chord sounds on a real musical instrument.
- The portable chord producing device as claimed in Claim 5, wherein said real musical instrument is a stringed musical instrument on which said chord sound is produced when a plurality of strings are strummed almost together.
- The portable chord producing device as claimed in Claim 6, comprising a memory loading-and-unloading mechanism for use in removably connecting said data memory to said control mechanism and the sound production mechanism,
said data memory having said data files recorded thereon for each of real musical instruments including said stringed musical instrument-using musical instrument. - The portable chord producing device as claimed in Claim 7, wherein said data memory has an image data for use in presenting a musical composition consisted of a series of measures, each measure being associated with one or a plurality of said chord IDs that are assigned for the subject real musical instrument,
said control mechanism further comprising display control means adapted to let a musical composition image for one or a plurality of measures be presented on a predetermined image display pane according to the image data for use in presenting said musical composition, and let a next musical composition image including one or a plurality of measures be presented on said image display pane in place of the musical composition image being presented when the chord data file identified on the basis of said chord ID that is associated with the measure(s) of the musical composition image being presented is produced through said sound production mechanism, said control mechanism conducting change of presentation of the musical composition images on said image display pane in response to the selection of saidmanipulator and operation of said touch sensor by a player. - The portable chord producing device as claimed in Claim 8, wherein the musical composition image presented on said image display pane accompanies at least one of a lyric of the subject musical composition, information which guides the timing of operating said touch sensor for producing a chord sound, and information which guides the generation of a chord sound on said musical instrument, which are assigned to the subject one or a plurality of measures.
- The portable chord producing device as claimed in Claim 9, wherein said control mechanism further comprises history recordingmeans on which a progress log that keeps trackof changing the presentation of said musical composition image, a selection log that keeps track of which said manipulator is selected for the presentation of said musical composition image, and a touch operation log for said touch sensor, are recorded in a mutually associated manner, said control mechanism being adapted to supply, in response to the input of an instruction from a player, said progress log out of the information recorded on said history recording means to said display control means, thereby to cause said display control means to reproduce the change in presentation of the musical composition image on said image display pane, and supply said selection log and said touch operation log to said chord production control means, thereby to cause said chord production control means to reproduce the production of a chord sound associated with said change in presentation and change in aspect thereof.
- The portable chord producing device as claimed in Claim 8, wherein said data memory has a vibration image data recorded thereon that is for representing a sound vibration image,
said control mechanism further comprising vibration image display control means adapted to let a vibration image file that is read from said data memory be presented on a vibration image display pane which is different from said image display pane, change the vibration image being presented according to the production of said chord sound, and stop it at the time point when the output intensity reaches zero. - A computer program for use in causing a computer which is mounted in a housing of a portable size to be held with one hand to operate as a portable chord producing device, said housing having a plurality of manipulators formed thereon each of which can be selected by a player with his or her finger of one hand, and a touch sensor formed therein or thereon which can be touched by the player directly with his or her finger of the other hand or indirectly, said computer being provided with a data memory and a sound production mechanism, said data memory having a plurality of chord data files recorded thereon along with chord IDs for use in identifying chord sounds, the chord data file being for producing chord sounds that have characteristics of sounds on a real musical instrument, through said sound production mechanism,
said computer program causing said computer to work as:assigning means for assigning either one of said chord IDs to each of said plurality of manipulators;manipulator selection state detection means that detects which manipulator is being selected by the player and when he or she cancels the selection;specific operation detection means that detects details of the operation including the timing to start touching said touch sensor; and ,chord production control means adapted to read the chord data file identified by said chord ID that is assigned to the manipulator detected by said manipulator selection state detection means, from said data memory only during the time when the subject manipulator is selected, to supply it to said sound production mechanism, and to let the chord sound that is made producible as a result of it be produced through said sound production mechanism in a manner that is associated with the details of the operation detected by said touch operation detection means. - A computer readable recording medium on which a computer program as claimed in Claim 10 is recorded.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2006183775 | 2006-07-03 | ||
PCT/JP2007/063630 WO2008004690A1 (en) | 2006-07-03 | 2007-07-03 | Portable chord output device, computer program and recording medium |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2045796A1 true EP2045796A1 (en) | 2009-04-08 |
EP2045796A4 EP2045796A4 (en) | 2012-10-24 |
Family
ID=38894651
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP07768354A Withdrawn EP2045796A4 (en) | 2006-07-03 | 2007-07-03 | Portable chord output device, computer program and recording medium |
Country Status (5)
Country | Link |
---|---|
US (1) | US8003874B2 (en) |
EP (1) | EP2045796A4 (en) |
JP (1) | JP4328828B2 (en) |
CN (1) | CN101506870A (en) |
WO (1) | WO2008004690A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2013134441A3 (en) * | 2012-03-06 | 2014-01-16 | Apple Inc. | Determining the characteristic of a played chord on a virtual instrument |
US9805702B1 (en) | 2016-05-16 | 2017-10-31 | Apple Inc. | Separate isolated and resonance samples for a virtual instrument |
Families Citing this family (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4815471B2 (en) * | 2008-06-10 | 2011-11-16 | 株式会社コナミデジタルエンタテインメント | Audio processing apparatus, audio processing method, and program |
US8269094B2 (en) * | 2009-07-20 | 2012-09-18 | Apple Inc. | System and method to generate and manipulate string-instrument chord grids in a digital audio workstation |
KR101657963B1 (en) | 2009-12-08 | 2016-10-04 | 삼성전자 주식회사 | Operation Method of Device based on a alteration ratio of touch area And Apparatus using the same |
US8822801B2 (en) * | 2010-08-20 | 2014-09-02 | Gianni Alexander Spata | Musical instructional player |
CN101996624B (en) * | 2010-11-24 | 2012-06-13 | 曾科 | Method for performing chord figure and rhythm figure by monochord of electric guitar |
US8426716B2 (en) * | 2011-01-07 | 2013-04-23 | Apple Inc. | Intelligent keyboard interface for virtual musical instrument |
KR20120110928A (en) * | 2011-03-30 | 2012-10-10 | 삼성전자주식회사 | Device and method for processing sound source |
EP3960956A1 (en) | 2011-08-26 | 2022-03-02 | Ceraloc Innovation AB | Floor panel |
US20130104039A1 (en) * | 2011-10-21 | 2013-04-25 | Sony Ericsson Mobile Communications Ab | System and Method for Operating a User Interface on an Electronic Device |
US9082380B1 (en) * | 2011-10-31 | 2015-07-14 | Smule, Inc. | Synthetic musical instrument with performance-and/or skill-adaptive score tempo |
US8614388B2 (en) * | 2011-10-31 | 2013-12-24 | Apple Inc. | System and method for generating customized chords |
JP5569543B2 (en) * | 2012-01-31 | 2014-08-13 | ブラザー工業株式会社 | Guitar chord display device and program |
US8878043B2 (en) * | 2012-09-10 | 2014-11-04 | uSOUNDit Partners, LLC | Systems, methods, and apparatus for music composition |
JP5590350B2 (en) * | 2012-09-24 | 2014-09-17 | ブラザー工業株式会社 | Music performance device and music performance program |
WO2016111716A1 (en) | 2015-01-08 | 2016-07-14 | Muzik LLC | Interactive instruments and other striking objects |
WO2019028384A1 (en) * | 2017-08-04 | 2019-02-07 | Eventide Inc. | Musical instrument tuner |
US20210407473A1 (en) * | 2017-08-04 | 2021-12-30 | Eventide Inc. | Musical Instrument Tuner |
USD874558S1 (en) * | 2018-06-05 | 2020-02-04 | Evets Corporation | Clip-on musical instrument tuner with removable pick holder |
JP7354539B2 (en) * | 2019-01-10 | 2023-10-03 | ヤマハ株式会社 | Sound control device, sound control method and program |
JP6977741B2 (en) * | 2019-03-08 | 2021-12-08 | カシオ計算機株式会社 | Information processing equipment, information processing methods, performance data display systems, and programs |
US11823652B2 (en) * | 2019-06-12 | 2023-11-21 | InstaChord Corp. | Chord-playing input device, electronic musical instrument, and chord-playing input program |
JP7306711B2 (en) * | 2019-06-12 | 2023-07-11 | 雄一 永田 | CHORD PERFORMANCE INPUT DEVICE, ELECTRONIC MUSICAL INSTRUMENT, AND CHORD PERFORMANCE INPUT PROGRAM |
US20210366448A1 (en) * | 2020-05-21 | 2021-11-25 | Parker J. Wonser | Manual music generator |
US11842709B1 (en) | 2022-12-08 | 2023-12-12 | Chord Board, Llc | Chord board musical instrument |
WO2024123342A1 (en) * | 2022-12-08 | 2024-06-13 | Chord Board, Llc | Chord board musical instrument |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4339979A (en) * | 1978-12-21 | 1982-07-20 | Travis Norman | Electronic music instrument |
US4794838A (en) * | 1986-07-17 | 1989-01-03 | Corrigau Iii James F | Constantly changing polyphonic pitch controller |
US20030209130A1 (en) * | 2002-05-09 | 2003-11-13 | Anderson Clifton L. | Musical-instrument controller with triad-forming note-trigger convergence points |
US20040244566A1 (en) * | 2003-04-30 | 2004-12-09 | Steiger H. M. | Method and apparatus for producing acoustical guitar sounds using an electric guitar |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4480521A (en) * | 1981-06-24 | 1984-11-06 | Schmoyer Arthur R | System and method for instruction in the operation of a keyboard musical instrument |
JPS5871797U (en) * | 1981-11-10 | 1983-05-16 | ヤマハ株式会社 | electronic musical instruments |
JP3177992B2 (en) * | 1991-02-14 | 2001-06-18 | カシオ計算機株式会社 | Electronic musical instrument |
US5440071A (en) * | 1993-02-18 | 1995-08-08 | Johnson; Grant | Dynamic chord interval and quality modification keyboard, chord board CX10 |
JPH0744172A (en) * | 1993-07-30 | 1995-02-14 | Roland Corp | Automatic playing device |
JP3204014B2 (en) * | 1995-01-10 | 2001-09-04 | ヤマハ株式会社 | Performance instruction device and electronic musical instrument |
JPH0934392A (en) * | 1995-07-13 | 1997-02-07 | Shinsuke Nishida | Device for displaying image together with sound |
US6111179A (en) * | 1998-05-27 | 2000-08-29 | Miller; Terry | Electronic musical instrument having guitar-like chord selection and keyboard note selection |
JP2000148168A (en) * | 1998-11-13 | 2000-05-26 | Taito Corp | Musical instrument play learning device and karaoke device |
JP3684892B2 (en) * | 1999-01-25 | 2005-08-17 | ヤマハ株式会社 | Chord presentation device and storage medium |
JP3838353B2 (en) * | 2002-03-12 | 2006-10-25 | ヤマハ株式会社 | Musical sound generation apparatus and computer program for musical sound generation |
JP2004240077A (en) | 2003-02-05 | 2004-08-26 | Yamaha Corp | Musical tone controller, video controller and program |
US7365263B2 (en) * | 2003-05-19 | 2008-04-29 | Schwartz Richard A | Intonation training device |
JP2005078046A (en) * | 2003-09-04 | 2005-03-24 | Takara Co Ltd | Guitar toy |
US7420114B1 (en) * | 2004-06-14 | 2008-09-02 | Vandervoort Paul B | Method for producing real-time rhythm guitar performance with keyboard |
US7161080B1 (en) * | 2005-09-13 | 2007-01-09 | Barnett William J | Musical instrument for easy accompaniment |
DE102006008260B3 (en) * | 2006-02-22 | 2007-07-05 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Device for analysis of audio data, has semitone analysis device to analyze audio data with reference to audibility information allocation over quantity from semitone |
KR100882064B1 (en) * | 2006-04-17 | 2009-02-10 | 야마하 가부시키가이샤 | Musical tone signal generationg apparatus |
-
2007
- 2007-07-03 WO PCT/JP2007/063630 patent/WO2008004690A1/en active Search and Examination
- 2007-07-03 CN CNA2007800307111A patent/CN101506870A/en active Pending
- 2007-07-03 EP EP07768354A patent/EP2045796A4/en not_active Withdrawn
- 2007-07-03 JP JP2008523768A patent/JP4328828B2/en not_active Expired - Fee Related
- 2007-07-03 US US12/307,309 patent/US8003874B2/en not_active Expired - Fee Related
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4339979A (en) * | 1978-12-21 | 1982-07-20 | Travis Norman | Electronic music instrument |
US4794838A (en) * | 1986-07-17 | 1989-01-03 | Corrigau Iii James F | Constantly changing polyphonic pitch controller |
US20030209130A1 (en) * | 2002-05-09 | 2003-11-13 | Anderson Clifton L. | Musical-instrument controller with triad-forming note-trigger convergence points |
US20040244566A1 (en) * | 2003-04-30 | 2004-12-09 | Steiger H. M. | Method and apparatus for producing acoustical guitar sounds using an electric guitar |
Non-Patent Citations (2)
Title |
---|
GÜNTER GEIGER: "Using the touch screen as a controller for portable computer music instruments", INTERNATIONAL CONFERENCE NEW INTERFACES FOR MUSICAL EXPRESSION, XX, XX, 4 June 2006 (2006-06-04), pages 61-64, XP002483047, * |
See also references of WO2008004690A1 * |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2013134441A3 (en) * | 2012-03-06 | 2014-01-16 | Apple Inc. | Determining the characteristic of a played chord on a virtual instrument |
GB2514270A (en) * | 2012-03-06 | 2014-11-19 | Apple Inc | Determining the characteristic of a played chord on a virtual instrument |
US8937237B2 (en) | 2012-03-06 | 2015-01-20 | Apple Inc. | Determining the characteristic of a played note on a virtual instrument |
US8940992B2 (en) | 2012-03-06 | 2015-01-27 | Apple Inc. | Systems and methods thereof for determining a virtual momentum based on user input |
US9129584B2 (en) | 2012-03-06 | 2015-09-08 | Apple Inc. | Method of playing chord inversions on a virtual instrument |
US9224378B2 (en) | 2012-03-06 | 2015-12-29 | Apple Inc. | Systems and methods thereof for determining a virtual momentum based on user input |
US9418645B2 (en) | 2012-03-06 | 2016-08-16 | Apple Inc. | Method of playing chord inversions on a virtual instrument |
GB2514270B (en) * | 2012-03-06 | 2019-11-06 | Apple Inc | Determining the characteristic of a played note on a virtual instrument |
US9805702B1 (en) | 2016-05-16 | 2017-10-31 | Apple Inc. | Separate isolated and resonance samples for a virtual instrument |
US9928817B2 (en) | 2016-05-16 | 2018-03-27 | Apple Inc. | User interfaces for virtual instruments |
Also Published As
Publication number | Publication date |
---|---|
JP4328828B2 (en) | 2009-09-09 |
WO2008004690A1 (en) | 2008-01-10 |
US20100294112A1 (en) | 2010-11-25 |
EP2045796A4 (en) | 2012-10-24 |
CN101506870A (en) | 2009-08-12 |
US8003874B2 (en) | 2011-08-23 |
JPWO2008004690A1 (en) | 2009-12-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8003874B2 (en) | Portable chord output device, computer program and recording medium | |
US11173399B2 (en) | Music video game with user directed sound generation | |
US7598449B2 (en) | Musical instrument | |
JP3317686B2 (en) | Singing accompaniment system | |
JP4752425B2 (en) | Ensemble system | |
JP4797523B2 (en) | Ensemble system | |
JP4692189B2 (en) | Ensemble system | |
US20190385577A1 (en) | Minimalist Interval-Based Musical Instrument | |
US7405354B2 (en) | Music ensemble system, controller used therefor, and program | |
JP4379291B2 (en) | Electronic music apparatus and program | |
JP2004271783A (en) | Electronic instrument and playing operation device | |
JP4131279B2 (en) | Ensemble parameter display device | |
US7838754B2 (en) | Performance system, controller used therefor, and program | |
WO2008019089A2 (en) | Musical instrument | |
JP2011039248A (en) | Portable sound output device, computer program, and recording medium | |
JP2007279696A (en) | Concert system, controller and program | |
US20150075355A1 (en) | Sound synthesizer | |
JP4218688B2 (en) | Ensemble system, controller and program used in this system | |
JP2008233614A (en) | Measure number display device, measure number display method, and measure number display program | |
WO2018229746A1 (en) | Musical instrument | |
JP2008089748A (en) | Concert system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20090129 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR MK RS |
|
DAX | Request for extension of the european patent (deleted) | ||
A4 | Supplementary search report drawn up and despatched |
Effective date: 20120924 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G10H 1/18 20060101AFI20120918BHEP |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20130423 |