JP2011039248A - Portable sound output device, computer program, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a portable sound output device capable of outputting sounds by a simple operation. <P>SOLUTION: In a portable-size casing body 10, an operation switch 121, by which four kinds of chords can be assigned, and a display 11 simultaneously serving as a touch sensor panel are formed. A memory card 20 stores a sound data file for outputting sounds having sound characteristics played by an actual musical instrument and a chord data file expressing a combination of sounds. In the display 11, six string images functioning as touch sensors are displayed. A chord is designated with the operation switch 121, and a sound based on the chord is set in each string image. When the chord is designated with the operation switch 121 and the string images are touched, the sound output device makes a sound output mechanism output sounds assigned to the string images by the chord. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a portable sound output device that simulates an actual musical instrument (acoustic musical instrument) such as a guitar, a piano, and the like by operating it by an operator, and a related product.

  With the development of sound processing and other information processing technologies, electronic musical instrument devices have been realized that output sounds played by real musical instruments using electronic means. This type of electronic musical instrument device is configured, for example, by providing a plurality of sensors, a sound output unit, and a control unit in a casing shaped like an actual musical instrument. The sensor is provided at a part operated by the operator, and outputs predetermined data when it is detected that the operator has performed an operation. The control unit stores a program and data for musical sound output, generates sound source data corresponding to the sensor output, and outputs it from a sound output unit including a speaker.

Some electronic musical instrument devices include a display unit such as a light emitting element or a display. In such an electronic musical instrument device, an operation procedure is sequentially displayed on the display unit, and an operator performs an operation input according to the procedure, thereby outputting a musical sound similar to that of an actual musical instrument. Some electronic musical instrument devices are accompanied by display of lyrics, such as so-called “karaoke”. That is, the lyric data linked with the operation instruction data representing the operation content to be operated by the operator is stored in the memory in the apparatus, and the operation instruction data is displayed together with the lyric data displayed on the display unit. Thus, the lyrics display and the operation instruction content are linked.
As shown in the above example, the conventional electronic musical instrument device has an advantage that musical sounds can be output at low cost instead of expensive actual musical instruments or karaoke. Further, these electronic musical instrument devices have an advantage that even those who cannot play the actual musical instrument can easily perform the performance operation if only the operation procedure unique to the device is memorized.

The inventor of the present application has proposed a portable sound output device as shown in Patent Document 1 as an example of an electronic musical instrument device. In the portable sound output device of Patent Document 1, a chord played by a real instrument such as a guitar or a piano by an operator at any pace at his / her own pace regardless of his / her skill level. Is output. Thereby, even if the operation of the actual musical instrument is immature, it is possible to play and talk, or accompaniment when a large group of friends gather and sing can be led by the operator.
In Patent Document 2, an image imitating a part of an actual musical instrument is displayed on a display screen, and an image of a part of the actual instrument displayed on the display screen is operated as if the operator is playing. Thus, a sound processing apparatus for simulating an actual musical instrument by an operator is described.

International Publication Number WO2008 / 004690 Japanese Patent Application No. 2007-206556

Since Patent Document 1 outputs a chord, it is not suitable for outputting a single sound such as an operation for each string of a guitar or an operation of each key of a piano.
In Patent Document 2, the sound of each string can be output by an image imitating the six strings of a guitar, and one sound can be output. The chord is realized by the operator operating a plurality of strings in one operation. The sound processing device of Patent Document 2 is the same as an actual guitar in that a chord is determined by button operation and a sound corresponding to the string is output by touching the string image with a stylus pen. is there. In such a sound processing device, it is easy for an expert to play the strings one by one, but it is difficult for beginners to play strings unrelated to the chord.

  It is an object of the present invention to provide a portable sound output device that can easily output sound similar to that of an actual musical instrument regardless of skill level.

  The sound output device of the present invention has a portable size casing that an operator can hold with one hand, and the casing includes a plurality of operators that can be selected by one operator with one finger, A display on which a plurality of touch sensors are formed, each of which is associated with a musical instrument element constituting an actual musical instrument and can be directly or indirectly touched by the operator with the other hand, and a sound output mechanism for outputting sound And a control mechanism capable of accessing a predetermined data memory. In the data memory, a plurality of sound data files for outputting sounds having sound characteristics played by the musical instrument elements from the sound output mechanism are recorded in association with sound data IDs for identifying the sounds, and A plurality of code data files for expressing a code combining one or a plurality of sounds identified by the sound data ID are recorded in association with a code ID for identifying the code, and the plurality of operating elements Each of these is assigned one of the code IDs.

  Specifically, the control mechanism includes an operator selection status detection unit that detects which operator is selected by the operator and when the selection is released, and a touch start timing for each of the plurality of touch sensors. And the operation content detection means for detecting the operation content by the operator including the touch operation speed, and the code file based on the code ID assigned to the operation element detected by the operation element selection status detection means. One or more sound data files are specified from the sound data ID associated with the specified code file, and the specified sound data file is read from the data memory only while the operation element is selected. And supplying the sound data ID associated with the specified sound data file to a small number of touch sensors. Control for causing the sound output mechanism to output the sound identified by the assigned sound data ID in an expression manner linked to the operation content of the touch sensor detected by the operation content detection means. Sound output control means to perform.

  In such a sound output device of the present invention, a sound data ID is appropriately assigned to each of the plurality of touch sensors according to the code selected by the operator. Depending on the selected code, the number of sound combinations is less than the number of touch sensors, and all of the plurality of touch sensors are not used. In such a case, the sound data ID is assigned only to the necessary touch sensor according to the code, and the sound data ID is not assigned to the unnecessary touch sensor. Since an unnecessary touch sensor is not assigned a sound data ID, a sound is not output unlike the sound processing device disclosed in Patent Document 2 even if operated erroneously. Therefore, it is possible to easily output the same sound as an actual musical instrument regardless of the skill level.

  In this sound output device, for example, when the operation content detection unit detects operation content to two or more touch sensors within a predetermined time, the sound output control unit is used as a touch sensor whose operation content is detected later. The sound identified by the assigned sound data ID is output from the sound output mechanism at a level attenuated from the sound identified before that. With such a configuration, it is possible to output a chord in the same sound mode as when a chord is output with an actual guitar while enabling output of sound for each touch sensor.

In one embodiment, the control mechanism has a predetermined area of the display when, for example, a musical instrument element image file for representing a state image representing the state of each musical instrument element is recorded in the data memory. A state image region is formed, and the state image corresponding to all the touch sensors to which the sound data ID of the sound to be output from the sound output mechanism is assigned by reading the instrument element image file is displayed on the display. State image display control means is further provided for simultaneously displaying in the area and changing the currently displayed state image in accordance with the expression mode of the sound output from the sound output mechanism. With such a configuration, it can be visually confirmed that the touch sensor is being operated.
In addition, the control mechanism records, for example, an instruction image file for expressing an instruction image instructing which touch sensor should be operated at which timing among the plurality of touch sensors in the data memory, for example. The instruction image area is formed in the predetermined area of the display, the instruction image file is read and the instruction image is displayed, and the operation content to the touch sensor represented by the instruction image being displayed is correctly operated. It is further provided with instruction image display control means for determining whether or not it has been detected based on detection results by the operation element selection status detection means and the operation content detection means, and when correctly detected, the contents of the instruction image are changed. With such a configuration, even a beginner can operate the sound output device more easily and correctly.
The state image is, for example, an image representing a stationary initial state and a vibration state when played for each of a plurality of strings constituting a stringed instrument, and the instruction image is expressed for each string, for example. It is.

The present invention provides a computer program for operating a computer mounted in a portable sized housing that can be held with one hand as an operator as a portable sound output device. The casing is associated with a plurality of operators that can be selected by one operator with one finger of the operator and musical instrument elements that constitute an actual musical instrument, respectively, and the operator can directly or indirectly use the other finger of the other hand A display on which a plurality of touch sensors capable of touch operation are formed, a sound output mechanism for outputting sound, and a control mechanism capable of accessing a predetermined data memory are provided in the data memory. Is recorded in association with a sound data ID for identifying the sound, and a plurality of sound data files for outputting the sound characteristic sound played by the musical instrument element is associated with the sound data ID. A plurality of code data files for expressing a code combining one or more identified sounds are recorded in association with a code ID for identifying the code. To have.
In this case, the computer program according to the present invention provides the computer, the assigning means for assigning one of the code IDs to each of the plurality of operators, the operator selecting which operator, and selecting the operator. Operating element selection status detecting means for detecting when it has been released, operating content detecting means for detecting the operating content including touch start timing and touch operating speed on any of the touch sensors, operation detected to be selected A code file is specified based on the code ID assigned to the child, one or more sound data files are specified from the sound data ID associated with the specified code file, and the specified sound data file is assigned to the operation element. Is read from the data memory and supplied to the sound output mechanism while the selected sound data file is selected. A sound data ID associated with the sound sensor is assigned to each of the plurality of touch sensors, and the sound identified by the assigned sound data ID is output from the sound output mechanism in a manner linked to the detected operation content. It functions as output control means. Such a computer program is recorded on a computer-readable recording medium.

It is structure explanatory drawing which shows the embodiment of the sound output device of this invention, (a) is a front view, (b) is an upper bottom view, (c) is a lower bottom view. The internal block diagram of a housing | casing, and the connection state figure of various components. (A) is an initial vibration image, (b), (c) is an example of a vibration image. A display screen showing an example of a code image. The display screen which shows an example of the vibration image at the time of code selection. FIG. 6 is an exemplary diagram showing a table indicating a relationship between a code ID and a code data file. A display screen showing an example of a code selection screen. A display screen showing an example of a code selection screen. The display screen which shows an example of a music image. The display screen which shows an example of the vibration image at the time of music screen display. The display screen which shows an example of the vibration image at the time of music screen display. A display screen showing an example of an initial display image. Explanatory drawing in the free performance mode. Explanatory drawing in the music performance mode.

Hereinafter, an embodiment example in which the present invention is applied to a sound output device that outputs a guitar sound will be described.
<Overall structure>
FIG. 1 is an explanatory view of the structure of the sound output device according to this embodiment. (A) is a front view, (b) is an upper bottom view, and (c) is a lower bottom view. This sound output device has a housing 10 of a size that can be held with one hand, and is configured so that the memory card 20 can be detachably accommodated in the housing 10.

A display 11 that also serves as a touch sensor panel is provided at a substantially central portion of the housing 10. The display 11 (touch sensor panel) is obtained by covering the surface of a display panel made of, for example, LCD (Liquid Crystal Display) or EL (Electronic Luminescence) with a touch sensor.
The outer edge portion of the display 11 is somewhat recessed with respect to the surface of the housing 10, and a stylus pen described later is traced along the outer edge portion. As the touch sensor, any of a resistive film type, an optical type (infrared type), and a capacitive coupling type can be used. The display 11 is touched with a stylus pen or the like by touching or stroking the top surface of the touch panel with a stylus pen tip or a finger (hereinafter sometimes referred to as “stylus pen or the like”). The operation contents including the start time, the touch coordinate position, and the change thereof are transmitted to the control unit described later.

Operation switches 121 and 122 are provided on the surface of the housing 10 at portions that are substantially symmetrical with respect to the central axis in the short side direction, and sound output holes 141 and 142 are further formed. Yes. The operation switch 121 functions as a digital joystick, and has four operation elements. When the operator presses one of these operation elements, the operation switch 121 has a maximum of four types only during the pressing operation. The data can be selectively entered. That is, the control unit 40 (to be described later) can detect which operator has started to be selected and when the operator has canceled the selection.
The operation switch 122 functions as a digital switch and has four operation contacts. By pressing one of the four operation contacts, a maximum of four types of data can be input.

  In this embodiment, the left operation switch 121 is tilted and pressed with the thumb of the left hand, that is, tilted in any of four directions of 0 degrees, 90 degrees, 180 degrees, and 270 degrees from the center as a starting point. On the other hand, the right operation switch 122 is used as an operation mode switch for operating with the right thumb, an optional function, and other operation selection switches. Considering that there are right-handed and left-handed operators, both switches 121 and 122 can be interchanged with each other.

  In addition, as the operation switches 121 and 122, those that function as a digital joystick may be used, and it may be possible to arbitrarily set which operation switch is a direction instruction switch or an operation selection switch. Further, the operation switch 122 does not necessarily have four operation contacts, and may share two or eight contacts.

  A power switch 15 is provided above the sound output hole 141, and a start switch 161 and a function switch 162 are provided above the sound output hole 142. As these switches 15, 161, 162, for example, push buttons can be used. The start switch 161 is pressed by the operator when starting (resuming) or temporarily stopping (pause) the operation. The function switch 162 is pressed when selecting display contents such as various setting screens and operation screens for sound output.

  A pair of expansion operation switches 131 and 132 are provided on the upper side surface of the housing 10 at portions that are substantially symmetrical with respect to the central axis in the short side direction. Furthermore, a storage space for the stylus pen 30 and a locking portion 17 for the stylus pen 30 are formed in the substantially central portion. The extended operation switch 131 is for switching the group in the four directions that can be instructed by the operation switch 121 to another preset group. When the operator holds the casing 10 with the left hand, the left hand It is arrange | positioned in the site | part which can be operated with an index finger or middle finger. When the operator depresses or does not depress the extended operation switch 131, it is possible to instruct and input a maximum of eight directions with only the left hand operation. The extended operation switch 132 and the operation switch 122 are the same as described above. That is, the extended operation switch 132 can switch a group of four types of selection contents that can be selected by the operation switch 122 to another group.

  A housing space 18 of the memory card 20 and an external output terminal 19 for guiding sound data output from the sound output device to an external amplifier connected to a speaker are formed on the lower side surface of the housing 10.

<Control unit, etc.>
The sound output device of this embodiment includes a control unit, which is a kind of computer, and its peripheral electronic components inside a housing 10.

FIG. 2 shows an internal configuration diagram of the housing 10 and a connection state of various components.
A control unit 40 shown in FIG. 2 includes a connector 41 for detachably storing the memory card 20, a CPU (Central Processing Unit) core 42 including a main processor, and a RAM (Random Access Memory) functioning as a cache memory. 43, SPU (Sound Processing Unit) 44 that performs sound processing, two GPUs (Graphic Processor Units) 451 and 452 that perform image processing, and a display that enables image display on the first and second image areas 11a and 11b A controller 47 and an I / O (Input / Output) interface 48 are connected via an internal bus B1.

  The SPU 44 and the GPUs 451 and 452 are configured by, for example, a single chip ASIC. The SPU 44 receives a sound command from the CPU core 42 and performs sound processing according to the sound command. Specifically, “sound processing” is information processing for outputting stereo sound that can be reproduced by each of the two sound output units 241 and 242. The GPUs 451 and 452 receive a drawing command from the CPU core 42 and generate image data according to the drawing command. In addition to the drawing command, the CPU core 42 gives each of the GPUs 451 and 452 an image generation instruction necessary for generating image data. The contents of the drawing command from the CPU core 42 to each of the GPUs 451 and 452 vary depending on the scene, which will be described later.

  VRAM (Video Random Access Memory) 461 and 462 for drawing image data are connected to the two GPUs 451 and 452, respectively. Image data to be displayed on the first display area 11 a of the display 11 is drawn on the VRAM 461 by the GPU 451. On the other hand, image data to be displayed in the second display area 11 a of the display 11 is drawn in the VRAM 462 by the GPU 452. The contents of the image data will be described later. The display controller 47 reads out the image data drawn in these VRAMs 461 and 462 and performs a required display control process.

The memory card 20 includes a ROM (Read Only Memory) 21 and an EEPROM (Electronically Erasable and Programmable Read Only Memory) 22. In place of the EEPROM, a flash memory or other nonvolatile memory can be used. The ROM 21 and the EEPROM RAM 22 are connected to each other by a bus (not shown), and this bus is joined to the internal bus B1 of the control unit 40 via the connector 41. As a result, the CPU core 42, SPU 44, GPU 451, 452 can directly access the ROM 21 and the EEPROM 22 of the memory card 20.
The sound data recorded in the ROM 21 is not created electronically, but is a data file obtained by recording the sound actually played by a so-called master guitar player, such as a guitar, which is a real instrument. It is.

  The I / O interface 48 receives the pressing operation data from the various switches 121, 122, 131, 132, 15, 161, 162 and the touch operation data from the display 11. The pressing operation data is data indicating which switch the operator has pressed, and the touch operation data is data indicating the content of the touch operation performed by the operator. When each switch 121, 122, 131, 132, 15, 161, 162 is operated, corresponding data is input to the CPU core 42 via the I / O interface 48. Sound data is output from the I / O interface 48 to the sound output units 241 and 242. The sound data is generated by cooperation between the CPU core 42 and the SPU 44. The sound output units 241 and 242 amplify the sound data with an amplifier and reproduce it with a speaker.

  The ROM 21 of the memory card 20 stores various image data, sound data of each string composed of one or more sounds, and a sound output program. The sound output program includes various functions for causing the control unit 40 to operate as a sound output device, for example, a function for detecting an operator selection state by an operator, an operation including a touch start timing and a touch operation speed for the touch sensor. A function for detecting the contents, a function for outputting the sound assigned to each string in a manner linked with the operation contents of the touch sensor, and the like are constructed and executed by the CPU core 42.

  The image data is roughly divided into state images representing the state of the instrument, for example, vibration image data for expressing an image in which a string vibrates, chord instruction and chord image data for instructing a string to be operated, performance of music Music image data for assisting, initial display image data for expressing the initial image, and various setting image data. These data will be described.

  The vibration image data is data for expressing a vibration image of a string when sound is output from the sound output units 241 and 242 by the control unit 40. In this example, six string images are prepared, and each string image expresses an image that vibrates independently. FIG. 3A is an initial vibration image 50 representing an initial state in which the string image is stationary. In this example, the first to sixth strings are illustrated from the left, and each string image does not vibrate. The vibration image 51 in FIG. 3B represents the vibration state of the string image. In this example, the second to fourth strings vibrate and the other strings do not vibrate. The color of the string image changes depending on whether it is vibrating or not. Note that vibration images having three kinds of amplitude values of “weak”, “medium”, and “strong” may be represented in accordance with the intensity of the output sound.

The vibration image of the string is changed from the initial vibration image 50 to the vibration image 51 when the touch operation of the string image is detected by the stylus pen 30 straddling the string image at a predetermined speed or higher. In addition to this, as shown in FIG. 3 (c), the stylus pen 30 displays a display area where the string image is displayed at a predetermined speed (a speed faster than the case of straddling the strings) by one touch operation. Even when moving beyond a predetermined distance, the vibration image of the string changes assuming that a touch operation on the string image is performed.
In the example of the vibration image 52 in FIG. 3C, the touch operation is performed by moving the stylus pen 30 within an area surrounded by dotted lines on both sides of the string image (hereinafter referred to as “string image display area”). Is detected. In the display area of the string image, the touch operation on the string image is not detected unless the stylus pen 30 is moved quickly as the distance from the string image increases. In the string image display area, for example, the stylus pen 30 is not detected as a touch operation unless the stylus pen 30 is moved by 3 mm or more in one touch operation.
Thus, the string image and its display area correspond to the touch sensor of the present invention.
By moving the stylus pen 30 in the string image display area without straddling the string image, the vibration image of the string is displayed, thereby avoiding the operator's stress that no sound is generated even if the user intends to touch the string image. can do. In addition, since the stylus pen 30 is not detected as a touch operation unless the stylus pen 30 moves more than a predetermined distance by one touch operation, a sound is output when the stylus pen 30 touches the display area of the string image carelessly. Can be prevented.

  The touch operation on the string image is detected by the CPU core 42 detecting and analyzing the coordinates of the movement of the stylus pen 30 from the touch operation data. The moving speed of the stylus pen 30 can be measured from the moving distance of the stylus pen 30 per frame. The moving distance of the stylus pen 30 per frame is measured from the coordinates on the display 11 touched by the stylus pen 30 in a predetermined frame and the coordinates on the display 11 touched by the stylus pen in the next frame. Further, by integrating this moving distance from the start of touching the stylus pen 30 to the end of touching, the moving distance of the stylus pen 30 by one touch operation can be measured.

The initial vibration image 50 and the vibration images 51 and 52 are displayed on the display 11 when a free performance mode, a music performance mode, and a recording mode described later are selected. 3B and 3C, the direction of the arrow represents the direction in which the display 11 is touch-operated with the stylus pen 30 or the like. Actually, no arrow is displayed.
The vibration image is selectively drawn on the VRAM 461 by the GPU 451 and displayed on the first display area 11a through the display controller 47, for example.

The code image data is prepared for each basic code combination or each piece of music. Referring to FIG. 4 showing a display screen example of the display 11, the code instruction image based on the code image data represents a code assigned to each operation element of the operation switch 121. In this example, Am, F, G, and C codes are assigned clockwise from the upper operator of the operation switch 121. Further, by pressing the extended operation switch 131 or the extended operation switch 132, the assignment is changed to the C7m, Cm7, Em7, and CM7 codes clockwise from the upper operation element of the operation switch 121. By pressing an operator, the code ID of the code assigned to the operator is input to the CPU core 42.
For example, the code instruction image is selectively drawn in the VRAM 462 by the GPU 452 and displayed in the second display area 11 b through the display controller 47.

When the operator is pressed, a string image that can be operated is indicated by a chord assigned to the operator, as in the vibration image shown in the example of FIG. In the example of FIG. 5, the chord ID of the C code is input to the CPU core 42 by pressing the left operator, and the display area of the string image is colored as strings that can be operated by the second to sixth strings. Instructed. The CPU core 42 detects only a string image that can be operated and a touch operation on the display area.
5 is selectively drawn in the VRAM 461 by the GPU 451, for example, and is displayed in the first display area 11a through the display controller 47.

  Each string image is assigned a sound according to the chord. When the code ID is sent to the CPU core 24, the CPU core 42 reads a code data file corresponding to the code ID. FIG. 6 is an example of a table showing the relationship between the code ID and the code data file. The chord data file includes a sound data ID for outputting the sound of each string image for each chord. The sound data ID is associated with sound data for outputting a predetermined sound. Therefore, the CPU core 42 can assign a sound to each string image from the chord ID. The sound data assigned to each string image is sent to the SPU 44. When a touch operation is performed by the stylus pen 30 in a state where a sound is assigned to each string image, the CPU core 42 analyzes the touch operation, and obtains sound data of a sound assigned to the string image on which the touch operation is performed. A sound command is transmitted to the SPU 44 so as to perform sound processing. The SPU 44 performs sound processing on the sound data in accordance with the sound command, thereby causing the sound output units 241 and 242 to output the sound assigned to the string image on which the touch operation has been performed.

  The code assigned to each operator can be changed on the code selection screen shown in FIGS. On the chord selection screen, the “Basic” tag for displaying basic chord combinations, the “Song” tag for displaying chord combinations for each song, and the code that can be edited by the operator can be edited. There are “Custom” tags, and these tags are selected to select a code. By this selection, the code assigned to each operator of the operation switch 121 is changed. The CPU core 42 that has detected the pressing of the various switches 121, 122, 161, 162 or the touch operation with the stylus pen 30 changes the code assigned to the operator, and causes the GPUs 451, 452 to display a code selection screen.

The music image data is prepared for each music. Referring to FIG. 9 showing a display screen example of the display 11, for example, an instruction for instructing an operator for sound guidance and a string image to be operated on the progress graph 53 of the music in the music image based on the music image data. An image 54 is displayed. The arrow of the instruction image 54 indicates the operation element, and the oval portion indicates the string image to be operated. The instruction image 54 flows from the upper side to the lower side of FIG. 9 at a constant rhythm, and the instruction image 54 is displayed in the timing image 55 representing the operation timing of the string image. In the example of FIG. 9, the left operator is designated first, and then the upper operator is designated.
For example, the music image is selectively drawn in the VRAM 462 by the GPU 452 and displayed in the second display area 11 b through the display controller 47.

When a music image is displayed according to the music image data, the display of the operable string image is sequentially changed according to the progress of the music. For example, in the music image of FIG. 9, the left operator is first designated, and the operator presses the left operator in response to this, so that the second to fourth strings as shown in FIG. Can be operated. Next, when the upper operator is instructed and the operator presses the upper operator in response to this, the first and second strings can be operated as shown in FIG.
The operator performs the touch operation on the string image that can be operated by pressing the operator indicated by the instruction image 54 at the timing when the instruction image 54 is displayed in the timing image 55, so that the music according to the timing with the correct chord is displayed. Can be played.
The images in FIGS. 10 and 11 are selectively drawn on the VRAM 461 by the GPU 451 and displayed on the first display area 11 a through the display controller 47.

  The initial display image data is data for displaying an initial display screen on the display 11 when the power is turned on. FIG. 12 is a view showing an example of a menu image which is an initial display screen of this example. The operator can select a free performance mode, a music performance mode, a recording mode, and a setting mode from the menu image. Each mode can be selected by a touch panel operation using the operation switches 121 and 122 and the stylus pen 30. The CPU core 42 executes processing in any mode according to the pressing operation data and the touch operation data input by the operation switches 121 and 122 and the touch panel operation.

<Operation of sound output device>
Next, the operation of the sound output device configured as described above will be described.
In the sound output device, for example, the operator holds the casing 10 with the left hand, operates (presses / releases) the operation switch 121 and the like with the left hand finger, holds the stylus pen 30 with the right hand, or uses the finger. Thus, it becomes possible to operate by touching the display 11 with a pen tip or a fingertip.
When the operator turns on the power switch 15 with the memory card 20 mounted on the housing 10, the control unit 40 (CPU core 42) accesses the ROM 21 of the memory card 20 and executes the sound output program. Start. The control unit 40 also loads the data recorded in the ROM 21 and the EEPROM 22 of the memory card 20 and a part or all of the table into the RAM 43. Thereby, an operating environment for the operator to operate the apparatus as a musical instrument is constructed.

  Immediately after the power is turned on, the control unit 40 causes the display 11 to display the initial display screen of FIG. 12 in the first display area 11a or the second display area 11b. When the operator selects any one of the free performance mode, the music performance mode, the recording mode, and the setting mode with the stylus pen 30 from the initial display screen, the control unit 40 changes the initial display screen to the operation screen of the selected operation mode. Switch to perform processing under each operation mode.

When the recording mode is selected, the content played in the free performance mode or the music performance mode can be recorded in the EEPROM 22 of the memory card 20. In the setting mode, settings such as adjusting the brightness of the display 11 and switching the functions of various switches, particularly the operation switches 121 and 122, can be performed. By switching the functions of the operation switches 121 and 122, both right-handed and left-handed can be handled.
The operation procedure in the free performance mode and the music performance mode will be described.

<Free play mode>
When the free performance mode is selected, the operator performs a free performance according to the processing procedure shown in FIG.
When the operator selects the free performance mode with the stylus pen 30 from the initial display screen, the control unit 40 displays the chord instruction image shown in FIG. 4 in the second display area 11b, and the initial vibration image 50 shown in FIG. Is displayed in the first display area 11a (step S100). This process is performed when the CPU core 42 inputs touch operation data for selecting the free performance mode from the touch panel. After the touch operation data is input, each image is displayed by sending a drawing command and image data from the CPU core 42 to the GPU 451. Each code of the operator displayed in the code instruction image is initially set, and can be freely changed by the operator on the code selection screen shown in FIGS. Each code is assigned to each operator of the operation switch 121 in this example.

  The code selection screen shown in FIG. 7 or 8 is displayed in the first display area 11a when an instruction to change the code to be used is given (step S110: Y, step S120). The code change instruction is performed, for example, by pressing the operation switch 122 to which no code is assigned, or by providing an area for instructing code change on the display 11 and touching the area with the stylus pen 30. The CPU core 42 causes the code selection screen to be displayed on the display area 11a via the GPU 451 by touch operation data or pressing operation data instructing code change. From the displayed code selection screen, the operator's desired code is selected with the stylus pen 30 or the like (step S130).

  When the code instruction image indicating the changed code or the initial setting code is displayed, the sound output device waits for detection of pressing of the operator by the operator (step S140). When the operator is pressed, the code ID of the code assigned to the operator is input to the CPU core 42. Thereby, the CPU core 42 detects pressing of the operation element. The CPU core 42 reads the chord data file by referring to the table of FIG. 6 according to the inputted chord ID, and assigns sound data to each string image. Thus, the SPU 44 can perform sound processing on the sound data of each string image. When the operator is pressed, the CPU core 42 instructs the GPU 451 to change the color of the operable string image in accordance with the chord assigned to the operator. Thereby, the string image which can be operated for every chord can be visually recognized (step S140: Y, step S150, step S160).

  When the sound output device is ready for sound processing, the sound output device waits for detection of a touch operation on the string image by the operator (step S170). When a touch operation on the string image is detected, sound processing and sound output are performed according to the content of the touch operation (step S170: Y, step S180). The touch operation is performed on each string image. The CPU core 42 detects the movement of the stylus pen 30 from the transition of the touch-operated coordinates, and confirms which string image the touch operation has been performed on. A sound command including information on a string image on which a touch operation has been performed is sent from the CPU core 42 to the SPU 44. The SPU 44 determines sound data to be processed by the sound command. As described above, the touch operation is performed when the stylus pen 30 straddles the string image at a predetermined speed or higher, or when the stylus pen 30 moves at a speed higher than the speed at which the string image is displayed in the region where the string image is displayed. It is recognized that The magnitude of the output sound is determined by the moving speed of the stylus pen 30. The faster the moving speed, the louder the volume is, expressing the natural nuances of a real musical instrument. The CPU core 42 detects the moving speed of the stylus pen 30 from the content of the touch operation, and instructs the SPU 44 of the magnitude of the output sound according to the result. This instruction is also included in the sound command.

When a plurality of string images are operated by one touch operation, that is, when the string images continuously touched are continuously confirmed, the CPU core 42 regards as a series of operations (code strokes). Then, the SPU 44 is instructed to output at a level that attenuates the output sound from the string image that is touch-operated later. For example, the CPU core 42 causes the SPU 44 to output the sound of the string image that is touched first at a volume corresponding to the speed of the stylus pen 30, and the second string image is the volume corresponding to the speed of the stylus pen 30. It is instructed to output a sound with a lower sound (for example, 90% volume) and to output a sound with a sound (for example, 80%) lower than the sound volume corresponding to the speed of the stylus pen 30 for the third string image. The series of operations refers to a case where the stylus pen 30 never touches the touch panel and the stylus pen 30 touches a plurality of string images without touching the same string image more than once within a predetermined time. To tell.
After the sound output or simultaneously with the sound output, a vibration image in which the touched string image vibrates is displayed. When a plurality of string images are touch-operated, vibration images of all operated string images are displayed (step S190). The CPU core 42 instructs the GPU 451 to display a vibration image of the string image on which the touch operation is performed.

When the CPU core 42 detects the end of pressing of the operation element after the sound output and the vibration image of the touched string image are displayed, the CPU core 42 is in a standby state until the next time the operation element is pressed (step S200: Y). In the case where the operator continues to be pressed, when the sound output level becomes zero, a standby state is entered until the next time the operator is pressed (step S200: N, step S210: Y). Next, when the operator is pressed, the process returns to step S140 and is executed.
Thus, in the free performance mode, the operator can freely select a chord and perform with his / her rhythm. When a chord is selected, the string images that can be touch-operated are limited, so that the possibility of playing the wrong string image is reduced. Therefore, it is possible to play an existing song or use it as a musical instrument for composition.

<Music performance mode>
When the music performance mode is selected, a music performance is performed by the operator according to the processing procedure shown in FIG.
When the operator selects the music performance mode with the stylus pen 30 from the initial display screen, the control unit 40 first displays a music selection screen on the display 11 (step S300).
The operator can select a desired music piece on the music selection screen. A plurality of music pieces having different difficulty levels can be selected on the selection screen. Even for the same song, the difficulty level is set according to the performance speed, the required number of touch operations, and the like. When a song is selected, a song image for the song is displayed in the second display area 11b, and an initial vibration image as shown in FIG. 3A is displayed in the first display area 11a (step S310). The CPU core 42 sends to the GPUs 451 and 452 a drawing command for instructing display of the music image and initial vibration image of the selected music. The GPUs 451 and 452 display the music image and the initial vibration image according to the drawing command.

  In the music image, the instruction image 54 flows on the progress graph 53 as the music progresses, and the operator presses the operator in accordance with the flowing instruction image 54. In FIG. 10, the operator first presses the left operation element (step S320: Y). When the operator is pressed, the code ID of the code assigned to the pressed operator is input to the CPU core 42. Thereby, the CPU core 42 detects pressing of the operation element. The CPU core 42 reads the chord data file by referring to the table of FIG. 6 according to the inputted chord ID, and assigns sound data to each string image. Thus, the SPU 44 can perform sound processing on the sound data of each string image. (Step S330). When the operator is pressed, the color of the string image that can be operated from the CPU core 42 to the GPU 451 according to the code assigned to the operator, according to the code assigned to the operator. Change is instructed. Thereby, the string image which can be operated for every chord can be visually recognized (step S340).

  When the sound output device is ready for sound processing, the sound output device waits for detection of the presence or absence of a touch operation by the operator. The touch operation is effective only when it is performed on all operable string images at the timing when the instruction image 54 is displayed in the timing image 55 (step S350). When there is no touch operation, it waits for the next operation element to be pressed (step S350: N, step S320). When the touch operation is performed on all string images that can be operated at an appropriate timing, accurate sound processing and sound output are performed on the music. Further, an image in which the string image vibrates is displayed (step S350: Y, step S360). The CPU core 42 detects the movement of the stylus pen 30 from the transition of the coordinate where the touch operation is performed, and confirms which string image the touch operation has been performed on. As a result, when a touch operation is performed on all the string images that can be operated at an appropriate timing, a sound command for instructing sound output is sent to the SPU 44. The SPU 44 performs sound processing according to the sound command. Further, the CPU core 42 instructs the GPU 451 to display a vibration image of the string image on which the touch operation has been performed (step S370).

If the music is not finished (step S380: N), the CPU core 42 detects the end of pressing the operator after the sound output and the touched string image is displayed, and then the next operation is performed. It will be in a standby state until the child is pressed (step S390: Y). In the case where the operator continues to be pressed, when the sound output level becomes zero (step S390: N, step S400: Y), a standby state is entered until the next time the operator is pressed. Next, when the operator is pressed, the process returns to step S320 and is executed.
Thus, in the music performance mode, it is possible to perform music accurately. In particular, since there is no sound other than the chord indicated by the instruction image, the music performance is not mistaken as long as the rhythm is obtained. Since the operator can determine the difficulty level, any level of the operator can enjoy playing the music. It can also be used as a game device that competes for accurate touch operations.
Note that in steps S320 and S350, if the operation is not performed at the instructed chord and timing, it is not necessary to output the sound, but dare to output the wrong sound at the wrong chord and timing. May be.

  The present invention can be applied not only to a guitar but also to outputting a tone color sound played by another musical instrument such as a piano.

  DESCRIPTION OF SYMBOLS 10 ... Housing | casing, 11 ... Display also serving as a touch sensor panel, 11a, 11b ... Display area, 121, 122 ... Operation switch, 131, 132 ... Expansion switch, 141, 142 ... Sound output hole, 15 ... Power switch, 161 ... Start switch 162... Function switch 17. Stylus pen locking portion 18. Memory card storage space 19 External output terminal 20 Memory card 21 ROM 22 EEPROM 241, 242 Sound output Unit: 30 ... stylus pen, 40 ... control unit, 41 ... connector, 42 ... CPU core, 43 ... RAM, 44 ... SPU, 451, 452 ... GPU, 461, 462 ... VRAM, 47 ... display controller, 50-52 ... Vibration image, 53 ... Progress graph, 54 ... Instruction image, 55 ... Timing image

Claims (7)

It has a portable size casing that can be held with one hand by an operator,
Each casing is associated with a plurality of operators that can be selected by one operator with one finger of the operator and instrument elements that constitute an actual musical instrument, and the operator can directly or indirectly use the other finger of the other hand. A display on which a plurality of touch sensors capable of touch operation are formed, a sound output mechanism for outputting sound, and a control mechanism capable of accessing a predetermined data memory,
In the data memory, a plurality of sound data files for outputting sounds having sound characteristics played by the musical instrument elements from the sound output mechanism are recorded in association with sound data IDs for identifying the sounds, and A plurality of code data files for representing a code combining one or more sounds identified by the sound data ID are recorded in association with the code ID for identifying the code,
Each of the plurality of operators is assigned any one of the code IDs,
The control mechanism is
An operator selection status detecting means for detecting which operator is selected by the operator and when the selection is released;
Operation content detection means for detecting operation content by the operator including a touch start time and a touch operation speed to each of the plurality of touch sensors;
The code file is identified based on the chord ID assigned to the manipulator detected by the manipulator selection status detecting means, and one or more sounds are generated from the sound data ID associated with the identified chord file. A data file is specified, and the specified sound data file is read from the data memory and supplied to the sound output mechanism only while the operator is selected, and is associated with the specified sound data file. The sound data ID is assigned to at least one of the plurality of touch sensors, and the sound identified by the assigned sound data ID is expressed in a manner linked to the operation content of the touch sensor detected by the operation content detection means. Sound output control means for performing control for outputting from the sound output mechanism,
Portable sound output device. The sound output control means is identified by a sound data ID assigned to a touch sensor whose operation content is detected later when the operation content detection means detects operation contents to two or more touch sensors within a predetermined time. The sound output is output from the sound output mechanism at a level attenuated from the sound identified before,
The portable sound output device according to claim 1. In the data memory, an instrument element image file for representing a state image representing the state of each instrument element is recorded,
The control mechanism is
A state image area is formed in a predetermined area of the display, the instrument element image file is read, and state images corresponding to all touch sensors assigned sound data IDs of sounds to be output from the sound output mechanism are State image display control means for simultaneously displaying in the state image area of the display and changing the state image being displayed according to the expression mode of the sound output from the sound output mechanism,
The portable sound output device according to claim 2. In the data memory, an instruction image file for expressing an instruction image instructing which touch sensor should be operated at what timing among the plurality of touch sensors is recorded,
The control mechanism is
An instruction image area is formed in a predetermined area of the display, the instruction image file is read to display the instruction image, and whether or not the operation content to the touch sensor represented by the instruction image being displayed is correctly operated is Determination based on detection results by the child selection status detection means and the operation content detection means, and provided with instruction image display control means for changing the content of the instruction image when correctly detected;
The portable sound output device according to claim 3. The state image is an image representing an initial state of being stationary and a vibration state when being played for each of a plurality of strings constituting the stringed instrument,
The instruction image is expressed for each string.
The portable sound output device according to claim 4. A computer program for operating a computer mounted in a portable sized casing that can be held with one hand as a portable sound output device,
The casing is associated with a plurality of operators that can be selected by one operator with one finger of the operator and musical instrument elements that constitute an actual musical instrument, respectively, and the operator can directly or indirectly use the other finger of the other hand A display on which a plurality of touch sensors capable of touch operation are formed, a sound output mechanism for outputting sound, and a control mechanism capable of accessing a predetermined data memory are provided in the data memory. Is recorded in association with a sound data ID for identifying the sound, and a plurality of sound data files for outputting the sound characteristic sound played by the musical instrument element is associated with the sound data ID. A plurality of code data files for expressing a code combining one or more identified sounds are recorded in association with a code ID for identifying the code. In what are,
The computer,
Assigning means for assigning one of the code IDs to each of the plurality of operators;
Operator selection status detection means for detecting which operator is selected by the operator and when the selection is released,
An operation content detection means for detecting an operation content including a touch start time and a touch operation speed to any of the touch sensors;
A code file is identified based on the code ID assigned to the operator detected to be selected, and one or more sound data files are identified from the sound data ID associated with the identified code file; The specified sound data file is read from the data memory and supplied to the sound output mechanism only while the operation element is selected, and the sound data ID associated with the specified sound data file is assigned to the plurality of touch sensors. A sound output control means for outputting the sound output from the sound output mechanism in a manner linked to the detected operation content, and the sound identified by the assigned sound data ID assigned to each;
Computer program. The computer program according to claim 6 is recorded.
Computer-readable recording medium.

Images