JP2002200338A - Portable terminal device with music data processing function - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable terminal device that can change the mode of reproduction of music data in dependence on the progress of a built-in game. SOLUTION: The portable terminal device connectable to a radio communication network has a storing means for storing a game program and a plurality of types of music data, a game executing means for executing the game program, a music data reproducing means for reproducing the music data, and a synchronous controlling means for synchronizing the game executing means and the music data reproducing means.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a portable terminal device, and more particularly, to a portable terminal device having a music data processing function.

[0002]

2. Description of the Related Art A portable telephone, which is a wireless portable terminal device, can generate a ring tone for notifying an incoming call as a part of the telephone function. In addition, a tone is used as a means for transmitting not only a ring tone but also various information to a user.

In order to generate these musical tones, it is necessary to store music information for producing musical tones in the portable telephone body. Until now, it has been necessary to input musical notes using an operator provided on the mobile phone body or to download music information in a format specific to the mobile phone model through the Internet or the like. Also, input is performed using dedicated computer software.

[0004] Also, as a function of using the above-mentioned musical sounds,
In addition to ringtones, BG for games built into mobile phones
It is widely used as M.

[0005]

The above-mentioned musical tone which can be pronounced by the portable telephone also has a plurality of sound channels as the portable telephone advances, and the musical tone can be produced by using the operator provided on the portable telephone main body. Input is becoming more difficult.

[0006] Even if downloaded from the Internet or the like, it is difficult to edit. In this case, the only choice is to select from provided music.

[0007] Further, as the BGM of the built-in game, only predetermined music pieces can be used, and those music pieces are simply repeated in the same pattern.

It is an object of the present invention to provide a portable terminal device capable of changing the reproduction mode of music data in accordance with the progress of a built-in game.

It is another object of the present invention to provide a portable terminal device capable of changing the progress of a built-in game in accordance with a reproduction mode of music data.

[0010] Still another object of the present invention is to provide a portable terminal device capable of easily inputting music data.

It is still another object of the present invention to provide a portable terminal device capable of easily editing music data.

[0012]

According to one aspect of the present invention, a portable terminal device connectable to a wireless communication network comprises: a storage unit for storing a game program and a plurality of types of music data; The game execution unit includes a game execution unit that executes a program, a music data reproduction unit that reproduces the music data, and a synchronization control unit that synchronizes the game execution unit with the music data reproduction unit.

According to another aspect of the present invention, a portable terminal device connectable to a wireless communication network includes a communication interface connected to an external device for inputting a performance signal, and a communication interface based on the performance signal. The musical instrument includes music data generating means for generating music data, storage means for storing the generated music data, and music data reproducing means for reproducing the music data.

[0014]

FIG. 1 is a block diagram showing a hardware configuration of a mobile phone 1 constituting a mobile terminal device according to an embodiment of the present invention.

The mobile phone 1 has a bus 2, a RAM 3, a ROM
4, CPU 5, timer 6, external storage device 7, detection circuit 8, operator 9, display circuit 10, display 11, sound source circuit 12 (12a, 12b), mixer 13, digital-analog converter (DAC) 14 (14a, 14b) ),
Speaker 15 (15a, 15b), analog-to-digital converter (ADC) 16, telephone call microphone 17, serial interface (I / F) 18, connector 19, wireless communication circuit 22, antenna 23, input / output (I / O) -It includes the interface 25.

A bus 2, a RAM 3, a ROM 4, a CPU
5, a timer 6, an external storage device 7, a detection circuit 8, a display circuit 10, a sound source circuit 12, a DAC 14, an ADC 16, a serial I / F 18, a wireless communication circuit 22, and an I / O interface 25 are connected.

The user can use the operating element 9 connected to the detection circuit 8 to input a telephone number during a call, input various instructions such as selection of music data, and make various settings. The operation element 9 may be, for example, a jog shuttle, a joystick, a switch, or any other element that can output a signal according to a user input.

Further, in this embodiment, a plurality of input means are connected as the operating elements 9, and as shown in FIG. 2, up / down / left / right cursor keys 9a, a power ON key 9b and an OFF key 9c. , Function (F) key 9d, 0
There are provided numeric keys 9e assigned to each of the numbers 9 to 9 and "*" and "#".

The display circuit 10 is connected to a display 11, and can display a staff, a list of functions, various information, and the like on the display 11. The user makes various selections, inputs, and settings with reference to the information displayed on the display 11.

The external storage device 7 includes an interface for the external storage device, and is connected to the bus 2 via the interface. The external storage device 7 includes, for example, a semiconductor memory such as a flash memory, a floppy disk drive (FDD), a hard disk drive (HDD),
Magneto-optical disk (MO) drive, CD-RW drive, CD-ROM (compact disk-read only memory) drive, DVD (Digital Ver)
(Satellite Disc) drive or the like. The external storage device 7 can be omitted.

In this embodiment, a flash memory is connected as the external storage device 7. Various information can be stored in the flash memory.

The external storage device 7 can store various parameters, various data, programs for implementing the present embodiment, and the like. In the present embodiment, the external storage device 7 stores a plurality of music data for automatic performance and a plurality of software for playing various games. Also,
Information such as a telephone number for a call function is also stored in the external storage device 7.

The RAM 3 has a working area of the CPU 5 for storing flags, registers or buffers, various parameters and the like. The ROM 4 can store various parameters and control programs, programs for implementing the present embodiment, and the like. In this case, it is not necessary to store the programs and the like in the external storage device 7 in an overlapping manner. CP
U5 performs calculation or control according to a control program or the like stored in the ROM 4 or the external storage device 7.

The timer 6 is connected to the CPU 5 and the bus 2, and instructs the CPU 5 on a basic clock signal, interrupt processing timing, and the like.

In this embodiment, the sound source circuit 12 includes a game sound source 12a and a music sound source 12b.
The game sound source 12a generates various sound effects and the like when the game is executed according to the game software.
2b is used at the time of reproducing music data. The basic functions of the two sound sources are similar. Hereinafter, the sound source circuit 12 includes both the game sound source 12a and the music sound source 12b.

Game sound source 12a and music sound source 12b
Generates a tone signal in accordance with the supplied MIDI signal, performance signal, waveform data, etc., and outputs a digital tone signal to the mixer 13. The mixer 13 appropriately mixes the tone signals input from both sound sources and outputs the mixed signals via a digital / analog converter (DAC) 14a.
It is supplied to the music speaker 15a.

The DAC 14 receives signals from the tone generator 12 and the mixer 1.
The digital tone signal supplied through the digital audio signal 3 is converted into an analog tone signal. In this embodiment, the music DA
C14a and a call DAC 14b are provided.
It should be noted that the DAC 14 can be used for both music and calls.
Only one may be provided.

The tone generator 12 has a waveform memory system,
FM system, physical model system, harmonic synthesis system, formant synthesis system, VCO (Voltage Control)
lled Oscillator) + VCF (Volt
age Controlled Filter) + VC
A (Voltage Controlled Ampl)
(i.e., analog synthesizer).

The tone generator circuit 12 is not limited to a configuration using dedicated hardware, but may be implemented by a DSP (Degit
al Signal Processor) + a microprogram, a CPU + software program, or a sound card.

Further, a plurality of tone generation channels may be formed by using one tone generator circuit in a time-division manner, or a plurality of tone generator circuits may be used and one tone generator circuit may be used for one tone channel. A pronunciation channel may be configured.

The serial I / F 18 is a musical instrument, an electronic musical instrument,
It can be connected to audio equipment, computers, etc., and can at least input and output performance signals. In this embodiment, the serial I / F 18 is connected to an external device 21 via a connector 19 and a cable 20. Also,
In this embodiment, the serial I / F 18 is a MIDI interface, but is not limited to a dedicated MIDI interface. May be used. Also, through these interfaces,
Data other than the MIDI message may be transmitted and received at the same time.

The connector 19 is preferably a standard connector for MIDI, but is limited by the thickness of the portable telephone 1, so that a connector having a shape specific to this embodiment is used.

The cable 20 has a connector which can be connected to the connector 19 on the mobile phone 1 side, and one end of the external device 21 which can be connected to, for example, a MIDI connector. That is, in this embodiment, the serial I / F
Reference numeral 18 denotes a MIDI interface, so that the external device 21 uses a cable 20 whose connector shape conforms to a normal MIDI standard. However, when a USB interface or the like is used instead of the MIDI interface, the connector of the external device 21 is used. The shape may be a USB standard.

As described above, by using the MIDI interface as the serial I / F 18, if the external device 21 has a MIDI terminal, any external device 2 can be used.
1 can be connected, and MIDI data can be easily transmitted and received without using a special device.

The external device 21 is a computer, an audio device, an electronic musical instrument, etc., which is connected to the serial I / F 18 and which can at least input and output MIDI signals. The form of electronic musical instruments is not limited to keyboard instruments, string instruments, wind instruments,
A form such as a percussion instrument type may be used. Further, the sound source device, the automatic performance device and the like are not limited to those built in one electronic musical instrument main body, but each device is a separate device, and each device is connected using communication means such as MIDI or various networks. There may be. Further, the external device 21 can also be used as the operator 9 for inputting various settings and information.

A control program or a program for realizing the present embodiment can be stored in the external storage device 7. By reading the control program and the like from the external storage device 7 to the RAM 3, the CPU 5 can cause the CPU 5 to perform the same operation as when the control program and the like are stored in the ROM 4. By doing so, it is possible to easily add a control program and the like, upgrade the version, and the like.

Further, a control program or a program for realizing the present embodiment can be stored in a CD-ROM. A control program, a program for implementing this embodiment, and the like can be copied from the CD-ROM to the external storage device 7. New installation and version upgrade of the control program and the like can be easily performed.

The radio communication circuit 22 includes a head amplifier for radio communication radio waves received from the antenna 23, a modulation / demodulation unit for performing modulation and demodulation by encoding, an audio codec for performing demodulation of audio data, and the like. The wireless communication circuit 22 is capable of transmitting and receiving at least voice for a call wirelessly, and transmits and receives voice data for a call via a wireless communication network 24 via an antenna 23.

The voice input by the user to the telephone microphone 17 is transmitted to an analog-to-digital converter (ADC) 1.
The audio data is converted into digital audio data by 6 and transmitted to the wireless communication network 24 via the antenna 23 by the wireless communication circuit 22.

From the wireless communication network 24 to the antenna 2
The audio data received by the wireless communication circuit 22 via the wireless communication circuit 3 is converted into an analog audio signal by the DAC 14b and is emitted from the telephone speaker 15b.

The wireless communication circuit 22 is connected to a server via a wireless communication network 24 in addition to the voice for communication, and the control program and the present embodiment are stored in the external storage device 7 or the RAM 4 from the server. A program for realizing the example, music data, game software, image data, and the like can be downloaded.

Further, a plurality of wireless communication circuits 22 may be provided. In that case, for example, a short-range wireless communication circuit such as the Bluetooth standard may be provided in addition to the wireless communication circuit for voice communication.

The I / O interface 25 is used for connection with a computer or the like. In this embodiment, the I / O interface 25 is used for transmission / reception of various data other than transmission / reception of music data.

FIG. 2 is a schematic view showing an example of the appearance of the mobile phone 1. As shown in FIG. Configurations similar to those in FIG. 1 are denoted by the same reference numerals.

As shown in the figure, on the front of the portable telephone 1, on the front of the portable telephone 1, numerals 9a assigned to numbers 0-9, "*" and "#", and up, down, left and right cursor keys 9b are provided. , An ENTER key 9c, a call key 9d, a power (call off) key 9e, and a function key (F key) 9f, and a display 11 is provided on the upper part.

Further, a telephone speaker 15b is provided at the uppermost part on the front of the portable telephone, and a telephone microphone 17 is provided at the lowermost part. The music speaker 15a
Are provided on the back of the mobile phone 1 and are not shown.

An antenna 23 protrudes outside from the upper side surface of the mobile phone 1. The connector of the I / O interface 25 is provided on the lower side surface.

The serial I / F 18 is provided on the side of the mobile phone 1.
Connector 19 is provided. The connector shape in the figure is merely an example, and any shape may be used. By inserting the connector of the cable 20 into the connector 19 as shown by the arrow in FIG.
(FIG. 1) and perform data communication.

To the numeric keys 9a, music symbols for a sequencer function, which will be described later, are assigned in addition to the numerals. For example, the key “1” is also used as a start button for music performance and the like, and the key “2” is used as a stop button for music performance and the like. Further, the key "3" is used as a step input switching button.

The numeric keys "4" to "8" include "whole note", "half note", "quarter note" and "eighth note", respectively.
“Sixteenth notes” are assigned. The user can use these keys to input the duration of the music.

The “9” key is assigned “dotted”. After pressing this “8” key, by pressing each of the numerical keys “4” to “8”, a dotted note is displayed. Can be entered. For example, if the "6" key is pressed after the "9" key is pressed, a "dotted quarter note" can be input.

A rest is assigned to the key of "0", and after pressing the "7" key, by pressing each of the numerical keys of "4" to "8", a desired note length is set. You can enter the rest you have.

Note that the assignment of musical notes to each numeric key is not limited to this example, and can be changed as appropriate. Further, in this embodiment, the pitch is determined by connecting the cable 2 to the connector 19.
Although the input is to be made from an external device 21 (FIG. 1) such as an electronic musical instrument connected via the line 0, the pitch may be inputted by using the up and down buttons of the cursor key 9b. .

FIG. 3 is a flowchart showing the main processing according to the embodiment of the present invention performed by the CPU 5 of FIG. Each process in the main process and the operation of the user will be described with reference to FIGS.

In step SA1, the user starts the main process by pressing the power key 9e for a predetermined time or more. Thereafter, the flow advances to the next Step SA2.

At Step SA2, a standby screen is displayed on the display 11. The standby screen is a screen on which various information such as a clock and a radio wave reception state is displayed, and can also display image data as a background. The user can also customize the standby screen. Thereafter, the flow advances to the next Step SA3.

At step SA3, a call process using a normal mobile phone is performed. Upon completion of the call processing, the flow advances to the next Step SA4.

At Step SA4, the operation of the function key (F key) 9f by the user and the input of a number (hereinafter referred to as an F number) by the numeric keys 9a are detected. If it is detected that the F key 9f has been operated,
The process proceeds to Step SA5 indicated by an ES arrow. If the F key 9f is not operated, step S indicated by a NO arrow
Return to A2 and display the standby screen.

The F number corresponds to each function of this embodiment. For example, “1” corresponds to a game function,
“2” corresponds to the sequencer function. Other numbers are assigned to other functions that can be executed or set by the mobile phone 1.

The user enters the F number using the numeric keys 9a instead of using the cursor keys 9b and ENT.
The function may be selected from a list of functions displayed on the display 11 using the ER key 9c. in this case,
The F number corresponding to the function selected from the function list is input.

At step SA5, the F number input at step SA4 is determined. If the F number is 1, the process proceeds to step SA6 indicated by an arrow A. F number is 2
If it is, the process proceeds to Step SA7 indicated by the arrow B.
If the F number is 3, step SA indicated by the arrow C
Proceed to 8.

At step SA6, a game process described later is performed. When the game process is over, the process advances to Step SA9.

At step SA7, a sequencer process described later is performed. When the sequencer processing is completed, step SA9
Proceed to.

At step SA8, other processing is performed.
When other processes are completed, the flow advances to Step SA9.

Here, the other processing is processing relating to functions normally provided in a mobile phone, for example, editing of a telephone directory memory, confirmation of billing information, and the like. In this case, transmission / reception of e-mail for browsing an Internet WEB page is included.

At step SA9, an instruction to end the main processing is detected. The instruction to end the main processing is input by the user pressing the power key 9e for a certain period of time or more. If there is an instruction to end the main processing, the flow advances to step SA10 indicated by a YES arrow to end the main processing and turn off the power. If there is no instruction to end the main processing, the process returns to step SA2 indicated by a NO arrow to display a standby screen.

FIG. 4 is a flowchart showing the game processing performed in step SA6 of FIG.

At Step SB1, the game process is started, and the process proceeds to the next Step SB2.

In step SB2, a list of games that can be executed on the mobile phone 1 is displayed on the display 11, and the user is allowed to select a game to be executed. Thereafter, the flow advances to the next Step SB3. The user refers to this game list,
Enter the game number. The game number may be input by directly inputting a number corresponding to the game to be executed using the numeric keys 9a, or may be selected using a combination of the cursor keys 9b and the ENTER key 9c.

At Step SB3, the input of the game number by the user is detected. When the input of the game number is detected, the process proceeds to the next Step SB4 indicated by a YES arrow. When the input of the game number is not detected, the process returns to step SB2 indicated by a NO arrow.

At Step SB4, the name of the selected game is displayed. Thereafter, the flow advances to the next Step SB5.

At step SB5, a game start button A and a user BGM insertion button B are displayed on the display 11. Thereafter, the flow advances to the next Step SB6. The user refers to the display on the display 11, selects one of the buttons with the cursor key 9b, and then presses the ENTER key 9c to select a processing mode corresponding to each button.

At step SB6, the operated button is detected. When the game start button A is operated, the process proceeds to step SB7 indicated by an arrow A, and the user BG
When the M insert button B is operated, the process proceeds to Step SB8 indicated by the arrow B.

At Step SB7, the processing of the game selected at Step SB3 is performed without the user BGM. Even without the user BGM, BGM that is originally played simultaneously with the game is played. When the game process ends, the process advances to Step SB9.

At Step SB8, the user BGM
Insertion processing is performed. In the user BGM insertion process, the user performs various settings of BGM to be performed during game play. When the user BGM insertion processing ends, the process proceeds to Step SB9.

At step SB9, the user is made to select whether or not to end the game processing. When ending the game process, the process proceeds to the next step SB10 indicated by a YES arrow, ends the game process, and returns to the main process of FIG. If the game process is not to be ended (if the game is to be played again), the process returns to step SB5 indicated by a NO arrow.

FIG. 5 is a flowchart showing the user BGM insertion process performed in step SB8 of FIG.

At step SC1, user BGM insertion processing is started. Thereafter, the flow advances to the next Step SC2.

At step SC2, a list of music data reproducible on the mobile phone 1 is displayed, and the user selects music data to be inserted as the user BGM (inserted music data). Thereafter, the flow advances to the next Step SC3.

At step SC3, it is determined whether or not the user has selected the inserted music data. If insertion music data is selected, step SC4 indicated by a YES arrow
Proceed to. If no inserted music data is selected, N
The process returns to step SC2 indicated by an arrow O.

At step SC4, a tempo mode selection screen is displayed on the display 11 to allow the user to select a tempo mode. Thereafter, the flow advances to the next Step SC5.
The tempo mode selected here is a first mode (T1) in which the progress of the game and the reproduction of the inserted music data are performed at independent tempos, and a second mode in which the reproduction tempo of the inserted music data is changed in accordance with the progress of the game. (T2) and a third mode (T3) in which the progress speed of the game is changed according to the playback tempo of the inserted music data.

In the first mode, both the game and the inserted music data proceed with the initial set values.

In the second mode, while the game program is being executed, the game function issues a synchronization signal in accordance with the speed of the game, and the sequencer function adjusts the tempo in accordance with the synchronization signal. The synchronization signal may be based on an absolute time (from the start), such as an SMPTE time code or a MIDI time code, or may be based on a clock that fluctuates according to a tempo, such as a MIDI timing clock.

In this embodiment, the latter MIDI timing clock is passed to the sequencer function as a synchronization signal. In the game function of the present embodiment, the tempo increases as the user's grade (level) increases or the game progresses, so that the reproduction tempo of the inserted music data selected by the user fluctuates in synchronization therewith. .

On the other hand, in the third mode, the sequencer function outputs a synchronization signal corresponding to the playback speed of the inserted music data, and while the game program is being executed, the game function proceeds in accordance with the synchronization signal. Adjust the speed.

That is, in this embodiment, as the playback tempo of the inserted music data increases, the progress speed of the game increases, and when the playback tempo decreases, the progress speed of the game decreases.

At Step SC5, it is determined whether or not the tempo mode has been selected. When the tempo mode is selected, the process proceeds to step SC6 indicated by a YES arrow, and when the tempo is not selected, the process returns to step SC4 indicated by a NO arrow.

At step SC6, it is determined whether the selected tempo mode is the first mode (T1), the second mode (T2), or the third mode (T3). First
If it is determined that the mode (T1) has been selected, the process proceeds to step SC7 indicated by an arrow of T1. Second mode (T2)
Is determined to have been selected, the process proceeds to step SC8 indicated by an arrow T2. When it is determined that the third mode (T3) has been selected, the process proceeds to step SC9 indicated by an arrow of T3.

In step SC7, the progress of the game and the reproduction of the inserted music data are set to be performed at independent tempos. Thereafter, the flow advances to step SC10.

At step SC8, a setting is made so that the reproduction tempo of the inserted music data is changed in accordance with the progress of the game. Thereafter, the flow advances to step SC10.

At step SC9, a setting is made so that the progress speed of the game is changed in accordance with the reproduction tempo of the inserted music data. Thereafter, the flow advances to step SC10.

In step SC10, an insertion mode selection screen is displayed on display 11, and the user is caused to select the insertion mode. Thereafter, the flow advances to the next Step SC11.
The insertion mode selected here is a BGM change mode (M) that changes music data to be inserted for each scene in the progress of the game.
1), a reproduction mode change mode (M2) in which the reproduction mode of the inserted music data is changed in accordance with the progress of the game, and a non-change mode (M3) in which the inserted music data is not changed.

In the BGM change mode (M1), the inserted music data used as the BGM can be changed every time the scene of the game changes.

In the reproduction mode changing mode, various statuses that change during the progress of the game are digitized. Here, the various statuses are, for example, the score, the number of items, the energy of the character, time and scene.

For example, it is assumed that the energy of the character changes between 0 and 500, and the volume of the sequencer function can be set in the range of 0 to 100. At this time, if the energy of the character is 100, the volume corresponding to this is 20. If the energy of the character is reduced to 50, the volume is also reduced to 1 according to this.
It becomes 0.

In this manner, the user can grasp the energy amount of the character based on the volume of the BGM.

The reproduction mode changed in the reproduction mode change mode may be any parameter as long as it can be represented by a numerical value. For example, besides the volume,
The key, timbre, velocity, effect (reverb depth, etc.) of the music, and the like.

In the non-change mode (M3), the inserted music data is not changed during the progress of the game, and its reproduction mode is not changed as an initial setting value except for the one originally included in the music data. The playback tempo follows the one set in any of steps SC7 to SC9.

In step SC11, it is determined whether the insertion mode has been selected. When the insertion mode is selected, the process proceeds to step SC12 indicated by a YES arrow, and when the insertion mode is not selected, the process returns to step SC10 indicated by a NO arrow.

At step SC12, it is determined whether the selected insertion mode is the BGM change mode (M1), the reproduction mode change mode (M2), or the non-change mode (M3). When it is determined that the BGM change mode (M1) has been selected, the process proceeds to step SC13 indicated by an arrow of M1. If it is determined that the reproduction mode change mode (M2) has been selected, the process proceeds to step SC14 indicated by an arrow of M2. If it is determined that the non-change mode (M3) has been selected, the process proceeds to step SC15 indicated by an arrow of M3.

In step SC13, since the BGM change mode is selected, it is set so that the inserted music data is changed for each scene of the game. At the same time, the user is caused to select the inserted music data for each scene. Thereafter, the flow advances to step SC16.

The selection of the inserted music data may be performed automatically. In this case, the music data that can be played back by the mobile phone 1 may be played back sequentially or randomly.

In step SC14, since the reproduction mode change mode is selected, a reproduction mode to be changed according to the progress of the game is set. In this embodiment, the reproduction mode is selected by the user. Thereafter, the flow advances to step SC16.

It is preferable to select a reproduction mode to be changed by displaying a list of changeable reproduction modes on the display 11 and making a selection by referring to the list. Also,
A plurality of reproduction modes may be changed. further,
The selection of the playback mode to be changed may be performed automatically.

At step SC15, since the non-change mode is selected, the setting is made so that the change of the inserted music data and the reproduction mode other than the tempo are not changed. Thereafter, the flow advances to step SC16.

In step SC16, the display 11
To display the game start button. Thereafter, the flow advances to the next Step SC17.

At step SC17, it is detected whether or not the start button has been pressed (operated). If the start button has been pressed, the process proceeds to step SC18 indicated by a YES arrow. If the start button is not pressed,
The process returns to step SC16 indicated by a NO arrow.

At step SC18, the game processing and the sequencer processing are started simultaneously. The game processing and the sequencer processing performed here are performed in accordance with the playback tempo or the progress speed set in any of steps SC7 to SC9, and in accordance with the contents set in any of steps SC13 to SC15. After that, when the game processing is completed, the sequencer processing is terminated accordingly, and the process proceeds to the next Step SC19.

In step SC19, the user is inquired whether to end the user BGM insertion processing. When ending the user BGM insertion process, the process proceeds to step SC20 indicated by a YES arrow, ends the user BGM insertion process, and returns to the main process of FIG. If the user BGM insertion process is not to be ended, step SC1 indicated by a NO arrow
Return to 6.

FIG. 6 is a flowchart showing the sequencer processing performed in step SA7 of FIG.

At step SD1, sequencer processing is started. Thereafter, the flow advances to the next Step SD2.

At Step SD2, the sequencer function SF
Is displayed on the display 11 and the user selects the sequencer function SF. Then, the next step SD
Proceed to 3. The selection of the sequencer function SF is performed by inputting the number assigned to each sequencer function SF. For example, in the present embodiment, a reproduction function of music data and an input function of music data are provided as the sequencer function SF, and "SF = 1" is used for reproducing music data.
However, “SF = 2” is assigned to the input of music data.

At Step SD3, the sequencer function SF
It is determined whether or not has been selected. If the sequencer function has been selected, the process proceeds to step SD4 indicated by a YES arrow. If the sequencer function is not selected, the process returns to step SD2 indicated by a NO arrow.

At step SD4, it is determined whether or not the selected sequencer function SF is "1" (SF = 1). If the selected sequencer function SF is "1", the process proceeds to Step SD5 indicated by an arrow of YES, and "1"
Otherwise, the process proceeds to Step SD10 indicated by a NO arrow.

At step SD5, a list of music data reproducible on the mobile phone 1 is displayed on the display 11, and
The user selects music data to be reproduced. The music data may be selected so that a plurality of music data are sequentially reproduced. Next, the process proceeds to step SD6.

In step SD6, it is determined whether music data has been selected. If music data has been selected, the process proceeds to step SD7 indicated by a YES arrow. If no music data has been selected, the process returns to step SD5 indicated by a NO arrow.

At step SD7, the selected music data is reproduced. The reproduction of the music data is performed, for example, by sequentially reading the selected music data from the external storage device 7 or the like according to a clock signal supplied from the timer 6 or the like, sending the selected music data to the music sound source 12b, and transmitting the selected music data to the music Sound is generated from the speaker 15a. Thereafter, the flow advances to the next Step SD8.

At step SD8, the user is inquired whether or not to end the music data reproduction processing. When the reproduction process of the music data is ended, the reproduction process of the music data is ended, the process proceeds to Step SD9 indicated by a YES arrow, the sequencer process ends, and the process returns to the main process of FIG. If the music data reproduction process is not to be ended, the process returns to step SD5 indicated by a NO arrow.

In step SD10, N is set in step SD4.
This is a process in the case of following the arrow O, and indicates that the selected sequencer function SF is “2”.

At step SD10, a music data input process described later is performed. When the music data input processing is completed, the process proceeds to step SD9.

FIG. 7 is a flowchart showing the music data input processing performed in step SD10 of FIG.

At step SE1, music data input processing is started. Thereafter, the flow advances to the next Step SE2.

In step SE2, the input method (SFI)
Is displayed on the display 11 and the user is made to select it.

In the present embodiment, as an input method (SFI), an external download input (SFI = 1) via a serial (MIDI) I / F 18 or the like, the operator 9 of the mobile phone 1 or the serial (MIDI) I / F18, a real-time input by an external device 21 such as a keyboard (SF
I = 2), operator 9 of mobile phone 1 or serial (MID)
I) A step input (SFI = 3) by an external device 21 such as a keyboard connected to the I / F 18 is prepared.

The user selects one of these input methods with the operation unit 9 with reference to the list displayed on the display 11. When the user selects the input method, the process proceeds to the next step SE3.

At this step SE2, the connection status of the serial (MIDI) I / F 18 with the external device and the external server through the communication line is determined, and only the currently executable input method is displayed. Alternatively, an input method that cannot be executed at present may be disabled.

At step SE3, the input method selected at step SE2 is determined. Download input (SF
If I = 1) is selected, the process proceeds to step SE4 indicated by an arrow “1”. When the real-time input (SFI = 2) is selected, step SE1 indicated by an arrow “2”
Go to 0. If the step input (SFI = 3) is selected, the process proceeds to step SE15 indicated by an arrow “3”.

In step SE4, the name of the music to be downloaded (file name of the music data) is input. Thereafter, the flow advances to the next Step SE5.

In step SE5, an input waiting button is displayed on the display 11. Then, the next step SE
Proceed to 6.

At Step SE6, the operation of the input waiting button is detected. When the operation of the input waiting button is detected,
The process proceeds to Step SE7 indicated by a YES arrow. If the operation of the input waiting button is not detected, the process returns to step SE5 indicated by a NO arrow.

In step SE7, a download wait state is set. The download wait state is continued until the music data is input, and the process proceeds to the next step SE8 as soon as the music data is input.

At step SE8, the input music data is sequentially stored in the external storage device 7, the RAM 4, or the like.
When the download is completed, proceed to the next step SE9,
The completion of download is displayed on the display 11, and the process proceeds to step SE20.

When music data is downloaded via the serial (MIDI) I / F 18, the mobile phone 1 serving as a client uses the serial (MIDI) I / F 18,
It is connected to an external device 21 via a connector 19 and a cable 20.

The user performs an operation for transmitting music data on the external device 21. The external device 21 that has received the transmission request from the user distributes the requested music data to the mobile phone 1 via the serial (MIDI) I / F 18 or the like. The mobile phone 1 is a serial (MIDI) I / F1
The music data is received through the external storage device 8 or the like and stored in the external storage device 7 or the RAM 3 or the like, thereby completing the download.

When downloading music data via a network such as the Internet, the mobile phone 1 serving as a client downloads music data and the like to a server via the wireless communication circuit 22 and the wireless communication network 24. Send the requested command.

The server receives the command and distributes the requested music data and the like to the mobile phone 1 via the wireless communication network 24. The mobile phone 1 receives the music data and the like via the wireless communication circuit 22 and stores the music data and the like in the external storage device 7 or the RAM 3 or the like, whereby the download is completed.

Steps SE10 to SE15 correspond to the case of proceeding according to the arrow “2” in step SE3.

At step SE10, the name of a music piece (file name of music piece data) to be created by real-time input is input. Thereafter, the flow advances to the next Step SE11.

At Step SE11, the display 11
To display the input waiting button. Then, the next step S
Proceed to E12.

At step SE12, the operation of the input waiting button is detected. When the operation of the input waiting button is detected, the process proceeds to Step SE13 indicated by a YES arrow. When the operation of the input wait button is not detected, the process returns to step SE11 indicated by a NO arrow.

In step SE13, the input wait state is displayed and an input end button is displayed. The input wait state is continued until the performance signal is input by the user, and the process proceeds to the next step SE14 as soon as the performance signal is input.

At step SE14, the input performance signals are temporarily stored in the external storage device 7, the RAM 4, or the like. Thereafter, the flow advances to the next Step SE15. The performance signal input here is, for example, a MIDI signal.

At Step SE15, the operation of the input end button is detected. When the operation of the input end button is detected, the performance signal temporarily stored in step SE14 is stored in the external storage device 7 or the RAM 4 or the like as the music data in the SMF format, for example, and the step S shown by the arrow of YES is performed.
Proceed to E20. If the operation of the input end button is not detected, the process returns to step SE14 indicated by a NO arrow.

Steps SE16 to SE19 correspond to the case of proceeding according to the arrow “3” in step SE3.

In step SE16, the name of a music piece (file name of music piece data) to be created or edited by step input is input. If you want to create new song data,
The music data having the input music name is created and stored in the external storage device 7, the RAM 4, or the like. Thereafter, the flow advances to the next Step SE17.

In step SE17, the input wait state is set, and the input end button and the staff are displayed on the display 1.
1 is displayed. The input wait state is continued until the user inputs the pitch or length information, and the process proceeds to the next step SE18 as soon as the pitch or length information is input.

The user creates music data by arranging notes at desired positions on the staff notation displayed on the display 11. In the present embodiment, pitch information is input using the keyboard of the external device 21 connected to the serial I / F, and the pitch information is input using the numeric keys 9a assigned to each note length of the mobile phone 1. Enter Alternatively, note length information is input using numeric keys 9a assigned to respective note lengths of the mobile phone 1, and pitch information is input using the up and down cursor keys 9b.

At step SE18, the inputted pitch and length information are stored at the corresponding sounding timing positions of the music data stored in the external storage device 7, the RAM 4, or the like. Thereafter, the flow advances to the next Step SE19. The pitch and duration information input here is, for example, a MIDI signal.

At step SE19, the operation of the input end button is detected. When the operation of the input end button is detected, the process proceeds to step SE20 indicated by a YES arrow. When the operation of the input end button is not detected, the process returns to step SE18 indicated by a NO arrow.

At step SE20, an inquiry is made to the user as to whether or not to end the music data input processing. When ending the music data input process, the process advances to step SE21 indicated by a YES arrow to end the music data input process.
If the music data input process is not to be ended, the process returns to step SE2 indicated by a NO arrow.

As described above, according to the present embodiment, a desired music can be reproduced as BGM during a game operation of a mobile phone.

Further, according to the present embodiment, the reproduction tempo of the music data (BGM) can be changed in accordance with the progress speed of the game. Conversely, the game tempo can be changed in accordance with the change in the playback tempo of the BGM. Furthermore, depending on the progress of the game, BG
The elements of M (volume, timbre, pitch, etc.) can also be varied.

Further, by providing a serial I / F 18 to which a MIDI device or the like can be connected, the MID
An I keyboard or the like can be connected to the mobile phone 1.

Therefore, M connected to serial I / F 18
Because you can use the keyboard of the IDI keyboard,
The pitch information of the music data can be easily input.

Since the keyboard of the MIDI keyboard can be used, chords can be input simultaneously. Further, by connecting a plurality of MIDI devices, simultaneous input of a plurality of parts becomes possible.

In this embodiment, since MIDI data can be reproduced, not only music data dedicated to a mobile phone but also music data in a widely-used MIDI format can be used.

This embodiment may be implemented by a commercially available computer or the like in which a computer program or the like corresponding to this embodiment is installed.

In this case, the computer program corresponding to the present embodiment is provided to the user while being stored in a computer-readable storage medium such as a CD-ROM or a floppy (registered trademark) disk. May be.

When the computer or the like is connected to a communication network such as a LAN, the Internet, or a telephone line, a computer program or various data may be provided to the computer or the like via the communication network.

The present invention has been described in connection with the preferred embodiments.
The present invention is not limited to these. For example, it will be apparent to those skilled in the art that various modifications, improvements, combinations, and the like can be made.

[0161]

As described above, according to the present invention,
A portable terminal device that can easily edit music data can be provided.

Further, according to the present invention, it is possible to provide a portable terminal device capable of changing the reproduction mode of music data in accordance with the progress of a built-in game.

Further, according to the present invention, it is possible to provide a portable terminal device capable of changing the progress of a built-in game in accordance with the reproduction mode of music data.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a hardware configuration of a mobile phone 1 constituting a mobile terminal device according to an embodiment of the present invention.

FIG. 2 is a schematic view showing an example of the appearance of the mobile phone 1. FIG.

FIG. 3 is a flowchart showing a main process performed by a CPU 5 in FIG. 1 according to an embodiment of the present invention.

FIG. 4 is a flowchart showing a game process performed in step SA6 of FIG.

FIG. 5 is a flowchart illustrating a user BGM insertion process performed in step SB8 of FIG. 4;

FIG. 6 is a flowchart illustrating a sequencer process performed in step SA7 of FIG. 3;

FIG. 7 is a flowchart showing a music data input process performed in step SD10 of FIG. 6;

[Explanation of symbols]

1 ... mobile phone, 2 ... bus, 3 ... RAM, 4 ... ROM, 5
.. CPU, 6 timer, 7 external storage device, 8 detection circuit, 9 operator, 10 display circuit, 11 display, 12 sound source circuit, 13 mixer, 14 DAC, 1
5 speaker, 16 ADC, 17 microphone for call, 1
8 ... serial interface, 19 ... connector, 2
0: cable, 21: external device, 22: wireless communication circuit,
23 ... antenna, 24 ... wireless communication network

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04M 1/725 H04B 7/26 109M F term (Reference) 2C001 BA07 BB04 BB08 BC09 BC10 CA01 CA06 CB01 CB03 CB06 CB08 CC08 DA06 5D378 MM24 MM52 MM96 QQ01 QQ06 5K027 AA11 FF25 HH29 5K067 AA21 BB04 BB21 EE02 FF27 FF31 GG11

Claims (11)

[Claims] 1. A portable terminal device connectable to a wireless communication network, comprising: storage means for storing a game program and a plurality of types of music data; game execution means for executing the game program; A portable terminal device comprising: music data reproduction means for reproducing data; and synchronization control means for synchronizing the game execution means with the music data reproduction means. 2. The portable terminal device according to claim 1, further comprising music data selecting means for selecting music data to be reproduced during execution of the game program from the plurality of types of music data. 3. The portable terminal according to claim 1, wherein the synchronization control means changes a music data reproduction mode of the music data reproduction means in accordance with a progress of a game program executed by the game execution means. apparatus. 4. The music data reproducing means according to claim 1, wherein said synchronization control means changes a music data reproduction tempo of said music data reproduction means in accordance with a progress speed of a game program executed by said game execution means. The portable terminal device according to the above. 5. The synchronization control means according to claim 1, wherein the synchronization control means changes a progress speed of a game program executed by said game execution means in accordance with a music data reproduction tempo of said music data reproduction means. The portable terminal device according to the above. 6. The communication interface according to claim 1, further comprising: a communication interface connected to an external device for inputting a performance signal; and music data generation means for generating music data based on the performance signal. Mobile terminal device. 7. A portable terminal device connectable to a wireless communication network, comprising: a communication interface connected to an external device for inputting a performance signal; and music data generation for generating music data based on the performance signal. A portable terminal device comprising: means; storage means for storing the generated music data; and music data reproducing means for reproducing the music data. 8. The portable terminal device according to claim 7, wherein the performance signal is a MIDI signal. 9. The portable terminal device according to claim 8, wherein the communication interface is a MIDI interface. 10. A method for controlling a portable terminal device having a storage means for storing a game program and a plurality of types of music data, the method being capable of being connected to a wireless communication network, wherein a game execution step of executing the game program A portable terminal control method, comprising: a music data reproduction step of reproducing the music data; and a synchronization control step of synchronizing the game execution step and the music data reproduction step. 11. A control procedure of a portable terminal device having a storage means for storing a game program and a plurality of types of music data, which is connectable to a wireless communication network, wherein the game execution procedure executes the game program. A medium storing a program for causing a computer to execute a mobile terminal control procedure including: a music data reproduction procedure for reproducing the music data; and a synchronization control procedure for synchronizing the game execution procedure and the music data reproduction procedure. .