JP2007034002A - Personal digital assistant - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a personal digital assistant with which music performance is easily attained. <P>SOLUTION: Music data of one octave is allocated to each button of a portable telephone. When the portable telephone is set at a mode to reproduce a musical instrument, the portable telephone reads and saves the data of an inclination sensor and geomagnetic sensor in a steady state (step S402). When the user presses a button on the portable telephone (step S403; Yes), the portable telephone re-reads the data of the inclination sensor and the geomagnetic sensor, and calculates the difference from the data in the steady state. The portable telephone determines the method for changing the music data, based on the calculated difference (step S404) and reproduces the music data from a music reproduction loudspeaker, after changing the music data by the determined changing method (step S405). <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a portable terminal device capable of playing music.

2. Description of the Related Art Conventionally, in mobile terminal devices such as mobile phones that can play music, musical tone data (sound scales, etc.) of sounds to be reproduced is assigned to each button of the mobile phone. When the user presses a button on the mobile phone, the musical sound data corresponding to the pressed button is converted to analog sound and played from the speaker, and the user can play music using the mobile phone like an instrument. It is. Note that Patent Document 1 and Patent Document 2 are known as references of prior art related to the present application.
JP 2003-131665 A JP 2004-037646 A

  However, the conventional portable terminal device has a problem that it is difficult to operate, for example, to move the scale up and down by one octave while pressing other buttons. The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a portable terminal device capable of easily playing music.

  The present invention has been made to solve the above problems, and the invention according to claim 1 is directed to an inclination detecting means for detecting an acceleration in a predetermined direction and an inclination angle in a predetermined direction of the housing, and an operation unit. A musical sound data output means for detecting an input operation and outputting musical sound data corresponding to the input operation, a musical sound data changing means for changing a mode of the musical sound data based on a detection result of the inclination detecting means, and the musical sound data A portable terminal device comprising: a tone generation unit that generates a tone based on the tone data changed by the changing unit.

  According to a second aspect of the present invention, in the first aspect of the present invention, the musical sound data changing means changes an octave of the musical sound data based on an inclination angle of the casing in a predetermined direction. It is said.

  According to a third aspect of the present invention, in the first aspect of the present invention, the musical sound data changing means changes a volume of the musical sound data based on an inclination angle of the casing in a predetermined direction. It is said.

  According to a fourth aspect of the present invention, in the first aspect of the present invention, the musical sound data changing means changes the volume of the musical sound data based on acceleration or speed in a predetermined direction of the casing. It is a feature.

  According to a fifth aspect of the present invention, in the first aspect of the present invention, the musical sound data changing means performs hold reproduction or release of the musical sound data based on acceleration in a predetermined direction of the casing. It is characterized by doing.

  The invention according to claim 6 is an azimuth detecting means for detecting the azimuth of the housing, a musical sound data output means for detecting an input operation to the operation unit and outputting musical sound data corresponding to the input operation, Musical tone data changing means for changing the mode of the musical tone data based on the detection result of the azimuth detecting means; and musical tone generating means for generating a musical tone based on the musical tone data changed by the musical tone data changing means. Is a mobile terminal device characterized by the above.

  The invention according to claim 7 is the invention according to claim 6, characterized in that the tone changing means changes the tone color of the tone data based on the orientation of the casing or a change in orientation. Yes.

  The invention according to claim 8 is the invention according to claim 1, further comprising orientation detection means for detecting the orientation of the housing, wherein the musical sound change means includes the inclination detection means and the orientation detection means. A feature of the musical sound data is changed based on a detection result.

  According to the present invention, in a portable terminal device capable of playing musical sound data, the octave, volume, tone color, etc. of the sound to be reproduced can be changed based on the inclination in the specific direction of the device and the acceleration in the specific direction. It is possible to play music with a simple operation.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is an external view showing an external appearance of a mobile phone according to an embodiment of the present invention. In FIG. 1, a pitch of one octave is assigned to each of the twelve push buttons including the numeric keypad of the mobile phone 1. In addition, although the note name is written on each push button in FIG. 1, this represents the assigned note name, and actually numbers 0 to 9 and various symbols are written. Yes.

  In addition, an application for reproducing musical sound data is incorporated in the mobile phone 1, and hereinafter, a state in which the musical sound data can be reproduced by activating this application is referred to as a musical instrument mode. In the musical instrument mode, the musical sound data corresponding to the pressed button is converted into an analog signal and played while the user presses the button, and the playback is stopped when the user releases the button. The coordinate axes Vx and Vy are coordinate axes on the surface of the casing of the mobile phone 1, and the coordinate axis Vz is an axis perpendicular to the surface of the casing of the mobile phone 1. Note that the casing of the mobile phone 1 shown in FIG. 1 is rectangular, and the coordinate axis Vx is defined to be parallel to the short side and the coordinate axis Vy is defined to be parallel to the long side. The axis A is an axis that passes through the center of the housing and is parallel to the coordinate axis Vy.

  FIG. 2 is an explanatory diagram showing coordinates used in the embodiment of the present invention. In FIG. 2, the direction α is the direction in which the axis A on the mobile phone 1 faces. The inclination angle β is an angle of the axis A from the horizontal plane, and the rotation angle γ is a rotation angle around the axis A.

  FIG. 3 is a configuration diagram showing the configuration of the mobile phone 1 of FIG. In FIG. 3, an operation unit 101 has 12 push buttons including a numeric keypad as its input means, and takes in an instruction input from a user. The display unit 102 is a display that is provided on the surface of the mobile phone 1 and displays information to be shown to the user. The communication unit 103 modulates a carrier wave with a transmission signal and transmits it from the antenna 104, demodulates the signal received by the antenna 104, and outputs the demodulated signal to the audio processing unit 105 or the bus line 116.

  The audio processing unit 105 converts the analog audio signal collected by the microphone 106 into a digital signal, compresses it, and outputs it to the communication unit 103. The audio processing unit 105 decompresses the digital audio data demodulated by the communication unit 103, converts the digital audio data into an analog audio signal, and outputs the analog audio signal to the speaker 107 for sound generation. The microphone 106 collects sound as an analog signal and outputs it to the sound processing unit 105. The speaker 107 produces an analog voice signal input from the voice processing unit 105 as voice.

  The sound source 108 generates and outputs a musical sound signal in accordance with an instruction from the CPU 111, and is, for example, an FM (Frequency Modulation) sound source or a WT (Wave Table) sound source. The sound source 108 holds timbre data representing the timbre of various musical instruments, and generates a musical tone signal using the timbre data corresponding to the timbre instruction of the CPU 111. The tone reproduction speaker 109 reproduces a tone signal input from the sound source 108.

  The GPS unit 110 receives a signal from a GPS (Global Positioning System) satellite (not shown) and acquires current position information of the own device. The CPU 111 is a CPU (Central Processing Unit) that controls each unit in the mobile phone 1. The RAM 112 is a RAM (Random Access Memory) that provides a memory area used by the CPU 111. The ROM 113 is a ROM (Read Only Memory) that holds programs executed by the CPU 111.

  The tilt sensor (tilt detection means) 114 is a sensor that detects acceleration and tilt angle in the three-axis directions of the Vx, Vy, and Vz axes shown in FIG. The geomagnetic sensor (orientation detecting means) 115 is a sensor that detects the geomagnetism in the three axial directions of the Vx, Vy, and Vz axes shown in FIG.

  When the mobile phone 1 is set to the map display mode, the GPS unit 110 acquires the current position information of the mobile phone 1, and the CPU 111 displays a map around the current location based on the detection direction of the geomagnetic sensor 115. Are displayed on the display unit 102 in accordance with the direction in which the screen faces. The bus line 116 is a bus line that connects each part in the mobile phone 1 to each other.

  Next, the operation of the above-described embodiment will be described with reference to FIGS. FIG. 4 is a flowchart showing a procedure for performing music on the mobile phone 1 of FIG. In FIG. 4, when the user operates the operation unit 101 to start the instrument mode, the CPU 111 determines whether or not the steady state setting has been started (step S401). Here, the steady state is a state in which the user is holding the cellular phone 1 and using the cellular phone 1 as a musical instrument from now on, as a reference posture of the cellular phone 1 or a direction in which the cellular phone 1 is facing.

  When the user gives an instruction to set the steady state to the CPU 111 via the operation unit 101, the CPU 111 takes in the detection results of the tilt sensor 114 and the geomagnetic sensor 115 and stores them in the RAM 112 as the detection result of the steady state (step S402). . Subsequently, when the user presses a button on the operation unit 101, the CPU 111 detects pressing of the button (step S403: Yes).

  Thereafter, the CPU 111 takes in the detection results of the tilt sensor 114 and the geomagnetic sensor 115 again, and detects a difference value from the value stored in the RAM 112 as the detection result of the steady state. From the detected difference value (including the detected azimuth data as the case may be), it is determined how to change the musical sound data previously assigned to the button pressed by the user (step S404).

  Here, with reference to FIG. 5, the procedure for determining the method for changing the musical sound data from the difference between the detection results of the inclination sensor 114 and the geomagnetic sensor 115 and the detection result of the steady state will be specifically described. In the present embodiment, four types are used: a method of shifting the octave, a method of increasing the volume, a method of changing the timbre, and a method of performing hold reproduction. FIG. 5 is a diagram showing a method of shifting the octave of the scale according to the rotation angle when the mobile phone 1 rotates on the Vx-Vz plane from the steady state shown in FIG.

  FIG. 5A is a diagram showing the mobile phone 1 in a steady state. FIG. 5B is a diagram when the mobile phone 1 is rotated to the right from the steady state on the Vx-Vz plane, and FIG. 5C is a diagram in which the mobile phone 1 is stationary on the Vx-Vz plane. It is a figure when it rotates to the left from a state. The sign of the rotation angle γ is negative when rotated to the right and positive when rotated to the left.

  In FIG. 5B, when the mobile phone 1 rotates to the right on the Vx-Vz plane, the detection result of the tilt sensor 114 changes, and the CPU 111 sets the rotation angle γ from the amount of change from the steady state of the detection result. calculate. Here, the calculation of the rotation angle γ may be performed not only from the detection result of the inclination sensor 114 but also from the detection result of the geomagnetic sensor 115, or may be performed only from the detection result of the geomagnetic sensor 115. . When the rotation angle γ is between −30 degrees and 0 degrees, the CPU 111 selects not to change from the standard octave in the steady state, and when the rotation angle γ is −30 degrees or less, the scale of the musical sound data is 1 octave. Choose to lower.

  On the other hand, in FIG. 5C, when the mobile phone 1 rotates to the left on the Vx-Vz plane, the CPU 111 similarly calculates the rotation angle γ. When the rotation angle γ is between 0 degrees and +30 degrees, the CPU 111 selects not to change from the standard octave in the steady state, and when the rotation angle γ is +30 degrees or more, the musical sound data scale is increased by one octave. Select.

  That is, in the example of FIG. 5, when the absolute value of the rotation angle γ is less than 30 degrees, the octave shift is not performed, and when the absolute value of the rotation angle γ becomes 30 degrees or more, the shift of one octave is performed. Become. Here, when the absolute value of the rotation angle γ exceeds 60 degrees, a shift of 2 octaves is performed, and when the rotation angle γ exceeds 90 degrees, a shift of 3 octaves is performed. You can also.

  The method of increasing the volume is performed by detecting the acceleration of the mobile phone 1 in the Vy axis direction. When the user vibrates the mobile phone 1 in the Vy axis direction, the tilt sensor 114 detects acceleration in both the positive and negative directions of the Vy axis. Depending on the detected acceleration value, the CPU 111 selects whether to increase the volume of the musical sound data. Here, not the acceleration but the speed in the Vy axis direction of the mobile phone 1 may be used as the selection criterion of the CPU 111.

  As another example of changing the sound volume, a method is possible in which the CPU 111 calculates the inclination angle β of the mobile phone 1 shown in FIG. 2 from the detection result of the inclination sensor 114 and changes the sound volume according to the calculated angle. . Here, the calculation of the inclination angle β may be performed not only from the detection result of the inclination sensor 114 but also from the detection result of the geomagnetic sensor 115 or may be performed only from the detection result of the geomagnetic sensor 115. . When the inclination angle β is within ± 30 degrees from the horizontal plane, the CPU 111 selects not to change from the reference sound volume, and selects to increase the sound volume by a predetermined amount when the inclination angle β is 30 degrees or more upward. When β is 30 ° or more downward, the volume is selected to be reduced by a predetermined amount.

  The timbre is changed by detecting the azimuth α (the azimuth of the axis A in FIG. 1) of the mobile phone 1 with the geomagnetic sensor 115. For example, if the mobile phone 1 is facing east, the CPU 111 selects a piano tone, and if it is facing west, the CPU 111 selects a guitar tone. As another example of changing the timbre, there is a method in which the user turns the mobile phone 1 once in parallel to the horizontal plane, and the timbre is changed when the CPU 111 detects the rotation by the user from the detection result of the geomagnetic sensor 115. .

  As a method of performing hold reproduction, the inclination sensor 114 detects acceleration in the Vz axis direction of the mobile phone, and the CPU 111 selects whether or not to perform hold reproduction according to the detected angle. When the user moves the mobile phone 1 in the positive direction of the Vz axis in FIG. 2 and the motion is detected as an acceleration of a predetermined value or more by the tilt sensor 114, the CPU 111 continuously plays the sound reproduced at that moment. And change it to continue sounding. In this state, the music playback is not stopped even if the user lifts his / her finger from the button of the operation unit 101.

  Conversely, when the user moves the mobile phone 1 in the negative direction of the Vz axis in FIG. 2 and the motion is detected by the tilt sensor 114 as an acceleration of a predetermined value or more, the CPU 111 cancels the hold reproduction. As another example of changing the music data reproduction method, when the inclination sensor 114 detects acceleration in any of the Vx axis, Vy axis, and Vz axis, the CPU 111 performs vibrato reproduction according to the detected acceleration. A method of selecting whether to perform or not is possible.

  Returning to FIG. 4, when the CPU 111 determines the musical sound data changing method from the detection result of each sensor in step S <b> 404, the musical sound data corresponding to the button pressed by the user is changed by the obtained changing method ( (Music data changing means), the CPU 111 issues an instruction to the sound source 108 and reproduces it on the music reproduction speaker 109 (step S405). Thereafter, if the user does not select the end of the musical instrument mode (step S406: No), steps S403 to S406 are repeatedly executed to reproduce music. On the other hand, when the user selects the end of the musical instrument mode (step S406: Yes), the series of processing ends.

  As mentioned above, although embodiment of this invention was explained in full detail, the concrete structure is not restricted to this embodiment, The design change etc. of the range which does not deviate from the summary of this invention are included. For example, the musical sound data changing method in step S404 in FIG. 4 is based on the octave shift and volume increase / decrease with respect to various conditions such as the inclination and azimuth of the mobile phone and the acceleration or velocity in each axis direction shown in FIG. It can be realized by assigning various methods such as a change in tone color and a change in reproduction method. It is also possible to combine a plurality of changing methods such as shifting the octave and increasing / decreasing the volume at the same time.

  Furthermore, it is also possible to take a form in which the user can set conditions relating to the musical sound data changing method. Furthermore, it may be realized by using only one of the inclination sensor 114 and the geomagnetic sensor 115. Furthermore, the musical sound data created in the instrument mode may be stored in the RAM 112 together with the time data so that it can be reproduced later.

  The present invention is suitable for use in a portable terminal device capable of playing music.

It is the external view which showed the external appearance of the mobile telephone concerning embodiment of this invention. It is explanatory drawing which showed the coordinate used by embodiment of this invention. It is the block diagram which showed the structure of the mobile telephone 1 of FIG. 3 is a flowchart showing a procedure for performing music on the mobile phone 1 of FIG. 1. It is the figure which showed the method of changing the octave of the sound reproduced | regenerated by the rotation angle (gamma) of FIG.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Mobile telephone (mobile terminal device) 101 ... Operation part 102 ... Display part 103 ... Communication part 104 ... Antenna 105 ... Audio | voice processing part 106 ... Microphone 107: Speaker 108: Sound source 109 ... Musical sound Reproduction speaker, 110 ... GPS section, 111 ... CPU, 112 ... RAM, 113 ... ROM, 114 ... tilt sensor (tilt detection means), 115 ... geomagnetic sensor (azimuth detection means), 116 ... bus line

Claims (8)

An inclination detecting means for detecting an acceleration in a predetermined direction of the housing and an inclination angle in the predetermined direction;
A musical sound data output means for detecting an input operation to the operation unit and outputting musical sound data corresponding to the input operation;
A musical sound data changing means for changing an aspect of the musical sound data based on a detection result of the inclination detecting means;
A musical sound generating means for generating a musical sound based on the musical sound data changed by the musical sound data changing means;
A portable terminal device comprising:   2. The portable terminal device according to claim 1, wherein the musical sound data changing unit changes an octave of the musical sound data based on an inclination angle of the casing in a predetermined direction.   2. The portable terminal device according to claim 1, wherein the musical sound data changing unit changes a volume of the musical sound data based on an inclination angle of the casing in a predetermined direction.   2. The portable terminal device according to claim 1, wherein the musical sound data changing unit changes a volume of the musical sound data based on an acceleration or speed in a predetermined direction of the casing.   2. The portable terminal device according to claim 1, wherein the musical sound data changing unit performs hold reproduction of the musical sound data or release of hold reproduction based on acceleration in a predetermined direction of the casing. Orientation detection means for detecting the orientation of the housing;
A musical sound data output means for detecting an input operation to the operation unit and outputting musical sound data corresponding to the input operation;
A musical sound data changing means for changing an aspect of the musical sound data based on a detection result of the azimuth detecting means;
A musical sound generating means for generating a musical sound based on the musical sound data changed by the musical sound data changing means;
A portable terminal device comprising:   7. The portable terminal device according to claim 6, wherein the musical sound changing means changes a timbre of the musical sound data based on an orientation of the casing or a change in the orientation. It has an orientation detection means for detecting the orientation of the housing,
2. The portable terminal device according to claim 1, wherein the musical sound changing unit changes a mode of the musical sound data based on detection results of the inclination detecting unit and the azimuth detecting unit.

Images