JP2004163511A - Mobile terminal device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To compose and play music corresponding to contents of text data at low cost in a simple manner without the aid of a server system. <P>SOLUTION: A portable telephone set 1 automatically composes and plays the music corresponding to the contents of displayed electronic mail according to the electronic mail displayed on a display part 2. As a result, a user can appreciate the music corresponding to the contents of the electronic mail without accessing the server system. Also, the user is able to utilize automatic composition services without paying communication charges. Namely, the music corresponding to the contents of the electronic mail can simply be composed and played at the low cost through the portable terephone set 1 without through the server system. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a portable terminal device that composes and reproduces music corresponding to the contents of text data such as e-mails and web pages.
[0002]
[Prior art]
2. Description of the Related Art In recent years, in response to receiving an e-mail transmitted by a user via a terminal device, a server device composes music corresponding to the content of the received e-mail (see, for example, Patent Document 1). According to such a system, the user can always listen to music composed according to the content of the e-mail by calling the server device via the telephone line.
[0003]
[Patent Document 1]
JP 2001-209592 A
[0004]
[Problems to be solved by the invention]
However, in the above-described conventional automatic music composition system, since the processing of composing and storing music is all performed on the server device side, the user needs to make a telephone call every time a music composition request or appreciation is made. It is necessary to access the server device via the line, and it is not possible to easily enjoy music composed according to the content of the e-mail.
[0005]
Further, in the conventional automatic music system as described above, music composed according to the content of the e-mail is provided to the user via the telephone line, so that all the composed music is By the end of listening, the user must pay a large communication fee, and cannot use the automatic music service using electronic mail at low cost.
[0006]
The present invention has been made in view of such a problem, and an object of the present invention is to be able to easily and inexpensively compose and reproduce music corresponding to the contents of text data without using a server device. A portable terminal device is provided.
[0007]
[Means for Solving the Problems]
The features of the portable terminal device according to the present invention include a display unit that displays text data, a storage unit that stores a plurality of keywords associated with numerical values that control at least the brightness of music, and text data that is displayed on the display unit. A control unit that searches for the keywords contained in the text and composes music corresponding to the content of the text data displayed on the display unit based on the numerical value associated with the searched keyword, and the text data is displayed on the display unit And a reproducing unit that reproduces and outputs music composed by the control unit.
[0008]
That is, in the portable terminal device according to the present invention, in response to the text data being displayed on the display unit, the control unit automatically composes music corresponding to the content of the displayed text data, and the playback unit composes the music. To play music.
[0009]
Thereby, the user can enjoy music corresponding to the content of the e-mail without accessing the server device. In addition, the user can use the automatic music service without paying the communication fee.
[0010]
That is, according to the portable terminal device, music corresponding to the content of the e-mail can be composed and reproduced easily and inexpensively without the intervention of the server device.
[0011]
BEST MODE FOR CARRYING OUT THE INVENTION
The present invention can be applied to, for example, a mobile phone as shown in FIG. Hereinafter, the configuration and operation of a mobile phone according to an embodiment of the present invention will be described in detail with reference to the drawings.
[0012]
[Overview of mobile phones]
First, with reference to FIG. 1, an outline configuration of a mobile phone according to an embodiment of the present invention will be described.
[0013]
As shown in FIG. 1, a mobile phone 1 according to an embodiment of the present invention includes a display unit 2, an operation input unit 3, an earpiece 4, and a mouthpiece 5 as main components.
[0014]
The display unit 2 includes a display device such as an LCD (Liquid Crystal Display) or an EL (Electro Luminescence) panel. Characters, numbers, symbols, and the like are controlled under the control of a CPU (Central Processing Unit, see FIG. 2) 15 described later. Visually display icons, cursors, images, moving images, etc.
[0015]
The operation input unit 3 includes, for example, input of numbers from "0" to "9", input of kana characters, input of alphabet characters, input of symbols, input of transmission and reception instructions, and input of power on / off instructions. It has a plurality of key buttons 6 used for operations such as. The operation input unit 3 has a dial (jog dial) 7 used for operations such as a movement operation of a cursor displayed on the display unit 2 and a scroll operation of a screen. The earpiece 4 and the mouthpiece 5 are respectively connected to a speaker and a microphone (see FIG. 2), which will be described later, and are used when the user makes a voice call with the other party.
[0016]
[Internal Configuration of Mobile Phone and Its Basic Operation]
Next, an internal configuration of the mobile phone 1 and a basic operation thereof will be described with reference to FIG. Note that the configurations and operations of the display unit 2 and the operation input unit 3 are as described above, and a description thereof will be omitted below.
[0017]
In the mobile phone 1 shown in FIG. 2, the microphone 8 connected to the mouthpiece 5 (see FIG. 1) converts a user's call voice into an analog voice signal. Then, the analog audio signal is amplified by an amplifier (not shown) and then input to a DSP (Digital Signal Processor) 9.
[0018]
When the analog audio signal is input, the DSP 9 converts the analog audio signal from analog to digital (A / D) at a predetermined sampling rate. The DSP 9 adds a CRC (Cyclic Redundancy Check) code to the digital audio data obtained by the A / D conversion for each transport block (TB), and performs channel coding (error correction coding) and interleaving processing. Is applied. Note that the transport block indicates a basic unit of data processed by the physical layer (a unit in which data is transferred from a MAC (Medium Access Control) layer to the physical layer).
[0019]
Also, the DSP 9 performs data modulation processing after adding overhead for channel determination such as pilot bits to the bit sequence after the interleaving processing, and performs in-phase (In-Phase) on a data modulation mapped phase plane. ) And quadrature components are spread with two-layer spreading code sequences. Then, the DSP 9 limits the band of the spread chip data sequence to a predetermined band (5 MHz) using a raised cosine root Nyquist filter, converts the band to a digital signal (D / A), and converts the analog signal to a transmitting unit. Output to 10
[0020]
When an analog signal is input from the DSP 9, the transmitting unit 10 orthogonally demodulates the analog signal, and frequency-converts the orthogonally demodulated intermediate frequency signal into a high-frequency signal (2 GHz band RF signal). Then, the transmission unit 10 amplifies the high-frequency signal and outputs the amplified high-frequency signal to the duplexer 11 as a transmission signal.
[0021]
The duplexer 11 is an antenna sharing device. That is, the duplexer 11 shares one antenna 12 for the transmission signal and the reception signal, sends the reception signal from the antenna 12 to the reception unit 13, and sends the transmission signal from the transmission unit 10 to the antenna 12. It is composed of a filter circuit having a function.
[0022]
The receiving unit 13 amplifies the high-frequency reception signal supplied via the antenna 12 and the duplexer 11, and frequency-converts the amplified reception signal into an intermediate-frequency signal. Then, the receiving unit 13 linearly amplifies the intermediate frequency signal by automatic gain control, and inputs the linearly amplified intermediate frequency signal to the DSP 9. At this time, the DSP 9 performs quadrature detection (Quadrature Detection) on the signal from the receiving unit 13 and performs A / D conversion on the in-phase and quadrature component analog signals obtained by the quadrature detection at a predetermined sampling rate. Then, the DSP 9 limits the band of the in-phase and quadrature components converted into digital values by the A / D conversion with the raised cosine root Nyquist filter, and then despreads the spread signals with the same spread code as the spread code of the received signal. Time separation into a plurality of multipath components having different propagation delay times.
[0023]
Also, the DSP 9 performs coherent lake synthesis on the data of each time-separated path, deinterleaves and channel-decodes the data sequence after the coherent lake synthesis, performs binary data determination, and transmits the data to the destination terminal. Play the data series. Then, the DSP 9 discriminates the reproduced data series into audio data and other communication data. The voice data is D / A-converted by the DSP 9, further amplified by an amplifier (not shown), and then sent to a speaker 14 built in the earpiece 4 (see FIG. 1). The speaker 14 is driven by the amplified analog audio signal. As a result, the call voice from the mobile phone of the call partner is emitted from the speaker 14.
[0024]
The DSP 9 analyzes what kind of data the communication data is, and performs a process corresponding to the analysis result. For example, when the communication data is text data such as an e-mail, the DSP 9 sends the text data to the CPU 15, and the CPU 15 controls the display of the text data on the display unit 2. For example, when the communication data is compressed image data, the DSP 9 decompresses the compressed image data and sends it to the CPU 15, and the CPU 15 controls the display of the image data on the display unit 2. For example, when the communication data is compressed audio data, the DSP 9 expands the compressed audio data and outputs the audio data to the speaker 14 or the speaker 16.
[0025]
The recording unit 17 is configured by a rewritable memory such as a flash memory which does not require a storage holding operation. The recording unit 17 includes an application program recording unit 19 that stores various application programs such as an address book function program, a schedule book function program, a user profile registration function program, an e-mail transmission / reception function program, and an automatic music program 18.
[0026]
The recording unit 17 stores various data such as address book data, schedule data, profile data, transmitted / received e-mails, automatic music processing data 20 (to be described in detail later), and performance data created by the automatic music processing. A data recording unit 21 for storing is provided. Further, the recording unit 17 stores setting data including values that can be arbitrarily set by the user among various setting values of the mobile phone. Note that all or a part of the information stored in the application program recording unit 19 and the data recording unit 21 may be received via a communication line.
[0027]
A ROM (Read Only Memory) 22 stores various computer programs such as a control program (not shown) for the CPU 15 to control each unit, various initial setting values, and font data. The ROM 22 stores a reproduction program 23 for reproducing the performance data created by the automatic music function.
[0028]
Note that the ROM 22 may be a rewritable ROM such as an EEPROM (Electrically Erasable and Programmable Read Only Memory). Further, in the portable telephone 1, the CPU 15 reproduces the performance data by software using the reproduction program 23. For example, a dedicated sound source circuit is provided inside the portable telephone 1, and the CPU 15 inputs the performance data to the sound source circuit. Thus, the performance data may be reproduced.
[0029]
A RAM (Random Access Memory) 24 functions as a work area when the CPU 15 performs various processes, and stores data as needed. The CPU 15 executes the computer programs stored in the recording unit 17 and the ROM 22, thereby controlling the operation of each unit in the mobile phone 1 according to the computer programs and performing various arithmetic processes.
[0030]
The camera unit 25 includes an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and an optical system that forms an optical image of a subject or the like on the image sensor. is there. Then, the image data captured by the camera unit 25 is input to the DSP 9. The DSP 9 that has received the image data from the camera unit 25 sends the image data to the CPU 15, and the CPU 15 controls the display on the display unit 2 based on the image data. The DSP 9 can also compress the image data as necessary, and send the compressed image data to the transmission unit 10 as transmission data. Further, the compressed image data can be recorded in the recording unit 17 via the CPU 15.
[0031]
The short-range wireless communication unit 26 and its antenna 27 are for performing wireless communication of a so-called Bluetooth system. Note that the Bluetooth system is a system for realizing wireless networking between a plurality of electronic devices. This Bluetooth system has been formulated in the Bluetooth SIG (Special Interest Group), and is disclosed in detail in “Bluetooth (TM) Special Interest Group, Bluetooth Specification Version 1.0”.
[0032]
[Operation of mobile phone]
[Automatic music processing]
The mobile phone 1 composes and outputs music corresponding to the content of the e-mail displayed on the display unit 2 when the user is browsing the e-mail received via the display unit 2 (hereinafter, referred to as “mobile phone”). This processing is referred to as automatic music processing). In this embodiment, the mobile phone 1 composes music at the time of browsing the e-mail. However, when the user transmits the e-mail (when the dial 7 is pressed) or browses a web page, the mobile phone 1 displays the music. The automatic music process may be executed when the text data is displayed. Hereinafter, the operation of the mobile phone 1 when executing the automatic music process will be described in detail with reference to the flowchart shown in FIG.
[0033]
The flowchart shown in FIG. 3 starts when the user operates the operation input unit 3 to display the received e-mail on the display unit 2, and the automatic music process proceeds to the process of step S1.
[0034]
In the process of step S1, the CPU 15 loads the automatic music program 18 from the recording unit 17 into the RAM 24, and reads the text data of the electronic mail currently displayed on the display unit 2 into the RAM 24 according to the automatic music program 18. Thereby, the process of step S1 is completed, and the automatic music process proceeds from the process of step S1 to the process of step S2.
[0035]
In the process of step S2, the CPU 15 analyzes the text data according to the automatic music program 18, and generates music chord progression data, rhythm progression data, and melody progression data corresponding to the contents of the text data based on the analysis result. Is calculated (hereinafter, this process is referred to as a parameter calculation process). The details of the parameter calculation processing will be described later with reference to the flowchart shown in FIG. Thereby, the process of step S2 is completed, and the automatic music process proceeds from the process of step S2 to the process of step S3.
[0036]
In the process of step S3, the CPU 15 generates chord progression data of music corresponding to the content of the text data based on the calculated parameters according to the automatic music program 18 (hereinafter, this process is referred to as a chord generation process). The details of the code generation process will be described later with reference to the flowchart shown in FIG. Thus, the process of step S3 is completed, and the automatic music composition process proceeds from the process of step S3 to the process of step S4.
[0037]
In the process of step S4, the CPU 15 generates rhythm progress data of the music whose chord progression has been determined based on the calculated parameters according to the automatic music program 18 (hereinafter, this process is referred to as rhythm generation process). The details of the rhythm generation processing will be described later with reference to the flowchart shown in FIG. Thereby, the processing of step S4 is completed, and the automatic music composition processing proceeds from the processing of step S4 to the processing of step S5.
[0038]
In the process of step S5, the CPU 15 generates melody progression data of the music whose rhythm has been determined based on the calculation parameters according to the automatic music program 18 (hereinafter, this process is referred to as a melody generation process). The details of the melody generation processing will be described later with reference to the flowchart shown in FIG. Thus, the processing of step S5 is completed, and the automatic music composition processing proceeds from the processing of step S5 to the processing of step S6.
[0039]
In the process of step S6, the CPU 15 generates performance data of the composed music by background processing according to the generated chord progression data, rhythm progression data, and melody progression data. Here, the generated performance data is composed of a combination of musical scales and musical notes of a plurality of parts (sound sources). In this embodiment, for example, the performance data is composed of MIDI data such as a standard MIDI (Standard Musical Instruments Digital Interface) file. . The above-mentioned parts are composed of, for example, timbre information of musical instruments such as piano, organ, guitar, bass, violin, cello, harp, trumpet, saxophone, koto, marimba, flute, etc. (40 chords). Further, the performance data is generated so as to have a predetermined reproduction time. The performance data is not limited to the MIDI data format, and may be configured in another data format such as MP3 (MPEG Audio Layer-3). Thus, the processing of step S6 is completed, and the automatic music composition processing proceeds from the processing of step S6 to the processing of step S7.
[0040]
In the process of step S7, the CPU 15 determines whether or not other performance data is being reproduced. If the result of the determination indicates that other performance data is being reproduced, the automatic music processing proceeds from step S7 to step S10. On the other hand, when the other performance data is not being reproduced, the automatic music composition processing proceeds from the processing in step S7 to the processing in step S8.
[0041]
In the process of step S8, the CPU 15 switches the performance data to be reproduced from the previously reproduced performance data to the performance data generated in advance by the background process by the process of step S6. According to such processing, it is possible to eliminate the time loss until the performance data is reproduced, and to reproduce the performance data seamlessly. Thus, the process of step S8 is completed, and the automatic music process proceeds from the process of step S8 to the process of step S9.
[0042]
In the process of step S9, the CPU 15 interprets and processes the scales and notes of each part of the performance data to be reproduced according to the reproduction program 23, and emits the composed music from the speakers 14 and 16. Thus, the processing of step S9 is completed, and the automatic music composition processing proceeds from the processing of step S9 to the processing of step S10.
[0043]
In the processing of step S10, the CPU 15 determines whether or not the reproduction of the performance data has been completed, and in response to the completion of the reproduction of the performance data, this automatic music processing is changed from the processing of step S10 to the processing of step S11. Proceed. In this embodiment, the CPU 15 determines whether or not the reproduction of the performance data has ended by measuring the reproduction time using a timer.
[0044]
In the process of step S11, the CPU 15 determines whether or not the content of the e-mail displayed on the display unit 2 has changed due to a process such as a scroll operation by the user. Then, as a result of the determination, if the content of the e-mail displayed on the display unit 2 changes, the CPU 15 returns the automatic music processing from the processing in step S11 to the processing in step S8, and generates the electronic music generated in advance by the background processing. The performance data is switched to the performance data corresponding to the changed part of the mail. According to such processing, the CPU 15 can seamlessly reproduce the performance data corresponding to the content of the electronic mail displayed on the display unit 2. On the other hand, if the content of the e-mail displayed on the display unit 2 has not changed, the CPPU 15 returns the automatic music processing from the processing in step S11 to the processing in step S9. This series of automatic music processing is repeatedly executed until the user finishes browsing the received e-mail.
[0045]
In the automatic music process, the user may operate the operation input unit 3 so that performance data can be set so as not to be generated and reproduced. Further, when the mobile phone 1 is playing the performance data, the user may be able to stop the playback of the performance data. In addition, it is desirable that the CPU 15 compose music based on only the newly displayed text data in response to the newly displayed text data of one paragraph, one sentence, or one screen of the e-mail. Thus, the mobile phone 1 can play music that matches the development of the text of the e-mail. Further, it is desirable that the performance data created in the automatic music process can be stored in the recording unit 17 in accordance with an instruction from a user. The performance data stored in the recording unit 17 may be transmitted to another user via a communication line.
[0046]
[Parameter calculation processing]
Next, the parameter calculation process in step S2 will be described in detail with reference to the flowchart shown in FIG.
[0047]
The flowchart shown in FIG. 4 starts when the text data of the e-mail displayed on the display unit 2 is read, and the parameter calculation process proceeds to the process of step S21.
[0048]
In the process of step S21, the CPU 15 analyzes the structure of the text constituting the text data by executing a natural language analysis such as a morphological analysis on the read text data. Thus, the process of step S21 is completed, and the parameter calculation process proceeds from step S21 to step S22.
[0049]
In the process of step S22, the CPU 15 acquires a keyword such as "happy" or "sad" from the automatic music piece processing data 20 stored in the recording unit 17. Here, for each keyword, for example, a numerical value (α) for controlling the brightness (darkness) of music to be composed using a method such as p / n (positive / negative) evaluation proposed by Kobayashi et al. A numerical value (β) for controlling the tempo and a numerical value (γ) for controlling the intonation are associated with each other. However, since the meaning of some keywords changes depending on the context, it is desirable to change the numerical value associated with the keyword according to the text to which the keyword belongs and the context before and after the text. The details of the p / n evaluation are disclosed in "Creation of" p / n Dictionary Using Translations ", Materials of the Japanese Society for Artificial Intelligence Language and Speech Understanding and Dialogue Processing, SLUD-33, 2001. Thus, the process of step S22 is completed, and the parameter calculation process proceeds from step S22 to step S23.
[0050]
In the process of step S23, the CPU 15 determines whether or not the acquired keyword is included in the text data based on the result of the natural language analysis of the text data. Then, as a result of the determination, if the acquired keyword is not included, the parameter calculation process proceeds from the process of step S23 to the process of step S25. On the other hand, when the acquired keyword is included, the parameter calculation process proceeds from the process of step S23 to the process of step S24.
[0051]
In the process of step S24, the CPU 15 stores the numerical values α, β, and γ associated with the acquired keywords in the RAM 24. If the values of the numerical values α, β, and γ have already been stored in the RAM 24 after the second processing, the CPU 15 adds the newly stored numerical value to each of the numerical values already stored. However, if the stored numerical value is created based on other text data, the CPU 15 deletes the numerical value and then stores a new numerical value in the RAM 24. Thus, the process of step S24 is completed, and the parameter calculation process proceeds from step S24 to step S25.
[0052]
In the process of step S25, the CPU 15 determines whether or not an unprocessed (unacquired) keyword is included in the automatic music processing data 20. If the result of the determination is that an unprocessed keyword is included, the parameter calculation process returns from the process of step S25 to the process of step S22. On the other hand, when an unprocessed keyword is not included, the parameter calculation process proceeds from the process of step S25 to the process of step S26.
[0053]
In the process of step S26, the CPU 15 determines the tune, speed, genre, motif (chord), rhythm, melody, accompaniment, drum progress rules of the music based on the numerical values α, β, γ stored in the RAM. Is calculated. Note that these parameters form a music rule (for example, “C”). This music rule can be changed to a new music rule (for example, “Cm” or “C7”) by dynamically rearranging parameters according to the genre such as “pops” or “classical”. Thereby, the number of music rules to be stored in the mobile phone 1 can be minimized along with the flexible melody generation, whereby the processing in step S26 is completed, and a series of parameter calculation processing ends.
[0054]
Note that the above music rules are theoretically summaries of the “chord progression”, “sound flow”, “sounding beauty”, etc. established by many people over and over. is there. Details of the music rules are described in, for example, JP-A-2002-23747.
[0055]
[Code generation processing]
Next, the code generation processing in step S3 will be described in detail with reference to the flowchart shown in FIG. The flowchart shown in FIG. 5 starts when the parameter calculation process is completed, and the code generation process proceeds to a process of step S31.
[0056]
In the processing of step S31, the CPU 15 determines the chord of the bar to be played first according to the parameters calculated in the parameter calculation processing. Thereby, the process of step S31 is completed, and the code generation process proceeds from the process of step S31 to the process of step S32.
[0057]
In the process of step S32, the CPU 15 selects the next bar code candidate (from the automatic music processing data 20) in accordance with the music rule specified in the previous code so that the codes do not become unnaturally connected. Code candidates). Thus, the process of step S32 is completed, and the code generation process proceeds from step S32 to step S33.
[0058]
In the process of step S33, the CPU 15 generates a random number. Thus, the process of step S33 is completed, and the code generation process proceeds from the process of step S33 to the process of step S34.
[0059]
In the process of step S34, the CPU 15 determines the code of the next bar from the extracted code candidates according to the generated random numbers. Thus, the process of step S34 is completed, and the code generation process proceeds from step S34 to step S35.
[0060]
In the process of step S35, the CPU 15 generates a chord component (pitch) according to the parameter related to the genre calculated in the parameter calculation process, and applies the chord component to the determined chord. Thus, the process of step S35 is completed, and the code generation process proceeds from the process of step S35 to the process of step S36.
[0061]
In the process of step S36, the CPU 15 determines whether or not the processes of steps S32 to S35 have been executed for all measures within a predetermined playing time. Then, as a result of the determination, if the processing of steps S32 to S35 has not been executed for all measures, the code generation processing returns from the processing of step S36 to the processing of step S32. On the other hand, when the processing of steps S32 to S35 has been executed for all measures, the CPU 15 stores the result of the above processing in the RAM 24 as chord progression data as the processing of step S37. Thus, the process of step S37 is completed, and a series of code generation processes ends.
[0062]
In order to generate more flexible chord progression patterns, some established chord progression patterns are stored in advance in the automatic music processing data 20 for each genre, and the chord generation processing is executed. It is desirable that the CPU 15 learns each time based on the processing result.
[0063]
[Rhythm generation processing]
Next, the rhythm generation processing in step S4 will be described in detail with reference to the flowchart shown in FIG. The flowchart shown in FIG. 6 starts when the chord generation processing is completed, and the rhythm generation processing proceeds to the processing of step S41.
[0064]
In the process of step S41, the CPU 15 determines a note to be played first according to the parameters calculated in the parameter calculation process. Thereby, the process of step S41 is completed, and the rhythm generation process proceeds from the process of step S41 to the process of step S42.
[0065]
In the processing of step S42, the CPU 15 selects a note candidate at the next beat count from the automatic music piece processing data 20 according to the music rule specified for the previous note so that the notes are not connected unnaturally. (Note candidate). Thereby, the process of step S42 is completed, and the rhythm generation process proceeds from the process of step S42 to the process of step S43.
[0066]
In the process of step S43, the CPU 15 generates a random number. Thereby, the process of step S43 is completed, and the rhythm generation process proceeds from the process of step S43 to the process of step S44.
[0067]
In the process of step S44, the CPU 15 determines a note at the next beat number from the extracted note candidates according to the generated random number. Thus, the process of step S44 is completed, and the rhythm generation process proceeds from step S44 to step S45.
[0068]
In the process of step S45, the CPU 15 determines whether or not the processes of steps S42 to S44 have been performed on the number of beats for a predetermined performance time. If it is determined that the processes of steps S42 to S44 have not been executed for the number of beats for the predetermined performance time, the rhythm generation process returns from the process of step S45 to the process of step S42. On the other hand, when the processing in steps S42 to S44 has been performed on the number of beats for the predetermined performance time, the CPU 15 stores the result of the processing in the RAM 24 as rhythm progress data in step S46. Thereby, the processing of step S46 is completed, and a series of rhythm generation processing ends.
[0069]
In order to generate a more flexible rhythm progression, several established rhythm progression patterns are stored in advance in the automatic music piece processing data 20 for each genre, and the rhythm generation process is executed. It is desirable that the CPU 15 learns each time based on the processing result.
[0070]
[Melody generation processing]
Next, the melody generation processing in step S5 will be described in detail with reference to the flowchart shown in FIG. The flowchart shown in FIG. 7 starts when the rhythm generation processing is completed, and the melody generation processing proceeds to the processing of step S51.
[0071]
In the process of step S51, the CPU 15 reads the rhythm progress data generated by the rhythm generation process, and searches for a note for which the melody generation process has not been performed. Thus, the process of step S51 is completed, and the melody generation process proceeds from step S51 to step S52.
[0072]
In the processing of step S52, the CPU 15 determines whether or not a note that has not been subjected to the melody generation processing has been searched as a result of the search. Then, as a result of the discrimination, if a note that has not been subjected to the melody generation processing is not retrieved, the melody generation processing proceeds from the processing of step S52 to the processing of step S57. On the other hand, when a note that has not been subjected to the melody generation processing is found, the melody generation processing proceeds from the processing in step S52 to the processing in step S53.
[0073]
In the process of step S53, the CPU 15 extracts a melody rule candidate applicable to a note from the automatic music piece processing data 20. Thus, the process of step S53 is completed, and the melody generation process proceeds from the process of step S53 to the process of step S54.
[0074]
In the process of step S54, the CPU 15 generates a random number. Thereby, the process of step S54 is completed, and the melody generation process proceeds from the process of step S54 to the process of step S55.
[0075]
In the process of step S55, the CPU 15 selects a melody rule from the melody rule candidates extracted according to the generated random numbers, and applies the selected melody rule to the searched musical note. Thus, the process of step S55 is completed, and the melody generation process proceeds from step S55 to step S56.
[0076]
In the process of step S56, the CPU 15 generates a melody generation rule in accordance with the genre parameters calculated in the parameter calculation process, and applies the generated melody generation rule to the searched notes. Thereby, the process of step S56 is completed, and the melody generation process returns from the process of step S56 to the process of step S51.
[0077]
In the process of step S57, the CPU 15 stores the result of the above process in the RAM 24 as melody progress data. Thus, the process of step S57 is completed, and a series of melody generation processes ends.
[0078]
In order to make it possible to generate a more flexible melody progression, some established melody progression patterns are stored in advance in the automatic music processing data 20 for each genre, and the melody generation process is executed. It is desirable that the CPU 15 learns each time based on the processing result.
[0079]
[Effects of Embodiment]
As is apparent from the above description, the mobile phone 1 according to one embodiment of the present invention automatically plays music corresponding to the content of the displayed email in response to the display of the email on the display unit 2. Since the user composes and reproduces the music, the user can enjoy the music corresponding to the contents of the e-mail without accessing the server device. Further, according to such a configuration, since the music composition and reproduction processing are all performed on the mobile phone 1, the user can use the automatic music service without paying a communication fee. That is, according to the mobile phone 1, music corresponding to the content of the e-mail can be composed and reproduced easily and inexpensively without the intervention of the server device.
[0080]
Further, when the user changes the content of the e-mail displayed on the display unit 2 by a scroll operation, the mobile phone 1 according to an embodiment of the present invention composes and reproduces music corresponding to the change in the content again. Therefore, music corresponding to the content of the displayed e-mail can always be reproduced.
[0081]
Further, the mobile phone 1 according to the embodiment of the present invention composes and reproduces music corresponding to the content of the e-mail when the user is browsing the e-mail. The communication can be performed by both the auditory and the auditory approaches, and conversely, the recipient of the e-mail can understand the contents of the e-mail with two senses, the visual sense and the auditory sense.
[0082]
Further, in the mobile phone 1 according to the embodiment of the present invention, the user can make settings for composing and reproducing music (motif melody settings) and music as disclosed in, for example, JP-A-2002-32078. There is no need to prepare data for composing and playing back, and the automatic music service can be used easily. In addition, since the mobile phone 1 determines a music rule to be applied when composing music according to random numbers, it is possible to flexibly compose music according to the content of an e-mail and to compose a variety of music. Becomes possible.
[0083]
[Other embodiments]
As described above, the configuration and operation of the embodiment to which the invention made by the present inventor is applied have been described. However, the present invention is not limited to the description and the drawings that constitute a part of the disclosure of the present invention according to this embodiment. Absent. For example, in the above-described embodiment, the present invention is applied to a mobile phone. However, the present invention is applied to any information processing apparatus having a music reproducing function, such as a personal computer or a PDA (Personal Digital Assistant). be able to. As described above, it is added that other embodiments, examples, operation techniques, and the like performed by those skilled in the art based on the above-described embodiments are all included in the scope of the present invention.
[0084]
【The invention's effect】
According to the present invention, music corresponding to the contents of text data can be composed and reproduced easily and inexpensively without the intervention of a server device.
[Brief description of the drawings]
FIG. 1 is a schematic view illustrating an appearance of a mobile phone according to an embodiment of the present invention.
FIG. 2 is a block diagram showing an internal configuration of the mobile phone shown in FIG.
FIG. 3 is a flowchart showing a flow of automatic music composition processing according to an embodiment of the present invention.
FIG. 4 is a flowchart illustrating a flow of a parameter calculation process illustrated in FIG. 3;
FIG. 5 is a flowchart illustrating a flow of a code generation process illustrated in FIG. 3;
FIG. 6 is a flowchart showing a flow of a rhythm generation process shown in FIG. 3;
FIG. 7 is a flowchart showing a flow of a melody generation process shown in FIG. 3;
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... Cellular telephone, 2 ... Display part, 3 ... Operation input part, 4 ... Earpiece, 5 ... Mouthpiece, 6 ... Key button, 7 ... Dial, 8 ... Microphone, 9 ... DSP (Digital Signal Processor), 10 ... Transmitting part, 11 ... Duplexer, 12, 27 ... Antenna, 13 ... Receiving part, 14,16 ... Speaker, 17 ... Recording part, 18 ... Automatic music program, 19 ... Application program recording part, 20 ... Automatic music processing data , 21: Data recording unit, 22: ROM (Read Only Memory), 23: Playback program, 24: RAM (Random Access Memory), 25: Camera unit, 26: Short-range wireless communication unit

Claims (3)

A display for displaying text data,
A storage unit that stores a plurality of keywords associated with a numerical value that controls at least light and shade of music;
A control for searching for the keyword included in the text data displayed on the display unit and composing music corresponding to the content of the text data displayed on the display unit based on a numerical value associated with the searched keyword. Department and
A portable terminal device comprising: a reproducing unit that reproduces and outputs music composed by the control unit in response to the text data being displayed on the display unit. The mobile terminal device according to claim 1,
An operation unit for scrolling the text data displayed on the display unit,
The control unit composes music corresponding to the content of the text data newly displayed on the display unit in response to the scrolling of the text data,
The portable terminal device, wherein the reproducing unit reproduces and outputs music corresponding to the content of the newly displayed text data. The mobile terminal device according to claim 1,
The portable terminal device, wherein the keyword is associated with at least a numerical value for controlling tempo and intonation of music.

Images