JP2006202321A - Information processor, information processing method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To transform a URL and an electronic mail address included in text data of an electronic mail into a predetermined registered words for outputting them in voice. <P>SOLUTION: A mail watcher application control part 281 carries out processing for transforming the electronic mail received by an MAPI mailer 282 into voice data. The mail watcher application control part 281 outputs the URL and the electronic mail address included in the text data of the electronic mail inputted from the MAPI mailer 282 toward a URL-mail address filter 289 for replacing them by predetermined mnemonic-names. When the inputted text includes a URL and a mail address matching that registered in the URL-mail address table 290, the URL-mail address filer 289 transforms them into registered mnemonic-names to output them to the mail watcher application control part 281. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information processing device, an information processing method, and a program, and more particularly, to an information processing device, an information processing method, and a program suitable for use when converting text data into speech data by speech synthesis.

  2. Description of the Related Art Conventionally, there is a technique for converting text data into voice data and reproducing the voice, such as software that synthesizes a sentence key-input to a personal computer and reads it out. This technique is applied to, for example, browsing a web page, reading an e-mail, or reading text data designated by a user.

  However, when the input text data is directly converted into voice data, for example, the URL of a web page, an e-mail address, etc. are read out as a list of alphabets and are more difficult to understand than seeing them as characters. If it is set to be converted into an appropriate romaji reading, it may be converted into meaningless speech.

  The present invention divides the body of an e-mail into a quoted sentence and a part that is not (the part where the quoted sentence is multiplexed is also that part), and the reading voice of the e-mail is the attribute of the text (here Then, it can be set to be changed and output depending on whether or not it is a quoted sentence or a hierarchy of quoted sentences.

  An information processing apparatus according to an aspect of the present invention is an information processing apparatus that synthesizes speech data corresponding to text data included in an e-mail, and includes a storage unit that stores a plurality of types of reading speech, Attribute classification means for classifying the attribute of the text data based on a citation symbol added for each line and the number of the citation symbols, and the storage means for each attribute of the text data classified by the attribute classification means Voice data synthesizing means for synthesizing the voice data corresponding to the text data included in the e-mail using the different kinds of the reading voices from the plurality of kinds of reading voices stored by Output means for outputting the voice data synthesized by the data synthesis means.

  The display control means for controlling the display of information for assisting the user's operation input and the operation input means for receiving the user's operation input can be further provided, and the display control means includes the attribute It is possible to control the display of the information to assist the user's operation input for setting each reading voice from a plurality of types of reading voices. In accordance with the user's operation input, which is input by the operation input unit and refers to the information whose display is controlled by the display control unit, a read-out sound for each attribute is selected from among a plurality of types of the read-out speech. By setting, the voice data corresponding to the text data included in the electronic mail can be synthesized.

  Operation input means for receiving a user's operation input, and speech-to-speech generation means for setting parameters relating to voice characteristics in accordance with the user's operation input by the operation input means and generating the speech to be read out The storage means may store the reading voice generated by the reading voice generation means.

  An information processing method according to an aspect of the present invention is an information processing method for an information processing apparatus that synthesizes voice data corresponding to text data included in an e-mail using a plurality of types of reading voices stored in a storage unit. And an attribute classification step for classifying the attribute of the text data based on a quotation mark added to each line of the text data and the number of the quotation marks, and the classification performed by the processing of the attribute classification step For each attribute of the text data, the voice data corresponding to the text data included in the e-mail is obtained by using different types of the reading voices from the plurality of kinds of reading voices stored in the storage unit. A voice data synthesis step to be synthesized, and output of the voice data synthesized by the processing of the voice data synthesis step; And an output control step for.

  A program according to an aspect of the present invention is a program for causing a computer to execute a process of synthesizing voice data corresponding to text data included in an e-mail using a plurality of types of reading voices stored in a storage unit. And an attribute classification step for classifying the attribute of the text data based on a quotation mark added to each line of the text data and the number of the quotation marks, and the classification performed by the processing of the attribute classification step For each attribute of the text data, the voice data corresponding to the text data included in the e-mail is obtained by using different types of the reading voices from the plurality of kinds of reading voices stored in the storage unit. A voice data synthesis step to synthesize, and the sound synthesized by the processing of the voice data synthesis step To execute processing that includes an output control step of controlling the output of data to the computer.

  In one aspect of the present invention, a plurality of types of reading voices are stored, and the attributes of the text data are classified based on the quotation marks added to each line of the text data included in the e-mail and the number of quotation marks. For each attribute of the classified text data, speech data corresponding to the text data included in the e-mail is synthesized from a plurality of types of speech, using different types of speech, and the synthesized speech data is Is output.

  According to one aspect of the present invention, voice data corresponding to text data can be output. In particular, text data included in an e-mail is classified based on the number of quotation marks and quotation marks. Different audio data can be associated with each other and synthesized.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  A network system for executing transmission / reception of e-mails and web page browsing will be described with reference to FIG.

  A personal computer 2-1 or 2-2 is connected to the public line network 1. In addition, the public line network 1 includes PDA 4− via base stations 3-1 to 3-4, which are fixed wireless stations, which are arranged in cells each having a communication service area divided into a desired area. 1 or 4-2, or a digital cellular phone with a camera 5-1 or 5-2 is connected.

  The base stations 3-1 to 3-4 are mobile radio stations such as PDAs 4-1 and 4-2 and camera-equipped digital cellular phones 5-1 and 5-2, for example, W-CDMA (Wideband Code Division Multiple Access). ) And wirelessly connected by PDA 4-1 and 4-2, which are mobile radio stations, and digital mobile phones with camera 5-1 and 5-2, using a frequency band of 2 GHz, up to 2 Mbps Large-capacity data can be transmitted at high speed with a data transfer speed of.

  Since the PDA 4-1 and 4-2 and the camera-equipped digital cellular phone 5-1 and 5-2 can perform high-speed data communication with the base stations 3-1 to 3-4 using the W-CDMA system, In addition to calls, various types of data communication such as transmission / reception of electronic mail, browsing of a simple homepage, transmission / reception of images, and the like can be performed.

  The base stations 3-1 to 3-4 are connected to the public line network 1 through wired lines. The public line network 1 is connected to the Internet 6, a subscriber wired terminal device (not shown), a computer network, a corporate network, and the like.

  The access server 7 of the Internet service provider is connected to the public network 1, and is further connected to a content server 8 and an e-mail server 9 owned by the Internet service provider.

  The content server 8 responds to a request from a subscriber wired terminal device, PDA 4-1 or 4-2, a digital cellular phone with a camera 5-1 or 5-2, or a personal computer 2-1 or 2-2. Thus, for example, content such as a simple homepage is provided as a file in HTML (Hypertext Markup Language) format or compact HTML format.

  The e-mail server 9 is a server that manages transmission / reception of e-mails. The e-mail server 9 includes an SMTP server for transmission and a POP server for reception. The mail transmitted from the SMTP server is not directly delivered to the destination POP server, but is sent to the destination POP server through several servers on the Internet 6. The receiving POP server temporarily stores the received e-mail in the mailbox. The user who receives the e-mail uses the PDA 4-1 or 4-2, the camera-equipped digital cellular phone 5-1 or 5-2, or the personal computer 2-1 or 2-2 to use the electronic The mail server 9 is accessed each time and an e-mail is received.

  A number of WWW (World Wide Web) servers 10-1 to 10 -N are connected to the Internet 6. The WWW servers 10-1 to 10-N are connected to subscriber wired terminal devices, PDAs 4-1 and 4-2, camera-equipped digital mobile phones 5-1 and TCP (Transmission Control Protocol) / IP (Internet Protocol) protocols, respectively. 5-2 and personal computers 2-1 and 2-2.

  Incidentally, the PDAs 4-1 and 4-2, and the digital mobile phones with cameras 5-1 and 5-2 communicate with the base stations 3-1 to 3-4 by a simple transport protocol of 2 Mbps, and the base station 3- 1 to 3-4, the Internet 6, and the WWW servers 10-1 to 10-N are communicated by TCP / IP.

  The management control device 11 is connected to the subscriber wired terminal devices, PDAs 4-1 and 4-2, camera-equipped digital cellular phones 5-1 and 5-2, and personal computers 2-1 and 2- through the public network 1. 2 for performing authentication processing or charging processing for subscriber wired terminal devices, PDAs 4-1 and 4-2, digital mobile phones with cameras 5-1 and 5-2, and personal computers 2-1 and 2-2. To do.

  Hereinafter, when the personal computers 2-1 and 2-2 do not need to be individually distinguished, they are simply referred to as the personal computer 2 and when the base stations 3-1 to 3-4 do not need to be individually distinguished, When it is called the base station 3 and it is not necessary to individually distinguish the PDAs 4-1 and 4-2, it is simply referred to as the PDA 4 and it is not necessary to individually distinguish the digital mobile phones with a camera 5-1 and 5-2. This is simply referred to as a digital mobile phone with camera 5.

  2 to 5 show the external appearance of the personal computer 2.

  The personal computer 2 basically includes a main body 21 and a display unit 22 that can be opened and closed with respect to the main body 21. FIG. 2 is an external perspective view showing a state where the display unit 22 is opened with respect to the main body 21. FIG. 3 is a plan view of the main body 21, and FIG. 4 is an enlarged view of a jog dial 23 described later provided on the main body 21. FIG. 5 is a side view of the jog dial 23 provided on the main body 21.

  The main body 21 includes a keyboard 24 operated when inputting various characters and symbols, a touch pad 26 as a pointing device operated when moving a pointer (mouse cursor) displayed on the LCD 25, and a power source. A switch 27 is provided on the upper surface. A jog dial 23 and an IEEE (Institute of Electrical and Electronics Engineers) 1394 port 28 are provided on the side of the main body 21. Instead of the touch pad 26, a stick-type pointing device can be provided.

  Further, an LCD (Liquid Crystal Display) 25 for displaying an image is displayed on the front of the display unit 22, and a power lamp PL, a battery lamp BL, and a message lamp ML (not shown) provided as necessary on the upper right part. A lamp made of other LEDs is provided. Furthermore, an imaging unit 30 having a CCD video camera 29 equipped with a CCD (solid-state imaging device) and a microphone 31 are provided in the upper central portion of the display unit 22. A shutter button 32 for operating the CCD video camera 29 is provided on the upper right side of the main body 21 in FIG.

  The imaging unit 30 is fixed to the display unit 22 so as to be rotatable. For example, the imaging unit 30 is capable of imaging the same direction as the line of sight of the user operating the personal computer 2 from a position where the CCD video camera 29 can image the user operating the personal computer 2 by user operation. Is rotated.

  Next, for example, the upper surface of the jog dial 23 is approximately the same height as the keys A and B between the keys A and B arranged on the right side of the keyboard 24 on the main body 21 in FIG. It is attached as follows. The jog dial 23 executes predetermined processing (for example, screen scrolling processing) corresponding to the rotation operation indicated by the arrow a in FIG. 4, and processing corresponding to the movement operation indicated by the arrow b in FIG. Execute icon selection decision processing).

  The IEEE1394 port 28 has a structure based on the standard defined in IEEE1394, and a cable based on the standard defined in IEEE1394 is connected to the IEEE1394 port 28.

  Next, an example of the internal configuration of the personal computer 2 will be described with reference to FIG.

  A central processing unit (CPU) 51 is configured by, for example, a Pentium (registered trademark) processor manufactured by Intel, and is connected to the host bus 52. Further, a bridge 53 (so-called north bridge) is connected to the host bus 52, and the bridge 53 has an AGP (Accelerated Graphics Port) 50 and a PCI (Peripheral Component Interconnect / Interface) bus 56. It is connected to the.

  The bridge 53 is configured by, for example, 440BX, which is an AGP Host Bridge Controller manufactured by Intel Corporation, and controls the CPU 51, RAM (Random Access Memory) 54 (so-called main memory), and the like. Further, the bridge 53 controls the video controller 57 via the AGP 50. The bridge 53 and the bridge (so-called south bridge (PCI-ISA Bridge)) 58 constitute a so-called chip set.

  The bridge 53 is further connected to a cache memory 55. The cache memory 55 is configured by a memory such as an SRAM (Static RAM) that can execute a faster write or read operation than the RAM 54, and caches (temporarily stores) a program or data used by the CPU 51. .

  It should be noted that the CPU 51 has a cache that can operate at a higher speed than the cache memory 55 that is primary, and that is controlled by the CPU 51 itself.

  The RAM 54 is composed of, for example, a DRAM (Dynamic RAM), and stores a program executed by the CPU 51 or data necessary for the operation of the CPU 51. Specifically, the RAM 54 is loaded from the HDD 67 at a predetermined timing, for example, an e-mail program 54A, an autopilot program 54B, a jog dial state monitoring program 54C, a jog dial driver 54D, an operating program (OS) 54E, and a communication program. 54F, a web browser 54G, and other application programs 54H (including a mail watcher application, a web reader application, a mail reader application, and a text reading application described later) are stored.

  The electronic mail program 54 </ b> A is a program for exchanging communication text (electronic mail) via the modem 75, the public line network 1, the Internet service provider, the electronic mail server 9, and the Internet 6.

  The autopilot program 54B is a program for sequentially starting and processing a plurality of preset processes (or programs) in a preset order.

  The jog dial state monitoring program 54C receives a notification from each application program as to whether or not it corresponds to the jog dial 23, and if the corresponding application corresponds to the jog dial 23, what is done by operating the jog dial 23? The LCD 25 displays whether it can be performed.

  The jog dial state monitoring program 54C also detects an event of the jog dial 23 (an operation in which the jog dial 23 is rotated in the direction indicated by the arrow a in FIG. 4 or pressed in the direction indicated by the arrow b in FIG. 4). Execute the process corresponding to the detected event. The jog dial driver 54D executes various functions in response to operations of the jog dial 23.

  The OS (Operating System) 54E is a basic computer such as the so-called Windows (registered trademark) 95 or Windows (registered trademark) 98 of Microsoft Corporation or the so-called Mac OS (registered trademark) of Apple Computer. It is a program that controls the operation.

  The communication program 54F executes processing for peer-to-peer communication and controls the e-mail program 54A to establish the communication connection so that the e-mail attached with the IP address of the personal computer 2 is sent to the communication partner. Or an IP address is acquired from a predetermined e-mail transmitted from a communication partner.

  The communication program 54F also controls the web browser 54G to perform communication based on the function of the web browser 54G.

  The web browser 54G executes processing for browsing data of a predetermined web page (displaying on the display unit 22) according to control by the communication program 54F.

  The application program 54H includes various application programs such as a mail watcher application, a web reader application, a mail reader application, and a text reading application, which will be described later.

  The video controller 57 is connected to the bridge 53 via the AGP 50, receives data (image data or text data) supplied from the CPU 51 via the AGP 50 and the bridge 53, and an image corresponding to the received data. Data is generated, and the generated image data or received data is stored as it is in a built-in video memory. The video controller 57 causes the LCD 25 of the display unit 22 to display an image corresponding to the image data stored in the video memory.

  Further, the video controller 57 supplies the video data supplied from the CCD video camera 29 to the RAM 54 via the PCI bus 56.

  A sound controller 64 is connected to the PCI bus 56. The sound controller 64 takes in sound from the microphone 31, generates data corresponding to the sound, and outputs the data to the RAM 54. The sound controller 64 drives the speaker 65 and causes the speaker 65 to output sound.

  A modem 75 is connected to the PCI bus 56. The modem 75 is connected to the public line network 1 and executes communication processing via the public line network 1 or the Internet 6.

  The PC card slot interface 111 is connected to the PCI bus 56 and supplies the data supplied from the interface card 112 installed in the slot 33 to the CPU 51 or the RAM 54 and outputs the data supplied from the CPU 51 to the interface card 112. To do. The drive 113 is connected to the PCI bus 56 via the PC card slot interface 111 and the interface card 112.

  The drive 113 reads and reads data recorded on the magnetic disk 121, the optical disk 122, the magneto-optical disk 123, or the semiconductor memory 124 (including a Memory Stick (trademark) 131 described later with reference to FIG. 7). The data is supplied to the RAM 54 via the interface card 112, the PC card slot interface 111, and the PCI bus 56. In addition, data generated by the processing of the CPU 51 (for example, audio data generated by processing to be described later) is converted into a magnetic disk 121, an optical disk 122, a magneto-optical disk 123, or a semiconductor memory 124 (memory stick 131) mounted on the drive 113. ) Can be stored.

  It goes without saying that memory stick slots may be prepared individually so that the memory stick 131 can be connected without using the interface card 112 and the drive 113.

  Accordingly, since the personal computer 2 is configured so that the memory stick 131 can be mounted, the other electronic devices (for example, the PDA 4, the digital mobile phone with camera 5, or later will be described later with reference to FIG. 14) via the memory stick 131. Data can be shared with a portable music player 271 or the like.

  A bridge 58 (so-called south bridge) is also connected to the PCI bus 56. The bridge 58 is configured by, for example, PIIX4E manufactured by Intel Corporation, and incorporates an IDE (Integrated Drive Electronics) controller / configuration register 59, an IDE interface 61, a USB interface 68, and the like. The bridge 58 controls various devices such as devices connected to the IDE bus 62 or devices connected via an ISA / EIO (Industry Standard Architecture / Extended Input Output) bus 63 or an I / O interface 69. Control (Input / Output).

  The IDE controller / configuration register 59 includes two IDE controllers, a so-called primary IDE controller and a secondary IDE controller, a configuration register, and the like (both not shown).

  An HDD 67 is connected to the primary IDE controller via an IDE bus 62. Further, when a so-called IDE device such as a CD ROM drive or HDD (not shown) is attached to the other IDE bus, the attached IDE device is electrically connected to the secondary IDE controller.

  The HDD 67 records an electronic mail program 67A, an autopilot program 67B, a jog dial state monitoring program 67C, a jog dial driver 67D, an OS 117E, a communication program 67F, a web browser 67G, and other application programs 67H.

  The e-mail program 67A to the application program 67H and the like recorded in the HDD 67 are appropriately loaded into the RAM 54.

  An I / O interface 69 is further connected to the ISA / EIO bus 63. The I / O interface 69 is composed of an embedded controller, in which a ROM 70, a RAM 71, and a CPU 72 are mutually connected.

  The ROM 70 stores in advance an IEEE1394 interface program 70A, an LED control program 70B, a touch pad input monitoring program 70C, a key input monitoring program 70D, a wakeup program 70E, a jog dial state monitoring program 70F, and the like.

  The IEEE1394 interface program 70A transmits and receives data (data stored in a packet) conforming to the IEEE1394 standard via the IEEE1394 port 28. The LED control program 70B controls the lighting of the power lamp PL, the battery lamp BL, the message lamp ML provided as necessary, or other LED lamps. The touch pad input monitoring program 70C is a program for monitoring an input from the touch pad 26 corresponding to the user's operation.

  The key input monitoring program 70D is a program for monitoring input from the keyboard 24 or other key switches. The wake-up program 70E checks whether or not a preset time has been reached based on data indicating the current time supplied from a timer circuit (not shown) of the bridge 58, and has reached the preset time. At this time, it is a program for managing the power supply of each chip constituting the personal computer 2 in order to activate a predetermined process (or program) or the like. The jog dial state monitoring program 70F is a program for constantly monitoring whether or not the rotary encoder of the jog dial 23 has been rotated or whether or not the jog dial 23 has been pressed.

  The ROM 70 further stores a BIOS (Basic Input / Output System) 70G. The BIOS 120G controls data transfer (input / output) between the OS or application program and peripheral devices (touchpad 26, keyboard 24, HDD 67, etc.).

  The RAM 71 has registers for LED control, touch pad input status, key input status, or set time, I / O register for jog dial status monitoring, IEEE1394 I / F register, and the like as registers 71A to 71F. . For example, when the jog dial 23 is pressed and the e-mail program 54A is activated in the LED control register, a predetermined value is stored, and lighting of the message lamp ML is controlled in accordance with the stored value. The The key input status register stores a predetermined operation key flag when the jog dial 23 is pressed. A predetermined time is set in the set time register in response to an operation of the keyboard 24 or the like by the user.

  The I / O interface 69 is connected to the jog dial 23, the touch pad 26, the keyboard 24, the IEEE1394 port 28, the shutter button 32, and the like via a connector (not shown). The jog dial 23, the touch pad 26, the keyboard 24 or a signal corresponding to an operation on each shutter button 32 is output to the ISA / EIO bus 63. The I / O interface 69 controls transmission / reception of data to / from a device connected via the IEEE1394 port 28. Furthermore, the I / O interface 69 is connected to a power lamp PL, a battery lamp BL, a message lamp ML, a power control circuit 73, and other lamps composed of LEDs.

  The power control circuit 73 is connected to a built-in battery 74 or an AC power supply, supplies necessary power to each block, and performs control for charging the built-in battery 74 or a second battery of a peripheral device. The I / O interface 69 monitors the power switch 27 that is operated when the power is turned on or off.

  The I / O interface 69 executes the IEEE1394 interface program 70A to the jog dial state monitoring program 70F with the power supply provided therein even when the power is off. That is, the IEEE1394 interface program 70A to the jog dial state monitoring program 70F are always operating.

  Therefore, even when the power switch 27 is off and the CPU 51 is not executing the OS 54E, the I / O interface 69 executes the jog dial state monitoring program 70F. For example, in the power saving state or the power off state, the jog dial When the button 23 is pressed, the personal computer 2 activates predetermined software or script file processing set in advance.

  Thus, in the personal computer 2, since the jog dial 23 has a programmable power key (PPK) function, it is not necessary to provide a dedicated key.

  7 to 9 are views for explaining the external appearance of the PDA 4. FIG. 7 is a perspective view of the PDA 4 when gripped. FIG. 8 is a perspective view of the PDA 4 attached to the cradle 141. FIG. 9 is a front view of the PDA 4.

  The PDA 4 has a housing that is sized to be grasped and operated with one hand. A slot for inserting a memory stick 131 containing a semiconductor memory is provided in the upper portion of the PDA 4.

  The memory stick 131 is a type of flash memory card developed by Sony Corporation, the applicant of the present application. This Memory Stick 131 is an EEPROM (Electrically Erasable and Programmable Read Only Memory) that is a non-volatile memory that can be electrically rewritten and erased in a small and thin plastic case with a length of 21.5 x width 50 x thickness 2.8 [mm]. A flash memory element is stored, and various data such as images, sounds, music, and the like can be written and read via a 10-pin terminal.

  The Memory Stick 131 uses a unique serial protocol that ensures compatibility with the equipment used even when the specifications of the built-in flash memory change due to an increase in capacity, etc., and a maximum writing speed of 1.5 [MB / S In addition to realizing high-speed performance of maximum reading speed 2.45 [MB / S], high reliability is secured by providing an erroneous erasure prevention switch.

  As shown in FIG. 8, the PDA 4 is attached to the cradle 141 so that the lower surface of the PDA 4 and the upper surface of the cradle 141 are in contact with each other. A USB (Universal Serial Bus) port (not shown) for connecting to the cradle 141 is provided on the lower surface of the PDA 4. The cradle 141 is a docking station when the PDA 4 and the personal computer 2 are connected by wire to exchange information and update each data to the latest data (so-called hot sync synchronizes the data).

  The PDA 4 is provided with a display 161, a key 162, a jog dial 151, and the like.

  The display unit 161 includes a thin display device such as a liquid crystal display device, and displays an image such as an icon, a thumbnail, or text. A touch pad is provided above the display unit 161. By pressing the touch pad with a finger or a pen, predetermined data or an operation instruction is input to the PDA 4.

  The key 162 includes input keys and the like, and inputs selection of icons or thumbnails displayed on the display unit 161.

  The jog dial 151 inputs selection of an icon or thumbnail displayed on the display unit 161 in response to a rotation operation or a pressing operation on the main body side.

  Next, the internal configuration of the PDA 4 will be described with reference to FIG.

  A CPU (Central Processing Unit) 171 is an operating system stored in a Flash ROM (Read only Memory) 173 or an EDO DRAM (Extended Data Out Dynamic Random Access Memory) 174 in synchronization with a clock signal supplied from the oscillator 172. Or various programs such as developed application programs.

  The Flash ROM 173 is composed of a flash memory which is a kind of EEPROM (Electrically Erasable Programmable Read Only Memory), and generally stores basically fixed data among the programs and calculation parameters used by the CPU 171. . The EDO DRAM 174 stores programs used in the execution of the CPU 171 and parameters that change as appropriate during the execution.

  The memory stick interface 175 reads data from the memory stick 131 mounted on the PDA 4 and writes data supplied from the CPU 171 to the memory stick 131.

  Accordingly, since the PDA 4 is configured so that the memory stick 131 can be mounted, the other electronic devices (for example, the personal computer 2, the digital mobile phone with camera 5, or later will be described with reference to FIG. 14) via the memory stick 131. Data can be shared with a portable music player 271 or the like.

  A USB (Universal Serial Bus) interface 176 inputs data or a program from a drive 183 that is a connected USB device in synchronization with a clock signal supplied from the oscillator 177 and drives data supplied from the CPU 171. 183. The USB interface 176 inputs data or a program from the cradle 141 that is a connected USB device in synchronization with the clock signal supplied from the oscillator 177 and supplies the data supplied from the CPU 171 to the cradle 141.

  A drive 183 is also connected to the USB interface 176. The drive 183 reads the data or program recorded in the mounted magnetic disk 191, optical disk 192, magneto-optical disk 193, or semiconductor memory 194, and connects the data or program via the USB interface 176. Supplied to the CPU 171 or EDO DRAM 174. Further, the drive 183 records the data or program supplied from the CPU 171 in the magnetic disk 191, the optical disk 192, the magneto-optical disk 193, or the semiconductor memory 194 that is mounted.

  The Flash ROM 173, EDO DRAM 174, memory stick interface 175, and USB interface 176 are connected to the CPU 171 via an address bus and a data bus.

  The display unit 161 receives data from the CPU 171 via the LCD bus, and displays an image or a character corresponding to the received data. When the touch pad provided on the upper side of the display unit 161 is operated, the touch pad control unit 178 receives data corresponding to the operation (for example, the touched coordinates) from the display unit 161, and the received data Is supplied to the CPU 171 via the serial bus.

  An EL (Electroluminescence) driver 179 operates an electroluminescent element provided on the back side of the liquid crystal display unit of the display unit 161 to control display brightness of the display unit 161.

  The infrared communication unit 180 transmits data received from the CPU 171 to other devices (not shown) via UART (Universal asynchronous receiver transmitter) using infrared as a medium, and transmits the infrared rays transmitted from other devices as a medium. Is received and supplied to the CPU 171. That is, the PDA 4 can communicate with other devices via the UART.

  The audio reproducing unit 182 includes a speaker, audio data decoding circuit, and the like. The audio reproducing unit 182 decodes and reproduces audio data stored in advance or audio data received via the Internet 6, and reproduces the audio. Is output. For example, the audio reproduction unit 182 reproduces audio data supplied from the CPU 171 via the buffer 181 and outputs audio corresponding to the data.

  The key 162 includes input keys and the like, and is operated by the user when inputting various commands to the CPU 171.

  The jog dial 151 supplies data corresponding to the rotation operation or the pressing operation to the main body side to the CPU 171.

  The power supply circuit 186 converts the voltage of the power supplied from the attached battery 184 or the connected AC (Alternating current) adapter 185 and supplies the power to each of the CPU 171 to the sound reproducing unit 182.

  Next, the external configuration of the digital mobile phone with camera 5 will be described. As shown in FIG. 11, the camera-equipped digital mobile phone 5 includes a display unit 202 and a main body 203, and is formed to be foldable by a central hinge unit 204.

  The display unit 202 includes a transmission / reception antenna 205 that can be pulled out or stored in the upper left portion. The camera-equipped digital cellular phone 5 transmits and receives radio waves to and from any of the base stations 3-1 to 3-4, which are fixed wireless stations, via the antenna 205.

  In addition, the display unit 202 has a camera unit 206 that is rotatable at an angle range of approximately 180 degrees at the center of the upper end. The digital mobile phone with camera 5 captures an image of a desired image with the CCD camera 207 of the camera unit 206.

  When the camera unit 206 is positioned by being rotated by approximately 180 degrees by the user, as shown in FIG. 12, the display unit 202 has a speaker 208 provided at the center on the back side of the camera unit 206 positioned on the front side. It becomes a state. As a result, the camera-equipped digital mobile phone 5 switches to a normal voice call state.

  Further, a liquid crystal display 209 is provided in front of the display unit 202. The liquid crystal display 209 is used for the reception status of the radio wave, the remaining battery level, the destination name registered in the telephone directory, the telephone number, the outgoing call history, etc. Display captured images.

  On the other hand, the main body 203 is provided with operation keys 210 such as numeric keys “0” to “9”, a call key, a redial key, an end call and power key, a clear key, and an e-mail key. . Various instructions corresponding to the operation of the operation key 210 are input to the digital mobile phone with camera 5.

  A memo button 211 and a microphone 212 are provided below the operation keys 210 of the main body 203. When the memo button 211 is operated, the digital mobile phone with camera 5 records the voice of the other party during the call. The digital mobile phone with camera 5 collects the voice of the user during a call using the microphone 212.

  Further, a rotatable jog dial 213 is provided above the operation key 210 of the main body 203 so as to slightly protrude from the surface of the main body 203. The digital mobile phone 5 with a camera performs a scrolling operation of a telephone directory list or an e-mail displayed on the liquid crystal display 209, an e-mail page turning operation, an image sending operation, etc. Perform various operations.

  For example, the main body 203 selects a desired telephone number from a plurality of telephone numbers in the telephone directory list displayed on the liquid crystal display 209 in response to a user's turning operation of the jog dial 213, and the jog dial 213 is When pressed in the internal direction, the selected telephone number is confirmed, and call processing is automatically performed for the confirmed telephone number.

  The main body 203 is equipped with a battery pack (not shown) on the back side, and when the call end / power key is turned on, power is supplied from the battery pack to each circuit unit to start operation. To do.

  A memory stick slot 214 for mounting a removable memory stick 131 is provided on the upper left side of the main body 203. When the memo button 211 is pressed, the digital mobile phone with camera 5 records the voice of the other party who is talking on the memory stick 131 attached. The camera-equipped digital cellular phone 5 stores e-mail, a simple homepage, an image captured by the CCD camera 207, or audio data generated by processing to be described later on a memory stick 131 attached in accordance with a user operation. Record.

  Accordingly, since the camera-equipped digital cellular phone 5 is configured so that the memory stick 131 can be mounted, other electronic devices (for example, the personal computer 2, the PDA 4, or a portable music playback device to be described later) via the memory stick 131. Etc.) can be shared.

  FIG. 13 is a block diagram showing an internal configuration of the digital mobile phone with camera 5.

  As shown in FIG. 13, the digital mobile phone with camera 5 has a power supply circuit unit 252, an operation input control unit 253, an image encoder with respect to a main control unit 251 that comprehensively controls each unit of the display unit 202 and the main body 203. 254, a camera I / F (interface) unit 255, an LCD (Liquid Crystal Display) control unit 256, a demultiplexing unit 258, a modulation / demodulation circuit unit 259, and an audio codec 260 are connected to each other via a main bus 261, and an image An encoder 254, an image decoder 257, a demultiplexing unit 258, a storage / playback unit 263, a modulation / demodulation circuit unit 259, and an audio codec 260 are connected to each other via a synchronization bus 262.

  When the call end / power key is turned on by the user's operation, the power supply circuit unit 252 activates the digital mobile phone with camera 5 in an operable state by supplying power from the battery pack to each unit. To do.

  The digital mobile phone with camera 5 converts the audio signal collected by the microphone 212 into digital audio data by the audio codec 260 in the voice call mode based on the control of the main control unit 251 including a CPU, ROM, RAM, and the like. . The digital cellular phone with camera 5 performs spread spectrum processing on the digital audio data in the modulation / demodulation circuit unit 259, performs digital analog conversion processing and frequency conversion processing in the transmission / reception circuit unit 264, and transmits the digital audio data via the antenna 205.

  In the voice communication mode, the camera-equipped digital cellular phone 5 amplifies the reception signal received by the antenna 205 by the transmission / reception circuit unit 264 to perform frequency conversion processing and analog-digital conversion processing, and the modulation / demodulation circuit unit 259 performs spectrum despreading. Processed and converted to an analog audio signal by the audio codec 260. The digital mobile phone with camera 5 causes the speaker 208 to output sound corresponding to the analog sound signal.

  Furthermore, when sending an e-mail in the data communication mode, the camera-equipped digital cellular phone 5 receives e-mail text data input by operating the operation key 210 or the jog dial 213 via the operation input control unit 253. The data is sent to the control unit 251.

  The main control unit 251 performs spread spectrum processing on the text data in the modulation / demodulation circuit unit 259, performs digital analog conversion processing and frequency conversion processing in the transmission / reception circuit unit 264, and then transmits the text data to the base station 3 via the antenna 205.

  On the other hand, in the data communication mode, when the digital mobile phone with camera 5 receives an e-mail, the modulation / demodulation circuit unit 259 performs spectrum despreading processing on the received signal received from the base station 3 via the antenna 205, After restoring the original text data, it is output to the LCD control unit 256. The LCD control unit 256 controls the liquid crystal display 209 in order to display an e-mail.

  In the camera-equipped digital cellular phone 5, an e-mail received according to a user's operation or an e-mail converted into voice data by a process to be described later is recorded on the memory stick 131 via the storage / playback unit 263. Is also possible.

  When transmitting image data in the data communication mode, the digital mobile phone with camera 5 supplies the image data captured by the CCD camera 207 to the image encoder 254 via the camera interface unit 255.

  Incidentally, when not transmitting image data, the digital mobile phone with camera 5 can also directly display the image data captured by the CCD camera 207 on the liquid crystal display 209 via the camera interface unit 255 and the LCD control unit 256. is there.

  The image encoder 254 converts the image data supplied from the CCD camera 207 into encoded image data by performing compression encoding according to a predetermined encoding method such as MPEG (Moving Picture Experts Group) 2 or MPEG4, for example, This is sent to the demultiplexing unit 258.

  At the same time, the camera-equipped digital cellular phone 5 sends the sound collected by the microphone 212 during imaging by the CCD camera 207 to the demultiplexing unit 258 via the audio codec 260 as digital audio data.

  The demultiplexing unit 258 multiplexes the encoded image data supplied from the image encoder 254 and the audio data supplied from the audio codec 260 using a predetermined method, and the modulation / demodulation circuit unit 259 performs spectrum processing on the resulting multiplexed data. The signal is subjected to spreading processing, subjected to digital / analog conversion processing and frequency conversion processing by the transmission / reception circuit unit 264, and then transmitted via the antenna 205.

  On the other hand, in the data communication mode, the digital mobile phone with camera 5 modulates / demodulates the received signal received from the base station via the antenna 205 when receiving data of a moving image file linked to a simple homepage, for example. The circuit unit 259 performs spectrum despreading processing, and sends the multiplexed data obtained as a result to the demultiplexing unit 258.

  The demultiplexer 258 separates the multiplexed data into encoded image data and audio data, and supplies the encoded image data to the image decoder 257 and also supplies the audio data to the audio codec 260 via the synchronization bus 262. To do.

  The image decoder 257 generates reproduced moving image data by decoding the encoded image data by a decoding method corresponding to a predetermined encoding method such as MPEG2 or MPEG4, and supplies the reproduced moving image data to the liquid crystal display 209 via the LCD control unit 256. To display. Thereby, the camera-equipped digital mobile phone 5 displays, for example, moving image data included in the moving image file linked to the simple homepage.

  At the same time, the audio codec 260 converts the audio data into an analog audio signal, which is then supplied to the speaker 208 for output. Thereby, the camera-equipped digital cellular phone 5 reproduces the audio data included in the moving image file linked to the simple homepage, for example.

  In this case, the camera-equipped digital cellular phone 5 also uses the received data such as the simplified home page or the text data such as the simplified home page converted into voice data by the processing described later, as in the case of e-mail. It is possible to record in the memory stick 131 via the storage / reproduction unit 263 by the user's operation.

  That is, as shown in FIG. 14, portable music that can be equipped with a personal computer 2, a PDA 4, a digital mobile phone with camera 5, and a memory stick 131 and can reproduce audio data recorded on the memory stick 131. Information can be shared via the memory stick 131 in each of the playback devices 271. For example, data generated in the personal computer 2, the PDA 4, or the digital mobile phone with camera 5 can be recorded on the memory stick 131 and played back by the portable music playback device 271.

  In FIG. 14, the case where information is shared via the memory stick 131 has been described. However, each of the personal computer 2, the PDA 4, the digital mobile phone with camera 5, and the portable music player 271 is wired or wireless. It goes without saying that information can be shared even if it is connected via the network and data can be exchanged.

  FIG. 15 is a functional block diagram when the mail watcher application is loaded into the RAM 54 and executed by the CPU 51 in the personal computer 2 out of the application programs 67H recorded in the HDD 67 described with reference to FIG. .

  The mail watcher application control unit 281 employs MAPI (Messaging Application Program Interface), which is a standard system interface for electronic messaging applications, standardized by Microsoft as WOSA (Windows (registered trademark) Open System Architecture). E-mail data is read from the MAPI mailer 282 (corresponding to the e-mail program 67A in FIG. 6), and various processes are executed based on user settings supplied from a GUI (Graphical User Interface) control unit 283.

  Here, when the mail watcher application control unit 281 executes processing, the MAPI mailer 282 may not be activated (that is, loaded into the RAM 54 and not executed by the CPU 51).

  The GUI control unit 283 controls display of a GUI such as a dialog box and a display window for performing various settings of the mail watcher application described later according to the control of the mail watcher application control unit 281, and the user is displayed. A signal indicating the content of the operation input executed for the GUI that is present is generated and supplied to the mail watcher application control unit 281.

  The mail filter 284 filters the electronic mail described in the text format supplied from the mail watcher application control unit 281 based on the conversion table described in the conversion table database 285.

  In the conversion table database 285, for example, when replying or forwarding a received electronic mail such as “>”, “|”, “:”, etc., it indicates that it is a quoted sentence in the body of the electronic mail. The symbol added to the indent portion is recorded.

  The mail filter 284 puts, for example, a mark for each part where the person who described the supplied mail text is the same, based on the number of symbols and the number added to each line of the supplied email text. Sort by etc. For example, when the e-mail shown in FIG. 16 is supplied, the mail filter 284 is different from the text A and the text A that are the first part of the body of the e-mail (here, the part described by the sender) (here Is quoted) text B, which is different from text B (the number of quoted symbols is different from text B), text C, which is different from text C (the number of quoted symbols is different from text C), text D The text E is divided into text E different from the text D (here, the portion described by the sender).

  An HTML (Hyper Text Markup Language) tag filter 286 filters the electronic mail described in HTML supplied from the mail watcher application control unit 281 based on the conversion table described in the conversion table database 287.

  FIG. 17 shows an example of an electronic mail described in HTML. Further, FIG. 18 shows an e-mail source described in HTML shown in FIG. E-mails written in HTML are different from e-mails written in text. For example, the background color is changed, the image data is used for the background, the character font is set, and the emphasis is made. You can add color to the part you want, increase the character point, make it bold, or italicize.

  In the e-mail source shown in FIG. 18, the part surrounded by <HTML> and </ HTML> shows the whole e-mail described in HTML. A portion surrounded by <HEAD> and </ HRAD> (portion indicated by I in the figure) is a header.

  The part enclosed by <BODY bgColer = # ffffff> and </ BODY> (the part indicated by J in the figure) is the body of the email. bgColer = # ffffff indicates the background color of the text. In the text, the part surrounded by <DIV> and </ DIV> indicates one line of the text. In the text, <BLOCKQUOTE dir = ltr ... 0px "> and after that, <DIV> indicating the beginning of the line is indented (the part indicated by k in the figure) indicates a quoted sentence. 17 is a part indicated by G in Fig. 17. <BLOCKQUOTE dir = ltr ... 0px "> is a reference symbol (straight line) added to the indented part of the part indicated by G in FIG. This is an HTML tag for display.

  The HTML tag filter 286 refers to an HTML tag (description of a part surrounded by <>), divides the body and the header, for example, based on the conversion table described in the conversion table database 287, and further, the body Is divided into the quoted text and the other part (the part where the quoted text is multiplexed is also the part) and is divided into lines, and the text data included in each line is divided into the quoted text and so on. For example, predetermined information is added to convert the data into data that can be processed by the read-out management module 288 so that the non-parts can be distinguished. The conversion process may be performed by changing the conversion table described in the conversion table database 287.

  Here, the e-mail is described as being written in text or HTML, but when the corresponding conversion table is prepared in the conversion table database 287, it is described in a markup language other than HTML. Can also be accommodated.

  The reading management module 288 converts the input text data into audio data and reproduces it, or executes processing for outputting and recording it to an external device. Details thereof will be described later with reference to FIG. To do.

  The URL / mail address filter 289 refers to the data registered in the URL / mail address table 290, and if there is a URL that matches the registered URL or mail address, those names are registered. Change to

  FIG. 19 shows data registered in the URL / mail address table 290. FIG. 19A shows a URL table. In the URL table, URLs and corresponding names are registered. FIG. 19B shows a mail address table. In the mail address table, mail addresses and corresponding names are registered.

  For example, as shown in FIG. 19C, the URL table may be classified and registered according to protocols such as “http” and “ftp”, for example. Thus, by classifying and registering, it is possible to shorten the time required for processing in matching processing with text data described later (URL processing 2 described later).

  In FIG. 19, it has been described that the URL table and the mail address table are registered in the URL / mail address table 290. However, the URL and the mail address may be registered in one table. Needless to say.

  The registration data in the URL / mail address table 290 described with reference to FIG. 19 is displayed by the user of the user by displaying a list window 291 of a name as shown in FIG. Can be registered, and the registered contents can be changed or deleted.

  For example, when a new URL is to be registered, an add name button 292 shown in FIG. 20B is displayed by selecting an add button in the call name list window 291, and the call name and URL are displayed in the corresponding text box. Just fill in and select the OK button. If the registered URL contents are to be changed, the change window 293 shown in FIG. 20C is displayed by selecting the change button in the name list window 291 and is written in the text box in advance. The currently registered call name and URL may be changed and the OK button may be selected. To delete a registered URL, the corresponding URL in the name list window 291 may be selected and the delete button may be selected.

  Although the URL registration has been described here, it goes without saying that the same applies to the registration of the mail address name.

  In addition, the URL and the mail address are registered by using the URL registered in the application for browsing the web page and the display name thereof, or the e-mail address registered in the application for sending and receiving the e-mail and the display name thereof. It is also possible to use this automatically. FIG. 21 is a functional block diagram for explaining automatic registration of URLs and mail addresses.

  The web browser 67G outputs a file describing the URL registered by the user and the registered name from the bookmark 296 registered by the user to the bookmark conversion unit 295.

  FIG. 22 shows an example of a file indicating a URL registered as “favorite” when Microsoft Internet Explorer (trademark) is used as the web browser 67G. The bookmark conversion unit 295 reads the URL registered as a favorite from the input “favorite” file and the registered name (in the example of FIG. 22, http://www.eeeclopedia.com/ and “electronic encyclopedia”). ", Http: //www.***.com and" JITEN ", and http: //www.ss.net.or.jp // ... and" Ocean Dictionary "). The bookmark conversion unit 295 registers a registered name corresponding to the URL in the URL / mail address table 290 as a call name for the URL.

  The e-mail program 67A outputs the e-mail address registered in the address book 298 and the registered name to the address book conversion unit 297. The address book conversion unit 297 registers the registered name corresponding to the e-mail address in the URL / mail address table 290 as a call name for the e-mail address.

  In this way, the registered contents of the automatically registered URL or e-mail address and each call name are manually changed by the user using the change window 293 described with reference to FIG. Is possible.

  FIG. 23 is a more detailed functional block diagram of the reading management module 288.

  The reading control unit 301 controls the entire reading management module 288, supplies the input various signals and data to the corresponding parts, and executes predetermined processing.

  The text management unit 302 registers the text data for reading supplied from the reading control unit 301 in the reading text database 303, and receives a reading command from the reading text database 303 according to the processing of the reading control unit 301. The text data corresponding to the received e-mail is read and output to the reading control unit 301.

  The dictionary management unit 304 manages the dictionary data registered in the dictionary database 305 in response to an input of user dictionary registration data set by the user, an instruction to update or delete the dictionary, and the like by processing described later.

  The text analysis unit 306 receives input of text data corresponding to an e-mail for which a reading command has been read, which is read from the text database 303 for reading by the reading control unit 301 via the text management unit 302, and receives the dictionary database 305 and the conversion With reference to the rule database 307, the text is analyzed and decomposed into words, prosodic information (so-called phonetic symbolic sound information) is generated and output to the speech synthesizer 308. The conversion rule database 307 stores rules for generating prosodic information.

  The speech synthesis unit 308 refers to the phoneme database 309 based on the prosodic information input from the text analysis unit 306, and generates synthesized speech data (connects the input prosodic information to obtain synthesized speech data). A plurality of phoneme databases 309 may be prepared, and phonemes for respective sounds of phoneme data prepared in advance and phoneme data created by processing to be described later are prepared. The voice synthesizer 308 selects phonemes designated by the user and generates synthesized voice data.

  The voice setting unit 310 receives input of information indicating the speed and height of the voice, which is set by the user through processing to be described later, from the reading control unit 301 and recorded in the phoneme database 309 as necessary. Change the data.

  The reproduction control unit 311 records the generated audio data in the audio database 312, and when the audio data reproduction command is input from the reading control unit 301, reads the corresponding audio data from the audio database 312, and the speaker 65. To play audio. The format of the audio data recorded in the audio database 312 is, for example, PCM (Pulse Code Modulation), and is actually recorded in an internal recording unit (for example, HDD 67), an external device, or an external recording medium. (For example, WAVE data, ATRAC (Advanced TRansform Acoustic Coding) 3, ADPCM (Adaptive Differential Pulse Code Modulation), etc.) may be different.

  The file output unit 313 receives an input of a control signal for recording audio data in a file storage device 291 (for example, the HDD 67) inside the apparatus, and inputs the audio data from the audio database 312 via the reproduction control unit 311. If necessary, the data converter 314 converts the data format (for example, converts PCM data to ADPCM data), adds a header, and changes the frequency (for example, 22 kHz data to 11 kHz or 16 kHz). Change) and output to the file storage device 291 for recording.

  The external device output unit 315 receives an input of a control signal for outputting audio data to the outside (recording device or recording medium), and receives input of audio data from the audio database 312 via the reproduction control unit 311. If necessary, the data conversion unit 314 converts the data format (for example, converts PCM data to ADPCM data), attaches a header, and changes the frequency (for example, changes 22 kHz data to 11 kHz or 16 kHz). To the external device output module 293.

  The data conversion unit 314 receives data input from the file output unit 313 or the external device output unit 315, for example, converts PCM data into ADPCM data, or the format after conversion is, for example, ATRAC3, and the reading management module 288. When the data conversion module 293 can convert data from PCM data to ATRAC3, it outputs the data to be converted to the data conversion module 293, and receives the data input after the conversion process is completed.

  When the data conversion module 293 needs to convert the audio data recorded in the audio database 312 to a data format that cannot be converted by the data conversion unit 314, for example, when converting PCM format data to ATRAC3 Then, the audio data is received from the data converter 314, converted into a corresponding format, and output to the data converter 314.

  The external device output module 293 outputs audio data to an external device connected to the personal computer 2 via, for example, the USB interface 68 of FIG. 6 or the PC card slot interface 111, and the audio storage processing 294, that is, A process for recording audio data in a recording medium mounted such as a memory stick 131, a memory included in an external device such as the PDA 4 or a recording medium mounted in the external device is executed.

  The processing executed by the data conversion module 292 and the external device output module 293 is, for example, application software for performing data conversion and data management of music data such as OpenMG (trademark) developed by Sony Corporation, the applicant of the present application. It is also possible to realize by the process.

  Any device can be used as the sound storage device 294 as long as it can record sound data. For example, the PDA 4, the digital mobile phone with camera 5, or the portable music player 271 may be used. it can.

  The text display unit 316 receives the display text input from the reading control unit 301, registers it in the display text database 317, and displays a display command from the display text database 317 according to the processing of the reading control unit 301. Text data corresponding to the received e-mail is read out and displayed on the display unit 22 for display.

  For example, the mail watcher application is activated simultaneously with the activation of the personal computer 2 (that is, resident), and an icon 322 corresponding to the mail watcher application is displayed on the toolbar 321 as shown in FIG. And The user can display the command box 323 by selecting the icon 322.

  When the user wants to make various settings of the mail watcher application, the user selects an item described as “setting” from the command box 323. A signal indicating a user operation is supplied from the GUI control unit 283 to the mail watcher application control unit 281. The mail watcher application control unit 281 receives a signal indicating that the user has selected the “setting” item from the command box 323, and generates a control signal for displaying the setting window 331 shown in FIG. To the GUI control unit 283.

  FIG. 25 shows a setting window 331 displayed when the mail tab 341 is selected. In the setting window 331, several setting screens can be displayed by selecting a tab. The setting window 331 includes a mail tab 341, a reading tab 342, an external device / media output tab 343, and other tabs 344 as tabs for switching the setting screen.

  A setting window 331 displayed when the mail tab 341 is selected is a check box 345 to a check box 349 for selecting a reading item when reading an e-mail, and a check box for setting automatic mail check. 350 and a drop-down list box 351 are provided.

  Among the check boxes 345 to 349, the contents of items for which a check is entered by the user are converted into audio data by a process described later. Of the check boxes 345 to 348 (that is, items other than the body text), the contents of the items checked by the user are the titles when audio data is output to an external device or the like by the processing described later. Used when generating. When an item other than the body is not checked, that is, when none of the check boxes 345 to 348 is checked, the title is set to a predetermined character string.

  In addition, the mail watcher application causes the MAPI mailer 282 to automatically check mail every predetermined time (that is, dial-up connection to a predetermined Internet service provider, access to a mail server, and send to itself) Checked whether the received e-mail is in the receiving mail server). When the check box 350 is checked, the mail watcher application control unit 281 refers to the number described in the drop-down list box 351 and automatically performs mail check for the MAPI mailer 282 every time. Make it.

  In accordance with the mail check result of the MAPI mailer 282, the mail watcher application control unit 281 may output a voice message “no new mail” when there is no e-mail to be received. A dialog box with a message may be displayed. The mail watcher application control unit 281 executes a process for reading out the received electronic mail when there is an electronic mail to be received in accordance with the mail check result of the MAPI mailer 282.

  The setting window 331 includes an OK button 352 that is selected when the setting is confirmed and the setting window 331 is erased, and a cancel button that is selected when the setting is canceled and the setting window 331 is erased. 353 is provided.

  FIG. 26 is a display example of the setting window 331 displayed in a state where the “read” tab 342 is selected. In the setting window 331, in addition to the OK button 352 and the cancel button 353, a detailed setting button 361 selected when performing detailed settings for voice 1 and a detailed setting button 362 selected when performing detailed settings for voice 2 A new voice creation button 363 selected when creating a new voice and a user dictionary button 364 selected when editing the user dictionary are provided.

  It is possible to set two types of voices “voice 1” and “voice 2” as voices when reading text data of electronic mail. When the user wants to change the setting of the voice 1 or the voice 2, the user selects the corresponding one of the detailed setting button 361 or the detailed setting button 362, and displays the voice setting window 371 shown in FIG.

  The voice setting window 371 includes a drop-down list box 381 for setting the voice type, a setting lever 382 for setting the speed of reading, a setting lever 383 for setting the height of the reading voice, and a reading voice. A setting lever 384 for setting the accent strength of the voice, a test button 385 for playing a voice sample with the current settings, and a setting button 371 for registering the set contents and deleting the voice setting window 371. OK button 386, cancel button 387 selected when canceling the set contents and deleting the voice setting window 371, and a help button 388 for displaying a help window in which operation method help is described. Is provided.

  In the drop-down list box 381, for example, the user selects a new voice creation button 363 in FIG. 26 in addition to preset voices such as women, men, children, robots, and aliens. The voice name corresponding to the phoneme uniquely created by the user is displayed and can be selected using the voice creation window shown in FIG. For the voice selected by the drop-down list box 381, the speed of reading, the pitch of the voice, and the strength of the accent are set by the positions of the setting levers 382 to 384.

  Here, the setting levers 382 to 384 are described as being able to set the speed of reading, the pitch of the voice, and the strength of the accent, but can be set for other features. Needless to say, it may be done.

  When it is desired to confirm the voice 1 or voice 2 set using the setting levers 382 to 384, the test button 385 is pressed. When the test button 385 is pressed, for example, a predetermined text such as “the set voice is such a voice” is reproduced with the set voice. The user presses the OK button 386 when confirming the confirmed voice setting, and presses the cancel button 387 when canceling.

  FIG. 28 shows a voice creation window 391 that is displayed when the new voice creation button 363 is selected. The voice creation window 391 includes a text box 401 for inputting the name of the created voice, an import button 402, setting levers 403 to 410, a test button 411, a save button 412, a close button 413, and a help button 414. Is provided.

  The import button 402 is a button for reading the setting of the existing voice and reflecting it in the positions of the setting levers 403 to 410 when creating a new voice using the existing voice. For example, when the import button 402 is selected, a list of existing voices similar to the drop-down list box 381 of FIG. 27 is displayed, and the user can select a desired voice from the list.

  The setting lever 403 is for setting the pitch of the voice by setting the speed at which the voice is rapidly turned. The setting lever 404 is for setting the voice hardness. The setting lever 405 is for setting the husky degree (smoothness) of the voice. The setting lever 406 is for setting whether the voice can be heard clearly. The setting lever 407 is for setting the voice pitch. The setting lever 408 is used to set the voice turning. The setting lever 409 is for setting a voice feature corresponding to a voice with a large vital capacity and a small voice. The setting lever 410 is used to set the quickness of the voice (reproduction speed regardless of the level of the voice).

  Here, it has been described that the setting levers 403 to 410 can be used to set the voice's fast turning, firmness, husky degree, clarity, height, flipping, vital capacity, and fast mouth degree. Needless to say, it may have other characteristics. When it is desired to confirm what kind of voice the setting levers 403 to 410 set, the user can select the test button 411 and check the set voice.

  The user inputs the set voice name in the text box 401. When text is input in the text box 401, the save button 412 becomes active. When the user wants to save the set voice, the user selects the save button 412.

  The close button 413 is a button selected when deleting the voice creation window 391. The help button 414 is a button selected when displaying a help window or the like on which help about voice creation or how to use the application is displayed.

  Since the newly set voice is set as a voice that can be used not only in the mail watcher application but also in a web reader application, a mail reader application, and a text-to-speech application, which will be described later, the mail watcher application control unit 281 The setting contents of the voice created in the above are output to the reading management module 288. The newly set voice information is registered in the phoneme database 309 by the processing of the reading control unit 301.

  When the user dictionary button 364 is selected in the setting window 331 of FIG. 26, a user word dictionary tool window 421 shown in FIG. 29 is displayed.

  The user word dictionary tool window 421 includes a word display window 431, an add button 432, a change button 433, a delete button 434, an OK button 435, a cancel button 436, and a help button 437.

  The word display window 431 displays the registered word phrase (displayed text), the reading corresponding to the word, the part of speech, and the reading priority when the input of the same phrase is received.

  When the add button 432 is selected, an add word window 441 shown in FIG. 30 is displayed. In the addition window 441, a text box 451 for inputting a word to be added, a reading of the word input in the text box 451, and a sound such as hiragana, katakana, or romaji can be expressed (such as kanji). A text box 452 for inputting text, an OK button 453 selected when registering the input content, and a selection when not registering the input content. A cancel button 454 is provided.

  Returning to the description of the user word dictionary tool window 421 in FIG. 29 again. The change button 433 displays a dictionary change window (not shown) for changing a selected word / phrase, part of speech, or priority among the words / phrases displayed in the word display window 431. Selected when.

  The delete button 434 is selected when deleting registration of a selected word (inverted display) among the words displayed in the word display window 431.

  The OK button 435 is selected when a word is registered with the registered contents displayed in the word display window 431 and the user word dictionary tool window 421 is deleted. The cancel button 436 is selected when canceling a newly registered or changed registered content and deleting the user word dictionary tool window 421. The help button 437 is selected to display a help window (not shown) that describes a user dictionary registration method and the like.

  The user dictionary set in this way is set as a user dictionary that can be used not only in the mail watcher application but also in a web reader application, a mail reader application, and a text-to-speech application, which will be described later, and therefore the mail watcher application control unit 281. Outputs a word or phrase newly registered in the user dictionary or the updated contents of the user dictionary to the reading management module 288, and registers them in the dictionary database 305 described with reference to FIG.

  FIG. 31 shows a setting window 331 when the output tab 343 to the external device / media is selected.

  The check box 461 is recorded in advance in the external device or the medium when the audio data is output and recorded from the user to the external device or the medium (that is, the recording medium capable of recording information). In order to prevent data from being overwritten, for example, it is for setting whether or not to display a confirmation dialog box as will be described later with reference to FIG. When the check box 461 is checked, a confirmation dialog box is displayed.

  FIG. 32 shows a setting window 331 when the other tab 344 is selected.

  The check box 471 is for setting whether or not to handle the read-out e-mail as a read mail in the e-mail program 67A installed in the personal computer 2 after the end of the reading-out process. A check box 472 is used to set whether or not to register the mail watcher application in the startup when an OS having a startup function such as Windows (registered trademark) 98 is used as the OS of the personal computer 2. Is.

  The check box 473 is used to set whether to display text data by displaying a text display window, which will be described later with reference to FIG. When the check box 473 is checked (that is, when the text is set to be displayed), the drop-down list box 474 is activated (operable state), and the font size of the displayed text is increased. You are able to set up.

  As described above, the mail watcher application control unit 281 executes various processes based on the contents set using the setting window 331, and performs electronic processing according to a signal indicating a user operation input from the GUI control unit 283. Executes the process of reading a mail (converting it into voice data and outputting it).

  Therefore, by executing the setting to increase the reading speed, a user who wants to play many e-mails can shorten the time required for playing e-mails, and the reading speed becomes slow. By performing such settings, it is possible to ensure the listening of voice. Furthermore, even if the user is deaf, such as the elderly, and the high range is easy to hear but the low range is difficult to hear, the voice can be set to female or set individually. The sound can be set to the most easy-to-listen phoneme, for example, by setting the tone to be high and making it easy to hear, slowing the playback speed and making it sound clearly.

  For example, when the command box 323 described with reference to FIG. 24 is displayed and any item is selected, the mail watcher application is activated, and processing is executed in accordance with a user operation input.

  Next, with reference to the flowchart of FIG. 33, the processing of the mail watcher when receiving an instruction to read out unread mail or output to an external device will be described.

  In step S1, the mail watcher application control unit 281 has received a signal from the GUI control unit 283 indicating that the user has performed an operation input corresponding to a command to read out unread mail or output to an external device. Judge whether or not. If it is determined in step S1 that the operation input corresponding to the reading of unread mail or the output command to the external device is not performed, the process of step S1 is repeated until the operation input is performed.

  The operation input for instructing to read unread mail is selection of the item “read out unread mail” in the command box 323 described with reference to FIG. In order to perform an operation input for instructing output of an unread mail to an external device, the item “output to external device / media” in the command box 323 described with reference to FIG. 24 is selected, and the command shown in FIG. From the box 481, the item “output unread mail” is selected. When the item “output new mail” is selected from the command box 481, the new mail is output and recorded on an external device or a connected recording medium, but here, when processing unread mail Will be described.

  If it is determined in step S1 that an operation input corresponding to reading out unread mail or an output command to an external device has been performed, in step S2, the mail watcher application control unit 281 sends an unread mail to the MAPI mailer 282. Judge whether there is.

  The process of step S2 is also executed when the check box 350 described with reference to FIG. 25 is checked and automatic mail check is set, or when a predetermined mail confirmation timing comes.

  If it is determined in step S2 that there is an unread mail in the MAPI mailer 282, in step S3, a reading voice setting process to be described later is executed using the flowchart of FIG.

  In step S4, the mail watcher application control unit 281 determines whether or not there is a next mail in the MAPI mailer 282. If it is determined that there is a next mail, the process returns to step S3, and unread mail is determined. The process of step S3 is repeated until there is no more.

  If it is determined in step S4 that there is no next mail, that is, after the read-out voice setting process is executed for all unread mails, in step S5, the mail watcher application control unit 281 displays the GUI control unit 283. Based on the signal input from, it is determined whether or not the instruction from the user is reproduction by voice of e-mail.

  In step S5, when it is determined that the instruction from the user is reproduction by voice of the e-mail, in step S6, the mail watcher application control unit 281 checks the check box 473 described with reference to FIG. Based on whether or not there is a setting for displaying text on the screen, it outputs to the reading management module 288.

  When the setting window 331 described with reference to FIG. 32 is set to display a reading sentence, the reading control unit 301 of the reading management module 288 is based on the signal supplied from the mail watcher application control unit 281. The text display unit 316 is controlled to read the corresponding text data from the display text database 317, and a text display window 485 as shown in FIG. 35 is displayed.

  In step S <b> 7, the mail watcher application control unit 281 generates and outputs a signal requesting reproduction of the corresponding audio data to the reading management module 288.

  In step S8, an audio reproduction process which will be described later with reference to FIG. 42 is executed, and the process ends.

  If it is determined in step S5 that the instruction from the user is not a reproduction by e-mail voice, the instruction from the user is output of audio data to an external device. Therefore, in step S9, mail watcher application control is performed. The unit 281 generates and outputs a signal requesting the reading management module 288 to output the corresponding audio data to the external device.

  In step S10, an external device output process which will be described later with reference to FIG. 43 is executed, and the process ends.

  If it is determined in step S2 that there is no unread mail in the MAPI mailer 282, in step S11, the mail watcher application control unit 281 generates a control signal for displaying the message “no unread mail”, and the GUI. The data is output to the control unit 283. The GUI control unit 283 causes the LCD 25 to display a message window (not shown) in which a message “There is no unread mail” is displayed, and the processing is terminated.

  Here, a case has been described in which unread mail is read out or an instruction to output to an external device is received and unread mail is read from the MAPI mailer 282 and processed, but new mail is read out instead of unread mail or external Also when receiving an output command to the device, the same processing is basically executed only by changing the mail read from the MAPI mailer 282 to a new mail, and the description thereof will be omitted.

  Next, referring to the flowchart of FIG. 36, the reading voice setting process executed in step S3 of FIG. 33 will be described.

  Here, the voice setting process when the mail watcher application control unit 281 converts unread mail into voice data will be described. For example, the mail reader process described later with reference to FIG. The mail reader application control unit 531 described later executes basically the same reading voice setting process.

  In step S <b> 21, the mail watcher application control unit 281 acquires an e-mail (in this case, an unread mail) to be converted into voice data from the MAPI mailer 282.

  In step S22, the filter processing described later with reference to FIG. 38 is executed.

  In step S23, the mail watcher application control unit 281 determines that the acquired email is a text format email, the mail filter 284, and if the acquired email is an HTML format email, the HTML watch filter 286. , Output the acquired email. The mail filter 284 refers to the conversion table database 285 and the HTML tag filter 286 refers to the conversion table database 287, filters the input e-mail, and outputs the filtering result to the mail watcher application control unit 281. The mail watcher application control unit 281 creates a Chapter based on the filtered result and counts the number of sentences N. Chapter is a unit of information (corresponding to one file of audio data) as one audio data, and one chapter is created by one e-mail. By filtering with the mail filter 284 or the HTML tag filter 286, the e-mail is separated for each sentence, so the mail watcher application control unit 281 can count the number of sentences N.

  In step S24, the mail watcher application control unit 281 determines information corresponding to the title of the chapter, that is, the song name in the music data and the artist name, based on the filtered result. Here, the name "ONSEI" is given to the artist name so that other information and voice data created from text data by voice synthesis can be distinguished. For example, it may be the name of an application that generates voice data from text data, or any character string that can be distinguished from other information.

  The title is determined by referring to the header of the electronic mail and the check box 345 to 348 described with reference to FIG. FIG. 37 shows an example of an e-mail header.

  Various information other than the main body of the electronic mail is described in the header of the electronic mail. The main information described in the header of the e-mail includes, for example, an e-mail transmission destination address (text 491 in FIG. 37), an e-mail transmission time (text 492), and an e-mail transmission source address (text 493). , A subject (text) 494 of the e-mail, and information indicating the format of the e-mail, that is, the text format or the HTML format (text 495). For the title, one of the check boxes 345 to 348 described with reference to FIG. 25 is connected to the text portion corresponding to the checked item by, for example, “/ (slash)”. It is generated by doing.

  When none of the check boxes 345 to 348 is checked, the title is set to a predetermined character string (for example, a character string “ONSEI”). Also, when the same character string is set as the title, for example, “AAA2” and “AAA3” are added to the character string by adding a number after the character string, for example, “AAA”. You may be able to do that.

  Here, a case has been described in which the mail watcher application control unit 281 converts unread mail into voice data. However, since the filtering method differs depending on the corresponding application, the Chapter title determination method differs depending on the application. Needless to say, it may be.

  The title set in this way is, for example, general audio data (for example, music data) when the corresponding audio data is output to the portable music playback device 271 or other devices and played back. In the same way as the title (song name), it is used for display for selecting audio data.

  In step S25, the mail watcher application control unit 281 sets the title and display text data in the reading management module 288 (that is, supplies data). The reading control unit 301 of the reading management module 288 records the supplied title and display text data in the display text database 317 via the text display unit 316.

  In step S <b> 26, the mail watcher application control unit 281 sets voice 1 as the reading voice of the first sentence of Chapter.

  In step S27, the mail watcher application control unit 281 sets the value of the register i for detecting which line of the sentence included in the chapter is being processed to i = 0.

  In step S28, the mail watcher application control unit 281 determines whether or not the value i of the register i is the number N of sentences where i <Chapter.

  If it is determined in step S28 that the value i of the register i is the number N of sentences where i <Chapter, in step S29, the mail watcher application control unit 281 acquires one sentence of the following text.

  In step S30, the mail watcher application control unit 281 refers to a mark or the like attached when filtering is performed, and does the acquired text have an attribute different from the previous sentence (that is, is it a quoted sentence)? Or the citation hierarchy is different).

  If it is determined in step S30 that the acquired text has an attribute different from that of the previous sentence, in step S31, the mail watcher application control unit 281 changes the voice so as to be different from the previous sentence. That is, when the voice before the attribute change is voice 1, the acquired text voice is changed to voice 2, and when the voice before the attribute change is voice 2, the acquired text voice is changed to voice 1. Is done.

  In step S32, the mail watcher application control unit 281 sets the previous sentence (that is, the part reproduced with the same voice until the voice is changed) as the last sentence of the previous paragraph, and the step A paragraph is created by making the text acquired in S29 the first sentence of a new paragraph.

  If it is determined in step S30 that the acquired text does not have an attribute different from that of the previous sentence, or after the process of step S32 is completed, the read-out generated by the process of steps S29 to S32 is performed in step S33. Is set in the reading management module 288. The reading control unit 301 of the reading management module 288 records the supplied reading text data in the reading text database 303 via the text management unit 302.

  In step S34, the mail watcher application control unit 281 sets the value i of the register i to i = i + 1, the process returns to step S28, and the subsequent processes are repeated.

  If it is determined in step S28 that the value i of the register i is not i <Chapter sentence number N, the process proceeds to step S4 in FIG. 33 (a reading voice setting process is performed in step S154 in FIG. 50 described later). If it is executed at step S155, the process proceeds to step S155 of FIG.

  By such processing, the reading voice of the e-mail is set to be changed and output depending on the attribute of the text (here, whether or not it is a quoted sentence or a hierarchy of the quoted sentence).

  In this example, two e-mail reading voices are set. However, it goes without saying that the number of reading voices may be any number of three or more.

  As a result, for example, the quoted text is often the content that you have written or that you have already read. It is possible to make it possible to fully grasp the contents while shortening the time.

  Next, the filtering process executed in step S22 of FIG. 33 will be described with reference to the flowchart of FIG.

  In step S41, the URL / mail address filter 289 is sent to the mail watcher application control unit 281 (or the mail reader application control unit 531 described later using FIG. 46, the web reader application control unit 591 described later using FIG. 51, or Text data is acquired from a text-to-speech application control unit 641), which will be described later with reference to FIG. 57, and the first character of the acquired text data is set as C.

  In step S42, the URL / mail address filter 289 determines whether or not the character C is C = “@ (at mark)”.

  If it is determined in step S42 that C = “@”, in step S43, the URL / mail address filter 289 executes mail address processing described later with reference to FIG.

  If it is determined in step S42 that C = “@”, the URL / mail address filter 289 determines in step S44 whether C = “:”.

  When it is determined in step S44 that C = “:”, in step S45, the URL / mail address filter 289 performs URL processing 1 described later with reference to FIG. 40 or URL processing described later with reference to FIG. 2 is executed.

  After the process of step S43 is completed, after the process of step S45 is completed, or when it is determined in step S44 that C = “:” is not satisfied, in step S46, the URL / mail address filter 289 displays the acquired text. Of these, it is determined whether or not there is any text that has not been processed.

  If it is determined in step S46 that there is a text that has not been processed among the acquired text, the URL / mail address filter 289 determines that the next character of the acquired text is C in step S47. The process returns to step S42, and the subsequent processes are repeated.

  If it is determined in step S46 that there is no text that has not been processed among the acquired texts, the process returns to step S23 in FIG.

  Here, the filter process has been described as being executed in step S22 of FIG. 33. However, when the filter process is executed by the web reader process described later with reference to FIG. 55, the process is as shown in FIG. Returning to step S174, when the text reading process described later with reference to FIG. 60 is executed, the process returns to step S193 in FIG.

  Next, the mail address process executed in step S43 in FIG. 38 will be described with reference to the flowchart in FIG.

  In step S 51, the URL / mail address filter 289 extracts the first e-mail address among the e-mail addresses registered in the URL / mail address table 290.

  In step S52, the URL / mail address filter 289 checks whether or not the character string before (left) before “@” matches, and in step S53, whether or not the character string before “@” matches. Judging.

  If it is determined in step S53 that the character string before “@” matches, the URL / mail address filter 289 determines whether or not the character string after (@) matches after “@” in step S54. In step S55, it is determined whether or not the character string after “@” matches.

  If it is determined in step S55 that the character string after “@” matches, the URL / mail address filter 289 in step S56 corresponds to the electronic mail address registered in the URL / mail address table 290 and the corresponding address. The corresponding address is read with the registered name, and the process returns to step S46 in FIG.

  If it is determined in step S53 that the character string before “@” does not match, or if it is determined in step S55 that the character string after “@” does not match, URL · The mail address filter 289 determines whether or not an unprocessed registered address remains in the URL / mail address table 290.

  If it is determined in step S57 that an unprocessed registered address remains in the URL / mail address table 290, the URL / mail address filter 289 is registered in the URL / mail address table 290 in step S58. The next address is selected, the process returns to step S52, and the subsequent processes are repeated. If it is determined in step S57 that no unprocessed registered address remains in the URL / mail address table 290, the name of the corresponding mail address is not registered in the URL / mail address table 290. Returns to step S46 of FIG.

  Here, “@” included in the email address is used as a reference, and the following processing is executed when the previous character string matches. For example, matching is performed character by character from the beginning of the address. By performing processing, it may be determined whether or not the address is a registered address.

  Next, the URL process 1 executed in step S45 of FIG. 38 will be described with reference to the flowchart of FIG.

  In step S 71, the URL / mail address filter 289 extracts the first URL from the URLs registered in the URL / mail address table 290.

  In step S72, the URL / mail address filter 289 checks whether or not the character string before (left side) of the acquired text matches “:”. In step S73, the character string before “:” matches. Judge whether to do.

  If it is determined in step S73 that the character string before “:” matches, the URL / mail address filter 289 matches the character string after (right side) after “:” of the acquired text in step S74. In step S75, it is determined whether or not the character strings after “:” match.

  If it is determined in step S74 that the character string after “:” (right side) matches, the URL / mail address filter 289 replaces the corresponding URL with the registered name in step S76, and the processing is as shown in FIG. Return to step S46.

  If it is determined in step S73 that the character string before “:” does not match, or if it is determined in step S74 that the character string after (“right”) does not match, in step S77. The URL / mail address filter 289 determines whether or not an unprocessed registered URL remains in the URL / mail address table 290.

  If it is determined in step S77 that an unprocessed registered URL remains, the URL / mail address filter 289 selects the next URL registered in the URL / mail address table 290 in step S78. The processing returns to step S72, and the subsequent processing is repeated. If it is determined in step S77 that an unprocessed registered URL does not remain, the name corresponding to the input URL is not registered in the URL / mail address table 290. Return to S46.

  Here, as in the case of the e-mail address, it goes without saying that it may be determined whether or not the URL is registered by performing matching processing one character at a time from the beginning.

  If URLs are registered in the URL / mail address table 290 for each protocol as shown in FIG. 19C, the corresponding protocol is determined after determining whether or not the protocol matches in advance. It may be determined whether or not a URL is registered.

  Next, URL processing 2 will be described with reference to the flowchart of FIG.

  In step S81, the URL / mail address filter 289 extracts the first protocol (“http” in the case of FIG. 19C) from the protocols registered in the URL / mail address table.

  In step S82, the URL / mail address filter 289 checks whether or not the extracted protocol matches the character string before (on the left side) of the input text “:”. It is determined whether or not the previous character string matches.

  If it is determined in step S83 that the character string before “:” does not match, the URL / mail address filter 289 determines whether an unprocessed registration protocol remains in the URL / mail address table 290 in step S84. Judge whether or not.

  If it is determined in step S84 that an unprocessed registration protocol remains, in step S85, the URL / mail address filter 289 selects the next protocol registered in the URL / mail address table 290, and The process returns to step S82, and the subsequent processes are repeated.

  If it is determined in step S83 that the character strings before (left) before “:” match, the same processing as in steps S74 to S76 in FIG. 40 is executed in steps S86 to S88.

  If it is determined in step S87 that the character strings after “:” (on the right side) do not match, an unprocessed registered URL is added to the URL group having the corresponding protocol in the URL / mail address table 290 in step S89. Determine if it remains.

  If it is determined in step S89 that an unprocessed registered URL remains, in step S90, the URL / mail address filter 289 selects the next URL registered with the corresponding protocol, Returning to step S86, the subsequent processing is repeated.

  If it is determined in step S84 that no unprocessed registration protocol remains, if it is determined in step S89 that there is no unprocessed registration URL, or after the process of step S88 is completed, The processing returns to step S46 in FIG.

  With such processing, when performing URL matching, the registered URLs are narrowed down by the protocol, so that the processing time can be shortened.

  When text data indicating a URL or an e-mail address that matches a registered URL or e-mail address is input by the processing described with reference to the flowcharts of FIGS. 38 to 41, the URL / e-mail address filter 289 is used. Is replaced with the registered name and output to the mail watcher application control unit 281. Therefore, it is possible to prevent a registered URL, that is, a frequently used URL or e-mail address from being read out as a list of alphabets and becoming information that is difficult to understand for a user who has heard voice data. it can.

  For example, when converting the sender of the e-mail described with reference to FIG. 16 and the e-mail address “info@abc.co.jp” described in the text into voice data, for example, “INF If the alphabet is read as it is, the voice data becomes meaningless (unintelligible) for the user who hears the voice. However, since this e-mail address is registered in the e-mail address table described with reference to FIG. 19B, the e-mail address is registered without being read as it is in the alphabet or by reading in the appropriate Roman alphabet. As shown in the figure, after being replaced with the text data “abc Inc.”, it is converted into voice data. As a result, the generated voice data is easy to understand for the user (suitable for understanding by listening rather than reading).

  Here, the URL / mail address filter 289 is described as registering the URL or mail address and its name in the URL / mail address table 290, but the URL / mail address filter 289 and the URL / mail address are described. The address table 290 is omitted, and the same data as the data registered in the URL / mail address table 290 is registered in the dictionary database 305 described with reference to FIG. A similar process may be executed during the execution. In this case, the user can register a URL or an e-mail address using the add word window 441 described with reference to FIG.

  In addition, the text analysis method of the dictionary database 305 is matching based on part of speech that is generally used in the past. When a URL or an e-mail address and its name are registered in the dictionary database 305 as nouns, When the URL or e-mail address to be analyzed is analyzed as another part of speech, voice data cannot be generated with the registered call name. In order to prevent such inconvenience, when a URL or mail address and its name are registered in the dictionary database 305, items such as URL and address can be used as part of speech at the time of registration. good.

  Next, the audio reproduction process executed in step S8 in FIG. 33 will be described with reference to the flowchart in FIG.

  Note that here, the audio reproduction process when the mail watcher application control unit 281 reproduces the audio data corresponding to the e-mail will be described. For example, step S158 of the mail reader process to be described later with reference to FIG. Also in step S180 of the web reader process described later using 55 and in step S196 of the text reading process described later using FIG. 60, basically the same sound reproduction process is executed.

  In step S91, the reading control unit 301 of the reading management module 288 determines whether a signal indicating a user operation has been input. If it is determined in step S91 that a signal indicating a user operation has not been input, the process in step S91 is repeated until it is determined that the signal has been input.

  Here, since the audio reproduction process executed in step S8 of FIG. 33 has been described, a signal indicating the user's operation is input from the mail watcher application control unit 281. This will be described later with reference to FIG. When the voice reproduction process is executed in step S158 of the mail reader process, a signal indicating the user's operation is input from the mail reader application control unit 531 described later with reference to FIG. 46. Similarly, FIG. When the voice reproduction process is executed in step S180 of the web reader process described later using step S196 or the text read-out process step S196 described later using FIG. 60, a signal indicating a user operation uses FIG. Web reader application control unit 591 described later, or FIG. Is input from the text reading application control unit 641 will be described later with reference.

  When it is determined in step S91 that a signal indicating a user operation has been input, in step S92, the reading control unit 301 determines whether a text acquisition command has been input based on the signal indicating the user operation. to decide.

  When it is determined in step S92 that a text acquisition command has been input, in step S93, the reading control unit 301 generates a control signal for acquiring text data from the reading text database 303, and the text management unit 302. Output to. The text management unit 302 acquires text data from the text database for reading 303 and outputs it to the reading control unit 301.

  In step S <b> 94, the text analysis unit 306 receives the input of the text data acquired from the reading control unit 301, analyzes the text data, decomposes the words into words, and dictionary data registered in the dictionary database 305. The phonetic symbol string (prosodic information) is generated by referring to the conversion rules registered in the conversion rule database 307 and output to the speech synthesizer 308.

  In step S 95, the speech synthesis unit 308 generates synthesized speech data based on the phoneme data registered in the phoneme database 309 according to the phonetic symbol string supplied from the text analysis unit 306, and outputs the synthesized speech data to the speech setting unit 310. To do. The audio setting unit 310 adjusts the synthesized audio data according to the detailed audio settings set using the setting levers 382 to 394 described with reference to FIG. 27, and generates audio data used for reproduction. The generated audio data is supplied to the reproduction control unit 311 and stored in the audio database 312.

  In step S <b> 96, the reproduction control unit 311 sequentially reads out the audio data stored in the audio database 312 and outputs it to the speaker 65.

  In step S97, the reproduction control unit 311 reproduces the audio being reproduced based on whether or not the audio data of the same Chapter as the audio data being reproduced remains among the audio data stored in the audio database 312. It is determined whether or not the data has been reproduced. If it is determined in step S97 that the reproduced audio data has been reproduced, the process returns to step S92, and the subsequent processes are repeated.

  If it is determined in step S97 that the reproduced audio data has not been reproduced, the reproduction control unit 311 in step S98 is based on a control signal corresponding to a user operation input from the reading control unit 301. Then, it is determined whether or not a playback stop command has been input. If it is determined in step S98 that a playback stop command has not been input, the process returns to step S96, and the subsequent processing is repeated.

  If it is determined in step S98 that a reproduction stop command has been input, in step S99, the reproduction control unit 311 stops reproduction, that is, stops outputting audio data recorded in the audio database 312 to the speaker. . After the process of step S99 ends, the process returns to step S92, and the subsequent processes are repeated.

  If it is determined in step S92 that a text acquisition command has not been input, the reading control unit 301 determines in step S100 whether an end command has been input.

  Here, since the audio reproduction process executed in step S8 in FIG. 33 has been described, an end command is input from the mail watcher application control unit 281 in accordance with a user operation input input from the GUI control unit 283. When the voice reproduction process is executed in step S158 of the mail reader process to be described later with reference to FIG. 50, a signal indicating the user operation is input from the mail reader application control unit 531 to be described later with reference to FIG. Similarly, when the voice reproduction process is executed in step S180 of the web reader process described later with reference to FIG. 55 or in step S196 of the text reading process described later with reference to FIG. 60, the user operation is indicated. The signal is a web reader application described later with reference to FIG. ® emission control section 591 or inputted from the text reading application control unit 641 will be described later with reference to FIG. 57.

  If it is determined in step S100 that an end command has not been input, the process returns to step S92, and the subsequent processes are repeated. If it is determined in step S100 that an end command has been input, the process ends (if the audio reproduction process is executed in step S158 in FIG. 50 described later, the process ends, and the process in FIG. If it is executed in step S180, the process is terminated. If it is executed in step S196 of FIG. 60 described later, the process proceeds to step S197 of FIG.

  By such processing, the voice data converted from the text data is reproduced based on the user's operation input.

  Further, the URL or mail address and its name are registered in the dictionary database 305, and it is determined whether or not the URL or mail address is registered during the voice reproduction process, and is replaced with the name by the processing of the text analysis unit 306. You may do it. In that case, the filtering process described with reference to FIG. 38 is executed in the process of step S94.

  Next, the external device output process executed in step S10 of FIG. 33 will be described with reference to the flowchart of FIG.

  Here, the processing in the case where the mail watcher application control unit 281 outputs audio data corresponding to an e-mail to an external device will be described. For example, step S160 of the mail reader processing described later with reference to FIG. In step S182 of the web reader process described later with reference to FIG. 55 and in step S199 of the text reading process described later with reference to FIG. 60, basically the same external device output process is executed.

  In step S111, the reading control unit 301 detects whether there is an external output device (including an external storage device such as the memory stick 131) that is a target of external output and is communicable with the personal computer 2. Control signal is generated and output to the external device output unit 315. The external device output unit 315 is a voice storage device 294 (for example, a memory stick 131, a PDA 4, a digital mobile phone with camera 5, or a portable music player 271 that is in a state where data can be exchanged with the external device output module 293. And the like, and the detection result is output to the reading control unit 301.

  In step S112, the reading-out control unit 301 determines whether an external output target device is detected in step S111 based on a signal input from the external device output unit 315.

  If it is determined in step S112 that a target device for external output has been detected, in step S113, the reading control unit 301 determines whether there are a plurality of devices detected in step S111.

  In step S113, when it is determined that there are a plurality of devices detected in step S111, in step S114, the reading control unit 301 generates a control signal for displaying the selection screen of the target device, and the mail watcher application The data is output to the GUI control unit 283 via the control unit 281. The GUI control unit 283 outputs and displays a target device selection screen on the LCD 25, receives a user's operation for selecting a device from the jog dial 23, the keyboard 24, or the touch pad 26, and receives the mail watcher application control unit 281. Output to.

  Here, since it is described that the external device output process is executed in step S10 of FIG. 33, in step S113, the control signal for displaying the selection screen of the target device is sent to the mail watcher application control unit 281. The control signal for displaying the selection screen for the target device when the external device output process is executed in step S160 of FIG. 50 to be described later. Is output to the GUI control unit 533 via the mail reader application control unit 531 which will be described later with reference to FIG. 46, and when an external device output process is executed in step S182 of FIG. The control signal for displaying the screen is a web reader which will be described later with reference to FIG. When the external device output process is executed in step S199 of FIG. 60 to be described later and output to the GUI control unit 593 via the application control unit 591, a control signal for displaying the target device selection screen is: The data is output to the GUI control unit 642 via the text-to-speech application control unit 641 described later with reference to FIG.

  In step S115, the reading-out control unit 301 sets N = “ID of the device selected by the user” as the value N of the register for selecting an external device included therein.

  In step S113, when it is determined that there are not a plurality of devices detected in step S111 (that is, one device), in step S116, the reading control unit 301 selects a register for selecting an external device included therein. Let N = 0. Here, when the value N of the register is N = 0, it indicates that only one device can output the audio data.

  After the process of step S115 is completed or after the process of step S116 is completed, in step S117, the reading control unit 301 selects the external device indicated by the value N of the register.

  In step S118, the reading control unit 301 sets display of a dialog box for confirming deletion of past data, that is, whether the check box 461 is checked in the setting screen 331 described with reference to FIG. Judge whether or not.

  When it is determined in step S118 that display of a dialog box for confirming deletion of past data is set, in step S119, the reading control unit 301 displays the dialog box 501 shown in FIG. Receive user operation input

  FIG. 44 shows a display example of the dialog box 501. The display area 511 displays a list of data whose artist name is “ONSEI” among the information recorded on the external device or the recording medium that is the output target of the music data. Three items of title 512, artist name 513, and capacity 514 are displayed in the display area.

  The data whose artist name 513 is “ONSEI” is not only the voice data created by the processing of the mail watcher application, but also the processing of the mail reader application, the processing of the web reader application, or the processing of the text-to-speech application described later Is voice data created by Further, the title 512 displayed at this time is the title determined in step S24 of the reading voice setting process described with reference to FIG.

  When the user selects the “Yes” button 515, the data whose artist name is “ONSEI” displayed in the display area 511 is deleted from the corresponding audio storage device 294, and new audio data is recorded. .

  When the user selects the “No” button 516, the data whose artist name displayed in the display area 511 is “ONSEI” is not erased from the corresponding audio storage device 294, and new audio data is stored in the data. Is newly recorded in an area where no is recorded.

  When the “cancel” button 517 is selected by the user, the output command of the audio data to the external device is canceled, and the dialog box 501 is deleted.

  In the dialog setting area 518, radio buttons 521 to 523 for setting the display of the dialog box 501 are provided. Only one of the radio buttons 521 to 523 is selected.

  When the radio button 521 is selected, if there is data that can be deleted in the audio storage device 294 in the external device output process to be executed next, a dialog box 501 is displayed without fail, and data that can be deleted by user operation input. It is determined whether or not is deleted. When the radio button 522 is selected, if there is data that can be deleted in the audio storage device 294 in the external device output process to be executed next, the new audio is deleted after the data is deleted without displaying the dialog box 501. Set to record data. When the radio button 523 is selected, even if there is data that can be deleted in the audio storage device 294 in the external device output processing to be executed next, the dialog box 501 is not displayed and the new data is deleted without being deleted. It is set to record additional audio data.

  If it is determined in step S118 that display of a dialog box for confirming deletion of past data has not been set, or after the processing in step S119 ends, the reading control unit 301 in FIG. Based on the setting in the dialog setting area 518 of the dialog box 501 described using the above, or the operation input by the user input in step S119, it is determined whether or not the past data needs to be deleted.

  If it is determined in step S120 that deletion of past data is necessary, a data deletion process, which will be described later with reference to FIG. 45, is executed in step S121.

  In step S120, when it is determined that it is not necessary to delete past data, or after the process of step S121 is completed, in step S122, the reading control unit 301 reads the corresponding audio data with the external device to be output. A format corresponding to a certain voice storage device 294 is converted.

  That is, the reading control unit 301 generates a control signal for causing the data conversion unit 314 to output the audio data instructed for external output recorded in the audio database 312 via the external device output unit 315. Then, the control signal is output to the reproduction control unit 311, and a control signal for converting the data into a format corresponding to the audio storage device 294 is generated and output to the data conversion unit 314. The reproduction control unit 311 retrieves corresponding audio data from the audio database 312 according to the input control signal, and outputs it to the data conversion unit 314 via the external device output unit 315. The data conversion unit 314 needs to In response, information is exchanged with the data conversion module 293, and the input audio data is converted into a corresponding data format and supplied to the external device output unit 315.

  In step S123, the external device output unit 315 outputs the converted data to the external device, that is, the voice storage device 294 via the external device output module 293, and the processing is ended.

  If it is determined in step S112 that the target device for external output has not been detected, in step S124, the reading control unit 301 generates a control signal for outputting an error message, and the mail watcher application control unit 281. To the GUI control unit 283. The GUI control unit 283 outputs an error message to the LCD 25 for display, and the process is terminated.

  Here, since it is described that the external device output process is executed in step S10 of FIG. 33, a control signal for displaying an error message in step S124 is sent via the mail watcher application control unit 281. Although it is described as being output to the GUI control unit 283, when an external device output process is executed in step S160 of FIG. 50 described later, a control signal for displaying an error message is shown in FIG. When the external device output process is executed in step S182 of FIG. 55 described later, the control signal for displaying an error message is output to the GUI control unit 533 via the mail reader application control unit 531 described later. Web reader application described later with reference to FIG. 57. As shown in FIG. 57, a control signal for displaying an error message when the external device output process is executed in step S199 of FIG. 60, which will be described later, is output to the GUI control unit 593 via the operation control unit 591. Then, the data is output to the GUI control unit 642 via the text reading application control unit 641 described later.

  In addition, here, it is described that the external device output process is executed in step S10 of FIG. 33. Therefore, it is assumed that the process ends after the process of step S123 or step S124 ends. However, when external device output processing is executed in step S160 of FIG. 50 described later, when external device output processing is executed in step S182 of FIG. 55 described later, or step S199 of FIG. 60 described later. In this case, even when the external device output process is executed, the process ends.

  The voice data generated by converting the text data by such processing is the target of the voice storage device 294, that is, the memory stick 131, the PDA 4, the camera-equipped digital cellular phone 5, or the portable music player 271. Output to and recorded on an external device or recording medium.

  Next, the data deletion process executed in step S121 in FIG. 43 will be described with reference to the flowchart in FIG.

  In step S131, the external device output unit 315 receives the audio storage device 294, that is, the memory stick 131, the PDA 4, the camera-equipped digital cellular phone 5, or the portable music player 271 via the external device output module 293. The number L of files recorded on the external device or the recording medium is detected.

  In step S132, the external device output unit 315 sets the register value i indicating the number of songs being deleted to i = 0, and in step S133, whether the register value i satisfies i <number of files L or not. Judging.

  If it is determined in step S133 that the register value i is i <the number of files L, in step S134, the external device output unit 315 determines that the data indicating the artist name is present in the i-th file. To get.

  In step S135, the external device output unit 315 determines whether the data indicating the artist name acquired in step S134 is a predetermined name (here, “ONSEI”).

  If it is determined in step S135 that the acquired data indicating the artist name is a predetermined name, the external device output unit 315 deletes the i-th file in step S136.

  When it is determined in step S135 that the acquired data indicating the artist name is not a predetermined name, or after the process of step S136 is completed, in step S137, the external device output unit 315 sets the register value i to i = i + 1 is set, and the process returns to step S133, and the subsequent processes are repeated.

  If it is determined in step S133 that the register value i is not i <the number of files L, that is, if it is determined that the processing for all the files has been completed, the processing returns to step S122 in FIG.

  FIG. 46 shows a functional block diagram of the personal computer 2 when the mail reader application is loaded into the RAM 54 and executed by the CPU 51 among the application programs 67H recorded in the HDD 67 described with reference to FIG. .

  The mail reader application control unit 531 reads e-mail data according to a user operation when mail software 352 (not necessarily a MAPI mailer) corresponding to the e-mail program 67A in FIG. 6 is activated. Various processes are executed based on the user settings supplied from the GUI control unit 533.

  Here, in order for the mail reader application control unit 531 to execute processing, the mail software 352 must be activated (that is, the electronic mail program 67A must be loaded into the RAM 54 and executed by the CPU 51). ).

  The GUI control unit 533 controls display of a GUI such as a dialog box and a display window for performing various settings of the mail reader application described later according to the control of the mail reader application control unit 531, and the user is displayed. A signal indicating the content of the operation input executed for the GUI that is present is generated and supplied to the mail reader application control unit 531.

  The mail filter 534 executes basically the same processing as the mail filter of the mail watcher application control unit 281 described with reference to FIG. 15, and the body of the electronic mail described in the text format is described in the conversion table database 535. Filter based on the conversion table.

  In the conversion table database 535, for example, when a received e-mail is replied or forwarded, such as “>”, “|”, “:”, etc., an indent indicating that it is a quoted sentence in the body of the e-mail The symbol added to the part is recorded. Information described in the conversion table database 535 may be the same as or different from the conversion table database 285. That is, the information described in the conversion table database 535 and the conversion table database 285 is determined by the types of symbols that can be used for indent setting at the time of reply in the setting of the corresponding mail software 352.

  The mail filter 534 executes basically the same processing as the mail filter of the mail watcher application control unit 281 described with reference to FIG. That is, the mail filter 534 divides the supplied mail body into parts where the described person is the same (for example, a mark) based on the number of symbols added to each line of the supplied electronic mail body and the number thereof. ). For example, when the e-mail shown in FIG. 16 is supplied, the mail filter is different from the text A and the text A (here, the part described by the sender) of the e-mail body (here, the part described by the sender). Cited text) Text B, text C different from text B (number of quote symbols different from text B), text D different from text C (number of quote symbols different from text C), text D The text E is divided into text E different from the text D (here, the portion described by the sender).

  The reading management module 288, the URL / mail address filter 289, and the URL / mail address table 290 are the same as those described with reference to FIG.

  FIG. 47 shows a display screen when the mail software 532 and the mail reader application are activated.

  On the mail software display screen 541, in addition to the components of the display screen of the normal mail software 352, a mail reader toolbar 542 is displayed, and the emails displayed in the email list display area 543 in the folder are displayed. Of these buttons, various buttons are provided that are operated when the selected e-mail (of course, a plurality of e-mails can be selected) is reproduced by voice or output to an external device.

  The stop button 551 is selected when stopping the reproduction of audio data. The read-out button 552 is selected when the content of the selected electronic mail is read out, that is, when audio data is reproduced. The previous mail button 553 is selected when the e-mail immediately before the e-mail currently being reproduced or interrupted is reproduced. The next e-mail button 554 is selected when reproducing the e-mail next to the e-mail currently being reproduced or interrupted.

  The output button 555 to an external device is selected when voice data corresponding to the selected electronic mail is output to the voice storage device 294 and recorded by the same process as the process described with reference to FIG. The menu button 556 is selected, for example, when displaying a list box including various menus for instructing operations such as displaying a setting setting window 561 described later with reference to FIG.

  When menu button 556 is selected, a list box in which various menus including an item “setting” are displayed is displayed. When the “setting” item is selected by a user operation, a signal indicating the user operation is input from the GUI control unit 533 to the mail reader application control unit 531. The mail reader application control unit 531 generates a control signal for displaying the setting window 561 shown in FIG. 48 and outputs it to the GUI control unit 533 to display the setting window 561.

  The setting window 561 shown in FIG. 48 is different from the setting window 331 described with reference to FIGS. 25 to 32, and has only two types of display screens. Therefore, the tab is a reading tab 571 and an output tab to an external device / media. There are only two of 572.

  FIG. 48 shows a setting window 561 when the reading-out tab 571 is selected. The OK button 352, cancel button 353, and detailed setting button 361 to user dictionary button 364 displayed in this case are basically the same as those described with reference to FIG.

  FIG. 49 shows a setting window 561 when the output tab 572 to the external device / media is selected. The check box 461 displayed in this case is basically the same as that described with reference to FIG. When the check box 581 is checked, the output button 555 to the external device described with reference to FIG. 47 is displayed on the tool bar 542. When the check box 581 is not checked, the output button 555 to the external device is not displayed on the tool bar 542.

  Next, processing when the mail reader application is loaded into the RAM 54 and executed by the CPU 51 will be described with reference to the flowchart of FIG.

  In step S151, the mail reader application control unit 531 instructs the user to reproduce the voice of the e-mail or output it to an external device based on the signal indicating the user's operation input from the GUI control unit 533. That is, it is determined whether or not the reading button 552, the previous mail button 553, the next mail button 554, or the output button 555 to the external device is selected. If it is determined in step S151 that a command for reproducing voice of mail or outputting to an external device has not been input, the processing in step S151 is repeated until any of these commands is input. It is.

  If it is determined in step S151 that an instruction to reproduce an e-mail voice or output to an external device is input, the mail reader application control unit 531 is input from the GUI control unit 533 in step S152. Based on the signal indicating the user's operation, the number M of the selected emails out of the emails displayed in the list display area 543 of the email software display screen 541 is counted and recorded in the internal register. . For example, in the state shown in FIG. 47, the number M of selected electronic mails is M = 1.

  In step S153, the mail reader application control unit 531 determines whether or not the register value M is M> 0.

  If it is determined in step S153 that the register value M is M> 0, in step S154, the reading voice setting process described with reference to the flowchart of FIG. 36 is executed.

  In step S155, the mail reader application control unit 531 sets the register value M to M = M-1, and the process returns to step S153.

  If it is determined in step S153 that the register value M is not M> 0, in step S156, the mail reader application control unit 531 receives an instruction from the user who received the input in step S151. It is determined whether or not the playback is based on.

  If it is determined in step S156 that the instruction from the user is reproduction by e-mail voice, in step S157, the e-mail reader application control unit 531 generates a control signal for requesting reproduction of the corresponding audio data. And output to the reading management module 288.

  In step S158, the audio reproduction process described with reference to the flowchart of FIG. 42 is executed, and the process ends.

  If it is determined in step S156 that the instruction from the user is not reproduction by voice of the e-mail, the instruction from the user is output of voice data to an external device. Therefore, in step S159, mail reader application control is performed. The unit 531 generates a control signal for requesting output of the corresponding audio data to the external device, and outputs the control signal to the reading management module 288.

  In step S160, the external device output process described using the flowchart of FIG. 43 is executed, and the process ends.

  As described with reference to FIG. 50, the email information desired by the user among the emails received by the processing of the mail software 532 is converted into voice data and reproduced by the processing of the mail reader application. Output to an external device.

  At this time, in the filtering process executed during the reading voice setting process in step S154, the text matching the registered URL or e-mail address is replaced with a predetermined call name, and then converted into voice data.

  In this process, the title of the audio data output to the external device is set as a title by selecting predetermined information such as the subject of an e-mail, for example, regardless of the user setting. To do. In this case as well, similar to the processing of the mail watcher application described above, the user may be able to select information that is the basis for determining the title.

  FIG. 51 shows a functional block diagram of the personal computer 2 when the web reader application is loaded into the RAM 54 and executed by the CPU 51 among the application programs 67 recorded in the HDD 67 described with reference to FIG. .

  When the web browser 592 (the web browser 67G in FIG. 6) is activated, the web reader application control unit 591 displays the data of the displayed web page (described in a markup language such as HTML) according to the user's operation. Data), and executes various processes based on user settings supplied from the GUI control unit 593.

  Here, when the web reader application control unit 591 executes processing, the web browser 592 must be activated (that is, the web browser 67G must be loaded into the RAM 54 and executed by the CPU 51). .

  The GUI control unit 593 controls display of a GUI such as a dialog box or a display window for performing various settings of the web reader application described later according to the control of the web reader application control unit 591, and the user is displayed. A signal indicating the content of the operation input executed for the GUI being used is generated and supplied to the web reader application control unit 591.

  The HTML tag filter 594 filters data described in HTML supplied from the web reader application control unit 591 based on a conversion table described in the conversion table database 595.

  FIG. 52 shows an example of web page data (web page source) described in HTML.

  In the web page source shown in FIG. 52, the portion surrounded by <HTML> and </ HTML> shows the entire source described in HTML. A portion surrounded by <HEAD> and </ HRAD> (portion indicated by L in the figure) is a web page header.

  52, the portion surrounded by <body bgcolor = "# BDFFFF" link = "# 0000FF" vlink = "# 800080"> and </ body> is a web page. The part surrounded by <p align = "display position"> and </ p> is a paragraph in the text. Since all tags are enclosed in <>, the part not enclosed in <> is the text data part.

  The HTML tag filter 594 refers to an HTML tag (description of a part surrounded by <>), divides the body and the header, for example, based on the conversion table described in the conversion table database 595, and further, the body Is divided into paragraphs and converted into data that can be processed by the reading management module 288. As the conversion processing method, another method may be adopted by changing the conversion table described in the conversion table database 595.

  Here, the web page is described as being described in HTML. However, even when the conversion table database 595 is prepared in a markup language other than HTML by preparing a corresponding conversion table, it is also possible to handle it. It is possible to make it.

  The reading management module 288, the URL / mail address filter 289, and the URL / mail address table 290 are the same as those described with reference to FIG.

  A display screen when the web browser 592 is activated is shown in FIG.

  In the web browser display window 601, a web reader toolbar 603 is displayed in addition to a display area 602 for displaying a web page and a normal toolbar of the web browser. When the audio reproduction is not executed, the web reader toolbar 603 is provided with a stop button 611, a reproduction button 612, a rewind button 613, a fast forward button 614, an output button 615 to an external device, and a setting button 616.

  When the user selects the play button 612 in a state where none of the text data displayed in the display area 602 is selected, the text data displayed in the display area is completely played until the playback is completed. Alternatively, playback is performed sequentially until the stop button 611 is selected. When the user selects text data displayed in the display area 602 and selects the play button 612, only the selected text is played back as audio data.

  When the rewind button 613 or the fast forward button 614 is selected, the playback position of the audio data is changed. When the output button 615 to the external device is selected, the corresponding audio data is output to an audio storage device 294 such as a memory stick 131 and recorded.

  When the setting button 616 is selected, a setting window 621 shown in FIG. 54 is displayed. FIG. 54 shows a setting window 621 when the reading-out tab 571 is selected. Here, an OK button 352, a cancel button 353, a detailed setting button 361, a new voice creation button 363, and a user dictionary button 364 are basically the same as those described with reference to FIG. Is omitted. That is, when the text data of the web page is converted into voice data by the processing of the web reader application, the voice is converted into the set one type of voice, so the voice 2 is not set. The setting window 621 when the output tab 572 to the external device / media is selected is basically the same as the setting window 561 described with reference to FIG.

  Next, processing when a web reader application is loaded into the RAM 54 and executed by the CPU 51 will be described with reference to the flowchart of FIG.

  In step S171, the web reader application control unit 591 determines whether the user has selected the play button 612 or the output button 615 to the external device based on the signal indicating the user operation input from the GUI control unit 593. That is, it is determined whether or not an instruction to reproduce the sound of a web page or output to an external device is input. In step S171, when it is determined that the instruction to reproduce the audio of the web page or the output to the external device is not input, the process of step S171 is repeated until it is determined that one of the instructions is input. It is.

  If it is determined in step S171 that one of the instructions for reproducing the audio of the web page or outputting to the external device is input, in step S172, the web reader application control unit 591 From 592, text data with a corresponding HTML tag is acquired.

  In step S173, the filtering process described with reference to FIG. 38 is executed.

  In step S174, the web reader application control unit 591 outputs the acquired data to the HTML tag filter 594. The HTML tag filter 594 filters the input data and outputs the result to the web reader application control unit 591. That is, the HTML tag filter 594, based on the HTML tag of the web page described with reference to FIG. 52, for example, <title> and </ title from the header data (the portion indicated by L in FIG. 52). The text in the portion surrounded by> is extracted as the title of the web page, the text portion in the body is extracted with reference to the tag enclosed in <>, and output to the web reader application control unit 591. The web reader application control unit 591 creates a chapter based on the filtering result input from the HTML tag filter 594. “Chapter” is a unit of information (corresponding to one file of audio data) as one audio data, and one chapter is created in one page of a web page.

  In step S175, the web reader application control unit 591 determines information corresponding to the title of the chapter, that is, the song name in the music data and the artist name, based on the filtered result. Here, the name “ONSEI” is assigned to the artist name so that other information can be distinguished from voice data created by the mail watcher application. The title is determined with reference to the title of the corresponding web page.

  In step S176, the web reader application control unit 591 sets the reading voice set by the setting window 621 described with reference to FIG. 54 to voice 1, and the determined title and reading text are set in step S177. , Set (ie, output) to the reading management module 288.

  In step S178, the web reader application control unit 591 determines whether or not the instruction from the user whose input is detected in step S171 is reproduction of the web page by voice.

  If it is determined in step S178 that the instruction from the user is to reproduce the web page by voice, in step S179, the web reader application control unit 591 requests the reading management module 288 to reproduce the corresponding voice data. Generate and output a signal.

  In step S180, the sound reproduction process described with reference to FIG. 36 is executed, and the process ends.

  FIG. 56 shows an example of the display screen of the web browser 592 when audio is being reproduced. In contrast to the buttons displayed on the toolbar 603 in the processing of the web browser 592 other than the time of sound playback described with reference to FIG. 53, since the sound is being played back in FIG. 56, the button is temporarily displayed instead of the play button 612. A stop button 631 is provided, and the stop button 611 becomes active and can be operated, while the output button 616 to the external device becomes inactive and cannot be operated. Further, the text currently read out like the text 632 is changed to a selected state (inverted display).

  For example, when the text currently being read out describes “Please see http://www.yuhi.com for details”, this URL is the URL table described with reference to FIG. Therefore, the URL described above is replaced with the text “Sunset newspaper” in the filtering process of step S173. Therefore, the above-mentioned URL is not reproduced as an insignificant sound such as “Heat, Tea, Tea, Pea, Colon, Slash, etc.” at the time of audio reproduction, and is referred to as “sunset newspaper” which is meaningful to the user. Played as sound.

  If it is determined in step S178 that the command from the user is not the reproduction of the web page by voice, the command from the user is output of voice data to an external device. Therefore, in step S181, the web reader application control is performed. The unit 591 generates and outputs a control signal that requests the reading management module 288 to output the corresponding audio data to the external device.

  In step S182, the external device output process described with reference to FIG. 43 is executed, and the process ends.

  Through this process, as in the case of e-mail, after the information described on the web page is converted into a predetermined name after matching the registered URL or e-mail address, the text data is converted. Can be converted into audio data for reproduction or output to an audio storage device 294 such as a memory stick 131, for example.

  FIG. 57 shows a functional block diagram when the text-to-speech application is loaded into the RAM 54 and executed by the CPU 51 among the application programs 67 recorded in the HDD 67 described in FIG. .

  The text-to-speech application control unit 641 generates a control signal for displaying the operation panel 651 as shown in FIG. 58 simultaneously with the activation of the text-to-speech application, and outputs the control signal to the GUI control unit 642. The GUI control unit 642 For example, various settings are executed on the basis of a signal indicating the user's operation input from, and processing such as supplying the input text data to the reading management module 288 is executed.

  The URL / mail address filter 289 and the URL / mail address table 290 are the same as those described with reference to FIG.

  FIG. 58 shows an operation panel 651 displayed when the text-to-speech application is activated.

  The operation panel 651 includes a text box 661, a minimize button 662, a close button 663, a menu button 664, a stop button 665, and a play button 666.

  A text box 661 is used to input text data for audio output. In the text box 661, the user can input text using the keyboard 24, and a predetermined file or selected text is cut and pasted by operating the touch panel 25 or a mouse (not shown). By (drag and drop), it is also possible to input the corresponding data.

  The GUI control unit 642 outputs the text data input in the text box 661 to the text-to-speech application control unit 641.

  The minimize button 662 is a button for minimizing the display of the operation panel 651 without ending the text-to-speech application and displaying it as, for example, an icon on the toolbar at the bottom of the display screen. The close button 663 is a text button. This is a button for ending the reading application and deleting the display on the operation panel 651.

  When the menu button 666 is selected, a command box 671 as shown in FIG. 59 is displayed.

  The user can execute various operations by selecting various commands displayed in the command box 671. For example, when the user wants to output audio data corresponding to the input text data to an external device, by selecting the item “output to external device / media”, the corresponding audio data is output to, for example, the memory stick 131 or the like. Processing to output is executed.

  When the “set” item is selected from the command box 671, a dialog box 621 similar to that in FIG. 54 is displayed. In the dialog box 621, a check box 581 may be displayed in the same manner as in FIG. 49 on the display screen displayed when the output tag 572 to the external device / media is selected, as in FIG. Thus, the check box 581 may not be displayed. For example, when the check box 581 is displayed and selected, an output button is added to the external device / media and displayed next to the playback button 666 of FIG. 58, and an output command to the external device can be directly input. You can do it.

  Next, processing when the text-to-speech application is loaded into the RAM 54 and executed by the CPU 51 will be described with reference to the flowchart of FIG.

  In step S191, the text-to-speech application control unit 641 inputs text data from the GUI control unit 642 when the user inputs text (drop and drag) in the text box 661 or enters text. It is determined whether or not it has been received. If it is determined in step S191 that no text data has been input, step S191 is repeated until it is determined that text data has been input.

  If it is determined in step S191 that text data has been input, the filtering process described with reference to FIG. 38 is performed in step S192.

  In step S193, the text-to-speech application control unit 641 sets the set voice 1 as the reading voice.

  In step S 194, the text-to-speech application control unit 641 sets (outputs) the text for reading input in the text box 661 in the reading-out management module 288.

  In step S195, the text-to-speech application control unit 641 generates a control signal for requesting reproduction of the audio data corresponding to the input text data, and outputs the control signal to the reading management module 288.

  In step S196, the audio reproduction process described with reference to FIG. 42 is executed.

  In step S197, the text-to-speech application control unit 641 receives an operation input for “outputting the data to the external device / media” from the user based on the signal indicating the operation content of the user input from the GUI control unit 462. Judge whether or not you received it.

  If it is determined in step S197 that an operation input for outputting data to “external device / media” is received, the text-to-speech application control unit 641 inputs the text data input to the reading management module 288 in step S198. A control signal for requesting recording of audio data corresponding to the above to an external device or an external recording medium is generated and output to the reading management module 288.

  In step S199, the external device output process described with reference to FIG. 43 is executed, and the process ends.

  If it is determined in step S197 that an operation input for “outputting data to an external device / media” has not been received, the process ends.

  Through such processing, the user converts the text data desired by the user into a predetermined name after converting the registered URL or e-mail address, and converts the text data into voice data. It is possible to reproduce the sound or output it to the external sound storage device 294.

  As described above, in the present invention, text data in a plurality of application programs that match a registered URL or e-mail address is converted into a predetermined name, and then the text data is converted to the same name. Using a mechanism (here, the function of the reading management module 288), it is possible to synthesize a voice and reproduce it or output it to the outside.

  Accordingly, even if the alphabet is read as it is, such as a URL or an e-mail address, data that does not make sense as voice data can be converted into data that makes sense as voice data. The URL and e-mail address can be registered automatically from the bookmark and address book, or by the user inputting data.

  Here, four application programs have been described as examples. Needless to say, the present invention can be applied to all application programs that handle text data.

  In addition, by providing a user-friendly GUI, the user's setting process is facilitated, and not only the convenience as an application program, but also its entertainment is dramatically improved.

  The present invention is not limited to the notebook personal computer 2 but can be realized by the PDA 4 and the digital mobile phone with camera 5. In this case, the CPU 171 of the PDA 4 or the main control unit 251 of the camera-equipped digital cellular phone 5 is the same as the above-described processing (processing executed by the mail watcher application, web reader application, mail reader application, or text reading application). Execute the process.

  Furthermore, the present invention relates to a device that transmits or receives mail, such as a desktop personal computer, a terminal device of PHS (Personal Handyphone System), a digital mobile phone that does not have an imaging function, or a car navigation system, or The present invention can be applied to a device having a web page browsing function or a device that can process at least text data and output sound.

  The series of processes described above can also be executed by software. The software is a computer in which the program constituting the software is incorporated in dedicated hardware, or various functions can be executed by installing various programs, for example, a general-purpose personal computer For example, it is installed from a recording medium.

  As shown in FIG. 6 or FIG. 10, this recording medium is distributed to provide a program to the user separately from the computer, and includes a magnetic disk 121 or 191 (including a flexible disk) on which the program is recorded. ), Optical disk 122 or 192 (including CD ROM (Compact Disc Read Only Memory), DVD (Digital Versatile Disc)), magneto-optical disk 123 or 193 (including MD (Mini Disc) (trademark)), or semiconductor memory 124 Alternatively, it is configured by a package medium made of 194 or the like.

  Further, in the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but may be performed in parallel or It also includes processes that are executed individually.

  In the present specification, the term “system” represents the entire apparatus constituted by a plurality of apparatuses.

It is a figure for demonstrating transmission / reception of the data of an email and a web page. FIG. 2 is an external perspective view of the personal computer of FIG. 1. It is a top view of the main body of the personal computer of FIG. FIG. 2 is an enlarged view of the vicinity of a jog dial of the personal computer of FIG. 1. It is a right view which shows the structure of the right side of the personal computer of FIG. FIG. 2 is a block diagram illustrating an internal configuration example of the personal computer in FIG. 1. It is a figure which shows the external appearance of PDA. It is a figure which shows the external appearance of PDA with which the cradle was mounted | worn. It is a figure which shows the external appearance of PDA. It is a block diagram for demonstrating the internal structure of PDA. It is a figure which shows the external appearance of the digital mobile phone with a camera. It is a figure which shows the external appearance of the camera part of the digital mobile phone with a camera. It is a block diagram which shows the structure of the digital mobile phone with a camera. It is a figure for demonstrating sharing of the information using a memory stick. It is a functional block diagram when a mail watcher application is started. It is a figure for demonstrating the email of a text format. It is a figure for demonstrating the email of an HTML format. It is a figure for demonstrating the tag of the email of an HTML format. It is a figure for demonstrating the data registered into URL and a mail address table. It is a figure for demonstrating GUI for registering data to URL and a mail address table. It is a functional block diagram for demonstrating automatic registration of the data to a URL and a mail address table. It is a figure for demonstrating a bookmark file. FIG. 16 is a more detailed functional block diagram of the reading management module of FIG. 15. It is a figure for demonstrating the command box of a mail watcher application. It is a figure for demonstrating the setting window displayed when the mail tab is selected. It is a figure for demonstrating the setting window displayed when the reading-out tab is selected. It is a figure for demonstrating the setting window of the voice displayed when a detail button is selected. It is a figure for demonstrating the voice creation window displayed when the new voice creation button is selected. It is a figure for demonstrating the user word dictionary tool window displayed when a user dictionary button is selected. It is a figure for demonstrating the addition window of the word displayed when an addition button is selected. It is a figure for demonstrating the setting window displayed when the output tab is selected for an external apparatus / media. It is a figure for demonstrating the setting window displayed when the other tab is selected. It is a flowchart for demonstrating the process of a mail watcher. It is a figure for demonstrating the operation input for instruct | indicating the output of an unread mail. It is a figure for demonstrating a text display window. It is a flowchart for demonstrating reading sound setting processing. It is a figure for demonstrating the header of an email. It is a flowchart for demonstrating a filter process. It is a flowchart for demonstrating a mail address process. 6 is a flowchart for explaining URL processing 1; 10 is a flowchart for explaining URL processing 2; It is a flowchart for demonstrating audio | voice reproduction | regeneration processing. It is a flowchart for demonstrating an external apparatus output process. It is a figure for demonstrating a dialog box. It is a flowchart for demonstrating a data deletion process. It is a functional block diagram when the mail reader application is activated. It is a figure for demonstrating the mail software display screen on which the tool bar for mail readers was displayed. It is a figure for demonstrating the setting window displayed when the reading-out tab is selected. It is a figure for demonstrating the setting window displayed when the output tab is selected for an external apparatus / media. It is a flowchart for demonstrating the process of a mail reader. It is a functional block diagram in case the web reader application is starting. It is a figure for demonstrating the source of a web page. It is a figure for demonstrating the web browser display window where the web reader tool bar was displayed. It is a figure for demonstrating the setting window displayed when the reading-out tab is selected. It is a flowchart for demonstrating the process of a web reader. It is a figure for demonstrating the web browser display window in audio | voice output. It is a functional block diagram when the text-to-speech application is activated. It is a figure for demonstrating an operation panel. It is a figure for demonstrating a menu. It is a flowchart for demonstrating a text-to-speech process.

Explanation of symbols

  2 Personal computer, 4 PDA, 5 Digital mobile phone with camera, 51 CPU, 131 Memory stick, 171 CPU, 251 Main control unit, 271 Portable music player, 281 Mail watcher application control unit, 282 MAPI mailer, 283 GUI control unit , 284 mail filter, 286 HTML tag filter, 289 URL / mail address filter, 290 URL / mail address table, 295 bookmark conversion unit, 296 bookmark, 297 address book conversion unit, 298 address book, 301 reading control unit, 206 text analysis Unit, 308 voice synthesis unit, 309 phoneme database, 310 voice setting unit, 311 playback control unit, 531 mail reader application Control unit, 532 mail software, 533 GUI control unit, 534 mail filter, 561 setting window, 591 web reader application control unit, 592 web browser, 593 GUI control unit, 594 HTML tag filter, 641 text reading application control unit, 642 GUI Control unit, 651 Operation panel

Claims (5)

In an information processing apparatus that synthesizes voice data corresponding to text data included in an e-mail,
Storage means for storing a plurality of types of reading voice;
Attribute classification means for classifying the attribute of the text data based on a quotation mark added to each line of the text data and the number of the quotation marks;
For each attribute of the text data classified by the attribute classifying means, from among a plurality of types of the reading voices stored in the storage means, the reading voices of different types are used to include the electronic mail. Voice data synthesis means for synthesizing the voice data corresponding to text data;
An information processing apparatus comprising: output means for outputting the voice data synthesized by the voice data synthesis means. Display control means for controlling the display of information to assist the user's operation input;
And an operation input means for receiving an operation input of the user,
The display control means controls the display of the information to assist the user's operation input for setting a reading voice for each attribute from a plurality of types of the reading voice,
The voice data synthesizing means is selected from a plurality of types of the reading voices according to the user's operation input that is input by the operation input means and refers to the information whose display is controlled by the display control means. The information processing apparatus according to claim 1, wherein a reading voice for each attribute is set, and the voice data corresponding to the text data included in the electronic mail is synthesized. Operation input means for receiving user operation input;
Read-out voice generating means for setting parameters relating to voice characteristics in accordance with the user's operation input by the operation input means and generating the read-out voice;
The information processing apparatus according to claim 1, wherein the storage unit stores the reading voice generated by the reading voice generation unit. In an information processing method of an information processing apparatus that synthesizes voice data corresponding to text data included in an e-mail using a plurality of types of reading voices stored in a storage unit,
An attribute classification step for classifying the attribute of the text data based on the quotation mark added to each line of the text data and the number of the quotation marks;
For each attribute of the text data classified by the processing of the attribute classification step, from the plurality of types of reading voices stored in the storage unit, using different types of the reading voices, included in the e-mail A voice data synthesis step of synthesizing the voice data corresponding to the text data to be
An output control step of controlling output of the voice data synthesized by the voice data synthesis step. A program for causing a computer to execute a process of synthesizing voice data corresponding to text data included in an e-mail using a plurality of types of reading voices stored in a storage unit,
An attribute classification step for classifying the attribute of the text data based on the quotation mark added to each line of the text data and the number of the quotation marks;
For each attribute of the text data classified by the processing of the attribute classification step, from the plurality of types of reading voices stored in the storage unit, using different types of the reading voices, included in the e-mail A voice data synthesis step of synthesizing the voice data corresponding to the text data to be
An output control step for controlling the output of the voice data synthesized by the voice data synthesis step.

Images