JP2003084785A - Information processor, information processing method, recording medium, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To jump to a link destination by an easy operation during sound output of data of a web page. SOLUTION: A web reader application control part 271 acquires data of a web page from a web browser 272 and analyzes a tag to extract a link tag and relates it to a linked text and outputs it to a read management module 276 to convert it to voice data. The read management module 276 informs the web reader application control part 271 of reproducing of voice data related to the link tag. When receiving a prescribed operation input from an operation input part 279 in a prescribed time (waiting state), the web reader application control part 271 controls the web browser 272 to jump to a web page of the corresponding link destination and acquires also data of the web page of the link destination and outputs the data to the read management module 276 to convert it into voice data.

Description

Detailed Description of the Invention

[0001]

TECHNICAL FIELD The present invention relates to an information processing apparatus and an information processing method, a recording medium, and a program,
In particular, the present invention relates to an information processing apparatus and an information processing method, a recording medium, and a program suitable for use when converting text data into voice data by voice synthesis.

[0002]

2. Description of the Related Art Conventionally, there is a technique for converting text data into voice data and reproducing the voice, such as software for synthesizing a sentence key-input to a personal computer and reading it. This technique is applied to, for example, browsing a web page, reading an e-mail, or reading text data designated by a user.

Such a technique is very convenient, for example, when the user wants to check the contents of a web page or an electronic mail while doing other work.

[0004]

However, in order to perform an operation of jumping from a web page that is being voice-reproduced to a web page to which a link is set, for example, an input device such as a mouse or a touch pad is operated. Then, the mouse cursor must be moved to the corresponding text portion on the displayed web page and the click operation must be executed. These operations are cumbersome for the user who is checking the web page while performing other operations.

[0005] Usually, the text linked to other pages is displayed in a different color from the text not linked. However, while doing other work, the user who is checking the web page does not follow the text displayed on the web page at a glance along with the voice output, so the text currently output as voice is not displayed. It was difficult to confirm whether the link was established.

The present invention has been made in view of such a situation, and it is possible to execute a process of jumping from a voice output web page to a linked page by a simple operation. To do.

[0007]

An information processing apparatus according to the present invention is disclosed on a network from first acquisition means for acquiring first information and first information acquired by the first acquisition means. First extracting means for extracting third information including the address of the second information stored, and second extracting means for extracting text data from the first information acquired by the first acquiring means. And voice generation means for performing voice synthesis using the text data extracted by the second extraction means and generating voice data corresponding to the text data.
Output means for outputting the voice data generated by the voice generating means, and output means for outputting the voice data generated from the text data corresponding to the third information extracted by the first extracting means. It is determined whether or not there is a predetermined operation input within a predetermined period after the detection means for detecting and the output of the voice data generated from the text data corresponding to the third information is detected by the detection means. And a second acquisition unit that acquires the second information based on the third information when the determination unit determines that a predetermined operation input has been made during a predetermined period. To do.

In the voice generating means, from the text data corresponding to the third information extracted by the first extracting means,
It is possible to generate the voice data with the first voice and generate the voice data with the second voice different from the first voice from the other text data.

The network may be the Internet and the third information may include the URL of a given web page.

The predetermined time period can be a predetermined time period.

During a predetermined period, the output means causes the next third
The output of the voice data generated from the text data corresponding to the information can be the period until the detection means detects.

The predetermined operation can be an operation input of a predetermined predetermined operation key.

The first information obtained by the first obtaining means may be information published on the network.

According to the information processing method of the present invention, a first acquisition step for acquiring the first information and the first information acquired by the processing of the first acquisition step are published on the network. A first extracting step of extracting third information including an address of the second information, and a second extracting step of extracting text data from the first information acquired by the processing of the first acquiring step, Speech synthesis is performed using the text data extracted by the processing of the second extraction step, and a speech generation step of generating speech data corresponding to the text data and the speech data generated by the processing of the speech generation step are output. Generated by the output step and the processing of the output step, the text data corresponding to the third information extracted by the processing of the first extraction step. A detection step of detecting that the voice data is output, and a predetermined period after the detection of the output of the voice data generated from the text data corresponding to the third information by the processing of the detection step is performed. Determination step for determining whether or not there is an operation input of
A second acquisition step of acquiring the second information based on the third information when it is determined by the processing of the determination step that a predetermined operation input has been performed in a predetermined period is included.

The program recorded on the recording medium of the present invention comprises a first acquisition step for acquiring the first information,
A first extraction step of extracting third information including an address of the second information published on the network from the first information acquired by the processing of the first acquisition step; and a first acquisition A second extraction step of extracting text data from the first information obtained by the processing of the step and a voice synthesis are executed using the text data extracted by the processing of the second extraction step to obtain text data. A voice generation step of generating corresponding voice data,
By the output step of outputting the voice data generated by the processing of the voice generation step and the processing of the output step,
The detection step of detecting that the voice data generated from the text data corresponding to the third information extracted by the processing of the first extraction step is output, and the detection step corresponds to the third information. A determination step of determining whether or not there is a predetermined operation input within a predetermined period after it is detected that the voice data generated from the text data is output, and a predetermined step during a predetermined period by the processing of the determination step If it is determined that there is an operation input, the third
And a second acquisition step of acquiring the second information based on the information.

The program of the present invention comprises a first acquisition step for acquiring the first information and a second information published on the network from the first information acquired by the processing of the first acquisition step. A first extraction step of extracting third information including an address of information, a second extraction step of extracting text data from the first information acquired by the processing of the first acquisition step, and a second extraction step of A voice generation step of performing voice synthesis using the text data extracted by the processing of the extraction step to generate voice data corresponding to the text data, and an output of outputting the voice data generated by the processing of the voice generation step. Steps,
By the processing of the output step, a detection step of detecting that the voice data generated from the text data corresponding to the third information extracted by the processing of the first extraction step is output, and by the processing of the detection step, The determination step of determining whether or not there is a predetermined operation input within a predetermined period after it is detected that the voice data generated from the text data corresponding to the information of 3 is output, and the processing of the determination step When it is determined that a predetermined operation input is made within a predetermined period, the computer is caused to execute a process including a second acquisition step of acquiring the second information based on the third information.

In the information processing apparatus, the information processing method and the program of the present invention, the first information is acquired,
The third information including the address of the second information published on the network is extracted from the acquired first information, and the text data is extracted from the acquired first information. Speech synthesis is executed using the text data, voice data corresponding to the text data is generated, the generated voice data is output, and voice data generated from the text data corresponding to the third information is output. Is detected, it is determined whether or not there is a predetermined operation input for a predetermined period after it is detected that the voice data generated from the text data corresponding to the third information is output, and the predetermined operation is performed. When it is determined that the predetermined operation input has been made during the period, the second information is acquired based on the third information.

[0018]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings.

A network system for transmitting / receiving electronic mail and browsing web pages will be described with reference to FIG.

A personal computer 2-1 or 2-2 is connected to the public line network 1. In addition, in the public line network 1, the PDA 4- through the base stations 3-1 to 3-4, which are fixed wireless stations, which are respectively arranged in cells obtained by dividing a communication service providing area into desired areas. 1 or 4-2, or digital mobile phone with camera 5-
1 or 5-2 is connected.

The base stations 3-1 to 3-4 connect the PDAs 4-1 and 4-2, which are mobile radio stations, and the digital mobile phones with cameras 5-1 and 5-2, for example, to W-CDMA (W
ideband code division multiple access) is a mobile radio station that connects wirelessly by code division multiple access
Large-capacity data can be transmitted at high speed at a maximum data transfer rate of 2 Mbps using the 2 GHz frequency band with the PDA 4-1 and 4-2 and the camera-equipped digital mobile phones 5-1 and 5-2. .

The PDA's 4-1 and 4-2, and the digital mobile phones with cameras 5-1 and 5-2 are the base stations 3-
Large-capacity data can be communicated at high speed by 1 to 3-4 and W-CDMA system, so not only voice call but also various kinds of data communication such as sending and receiving e-mail, browsing simple homepage, sending and receiving images, etc. You can

The base stations 3-1 to 3-4 are connected to the public line network 1 via wired lines. The public line network 1 is connected to the Internet 6, a subscriber wired terminal device (not shown), a computer network, a corporate network, and the like.

The access server 7 of the Internet service provider is connected to the public line network 1, and further connected to the content server 8 and the electronic mail server 9 owned by the Internet service provider.

The content server 8 requests from the subscriber wired terminal device, PDA 4-1 or 4-2, or camera-equipped digital mobile phone 5-1 or 5-2, or personal computer 2-1 or 2-2. Corresponding to, for example, contents such as simple homepage,
HTML (Hypertext Markup Language) method, or
It is provided as a compact HTML file.

The electronic mail server 9 is a server that manages transmission and reception of electronic mail. The email server 9
There is an SMTP server for sending and a POP server for receiving. SMT
The mail sent from the P server is not delivered directly to the destination POP server, but is sent to the destination POP server through several servers on the Internet 6. The receiving POP server temporarily stores the received email in the mailbox. The user who receives the e-mail uses the PDA 4-1 or 4-2, or the digital mobile phone with camera 5-1 or 5-2, or the personal computer 2-1 or 2-2 to use the electronic mail. Each time the mail server 9 is accessed, the electronic mail is received.

A large number of WWW (World
Wide Web) servers 10-1 to 10-N are connected. The WWW servers 10-1 to 10-N are TCP (Transm
ission Control Protocol) / IP (Internet Protocol)
Subscriber's wired terminal device, PDA4-
1 and 4-2, digital mobile phones with cameras 5-1 and 5-2, and personal computers 2-1 and 2-2.

By the way, the PDA 4-1 and 4-2 and the camera-equipped digital mobile phones 5-1 and 5-2 communicate with the base stations 3-1 to 3-4 by a simple transport protocol of 2 Mbps, and From stations 3-1 to 3-4,
Internet 6 and WWW servers 10-1 to 10
-Communicate up to N with TCP / IP.

The management control device 11 is, via the public line network 1, a subscriber wired terminal device, PDAs 4-1 and 4-2, digital mobile phones with cameras 5-1 and 5-2, and a personal computer 2-1. And 2-2, the authentication processing or billing processing for the subscriber wired terminal device, PDA 4-1 and 4-2, digital mobile phone with camera 5-1 and 5-2, and personal computer 2-1 and 2-2. And so on.

Hereinafter, when it is not necessary to individually distinguish the personal computers 2-1 and 2-2, they are simply referred to as the personal computer 2 and the base stations 3-1 to 3-4.
When it is not necessary to individually distinguish each of them, it is simply referred to as a base station 3, and when it is not necessary to individually distinguish PDA's 4-1 and 4-2, they are simply referred to as PDA 4, and a digital mobile phone with a camera 5-1 and When it is not necessary to distinguish 5-2 individually, it is simply referred to as a camera-equipped digital mobile phone 5.

2 to 5 show the external appearance of the personal computer 2.

The personal computer 2 is basically
It is composed of a main body 21 and a display unit 22 which can be opened and closed with respect to the main body 21. FIG. 2 shows the display unit 22 as the main body 2.
FIG. 3 is an external perspective view showing a state where it is opened with respect to FIG. Figure 3
4 is a plan view of the main body 21, and FIG. 4 is an enlarged view of a jog dial 23, which will be described later, provided on the main body 21. FIG. 5 is a side view of the jog dial 23 provided on the main body 21.

On the main body 21, a keyboard 24 operated when inputting various characters and symbols, and a touch pad 26 used as a pointing device operated when moving a pointer (mouse cursor) displayed on the LCD 25. , And a power switch 27 are provided on the upper surface thereof. In addition, the jog dial 23 and IEEE (In
Institute of Electrical and Electronics Engineers) 1
The 394 port 28 and the like are provided on the side surface of the main body 21. Instead of the touch pad 26, a stick type pointing device can be provided.

An LCD (Liquid Crystal Display) 25 for displaying an image is provided on the front of the display unit 22, and a power lamp PL, a battery lamp BL, and a message lamp ML provided as necessary (see FIG. A lamp comprising other LEDs (not shown) is provided. Further, an image pickup unit 30 having a CCD video camera 29 having a CCD (solid-state image pickup device), and a microphone 31 are provided in the center of the upper portion of the display unit 22. A shutter button 32 for operating the CCD video camera 29 is provided on the upper right side of the main body 21 in FIG.

The image pickup section 30 is rotatably fixed to the display section 22. For example, the image capturing unit 30 can be imaged in the same direction as the line of sight of the user operating the personal computer 2 from the position where the CCD video camera 29 can image the user operating the personal computer 2 by the operation of the user. Is rotated to.

Next, the jog dial 23 has, for example, a key A and a key B arranged on the right side of the keyboard 24 on the main body 21 in FIG. It is installed so that The jog dial 23 executes a predetermined process (for example, a screen scrolling process) in response to a rotating operation indicated by an arrow a in FIG. 4, and a process corresponding to a moving operation indicated by an arrow b in FIG. Icon selection process).

The IEEE1394 port 28 has a structure based on the standard defined by IEEE1394, and a cable based on the standard defined by IEEE1394 is connected thereto.

Next, an example of the internal structure of the personal computer 2 will be described with reference to FIG.

Central processing unit (CPU (Central Processing
Unit)) 51 is composed of, for example, a Pentium (registered trademark) processor manufactured by Intel, and is connected to the host bus 52. A bridge 53 (so-called north bridge) is further connected to the host bus 52, and the bridge 53 is an AGP (Accelerated Graph).
ics Port) 50 and PCI (Periph)
It is connected to the eral component interconnect / interface) bus 56.

The bridge 53 is, for example, manufactured by Intel.
It is composed of 440BX which is AGP Host Bridge Controller, and CPU 51 and RAM (Random Access Memo).
ry) 54 (so-called main memory) and the like are controlled. Further, the bridge 53 controls the video controller 57 via the AGP 50. The bridge 53 and the bridge (so-called south bridge (PCI-ISA Bridg
e)) 58 constitutes a so-called chipset.

The bridge 53 is also connected to the cache memory 55. The cache memory 55 is SR
As compared with the RAM 54 such as AM (Static RAM), it is configured by a memory capable of executing a faster write or read operation, and caches (temporarily stores) a program or data used by the CPU 51.

The CPU 51 has a primary
Compared to the cache memory 55, it has a cache that can operate at a higher speed and is controlled by the CPU 51 itself.

The RAM 54 is, for example, DRAM (Dynamic RAM)
A program executed by the CPU 51, or a CPU
The data required for the operation of 51 are stored. Specifically, RA
The M54 is loaded from the HDD 67 at a predetermined timing.
G and other application programs 54H
(Including a web reader application described later) is stored.

The e-mail program 54A is used by the modem 7
5, a program for sending and receiving communication text (e-mail) via the public line network 1, the Internet service provider, the electronic mail server 9, and the Internet 6.

The auto-pilot program 54B executes a plurality of preset processes (or programs), etc.
It is a program that is sequentially activated and processed in a preset order.

Jog dial status monitoring program 54C
Receives a notification from each of the application programs described above as to whether or not it is compatible with the jog dial 23, and when the corresponding application is compatible with the jog dial 23, the LCD 25 displays what can be done by operating the jog dial 23. Display it.

Jog dial status monitoring program 54C
Also detects an event of the jog dial 23 (operation in which the jog dial 23 is rotated in the direction indicated by the arrow a in FIG. 4 or is pressed in the direction indicated by the arrow b in FIG. 4) and corresponds to the detected event. Execute the process. The jog dial driver 54D executes various functions in response to the operation of the jog dial 23.

An OS (Operating System) 54E is a computer represented by, for example, so-called Windows (registered trademark) 95 or Windows (registered trademark) 98 of Microsoft Corporation, or so-called Mac OS (registered trademark) of Apple Computer Corporation. It is a program that controls basic operations.

The communication program 54F is
The electronic mail program 5 executes the process for peer-to-peer communication and establishes the communication connection.
4A is controlled to cause the communication partner to transmit an electronic mail to which the IP address of the personal computer 2 is attached, or to acquire the IP address from a predetermined electronic mail transmitted from the communication partner.

The communication program 54F also controls the web browser 54G to perform communication based on the function of the web browser 54G.

The web browser 54G executes processing for browsing (displaying on the display unit 22) data of a predetermined web page under the control of the communication program 54F.

The application program 54H is composed of various application programs such as a web reader application to be described later and an application program for converting text data into voice data and outputting the data.

The video controller 57 is connected to the bridge 53 via the AGP 50, receives data (image data or text data, etc.) supplied from the CPU 51 via the AGP 50 and the bridge 53, and converts the received data into the received data. The corresponding image data is generated, and the generated image data or the received data is stored in the built-in video memory as it is. The video controller 57 causes the LCD 25 of the display unit 22 to display an image corresponding to the image data stored in the video memory.

The video controller 57 is a CCD
The video data supplied from the video camera 29 is transferred to the PC.
It is supplied to the RAM 54 via the I bus 56.

A sound controller 64 is connected to the PCI bus 56. Sound controller 64
Captures voice from the microphone 31, generates data corresponding to the voice, and outputs the data to the RAM 54. The sound controller 64 also drives the speaker 65 to cause the speaker 65 to output sound.

A modem 75 is connected to the PCI bus 56. The modem 75 is connected to the public line network 1 and executes a communication process via the public line network 1 or the Internet 6.

PC card slot interface 11
1 is connected to the PCI bus 56 and supplies the data supplied from the interface card 112 mounted in the slot 33 to the CPU 51 or the RAM 54, and the CP.
The data supplied from U51 is output to the interface card 112. The drive 113 is connected to the PCI bus 56 via the PC card slot interface 111 and the interface card 112.

The drive 113 is equipped with a magnetic disk 121, an optical disk 122, and a magneto-optical disk 12 mounted therein.
3 or the semiconductor memory 124 (including a Memory Stick (trademark) 131 described later with reference to FIG. 7) is read, and the read data is used as the interface card 112, the PC card slot interface 111, and the PCI bus 56. Through ram
Supply to 54. Further, data generated by the processing of the CPU 51 (for example, audio data generated by the processing described later) is used for the magnetic disk 121, the optical disk 122, the magneto-optical disk 123 mounted on the drive 113, or the semiconductor memory 124 (memory stick 131). )
Can be stored in.

Needless to say, the memory stick slot may be separately prepared so that the memory stick 131 can be connected without the intermediary of the interface card 112 and the drive 113.

Therefore, since the personal computer 2 is constructed so that the memory stick 131 can be attached, another electronic device (for example, PDA 4, camera-equipped digital mobile phone 5, or FIG. 14) is used via the memory stick 131. Portable music player 2 which will be described later
65) and the like can be shared.

The PCI bus 56 has a bridge 58.
(So-called South Bridge) is also connected. The bridge 58 is composed of, for example, a PIIX4E manufactured by Intel Corp., and the IDE (Integrated Drive Electrode).
nics) controller / configuration register 59, IDE interface 61, USB interface 68 and the like are incorporated. Bridge 58
Device connected to DE bus 62 or ISA / E
IO (Industry Standard Architecture / Extended In
put Output) Bus 63 or I / O interface 6
Various I / O such as control of devices connected via 9
Control (Input / Output).

The IDE controller / configuration register 59 has two IDs, a so-called primary IDE controller and a secondary IDE controller.
It is composed of an E controller, a configuration register, and the like (both not shown).

The primary IDE controller has an ID
The HDD 67 is connected via the E-bus 62. In addition, the secondary IDE controller may be connected to another IDE bus, such as a CD ROM drive or HDD (not shown),
When a so-called IDE device is mounted, the mounted IDE device is electrically connected.

The HDD 67 is an electronic mail program 67.
A, an autopilot program 67B, a jog dial status monitoring program 67C, a jog dial driver 67D, an OS 117E, a communication program 67F, a web browser 67G, and other application programs 67H (including a web reader application described later) and the like are recorded.

The electronic mail program 67A to the application program 67H recorded in the HDD 67
Etc. are loaded into the RAM 54 as appropriate.

The ISA / EIO bus 63 is further provided with I / O.
The interface 69 is connected. The I / O interface 69 is composed of an embedded controller, and inside thereof, a ROM 70, a RAM 71, and a CPU 72 are mutually connected.

The ROM 70 stores in advance an IEEE1394 interface program 70A, an LED control program 70B, a touch pad input monitoring program 70C, a key input monitoring program 70D, a wakeup program 70E, a jog dial status monitoring program 70F and the like.

IEEE1394 interface program 70
A transmits / receives data (data stored in a packet) conforming to the IEEE1394 standard via the IEEE1394 port 28. The LED control program 70B controls lighting of a power lamp PL, a battery lamp BL, a message lamp ML provided as necessary, or other lamps including LEDs. The touch pad input monitoring program 70C is a touch pad 26 corresponding to a user operation.
It is a program that monitors the input from.

The key input monitoring program 70D is a program for monitoring the input from the keyboard 24 or other key switches. Wake-up program 70
E checks whether or not a preset time has come based on the data indicating the current time supplied from a timer circuit (not shown) of the bridge 58, and when the preset time comes, a predetermined value is given. It is a program for managing the power supply of each chip constituting the personal computer 2 in order to activate the processing (or program) of FIG. The jog dial status monitoring program 70F uses the jog dial 2
3 is a program for constantly monitoring whether the rotary encoder 3 is rotated or whether the jog dial 23 is pressed.

The ROM 70 further includes a BIOS (Basic Input / Out
put System (basic input / output system) 70G is written. The BIOS 120G controls data transfer (input / output) between the OS or application program and the peripheral device (touch pad 26, keyboard 24, HDD 67, or the like).

The RAM 71 is a register 71 for registering LED control, touch pad input status, key input status, or set time registers, jog dial status monitoring I / O register, or IEEE1394 I / F register.
A to 71F. For example, when the jog dial 23 is pressed and the electronic mail program 54A is activated in the LED control register, a predetermined value is stored, and lighting of the message lamp ML is controlled according to the stored value. It When the jog dial 23 is pressed, a predetermined operation key flag is stored in the key input status register. A predetermined time is set in the set time register in response to the operation of the keyboard 24 or the like by the user.

Further, the I / O interface 69 is connected to the jog dial 23, a connector (not shown),
Touchpad 26, keyboard 24, IEEE1394 port 2
8 and the shutter button 32 are connected to output signals corresponding to operations on the jog dial 23, the touch pad 26, the keyboard 24, or the shutter button 32 to the ISA / EIO bus 63. Also, I / O
The interface 69 controls data transmission / reception with a device connected via the IEEE1394 port 28. Further, the I / O interface 69 has a power lamp PL,
The battery lamp BL, the message lamp ML, the power supply control circuit 73, and other lamps including LEDs are connected.

The power supply control circuit 73 is connected to the built-in battery 74 or the AC power supply, supplies necessary power to each block, and controls the charging of the built-in battery 74 or the second battery of the peripheral device. . The I / O interface 69 also monitors the power switch 27 that is operated when the power is turned on or off.

The I / O interface 69 executes the IEEE1394 interface program 70A to the jog dial status monitoring program 70F by the power supply provided inside even when the power is off. That is, IEEE13
94 The interface program 70A to the jog dial status monitoring program 70F are always operating.

Therefore, when the power switch 27 is off, the CPU 5
Since the I / O interface 69 executes the jog dial status monitoring program 70F even when the jog dial 23 is pressed when the jog dial 23 is pressed in the power saving state or the power off state, The computer 2 starts processing of predetermined software or script files set in advance.

As described above, in the personal computer 2, since the jog dial 23 has a programmable power key (PPK) function, it is not necessary to provide a dedicated key.

7 to 9 are views for explaining the external appearance of the PDA 4. FIG. 7 is a perspective view of the PDA 4 when gripped. FIG. 8 is a perspective view of the PDA 4 mounted on the cradle 141. FIG. 9 is a front view of the PDA 4.

The housing of the PDA 4 is formed in a size that can be held and operated with one hand. On the upper part of the PDA 4, there is provided a slot into which the memory stick 131 containing the semiconductor memory is inserted.

The memory stick 131 is a type of flash memory card developed by Sony Corporation, the applicant of the present application. This Memory Stick 13
1 is EEPROM (Electrically Erasableand), which is a non-volatile memory that can be electrically rewritten and erased in a small and thin plastic case with a length of 21.5 x width 50 x thickness 2.8 [mm].
A flash memory device, which is a type of Programmable Read Only Memory, is stored, and various data such as images, voices, and music can be written and read out through a 10-pin terminal.

Also, the Memory Stick 131 adopts a unique serial protocol that can ensure compatibility with the equipment used even when the specifications of the built-in flash memory are changed due to an increase in capacity, and a maximum writing speed of 1.5 [ MB /
S] and a maximum read speed of 2.45 [MB / S], and high reliability is ensured by providing an erasure prevention switch.

As shown in FIG. 8, the PDA 4 is mounted on the cradle 141 so that the lower surface of the PDA 4 and the upper surface of the cradle 141 are in contact with each other. On the bottom surface of the PDA4, a USB (Universal Serial Bus) for connecting to the cradle 141
s) Ports (not shown) and the like are provided. The cradle 141 is a docking station when the PDA 4 and the personal computer 2 are connected by wire to exchange information and each data is updated to the latest data (so-called hot sync is used to synchronize data).

The PDA 4 has a display section 161, keys 162,
Also, a jog dial 151 and the like are provided.

The display section 161 is composed of a thin display device such as a liquid crystal display device and displays an image such as an icon, a thumbnail or a text. A touch pad is provided on the upper side of the display unit 161. By pressing the touch pad with a finger or a pen, predetermined data or operation instructions are input to the PDA 4.

The key 162 is composed of an input key or the like, and is used for inputting selection of an icon or thumbnail displayed on the display unit 161.

The jog dial 151 is used for inputting selection of an icon or thumbnail displayed on the display section 161 in response to a rotating operation or a pressing operation on the main body side.

Next, the internal structure of the PDA 4 will be described with reference to FIG.

CPU (Central Processing Unit) 171
Is a Flash ROM (Read only Memory) 173 or EDO D synchronized with the clock signal supplied from the oscillator 172.
RAM (Extended Data Out Dynamic Random Access Memor
y) Execute various programs such as the operating system stored in 174 or developed application programs.

The Flash ROM 173 is an EEPROM (Electricall
y Erasable Programmable Read Only Memory), which is a type of flash memory.
Basically fixed data of the program used by 71 and the parameters for calculation is stored. EDO DRAM174
Is a program used in the execution of the CPU 171
The parameters that change appropriately during the execution are stored.

Memory Stick Interface 17
5 is a Memory Stick 13 attached to the PDA 4
At the same time as reading the data from 1, the data supplied from the CPU 171 is written to the memory stick 131.

Therefore, the PDA 4 is the memory stick 1.
31 is mountable, another electronic device (for example, a personal computer 2, a camera-equipped digital mobile phone 5, or a portable music reproducing device 2 described later with reference to FIG. 14 is used via the memory stick 131.
65) and the like can be shared.

A USB (Universal Serial Bus) interface 176 receives data or a program from a drive 183, which is a connected USB device, in synchronization with a clock signal supplied from an oscillator 177, and is supplied from the CPU 171. Drive data 183
Supply to. The USB interface 176 is the oscillator 1
In synchronization with a clock signal supplied from 77, data or a program is input from the connected cradle 141, which is a USB device, and the data supplied from the CPU 171 is supplied to the cradle 141.

In addition, the USB interface 176 includes
The drive 183 is also connected. The drive 183 is
Mounted magnetic disk 191, optical disk 19
2. Magneto-optical disk 193 or semiconductor memory 194
The data or program recorded in the memory is read, and the data or program is read via the USB interface 176, and is connected to the CPU 171 or E.
Supply to the DO DRAM174. The drive 183 is C
The data or program supplied from the PU 171 is loaded with the magnetic disk 191, optical disk 192,
The data is recorded on the magneto-optical disk 193 or the semiconductor memory 194.

The flash ROM 173, EDO DRAM 174, memory stick interface 175, and USB interface 176 are connected to the CPU 171 via an address bus and a data bus.

The display unit 161 has the CPU 1 via the LCD bus.
The data is received from 71, and the image or the character corresponding to the received data is displayed. Touchpad controller 17
When a touch pad provided on the upper side of the display unit 161 is operated, the reference numeral 8 receives data corresponding to the operation (for example, indicating touched coordinates) from the display unit 161, and a signal corresponding to the received data. Via the serial bus to CP
Supply to U171.

EL (Electroluminescence) driver 17
Reference numeral 9 operates the electroluminescent element provided on the back side of the liquid crystal display portion of the display portion 161 to control the display brightness of the display portion 161.

The infrared communication section 180 uses the infrared light as a medium to transfer the data received from the CPU 171 to a UART (Universa
The data is transmitted to another device (not shown) via the asynchronous receiver transmitter), and the data transmitted from the other device using infrared rays as a medium is received by the CPU 17
Supply to 1. That is, the PDA 4 can communicate with other devices via the UART.

The voice reproducing unit 182 is composed of a speaker, a voice data decoding circuit, and the like, and decodes and reproduces voice data stored in advance or voice data received via the Internet 6. And output audio. For example, the audio reproducing unit 182 may include the buffer 181.
The audio data supplied from the CPU 171 is reproduced via the, and the audio corresponding to the data is output.

The key 162 is composed of an input key or the like,
When various commands are input to the CPU 171, they are operated by the user.

The jog dial 151 supplies the CPU 171 with data corresponding to a rotating operation or a pressing operation on the main body side.

The power supply circuit 186 includes a battery 184 installed or an AC (Alternating curr) connected.
ent) The voltage of the power source supplied from the adapter 185 is converted and the power source is supplied to each of the CPU 171 to the audio reproducing unit 182.

Next, the external structure of the digital mobile phone with camera 5 will be described. As shown in FIG. 11, the digital mobile phone with camera 5 includes a display unit 202 and a main body 20.
3 and is formed so as to be foldable by the hinge portion 204 at the center.

The display section 202 has an antenna 205 for transmission and reception, which can be pulled out or stored in the upper left part. The digital mobile phone 5 with camera is
Radio waves are transmitted and received to and from any of the base stations 3-1 to 3-4 which are fixed wireless stations.

Further, the display section 202 has a camera section 206 which is rotatable in an angular range of approximately 180 degrees at the center of the upper end. The camera-equipped digital mobile phone 5 has a camera unit 206.
The desired CCD image is captured by the CCD camera 207.

The camera unit 206 is set to about 18 by the user.
When the display unit 202 is rotated by 0 degrees and positioned, the display unit 202 is in a state in which the speaker 208 provided in the center on the back side of the camera unit 206 is located on the front side. As a result, the digital mobile phone with camera 5 is switched to a normal voice call state.

Further, a liquid crystal display 209 is provided in front of the display section 202. Liquid crystal display 209
Is the reception status of electric waves, the remaining battery level, the destination name and phone number registered in the phonebook, the outgoing call history, etc., the contents of the e-mail, the simple homepage, and C of the camera unit 206.
An image captured by the CD camera 207 is displayed.

On the other hand, the main body 203 has "0" on its surface.
Through operation keys 210 such as a numeric keypad “9”, a call key, a redial key, a call end / power key, a clear key and an electronic mail key are provided. Various instructions corresponding to the operation of the operation keys 210 are displayed on the digital mobile phone 5 with a camera.
Entered in.

A memo button 211 and a microphone 212 are provided below the operation keys 210 of the main body 203. When the memo button 211 is operated, the camera-equipped digital mobile phone 5 records the voice of the other party during the call. The camera-equipped digital mobile phone 5 collects the voice of the user during a call by the microphone 212.

Further, a rotatable jog dial 213 is provided above the operation keys 210 of the main body 203 so as to slightly project from the surface of the main body 203. The camera-equipped digital mobile phone 5 operates in accordance with a rotating operation of the jog dial 213, such as a scrolling operation of a phonebook list or an electronic mail displayed on the liquid crystal display 209, a page turning operation of a simple home page, or an image sending operation. Performs various actions.

For example, the main body 203 selects a desired telephone number from a plurality of telephone numbers in the telephone directory list displayed on the liquid crystal display 209 in response to the user's turning operation of the jog dial 213, and the jog dial 213 displays the desired telephone number. When pressed inward of the main body 203, the selected telephone number is confirmed, and the calling process is automatically performed to the confirmed telephone number.

A battery pack (not shown) is attached to the back of the main body 203, and when the call end / power key is turned on, power is supplied from the battery pack to each circuit portion to enable operation. Boot into state.

A memory stick slot 214 for mounting the removable memory stick 131 is provided on the upper left side surface of the main body 203. When the memo button 211 is pressed, the camera-equipped digital mobile phone 5 records the voice of the person who is talking on the memory stick 131. The camera-equipped digital mobile phone 5 stores an e-mail, a simple home page, an image captured by the CCD camera 207, or audio data generated by the processing described below in the attached memory stick 131 according to the operation of the user. Record.

Therefore, the digital mobile phone 5 with a camera
Is configured so that the memory stick 131 can be attached, other electronic devices (for example, personal computer 2, PDA 4,
Alternatively, it is possible to share data with a portable music reproducing device described later).

FIG. 13 shows a digital mobile phone 5 with a camera.
3 is a block diagram showing the internal configuration of FIG.

As shown in FIG. 13, the camera-equipped digital mobile phone 5 has a power supply circuit section 252 and an operation input control section 253 with respect to a main control section 251 which controls the respective sections of the display section 202 and the main body 203. , Image encoder 25
4, camera I / F (interface) 255, LCD
(Liquid Crystal Display) control unit 256, demultiplexing unit 258, modem circuit 259, and audio codec 2
60 are connected to each other via a main bus 261, and an image encoder 254, an image decoder 257, a demultiplexing unit 258, a storage / reproducing unit 263, a modulation / demodulation circuit unit 25.
9 and an audio codec 260 are connected to each other via a synchronization bus 262.

The power supply circuit section 252 can operate the digital mobile phone with camera 5 by supplying power to each section from the battery pack when the end call / power key is turned on by the operation of the user. Boot into state.

The digital mobile phone with camera 5 includes a CPU, R
Under the control of the main control unit 251 including OM and RAM, in the voice call mode, the voice signal collected by the microphone 212 is converted into digital voice data by the voice codec 260. In the camera-equipped digital mobile phone 5, the modulation / demodulation circuit unit 259 performs spectrum spread processing on the digital audio data, the transmission / reception circuit unit 264 performs digital-analog conversion processing and frequency conversion processing, and then transmits the data via the antenna 205.

Further, the digital mobile phone 5 with a camera is
In the voice call mode, the reception signal received by the antenna 205 is amplified by the transmission / reception circuit unit 264, subjected to frequency conversion processing and analog-digital conversion processing, and subjected to spectrum despreading processing in the modulation / demodulation circuit unit 259.
It is converted into an analog voice signal by 60. The camera-equipped digital mobile phone 5 causes the speaker 208 to output audio corresponding to the analog audio signal.

Furthermore, the digital mobile phone with camera 5
When sending an e-mail in the data communication mode, the text data of the e-mail input by operating the operation key 210 or the jog dial 213
It is sent to the main control unit 251 via the operation input control unit 253.

The main control section 251 performs spread spectrum processing on the text data in the modulation / demodulation circuit section 259, performs digital-analog conversion processing and frequency conversion processing in the transmission / reception circuit section 264, and then transmits it to the base station 3 via the antenna 205. .

On the other hand, when the camera-equipped digital mobile phone 5 receives an electronic mail in the data communication mode, the modulation / demodulation circuit unit 259 performs spectrum despreading processing on the received signal received from the base station 3 via the antenna 205. Then, the original text data is restored and then output to the LCD control unit 256. The LCD control unit 256 controls the liquid crystal display 209 to display the electronic mail.

In the camera-equipped digital mobile phone 5, the data corresponding to the electronic mail received according to the operation of the user can be recorded in the memory stick 131 via the storage / playback unit 263.

When transmitting image data in the data communication mode, the digital mobile phone 5 with a camera uses the CCD.
The image data captured by the camera 207 is supplied to the image encoder 254 via the camera interface unit 255.

By the way, the digital mobile phone 5 with a camera is
When the image data is not transmitted, the CCD camera 207
Image data captured by the camera interface unit 25
5 and the LCD control unit 256, the liquid crystal display 2
It is also possible to display it directly on 09.

The image encoder 254 is the CCD camera 2
The image data supplied from 07 is, for example, MPEG
(Moving Picture Experts Group) 2 or MPEG
4 is converted into coded image data by compression coding by a predetermined coding method such as 4 and the like, and this is demultiplexed by the demultiplexing unit 25.
Send to 8.

At the same time, the camera-equipped digital mobile phone 5 sends the sound collected by the microphone 212 during the image pickup by the CCD camera 207 to the demultiplexer 258 via the sound codec 260 as digital sound data.

The demultiplexing unit 258 is the image encoder 25.
Coded image data and audio codec 2 supplied from 4
The audio data supplied from 60 is multiplexed by a predetermined method, and the resulting multiplexed data is modulated / demodulated by the modulation / demodulation circuit section 25.
9 performs spectrum spread processing, and the transmission / reception circuit unit 264 performs digital-analog conversion processing and frequency conversion processing, and then transmits via the antenna 205.

On the other hand, in the data communication mode, the digital mobile phone with camera 5 receives the data received from the base station via the antenna 205, for example, when receiving the data of the moving image file linked to the simple homepage or the like. The signal is subjected to spectrum despreading processing by the modulation / demodulation circuit section 259, and the resulting multiplexed data is demultiplexed by the demultiplexing section 25.
Send to 8.

The demultiplexing unit 258 demultiplexes the multiplexed data into coded image data and audio data, and the synchronization bus 262.
The encoded image data is supplied to the image decoder 257 and the audio data is supplied to the audio codec 260 via the.

The image decoder 257 generates reproduced moving image data by decoding the coded image data by a decoding method corresponding to a predetermined coding method such as MPEG2 or MPEG4, and a liquid crystal display via the LCD control unit 256. 209 for display. Thereby, the digital mobile phone with camera 5 displays the moving image data included in the moving image file linked to the simple home page, for example.

At this time, the voice codec 260 simultaneously
After converting the audio data into an analog audio signal, the audio data is supplied to the speaker 208 to be output. As a result, the digital mobile phone with camera 5 reproduces the audio data included in the moving image file linked to the simple home page, for example.

In this case as well, in the case of the digital mobile phone with camera 5, as in the case of the electronic mail, the data such as the received simple home page or the text data such as the simple home page converted into the voice data by the process described later. By the user's operation.
It is possible to record to the Memory Stick 131 via

That is, as shown in FIG. 14, the personal computer 2, the PDA 4, the camera-equipped digital mobile phone 5, and the memory stick 131 can be mounted, and the audio data recorded in the memory stick 131 can be reproduced. Portable music player 26
It is possible to share information via the memory stick 131 in each of the five. For example, the data generated in the personal computer 2, the PDA 4, or the camera-equipped digital mobile phone 5 is recorded in the memory stick 131, and the portable music reproducing device 26
5, it is possible to reproduce.

In FIG. 14, the Memory Stick 1
Although the case of sharing information via 31 has been described, the personal computer 2, the PDA 4, the camera-equipped digital mobile phone 5, and the portable music playback device 265 are described.
It is needless to say that the information can be shared even if each of them is connected by wire or wirelessly and can exchange data.

15, in the personal computer 2, the web reader application is loaded into the RAM 54 among the application programs 67H recorded in the HDD 67 described with reference to FIG.
1 shows a functional block diagram when it is executed by 1.

Web reader application control unit 27
1 is a web browser 272 (the web browser 6 in FIG. 6).
7G) is activated, the data of the displayed web page (data described in a markup language such as HTML) is read according to a user operation input from the GUI control unit 273, and the reading management module 2 is read.
It is output to the operation input unit 279 within a predetermined time after being output to 76 and converted into voice data for voice output, or voice output corresponding to the data linked to a predetermined web page is performed. When a signal indicating the operation is input, a process of jumping to the corresponding link destination web page is executed, or a process of returning from the jumped link destination to the original page is executed.

Here, when the web reader application control unit 271 executes the processing, the web browser 272 must be activated (that is, the web browser 67G is loaded into the RAM 54 and the CPU 51 is used).
Must be run by).

Under the control of the web reader application control section 271, the GUI control section 273 controls the display of GUI such as dialog boxes and display windows for making various settings of the web reader application described later, and the user A signal indicating the content of the operation input executed on the displayed GUI is generated and supplied to the web reader application control unit 271.

The HTML tag filter 274 converts the data described in HTML supplied from the web reader application control unit 271 into the conversion table database 2
Filtering is performed based on the conversion table described in No. 75.

FIG. 16 shows an example of web page data (web page source) described in HTML.

In the web page source shown in FIG. 16, the portion enclosed by <HTML> and </ HTML> is H
It shows the entire source written in TML. And <
The part surrounded by HEAD> and </ HRAD> (the part indicated by L in the figure) is the header of the web page.

Although omitted in FIG. 16, <body bgcolor = "# BDFFFF" link = "# 0000FF" vlink = "
The part enclosed by # 800080 "> and </ body> is the text of the web page, and the part enclosed by <p align =" display position "> and </ p> is It is a paragraph in the text.
Since all are enclosed in <>, the part not enclosed in <> is the text data part.

The HTML tag filter 274 refers to the HTML tag (description of the part enclosed in <>), and based on the conversion table described in the conversion table database 275, for example, divides the body and the header, Furthermore, the body is divided into paragraphs, and the reading management module 276 executes processing for converting the data into data that can be processed. The conversion processing method may be changed to another method by changing the conversion table described in the conversion table database 275.

Although the description has been given here assuming that the web page is described in HTML, in the case where it is described in a markup language other than HTML by preparing a corresponding conversion table in the conversion table database 275. Is also possible.

The reading management module 276 extracts the link tag based on the input data, converts the text data without the tag into voice data, reproduces it, and outputs it to an external device for recording. The processing for executing the processing is executed, and the details thereof will be described later with reference to FIG.

The operation input unit 279 is composed of, for example, a predetermined key or button, and by the processing described later, the linked text data on the web page is converted into voice data and voice-outputted, and then the predetermined input. Before the time elapses, the user makes an operation input to jump to the corresponding link destination (access the web server that stores the data corresponding to the linked web page, and (Reading) is to instruct processing.

The key or button corresponding to the operation input unit 279 indicates a period from the time when linked text data on a web page is converted into voice data and voice output until a predetermined time elapses. Except for this, it may be used for other operation input, and for example, it is possible to instruct the jump processing to the link destination by a combination of a plurality of predetermined keys or buttons, or by the GUI control unit 275. It goes without saying that a button for instructing a “jump” operation may be prepared as the operation button to be controlled and displayed on the display screen.

Further, the operation input section 279 has not only an operation input function for instructing a process of jumping to the corresponding link destination, but also the jumped link similar to the "return" button that the web browser 272 has as standard. A function for inputting an operation for returning from the previous page may be provided.

URL / mail address filter 277
Refers to the data registered in the URL / mail address table 278, and if there is a match with the registered URL or mail address, changes them to the registered name.

FIG. 17 shows data registered in the URL / mail address table 278. FIG. 17 (A)
FIG. 6 is a diagram showing a URL table. The URL and the corresponding name are registered in the URL table.
FIG. 17B is a diagram showing a mail address table. The mail address and the corresponding name are registered in the mail address table.

The URL table is shown in FIG. 17C, for example.
As shown in FIG. 2, for example, the protocols may be classified and registered according to protocols such as “http” and “ftp”. By classifying and registering in this way, it is possible to shorten the processing time in the matching process with text data described later (U described later).
RL processing 2).

In FIG. 17, the URL table and the mail address table are described as being registered in the URL / mail address table 278, respectively. However, the URL and the mail address are registered in one table. It goes without saying that it is okay.

The registration data of the URL / mail address table 278 described with reference to FIG.
By displaying the list window 281 of call names as shown in FIG. 18A by the processing of 73,
The user can arbitrarily register, change or delete the registered contents.

For example, when a new URL is desired to be registered, by selecting the add button of the call name list window 281, the call name addition window 282 shown in FIG. 18 (B) is displayed, and the corresponding text box is displayed.
Enter the name and URL and select the OK button. If the user wants to change the contents of the registered URL, he or she selects the change button in the list window 281 of the call name to display the change window 283 shown in FIG. 18C, which is previously written in the text box. The registered name and URL currently registered can be changed and the OK button can be selected. Registered U
If you want to delete the RL, call name list window 281
The corresponding URL may be selected and the delete button may be selected.

Although the registration of the URL has been described here, it goes without saying that the registration of the name of the mail address is the same.

The registration of the URL and the mail address is performed by registering the URL and its display name registered in the application for browsing the web page, or the electronic mail address and its registered in the application for sending and receiving electronic mail. It is also possible to do this automatically using the display name. FIG. 19 is a functional block diagram for explaining the automatic registration of the URL and the mail address.

The web browser 67G outputs a file in which the URL registered by the user and its registered name are described from the bookmark 285 registered by the user to the bookmark conversion unit 286.

FIG. 20 shows a web browser 67G,
It is an example of a file showing a URL registered as "favorite" when using Internet Explorer (trademark) of Microsoft Corporation. The bookmark conversion unit 286 selects from the input “favorite” file,
The URL registered as a favorite and the registered name (in the example of FIG. 20, http://www.eeeclopedia.com
/ And "Electronic Encyclopedia", http: //www.***.com and "JITE
N "and http: //www.ss.net.or.jp // ... and" Ocean dictionary "). The bookmark converter 286
The registered name corresponding to the URL is registered in the URL / email address table 278 as a nickname for the URL.

The electronic mail program 67A outputs the electronic mail address registered in the address book 287 and its registered name to the address book converter 288. The address book conversion unit 288 uses the registered name corresponding to the electronic mail address as a nickname for the electronic mail address.
Register in the URL / email address table 278.

The UR automatically registered in this way
The user can manually change the registered contents of L or the e-mail address and the respective call names by using the change window 283 described with reference to FIG.

FIG. 21 shows the reading management module 276.
It is a more detailed functional block diagram of.

The reading control unit 301 controls the reading management module 276 as a whole, supplies various input signals and data to the corresponding parts, and causes them to execute predetermined processing.

The text management unit 302 stores the text data for reading supplied from the reading control unit 301,
The text data is registered in the reading text database 303, and according to the processing of the reading control unit 301, the text data corresponding to the web page for which the reading instruction is issued is read from the reading text database 303 and output to the reading control unit 301.

The dictionary management unit 304 receives instructions for inputting registration data of the user dictionary set by the user, updating and deleting of the dictionary, etc. by the processing described later, and stores the dictionary data registered in the dictionary database 305. to manage.

The text analysis unit 306 receives the input of the text data corresponding to the web page for which the reading instruction is issued, which is read from the reading text database 303 by the reading control unit 301 via the text management unit 302, and the dictionary database is received. 305 and the conversion rule database 307 are referred to, the text is analyzed and decomposed into words, and prosody information (so-called phonetic symbolic sound information).
Is generated and output to the voice synthesis unit 308. The conversion rule database 307 stores rules for generating prosody information.

The voice synthesis unit 308 is a text analysis unit 30.
Phoneme database 3 based on the prosody information input from 6
09, the synthesized voice data is generated (the input prosody information is connected to form the synthesized voice data). A plurality of phoneme databases 309 may be prepared,
Phoneme data for each of the phoneme data prepared in advance and the phoneme data created by the process described below is prepared. The speech synthesis unit 308 selects a phoneme designated by the user and generates synthetic speech data.

The voice setting unit 310 receives input of information indicating the speed and height of the voice, which is set by the user by the process described later, from the reading control unit 301 and is recorded in the phoneme database 309 as necessary. Change the phoneme data that is being played.

The reproduction control section 311 records the generated voice data in the voice database 312, and when receiving a voice data reproduction command from the reading control section 301, reads the corresponding voice data from the voice database 312. , And outputs it to the speaker 65 to reproduce the sound. The format of the audio data recorded in the audio database 312 is, for example, PCM (Pulse Code Modulatio).
n), and actually the internal recording unit (for example, HDD 67)
Or a format for recording on an external device or an external recording medium (for example, WAVE data, ATRAC (Adv
anced TRansform Acoustic Coding) 3, ADPCM (Adaptiv
e Differential Pulse Code Modulation))).

The file output unit 313 stores the audio data in a file storage device 291 (for example, HDD 6) inside the device.
7) receives an input of a control signal for recording, and receives audio data from the audio database 312 via the reproduction controller 311 and, if necessary, the data converter 3
In 14, the data format is converted (for example, PCM data is converted to ADPCM data), the header is added, and the frequency is changed (for example, 22 KHz data is converted to 11 KHz or 16 KH).
(changed to z) and output to the file storage device 291 for recording.

The external device output section 315 receives an input of a control signal for outputting the audio data to the outside (recording device or recording medium), and from the audio database 312,
Receives audio data input via the playback control unit 311
If necessary, the data conversion unit 314 converts the data format (for example, PCM data is converted to ADPCM data).
Then, a header is added, the frequency is changed (for example, 22 KHz data is changed to 11 KHz or 16 KHz), and the result is output to the external device output module 293.

The data conversion unit 314 is the file output unit 3
13 or receives data input from the external device output unit 315, for example, converts PCM data into ADPCM data,
The converted format is, for example, ATRAC3, and the data conversion module 2 outside the reading management module 276
If the data can be converted from PCM data to ATRAC3 in 93, the data to be converted is output to the data conversion module 293, and after the conversion processing is completed, the data input is received.

The data conversion module 293 is, for example,
When it is necessary to convert the audio data recorded in the audio database 312 into a data format that the data conversion unit 314 cannot convert, such as when converting the PCM format data to ATRAC3, the data conversion unit 314 outputs the audio data. The data input is received, converted into a corresponding format, and output to the data conversion unit 314.

The external device output module 293 outputs audio data to an external device connected to the personal computer 2 via, for example, the USB interface 68 or the PC card slot interface 111 shown in FIG. That is, it executes a process for recording audio data on a recording medium attached such as a memory stick 131, a memory inside the external device such as a PDA 4 or a recording medium attached to the external device. is there.

The processing executed by the data conversion module 292 and the external device output module 293 is performed by, for example, Open developed by Sony Corporation, the applicant of the present application.
It can also be realized by processing of application software that executes data conversion and data management of music data, such as MG (trademark).

As the audio storage device 294, any device can be used as long as it can record audio data. For example, the PDA 4, the camera-equipped digital mobile phone 5, the portable music playback device 265, or the like can be used. Can be used.

The text display unit 316 receives the display text input from the reading control unit 301,
It is registered in the display text database 317, and according to the processing of the reading control unit 301, the text for which a display instruction is issued is extracted from the web page being displayed by the web browser from the display text database 317. The user is notified of the position of the text in the voice output by reversing the display (FIG. 31 described later).

The text display portion 316 also displays, for example,
When data other than a web page such as an electronic mail can be converted into voice data and read out, corresponding text data can be read out and output to the display unit 22 for display. .

FIG. 22 shows a display screen when the web browser 272 is activated.

In the web browser display window 331, a display area 332 for displaying a web page and a web reader toolbar 333 are displayed in addition to the usual toolbar of the web browser. When the voice reproduction is not executed, the web reader toolbar 333 has a stop button 341, a play button 342, and a rewind button 34.
3, fast forward button 344, output to external device button 34
5 and a setting button 346 are provided.

When the user selects the play button 342 while none of the text data displayed in the display area 332 has been selected, the text data displayed in the display area is completely played back. Until the stop button 341 is selected or until the stop button 341 is selected. The user selects the text data displayed in the display area 332, and the play button 3
When 42 is selected, only the selected text is reproduced as audio data.

When the rewind button 343 or the fast forward button 344 is selected, the reproduction position of the audio data is changed. When the output button 345 to the external device is selected, the corresponding audio data is output to and recorded in the audio storage device 294 including the memory stick 131, for example.

When the setting button 346 is selected, as shown in FIG.
A setting window 351 shown in 3 is displayed. Figure 2
3 is a setting window 351 when the reading tab 354 is selected.

In the setting window 351, an OK button 352 selected when the setting is confirmed and the display of the setting window 351 is erased, and a cancel selected when the setting is canceled and the display of the setting window 351 is erased. A button 353 is provided.

Further, in the setting window 351, the detailed setting button 36 selected when the detailed setting of the voice 1 is performed.
1, detailed setting button 362 selected when performing detailed setting of voice 2, new voice creation button 363 selected when creating a new voice, user dictionary button selected when editing a user dictionary 364 is provided.

"Voice 1" is set as a voice when text data of a web page that is not linked to another web page is converted into voice data and read aloud. "Voice 2" is Of the text data of the web page, the text data linked to another web page is set as a voice when it is converted into voice data and read aloud. Here, the output voice is changed depending on whether or not it is linked to another web page. However, without changing the output voice, for example, another web page is displayed. When the voice corresponding to the linked text data is output, a buzzer sound, a chime, etc. are emitted, or the corresponding text is displayed in a blinking manner so that the user can display the text corresponding to the voice currently playing. May be able to notify that the link is established.

When the user wants to change the setting of voice 1 or voice 2, the user selects the corresponding one of the detailed setting buttons 361 or 362 to display the voice setting window 371 shown in FIG. .

The voice setting window 371 has a drop-down list box 381 for setting the type of voice.
A setting lever 382 for setting the reading speed, a setting lever 383 for setting the reading voice pitch,
The setting lever 384 for setting the accent strength of the voice to be read out, the test button 385 for reproducing the voice sample in the current setting, the set contents are registered,
An OK button 386 selected when deleting the voice setting window 371, a cancel button 387 selected when canceling the set contents and deleting the voice setting window 371, and help for the operation method are described. A help button 388 for displaying a help window or the like is provided.

In the drop-down list box 381, for example, in addition to preset voices of women, men, children, robots, aliens, etc., the user selects the new voice creation button 363 shown in FIG. Using the voice creation window shown in FIG. 25, the name of the voice corresponding to the phoneme originally created by the user is displayed and can be selected. Drop-down list box 38
With respect to the voice selected by 1, the speed of reading, the pitch of the voice, and the strength of the accent are set by the positions of the setting levers 382 to 384.

Although it has been described here that the reading speed, the pitch of the voice, and the strength of the accent can be set by the setting levers 382 to 384, other settings are set. It goes without saying that it is okay to be able to do so.

When it is desired to confirm what kind of voice the voice 1 or the voice 2 set using the setting levers 382 to 384 is, the test button 385 is pressed. When the test button 385 is pressed, a predetermined text such as "the set voice is such a voice" is displayed.
Plays with the set voice. The user presses the OK button 386 to confirm the confirmed voice setting, and presses the cancel button 387 to cancel.

In FIG. 25, the voice creation window 391 displayed when the new voice creation button 363 is selected.
Indicates. In the voice creation window 391, a text box 401 for inputting the name of the created voice, an import button 402, setting levers 403 to 410, a test button 411, a save button 412, and a close button 4.
13 and a help button 414 are provided.

The import button 402 is a button for reading the setting of an existing voice and reflecting it on the positions of the setting levers 403 to 410 when a new voice is created using the existing voice. For example, import button 40
When 2 is selected, a list of existing voices similar to the drop-down list box 381 of FIG. 24 is displayed, and the user can select a desired voice from the list.

The setting lever 403 is for setting the pitch of the voice by setting the speed of quick turning of the voice. The setting lever 404 is for setting the hardness of the voice. The setting lever 405 is for setting the husky degree (degree of blurring) of the voice. Setting lever 4
06 is for setting whether the voice can be clearly heard. The setting lever 407 is for setting the voice pitch. The setting lever 408 is used to set the pitch of the voice. The setting lever 409 is for setting the characteristics of a voice corresponding to a voice having a large vital capacity and a voice having a small vital capacity. The setting lever 410 is for setting the quickness of the voice (reproduction speed regardless of the pitch of the voice).

Here, by the setting levers 403 to 410, quick turning of the voice, firmness, husky degree, clarity,
Although the description has been made on the assumption that the height, the fits, the vital capacity, and the quickness of mouth can be set, it goes without saying that the features of the settable voice may be other features. When the user wants to confirm what kind of voice the voices set by the setting levers 403 to 410 are, the user can select the test button 411 and confirm the set voice.

The user inputs the name of the set voice in the text box 401. Text box 401
If the text is entered in, the save button 412 becomes active. When the user wants to save the set voice, the user selects the save button 412.

The close button 413 is a button selected when deleting the voice creation window 391. The help button 414 is a button selected when displaying a help window or the like in which help for voice creation or help for using this application is displayed.

Since the newly set voice is set as a voice that can be used not only by the web reader application but also by an application for executing another voice output, the web reader application control section 271
The setting contents of the newly created voice are output to the reading management module 276. The information of the newly set voice is processed by the reading control unit 301 by the phoneme database 3
09 is registered.

In the setting window 351 of FIG. 23,
When the user dictionary button 364 is selected, the user word dictionary tool window 421 shown in FIG. 26 is displayed.

User word dictionary tool window 421
Is a word display window 431, an add button 432, a change button 433, a delete button 434, and an OK button 43.
5, cancel button 436, and help button 43
It is composed of 7.

In the word display window 431, the phrase (text to be displayed) of the registered word, the reading, the part of speech corresponding to the phrase, and the reading priority when the same phrase is input are displayed. To be done.

When the add button 432 is selected, as shown in FIG.
The word addition window 441 shown in FIG. 7 is displayed. In the addition window 441, a text box 451 for inputting a word to be added, a text box 451
A text box 452 for inputting the reading of the word input to the text using a text that can express a sound (such as a kanji character that does not have a different sound like a kanji) such as hiragana, katakana, or romaji. , OK button 453 selected when registering the input contents,
A cancel button 454 is provided which is selected when the entered content is not registered.

Returning to the explanation of the user word dictionary tool window 421 shown in FIG. The change button 433 is used to select a word or phrase selected from the words or phrases displayed in the word display window 431 (display is inverted), a part of speech,
Alternatively, it is selected when a dictionary change window (not shown) for changing the priority is displayed.

The delete button 434 is selected to delete the registration of the selected word (display is reversed) among the words displayed in the word display window 431.

The OK button 435 is selected when registering a word with the registered contents displayed in the word display window 431 and deleting the user word dictionary tool window 421. The cancel button 436 is newly registered,
Alternatively, it is selected when the user changes the registered contents and cancels the user word dictionary tool window 421. The help button 437 is selected when displaying a help window (not shown) in which a method for registering a user dictionary is described.

Since the user dictionary set in this way is set as a user dictionary that can be used not only by the web reader application but also by other applications, the web reader application control section 271.
Reads the phrase newly registered in the user dictionary or the updated content of the user dictionary into the reading management module 276.
Output to the dictionary database 3 described with reference to FIG.
Register in 05.

FIG. 28 shows the setting window 351 when the output to external device / media tab 355 is selected.

The check box 461 indicates that the user
When outputting and recording audio data to an external device or medium (that is, a recording medium capable of recording information), the data previously recorded on the external device or medium may be overwritten. This is for setting whether or not to display a confirmation dialog box, which will be described later with reference to FIG. If the check box 461 is checked, a confirmation dialog box is displayed.

Next, referring to the flow charts of FIGS. 29 and 30, the web reader application executes RAM 5
Web page read-out processing in the case of being loaded in No. 4 and executed by the CPU 51 will be described.

In step S11, the web reader application control unit 271 selects the play button 342 or the output button 345 to the external device by the user based on the signal indicating the user's operation input from the GUI control unit 273. It is determined whether or not, that is, whether or not a command for reproducing the sound of the web page or outputting to the external device is input. When it is determined in step S11 that the command for reproducing the voice of the web page or the output to the external device is not input, the process in step S11 is repeated until it is determined that one of the commands is input. Be done.

If it is determined in step S11 that one of the commands for reproducing the voice of the web page or outputting to the external device is input, the web reader application control unit 271 determines in step S12. , From web browser 272, corresponding
Get data with HTML tags.

[0210] In step S13, the web reader application control unit 271 converts the acquired data into HTML.
It is output to the tag filter 274. HTML tag filter 27
4 filters the input data and outputs the result to the web reader application control unit 271. That is, the HTML tag filter 274 is shown in FIG.
Based on the HTML tag of the web page described using, for example, the text of the part enclosed by <title> and </ title> from the header data (the part indicated by L in FIG. 16) is , As the title of the web page, refers to the tags enclosed in <>, extracts the text, and outputs the text to the web reader application control unit 271. The web reader application control unit 271 uses the HTML tag filter 274.
Chapter based on the filtering result input from
create r. Chapter is a unit of information (corresponding to one file of voice data) that is one voice data, and one chapter of one web page is created.

In step S14, the filtering process described later with reference to FIG. 32 is executed.

In step S15, the web reader application control section 271 determines the title of Chapter, that is, the title of the music data or the information corresponding to the artist's name, based on the filtering result in step S13. Here, in the artist name,
It is named "ONSEI" so that other information can be distinguished from the audio data created by the web reader application. In addition, the title is determined by referring to the title of the corresponding web page.

[0213] In step S16, the web reader application control unit 271 determines the determined title,
And the reading text is set (ie, output) to the reading management module 276. A link tag is associated with this read text by the process of step S42 of FIG. 32, which will be described later, with respect to the linked text.

In step S17, the web reader application control section 271 determines whether or not the command from the user, the input of which is detected in step S11, is the reproduction of the web page by voice.

When it is determined in step S17 that the command from the user is the reproduction of the web page by voice, the web reader application control section 271 outputs a signal requesting the reproduction of the corresponding voice data in step S18. Generate and read aloud management module 27
Output to 6.

If it is determined in step S17 that the instruction from the user is not reproduction of the web page by voice, the instruction from the user is output of voice data to the external device. The reader application control unit 271 generates and outputs a control signal requesting the reading management module 276 to output the corresponding audio data to an external device.

In step S20, an external device output process described later with reference to FIG. 36 is executed.

The reading control unit 301 executes step S18.
In response to the request to reproduce the voice data in, the control signal for acquiring the text data from the reading text database 303 is generated and output to the text management unit 302. In step S21, the text management unit 30
2 acquires text data from the reading text database 303 and outputs it to the reading control unit 301.

In step S22, the text analysis unit 306 receives the text data input from the reading control unit 301, analyzes the text data, decomposes it into words, and registers it in the dictionary database 305. The dictionary data and the conversion rules registered in the conversion rule database 307 are referenced to generate a phonetic symbol string (prosodic information) and output to the speech synthesis unit 308.

In step S23, the text analysis unit 306 determines whether the text data analyzed in step S22 is associated with a URL link tag. The URL link tag is added to the text of the part linked to the web page in the filtering process described later with reference to FIG. 32 in step S14.

If it is determined in step S23 that the URL link tag is not associated with the text data, then in step S24, the text analysis unit 30 is executed.
Reference numeral 6 indicates a control signal indicating that the URL link tag is not associated with the corresponding text, to the voice synthesis unit 30.
Output to 8. The voice synthesis unit 308 is a text analysis unit 3.
Based on the phoneme data registered in the phoneme database 309 according to the phonetic symbol string supplied from 06, synthetic voice data is generated by voice 1 and output to the voice setting unit 310. The audio setting unit 310 adjusts the synthetic audio data according to the detailed audio settings set using the setting levers 382 to 394 described with reference to FIG. 24, and generates audio data used for reproduction. The generated voice data is
The audio database 312 is supplied to the reproduction control unit 311.
Stored in. The reproduction control unit 311 sequentially reads the audio data stored in the audio database 312 and outputs the audio data to the speaker 65. After the processing of step S24 ends, the processing proceeds to step S31.

If it is determined in step S23 that the URL link tag is associated with the text data, then in step S25, the text analysis unit 306.
Outputs a control signal indicating that a URL link tag is associated with the corresponding text, to voice synthesis unit 308. The voice synthesis unit 308 is a text analysis unit 306.
Based on the phoneme data registered in the phoneme database 309 in accordance with the phonetic symbol string supplied from, voice 2 generates synthesized voice data and outputs it to the voice setting unit 310.
The audio setting unit 310 adjusts the synthetic audio data according to the detailed audio settings set using the setting levers 382 to 394 described with reference to FIG. 24, and generates audio data used for reproduction. The generated voice data is supplied to the reproduction control unit 311 and stored in the voice database 312. The reproduction control unit 311 uses the voice database 31.
The audio data stored in No. 2 are sequentially read and output to the speaker 65.

In step S26, the reading control unit 301 indicates that the reading of the portion corresponding to the URL has started, and the Web reader application control unit 271.
To notify.

In step S27, the web reader application control section 271 starts counting a timer (not shown) provided therein in order to measure the elapsed time after the reading of the portion corresponding to the URL is started.

In step S28, the web reader application control unit 271 determines whether or not a predetermined operation input has been received from the operation input unit 279.

When it is determined in step S28 that a predetermined operation input has been received, in step S29
The web reader application control unit 271 generates a control signal for stopping voice output, and outputs the control signal to the reading control unit 301 of the reading management module 276.
A control signal for jumping to the corresponding link destination is generated and output to the web browser 272. The reading control unit 301 of the reading management module 276 controls the reproduction control unit 311 to stop the voice output, and temporarily saves the position of the text data currently being voice output. The web browser 272 executes a process for jumping to the link destination described in the corresponding text (that is, accessing a predetermined web page of the web server indicated by the corresponding link destination address). Then, the process returns to step S12, and the subsequent processes are repeated.

The operation input unit 279 has not only an operation input function for instructing a process to jump to the corresponding link destination, but also a function for performing an operation input for returning from the page of the jumped link destination. If the user inputs an operation for returning to the original page while the web page of the jumped destination is being output by voice,
Alternatively, when the “back” button that the web browser 272 has as standard is selected, the web browser 272
Causes the web page that was displayed first to be displayed again, and the reading control unit 301 refers to the position of the temporarily stored text that has been subjected to voice output processing before the jump, and restarts voice output from that position. The reproduction control unit 311 is controlled so that

If it is determined in step S28 that the predetermined operation input has not been received, the web reader application control unit 271 determines in step S30.
Referring to the count of a timer (not shown) inside,
It is determined whether or not a predetermined time has elapsed since the reading of the portion corresponding to the URL was started. Step S30
In, when it is determined that the predetermined time has not elapsed, the process returns to step S28, and the subsequent processes are repeated.

After the processing of step S24 is completed, or when it is determined in step S30 that the predetermined time has elapsed, the reproduction control section 311 determines in step S31 the audio data stored in the audio database 312. Of these, the same Chapter as the audio data being played
It is determined whether or not the voice reproduction corresponding to all the text data included in the displayed web page is completed based on whether or not the voice data of No. 2 remains. Step S3
When it is determined in 1 that the reproduction is not completed, the process returns to step S21, and the subsequent processes are repeated.

After the processing of step S20 is completed, or when it is determined in step S31 that the reproduction of the audio data being reproduced is completed, the processing is completed.

FIG. 31 shows an example of the display screen of the web browser 272 when the sound is reproduced. In contrast to the button displayed on the toolbar 333 in the processing of the web browser 272 other than the time of voice reproduction described with reference to FIG. 22, the voice is being reproduced in FIG. 31,
A pause button 471 is provided instead of the play button 342, and the stop button 341 is activated and becomes operable, while the output button 346 to the external device is provided.
Becomes inactive and cannot be operated. Also, like the text 472, the text that is currently read out is changed to the selected state (reverse display).

[0232] For example, the text 47 described as "Ministry of Agriculture and Fisheries" included in the text 472 being currently read out.
When 3 is linked to the web page indicated by the predetermined address, if it is described, the “Ministry of Agriculture and Fisheries” part is voice-output with “voice 2” having a setting different from the other parts. It is possible to know the existence of the linked text without looking at the web browser display window 331.

By such processing, of the information described on the web page, in the filtering processing described later, the information that matches the registered URL or e-mail address is converted into a predetermined nickname and then converted into text. Whether the data is linked (ie U
Based on whether or not it is associated with the RL link tag), a process of jumping to the link destination is executed based on a user's operation input, or the converted voice data is It can be output to the audio storage device 294 such as the memory stick 131.

In the processing described with reference to FIGS. 29 and 30, the output voice is changed depending on whether or not the web page is linked to another web page. Web browser display window 3
It is possible to know the existence of the linked text without looking at 31, but it corresponds to the text data linked to other web pages without changing the output voice. A buzzer sound or a chime may be sounded when the sound is output. Further, if it is assumed that the user sees the web browser display window 331 during voice output, the corresponding text is displayed in a blinking manner so that the user can link to the text corresponding to the voice currently being reproduced. It may be possible to notify that the information is posted.

Further, in the processing described with reference to FIGS. 29 and 30, after the voice output of the text associated with the URL link tag is made, a jump command to the link destination of the user is given for a predetermined time. Although it has been described that the standby state for the input is held, the following text data may be converted into voice data and output as voice even during the standby state.

[0236] It should be noted that, while in the standby state for the first text associated with the URL link tag, the following U
When the voice output of the second text associated with the RL link tag is performed, the standby state for the first text is forcibly ended and the standby state for the newly voiced second text is set. Shall be transitioned.

Alternatively, instead of holding the standby state for the user's input of the jump instruction to the link destination for a predetermined time, after the first text associated with the URL link tag is output as voice, To UR
The period until the second text associated with the L link tag is output as voice is set to the standby state for the first text. When the second text is output as voice, the standby state for the first text is set. May be ended, and the state may transition to the standby state for the second text that is newly output as voice.

Next, the filtering process executed in step S14 of FIG. 29 will be described with reference to the flowchart of FIG.

In step S41, the web reader application control section 271 uses step S1 in FIG.
The tag of the text data input in 3 is analyzed, and the link tag for the web page is extracted.

Web reader application control unit 27
In step S42, 1 associates the extracted link tag with the text corresponding to the link tag extracted in step S41, sets the text of the part corresponding to the link tag to voice 2 in step S43, and sets the other parts. Is set to voice 1.

That is, the web reader application control unit 271 adds, for example, "<A hre
f = http: //www.***/go/jp> Ministry of Agriculture and Water </A> is text data for voice conversion if "... Link the link tag to "Ministry of Agriculture and Fisheries" and set it to voice 2, and other parts (for example, "is one day,
Set the voice 1) to the part of the salt levee.
As a method for associating the link tag with the text data “Ministry of Agriculture, Forestry and Fisheries”, for example, a table may be created in which the relative address of the description part of the corresponding text is associated with the link tag, or another method. It doesn't matter.

In step S44, the web reader application control unit 271 deletes the tags other than the link tag associated with the data being processed into text data, and the URL / mail address filter 27
Output to 7.

In step S45, the URL / mail address filter 277 acquires the text data from the web reader application control unit 271 and sets the first character of the acquired text data as C.

In step S46, the URL / mail address filter 277 determines whether or not the character C is C = "@ (at mark)".

If it is determined in step S46 that C = "@", the URL is determined in step S47.
-The mail address filter 277 executes the mail address processing described later with reference to FIG.

If it is determined in step S46 that C is not "@", the URL is determined in step S48.
The mail address filter 277 determines whether or not C = “:”.

If it is determined in step S48 that C = “:”, the URL is determined in step S49.
The mail address filter 277 executes URL processing 1 described below with reference to FIG. 34 or URL processing 2 described below with reference to FIG.

After the processing of step S47, the processing of step S49, or if it is determined in step S48 that C = “:” is not true, the URL / mail address filter 27 is executed in step S50.
Step 7 determines whether or not there is any text that has not been processed, among the acquired texts.

If it is determined in step S50 that the text that has not been processed remains in the acquired text, the URL in step S51
The mail address filter 277 sets the character next to the acquired text to C, the process returns to step S46, and the subsequent processes are repeated.

If it is determined in step S50 that no unprocessed text remains in the acquired text, the process proceeds to step S15 in FIG.
Return to.

Next, the mail address processing executed in step S47 of FIG. 32 will be described with reference to the flowchart of FIG.

In step S61, the URL / mail address filter 277 extracts the first electronic mail address from the electronic mail addresses registered in the URL / mail address table 278.

URL / mail address filter 277
Checks in step S62 whether or not the character strings before (@) the "@" match, and in step S63 determines whether or not the character strings before "@" match.

When it is determined in step S63 that the character strings before "@" match, the URL / mail address filter 277 determines in step S64 that "
Check whether the character strings after (at the right) after "@" match,
In step S65, it is determined whether the character strings after "@" match.

If it is determined in step S65 that the character strings after "@" match, the URL / mail address filter 277 determines in step S66 that the U
The e-mail address registered in the RL / mail address table 278 and the corresponding nickname are referred to, and the corresponding address is replaced with the registered name.
It returns to step S50 of FIG.

If it is determined in step S63 that the character strings before "@" do not match, or in step S65 that the character strings after "@" do not match, in step S67. , URL
The mail address filter 277 determines whether or not there is an unprocessed registered address in the URL / mail address table 278.

If it is determined in step S67 that the unprocessed registered address remains in the URL / mail address table 278, in step S68.
The URL / mail address filter 277 selects the next address registered in the URL / mail address table 278, the process returns to step S62, and the subsequent processes are repeated. In step S67, U
32. If it is determined that there is no unprocessed registered address remaining in the RL / mail address table 278, the name of the corresponding mail address is not registered in the URL / mail address table 278.
Return to step S50.

Here, "@" included in the mail address is included.
Although it is described that the next process is executed when the preceding character string is matched with "as a reference, for example, the matching process is performed for each character from the beginning of the address, and the registered process is performed. It may be determined whether or not it is an address.

Next, referring to the flowchart in FIG. 34, the URL executed in step S49 in FIG.
The process 1 will be described.

[0260] In step S71, the URL / mail address filter 277 determines that the first U of the URLs registered in the URL / mail address table 278 is U.
Extract the RL.

URL / mail address filter 277
Checks in step S72 whether or not the character strings before (to the left of) the acquired text ":" match, and in step S73 determines whether or not the character strings before ":" match. To do.

When it is determined in step S73 that the character strings before ":" match, the URL / mail address filter 277 determines that the character string after ("right") the acquired text in step S74. Are checked, and it is determined in step S75 whether the character strings after ":" are matched.

If it is determined in step S75 that the character strings after the ":" (on the right side) match, the URL / mail address filter 2 is entered in step S76.
77 replaces the corresponding URL with the registered name, and the process returns to step S50 in FIG.

If it is determined in step S73 that the character strings before ":" do not match, or if it is determined in step S75 that the character strings after ":" (right side) do not match, In step S77, the URL / email address filter 277 determines the URL
・ Unregistered URs in the email address table 278
It is determined whether or not L remains.

At step S77, the unprocessed registration U
If it is determined that the RL remains, the URL / email address filter 277 determines in step S78 that the U
The next URL registered in the RL / mail address table 278 is selected, the process returns to step S72, and the subsequent processes are repeated. If it is determined in step S77 that no unprocessed registered URL remains, the URL / email address table 278 shows
Since the call name corresponding to the input URL is not registered, the process returns to step S50 in FIG.

[0266] In the web browser 272 when the voice described with reference to Fig. 31 is being reproduced, for example, the text currently read is displayed with "For details, see http: // w.
Please visit ww.yuhi.com ",
Since this URL is registered in the URL table described with reference to FIG. 17A, the above-mentioned URL is replaced with the text "Sunset newspaper" in the filtering process of step S13. Therefore, the above URL
Is not played as a meaningless sound such as "Hee, Tee, Teep, Colon, Slash, etc." at the time of voice reproduction, but is played as a sound of "Sunset newspaper" that has meaning to the user. .

If the link tag is associated with "http://www.yuhi.com", the replaced text "Sunset newspaper" is also associated with the link tag. Is reproduced with voice 2, and if a predetermined operation input is received within a predetermined time after the reproduction output of the voice data corresponding to this text data, "http: //www.y
The process to jump to "uhi.com" is executed.

Also in this case, it is needless to say that it is possible to judge whether or not the URL is a registered URL by performing a matching process character by character from the beginning, as in the case of the electronic mail address.

Also, the URL / mail address table 2
In FIG. 17C, when the URLs are classified according to the protocol and registered, as shown in FIG. 17C, the URL is registered in the corresponding protocol after determining whether the protocols match in advance. It may be determined whether or not there is.

Next, the URL process 2 will be described with reference to the flowchart in FIG.

In step S81, the URL / mail address filter 277 extracts the first protocol (“http” in the case of FIG. 17C) among the protocols registered in the URL / mail address table.

URL / mail address filter 277
And the extracted protocol in step S82,
It is checked whether or not the character string before ("left") of the input text matches (at the left side), and it is determined at step S83 whether or not the character string before ":" matches.

When it is determined in step S83 that the character strings before ":" do not match, step S84
In the URL / email address filter 277,
It is determined whether or not any unprocessed registration protocol remains in the URL / mail address table 278.

If it is determined in step S84 that unprocessed registration protocols remain, step S8 is performed.
5, URL / mail address filter 277
Selects the next protocol registered in the URL / email address table 278, and the process proceeds to step S
Returning to 82, the subsequent processing is repeated.

If it is determined in step S83 that the character strings before (to the left of) ":" match, in steps S86 to S88, the same processing as steps S74 to S76 in FIG. 34 is executed.

If it is determined in step S87 that the character strings after the ":" (on the right side) do not match, in step S89, the URL group having the corresponding protocol in the URL / mail address table 278 is not processed. It is determined whether the registered URL remains.

In step S89, the unprocessed registration U
When it is determined that the RL remains, in step S90, the URL / mail address filter 277 selects the next URL registered in the corresponding protocol, and the process returns to step S86 and thereafter. The process is repeated.

If it is determined in step S84 that no unprocessed registration protocol remains, step S84.
If it is determined in 89 that no unprocessed registered URL remains, or after the processing in step S88 ends, the processing returns to step S50 in FIG.

With the above processing, since the registered URLs are narrowed down by the protocol when performing the URL matching, the time required for the processing can be shortened.

If text data indicating a URL or an e-mail address that matches the registered URL or e-mail address is input by the processing described with reference to the flowcharts of FIGS. 32 to 35, the URL / mail Address filter 277 is URL
Alternatively, the e-mail address is replaced with the registered name, and the web reader application control unit 27
Output to 1. Therefore, the registered URL, that is, the URL or email address that the user often uses,
It is possible to prevent the information from being read as a list of alphabets, which is difficult for the user who hears the voice data to understand.

For example, when the e-mail address "info@abc.co.jp" is described on the web page during voice reproduction, and the web page is converted into voice data and output, for example, "I.N.F.・ Oh At Mark A ・
If the alphabet is read as it is, the voice data will be meaningless (difficult to understand) for the user who hears the voice. However, this email address is
Since it is registered in the email address table described using (B), the text "abc Co., Ltd." will be registered as it is without being read as it is in the alphabet or read in the proper Roman alphabet. After being replaced with data, it is converted into audio data. As a result, the generated voice data becomes data that is easy for the user to understand (suitable for understanding by listening rather than reading).

Here, it is described that the URL / mail address filter 277 registers the URL or mail address and its name in the URL / mail address table 278. However, the URL / mail address filter 277 and The URL / email address table 278 is omitted, and the same data as the data registered in the URL / email address table 278 is registered in the dictionary database 305 described with reference to FIG. The same processing may be executed during the reproduction processing. In this case, the user can register the URL or the electronic mail address using the word addition window 441 described with reference to FIG.

Further, the method of text analysis of the dictionary database 305 is matching by the part of speech that is generally used in the past, and when the URL or mail address and its name are registered as nouns in the dictionary database 305, the text analysis is performed. As a result, when the corresponding URL or email address is analyzed as another part of speech,
It is not possible to generate voice data with the registered name. In order to prevent such a problem, when the URL or mail address and its name are registered in the dictionary database 305, the part of speech at the time of registration is, for example, U.
Items such as RL and address may be used.

Next, the external device output processing executed in step S20 of FIG. 29 will be described with reference to the flowchart of FIG.

[0285] In step S111, the reading control unit 301 determines whether or not there is an external output device (including an external storage device such as the memory stick 131) that is a target of external output and is in a state of being communicable with the personal computer 2. A control signal for detection is generated and output to the external device output unit 315. The external device output unit 315 is a voice storage device 294 (for example, a memory stick 131, a PDA 4, a camera-equipped digital mobile phone 5, or a portable music playback device 265) that is in a state capable of exchanging data with the external device output module 293. Etc.) is detected and the detection result is read out by the reading control unit 301.
Output to.

In step S112, the reading control unit 301 determines based on the signal input from the external device output unit 315 whether or not the external output target device is detected in step S111.

If it is determined in step S112 that a target device for external output has been detected, step S11
3, the reading control unit 301 performs step S11.
It is determined whether the number of devices detected in 1 is plural.

In step S113, step S1
When it is determined that the number of devices detected in 11 is plural, in step S114, the reading control unit 30
1 generates a control signal for displaying the selection screen of the target device, and the web reader application control unit 271
Output to the GUI control unit 273 via. The GUI control unit 273 outputs and displays the selection screen of the target device on the LCD 25, receives an input of an operation for the user to select the device from the jog dial 23, the keyboard 24, or the touch pad 26, and receives the web reader application control unit 271. Output to.

[0289] In step S115, the reading control unit 301 sets the value N of the register for selecting an external device included therein to N = "ID of device selected by user".

In step S113, step S1
If it is determined that the number of devices detected in 11 is not plural (that is, one), step S116.
In, the reading control unit 301 sets the value N of the register for selecting an external device included therein to N = 0.
Here, when the value N of the register is N = 0, it indicates that only one device can output audio data.

After the processing of step S115 or the processing of step S116 is finished, step S117
At, the reading control unit 301 selects the external device indicated by the value N of the register.

In step S118, the reading control unit 301 determines whether the display of the dialog box for confirming the deletion of the past data is set, that is, the check box 461 is set in the setting screen 351 described with reference to FIG. Judge whether it is checked or not.

When it is determined in step S118 that the display of the dialog box for confirming deletion of past data is set, the reading control unit 301 displays the dialog box 501 shown in FIG. 37 in step S119. Display and receive user operation input

Display Area 5 of Dialog Box 501
A list of data whose artist name is "ONSEI" among information recorded in the external device or the recording medium which is the output target of the music data is displayed in 11. In the display area, three items of title 512, artist name 513, and capacity 514 are displayed.

The data whose artist name 513 is "ONSEI" is not only voice data created by the processing of the web reader application, but also text data other than web pages, such as e-mail, is converted into voice data. It may be audio data created by the processing of the application. Also,
The title 512 displayed at this time is the title determined in step S15 of the web page read-out processing described with reference to FIG.

When the user selects the "Yes" button 515, the data whose artist name is "ONSEI" displayed in the display area 511 is erased from the corresponding voice storage device 294, and new voice data is written. Will be recorded.

When the user selects the “No” button 516, the data whose artist name is “ONSEI” displayed in the display area 511 is not erased from the corresponding audio storage device 294 and new audio data is displayed. But,
Data is newly recorded in the area where no data is recorded.

When the user selects the "Cancel" button 517, the output command of the audio data to the external device is canceled and the dialog box 501 is erased.

[0299] The dialog setting area 518 is provided with radio buttons 521 to 523 for setting the display of the dialog box 501. Only one of the radio buttons 521 to 523 is selected.

When the radio button 521 is selected, if there is data that can be deleted in the voice storage device 294 in the external device output process to be executed next, the dialog box 501 is displayed without fail, and the user's operation input
It is determined whether or not the deletable data is deleted. When the radio button 522 is selected, in the next external device output process, if there is data that can be deleted in the audio storage device 294, the dialog box 501 is not displayed, and the new audio is deleted. Set to record data. When the radio button 523 is selected, even if there is data that can be deleted in the voice storage device 294 in the external device output process that is executed next, the dialog box 501 is not displayed and the data is deleted without deleting the data. It is set to add and record various audio data.

When it is determined in step S118 that the display of the dialog box for confirming deletion of past data is not set, or in step S118.
After the processing of step 119 is completed, in step S120, the reading control unit 301 is based on the setting in the dialog setting area 518 of the dialog box 501 described with reference to FIG. 37, or based on the operation input by the user input in step S119. Then, it is determined whether the deletion of the past data is necessary.

If it is determined in step S120 that deletion of past data is necessary, step S121
At this point, a data deletion process described later with reference to FIG. 38 is executed.

When it is determined in step S120 that deletion of past data is not necessary, or after the processing of step S121 ends, in step S122, the reading control unit 301 outputs the corresponding voice data,
It is converted into a format corresponding to the audio storage device 294 which is an external device to be output.

That is, the reading control unit 301 outputs the voice data, which is instructed to be output externally, recorded in the voice database 312, via the external device output unit 315.
A control signal to be output to the data conversion unit 314 is generated and output to the reproduction control unit 311, and the audio storage device 294.
A control signal for converting the data into a format corresponding to is generated and output to the data conversion unit 314. The reproduction control unit 311 retrieves corresponding audio data from the audio database 312 according to the input control signal, and the data conversion unit 314 via the external device output unit 315.
The data conversion unit 314 exchanges information with the data conversion module 293 to convert the input voice data into a corresponding data format, if necessary.
It is supplied to the external device output unit 315.

In step S123, the external device output section 315 outputs the converted data to the external device, that is, the voice storage device 294 via the external device output module 293, and the process is terminated.

If it is determined in step S112 that the external output target device is not detected, in step S124, the reading control unit 301 generates a control signal for outputting an error message, and the web reader application. GU via the control unit 271
It is output to the I control unit 273. The GUI control unit 273 outputs the error message to the LCD 25 for display, and the process ends.

By the above processing, the voice data generated by converting the text data is converted into the voice storage device 29.
4, that is, the memory stick 131, the PDA 4, the camera-equipped digital mobile phone 5, the portable music reproducing device 265, or the like, is output to and recorded on an external device or a recording medium.

Next, the data deletion processing executed in step S121 of FIG. 36 will be described with reference to the flowchart of FIG.

[0309] In step S131, the external device output section 315 receives the external device output module 293,
Voice storage device 294, that is, Memory Stick 1
The number L of files recorded in a target external device such as 31, PDA 4, camera-equipped digital mobile phone 5, portable music player 265 or the like, or a recording medium is detected.

The external device output section 315 operates in step S13.
2, the register value i indicating the number of songs being deleted
Is set to i = 0, and it is determined in step S133 whether the register value i is i <number of files L.

When it is determined in step S133 that the register value i is i <the number of files L, in step S134, the external device output unit 315 determines that the i-th file has data indicating the artist name. ,
Get that data.

In step S135, the external device output unit 315 determines that the data indicating the artist name acquired in step S134 has a predetermined name (here, "ON".
SEI ”).

When it is determined in step S135 that the acquired data indicating the artist name is a predetermined name, in step S136, the external device output unit 3
15 deletes the i-th file.

When it is determined in step S135 that the acquired data indicating the artist name is not a predetermined name, or after the processing of step S136 is completed, in step S137, the external device output unit 315 is used.
Sets the register value i to i = i + 1, the process returns to step S133, and the subsequent processes are repeated.

If it is determined in step S133 that the register value i is not i <the number of files L, that is, if it is determined that the processing for all the files has been completed, the processing is step S122 in FIG. Return to.

By the above processing, when the user converts the text data described on the web page into voice data and outputs the voice data, the user can select a name that matches the registered URL or e-mail address as a predetermined name. Can be converted into a voice output and output to an external voice storage device 294. Further, when the text data being voice output is linked,
Before a predetermined time elapses (or before the next linked text is output by voice) after the corresponding text is output by voice, for example, by pressing a predetermined key By operation, jump to the link destination,
The linked page can be continuously output as audio.

Furthermore, a GUI that is easy for the user to understand
By providing the above, the setting process by the user becomes easy, and not only the convenience as an application program but also the entertainment property thereof is dramatically improved.

Here, an application program for converting text data described on a web page into voice data and outputting the voice data has been described as an example.
The present invention can be applied to general application programs that handle text data, such as application programs that convert text data described in electronic mail into voice data and output the data.

Also, here, the case of accessing a web page published on the Internet has been described, but for example, in an intranet in a company,
The present invention can be applied to networks other than the Internet.

The present invention is not limited to the notebook personal computer 2, but can be realized by the PDA 4 and the digital mobile phone 5 with a camera. In that case, the CPU 171 of the PDA 4 or the main control unit 251 of the digital mobile phone with camera 5 executes the same processing as the above-mentioned processing.

Furthermore, the present invention is a desktop type personal computer, PHS (Personal Handyphone Sy).
stem) terminal device, digital mobile phone without imaging function, car navigation system, or other device that sends or receives mail, or device that has a web page browsing function, or at least processes text data. However, the present invention can be applied to all devices capable of outputting sound.

The series of processes described above can also be executed by software. The software is, for example, a general-purpose personal computer, in which a program that constitutes the software is installed in dedicated hardware, or various functions can be executed by installing various programs. Installed from the recording medium.

This recording medium is shown in FIG. 6 or FIG.
As shown in, a magnetic disk 121 or 191 (including a flexible disk) on which the program is recorded and an optical disk 122 or 19 which is distributed to provide the program to the user separately from the computer.
2 (CD ROM (Compact Disc Read Only Memory), DVD
(Including Digital Versatile Disc), magneto-optical disc 123 or 193 (including MD (Mini Disc) (trademark)), or package medium including semiconductor memory 124 or 194.

Further, in the present specification, the steps for writing the program recorded on the recording medium are not limited to the processing performed in time series according to the order described, but are not necessarily performed in time series. It also includes processing executed in parallel or individually.

In this specification, the system means
It represents the entire apparatus composed of a plurality of devices.

[0326]

According to the information processing apparatus, the information processing method, and the program of the present invention, the first information is acquired,
The third information including the address of the second information published on the network is extracted from the acquired first information, the text data is extracted from the acquired first information, and the extracted The voice synthesis is executed using the text data, the voice data corresponding to the text data is generated, the generated voice data is output, and the voice data generated from the text data corresponding to the third information is output. Is detected, it is determined whether or not there is a predetermined operation input within a predetermined period after it is detected that the voice data generated from the text data corresponding to the third information is output, and the predetermined operation is performed. When it is determined that the predetermined operation input has been made during the period, the second information is acquired based on the third information. Therefore, for example, by a simple operation such as pressing a predetermined key, voice output is performed. Been That to jump to the link destination corresponding to the text, it can be made as to the audio output to continue the linked page.

[Brief description of drawings]

FIG. 1 is a diagram for explaining how to send and receive electronic mail and web page data.

FIG. 2 is an external perspective view of the personal computer shown in FIG.

FIG. 3 is a plan view of a main body of the personal computer shown in FIG.

FIG. 4 is an enlarged view of the vicinity of a jog dial of the personal computer of FIG.

5 is a right side view showing the configuration of the right side surface of the personal computer in FIG. 1. FIG.

FIG. 6 is a block diagram showing an internal configuration example of the personal computer in FIG.

FIG. 7 is a diagram showing an appearance of a PDA.

FIG. 8 is a diagram showing an appearance of a PDA attached to a cradle.

FIG. 9 is a diagram showing an appearance of a PDA.

FIG. 10 is a block diagram for explaining an internal configuration of a PDA.

FIG. 11 is a diagram showing an appearance of a digital mobile phone with a camera.

FIG. 12 is a diagram showing an appearance of a camera unit of a digital mobile phone with a camera.

FIG. 13 is a block diagram showing a configuration of a digital mobile phone with a camera.

FIG. 14 is a diagram for explaining information sharing using a memory stick.

FIG. 15 is a functional block diagram when a web reader application is activated.

FIG. 16 is a diagram illustrating a source of a web page.

FIG. 17 is a diagram for explaining data registered in a URL / mail address table.

FIG. 18 is a diagram illustrating a GUI for registering data in a URL / mail address table.

FIG. 19 is a functional block diagram for explaining automatic registration of data in a URL / mail address table.

FIG. 20 is a diagram for explaining a bookmark file.

21 is a more detailed functional block diagram of the reading management module in FIG. 15. FIG.

FIG. 22 is a diagram for explaining a web browser display window in which a web reader toolbar is displayed.

FIG. 23 is a diagram for explaining a setting window displayed when a reading tab is selected.

FIG. 24 is a diagram for explaining a voice setting window displayed when a detail button is selected.

FIG. 25 is a diagram illustrating a voice creation window displayed when a new voice creation button is selected.

FIG. 26 is a diagram illustrating a user word dictionary tool window displayed when a user dictionary button is selected.

FIG. 27 is a diagram for explaining a word addition window displayed when an add button is selected.

FIG. 28 is a diagram for describing a setting window displayed when an output tab is selected for external device / media.

FIG. 29 is a flowchart illustrating a web page read-aloud process.

FIG. 30 is a flowchart illustrating a web page reading process.

FIG. 31 is a diagram for explaining a web browser display window during voice output.

FIG. 32 is a flowchart for explaining filter processing.

FIG. 33 is a flow chart for explaining mail address processing.

FIG. 34 is a flowchart for explaining URL processing 1.

FIG. 35 is a flowchart for explaining URL processing 2.

FIG. 36 is a flowchart illustrating an external device output process.

FIG. 37 is a diagram for explaining a dialog box.

FIG. 38 is a flowchart illustrating a data deletion process.

[Explanation of symbols]

2 personal computer, 4 PDA, 5 digital mobile phone with camera, 51 CPU, 131 memory stick, 171 CPU, 251 main controller, 265 portable music player, 271 web reader application controller, 272 web browser, 273 GUI controller , 274HTML tag filter, 275 conversion table database, 276
Reading management module, 277 URL / mail address filter, 278 URL / mail address table, 279 operation input unit, 301 reading control unit, 206 text analysis unit, 308 speech synthesis unit, 309 phoneme database, 310 speech setting unit, 311 playback control Division, 473 text

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) G10L 13/00 G10L 3/00 E (72) Inventor Yasuhiko Kato 6-735 Kitashinagawa, Shinagawa-ku, Tokyo Issue Sony Corporation F-term (reference) 5B085 BE03 CC02 CE04 5D045 AA01

Claims (10)

[Claims] 1. An information processing apparatus connectable to a network, wherein a first acquisition unit for acquiring first information, and the first information acquired by the first acquisition unit are connected to the network. A first extracting means for extracting third information including an address of the publicized second information; and a second extracting text data from the first information acquired by the first acquiring means. And a voice generation unit that performs voice synthesis using the text data extracted by the second extraction unit to generate voice data corresponding to the text data, and a voice generation unit generated by the voice generation unit. Output means for outputting the voice data, and the output means for generating from the text data corresponding to the third information extracted by the first extracting means. A detection unit that detects that the voice data is output, and a predetermined period after the detection unit detects that the voice data generated from the text data corresponding to the third information is output. Determination means for determining whether or not there is a predetermined operation input during the period, and when the determination means determines that the predetermined operation input has been performed during the predetermined period, based on the third information, An information processing apparatus comprising: a second acquisition unit that acquires second information. 2. The voice generating means generates the voice data with a first voice from the text data corresponding to the third information extracted by the first extracting means, and the other voice data. The information processing apparatus according to claim 1, wherein the voice data is generated from text data with a second voice different from the first voice. 3. The information processing apparatus according to claim 1, wherein the network is the Internet, and the third information includes a URL of a predetermined web page. 4. The information processing apparatus according to claim 1, wherein the predetermined time period is a predetermined time period. 5. The detecting means detects that the output means outputs the voice data generated from the text data corresponding to the third information, during the predetermined period. The information processing apparatus according to claim 1, wherein the information processing apparatus is a period. 6. The operation according to claim 1, wherein the predetermined operation is an operation input of a predetermined operation key.
The information processing device according to 1. 7. The information processing apparatus according to claim 1, wherein the first information acquired by the first acquisition unit is information published on the network. 8. An information processing method of an information processing apparatus connectable to a network, comprising: a first acquisition step of acquiring first information; and the first information acquired by the processing of the first acquisition step. From the first extraction step of extracting the third information including the address of the second information published on the network, and the first information acquired by the processing of the first acquisition step. A second extraction step of extracting text data, and voice generation of performing voice synthesis using the text data extracted by the process of the second extraction step to generate voice data corresponding to the text data. A step, an output step of outputting the voice data generated by the processing of the voice generation step, and a step of outputting the voice data by the processing of the output step A detection step of detecting that the voice data generated from the text data corresponding to the third information extracted by the processing of the first extraction step is output; Determination step of determining whether or not there is a predetermined operation input during a predetermined period after it is detected that the voice data generated from the text data corresponding to the information is output, A second acquisition step of acquiring the second information based on the third information when it is determined by the processing that the predetermined operation input has been performed during the predetermined period. Processing method. 9. A program for an information processing device connectable to a network, comprising a first acquisition step of acquiring first information, and the first acquisition step obtained by the processing of the first acquisition step. A first extraction step of extracting from the information third information including an address of the second information published on the network; and the first information acquired by the processing of the first acquisition step. A second extraction step of extracting text data from the above, and a voice that performs voice synthesis using the text data extracted by the processing of the second extraction step to generate voice data corresponding to the text data. A generation step, an output step of outputting the voice data generated by the processing of the voice generation step, and a processing of the output step, A detection step of detecting that the voice data generated from the text data corresponding to the third information extracted by the processing of the first extraction step is output; Determination step of determining whether or not there is a predetermined operation input during a predetermined period after it is detected that the voice data generated from the text data corresponding to the information is output, A second acquisition step of acquiring the second information based on the third information when it is determined by the processing that the predetermined operation input has been performed during the predetermined period. A recording medium on which a computer-readable program is recorded. 10. A program executable by a computer that controls an information processing apparatus connectable to a network, the program including a first acquisition step of acquiring first information, and acquisition by the processing of the first acquisition step. A first extraction step of extracting third information including an address of the second information published on the network from the first information obtained; A second extraction step of extracting text data from the first information, and voice synthesis using the text data extracted by the processing of the second extraction step, corresponding to the text data. A voice generation step of generating voice data; an output step of outputting the voice data generated by the processing of the voice generation step; A detection step of detecting that the voice data generated from the text data corresponding to the third information extracted by the processing of the first extraction step is output by the processing of the output step; It is determined whether or not there is a predetermined operation input within a predetermined period after it is detected that the voice data generated from the text data corresponding to the third information is output by the processing of the detection step. A determination step, and a second acquisition step of acquiring the second information based on the third information when it is determined by the processing of the determination step that the predetermined operation input has been made during the predetermined period. A program that causes a computer to execute a process including.