JPH10133847A - Mobile terminal system for voice recognition, database search, and resource access communications - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize voice recognition, database search, and resource access function as a user interface with practical accuracy and cost in communications environment using a mobile terminal. SOLUTION: In the mobile terminal 101, a voice signal inputted from an input part 109 is transmitted to a PHS network 103 from a control part 110 and a communication part 111, and transmitted to a voice control host unit 108 from there via a control host unit 104 and an internet 105. This voice signal is received by a mobile terminal communication control part 116 via a packet transmitting/receiving part 115 in the same unit, and after recognized in a sentence voice recognizing part 117, its search key word is extracted in a search control part 118, and a search processing is executed to a prescribed database engine. The search result HTML sentence data obtained as a result of that is returned to the mobile terminal 101 and received by the control part 110 via the communication part 111 and displayed at an output part 112. By selecting a hyper text on the displayed search result HTML sentence, a user accesses to an arbitrary resource on the internet 105.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technology for recognizing speech such as a call speech input in a mobile (portable) terminal device, searching a database based on the result of the recognition, and accessing resources on the Internet or the like. About technology.

[0002]

2. Description of the Related Art There are various voice recognition technologies for recognizing voice signals, converting them into character data and storing the data, and providing recognition results to use of various services. It has been demanded in various industrial fields.

In recent years, with the development of speech recognition algorithms, speech recognition systems using a mainframe computer or a workstation computer have been developed.

[0004] These systems include various systems such as a bank balance inquiry system and a seat reservation system using telephone voice as input, and a delivery package sorting system that recognizes workers' voices and automatically delivers packages. It is being adopted by other industrial fields.

However, such a speech recognition system has
Only under the environment of a large-scale computer system as described above has reached a level having practical recognition accuracy, and under the environment of a small-sized computer system such as a so-called personal computer, the practical recognition accuracy has been reached. At present, an inexpensive speech recognition system having recognition accuracy has not been realized yet.

[0006] On the other hand, in parallel with the above information processing technology, mobile terminals such as car phones, mobile phones, and PHS (Personal Handy Phone System) have been rapidly spreading in recent years.

[0007] In particular, the PHS is small in size, and at the same time, the call charge is lower than that of a car phone or a mobile phone.
It has the feature of being able to talk with high quality "anytime, anywhere, with anyone" and is exploding. In addition, PHS is an ISDN (Integrated Services)
Since it is a public network using a Digital Network (Integrated Services Digital Network) as a backbone, high-speed digital communication at a transmission rate of 32 kilobits / second is possible, and expectations for its application to the multimedia communication field are increasing.

Further, in order to take advantage of the convenience of the mobile terminal,
It is also expected that it can be used as a multimedia information management / communication terminal device that can be used not only as a mobile phone device but also as a mobile information management device. Specifically, such a mobile terminal is expected to have not only a call function / fax function, but also a homepage access function and an e-mail communication function as an access function to the Internet and a company network. It is expected to have information management functions such as address management, schedule management, and database search / storage.

[0009] Such a mobile terminal is required to have a natural user interface that is as gentle as possible to a person so that the user can use it easily. As user interfaces currently realized, finger operation input using a keyboard or a mouse, handwriting input using an electronic pen, and the like have been put to practical use, but if they can respond to voice input and the like, they are ideal as user interfaces. . That is, for example, if it becomes possible to process a voice signal indicating the content of a call as data while using a call function as a basic function, and to search a database on the Internet based on the processing result, etc. It is possible to dramatically increase the performance. Here, the value of applying a voice recognition function as a user interface to a mobile terminal can be found.

[0010] However, while the mobile terminal is small and has limited information processing capability, as described above, in the current speech recognition processing, the mobile terminal must be installed in a mainframe computer or workstation computer class environment. It is difficult to achieve practical recognition accuracy. Therefore, at present, there is a problem that it is very difficult to realize a voice recognition function as a user interface of a mobile terminal.

An object of the present invention is to realize a speech recognition function as a user interface with practical accuracy and cost in a communication environment using a mobile terminal, and perform database search and access to various resources on the Internet. To make it possible.

[0012]

The present invention first has a mobile terminal having the following configuration. In other words, the host connection means (the control unit 110 and the communication unit 111) is connected to a relay network (PHS network 10) composed of one or both of a wireless network and a wired network.
3 and the Internet 105) indirectly or directly to a voice control host device (voice control host device 108) as a host device without going through a relay network.

The voice input means (input section 109) inputs voice. After the connection operation by the host connection unit, the audio data transmission unit (the control unit 110 and the communication unit 111) transmits the audio data input from the audio input unit to the audio control host device.

The search result HTML text data receiving means (the control unit 110 and the communication unit 111) returns the hypertext markup language HTML which is returned from the voice control host device.
Receiving the search result HTML text data described in the above.

The search result HTML text data display / processing means (control unit 110, output unit 112) displays and processes the received search result HTML text data. Resource access processing means (control unit 110, communication unit 111)
Are resources (homepage data, Java applets, file data, etc.) on the host device corresponding to the access information (URL included in the hypertext) included in the displayed search result HTML text data and specified by the user. Login account)
Access the resource indirectly via the transit network or directly without transiting the transit network to process the resources. More specifically, the resource access processing means includes various resources such as homepage data, Java applets and file data on a host device connected to the Internet or the like indicated by the URL as the access information, and a login account of the host device. HTTP (Hyper Text Transfer Protocol) specified by the URL (in the case of obtaining homepage data or obtaining / executing a Java applet), FTP (File Transfer Protocol)
(For file data acquisition) or TELNET
Access is made using a communication protocol such as (in the case of login to a host device). In this case, when acquisition or execution of homepage data, Java applet, file data, or the like is specified by the URL, the resource access processing unit converts the data into a host device using the communication protocol such as HTTP or FTP. To transfer to a mobile terminal and display (in the case of acquiring homepage data), execute (in the case of acquiring and executing Java applets), or accumulate (in the case of acquiring file data). Alternatively, the resource access processing means includes the UR
When the login to the host device is designated by L, the user logs in to the host device using the TELNET protocol.

Next, the present invention has a voice control host device 108 having the following configuration. That is, mobile terminal connection means (packet transmitting / receiving section 115, mobile terminal communication control section 11
6) responds to the connection operation by the host connection means in the mobile terminal, and identifies and connects the mobile terminal.

Voice data receiving means (packet transmitting / receiving unit 1)
15. The mobile terminal communication control unit 116) receives voice data for each currently connected mobile terminal. Voice recognition means (mobile terminal communication control unit 116, sentence voice recognition unit 117)
Executes voice recognition processing on voice data received by the voice data receiving means for each mobile terminal currently connected.

The search control means (search control unit 118) extracts a search keyword from the recognized voice data obtained by the voice recognition processing by the voice recognition means for each currently connected mobile terminal, and corresponds to the search keyword. The search result HTML text data including the access information for the resource is searched from a predetermined database system. This predetermined database system is provided, for example, by a predetermined host device connected to the Internet.

The above-mentioned search control means includes, for example, the following search index creation means, search keyword extraction means, and search execution means. That is, first, the search index creation unit classifies the recognized speech data obtained by the speech recognition processing by the speech recognition unit for each currently connected mobile terminal according to a predetermined classification rule, and more specifically, for example, By classifying the words that appear in the input data in the order of the number of occurrences,
Create a search index. The search keyword extracting means extracts a phrase satisfying a predetermined extraction criterion from a search index created by the search index creating means for each of the currently connected mobile terminals, and more specifically, for example, when the number of appearances is a predetermined number of times. The above words or words having a rank equal to or higher than a predetermined number of appearances are extracted, a predetermined unnecessary keyword is removed from the extracted phrases, and a new one of the resulting phrases is extracted as a search keyword.
Then, the search execution means searches the predetermined database system for search result HTML text data corresponding to the search keyword. Note that the search index creation processing and the unnecessary keyword removal processing may be performed in the reverse order, which is also within the scope of the present invention.

Means for returning search result HTML text data (mobile terminal communication control unit 116, packet transmission / reception unit 115)
Returns search result HTML text data obtained by the search processing by the search control means for each mobile terminal currently connected to the corresponding mobile terminal.

The mobile terminal according to the present invention including the mobile terminal and the voice control host device according to the present invention can perform advanced voice recognition / database detection.
There is no need to provide a database search / resource access environment, and a speech recognition / database search function having practical accuracy can be provided at low cost.

The configuration of the invention described above can include the following limitations. That is, first, the mobile terminal has a personal handyphone system communication function (communication unit 111).

Next, the relay network includes a personal handyphone system communication network (PHS network 103) and the Internet (Internet 105). The voice control host device and the host device corresponding to the above-mentioned access information are connected to the Internet.

The host connection means or the resource access processing means in the mobile terminal has a gateway function between the public network including the personal handyphone system communication network and the Internet via the personal handyphone system communication network. By transmitting and connecting to the mobile terminal control host device (mobile terminal control host device 104), the voice control host device or the aforementioned access information is transmitted from the mobile terminal control host device via the Internet using a communication protocol on the Internet. Or access to the host device corresponding to.

With this limited configuration, a voice recognition function having practical accuracy and a world-wide database search can be provided via a personal handyphone system communication network and the Internet, which are currently spreading nationwide and worldwide. , And the provision of an access function to a resource corresponding to the search result can be provided at a lower cost and easily, and at the same time, the function provided by the present invention, the personal handyphone system call function and the Internet access function, Can be seamlessly combined.

Further, the communication protocol used by the host connection means can include the following restrictions. That is, the communication protocol is Internet Protocol (IP)
Layer and Transmission Control Protocol (T
This is a layer protocol including a CP) layer.

Next, an Internet Protocol datagram (IP datagram) which is packet data of an Internet protocol layer transmitted on the Internet.
The header (IP header) field stores a source Internet protocol address and a destination Internet protocol address designating addresses of a mobile terminal and a voice control host device on the Internet, and the data field of the Internet protocol datagram contains And a transmission control protocol segment which is packet data of the transmission control protocol layer.

The transmission control protocol segment (TCP segment) header (T
The CP header field stores a source port number and a destination port number for specifying a communication protocol for speech recognition / database search processing. The data field of the transmission control protocol segment includes a data field for identifying a mobile terminal. Terminal identification code, voice data, or search result HTML text data.

With this limited configuration, the mobile terminal and the voice control host device can be easily specified worldwide, and
The coexistence of the voice recognition / database search processing service, the resource access service based on the search result, and other information processing services can be easily realized.

In the configuration of the present invention described above, the voice control host devices are mutually connected by a network, and mobile terminal connecting means, voice data receiving means, voice recognition means, database means, search control means, and search result HTML text are provided. The present invention can be realized by a plurality of host computers that realize the functions corresponding to the data return means in a distributed manner.

With this limited configuration, load distribution on the host device side can be easily realized. Note that the above-described mobile terminal and voice control host device alone are also within the scope of the present invention.

[0032]

Embodiments of the present invention will be described below in detail with reference to the drawings. In the present embodiment, in a mobile terminal having a built-in PHS function, a voice signal input from a microphone during a call or in an off-line state is connected to a LAN in a specific voice service provider from the PHS network via the Internet. After being sent to the voice control host device, where the voice signal is recognized, the recognition result is automatically classified, and a specific database search engine on the Internet is accessed based on the classification result, and the database there is searched. Searched. As a result, the voice control host device obtains database information related to the content of voice input at the mobile terminal from the Internet, and returns it to the mobile terminal in real time. The database information includes an HTML sentence including a hypertext in which a URL that is a unified format access information for various resources such as a homepage on the Internet including a keyword related to the content of the voice input by the mobile terminal is described (search result). (HTML text data). Upon receiving the search result HTML text data, the mobile terminal activates a browser application for browsing a home page, and displays the above-described search result HTML text data in a home page format. The user of the mobile terminal selects an anchor (text anchor or graphics anchor) displayed as a part of the hypertext by touching the electronic pen or the like with an electronic pen or the like, and the Internet corresponding to the URL included in the hypertext together with the anchor. When it is necessary to access various resources such as the above homepage, Java applet, file, and login account of the host device and transfer them to the mobile terminal, transfer those resources to the mobile terminal 101, and then display and execute the resources. Or can be accumulated. Thus, in the present embodiment,
The mobile terminal must be able to provide a voice recognition function with practical accuracy at a low cost without having to install an advanced voice recognition environment, and also be equipped with an interactive database search function on the Internet. Can do
This is a major feature related to the present invention. <System Configuration> FIG. 1 is an overall system configuration diagram of an embodiment of the present invention.

[0033] The mobile terminal 101 has a PHS terminal function.
It is connected to the HS network 103. The wireless base 102 is a public wireless base provided on a public telephone booth, a telephone pole, a building rooftop, an underground passage, or the like on a street, or a parent-child telephone device in a subscriber's house. When connected to the parent-child telephone device, the PH
It is directly connected to the public telephone network without going through the S network. In addition,
Instead of the wireless base 102, a configuration may be adopted in which the wireless base 102 is connected to the PHS network 103 or the public telephone network by wired communication via a wired connection device.

The PHS network 103 is a public telephone network or an ISD
It is interconnected with N networks, and a mobile terminal control host device 104 connected to the Internet 105 by a high-speed digital leased line or the like is connected to these networks.

The mobile terminal 101 is connected to the radio base 102 and the P
By automatically dialing up the mobile terminal control host device 104 connected to the public telephone network or the ISDN network via the HS network 103, it is possible to connect to the Internet 105.

A predetermined voice service provider LA is connected to the Internet 105 via a high-speed digital leased line or the like.
The router device 106 connected to N107 is connected. LAN 107 is an Ethernet system, ATM (As
Synchronous Transfer Mode) or FDDI. LAN 107
Is connected to a voice control host device 108.

After automatically dialing up the mobile terminal 101 to the mobile terminal control host device 104, the mobile terminal 101 sends the Internet 105, the router device 106, and the LAN 10
7 can communicate with the voice control host device 108.

Now, when the user instructs communication with the voice control host device 108 from the touch panel on the input unit 109 in the mobile terminal 101, the control unit 110 sends a command to the communication unit 111 with the voice control host device 108. Request to start communication.

When the communication unit 111 is requested by the control unit 110 to start communication, the current mobile terminal control host device 104
If not connected to a wireless base (or wired connection device)
After making a wireless (or wired) call to 102 and connecting to the PHS network 103, a dial-up call is made by specifying the access telephone number of the mobile terminal control host device 104.

When the mobile terminal control host device 104 receives an incoming call, the communication unit 111 in the mobile terminal 101 first communicates with the connection establishment unit 113 in the mobile terminal control host device 104, thereby establishing a standard communication protocol on the Internet 105. Negotiation for establishing a connection by the TCP / IP and PPP methods. As a result, an IP address, which is an identification address on the Internet 105, is assigned from the mobile terminal control host device 104 to the communication unit 111 in the mobile terminal 101, and the mobile terminal 101
Can access the Internet 105.

If the communication unit 111 in the mobile terminal 101 is already connected to the mobile terminal control host device 104, the above dial-up transmission is omitted. Then, the mobile terminal 10
1 includes a “destination IP address” that is a preset IP address of the voice control host device 108 and a “source IP address” that is an IP address assigned by the mobile terminal control host device 104. And a "terminal identification code" (for example, a PHS telephone number) for identifying the mobile terminal 101, and a command to start a sentence speech recognition / database search process or a request to end a sentence speech recognition / database search process based on a user's designation. The TCP / IP packet storing the command and the
Send it out to 5.

Based on the “destination IP address” stored in the TCP / IP packet, a voice service is provided by a routing unit 114 in the mobile terminal control host device 104 and a relay host device (not shown) in the Internet 105. Router device 106 in the provider
After that, the packet is further transferred to the packet transmitting / receiving unit 115 in the voice control host device 108 via the LAN 107.

Packet transmitting / receiving section 115 receives the received TC
From the P / IP packet, the “source IP address”
The terminal identification code and the sentence speech recognition / database search processing start request command or the sentence speech recognition / database search processing end request command are extracted and transferred to the mobile terminal communication control unit 116 in the speech control host device 108. .

The mobile terminal communication control unit 116 transmits the delivered “source IP address”, “terminal identification code”,
After registering information relating to a start command of the sentence speech recognition / database search process or an end request command of the sentence speech recognition / database search process in a processing terminal registration table (FIG. 12) described later, the information is transmitted to the packet transmitting / receiving unit 115 A request is sent to the mobile terminal 101 to return a TCP / IP packet storing the permission data.

The packet transmitting / receiving unit 115
The P / IP packet is transmitted to the IP address corresponding to the mobile terminal 101. In this way, the voice control host device 108 can execute sentence voice recognition / database search processing on voice data transferred from the mobile terminal 101.

When the communication unit 111 in the mobile terminal 101 receives a TCP / IP packet storing the above-mentioned transmission permission data from the voice control host device 108, it passes the transmission permission data stored therein to the control unit 110.

After the transmission permission data is delivered, the control unit 110 in the mobile terminal 101 sends the voice of the voice data input from the microphone to the communication unit 111 by a call operation or a voice input operation in an offline state. Request transmission to the control host device 108.

The communication unit 111 transmits the TCP / IP packet storing the voice data to the voice control host device 10.
8 is transmitted to the IP address corresponding to No. 8. This TC
The P / IP packet has the “destination IP” stored therein.
Based on the address, via the routing unit 114 in the mobile terminal control host device 104, the relay host device (not shown) in the Internet 105, the router device 106 in the voice service provider, and the LAN 107,
Packet transmission / reception unit 115 in voice control host device 108
Transferred to

The packet transmitting / receiving unit 115 receives the received TC
The voice data stored in the P / IP packet is extracted and delivered to the mobile terminal communication control unit 116 in the voice control host device 108.

The mobile terminal communication control section 116 delivers the delivered voice data to the sentence voice recognition section 117. The sentence speech recognition unit 117 executes a sentence speech recognition process on the delivered speech data, and delivers the recognized speech sentence data as the recognition result to the search control unit 118. The search control unit 118
Recognized speech text data is classified into indices for each mobile terminal 101, and a search keyword is extracted based on a search index obtained as a result while referring to an unnecessary keyword dictionary. Then, the search control unit 118 requests a specific database search engine registered in advance on the Internet 105 to make an inquiry using the search keyword. As a result, the search control unit 118 uses the search result HT based on the search result returned from the database search engine.
Generates ML text data and transmits it to the mobile terminal communication control unit 1
Hand over to 16. This search result HTML text data is
A hypertext in which a URL (Uniform Resource Locator), which is unified format access information for various resources such as an arbitrary homepage on the Internet 105 including the above-described search keyword related to the content of the voice input by the mobile terminal 101, is described. Includes Hypertext Markup Language HTML.

Now, for example, the PH in the mobile terminal 101
It is assumed that a conversation as shown in FIG. 17 has been exchanged in the S call. On the other hand, the sentence speech recognition unit 117
Outputs recognized speech sentence data as shown in FIG. Note that “*” is a word segment added by the sentence speech recognition unit 117. The search control unit 118 that has input the recognized voice sentence data creates a search index as shown in FIG. 19, for example, as the progress, and in the search index, the word “clock” in which the number of appearances exceeds two, for example, And “Casio” are extracted as search keywords. As a result of an inquiry to a specific database search engine on the Internet 105 using the search keyword (and condition), FIG.
The search result HTML text data as shown in FIG. In this HTML data, for example, “<A HREF
= "http://www.casio.co.jp/"> Casio homepage </ A
“>” Is a hypertext corresponding to the Casio homepage, “http://www.casio.co.jp/” indicates the URL of the above homepage, and “Casio homepage” indicates a text anchor for accessing the URL. The URL includes address information “www.casio.co.jp/” and communication protocol information “http” for accessing a resource of the address, and “<DD>” following the communication information.
The following sentence is an explanatory sentence automatically obtained from the above-described database search engine. The symbols enclosed by “<” and “>” are display control symbols.

The mobile terminal communication control unit 116 searches the search result H
A request is sent to the mobile terminal 101 to return a TCP / IP packet storing the TML text data. Packet transmitting / receiving section 115 transmits a corresponding TCP / IP packet to an IP address corresponding to mobile terminal 101.

When the communication unit 111 in the mobile terminal 101 receives a TCP / IP packet storing the above search result HTML text data from the voice control host device 108,
The search result HTML text data stored therein is delivered to the control unit 110.

The control unit 110 in the mobile terminal 101 activates a browser application and displays the delivered search result HTML text data on the LCD display unit in a homepage format.

Now, for example, when the search result HTML text data shown in FIG. 20 is received, the search result is displayed on the LCD display unit 311 (203 in FIG. 2), for example, as shown in FIG. . Here, the underlined keyword indicates the text anchor included in the hypertext together with the URL of various resources such as a homepage on the Internet 105.

When the user of the mobile terminal 101 selects the anchor displayed as described above by touching it with an electronic pen or the like, the mobile terminal 101 uses the function of the browser application to transmit the anchor via the mobile terminal control host device 104, For various resources such as homepage data, Java applets and file data on the host device connected to the Internet 105 indicated by a URL included in the hypertext together with the anchor, and a login account of the host device, HTTP specified by the URL is used. Communication such as (Hyper Text Transfer Protocol) (for acquiring homepage data or acquiring and executing a Java applet), FTP (File Transfer Protocol) (for acquiring file data), or TELNET (for logging in to a host device) Access using protocol. In this case, when acquisition or execution of homepage data, Java applet, file data, or the like is specified by the URL, the mobile terminal 101 transmits the data from the host device using the communication protocol such as HTTP or FTP. The data is transferred to the mobile terminal 101 and displayed on the LCD display unit 311 (203 in FIG. 2) (in the case of acquiring homepage data).
(In the case of acquiring and executing a Java applet) or storing it in the RAM 317 (in the case of acquiring file data). Alternatively, the mobile terminal 101 uses the URL
When the login to the host device is designated by the, the login to the host device is performed using the TELNET protocol.

Now, on the search result display screen shown in FIG. 21, the user can input, for example, a text anchor " WATCH WA ".
TCHES! ”, The URL“ http://www.casio.co.
From the “ww” directory in the host device on the Internet 105 having “jp”, a home page as shown in FIG. 22 is obtained using the HTTP communication protocol, and displayed on the LCD display unit 311 (203 in FIG. 2). Similarly, when the user selects, for example, the text anchor “Casio homepage”, the URL “http: // ww
A home page as shown in FIG. 23 is obtained from a “/” directory (Web root directory) in the host device on the Internet 105 having “w.casio.co.jp”, and is displayed on the LCD display unit 311 (203 in FIG. 2). <External Configuration of Mobile Terminal 101> FIG. 2 is an external view of the mobile terminal 101 shown in FIG.

The mobile terminal 101 has the appearance of a compact portable information management device, and has a microphone 201 also serving as a transmitter for inputting voice, and a microphone 201 for inputting an image which is not particularly related to the present invention. 1. The camera 202, an LCD display unit 203 having a touch panel function of displaying various information and receiving a touch input or a pen input, and a speaker 204 also serving as a receiver for outputting voice. It has a wireless antenna 205 for transmitting to the base 102 and a socket 206 for connecting to a wired connection device instead of the wireless base 102.

Further, an I for inserting various IC cards is provided.
An optical transceiver 208 for performing infrared optical communication between the C card slot 207 and another mobile terminal 101 or a personal computer or the like is provided.

The switch 209 is a power switch. <Functional Block Configuration of Mobile Terminal 101> FIG. 3 is a functional block diagram of the mobile terminal 101.

As shown in FIG. 1, the mobile terminal 101 comprises an input unit 109, a control unit 110, a communication unit 111, and an output unit 112, and are mutually connected by a bus 326.

First, the input unit 109 includes a part for inputting voice, a part for inputting an image which is not particularly related to the present invention, and a part of a touch panel mechanism described later in the operation of the output unit 112. .

The part for inputting voice is the microphone 301, A
It comprises a / D conversion unit 302 and a microphone control unit 303. The microphone 301 (corresponding to 201 in FIG. 2) is a PHS
Also serves as a telephone transmitter, and inputs a voice uttered by the user.

The A / D converter 302 converts an analog audio signal input from the microphone 301 into digital audio data, and further converts the digital audio data into an ADPCM (Adaptive Differential) which is a PHS standard audio encoding system.
l Pulse Code Modulation: Adaptive differential linear pulse coding
Encode according to the method. This part has already been put to practical use as an LSI integrated circuit constituting a PHS terminal.

The microphone control unit 303 transfers the encoded voice data to the communication control unit 321 in the communication unit 111 during a call and places it on a call channel. Control unit 1
10 to the RAM 317.

On the other hand, a portion for inputting an image is a CCD (Ch
arge Coupled Device) Camera 304, A / D converter 3
05, a memory 306, and a camera control unit 307.

The CCD camera 304 captures an arbitrary image based on a user operation. The A / D conversion unit 305
An analog video signal captured by the CCD camera 304 is converted into digital image data.

The memory 306 stores digital image data in frame units. The camera control unit 307 includes a CCD
Camera 304, A / D converter 305, and memory 306
Control the operation of.

Next, the output section 112 includes a section for outputting sound and a section for outputting an image. The part that outputs audio includes a speaker 308, a D / A converter 309,
And a speaker control unit 310.

The speaker control section 310 transmits the PHS telephone call voice data received from the communication control section 321 in the communication section 111 or the synthesized voice data received from the RAM 317 in the control section 110 to the D / A conversion section 309. Forward.

The D / A converter 309 decodes the received audio data, converts it into an analog audio signal, and emits it as sound from the speaker 308 (corresponding to 204 in FIG. 2).

The part for outputting the image is the LCD display unit 20
3, LCD driver 312, memory 313, and LCD
It comprises a control unit 314. The LCD control unit 314
Various image data such as character data, image data, and command button data received from the RAM 317 in the control unit 110 are stored in the memory 313 in frame units.
The CD driver 312 is started.

The LCD driver 312 displays the image data read from the memory 313 in frame units on the LCD display unit 311 (corresponding to 203 in FIG. 2). In addition,
A transparent touch panel is provided on the surface of the LCD display unit 311 (203 in FIG. 2). The user touches the touch panel with his / her finger or pen in accordance with command button data displayed on the LCD display unit 311. Command input. This input signal is transferred by the touch panel control unit 315 to the RAM 317 in the control unit 110.

Subsequently, the control unit 110 controls the CPU 316,
It comprises a RAM 317 and a ROM 318, an IC card interface unit 319, and an IC card 320 inserted into an IC card slot 207 (FIG. 2) as required.

The CPU 316 controls the operation of the entire mobile terminal 101 according to the control program stored in the ROM 318 while using the RAM 317 as a work area.

The IC card interface unit 319
The input / output of data to / from the C card 320 is controlled. Lastly, the communication unit 111 includes a communication control unit 321, a wireless driver 322, a wireless antenna 323, a wired driver 324,
And a socket 325.

The communication control unit 321 executes a PHS call process and a TCP / IP communication process (to be described later) with the Internet 105, and controls the wireless driver 322 or the wired driver 324.

The wireless driver 322 mutually converts communication data with a PHS wireless signal transmitted / received via the wireless antenna 323 (corresponding to 205 in FIG. 2) during wireless communication. The PHS radio signal has a radio frequency of 1.9 GHz, a carrier frequency interval of 300 kHz, a TDMA-TDD radio access scheme of 4 channels / carrier,
π / 4 shift QPSK modulation method and 384 kbits /
This is a wireless signal based on the wireless transmission speed of sec.

On the other hand, at the time of wired communication, the wired driver 324 mutually converts communication data with a wired signal transmitted / received via the socket 325 (corresponding to 206 in FIG. 2). This is a typical telephone band modem modulated signal.
The operation of the embodiment of the present invention having the above configuration will be described in detail below. <Process of Mobile Terminal 101> First, the process of the mobile terminal 101 will be described.

FIG. 4 shows the CPU 3 in the control unit 110 shown in FIG.
16 stores the ROM 318 in the control unit 110 after the power is turned on.
4 is an overall operation flowchart showing a control operation realized as an operation of executing a control program stored in the control program.

A control program for realizing each function shown in the operation flowcharts of FIGS. 4, 5 and 8 and data necessary for the control program are, for example, ICs shown in FIG.
IC card 320 detachable from card slot 207
Is stored in the form of a program code readable by the CPU 316, and the program code is stored in the CPU 316.
Or the program code can be directly executed by the RAM 317 or the writable ROM 31 as needed.
8 to be executed by the CPU 316. Alternatively, the above-described control program and data necessary for the control program are received from another device via a communication unit 111 from a wireless or wired communication line or an optical transceiver 208 (FIG. 2), and stored in a RAM 317 or a writable ROM 318. It may be configured to be loaded and executed by the CPU 316.

First, steps 401 → 402 → 403 →
In the repetition loop of 404 → 401, it is determined whether touch panel input has been detected from the touch panel control unit 315 in FIG. 3 (401), and the search result HTML text data is sent from the voice control host device 108 (FIG. 1). A determination process (402) of whether or not the data has been received, another reception / display process (403), and a necessary data transmission process (404) are executed.

Touch panel control section 315 notifies of touch panel input detection, and determination in step 401 is YES.
Then, in step 405 or 406, the touch panel input is performed by the CCD camera 304 in FIG. 3 (202 in FIG. 2).
It is determined whether or not the input instruction is the input instruction of the microphone 301 of FIG. 3 (201 of FIG. 2).

The touch panel input is the CCD camera 3 shown in FIG.
04 (202 in FIG. 2) and the
If the determination at 5 is YES, at step 407, the camera control unit 307 in the input unit 109 in FIG. 3 is instructed to start input processing of, for example, a handwritten character image. Thereafter, the process proceeds to the transmission process of step 404. Since the image input processing is not particularly related to the present invention, a detailed description thereof will be omitted.

The touch panel input is the microphone 301 shown in FIG.
If the input instruction is (201 in FIG. 2) and the determination in step 406 is YES, in step 408, the microphone control unit 303 in the input unit 109 in FIG. 3 is instructed to start the voice input process. This voice input processing start instruction is
For example, it is an instruction to start a PHS call process or an instruction to start a speech input process in an offline state for executing a sentence speech recognition / database search process.

The microphone control unit 303 is provided with the CPU 31 described above.
6, the microphone 301 (201 in FIG. 2)
And instruct the A / D converter 302 to start voice input. As a result, the audio data input from the microphone 301 (201 in FIG. 2) is output from the A / D converter 302.

After that, when the above-mentioned voice input processing start instruction is a PHS telephone call start instruction, the above-mentioned voice data is loaded on a predetermined telephone channel by a transmission processing (not shown) of the communication control unit 321. And sent to the other party.

If the above-described voice input processing start instruction includes a voice input processing start instruction for sentence voice recognition / database search processing, thereafter, the microphone 301 (201 in FIG. 2) receives the input from the microphone 301. The audio data output from the control unit 303 is transmitted to the audio control host device 108 in the transmission processing in step 404 described below.

The touch panel input is the CCD camera 3 shown in FIG.
04 (202 in FIG. 2), the microphone 30 in FIG.
If the input instruction is not the input instruction 1 (201 in FIG. 2), the determinations in steps 405 and 406 are NO, and in step 409, another key input processing is executed. Thereafter, the process proceeds to the transmission process of step 404.

On the other hand, the voice control host device 108 (FIG. 1)
From the RAM 31 in the control unit 110 via the communication unit 111
7, the search result HTML text data is received, and if the determination in step 402 in the iteration loop of steps 401 → 402 → 403 → 404 → 401 becomes YES, in step 410, the search result HTML text data is output from the RAM 317 to the output unit 112. The search result H is transferred to the memory 313 in the
Display of the TML text data is instructed.

As a result, under the control of the LCD control unit 314, the received search result HTML text data is displayed on the LCD display unit 311 (203 in FIG. 2) from the memory 313 via the LCD driver 312.

Next, the transmission process in step 404 will be described. FIG. 5 is an operation flowchart showing details of the transmission processing. First, in step 501, it is determined whether or not a key input from the touch panel processed by the other key input processing in step 409 in FIG. 4 is accompanied by a transmission instruction. If this determination is NO, the process proceeds to step 505.

If the determination in step 501 is YES, in step 502, it is determined whether or not the mobile terminal 101 is currently connected to the mobile terminal control host device 104 in FIG.

If mobile terminal 101 is currently connected to mobile terminal control host device 104 in FIG. 1 and the determination in step 502 is YES, CPU 316 in control unit 110 in FIG.
Requests the communication control unit 321 in the communication unit 111 in FIG. 3 to transmit a “terminal identification code” of the mobile terminal 101 and a command corresponding to the key input process in step 504. As a result, the communication control unit 321 generates a TCP / IP packet storing the “terminal identification code” and the command, and transmits the TCP / IP packet to a predetermined host connected to the Internet 105 (for example, the voice control host device in FIG. 1). 1
08).

If the mobile terminal 101 is not currently connected to the mobile terminal control host device 104 in FIG. 1 and the determination in step 502 is NO, the CPU 316 in the control unit 110 in FIG.
Requests the communication control unit 321 in the communication unit 111 of FIG. 3 to perform a transmission process in step 503, and then executes step 504.

As will be described in detail later, the transmission instruction of the start request command of the sentence speech recognition / database search process and the transmission instruction of the end request command of the sentence speech recognition / database search process based on the user's designation are made in step 504 described above.
Issued at

As described above, the determination at step 501 is N
In the case of O or after the processing of step 504, step 50
In step 5, in step 408 of FIG.
An instruction to start voice input processing for database search processing has been executed, and the voice control host device 1 for voice data has been executed.
08 (FIG. 1) is determined.

If this determination is NO, step 51
Proceed to process 0. If the determination in step 505 is YES, in step 506, it is determined whether or not transmission permission data, which is a response to the command to start the sentence voice recognition / database search processing, has already been returned from the voice control host device. You.

If the determination is NO, the voice control host device 108 still recognizes the sentence voice recognition /
Since the preparation for the database search process start request command has not been completed, the process proceeds to step 510.

If transmission permission data, which is a response to the command for requesting the start of sentence voice recognition / database search processing, has already been returned from the voice control host device 108, and if the determination in step 506 is YES, then step 50 is further executed.
At 7, it is determined whether the mobile terminal 101 is currently connected to the mobile terminal control host device 104 of FIG.

If the mobile terminal 101 is currently connected to the mobile terminal control host device 104 in FIG. 1 and the determination in step 507 is YES, the CPU 316 in the control unit 110 in FIG.
In step 509, the microphone control unit 303 in the input unit 109 shown in FIG.
The communication control section 321 in the communication section 111 is requested to transmit the voice data transferred to the communication section 7. As a result, the communication control unit 321 generates a TCP / IP packet in which the above-mentioned voice data is stored, and transmits the TCP / IP packet to the voice control host device 10 of FIG.
Send to 8

If mobile terminal 101 is not currently connected to mobile terminal control host device 104 in FIG. 1 and the determination in step 507 is NO, CPU 316 in control unit 110 in FIG.
Requests the communication control unit 321 in the communication unit 111 of FIG. 3 to perform a transmission process in step 508, and then executes step 509.

As will be described in detail later, an instruction to transmit voice data for sentence voice recognition / database search processing is issued in step 509 described above. As described above, when the determination in step 505 or 506 is NO or after the processing in step 509, in step 510, a start instruction of the image input processing is executed by step 407 in FIG. The Internet 105
It is determined whether or not a transmission instruction to an image control host device (not shown) connected to the image control host device is transmitted.

If this determination is NO, the transmission processing of step 404 in FIG. 4 ends. If the determination in step 510 is YES, in step 511, the mobile terminal 10
1 is currently connected to the mobile terminal control host device 104 in FIG.

If mobile terminal 101 is currently connected to mobile terminal control host device 104 in FIG. 1 and the determination in step 511 is YES, CPU 316 in control unit 110 in FIG.
Requests the communication control unit 321 in the communication unit 111 to transmit the image data obtained in the memory 306 in the input unit 109 shown in FIG. As a result, the communication control unit 321 generates a TCP / IP packet storing the image data, and transmits the TCP / IP packet to the image control host device 108 (not shown) connected to the Internet 105.

If mobile terminal 101 is not currently connected to mobile terminal control host device 104 in FIG. 1 and the determination in step 511 is NO, CPU 316 in control unit 110 in FIG.
Requests the communication control unit 321 in the communication unit 111 of FIG. 3 to perform a transmission process in step 512, and then executes step 513.

Since the image data transmission instruction in step 513 is not particularly related to the present invention, a detailed description thereof will be omitted. As described above, when the determination in step 510 is NO or after the processing in step 513, the transmission processing in step 404 in FIG. 4 ends. <Format of Communication Data> FIG.
And mobile terminal control host device 104 and Internet 1
FIG. 5 is a format diagram of communication data communicated with the MFP 05 (voice control host device 108).

Communication data between the mobile terminal 101 and the mobile terminal control host device 104 is PPP (Point-to-P
oint Protocol).
Using the PPP frame shown in FIG. 6A (transferred from left to right in the figure), 32 kbits of the PHS standard
It is transmitted over a digital communication channel having a transmission rate of s / sec.

"Flag", which constitutes a PPP frame,
In each of the "address" and "control" fields, each fixed bit string shown in FIG. 6A is set. The FCS having a data length of 2 octets is called a frame check sequence, and is data for error detection / correction of PPP frame data. “Information” of a PPP frame transferred after a PPP link is established between the mobile terminal 101 and the mobile terminal control host device 104
The field (having a variable data length) includes I, which is a basic transmission unit of data on the Internet 105 (FIG. 1).
P datagram is stored, in which case a "protocol" field having a data length of 2 octets contains:
A hexadecimal value “0021” indicating that the IP datagram is stored is stored in the “information” field.

"Information" of PPP frame
The IP datagram is stored in the field as described above. This IP datagram is a basic transmission unit of data on the Internet 105 as described above. IP
The datagram is defined in accordance with the Internet Protocol (IP), provides a function for uniquely transferring data stored in its “data” field to a destination host device on the Internet 105, and has an address on the Internet 105. , The function of transferring the IP datagram itself to the host specified by the "destination IP address" through a fixed route on the Internet 105, and the fragmentation (division) and reassembly of the IP datagram itself. It has functions and the like.

An IP datagram is composed of an IP header field and a data field as shown in FIG. The IP header field contains all the information necessary to deliver the IP datagram containing it. FIG. 7A is a format diagram of the IP header.

The IP header has a data length of 5 to 6 words, with 32 bits as one word. This data length is stored in the “header length” field of the first word. The length is stored in the first word of the "total length of IP datagram" field.

In the "version" field of the first word, the version of the Internet Protocol (IP) that defines the method of transmitting the IP datagram is set. The current version is 4.

In the “service type” field of the first word, information indicating the priority of delivery is stored.
This is not particularly relevant to the present invention. Each field of the second word indicates that the IP datagram is
The control information in the case of fragmentation (division) due to the above-described transfer restriction is defined. First, the “identification number”
The field contains this fragmented I
A unique integer for identifying the undivided IP datagram to which the P datagram belongs is set. Next, in the “fragment offset” field, offset information indicating which part of the IP datagram before the division corresponds to the IP datagram that is the divided fragment is set. In the "flag string" field, it is set whether or not another fragment constituting the undivided IP datagram to which this divided IP datagram belongs is followed by the divided fragment. With the above information, even if the IP datagram is fragmented at the relay host on the Internet 105,
The IP datagram before division can be accurately restored on the receiving side.

The "lifetime" of the third word (TTL: Time
In the “To Live” field, time information in seconds indicating how long the IP datagram is allowed to exist on the Internet 105 is set. The relay host on the Internet 105 subtracts the above field value each time the IP datagram is processed, and discards the IP datagram whose value becomes 0 or less from the Internet 105. This suppresses the occurrence of excessive traffic on the Internet 105. The retransmission control for the discarded IP datagram is executed in a control process for a TCP segment stored in the IP datagram.

In the "protocol" field of the third word, an integer value for defining the format of data stored in the "data" field of the IP datagram is set. In the case of the present embodiment, as shown in FIG. 6C, since the TCP segment data is stored in the "data" field of the IP datagram, an integer value 6 defining the format is set. You.

In the “checksum of header” field of the third word, checksum data for detecting an error in the data of the IP header is set. A 32-bit “source IP address” is set in the fourth word. For example, when an IP datagram is transferred from the mobile terminal 101 to the voice control host device 108, the “source IP address” is assigned from the mobile terminal control host device 104 to the mobile terminal 101 by a transmission process described later. The set IP address is set. By storing this “source IP address”, the voice control host device 108 in FIG. 1 can return format text data and the like to the mobile terminal 101 via the Internet 105.

The fifth word contains a 32-bit “destination IP”.
For example, when an IP datagram is transferred from the mobile terminal 101 to the voice control host device 108, the “destination IP address” is fixedly assigned to the voice control host device 108. The IP address is set.The routing unit 114 in the mobile terminal control host device 104, each relay host device on the Internet 105, and the router device 106 in the voice service provider are stored in the received IP datagram. By identifying the "destination IP address", the delivery route of the IP datagram is determined in advance according to the routing control table information of each device, and finally the IP datagram is transferred to the voice control host device in the voice service provider. 108.

The “IP option” field of the sixth word is optional, and is used for information for testing or debugging each network constituting the Internet 105 and control for controlling or monitoring a delivery route on the Internet 105. Information and the like are set, but this is not particularly relevant to the present invention.

In the "padding" field of the sixth word, padding data for adjusting the data length is set. Next, TCP segment data is stored in the "data" field of the IP datagram. This T
The CP segment is defined according to the Transmission Control Protocol (TCP), and its "data"
The data stored in the field is transferred to the Internet 105
A function is provided for accurately delivering the packet to the above destination host device in an appropriate order. IP datagrams provide only the unique transfer function of data on the Internet 105, and the function of ensuring data reliability (retransmission control function, etc.)
Is provided, whereas the TCP segment provides a function for ensuring data reliability.

As described above, the communication data has the hierarchical structure of the IP datagram (with the PPP frame) and the TCP segment. Therefore, it is necessary to efficiently deliver the data on the Internet 105 under a processing load as small as possible. Yes, in order to efficiently address the different demands of achieving the most reliable data delivery end-to-end. As a result, the relay host device on the Internet 105 refers to only the IP header of the IP datagram, so that the information (TCP segment) stored in the “data” field of the IP datagram is as fast and efficiently as possible. To the destination host device, and between end-to-end (source host device and destination host device), TCP
By referring to the TCP header of the segment, highly reliable data communication such as retransmission control can be realized.

The TCP segment is composed of a TCP header field and a data field as shown in FIG. FIG. 7B is a format diagram of the TCP header.

As in the case of the IP header, the TCP header has a data length of 5 to 6 words with 32 bits as one word, and this data length is stored in the “header length” field of the fourth word. Also, the data length of the entire IP datagram is stored in the “total length of IP datagram” field of the first word.

In the "source port number" field and the "destination port number" field of the first word, a 16-bit integer value specifying a communication protocol for sentence speech recognition / database search processing is set.

The packet transmission / reception unit 115 (FIG. 1) in the voice control host device 108 includes electronic mail data in addition to TCP segments in which voice data for sentence voice recognition / database search processing is stored. In order to transmit and receive various TCP segments storing various data, by recognizing the value of the “destination port number” field set in the TCP header of the received TCP segment, the “data” field of the TCP segment is recognized. Can be determined to which application executed on the voice control host device 108 the data stored in the voice control host device 108 is to be delivered.

The packet transmitting / receiving unit 115 sets the value of the “destination port number” field set in the TCP header of the received TCP segment to a value corresponding to the communication protocol for sentence speech recognition / database search processing. In this case, the voice data stored in the "data" field of the TCP segment can be delivered to the mobile terminal communication control unit 116.

Similarly, the communication control unit 321 (FIG. 3) in the communication unit 111 of the mobile terminal 101 also stores homepage data and e-mail data in addition to the TCP segment in which the search result HTML text data is stored. In order to transmit and receive various TCP segments storing various data to be transmitted and received, the value of the “destination port number” field set in the TCP header of the received TCP segment is recognized, so that the “data” of the TCP segment is recognized. It is possible to determine to which application executed on the mobile terminal 101 the data stored in the field is to be delivered.

The communication control unit 321 transmits the received T
If the value of the “destination port number” field set in the TCP header of the CP segment indicates a value corresponding to a communication protocol for sentence speech recognition / database search processing, the control unit 110 (FIG. 1, FIG. 3), the reception of data for sentence speech recognition / database search processing is notified, and the search result HTML text data stored in the “data” field of the TCP segment can be delivered.

Furthermore, the packet transmission / reception unit 115 in the voice control host device 108 and the communication unit 111 of the mobile terminal 101
The communication control unit 321 in the above can confirm the source application by confirming the “source port number” set in the TCP header of the received TCP segment.

Next, the second TCP header shown in FIG.
The word "sequence number" field contains the current TC
From the entire byte stream transmitted from the transmission side to the reception side in the P connection, the transmission side determines from which byte of the byte stream the data stored in the "data" field of this TCP segment corresponds. This is a field for notifying the receiving side. Conversely, the “acknowledgement number” field of the third word indicates the number of bytes that the receiving side has received without error in the entire byte stream transmitted from the transmitting side to the receiving side in the current TCP connection. This is a field for notification from the receiving side to the transmitting side. As a result, for example, the voice data can be transferred from the mobile terminal 101 to the voice control host device 108 in the correct order and with high reliability.

In the "flag string" field of the fourth word, a value indicating the type of the TCP segment is set. T
In the CP communication, for example, various control data for acknowledgment is transmitted at the start or end of the connection, for example, and the type of the control data is set in the “flag string” field.

The "window" field of the fourth word is a field for notifying the receiving side to the transmitting side window data indicating how many bytes of data the receiving side can currently receive continuously. is there. This enables data flow control from the receiving side to the transmitting side. For example, when the load on the voice control host device 108 is high, the transmission of voice data to the mobile terminal 101 is suppressed. Fine control is possible.

The “reserved” field of the fourth word is a field for reservation. The “checksum” field of the fifth word stores checksum data for detecting an error in the data stored in the TCP header and the “data” field. Thus, for example, the voice control host device 108 can correctly receive voice data from the mobile terminal 101.

The "urgent pointer" of the fifth word is control data for communicating urgent data (interrupt data, abort data, etc.), but this is not particularly relevant to the present invention.

The "option" field of the sixth word is used, for example, to specify the maximum segment length that can be communicated between the transmitting and receiving apparatuses, but this is not particularly relevant to the present invention.

In the “padding” field of the sixth word, padding data for adjusting the data length is set. The communication (termination) processing function of the TCP segment having the above-described configuration is realized by the communication control unit 321 (FIG. 3) in the communication unit 111 in the mobile terminal 101, and the packet transmission / reception unit 115 ( 1). Note that the control program executed by the CPU 316 in the mobile terminal 101 may be configured to realize the above processing functions. <Outgoing Call Processing> As described above, the control unit 1 of the mobile terminal 101
The CPU 316 in FIG. 10 (FIG. 3)
5, when the mobile terminal 101 is not currently connected to the mobile terminal control host device 104 in FIG. 1 and the determination in step 502, 507, or 511 is NO, In step 503, 508, or 512, the communication control unit 3 in the communication unit 111 in FIG.
Request the transmission processing to 21. By this request,
The transmission process executed by the communication control unit 321 is shown by the operation flowchart in FIG.

First, in step 801, a link establishment phase is executed. In this phase, the access telephone number of the mobile terminal control host device 104 is automatically dialed up and the mobile terminal control host device 104
Is received, the link control protocol (LC
P), a maximum data length of a PPP frame (FIG. 6A) used for communication, a non-transparent character to be escaped, a "protocol" field of the PPP frame (FIG. 6). (a)) Determine whether to compress the data length from 2 octets to 1 octet, and omit (compress) the "address" field (FIG. 6 (a)) having the fixed value "11111111" of the PPP frame. A negotiation regarding the determination of the presence / absence is performed with the connection establishment unit 113 (FIG. 1) in the mobile terminal control host device 104. In this case, communication between the communication control unit 321 in the communication unit 111 of the mobile terminal 101 and the connection establishment unit 113 in the mobile terminal control host device 104 is performed by using a PPP frame having the format shown in FIG. By setting a hexadecimal value “c021” specifying the LCP in the “protocol” field and setting necessary control data in the “information field”,
Be executed.

Next, in step 802, an authentication phase is executed. In this phase, PAP (Pass
word Authentication Protocol) or CHAP (Challe
The authentication of the user using the mobile terminal 101 is performed from the connection establishment unit 113 (FIG. 1) in the mobile terminal control host device 104 to the mobile terminal 101 using an authentication protocol called ngeHandshake Authentication Protocol). As a result, the Internet provider operating the mobile terminal control host device 104 becomes the mobile terminal 101
Can be determined whether or not the user who uses is a contracted user. In this case, communication between the communication control unit 321 in the communication unit 111 of the mobile terminal 101 and the connection establishment unit 113 in the mobile terminal control host device 104 is performed by using a PPP frame having the format shown in FIG. A hexadecimal value “c023” specifying PAP or a hexadecimal value “c223” specifying CHAP is set in the “protocol” field, and necessary authentication data is set in the “information field”. Will be executed.

Finally, in step 803, a network layer protocol phase is executed. In the case of the present embodiment, in this phase, a protocol called an IP control protocol (IPCP) is used, and T
Whether to compress the CP header (see FIG. 7B) is determined, and one of the free (unused) IP addresses that can be allocated by the mobile terminal control host device 104 is allocated to the mobile terminal 101. In addition, necessary route information is set in the communication control unit 321 (FIG. 3) in the communication unit 111 of the mobile terminal 101 and the routing unit 114 (FIG. 1) in the mobile terminal control host device 104. After this,
By using the IP address, the mobile terminal 101 can access the voice control host device 108 connected to the Internet 105 and any resource desired by the user on the Internet 105. In this case, communication between the communication control unit 321 in the communication unit 111 of the mobile terminal 101 and the connection establishment unit 113 in the mobile terminal control host device 104 is performed by using a PPP frame having the format shown in FIG. The "protocol" field is used to set a hexadecimal value "8021" for specifying the IPCP, and the "information field" is set with data for negotiating a necessary IP address, and executed.

By the above series of operations, the mobile terminal 101
Can exchange a PPP frame storing a TCP / IP packet for communication with the routing unit 114 in the mobile terminal control host device 104, and the mobile terminal 101 can freely use resources on the Internet 105. Can be accessed.

Note that the mobile terminal 101 can be configured to have, for example, a two-channel simultaneous communication function in order to allow access to the voice control host device 108 and the like even during a PHS call.

When the communication control unit 321 (FIG. 3) in the communication unit 111 of the mobile terminal 101 does not detect transmission / reception data for a predetermined time (for example, 10 minutes), the communication control unit 321 communicates with the mobile terminal control host device 104. May be configured to automatically disconnect the PPP link. <Detailed operation of transmission / reception processing of mobile terminal 101 related to sentence speech recognition / database search processing>
The detailed operation of the transmission / reception processing executed by the mobile terminal 101 when the start of sentence speech recognition / database search processing is instructed by operating the touch panel 1 and thereafter will be described.

The operation of the touch panel described above is detected by the touch panel control unit 315 of FIG.
In the control operation corresponding to the above-described operation flowchart of FIG. 4 executed by the CPU 316 (FIG. 3) in the CPU 10, the determination in step 401 is YES, and the determinations in steps 405 and 406 are NO.
09 is detected by executing another key input process. Further, in the transmission processing in step 404, the determination in step 501 in FIG. 5 described above is YES, and the transmission processing is executed in step 503 as necessary. Then, in step 504, the “terminal identification code” of the mobile terminal 101 is transmitted. Then, the communication control unit 321 in the communication unit 111 of FIG. 3 is requested to send a command corresponding to the key input process indicating the start instruction of the sentence speech recognition / database search process.

As a result, the communication control section 321 first generates a TCP segment having the format shown in FIG. In this case, in the TCP header having the format shown in FIGS. 6 (c) and 7 (b), the "source port number" field and the "destination port number" field contain text / speech recognition / database search processing. A 16-bit integer value specifying the communication protocol is set. In the “data” field of the TCP segment, a “terminal identification code” (for example, the PHS telephone number) for identifying the mobile terminal 101 and a command for starting a sentence voice recognition / database search process based on a user's designation are included. Is stored.

Next, the communication control unit 321 executes the above-described TCP
Figure 6 with segments stored in the "data" field
An IP datagram having the format shown in (b) is generated. In this case, in the IP header having the format shown in FIGS. 6 (b) and 7 (a), the "protocol" format includes a format that defines the format of the TCP segment data stored in the "data" field. Numerical value 6 is set. In the “source IP address” field, the connection establishment unit 113 in the mobile terminal control host device 104 transmits the communication unit of the mobile terminal 101 by the transmission processing already executed (see the description of step 803 in FIG. 8). The assigned IP address is set for the communication control unit 321 in 111. Further, the "destination IP address" field contains the voice control host device 1
08 is set.

Then, the communication control unit 321 transmits the IP
The datagram is stored in the "Information" field, and the IP
Hexadecimal value "00" indicating that the datagram is stored
FIG. 6A in which “21” is stored in the “protocol” field
A PPP frame having the format shown in FIG. 8 is generated, and according to the path information (see the description of step 803 in FIG. 8) set in the communication control unit 321, the PPP frame is generated.
The P frame is transmitted to the mobile terminal control host device 104. Hereinafter, when a data unit including the above-described TCP segment, IP datagram, and PPP frame is transferred in the Internet 105, the data unit is simply referred to as a TCP / IP packet.

This TCP / IP packet is routed to the routing unit 114 in the mobile terminal control host device 104 and the Internet 105 in the Internet 105 based on the “destination IP address” stored in the IP header of the IP datagram constituting the TCP / IP packet. In particular, by a relay host device (not shown),
After being transferred to the router device 106 in the voice service provider, the data is further transferred to the packet transmitting / receiving unit 115 in the voice control host device 108 via the LAN 107.

The packet transmitting / receiving section 115 has its own IP address set in the “destination IP address” field of the IP header of the IP datagram constituting the transferred TCP / IP packet. That the TCP / I
Receive a P packet.

The packet transmitting / receiving unit 115 stores a communication protocol for text / speech recognition / database search processing in the “destination port number” field and the “source port number” field of the TCP segment constituting the received TCP / IP packet. The mobile terminal communication control unit 116 (FIG. 1) is notified of the reception by confirming that a 16-bit integer value for specifying is set.

Along with this notification, the packet transmitting / receiving unit 115
Extracts the “source IP address” from the IP header of the IP datagram constituting the received TCP / IP packet, and reads “terminal identification code” from the “data” field of the TCP segment constituting the TCP / IP packet. The voice recognition / database search process start request command is extracted, and the data is transferred to the mobile terminal communication control unit 116.

As a result, a TCP / IP packet storing transmission permission data is returned from the voice control host device 108 to the mobile terminal 101 as described later. This TCP / IP packet is composed of the IP
“Destination IP” stored in the IP header of the datagram
After being transferred to the routing unit 114 in the mobile terminal control host device 104 by the router device 106 in the voice service provider and the relay host device (not shown) in the Internet 105 based on the "address", the PHS network Mobile terminal 1 via 103 (FIG. 1)
01 to the communication control unit 321 (FIG. 3) in the communication unit 111.

The communication control section 321 in the communication section 111 of the mobile terminal 101 stores its own mobile terminal 101 (in the “destination IP address” field of the IP header of the IP datagram constituting the transferred TCP / IP packet. By identifying that the IP address assigned to it (temporarily or dynamically) is set.
/ IP packet is received.

Then, the communication control unit 321 transmits the received T
In the “destination port number” field and the “source port number” field of the TCP segment constituting the CP / IP packet, a 16-bit integer value for specifying a communication protocol for sentence speech recognition / database search processing is set. By confirming this, the CPU 316 in the control unit 110 of the mobile terminal 101 is notified of the reception notification.

At the same time as this notification, the communication control unit 321 extracts the transmission permission data from the “data” field of the TCP segment constituting the received TCP / IP packet, and delivers it to the CPU 316.

The CPU 316 processes the above-described reception notification and transmission permission data in step 403 of FIG.
The transmission permission data is stored in the RAM 317. In the mobile terminal 101, when the user operates the touch panel to instruct the start of the sentence speech recognition / database search processing, the CPU 316 causes the above-described step 408 in FIG.
Then, the microphone control unit 303 in the input unit 109 in FIG. 3 is instructed to start a PHS call process or to start a speech input process in an off-line state for executing a sentence speech recognition / database search process. . As a result, the user has started inputting sound from the microphone 301 (201 in FIG. 2) through a call operation or a sound input operation in an offline state.

Thereafter, the CPU 316 executes steps 401 → 402 → 403 → 404 → 401 in FIG.
Step 40 executed as one processing of a repetition loop of
4 in steps 505 and 506 in FIG.
Is determined to be YES, and if necessary, the transmission processing is executed again in step 508, and then, in step 509, the data is transferred from the microphone control unit 303 in the input unit 109 to the RAM 317 in the control unit 110 shown in FIG. The transmitted voice data transmission instruction is transmitted to the communication control unit 3 in the communication unit 111.
21 is requested.

As a result, the communication control unit 321 first generates a TCP segment having the format shown in FIG. In this case, in the TCP header having the format shown in FIGS. 6 (c) and 7 (b),
In the “source port number” field and the “destination port number” field, a 16-bit integer value specifying a communication protocol for sentence speech recognition / database search processing is set. Then, the “data” field of the TCP segment includes the microphone control unit 303 in the input unit 109 and the RAM 317 in the control unit 110 shown in FIG.
Is stored.

Next, the communication control unit 321 executes the above-described TCP
Figure 6 with segments stored in the "data" field
An IP datagram having the format shown in (b) is generated. In this case, in the IP header having the format shown in FIGS. 6 (b) and 7 (a), the "protocol" format includes a format that defines the format of the TCP segment data stored in the "data" field. Numerical value 6 is set. In the “source IP address” field, the connection establishment unit 113 in the mobile terminal control host device 104 transmits the communication unit of the mobile terminal 101 by the transmission processing already executed (see the description of step 803 in FIG. 8). The assigned IP address is set for the communication control unit 321 in 111. Further, the "destination IP address" field contains the voice control host device 1
08 is set.

Then, the communication control unit 321 transmits the IP
The datagram is stored in the "Information" field, and the IP
Hexadecimal value "00" indicating that the datagram is stored
FIG. 6A in which “21” is stored in the “protocol” field
A PPP frame having the format shown in FIG. 8 is generated, and according to the path information (see the description of step 803 in FIG. 8) set in the communication control unit 321, the PPP frame is generated.
The P frame is transmitted to the mobile terminal control host device 104.

The TCP / IP packet is routed to the routing section 114 in the mobile terminal control host device 104 and to the Internet 105 in the Internet 105 based on the “destination IP address” stored in the IP header of the IP datagram constituting the TCP / IP packet. In particular, by a relay host device (not shown),
After being transferred to the router device 106 in the voice service provider, the data is further transferred to the packet transmitting / receiving unit 115 in the voice control host device 108 via the LAN 107.

The packet transmitting / receiving section 115 has its own IP address set in the “destination IP address” field of the IP header of the IP datagram constituting the transferred TCP / IP packet. That the TCP / I
Receive a P packet. Then, the packet transmitting / receiving unit 11
5 is the TCP constituting the received TCP / IP packet
By confirming that a 16-bit integer value specifying a communication protocol for sentence speech recognition / database search processing is set in the “destination port number” field and the “source port number” field of the segment,
The reception notification is notified to the mobile terminal communication control unit 116 (FIG. 1).

Along with this notification, the packet transmitting / receiving unit 115
Extracts the “source IP address” from the IP header of the IP datagram constituting the received TCP / IP packet, extracts the audio data from the “data” field of the TCP segment constituting the TCP / IP packet, and Is transferred to the mobile terminal communication control unit 116.

As a result, the mobile terminal communication control unit 116
As will be described later, the control of the sentence speech recognition / database search process is executed, the sentence speech recognition unit 117 executes the recognition process of the received speech data, and the search control unit 118 performs the recognition speech sentence data obtained thereby. To execute a database search process. Then, the mobile terminal communication control unit 116 returns a TCP / IP packet storing the search result HTML text data obtained from the search control unit 118 to the mobile terminal 101 as described later.

This TCP / IP packet is based on the “destination IP address” stored in the IP header of the IP datagram that composes the TCP / IP packet. After being transferred by the relay host device (not shown) to the routing unit 114 in the mobile terminal control host device 104, the communication control unit 321 (in the communication unit 111 of the mobile terminal 101) via the PHS network 103 (FIG. 1). It is transferred to Fig. 3).

The communication control unit 321 in the communication unit 111 of the mobile terminal 101 stores its own mobile terminal 101 (in the “destination IP address” field of the IP header of the IP datagram constituting the transferred TCP / IP packet). By identifying that the IP address assigned to it (temporarily or dynamically) is set.
/ IP packet is received.

The communication control unit 321 transmits the received T
In the “destination port number” field and the “source port number” field of the TCP segment constituting the CP / IP packet, a 16-bit integer value for specifying a communication protocol for sentence speech recognition / database search processing is set. By confirming this, the CPU 316 in the control unit 110 of the mobile terminal 101 is notified of the reception notification.

Along with this notification, the communication control unit 321 extracts the search result HTML text data from the “data” field of the TCP segment constituting the received TCP / IP packet, and transfers it to the CPU 316.

The CPU 316 converts the above-described reception notification and the search result HTML text data into the above-described step 40 in FIG.
2, the browser application is started, and the delivered search result HTML text data is displayed on the LCD display unit 311 (203 in FIG. 2) in a homepage format including an anchor which is a part of the hypertext.

When the user of the mobile terminal 101 selects an anchor on the home page displayed as described above by touching it with an electronic pen or the like, the mobile terminal 101 uses the function of the browser application to control the mobile terminal control host device 104. The URL of various resources such as homepage data, Java applets and file data on the host device connected to the Internet 105 indicated by the URL included in the hypertext together with the anchor, together with the anchor, and the login account of the host device. Is accessed using a communication protocol such as HTTP or FTP indicated by.

The user operates the touch panel of the mobile terminal 101 to request the voice control host device 108 to end the sentence speech recognition / database search processing, thereby requesting the end of the sentence speech recognition / database search processing. Can be indicated.

In this case, the operation of the touch panel described above is detected by the touch panel control section 315 of FIG. 3 and then executed by the CPU 316 (FIG. 3) of the control section 110. In the control operation corresponding to the flowchart, the determination is made by YES in Step 401 and NO in Steps 405 and 406, and the other key input processing of Step 409 is executed. Further, in the transmission processing of step 404, the determination of step 501 in FIG.
In step 503, the mobile terminal 10 becomes an ES, and if necessary, a calling process is executed in step 503.
The transmission control unit 321 in the communication unit 111 of FIG. 3 is requested to transmit the “terminal identification code” of No. 1 and the above-described sentence speech recognition / database search processing end request command.

As a result, the communication control unit 321 first
A TCP segment having a format shown in FIG. 6C in which a "terminal identification code" for specifying the mobile terminal 101 and a command for requesting termination of sentence speech recognition / database search processing are stored in a "data" field, next,
An IP datagram having the format shown in FIG. 6B in which the TCP segment is stored in the "data" field is generated, and the IP datagram is stored in the "information" field in FIG. 6A. A PPP frame having the format shown in (1) is generated, and a TCP / IP packet including the PPP frame is transmitted.
In this case, the TCP header (FIG. 6 (c), FIG. 7 (b)), I
P header (Fig. 6 (b), Fig. 7 (a)) and "protocol"
Each piece of information set in the field (FIG. 6 (a)) is the same as each piece of information set when the above-described sentence speech recognition / database search processing start request command is transmitted.

As a result, the above-mentioned TCP / IP packet is transmitted via the Internet 105 in exactly the same manner as the TCP / IP packet storing the above-mentioned sentence speech recognition / database search processing start request command and the like. The packet is transferred to the packet transmission / reception unit 115 in the control host device 108.

The packet transmitting / receiving unit 115 transmits the transferred TCP / IP in exactly the same manner as when the TCP / IP packet storing the above-described sentence speech recognition / database search processing start request command and the like is transferred. It receives the packet and notifies the mobile terminal communication control unit 116 (FIG. 1) of a reception notification.

Along with this notification, the packet transmitting / receiving unit 115
Extracts the “terminal identification code” and the command to end the sentence / speech recognition / database search process from the “data” field of the TCP segment constituting the received TCP / IP packet, and extracts the data from the mobile terminal communication control unit. Hand over to 116.

As a result, the mobile terminal communication control unit 116
As described later, the sentence speech recognition / database search processing for the mobile terminal 101 ends. <Schematic Operation of Mobile Terminal Communication Control Unit 116, Sentence / Speech Recognition Unit 117, and Search Control Unit 118> Next, the mobile terminal communication control unit 116, sentence / speech recognition unit 117, and search control unit in the voice control host device 108 The schematic operation of 118 will be described.

The mobile terminal communication control unit 116 transmits the “terminal identification code” assigned to the mobile terminal 101 that has transmitted the command to start the sentence speech recognition / database search process.
An entry is registered in the processing terminal registration table having the data structure shown in FIG.
A buffer file for receiving voice data (voice buffer file), a buffer file for temporarily storing recognized voice text data (text buffer file), and a search result H
A buffer file for transmitting TML text data (search result buffer file) and other necessary buffer files are created on a file system managed by the voice control host device 108. Also, the mobile terminal communication control unit 11
6 successfully registers the entry and the file, and returns the transmission permission data to the mobile terminal 101 of the “source IP address” stored in the IP datagram that has transmitted the command.

The mobile terminal communication control unit 116 converts the voice data received from the mobile terminal 101 thereafter into the processing terminal corresponding to the “source IP address” (stored in the IP datagram that transferred the data). Write additionally to the audio buffer file specified from the entry in the registration table.

The sentence / speech recognition unit 117 performs a sentence / speech recognition process on each entry of the processing terminal registration table shown in FIG. 12 if the speech data is received in the speech buffer file specified from each entry. Then, the recognition voice text data obtained as a result is additionally written to the text buffer file corresponding to each of the above entries.

For each entry in the processing terminal registration table shown in FIG. 12, the search control unit 118 (FIG. 1) responds to the sentence buffer file specified by each entry if the recognized speech sentence data is obtained. A database search process is executed, and the search result HTML text data obtained as a result is additionally written into a search result buffer file corresponding to each entry.

For each entry in the processing terminal registration table, if the search result HTML text data is obtained in the search result buffer file specified from each entry, the mobile terminal communication control unit 116 registers it in each entry. To the mobile terminal 101 of the “source IP address”.

The mobile terminal communication control unit 116 determines whether the entry in the processing terminal registration table that has received the end request command for the sentence speech recognition / database search processing or the last access time is earlier than the time that is a fixed time before the current time. For the entry in the processing terminal registration table that is the time, the contents of the entry are deleted, and each buffer file specified from that entry is deleted. <Detailed Operation of Mobile Terminal Communication Control Unit 116> FIGS. 9 to 11
Is a mobile terminal communication control unit 1 for realizing the above function.
16 is an operation flowchart illustrating a control operation performed by the control unit 16. This operation flowchart is based on the mobile terminal communication control unit 1.
A processor (not shown) for controlling the CPU 16 is realized as an operation for executing a control program (not shown).

First, in step 901, it is determined whether or not a reception notification has been received from the packet transmitting / receiving unit 115 (FIG. 1) in the voice control host device. As described above, the packet transmitting / receiving unit 115 communicates with the Internet 105
I that constitutes the TCP / IP packet transferred from
In the "destination IP address" field of the IP header of the P datagram, the IP address of the voice control host
By identifying that the address is set,
A 16-bit that receives the TCP / IP packet and specifies a communication protocol for sentence speech recognition / database search processing in the "destination port number" field and the "source port number" field of the TCP segment constituting the TCP / IP packet By confirming that an integer value is set, the mobile terminal communication control unit 116 is notified of the reception notification. This reception notification is a reception notification relating to any one of a sentence speech recognition / database search processing start request command, speech data to be subjected to sentence speech recognition / database search processing, and a sentence speech recognition / database search processing end request command. is there.

When the reception notification is notified from the packet transmission / reception unit 115 and the determination in step 901 is YES, in step 902, the data transferred together with the reception notification from the packet transmission / reception unit 115 is fetched. In this case, if the reception notification is a reception notification of a sentence speech recognition / database search process start request command, the “source IP address”, the “terminal identification code”, and the above command are fetched. When the reception notification is a reception notification of audio data, the “source IP address” and the audio data are captured. Further, when the reception notification is a reception notification of a command for requesting termination of sentence speech recognition / database search processing, the “terminal identification code” and the command are fetched.

After the processing of step 902, the judgments of step 903 of FIG. 9, step 907 of FIG. 10, or step 909 of FIG. 10 are sequentially examined, and any judgment result becomes YES. That is, if the data delivered from the packet transmitting / receiving unit 115 in step 902 is related to a command requesting start of sentence speech recognition / database search processing, the determination in step 903 is YES, and steps 904 to 906 are executed. If it is related to voice data, the determination in step 907 of FIG. 10 is YES.
Then, step 908 is executed, and when the command is related to the end request command of the sentence speech recognition / database search processing, the determination in step 909 in FIG. 10 is YES, and steps 910 and 911 are executed.

If the reception notification has not been received from the packet transmission / reception unit 115 and the determination in step 901 is NO, or after the processing corresponding to the reception of each command or voice data described above, steps 912 and 913 in FIG. The transmission processing of the search result HTML text data is executed in Steps 914 and 915. After the processing for terminating the communication with the mobile terminal 101 whose last access time is a predetermined time or more is performed in Steps 914 and 915, the processing shown in FIG. The process returns to the determination process of Step 901 of Step 9.

If the determination in step 901 is YES and the data passed from packet transmitting / receiving section 115 in step 902 is related to a command requesting start of sentence speech recognition / database search processing, the determination in step 903 is YES. Step 90 to be executed
The processing of 4-905 will be described.

First, in step 904, an audio buffer file which is a buffer file for receiving audio data, a text buffer file which is a buffer file for temporarily storing a recognized voice text, and a search completed file used by the search control unit 118. A keyword buffer file, a search index buffer file, and a search result buffer file that is a buffer file for transmitting search result HTML text data are created on a file system managed by the voice control host device 108.

Next, at step 904, one entry (one horizontal row) is stored in the processing terminal registration table having the data structure shown in FIG. 12 stored in the memory (not shown) in the mobile terminal communication control unit 116. Data set) is secured. Then, in the entry, "terminal identification code"
, “Source IP address”, last access time,
An audio buffer file name, a text buffer file name, a searched keyword buffer file name, a search index buffer file name, and a search result buffer file name are registered. The “terminal identification code” is data transferred from the packet transmission / reception unit 115 in step 902, and is the TC transmitted from the mobile terminal 101.
This is stored in the "data" field of the TCP segment constituting the P / IP packet (FIG. 6 (c)).
reference). The “source IP address” is also stored in step 9
02 is the data transferred from the packet transmitting / receiving unit 115, and is the TC transferred from the mobile terminal 101.
This is stored in the IP header of the IP datagram constituting the P / IP packet (FIGS. 6B and 7A).
reference). The current time is set as the last access time. Each buffer file name is a file name indicating each file created in step 904.

After the processing of step 905, step 90
In step 6, the transmission permission data is returned to the "source IP address" passed from the packet transmitting / receiving unit 115 in step 902 and registered in the entry of the processing terminal registration table.

More specifically, mobile terminal communication control section 116
Requests the packet transmission / reception unit 115 (FIG. 1) to return transmission permission data to the “source IP address”. As a result, the packet transmitting / receiving unit 115 first
Generate a TCP segment having the format shown in (c). In this case, in the TCP header having the format shown in FIGS. 6 (c) and 7 (b), the "source port number" field and the "destination port number" field contain text / speech recognition / database search processing. A 16-bit integer value specifying the communication protocol is set. Then, transmission permission data is stored in the “data” field of the TCP segment.

Next, the packet transmitting / receiving unit 115 generates an IP datagram having the format shown in FIG. 6B in which the above-mentioned TCP segment is stored in the “data” field. In this case, in the IP header having the format shown in FIGS. 6 (b) and 7 (a),
In the “protocol” format, an integer value 6 defining the format of the TCP segment data stored in the “data” field is set. The “source IP address” field contains the voice control host device 1
08 is set. Further, in the “destination IP address” field, the “source IP address” passed from the packet transmission / reception unit 115 in step 902 of FIG. 9 is set.

Then, the packet transmitting / receiving unit 115 generates a frame according to the protocol on the LAN 107 in which the above-described IP datagram is stored, and transmits the frame to the LAN 107
To send to. For example, if the LAN 107 is a local area network based on the Ethernet system, the frame is an Ethernet frame.

The above frame, IP datagram and TCP
A TCP / IP packet composed of a segment and
After being transferred to the mobile terminal control host device 104 via the router device 106 and the Internet 105 based on the “destination IP address” stored in the IP header of the IP datagram constituting the PHS network,
03 and the communication control unit 32 in the communication unit 111 of the mobile terminal 101 via the wireless base (or wired connection device) 102
1 (FIG. 3).

Thereafter, voice data is transferred from the mobile terminal 101 to the voice control host device 108 as described above. After the processing of step 906, FIG.
In steps 912 and 913 of step 1, transmission processing of search result HTML text data is executed, and the subsequent step 914
In steps 915 and 915, a process for terminating communication with the mobile terminal 101 whose last access time is a predetermined time or more is performed, and then the process returns to step 901 in FIG.

Next, the determination in step 901 in FIG.
Step S 908, which is executed when the determination in step 907 in FIG. 10 is YES when the data delivered from the packet transmitting / receiving unit 115 in step S 902 is voice data, will be described.

That is, in step 908, an entry in the processing terminal registration table (FIG. 12) in which the same “source IP address” passed from the packet transmitting / receiving section 115 in step 902 in FIG. 9 is stored is searched. The audio buffer file corresponding to the audio buffer file name stored in the corresponding entry (step 90 in FIG. 9)
4), the audio data transferred from the packet transmitting / receiving unit 115 in step 902 of FIG. 9 is additionally written. The size of the audio buffer file at the time of additional writing is automatically adjusted by the file system managed by the audio control host device 108.

At step 908, the last access time stored in the relevant entry is updated to the current time. In this way, the mobile terminal communication control unit 116 sends the sentence voice recognition unit 11 via the voice buffer file for each mobile terminal 101 (for each “terminal identification code”).
7 (FIG. 1) is delivered. As will be described later, the sentence speech recognition unit 117 performs, for each entry of the processing terminal registration table shown in FIG. 12, the sentence speech recognition if the speech data is received in the speech buffer file specified from each entry. The process is executed, and the resulting recognized voice text data is additionally written to the text buffer file corresponding to each of the entries. Further, as described later, the search control unit 118 (FIG. 1) performs, for each entry of the processing terminal registration table shown in FIG.
If the recognized voice sentence data is obtained in the sentence buffer file specified from each entry, a database search process is executed on the data, and a search result HT obtained as a result is obtained.
The ML text data is additionally written to the search result buffer file corresponding to each of the entries.

After the processing in step 908, transmission processing of the retrieval result HTML text data is executed in steps 912 and 913 in FIG. 11, and the subsequent steps 914 and 9
After the processing for terminating the communication with the mobile terminal 101 whose final access time is a fixed time or more in 15 is performed, the process returns to the determination processing in step 901 in FIG. 9 again.

Next, the determination in step 901 in FIG.
If it is S and the data transferred from the packet transmitting / receiving unit 115 in step 902 is related to a command for requesting termination of sentence speech recognition / database search processing, the determination in step 909 in FIG. The processing of steps 910 and 911 will be described.

First, in step 910, all the contents of the entries in the processing terminal registration table (FIG. 12) storing the same “terminal identification code” passed from the packet transmitting / receiving section 115 in step 902 in FIG. Deleted.

Next, in step 911, each of the audio buffer file name, the sentence buffer file name, the searched keyword buffer file name, the search index buffer file name, and the search result buffer file name stored in the above entry is read. The buffer file is deleted from the file system managed by the audio control host device 108.

After the processing of step 911, transmission processing of the retrieval result HTML text data is executed in steps 912 and 913 of FIG.
After the processing for terminating the communication with the mobile terminal 101 whose final access time is a fixed time or more in 15 is performed, the process returns to the determination processing in step 901 in FIG. 9 again.

When the reception notification is not notified from the packet transmitting / receiving unit 115 and the determination in step 901 in FIG. 9 is NO, or after the processing corresponding to the reception of each command or voice data described above, FIG. Processing of steps 912 and 913, and subsequent steps 914 and 915
Will be described.

In these processes, the sentence speech recognition unit 11
7 is transmitted. First, in step 912, it is determined whether or not the search result buffer file corresponding to the search result buffer file name has an entry in which search result HTML text data exists in the processing terminal registration table (FIG. 12).

If there is no such entry, step 912
Is negative, the process of transmitting the search result HTML text data in step 913 is not executed, and the process proceeds to steps 914 and 915.

If there is one or more entries as described above and the determination in step 912 is YES, step 91
At 3, the search result HTML in the search result buffer file corresponding to the search result buffer file name stored in the entry is directed to the “source IP address” stored in the entry for each corresponding entry. The sentence data is transmitted, and the transmitted search result HTML sentence data is deleted from the search result buffer file. The size of the search result buffer file at the time of deletion is automatically adjusted by the file system managed by the voice control host device 108.

After the processing in step 913 or when the determination in step 912 is NO, step 914
Is executed. Here, the processing terminal registration table (FIG. 1)
Of the entries in 2), the entry whose last access time is a time earlier than the current time by a certain time before the current time is detected, and all the contents of the entry are deleted.

In step 915, each buffer corresponding to the audio buffer file name, text buffer file name, searched keyword buffer file name, search index buffer file name, and search result buffer file name stored in the above entry The file is deleted from the file system managed by the voice control host device 108.

After the processing in step 915, the process returns to the determination processing in step 901 in FIG. <Detailed Operation of Sentence Speech Recognition Unit 117> FIG. 13 is a functional block diagram of the sentence speech recognition unit 117.

As described above, this sentence speech recognition unit 117 performs, for each entry in the processing terminal registration table shown in FIG. 12, if speech data is received in a speech buffer file specified from each entry, Then, sentence speech recognition is executed, and the resulting recognized speech sentence data is additionally written into a sentence buffer file corresponding to each of the above entries.

The reading of the voice data from the voice buffer file for each entry and the writing of the recognized voice text data to the text buffer file are controlled by the input / output control unit 1309 in FIG. First, the input / output control unit 1309
Will be described. FIG. 14 shows the input / output control unit 1
309 is an operation flowchart illustrating a control operation performed by the control unit. This operation flowchart is based on the input / output control unit 130.
9 is realized as an operation of executing a control program (not shown).

First, in step 1401, it is determined whether or not an entry in which audio data is stored in the audio buffer file corresponding to the audio buffer file name exists in the processing terminal registration table (FIG. 12).

If there is such an entry and step 14
If the determination of 01 is YES, in step 1402, for each entry, the "terminal identification code" stored in the entry and the audio buffer file name corresponding to the audio buffer file name stored in the entry are displayed. Of the input buffer queue 130 shown in FIG.
1 and the audio data is deleted from the audio buffer file.

The input buffer queue 1301 stores the audio data queued in the input buffer queue 1301
02. Voice section detector 13
02, the speech analysis unit 1303, the phoneme recognition unit 1304, the word recognition unit 1306, and the text recognition unit 1
A data processing pipeline 307 has a function of processing input data independently of each other. Each of the parts 1302 to 1307 can recognize the “terminal identification code” (input from the input buffer queue 1301) corresponding to the audio data currently being processed. Therefore, finally, a set of the “terminal identification code” and the recognized voice text data is output from the text recognition unit 1307 to the output buffer queue 1308.

After the processing in step 1402 or when the determination in step 1401 is NO, step 1403
Then, it is determined whether or not a set of “terminal identification code” and recognized speech text data has been obtained in the output buffer queue 1308 of FIG.

When such a set has been obtained, step 14 is executed.
If the determination in step 03 is YES, in step 1404, for each set in the output buffer queue 1308, for the entry in the processing terminal registration table corresponding to the "terminal identification code" of that set, the text buffer stored in that entry The set of recognized speech text data in the output buffer queue 1308 is additionally written to the text buffer file corresponding to the file name.

After the processing in step 1404 or when the determination in step 1403 is NO, step 140
1 is performed. As described above, the sentence / speech recognition unit 117 can efficiently execute the sentence / speech recognition process on the speech data requested by the plurality of mobile terminals 101 in a streamlined manner.

Next, 1 for realizing the sentence speech recognition processing is described.
The function of each of the parts 302 to 1307 will be described below. Each of the methods described below can be realized by referring to, for example, the document “Electronic / Information Engineering Introduction Series 2, Sound and Speech Engineering” (Furui, Modern Science Co., Chapter 14).

[0220] Voice section detection section 1302 detects a section in which voice exists, in a sample time series of voice data input from input buffer queue 1301. More specifically, the voice section detection unit 1302 calculates an average power (power) of predetermined samples (for example, 32 to 256 samples for 8 kHz sampling data),
A section in which the state in which the average power exceeds a predetermined threshold continues for a predetermined number of times or more is detected as a voice section. Thereby, it is possible to prevent a sentence voice from being erroneously recognized in a section where no voice exists.

The voice analysis unit 1303 is provided with the voice section detection unit 1
A feature amount parameter vector is detected by performing a feature analysis on the audio data output from 302. Any of the following well-known analysis methods can be adopted as the voice analysis method. (1) A method of smoothing each output of a band filter bank to which a time series of audio data is input, and using each smoothed output as an element of a feature parameter vector. (2) Smoothing each short-time spectrum component calculated by Fast Fourier Transform (FFT) which receives an audio data time series of a predetermined number of continuous samples as input, and converts each smoothed component value into a feature amount parameter vector. Element method. (3) A method in which a cepstrum coefficient group is calculated by cepstrum analysis using a time series of audio data for each successive predetermined sample as an input, and these are used as elements of a feature parameter vector. (4) A method of calculating a Δ (delta) cepstrum (differential coefficient of a cepstrum) group for the cepstrum coefficient group in addition to the cepstrum coefficient group of the above (3), and adding them to the element of the feature amount parameter vector. (5) LPC analysis is performed by linear prediction analysis (LPC analysis, more specifically, line spectrum pair analysis: LSP analysis) that receives a time series of audio data for each successive predetermined sample as input.
(LSP) A method of calculating coefficient groups and using them as elements of a feature parameter vector. (6) An autocorrelation function is calculated by an autocorrelation analysis using a time series of voice data of each successive predetermined sample as an input, and a pitch fundamental frequency pattern of voice detected based on the autocorrelation function is calculated as one element of a feature parameter vector. Method to add to Next, the phoneme recognizing unit 1304 converts the feature parameter vector output from the speech analyzing unit 1303 for each predetermined frame period (predetermined sample) with the phoneme standard pattern dictionary 1303.
5. The similarity (distance) of the feature parameter vector of each phoneme stored in No. 5 with the standard pattern is calculated, and as a result, a set of phonemes with high similarity obtained at every predetermined frame period is determined along with the phonetic lattice along with the similarity. Output as data.
The phoneme recognizing unit 1304 does not determine the final phoneme at every predetermined frame period in order to avoid occurrence of a phoneme recognition error. Instead, the result data in the form of phoneme lattice data in which phoneme candidates are listed. Is output.

The word recognizing unit 1306 receives the phoneme lattice data output from the phoneme recognizing unit 1304 at every predetermined frame cycle, and outputs word lattice data with a table of word candidates at every predetermined frame cycle. As the word recognition method, any of the following well-known analysis methods can be adopted. (1) The word recognition unit 1306 performs time normalization on a time series of phoneme lattice data output from the phoneme recognition unit 1304 over a plurality of frame periods and all phoneme standard pattern sequences stored in the word dictionary ( DP matching or
DTW (Dynamic Time Warping) is executed to output word lattice data. Also in this case, the word recognition unit 1306
Outputs the result data in the form of word lattice data in which word candidates are tabulated without determining a final word at every predetermined frame period in order to avoid utterance of a word recognition error. (2) The word recognition unit 1306 uses HMM (Hidden Markov)
Model), all the words are modeled, and the phoneme recognition unit 1
A time series of phoneme lattice data spanning a plurality of frame periods output from 304 is input to the HMM analysis unit, and each word corresponding to a plurality of models from a large occurrence probability is regarded as word lattice data as a word candidate. Output. Finally, the sentence recognizing unit 1307 sequentially inputs the word lattice data output from the word recognizing unit 1306 as a first stage processing, and generates a grammar (phrase order rule) in the bunsetsu regarding the bunsetsu structure of Japanese (or English). , The possibility of various phrases is calculated as phrase lattice data. Then, the sentence recognizing unit 1307 analyzes the semantic dependency between the phrases according to the inter-phrase grammar as the second stage processing,
The recognition voice sentence data is determined, and it is written in the output buffer queue 1308 in combination with the “terminal identification code” sequentially transmitted from the input buffer queue 1301. <Detailed Operation of Search Control Unit 118> FIG. 15 is a functional block diagram of the search control unit 118.

As described above, the search control unit 118 stores, for each entry in the processing terminal registration table shown in FIG. 12, the sentence speech recognition unit 117 stores the sentence speech sentence data in the sentence buffer file specified from each entry. If it is obtained, a database search process is executed for the search result, and the search result HTML text data obtained as a result is additionally written to the search result buffer file corresponding to each entry.

The reading of the recognized speech text data from the text buffer file for each entry and the writing of the search result HTML text data to the search result buffer file are performed as described above.
The input / output control unit 1507 in FIG. First, the control operation of the input / output control unit 1507 will be described. FIG.
6 is an operation flowchart illustrating a control operation performed by the input / output control unit 1507. This operation flowchart is realized as an operation in which a processor (not shown) for controlling the input / output control unit 1507 executes a control program (not shown).
7 realizes the same control operation as the input / output control unit 1309 shown in FIG.

First, in step 1601, it is determined whether or not there is an entry in the processing terminal registration table (FIG. 12) in which the recognized speech text data is stored in the text buffer file corresponding to the text buffer file name. .

If such an entry exists and step 16
If the determination of 01 is YES, in step 1602, for each entry, the "terminal identification code" stored in the entry and the text buffer file name corresponding to the text buffer file name stored in the entry are displayed. Is written into the input buffer queue 1501 in FIG. 15, and the recognized voice sentence data is deleted from the text buffer file.

The input buffer queue 1501 has a function of sequentially flowing the recognition voice sentence data queued therein to the search index creation unit 1502. A search keyword extraction unit 1503 and a search execution unit 1505 connected after the search index creation unit 1502
Forms a data processing pipeline similarly to the configuration of the sentence speech recognition unit 117 shown in FIG. 13, and has a function of processing input data independently of each other. Each of the parts 1502 to 1505 can recognize the “terminal identification code” (input from the input buffer queue 1501) corresponding to the currently recognized speech text data. Therefore, finally, a set of the “terminal identification code” and the search result HTML text data is output from the search execution unit 1505 to the output buffer queue 1506.

After the processing in step 1602 or when the determination in step 1601 is NO, step 1603
Then, it is determined whether a set of “terminal identification code” and search result HTML text data is obtained in the output buffer queue 1506 in FIG.

When such a set is obtained, step 16
If the determination in step 03 is YES, in step 1604, for each set in the output buffer queue 1506, for the entry in the processing terminal registration table corresponding to the "terminal identification code" of that set, the search result stored in that entry A set of search results HT in the output buffer queue 1506 is stored in the search result buffer file corresponding to the buffer file name.
ML text data is additionally written.

After the processing in step 1604 or when the determination in step 1603 is NO, step 160
1 is performed. As described above, similarly to the case of the sentence speech recognition unit 117, the search control unit 118 efficiently performs the workflow and recognizes the recognition obtained by the sentence speech recognition unit 117 based on the requests from the plurality of mobile terminals 101. It is possible to execute a database search process for voice sentence data.

Next, the function of each of the parts 1502 to 1505 for realizing the database search processing will be described below. For each set of the “terminal identification code” and the recognized speech text data that are sequentially input from the input buffer queue 1401, the search index creation unit 1502 creates an entry in the processing terminal registration table corresponding to the “terminal identification code” of the set. The search index buffer file obtained from the search index buffer file name stored in is used to create a search index, which is a list in which words constituting the recognized speech text data are classified for each mobile terminal 101 according to a predetermined criterion, It is output to the search keyword extraction unit 1503 together with the above-mentioned “terminal identification code”. More specifically, for example, the search index creation unit 1502 counts the number of appearances of each of the words constituting the set of recognized speech text data as shown in FIG. A search index, which is a word table obtained, is created, for example, as shown in FIG. In this case, one mobile terminal 1 is stored in the search index buffer file.
From 01, a search index after the command for starting the sentence speech recognition / database search process is designated is accumulated, and a new search index is stored on the basis of the search index and each word constituting the currently-recognized speech sentence data. A search index is created and stored in a search index buffer file. Therefore, words appearing in the voice input from one mobile terminal 101 after the designation of the command are listed on the search index according to a certain standard, that is, for example, in descending order of the number of appearances. Note that the recognized voice sentence data includes, for example, FIG.
The word delimiter information is included as indicated by “*”. Since the word delimiter information is passed from the text recognition unit 1407 in the text and speech recognition unit 117 via the text buffer file and the input buffer queue 1501, the delimitation of each word on the recognized voice text data is easily identified. it can.

Next, the search keyword extraction unit 1503
For each set of the “terminal identification code” and the search index output from the search index creation unit 1502, a word that satisfies a predetermined criterion in the search index of the set, for example, the number of occurrences of which is equal to or more than a certain number (or a certain number) Extract words whose rank is equal to or higher than the rank of appearance frequency. Further, the search keyword extracting unit 1503 selects, among the extracted words,
A word that is not registered in the unnecessary keyword dictionary 1504 is extracted, and a search stored in an entry of the processing terminal registration table corresponding to the “terminal identification code” output from the search index creation unit 1502 together with the search index. Then, a word other than the searched keyword registered in the searched keyword buffer file obtained from the searched keyword buffer file name is extracted, and the extracted word is output as a search keyword together with the “terminal identification code” of the above set. The search keyword extraction unit 1503 registers the search keyword in the searched keyword buffer file.

In the unnecessary keyword dictionary 1504, words such as ordinary verbs, adjectives, adverbs, auxiliary verbs, particles, conjunctions, and prepositions are registered. By referring to this dictionary, meaningless words can be prevented from being searched in the database, and only significant search result HTML text data can be provided to the mobile terminal 101.

[0234] In the searched keyword buffer file, search keywords that have been subjected to database search processing after one mobile terminal 101 has specified a sentence speech recognition / database search processing start request command are registered. By referring to this file, it is possible to prevent the same search keyword from being subjected to database search processing redundantly.

The search execution unit 1505 is registered in advance on the Internet 105 for each set of the “terminal identification code” and the search keyword output from the search keyword extraction unit 1503, using the set search keyword. Request a query from a specific database search engine. In this case, the inquiry data is created by, for example, AND-joining or OR-joining the plurality of search keywords. The inquiry data is stored in a TCP / IP packet as request data based on an HTTP communication protocol for a Web server on a host device connected to the Internet 105 where the above-described database search engine exists, and is stored in the packet transmission / reception unit 115 ( 1). As a result, based on the search result returned from the host device on the Internet 105 via the router device 106, the LAN 107, and the packet transmission / reception unit 115 (FIG. 1), the search control unit 118 as shown in FIG. The search result HTML text data is generated and written to the output buffer queue 1408 together with the above-mentioned “terminal identification code”. <Other Embodiments> In the embodiment described above, mobile terminal 101 is a PHS terminal, and mobile terminal 101 and voice control host device 108 are connected via PHS network 103 and Internet 105. I have. However, the present invention is not limited to this, and the present invention may be applied to any form connected to the voice control host device 108 indirectly or directly by wireless or wired. Can be applied.

In this embodiment, the search control unit 11
The database search engine searched by the Web server 8 is a Web search engine on a host device connected to the Internet 105.
Although managed by the server, the present invention is not limited to this. For example, a local database storing home page information for a search keyword in the voice control host device 108 or another host device connected to the LAN 107 And the search control unit 118 may be configured to access it and obtain search results.

[0237]

According to the present invention, a mobile terminal can provide a speech recognition / database search function having practical accuracy without providing a sophisticated speech recognition / database search / resource access environment at a low cost. It is possible to receive.

Further, according to the present invention, by using a personal handyphone system communication network and the Internet, which are currently spreading nationwide and worldwide, a speech recognition function having practical accuracy and a world wide A simple database search and a function of accessing a resource corresponding to the search result can be provided at a lower cost and easily, and at the same time, a function provided by the present invention, a call function of a personal handyphone system, and an Internet access function Can be seamlessly combined.

Further, according to the present invention, a mobile terminal and a voice control host device can be easily specified worldwide,
It is possible to easily realize a speech recognition / database search processing service, a resource access service based on the search result, and other information processing services.

In addition, according to the present invention, it is possible to easily realize load distribution on the host device side.

[Brief description of the drawings]

FIG. 1 is an overall system configuration diagram.

FIG. 2 is an external view of a mobile terminal.

FIG. 3 is a functional block diagram of a mobile terminal.

FIG. 4 is an overall operation flowchart of processing of a mobile terminal.

FIG. 5 is an operation flowchart of a transmission process.

FIG. 6 is a format diagram of communication data.

FIG. 7 is a format diagram of an IP header and a TCP header.

FIG. 8 is an operation flowchart of a calling process using PPP.

FIG. 9 is an operation flowchart (part 1) of a mobile terminal communication control unit.

FIG. 10 is an operation flowchart (part 2) of the mobile terminal communication control unit.

FIG. 11 is an operation flowchart (part 3) of the mobile terminal communication control unit.

FIG. 12 is a data configuration diagram of a processing terminal registration table.

FIG. 13 is a configuration diagram of a sentence speech recognition unit.

FIG. 14 is an operation flowchart of an input / output control unit in the sentence speech recognition unit.

FIG. 15 is a configuration diagram of a search control unit.

FIG. 16 is an operation flowchart of an input / output control unit in the search control unit.

FIG. 17 is a diagram illustrating an example of PHS conversation content.

FIG. 18 is a diagram illustrating an example of recognized speech sentence data.

FIG. 19 is a diagram illustrating an example of a search index.

FIG. 20 is a diagram illustrating an example of search result HTML text data.

FIG. 21 is a diagram illustrating a display screen example of search result HTML text data.

FIG. 22 is a diagram showing an example (part 1) of a display screen of a homepage at a hyperlink destination.

FIG. 23 is a diagram showing an example (part 2) of a display screen of a homepage at a hyperlink destination.

[Explanation of symbols]

 Reference Signs List 101 mobile terminal 102 wireless base (wired connection device) 103 PHS network (public telephone network, ISDN network) 104 mobile terminal control host device 105 internet 106 router device 107 LAN (local area network) 108 voice control host device 109 input unit 110 control Unit 111 communication unit 112 output unit 113 connection establishment unit 114 routing unit 115 packet transmission / reception unit 116 mobile terminal communication control unit 117 sentence speech recognition unit 118 search control unit 201, 301 microphone 202, 304 camera (CCD camera) 203, 311 LCD display Units 204, 308 Speakers 205, 323 Wireless antenna 206, 325 Socket (for communication) 207 IC card slot 208 Optical transceiver (for optical communication) 302, 305 A / D conversion unit 303 Microphone Control unit 306, 313 memory 307 Camera control unit 309 D / A conversion unit 310 Speaker control unit 312 LCD driver 314 LCD control unit 315 Touch panel control unit 316 CPU 317 RAM 318 ROM 319 IC card interface unit 320 IC card 321 Communication control unit 322 Wireless driver 324 Wired driver 1401, 1501 Input buffer queue 1402 Voice section detection unit 1403 Voice analysis unit 1404 Phoneme recognition unit 1405 Phoneme standard pattern dictionary 1406 Word recognition unit 1407 Text recognition unit 1408, 1506 Output buffer queue 1409, 1507 Input / output control unit 1502 search index creation unit 1503 search keyword extraction unit 1504 unnecessary keyword dictionary 1505 search execution unit

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁶ Identification code FI H04M 11/08 H04B 7/26 109M

Claims (9)

[Claims] 1. A communication system in which a mobile terminal communicates with a host device, wherein the mobile terminal indirectly or via a relay network comprising one or both of a wireless network and a wired network. A host connecting means for directly connecting to the voice control host device, which is the host device, without going through a relay network; a voice input means for inputting voice; and a connection operation by the host connecting means, after the voice input means, Voice data transmission means for transmitting input voice data to the voice control host device; and search result HTML text returned from the voice control host device and receiving search result HTML text data described in hypertext markup language HTML. Data receiving means, and search result HTML text data for displaying and processing the received search result HTML text data Display / processing means, indirectly via the relay network or via the relay network to resources on the host device which are included in the displayed search result HTML text data and correspond to the access information specified by the user. Resource access processing means for directly accessing the mobile terminal without processing the resource, in the voice control host device, in response to a connection operation by a host connection means in the mobile terminal, Mobile terminal connection means for identifying and connecting to each other, voice data receiving means for receiving the voice data for each currently connected mobile terminal, and voice data receiving means for each currently connected mobile terminal. Voice recognition means for performing voice recognition processing on received voice data, and voice recognition processing by the voice recognition means for each currently connected mobile terminal. Search control means for extracting a search keyword from the recognized voice data obtained by the search and searching the search result HTML text data including the access information for the resource corresponding to the search keyword from a predetermined database system; For each mobile terminal, the search result HTML text data obtained by the search processing by the search control means is returned to the corresponding mobile terminal by the search result H.
A mobile terminal voice recognition / database search / resource access communication system, comprising: TML text data return means. 2. The mobile terminal used in a communication system in which the mobile terminal communicates with a host device, wherein the mobile terminal is indirectly or via a relay network including one or both of a wireless network and a wired network. Host connection means for directly connecting to the audio control host device which is the host device without passing through the relay network; voice input means for inputting voice; and after the connection operation by the host connection means, the voice input means Voice data transmitting means for transmitting voice data input from the voice control host device to the voice control host device; and search result HTML for receiving search result HTML text data returned from the voice control host device and described in hypertext markup language HTML Sentence data receiving means, and a search result HTML sentence for displaying and processing the received search result HTML sentence data Data display / processing means, and indirectly via the relay network or the relay network to resources on the host device included in the displayed search result HTML text data and corresponding to the access information specified by the user. And a resource access processing means for directly accessing the resource without using the resource and processing the resource. 3. The host device used in a communication system in which a mobile terminal communicates with a host device, wherein the host device is indirectly or via a relay network including one or both of a wireless network and a wired network. Mobile terminal connection means for identifying and connecting to the mobile terminal in response to a connection operation performed by the mobile terminal directly without passing through the relay network; and voice data for each currently connected mobile terminal. Voice data receiving means for receiving voice data, voice recognition means for performing voice recognition processing on voice data received by the voice data receiving means, for each currently connected mobile terminal, For each terminal, a search keyword is extracted from recognition voice data obtained by voice recognition processing by the voice recognition means, and access information for a resource corresponding to the search keyword is extracted. Search control means for searching a predetermined database system for search result HTML text data described in a hypertext markup language HTML, and a search obtained by the search processing by the search control means for each currently connected mobile terminal. A search result H which returns the result HTML text data to the corresponding mobile terminal.
A voice control host device comprising: a TML text data returning means. 4. The mobile terminal has a personal handyphone system communication function, the relay network includes a personal handyphone system communication network and the Internet, and the voice control host device and the host device corresponding to the access information are: Connecting to the Internet, the host connection means or the resource access processing means in the mobile terminal, via the personal handyphone system communication network, between the public network including the personal handyphone system communication network and the Internet The voice control host device or the access information is transmitted from the mobile terminal control host device via the Internet using the communication protocol on the Internet by transmitting and connecting to the mobile terminal control host device having a gateway function of Corresponding to The mobile terminal voice recognition / database search / resource access communication system, mobile terminal, or voice control host device according to any one of claims 1 to 3, wherein the mobile terminal is connected or accessed to a host device. 5. The communication protocol used by the host connection means is a hierarchical protocol including an Internet protocol layer and a transmission control protocol layer, and the Internet protocol is packet data of the Internet protocol layer transmitted on the Internet. In the header field of the datagram, a source Internet protocol address and a destination Internet protocol address that specify the addresses of the mobile terminal and the voice control host device on the Internet are stored, and in the data field of the Internet protocol datagram, Stores a transmission control protocol segment which is packet data of the transmission control protocol layer. In the header field of the transmission control protocol segment, a source port number and a destination port number that specify a communication protocol for the voice recognition / database search processing are stored. In a data field of the transmission control protocol segment, A terminal identification code for identifying the mobile terminal, the voice data, or the search result HTML
The mobile terminal voice recognition / communication according to claim 4, wherein text data is stored.
Database search / resource access communication system, mobile terminal, or voice control host device. 6. The voice control host device is mutually connected by a network, and the mobile terminal connection means, the voice data receiving means, the voice recognition means, the database means, the search control means, and the search result HTML. The mobile terminal voice recognition / database according to any one of claims 1 to 3, further comprising a plurality of host computers that realize functions distributed to the sentence data return means in a distributed manner. Search / resource access communication system or voice control host device. 7. The search control unit creates a search index by classifying recognized speech data obtained by speech recognition processing by the speech recognition unit according to a predetermined classification rule for each of currently connected mobile terminals. A search index creating unit that extracts a phrase that satisfies a predetermined extraction criterion from a search index created by the search index creation unit for each currently connected mobile terminal, and extracts a predetermined unnecessary keyword from the extracted phrase. Search keyword extracting means for extracting a new one of the resulting phrases as a search keyword, and search executing means for searching the predetermined database system for search result HTML text data corresponding to the search keyword. 7. The method according to claim 1, further comprising: Mobile device voice recognition according to one of claims / database search /
Resource access communication system or voice control host device. 8. The search index creating means creates the search index by classifying each word appearing in the input data in the order of the number of appearances, and the search keyword extracting means includes: A word whose appearance number is equal to or more than a predetermined number or a word whose rank is equal to or more than a predetermined appearance number rank, removes a predetermined unnecessary keyword from the extracted words, and replaces a new word among the words obtained as a result. 8. The mobile terminal voice recognition / database search / resource access communication system or voice control host device according to claim 7, wherein the voice terminal is extracted as a search keyword. 9. The mobile terminal according to claim 4, wherein the predetermined database system is provided by a predetermined host device connected to the Internet.
Database search / resource access communication system or voice control host device.