JP2004015196A - Communication system and communication service method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enhance operability in a portable terminal, when a user operates it. <P>SOLUTION: A server 3 displays the same image as one to be displayed on the portable terminal 1, when it receives operational information and voice from the portable terminal 1. Not only is the image prepared by an operator transmitted to the portable terminal 1, but also the voice uttered by the operator is transmitted to the portable terminal 1, when the operator utters voice. The portable terminal 1 displays the image received from the server 3 and outputs the voice received from the server 3. The operator instructs an indication, to urge the user to operate, properly supposing a situation for the user to operate the portable terminal 1, and the user views the image received from the server 3 and operates hearing the voice uttered by the operator. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention provides a communication system in which a terminal such as a mobile terminal displays an image received from a server, thereby enabling a user to set a destination while viewing an image received from the server. It relates to a communication service method.
[0002]
[Problems to be solved by the invention]
In recent years, the server transmits an image to, for example, a mobile terminal, and the mobile terminal displays an image received from the server, so that the user can perform, for example, setting a destination while viewing the image received from the server. Is being put to practical use.
[0003]
Specifically, when the user performs an operation to start setting a destination on the mobile terminal, the mobile terminal transmits operation information indicating the content of the operation performed by the user to the server. When the operation information is received from the mobile terminal, the server notifies the operator of the fact, and the operator prepares an image (for example, a map) necessary for the user to set the destination. Then, the image prepared by the operator is transmitted to the portable terminal. Then, when the image is received from the server, the mobile terminal displays the received image. Through such a series of processes, the user can receive an image necessary for setting a destination from the server, and thereafter, set a desired destination while viewing the image received from the server. Can be.
[0004]
However, as described above, if the portable terminal only displays the image received from the server, the user must perform operations only by using the displayed image thereafter, which is excellent in operability. Is hard to say.
[0005]
The present invention has been made in view of the above circumstances, and has as its object the purpose of, for example, setting a destination while the user looks at an image received from a server. An object of the present invention is to provide a communication system and a communication service method capable of improving operability.
[0006]
[Means for Solving the Problems]
According to the communication system of the first aspect, when the user operates the terminal or utters a voice, the terminal transmits operation information or a voice indicating the content of the operation to the server. When receiving the operation information and the voice from the terminal, the server transmits the image prepared by the operator to the terminal. At this time, the server not only transmits the image prepared by the operator to the terminal, but also displays the same image as the image displayed on the terminal, and when the operator utters a voice, the server outputs the voice uttered by the operator. Send to Then, when the terminal receives the image and the sound from the server, the terminal displays the received image and outputs the received sound.
[0007]
Therefore, since the server displays the same image as the image displayed on the terminal by the server, the operator can see the same image as the user sees, and assumes the situation where the user operates the terminal from the user's standpoint. Meanwhile, an instruction to appropriately prompt the user's operation can be given by voice. In addition, since the terminal not only displays the image received from the server but also outputs the voice received from the server, the user can listen to the voice received from the server, that is, the voice emitted by the operator. Thereby, while viewing the image received from the server, it is possible to perform, for example, an operation for setting a destination while listening to the voice uttered by the operator. Thereby, the operability when the user operates the terminal can be improved.
[0008]
According to the communication system described in claim 2, the terminal transmits the terminal capability indicating the size of the display area and the communication speed of the terminal to the server, and the server analyzes the terminal capability received from the terminal. In addition, the same image as the image displayed on the terminal is displayed based on the terminal capability, and the voice generated by the operator is transmitted to the terminal based on the terminal capability. Therefore, by absorbing (adjusting) the difference in performance between the terminal and the server, it is possible to prevent a problem from occurring due to the difference in performance between the terminal and the server. .
[0009]
According to the communication system described in claim 3, the terminal and the server each display an image in a state where the display area is partitioned. Therefore, for example, when specifying an arbitrary point on a map, the user or the operator can perform an appropriate operation by specifying any of the partitioned display areas.
[0010]
According to the communication system described in claim 4, when the user operates the terminal or utters a voice, the terminal transmits operation information or voice indicating the content of the operation to the server. When the server receives operation information and voice from the terminal, the server prepares an image and transmits it to the terminal by analyzing the received operation information or performing voice recognition on the received voice. I do. At this time, the server not only transmits the image to the terminal, but also analyzes the operation information received from the terminal, or performs voice recognition on the voice received from the terminal, thereby generating the voice. Prepare and send to terminal. Then, when the terminal receives the image and the sound from the server, the terminal displays the received image and outputs the received sound.
[0011]
Therefore, since the terminal not only displays the image received from the server, but also outputs the audio received from the server, the user can listen to the audio received from the server, that is, the audio prepared by the server. Thereby, while viewing the image received from the server, it is possible to perform an operation for setting a destination, for example, while listening to the sound prepared by the server. Thus, the operability when the user operates the terminal can be improved in the same manner as in the first aspect.
[0012]
BEST MODE FOR CARRYING OUT THE INVENTION
(First embodiment)
Hereinafter, a first embodiment in which the terminal of the present invention is applied to a portable terminal will be described with reference to FIGS.
First, FIG. 1 schematically shows an entire configuration of a communication system. The mobile terminal 1 has a structure that can be carried by the user. When the user performs an operation on the mobile terminal 1 or when the user utters a voice, the mobile terminal 1 transmits operation information and voice indicating the content of the operation to the mobile phone network. And a server 3 through a telephone network 2 composed of various telephone networks such as a telephone network and a fixed telephone network. The server 3 is composed of, for example, a desktop computer terminal and peripheral devices. When operation information or voice is received from the mobile terminal 1, the server 3 displays the received operation information or outputs the received voice. And inform the operator accordingly.
[0013]
FIG. 2 is a functional block diagram showing the electrical configuration of the portable terminal 1 described above. The mobile terminal 1 includes a CPU (Central Processing Unit) 4 for executing a control program (a computer program according to the present invention), a microphone 5, a speaker 6, a voice interface unit 7, a data interface unit 8, a multiplexing unit 9, and a communication unit 10. , A storage unit 11, an operation unit 12, and a display unit 13.
[0014]
The microphone 5 outputs the input voice to the voice interface unit 7 when the voice emitted by the user is input, and the voice interface unit 7 performs a transmission process on the input voice when the voice is input from the microphone 5. Output to the multiplexing unit 9. The multiplexing unit 9 receives the voice from the voice interface unit 7 and receives the data from the data interface unit 8, and multiplexes the voice and data thus input. Is output to the communication unit 10. When receiving the transmission signal from the multiplexing unit 9, the communication unit 10 transmits the input transmission signal by radio waves.
[0015]
Further, when receiving a reception signal in which voice and data are multiplexed by radio waves, the communication unit 10 outputs the received reception signal to the multiplexing unit 9. Upon receiving the received signal from the communication unit 10, the multiplexing unit 9 extracts voice and data from the input received signal, outputs the voice to the voice interface unit 7, and outputs the data to the data interface unit 8. . When audio is input from the multiplexing unit 9, the audio interface unit 7 receives and processes the input audio and outputs it to the speaker 6, and when the audio is input from the audio interface unit 7, the audio is input. Output audio to outside.
[0016]
The storage unit 11 is configured to be able to store various types of information. The operation unit 12 is operated by a user, and is configured by arranging some keys (buttons). In this case, the operation unit 12 may be configured by a touch panel type key displayed on the display unit 13. The display unit 13 displays an image (for example, a map) received from the server 3 and the like.
[0017]
FIG. 3 shows an electrical configuration of the server 3 as a functional block diagram. The server 3 displays a main body 14, a voice input device 15 for inputting a voice uttered by an operator, a voice output device 16 for outputting a voice received from the mobile terminal 1, an operation device 17 operated by the operator, and various kinds of information. And a communication device 19 for performing communication processing with the mobile terminal 1 and a storage device 20 for storing various information.
In the configuration described above, the mobile terminal 1 and the server 3 can simultaneously communicate voice and data (images, operation information, and the like).
[0018]
Next, the operation of the above configuration will be described with reference to FIGS. Here, as an example, a case where the user operates the mobile terminal 1 to set a destination will be described.
[0019]
When the mobile terminal 1 detects that the user has performed an operation for starting the setting of the destination using the operation unit 12 (step S1 in FIG. 4), a communication link (voice and data) with the server 3 is provided. ) Is established by the communication unit 10, and a request signal is transmitted from the communication unit 10 to the server 3 through the telephone network 3 in order to request the start of the destination setting. In this case, the mobile terminal 1 transmits a request signal to the server 3 and transmits a terminal identification number unique to the terminal to the server 3 via the telephone network 3 from the communication unit 10.
[0020]
When the communication device 19 receives the request signal and the terminal identification number from the mobile terminal 1, the server 3 analyzes the received terminal identification number (step T1 in FIG. 4), and as shown in FIG. A display message is displayed on the display device 18, for example, "There is a request to set the destination from the mobile terminal (terminal ID: NNNN). Do you want to respond?" (Step T2 in FIG. 4).
[0021]
When the operator confirms the display message displayed on the display device 18 in this way, the operator selects whether or not to respond to the request for setting the destination from the mobile terminal 1. Here, when the server 3 detects that the operator has performed an operation for responding to the request for setting the destination from the mobile terminal 1 with the operation device 17 (step T3 in FIG. 4), the server 3 A response signal is transmitted from the communication device 19 to the mobile terminal 1 through the telephone network 3 in order to respond to the request for setting the location.
[0022]
Next, when the response signal is received from the server 3 by the communication unit 10, the mobile terminal 1 transmits the terminal capability indicating the size of the display area and the communication speed of the mobile terminal 1 from the communication unit 10 to the server 3 via the telephone network 3. Here, the reason why the mobile terminal 1 transmits the terminal capability to the server 3 is to prevent a problem from occurring due to a difference in performance between the mobile terminal 1 and the server 3 beforehand.
[0023]
When the terminal capability is received from the mobile terminal 1 by the communication device 19, the server 3 analyzes the received terminal capability (step T4 in FIG. 4) and absorbs a difference in performance between the mobile terminal 1 and the mobile terminal 1. (Adjust). Then, as shown in FIG. 5B, the server 3 displays an outline of the appearance (see P) of (the display unit 13 of) the mobile terminal 1 on the display device 18 (Step T5 in FIG. 4). Thereby, the operator will see the same image as the image displayed on the display unit 13 of the mobile terminal 1 thereafter.
[0024]
Next, the server 3 prepares an image necessary for the operator to set the destination, and emits a sound appropriate to the prepared image, for example, “Display an image. Specify an area.” When it is detected that the operation has been performed (step T6 in FIG. 4), as shown in FIG. 6, the image prepared by the operator is displayed in a plurality of blocks (A1 to A3, B1 to B3 in FIG. 6). Block), and displays the image on the display device 18 on the basis of the terminal capability analyzed earlier, and displays the same image as the image displayed on the display device 18 and the image input by the voice input device 15, for example, Please specify the area. "Is transmitted from the communication device 19 to the portable terminal 1 through the telephone network 3 based on the terminal capability analyzed earlier.
[0025]
When the image and the sound are received from the server 3 by the communication unit 10, the mobile terminal 1 displays the received image on the display unit 13 and outputs the received sound from the speaker 6 (step in FIG. 4). S2). Thus, the user sees the image in which the display area received from the server 3 is partitioned into a plurality of blocks, and also displays the voice received from the server 3, that is, for example, an image generated by the operator. Please specify the area. "
[0026]
Here, when the user confirms the image displayed on the display unit 13 and confirms the voice uttered by the operator, the user designates one of the areas according to the instruction from the operator. When detecting that the user has performed an operation for designating any of the regions using the operation unit 12 (step S3 in FIG. 4), the mobile terminal 1 transmits operation information indicating the content of the operation performed by the user. The information is transmitted from the communication unit 10 to the server 3.
[0027]
When the operation information is received from the mobile terminal 1 by the communication device 19, the server 3 notifies the operator of the received operation information (step T7 in FIG. 4). Then, the operator prepares the next image based on the operation information notified from the server 3 and emits the next sound appropriate for the prepared image. Thereafter, the above operation is repeated, and the user Support the work of setting the land. FIG. 7 shows a case where the user specifies, for example, an area “A2” on the map shown in FIG. Although not described in detail, the images displayed on the display unit 13 of the mobile terminal 1 and the display device 18 of the server 3 are similarly displayed, for example, on a wide area map according to the operation of the user or the operator. Will be sequentially updated to the detailed map image.
[0028]
As described above, the operator can see the same image as the user sees, and the user can see the image received from the server and set the destination while listening to the voice uttered by the operator. Operations can be performed.
[0029]
By the way, the case where the user operates the operation unit 12 to specify the area has been described above. However, even in a configuration in which the user can specify the area by uttering a voice. good. In addition, the case where the user sets the destination based on the image received from the server 3 has been described above. For example, when the user searches for a route from the current position to the destination, Even when browsing an e-mail or performing an information search, the configuration allows the user to perform those operations while viewing the image received from the server 3 and listening to the voice emitted by the operator. There may be.
[0030]
As described above, according to the first embodiment, when the operation information and the voice are received from the portable terminal 1, the server 3 not only transmits the image prepared by the operator to the portable terminal 1, but also transmits the image to the portable terminal 1. The same image as the image displayed on the terminal 1 is displayed, and the voice uttered by the operator is also transmitted to the mobile terminal 1. When the mobile terminal 1 receives the image and the voice from the server 3, the received voice is received. It is configured to display the image and output the received sound.
[0031]
Therefore, since the server 3 displays the same image as the image displayed on the mobile terminal 1, the operator can see the same image as the image that the user sees. While assuming a situation in which the operation is performed, an instruction to appropriately prompt the user's operation can be given by voice. In addition, since the mobile terminal 1 not only displays the image received from the server, but also outputs the voice received from the server 3, the user receives the voice received from the server 3, ie, the operator. By listening to the voice emitted by the user, the user can view the image received from the server 3 and perform an operation for setting the destination while listening to the voice emitted by the operator. Thereby, the operability when the user operates the mobile terminal 1 can be improved.
[0032]
Further, the server 3 analyzes the terminal capability received from the mobile terminal 1 to display the same image as the image displayed on the mobile terminal 1 based on the terminal capability, and also outputs the voice uttered by the operator to the terminal. Since transmission is performed to the mobile terminal 1 based on the capability, the difference in performance between the mobile terminal 1 and the server 3 is absorbed (adjusted), so that the communication between the mobile terminal 1 and the server 3 is performed. Problems can be prevented from occurring due to differences in performance.
[0033]
Furthermore, since the mobile terminal 1 and the server 3 are configured to display an image in a state where the display area is partitioned, the user or the operator can specify a desired location on the map, for example, when the user specifies an arbitrary point on the map. An appropriate operation can be performed by designating any of the display areas.
[0034]
(Second embodiment)
Next, a second embodiment of the present invention will be described with reference to FIG. The description of the same parts as in the first embodiment is omitted, and different parts will be described. In the above-described first embodiment, the arrangement of the operator enables the operator to respond to the operation information and the voice received from the mobile terminal 1. In the second embodiment, the server performs the processing performed by the operator described in the first embodiment so that the server responds to the operation information and the voice received from the mobile terminal 1 on behalf of the operator. It is configured.
[0035]
That is, unlike the server 3 described in the first embodiment, the server 21 has an operation recognition function for automatically recognizing the operation information received from the mobile terminal 1, and a voice received from the mobile terminal 1. Has a voice recognition function for automatically recognizing the operation information. When operation information or voice is received from the mobile terminal 1, the received operation information is analyzed or a voice is generated for the received voice. By performing the recognition, an image and a sound are prepared and transmitted to the mobile terminal 1.
[0036]
As described above, according to the second embodiment, the server 21 has the operation recognition function and the voice recognition function, and when the operation information and the voice are received from the mobile terminal 1, the server 21 analyzes the received operation information. Or by performing voice recognition on the received voice, so that not only an image is prepared and transmitted to the mobile terminal 1, but also a voice is prepared and transmitted to the mobile terminal 1. did.
[0037]
Therefore, the user does not only display the image received from the server 21 but also output the sound received from the server 21, so that the sound received from the server 21, that is, the server By listening to the sound prepared by the server 21, the user can view the image received from the server 21 and perform an operation for setting the destination while listening to the sound prepared by the server 21. Thus, the operability when the user operates the portable terminal 1 can be improved in the same manner as described in the first embodiment.
[0038]
(Other Examples)
The present invention is not limited to the above-described embodiment, but can be modified or expanded as follows.
The terminal is not limited to a mobile terminal, and may be a mobile phone or an in-vehicle terminal mounted on an automobile.
The period during which the operator responds to the operation information and voice received from the mobile terminal and the period at which the server responds to the operation information and voice received from the mobile terminal by the server operating the voice recognition function. They may be mixed and have a selectable configuration.
As a procedure for the user or the operator to specify the area, another method such as operating (marking) with a touch pen may be adopted.
[Brief description of the drawings]
FIG. 1 is a diagram schematically showing an entire configuration of a first embodiment of the present invention; FIG. 2 is a functional block diagram showing an electrical configuration of a portable terminal; FIG. 3 is a functional block showing an electrical configuration of a server; FIG. 4 is a diagram schematically showing a processing flow. FIG. 5 is a diagram showing an example of display on a server. FIG. 6 is a diagram showing an example of display on a mobile terminal and a server. FIG. 7 is a diagram corresponding to FIG. FIG. 8 is a diagram schematically showing the entire configuration of a second embodiment of the present invention.
In the drawings, 1 is a mobile terminal (terminal), 3 is a server, and 21 is a server.

Claims (6)

A terminal that transmits operation information or a voice representing the content of the operation to the server in response to a user operating the terminal or uttering a voice,
A communication system comprising: a server that transmits an image prepared by an operator to the terminal in response to reception of operation information and voice from the terminal,
The server is configured to display the same image as the image displayed on the terminal, and to transmit a voice uttered by the operator to the terminal,
A communication system, wherein the terminal is configured to display an image received from the server and output a sound received from the server. In the communication system according to claim 1,
The terminal is configured to transmit a terminal capability indicating the size of the display area, the communication speed, and the like to the server,
The server analyzes the terminal capability received from the terminal, displays the same image as the image displayed on the terminal based on the terminal capability, and transmits the voice emitted by the operator to the terminal based on the terminal capability. A communication system characterized in that the communication system is configured to: In the communication system according to claim 1 or 2,
A communication system wherein the terminal and the server are each configured to display an image in a state where a display area is partitioned. A terminal that transmits operation information or a voice representing the content of the operation to the server in response to a user operating the terminal or uttering a voice,
Prepare an image and send it to the terminal by analyzing the received operation information or by performing voice recognition on the received voice in response to the reception of the operation information and voice from the terminal. A communication system comprising:
The server is configured to analyze the operation information received from the terminal, or to perform voice recognition on the voice received from the terminal, to prepare voice and transmit it to the terminal,
A communication system wherein the terminal is configured to display an image received from the server and output audio received from the server. The terminal transmits operation information or voice representing the content of the operation to the server in response to the user operating the terminal or uttering a voice,
A communication service method in which a server transmits an image prepared by an operator to a terminal in response to operation information and voice received from the terminal,
The server displays the same image as the image displayed on the terminal, transmits the voice uttered by the operator to the terminal,
A communication service method, wherein a terminal displays an image received from a server and outputs a sound received from the server. The terminal transmits operation information or voice representing the content of the operation to the server in response to the user operating the terminal or uttering a voice,
The server prepares an image by analyzing the received operation information or performing voice recognition on the received voice according to the reception of the operation information or voice from the terminal. A communication service method for transmitting to a terminal,
The server prepares a voice and transmits it to the terminal by analyzing the operation information received from the terminal, or by performing voice recognition on the voice received from the terminal,
A communication service method, wherein a terminal displays an image received from a server and outputs a sound received from the server.

Images