JP3888667B2 - Multi-person communication device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a multi-party communication apparatus that can display the positions of opponents on a map screen when making a call with a plurality of people.
[0002]
[Prior art]
In recent years, it has become widespread that a navigation device is mounted on a vehicle. This navigation device includes a current position detection unit such as a GPS receiver, and data centered on the current position from a storage unit such as a map and facility information. Is displayed on the monitor screen, indicating the vehicle position and direction of travel, and the optimum guidance route to the destination is obtained by instructing the destination, etc., and this is displayed on the map screen. It is possible to inform the user in an easy-to-understand manner using an enlarged screen or voice at intersections such as right and left turn.
[0003]
On the other hand, in recent years, mobile phones have become widespread and are often brought into vehicles, so that it is possible to communicate by telephone whenever a person inside the vehicle and a person outside the vehicle need it. Therefore, a hands-free set is provided on the vehicle so that the driver can safely make and receive calls. Further, in recent years, many navigation devices are provided with a voice recognition device, and various operations of the navigation device can be easily performed by a driver's voice. Furthermore, the navigation device is equipped with a mobile phone connection function, and various information can be taken in from the Internet, and the latest detailed information can also be taken in from an information center operated by a car manufacturer or a navigation device manufacturer. .
[0004]
For this reason, in the current navigation device, a mobile phone is connected, a phone call is made with another person using a hands-free set, etc., and data is transmitted from the other party at the same time as necessary. It is also possible to capture and display in the device.
[0005]
Furthermore, in recent years, mobile phones can be equipped with a small TV camera to enable simple videophone calls, and calls can be made while watching the face image of the other party. For this reason, it has been considered that a navigation apparatus can display an image of a partner's face or the like input from a connected mobile phone on a monitor screen. In addition, the above-mentioned video phone is provided with a call function between three parties or a multi-party call on a general telephone, thereby connecting a mobile phone with a video phone function to the navigation device. Sometimes, it is possible to display a plurality of images such as a face transmitted by the other party on the monitor screen. Note that the videophone function as described above can make a videophone call similar to the above by connecting a small camera to the navigation device even when the mobile phone is not equipped with a camera.
[0006]
[Problems to be solved by the invention]
As described above, due to recent technological advances in navigation devices, the spread of mobile phones, and advances in communication technologies, mobile phones can be connected to navigation devices, and video and various data can be transmitted and received along with calls.
[0007]
In this way, when a videophone is connected to the navigation device and the videophone video is displayed on the monitor screen of the navigation device, for example, as shown in FIG. It is a normal display mode that the display screen is arranged in one corner of the monitor screen of the navigation device or the screen is divided and a map screen is displayed on one side and an image is displayed on the other side as shown in FIG. Become.
[0008]
However, with such a display, it is impossible to know where the other party is currently in communication even though a map is displayed on the screen. In particular, in a call using a mobile phone, the characteristics of the other party's voice are not clearly understood, and it is difficult to know who is talking to many of the other parties only by listening to the voice. Moreover, sometimes the voice is interrupted, and there is a problem that the other party is difficult to understand, and even when it is a videophone system, it is not possible to immediately know who the other party is talking to. If you are talking only by phone, you cannot know who you are talking to.
[0009]
Therefore, when a large number of people are trying to gather in one place at a golf competition or when they are gathering in a car to hold a meeting at a specific place, set the time and gather at a predetermined place. It is convenient to keep in touch with each other's current situation between each person's vehicles. Furthermore, when it is necessary to keep in touch for work, it is necessary to be able to easily know who is currently talking and where the other party is currently talking. Such a display is difficult. Furthermore, the same situation occurs when acting with many people other than when moving by car.
[0010]
Therefore, the present invention makes it easy to identify where each other party is located even when there are a plurality of other parties, and can easily identify who is currently talking. The main purpose is to provide a device.
[0011]
[Means for Solving the Problems]
In order to solve the above problems, a multi-party communication apparatus according to the present invention includes a current position detection unit that detects a current position, a communication unit that can communicate with a plurality of communication devices, and that can transmit and receive position data, and a map. In the multi-party communication device including a display unit, the map display unit includes a caller display unit that displays a caller at a position on a map corresponding to the position data received by the communication unit, and the communication The means transmits the current position data detected by the current position detecting means simultaneously with the call.
[0012]
Further, in the multi-party call device according to the present invention, the caller display unit displays either a serial number corresponding to the call partner, a deformed face image, a nickname, a still image, or a moving image. It is what you do.
[0013]
In addition, another multi-party communication device according to the present invention is such that the still image or the moving image is taken by a camera attached to the communication means or an image taken by a camera provided in a device connected to the communication means. It is what.
[0015]
Further, in the other multi-party communication device according to the present invention, the map display means selects a map of a scale on which all the other parties within a predetermined distance from the current position of the device are displayed on one screen. It is what.
[0016]
Further, in the other multi-party communication device according to the present invention, the map display means displays a remote call partner having a predetermined distance or more from the current position of the device at a corner of the map screen where the remote call partner exists. Are displayed in a display mode indicating that they exist outside the screen.
[0017]
In another multi-party communication device according to the present invention, either or both of the current position detection means and the map display means are provided in a communication means or a device connected to the communication means.
[0018]
In another multi-party communication device according to the present invention, a device connected to the communication means is a navigation device.
[0019]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a functional block diagram showing various functional units of the embodiment of the present invention and their interrelationships. The present invention can be implemented in various modes, and a TV camera is attached as one mode. It is the figure which showed mainly the function of the navigation apparatus of one user when many people call by a videophone using the existing mobile phone.
[0020]
In the example shown in FIG. 1, a mobile phone 11 is connected to the navigation device 10, and this mobile phone can communicate with other mobile phones A50, B51, C52,. ing. In this mobile phone, as functions of a mobile phone with a videophone, the sound from the microphone 19 is sent from the audio output unit 18 to the signal output unit 17, and the video signal from the TV camera 21 is sent from the video output unit 20 to the signal output unit 17. Each output. Further, as will be described later, the cellular phone 11 receives the current position signal from the current position signal output unit 44 of the navigation device 10 and transmits these signals that have entered the signal output unit 17 from the antenna to the outside. Be able to.
[0021]
In addition, various external signals received by the antenna in the cellular phone 11 are input to the signal input unit 12, and the audio signal is output from the audio input unit 13 to the speaker 14, and the video signal as a videophone is input to the video The data is output from the unit 15 to the screen 16 of the telephone. In this navigation device 10, the video of the video input unit 15 is also output to the display video forming unit 30 described later. Note that since various other video captured from the Internet are also input to the video input unit 15, they are also displayed on the screen 16 and, if necessary, on the monitor screen 33 of the navigation device 10.
[0022]
As will be described later, since the current position signal is output from the mobile phone 50, 51, 52... Connected to the other party to the mobile phone 11, the signal input unit 12 captures the current position signal. The signal is output to the partner position signal input unit 24. On the other hand, in the cellular phone 11, the current position detection unit 38 takes in data obtained from the current position signal output unit 44 of the navigation device 10 by the signal received by the GPS receiver 37, and this is taken in. The signal output unit 17 can automatically transmit to the other party.
[0023]
In the navigation device 10, the other party's telephone number that has entered the signal input unit 12 of the mobile phone 11 is identified by the other party telephone number identification unit 22, so that the other party can be known from the correspondence table registered in advance. Further, the display template selection unit 25 can select a template stored in the template storage unit 26. As shown in FIG. 3 (a), for example, various templates (1) to (3) are prepared for this template corresponding to the telephone number. Among the template patterns of any one of (1) to (3), the template corresponding to the telephone number of the caller is selected.
[0024]
The speaker discriminating unit 23 discriminates the person who is currently calling based on the telephone number identified by the other party telephone number identifying unit 22, and the caller display change instruction unit 28 displays the display image forming unit 29 and the display video. An instruction is given to the forming unit 30. The display image forming unit 29 forms an image of a call partner template to be displayed on the map screen as shown in FIGS. 3B, 3C, and 4A, for example. When there is a display change instruction of the person who is currently communicating from the person display change instruction unit 28, for example, a flash display is performed as shown in FIG. 5A, or an enlarged template display is displayed as shown in FIG. 5B. So that you can see at a glance who the person is currently calling.
[0025]
In this navigation apparatus, an input video as a videophone function from the video input unit 15 is taken into the display video forming unit 30, and the caller display unit 31 is similar to the template image of the display image forming unit 29. Is output. As a result, the caller display unit 31 selects either a template image from the display image forming unit 29 or a video from the display video forming unit 30 and displays it on the screen. In this embodiment, a still image registered in advance as one mode of the template can be displayed on the map screen as shown in FIG. 4B, for example. Furthermore, although the processing load is increased for the navigation device, the TV moving images of each person in the conversation group may be displayed in a manner as shown in FIG. 4C instead of the still image as necessary. . In that case, it is preferable that the display image forming unit 30 processes and forms the display image so that the face portion of the input image is identified and only that portion is enlarged and displayed.
[0026]
The above-mentioned position signal of the other party that is taken in from the mobile phone 11 to the other party position signal input unit 24 is output to the other party display position setting unit 34. Here, the template image or video obtained as described above is used. Set the position to display on the map. The signal is output to the caller display unit 31 and is output to the display image processing unit 32 together with a template image or video position signal to be displayed on the map screen input to the caller display unit 31.
[0027]
This navigation device includes a map data storage unit 40 such as a CD-ROM or a DVD-ROM. The current position detection unit 38 detects the position of the host vehicle based on a signal from the GPS receiver 37. The map data reading unit 41 A map of an arbitrary region centered on the current position is read out, and this is output to the map drawing unit 42 to perform arbitrary display processing such as 3D display, and output to the display image processing unit 32.
[0028]
The position signal of the own vehicle in the current position detection unit 38 is output to the own vehicle position distance calculation unit 36, and the own vehicle position distance calculation unit 36 determines the call partner position and the own vehicle from the call partner position signal input unit 24. Calculate the distance to the position. The calculation result is output to the display map scale setting unit 39. For example, as shown in FIG. 6 (a), the call partner existing at a predetermined distance or more is removed, and all the call partners within the range are displayed on one screen. In addition, the scale of the map screen is set so that the map is as small as possible. Also, the image or video of the other party at a position of a predetermined distance or more is displayed at the corner in the direction in which the person is present on this screen as shown in FIG. 6B, for example, as shown in the double frame Or a white arrow or the like may be given to indicate that it exists in the direction of the arrow not on the map.
[0029]
The own vehicle position by the current position detection unit 38 is output to the other current position display unit 43, and the position and traveling direction of the own vehicle are displayed on the map screen. Further, the current position signal output unit 44 outputs the signal to the signal output unit 17 as described above, and when the mobile phone 11 is operated to make a call to the other party, this signal is also output at the same time. As a result, when the mobile phone connected to the other navigation device has the same function as the mobile phone with the navigation device as described above, the position of this vehicle is automatically displayed on the other party's screen by receiving this signal. Is done. The image or video input to the display image processing unit 32 as described above is subjected to image processing for display, and is displayed on the monitor screen 33 by appropriately combining images.
[0030]
In the apparatus of the above-described embodiment including such a function unit, for example, the call partner display process for displaying the call partner image and video on the map screen is performed by sequentially operating the operation flow as shown in FIG. be able to. Hereinafter, this operation flow will be described in sequence with reference to the functional block diagram of FIG. 1 and the examples shown in FIGS.
[0031]
First, when making a call using a mobile phone, a position signal captured from a navigation device connected to the mobile phone of the other party is input (step S1). This is performed by the call partner position signal input unit 24 in the navigation device 10 of FIG. Next, the distance between the position and the position of the host vehicle is calculated (step S2). This is obtained from the current position data obtained by the current position detection unit 38 from the signal of the GPS receiver 37 and the position data from the call partner position signal input unit 24 in the distance calculation unit 36 of the own vehicle position in FIG.
[0032]
Next, based on the calculation result, the other party determines whether or not the other party is within a predetermined distance from the own vehicle position (step S3). And display (step S4). This processing is selected and set in the display map scale setting unit 39 of FIG. 1, whereby the map data reading unit 41 reads a map of a corresponding scale centered on the current position from the map data storage unit 40 and sends it to the map drawing unit 42. This is done by outputting.
[0033]
Thereafter, a display template for the other party is selected (step S5). Various templates can be used as display templates. In the example shown in FIG. 3 (a), (1) (2) (3) corresponding to each telephone number as in group (1). Register the template represented by serial number like ▼ ... in advance, or register the face deformed image template corresponding to each phone number like the group in (2), and further the group in (3) In this way, a template representing the user's nickname corresponding to each telephone number is registered in advance.
[0034]
Thus, for example, in this apparatus, when only one type of template such as the group (1) is prepared, this is automatically selected. However, as shown in FIG. When the templates are allocated and registered in advance corresponding to the telephone numbers of friends or the like that are frequently used in advance, the user can select (for example, ( By selecting the group that displays the serial number of 1), the other party can be displayed as shown in FIG. 3B (step S6).
[0035]
Further, when the group (2) is selected, a deformed face image is displayed as shown in FIG. 4C, so that the display can be more familiar, and when the group (3) is further selected, FIG. As shown in (a), the nickname is displayed, and the display can be further felt. Also, as shown in the figure, by adding an arrow to each template, the current position can be shown more accurately. Such an arrow is also used when the templates in FIGS. 3 (b) and 3 (c) are used. Can be used.
[0036]
Furthermore, a face photo template as a still image as shown in FIG. 4B may be prepared and displayed as shown in FIG. Further, each person's video captured by videophone may be displayed on the still image portion. At this time, in a videophone that does not have the function of receiving and displaying images of a plurality of other parties at the same time, only a busy person displays a moving image, and the other person has transmitted a previously prepared still image or previously transmitted. The last video of the image can also be displayed as a still image.
[0037]
On the other hand, if it is determined in step S3 that the other party is within a predetermined distance from the vehicle position, the process proceeds to step S8, and all vehicle positions within the predetermined distance are entered. Select and display a scale map. Next, a display template is selected in the same manner as in step S5 (step S10). Further, in the same manner as in step S6, a template or video is arranged and displayed at the position of each vehicle within a predetermined distance (step S11). ).
[0038]
Next, for example, a template corresponding to a vehicle outside the one-screen display range in FIG. 6A is displayed in one corner of the screen in FIG. The template is displayed at the corner in the direction of the screen (step S12). At this time, in order to show that this template does not exist in this part of the map, for example, as shown in FIG. Indicate the direction of the
[0039]
After such a template or video is displayed, the person who is currently talking is recognized (step S7), and for the current caller, for example, the template is flash-displayed as shown in FIG. As shown in FIG. 6B, the template is displayed in a large size so that the user can clearly see at a glance which person is currently talking.
[0040]
At this time, the flash display and the large display as described above may be displayed only when the other party starts speaking, and may be all the same after that. May be implemented in such a manner that, for example, the face is displayed and then the flash display is switched as described above.
[0041]
In the above embodiment, an example in which various functional units are provided so as to perform as many functions as possible is shown. For example, a normal mobile phone is connected to a navigation device without using a video phone as a mobile phone, At that time, the current position can be automatically transmitted from the navigation device, so that the template can be displayed on the map screen as described above. In the case where transmission is possible, the same function as described above can be performed even with a mobile phone having no videophone function.
[0042]
In addition, the camera for still image shooting can be operated in the same manner instead of the TV camera, and in the above embodiment, an example of use when all people are moving in a car is shown. Can be operated even if some of them are at home or at work and using a landline phone, in which case the location of the landline phone is registered to fix the template etc. at that location on the map Can be displayed.
[0043]
Moreover, although the example which connected the mobile telephone to the navigation apparatus was shown in the said Example, even if it uses the portable information terminal device provided with the GPS receiver and the map display function, for example, the same function can be performed. If the GPS receiver is further miniaturized in the future, the above functions can be operated as part of the functions of the mobile phone by installing the GPS receiver in the mobile phone and downloading the map by communication. . If you do not use the navigation device in this way, in addition to using it in the vehicle, while touring bikes and bicycles, climbing mountains, hiking, tour skiing, and also checking the position of many opponents for sea yachts and boat leisure Can communicate with each other.
[0044]
【The invention's effect】
As described above, the multi-person communication device according to the present invention includes a current position detecting unit that detects a current position, a communication unit that can communicate with a plurality of communication devices and can transmit and receive position data, and a map display unit. In the multi-party communication device, the map display means includes a caller display unit that displays a caller at a position on the map corresponding to the position data received by the communication means, The caller display unit displays a display corresponding to a person who is currently talking, at least at the start of a call, in a manner different from the others, The communication means transmits the current position data detected by the current position detection means simultaneously with a call, so that even when there are a plurality of call partners, it is easy to know where each call partner is. be able to. Moreover, since the current position is automatically sent and received during a call, the user's own position is automatically output without any special input operation, etc., and the other party's position is received and displayed on the map. In addition, the other party can also automatically display the received position data in the same manner, so that a conversation between multiple persons can be performed smoothly.
In addition, it is possible to easily identify the person who is currently speaking, and when such a display is performed only at the start of communication, and when a normal display is performed at other times, the other party can be easily identified first. In addition, after that, the map display can be clearly seen, and the device can be easily used.
[0045]
Further, in the other multi-party communication device according to the present invention, the caller display unit displays either the serial number corresponding to the call partner, the deformed face image, the nickname, the still image, or the moving image. Since it is displayed, it is possible to diversify the display mode of the other party, and when displaying a deformed face image or a nickname, it is possible to display a feeling of familiarity with the other party. Further, when displaying a still image, the other party can be easily identified by displaying the other party's face, and when displaying a moving image, it is possible to immediately know the current state of the other party.
[0046]
In another multi-party communication device according to the present invention, the still image or the moving image is an image captured by a camera attached to the communication unit, or an image captured by a camera provided in a device connected to the communication unit. Therefore, in the case of the image taken by the camera attached to the communication means, for example, a mobile phone with a videophone recently released can be easily used as it is, and the communication means In the case of an image taken by a camera provided in a connected device, even if no camera is attached to the communication means, the camera can be provided in a device connected to the communication means.
[0048]
Further, in the other multi-party communication device according to the present invention, the map display means selects a map of a scale on which all the other parties within a predetermined distance from the current position of the device are displayed on one screen. Therefore, in a state where a plurality of people are talking, the positional relationship can be understood at a glance, and the situation around the caller can be easily known. Further, since a person over a predetermined distance is not displayed on the same screen, displaying a person who is far away on the same map screen can increase the scale of the map and prevent the map from being difficult to see.
[0049]
Further, in the other multi-party communication device according to the present invention, the map display means displays a remote call partner having a predetermined distance or more from the current position of the device at a corner of the map screen where the remote call partner exists. In addition, since it is displayed in a display mode indicating that it exists outside the screen, even a person who cannot display on the same screen can recognize at a glance which direction the person is.
[0050]
Further, in the other multi-party communication device according to the present invention, either or both of the current position detection means and the map display means are provided in the communication means or the device connected to the communication means, so that the current position detection means Alternatively, in the case where the map display means is provided in the communication means, the function of the device connected to the communication means can be reduced accordingly, and conversely, the current position detection means or the map display means is provided in the device connected to the communication means. In this case, the communication means can be reduced in function accordingly. Further, if the communication means is provided with both the current position detection means and the map display means, all functions can be performed by the communication means alone.
[0051]
In addition, another multi-party communication device according to the present invention is widely used in communication between vehicles, which is most likely to be used because the device connected to the communication means is a navigation device. It can be operated by using the position detection function of the navigation device, and there is no need to provide special position detection means. Moreover, it can operate | move using the map output function with which a navigation apparatus is equipped, a large sized monitor screen, etc., and can implement this invention easily. In addition, it is possible to recognize the other party of the call simply by looking at the display on the map screen of the navigation device, and this device can be used without hindering safe driving.
[Brief description of the drawings]
FIG. 1 is a functional block diagram of an embodiment of the present invention.
FIG. 2 is an operation flowchart of processing for displaying a call partner in the present invention.
FIG. 3 shows an example of displaying a template on a map screen in the present invention, where (a) is an example of a call partner template pattern, (b) is an example of displaying a call partner with a serial number, and (c) is a call. It is a figure which shows the example which displays an other party in the deformed image of a face.
FIGS. 4A and 4B show examples of displaying a call partner on a map screen according to the present invention, FIG. 4A shows an example of displaying a call partner's nickname with a point indication arrow, and FIG. It is a figure which shows the example of an image when displaying the still image or the moving image of the television screen transmitted from a telephone call other party, (c) is a figure which shows the state which displayed them on the map.
FIGS. 5A and 5B show an example of displaying a partner who is currently talking in the present invention, FIG. 5A is an example of displaying a template corresponding to the partner who is talking in flash, and FIG. 5B is a template corresponding to the partner who is talking; FIG.
FIGS. 6A and 6B are diagrams showing a display mode of a map screen when a call partner is far away in the present invention, FIG. 6A is a diagram showing a predetermined distance area, and FIG. 6B is for a person outside the predetermined area. It is a figure which shows the aspect which displays the template to perform on the corner of a screen.
FIG. 7 is a diagram showing an aspect of a conventional videophone-use multi-party call, in which (a) shows an example in which TV screens of a plurality of opponents are arranged at appropriate positions on a map as a conventional example 1; (B) shows the example which divided the screen into 2 as the prior art example 2, displayed the map on one side, and displayed the television screens of a plurality of opponents on the other side.
[Explanation of symbols]
10 Navigation device
11 Mobile phone
12 Signal input section
14 Speaker
16 screens
17 Signal output section
19 Microphone
21 TV camera
22 Calling party phone number identification section
23 Speaker Discriminator
24 Caller location signal input section
25 Display template selection section
26 Template storage
27 Template pattern specification section
28 Caller display change instruction section
29 Display Image Forming Unit
30 Display image forming part
31 Caller display
32 Display image processing unit
33 Monitor screen
34 Calling party display position setting section
36 Distance calculation section between own vehicle positions
37 GPS receiver
38 Current position detector
39 Display map scale setting section
40 Map data storage
41 Map data reading part
42 Map drawing part
43 Current position display
44 Current position signal output section
50, 51, 52 Navigation device connected mobile phone

Claims (7)

Current position detecting means for detecting the current position;
A communication means capable of making a call with a plurality of communication devices and capable of transmitting and receiving position data;
In a multi-party communication device comprising a map display means,
The map display means includes a caller display unit for displaying a caller at a position on a map corresponding to the position data received by the communication means,
The caller display unit displays a display corresponding to a person who is currently talking, at least at the start of a call, in a manner different from the others,
The multi-party communication apparatus, wherein the communication means transmits current position data detected by the current position detecting means simultaneously with a call.   The multi-party communication according to claim 1, wherein the caller display unit displays either a serial number corresponding to a call partner, a deformed face image, a nickname, a still image, or a moving image. apparatus.   The multi-person image according to claim 2, wherein the still image or the moving image is an image photographed by a camera attached to the communication means or an image photographed by a camera provided in a device connected to the communication means. Communication device.   2. The multi-party communication apparatus according to claim 1, wherein the map display means selects a map on a reduced scale on which all callers within a predetermined distance from the current position of the apparatus are displayed on one screen.   The map display means displays a remote caller of a predetermined distance or more from the current position of the device in a display mode indicating that the remote caller is present at the corner of the map screen in the direction where the remote caller is present. The multi-party communication apparatus according to claim 1.   2. The multi-person communication apparatus according to claim 1, wherein either or both of the current position detection means and the map display means are provided in a communication means or a device connected to the communication means. The multi-party communication device according to claim 6 , wherein the device connected to the communication means is a navigation device.

Images