JPH11308591A - Information communication system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information communication system where a receiver side easily recognizes which information generating source produces information among pluralities of information generating sources at a transmitter side. SOLUTION: The system is provided with a transmitter 10 that sends position information used to identify the position of an information generating source and the send produced information and with a receiver 20 consisting of a position relation re-buildup means 22 that converts received position information received from the transmitter 10 into position information of a receiver side by referring to conversion rules 21 which are used to convert respective position information of pluralities of information generating sources into respective position information at the receiver side corresponding to the position relation of pluralities of the information generating sources and of a position relation expression means 22 that uses information output means such as voice output means (232a, 232b,...) to express the position relation of the information generating source producing the information based on the converted position information at the receiver side.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a plurality of users on a transmitting side, for example, when outputting information such as voice input by a microphone placed at each position on a receiving side, the positional relationship of the users is determined. The present invention relates to an information communication system having a function of outputting a representation.

[0002]

2. Description of the Related Art For example, in a video conference system, when a member speaks, an image of the conference room where the speaker is photographed is transmitted to another conference room together with its voice while a receiving member is monitored. Can be heard while looking at the face of the speaker of the image displayed in. Therefore, even between distant meeting rooms, members can obtain a sense of unity as if they are holding a meeting in the same room. Also,
When a plurality of members are participating in the conference room displayed on the monitor, the receiving member recognizes which member has spoken based on the movement of the mouth, the movement of the hand, and the like in the image.

[0003]

However, when the image is unclear, when a series of still images taken at regular intervals, or when the number of members is large, the speaker can be recognized from the monitor image. It becomes difficult. If the speaker cannot be recognized from the image, it is necessary to judge who the speaker is and whether or not the member who is speaking is the same person as the previous and previous speakers only by voice. However, since only one set of speakers for outputting sound is generally provided, the receiving member must guess the speaker from the difference in voice. Therefore, information exchange using the information communication system is hindered, for example, there is a risk that the video conference will not be smoothly operated due to a mistaken speaker.

The present invention has been made in order to solve such a problem, and transmits position information of an information source such as a speaker in a video conference system together with generated information such as voice. The position information transmitted and received from the side is converted into position information on the receiving side according to the positional relationship between a plurality of information sources, for example, from a speaker arranged at a position having a positional relationship according to this positional information. By expressing the positional relationship of the information sources on the transmitting side on the receiving side, such as outputting sound, it is possible to determine which information source among the multiple information sources existing on the transmitting side generated the information. It is an object of the present invention to provide an information communication system which can be easily recognized on a receiving side and realizes a smooth information exchange.

[0005]

FIG. 1 is a diagram illustrating the principle of the present invention. In the transmitting apparatus 10, when a member speaks using information input means 12 such as a microphone placed in front of each of a plurality of members as information sources, the information input means 12 to which voice is input is arranged. Based on the current position, the position detecting means 11 detects the position of the information source. The transmitting device 10 transmits to the receiving device 20 positional information such as coordinates specifying the position of the information generating source and generated information such as a voice generated by a speaker as the information generating source.

[0006] In the receiving apparatus 20, the position information of each of the plurality of information sources on the transmitting side is converted into the position coordinates (the receiving side coordinates) of the coordinate system of the positional relationship reconstructing means 22 according to the positional relationship of the information sources. ) For conversion to ().
0). The positional relationship reconstructing means 22 includes:
Referring to the conversion rule 21, the position information (transmission-side coordinates) of the information source transmitted from the transmission device 10 is converted into position information on coordinates (reception-side coordinates) of the positional relationship expressing means 23. .

[0007] The positional relationship expressing means 23 is a position corresponding to the coordinates of the receiving side (the coordinates of the receiving side and the position of the information output means) among information outputting means (not shown) such as speakers and monitors arranged at a plurality of positions. From the information output means arranged at the nearest position when the coordinates do not coincide with the coordinates of the information source, the voice of the information source, the image, the pre-recorded voice for identifying the information source, the previously captured image, Output sound, image, etc., or perform three-dimensional processing on the sound of the information source and the sound specifying the information source to form a sound image at a position corresponding to the coordinates of the receiving side, or according to the coordinates of the receiving side. By displaying the image of the information source, the image taken in advance to identify the information source, the image generated in advance, and the like at the display position on the monitor, the positional relationship of the information source that generated the information is expressed. I do.

When the positional relationship is not represented by the information generated by the information source, information such as voice, image, text, etc. generated by the information source is output from the information output means.

The information communication system of the present invention transmits the position information of the information source together with the generation information such as the voice from the transmitting device, and refers to the conversion rules stored in advance,
Converts position information on the transmitting side to position information on the receiving side according to the positional relationship between a plurality of information sources, and outputs sound from, for example, a speaker arranged at a position having a positional relationship according to the positional information. Information on the transmitting side, such as generating a sound image at a three-dimensional position, displaying an image on a monitor arranged at a position corresponding to the position information, displaying an image at a display position on the monitor according to the position information, etc. Express the positional relationship of the source on the receiving side. This makes it possible for the receiving side to easily recognize which information generating source has generated information among the plurality of information generating sources existing on the transmitting side, and realizes smooth information exchange.

[0010]

FIG. 2 is a block diagram of a main part (positional relationship expressing means) of an information communication system according to a first embodiment of the present invention. The configuration of the other parts of the system is the same as the principle diagram shown in FIG. In the first embodiment, voice data 231 in which the voice of each user who is the information source on the transmitting side is recorded in advance is stored for each user. Are arranged at a plurality of positions, and the positions of the sound output units 232a, 232b,... Are mapped to the coordinate system of the positional relationship expression unit 23, respectively.

The audio output control means 233 outputs information from the audio output means 232 which is arranged at a position corresponding to the coordinates of the receiving side converted by the positional relationship restructuring means 22 with reference to the conversion rule 21. The source audio data 231 is output.

FIG. 3 is a block diagram of a main part (positional relationship expressing means) of an information communication system according to a second embodiment of the present invention. The case where the information generated by the information source is voice will be described. The configuration of the other parts of the system is the same as that of the principle diagram shown in FIG. 1, and the same parts as those in the first embodiment shown in FIG. In the second embodiment, the audio output control unit 233 transmits the information source information from the audio output unit 232 arranged at a position corresponding to the receiving-side coordinates converted by the positional relationship restructuring unit 22 with reference to the conversion rule 21. The sound of the sound source is output.

FIG. 4 is a block diagram of a main part (positional relationship expressing means) of an information communication system according to a third embodiment of the present invention. The configuration of other parts of the system is the same as that of the principle diagram shown in FIG. 1, and the same parts as those in the first embodiment shown in FIG. In the third embodiment, a three-dimensional sound output unit 234 is provided instead of the plurality of sound output units.

The sound output control means 233 forms a sound image at a position corresponding to the coordinates of the receiving side converted by the positional relation restructuring means 22 with reference to the conversion rule 21 together with the sound data 231 of the information source which generated the information. Such three-dimensional information is given to the three-dimensional sound output means 234. The three-dimensional sound output unit 234 performs three-dimensional processing on the sound data 231 given from the sound output unit 233 based on the three-dimensional information, and forms a sound image at a position corresponding to the coordinates on the receiving side.

FIG. 5 is a block diagram of a main part (positional relation expressing means) of an information communication system according to a fourth embodiment of the present invention. The case where the information generated by the information source is voice will be described. Further, the configuration of the other parts of the system is the same as that of the principle diagram shown in FIG. 1, and the same parts as those of the third embodiment shown in FIG. In the fourth embodiment, the sound output control unit 233 forms a sound image at a position corresponding to the receiving-side coordinates converted by the positional relationship restructuring unit 22 with reference to the conversion rule 21 together with the sound of the sound source that is the information source. Such three-dimensional information is given to the three-dimensional sound output means 234. The three-dimensional sound output unit 234 performs three-dimensional processing on the sound of the sound source provided from the sound output unit 233 based on the three-dimensional information to form a sound image at a position corresponding to the coordinates on the receiving side.

FIGS. 6 (a) and 6 (b) are block diagrams of a main part (positional relationship expressing means) of a modification of the second and fourth embodiments of the information communication system of the present invention. The case where the information generated by the information source is voice will be described. The configuration of the other parts of the system is the same as that of the principle diagram shown in FIG. 1, and the same parts as those in the second and fourth embodiments shown in FIG. 3 and FIG. In this modification, image data 235 of each user who is an information source on the transmitting side is previously stored for each user. Are arranged at a plurality of positions, and the positions of the display units 236a, 236b,... Are mapped to the coordinate system of the positional relationship reconstructing unit 22, respectively.

In FIG. 6A, the sound output control means 233
Outputs the sound of the sound source, which is the information source, from the sound output means 232 arranged at the position corresponding to the receiving-side coordinates converted by the positional relationship restructuring means 22 with reference to the conversion rule 21. In FIG. 6B, the sound output control means 233 outputs the sound image at the position corresponding to the receiving-side coordinates converted by the positional relationship reconstructing means 22 with reference to the conversion rule 21 together with the sound of the sound source as the information source. The three-dimensional information to be formed is provided to the three-dimensional audio output means 234. Three-dimensional sound output means 23
Reference numeral 4 denotes the sound of the sound source given from the sound output means 233,
A three-dimensional process is performed based on the three-dimensional information to form a sound image at a position corresponding to the coordinates on the receiving side.

6 (a) and 6 (b), the display control means 237 is arranged at a position corresponding to the receiving-side coordinates converted by the positional relationship restructuring means 22 with reference to the conversion rule 21. Display means 236 displays the image data 2 of the information source.
35 is displayed.

Note that a plurality of display means 2 shown in this modification example
36a, 236b,... And the first and third embodiments,
A combination with a configuration that uses previously recorded audio data is also possible.

FIGS. 7A and 7B are block diagrams of a main part (positional relationship expressing means) of another modification of the second and fourth embodiments of the information communication system of the present invention. The case where the information generated by the information source is voice will be described. Further, the configuration of the other parts of the system is the same as that of the principle diagram shown in FIG. 1, and the second and fourth embodiments shown in FIGS.
The same reference numerals are given to the same parts as those of the modification shown in FIG. In this modification, the display control means 237
The image data 235 of a plurality of information sources is displayed at a display position on the screen of the display unit 236 corresponding to the receiving-side coordinates converted by the positional relationship reconstructing unit 22 with reference to the conversion rule 21.

FIG. 8 is a block diagram of a main part (transmitting device) according to a fifth embodiment of the information communication system of the present invention. In addition,
A case where the information generated by the information source is voice will be described. The configuration of the other parts of the system is the same as that of any one of the principle diagrams shown in FIG. 1, the first to fourth embodiments and the modifications shown in FIGS. In the fifth embodiment, imaging means 13a and 13 arranged one-to-one or many-to-one with a user as a sound source and capable of photographing a user respectively.
b,... and a photographing control means 14 for photographing the information generation source by the imaging means 13 capable of photographing the information generation source which generated the information.

The position information of the information source, which is the speaker, detected by the sound source position detecting means 111 based on the position of the microphone arranged in front of the user as the voice input means 121 is given to the photographing control means 14. Imaging control means 1
Reference numeral 4 denotes an imaging unit 1 capable of photographing the sound source based on the position information given from the sound source position detection unit 111.
3 is driven to photograph the sound source. The image of the sound source captured by the imaging unit 13 is transmitted to a receiving device (not shown) together with the position information detected by the sound source position detection unit 111 and the sound information generated by the sound source.

FIG. 9 is a block diagram of a main part (transmitting device) according to the sixth embodiment of the present invention. The case where the information generated by the information source is voice will be described. The configuration of the other parts of the system is the same as that of any one of the principle diagrams shown in FIG. 1, the first to fourth embodiments and the modifications shown in FIGS. In the seventh embodiment, instead of a plurality of imaging means, an imaging means 13 for chasing and photographing a sound source which is an information source.
Is provided.

The position information of the information source, which is the speaker, detected by the sound source position detecting means 111 based on the position of the microphone arranged in front of the user as the voice input means 121 is given to the photographing means 13. The photographing unit 13 moves to a position near the sound source and photographs the sound source based on the position information given from the sound source position detecting unit 111. The image of the sound source captured by the imaging means 13 is
1 is transmitted to a receiving device (not shown) together with the detected position information and the sound information generated by the sound source.

[0025]

DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 10 is a conceptual diagram of a conversion rule, and FIG. 11 is a conceptual diagram of a positional relationship reconstruction and a positional relationship expression, for a specific example in which the information communication system having the above configuration is applied to a video conference. A description will be given based on the flowchart of the processing procedure of the positional relationship reconstruction shown in FIG. 12 and the flowchart of the processing procedure of the positional relationship expression shown in FIG.

Users 1, 2, 3, on the transmitting side (source)
Are Pos1, Pos2, Pos3,..., And the receiving-side coordinates of users 1, 2, 3,... In the coordinate system on the receiving side (destination) are Pos10,
In the case of Pos20, Pos30,..., As shown in FIG.

Further, a plurality of information output means OUT1 to OUT8 such as a microphone and a display arranged on the receiving side.
Is mapped to the coordinate system of the positional relationship reconstruction means 22. In the positional relationship reconstruction, the transmitting side coordinates Pos1, Pos2, and Po of the transmitting side users 1, 2, and 3
s3 is the receiving-side coordinate Pos1 based on the conversion rule 21.
0, Pos20 and Pos30.

In the positional relationship expression, the receiving side coordinates Pos10, Pos20 and Pos30 of the users 1, 2 and 3
The information output means Out2, Out8 and Out5 arranged at the same coordinate position as the above, or at the other coordinate position if not, are selected, and these information output means Out2 and O5 are selected.
From ut8 and Out5, the contents of remarks of the users 1, 2, and 3, the images of the users 1, 2, and 3, the voices recorded in advance, or the images generated for the users 1, 2, and 3 are output. When an image of the users 1, 2, and 3 is captured, a pre-recorded voice, or an image generated for the users 1, 2, and 3, the contents of the remarks of the users 1, 2, and 3 are output by the positional relationship expressing unit 23. It is output from an external information output means. As a result, the user on the receiving side can surely recognize who the speaker is, and the information exchange is performed smoothly.

The procedure for reconstructing the positional relationship will be described with reference to the flowchart of FIG. It is determined whether or not termination of the positional relationship reconstruction has been instructed (step S1) and whether or not there is data to be processed to convert the coordinates on the transmission side into coordinates on the reception side (step S2). Is
The transmission-side coordinates of the processing target data are converted into the coordinates (reception-side coordinates) of the positional relationship expressing means 23 (step S3).

The coordinates on the receiving side after the conversion are represented by the positional relationship expressing means 2
In step S3, it is determined whether or not the coordinates are valid.
4) If it is a valid coordinate position, the positional relationship expressing means 2
3, audio data and image data are supplied together with the converted coordinate data. On the other hand, if the converted coordinates on the receiving side are not valid in the positional relationship expressing means 23, the process returns to step S1 and shifts to the processing of the next data to be processed. At this time, a coordinate position that is not valid in the positional relationship expressing means 23 is
It may be re-converted to any valid coordinate position. The above steps are repeated until termination of the positional relationship reconstruction is instructed (YES in step S1).

The processing procedure of the positional relationship expression will be described with reference to the flowchart of FIG. Here, a case where the information expressing the positional relationship is audio will be described. Whether termination of the positional relationship expression has been instructed (step S11),
It is determined whether or not there is data to be processed to represent the positional relationship (step S12). If there is data to be processed, the operable audio output means OUTn closest to the coordinates (receiving side) is detected (step S12). Step S13).

It is determined whether or not the operable voice output means OUTn closest to the coordinates on the receiving side has been detected (step S).
14) If detected, audio data is output from the audio output means OUTn. On the other hand, if the operable audio output unit OUTn closest to the receiving-side coordinates cannot be detected, the process returns to step S11 and shifts to the processing of the next processing target data. At this time, the audio output means OUTn
May be output from any audio output means OUTn. In the above steps, the end of the positional relationship expression is instructed (YE in step S11).
Repeat until S).

Further, when the information communication system of the present invention is applied to a chat where a plurality of users exchange text messages input from respective personal computers using keyboards on a network, the domain name is the position information. Is equivalent to When exchanging messages with an unspecified majority through chat, the country code in the domain name is the location information of the message sender that is the information source. Further, in addition to the domain name, location information such as the area name of the message sender may be transmitted from the transmission side. Further, when the exchange members of the message are limited, a table in which the area name and the domain name of the member are associated with each other may be provided on the receiving side.

On the receiving side, the position information of the message sender as described above is converted into coordinates of a position where a plurality of speakers are arranged, coordinates of an image for expressing a positional relationship such as a map displayed on a display, and the like. Convert to receiving side coordinates. Then, from a speaker arranged in the vicinity of the coordinates of the receiving side, a voice synthesized from the text data of the message or a voice identifying the message sender (actual voice of the sender, voice recorded in advance, receiving side Etc.) is output. In the case where speech is synthesized from the text data of the message, the receiving device 20 is provided with speech synthesis means. Also, at the position of the receiving side coordinates of the display, text data of the message or an image that identifies the message sender (actual image of the sender, image captured in advance,
Image generated on the receiving side). Is displayed.

[0035]

As described above, the information communication system of the present invention transmits the position information of the information source such as the speaker in the video conference system from the transmitting side together with the generated information such as its voice. The received position information is converted into position information on the receiving side according to the positional relationship between a plurality of information sources, and for example, sound is output from a speaker installed at a position having a positional relationship according to the positional information. As described above, the positional relationship between the information sources on the transmitting side is expressed on the receiving side, so the receiving side can easily recognize which of the multiple information sources on the transmitting side generated the information. And has an excellent effect of realizing smooth information exchange.

[Brief description of the drawings]

FIG. 1 is a principle diagram of the present invention.

FIG. 2 is a main part block diagram of the first embodiment of the present invention.

FIG. 3 is a main part block diagram of a second embodiment of the present invention.

FIG. 4 is a main part block diagram of a third embodiment of the present invention.

FIG. 5 is a main part block diagram of a fourth embodiment of the present invention.

FIG. 6 is a main part block diagram of a modification of the second and fourth embodiments of the present invention.

FIG. 7 is a main part block diagram of another modification of the second and fourth embodiments of the present invention.

FIG. 8 is a main part block diagram of a fifth embodiment of the present invention.

FIG. 9 is a main part block diagram of a sixth embodiment of the present invention.

FIG. 10 is a conceptual diagram of a conversion rule.

FIG. 11 is a conceptual diagram of a positional relationship reconstruction and a positional relationship expression.

FIG. 12 is a flowchart of a processing procedure for reconstructing a positional relationship.

FIG. 13 is a flowchart of a processing procedure of a positional relationship expression.

[Explanation of symbols]

 Reference Signs List 10 transmitting device 11 position detecting means 111 sound source position detecting means 12 information input means 121 voice input means 13 imaging means 14 imaging control means 20 receiving apparatus 21 conversion rule 22 positional relationship reconstructing means 23 positional relationship expressing means 231 voice data 232 voice output Means 233 Sound output control means 234 Three-dimensional sound output means 235 Image data 236 Display means 237 Display control means OUTn Sound output means

Claims (13)

[Claims] 1. A transmitting apparatus for transmitting, from among a plurality of information sources capable of generating information, position information for specifying the position of the information source that generated the information, and transmitting information generated by the information source. And receiving means for receiving the information and the position information from the transmitting device, the position information of each of the plurality of information sources,
Storage means for storing a conversion rule for converting each of the plurality of information sources into position information on the receiving side in accordance with the positional relationship between the information sources; A receiving device having a converting means for converting to information, an information output means, and a positional relationship expressing means for expressing, using the information output means, a positional relationship of an information generating source that has generated information based on the converted positional information on the receiving side; An information communication system comprising: 2. The information processing device according to claim 1, wherein the positional relationship expressing means stores information output means arranged at a plurality of positions, and correspondence between a plurality of information generating sources of the transmitting apparatus and a plurality of information outputting means of the receiving apparatus. 2. The information communication system according to claim 1, further comprising: output control means for outputting, from an information output means arranged at a position corresponding to the information generation source which generated the information, specific information for specifying the information generation source. . 3. An information output unit arranged at a position corresponding to position information on a receiving side of the information generating source and capable of outputting the received information,
2. The information communication system according to claim 1, further comprising: an output control unit that outputs the received information. 4. The means for expressing positional relationship, wherein means for storing voices respectively specifying a plurality of information sources included in the transmitting device, and three-dimensional processing of the voices specifying the information sources which generated the information, 2. The information communication system according to claim 1, further comprising: three-dimensional sound output means for forming a sound image at a three-dimensional position corresponding to position information on the receiving side of the information source. 5. The tertiary information, wherein the information is audio, and the positional relationship expressing means performs three-dimensional processing on the audio to form a sound image at a three-dimensional position corresponding to positional information on a receiving side of the information generating source. 2. The information communication system according to claim 1, further comprising an original audio output unit. 6. The information processing apparatus according to claim 1, wherein the positional relationship expressing means includes display means arranged at a plurality of positions, means for storing images respectively specifying a plurality of information sources included in the transmitting device, and a receiving side of the information generating sources. The information communication system according to any one of claims 2 to 5, further comprising: display control means for displaying an image specifying the information source on a display means arranged at a position corresponding to the position information. 7. The display device according to claim 6, wherein the positional relationship expression means includes: a display means;
Means for storing an image specifying each of the plurality of information sources included in the transmitting device, and an image for specifying the information source at a display position of the display unit corresponding to the position information on the receiving side of the information source. The information communication system according to any one of claims 2 to 5, further comprising: display control means for displaying the information. 8. The information processing apparatus according to claim 1, wherein the transmitting device includes a plurality of image capturing units capable of capturing a plurality of information sources, and an image capturing unit capable of capturing an information source that has generated information. The transmitting device transmits an image obtained by photographing the information generation source together with position information specifying the position of the information generation source, and the positional relationship expression unit of the reception device includes a plurality of And display control means for displaying an image of the information source on the display means arranged at a position corresponding to the position information on the receiving side of the information source. The information communication system according to claim 2, further comprising: 9. The information processing apparatus according to claim 1, wherein the transmitting device includes a plurality of image capturing units each capable of capturing a plurality of information sources, and an image capturing unit capable of capturing an information source that has generated information. The transmitting device transmits an image obtained by photographing the information source together with position information specifying the position of the information source, and the positional relationship expressing unit of the receiving device displays the image. And a display control means for displaying an image of the information source at a display position of the display means corresponding to the position information on the receiving side of the information source. Or the information communication system according to claim 7. 10. The transmitting apparatus further comprises an imaging unit that captures an image of the information source while tracking the information source. The transmitting apparatus specifies an image of the information source that generated the information, and specifies the position of the information source. The positional relationship expressing means of the receiving device is transmitted together with the position information, and the display means arranged at a plurality of positions and the display means arranged at a position corresponding to the position information on the receiving side of the information source. The information communication system according to any one of claims 2 to 6, further comprising: display control means for displaying an image obtained by capturing the information source. 11. The transmitting device includes an image capturing unit that captures an image of the information generating source while tracking the information generating source. The transmitting device specifies an image of the information generating source that has generated the information and identifies the position of the information generating source. An image obtained by photographing the information source at a display position corresponding to the position information on the receiving side of the information source on the display means, The information communication system according to any one of claims 2 to 5, or 7 or 9, further comprising: display control means for displaying the information. 12. The information processing apparatus according to claim 1, wherein the transmitting device includes: a plurality of image capturing units capable of capturing the information generated by the information generating sources; and an image capturing unit capable of capturing the information generated by the information generating source. A photographing control unit for photographing the generation source, wherein the transmission device transmits an image obtained by photographing the information generation source together with position information for specifying the position of the information generation source, and the positional relationship expression unit of the reception device Display means arranged at a plurality of positions, and display control means for displaying an image of the information source on a display means arranged at a position corresponding to the position information on the receiving side of the information source. The information communication system according to any one of claims 2 to 6, or claim 8 or claim 10, comprising: 13. The information processing apparatus according to claim 1, wherein the transmitting device includes a plurality of image capturing units capable of capturing and tracking the plurality of information sources, and an image capturing unit capable of capturing the information source that generated the information. A photographing control unit for photographing the generation source, wherein the transmission device transmits an image obtained by photographing the information generation source together with position information for specifying the position of the information generation source, and the positional relationship expression unit of the reception device And display means for displaying an image of the information source at a display position of the display means in accordance with position information on the receiving side of the information source. 12. The information communication system according to claim 7, or claim 9 or claim 9 or claim 11.