JPH09200715A - Equipment, method and system for communication - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide equipment, method and system for communication with which an image watching an object on the side of communicating party from any desired direction can be easily provided and speaking having presence is enabled in simple configuration. SOLUTION: On the side of equipment, a viewpoint position measuring part 13 measures the viewpoint position information of an operator from image information provided at an image input part 11 through threshold value processing, etc., concerning an I component and this measured information is transmitted through an encoder part 15. At the communication equipment on the side where that viewpoint position information is received through a decoder part 18, on the other hand, a transmission image selection part 14 specifies any camera suitable for that viewpoint position out of cameras at the image input part 11. Then, only the image information provided by that specified camera is transmitted through the encoder part 15 to the side of that equipment.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a communication device such as a videophone, a communication method, and a communication system for carrying out a conversation by receiving an image of the other party.

[0002]

2. Description of the Related Art A conventional communication system is generally constructed by connecting a plurality of communication devices such as videophones to each other. In a conventional communication system, for example, each communication device acquires video / audio information of the operator side by a camera / microphone, transmits this information to the communication device of the other side, and the information received by the communication device of the other side is acquired. By outputting to a monitor, it is possible to talk while watching the video.

[0003]

However, in the above-described conventional communication system, the communication direction of the camera (hereinafter referred to as the "source device") on the side transmitting the image information (hereinafter referred to as "source device") has a single shooting direction and a single shooting viewpoint. Since it is normal, the operator of the communication device on the side where the image information is transmitted (hereinafter referred to as “destination device”) can see only a fixed image, and the object on the transmission source device side is desired. An image viewed from the direction could not be easily obtained.

If the camera of the source device is controlled to be manually changed, the operator of the destination device can change the shooting direction to display an image from any direction. Obtainable.

However, it is very difficult to control the orientation of the camera of the transmission source device during a call, which causes many inconveniences.

As described above, there is room for improvement when the operator of the transmission destination device makes a more realistic call with the transmission source device side.

The present invention has been made to solve the above-mentioned problems of the prior art, and an object thereof is to easily obtain an image of a subject on the other end of communication from a desired direction and to have a simple structure. In order to provide a communication device, a communication method and a communication system that enable a realistic call.

[0008]

In order to achieve the above object, a communication device according to claim 1 of the present invention has a position information acquisition means for acquiring position information of an operator of a transmission destination device and a plurality of different subjects. A photographing means capable of photographing from a viewpoint, an image selecting means for selecting a specific image from images of a subject from a plurality of different viewpoints obtained by the photographing means, based on the acquired position information, and the selected And a transmission unit that transmits information related to a specific image to the transmission destination device.

In order to achieve the same object, the communication device according to a second aspect of the present invention has the configuration according to the first aspect, wherein the position information acquisition means is obtained by photographing the operator of the destination device. It is characterized in that the position information of the operator is acquired based on predetermined information related to the image of the operator.

In order to achieve the same object, the communication device according to claim 3 of the present invention is the structure according to claim 2, wherein the predetermined information is color information and a difference between images obtained with a time lag from each other. And / or information related to.

In order to achieve the same object, the communication device according to claim 4 of the present invention is the structure according to claim 1, wherein the position information acquiring means acquires the position information of the operator by a three-dimensional position measuring device. It is characterized by doing.

In order to achieve the same object, the communication device according to claim 5 of the present invention is the structure according to claim 4, wherein the three-dimensional position measuring device is the position of the antenna worn by the operator of the destination device. Is magnetically measured, and the antenna is attached to a voice input unit configured to be attachable by an operator of the transmission destination device.

In order to achieve the same object, the communication device according to claim 6 of the present invention is the structure according to any one of claims 1 to 5, wherein the image selecting means operates the destination device. The specific image is selected for the right eye and the left eye corresponding to each of the right eye and the left eye of the person.

In order to achieve the same object, the communication device according to claim 7 of the present invention is the structure according to any one of claims 1 to 6, wherein the voice information for acquiring voice information on the device side is obtained. An acquisition unit and a position information acquisition unit that acquires position information of the operator of the device side, the transmission unit, the acquired position information of the operator of the device side,
It is characterized in that the information on the selected specific image and the acquired audio information on the device side are collectively encoded and transmitted to the destination device.

In order to achieve the same object, a communication method according to claim 8 of the present invention is a position information acquisition step of acquiring position information of an operator of a transmission destination device, and photographing capable of photographing a subject from a plurality of different viewpoints. Step, an image selection step of selecting a specific image from images of the subject from a plurality of different viewpoints obtained by the photographing step based on the acquired positional information, and information related to the selected specific image Is transmitted to the device of the transmission destination.

In order to achieve the same object, the communication method according to a ninth aspect of the present invention is the configuration according to the eighth aspect, wherein the position information obtaining step is obtained by photographing the operator of the destination apparatus. It is characterized in that the position information of the operator is acquired based on predetermined information related to the image of the operator.

In order to achieve the same object, the communication method of claim 10 of the present invention is, in the structure of claim 9, wherein the predetermined information is color information and a difference between images obtained with a time lag from each other. And / or information related to.

In order to achieve the same object, in the communication method according to claim 11 of the present invention, in the structure according to claim 8, the position information acquisition step acquires the position information of the operator by a three-dimensional position measuring device. It is characterized by doing.

In order to achieve the same object, the communication method according to claim 12 of the present invention is the structure according to claim 11, wherein the three-dimensional position measuring device is the position of an antenna worn by an operator of the destination device. Is measured magnetically,
The antenna is attached to a voice input unit configured to be attachable to an operator of the transmission destination device.

In order to achieve the same object, the communication method according to claim 13 of the present invention is the configuration according to any one of claims 8 to 12, wherein the image selecting step is an operation of the transmission destination device. The specific image is selected for the right eye and the left eye corresponding to each of the right eye and the left eye of the person.

In order to achieve the same object, the communication method according to claim 14 of the present invention is the configuration according to any one of claims 8 to 13, wherein the voice information for acquiring the voice information on the device side. The acquisition step and the position information acquisition step of acquiring the position information of the operator of the device side, in the transmitting step, the acquired position information of the operator of the device side, the selected specific It is characterized in that the information related to the image and the acquired voice information on the device side are collectively encoded and transmitted to the destination device.

In order to achieve the same object, a communication system according to a fifteenth aspect of the present invention is a communication system in which a first communication device and a second communication device are communicably connected to each other, and the second communication device side Position information of the operator of the
Position information acquisition means acquired by the communication device, photographing means capable of photographing a subject including the operator on the side of the first communication device from a plurality of different viewpoints, and subject photographing from a plurality of different viewpoints obtained by the photographing means. An image selecting unit that selects a specific image from the images based on the acquired position information; and a transmitting unit that transmits information related to the selected specific image to the second communication device. Characterize.

[0023]

Embodiments of the present invention will be described below with reference to the drawings.

(First Embodiment) A communication apparatus and a communication system according to a first embodiment of the present invention will be described below with reference to FIGS.

FIG. 1 is a diagram showing a configuration of a communication device according to the present embodiment.

The communication device 1 includes a transmitter 16 and a receiver 11.
Broadly divided into 1.

The communication device 1 is connected to another communication device 2 having the same configuration to form a communication system. That is, the information transmitted to the transmission path 17 is received by the receiving unit (not shown) of the communication device 2, and the information transmitted from the communication device 2 is transmitted to the communication device 1 via the transmission path 20.
Is received by the receiving unit 111.

The transmission unit 16 is composed of an image input unit 11, a voice input unit 12, a viewpoint position measurement unit 13, a transmission image selection unit 14 and an encoding unit 15.

The image input unit 11 is a subject on the communication device 1 side, for example, a person who makes a call on the communication device 1 (hereinafter referred to as "operator").
Image is taken from multiple viewpoints, and the obtained image information is input. The input image information is output to the viewpoint position measuring unit 13 and the transmission image selection unit 14 connected to the image input unit 11.

The voice input unit 12 inputs voice information such as the voice of the operator, and the encoding unit 15 connected to the voice input unit 12.
Output to

The viewpoint position measuring unit 13 measures the position of the operator (for example, the position of the head) based on the image information input from the image input unit 11, and the encoding unit 15 connected to the viewpoint position measuring unit 13. The position information is output to (details will be described later).

The transmission image selection unit 14 selects the optimum image corresponding to the position of the communication partner on the communication device 2 side from the images obtained from the image input unit 11, and the information relating to the selected image is selected. Encoding unit 15 connected to transmission image selection unit 14
To the output (details will be described later).

The encoding unit 15 collectively encodes the voice information input from the voice input unit 12, the position information input from the viewpoint position measurement unit 13 and the image information input from the transmission image selection unit 14, and transmits the information. Send to road 17.

The receiving section 111 comprises a decoding section 18, an image output section 19 and an audio output section 110.

The decoding section 18 decodes the information sent from the communication device 2 side via the transmission path 20. The decoded position information of the communication partner is output to the transmission image selection unit 14 also connected to the decoding unit 18. The decoded image information is output to the image output unit 19 such as a display connected to the decoding unit 18, and the decoded audio information is output to the audio output unit 110 such as a speaker.

It should be noted that the viewpoint position measuring unit 13 is the communication device 1
It is an element required when the user wants to see the image on the communication device 2 side with a sense of reality, and the transmission image selection unit 14 is necessary when the device 2 side wants to see the image of the communication device 1 side with a sense of reality. Is an element.

FIG. 2 is a diagram showing the arrangement of cameras in the communication device according to the present embodiment. In this figure, the arrangement of the cameras of the communication device 2 which is the communication partner is shown, but the communication device 1 is also arranged in the same manner. In FIG. 1, FIG.
The same elements as are denoted by the same reference numerals.

On the side of the communication device 2, five cameras 23, 2
4, 25, 26 and 27 are arranged so as to face the head of the communication partner 21 at appropriate angular intervals.
The head position of the communication partner 21 is set in advance as an optimum position for performing communication operation.

In the conventional communication device, it is usual to provide only the central camera 25, and the operator 2 on the communication device 1 side is provided.
Even when 2 changes the viewpoint position with respect to the image output unit 19 from point A to point B, the image displayed on the image output unit 19 does not change. That is, the front image of the communication partner 21 obtained by the camera 25 was only seen.

In the present invention, a camera for taking a picture of the communication partner 21 from the side of the lick is added in advance, and an optimum image is selected and output according to the position of the operator 22.

The position information of the operator 22 obtained by the viewpoint position measuring unit 13 on the communication device 1 side is transmitted to the transmission image selection unit 14 of the communication device 2 and out of the five images obtained by the cameras 23 to 27. From the above, one image is selected according to the position of the operator 22 and is transmitted to the communication device 1 side. As a result, for example, when it is desired to see an image of the side of the right lick toward the communication partner 21, the image from the camera 23 or the camera 24 is output.

The greater the number of cameras 23 to 27, the better,
It is desirable to arrange them so that the range corresponding to the movable range of the viewpoint of the operator 22 can be covered.

Specifically, for example, in consideration of the fact that the proper angle at which the operator 22 views the image output unit 19 is within the range of 120 ° (60 ° on one side), this can be covered, that is, the communication partner. It is desirable to cover the range in which 21 can be seen from the left and right 60 ° with respect to the front.

At this time, even if the operator 22 moves his or her viewpoint, the line of sight normally looks at the direction of the display. Therefore, the cameras 23 to 27 should be arranged in a circular arc on the assumption that this is the case. You may

Also, instead of providing a plurality of cameras,
Two cameras may be allowed to move to the camera positions shown in FIG.

FIG. 3 is a flow chart of the image selection processing by the transmission image selection unit 14.

This processing is executed when the communication device 2 side wants to obtain an image of the communication device 1 side.

First, the transmission image selecting section 14 determines the communication partner 2
The viewpoint position information of No. 1 is acquired via the decoding unit 18 (step S31).

Next, the optimum camera number is calculated (step S32). Here, the acquisition of the position information and the calculation of the optimum camera number are performed as follows.

Assuming that the viewpoint position is measured using only the image captured by the central camera 25 on the communication device 2 side,
The shootable angle of is set to 120 °, for example. And
The image obtained by the camera 25 is divided into 5 parts by 24 ° to the left and right, and the divided images are numbered 1 to 5 in order from the right. The cameras 23 to 27 are also numbered 1 to 5 from the right.

Next, the viewpoint position measuring unit 13 of the communication device 2
Determines which of the divided images the communication partner 21 is best (largest) in the divided images, and transmits the determination result to the communication device 1 side as viewpoint position information. The transmission image selection unit 14 of the communication device 1 identifies a camera having a number corresponding to the image number. Therefore, for example, when the communication partner 21 has moved to the right of the camera 25 within the photographing range of the camera 25, the first camera 23 is specified.

Next, in step S33, only the image information obtained by the camera specified as described above is converted into digital information, which is output to the encoding unit 15 in step S34, and this processing ends.

By this processing, the camera that will provide the most suitable image for the communication partner 21 is specified, and
The communication partner 21 can obtain image information from the camera.

FIG. 4 shows the viewpoint position measuring unit 13 on the communication device 1 side.
8 is a flowchart of a position measurement process of the operator 22 according to the above.

This process is executed when the communication device 1 side wants to obtain an image of the communication device 2 side.

In the viewpoint position measurement of the operator 22 by this process, the head of the operator 22 is regarded as the viewpoint position, and a rough measuring method is adopted.

First, of the cameras constituting the image input unit 11, the image from the camera arranged in the center is input to the viewpoint position measuring unit 13 and converted into the YIQ display system by the NTSC (American Television System Committee). (Step S4
1). Here, it is utilized that the human skin color appears more strongly due to the I component of YIQ.

Next, the I component is subjected to the binarization process by the threshold process, so that only the strong I component is left (step S42).

By removing the isolated points,
Pixels left unresolved that are isolated and have low reliability are excluded (step S43).

Next, the position of the center of gravity is calculated (step S4).
4) The position of the center of gravity is regarded as the head position of the operator 22 in the image.

Next, the obtained viewpoint position information is decoded by the decoding unit 1.
5 (step S45), and this processing ends.

Here, it is sufficient for the communication device 2 which is the communication partner side to know which of the cameras on the communication device 1 side is the most suitable image. Therefore, FIG.
Instead of the processing according to, the numerical value relative to the image width may be output as the viewpoint position information. For example,
A value obtained by dividing the x component of the barycentric coordinate by the horizontal size of the image may be used as the viewpoint position information.

By this processing, the direction in which the operator 22 of the communication device 1 wants to see the subject on the communication device 2 side can be notified to the communication device 2 side.

Moreover, since the direction is determined based on the image information obtained by the image input unit 11, it can be easily constructed without providing a special sensor.

FIG. 5 is a diagram showing the concept of information processing by the encoder 15.

The encoder 15 is generally capable of transmitting additional information in addition to video and audio information. Therefore, the encoding unit 15 transmits the obtained viewpoint position information to the communication device 2 as one of the additional information.

The image information obtained by the image input unit 11 is H.264 in ITU-T (Telecommunication Standardization Division of International Telecommunication Union). Image compression processing such as 261 is performed.

The voice information obtained by the voice input unit 12 includes G. Data compression processing such as 728 is performed.

The compressed image information and audio information are collectively and collectively ITU with a plurality of information such as viewpoint position information of the communication partner 21 obtained from the transmission image selection unit 14.
-H. Multiplexing is performed by processing such as 221. Then, this multi-coded information is transmitted to the transmission path 17
Is transmitted to the communication device 2 via.

Note that the collective multiple encoding of the viewpoint position information may be performed with either one of the image information and the audio information.

FIG. 6 is a diagram showing the concept of information processing by the decoding unit 18.

The decoding unit 18 receives the multi-coded information from the communication device 2.

The received information is separated into voice information, image information and position information of the communication partner 21, and is decoded.

Audio information and image information are respectively ITU-T
In H .; 261 and G.H. The data is decoded by the processing of 728 and output to the audio output unit 110 and the image output unit 19, respectively.

The position information of the decrypted communication partner 21 is
It is output to the transmission image selection unit 14 in the transmission unit 16.

As shown in FIGS. 5 and 6, information is transmitted and received using the encoding unit and the decoding unit that are generally provided in the conventional communication apparatus, so that the configuration can be simplified.

The series of processes described above are mutually performed between the communication device 1 and the communication device 2. An example of the processing result is shown in FIG.

In the figure, the operator 22 of the lower communication device 1
Shows a case where the communication partner 21 on the upper communication device 2 side is desired to be viewed from a desired direction.

When the operator moves to the position displaced rightward by the angle θ with respect to the center line of the image output unit 19, the camera 23 of the communication device 2 is selected as the camera corresponding to the position.

The camera 23 is arranged at a position where the angle from the center line of the communication partner 21 is deviated by approximately θ.
The shift angle of 3 is selected because it is the closest to the angle θ.

The image of the communication partner 21 obtained by the camera 23 is sent to the communication apparatus 1 side, and the image output unit 19 shows a diagonally right side profile toward the communication partner 21, as shown in the lower right diagram. Will be done.

As described above, according to the communication device 1, it is possible to easily obtain an image of the subject on the communication device 2 side as viewed from a desired direction simply by changing the viewpoint position of the operator 22 itself. Therefore, it is possible to make a realistic call.

Further, since the image information obtained by the image input unit 11 is used for the position measurement of the operator 22, no special sensor is required and the structure can be simplified.

Further, since the image information, the audio information and the position information are collectively multi-coded and transmitted, the conventional coding unit and decoding unit can be used, and the structure can be simplified.

(Second Embodiment) A communication apparatus and a communication system according to the second embodiment of the present invention will be described below.

The configuration of the communication apparatus according to this embodiment is basically the same as that of the communication apparatus according to the first embodiment, and only the method of the position measurement processing of the operator 22 by the viewpoint position measurement unit 13 is different. Therefore, FIG. 8 is used instead of FIG.
Only different points will be described. The same reference numerals are used for the same elements as in the first embodiment.

Further, in the communication system according to the present embodiment, the communication device on the communication partner side has the same configuration as the communication device according to the present embodiment.

FIG. 8 is a flow chart of the position measuring process of the operator 22 by the viewpoint position measuring unit 13 according to this embodiment.

In this processing, so-called moving image information is used. That is, the information obtained from the continuity of images obtained in time series is added to the processing according to the first embodiment.

First, step S81, step S82,
In step S83, the same processing as step S41, step S42, and step S43 in FIG.
Is performed on the moving image obtained by. Then, in parallel with this, the processes of steps S84 and S85 are performed.

In step S84, difference processing is performed on the previous frame and the current frame obtained with a time difference from each other. That is, since the obtained moving image is obtained by shooting with a fixed camera, the background portion of the image does not move normally and is erased by the difference processing between the previous frame and the current frame. On the other hand, the moving operator 22
The image part of appears as a part where the difference between the previous frame and the current frame is strong.

Next, in step S85, threshold processing is performed on the image information remaining after the difference processing to obtain the movable area.

Then, steps S81, S82, S83
The logical product of the skin color area obtained in step S4 and the movable area obtained in steps S84 and S85 is calculated (step S8).
6). This is because the skin-colored area and the movable area are considered to represent the head of the operator 22.

Next, step S44 and step S in FIG.
The same processing as 45 is performed in steps S87 and S88, and this processing ends.

According to the communication device or the communication system according to the present embodiment, the same effect as in the first embodiment can be obtained, and further, the position measurement information of the operator 22 becomes high, so that the presence of a call can be enhanced. You can increase more.

In this processing, color information may not be used, and only moving image information may be used.

(Third Embodiment) A communication apparatus and a communication system according to the third embodiment of the present invention will be described below.

Also in this embodiment, the communication devices have the same configuration and are connected to each other to form a communication system.

The communication apparatus according to this embodiment is basically the same in configuration as the communication apparatus according to the first embodiment, but differs in the following points in order to obtain a stereoscopic image.

First, as shown in FIG. 9, a large number (for example, 15 or more) of cameras for measuring the viewpoint position of the communication partner 21 are arranged at very close intervals. Moreover, it is desirable that each of the arranged cameras be arranged so that the other cameras are positioned at an interval substantially the same as the interval between the human eyes.

Further, the image output section 19 is not a mere display but a head mounted display capable of stereoscopic display, stereo glasses or a lenticular display.

With this configuration, image information processing is performed for each of the left and right eyes.

Specifically, by correcting the displacement between the center of the human head and the positions of both eyes based on the viewpoint position information of the communication partner 21 obtained by the viewpoint position measuring unit 13, for the left and right eyes. Identify each camera that will provide the best image. Then, the image information obtained from the two specified cameras is subjected to the same processing as in the first or second embodiment, and then displayed on the left-eye display unit and the right-eye display unit of the image output unit 19, respectively.

As a result, it is possible to obtain a stereoscopic image of the communication partner 21, etc. from the direction desired by the operator 22.

In the first, second, and third embodiments, the cameras 23 to 27 are arranged in a line in the left-right direction, but by arranging the cameras in the up-down direction and the diagonal direction, a more realistic feeling can be obtained. You can talk.

In the first, second and third embodiments, it is assumed that the communication devices forming the communication system have the same structure, but the present invention is not limited to this. For example,
It is assumed that the side that wants to obtain a realistic image is the communication device 1 and the side that is the transmission source of the subject image is the communication device 2. The communication device 2 may include only the transmission unit 16, the communication device 1 may include only the reception unit 111, and a unit for notifying the viewpoint position information of the operator 22 to the communication device 2 may be separately provided.

By doing so, the object on the side of the communication device 2 can be seen from the desired direction on the side of the communication device 1 although it is a one-way traffic.

The method of measuring the viewpoint position of the communication partner 21 or the operator 22 is not limited to the method described in the first, second and third embodiments.

That is, in the communication system, it is sufficient if the optimum camera can be grasped by either the communication device or an element in the communication device system. It is sufficient to obtain a one-way image if at least a means for identifying a different camera is provided.

For example, it may be configured such that the information for specifying the camera or the information related to the specified result is received from the communication device of the image transmission source, and the image from the specified camera can be obtained. .

Further, in the viewpoint position measurement, a three-dimensional position sensor may be used to directly measure the (x, y, z) coordinates of the measuring object. For this measurement, for example, a device called Fast Rack manufactured by Pohimas, USA can be used. This device has a predetermined antenna mounted on a measurement target and can measure a three-dimensional position of the measurement target by using a magnetic field.

There is a case where a microphone or the like for inputting the voice of a person who makes a call is directly attached to the body of the caller. By attaching the three-dimensional position sensor to this microphone, It is possible to realize a low-cost communication device with a simple structure that does not hinder a call.

Besides, in the viewpoint position measurement, the position of the measuring object may be grasped by using the angle. Alternatively, instead of setting all of the shooting target points of the cameras 23 to 25 as the center points of the measurement target, the points may be shifted before or after the measurement target. By doing this,
If the measurement target moves left and right, the position of the measurement target in the image differs for each camera. Therefore, by using this, it is possible to grasp the viewpoint position of the measurement target from the camera that captures the measurement target at the center.

[0114]

As described above, according to the first aspect of the present invention.
According to the communication apparatus according to claim 8 or the communication method according to claim 8, the position information of the operator of the transmission destination apparatus is acquired, the subject is photographed from a plurality of different viewpoints, and the obtained subject from a plurality of different viewpoints is acquired. Since a specific image is selected from the images based on the acquired position information and the information related to the selected specific image is transmitted to the transmission destination device, the operator of the transmission destination device is An image of the subject of the device viewed from a desired direction can be easily obtained, and a call with a realistic sensation can be performed with a simple configuration.

According to the communication device of the second aspect of the present invention or the communication method of the ninth aspect, based on the predetermined information relating to the image of the operator obtained by photographing the operator of the destination apparatus. Since the position information of the operator is acquired by the above, a special sensor is not required and the configuration can be simplified.

According to the communication device of the third aspect of the present invention or the communication method of the tenth aspect of the present invention, the operation is performed based on at least one of the color information and the information regarding the difference between the images obtained with a time lag from each other. Location information of the person is acquired.

According to the communication device of the fourth aspect of the present invention or the communication method of the eleventh aspect, the position information of the operator is acquired by the three-dimensional position measuring device.

According to the communication device of the fifth aspect of the present invention or the communication method of the twelfth aspect of the invention, from the position of the antenna attached to the voice input means that the operator of the destination device can wear. Since the position of the operator of the transmission destination device is magnetically measured, it is possible to improve usability with a simple configuration without hindering the call.

According to the communication device of the sixth aspect of the present invention or the communication method of the thirteenth aspect, the specific images are assigned to the right eye and the left eye of the operator of the transmission destination device, respectively. For each of the three-dimensional images, the operator of the transmission destination device can easily obtain an image of the subject of the transmission source device viewed from a desired direction even with a stereoscopic image. A certain call becomes possible.

According to the communication device of claim 7 or the communication method of claim 14, the voice information of the device side is acquired, the position information of the operator of the device side is acquired, and the acquisition is performed. The positional information of the operator on the device side is
It is collectively encoded together with the information related to the selected specific image and the acquired audio information of the device side,
Since the data is transmitted to the destination device, the encoding unit and the decoding unit of the conventional communication device can be used, and the configuration can be simplified.

According to the fifteenth aspect of the communication system of the present invention, the position information of the operator on the second communication device side is the second information.
A subject including the operator on the side of the first communication device is captured from a plurality of different viewpoints by the communication device, and a specific image is obtained from the obtained images of the subject from the plurality of different viewpoints. Since information related to the specific image selected based on the position information is transmitted to the second communication device, it is possible to easily obtain an image of the subject viewed from a desired direction between the devices. It is possible, and it becomes possible to make a two-way call with a realistic feeling with a simple structure.

[Brief description of drawings]

FIG. 1 is a configuration diagram of a communication device according to a first embodiment of the present invention.

FIG. 2 is a diagram showing an arrangement of cameras in the communication device according to the embodiment.

FIG. 3 is a flowchart of image selection processing by a transmission image selection unit 14 according to the same embodiment.

FIG. 4 is a flowchart of an operator position information measuring process by the viewpoint position measuring unit according to the embodiment.

FIG. 5 is a diagram showing a concept of information processing by an encoding unit 15 according to the same embodiment.

FIG. 6 is a diagram showing a concept of information processing by a decoding unit 18 according to the same embodiment.

FIG. 7 is a diagram showing an example of a processing result according to the same embodiment.

FIG. 8 is a flowchart of a viewpoint position measuring process according to the second embodiment of the present invention.

FIG. 9 is a diagram showing an arrangement of cameras according to a third embodiment of the present invention.

[Explanation of symbols]

 11 image input unit 12 audio input unit 13 viewpoint position measurement unit 14 transmission image selection unit 15 encoding unit 16 transmission unit 18 decoding unit 19 image output unit 23 camera 24 camera 25 camera 26 camera 27 camera 111 receiving unit

Claims (15)

[Claims] 1. A position information acquisition unit for acquiring position information of an operator of a transmission destination apparatus, a photographing unit capable of photographing a subject from a plurality of different viewpoints, and a subject from a plurality of different viewpoints obtained by the photographing unit. Image selecting means for selecting a specific image from among the images based on the acquired position information, and transmitting means for transmitting information relating to the selected specific image to the destination device. Characterized communication device. 2. The position information acquisition means acquires the position information of the operator based on predetermined information related to an image of the operator obtained by photographing the operator of the transmission destination device. The communication device according to claim 1. 3. The communication device according to claim 2, wherein the predetermined information is at least one of color information and information regarding a difference between images obtained with a time difference from each other. 4. The communication device according to claim 1, wherein the position information acquisition means acquires the position information of the operator by a three-dimensional position measuring device. 5. The three-dimensional position measuring device magnetically measures the position of an antenna worn by an operator of the destination device, and the antenna can be worn by the operator of the destination device. The communication device according to claim 4, wherein the communication device is attached to the constituted voice input means. 6. The image selecting means selects the specific image for the right eye and the left eye corresponding to each of the right eye and the left eye of the operator of the transmission destination device. 5. The communication device according to any one of 5 to 5. 7. The audio information acquisition means for acquiring the audio information of the device side, and the position information acquisition means for acquiring the position information of the operator of the device side, wherein the transmission means is the acquired. The position information of the operator on the device side, the information related to the selected specific image, and the acquired voice information on the device side are collectively encoded and transmitted to the destination device. The communication device according to any one of claims 1 to 6. 8. A position information acquisition step of acquiring position information of an operator of a transmission destination device, a photographing step of photographing a subject from a plurality of different viewpoints, and a subject from a plurality of different viewpoints obtained by the photographing step. An image selecting step of selecting a specific image from among the images based on the acquired position information, and a transmitting step of transmitting information related to the selected specific image to the destination device. Characterized communication method. 9. The position information acquisition step acquires the position information of the operator based on predetermined information relating to an image of the operator obtained by photographing the operator of the transmission destination device. The communication method according to claim 8. 10. The communication method according to claim 9, wherein the predetermined information is at least one of color information and information regarding a difference between images obtained with a time lag from each other. 11. The communication method according to claim 8, wherein in the position information acquisition step, the position information of the operator is acquired by a three-dimensional position measuring device. 12. The three-dimensional position measuring device magnetically measures the position of an antenna worn by the operator of the destination device, and the antenna can be worn by the operator of the destination device. The communication method according to claim 11, wherein the communication method is attached to the constituted voice input means. 13. The image selecting step, wherein the specific image is selected for the right eye and the left eye respectively corresponding to the right eye and the left eye of the operator of the transmission destination device. The communication method according to any one of 1 to 12. 14. The voice information acquisition step of acquiring voice information of the device side, and the position information acquisition step of obtaining position information of an operator of the device side, the transmitting step including the acquired information. Location information of the operator on the device side,
14. The information related to the selected specific image and the acquired voice information of the device side are collectively encoded and transmitted to the transmission destination device. The communication device according to 1. 15. A position in which the first communication device acquires position information of an operator on the side of the second communication device in a communication system configured to communicably connect the first communication device and the second communication device. An information acquisition unit, a photographing unit capable of photographing a subject including the operator on the side of the first communication device from a plurality of different viewpoints, and a specific one from the images of the subject from a plurality of different viewpoints obtained by the photographing unit. A communication system comprising: an image selecting unit that selects an image based on the acquired position information; and a transmitting unit that transmits information related to the selected specific image to the second communication device.