JP6541497B2 - Communication system, control method thereof and program - Google Patents

Description

  The present invention relates to a communication system for communicating with a remote place, a control method thereof, and a program.

  There is known a system for communicating with a remote party (remote place). Patent Document 1 discloses a teleconferencing system for holding a conference with a remote party. The system of Patent Document 1 includes a camera for capturing an image of a person, a projector for projecting an image, and a screen for projecting an image projected by the projector.

  In the system of Patent Document 1, while a person image captured by a camera provided in a conference room is projected onto a screen by a projector on the other side (remote place), a person captured by the camera on the other side is a conference room Projected onto the screen by the Further, Patent Document 1 shows that the reality of a conference is enhanced by projecting a person in a life-size size.

JP, 2008-191613, A

  In the system of Patent Document 1, a camera is used to capture a person from the front side. Therefore, the system of Patent Document 1 is considered to be effective when a plurality of persons face each other to communicate. However, assuming, for example, an office meeting as communication, the system of Patent Document 1 may not be able to take sufficient communication.

  In the case of a meeting, a person may move to the front of the screen to point to the material projected on the screen, or may make a new entry on the whiteboard. In such a case, it is desirable to image the person from the back side in order to convey the person's action (pointing and new entry) to the remote location. However, in the case of the system of patent document 1, imaging a person from the back side is not assumed.

  Based on this, in addition to the front camera for imaging a person from the front side, it is considered to further use a rear camera for imaging a person from the back side. However, when the user (for example, a participant in a conference) is manually switched which of a person image captured by the front camera and a person image captured by the rear camera is to be projected to a remote location, communication stagnates each time. Become. This is a factor that impedes smooth communication.

  Therefore, in the present invention, it is an object of the present invention to provide a mechanism capable of automatically switching between a person image picked up by a front camera and a person image picked up by a rear camera on a remote place without making the user conscious. I assume.

  In order to solve the problems described above, a communication system provided by the present invention comprises: first projection means for projecting an image on a first projection plane; and a person located in front of the first projection plane. A first imaging unit for imaging from the side of the projection plane of 1, a second imaging unit for imaging the person from the opposite side of the first projection plane with respect to the person, and a projection on the second projection plane Selection means for selecting any one of a person image picked up by the first image pickup means and a person image picked up by the second image pickup means as an image based on the position of the person, and the selection means And second projection means for projecting the person image selected by the second projection plane onto the second projection plane, and the person image projected on the second projection plane by the second projection Is characterized in that

  Further, a communication system provided by the present invention is a communication system for communicating with a remote place, which is a first projection means for projecting an image on a projection plane, and a person located in front of the projection plane. A first imaging unit configured to capture an image from the projection surface side, a second imaging unit configured to capture the person from the opposite side of the projection surface with respect to the person, and a person image captured by the first imaging unit; A selection unit that selects any one of the human images captured by the second imaging unit based on the position of the person; and a processing unit that performs a process of making the human image selected by the selection unit transparent. And transmitting means for transmitting the person image on which the transparency processing has been performed to the remote location.

  According to the present invention, it is possible to automatically switch which of a person image captured by the front camera and a person image captured by the rear camera are to be projected to a remote place, thereby promoting smooth communication.

It is a figure showing composition of a communication system. It is a figure which shows a mode that it is communicating. It is a figure which shows a mode that it is communicating. It is a figure which shows the hardware constitutions of a communication system. It is a figure explaining switching of a back person image and a front person image. It is a figure explaining the person image projected on the screen of a remote place. It is a flowchart which shows the process which a control server performs. It is a flowchart which shows the process which the control server of a remote place performs.

  Hereinafter, the best mode for carrying out the present invention will be described using the drawings. The following embodiments do not limit the invention according to the claims, and all combinations of the features described in the embodiments are not necessarily essential to the solution means of the invention.

(Embodiment 1)
FIG. 1 is a cross-sectional view of a communication system to which the present invention is applied. By using this communication system, it is possible to communicate between the office 1 (for example, the head office) and the office 2 (for example, the branch office). Although two offices are taken as an example here, a configuration in which communication between three or more offices is possible may be employed.

  In addition, each office described here may be separated to take several hours to move, or may be another conference room provided in the same building. That is, the expression "remote" indicates that the physical space is different, and does not define the physical distance or the length of time taken for movement.

  The office 1 shown in FIG. 1A is provided with a projector 101, a screen 102, a front camera 103, and a rear camera 104. The projector 101 is a projection device that projects an image captured in another office onto the screen 102. In the case of the present embodiment, the images captured by the front camera 103 and the rear camera 104 and the images projected onto the screen 102 are assumed to be moving images, but may be still images.

  The projector 101 superimposes the conference material and the person image of the remote place (for example, the office 2) and projects the superimposed image on the screen 102. In the present embodiment, a configuration in which projection is performed on the screen 102 using a single projector will be described. However, a plurality of projectors may be provided, and different projectors may project the conference material and the person image at a remote place.

  The screen 102 is a projection plane on which an image projected by the projector 101 is projected. The screen 102 may be temporarily installed when communicating with another office, or the wall of the office may double as the screen 102. Further, although an example in which a projector and a screen are used as means for displaying an image is shown in the present embodiment, the image may be displayed using a large liquid crystal display.

  The front camera 103 is an imaging device for imaging the person 105, and is embedded in the screen 102. The front camera 103 is a camera for capturing an image of the front of the person 105 standing in front of the screen 102 from the side of the screen 102 which is the projection plane side. The front camera 103 is installed at the position shown in FIG. 1A so that the front of the person 105 can be imaged when the person 105 faces the screen 102.

  The rear camera 104 is an imaging device for imaging the person 105. The rear camera 104 is a camera for capturing an image displayed on the back of the person 105 standing in front of the screen 102 or on the screen 102. The rear camera 104 is at the position shown in FIG. 1A (the opposite side of the screen 102 with respect to the person 105) so that the back (back side) of the person 105 can be imaged when the person 105 faces the screen 102. Installed in

  The front camera 103 includes a distance sensor for detecting the distance to the subject. The image obtained by the front camera 103 includes a color image consisting of RGB 8-bit 3-channel information and a distance image consisting of 8-bit 1-channel information. The front camera 103 can measure the distance between the screen 102 and the person 105 by using the distance image.

  Further, as shown in FIG. 1B, the office 2 in which the person 115 is located is also equipped with the same facilities as the office 1 (projector 111, screen 112, front camera 113, rear camera 114).

  FIG. 2A is an external view of the communication system, and shows that the person 105 in the office 1 communicates with the person 115 in the office 2. On the screen 102, a person 115 captured by the front camera 113 of the office 2 and the conference material 200 are projected.

  The office 1 is provided with a digitizer comprising a transmitter 201a and a receiver 201b. The digitizer is a detection device for detecting the user's action on the screen 102. When the infrared light projected by the transmitter 201a is blocked by a part of the body of the person 105, a pointing rod held by the person 105, or the like, the digitizer outputs coordinates indicating the position. Although the transmitter 201 a and the receiver 201 b are disposed on the left and right of the screen 102 here, they may be disposed on the top and bottom of the screen 102. Further, the method of detecting the user's operation is not limited to the digitizer, and the screen 102 may be provided with a touch panel function to detect the position where the screen 102 is pressed.

  FIG. 2B shows the state of the office 2. On the screen 112 of the office 2, a person 105 captured by the front camera 103 of the office 1 and the conference material 210 are projected. Similarly to the office 1, the office 2 is also provided with a digitizer including a transmitter 211a and a receiver 211b.

  As described above, as shown in FIG. 2, a remote person is projected at each of the office 1 and the office 2. Therefore, when the person 105 and the person 115 are examined, it is possible to obtain a feeling that the two face each other in the same conference room and communicate.

  In the case of a meeting, there is a case where a user (meeting participant) approaches the projected meeting material and communicates while pointing the meeting material with a finger or a pointer. In such a case, even if an image of a person captured by the front camera is projected to a remote place, it can not be grasped where in the conference material it points to the user of the remote place. Therefore, the present embodiment is characterized in that when the user approaches the screen, the image projected on the remote place is switched from the person image captured by the front camera to the person image captured by the rear camera. In the following description, a person image captured by the front camera may be referred to as a front person image, and a person image captured by the rear camera may be referred to as a back person image.

  A process of switching an image to be projected on a remote place from a front person image to a back person image will be described in detail with reference to FIG. FIG. 3A shows that, in the office 1, the person 105 approaches the screen 102 and points to the meeting material with the pointer. Compared to the case of FIG. 2A, the person 105 is located closer to the screen 102.

  In the office 2, as shown in FIG. 3B, the projected image is switched from the front person image of the person 105 to the back person image. Thereby, the person 115 of the office 2 can grasp where in the meeting material the person 105 points with the pointer. In addition, a process of making transparent on the back person image of the person 105 projected in the office 2 is executed. Therefore, in the case of the person 115, even if the back person image of the person 105 and the conference material are projected in an overlapping manner, it is possible to grasp what the content of the overlapping part is.

  Next, the hardware configuration of the communication system will be described with reference to FIG. Although not shown in FIGS. 1 to 3, the office 1 is provided with a control server 401. The CPU 402 included in the control server 401 reads out the control program stored in the ROM 404 and controls each device provided in the office 1. The RAM 403 is used as a temporary storage area such as a main memory of the CPU 402 and a work area. In the office 1, one CPU 402 executes each process shown in the flowchart to be described later using one memory (RAM 403), but another mode may be used. For example, CPUs may be individually provided for each camera, projector, and digitizer, or a plurality of CPUs, a plurality of RAMs, or HDDs or SSDs may be cooperated to execute each processing. it can. Further, part of the processing described later may be performed using a hardware circuit such as an application specific integrated circuit (ASIC). The HDD 405 is used as a storage medium for storing various data.

  A network 400 is a network connecting the offices. The type of the network 400 is not limited, and can be appropriately selected according to the environment, such as wired, wireless, WAN, LAN, public line, and dedicated line. The network I / F 410 is an interface for connecting the office 1 to the network 400.

  Although not shown in FIGS. 1 to 3, each office is provided with a microphone and a speaker. The words uttered by the person in the office are converted into voice signals by the microphone and output from the remote speaker. The office 1 is provided with a microphone 411 and a speaker 412, and an audio I / F 407 is an interface for controlling the input of audio by the microphone 411 and the output of audio by the speaker 412.

  The projector I / F 408 is an interface for controlling the projection of an image by the projector 101. In the present embodiment, a single projector is used to project an image on a screen. However, when the width of the screen is large, a plurality of projectors may be used to project a screen.

  The digitizer I / F 409 is an interface for controlling the detection of the user's operation by the digitizer comprising the transmitter 201a and the receiver 201b. The camera I / F 406 is an interface for controlling imaging by the front camera 103 and the rear camera 104.

  Also, the office 2 has the same hardware configuration as the office 1. The hardware of the office 2 is the same as the hardware of the office 1, so the description thereof is omitted.

  Next, the process of switching the back person image and the front person image will be described in more detail with reference to FIGS. 5 and 6. FIG. 5 shows the positional relationship between the screen 102 and the person 105 when the office 1 is viewed from above (the ceiling side). The front camera 103 is embedded in the screen 102. Therefore, the distance between the front camera 103 and the person 105 measured by the front camera 103 corresponds to the distance between the screen 102 and the person 105. The distances D1, D2, D3 and D4 in FIG. 5 are previously defined as threshold values, and are stored in the HDD 405 of the control server 401 and the HDD 425 of the control server 421.

  When the position of the person 105 is the position range A (distance D3 <distance between the front camera 103 and the person 105 ≦ distance D4), the control server 401 of the office 1 transmits the front person image of the person 105 to the office 2 Do. In addition, the transparency of the front person image of the person 105 is 0%, that is, the transparency processing is not performed and the image is transmitted to the office 2. In the office 2, the projection result in FIG. 6 (A) is obtained. The image projected on the screen 112 of the office 2 is a front person image of the person 105. If the person 115 is considered, it is possible to face and communicate with the person 105.

  When the position of the person 105 is the position range B (distance D2 ≦ distance between the front camera 103 and the person 105 ≦ distance D3), the control server 401 of the office 1 transmits the front person image of the person 105 to the office 2 Do. In addition, the front person image of the person 105 is transmitted to the office 2 after the transparency processing is executed with the transparency determined based on the following formula. In the office 2, the projection result of FIG. 6 (B) is obtained. Unlike FIG. 6 (A), the front person image in FIG. 6 (B) is subjected to a transparency processing. When the position of the person 105 is in the position range B, as the person 105 approaches the screen 102, the transparency of the front person image of the person 105 projected on the office 2 increases.

L: Distance Between Front Camera and Person The position where the distance between the front camera 103 and the person 105 is the distance D2 is the switching position of the front person image and the rear person image. When the distance between the front camera 103 and the person 105 is the distance D2, the transparency of the front person image of the person 105 is 100%, that is, completely transparent. As a result, in the office 2, the projection result in FIG. 6 (C) is obtained.

  When the position of the person 105 is the position range C (distance D1 ≦ the distance between the front camera 103 and the person 105 <the distance D2), the control server 401 of the office 1 transmits the back person image of the person 105 to the office 2 Do. Unlike the case where the position of the person 105 is the position range A or the position range B, not the front person image but the back person image is transmitted to the office 2. This is because the person 105 is approaching the screen 102 and is expected to perform some action (for example, an action of pointing with a pointer) on the meeting material. In addition, since switching between the front person image and the back person image is automatically performed, the person 105 and the person 115 can communicate smoothly.

  When the position of the person 105 is in the position range C, the back person image of the person 105 is transmitted to the office 2 after being subjected to transparency processing with transparency determined based on the following formula. Although FIG. 5 shows an example in which the minimum transparency is 60 (%), the minimum transparency may have another value. In the office 2, the projection result in FIG. 6 (D) is obtained. Unlike FIGS. 6A and 6B, the back person image of the person 105 is projected on the screen 112 of the office 2. When the position of the person 105 is in the position range C, as the person 105 approaches the screen 102, the transparency of the back person image of the person 105 projected to the office 2 decreases.

L: The distance between the front camera and the person Minimum transparency: Transparency of the position range D Focusing on the switching position of the front person image and the back person image, the person image becomes completely transparent when the person 105 approaches the screen 102 Moment occurs. In the case of the person 115 in the office 2, the front person image of the person 105 gradually becomes transparent and disappears for a moment and switches to the back person image of the person 105, so that it can be recognized as a smooth image change.

  When the position of the person 105 is the position range D (the distance between the front camera 103 and the person 105 <the distance D1), the control server 401 of the office 1 transmits the back person image of the person 105 to the office 2. In addition, the transparency of the back person image of the person 105 is 60%. In the office 2, the projection result of FIG. 6 (E) is obtained. The image projected on the screen 112 of the office 2 is a front person image of the person 105. If the person 115 is used, the action of the person 105 on the meeting material can be grasped. In addition, the value of 60% of transparency is an example, and may be another value.

  Next, processing executed by the control server 401 of the office 1 will be described with reference to the flowchart of FIG. The flowchart of FIG. 7 shows a process in which the control server 401 of the office 1 selects one of the front person image and the back person image as an image to be transmitted to the office 2. Each step shown in the flowchart of FIG. 7 is processed by the CPU 402 loading a control program stored in a memory such as the ROM 404 into the RAM 403 and executing it.

  First, in step S701, the CPU 402 specifies the position of a person (in the case of the present embodiment, the person 105) in front of the screen 102. In the case of this embodiment, the front camera 103 includes a distance sensor, and the position of the person 105 is identified based on the distance between the front camera 103 and the person 105 measured by the front camera 103. The relationship between the distance between the front camera 103 and the person 105 and the specified position range is as described in FIG.

  Next, in step S702, the CPU 402 determines whether the front person image is to be used as an image to be transmitted to the office 2. If the position of the person 105 identified in step S701 is the position range A or the position range B, the CPU 402 determines to use the front person image. In other words, the CPU 402 selects the front person image as the image to be transmitted to the office 2. Then, the process proceeds to step S703.

  On the other hand, when the position of the person 105 identified in step S701 is the position range C or the position range D, the CPU 402 determines that the front person image is not used. In other words, the CPU 402 selects the back person image as the image to be transmitted to the office 2. Then, the process proceeds to step S 707.

  Next, step S703 will be described. In step S703, the CPU 402 extracts a human image from the image captured by the front camera 103. In the case of the present embodiment, the difference image between the background image prepared in advance (the image captured in advance by the front camera 103 when there is no person) and the latest captured image by the front camera 103 is acquired and acquired The difference image is a person image. Of course, the human image extraction method described here is an example, and other methods may be used.

  Next, in step S704, the CPU 402 determines the degree of transparency based on the position of the person 105 identified in step S701. The relationship between the position of the person and the degree of transparency is as described in FIG. Then, in step S705, the CPU 402 executes the transparency processing on the person image extracted in step S703 with the transparency determined in step S704.

  Next, in step S706, the CPU 402 transmits the front person image to the office 2. More specifically, the CPU 402 controls the network I / F 410 to transmit the front person image to the office 2. The front person image transmitted here is an image on which the transparency processing has been performed in step S705.

  Next, step S 707 will be described. In step S 707, the CPU 402 extracts a human image from the image captured by the rear camera 104. The method of extracting a person image from the captured image is the same as step S703.

  Next, in step S708, the CPU 402 determines the degree of transparency based on the position of the person 105 identified in step S701. The relationship between the position of the person and the degree of transparency is as described in FIG. Then, in step S709, the CPU 402 executes the transparency processing on the person image extracted in step S707 with the transparency determined in step S708.

  Next, in step S710, the CPU 402 transmits the back person image to the office 2. More specifically, the CPU 402 controls the network I / F 410 to transmit the back person image to the office 2. The back person image transmitted here is an image on which the transparency processing has been performed in step S709.

  Next, step S711 will be described. In step S711, the CPU 402 determines whether to end communication. For example, when a predetermined ending operation is performed on the user, the CPU 402 determines that the communication is ended, and the processing illustrated in the flowchart of FIG. 7 is ended. On the other hand, when the CPU 402 determines that the communication is not ended, the process returns to step S701.

  Next, processing executed by the control server 421 of the office 2 will be described with reference to the flowchart of FIG. The flowchart in FIG. 8 shows a process of superimposing a person image (a person image on the front or a person image on the back) received from the office 1 on a meeting material in a superimposed manner on the screen 112. Each step shown in the flowchart of FIG. 8 is processed by the CPU 422 loading a control program stored in a memory such as the ROM 424 into the RAM 423 and executing it.

  First, in step S801, the CPU 422 determines whether a person image (front person image or back person image) has been received from the office 1. If a person image is received from the office 1, the process proceeds to step S802. On the other hand, if no person image has been received from the office 1, the process proceeds to step S803.

  In step S802, the CPU 422 superimposes the person image and the conference material received in step S801 on the screen 112. More specifically, the CPU 422 controls the projector 111 to project a composite image obtained by combining the human image and the conference material onto the screen 112.

  In step S803, the CPU 422 determines whether to end communication. For example, when a predetermined ending operation is performed on the user, the CPU 422 determines that the communication is ended, and the processing illustrated in the flowchart of FIG. 8 is ended. On the other hand, when the CPU 422 determines that the communication is not ended, the process returns to step S801.

  According to the present embodiment, it is possible to switch which one of the front person image and the back person image is to be transmitted to the remote location based on the position of the person. In particular, when the person approaches the screen, the user switches to the back person image, so if the user of the remote location is used, the person's action on the meeting material can be easily grasped. Further, since switching between the front person image and the back person image is automatically performed based on the position of the person, the time and effort of the user can be reduced, and smooth communication can be promoted.

  Further, according to the present embodiment, the transparency processing is performed on a person image projected to a remote place. If it is a remote user, even if the meeting material and the person are projected in an overlapping manner, it is possible to easily grasp what the overlapping portion is.

  Further, according to the present embodiment, when the switching between the front person image and the back person image occurs, the timing at which the person image becomes completely transparent occurs. For a remote user, the front person image gradually becomes transparent, and disappears for a moment and switches to the back person image, so that it can be recognized as a smooth image change.

(Other embodiments)
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read the program. It can also be realized by the process to be executed. It can also be implemented by a circuit (eg, an ASIC) that implements one or more functions.

103 front camera 104 rear camera 401 control server 402 CPU
410 Network I / F

Claims (20)

First projection means for projecting an image on a first projection plane;
A first imaging unit disposed on the first projection plane and imaging an object located in front of the first projection plane;
Second imaging means for imaging the subject from the opposite side of the first projection plane with respect to the subject;
Image processing means for performing image processing based on processing parameters;
Using the first image of the subject captured by the first imaging means for the image processing by comparing the distance from the first projection plane to the subject and at least one threshold value, or Determining whether to use the second image of the subject imaged by the second imaging means for the image processing, and comparing the distance from the first projection plane to the subject with the at least one threshold value Determining means for determining processing parameters of the image processing according to
A second projection unit configured to project an image on which image processing has been performed by the image processing unit on a second projection plane.   The communication system according to claim 1, wherein the first imaging means is embedded in the first projection plane. The communication system according to claim 1, wherein the first imaging unit includes a distance sensor which determines a distance from the first projection plane to the subject.   4. The image forming apparatus according to claim 1, wherein the second projection unit projects an image different from the image on which the image processing is performed by the image processing unit and the image on which the image processing is performed by the image processing unit. Communication system according to any one of the above. When the distance from the first projection plane to the subject is equal to or less than a predetermined threshold value of the at least one threshold value, the image processing means executes image processing on the second image,
The image processing means executes image processing on the first image when the distance from the first projection plane to the subject is longer than the predetermined threshold value. The communication system according to any one of 1 to 4. When the distance from the first projection plane to the subject is less than a predetermined threshold of the at least one threshold, the image processing unit executes image processing on the second image;
The image processing unit executes image processing on the first image when the distance from the first projection plane to the subject is equal to or more than the predetermined threshold value. The communication system according to any one of 1 to 5. The image processing is transparency processing,
The communication system according to any one of claims 1 to 6, wherein the processing parameter is transparency. The at least one threshold is a first threshold which is the shortest distance from the first projection plane, a second threshold which is a longer distance from the first projection plane than the first threshold, the second threshold A third threshold which is a longer distance from the first projection plane than a second threshold, and a fourth threshold which is a longer distance from the first projection plane than the third threshold,
In response to the distance from the first projection plane to the subject being less than the first threshold, the image processing means performs the transparency processing at 60% transparency to the second image. Do,
According to the fact that the distance from the first projection plane to the subject is greater than or equal to the first threshold and less than the second threshold, the image processing unit may perform the second image processing on the second image, The transparency processing is performed in the range of 60% to 100% so that the transmittance decreases as the distance from the subject to the first projection plane decreases.
According to the fact that the distance from the first projection plane to the subject is greater than or equal to the second threshold and less than the third threshold, the image processing unit may perform the first image processing on the first image, The transparency processing is performed in the range of 0% to 100% so that the transparency increases as the distance from the subject to the first projection plane decreases.
According to the fact that the distance from the first projection plane to the subject is greater than or equal to the third threshold and less than the fourth threshold, the image processing unit performs the first image processing on the first image, 8. The communication system according to claim 7, wherein the transparency processing is performed with 0% transparency.   9. The communication system according to claim 8, wherein the determination means switches between using the first image and using the second image bordering on the second threshold. The first image is a portion where a subject is extracted from the large image captured by the first imaging unit,
The communication system according to any one of claims 1 to 9, wherein the second image is a portion of a large image captured by the second imaging means, from which a subject is extracted. . Projection means for projecting an image on a projection plane;
A first imaging unit disposed on the projection plane and imaging an object located in front of the projection plane;
A second imaging unit configured to image the subject from the opposite side of the projection plane with respect to the subject;
Image processing means for performing image processing based on processing parameters;
Whether the first image of the subject captured by the first imaging means is used for the image processing by comparing the distance from the projection plane to the subject and at least one threshold value; It is determined whether to use the second image of the subject taken by the imaging means for the image processing, and comparing the distance from the projection plane to the subject with the at least one threshold value. Determining means for determining processing parameters;
A communication system, comprising: transmission means for transmitting an image on which image processing has been performed by the image processing means to an external device.   The communication system according to claim 11, wherein the first imaging means is embedded in the projection plane. 13. The communication system according to claim 11, wherein the first imaging means includes a distance sensor which determines a distance from the projection plane to the subject. When the distance from the projection plane to the subject is equal to or less than a predetermined threshold value of the at least one threshold value, the image processing means executes image processing on the second image;
12. The image processing method according to claim 11, wherein when the distance from the projection plane to the subject is longer than the at least one threshold, the image processing unit executes image processing on the first image. 13. The communication system according to any one of 13. When the distance from the projection plane to the subject is less than a predetermined threshold of the at least one threshold, the image processing unit executes image processing on the second image;
The image processing means executes image processing on the first image when the distance from the projection plane to the subject is equal to or more than the predetermined threshold value. Communication system according to any one of the above. The image processing is transparency processing,
The communication system according to any one of claims 11 to 15, wherein the processing parameter is transparency. The at least one threshold is a first threshold which is the shortest distance from the projection plane, a second threshold which is a longer distance from the projection plane than the first threshold, the projection than the second threshold A third threshold which is a long distance from the plane, and a fourth threshold which is a long distance from the projection plane than the third threshold,
In response to the distance from the projection plane to the subject being less than the first threshold, the image processing means performs the transparency processing on the second image with a transparency of 60%,
In response to the distance from the projection plane to the subject being greater than or equal to the first threshold and less than the second threshold, the image processing unit is configured to, from the subject, for the second image, The transparentizing treatment is performed in the range of 60% to 100% so that the transmittance decreases as the distance to the projection plane decreases.
In response to the distance from the projection plane to the subject being greater than or equal to the second threshold and less than the third threshold, the image processing unit is configured to, from the subject, for the first image. A transparency treatment is performed in a range of 0% to 100% so that the transparency becomes higher as the distance to the projection plane becomes shorter,
According to the fact that the distance from the projection plane to the subject is greater than or equal to the third threshold and less than the fourth threshold, the image processing means determines that the first image is 0%. The communication system according to claim 16, wherein the transparency processing is performed with the transparency of.   18. The communication system according to claim 17, wherein the determination means switches whether to use the first image or to use the second image bordering on the second threshold. The first image is a portion where a subject is extracted from the large image captured by the first imaging unit,
The communication system according to any one of claims 11 to 18, wherein the second image is a portion of a large image captured by the second imaging means, from which a subject is extracted. .   The communication system according to any one of claims 1 to 19, wherein the first imaging unit and the second imaging unit are disposed on opposite sides of the subject.

Images