JP2616392B2 - User interface of image communication terminal - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a user interface of an image communication terminal, and more particularly to improvement of a sense of reality.

[0002]

2. Description of the Related Art In conventional image communication, as shown in FIG. 6, an image of an opponent's point is photographed by a photographing unit 110 such as a video camera, the image signal is transmitted to the other party, and displayed on a display unit 111 such as a CRT. I was

As a method of combining a background image and a person image in image communication and displaying the image, conventionally, as shown in FIG. 7, a background image is generated by a conventional background image generation unit 701 on the receiving side, and the image is synthesized. The unit 702 combines and displays the images using the chroma key method or the like. There is also a method of performing chroma key processing at a transmission source to extract and transmit only a human image. FIG. 8 (JP-A-3-79191) is an extension of the chroma key processing method to multipoint communication.

[0004] In FIG. 8, an image signal sent from each point is processed by a chroma key device 805 and sent to a special effect device 803. The image memory 804 stores background image information to be projected on a plurality of display devices 801 adjacent to each other. Information. The background image and the image sent from the destination are combined by the special effect device 803,
It is sent to the display device 801.

[0005] As a conventional method for controlling illumination in an image communication environment, there is a method shown in FIG. 9 (Japanese Patent Laid-Open No. 2-119390). The method shown in FIG. 9 is a method in which when the user picks up the handset 901, the illumination for illuminating the user is turned on. When the handset 901 is off-hook, the current detection circuit 903 detects this through the network control circuit 902 Then, the power of the lighting unit 904 and the communication terminal is turned on. Further, the camera unit 905 senses the brightness of the surroundings of the shooting target and controls the lighting unit 904 so that the intensity of the lighting is substantially inversely proportional to the surrounding brightness.

[0006]

It is important to improve the sense of reality in image communication. Conventionally, an apparatus that reproduces an image captured on a transmission side as it is on a reception side has been mainly used. This device emphasizes the boundary between the transmission-side image, which is a virtual conversation space, and the physical space on the reception side, and hinders the creation of a sense of being in front of the other party. It is effective to enhance the sense of unity and continuity of the physical space between the image sent from the opponent's point and the own point to improve the sense of realism, and to match the image and the information of the own point or give a continuous impression There is a device that is designed as follows. One example of this is matching of light source information.

The light source information includes the brightness, type, color,
It represents characteristics of the light source such as position, number, and size. There is a large difference between the light source conditions on the other end and the light source conditions on the own site.If images are communicated without considering these differences, the sense of unity between the image sent from the other site and the own site conditions will be lost. It is difficult to obtain. The inconsistency of the light source information increases as the number of communicating points increases, and the impression that the images are scattered increases.

However, as shown in FIG. 6, information on the light source is conventionally transmitted only as an image signal photographed by the camera. Light source information in both physical spaces is extracted, encoded, and transmitted to the other party. However, no device has been used for generating a conversation space. Further, as shown in FIG. 9, a device for controlling the lighting according to the communication condition also attaches the lighting to the local point image communication terminal and controls only the brightness.

FIG. 8 shows a device for extracting only a human image on the transmitting side and synthesizing images transmitted from multiple points in one background (in a virtual conversation space). However, matching of light source information is considered. Not. Although the device shown in FIG. 10 is a display device in consideration of the light source position, it is a device for displaying CG information in high-quality three-dimensional display, and it is necessary to convert a real space into a CG space for image communication. Yes, and light source information cannot be exchanged between conversation spaces unless a light source information detection unit and analysis unit are added.

[0010] Even if a light source information transmission function is added to this device, the display device is a device that comes close to the eyes.
It cannot be used in a TV conference system or the like in which a display image communication terminal is shared by a plurality of persons. Further, unlike the case of multipoint communication, images of different points cannot be combined.

An object of the present invention is to exchange light source information separately from an image, and to determine the background of an image sent from a partner point based on the light source information of the own point and the light source information sent from the partner in image communication. Or to control the lighting conditions at the own point to obtain a communication dialog space where the image sent from the other point looks natural and there is a sense of continuity between the own point and the other point. .

[0012]

The gist of the means for solving the above problems lies in the following two items.

[1] Provided in an image communication terminal having a photographing unit and a display unit, based on a dialog space related to the image communication terminal at the other party's point, generates a dialogue space related to the image communication terminal at the own point. A user interface of the image communication terminal that displays an image from the light source information detecting unit that detects information about a light source at an installation point of the image communication terminal at the own point and the other point, and generates light source information, A light source information analysis unit that analyzes the light source information of the partner point and the light source information of the own point transmitted from the partner point and generates combined light source information, and a background in the interactive space based on the combined light source information A background image generation unit that generates an image, and a visual image that generates a display image by combining the image and the background image sent from the partner point. A user interface for an image communication terminal, comprising: an information synthesis unit; and a signal transmission / reception unit configured to transmit / receive the image and the light source information to / from the partner point.

[2] An image communication terminal provided with a photographing unit and a display unit is provided to generate a dialogue space related to the image communication terminal at the own point based on the dialogue space related to the image communication terminal at the counterpart point. A user interface of the image communication terminal for displaying an image from the image communication terminal, wherein the light source information detection unit detects the information on the light source at the installation point of the image communication terminal and generates the light source information based on the information, A light source information analysis unit that analyzes the light source information transmitted from a point and the light source information of the own point to generate combined light source information; and generates an illumination condition in an interactive space based on the combined light source information. A communication condition transmitting / receiving unit for communicating an image and the light source information with the counterpart point. The interface.

[0015]

According to the user interface of the image communication terminal of the first invention, the light source information detecting section detects information on the light source at the terminal installation point to generate light source information, which is transmitted to the other party via the communication section. Sent. The light source information analysis unit analyzes the light source information transmitted from the partner point and the light source information of the own point, and generates combined light source information. The background generation unit generates a background image in which the light sources are consistent based on the synthesized light source information.
The image sent from the other party and the background image are combined by the visual information combining unit to generate a display image, and the display image is displayed by the display unit. The signal transmitting and receiving unit exchanges image information and light source information captured by the capturing unit with the other party.

According to the user interface of the image communication terminal of the second invention, the light source information detecting section detects information on the light source at the terminal installation point and generates light source information, which is transmitted to the other party via the communication section. Sent. The light source information analysis unit analyzes the light source information transmitted from the partner point and the light source information of the own point, and generates combined light source information. Based on the synthesized light source information, the lighting environment generating unit controls the lighting environment at the own location and generates an environment in which the light sources are consistent. The signal transmitting and receiving unit exchanges image information and light source information captured by the capturing unit with the other party.

[0017]

DESCRIPTION OF THE PREFERRED EMBODIMENTS In the present invention, the light source information or the information on the light source includes the position and brightness of the light source and the lighting equipment, the light source type, the color temperature of the light source, the number of the light sources and the lighting equipment, the light emitting area of the light source, and the light source. General information used in indoor effects such as lighting, such as the arrival path of the object and its transmittance, the optical characteristics of the reflecting object if there is reflection on the way of the light, the difference between direct light and indirect light, etc. Point to.

In the conventional image communication, such information was not extracted and used secondarily while being included in the image signal. However, in the present invention, the light source information is detected by the light source information detecting unit and the light source information analyzing unit. Since it is converted into numerical value, symbol, or code information and handled as information independent of the image signal, secondary use such as precise transmission of light source information and use in generating a conversation space is facilitated.

In the present invention, the lighting environment refers to an optical state or characteristic of a room or a physical space where a user exists, which is illuminated by a lighting fixture or natural light.

Further, in the present invention, the conversation space refers to either a virtual space in the communication terminal for performing a conversation or a whole three-dimensional space facing the user. The former example refers to a space represented by an image or a space represented by a real model. The latter example is
It refers to the entire real three-dimensional space in which the user is facing the image of the remote partner, and when it is distinguished from the former, it is called "physical conversation space".

An embodiment of the first invention will be described with reference to the drawings. FIG. 1 is a block diagram showing an embodiment of a user interface of the image communication terminal according to the first invention. According to the image communication terminal 101, the light source information is exchanged with the opponent point, and a realistic interactive space in which the shadow of the image transmitted from the opponent point matches the lighting environment of the own point can be realized.

Information about the light source in the space where the user is located is detected by the light source information detecting unit 102, and the light source information 19 of the own point is detected.
0 is sent to the signal transmission unit 105 and the light source information analysis unit 103. The signal transmission / reception unit 105 includes the light source information 190 of the own location and the user's image signal 182 transmitted from the imaging unit 110.
Is transmitted to the other party via the communication unit. Further, the signal transmitting / receiving unit 105 transmits the image signal 18 transmitted from the other party.
“0” is sent to the visual information synthesizing unit 106, and the light source information 191 of the partner point is sent to the light source information analyzing unit 103.

The light source information analysis unit 103 determines the position and characteristics of the background light source to be generated based on the light source information 190 of the own point and the light source information 191 of the other point, and
92 is generated by the background image generation unit 104. The background image generation unit 104 sets the illumination and the characteristics of the light source according to the synthesized light source information 192, generates a background image 193, and sends the background image 193 to the visual information synthesis unit 106. The visual information synthesizing unit 106 synthesizes the image 180 and the background image 193 sent from the other party,
A composite image 181 is generated on the display unit 111.

An embodiment of the second invention (second invention) will be described with reference to the drawings. FIG. 2 is a block diagram showing one embodiment of the user interface of the image communication terminal according to the second invention. According to the image communication terminal 201, the light source information is exchanged with the opponent point, and a realistic interactive space in which the shadow of the image sent from the opponent point matches the lighting environment of the own point can be realized.

Information on the light source in the space where the user is located is detected by the light source information detecting unit 102, and the light source information 19 of the own point is detected.
0 is sent to the signal transmission unit 105 and the light source information analysis unit 203. The signal transmission / reception unit 105 includes the light source information 190 of the own location and the user's image signal 182 transmitted from the imaging unit 110.
Is transmitted to the other party via the communication unit. Further, the signal transmitting / receiving unit 105 transmits the image signal 18 transmitted from the other party.
“0” is sent to the display unit 111, and the light source information 191 of the other party is sent to the light source information analysis unit 203.

The light source information analysis unit 203 determines the position and characteristics of the light source in the physical space of the own point based on the light source information 190 of the own point and the light source information 191 of the other point, and converts the combined light source information 292 into the lighting environment. Generated by the generation unit 202. The lighting environment generation unit 202 sets the lighting in the physical space of the own point and the characteristics of the light source according to the combined light source information 292.

The difference between the first invention and the second invention will be described. A first invention is an apparatus in a case where a background image and an image sent from a partner point are combined at a signal level, and both are simultaneously integrated and displayed in a display unit by a display unit. On the other hand, the second invention is an apparatus for controlling an illumination environment in a physical conversation space, for example, for directly controlling indoor lighting, and a light source information on an own point side for an image displayed in a display unit. No processing is added. When an environment for communication is generated by virtual reality, it is a virtual dialogue space that is processed in a signal manner and belongs to the category of the first invention.

In the first invention and the second invention, the light source information to be exchanged has a common format so that they can be connected and communicate with each other.

The exchange of light source information and light source information between terminals will be described in detail with reference to FIG. 3, taking the case of the embodiment of the first invention as an example. In the second invention, detection of information on the light source and exchange of the light source information
According to the method of the first invention. Light source information detection unit 102 of user interface 101 (s) of the image communication terminal on the transmission side
(s) detects information about the light source at the transmission point, transmits the light source information 191 to the light source information analysis unit 103 of the user interface 101 (r) of the image communication terminal on the reception side, and simultaneously, detects the light source position detection unit 102 on the reception side. (r) detects information related to the light source at the reception point and sends the light source information 19 to the light source information analysis unit 103.
Send 0. The light source information analysis unit 103 creates information 192 on the light source of the background image created on the receiving side based on both the light source information 190 and 191, and the background image generation unit 1
Send to 04. In the background image generation unit, the combined light source information 192
Based on this, a background in which the lighting environment of the transmitting side and the receiving side is consistent is created.

The consistency of the lighting environment will be described. Lighting environment matching refers to the continuity and unity between the image sent from the destination in communication and the virtual conversation space created in the terminal and the physical space (real space) where the terminal user is located. When the user considers the situation, it refers to a state in which the environment regarding the light source in both the image and the conversation space and the real space is the same or the difference is small enough that the user does not feel uncomfortable. In this way, by bringing the lighting environment of the conversation space close to the lighting environment of the real space, the realism of the conversation space can be improved.

A method for matching the lighting environment between the conversation space and the real space includes a method for matching the position of the virtual light source in the conversation space with the position of the light source in the real space, a method for comparing the light source in the conversation space and the vector between the objects. And the light source in the real space vs the method of matching the direction of the vector between the positions in the real space where the dialog space is displayed / represented, the method of matching the brightness and color temperature of the lighting with the display screen, and the type of the light source There are a method of matching, a method of matching the number of light sources, the light emitting area and the shape, and the like, and these methods are implemented in combination.

The generation of the background image and the generation of the display image according to the first invention will be described in detail with reference to FIG. First
In the present invention, an original background image 401 serving as a prototype of the background image 402 is stored in the background image generation unit. Original background image 4
01 is expressed in such a format that various lighting environments can be generated, and a background of an arbitrary lighting environment is generated by giving a virtual lighting position and characteristics in the original background image 401.
For example, the original background image 401 is realized as coordinate information or shape information. Therefore, the original background image 401 is also realized by a three-dimensional image like a virtual reality. Further, it is also realized by a method of processing a real image by computer processing, operating palette information such as color and brightness, and synthesizing shadow information. If the continuity between the real space and the display image as the conversation space is taken into consideration, an image having continuity with the real space environment where the user is located is selected as the original background image. For example, if the user has a conversation in a conference room, it is more effective to select an image imitating the environment of the conference room as the original background image.

Further, in order to enhance the effect of improving the sense of realism by image synthesis, it is desirable that only the human image be extracted from the image sent from the other party by chroma key processing or the like. The chroma key processing may be performed on the transmitting side or on the receiving side. The chroma key processing device is provided between the photographing unit and the signal transmitting / receiving unit when performed on the transmitting side, and between the signal transmitting / receiving unit and the visual information synthesizing unit when performed on the receiving side. Furthermore, it may be realized as an internal function of the visual information synthesis unit.

The background image 402 is generated by adding the light source information 191 of the other party and the light source information 190 of the own location to the original background image 401. The image 403 and the background image 402 sent from the other party are synthesized by the visual information synthesizing device, and the display image 404 is generated. Normally, the image 403 sent from the partner point is placed on the background image 402
Are synthesized as if they overlap. There is also a method of converting an image sent from a partner point into a format that can be handled in the CG space, and combining the images in the CG space. In this case, since the image sent from the partner point in the CG space can be processed numerically, the image sent from the partner point in the conversation space and the virtual object (the object represented by the CG) can be processed. The positional relationship can be set arbitrarily, and a three-dimensional conversation space is created.

The generation of the illumination environment according to the second invention will be described. In the second invention, the lighting environment of the space (real space) where the user is actually located, or the real space, is specially secured in a terminal or the like as a dedicated area for communication dialogue, and the user exists outside. To control the lighting environment of the space. As an example of the latter, there is a space located behind the half mirror of the eye-gaze matching terminal using the half mirror. Further, the case where a transmission type HMD is used also corresponds to this environment.

The lighting environment generating section includes a lighting device such as a lighting device, a lighting device, and a light source, in addition to a control device for a lighting device and a lighting device. There is a case where the lighting environment generating unit controls all of the lighting in the conversation space, and a case where the lighting environment generating unit partially controls the lighting.

FIG. 5 shows an example in which consistency regarding the position of the light source is obtained.
It is. Hereinafter, the person image 524 of the user A will be described as a plane image. However, when the person image 524 is a three-dimensional image, a cutting plane passing through the center of the three-dimensional image is considered, and the cutting plane is described below as a plane. By considering the human image 524 by replacing it with the human image 524, it is possible to treat the human image 524 in the same manner as when the image is a plane.

Light source A 511 and light source B 521 represent actual illumination, such as an incandescent bulb. User A at point A
510 is photographed by the photographing device 513, and the point B502
Is displayed as a person image 524 by the display unit of. The display unit includes a case where a human image is projected onto a real space by a half mirror or the like. At the point A501, a unit coordinate system 519 is set with the representative point 518 of the user A510 as the origin and the vertical direction and the photographing axis of the photographing device 513 as references, and the positional relationship between the user representative point 518 and the light source A511 is a vector. It is represented by 512. As the user representative point, it is desirable to select a point located at the center of a person or a person image, such as the head, chest, and navel of the user.

In some cases, a point having the highest probability (state density) of the presence of a person may be selected. FIG. 5 shows a user representative point 51.
In this case, the umbilical portion of the user A 510 is selected as 8. Information on the vector 512 and the user representative point 518 is sent to the point B502. The coordinates of the user representative point 518 in the plane coordinate system of the captured image are represented by a point B502.
There is also a way to send to.

If necessary, the human image 524 transmitted to the point B 502 is approximated by a plane, and its radiation vector is
The person image 524 is arranged so as to face the vicinity of 520 and to intersect perpendicularly with the horizontal plane. The unit coordinate system 529 at the point B502 is defined by using the representative point 528 of the user A projected on the human image 524 as an origin, based on the vertical direction and the radiation vector of the human image 524, and using a scalar multiple of the coordinate system 519. Is defined as The light source B521 is arranged at the coordinate position of the mapping vector 522 in the coordinate system 529 of the vector 512.

Further, when the real object 525 is placed in the conversation space at the point B502, a series is created between the shadow of the human image 524 and the shadow of the real object 525, and the presence and realism of the human image 524 are reduced. Increase. Examples of the real object 525 include a model, an indoor fixture, and the like.

When matching the characteristics and information of the light source other than the position, the lighting environment of the interactive space is designed and controlled so that the lighting environment is variable for each attribute. For example,
There are factors such as variable brightness and the ability to change the spectrum of the light source.

The detection of information on the light source in the first and second inventions will be described. The type of light source can be determined from the spectrum (spectrum) distribution of the indoor lighting. This includes a method of analyzing an image signal obtained from a photographing device such as a CCD, a method of using an optical sensor using an ND filter having a different band, and a method of using a spectroscope. Brightness information can also be detected using the spectrum distribution obtained when the light source type is measured, and semiconductor devices such as photodiodes, CdS, and solar cells, and photodetectors and devices such as thermoelectric cones and photomultipliers. There is a method of detecting using

The position of the light source is measured relative to the position of the photographing range, the photographing device and the subject. In order to measure optically, the position of the detector is known, the direction range (solid angle) incident on the optical passive element of the detector is limited to a certain range to obtain the required resolution, and the detector is rotated. By measuring the light intensity in all directions (all solid angles), or practically in the upper hemisphere, the angular relationship between the illumination (light source) and the detector can be obtained. For the distance, two detectors
It can be detected by a triangulation method, for example, by disposing one detector and moving one detector by a known distance. If there is no transparent obstacle in between, a distance sensor using ultrasonic waves or the like can be used.

By pre-registering information on the light source in the terminal at the time of installing the terminal, it becomes easy to generate the light source information. For example, by registering the lighting position and lighting type of the installation location in the terminal so that the relative positional relationship between the installation location and the shooting range can be detected, the information such as the light source position and the number can be numerical values. Can be calculated. Such management of registration and storage of information can be realized by adding a function to the light source information analysis unit.

The synthesis of the light source information will be described. The synthesis of the light source information is to compare the lighting environment of the other party with the lighting environment of the own point and generate information for making the display at the own point natural. For example, if there is one light source for each side and the virtual position of the other light source in the conversation space is different from the position of the light source at the own point, the light source at the virtual position is added in the background image or the conversation space. The environment is set as one light source. If the spectra of the light sources are different from each other, the sum is set as the sum of the spectra of both illuminations. The method of synthesizing the light source information of the partner point and the own point has a difference between the case of the first invention and the case of the second invention.

In the case of the first aspect, since the lighting environment at the own point is uncontrollable, the priority of the light source information at the own point is high. Therefore, when the background image is generated, the light source at the own point is switched. An image is generated with priority. If the lighting environment of the other party and the lighting environment of the own location are extremely different, image processing is performed on the image sent from the other location, and adjustment is made so that it is easy to match the lighting environment of the own location However, by using the difference information between the lighting information sent from the other party and the lighting information of the own location, adjustment processing can be performed without analyzing the image sent from the other party. Become.

In the case of the second invention, since the lighting environment on the own point side can be controlled, it is possible to set conditions such that information on either the other party or the own point side is given priority or is treated equally. Become. In the second invention, it is possible to virtually share the lighting environment with the other party, and ideally, a feeling of having a conversation under the same lighting can be obtained. If both lighting environment generating units are the same and there is no illumination source other than the lighting environment generating unit, it is easy to achieve consistency of the lighting environment. However, when there is a lighting environment element that cannot be controlled by the terminal in the conversation space, it is difficult to completely match both lighting environments. In this case, if the lighting elements that cannot be controlled by the terminal can be matched within the environment generation range of the lighting environment generation unit, the effect of improving the sense of reality can be obtained.

When all lighting environments in the conversation space cannot be controlled, a method called enhanced lighting is used. The term “enhanced lighting” as used herein refers to, for example, a spotlight that emphasizes only a specific area in brightness more than conventional lighting, and
Refers to lighting with a strong point light source. By using the enhanced lighting on both sides, an uncontrollable lighting element can be weakened, and a situation in which all the lighting environment elements in the conversation space can be controlled can be created.

When the terminals of the second invention are connected to each other, if the control of the lighting environment at the own point starts freely, the control points vibrate, and the environment continues to fluctuate without being completed forever. It may not be stable. Therefore, in order to prevent this, there is a method in which the control of one terminal is stopped and the other environment is set during that time. In other words, the method is based on one of the conversation spaces.
In this case, it is better to make the control environment the one with the superior performance of the lighting environment generation unit. Another method is to stop the control of both lighting environments first, exchange the light source information between the terminals, determine the lighting environment to be generated, and then set the lighting environment in the dialog space to complete the control. is there. By preparing a standard lighting environment in advance and setting the conversation space to the standard lighting environment when the terminal is started, it is possible to prevent control overshoot and the like.

The extension to multiple points will be described. When the number of points increases, it becomes difficult to design a conversation space. If each point has disparate light source information, even if it is simply synthesized, the number of light sources will increase,
An environment without features will be created. Rather, it defines a virtual shared dialogue space that integrates the image information of each point, sets a characteristic lighting environment in the shared dialogue space, and controls the lighting environment of the local point to match the shared dialogue space. The method is effective.

The characteristics of the display unit and the photographing unit differ from device to device, and in order to obtain an environment that is highly consistent with the lighting environment, the characteristics of the display unit and the photographing unit need to be known. . If necessary, the characteristics of the display unit and the photographing unit are registered in advance in the light source information analysis unit, and are exchanged with the partner point as necessary, similarly to the light source information. Information such as the sensitivity of the display unit and the brightness of the image capturing unit and the color temperature correspond to this.

Although the speech dialogue space is not included in the embodiment of the present invention, speech is important when a conversation is made with a partner point. By adding a communication function or separately preparing a communication system for voice, a dialogue with voice is performed with the other party.

[0054]

As described above, by using the user interface of the image communication terminal provided by the present invention,
The light source information such as the position and brightness of the light source in both physical spaces is symbolized, and can be separated from the image signal and communicated with the opponent point. Based on the light source information, the user can Control and adjust the background and indoor environment of the confronting image to create a dialogue space with a sense of continuity with the opponent, as if the environment of the light source and the opponent's point were matched, and communication and work with the opponent's point It is possible to realize an effective dialog space such as smooth operation.

In the case of controlling the lighting in the indoor environment where the conversation is being performed, not only the brightness of the lighting at the own site but also the lighting of the other party are controlled in conjunction with each other. Can be more strictly matched. Furthermore, when combining human images sent from a plurality of points in one background (in a virtual dialogue space), image processing is also performed when matching light source information between each human image and the background image. About the chroma key processor and C
Conventionally widely used image processing apparatuses and image processing methods, such as a G generation apparatus, can be used, and thus can be realized at low cost.

Further, the light source information can be transmitted in a form that can be used secondarily, and the illumination environment of the background image can be freely changed to generate the image. Can automatically match the conditions of the light source when combining with the background image generated by the above, and the image sent from the partner point looks natural and there is a sense of continuity between the own point and the partner point A communication dialog space is obtained.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a user interface of an image communication terminal according to an embodiment of the first invention.

FIG. 2 is a configuration diagram of a user interface of an image communication terminal according to an embodiment of the second invention.

FIG. 3 is a diagram showing how light source information is exchanged using the embodiment of the first invention.

FIG. 4 is a diagram showing how a display image is generated in the embodiment of the first invention.

FIG. 5 is a diagram showing how information about the position of a light source is exchanged in the embodiment of the second invention.

FIG. 6 is a configuration diagram of a conventional image communication.

FIG. 7 is a configuration diagram in a case where a background is generated at a local point side by conventional image communication.

FIG. 8 is a configuration diagram of a conventional image communication input / output device.

FIG. 9 is a configuration diagram of a conventional videophone.

[Explanation of symbols]

101, 201 User interface of image communication terminal 102 Light source information detection unit 103, 203 Light source information analysis unit 104 Background image generation unit 105 Signal transmission / reception unit 106 Visual information synthesis unit 109 Communication line 110 Imaging unit 111 Display unit 180, 403 Sent images 181, 404 Display image 182 Local point image 190 Light source information of local point 191 Light source information of partner 192, 292 Synthetic light source information 193, 402 Background image 202 Lighting environment generation unit 208 Dialog space 401 Original background image 501 Point A 502 which is the other party point B 510 which is the own point User 510 which is the user of the other party 511 Light source A 512 which is the other party Vector 513 showing the positional relationship between the user A and the light source 513 Imaging device 518 User A 519 Usage at point A A unit coordinate system 520 having the representative point of A as the origin 520 A user B 521 who is a user at the own point A light source B 528 at the own point A representative point 529 of the user A projected on the image 524 The user A at the point B Unit coordinate system 522 with image 524 as the origin 522 Mapping vector of vector 512 in unit coordinate system 529 524 Image of user A 525 Real object installed at point B 701 Conventional background image generation unit 801 Display device 802 Television camera 803 Special Effect device 804 Image memory 805 Chroma key device 901 Handset 902 Network control circuit 903 Current detection circuit 904 Illumination unit 905 Camera unit

Claims (2)

(57) [Claims] 1. An image communication terminal provided with a photographing unit and a display unit, and generates a conversation space related to an image communication terminal at a self-point based on a conversation space related to the image communication terminal at a partner point. A user interface of the image communication terminal that displays an image of a light source information detecting unit that detects information about a light source at an installation point of the image communication terminal at the own point and the counterpart point, and generates light source information; A light source information analyzing unit that analyzes the light source information of the partner point and the light source information of the own point transmitted from the partner point and generates combined light source information; and a background image in the interactive space based on the combined light source information. A background image generating unit that generates a display image by combining the image sent from the partner point with the background image. A combining unit, the image and the source information image communication terminal user interface, characterized in that the transceiver is configured and a signal transceiver for performing between the mating point. 2. An image communication terminal comprising a photographing unit and a display unit, wherein a dialog space for an image communication terminal at an own point is generated based on a dialog space for an image communication terminal at a partner point, and a dialog space is generated from the partner point. A user interface of the image communication terminal that displays an image of the light source information detecting unit that detects the information on the light source at the installation point of the image communication terminal and generates the light source information based on the information; A light source information analysis unit that analyzes the light source information transmitted from and the light source information of the own point to generate combined light source information; and illumination of a conversation space generated by the light source based on the combined light source information. An illumination condition generation unit for generating a condition; and a signal transmission / reception unit for communicating the image with the counterpart point and the light source information. The user interface of the communication terminal.