JP2010028299A - Conference photographed image processing method, conference device, and the like - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a conference participant to attend a necessary conference among a plurality of conferences concurrently held with a single conference device, and to allow the image of the participant to be displayed without uncomfortable feeling on the screen of the other participant of each of the conferences. <P>SOLUTION: When at least one person among a plurality of participants photographed by a photographing means attends each of a plurality of conferences concurrently held, a location relationship between the conferences of the participants located separately per conference when the participants are seen on the screen is determined, transmission photographed images are divided into images corresponding to the conferences with the location relationship on the screen which becomes opposite to the determined location relationship, each divided image is transmitted to the other conference device used in the corresponding conference, reception photographed images corresponding to the plurality of conferences are received from the other conference devices, and a display means displays on the screen an image in which the reception photographed image associated with each of the conferences is located with a location relationship on the screen which becomes opposite to the determined location relationship. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a conference apparatus that photographs a conference participant using a conference apparatus, transmits / receives a captured image to / from another conference apparatus via a communication unit, and displays a captured image from the other conference apparatus on a screen. Related to the technical field.

  Conventionally, conference participants in remote locations are photographed with cameras at their respective bases, and the participants' images are displayed on the display at the other party's base, and a conference is held while watching each other's face images. Video conferencing systems are known.

  In such a video conference system, each participant has a conference using his / her own conference device, and one conference is held in one base or conference room (hereinafter referred to as “base etc.”). There is a system in which an apparatus is installed and one or a plurality of participants in the base use one conference apparatus.

In the former system, each participant can use his / her own conference device, so that even when multiple conferences are held at the same time, each participant can participate in the necessary conferences. . Further, as described in Patent Document 1, it is possible to construct the former system so that one person can participate in a plurality of conferences at the same time.
JP-A-7-105106

  However, in the case where a plurality of participants use one conference device as in the latter system, even if a plurality of conferences are simultaneously performed, all the participants present participate in only one of the conferences. I could only do it. In order to solve this, a plurality of conference devices may be prepared, but the cost for increasing the number of conference devices is required.

  If the invention described in Patent Document 1 is used, it seems that a plurality of participants can participate in a conference of a necessary one among a plurality of conferences simultaneously performed by one conference apparatus.

  However, since all participants at one site etc. will be photographed with one camera, the other party of the conference at the other site etc. will have another meeting with the other party You will see an image of both the conference participants and you will not be able to determine who you are.

  In addition, the other party's image is usually displayed using a display device having a large display screen such as a projector so that all the participants at one base can see the image of the other party. Moreover, it is common for participants to sit side by side so that all participants can be photographed with one camera. Therefore, when looking at a meeting partner reflected on the screen, the line of sight may deviate from the camera depending on the position where the participant sits, the display position of the partner's image, and the like. As a result, the participants displayed on the screens of other bases are not facing the front, so that the participants at other bases feel uncomfortable and impair the realism of the conference.

  Therefore, the present invention has been made in view of the above points, and each of a plurality of conference participants participates in a necessary conference among a plurality of conferences simultaneously performed by one conference apparatus. In this case, it is an object of the present invention to provide a conference photographed image processing method, a conference apparatus, and the like that can display a participant's image without a sense of incongruity on the other party's screen in each conference.

  In order to solve the above-mentioned problem, the invention described in claim 1 is a photographed image that is transmitted and received between a conference device and another conference device via a communication unit. A meeting photographed image processing method in a conference apparatus, comprising: photographing means for photographing a certain transmitted photographed image; and display means for displaying a received photographed image that is a received photographed image on a screen, the photographed by the photographing means. When at least one person participates in each of a plurality of conferences held simultaneously from among the plurality of participants, the participation when viewing the plurality of participants located separately for each conference toward the screen And dividing the transmission photographed image into images corresponding to each of the plurality of conferences by a positional relationship determining step for determining a positional relationship between the conferences of the person and a display positional relationship that is opposite to the determined positional relationship. Each of the divided images is transmitted to the other conference devices used for the corresponding conference, and the received captured images corresponding to the plurality of conferences are received from one or more of the other conference devices, respectively. Divided transmission / reception display in which the display means displays on the screen an image in which the received photographed image is positioned corresponding to each of the plurality of conferences in a display positional relationship opposite to the determined positional relationship. And a process.

  According to the present invention, the positional relationship between the conferences of the participants is determined, and the transmission captured image captured by the imaging unit is divided corresponding to each conference with a positional relationship opposite to this positional relationship, Each of the images thus transmitted is transmitted to the corresponding other conference device, and displayed on the screen of each other conference device. In addition, received captured images captured by the other conference apparatuses used for each conference are received from the other conference apparatuses, and these received captured images are displayed on the screen. Thus, each of a plurality of participants can participate in a necessary conference among a plurality of conferences to be performed simultaneously with one conference apparatus.

  At this time, the positional relationship on the screen display of each received photographed image is opposite to the determined positional relationship. Therefore, the line of sight when each participant sees the image of the other party of the conference displayed on the screen intersects between the conferences. Here, when deciding the position of the participant so that all the participants are within the photographing range of the photographing means, the photographing means is generally located in front of or near the center position of the participants. Thus, each participant's line of sight passes through the photographing means or the vicinity thereof.

  Therefore, if the participants are photographed by the photographing means, it is possible to take an image with each participant's face almost facing the front, so that the other party of the conference who sees this image on the screen can hold the conference without feeling uncomfortable. Can do.

  According to a second aspect of the present invention, in the conference photographed image processing method according to the first aspect, when the plurality of participants view the received photographed images of the conference in which the self participates displayed on the screen. The photographing means is positioned so that the position where the line of sight intersects between the meetings matches the position of the photographing means.

  According to the present invention, it is possible to take an image in which each participant's face is almost directly in front.

  According to a third aspect of the present invention, in the conference photographed image processing method according to the first or second aspect, the positional relationship determining step includes the position of the image of each of the plurality of participants on the transmission photographed image. A conference to participate in is specified, and the positional relationship is determined based on the location and the conference.

  According to the present invention, as long as each participant is positioned together for each conference, the conference apparatus can specify the positional relationship of the participants in each conference even if the location of the participant is free to some extent.

  According to a fourth aspect of the present invention, in the conference photographed image processing method according to any one of the first to third aspects, the participant is positioned so as to have the positional relationship determined in the positional relationship determining step. It further includes an instruction information presenting step for presenting instruction information for instructing the participant to the participant.

  According to this invention, since the message etc. instructing each participant to be positioned so as to be in the determined positional relationship is presented to the participant, the conference device determines the positional relationship of the participant in each conference. It can be determined arbitrarily or uniformly.

  According to a fifth aspect of the present invention, in the conference photographed image processing method according to any one of the first to fourth aspects, in the positional relationship determining step, the number of participants in each of the plurality of conferences is specified, and the division is performed. In the transmission / reception display step, the received photographed image corresponding to a meeting with a larger number of the specified number of participants than other meetings is displayed larger than the received photographed image corresponding to the other meeting. Features.

  When all the participants in a plurality of conferences are within the shooting range of the shooting means, the larger the number of participants at the base, the higher the proportion of the participants in the shooting range. Then, for example, when a participant with a larger number of participants is positioned relatively on the left side and a participant with a smaller number of participants is positioned relatively on the right side, one of the former Participants will be located on the right side beyond the center. At this time, if the received captured images of a plurality of conferences are all displayed on the screen with the same size, the line of sight of each participant looking at the screen is entirely shifted to the right side of the photographing means.

  On the other hand, according to the present invention, for example, if a received photographed image corresponding to a meeting with a larger number of participants on its own site side than other meetings is displayed larger than a received photographed image corresponding to the other meeting. Even if the number of participants for each conference is different from each other, it is possible to take an image in which the direction of each participant's face is close to the front while suppressing the gaze of each participant from being deviated from the photographing means.

  According to a sixth aspect of the present invention, in the conference photographed image processing method according to any one of the first to fifth aspects, the number of persons participating in at least one of the plurality of conferences using the other conference device. The number of people information receiving means for receiving the number of people through the communication means, and the number of participants in each of the plurality of conferences based on the received number of people information, the range of the participants using the other conference device In the divided transmission / reception display step, the received captured image corresponding to the conference having the specified number of participants larger than that of the other conference is the received captured image corresponding to the other conference. It is characterized by displaying larger.

  In order for all the participants using other conference apparatuses to enter the shooting range of the camera or the like, it is necessary to increase the distance from the camera or the like to the participant as the number of participants increases. Therefore, the larger the number of participants, the smaller the size of each participant's image in the received captured image showing all the participants. At this time, if the received captured images of a plurality of meetings are all displayed on the screen with the same size, the images of the participants displayed on the screen may be different for each meeting.

  On the other hand, according to the present invention, since the received photographed image corresponding to the conference having a larger number of participants of the other party than the other conference is displayed larger than the received photographed image corresponding to the other conference, it is displayed on the screen. In addition, the size of each participant's image approaches between conferences, which can be expected to enhance the sense of reality of the conference.

  A seventh aspect of the present invention is the conference photographed image processing method according to the third aspect, wherein, in the divided transmission / reception display step, the images of the plurality of participants are among the plurality of divided images. The transmission photographed image is divided so as to be included in images corresponding to a conference in which a person participates.

  According to the present invention, the other party of the conference can see a captured image in which all the users participating in the conference are reliably shown.

  According to an eighth aspect of the present invention, in the conference photographed image processing method according to the third or seventh aspect, information indicating a conference in which the participant whose image position is specified participates in the positional relationship determination step. Based on the participation conference information input using the input means, a conference in which each of the plurality of participants participates is specified.

  The invention according to claim 9 is the conference photographed image processing method according to any one of claims 1 to 8, wherein all the participants photographed by the photographing means participate in only one meeting. A determination step of determining whether or not the transmission photographed image is transmitted to the other conference device used for the one conference, and the received photographed image corresponding to the one conference is transmitted to one or a plurality of the other conferences. A non-divided transmission / reception display step of receiving from the device and displaying the received photographed image on the screen by the display means, and when all the participants participate only in the one meeting, When performing non-divided transmission / reception display step and at least one person participates in each of a plurality of conferences simultaneously performed from among the plurality of participants, the positional relationship determination step and the divided transmission / reception display step; To do And butterflies.

  According to the present invention, a single conference device can participate in a necessary conference among a plurality of conferences that are performed simultaneously by a plurality of conference participants, or a plurality of conference participants can participate in a single conference. You can also

  According to a tenth aspect of the present invention, there is provided a conference device that transmits and receives a photographed image taken by a participant of a conference to and from another conference device via a communication unit, and is a transmission that is the photographed image that is transmitted. Photographing means for photographing the photographed image, display means for displaying the received photographed image that is the received photographed image on a screen, and a plurality of conferences held simultaneously from among the plurality of participants photographed by the photographing means A positional relationship determining means for determining a positional relationship between the conferences of the participants when viewing the plurality of participants positioned separately for each conference toward the screen when at least one person participates in each; Dividing means for dividing the transmission photographed image into images corresponding to each of the plurality of conferences in a display positional relationship opposite to the determined positional relationship; and each divided image to a corresponding conference In Transmitting means for transmitting to each of the other conference devices, receiving means for receiving the received photographed images corresponding to the plurality of conferences from one or a plurality of other conference devices, respectively, and the determined position Display control means for causing the display means to display an image in which the received photographed image is positioned in correspondence with each of the plurality of conferences in a display positional relationship opposite to the relationship.

  According to an eleventh aspect of the present invention, a photographic image taken by a participant in a conference is transmitted to and received from another conference apparatus via a communication means, and a photographic image that is a photographic image to be transmitted is photographed. A computer included in the conference apparatus comprising: means; and a display means for displaying the received photographed image that is the received photographed image on a screen. When at least one person participates in each of the conferences, the positional relationship determination that determines the positional relationship between the conferences of the participants when viewing the plurality of participants that are divided for each conference toward the screen Means for dividing the transmission photographed image into images corresponding to each of the plurality of conferences in a display positional relationship opposite to the determined positional relationship, and corresponding each of the divided images Transmitting means for transmitting to each of the other conference devices used in the conference, receiving means for receiving the received captured images corresponding to the plurality of conferences from one or more of the other conference devices, respectively, and the determination A display control unit that causes the display unit to display an image in which the received photographed image is positioned in correspondence with each of the plurality of conferences in a display positional relationship that is opposite to the positional relationship. To do.

  According to the present invention, it is possible for each of a plurality of conference participants to participate in a necessary conference among a plurality of conferences held at the same time with one conference apparatus, and corresponding to each conference. Since the positional relationship on the screen display of each received photographed image received from another conference terminal device is opposite to the positional relationship of the participants in each conference, the screen on the other party side of each conference is uncomfortable. It is possible to display the images of participants who have no.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, the best embodiment of the invention will be described with reference to the drawings. The embodiment described below is an embodiment when the present invention is applied to a conference terminal device.

[1. Configuration of conference system]
First, a schematic configuration and the like of the conference system S according to the present embodiment will be described with reference to FIG.

  FIG. 1 is a block diagram illustrating an example of a schematic configuration of the conference system according to the present embodiment.

  As shown in FIG. 1, the conference system S includes a conference device 1 as an example of a conference device according to the present invention capable of switching between two conference settings simultaneously with one conference setting, and other conference devices. And a plurality of conference terminal apparatuses 2 (2A, 2B) as an example. In addition, when showing the specific conference terminal device 2 among the conference terminal devices 2, it shall be called the conference terminal device 2A or the conference terminal device 2B.

  The conference apparatus 1 and each conference terminal apparatus 2 can transmit and receive data to and from each other using, for example, TCP / IP (Transmission Control Protocol / Internet Protocol) as a communication protocol via a network NW as an example of communication means. Is possible. The network NW may be, for example, the Internet or a dedicated network.

  The conference device 1 and each conference terminal device 2 are installed at locations separated from each other. For example, the conference device 1 is installed at the site B1, the conference terminal device 2A is installed at the site B2, and the conference terminal device 2B is installed at the site B3. For example, a user P11 and a user P12 exist at the base B1 as users who participate in the conference. In addition, for example, a user P21 exists at the base B2. In addition, for example, a user P31 exists at the base B3. The conference device 1 and each conference terminal device 2 may be installed in the same building.

  In addition, this system adopts a P2P (peer to peer) type configuration without a server device, but may adopt a client-server type configuration in which a server device is interposed.

  In the conference system S having such a configuration, the conference device 1 and each conference terminal device 2 capture the participant with the camera and input the participant's voice from the microphone, thereby capturing the participant's captured image (the captured image). (Example) and audio information are transmitted in real time to the conference apparatus 1 or the conference terminal apparatus 2 on the other side of the conference. In addition, the conference device 1 and each conference terminal device 2 receive the captured image and audio information of the other party of the video conference transmitted from the conference device 1 or the conference terminal device 2 of the other party of the conference, and display this image on the screen. And a sound corresponding to this sound information is output from the speaker.

  Furthermore, the conference device 1 is a device configured such that a plurality of users at the base B1 can participate in two video conferences simultaneously by one camera and one display device. Specifically, the conference apparatus 1 divides a captured image obtained by photographing a plurality of participants into an image of a participant in one conference and an image of a participant in the other conference, It transmits to the conference terminal device 2. In addition, when the conference device 1 receives the captured image from the conference terminal device 2, the conference device 1 divides the display area for each corresponding conference and displays the image. In this case, the conference device 1 indicates the positions of the two conference display areas on the screen, such as the orientation of the participants' faces when the conference participants at the base B1 take a picture with the camera. Set so that it is not unnatural. Details of these will be described later.

  The conference terminal device 2 is a device in which one or a plurality of users at the installed base can participate in one video conference at the same time, and since its configuration is publicly known, detailed description thereof is omitted. Instead of installing one conference terminal device 2 for each base, one conference terminal device 2 may be assigned for each user. Further, the configuration of the conference terminal device 2 may be the same as the configuration of the conference device 1 described later.

[2. Configuration of conference equipment]
Next, the configuration of the conference apparatus 1 will be described with reference to FIG.

  FIG. 2 is a block diagram illustrating an example of a schematic configuration of the conference apparatus 1 according to the present embodiment.

  As shown in FIG. 2, the conference terminal device 2 is connected to a control unit 11 having a CPU, a ROM, a RAM, and the like, a storage unit 12 (for example, a hard disk drive) that stores various data and programs, and a network NW. The communication unit 13 for controlling the communication state with the server device 1 and the like, the control unit 11, the input device and the output device (projector 15, camera 16, microphones 17-1 and 17-2, speakers 18-1 and 18- 2, an input / output unit 14 that performs input / output control of data between the operation units 19-1 and 19-2), and a projector 15 as an example of a display unit that displays a captured image of the other party of the conference as a moving image. The camera 16 as an example of a photographing means for taking a video of a conference participant and the like, and the speech voice of the conference participant and the like are input, and the input / output unit 1 as a voice signal Microphones 17-1 and 17-2 as examples of voice input means capable of setting directivity to be output to the speakers, and speakers 18-1 and 18-that output voices such as uttered voices of participants at the other end of the conference 2 and the operation units 19-1 and 19-2 (for example, a keyboard, a mouse, etc.) as an example of an input unit that receives an operation instruction from a conference participant and outputs the instruction content to the input / output unit 14 as an instruction signal. , Remote pointing device, etc.), and the control unit 11 and each unit are connected via a system bus 21.

  The input device and the output device connected to the input / output unit 14 are classified into a shared unit, a conference 1 and a conference 2.

  The projector 15 and the camera 16 are classified as a common unit, and are used for both conferences when two video conferences are simultaneously performed. The microphone 17-1, the speaker 18-1, and the operation unit 19-1 are classified for the conference 1, and are used for one conference when two video conferences are performed at the same time. The microphone 17-2, the speaker 18-2, and the operation unit 19-2 are classified for the conference 2, and are used for the other conference when two video conferences are simultaneously performed.

  When only one video conference is held, both the input device and the output device for the conference 1 and the conference 2 or any one of the input device and the output device are used for the conference.

  The assignment of the input device and the output device to the conference is set by the control unit 11.

  In the present embodiment, the control unit 11 constitutes an example of a positional relationship determination unit, a division unit, a transmission unit, a reception unit, a display control unit, and the like. The control unit 11 reads out and executes various programs stored in the ROM and the storage unit 12 so that the CPU 11 performs overall control of each unit of the conference apparatus 1, as well as positional relationship determination means, division means, transmission means, and reception. Functions as display means and display control means.

  Various programs may be acquired from a server device or the like via, for example, the network NW, or may be recorded on a recording medium such as a CD-ROM and read from a drive device or the like. .

[3. Arrangement of input device and output device, display position of captured image]
Next, the arrangement of input devices and output devices such as the projector 15 and the display positions of captured images of the participants at the base B2 or B3 will be described with reference to FIGS.

  FIG. 3 is a diagram illustrating a positional relationship between the input device and the output device of the conference device 1 according to the present embodiment. Moreover, FIG. 4 is a figure which shows the example of a screen display of the captured image which concerns on this embodiment, (a) is a screen of the conference apparatus 1, (b) is a screen of the conference terminal device 2A, (C) is a screen of the conference terminal apparatus 2B. FIG. 5 is a diagram illustrating a positional relationship between the input device and the output device of the conference apparatus 1 according to the comparative example. FIG. 6 is a diagram illustrating a screen display example of a captured image according to the comparative example, where (a) is a screen of the conference device 1, (b) is a screen of the conference terminal device 2A, c) is a screen of the conference terminal apparatus 2B.

  In the following description, it is assumed that the user P11 in the base B1 participates in the conference 1 and the user P12 participates in the conference 2. In addition, it is assumed that the user P21 at the base B2 participates in the conference 1 and the user P31 at the base B3 participates in the conference 2.

  Each input device and output device are arranged as shown in FIG. 3, for example. In the figure, reference numeral 100 denotes a screen on which an image is projected by the projector 15. Users P11 and P12 sit at positions facing the display surface of the screen 100, respectively. Further, the user P11 is located on the left side toward the screen 100, and the user P12 is located on the right side toward the screen 100. That is, the participant of the meeting 1 is located on the left side of the page of FIG. 3, and the participant of the meeting 2 is located on the right side of the page of FIG. In the example shown in FIG. 3, there is one participant in each conference at the base B1, but when there are a plurality of participants, they are seated together.

  The camera 16 is disposed on the projector 16, for example. The projector 15 with the camera 16 is placed between the screen 100 and the users P11 and P12 in the vertical direction in FIG. 3 so that the user P11 and the user P12 are simultaneously within the shooting range of the camera 16. These are installed between the user P11 and the user P12 in the horizontal direction of the drawing.

  The device for the conference 1 (the microphone 17-1, the speaker 18-1, and the operation unit 19-1) is arranged on the left side of the paper, and the device for the conference 2 (the microphone 17-2, the speaker 18-2, and the operation). The part 19-2) is arranged on the right side of the page. The directivities of the microphones 17-1 and 17-2 are set. Specifically, the directivity of the microphone 17-1 is set so as to collect the utterance voice of the user P11 while not collecting the utterance voice of the user P12. In addition, the microphone 17-2 collects the voice of the user P12, and the directivity is set so as not to collect the voice of the user P11.

  In the present embodiment, the captured images of the other parties of the two conferences are displayed on the screen 100 in a positional relationship that is opposite to the positional relationship of the participants at the base B1. That is, in FIG. 3, the captured image of the other party of the conference 1 is displayed on the right side of the paper, and the captured image of the other party of the conference 2 is displayed on the left side of the paper. For example, if the display surface of the screen 100 is divided into a display area 102 and a display area 101 at the center in the left and right directions, as shown in FIG. 4A, the left display area 102 has a user P31 at the base B3. The captured image of the user P21 in the base B2 is displayed in the display area 101 on the right side.

  When the captured image is displayed in this way, the user P11 at the base B1 naturally sees the display area 101, while the user P12 naturally sees the display area 102. Therefore, as shown in FIG. The line of sight and the line of sight of the user P12 intersect on the way.

  Then, the line of sight of the user P11 and the line of sight of the user P12 necessarily pass through the vicinity of the camera 16. Therefore, when the camera 16 captures the user P11 and the user P12 in this state, it is possible to capture an image in which the user P11 and the user P12 are substantially facing the front. Therefore, this captured image is divided into a part where the user P11 is shown and a part where the user P12 is shown, the captured image of the user P11 is transmitted to the conference terminal apparatus 2A, and the captured image of the user P12 is transmitted to the conference terminal apparatus. 2B to display on each screen. Then, as shown in FIGS. 4B and 4C, an image in which the user P11 and the user P12 are substantially facing the front is displayed. In the figure, reference numeral 200 is a screen of the conference terminal apparatus 2A, and reference numeral 300 is a screen of the conference terminal apparatus 2B.

  Then, the line of sight of the user P11 on the screen 200 matches the line of sight of the user P21 at the base B2, and the line of sight of the user P12 on the screen 300 matches the line of sight of the user P31 at the base B3. Therefore, the user P21 and the user P31 can feel as if the other party of the conference is facing themselves.

  In order to clarify the effect of this embodiment, a comparative example will be described. In the comparative example, the captured images of the other parties of the two conferences are displayed on the screen 100 with the same positional relationship as the positional relationship of the participants at the base B1. That is, in FIG. 5, the captured image of the other party of the conference 1 is displayed on the left side of the paper, and the captured image of the other party of the conference 2 is displayed on the right side of the paper. Accordingly, as shown in FIG. 6A, the captured image of the user P21 at the base B2 is displayed in the left display area 101, and the captured image of the user P31 at the base B3 is displayed in the right display area 102. Is displayed.

  Then, as shown in FIG. 5, the line of sight of the user P11 and the line of sight of the user P12 do not intersect, and the line of sight passes away from the vicinity of the camera 16. Then, as shown in FIGS. 6B and 6C, the user P11 and the user P12 face left or right by the angle formed by the user P11's line of sight and the user's P12's line of sight from the direction of the camera 16, respectively. The displayed image does not match the line of sight of the user P21 or the user P31. Therefore, the user P21 and the user P31 feel that the other party's attention is not suitable for themselves, and thereby feel difficult to talk.

  Returning to the description of the present embodiment, the camera 16 (the projector 15 on which the camera 16 is mounted) is used to more accurately match the user's line of sight displayed on the screens 200 and 300 with the line of sight of the user at the bases B2 and B3. It is desirable to arrange the camera 16 in the vicinity of directly above so that the line of sight of the user P11 and the line of sight of the user P12 intersect. Strictly speaking, the recommended position of the camera 16 is a position where the line of sight of the user P11 and the line of sight of the user P12 intersect in the vicinity immediately above the camera lens.

  In addition, when dividing an image taken at the local site into two, various methods can be considered as to which position on the image to divide. For example, the simplest method is to divide it into two at the center. In this case, the participant of each conference needs to adjust the sitting position so that he / she is reflected in the captured image of the conference in which he / she participates. Further, the participant may determine the division position by operating the operation unit 19-1 or 19-2.

  Moreover, you may determine by the display position of each participant on a captured image. Specifically, the control unit 11 analyzes the captured image, identifies the image portion of the participant, and displays the captured image on the screen 100. Next, the control unit 11 causes the participant to select which conference each participant displayed on the screen 100 participates in. And the control part 11 should just make the middle of the participant in the meeting 1 and the participant in the meeting 2 a division | segmentation position on a captured image. Note that this method is used in the process of the conference apparatus 1 to be described later.

  In addition, the control unit 11 thus identifies the positional relationship between the conference 1 participants and the conference 2 participants, and receives from the conference terminal device 2 in a positional relationship opposite to the positional relationship. Image synthesis is performed so that the captured image is displayed on the screen 100 divided into display areas 101 and 102.

[4. Operation of conference equipment]
Next, the operation of the conference device will be described. When one conference has already been held, a new conference is held by the addition of users who have not participated in the conference (new participants). In some cases, some of the participants in a conference that has already been held will hold a new conference.

[4.1 When a new participant holds a new meeting]
First, the case where a new participant holds a new meeting will be described with reference to FIGS.

  FIG. 7 is a flowchart illustrating a processing example when a new participant holds a new conference in the control unit 11 of the conference apparatus 1 according to the present embodiment. FIG. 8 is a diagram showing a screen display example of a conference selection menu.

  The user P11 in the base B1 has a meeting with the user P21 in the base B2 using the conference device 1. Accordingly, the control unit 11 of the conference apparatus 1 receives the captured image and audio information transmitted from the conference terminal apparatus 2A, displays the received captured image on the screen 100 by the projector 15, and corresponds to the received audio information. Audio is output from the speaker 18-1 and the speaker 18-2. In addition, the control unit 11 causes the camera 16 to photograph the user P11, causes the microphone 17-1 or the microphone 17-2 to input the utterance voice of the user P11, and transmits a captured image and voice information obtained by these to the conference terminal apparatus 2A. To do.

  Here, when the user P12 newly joins the right side of the user P11 as a new participant, the control unit 11 detects a new participant as shown in FIG. 7 (step S1). There are various methods for detecting this new participant. For example, the user P12 may cause the control unit 11 to recognize that he / she has been added by operating the operation unit 19-2, or the control unit 11 performs image recognition processing such as an inter-frame difference method, for example. Thus, a participant in a captured image from the camera 16 (hereinafter referred to as “own site image”) may be specified, and a participant newly appearing on the own site screen may be detected as a new participant.

  Next, as shown in FIG. 8, the control unit 11 displays a conference selection menu 105 (step S2). A message indicating that a new participant has been detected is displayed on the selection menu 105, and menu items that can be selected include an item for a new participant to join the conference 1 and an item for holding a new conference 2. Is displayed. In addition, the code | symbol 103 in FIG. 8 is a captured image in the base B2, and the code | symbol 104 is a pointer for selecting the item on a screen.

  Here, when the user P12 selects any item by operating the operation unit 19-2, the control unit 11 determines whether or not a new participant has selected to hold a new conference 2 (step S3). ).

  At this time, when the new participant has selected to join the conference 1 (step S3: NO), the control unit 11 ends the process and continues the process related to the conference 1 described above. In this case, the user P11 and the user P12 are displayed on the screen 200 at the site B2.

  On the other hand, when the new participant has selected to hold a new meeting 2 (step S3: YES), the control unit 11 specifies the position of the new participant by image recognition, and determines the division position of the own base image. (Step S4).

  Next, the control unit 11 sets the connection with the conference terminal device 2B for transmission / reception of a captured image and audio information of the newly held conference 2 (step S5).

  Next, the control unit 11 assigns the microphones 17-1 and 17-2 and the speakers 18-1 and 18-2 to the conference 1 and the conference 2 respectively (step S6). Specifically, setting information indicating whether the microphones 17-1 and 17-2 and the speakers 18-1 and 18-2 are positioned on the right side or the left side is stored in the storage unit 12 in advance. ing. And the control part 11 performs allocation according to the display positional relationship on the own base image of the participant of the meeting 1 and the participant of the meeting 2, referring this setting information. In this case, the control unit 11 sets the microphone 17-1 and the speaker 18-1 for the conference 1, and sets the microphone 17-2 and the speaker 18-2 for the conference 2.

  Next, the control unit 11 intersects the line of sight to the captured image of the other party displayed on the screen 100 of the participant in the meeting 1 and the line of sight to the captured image of the other party displayed on the screen 100 of the participant in the meeting 1. Thus, the positions of the display area 101 for the conference 1 and the display area 102 for the conference 2 are set (step S7). Specifically, the control unit 11 determines that the user P11 who is a participant in the conference 1 is located on the left side (right side on the own site image) toward the screen 100 from the own site image and is a participant in the conference 2 Since it is determined that P12 is located on the right side (left side in the local site image) with respect to the screen 100, the positions of the display areas 101 and 102 are determined based on the positional relationship opposite to the positional relationship. That is, as shown in FIG. 3, the control unit 11 sets the position of the display area 101 on the right side of the screen 100 and sets the position of the display area 102 on the left side of the screen 100.

  Subsequently, the control part 11 starts the meeting 2 (step S8).

  Next, the control unit 11 divides the local image into left and right at the set division position (step S9).

  Next, the control unit 11 transmits the divided own base image to the conference terminal device 2 on the counterpart side of the corresponding conference (step S10). Here, the local site image on the right side, that is, the local site image showing the user P11 is transmitted to the conference terminal apparatus 2A, and the local site image on the left side, that is, the local site image showing the user P12 is displayed in the conference terminal apparatus. 2B. In addition, when there are a plurality of counterpart conference terminal devices 2 for each corresponding conference, the local site image is transmitted to each conference.

  Next, the control unit 11 transmits the input voices from the microphones 17-1 and 17-2 as voice information to the conference terminal device 2 on the partner side of the assigned conference (step S <b> 11). Here, the input voice from the microphone 17-1 is transmitted to the conference terminal apparatus 2A, and the input voice from the microphone 17-2 is transmitted to the conference terminal apparatus 2B. Note that the local image and the input voice may be multiplexed and transmitted.

  Next, the control unit 11 displays the captured image received from each conference terminal device 2 in the corresponding display area on the screen (step S12). Here, the captured image from the conference terminal device 2 </ b> A is displayed in the display area 101, and the captured image from the conference terminal device 2 </ b> B is displayed in the display area 102. When there are a plurality of conference terminal devices 2 on the other side for each corresponding conference, a captured image is received from each.

  Subsequently, the control part 11 outputs the audio | voice corresponding to the audio | voice information received from each meeting terminal device 2 with the speaker allocated to the respectively corresponding meeting (step S13). As for this, the audio | voice from the conference terminal device 2A is output by the speaker 18-1, and the audio | voice from the conference terminal device 2B is output by the speaker 18-2.

  Next, the control unit 11 determines whether or not the end of the meeting 1 or the meeting 2 is detected (step S14). Specifically, the control unit 11 operates when the participant at the base B1 instructs the end of the conference 1 or the conference 2 by operating the operation unit 19-1 or 19-2, or the conference terminal device 2A or the conference When a conference end request is received from the terminal device 2B, it is determined that either the conference 1 or the conference 2 is ended.

  Here, when neither the end of the conference 1 nor the end of the conference 2 is detected (step S14: NO), the control unit 11 proceeds to step S9. That is, the control unit 11 repeats the processes in steps S9 to S13 while two meetings are being performed simultaneously.

  When the control unit 11 detects the end of the conference 1 or the conference 2 (step S14: YES), the control unit 11 assigns the microphones 17-1 and 17-2 and the speakers 18-1 and 18-2 to this. It is integrated into the meeting that will continue later (step S15). Specifically, the control unit 11 assigns to the conference 2 when the end of the conference 1 is detected, and assigns to the conference 1 when the end of the conference 2 is detected.

  Next, the control unit 11 releases the connection that has been set for the conference that has ended (step S16).

  Next, the control unit 11 integrates the display area 101 and the display area 102 (step S17). That is, the control unit 11 integrates the display area so that only the captured image of the other party in the continuing meeting is displayed.

  Next, the control unit 11 ends this process and continues the process for the meeting that is to be continued.

[4.2 When some participants of an existing conference hold a new conference]
Next, a case where a part of participants of a conference already held holds a new conference will be described with reference to FIGS. 9 and 10.

  FIG. 9 is a flowchart showing a processing example in the case where a part of participants of a conference that has already been held holds a new conference in the control unit 11 of the conference device 1 according to the present embodiment. Elements similar to those in FIG. 7 are denoted by the same reference numerals. FIG. 10 is a diagram illustrating a screen display example for selecting a user participating in a new meeting.

  The user P11 and the user P12 in the base B1 are using the conference device 1 to perform a meeting with the user P21 in the base B2.

  Here, as shown in FIG. 9, the control unit 11 detects the start of a new conference 2 (step S21). For example, when the control unit 11 receives a request to start the conference 2 from the conference terminal device 2 or when the user P12 instructs the start of the conference 2 by operating the operation unit 19-2, It is determined that the meeting 2 is started.

  Subsequently, the control part 11 determines the user who participates in the new meeting 2 (step S22). Specifically, the control unit 11 identifies the participant on the local site image by the image recognition process, displays the local site image (reference numeral 106), and is displayed on the screen 100 as shown in FIG. One or a plurality of users who participate in the conference 2 are selected from the participants of the conference 1 by the participants. Here, the user P12 is selected as a user who participates in the conference 2 (in FIG. 10, the user P12 is surrounded by a broken line).

  Next, the control unit 11 determines the division position of the local site image based on the result of image recognition and the selection result by the user (step S23).

  Thereafter, the control FIG. 9 executes steps S5 to S17 in the same manner as FIG.

  In the above description, the case where the conference 2 is started from the middle of the conference 1 has been described. However, the conference 1 and the conference 2 can be started simultaneously. For example, the control unit 11 detects the simultaneous start of the conference 1 and the conference 2 by a request from the conference terminal device 2 or a user operation. And the control part 11 displays a screen as shown in FIG. 10, makes the user who participates in the meeting 1 or the meeting 2 select, and recognizes the participant who was not selected as the participant who participates in the other meeting. Just do it.

[5. Application example]
Next, application examples according to the present embodiment will be described with reference to FIGS.

  FIG. 11 is a diagram illustrating the sizes of the display areas 101 and 102 when the number of participants in the conference 1 at the local site is larger than the number of participants in the conference 2 at the local site. FIG. 12 is a diagram showing a screen display example of the conference apparatus 1 in the case shown in FIG. FIG. 13 is a diagram showing the sizes of the display areas 101 and 102 in the comparative example. FIG. 14 is a diagram illustrating the sizes of the display areas 101 and 102 when the number of participants in the conference 1 at other sites is larger than the number of participants in the conference 2 at other sites. FIG. 15 is a diagram showing a screen display example of the conference apparatus 1 in the case shown in FIG.

  In the above description, the sizes of the display area 101 and the display area 102, that is, the display magnification (display size) of the captured image of the other party of the conference 1 and the display magnification of the captured image of the other party of the conference 2 are assumed to be the same ratio (same size). However, in this application example, the display magnification is changed according to the number of participants.

  First, in the first example, the number of participants in each conference at its own base is compared, and the display magnification of the captured image of the partner of the conference with the larger number of people is compared with the display magnification of the captured image of the partner of the other conference. Also make it bigger. For example, in the example shown in FIG. 11, there are three users P11, user P13, and user P14 in the conference 1 at the base B1, and one participant in the conference 2 at the base B1. As shown in FIG. 12, the display magnification of the captured image of the other party of the conference 1 is displayed, for example, three times that of the captured image of the other party of the conference 2.

  If the display magnification of the captured image of the other party in the conference 1 and the captured image of the other party in the conference 2 are the same ratio, as shown in FIG. 13, the line of sight of the participant in the meeting 1 and the line of sight of the participant in the meeting 2 are cameras. An image with the face of the participant facing right or left is displayed on the other party's screen.

  This phenomenon is due to the following reason. When there are a plurality of conference participants at the base, for example, the participants sit side by side. When the conference is performed simultaneously, if the number of participants in one conference among the participants at the base is larger than the number of conferences in the other conference, the range occupied by the former is larger than the range occupied by the latter. When all the participants are within the shooting range of the camera 16, a part of the former enters the latter side beyond the center of the shooting range of the camera 16. In general, it is considered that each participant often sees the vicinity of the center of the captured image of the other party, so that the participant's line of sight is entirely deviated from the camera 16 (shifted to the right in the example of FIG. 13). .

  On the other hand, in the first example, the participant's line of sight is increased by enlarging the captured image of the partner of the meeting with the larger number of participants at his / her base and reducing the captured image of the partner of the meeting with the smaller number of participants. Since the camera 16 is moved as a whole, it is possible to take an image with each participant's face almost facing the front.

  In the case of the first example, the control unit 11 calculates the number of participants in each conference in the process of step S4 of FIG. 8 or step S22 of FIG. 9, and sets the calculated number of persons in the process of step S7. Based on this, the display magnification of the captured image of the other party (the display size of the display areas 101 and 102) may be changed.

  Although it is desirable to match the ratio of the captured images of the other party in the meeting 1 and the meeting 2 with the ratio of the number of participants on the local site side, it is not always necessary to do so. It is also effective to simply display the captured image of the counterpart of the meeting with the larger number of participants at the local site than the captured image of the counterpart of the meeting with the smaller number of participants.

  Next, in the second example, by comparing the number of participants of the other party of the conference at the other base, the display magnification of the captured image of the other party of the conference with the larger number of people is set to the display magnification of the captured image of the other party of the other conference. Make it larger than the display magnification. For example, in the example shown in FIG. 14, there are two users P21 and P22 in the conference 1 at the base B2, and one participant in the conference 2 is the user P31. In addition, the display magnification of the captured image of the other party in the conference 1 is displayed, for example, twice that of the captured image of the other party in the conference 2. Then, the sizes of the images of the users P21, P22, and P31 displayed on the screen 100 are almost uniform.

  This phenomenon is due to the following reason. In order for one participant or all of the participants to fall within the shooting range of the camera, it is necessary to adjust the distance from the camera to the participant. In other words, the more participants, the more each participant needs to move away from the camera. Then, the size of each participant's image in the captured image showing the participant with the larger number of participants becomes smaller than the size of each participant's image in the captured image showing the participant with the smaller number of participants. Therefore, by matching the ratio of the captured images of the other party in the meeting 1 and the meeting 2 with the ratio of the number of participants of the other party, the sizes of the images of the participants approach each other. Therefore, since the size of the other party seen from the participants at each local site becomes uniform as a whole, it can be expected that the presence of the conference is enhanced.

  Although it is desirable to match the ratio of the captured images of the other party in the meeting 1 and the meeting 2 with the ratio of the number of participants at other bases, it is not always necessary to do so. It is effective to simply display the captured image of the other party of the conference with the larger number of participants at the other bases than the captured image of the other party of the conference with the smaller number of participants.

  In the case of the second example, the control unit 11 transmits a request to transmit the number of participants in each conference to each conference terminal device 2 of the other party of the conference, for example, in step S7 of FIG. Accordingly, the number of participants in each conference transmitted from each conference terminal device 2 may be totaled. When the conference system S is a client-server system and the server device manages the number of participants for each conference, the control unit 11 may acquire this information from the server device.

  Also, by comparing the total number of participants in each conference, that is, the total number of participants at your site and the number of participants at other sites, the display magnification of the captured image of the partner of the conference with the larger number of people, You may make it larger than the display magnification of the captured image of the other party of the meeting. For example, there are three participants of the conference 1, the user P11 and the user P13 at the base B1, and the user P21 at the base B2, and the participants of the conference 2 are at the user P12 and the base B3 at the base B1. In the case of two people with the user P31, the display magnification of the captured image of the other party of the conference 1 is displayed, for example, 1.5 times that of the captured image of the other party of the conference 2.

  In this case, for example, the control unit 11 specifies the number of participants at its own base and the number of participants at other bases by the processing described in the first example and the second example, and adds them to each conference. The total number of participants can be calculated.

  As described above, according to the present embodiment, when the conference 1 and the conference 2 are simultaneously held, the control unit 11 participates in the conference 1 in the base B1 and the conference 2 in the base B1. The positional relationship between the conference 1 and the conference 2 when the person's sitting position is viewed toward the screen 100 is determined. Then, the control unit 11 divides the local site image into two on the left and right sides in a positional relationship opposite to this positional relationship, and determines the one corresponding to the conference 1 of each divided local site image as the conference on the other side of the conference 1. It transmits to the terminal device 2 and transmits the person corresponding to the conference 2 to the conference terminal device 2 on the other side of the conference 2. To do. Further, the control unit 11 receives captured images respectively transmitted from the conference terminal device 2 on the other side of the conference 1 and the conference terminal device 2 on the other side of the conference 2, and is in a position opposite to the determined positional relationship. The projector 15 displays an image in which these captured images are positioned in relation.

  Therefore, by using only one conference apparatus 1, each of a plurality of participants at the base B1 can participate in a necessary conference among the two conferences to be performed simultaneously. Further, since the participant's line of sight passes through or near the camera 16, when the participant is photographed by the camera 16, it is possible to take an image with each participant's face almost facing the front, thereby displaying this image on the screen. The other party you saw in can hold the meeting without feeling uncomfortable.

  In addition, by installing the camera 16 immediately below the position where the line of sight of the participant in the meeting 1 and the line of sight of the participant in the meeting 2 intersect, it is possible to take an image in which each participant's face is almost directly in front. it can.

  Moreover, since the control part 11 specifies the image of each participant reflected in the own base image by image recognition and selects which meeting the participant participates using the operation part 19-2 etc., As long as each participant sits together for each meeting, the positional relationship of the participants in each meeting can be specified even if the sitting position of the participants is somewhat free.

  Further, the control unit 11 determines the positions of the participants of the conference 1 and the conference 2 as the left side and the right side, respectively, and the screen display by the projector 15 and the speaker 18-1 so that each participant sits in this positional relationship. When the participant is instructed by voice output according to 18-2, the positional relationship of the participants in each conference can be set in advance on the conference device 1 side.

  In addition, when the control unit 11 matches the display magnification ratio of the captured image of the other party in the conference 1 and the conference 2 with the ratio of the number of participants in the conference 1 and the conference 2 on the local site side, Even if the number of participants is different from each other, it is possible to suppress the deviation of the line of sight of each participant from the camera 16 and to take an image in which the direction of each participant's face is close to the front.

  Further, when the control unit 11 matches the ratio of the display magnification of the captured image of the other party in the meeting 1 and the meeting 2 with the ratio of the number of participants in the meeting 1 and the meeting 2 on the other base side, the screen 100 Since the size of each participant's image displayed on the screen becomes uniform, it can be expected to enhance the presence of the conference.

  Moreover, the control part 11 specifies the image of the participant of the meeting 1 and the image of the participant of the meeting 2 on the own site image by image recognition, and the participant 1 of the meeting 1 is reflected in the own site image. And the image showing the participants of the conference 2 are divided and transmitted to the corresponding conference terminal devices 2, so that the other party of the conference captures the captured image in which all the users participating in the conference are reliably reflected. Can see.

  In the above embodiment, the present invention is applied when two conferences are held at the same time, but may be applied when three or more conferences are held at the same time. For example, when three conferences are held at the same time, the conference 1 may be determined on the left side, the conference 2 on the center, the conference 3 on the right side, and the positional relationship of the participants between the conferences.

  Moreover, in the said embodiment, although the captured image of the camera 16 was divided | segmented into right and left and it was made to transmit to the conference terminal device 2, if it respond | corresponds even to the positional relationship of a participant, it will differ from the left-right direction. It may be divided in the direction.

It is a block diagram which shows an example of schematic structure of the conference system which concerns on one Embodiment. It is a block diagram which shows an example of schematic structure of the conference apparatus 1 which concerns on one Embodiment. It is a figure which shows the positional relationship of the input device, output device, etc. of the conference apparatus 1 which concerns on one Embodiment. It is a figure which shows the example of a screen display of the captured image which concerns on one Embodiment, (a) is the screen of the conference apparatus 1, (b) is the screen of the conference terminal device 2A, (c) is a conference It is a screen of the terminal device 2B. It is a figure which shows the positional relationship of an input device, an output device, etc. of the conference apparatus 1 which concerns on a comparative example. It is a figure which shows the example of a screen display of the captured image which concerns on a comparative example, (a) is a screen of the conference apparatus 1, (b) is a screen of the conference terminal device 2A, (c) is a conference terminal It is a screen of the apparatus 2B. It is a flowchart which shows the process example in the case of a new participant holding a new meeting in the control part 11 of the conference apparatus 1 which concerns on one Embodiment. It is a figure which shows the example of a screen display of the selection menu of a meeting. It is a flowchart which shows the process example in case one of the participants of the already held meeting holds a new meeting in the control part 11 of the conference apparatus 1 which concerns on one Embodiment. It is a figure which shows the example of a screen display for selecting the user who participates in a new meeting. It is a figure which shows the size of the display areas 101 and 102 in case there are more participants of the meeting 1 in its own base than the participants of the meeting 2 in its own base. It is a figure which shows the example of a screen display of the conference apparatus 1 in case there are more participants of the meeting 1 in an own base than the participants of the meeting 2 in an own base. It is a figure which shows the size of the display areas 101 and 102 in a comparative example. It is a figure which shows the size of the display areas 101 and 102 in case there are more participants of the meeting 1 in another base than the participants of the meeting 2 in another base. It is a figure which shows the example of a screen display of the conference apparatus 1 in case there are more participants of the meeting 1 in another base than the participants of the meeting 2 in another base.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Conference apparatus 2, 2A, 2B Conference terminal apparatus 11 Control part 12 Storage part 13 Communication part 14 Input / output part 15 Projector 16 Camera 17-1, 17-2 Microphone 18-1, 18-2 Speaker 19-1, 19- 2 Operation unit 20 System bus NW network S Conference system

Claims (11)

An image capturing unit that captures a captured image captured by a participant of a conference with another conference apparatus via a communication unit and captures a transmitted captured image that is a captured image to be transmitted, and the received captured image. A conference photographed image processing method in a conference apparatus comprising: a display unit that displays a received photographed image on a screen,
When at least one person participates in each of a plurality of conferences simultaneously performed from among the plurality of participants photographed by the photographing unit, the plurality of participants positioned separately for each conference are directed toward the screen. A positional relationship determination step for determining a positional relationship between the conferences of the participants when viewed;
The transmission photographed image is divided into images corresponding to each of the plurality of conferences with a display positional relationship opposite to the determined positional relationship, and each of the divided images is used for the corresponding conference. To each conference device,
The received captured images corresponding to each of the plurality of conferences are received from one or a plurality of other conference devices, respectively, and each of the plurality of conferences is displayed with a positional relationship on the display that is opposite to the determined positional relationship. A split transmission / reception display step in which the display means displays on the screen an image in which the received photographed image is correspondingly positioned;
A meeting photographed image processing method comprising: In the meeting picked-up image processing method of Claim 1,
The position at which the line of sight when the plurality of participants see the received captured images of the conference in which the self is displayed displayed on the screen intersects between the conferences and the position of the imaging unit match, A conference photographed image processing method, wherein the photographing means is located. In the meeting photo image processing method according to claim 1 or 2,
The positional relationship determining step specifies the position of each of the plurality of participants on the transmission photographed image and the conference to participate in, and determines the positional relationship based on the location and the conference. Meeting image processing method to do. In the meeting picked-up image processing method of any one of Claims 1 thru | or 3,
The conference photographed image further comprising an instruction information presenting step for presenting instruction information for instructing the participant to be positioned so as to be in the positional relationship determined in the positional relationship determining step. Processing method. In the meeting picked-up image processing method of any one of Claims 1 thru | or 4,
In the positional relationship determination step, specify the number of participants in each of the plurality of meetings,
In the divided transmission / reception display step, the received photographed image corresponding to a meeting in which the specified number of participants is larger than other meetings is displayed larger than the received photographed image corresponding to the other meeting. A method for processing a conference photographed image. In the meeting picked-up image processing method of any one of Claims 1 thru | or 5,
Number-of-persons information receiving means for receiving, via communication means, number-of-persons information indicating the number of persons participating in at least one of the plurality of meetings using the other meeting device;
Based on the received number information, the number of participants in each of the plurality of conferences is specified within the range of the participants using the other conference device,
In the divided transmission / reception display step, the received photographed image corresponding to a meeting in which the specified number of participants is larger than other meetings is displayed larger than the received photographed image corresponding to the other meeting. A method for processing a conference photographed image. In the meeting photo image processing method according to claim 3,
In the divided transmission / reception display step, the transmission photographed image is divided so that the images of the plurality of participants are respectively included on images corresponding to the conference in which the participant participates among the plurality of divided images. A method for processing a conference photographed image. In the meeting picked-up image processing method of Claim 3 or Claim 7,
In the positional relationship determination step, each of the plurality of participants participates based on participation conference information input using an input unit as information indicating a conference in which the participant whose image position is specified participates. A meeting photographed image processing method characterized by specifying a meeting. In the meeting picked-up image processing method of any one of Claims 1 thru | or 8,
A determination step of determining whether or not all the participants photographed by the photographing means participate in only one meeting;
The transmission photographed image is transmitted to the other conference device used for the one conference,
A non-divided transmission / reception display step of receiving the received photographed image corresponding to the one conference from one or a plurality of other conference devices and displaying the received photographed image on the screen by the display means; Prepared,
When all the participants participate only in the one meeting, the non-split transmission / reception display step is performed,
The conference photographed image characterized by performing the positional relationship determination step and the divided transmission / reception display step when at least one person participates in each of a plurality of conferences held simultaneously from the plurality of participants. Processing method. A conference device that transmits and receives captured images taken by participants of a conference to and from other conference devices via communication means,
Photographing means for photographing a transmission photographed image that is the photographed image to be transmitted;
Display means for displaying a received photographed image as the received photographed image on a screen;
When at least one participant participates in each of a plurality of conferences held simultaneously from among the plurality of participants photographed by the photographing means, the plurality of participants positioned separately for each conference are directed toward the screen. Positional relationship determining means for determining the positional relationship between the conferences of the participants when viewed;
A dividing unit that divides the transmission photographed image into images corresponding to each of the plurality of meetings in a display positional relationship that is opposite to the determined positional relationship;
Transmitting means for transmitting each of the divided images to the other conference devices used for the corresponding conference;
Receiving means for receiving the received photographed image corresponding to each of the plurality of conferences from one or a plurality of other conference devices;
Display control means for causing the display means to display an image in which the received photographed image is positioned corresponding to each of the plurality of conferences in a display positional relation opposite to the determined positional relation;
A conference apparatus comprising: An image capturing unit that captures a captured image captured by a participant of a conference with another conference apparatus via a communication unit and captures a transmitted captured image that is a captured image to be transmitted, and the received captured image. A computer included in the conference apparatus, comprising: display means for displaying a certain received photographed image on the screen;
When at least one person participates in each of a plurality of conferences simultaneously performed from among the plurality of participants photographed by the photographing unit, the plurality of participants positioned separately for each conference are directed toward the screen. Positional relationship determining means for determining the positional relationship between the conferences of the participants when viewed;
A dividing unit configured to divide the transmission photographed image into images corresponding to each of the plurality of meetings in a display positional relationship opposite to the determined positional relationship;
Transmitting means for transmitting each of the divided images to the other conference devices used for the corresponding conference;
Receiving means for receiving the received photographed image corresponding to each of the plurality of conferences from one or a plurality of the other conference devices; and
Display control means for causing the display means to display an image in which the received photographed image is positioned in correspondence with each of the plurality of conferences in a display positional relation opposite to the determined positional relation;
A program for conference processing, characterized in that it functions as a program.

Images