WO2010067802A1 - Conference system - Google Patents

Abstract

When it is determined, in a television conference apparatus, that there has been given an instruction of connection destination candidate selection request, a connection destination candidate selection request command is transmitted (step S12).  Next, a process of acquiring a connection destination candidate image is executed (step S14).  Next, a connection destination candidate list is generated (step S15).  Next, a management server transmits the generated connection destination candidate list (step S15#).  The television conference apparatus receives the connection destination candidate list (step S16).  Then, the television conference apparatus displays the connection destination candidate list (step S17).

Description

Conference system

The present invention relates to a conference system, and more particularly to a conference system capable of remote information communication by connecting conference devices provided between a plurality of bases.

In recent years, there has been an increasing demand for network computing technology for connecting computers to each other. By connecting computers to each other via a network, computer resources can be shared and information can be shared smoothly.

For example, a video conference system can be cited as a system that realizes bidirectional communication of information by a plurality of people via a network. According to the video conference system, it is possible to transmit an image and sound between conference rooms that are bases away from each other, and to proceed with the conference while looking at the faces of the participants reflected on the TV screen.

Actually, it is possible to proceed with the conference as if participants in remote locations are in the same conference room. Moreover, since each person's movement is not accompanied, it leads also to effective use of time, reduction of expenses, such as travel expenses.

Generally, a video conference system is composed of an input / output device for images and sounds such as a camera, a microphone, a monitor, and a speaker, a communication device for connecting each point, a line, and the like.

On the other hand, when using the video conference system, it is necessary to specify the IP address or telephone number of the connection partner. Therefore, it is necessary to ask in advance the IP address or telephone number of the connection partner.

Also, the IP address or telephone number is often determined for each conference room location. If the conference room is changed, it is necessary to re-inquire the connection partner and find the connection partner easily. Connection is required.

In this regard, Japanese Patent Application Laid-Open No. 2006-5590 discloses a system capable of easily searching for a connection partner when connecting by registering information related to the base system in advance such as a face image. ing.

JP 2006-5590 A

However, the system disclosed in the above publication is for registering information related to the base system in advance and displaying the information, and cannot grasp the current status of the base. Therefore, it is not known whether the other party exists at the connection base when connecting. In addition, there is a possibility that the connection will be made unintentionally, for example, when the connection destination is set incorrectly or when the previous meeting is prolonged and not yet ready.

The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a conference system that can easily and surely establish a communication connection with a desired connection destination.

The conference system according to the present invention is a communication connection between a plurality of conference devices connected to each other via a network and capable of bidirectional communication of information, each including a display unit, and conference devices selected from the plurality of conference devices. And a management server connected via a network. When there is a request for communication connection with another conference device among a plurality of conference devices, the management server installs a conference device for a conference device that is a connection destination candidate connected via a network. Connection destination candidate status acquisition unit that acquires the surrounding status information of the selected base, a connection destination candidate list generation unit that generates a list of connection destination candidates from the ambient status information acquired by the connection destination candidate status acquisition unit, and a connection destination candidate list A connection control unit that executes communication connection with another conference apparatus that is a connection destination selected from the above.

Preferably, the connection destination candidate status acquisition unit acquires camera image information of a base installed from a conference apparatus that is a connection destination candidate as surrounding status information.

In particular, each conference device includes an image capturing unit that captures an image of a site where the corresponding conference device is installed, and a control unit that controls the image capturing unit. In response to the instruction, the control unit acquires the camera image information of the base where the corresponding conference device is installed from the imaging unit, and outputs it to the connection destination candidate status acquisition unit of the management server.

In particular, the imaging unit has a fisheye lens.
In particular, the management server further includes a face image extraction unit that extracts a face image based on the acquired camera image information.

In particular, it further includes a human management server that registers human attribute information including face images. The connection destination candidate list generation unit acquires human attribute information registered in the human management server based on the face image extracted by the face image extraction unit, and generates a list of connection destination candidates including the acquired human attribute information To do.

Preferably, the management server has a connection availability management table in which the permission of connection from other conference devices in each of the plurality of conference devices is registered. When there is a request for communication connection with another conference device among a plurality of conference devices, the connection destination candidate status acquisition unit is permitted to connect from another conference device based on the connection availability management table. For the conference device that is a candidate for the connection destination, the surrounding state information of the base where the conference device is installed is acquired.

Preferably, the management server has a device information management table in which information to be displayed as a list of connection destination candidates is registered together with the surrounding state information in each of the plurality of conference devices. The connection destination candidate list generation unit generates a list of connection destination candidates from the information registered in the device information management table and the surrounding status information acquired by the connection destination candidate status acquisition unit.

In particular, the management server further includes display presence / absence management information in which the presence / absence of display of predetermined information among the information registered in the device information management table in each of the plurality of conference devices is registered. The connection destination candidate list generation unit includes the predetermined information registered in the device information management table when the display of predetermined information is permitted based on the display presence / absence management information and the surroundings acquired by the connection destination candidate status acquisition unit A list of connection destination candidates is generated from the status information.

Another conference system according to the present invention includes a plurality of conference apparatuses that are connected to each other via a network and each capable of bidirectional communication of information includes a display unit. When there is a request for communication connection with another conference device among a plurality of conference devices, each conference device is installed with respect to the conference device that is a connection destination candidate connected via the network. A connection destination candidate status acquisition unit that acquires the surrounding status information of the selected base, a connection destination candidate list generation unit that generates a list of connection destination candidates from the ambient status information acquired by the connection destination candidate status acquisition unit, and a connection destination candidate A connection control unit that performs communication connection with another conference apparatus that is a connection destination selected from the list of connection destination candidates generated by the list generation unit.

When there is a request for communication connection, the conference system according to the present invention acquires the surrounding situation information of the base where the conference device is installed for the conference device that is a connection destination candidate connected via the network. Since a list of connection destination candidates is generated from the surrounding state information, it is possible to grasp the current state of other conference apparatuses, and it is possible to easily and reliably establish communication connection with a desired connection destination.

It is the schematic explaining the conference system according to Embodiment 1 of this invention. It is a schematic block diagram explaining the structure of the video conference apparatus and management server according to Embodiment 1 of this invention. It is a flowchart explaining the flow of a process at the time of performing the starting process of the video conference apparatus according to embodiment of this invention. It is a figure explaining the connection destination management table according to Embodiment 1 of this invention. It is a flowchart explaining the flow of a process in the case of selecting a connection destination candidate according to Embodiment 1 of this invention, and performing a connection. It is a flowchart explaining the connection destination candidate image acquisition process according to Embodiment 1 of the present invention. It is a figure explaining the selection screen (connection destination candidate list selection screen) of a connection destination candidate list according to the embodiment of the present invention. FIG. 6 is a flowchart for explaining connection processing in a connection execution unit 18. It is a figure explaining another connection destination management table according to Embodiment 1 of this invention. It is a figure explaining the attendee confirmation screen according to the modification of Embodiment 1 of this invention. It is a flowchart explaining the flow of the process which displays the attendance confirmation screen according to the modification of Embodiment 1 of this invention. It is a figure explaining the apparatus information registration screen 200 according to Embodiment 2 of this invention. It is a flowchart explaining the process which registers the temporary connection conditions according to Embodiment 3 of this invention. It is a figure explaining the temporary connection setting screen according to Embodiment 3 of this invention. It is a figure explaining the temporary connection possibility setting screen 315 according to Embodiment 3 of this invention. It is a figure explaining the connection destination management table according to Embodiment 3 of this invention. It is a figure explaining meeting participant restriction condition setting screen 330 according to Embodiment 3 of the present invention. It is a flowchart explaining the selection process of the connection destination candidate based on the temporary connection conditions according to Embodiment 3 of this invention. It is a flowchart explaining the process in the case of using the audio | voice information according to Embodiment 4 of this invention as surrounding condition information. It is a schematic block diagram explaining the video conference apparatus 2 # according to the fifth embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same.

(Embodiment 1)
FIG. 1 is a schematic diagram illustrating a conference system according to the first embodiment of the present invention.

Referring to FIG. 1, the conference system 1 includes a management server 10, a human management server 10 #, and video conference apparatuses 2 to 4.

The management server 10, the human management server 10 #, and the video conference apparatuses 2 to 4 are connected to each other via a network 5.

In this example, the case where the video conference apparatuses 2 to 4 are connected to each other via a network will be described. However, the present invention is not limited to this, and a conference system in which a plurality of video conference apparatuses are connected to the network may be used. It is also possible to connect a smaller number of video conferencing apparatuses to the network.

The management server 10 is a server that manages communication connections in the video conference apparatuses 2 to 4.
Further, the person management server 10 # stores in advance attribute information related to users who use the video conference apparatuses 2 to 4, and outputs the attribute information as necessary.

The network 5 may be a LAN (Local Area Network) or a WAN (Wide Area Network) using a public line or the like. In this example, it is assumed that these video conference apparatuses 2 to 4 are provided at respective remote sites as an example.

FIG. 2 is a schematic block diagram illustrating the configuration of the video conference device and the management server according to the first embodiment of the present invention.

Referring to FIG. 2, video conference device 2 according to the first embodiment of the present invention includes a control unit 21, a camera unit 22, a memory unit 23, an audio input unit that controls communication connection for executing a video conference. The output part 24, the communication part 26, the display part 28, the operation part 30, and the internal bus 34 which connects each part are included. Since other video conference apparatuses 3 and 4 have the same configuration, detailed description thereof will not be repeated.

The camera unit 22 acquires a captured image at the base where the video conference device 2 is provided. Here, the camera unit 22 can acquire a captured image of the entire site by panning, tilting, or zooming the camera in response to the instruction. The operation of the camera unit 22 can be determined in advance.

In addition, the lens provided in the camera unit can be a fish-eye lens as an example. By using a fisheye lens, it is possible to obtain a wide viewing angle, and it is possible to reduce the operating range of panning or tilting the camera unit with respect to the range of shooting in the camera unit.

The memory unit 23 is used as a work area for temporarily storing software programs necessary for controlling the video conference device 2 and data necessary for executing control processing in the control unit 21.

The audio input / output unit 24 receives audio input at a site where the video conference device 2 is installed, outputs the audio signal to a video conference device provided at another site, and is provided at another site. The audio signal output from the video conference device is output.

The communication unit 26 exchanges data with the video conference device 2 or the management server 10 and the human management server 10 # connected via the network 5.

The display unit 28 is a display and displays a received captured image captured by a camera unit such as another video conference device.

The operation unit 30 includes an operation key (not shown) for executing a predetermined operation of the video conference device 2, and the control unit 21 receives a predetermined operation instruction input of the operation key and performs a predetermined operation of the video conference device 2. Execute. In addition, the operation unit 30 includes a remote control receiving unit 32, and the remote control receiving unit 32 receives a remote control signal from the remote control 36 and outputs an instruction corresponding to the remote control signal to the control unit 21.

The control unit 21 loads a software program stored in the memory unit 23 and controls the entire units of the video conference apparatus 2.

In addition, the management server 10 according to the first embodiment of the present invention includes a communication unit 11 that transmits and receives data to and from a video conference device or a human management server 10 # connected via a network, and a connection destination candidate management unit 12. A connection destination management table 13, an internal bus 14, a face image extraction unit 15, a connection destination candidate status acquisition unit 16, a connection destination candidate list generation unit 17, and a connection execution unit 18.

The connection destination candidate management unit 12 extracts candidates for connection based on the connection candidate list managed in the connection destination management table 13.

The connection destination candidate status acquisition unit 16 acquires a captured image captured by the camera unit 22 of the video conference apparatus extracted as the connection destination candidate.

The face image extraction unit 15 extracts a face image of a person included in the captured image acquired by the connection destination candidate status acquisition unit 16.

The connection destination candidate list generation unit 17 connects based on the video conference device extracted as the connection destination candidate and the captured image captured by the camera unit 22 of the video conference device acquired by the connection destination candidate status acquisition unit 16. Generate a destination candidate list.

Then, the connection destination candidate list generation unit 17 outputs the connection destination candidate list generated via the communication unit 11 to the video conference apparatus.

The connection execution unit 18 receives a connection selection instruction from the connection destination candidate list of the video conference apparatus transmitted from the video conference apparatus, and executes communication connection with the selected connection destination candidate.

FIG. 3 is a flowchart illustrating a process flow when the activation process of the video conference apparatus according to the embodiment of the present invention is executed.

Referring to FIG. 3, it is first determined whether or not the power supply of the video conference apparatus is turned on (step S1).

Then, when it is determined that the power is turned on, a startup process is executed (step S2). Specifically, the control unit 21 loads a software program for controlling the operation of the video conference apparatus stored in the memory unit 23. It is assumed that the control process of each unit in the video conference apparatus 2 can be performed by the process.

Next, a startup notification is transmitted (step S3). Specifically, the control unit 21 notifies the management server 10 registered in advance that the activation has been started via the communication unit 26 (step S3).

Then, the management server 10 receives the activation notification transmitted from the video conference device via the communication unit 11 (step S4).

Then, the connection destination candidate management unit 12 of the management server 10 transmits a device information acquisition request command (step S5). Specifically, the connection destination candidate management unit 12 transmits a device information acquisition request command via the communication unit 11 to the video conference device to which the activation notification is transmitted.

Then, the video conference device 2 receives a device information acquisition request command (step S6). Specifically, the control unit 21 receives a device information acquisition request command via the communication unit 26.

And the control part 21 transmits apparatus information based on an apparatus information acquisition request command (step S7).

Specifically, the control unit 21 receives the device information acquisition request command and transmits the previously registered device information stored in the memory unit 23 to the management server 10 via the communication unit 26.

Then, the management server 10 receives the device information (Step S8).
Specifically, the connection destination candidate management unit 12 of the management server 10 receives the device information transmitted from the video conference device 2 via the communication unit 11.

Then, the connection destination candidate management unit 12 registers the received device information in the connection destination management table (step S9).

Then, the process ends (END).
The video conference apparatus activated in the management server 10 by this process is registered as a connection destination candidate and is included in a connection destination candidate list described later.

FIG. 4 is a diagram illustrating a connection destination management table according to the first embodiment of the present invention.
Referring to FIG. 4, here, as an example, a case where a video conference apparatus B and a video conference apparatus C are registered is shown. Specifically, IDs are given in the registered order.

As an example, it is assumed that the video conference apparatus B is registered with an ID number “1” and the video conference apparatus C is registered with an ID number “2”.

Also, the case where “IP address”, “name”, and “installation location” are registered as the device information of the video conference device B is shown. Specifically, “IP address” is registered as “10.0.680.010”, “name” is registered as “planning department No. 1”, and “installation location” is registered as “head office first conference room”. Also, as the device information of the video conference device C, the “IP address” is registered as “10.80.30.88”, the “name” as “planning department 3”, and the “installation location” as “sales office meeting room”. Has been.

In this example, since the video conference apparatuses B and C are not yet connected, the “connected” item is set to “none”.

In addition, in the item “current image”, it is assumed that a camera image provided in a corresponding video conference device is registered as described later. In this example, one camera image is described as an example, but it is also possible to acquire and register a plurality of camera images by panning or tilting the camera unit.

FIG. 5 is a flowchart illustrating a processing flow when a connection destination candidate is selected and a connection is executed according to the first embodiment of the present invention.

Referring to FIG. 5, it is first determined whether or not there is an instruction to select a connection destination candidate in the video conference apparatus (step S11). Specifically, the operation unit 30 of the video conference apparatus 2 is provided with a connection destination candidate selection request button (not shown), and the determination is made based on whether or not the selection request button is pressed.

If it is determined in step S11 that a connection destination candidate selection request instruction has been issued, a connection destination candidate selection request command is then transmitted (step S12).

Specifically, the control unit 21 transmits a connection destination candidate selection request command to the management server 10 via the communication unit 26. In this example, the case where the connection destination candidate selection request command is transmitted when the selection request button is pressed is described. However, the present invention is not limited to the pressing of the button, for example, provided in the display unit A connection destination candidate selection request instruction may be executed from the menu screen, or may be an instruction from a remote controller, and a connection destination candidate selection request instruction is transmitted to the management server 10. Anything is fine.

Next, the management server 10 receives a connection destination candidate selection request command (step S13). Specifically, the connection destination candidate management unit 12 of the management server 10 receives a connection destination candidate selection request command via the communication unit 11.

Next, a connection destination candidate image acquisition process is executed (step S14).
FIG. 6 is a flowchart illustrating connection destination candidate image acquisition processing according to the first embodiment of the present invention.

Referring to FIG. 6, first, the management server 10 transmits an image acquisition request command to the video conference apparatus that is a connection destination candidate based on the connection destination candidate management table (step S31). Specifically, the connection destination candidate management unit 12 transmits an image acquisition request command to each of the video conference devices registered based on the connection destination candidate management table via the communication unit 11.

And each video conference device receives the image acquisition request command. Specifically, the control unit 21 of the video conference apparatus to which the image acquisition request command has been transmitted receives the image acquisition request command via the communication unit 26.

Then, a camera image is acquired by the camera unit 22 of the video conference device (step S33). Specifically, the control unit 21 instructs the camera unit 22 to acquire a camera image according to the image acquisition request command. The camera unit 22 acquires a camera image of the base where the video conference device is provided according to the instruction.

Then, the camera image is transmitted (step S34). Specifically, the control unit 21 of the video conference device transmits the camera image acquired by the camera unit to the management server 10 via the communication unit 26.

The management server 10 receives the camera image transmitted from each video conference device (step S35).

Specifically, the connection destination candidate status acquisition unit 16 of the management server 10 receives the camera image transmitted from each video conference device via the communication unit 11.

Then, the camera image is registered (step S36). Specifically, the connection destination candidate status acquisition unit 16 registers the acquired camera image in the connection destination management table 13 by linking with the corresponding video conference device.

Then, the process ends (return). In other words, the processing returns to the processing of FIG.
Next, referring to FIG. 5 again, next, a connection destination candidate list is generated (step S15). Specifically, the connection destination candidate list generation unit 17 of the management server 10 generates a connection destination candidate list based on the connection destination management table 13.

Then, the management server 10 transmits the generated connection destination candidate list (step S15 #). Specifically, the connection destination candidate management unit 12 sends the connection destination candidate list generated by the connection destination candidate list generation unit 17 to the video conference apparatus that has transmitted the connection destination candidate selection request command via the communication unit 11. To send.

Next, the video conference apparatus receives the connection destination candidate list (step S16). Specifically, the control unit 21 receives a connection destination candidate list via the communication unit 26.

Then, the video conference apparatus displays a connection destination candidate list (step S17). Specifically, the control unit 21 displays the received connection destination candidate list on the display unit 28.

FIG. 7 is a diagram illustrating a connection destination candidate list selection screen (connection destination candidate list selection screen) according to the embodiment of the present invention.

Referring to FIG. 7, a connection destination candidate list selection screen generated by the connection destination candidate list generation unit 17 is shown.

Here, as an example, a case where “current image” is displayed together with “name” and “installation location” as device information is shown. Specifically, the display of “Planning Department No. 1” and “Head Office No. 1 Meeting Room” and the camera images taken at the base of “Head Office No. 1 Meeting Room” where “Planning Department No. 1” is provided. The case where it is displayed is shown.

Similarly, “Planning Department No. 3” and “Sales Office Meeting Room” are displayed, and camera images taken at the base of “Sales Office Meeting Room” where “Planning Department No. 3” is displayed. The case is shown.

It is assumed that the user can specify a selectable connection destination displayed on the connection destination candidate list selection screen by using a cross key or a pointing device (not shown) of the operation unit 30. Specifically, by specifying a selectable connection destination using a pointing device, the check box 110 provided at the left end is checked, and it is possible to recognize that the connection destination is selected by the display. It shall be.

Then, it is possible to instruct connection processing with a connection destination in a selected state by selecting (pressing) the “connect” button 102. Also, by selecting (pressing) the “Cancel” button 104, the display of the connection destination candidate list is terminated and the screen returns to the initial screen.

Also, it is assumed that the display format is changed by selecting (pressing) the “all display” button 106 so that all connection destination candidate lists are displayed as much as possible on one screen.

In addition, a search screen is displayed by selecting (pressing) the “search” button 108, and a search result is displayed by inputting, for example, “name” or “installation location” on the search screen. .

It is also possible to enlarge and display the displayed image by selecting (pressing) the display area 112 of “current image”.

With this configuration, that is, the selection screen of the connection destination candidate list, the user confirms in advance the camera image captured by the camera unit of the video conference device provided at each site before connecting the video conference. Is possible.

Therefore, it is possible to connect the video conference by confirming that the other party that the user desires exists at the connection base before connecting, and it is possible to suppress erroneous setting of the connection destination. There is no unintentional connection if your meeting is long and not ready yet.

In addition, although the case where a camera image is used as the surrounding state information of the connection base in the connection destination candidate list has been described here, any information can be used as long as it can grasp the surrounding situation of the connection base.

In other words, since it is possible to acquire the surrounding state information of the partner connection base in the connection destination candidate list, it is possible to realize a conference system that can easily and reliably communicate with a desired connection destination. is there.

Again, referring to FIG. 5, it is determined whether or not there is a next selection (step S18).
Specifically, the control unit 21 of the video conference device 2 determines whether there is a selection from the connection destination candidate list according to the operation instruction of the operation unit 30.

If it is determined in step S18 that there is a selection, the video conference device transmits a connection request command (step S19). Specifically, the control unit 21 transmits a connection request command for requesting connection with a connection destination selected from the connection destination candidate list to the management server 10 via the communication unit 26.

Then, the management server 10 receives a connection request command (step S20). Specifically, the connection execution unit 18 receives a connection request command via the communication unit 11.

And the connection execution part 18 performs a connection process (step S21).
FIG. 8 is a flowchart for explaining connection processing in the connection execution unit 18.

Referring to FIG. 8, connection execution unit 18 transmits a connection execution command to the video conference device via communication unit 11 (step S41).

Then, the video conference device receives a connection execution command (step S42). Specifically, the control unit 21 receives a connection execution command via the communication unit 26.

Then, the control unit 21 receives the connection execution command and executes a connection process with the selected connection destination to execute a communication connection between them (step S43).

Then, the video conference device transmits a connection approval notification (step S44). Specifically, the control unit 21 transmits a connection approval notification indicating that a communication connection has been executed to the management server 10 via the communication unit 26.

The management server 10 receives a connection approval notification via the communication unit 11 (step S45). Specifically, the connection execution unit 18 receives a connection approval notification via the communication unit 11.

Then, the management server 10 registers in the connection destination management table (step S46). Specifically, the connection execution unit 18 receives the connection approval notification, and the item “connected” of the corresponding video conference apparatus received in the connection destination management table is changed.

Then, the process ends (END).
FIG. 9 is a diagram illustrating another connection destination management table according to the first embodiment of the present invention.

Referring to FIG. 9, as described with reference to FIG. 4, the case where the video conference apparatus B and the video conference apparatus C are registered is shown here as an example. Further, the case where the video conference apparatus A is registered is shown.

Specifically, it is assumed that the video conference apparatus A is registered with the ID number “3”.

Also, the case where “IP address”, “name”, and “installation location” are registered as device information of the video conference device A is shown. Specifically, “IP address” is registered as “10.90.10.90”, “name” is registered as “development department No. 1”, and “installation location” is registered as “development center third conference room”.

In this example, since the video conference apparatus A and the video conference apparatus C are still connected, an ID number corresponding to the connected apparatus is registered in the item “connected”. Specifically, the ID number “1” is registered in the “connected” item of the video conference apparatus B, and the ID number “3” is registered in the “connected” item of the video conference apparatus A. The case is shown.

In addition, although the case where ID number is registered is shown here, it is not restricted to this in particular, The name which is a connection destination may be sufficient, and other identifiable information may be sufficient.

By this processing, the user can select a desired connection destination from the connection destination candidate list and execute communication connection by the video conference apparatus.

Specifically, by using a video conference device provided in a conference room that is a remote base, an image acquired by the camera unit 22 and an audio signal input by the audio input / output unit 24 are connected to different connection destinations. To the other video conference device and displayed on the display unit 28 of another video conference device, and outputs an audio signal via the audio input / output unit 24. By performing the processing in both directions, the conference can actually proceed as if the participants in remote places are in the same conference room.

In this example, the video conference apparatus has described the method of receiving an image acquisition request command and acquiring and transmitting a camera image using the command as a trigger. In particular, the video conference apparatus uses the command as a trigger. Alternatively, a method of automatically acquiring a camera image and transmitting it to the management server 10 may be employed. In the case of this method, it is possible to register an actual camera image as ambient state information by acquiring a camera image at regular intervals and transmitting it to the management server 10.

Although not shown, it is also possible to detect the presence of a person using an infrared sensor or the like and acquire a camera image by the camera unit based on the detection result.

(Modification of Embodiment 1)
In the configuration of FIG. 7 described above, it is possible to easily and reliably establish a communication connection with a desired connection destination by including the camera image acquired by the camera unit of the video conference apparatus as the surrounding state information in the connection destination candidate list. The method was explained.

In the modified example of the first embodiment, a method capable of communicating with a connection destination more simply and surely based on an acquired camera image will be described.

FIG. 10 is a diagram illustrating an attendee confirmation screen according to a modification of the first embodiment of the present invention.
Referring to FIG. 10, here, a list of persons included in the camera image acquired by the camera unit of the video conference device of Planning Department No. 1 is shown.

Specifically, in response to “Planning Department No. 1”, four people, “Planning Department A”, “Planning Department B”, “Planning Department C”, and “Planning Department D” The case where it is displayed with the face image etc. which were extracted from is shown.

For example, in the configuration of FIG. 7 described above, the case where the displayed image is enlarged and displayed by selecting (pressing) the display area 112 of “current image” has been described. In the configuration according to the first modification, the attendee confirmation screen is displayed by selecting (pressing) the display area 112 of “current image”.

FIG. 11 is a flowchart for explaining the flow of processing for displaying the attendee confirmation screen according to the modification of the first embodiment of the present invention.

Referring to FIG. 11, it is first determined whether or not a display area is selected (step S50). Specifically, the control unit 21 determines whether or not the above-described “current image” display area 112 has been selected (pressed).

If it is determined in step S50 that the display area is selected, an attendance confirmation request command is transmitted (step S51). Specifically, the control unit 21 transmits an attendee confirmation request command to the management server 10 via the communication unit 26.

Next, the management server 10 receives an attendee confirmation request command (step S52). Specifically, the connection destination candidate management unit 12 of the management server 10 receives an attendee confirmation request command from the video conference apparatus via the communication unit 11.

Next, face image extraction processing is executed (step S53). Specifically, the connection destination candidate management unit 12 instructs the face image extraction unit 15 to execute face image extraction processing. The face image extraction unit 15 performs face image extraction processing based on the camera image data instructed by the attendee confirmation request command. Here, as a method for executing face image extraction processing based on camera image data, for example, various known methods such as a method of extracting a face image by pattern matching with a face part are used.

Then, the extracted face image data is transmitted (step S54). Specifically, the connection destination candidate management unit 12 transmits the face image data extracted by the face image extraction unit 15 to the human management server 10 #.

Next, the human management server 10 # receives face image data (step S55).
Next, face image data matching processing is executed (step S56). Specifically, it is assumed that attribute information regarding a user who uses the video conference apparatus is stored in advance in the human management server 10 #. As the attribute information, it is assumed that the user's name and the like are stored in association with the user's face image data.

The human management server 10 # executes a matching process based on the received face image data as to whether or not the face image data registered in the data stored in advance is matched (matched).

Then, the collation result of the face image data is transmitted (step S57). Specifically, when matching the face image data, the human management server 10 # sends the user name and the like included in the pre-stored attribute information to the management server 10 as the face image data matching result. Send.

Then, the collation result of the face image data is received (step S58). Specifically, the connection destination candidate management unit 12 of the management server 10 receives the collation result of the face image data.

Next, a face image list is generated (step S59). Specifically, the connection destination candidate management unit 12 instructs the face image list generation unit 19 to generate a face image list based on the collation result of the received face image data. The face image list generation unit 19 generates a face image list based on the face image data and the collation result of the face image data.

Next, the face image list is transmitted (step S60). Specifically, the connection destination candidate management unit 12 transmits a face image list to the video conference apparatus via the communication unit 11.

Then, the video conference device receives the face image list (step S61). Specifically, the control unit 21 receives a face image list via the communication unit 26.

Next, an attendee confirmation screen is displayed (step S62). Specifically, the control unit 21 displays the face image list as an attendee confirmation screen on the display unit 28 based on the received face image list.

This process allows the user to check the attendees present in the selected display area, and it is possible to more easily and reliably establish a communication connection with the connection destination based on the acquired camera image.

In addition, by displaying the names of attendees as face image matching processing results using the human management server 10 #, it is possible to immediately know who the conference participants are. Even if attendees who do not recognize the user are participating, it is possible to see and recognize the name of the attendee, which is highly convenient for the user.

In FIG. 7 described above, the case where it is possible to instruct connection processing with the connection destination in the selected state by selecting (pressing) the “connect” button 102 has been described. It is also possible to provide a plurality of connection modes for. Specifically, by providing a plurality of connection modes such as “immediate connection” and “connect if called and OK”, a more flexible connection can be executed. For example, “immediate connection” is a connection mode in which connection processing with a connection destination in a selected state is immediately executed by selecting (pressing) the “connect” button 102.

In addition, “call and connect if OK”, for example, by selecting (pressing) the “connect” button 102, the connection destination in the selected state is notified by voice or display that there is a connection execution request, In this connection mode, a connection process is executed in response to a response from the connection destination in a selected state.

Suppose that the connection mode is set in advance, the connection mode desired by the user from a plurality of connection modes on the connection mode setting screen (not shown). Alternatively, when the “connect” button 102 is selected (pressed), a connection mode setting screen appears, and the user can select a desired connection mode from a plurality of connection modes.

(Embodiment 2)
In the first embodiment described above, the method of displaying the name of the video conference device, the installation location, and the camera image as the connection destination candidate list when selecting the video conference device has been described.

On the other hand, depending on the user, there may be a case where it is not desired to disclose a camera image or the like acquired by the video conference device.

In the second embodiment, a method that can be selected for information displayed as a connection destination candidate list will be described.

FIG. 12 is a diagram illustrating apparatus information registration screen 200 according to the second embodiment of the present invention.
Referring to FIG. 12, in this example, a device information registration screen 200 of video conference device B is shown as an example. It is assumed that the device information registration screen is displayed by executing a predetermined operation on a menu screen (not shown).

In this device information registration screen, the user registers the device information in advance using the pointing device or the like of the operation unit 30 so that it is registered in the connection destination management table when starting up as described above.

It is assumed that “name”, “image”, “person image”, “installation location”, “agenda”, “password”, “voice information”, etc. can be registered as specific registration items.

As an example, “Planning Department No. 1” can be registered as “Name”, the first meeting room of the head office as “Installation Location”, “Project A” as “Agenda”, “ABCD” as “Password”, and so on.

Also, here, a case where a public check box 210 is provided for each corresponding registered item is shown in the leftmost column.

Suppose, for example, that a public check box is specified by using the pointing device by the operation unit 30, a check is displayed in the public check box, and the public check box is published. On the other hand, when the check is not displayed in the public check box, it is registered as device information, but is not disclosed.

In the connection destination management table described above, each registration item is registered as device information, and information on a public check box is also registered.

Then, when generating the connection destination candidate list, the connection destination candidate list generation unit 17 displays the items for which the check is displayed as the connection destination candidate list based on the information of the public check box. On the other hand, items for which no check is displayed are not displayed as the connection destination candidate list.

For example, if you want to make a video conference connection secretly, such as when you want to disclose the camera image, installation location, agenda etc. By not checking, the camera image, installation location, agenda, etc. are hidden in the connection destination candidate list, so it is possible to connect securely. For example, check only the public check box corresponding to "secret" By making it public, the connected partner can easily search for a connection destination by searching for a secret word, and is highly convenient.

(Embodiment 3)
In the above embodiment, when device information is registered, and when there is an access from another video conference device, a case where it is displayed as a connectable video conference device as a connection destination candidate list will be described. However, there is a demand for a system that performs connection only with a desired connection destination so as not to disclose information as much as possible, such as a video conference that needs to be kept secret.

In Embodiment 3 of the present invention, a method for setting a temporary connection condition for setting a state for enabling connection from the other party, that is, a condition for displaying in the connection destination candidate list will be described.

FIG. 13 is a flowchart illustrating processing for registering temporary connection conditions according to the third embodiment of the present invention.

Referring to FIG. 13, first, a temporary connection setting screen is displayed (step S71). Specifically, the control unit 21 receives a predetermined operation instruction input from the operation unit 30 and displays a temporary connection setting screen on the display unit 28 based on a software program or the like stored in advance in the memory unit 23 or the like. Shall. For example, it is assumed that a temporary connection setting screen is displayed by executing a predetermined operation on a menu screen (not shown).

FIG. 14 is a diagram illustrating a temporary connection setting screen according to the third embodiment of the present invention.
Referring to FIG. 14, here, a case is shown in which a “temporary connection availability setting” button 310 and a “conference participant restriction condition setting” button 320 are provided.

Suppose that temporary connection permission / inhibition can be set by pressing (selecting) the “temporary connection permission / inhibition setting” button 310.

Also, it is assumed that the conference participant restriction condition can be set by pressing (selecting) the “conference participant restriction condition setting” button 320.

First, a case where the “temporary connection availability setting” button 310 is selected will be described.
FIG. 15 is a diagram for explaining a temporary connection availability setting screen 315 according to the third embodiment of the present invention.

Referring to FIG. 15, here, a screen for selecting whether to permit or reject the temporary connection is shown.

Specifically, an “permit” button 316 and a “reject” button 317 are provided. When the “permit” button 316 is pressed (selected) and the “set” button 318 is pressed (selected), Information that permits temporary connection is transmitted as temporary connection condition setting information.

On the other hand, when the “reject” button 317 is pressed (selected) and the “set” button 318 is pressed (selected), information for rejecting the temporary connection is transmitted as temporary connection condition setting information.

Referring again to FIG. 13, next, temporary connection condition setting information is transmitted (step S72). Specifically, the control unit 21 transmits temporary connection condition setting information to the management server 10 via the communication unit 26.

Next, the management server 10 receives temporary connection condition setting information (step S73). Specifically, the connection destination candidate management unit 12 receives temporary connection condition setting information via the communication unit 11.

Then, it is registered in the connection destination management table 13 (step S74). Specifically, the connection destination candidate management unit 12 registers permission or rejection of temporary connection in the connection destination management table 13 based on the temporary connection condition setting information.

Then, the process ends (END).
FIG. 16 is a diagram illustrating a connection destination management table according to the third embodiment of the present invention.

Referring to FIG. 16, it is assumed that an item for determining whether or not temporary connection is possible is provided in comparison with the connection destination management table of FIG.

Here, specifically, the video conference apparatus B is registered as permitting temporary connection, and the video conference apparatus C is registered as rejecting temporary connection.

Here, it is assumed that the connection destination candidate list generation unit 17 sets the temporary connection registered as permitted so that it can be selected by being included in the connection destination candidate list. On the other hand, for those for which temporary connection is registered as rejected, the connection destination candidate list generation unit 17 does not include the temporary connection in the connection destination candidate list, and the video conference apparatus is set in a state where it cannot be selected.

When the temporary connection is registered as rejected by this method, even when there is a connection destination candidate selection request button from another device, the video conference device in which the temporary connection is registered as rejected is Since it is not included in the connection destination candidate list, it is possible to prevent connection from other video conference apparatuses.

On the other hand, in the video conference device in which temporary connection is rejected, even when the self presses the connection destination candidate selection request button, a connection destination candidate list is similarly generated based on the provisional connection possibility item, and the connection destination candidate It is possible to select a desired connection destination from the list.

当 該 By this method, it is possible to reject a free connection from the other party and safely connect only to a desired connection destination.

And, after executing the connection with the other party (after this connection), the provisional connection rejection button can be selected. Information that rejects the temporary connection by selecting the temporary connection rejection button is transmitted to the management server 10 as temporary connection rejection information. As a result, the connection destination candidate management unit 12 registers, in the connection destination management table 13, an item for performing a determination as to whether or not temporary connection is possible between the video conference apparatuses that are currently connected based on the temporary connection rejection information as rejection. . Accordingly, communication connections are possible between the video conference apparatuses that are permanently connected, but since the temporary connection is registered as a rejection in the connection destination management table 13, it is possible to connect from other video conference apparatuses. It is possible to prevent completely.

Next, a case where the “conference participant restriction condition setting” button 320 is selected will be described.
FIG. 17 is a diagram illustrating conference participant restriction condition setting screen 330 according to the third embodiment of the present invention.

Referring to FIG. 17, here, a case where an area 340 of the participation possible list and an area 350 of the participation impossible list are provided is shown.

As an example, in the possible participation list area 340, three people A, B, and C are displayed in the possible participation list area 340, and D is displayed in the non-participation list area 350. Yes. It is assumed that the participant can be moved to one of the areas 340 and 350 using the pointing device of the operation unit 30 or the like.

When the “setting” button 360 is pressed (selected), the participation conditions for the person displayed in the areas 340 and 350 at that time are transmitted as temporary connection condition setting information.

The connection destination candidate management unit 12 receives the temporary connection condition setting information via the communication unit 11 and registers the corresponding video conference device and the temporary connection condition setting information in the connection destination management table 13 in association with each other.

Then, when the connection destination candidate list is generated, the connection destination candidate list is generated based on the temporary connection condition setting information. Specifically, it is assumed that the following process is executed after the process of step S14 of FIG. 5 and before the process of step S15.

FIG. 18 is a flowchart illustrating connection destination candidate selection processing based on temporary connection conditions according to the third embodiment of the present invention.

Referring to FIG. 18, first, a temporary connection condition confirmation process is executed (step S81). Specifically, the connection destination candidate management unit 12 performs a process of confirming temporary connection condition setting information stored in the connection destination management table associated with the video conference apparatus that has pressed the connection destination candidate selection request button. Execute.

If the temporary connection condition setting information is registered, it is determined whether there is a connection destination candidate that satisfies the temporary connection condition (step S83). For example, when the conference participant restriction condition is registered as temporary connection condition setting information, it is determined whether there is a connection destination candidate that satisfies the conference participant restriction condition.

Specifically, the face image extraction unit 15 executes face image extraction processing based on registered camera image data of a video conference apparatus that may be a connection destination candidate, and acquires face image data. Then, the face image data is transmitted to the human management server 10 #, and the collation result of the face image data is acquired.

If it is determined from the collation result of the face image data that there is a participant registered in the area 350 of the above-described participation impossible list, it is determined that the temporary connection condition is not satisfied.

On the other hand, if it is determined that there is no participant registered in the area 350 of the participation unavailable list, it is determined that the temporary connection condition is satisfied.

In this case, the participant information registered in the participation possible list area 340 is not used, but there is no participant registered in the participation unavailable list area 350 using the information. In addition, it may be determined that the temporary connection condition is satisfied when there is a participant registered in the area 340 of the participation list. Alternatively, if there is no participant registered in the area 350 of the participation impossible list and the participants registered in the area 340 of the participation possible list partially match, the provisional connection condition is satisfied. You may make it judge. That is, these combinations are not particularly limited and can be set freely.

The connection destination candidate management unit 12 performs a process of determining whether or not the temporary connection condition is satisfied for each video conference apparatus that may be a connection destination candidate, and in step S83, the connection destination candidate that satisfies the temporary connection condition. When it is determined that there is a connection destination candidate management unit 12, the connection destination candidate that satisfies the temporary connection condition is extracted (step S84).

Then, the process ends (END).
Then, based on the extracted connection destination candidates, the connection destination candidate list generation unit 17 generates a temporary connection destination candidate list. Then, the temporary connection destination candidate list is displayed on the display unit of the video conference apparatus in which the connection destination candidate selection request button is pressed.

For example, by performing the processing after step S14 described in FIG. 5 every elapse of a predetermined period, in this example, for example, the provisional connection destination condition is satisfied when Mr. D disappears, At this time, it is displayed in the temporary connection destination candidate list.

If it is inconvenient if a specific person exists at the connection destination by this process, the connection can be made after the person disappears, so it is possible to connect to the desired connection destination safely and reliably. is there.

(Embodiment 4)
In the above embodiment, the case where the camera image is used as the surrounding state information has been described. However, the case where the surrounding state information is displayed using audio information will be described.

In this example, a method will be described in which surrounding information is automatically detected by the video conference device and registered in the connection destination management table 13.

FIG. 19 is a flowchart illustrating a process when voice information according to the fourth embodiment of the present invention is used as the surrounding state information.

Referring to FIG. 19, first, a voice input level confirmation process is executed (step S91). Specifically, the voice input / output unit 24 detects the input level of the input voice.

Then, it is determined whether or not the voice input level satisfies a predetermined condition (step S92). Specifically, the voice input / output unit 24 determines whether or not the input level is equal to or lower than a certain input level as an example in this example based on the input level of the input voice.

If the audio input level does not satisfy the predetermined condition in step S92, the processes in steps S91 and S92 are repeated.

On the other hand, if the input level is below a certain input level, the voice input / output unit 24 notifies the control unit 21 accordingly.

On the other hand, if the voice input level satisfies the predetermined condition in step S92, next, preparation completion data is transmitted (step 93).

Specifically, when the control unit 21 determines that the voice input level satisfies a predetermined condition in accordance with an instruction from the voice input / output unit 24, the control unit 21 transmits preparation completion data via the communication unit 26.

Then, the connection destination candidate management unit 12 of the management server 10 receives the preparation completion data via the communication unit 11 (step S94). Then, the preparation completion data is registered in a predetermined item of the corresponding video conference apparatus in the connection destination management table 13 (step S95).

Then, the process ends (END).
As a result of this processing, for example, preparation completion is registered in a predetermined item of the corresponding video conference device in the connection destination management table 13, and preparation is completed when the video conference device is included in the list in the connection destination candidate list Audio information can be displayed.

It should be noted that by executing this processing at regular intervals, it is possible to register actual voice information as the surrounding state information.

Therefore, the user determines whether or not preparation is completed based on the audio information that is the surrounding state information included in the connection destination candidate list, and reliably connects to the desired connection destination at an appropriate timing. It is possible.

(Embodiment 5)
In the above description, the method of executing connection control with another video conference apparatus using the management server 10 has been described. However, the same function as that executed by the management server 10 without providing the management server 10 is described. It is also possible to realize a similar conference system 1 # by providing a function in the video conference apparatus.

FIG. 20 is a schematic block diagram illustrating a video conference apparatus 2 # according to the fifth embodiment of the present invention.

Referring to FIG. 20, as compared with the configuration of FIG. 2, the management server 10 is deleted. Further, the video conference apparatus 2 # has a configuration in which the control unit 21 is replaced with a control unit 21 # as compared with the video conference apparatus 2. Further, the connection destination management table 13 is provided in the video conference apparatus 2 #. The other points are the same as those of the video conference apparatus 2.

The control unit 21 # includes a connection destination candidate status acquisition unit 40, a connection destination candidate management unit 42, a face image extraction unit 43, a connection destination candidate list generation unit 45, a connection execution unit 46, and a face image list generation unit. 47.

Suppose that the processing executed by the management server 10 is executed using each means of the control unit 21 # of the video conference device 2 #. The connection destination candidate status acquisition means 40, connection destination candidate management means 42, face image extraction means 44, connection destination candidate list generation means 45, connection execution means 46, and face image list generation means 47 are: The connection destination candidate status acquisition unit 16, the connection destination candidate management unit 12, the face image extraction unit 15, the connection destination candidate list generation unit 17, the connection execution unit 18, and the face image list generation unit described in the management server 10. It is assumed that the same function as 19 is executed.

With this configuration, the conference system described above can be realized without providing the management server 10.

In addition, it is also possible to provide a program that causes a computer to function for each unit that controls the video conference apparatus or the management server 10 to execute control as described in the above flow. Such a program is stored on a computer-readable recording medium such as a flexible disk, CD-ROM (Compact Disk-Read Only Memory), ROM (Read Only Memory), RAM (Random Access Memory), and memory card attached to the computer. And can be provided as a program product. Alternatively, the program can be provided by being recorded on a recording medium such as a hard disk built in the computer. A program can also be provided by downloading via a network.

The program may be a program module that is provided as a part of an operation system (OS) of a computer and that calls necessary modules in a predetermined arrangement at a predetermined timing to execute processing. In that case, the program itself does not include the module, and the process is executed in cooperation with the OS. A program that does not include such a module can also be included in the program according to the present invention.

The program according to the present invention may be provided by being incorporated in a part of another program. Even in this case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. Such a program incorporated in another program can also be included in the program according to the present invention.

The provided program product is installed in a program storage unit such as a hard disk and executed. The program product includes the program itself and a recording medium on which the program is recorded.

The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

1,1 # conference system, 2-4 videoconferencing device, 5 network, 10 management server, 10 # human management server, 11 communication unit, 12 connection destination candidate management unit, 13 connection destination management table, 14 internal bus, 15 faces Image extraction unit, 16 connection destination candidate status acquisition unit, 17 connection destination candidate list generation unit, 18 connection execution unit, 19 face image list generation unit, 21 control unit, 22 camera unit, 23 memory unit, 24 voice input / output unit, 26 communication unit, 28 display unit, 30 operation unit, 32 remote control reception unit, 36 remote control.

Claims (10)

1. A plurality of conference apparatuses (2-4) each including a display unit (28) connected to each other via a network and capable of bidirectional communication of information;
   A network-connected management server (10) for controlling communication connection between the conference devices selected from among the plurality of conference devices;
   The management server
   When there is a request for communication connection with another conference device among the plurality of conference devices, the conference device where the conference device is installed is connected to the conference device that is a connection destination candidate connected via the network. A connection destination candidate status acquisition unit (16) for acquiring ambient status information;
   A connection destination candidate list generation unit (17) for generating a list of connection destination candidates from the surrounding situation information acquired by the connection destination candidate status acquisition unit;
   A conference system, comprising: a connection control unit (18) for performing communication connection with another conference device that is a connection destination selected from the connection destination candidate list.
2. The conference system according to claim 1, wherein the connection destination candidate status acquisition unit acquires camera image information of a base installed from a conference device that is a connection destination candidate as the surrounding status information.
3. Each said conference device
   An imaging unit (22) for imaging the base where the corresponding conference device is installed;
   A control unit (21) for controlling the imaging unit,
   In response to the instruction, the control unit acquires camera image information of a base where the corresponding conference device is installed from the imaging unit, and outputs the camera image information to the connection destination candidate status acquisition unit of the management server. The conference system according to range 2.
4. The conference system according to claim 3, wherein the imaging unit includes a fisheye lens.
5. The conference system according to claim 3, wherein the management server further includes a face image extraction unit (15) that extracts a face image based on the acquired camera image information.
6. A human management server (10 #) that registers human attribute information including a face image;
   The connection destination candidate list generation unit acquires human attribute information registered in the human management server based on the face image extracted by the face image extraction unit, and includes a connection destination candidate including the acquired human attribute information The conference system according to claim 5, wherein the conference system is generated.
7. The management server has a connection availability management table (13) in which permission of connection from other conference devices in each of the plurality of conference devices is registered.
   When there is a request for communication connection with another conference device among the plurality of conference devices, the connection destination candidate status acquisition unit establishes a connection from another conference device based on the connection availability management table. The conference system according to claim 1, wherein peripheral status information of a base where the conference device is installed is acquired for a conference device that is a permitted connection destination candidate.
8. The management server has a device information management table in which information to be displayed as a list of connection destination candidates is registered together with the surrounding state information in each of the plurality of conference devices
   The connection destination candidate list generation unit generates a list of connection destination candidates from the information registered in the device information management table and the surrounding situation information acquired by the connection destination candidate situation acquisition unit. The conference system described.
9. The management server further includes display presence / absence management information in which presence / absence of display of predetermined information is registered among information registered in the device information management table in each of the plurality of conference devices,
   The connection destination candidate list generation unit includes predetermined information registered in the device information management table and the connection destination candidate status acquisition unit when display of predetermined information is permitted based on the display presence / absence management information. The conference system according to claim 8, wherein a list of connection destination candidates is generated from the ambient situation information acquired in step 8.
10. A plurality of conference apparatuses (2 to 4) each including a display unit (28) connected to each other via a network and capable of bidirectional communication of information,
    Each said conference device
    When there is a request for communication connection with another conference device among the plurality of conference devices, the conference device where the conference device is installed is connected to the conference device that is a connection destination candidate connected via the network. A connection destination candidate status acquisition unit (21 #) that acquires ambient status information;
    A connection destination candidate list generation unit (45) for generating a list of connection destination candidates from the surrounding situation information acquired by the connection destination candidate status acquisition unit;
    A conferencing system including a connection control unit (46) for performing communication connection with another conferencing apparatus that is a connection destination selected from the list of connection destination candidates generated by the connection destination candidate list generation unit .

Images