JP2019169833A - Management device, method, program, and management system - Google Patents

Abstract

To improve realism in an interaction between remote areas.SOLUTION: A management device is connected to a first imaging device that acquires a first video and a second imaging device that acquires a second video, the management device comprising a control unit that controls transmission of the second video to a communication partner device that receives the first video from the first imaging device and displays the first video, on the basis of the positional relationship between the first imaging device and the second imaging device.SELECTED DRAWING: Figure 7

Description

  The present invention relates to a management apparatus, method, program, and management system.

  In recent years, with the development of network and multimedia transmission technologies, it has become easy to introduce telework connecting remote satellite offices or connecting a local satellite office and a head office. For this reason, an increasing number of companies are promoting the introduction of telework as part of management reform. As a document which the technique which supports telework discloses, for example, Patent Document 1 is cited.

  In order to support telework, it is conceivable to transmit and receive video and audio from a plurality of sites between sites. For example, each base has a large-screen terminal having an imaging function and a large display function for acquiring a bird's-eye view video, and a communication terminal used by each member and having an imaging function and a display function for acquiring each member's video A terminal is provided. When the large screen terminal displays the bird's-eye view video acquired by the large screen terminal at another base, a sense that members at different bases exist at the same base can be realized. In addition, it is possible to obtain a sense of presence like a dialogue through a window by allowing members who exist in different locations to interact using a large screen terminal. Note that the dialogue between members can also be realized by transmitting and receiving video and audio between communication terminals used by each member.

JP 2014-164654 A

  As described above, a sense of reality such as dialogue through a window can be realized by dialogue using a large screen terminal. However, since the size of the member's face image included in the overhead view image acquired by the large screen terminal differs depending on the position of the member, there may be a case where a sense of reality is not sufficiently obtained even in the conversation using the large screen terminal.

  Accordingly, the present invention has been made in view of the above problems, and an object of the present invention is to provide a new and improved management apparatus capable of improving the sense of reality in dialogue between remote locations. , Method, program and management system.

  In order to solve the above problems, according to an aspect of the present invention, there is provided a management device connected to a first imaging device that acquires a first video and a second imaging device that acquires a second video. The transmission of the second video to the communication partner device that receives the first video from the first imaging device and displays the first video is performed using the first imaging device and the second imaging device. And a control unit that performs control based on the positional relationship of the imaging devices.

  The control unit displays the second image on the second imaging device based on a distance between the position of the first imaging device and the position of the second imaging device being equal to or greater than a threshold value. You may make it transmit to a said 2nd imaging device.

  The control unit is further configured to transfer from the second imaging device to the communication counterpart device based on a relationship between a direction of imaging by the first imaging device and a direction of imaging by the second imaging device. The transmission of the second video may be controlled.

  The control unit causes the second imaging device to perform the second imaging based on a difference between an imaging direction by the first imaging device and an imaging direction by the second imaging device being less than a reference. May be transmitted to the second imaging device.

  The controller includes an object included in the first video to determine whether a difference between a direction of imaging by the first imaging device and a direction of imaging by the second imaging device is less than a reference, The determination may be made based on the correspondence with the object included in the second video.

  The second imaging device may acquire sound, and the control unit may cause the second imaging device to transmit the sound to the communication partner device.

  The controller may calculate a distance between the position of the first imaging device and the position of the second imaging device based on the position of the second imaging device in the first video. Good.

  In order to solve the above-described problem, according to another aspect of the present invention, a management connected to a first imaging device that acquires a first video and a second imaging device that acquires a second video. A method executed by a device, wherein the second video is transmitted to a communication partner device that receives the first video from the first imaging device and displays the first video. Controlling based on a positional relationship between one imaging device and the second imaging device.

  In order to solve the above-mentioned problem, according to another aspect of the present invention, a computer is connected to a first imaging device that acquires a first video and a second imaging device that acquires a second video. The second video is transmitted to a communication partner device that receives the first video from the first imaging device and displays the first video, and transmits the second video to the communication partner device. A program is provided for functioning as a management device including an imaging device and a control unit that controls based on a positional relationship between the imaging device and the second imaging device.

  In order to solve the above-described problem, according to another aspect of the present invention, a management connected to a first imaging device that acquires a first video and a second imaging device that acquires a second video. A management system comprising a device, wherein the second video is transmitted to a communication partner device that receives the first video from the first imaging device and displays the first video, And a control unit that performs control based on a positional relationship between the second imaging device and the second imaging device.

  According to the present invention described above, it is possible to improve a sense of reality in a conversation between remote locations.

It is explanatory drawing which shows an example of a structure of the remote communication system by embodiment of this invention. 2 is an explanatory diagram showing a configuration of a large screen terminal 10. FIG. The bird's-eye view image of the base A displayed on the large screen terminal 10B of the base B is shown. The bird's-eye view image of the base B displayed on the large screen terminal 10A of the base A is shown. It is explanatory drawing which shows the external appearance structure of the communication terminal 20 by embodiment of this invention. It is explanatory drawing which shows the structure of the communication terminal 20 by embodiment of this invention. 4 is an explanatory diagram showing a configuration of a terminal management server 30. FIG. It is explanatory drawing which shows the physical space of the base A, and a bird's-eye view image | video. 4 is a plan view of a physical space of a base A. FIG. It is explanatory drawing which shows the specific example of a dialogue screen. It is explanatory drawing which shows the specific example of a dialogue screen. It is explanatory drawing which shows operation | movement of the remote communication system by embodiment of this invention. It is explanatory drawing which shows operation | movement of the remote communication system by embodiment of this invention. It is explanatory drawing which shows the structure of the terminal management server 31 by an application example. 4 is an explanatory diagram showing a bird's-eye view image of a base acquired by the large screen terminal 10. FIG. It is explanatory drawing which shows operation | movement of the remote communication system by an application example. It is explanatory drawing which shows operation | movement of the remote communication system by an application example. 3 is a block diagram illustrating a hardware configuration of a terminal management server 30. FIG.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

  In the present specification and drawings, a plurality of components having substantially the same functional configuration may be distinguished by adding different alphabets after the same reference numeral. For example, a plurality of configurations having substantially the same functional configuration or logical significance are distinguished as communication terminals 20A and 20B as necessary. However, when it is not necessary to particularly distinguish each of a plurality of constituent elements having substantially the same functional configuration, only the same reference numeral is given to each of the plurality of constituent elements. For example, when it is not necessary to distinguish between the communication terminals 20A and 20B, each communication terminal is simply referred to as a communication terminal 20.

<1. Overview of remote communication system>
Embodiments described herein relate generally to a remote communication system that realizes communication between remote bases. Hereinafter, the outline of the remote communication system will be described with reference to FIG.

  FIG. 1 is an explanatory diagram showing an example of the configuration of a remote communication system according to an embodiment of the present invention. As shown in FIG. 1, the remote communication system according to the embodiment of the present invention includes a large screen terminal 10, a communication terminal 20, and a terminal management server 30.

  FIG. 1 illustrates communication between two remote locations. The network 12 includes a large screen terminal 10A and a communication terminal 20A provided at the location A, a large screen terminal 10B provided at the location B, and The communication terminal 20B and the terminal management server 30 are connected.

  The network 12 may include a public line network such as a telephone line network, the Internet, a satellite communication network, a LAN (Local Area Network), a WAN (Wide Area Network), and the like. Further, the network 12 may include a dedicated line network such as an IP-VPN (Internet Protocol-Virtual Private Network).

(Large screen terminal)
The large screen terminal 10 is a terminal that is shared at a base, and has a video output unit 130 that is a large display that displays a bird's-eye view video of another base. The members present at the bases can obtain a feeling as if the members at the other bases exist in the same space by displaying an overhead video of the other bases on the video output unit 130. The configuration of such a large screen terminal 10 will be described more specifically with reference to FIG.

  FIG. 2 is an explanatory diagram showing the configuration of the large screen terminal 10. As shown in FIG. 2, the large screen terminal 10 includes a video output unit 130, an imaging unit 140, a voice input / output unit 150, a communication unit 160, an information storage unit 170, and a control unit 180.

  The video output unit 130 is a larger display than the video output unit of the communication terminal 20 described later. The video output unit 130 displays a bird's-eye view image of another site obtained by the imaging unit 140 included in the large screen terminal 10 of another site.

  The imaging unit 140 has a function of capturing an overhead view video of the site. Such an imaging unit 140 or the large screen terminal 10 having the imaging unit 140 can be said to be a first imaging device that acquires a first video. The voice input / output unit 150 has a voice input function and an output function. For example, the voice input / output unit 150 collects the voice of the base (including the environmental sound) and outputs the voice of the other base collected by the voice input / output part 150 of the large screen terminal 10 of the other base. To do.

  The communication unit 160 communicates with the large screen terminal 10 and the communication terminal 20 provided at other bases via the network 12. For example, the communication unit 160 transmits the bird's-eye view video obtained by the imaging unit 140 and the voice obtained by the audio input / output unit 150 to the large screen terminal 10 existing at the other base, and the large screen existing at the other base. The terminal 10 receives a bird's-eye view video of another base and audio of the other base.

  The information storage unit 170 stores information used for the operation of the large screen terminal 10, information regarding the large screen terminal 10, and the like. The control unit 180 controls the overall operation of the large screen terminal 10. For example, the control unit 180 controls transmission / reception of the overhead view video and audio by the communication unit 160.

  Here, with reference to FIG. 3 and FIG. 4, the specific example of the bird's-eye view image displayed on the large screen terminal 10 of each base is demonstrated. FIG. 3 shows a bird's-eye view image of the site A displayed on the large screen terminal 10B at the site B, and FIG. 4 shows a bird's eye view image of the site B displayed on the large screen terminal 10A at the site A. 3 includes the members MA1, MA2 and MA3 existing at the site A, and the overhead image of the site B illustrated in FIG. 4 includes the members MB1 and MB2 existing at the site B. And MB3.

(Communication terminal)
The communication terminal 20 is a communication device for supporting communication between a plurality of bases. For example, the communication terminal 20 establishes a connection with the communication terminal 20 existing at another base. When a connection between two communication terminals 20 existing at different bases is established, each member of the two communication terminals 20 can perform a conversation using the communication terminal 20.

  FIG. 5 is an explanatory diagram showing an external configuration of the communication terminal 20 according to the embodiment of the present invention. As illustrated in FIG. 5, the imaging unit 220 that acquires video, the sound collection unit 230 that acquires audio, the video output unit 240, the audio output unit 250, and the light emitting unit 270 are provided. The video output unit 240 displays a bird's-eye view video of another base transmitted from the large screen terminal 10 of another base, and the audio output unit 250 outputs the voice of the other base transmitted from the large screen terminal 10. . Hereinafter, the configuration of the communication terminal 20 will be described more specifically with reference to FIG.

  FIG. 6 is an explanatory diagram showing the configuration of the communication terminal 20 according to the embodiment of the present invention. As shown in FIG. 6, the communication terminal 20 according to the embodiment of the present invention includes an imaging unit 220, a communication unit 224, a sound collection unit 230, a video output unit 240, an audio output unit 250, an information storage unit 260, and a light emitting unit 270. And a control unit 280. Some of these functions may be implemented in a server (not shown).

  The imaging unit 220 acquires a subject image. Such an imaging unit 220 or the communication terminal 20 having the imaging unit 220 can be said to be a second imaging device that acquires a second video. When the imaging direction of the imaging unit 220 is directed to a member who uses the communication terminal 20, the imaging unit 220 acquires an image of the member who uses the communication terminal 20. When the communication terminal 20 is connected to the communication terminal 20 at another base, the video of the member acquired by the imaging unit 220 is transmitted from the communication unit 224 to the communication terminal 20 at the other base.

  The communication unit 224 is an interface of another device. For example, the communication unit 224 functions as a receiving unit that receives the overhead video and audio of another site from the large screen terminal 10 of the other site, and the member video and sound collection unit 230 acquired by the imaging unit 220. It has a function as a transmission part which transmits the voice of the acquired member to the communication terminal 20 of another base. In addition, the communication unit 224 receives various control signals from the terminal management server 30.

  The sound collection unit 230 acquires an audio signal by converting air vibration into an electric signal. For example, the sound collection unit 230 acquires a sound signal of a sound emitted by a member using the communication terminal 20. In the present specification, for convenience of explanation, an audio signal acquired by the sound collection unit 230 may be simply referred to as audio or input audio. When the communication terminal 20 is connected to the communication terminal 20 at another base, the voice of the member acquired by the sound collection unit 230 is transmitted from the communication unit 224 to the communication terminal 20 at the other base.

  The video output unit 240 is a display unit that outputs an overhead video of another base received from the large screen terminal 10 of another base by the communication unit 224. When the communication terminal 20 is connected to the communication terminal 20 at another site, the video of the member who uses the communication terminal 20 at the other site is received by the communication unit 224, and the video of the member is received by the video output unit 240. Is output.

  The voice output unit 250 outputs the voice of another base received from the large screen terminal 10 of the other base by the communication unit 224. When the communication terminal 20 is connected to the communication terminal 20 at another base, the voice of the member who uses the communication terminal 20 at the other base is received by the communication unit 224, and the voice of the member is received by the voice output unit 250. Is output. The audio output unit 250 can be constituted by a speaker, for example.

  The information storage unit 260 stores terminal information such as the ID of the communication terminal 20 and information on members who use the communication terminal 20.

  The light emitting unit 270 includes one or more light emitting elements. The light emitting unit 270 may be, for example, a plurality of LEDs (Light Emitting Diodes) arranged circumferentially on the top surface of the communication terminal 20 as illustrated in FIG. The light emitting unit 270 emits light according to the light emission instruction transmitted from the terminal management server 30.

  The control unit 280 controls the overall operation of the communication terminal 20. For example, the control unit 280 controls transmission / reception of video and audio by the communication unit 224, light emission by the light emitting unit 270, and the like.

(Terminal management server)
The terminal management server 30 is an example of a management device that controls connection between communication terminals 20 existing at different locations, connection between the communication terminal 20 and the large screen terminal 10 existing at different locations, and the like. The function of the terminal management server 30 may be implemented in an independent server using, for example, XMPP (extensible messaging and presence protocol), or may be implemented in any one of a plurality of communication terminals 20 provided. Alternatively, it may be distributed to a plurality of communication terminals 20 or may be mounted on the large screen terminal 10. Hereinafter, a detailed configuration of the terminal management server 30 will be described.

<2. Configuration of terminal management server>
FIG. 7 is an explanatory diagram showing the configuration of the terminal management server 30. As illustrated in FIG. 7, the terminal management server 30 according to the embodiment of the present invention includes a communication unit 324, a terminal information storage unit 328, a distance calculation unit 332, a connection destination determination unit 336, and a connection control unit 340.

(Communication Department)
The communication unit 324 has a function of performing communication via the network 12 and performs communication with the large screen terminal 10 and the communication terminal 20. For example, the communication unit 324 receives a connection request from the large screen terminal 10 and transmits a connection instruction for instructing connection to the large screen terminal 10 to the communication terminal 20 to be connected.

(Terminal information storage unit)
The terminal information storage unit 328 stores terminal information of each large screen terminal 10 and each communication terminal 20. The terminal information of the communication terminal 20 includes information indicating the ID of the communication terminal 20 and the distance between the communication terminal 20 and the imaging unit 140 of the large screen terminal 10 provided at the same base, which is calculated by the distance calculation unit 332 described later. Etc. In this specification, an example in which the distance between the large screen terminal 10 and the communication terminal 20 is calculated by the distance calculation unit 332 will be described. However, the distance between the large screen terminal 10 and the communication terminal 20 may be set in advance. .

(Distance calculation unit)
The distance calculation unit 332 calculates the distance between the large screen terminal 10 and the communication terminal 20 with respect to the large screen terminal 10 and the communication terminal 20 provided at the same base. For example, when the light emitting unit 270 of the communication terminal 20 emits light, the large screen terminal 10 detects the light emission of the light emitting unit 270 in the overhead view video, specifies the terminal coordinates of the communication terminal 20 from the position of the light emitting unit 270 in the overhead view video, The large screen terminal 10 transmits the terminal coordinates to the terminal management server 30. The distance calculation unit 332 can calculate the distance between the large screen terminal 10 and the communication terminal 20 based on the terminal coordinates of the communication terminal 20. This point will be described more specifically with reference to FIGS. 8 and 9.

  FIG. 8 is an explanatory diagram showing the physical space of the base A and an overhead view video. The upper part of FIG. 8 shows the physical space of the base A, and the upper part of FIG. 8 shows three members who are working at the base A. The three members include members MA1 to MA2, and communication terminals 20A # 1 to # 2 used by the members MA1 to MA2 are also shown.

  The position of the base A in the physical space is expressed using three-dimensional coordinate data represented by x, y, and z axes. The communication terminal 20 used by each member is associated with a position expressed using the three-dimensional coordinate data. For example, the position of the communication terminal 20A # 2 used by the member MA2 is expressed as (x1, y1, z1).

  The lower part of FIG. 8 shows a bird's-eye view image of the base A. The position in the bird's-eye view image is expressed using two-dimensional coordinate data represented by X and Y axes. For example, the position in the overhead view of the communication terminal 20A # 2 used by the member MA2 is expressed as (X1, Y1).

  FIG. 9 is a plan view of the physical space of the base A described with reference to FIG. That is, FIG. 9 shows a plane represented by the x and y axes of the base A described with reference to FIG. A one-dot chain line extending from the imaging unit 140 illustrated in FIG. 9 indicates an angle of view of the imaging unit 140.

  The distance calculation unit 332 is based on the terminal coordinates of each of the communication terminals 20A # 1 to # 3 received from the large screen terminal 10, and the distance L1 between the imaging unit 140 and each of the communication terminals 20A # 1 to # 3. ~ L3 is calculated. The distances L1 to L3 calculated by the distance calculation unit 332 are stored in the terminal information storage unit 328.

(Destination determination unit)
When a connection request is received from the large screen terminal 10 or the communication terminal 20, the connection destination determination unit 336 determines a connection destination related to the connection request. For example, when the name of a member existing at the site B is called to the large screen terminal 10 or the communication terminal 20 at the site A and a voice indicating the name is received as a connection request, the connection destination determination unit 336 The communication terminal 20 corresponding to the name indicated by may be determined as the connection destination. Alternatively, when the display of the member existing at the base B is touched in the overhead view video displayed on the large screen terminal 10 or the communication terminal 20, and information indicating the touch position in the overhead view video is received as a connection request, the connection destination determination unit In step 336, the communication terminal 20 having the terminal coordinates corresponding to the touch position may be determined as the connection destination.

(Connection control unit)
The connection control unit 340 is a function of the control unit, and controls connection between the communication terminals 20 existing at different bases and connection between the communication terminal 20 and the large screen terminal 10 existing at different bases. For example, regarding the connection of the large screen terminal 10A existing at the site A and the communication terminal 20B existing at the site B, the connection control unit 340 transmits and receives audio between the large screen terminal 10A and the communication terminal 20B. On the other hand, the connection control unit 340 controls whether to transmit / receive video between the large screen terminal 10A and the communication terminal 20B based on the positional relationship between the communication terminal 20B and the large screen terminal 10B existing at the base B. .

  In this regard, a member located near the large screen terminal 10B of the site B may interact with the members of the site A using the large screen terminal 10B instead of the communication terminal 20B of the member. It is preferable from the viewpoint. On the other hand, when a member located away from the large screen terminal 10B of the base B has a conversation with a member of the base A using the large screen terminal 10B, the display of the members of the base B displayed on the large screen terminal 10A of the base A is displayed. Because it is small, the sense of presence is reduced.

  Therefore, when the distance between the communication terminal 20B and the large screen terminal 10B existing at the base B is less than the threshold, the connection control unit 340 uses the large screen terminal 10B instead of the communication terminal 20B for video. Therefore, no video is transmitted / received between the large screen terminal 10A and the communication terminal 20B. On the other hand, when the distance between the communication terminal 20B and the large screen terminal 10B existing at the site B is equal to or greater than the threshold value, the large screen terminal 10A and the communication terminal 20B are used in order to use the communication terminal 20B for video. Video is sent and received between them.

  Thereby, the overhead image of the base A received from the large screen terminal 10A is displayed on the communication terminal 20B. The bird's-eye view video of the site A includes, for example, a display of the member MA4 who is a conversation partner of the member who uses the communication terminal 20B as shown in FIG. In addition, the member screen received from the communication terminal 20B is displayed on the large screen terminal 10A. For example, as shown in FIG. 11, the POPUP display D including the display of the member MB3 is superimposed on the overhead view video of the base B displayed on the large screen terminal 10A.

<3. Operation>
The configuration of the terminal management server 30 according to the embodiment of the present invention has been described above. Subsequently, with reference to FIGS. 12 and 13, the operation of the remote communication system according to the embodiment of the present invention is organized.

  12 and 13 are explanatory diagrams showing the operation of the remote communication system according to the embodiment of the present invention. First, the large screen terminal 10A existing at the site A, the large screen terminal 10B existing at the site B, and the communication terminal 20B existing at the site B are activated (S504). Then, the large screen terminal 10B and the communication terminal 20B notify the terminal management server 30 of activation (S508). Subsequently, the large screen terminal 10A and the large screen terminal 10B start to obtain the overhead view video (S512), start transmission / reception of the overhead view video (S516), and start displaying the received overhead view video (S520).

  Thereafter, the terminal management server 30 instructs the communication terminal 20B to emit light (S524), and instructs the large screen terminal 10B to acquire the coordinates of the communication terminal 20B (S528). The light emitting unit 270 of the communication terminal 20B emits light based on the light emission instruction from the terminal management server 30 (S532), and the large screen terminal 10B specifies the terminal coordinates of the communication terminal 20B based on detection of light emission in the overhead view video (S536). ).

  Then, the large screen terminal 10B transmits the terminal coordinates of the identified communication terminal 20B to the terminal management server 30 (S540), and the distance calculation unit 332 of the terminal management server 30 determines the large screen terminals 10B and 10B based on the received terminal coordinates. The distance between the communication terminals 20B is calculated, and information indicating the distance between the large screen terminal 10B and the communication terminal 20B is stored in the terminal information storage unit 328 (S544).

  Thereafter, as shown in FIG. 13, when the large-screen terminal 10A transmits a connection request to the terminal management server 30 (S548), the connection destination determination unit 336 of the terminal management server 30 determines the connection destination related to the connection request ( S552). Here, a case where the communication terminal 20B is determined as a connection destination is considered. In this case, the terminal management server 30 transmits a connection instruction to the large screen terminal 10A and the communication terminal 20B (S556).

  Here, the terminal management server 30 performs different control regarding connection according to the positional relationship between the large screen terminal 10B and the communication terminal 20B. Specifically, when the distance between the communication terminal 20B and the large screen terminal 10B is less than the threshold, the terminal management server 30 causes the large screen terminal 10A and the communication terminal 20B to start transmitting and receiving audio (S560). The large screen terminal 10A and the communication terminal 20B start outputting the received voice (S564). At this time, the large screen terminal 10A and the communication terminal 20B do not transmit and receive video.

  On the other hand, when the distance between the communication terminal 20B and the large screen terminal 10B is equal to or greater than the threshold, the terminal management server 30 causes the large screen terminal 10A and the communication terminal 20B to start transmission / reception of video and audio (S570). The large screen terminal 10A starts outputting the received video and audio, and the communication terminal 20B starts outputting the received audio and POPUP display of the received video (member video of the communication terminal 20B) (S574).

  Thereafter, when the large screen terminal 10A transmits a disconnection request to the terminal management server 30 (S584), the terminal management server 30 transmits a disconnection instruction to the communication terminal 20B and the large screen terminal 10A (S588, S592), and the communication terminal 20B and The connection between the large screen terminals 10A is disconnected (S596, S598).

<4. Effect>
According to the embodiment of the present invention described above, various functions and effects can be obtained. For example, a member existing near the large screen terminal 10 can obtain a sense of reality such as a dialogue through a window by using the large screen terminal 10 to interact with members of other bases. Even when the member A who is away from the large screen terminal 10 interacts with the member B at the other base, the video of the member A is displayed in an appropriate size on the large screen terminal 10 at the other base. It is possible to reduce the decrease.

<5. Application example>
The embodiments of the present invention have been described above. Below, with reference to FIG. 14 and FIG. 15, the application example of embodiment of this invention is demonstrated.

(Constitution)
FIG. 14 is an explanatory diagram showing the configuration of the terminal management server 31 according to an application example. As illustrated in FIG. 14, the terminal management server 31 according to the application example includes a communication unit 324, a terminal information storage unit 328, a distance calculation unit 332, an imaging direction analysis unit 334, a connection destination determination unit 336, and a connection control unit 342. . Since the functions of the communication unit 324, the terminal information storage unit 328, the distance calculation unit 332, and the connection destination determination unit 336 are as described with reference to FIG. 7, detailed description thereof is omitted here.

  The imaging direction analysis unit 334 analyzes the relationship between the imaging direction by the large screen terminal 10 and the imaging direction by the communication terminal 20 with respect to the large screen terminal 10 and the communication terminal 20 existing at the same base. The imaging direction analysis unit 334 performs the above analysis based on the correspondence relationship between the object included in the overhead view video of the base acquired by the large screen terminal 10 and the object included in the video acquired by the communication terminal 20, for example. . For example, the imaging direction analysis unit 334 includes the position of the same object included in both the overhead view video of the base acquired by the large screen terminal 10 and the video acquired by the communication terminal 20 in the overhead view video of the base, and the communication terminal. Based on the relationship with the position in the video acquired by 20, the relationship between the direction of imaging by the large screen terminal 10 and the direction of imaging by the communication terminal 20 is analyzed. A specific example of the analysis will be described with reference to FIG.

  FIG. 15 is an explanatory view showing a bird's-eye view image of a base acquired by the large screen terminal 10. As shown in FIG. 15, the overhead view video of the base includes a door display E1 and a bookshelf display E2. A rectangular area indicated by a broken line in FIG. 15 indicates a range of imaging by the communication terminal 20A # 1, and the video acquired by the communication terminal 20A # 1 includes a door display E1 and a bookshelf display E2.

  The imaging direction analysis unit 334 is related to the positions of the door display E1 and the bookshelf display E2 in the overhead view video of the base, and the positions of the door display E1 and the bookshelf display E2 in the video acquired by the communication terminal 20A # 1. Thus, the relationship between the direction of imaging by the large screen terminal 10 and the direction of imaging by the communication terminal 20 is analyzed.

  The connection control unit 342 controls the connection between the communication terminals 20 existing at different bases and the connection between the communication terminal 20 and the large screen terminal 10 existing at different bases. For example, regarding the connection of the large screen terminal 10A existing at the site A and the communication terminal 20B existing at the site B, the connection control unit 342 transmits and receives audio between the large screen terminal 10A and the communication terminal 20B. On the other hand, the connection control unit 342 determines whether to transmit / receive video between the large screen terminal 10A and the communication terminal 20B, in addition to the positional relationship between the communication terminal 20B and the large screen terminal 10B existing at the base B, and the imaging direction. Control is performed based on the relationship between the direction of imaging by the large screen terminal 10B and the direction of imaging by the communication terminal 20B analyzed by the analysis unit 334.

  In this regard, even if the distance between the communication terminal 20B and the large screen terminal 10B existing at the base B is less than the threshold, the member using the communication terminal 20B is turning away from the large screen terminal 10B. It is difficult for the member to interact with the member of the base A using the large screen terminal 10B. Therefore, the connection control unit 342 is such that the distance between the communication terminal 20B and the large screen terminal 10B existing at the base B is less than the threshold, and the body of the member using the communication terminal 20B faces the large screen terminal 10B. In the case where it is estimated that the large screen terminal 10B is used instead of the communication terminal 20B, the video is not transmitted / received between the large screen terminal 10A and the communication terminal 20B. Here, since the direction of the body of the member using the communication terminal 20B is considered to be opposite to the direction of imaging by the communication terminal 20B, the connection control unit 342 has the large screen analyzed by the imaging direction analysis unit 334. The fact that the difference between the direction of imaging by the terminal 10B and the direction of imaging by the communication terminal 20B is less than the reference is handled as the body of the member using the communication terminal 20B facing the large screen terminal 10B.

  On the other hand, when the distance between the communication terminal 20B and the large screen terminal 10B existing at the site B is greater than or equal to the threshold, or when it is estimated that the body of the member using the communication terminal 20B does not face the large screen terminal 10B. In order to use the communication terminal 20B for the video, the video is also transmitted and received between the large screen terminal 10A and the communication terminal 20B.

(Operation)
16 and 17 are explanatory diagrams illustrating the operation of the remote communication system according to the application example. The processing of S504 to S544 in FIG. 16 is as described with reference to FIG. After S544, the terminal management server 31 requests an image from the large screen terminal 10B and the communication terminal 20B (S545). The large screen terminal 10B and the communication terminal 20B transmit the video to the terminal management server 31 in response to the request (S546). The terminal management server 31 analyzes the relationship between the direction of imaging by the large screen terminal 10B and the direction of imaging by the communication terminal 20B based on the video received from the large screen terminal 10B and the communication terminal 20B (S547).

  After that, as shown in FIG. 17, when the large screen terminal 10A transmits a connection request to the terminal management server 30 (S548), the connection destination determination unit 336 of the terminal management server 31 determines the connection destination related to the connection request ( S552). Here, a case where the communication terminal 20B is determined as a connection destination is considered. In this case, the terminal management server 30 transmits a connection instruction to the large screen terminal 10A and the communication terminal 20B (S556).

  Here, the terminal management server 31 performs different control regarding connection depending on the positional relationship between the large screen terminal 10B and the communication terminal 20B and the relationship between the direction of imaging by the large screen terminal 10B and the direction of imaging by the communication terminal 20B. I do. Specifically, in the terminal management server 31, the distance between the communication terminal 20B and the large screen terminal 10B is less than the threshold, and the difference between the direction of imaging by the large screen terminal 10B and the direction of imaging by the communication terminal 20B is If it is less than the reference, the large screen terminal 10A and the communication terminal 20B are allowed to start transmitting and receiving audio (S562). The large screen terminal 10A and the communication terminal 20B start outputting the received voice (S566). At this time, the large screen terminal 10A and the communication terminal 20B do not transmit and receive video.

  On the other hand, when the distance between the communication terminal 20B and the large screen terminal 10B is equal to or larger than the threshold value, or when the difference between the imaging direction by the large screen terminal 10B and the imaging direction by the communication terminal 20B is equal to or larger than the reference, terminal management The server 31 causes the large screen terminal 10A and the communication terminal 20B to start transmission / reception of video and audio (S572). The large screen terminal 10A starts outputting the received video and audio, and the communication terminal 20B starts outputting the received audio and POPUP display of the received video (member video of the communication terminal 20B) (S576).

  Thereafter, when the large screen terminal 10A transmits a disconnection request to the terminal management server 31 (S584), the terminal management server 31 transmits a disconnection instruction to the communication terminal 20B and the large screen terminal 10A (S588, S592), and the communication terminal 20B and The connection between the large screen terminals 10A is disconnected (S596, S598).

<6. Hardware configuration>
The embodiments of the present invention have been described above. Information processing such as distance calculation and connection control described above is realized by cooperation of software and hardware of the terminal management server 30 (terminal management server 31) described below.

  FIG. 18 is a block diagram illustrating a hardware configuration of the terminal management server 30. The terminal management server 30 includes a CPU (Central Processing Unit) 371, a ROM (Read Only Memory) 372, a RAM (Random Access Memory) 373, and a host bus 374. The terminal management server 30 includes a bridge 375, an external bus 376, an interface 377, an input device 378, a display device 379, an audio output device 380, a storage device (HDD) 381, a drive 382, a network, And an interface 383.

  The CPU 371 functions as an arithmetic processing device and a control device, and controls the overall operation in the terminal management server 30 according to various programs. Further, the CPU 371 may be a microprocessor. The ROM 372 stores programs used by the CPU 371, calculation parameters, and the like. The RAM 373 temporarily stores programs used in the execution of the CPU 371, parameters that change as appropriate during the execution, and the like. These are connected to each other by a host bus 374 including a CPU bus. Functions such as the distance calculation unit 332, the imaging direction analysis unit 334, the connection destination determination unit 336, and the connection control unit 340 can be realized by cooperation of the CPU 371, the ROM 372, the RAM 373, and the software.

  The host bus 374 is connected to an external bus 376 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 375. Note that the host bus 374, the bridge 375, and the external bus 376 are not necessarily configured separately, and these functions may be mounted on one bus.

  The input device 378 generates input signals based on input by members, such as a mouse, keyboard, touch panel, buttons, microphones, sensors, switches, and levers, and inputs input by the members, and outputs them to the CPU 371. It can be composed of a control circuit or the like. The operation of the terminal management server 30 is usually performed by voice. However, by operating the input device 378, various data can be input to the terminal management server 30 and a processing operation can be instructed. .

  The display device 379 includes display devices such as a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, a projector device, an OLED (Organic Light Emitting Diode) device, and a lamp. The display device 379 corresponds to the video output unit 240, for example. The audio output device 380 includes an audio output device such as a speaker and headphones. The audio output device 380 corresponds to the audio output unit 250, for example.

  The storage device 381 is a data storage device configured as an example of a storage unit of the terminal information storage unit 328 according to the present embodiment. The storage device 381 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device 381 is configured by, for example, a hard disk drive (HDD), a solid storage drive (SSD), or a memory having an equivalent function. The storage device 381 drives storage and stores programs executed by the CPU 371 and various data.

  The drive 382 is a storage medium reader / writer, and is built in or externally attached to the terminal management server 30. The drive 382 reads information recorded on the mounted removable storage medium 24 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the information to the RAM 373 or the storage device 381. The drive 382 can also write information into the removable storage medium 24.

  The network interface 383 is a communication interface configured by a communication device for connecting to the network 12, for example. The network interface 383 may be a wireless LAN (Local Area Network) compatible terminal or a wire terminal that performs wired communication.

<7. Supplement>
The preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, but the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention pertains can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also belong to the technical scope of the present invention.

  For example, in the above description, an example in which the large screen terminal 10 and the communication terminal 20 existing in different bases are connected has been described. However, the embodiment of the present invention can also be applied to connection between communication terminals 20 existing in different bases. It is. That is, when the communication terminal 20 existing at the first base is located far from the large screen terminal 10 existing at the first base, the communication terminal 20 existing at the second base is present at the first base. The face video of the member who uses the communication terminal 20 existing at the first base may be POPUP-displayed on the bird's-eye view video of the first base acquired by the large screen terminal 10.

  Further, each step in the processing of the remote communication system of the present specification does not necessarily have to be processed in time series in the order described as a sequence diagram. For example, each step in the processing of the remote communication system may be processed in an order different from the order described as the sequence diagram or may be processed in parallel.

  Further, hardware such as a CPU, a ROM, and a RAM incorporated in the large screen terminal 10, the communication terminal 20, and the terminal management server 30 are equivalent to the configurations of the large screen terminal 10, the communication terminal 20, and the terminal management server 30 described above. It is also possible to create a computer program for exercising these functions. A storage medium storing the computer program is also provided.

10 large screen terminal 12 network 20 communication terminal 30, 31 terminal management server 130 video output unit 140 imaging unit 150 voice input / output unit 160 communication unit 170 information storage unit 180 control unit 220 imaging unit 224 communication unit 230 sound collecting unit 240 video output Unit 250 voice output unit 260 information storage unit 270 light emitting unit 280 control unit 324 communication unit 328 terminal information storage unit 332 distance calculation unit 334 imaging direction analysis unit 336 connection destination determination unit 340, 342 connection control unit

Claims (10)

A management device connected to a first imaging device that acquires a first video and a second imaging device that acquires a second video,
The transmission of the second video to a communication partner device that receives the first video from the first imaging device and displays the first video, and the first imaging device and the second imaging A control unit for controlling based on the positional relationship of the devices;
A management device comprising:   The control unit displays the second image on the second imaging device based on a distance between the position of the first imaging device and the position of the second imaging device being equal to or greater than a threshold value. The management apparatus according to claim 1, wherein transmission is performed to the second imaging apparatus.   The control unit is further configured to transfer from the second imaging device to the communication counterpart device based on a relationship between a direction of imaging by the first imaging device and a direction of imaging by the second imaging device. The management apparatus according to claim 1, wherein transmission of the second video is controlled.   The control unit causes the second imaging device to perform the second imaging based on a difference between an imaging direction by the first imaging device and an imaging direction by the second imaging device being less than a reference. The management apparatus according to claim 3, wherein the video is transmitted to the second imaging apparatus.   The controller includes an object included in the first video to determine whether a difference between a direction of imaging by the first imaging device and a direction of imaging by the second imaging device is less than a reference, The management apparatus according to claim 3, wherein the determination is made based on a correspondence relationship with an object included in the second video. The second imaging device acquires audio;
The management device according to claim 1, wherein the control unit causes the second imaging device to transmit the voice to the communication partner device.   The control unit calculates a distance between the position of the first imaging device and the position of the second imaging device based on the position of the second imaging device in the first video. Item 3. The management device according to Item 2. A method executed by a management device connected to a first imaging device that acquires a first video and a second imaging device that acquires a second video,
The transmission of the second video to a communication partner device that receives the first video from the first imaging device and displays the first video, and the first imaging device and the second imaging Control based on the positional relationship of the devices,
Including the method. Computer
A management device connected to a first imaging device that acquires a first video and a second imaging device that acquires a second video,
The transmission of the second video to a communication partner device that receives the first video from the first imaging device and displays the first video, and the first imaging device and the second imaging A control unit for controlling based on the positional relationship of the devices;
A program for causing a computer to function as a management device. A management system comprising a management device connected to a first imaging device that acquires a first video and a second imaging device that acquires a second video,
The transmission of the second video to a communication partner device that receives the first video from the first imaging device and displays the first video, and the first imaging device and the second imaging A control unit for controlling based on the positional relationship of the devices;
A management system comprising:

Images