JP2015186177A - Video distribution system and video distribution method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable persons to actually face each other and to attain total communications similarly to a conference not only by enabling the communications while including an expression of a speaker but also by simultaneously confirming reactions of any other conference participants other than the speaker.SOLUTION: At a transmission-side base, an imaging object at the transmission-side object is individually imaged at least in two directions, images individually captured in the imaging directions are coupled into one image data item, and the coupled one image data item are sent to a communication line. A plurality of screens are provided at a reception-side base, the one image data item transmitted via the communication line are separated into individual images for the unit of the imaging direction, and the individual images separated for the unit of the imaging direction are projected on the corresponding screens. Thus, the persons are enabled to actually face each other and to attain total communications similarly to the conference.

Description

  The present invention relates to a video distribution system and a video distribution method used for advancing a conference or the like by distributing a video to each base such as a conference room separated from each other.

  According to Patent Document 1, in a video conference system, a terminal device compatible with the video conference system is provided for each place such as a conference hall that is separated from each other, and an imaging device and a display device are connected to the terminal device. In one conference hall, for example, a captured image obtained by imaging a conference participant or the like in the conference hall with an imaging device is transmitted via the terminal device to a terminal device in a conference hall in another location. . The far-end terminal device receives the transmitted captured image and displays it on a display connected to itself.

  In the case of a video conference system, it may be preferable to change the imaging field of view captured by the imaging device in accordance with the progress of the conference. For example, every time a conference participant speaks, the conference participant (speaker) in speech is desired to be shown in close-up. However, in such a case, it is not convenient for the imaging apparatus to perform imaging in a state where the imaging direction is fixed by a fixed point.

  Therefore, the video conference system adopts a configuration that can control so-called pan / tilt / zoom after combining the imaging device and the pan / tilt head. When the corresponding movement instruction operation is performed, for example, when the speaker changes, the imaging field of view can be set so that the speaker is reflected and the imaging apparatus can be imaged.

JP 2009-188975 A

  However, in a conventional video conference system, only a flat display or the like corresponding to a specific imaging field of view is arranged. For example, in order to give a sense of reality and reality, a speaker is focused by pan, tilt, zoom, etc. In this case, the remote display can communicate, including the speaker's facial expression, but at the same time, it is not possible to check the reaction of other conference participants other than the speaker. As compared with the case where a conference is held, there is a problem that it is insufficient as comprehensive communication.

  The conventional video conferencing system has been devised to make the other party's facial expression and gesture clearly visible by increasing the size of the display and improving the image quality to give a sense of realism and reality. In order to express the atmosphere of the conference hall only by increasing the size or improving the image quality, there is a problem that there is a lack of realism and reality, and it is difficult to fill a sense of distance between the transmission side and the reception side.

  The purpose of the present invention is not only to enable communication including the facial expression of the speaker, but also to confirm the reaction of other conference participants other than the speaker at the same time. It is to provide a video distribution system and a video distribution method capable of achieving comprehensive communication in the same manner as the above.

  In order to achieve the above object, a video distribution system according to the present invention is a video distribution system that displays image data captured at a transmitting site on a screen of a receiving site, wherein the transmitting site is a shooting object at the transmitting site. An image capturing device that individually captures images from at least two directions, a combining unit that combines images individually captured from the image capturing directions into one image data, and the combined image data A transmission unit for transmitting to the communication line, the base on the receiving side has a plurality of screens, and each image data transmitted on the communication line is an individual image in the photographing direction as a unit. And a display unit for projecting each individual image separated by the separation unit in the photographing direction on the corresponding screen. And it is characterized in Rukoto.

  In the video distribution system, the imaging device outputs the captured image in units of one frame, and the combining unit combines the images in units of one frame with one image data. It is what.

  In the video distribution system, the separating unit of the receiving base has a function of notifying the transmitting base including not only the information of the number of installed screens but also the position information of the screens installed. The combining unit of the transmission side base selects the individual image corresponding to the number of installed screens and the position information notified from the separation unit of the reception side base, and selects the selected image as one It has a function of combining with image data.

  In the video distribution system, the plurality of screens at the receiving base are combined with a depth to form a stereoscopic view in the field of view on the receiving side.

  In the video distribution system, the photographing device is installed for each photographing direction.

  In the video distribution system, the photographing device is a photographing device having a wide angle of view.

  The video distribution method according to the present invention is a video distribution method for projecting image data captured at a transmission site to a screen of a reception site, and at each of the transmission sites, the imaging object at the transmission site is individually separated from at least two directions. The images taken individually from the shooting direction are combined into one image data, the combined image data is sent to a communication line, and the receiving base has a plurality of screens. Each of the image data transmitted through the communication line is separated into individual images in units of photographing directions, and the individual images separated in units of the photographing directions are respectively displayed on the corresponding screens. It is what.

  In the video distribution method, the captured image is output in units of frames at the transmission base, and the images in units of frames are combined into one image data.

  In the video delivery method, the plurality of screens are combined with a depth to form a stereoscopic view in the field of view on the receiving side.

  As described above, according to the present invention, at the transmission side base, the photographing object at the transmission side base is individually photographed from at least two directions, and the images individually photographed from the respective photographing directions are made into one image data. The combined image data is transmitted to a communication line, and at least a plurality of screens are provided at a receiving base, and the image data transmitted through the communication line is converted into individual images in units of photographing directions. Each individual image separated and displayed in the shooting direction unit is displayed on the corresponding screen, so that communication including the expression of the speaker is possible, and at the same time other meetings other than the speaker Participants' reactions can be confirmed, and comprehensive communication can be achieved in the same manner as a meeting where people actually face each other.

  In addition, the separation unit of the reception site has a function of notifying the transmission site including the position information of the screen in addition to the information on the number of installed screens, and the coupling unit of the transmission site The transmission side for selecting the individual images corresponding to the number of installed screens and the position information notified from the separation unit of the receiving base and combining the selected images into one image data. Even when the number of screens on the receiving side is smaller than the number of imaging devices, only necessary images are combined, so that the amount of data to be transmitted can be reduced and the load on the communication line can be reduced.

  Furthermore, since the receiving side base forms a stereoscopic view within the field of view on the receiving side by combining the plurality of screens with a depth, it is possible to give the image projected at the receiving side base a sense of depth. In addition, the presence and reality of the transmitting side base can be brought about by the image transmitted from the transmitting side base.

  Further, since the captured image is output in units of one frame at the transmitting side base, and the image in one frame unit is combined with one image data to be transmitted to the receiving side base, a network delay occurs when the data is transmitted over the network. Even if an error occurs, the image displayed on each screen will not cause an unnatural phenomenon such as dropping a frame on a specific screen. And the room can be seen with a sense of realism, communication between the transmitting base and the receiving base can be maintained well, and the discussion can be facilitated without a sense of distance.

It is a block diagram which shows the video delivery system which concerns on embodiment of this invention. It is a block diagram which shows the structure of the transmission side base in the video delivery system which concerns on embodiment of this invention. It is a block diagram which shows the structure of the receiving side base in the video delivery system which concerns on embodiment of this invention. It is a figure which shows the processing state which transmits a combined image from a transmission side base to a reception side base, and isolate | separates the said combined image in a reception side base. It is a block diagram which shows another example of a structure of the transmission side base in the video delivery system which concerns on embodiment of this invention. It is a block diagram which shows another example of a structure of the receiving side base in the video delivery system which concerns on embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  Video conferencing systems have already been widely developed, but these video conferencing systems have a sense of distance between the transmitting base and the receiving base as described above. There is no current situation.

  The video distribution system according to the embodiment of the present invention constructs a video distribution system that displays the image data captured at the transmission site A on the screen of the reception site B, so that the transmission site A and the reception site B It is intended to eliminate the sense of distance that exists in. Specifically, as shown in FIG. 1, the video distribution system according to the embodiment of the present invention connects a transmission-side base A and a reception-side base B via a communication network 4, and a plurality of shootings are performed at the transmission-side base A. The apparatus 1a, 1b, 1c, the coupling part 2, and the transmission part 3 are provided, the receiving side base B is provided with a plurality of screens 7a, 7b, 7c, and the receiving side base B is provided with a separating part 6 and a display. Part 5a, 5b, 5c.

  Video processing devices P 1 and P 2 are installed at the transmitting site A and the receiving site B, respectively, and these video processing devices P 1 and P 2 are connected to each other via a communication network 4. Then, the coupling unit 2 and the transmission unit 3 of the transmission base A are constructed on the video processing device P1 of the transmission base A. Similarly, the separating unit 6 of the receiving base B is constructed on the video processing device P2 of the receiving base B.

  In the example shown in FIG. 1, three imaging devices 1a, 1b, and 1c are installed at the transmitting site A, and the receiving site B corresponds to the three imaging devices 1a, 1b, and 1c at the transmitting site A. Although three screens 7a, 7b, and 7c are installed, the number of the photographing devices and the screens is not limited to three, and the number of installed devices is limited as long as it is at least two. It is not something.

  First, the configuration of the transmitting side base A will be described with reference to FIG. The three photographing devices 1a, 1b, and 1c individually photograph the space S1 such as a conference room, which is a subject to be photographed at the transmission side base A, from the XYZ photographing directions. That is, the first imaging device 1a captures the space S1 as an image on the ZY plane (right side), and the second imaging device 1b captures the space S1 as an image on the ZX plane (left side). The third imaging device 1c captures the space S1 as an image on the XY plane (bottom surface). Among these photographing devices 1a, 1b, and 1c, and the photographing device 1c for photographing an image on the XY plane (bottom surface) can be installed on the ceiling side in the Z direction and can photograph the space S1 through a lens obliquely below. ing. The crossing angle between the ZY plane (right side plane) and the ZX plane (left side plane) and the angle between these planes and the XY plane (bottom plane) are not limited to 90 degrees. The crossing angle is not limited as long as the stereoscopic view is formed in the field of view.

  Further, the three photographing devices 1a, 1b, and 1c use video cameras or the like, and sequentially output photographed images in units of one frame.

  The combining unit 2 combines the images D1, D2, and D3 individually photographed from the respective photographing directions (XYZ directions) by the three photographing devices 1a, 1b, and 1c into one image data D to form one image. Output as data. Specifically, as shown in FIG. 4, the combining unit 2 combines the images D1, D2, and D3 output by the three photographing devices 1a, 1b, and 1c in units of one frame as one image data D.

  The transmitting unit 3 transmits one image data D combined by the combining unit 2 to the communication network 4. Specifically, as shown in FIG. 4, the transmitting unit 3 receives one image data D combined by the combining unit 2, and transmits the image data D via a communication network 4 such as the Internet. ing.

Next, the configuration of the receiving site B will be described with reference to FIG.
The three screens 7a, 7b, and 7c at the receiving site B are installed corresponding to the mode in which the three imaging devices 1a, 1b, and 1c at the transmitting site A capture the space S1. Specifically, the space S2 surrounded by the three screens 7a, 7b, 7c at the receiving site B corresponds to the space S1 at the transmitting site A, and the first screen 7a is ZY of the space S2. The second screen 7b is disposed on the ZX plane (left side) of the space S2, and the third screen 7c is disposed on the plane XY plane (bottom surface). These three screens 7a, 7b, and 7c form a space S2 having a depth. The crossing angle between the ZY plane (right side plane) and the ZX plane (left side plane) and the angle between these planes and the XY plane (bottom plane) are not limited to 90 degrees. The crossing angle is not limited as long as the stereoscopic view is formed in the field of view.

  The separation unit 6 separates one image data D transmitted from the transmission unit 3 of the transmission side base A via the communication network 4 into individual images D1, D2, and D3 in units of one frame. . When the crossing angle between the photographing directions by the imaging devices 1a, 1b, and 1c installed at the transmitting site A differs from the crossing angle of the screens 7a, 7b, and 7c installed at the receiving site B, the screen 7a , 7b, 7c are distorted into trapezoidal images. In order to eliminate this distortion, the separation unit 6 performs a trapezoidal distortion correction (keystone correction) process to make each of the separated images have a trapezoidal image of D1, D2, and D3.

  The display units 5a, 5b, and 5c are projectors that project images on the screens 7a, 7b, and 7c, and the three display units 5a, 5b, and 5c are spaces such as a conference room that is an object to be photographed at the transmission base A. An image of S1 is projected onto the screens 7a, 7b, and 7c individually from the XYZ shooting directions, thereby reproducing an image of the three-dimensional space S1 having a depth in the space S2. In other words, the first display unit 5a displays an image captured by the first imaging device 1a on the ZY plane (right side surface) of the space S2, and the second display unit 5b displays the second imaging device 1b. Is displayed on the ZX plane (left side) of the space S2, and the third display unit 5c displays the image captured by the third imaging apparatus 1c on the XY plane (bottom surface) of the space S2. The space S1 of the transmitting side base A is reproduced in the space S2 by the images projected on the three screens 7a, 7b, 7c.

  Next, an operation for reproducing the image of the space S1 that is the object to be photographed at the transmitting site A in the space S2 surrounded by the screens 7a, 7b, and 7c at the receiving site B will be described.

  At the transmitting site A, the three shooting devices 1a, 1b, and 1c are used to individually shoot a space S1 such as a conference room that is a shooting target from the XYZ shooting directions. That is, the first photographing device 1a is used to photograph the space S1 as an image on the ZY plane (right side), and the second photographing device 1b is used to photograph the space S1 on the ZX plane (left side). The space S1 is photographed as an image on the XY plane (bottom surface) using the third photographing device 1c, and the images photographed by the three photographing devices 1a, 1b, 1c are taken as a frame unit. Are sequentially output to the coupling unit 2 of the transmitting site A.

  As shown in FIG. 4, the coupling unit 2 shown in FIG. 2 has images D1, D2, and D3 taken individually from the respective photographing directions (XYZ directions) by the three photographing devices 1a, 1b, and 1c. The image data D is combined and output to the transmission unit 3 of the transmission side base A shown in FIG.

  As shown in FIG. 4, the transmission unit 3 receives and transmits one image data D combined by the combining unit 2. As a result, the image data D obtained by photographing the space S1 of the transmitting site A is sent to the receiving site B via the communication network 4.

  As shown in FIG. 4, the separating unit 6 at the receiving site B shown in FIG. 2 converts one image data D transmitted from the transmitting unit 3 at the transmitting site A via the communication network 4 into individual frames. The images D1, D2, and D3 are separated, and the images D1, D2, and D3 are sent to the corresponding display units 5a, 5b, and 5c. That is, the image D1 is sent to the first display unit 5a, the image D2 is sent to the second display unit 5b, and the image D3 is sent to the third display unit 5c.

  When the three display units 5a, 5b, and 5c receive the images D1, D2, and D3 from the separation unit 6, they display the images D1, D2, and D3 on the corresponding screens 7a, 7b, and 7c, respectively. That is, the first display unit 5a displays an image captured by the first imaging device 1a on the ZY plane (right side) of the space S2, and the second display unit 5b is captured by the second imaging device 1b. The image is displayed on the ZX plane (left side) of the space S2, and the third display unit 5c displays the image captured by the third imaging device 1c on the XY plane (bottom surface) of the space S2. Thereby, the space S1 of the transmission side base A is reproduced in the space S2 by the images projected on the three screens 7a, 7b, 7c.

  In the above embodiment, in order to photograph the space S1 of the transmitting base A from a plurality of directions, the three photographing apparatuses 1a, 1b, and 1c are photographed. However, the present invention is not limited to this. The image on the ZY plane, the ZX plane, and the XY plane may be shot as a single image in a panoramic manner using a single shooting apparatus with a wide angle of view. In this case, the separating unit 6 at the receiving site B separates one panoramic image into a ZY plane, a ZX plane, and an XY plane, and based on parameters such as an angle Z- The image is separated into images on the Y, ZX, and XY planes.

  As described above, according to the embodiment of the present invention, at the transmission side base, the shooting target object at the transmission side base is individually photographed from at least two directions, and images individually photographed from the respective photographing directions are individually captured. Combine one image data, send the combined one image data to a communication line, and provide at least a plurality of screens at a base on the receiving side. Each unit is separated into individual images, and each individual image separated with the shooting direction as a unit is displayed on the corresponding screen, so that communication including the expression of the speaker is possible, and at the same time It is possible to confirm the reactions of other conference participants other than the speaker, and people can actually face each other and have a comprehensive communication similar to the conference. Shon can be achieved.

  Next, a modified example of the embodiment of the present invention will be described. When a new video distribution system is applied to the receiving site B, it may be possible to install the screen 7a on the ZY plane and the screen 7b on the ZX plane without providing the screen 7c on the XY plane. . In this case, it is conceivable to transmit three images captured by the three imaging devices 1a, 1b, and 1c at the transmitting site A to the receiving site B via the communication network 4, but the amount of data flowing on the communication network 4 Increases and places a burden on the communication network 4.

  Therefore, as shown in FIG. 6, the notification unit 8 provided in the separation unit 6 of the reception-side base B includes the information on the number of installed screens 7 a, 7 b or 7 c, It has a function of notifying the transmitting base including the installed position information. The selection unit 9 installed in the combining unit 2 of the transmission side base B selects the individual image corresponding to the number of installed screens 7a, 7b or 7c notified from the reception side base B and the position information. The selected image is combined with one image data.

  The position information indicates that the screen 7a installed at the receiving site B corresponds to the ZY plane of the space S2, and the screen 7b corresponds to the ZX plane of the space S2. Information.

  In the example illustrated in FIG. 5, the selection unit 9 installed in the coupling unit 2 of the transmission base A is connected to the notification unit 8 provided in the separation unit 6 of the reception base B via the transmission unit 3 and the communication network 4. An inquiry is made regarding information relating to the screen 7a, 7b or 7c at the site B.

  The notification unit 8 at the receiving site B receives the inquiry from the transmitting site A about the screen. The receiving site B has two screens 7a and 7b, and these screens 7a and 7b are Z. Information on the -Y plane and the Z-X plane is notified to the transmitting site B.

  When the selection unit 9 at the transmission site A receives the information about the screens 7a and 7b notified from the notification unit 8 at the reception site B through the communication network 4 and the transmission unit 3, the selection unit 9 includes three units. Two images D1, D2 are selected from the images D1, D2, D3 photographed by the photographing devices 1a, 1b, 1c, and the selected images D1, D2 are combined into one image data D.

  The transmission unit 3 of the transmission side base A transmits one image data D (images D1 and D2) from the selection unit 9 to the reception side base B.

  The separating unit 6 at the receiving site B separates one image data D into two images D1 and D2, and outputs these images to the display units 5a and 5b. The display unit 5a displays an image on the ZY screen 7a, and the display unit 5b displays the image on the ZX screen 7b.

  Also in this example, the screen 7a is arranged on the ZY plane, the screen 7b is arranged on the ZX plane, and the receiving side base B forms a space S2 having a depth by the screen 7a and the screen 7b. The sense of distance between the transmitting site A and the receiving site B can be eliminated as much as possible.

  Furthermore, since the number of images is reduced from the three images captured by the three imaging devices 1a, 1b, and 1c at the transmitting site A and transmitted to the receiving site B via the communication network 4, the amount of data flowing on the communication network 4 Can be suppressed as much as possible, and the burden on the communication network 4 can be reduced.

  The present invention described above is a sense of distance between a transmitting base and a receiving base in a wide range of fields, such as meetings / business negotiations, education / training fields, disaster countermeasures, and BCP (Business Continuity Plan Business Continuity Plan). It is possible to create a sense of presence and a feeling of air as if you were there.

  The present invention can be embodied in many forms without departing from its essential characteristics. Therefore, it is needless to say that the above-described embodiment is exclusively for description and does not limit the present invention.

A transmitting base B receiving base 1a, 1b, 1c photographing device 2 coupling unit 3 transmitting unit 4 communication network 5a, 5b, 5c display unit 6 separating unit 7a, 7b, 7c screen 8 notifying unit 9 selecting unit

Claims (9)

In a video distribution system that displays image data taken at the transmitting site on the screen of the receiving site,
The transmitting site is
An imaging device that individually captures an object to be imaged at a transmitting site from at least two directions, and a combining unit that combines the images individually captured from the imaging directions by the plurality of imaging devices into one image data; A transmission unit that sends the combined image data to a communication line;
The receiving site is
Each having a plurality of screens, each separating one image data transmitted over the communication line into individual images in units of shooting directions, and each of the separation units separated in units of shooting directions And a display unit for displaying individual images on the corresponding screens. The photographing device outputs the photographed image in units of one frame,
The video distribution system according to claim 1, wherein the combining unit is configured to combine an image of one frame unit with one image data. The separating unit of the receiving base has a function of notifying the transmitting base including the position information of the screen in addition to the information on the number of installed screens,
The combining unit of the transmission side base selects the individual image corresponding to the number of installed screens and the position information notified from the separation unit of the reception side base and selects the selected image as one image. The video distribution system according to claim 1, wherein the video distribution system has a function of combining with data.   2. The video distribution system according to claim 1, wherein the plurality of screens at the receiving side base are combined with a depth to form a stereoscopic view in the field of view on the receiving side.   The video distribution system according to claim 1, wherein the photographing device is installed for each photographing direction.   The video delivery system according to claim 1, wherein the photographing device is a photographing device having a wide angle of view. In the video distribution method that displays the image data taken at the transmitting site on the screen of the receiving site,
At the transmission base, the photographing object at the transmission base is individually photographed from at least two directions, images individually photographed from the photographing directions are combined into one image data, and the combined image Send data to the communication line,
The receiving-side base has a plurality of screens, each of the image data transmitted through the communication line is separated into individual images in the photographing direction unit, and each individual separated in the photographing direction unit A video distribution method, wherein each of the images is displayed on the corresponding screen.   8. The video distribution method according to claim 7, wherein the captured image is output in units of one frame at the transmission base, and the image in units of one frame is combined into one image data.   8. The video distribution method according to claim 7, wherein the plurality of screens at the receiving base are combined with a depth to form a stereoscopic view in the field of view on the receiving side.

Images