JP2020123990A - Multiple video distribution system - Google Patents

Abstract

To provide a multiple video distribution system that allows a large number of users to simultaneously observe an imaging target present in a limited area without causing device congestion in the vicinity of the imaging target.SOLUTION: A multiple video distribution system includes: a plurality of slave devices for imaging an imaging target from different perspectives and/or gaze directions and generating and transmitting an imaging signal; and a master device for generating and transmitting "video signals of a plurality of systems having different display ranges" on the basis of the imaging signal. The master device has a function to generate three-dimensional mapping data of the surface of the imaging target on the basis of "the imaging signal received from each of the slave devices", and "the positional information on each slave device and gaze direction information", and generate "a video signal corresponding to 'a view obtained by viewing the imaging target from a predetermined view position and the gaze direction'" on the basis of the three-dimensional mapping data.SELECTED DRAWING: Figure 1

Description

The present invention relates to a multiplex video distribution system, and more particularly to a multiplex video distribution system that allows a plurality of users to simultaneously enjoy videos with different display ranges.

As a multiplex video distribution system in which a plurality of users can enjoy videos with different display ranges at the same time, as described in Patent Document 1 and Patent Document 2 in the related art,
An imaging signal generated by the child device imaging the imaging target after associating the “child device existing in “the site where the imaging target is located”” with the “terminal device used by the “user in a remote location”” A multiplex video distribution system has been proposed in which the “local device existing in the field” converts the video signal into a video signal and transmits the video signal to the terminal device.

However, in the conventional system, since the terminal device and the child device are usually associated with each other in a one-to-one or approximately one-to-one relationship, the number of child devices also increases as the number of users who use the terminal device increases. However, the problem of congestion at the site arises. And, this problem is that many users can simultaneously capture images of imaging targets (for example, creatures in a cave, plays performed in a theater, sports events and concerts performed in a stadium, etc.) that exist in a limited area. When you try to have fun, you get more serious.

In addition, in the conventional system, the image pickup signal from the "child device existing in the field" and the video signal from the "parent device existing in the field" are usually delivered live in real time. When there is a time difference between "the target site" and "the remote place where the user is", there is a problem that the user at the remote place can enjoy the event that is being performed locally during the daytime only at midnight. Occurs.

Patent No. 6089256 JP, 2017-103796, A

The present invention has been made in view of such circumstances, and a large number of users simultaneously observe the imaging target existing in a limited area without causing congestion of the device near the imaging target. An object of the present invention is to provide a multiplex video distribution system capable of performing the above.

Further, according to the present invention, even when there is a time difference between the “local where the imaging target is located” and the “remote location where the user is”, a time close to the time of the “remote location where the user is” (however, the date is the previous day). It is an object of the present invention to provide a multiplex video distribution system capable of observing the state of an image pickup target in (see also).

In order to achieve the above object, a first aspect of the present invention related to a multiplex video distribution system is
A plurality of child devices which are three-dimensionally arranged, generate an image pickup signal by picking up an image pickup target from different viewpoints and/or line-of-sight directions, perform necessary conversion, and then transmit the parent signal to a parent device described later;
A parent device that generates and transmits “a plurality of systems of video signals having different display ranges” based on the imaging signals received from each of the child devices;
A multi-video distribution system consisting of
The parent device is a three-dimensional map in which the surface of the imaging target is mapped in a three-dimensional space based on the “imaging signal received from each of the child devices” and “position information and line-of-sight direction information of each of the child devices”. It has a function of generating mapping data and generating a "video signal corresponding to "a visual image of an object to be imaged viewed from a predetermined viewpoint and line-of-sight direction"" based on the three-dimensional mapping data
As configured.

In the first aspect of the present invention, the child device includes an image pickup unit configured by an image sensor (CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor)) that photoelectrically converts incident light, and an image pickup unit including the image pickup unit. Electrical signals (hereinafter abbreviated as “imaging electrical signals”) of digital RGB, LVDS (Low Voltage Differential Signaling) (or LDI (LVDS Display Interface)), GVIF (GigabitVideo InterFace), USB (Universal Serial Bus), DisplayPort , WirelessHD (High Definition), WHDI (Wireless Home Digital Interface), WiGig (Wireless Gigabit), and other uncompressed video signals (hereinafter referred to as "uncompressed video signals") are transmitted, and the uncompressed A video signal that is compression-encoded by a standard such as H.261, H.263, H.264, MPEG (Moving Picture Experts Group)-1, MPEG-2, MPEG-4 (hereinafter, "compressed video signal"). ")) and a communication means for transmitting the compressed video signal to the parent device.

Note that the child device may have a configuration in which the conversion by the signal conversion unit is limited to the non-compressed video signal instead of the above configuration. Then, in the case of adopting this configuration, the communication means will transmit the uncompressed video signal to the parent device.

Further, as the position information of the child device, the latitude/longitude of the ground point vertically below the viewpoint of the imaging device of the child device and the altitude of the viewpoint of the imaging device of the child device can be used. Further, as the line-of-sight direction information of the child device, the vertical inclination angle θ and the horizontal rotation angle φ of the line-of-sight of the image pickup means of the child device can be used.

In the present specification and claims, "viewpoint", "altitude of viewpoint", "ground point vertically below the viewpoint", "line of sight", "angle of inclination in the vertical direction of line of sight", and "horizontal direction of line of sight" in the description and claims. The rotation angle φ, the “imaging range”, the “viewpoint (center of the imaging range)”, etc. are as shown in FIG.

In addition, what is meant in the present specification and claims such as "a visual image of a subject viewed from a predetermined visual point and line-of-sight direction" and "a video signal corresponding to the visual image" is shown in FIG. That's right.

In order to achieve the above object, a second aspect of the present invention relating to a multiplex video distribution system is the multiplex video distribution system of the first aspect,
A function of generating "a plurality of video signals of different display ranges" based on display range setting signals received from a plurality of terminal devices;
A function of transmitting the generated video signal of each system to the "terminal device that generated the display range setting signal generated based on the video signal of the system";
Has,
Configured to do so.

In order to achieve the above object, a third aspect of the present invention relating to a multiplex video distribution system is the multiplex video distribution system according to the second aspect.
The parent device is
After setting the viewpoint and the line-of-sight direction based on the viewpoint setting signal and the line-of-sight direction setting signal received from the terminal device, a "video signal corresponding to the "view image of the imaging target viewed from the viewpoint and the line-of-sight direction"" Function to generate;
A function of transmitting the generated video signal to “a terminal device that has generated the viewpoint setting signal and the line-of-sight direction setting signal generated based on the video signal of the system”;
Has,
Configured to do so.

In order to achieve the above object, a fourth aspect of the present invention relating to a multiplex video distribution system is the multiplex video distribution system according to the third aspect,
The parent device has a function of generating “two systems of video signals that reflect the displacement of the binocular visual point”.
Has,
As configured.

In order to achieve the above object, a fifth aspect of the present invention relating to a multiplex video distribution system is the multiplex video distribution system according to any one of the second to fourth aspects,
The parent device is
A function of accumulating the past three-dimensional mapping data;
A function of generating a video signal based on three-dimensional mapping data before the time when the display range setting signal is received from the terminal device;
Has,
As configured.

According to the multiplex video distribution system of the present invention, by preparing only a sufficient number of child devices that can image the surface of the imaging target existing in a predetermined area, the shape of the surface of the imaging target in each area and the surface points As long as it is possible to generate three-dimensional mapping data that expresses a color, and if three-dimensional mapping data can be created, no matter what viewpoint or line-of-sight direction is set, the "viewing point of view of the imaging target from the viewpoint and line-of-sight direction" Since it is possible to generate a video signal equivalent to "image", it is not necessary to increase the number of child devices even if the number of users who use the terminal device increases, and therefore, the small device does not become congested near the imaging target. ..

Particularly, according to the multiplex video distribution system of the fifth aspect of the present invention, it is possible to time-shift and generate a video corresponding to a visual image of an imaging target observed before the time when the user operates the terminal device. Therefore, even if there is a time difference between "the site where the image is captured" and "the remote location where the user is", it is possible to observe the state of the image capture target at a time close to the time of the "remote location where the user is". it can.

It is a block diagram for explaining a configuration and a function of the multiplex video distribution system according to the first embodiment of the present invention. It is an image diagram for explaining the configuration and function of the multiplex video distribution system according to the first embodiment of the present invention. FIG. 3 is an explanatory diagram for explaining a deployment principle of child devices in the multiplex video distribution system according to the first embodiment of the present invention. FIG. 5 is an explanatory diagram for explaining a method of mapping surface points of an imaging target onto a three-dimensional space in the multiplex video distribution system according to the first embodiment of the present invention. "Sight", "elevation altitude", "ground point vertically below the sight", "line of sight", "angle of inclination in the vertical direction of the line of sight" "rotation of the line of sight in the horizontal direction" of the image pickup means in the present specification and claims. It is explanatory drawing for demonstrating meaning, such as an angle (phi), "imaging range," "a viewpoint (center of an imaging range)." FIG. 3 is an explanatory diagram for explaining “a view image of an image pickup target viewed from a predetermined viewpoint and line-of-sight direction” and “a video signal corresponding to the view image” in the present specification and claims.

Embodiments of the present invention will be described below with reference to the drawings. However, the present invention is not limited to such an embodiment, and various modifications can be made within the scope of the technical idea thereof.

FIG. 1 is a block diagram for explaining the configuration and function of the multiplex video distribution system according to the first embodiment of the present invention.
FIG. 2 is an image diagram for explaining the configuration and function of the multiplex video distribution system according to the first embodiment of the present invention. In particular, the multiplex video distribution system according to the first embodiment of the present invention It illustrates an example of a method of deploying a child device in the case where a sphinx image is simultaneously distributed.

In the present embodiment, the multiplex video distribution system includes a child device α_1α to a child device ζ_1ζ and a parent device 2, and the parent device 2 further includes an interface unit 21 and a server 22. The server 22 is also connected to the terminal devices A_4A to H_4H used by the user via the Internet 3.

Among the child devices, the child device α_1α, the child device β_1β, and the child device ζ_1ζ are fixed to the ground around the sphinx that is the imaging target. On the other hand, the child device γ_1γ, the child device δ_1δ, and the child device ε_1ε are drones equipped with image pickup means and are floating in the air around the sphinx.

Further, each child device is a signal conversion unit that converts an image pickup electrical signal from an image pickup unit that is a CMOS camera module and an image sensor of the CMOS camera module into a non-compressed video signal, and further converts the compressed video signal into a compressed video signal. And a communication means for transmitting the compressed video signal to the parent device 2. Then, the child device α_1α, the child device β_1β and the child device ζ_1ζ transmit the generated compressed video signal from the communication means to the parent device 2 via the cable, and the child device γ_1γ, the child device δ_1δ and the child device ε_1ε generate the The compressed video signal is transmitted from the communication means to the parent device 2 by wireless communication.

Furthermore, each child device includes a GPS sensor that measures the horizontal position of the visual point of the attached image pickup means, an altitude sensor that measures the altitude, and a gyro sensor that measures the inclination angle θ and the rotation angle φ of the image pickup means in the line-of-sight direction. Signals (hereinafter, collectively referred to as “position/line-of-sight direction signals”) that are mounted and transmit the measurement results of these sensors are transmitted from the communication means to the parent device 2.

Note that, in the figure, for convenience of expression on paper, only six child devices, namely, child devices α_1α to child devices ζ_1ζ are shown, but the principle of deploying the child devices is as follows, and this principle is fulfilled. The required number of child devices are deployed.
[Principle of deploying child devices]
"All surface points to be imaged are within the image-capable range of the image-capturing means of a plurality of child devices."

Hereinafter, the deployment principle of the above-mentioned child device will be described with reference to FIG.
In FIG. 3, the imaging target has side surfaces A to F, but these side surfaces are all within the image-capable range of a plurality of child devices as described below.
Side A... Child device i + Child device ii
Side B... Child device ii + Child device iii
Side C... Child device iii + Child device iv
Side D... Child device iii + Child device iv
Side E... Child device iii+Child device iv+Child device v
Side F... Child device i + Child device v

On the other hand, the parent device 2 receives the compressed video signal and the position/gaze direction signal transmitted from the child device α_1α to the child device ζ_1ζ by the interface unit 21 and transfers them to the server 22. The server 22 maps the surface points of the imaging target in the three-dimensional space based on the signals from the plurality of child devices, and defines the color of each surface point by the RGB value or the HSV value.

In the following, the procedure of the mapping method of the surface points (indicated by * in the figure) of the imaging target in the three-dimensional space will be described with reference to FIG. Note that the imaging target in FIG. 3 is the same as that in FIG. 2, but the child devices iii to v described in FIG. 3 are not shown for the sake of simplicity.

(1) Setting of three-dimensional space coordinate axes The Cartesian coordinate axes of the three-dimensional space for mapping the surface points of the imaging target are set as follows.
X-axis: Latitude direction (east direction is positive)
Y axis: Longitudinal direction (north direction is positive)
Z axis: Vertical direction (upward is positive)
Origin: Ground point vertically below the center of the imaged object

(2) Calculation of the Coordinates of the Perspectives of the Image Pickup Units of the Child Devices i and ii As described above, the surface point ★ on the side surface A is imaged by both the child devices i and ii. On the other hand, the position information of the viewpoint of the image pickup means of each of the child devices i and ii (the altitude of the view point of the image pickup means and the latitude/longitude of the ground point vertically below) is transmitted from each of the child devices i and ii. Included in the position/line-of-sight direction signal. Based on this information, the coordinates of the viewpoints of the imaging devices of the child devices i and ii are calculated.
Coordinates of the viewpoint of the image pickup means of the child device i (x1, y1, z1)
Coordinates of the viewpoint of the image pickup means of the child device ii (x2, y2, z2)

(3) Calculation of the unit direction vector of the line-of-sight of the image pickup means of each of the child device i and the child device ii The line-of-sight information of the image pickup means of each of the child device i and the child device ii (the inclination angle θ in the line-of-sight direction of the image pickup means and The rotation angle φ) is included in the position/line-of-sight direction signals transmitted from each of the child devices i and ii. Based on this information, the unit direction vector of the line of sight of the image pickup means of each of the child devices i and ii is calculated.
Unit direction vector of the line of sight of the image pickup means of the child device i (sin θ1 · cos φ1, sin θ1 · sin φ1, cos θ1)
Unit direction vector of the line of sight of the image pickup means of the child device ii (sinθ2・cosφ2, sinθ2・sinφ2, cosθ2)

(4) Calculation of the unit direction vector of the “imaging line of the surface point*” by the image pickup means of each of the child devices i and ii The child is included in the compressed video signal transmitted from each of the child devices i and ii. Two-dimensional deviation between the line of sight of the image pickup means of each of the device i and the child device ii and the straight line connecting the surface point ★ from the viewpoint of each image pickup means (hereinafter referred to as “image pickup line of the surface point ★”) The angle (Δθ, Δφ) information is included, and by combining this information with the above-mentioned line-of-sight direction information, the unit direction of the “imaging line of the surface point ★” of the imaging means of each of the child device i and the child device ii. Calculate the vector.
Unit direction vector of the "imaging line of the surface point★" of the imaging means of the child device i (sin(θ1+Δθ1)・cos(φ1+Δφ1), sin(θ1+Δθ1)・sin(φ1+Δφ1), cos(θ1+Δθ1))
Unit direction vector of the “imaging line of the surface point★” of the image pickup means of the child device ii ((sin(θ2+Δθ2)・cos(φ2+Δφ2), sin(θ2+Δθ2)・sin(φ2+Δφ2), cos(θ2+Δθ2))

(5) Calculation of coordinates of surface point ★ From the above steps (3) and (4), a point (=child device) through which the “imaging line of surface point ★” by the image pickup means of each of the child devices i and ii passes. Since the viewpoints of the image pickup means of i and the child device ii) and the unit direction vector are determined, the equation of the straight line of the "imaging line of the surface point ★" by the image pickup means of the child devices i and ii is determined from these. Is calculated.
Since the surface point ★ is the intersection of these two straight lines, the coordinates of the surface point ★ are calculated by solving a simultaneous equation consisting of two straight line equations.

By performing the above procedure on all the surface points of the imaging target, the three-dimensional mapping of the surface of the imaging target is completed. It should be noted that the surface of this imaging target is generally composed of a plurality of curved surfaces, and these curved surfaces change with time t. The equations for these curved surfaces are expressed below (where the subscript t indicates that each curved surface changes with time t).
Curved surface 1... f1, t (x, y, z)=0
Curved surface 2... f2,t(x,y,z)=0
Curved surface 3... f3,t(x,y,z)=0
………
Curved surface n...fn,t(x,y,z)=0

On the other hand, the terminal devices A_4A to H_4H used by the user include a controller, a communication unit to which an IP address is assigned and an immersive 3D-HMD (Head Mounted Display).

The controller generates a visual point setting signal based on a button operation, a lever operation, a dial operation, etc. performed by the user, and transmits the visual point setting signal to the communication unit. On the other hand, an acceleration sensor and a gyro sensor are incorporated inside the HMD, and the HMD generates a visual point setting signal based on the output results of these sensors and transmits the visual line direction setting signal to the communication unit.

The communication unit converts the line-of-sight direction setting signal received from the controller and the line-of-sight direction setting signal received from the HMD into a signal conforming to the Internet protocol in which the assigned IP address is the source IP address, and the signal is transmitted via the Internet 3. And sends it to the server of parent device 2 at 22.

The server 22 uses each of the terminal devices A_4A to H_4H in the three-dimensional space based on the viewpoint setting signal and the line-of-sight direction setting signal received from each of the terminal devices A_4A to H_4H via the Internet 3. The virtual viewpoint and the line-of-sight direction are set and set for both eyes of the user. In addition, "a video signal corresponding to "a virtual image from the virtual viewpoint and the viewing direction of the imaging target viewed from the user's right eye using each of the terminal devices A_4A to H_4H"" And "a video signal corresponding to "a visual image of an imaging target viewed from a virtual viewpoint and line-of-sight direction set for the left eye of a user who uses each of the terminal devices A_4A to H_4H"". ..

Generally, as shown conceptually in FIG. 6, the video signal transmits color information of each pixel constituting the display range. In the following, a method for the server 22 to determine the color information of the pixel transmitted by the “video signal corresponding to “a visual image of the imaging target viewed from the predetermined viewpoint and line-of-sight direction”” will be described.

(1) Calculation of straight line equation of "visual line corresponding to each pixel of video signal""Video signal corresponding to "visual image of subject viewed from predetermined visual point and visual line direction" transmits color information Among the pixels, the pixel in the center of the display range corresponds to the “surface point of the imaging target in the line-of-sight direction”. Then, the other pixels in the display range are the surface of the imaging target in the direction of a “straight line starting from the viewpoint and deviating from the line of sight by a certain deviation angle (hereinafter referred to as “visual line corresponding to pixel”). "Point".
As described above, since the server 22 receives the line-of-sight direction setting signal from each of the terminal devices A_4A to H_4H, the unit direction vector of the line-of-sight is calculated based on this. Further, as described above, since each pixel of the video signal is associated with the deviation angle from the line of sight, the unit direction vector of the “visual line corresponding to each pixel” is calculated from this information. Further, the “visual line corresponding to each pixel” passes through the visual point, while the coordinate of the visual point is calculated based on the visual point setting signal received from each of the terminal devices A_4A to H_4H. .. Therefore, the straight line equation of the “visual line corresponding to the pixel” is calculated based on the line-of-sight direction setting signal and the line-of-sight setting signal received from each of the terminal devices A_4A to H_4H.

(2) Identification of Surface Point Corresponding to Each Pixel of Video Signal As described above, the surface of the imaging target has a plurality of curved surfaces 1 (f1,t(x,y,z)=0) to curved surface n(fn,t). (X, y, z)=0), and in particular, the surface of the imaging target at the time point t0 when the parent device receives the viewpoint setting signal and the line-of-sight direction setting signal from each of the terminal devices A_4A to H_4H, If the processing time is ignored, it is composed of a plurality of curved surfaces 1 (f1,t=t0(x,y,z)=0) to curved surface n(fn,t=t0(x,y,z)=0). , By solving the simultaneous equations of these curved surface equations and the linear equation of the “visual line corresponding to each pixel”, the coordinates of the intersection of the “visual line corresponding to each pixel” and the surface of the imaging target Is determined. Generally, there are a plurality of intersections, and the intersection having the shortest distance from the visual point is the surface point corresponding to each pixel of the video signal.

(3) Determining Color of Each Pixel of Video Signal As described above, since each surface point of the imaging target mapped in the three-dimensional space is defined by the RGB value or the HSV value, the color is defined. The color is the color of each pixel of the video signal.

In the above, the server 22 performs “generation of three-dimensional mapping data based on the image pickup signal and position/gaze direction signal received from the child device” and “generation of video signal based on the three-dimensional mapping data” without a time lag. Although the configuration has been described, the server 22 has a storage means for accumulating past three-dimensional mapping data, and then receives the viewpoint setting signal and the line-of-sight direction setting signal from each of the terminal devices A_4A to H_4H. Three-dimensional mapping data before the time point by Δt (specifically, curved surface equation: f1, t=t0-Δt(x, y, z)=0) to fn, t=t0-Δt(x, y , Z)=0) may be used.

In this configuration, the user can specify the time (t0-Δt) at which he/she wants to observe the state of the imaging target by operating the buttons, levers, dials, etc. of the controller. Then, the controller generates an observation time point setting signal based on the time designated by the user, and transmits it to the server 22 via the communication means and the Internet.
As a result, the user can observe the state of the imaging target at a time point that is traced back by Δt from the time t0 at which the user is operating the controller.

The parent device is generated as described above, and is displayed as “a virtual image from the virtual viewpoint and line-of-sight direction set for the right eye of the user who uses each of the terminal devices A_4A to H_4H. Corresponding to "a video signal corresponding to" and ""a visual image of the imaging target viewed from the virtual viewpoint and the line-of-sight direction set for the left eye of the user who uses each of the terminal devices A_4A to H_4H". Video signals of "the video signal to be executed" are transmitted to each of the terminal devices A_4A to H_4H via the Internet 3. On the other hand, each of the terminal devices A_4A to H_4H receives the video signals of the two systems by the communication means and displays the video based on the video signals of the two systems on the left and right display portions of the HMD. This allows the user to enjoy an immersive visual experience.

The generated video signals of the two systems and the video bulletins are associated with each other based on the IP addresses received from the communication units of the terminal devices A_4A to H_4H.
On the other hand, the server 22 sets the time point of the three-dimensional mapping data used when generating the video signal based on the received observation time point setting signal.

INDUSTRIAL APPLICABILITY The present invention relates to an industry that manufactures an image pickup unit, a signal conversion unit, and a communication unit that configure a child device of a multiplex video distribution system, an interface unit and a server that configures a parent device, a controller that configures a terminal device, and an HMD-related device. Can be used. It can also be used in industries that provide services (especially tourism services) that use the multiplex video distribution system.

1α ··· Child device α
1β ··· Child device β
1γ ··· Child device γ
1δ ··· Child device δ
1ε ··· Child device ε
1ζ··· Child device ζ
2… Parent device
21‥‥‥ Interface section
22 ‥‥ Server
3 Internet
4A ‥‥‥ Terminal device A
4B ... Terminal device B
4C ‥‥‥ Terminal device C
4D ‥‥‥ Terminal device D
4E ··· Terminal device E
4F: Terminal device F
4G ‥‥‥ Terminal device G
4H ‥‥‥ Terminal device G
5: Imaging means
51 ‥‥‥ Perspective of the imaging means
511.. Altitude of the viewpoint of the imaging means
512 ... Ground point vertically below the viewpoint of the imaging means
52........Gaze of the imaging means
522 ‥‥‥ The vertical tilt angle of the line of sight of the imaging means
523 ... Horizontal rotation angle of the line of sight of the imaging means
53 ... Imaging range of imaging means
531 ·······Viewing point of view (center of imaging range)

Claims (5)

A plurality of child devices which are three-dimensionally arranged, generate an image pickup signal by picking up an image pickup target from different viewpoints and/or line-of-sight directions, perform necessary conversion, and then transmit the parent signal to a parent device described later;
A parent device that generates and transmits “a plurality of systems of video signals having different display ranges” based on the imaging signals received from each of the child devices;
A multi-video distribution system consisting of
The parent device is a three-dimensional map in which the surface of the imaging target is mapped in a three-dimensional space based on the “imaging signal received from each of the child devices” and “position information and line-of-sight direction information of each of the child devices”. It has a function of generating mapping data and generating a “video signal corresponding to “a visual image of an object to be imaged viewed from a predetermined visual point and line-of-sight direction”” based on the three-dimensional mapping data.
A multi-video distribution system characterized by the above. The parent device is
A function of generating "a plurality of video signals of different display ranges" based on display range setting signals received from a plurality of terminal devices;
A function of transmitting the generated video signal of each system to the "terminal device that generated the display range setting signal generated based on the video signal of the system";
Has,
The multiplex video distribution system according to claim 1, wherein: The parent device is
After setting the viewpoint and the line-of-sight direction based on the viewpoint setting signal and the line-of-sight direction setting signal received from the terminal device, a “video signal corresponding to “a view of the image-capturing target from the viewpoint and the line-of-sight direction”” is obtained. Function to generate;
A function of transmitting the generated video signal to “a terminal device that has generated the viewpoint setting signal and the line-of-sight direction setting signal generated based on the video signal of the system”;
Has,
The multiplex video distribution system according to claim 2, characterized in that. The parent device has a function of generating “two systems of video signals that reflect the displacement of the binocular visual point”.
4. The multiplex video distribution system according to claim 3, wherein: The parent device is
A function of accumulating the past three-dimensional mapping data;
A function of generating a video signal based on the three-dimensional mapping data before the time when the display range setting signal is received from the terminal device;
Has,
The multiplex video distribution system according to any one of claims 2 to 4, characterized in that: