JP2008167127A - Video distributing method and video distributing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video distributing method and video distributing device, capable of generating distributing video, wherein an individual video based on video extracted for each person from photographed video can be displayed in an another window different from the entire video. <P>SOLUTION: In the video distributing method for distributing video through a network 8 by the video distributing device 11a, persons are extracted from video A1 photographed by an imaging apparatus 1 to output extraction results B1 to Bn, individual videos C1 to Cn including video of the extracted persons and their ambient video are segmented from the video A1 photographed by the imaging apparatus 1, for each extracted person, all or a portion of segmented individual video C1 to Cn are superposed on the video A1 photographed by the imaging apparatus 1 or video photographed by another imaging apparatus, for each extracted person by using an another window, to generate distributing video D1 to Dm and distribute the distributing video D1 to Dm to a receiving terminal through the network 8. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a video distribution method and a video distribution apparatus that distribute video captured by an imaging device to a receiving terminal via a network.

  It is possible to view sports competitions (games, etc.) such as baseball, soccer, or athletics using video distribution via a network. In video distribution that can be used free of charge or at a low charge, the viewer selects one of a service that distributes the video determined by the transmission side, such as television reception, and video captured by multiple cameras. A service to deliver is being implemented. In addition, a technique for extracting and tracking a player from an image of a sports competition has been proposed (see, for example, Patent Documents 1 and 2).

JP 2004-046647 A (pages 9 to 14, FIGS. 5 and 8) JP 2004-072628 A (pages 4-5, FIG. 1)

  By the way, the viewer, especially the fan, when there is a favorite player or attention player, is a scene that is not directly related to the game itself (for example, a defensive scene in baseball, a warm-up scene in soccer, or an athletic competition). I want to watch it even in a mental concentration scene. However, in the video distribution of a competition in which multiple players participate, only the entire game is distributed, or only the attention area that is expected to be noticed by many viewers, such as around the ball or the crossing board. Has been done. For this reason, in the conventional video distribution, it is not possible to simultaneously distribute the video of the entire game and the attention video desired by the viewer, or to simultaneously distribute the plurality of attention videos desired by the viewer. There was a problem that a plurality of images could not be viewed simultaneously.

  Therefore, the present invention has been made to solve the above-described problems of the prior art, and an object of the present invention is to convert an individual video based on a video extracted for each person from a video taken by an imaging device as an entire video. An object of the present invention is to provide a video distribution method and a video distribution apparatus capable of distributing distribution videos that can be displayed in different windows.

  The video distribution method of the present invention is a method of distributing video over a network by a video distribution device, wherein one or a plurality of persons are extracted from the video captured by the imaging device, and the extracted video of the person and The individual video including the video around the extracted person is cut out from the video taken by the imaging device for each of the extracted people, and all or part of the cut out single video or multiple individual videos. Is superimposed on a video shot by the imaging device or a video shot by another imaging device different from the imaging device using a separate window for each extracted person to generate a delivery video. The distribution video is distributed to a receiving terminal via a network.

  Further, another video distribution method of the present invention is a method of distributing video over a network by a video distribution device, wherein a plurality of persons are extracted from video captured by an imaging device, and the extracted person's An individual video including the video and the video around the extracted person is cut out from the video taken by the imaging device for each extracted person, and one of the extracted individual videos is selected. By selecting and combining the above individual videos, a combined video including one or more individual videos is generated, and for each of the combined videos, a video shot by the imaging device or another imaging different from the imaging device Video that has been distributed over the network by generating a plurality of video images for distribution by superimposing the above-mentioned combined video on video captured by the device using a separate window A request signal from a receiving terminal is received, and one of the plurality of distribution videos is selected according to the received request signal, and the selected distribution video is transmitted to the request signal via a network. It is characterized by delivering to the receiving terminal that issued

  Further, another video distribution method of the present invention is a method of distributing video over a network by a video distribution device, wherein a plurality of persons are extracted from video captured by an imaging device, and the extracted person's A receiving terminal that cuts out an individual video including the video and the video around the extracted person from the video taken by the imaging device for each extracted person and receives the video distributed via the network One or more individual images are received by selecting and combining one or more individual images from among the plurality of individual images extracted for each person according to the received request signals. A combined video including a video is generated and the combined video is added to a video shot by the imaging device or a video shot by another imaging device different from the imaging device. Superposed with another window, and generates a distribution image, the distribution image, is characterized in that for delivery to the receiving terminal that has issued the request signal via the network.

  Further, another video distribution method of the present invention is a method of distributing video over a network by a video distribution device, wherein one or a plurality of persons are extracted from the video taken by the imaging device, and the above-mentioned extraction is performed. An individual video including a video of a person and a video around the extracted person is cut out from the video taken by the imaging device for each of the extracted people, and one or more of the cut out individual videos A distribution video is generated from all or a part, and the distribution video is distributed to a receiving terminal via a network.

  Further, another video distribution method of the present invention is a method of distributing video over a network by a video distribution device, wherein a plurality of persons are extracted from video captured by an imaging device, and the extracted person's An individual video including the video and the video around the extracted person is cut out from the video taken by the imaging device for each extracted person, and one of the extracted individual videos is selected. By selecting and combining the above individual videos, a combined video including one or more individual videos is generated, and a plurality of distribution videos for displaying the combined video are generated for each of the combined videos. Receiving a request signal from a receiving terminal that receives the video distributed via the network, selecting one of the plurality of video for distribution according to the received request signal, The selected distribution image, is characterized in that for delivery to the receiving terminal that has issued the request signal via the network.

  Further, another video distribution method of the present invention is a method of distributing video over a network by a video distribution device, wherein a plurality of persons are extracted from video captured by an imaging device, and the extracted person's A receiving terminal that cuts out an individual video including the video and the video around the extracted person from the video taken by the imaging device for each extracted person and receives the video distributed via the network One or more individual images are received by selecting and combining one or more individual images from among the plurality of individual images extracted for each person according to the received request signals. Generating a combination video including the video, generating a distribution video for displaying the combination video, and receiving the request video signal via the network. It is characterized in that to be delivered to the terminal.

  The video distribution device of the present invention is a device that distributes video over a network, and includes a person extraction unit that extracts one or a plurality of persons from video captured by an imaging device, and the extracted video of the person An extracted person video generation unit that cuts out and outputs an individual video including the video around the extracted person from the video shot by the imaging device for each extracted person, and the extracted single Alternatively, all or a part of the plurality of individual videos may be converted into a video taken by the imaging device or a video taken by another imaging device different from the imaging device, using a separate window for each extracted person. A distribution video generation unit that generates a distribution video to be distributed to the receiving terminal in a superimposed manner.

  Another video distribution device of the present invention is a device that distributes video over a network, and includes a person extraction unit that extracts a plurality of persons from video captured by an imaging device, and the extracted person An extracted person video generation unit that cuts out an individual video including a video and a video around the extracted person from the video shot by the imaging device for each extracted person, and the cut out video An individual video combination unit that generates a combined video including one or more individual videos by selecting and combining one or more individual videos from the plurality of individual videos, and the imaging device for each of the combined videos The combination video is superimposed using a separate window on the video shot by the other image pickup device different from the image pickup device or the image picked up by a plurality of distribution images. The distribution video generation unit receives a request signal from a receiving terminal that receives a video distributed via a network, and responds to the received request signal. The distribution video to be distributed to the receiving terminal that issued the request signal is selected from the plurality of distribution videos.

  Another video distribution device of the present invention is a device that distributes video over a network, and includes a person extraction unit that extracts a plurality of persons from video captured by an imaging device, and the extracted person An individual person image including an image and an image around the extracted person is cut out from the image photographed by the imaging device for each extracted person, and is output via a network. Receiving a request signal from a receiving terminal that receives the distributed video, and selecting one or more individual videos from a plurality of individual videos cut out for each person according to the received request signal By combining them, an individual video combination unit that generates a combined video including one or more individual videos, and a video shot by the imaging device or another shooting different from the imaging device. A distribution video generation unit that generates a distribution video to be distributed to a receiving terminal that has issued the request signal by superimposing the combination video on a video captured by the apparatus using a separate window; It is said.

  In addition, another video distribution device of the present invention is a device that distributes a video via a network, and a person extraction unit that extracts one or a plurality of persons from a video taken by an imaging device, and the above-described extraction An extracted person video generation unit that cuts out and outputs an individual video including a video of a person and a video around the extracted person for each of the extracted people from a video shot by the imaging device; and A distribution video generation unit that generates a distribution video to be distributed to a receiving terminal from all or a part of one or a plurality of cut out individual videos.

  Another video distribution device of the present invention is a device that distributes video over a network, and includes a person extraction unit that extracts a plurality of persons from video captured by an imaging device, and the extracted person An extracted person video generation unit that cuts out an individual video including a video and a video around the extracted person from the video shot by the imaging device for each extracted person, and the cut out video An individual video combination unit that generates a combination video including one or more individual videos by selecting and combining one or more individual videos from the plurality of individual videos, and the combination video for each of the combination videos A distribution video generation unit that generates a plurality of distribution videos for displaying the video, and the distribution video generation unit receives a video distributed via a network In response to the request signal received, the distribution video to be distributed to the receiving terminal that issued the request signal is selected from the plurality of distribution videos. .

  Another video distribution device of the present invention is a device that distributes video over a network, and includes a person extraction unit that extracts a plurality of persons from video captured by an imaging device, and the extracted person An individual person image including an image and an image around the extracted person is cut out from the image photographed by the imaging device for each extracted person, and is output via a network. Receiving a request signal from a receiving terminal that receives the distributed video, and selecting one or more individual videos from a plurality of individual videos cut out for each person according to the received request signal Are combined to generate an individual video combining unit that generates one or more individual videos, and to display the combined video to the receiving terminal that issued the request signal. It is characterized by having a distribution image generator that generates a distribution image to be.

  According to the video distribution method or the video distribution apparatus of the present invention, it is possible to display the individual video based on the video extracted for each person from the video shot by the imaging device in a separate window different from the whole video. There is.

  In the video distribution method according to the embodiment of the present invention, a stadium (for example, a baseball stadium, a soccer stadium, an athletic stadium, a gymnasium, etc.) that performs a competition (game) such as baseball, soccer, or athletics. )), And a person (for example, a player) of interest is extracted from the whole captured image, and an individual image including the image of the person of interest can be displayed in a separate window. The distribution video signal to be distributed is distributed to the receiving terminal via the network. In the present invention, “identification” means that the person of interest is determined to be the same person and the person is tracked.

Embodiment 1 FIG.
FIG. 1 is a block diagram schematically showing a configuration of an apparatus that implements a video distribution method according to Embodiment 1 of the present invention (that is, video distribution apparatus 11a according to Embodiment 1).

  As shown in FIG. 1, the video distribution apparatus 11a according to Embodiment 1 includes one or more persons (for example, persons P1,..., Pi,... Described later) from the extraction video A1 captured by the imaging apparatus 1. , Pn) to extract extraction results B1,..., Bi,..., Bn, and individual images C1,. , Ci,..., Cn for each extracted person, an extracted person video generation unit 3 that cuts out from the extraction video A1 photographed by the imaging device 1. The person extraction unit 2 and the extracted person video generation unit 3 constitute an individual video generation unit 6. Note that n is an integer of 1 or more, and i is an integer of 1 to n.

  In addition, the video distribution device 11a according to the first embodiment includes the extraction video A1 or the imaging device 1 in which all or a part of the cut out single or plural individual videos C1, ..., Cn are captured by the imaging device 1. .., Dj for superimposing on a video (overall video A2 to be described later) taken by another imaging device (not shown in FIG. 1) different from the above, using a separate window for each person. ,..., Dm is generated. Note that m is an integer of 1 or more, and j is an integer of 1 or more and m or less.

  The imaging device 1 includes a camera that can capture the entire stadium. The extraction video A1 output from the imaging device 1 is input to the person extraction unit 2 and the extracted person video generation unit 3. The person extracting unit 2 identifies n persons (attention players) P1,..., Pn one by one using a method such as a frame difference method or an edge extraction method for the design or color of the uniform. , Pn are selected and identified, and extraction results B1,..., Bn of the persons P1,.

The distribution videos D1,..., Dm transmitted from the transmission unit (not shown) of the distribution video generation unit 4 are received via the network 8 through the receiving terminals 9 ₁ ,..., 9 _{j ,.} is delivered to the receiving terminal ₉ 1, ..., ₉ display unit or the receiving terminal ₉ 1 provided on _m, ..., display image E1 by a display device connected to _{9 m,} ..., Ej, ..., it is displayed as Em The The display images E1,..., Em include the entire images F1,..., Fj,..., Fm and individual images displayed in a separate window from the entire image. FIG. 1 shows individual videos G11 in the display video E1, individual videos G21, G22, and G23 in the display video E2, and individual videos Gm1 and Gm2 in the display video Em.

  FIG. 2 is a diagram for explaining the operation of the person extraction unit 2 shown in FIG. 1 taking baseball as an example.

  The whole of FIG. 2 corresponds to the extraction video A1 shown in FIG. The person extraction unit 2 uses the color of the uniform, the white line in the stadium, etc., as shown by the rectangular area drawn with a broken line in FIG. Individual images including C1 (for example, C1,..., C10) are separated from the ground and the audience.

  Next, as shown by a star in FIG. 2, a representative point indicating a position on the extraction video A1 is given to each extracted player (for example, P1,..., P10). The representative point (star) tracks the player according to the movement of the player (for example, P1,..., P10).

  Next, the person extracting unit 2 determines the player number to which the representative point (star) is identified from the color of the uniform, the back number, the position of the defensive position or the position of the batter box, etc. decide. In FIG. 2, the person extraction unit 2 uses the numbers corresponding to the defensive positions of the defensive players to identify them as the first to ninth players, and identifies the batter who is the attacking player as the tenth. It is identified as a player. And if the batter who is the 10th player hits the hit and goes on the heel, the person extracting unit 2 will still identify the runner as the 10th player and the next batter who is the attacking player will be the 11th Start identification as a player.

  If the 10th player does not appear on the heel, the person extracting unit 2 identifies the next player as the 10th player, or identifies the 11th player and makes the 10th a missing number. The method of handling the tenth player by the person extraction unit 2 can be selected. The person extraction unit 2 is information on the position of the representative point (star), or information on the position of the representative point and the size of the person extraction area (for example, the vertical position of the rectangular area drawn in broken lines in FIG. (Horizontal length) is output as the extraction results B1,..., B10 of the persons P1,. The extracted extraction results B1,..., B10 of the persons P1,..., P10 are input to the extracted person video generation unit 3 shown in FIG. In FIG. 2, the representative point is set at the upper left of the person extraction area, but this is for ease of viewing FIG. 2, and the representative point is a position that can be uniquely determined based on the person extraction area. Other positions may also be used, such as in a rectangular area drawn with a broken line. In FIG. 2, the person extraction area is represented by a rectangle, but the shape of the person extraction area is not limited to a rectangle, and may be another shape.

  FIG. 3 is a block diagram schematically showing the configuration of the extracted person video generation unit 3 shown in FIG.

As shown in FIG. 3, the extracted person video generation unit 3 includes first to n-th extracted person video generation units 3 ₁ ,..., 3 corresponding to the extraction results B1,. _n . The i-th extracted person video generation unit 3 _i corresponding to the extraction result Bi of the person Pi includes an extraction video A1 that is an output of the imaging device 1 shown in FIG. 1 and an output of the person extraction unit 2 shown in FIG. The extraction result Bi of the person Pi is received as an input signal. The i-th extracted person video generation unit 3 _i uses the position information of the representative point of the extraction result Bi of the person Pi or the position information of the representative point and the size of the person extraction area to extract the person from the extraction video A1. The image is enlarged or reduced so that Pi is in the center of the picture and the size of the window distributed by the person Pi, and the surrounding image of the person Pi corresponding to the size of the window to be distributed is cut out. An individual video Ci of Pi is generated. The i-th extracted person video generation unit 3 _i corresponding to the extraction result Bi of the person Pi generates brightness correction, edge enhancement, color saturation correction, etc. as necessary when generating the individual video Ci of the person Pi. Perform signal processing. FIG. 3 schematically shows an example of the individual video C1 of the person P1. As shown in FIG. 1, the individual videos C1,..., Cn of the persons P1,..., Pn output from the extracted person video generation unit 3 are input to the distribution video generation unit 4. As shown in FIG. 1, the distribution video generation unit 4 receives the extraction video A <b> 1 that is the output of the imaging device 1, generates a distribution video, and distributes it to the receiving terminal via the network 8. The function of the distribution video generation unit 4 will be described with reference to FIG.

  1 generates the first to m-th distribution videos D1,..., Dj,. A state of the display video Ej when the j-th distribution video Dj is displayed on the display unit of the receiving terminal connected to the network 8 is schematically shown on the right side of FIG.

  The receiving terminal that has received the first distribution video D1 displays the extraction video A1 in the entire video area F1 of the display video E1, and the individual video C1 of the person P1 is displayed in a separate window in the individual video area G11 of the display video E1. It is displayed so as to be superimposed. Further, the receiving terminal that has received the second distribution video D2 displays the extraction video A1 in the entire video area F2 of the display video E2, the individual video C3 of the person P3 in the individual video area G21, and the individual video area G22. The individual video C1 of the person P1 and the individual video C4 of the person P4 in the individual video area G23 are displayed in a separate window so as to be superimposed on the entire video area F1. The receiving terminal that has received the m-th distribution video Dm displays the extraction video A1 in the entire video area Fm of the display video Em, the individual video C3 of the person P3 in the individual video area Gm1, and the individual video area Gm2. The individual video C1 of the person P1 is displayed in a separate window so as to be superimposed on the entire video area Fm. According to the video distribution method or the video distribution apparatus according to the first embodiment, it is possible to simultaneously view a video that captures the entire game (such as a game) and an individual video such as a player of interest.

  In FIG. 1, the number of individual videos of the person Pi superimposed on the whole video Fj is three or less. However, in the distribution video generation unit 4 of the present invention, the individual video of the person Pi superimposed on the whole video Fj. The number of may be four or more. 1 shows a display video Ej in the picture-in-picture (PinP) format in which the individual video Ci of the person Pi is inserted into the entire video Fj. The video for distribution in Embodiment 1 is shown. The generation unit 4 can also generate a display video Ej in a format in which the individual video Ci of the person Pi is displayed outside the entire video Fj.

  FIG. 4 is a block diagram schematically showing a configuration of an apparatus that performs another video distribution method according to the first embodiment of the present invention (that is, another video distribution apparatus 11b according to the first embodiment). In FIG. 4, the same or corresponding components as those shown in FIG.

  The video delivery device 11b shown in FIG. 4 is connected to another imaging device 10 different from the imaging device 1, and the extraction video A1 that is the output of the imaging device 1 is a person extraction unit 2 and an extracted person video generation unit. 3 is different from the video distribution apparatus 11a shown in FIG. 1 in that the entire video A2 that is input to the other imaging apparatus 10 is input to the distribution video generation unit 4. The functions of the person extraction unit 2, the extracted person video generation unit 3, and the distribution video generation unit 4 in FIG. 4 are basically the same as the corresponding components shown in FIG.

  In the video distribution device 11b shown in FIG. 4 (or a video distribution method implemented by this device), the entire video Fj of the display video Ej is the overall video A2 that is the output of the imaging device 10. Therefore, according to the video distribution apparatus shown in FIG. 4 or the video distribution method using this apparatus, the entire video Fj, which is the main part of the display video Ej, can be used for the most interesting video in the competition. There is.

  FIG. 5 is a block diagram schematically showing the configuration of a device that performs yet another video distribution method according to Embodiment 1 of the present invention (that is, still another video distribution device 11c according to Embodiment 1). is there. In FIG. 5, the same or corresponding components as those shown in FIG. 1 or FIG.

  The video distribution device 11c shown in FIG. 5 is connected to another imaging device 10 different from the imaging device 1, and the extraction video A1 that is the output of the imaging device 1 is generated by the person extraction unit 2 and the extracted person video generation. 1 or FIG. 4 shows that the whole video A2 that is input to the unit 3 and the distribution video generation unit 41 and is the output of the other imaging device 10 is input to the distribution video generation unit 41. Different from the distribution device 11a or 11b. The functions of the person extraction unit 2, the extracted person video generation unit 3, and the distribution video generation unit 41 in FIG. 5 are basically the same as the corresponding components shown in FIG. 1 or FIG. The distribution video generation unit 41 in FIG. 5 displays a display video obtained by superimposing one or more individual videos Ci of the person Pi on the extraction video A1, or an individual video Ci of one or more persons Pi on the whole video A2. The superimposed display video is generated and distributed to the receiving terminal via the network 8. That is, the distribution video generation unit 41 is the display video Ej in FIG. 5, the distribution video in which the whole video Fj is the extraction video A1 and the distribution video in which the whole video Fj is the whole video A2. And a distribution video whose whole video Fj is the extraction video A1 or a distribution video whose whole video Fj is the whole video A2 can be selectively transmitted.

  In the video distribution apparatus shown in FIG. 5 (or the video distribution method implemented by this apparatus), more types of video than the video distribution apparatus shown in FIG. 4 (or the video distribution method implemented by this apparatus). Can be delivered.

  In addition, in the video distribution apparatus shown in FIG. 5 (or the video distribution method implemented by this apparatus), a video that can be viewed simultaneously with the video of interest and the video of the person of interest, There is an effect that the entire video and the video capable of simultaneously viewing the video of the person of interest can be selectively distributed to the network 8.

  Furthermore, the imaging device 10 that outputs the entire video in FIGS. 4 and 5 is not limited to one, and a plurality of imaging devices 10 may exist. In this case, the distribution video generation unit 4 shown in FIG. 4 has individual video images of one or a plurality of persons Pi as one of the plurality of input whole video images like the distribution video generation unit 41 shown in FIG. A distribution video in which Ci is superimposed in another window is generated and distributed to the receiving terminal via the network 8. The distribution video generation unit 4 in FIG. 4 also generates a distribution video in which the individual video Ci of one or a plurality of persons Pi is superimposed on one of the plurality of overall videos and receives it via the network 8. Can be distributed to terminals. By using such a video distribution method, it is possible to distribute more types of video for distribution than in the case shown in FIG. 4 or FIG.

Embodiment 2. FIG.
FIG. 6 is a block diagram schematically showing a configuration of an apparatus that implements the video distribution method according to Embodiment 2 of the present invention (that is, video distribution apparatus 12a according to Embodiment 2).

  As shown in FIG. 6, the video distribution apparatus 12a according to the second embodiment includes an individual video generation unit 6, an individual video combination unit 70 that generates m types of combination videos H1,..., Hm, and a selection function. And a distribution video generation unit 42. 6, the individual videos C1,..., Cn of the n persons P1,..., Pn generated by the individual video generation unit 6 are output from the individual video generation unit 6 and are output as individual video combination units. 70. The first to m-th combination videos H1,..., Hm output from the individual video combination unit 70 are input to the distribution video generation unit 42 with a selection function.

  The first combined video H1 is, for example, a video obtained by selecting and combining only the individual video C1 of the person P1 (also treated as a combined video in this case). The second combined video H2 is, for example, a video in which the individual video C3 of the person P3, the individual video C1 of the person P1, and the individual video C4 of the person P4 are arranged in this order in order from the left of the display video. The m-th combined video Hm is, for example, a video obtained by combining the individual video C1 of the person P1 on the left side of the display screen and the individual video Cn of the person Pn on the right side of the display screen.

As shown in FIG. 6, the first receiving terminal 9 _1, for example, if the first request K1 that wants to see the second combination image H2 is sent to the video distribution device through the network 8, selected The function-equipped delivery video generation unit 42 receives the first request K1, and receives the first combination video H2 superimposed on the extraction video A1 input to the selection function-equipped delivery video generation unit 42. The request video J1 is generated and distributed to the _first receiving terminal 91 via the network 8. Similarly, the second receiving terminal 9 ₂ is transmitted second request K2 is, when requesting a second combination image H2, the second request K2 is input to the distribution with selection function for image generation unit 42 , distribution image generating unit 42 with selection function, the second combined image H2 to generate a second request video J2 superimposed to the extraction image A1, delivered to the second receiving terminal 9 ₂ via the network 8 To do. Thereafter, similarly, the distribution function generating video generation section 42 distributes the request video corresponding to the request from the receiving terminal to the receiving terminal that has transmitted the corresponding request signal via the network 8. At this time, even if requests from the receiving terminals overlap with each other, the video distribution method of the present invention does not cause a problem and distributes the same requested video to the corresponding receiving terminals.

  According to the video distribution method or the video distribution apparatus according to the second embodiment, the viewer selects the combination video closest to the viewer's request from the plurality of combination videos of the player of interest, etc. It will be possible to see the whole picture at the same time.

  FIG. 7 is a block diagram schematically showing a configuration of an apparatus that performs another video distribution method according to the second embodiment of the present invention (that is, another video distribution apparatus 12b according to the second embodiment). In FIG. 7, the same or corresponding components as those shown in FIG.

  The video delivery device 12b shown in FIG. 7 is connected to another imaging device 10 that is different from the imaging device 1, and the extraction video A1 that is the output of the imaging device 1 is input to the individual video sanitary unit 6, and the others. 6 differs from the video distribution device 12a shown in FIG. 6 in that the overall video A2 that is the output of the imaging device 10 is input to the distribution video generation unit 42 with a selection function. The functions of the individual video generation unit 6, the individual video combination unit 70, and the distribution video generation unit with selection function 42 in FIG. 7 are basically the same as the corresponding components shown in FIG.

  In the video distribution device 12b shown in FIG. 7 (or a video distribution method implemented by this device), the entire video of the display video at the receiving terminal is the overall video A2 that is the output of the imaging device 10. For this reason, according to the video distribution device 12b shown in FIG. 7, there is an effect that the entire video, which is the main part of the display video, can be allocated to the most interesting video in the competition.

  FIG. 8 is a block diagram schematically showing a configuration of an apparatus that performs yet another video distribution method according to Embodiment 2 of the present invention (that is, still another video distribution apparatus 12c according to Embodiment 2). is there. 8, the same or corresponding components as those shown in FIG. 6 or FIG.

  The video delivery device 12c shown in FIG. 8 is connected to another imaging device 10 different from the imaging device 1, and the extraction video A1 that is the output of the imaging device 1 is sent to the delivery video generation unit 43 with a selection function. It differs from the video distribution device 12a or 12b shown in FIG. 6 or 7 in that the whole video A2 that is input and output from the other imaging device 10 is also input to the distribution video generation unit 43 with selection function. The functions of the individual video generation unit 6, the individual video combination unit 70, and the distribution video generation unit 42 with a selection function in FIG. 8 are basically the same as the corresponding components shown in FIG. 6 or FIG.

The distribution function generating video generation unit 43 in FIG. 8 includes a display video in which one or more individual videos Ci of the person Pi are superimposed on the extraction video A1, or one or more individual Pis on the entire video A2. A display image on which the image Ci is superimposed is generated and distributed to the receiving terminal 9 _j via the network 8. That is, the distribution video generation unit 43 with a selection function is the display video Ej of FIG. 5, the distribution video in which the whole video Fj is the extraction video A1, and the whole video Fj is the whole video A2. Can generate video for distribution. For this reason, in the video distribution apparatus shown in FIG. 8 (or the video distribution method implemented by this apparatus), the request video (via the network 8 is sent together with the selection information of the combination video to the request from the receiving terminal ( For example, by adding selection information as to which one of the extracted video A1 and the whole video A2 is used to the main part of J1 to J3), there is an effect of obtaining more options.

Embodiment 3 FIG.
FIG. 9 is a block diagram schematically showing a configuration of a device that performs the video distribution method according to the third embodiment of the present invention (that is, video distribution device 13a according to the third embodiment).

  As shown in FIG. 9, the video distribution apparatus 13a according to Embodiment 3 includes an individual video generation unit 6, a combination video generation unit 71 for each reception terminal that generates combination video L1, L2,. And a distribution video generation unit 44. As shown in FIG. 9, the individual videos C1,..., Cn of n persons P1,..., Pn generated by the individual video generation unit 6 are output from the individual video generation unit 6 and are combined for each receiving terminal. Input to the video generation unit 71. The combination videos L1, L2,... Output from the combination video generation unit 71 for each reception terminal are input to the distribution video generation unit 44 for each reception terminal.

From the first receiving terminal 9 ₁ 9, for example, if the first request K1 desire to superimpose only individual image C1 of the person P1 in another window is sent to the video distribution device 13a via the network 8, the video The first request K1 is input to the receiving terminal-specific combination video generation unit 71 and the receiving terminal-specific distribution video generation unit 44 of the distribution device 13a. Receiving the first request K1, the combined video generating unit 71 for each receiving terminal selects only the individual video C1 of the person P1 from the output of the individual video generating unit 6, and distributes it as the first combined video L1 for each receiving terminal To the video generator 44. The distribution video generation unit 44 for each receiving terminal generates a first request video M1 in which the first combination video L1 is superimposed on the extraction video A1 that is the output of the individual video generation unit 6, and the first request K1 via the network 8 based on the distribution destination information to the first receiving terminal 9 ₁ delivers a first request video M1.

The second receiving terminal 9 ₂ sends a second request K2, in order from the left of the display screen, individual video C3 person P3, individual image C1 of the person P1, arranged to separate image C4 of the person P4 When requesting the video distribution device to request a second request K2 for simultaneously watching the image, the second request K2 Is entered. Receiving the second request K2, the receiving terminal specific combination video generation unit 71 outputs the individual video C1 of the person P1, the individual video C3 of the person P3, and the individual video C4 of the person P4 from the outputs of the individual video generation unit 6. And the second combined video L2 arranged according to the arrangement information of the window of the second request K2 is generated and output to the receiving terminal-specific distribution video generating unit 44. The receiving terminal-specific distribution video generation unit 44 generates a second request video M2 in which the second combination video L2 is superimposed on the extraction video A1 that is the output of the individual video generation unit 6, and the second request K2 via the network 8 based on the distribution destination information to the second receiving terminal 9 ₂ delivers a second request video M2.

When the third receiving terminal 9 ₃ requests a third request K3 the same content as the second request K2 to the video distribution device, the receiving terminal by combining image generator 71 receives the third request K3, The individual video C1 of the person P1, the individual video C3 of the person P3, and the individual video C4 of the person P4 are selected from the outputs of the individual video generation unit 6 and arranged according to the arrangement information of the window of the third request K3. The generated third combination video L3 is generated and output to the receiving terminal-specific distribution video generation unit 44. At this time, the second combination video L2 and the third combination video L3 are the same. The distribution video generation unit 44 for each receiving terminal generates a third request video M3 in which the third combination video L3 is superimposed on the extraction video A1 that is the output of the individual video generation unit 6, and the third request K3 via the network 8 based on the distribution destination information to the third receiving terminal 9 ₃ delivers the third request video M3. Thereafter, similarly, a request video corresponding to a request from the receiving terminal is distributed to each receiving terminal via the network 8.

  According to the video distribution method or the video distribution apparatus according to the third embodiment, the viewer selects only individual videos of the attention player or the like that the viewer wants to see, and the entire game (game, etc.) is photographed. It becomes possible to see at the same time.

  FIG. 10 is a block diagram schematically showing a configuration of an apparatus that performs another video distribution method according to Embodiment 3 of the present invention (that is, another video distribution apparatus 13b according to Embodiment 3). 10, the same reference numerals are given to the same or corresponding components as those shown in FIG.

  The video delivery device 13b shown in FIG. 10 is connected to another imaging device 10 that is different from the imaging device 1, and the extraction video A1 that is the output of the imaging device 1 is input to the individual video hygiene unit 6, and the other 9 is different from the video distribution apparatus 13a shown in FIG. 9 in that the overall video A2 that is the output of the imaging apparatus 10 is input to the distribution video generation unit 44 for each receiving terminal. The functions of the individual video generation unit 6, the reception terminal specific combination video generation unit 71, and the reception terminal specific distribution video generation unit 44 in FIG. 10 are basically the same as the corresponding components shown in FIG.

  In the video distribution device 13b shown in FIG. 10 (or a video distribution method implemented by this device), the entire video of the display video at the receiving terminal is the overall video A2 that is the output of the imaging device 10. For this reason, according to the video distribution apparatus 13b shown in FIG. 10, there is an effect that the entire video, which is the main part of the display video, can be allocated to the most interesting video in the competition.

  FIG. 11 is a block diagram showing a configuration of an apparatus that performs yet another video distribution method according to Embodiment 3 of the present invention (that is, still another video distribution apparatus 13c according to Embodiment 3). In FIG. 11, the same or corresponding elements as those shown in FIG. 9 or FIG.

  The video delivery device 13c shown in FIG. 11 is connected to another imaging device 10 different from the imaging device 1, and the extraction video A1 that is the output of the imaging device 1 is sent to the receiving terminal-specific delivery video generation unit 45. The whole video A2 that is input and output from the other imaging device 10 is different from the video distribution device 13a or 13b shown in FIG. 9 or FIG. The functions of the individual video generation unit 6, the reception terminal specific combination video generation unit 71, and the reception terminal specific distribution video generation unit 45 in FIG. 11 are basically the same as the corresponding components shown in FIG. 9 or 10. is there.

  In the video distribution apparatus shown in FIG. 11 (or the video distribution method implemented by this apparatus), the extracted video A1 and the whole video A2 are sent to the main part of the requested video distributed via the network in response to a request from the receiving terminal. Information for selecting which one to use is added, and based on this selection information, the video generation unit 45 for each receiving terminal selects a main part video on which the combination video is superimposed, and requests video (for example, N1) To N3) to the receiving terminal. For this reason, in the video delivery apparatus (or video delivery method implemented by this apparatus) shown in FIG. 11, there is an effect that more options are obtained.

Embodiment 4 FIG.
FIG. 12 is a block diagram schematically showing a configuration of an apparatus (that is, video distribution apparatus 14 according to Embodiment 4) that performs the video distribution method according to Embodiment 4 of the present invention. FIG. 13 is a block diagram schematically showing the configuration of the individual video combination unit 72 shown in FIG.

  In the fourth embodiment, a case where m kinds of combination videos are distributed will be described. In the fourth embodiment, for example, the first combination video Q1 is a video obtained by selecting only the individual video C1 of the person P1, and the second combination video Q2 is a person in order from the left of the display video. The individual video C3 of P3, the individual video C1 of the person P1, and the individual video C4 of the person P4 are selected and arranged side by side. The m-th combination video Qm is an individual video C1 of the person P1 on the left side of the display screen. This is an image combined with an individual image Cn of the person Pn arranged on the right side of the display screen. In the fourth embodiment, as shown in FIG. 12, the individual images C1,..., Ci,..., Cn of the persons P1,. It is output to the combination unit 72 and processed by the individual image combination unit 72 to generate and distribute m combination images Q1,..., Qj,. Therefore, according to the video distribution method or the video distribution apparatus according to the fourth embodiment, it becomes possible to simultaneously view a plurality of individual videos of a player of interest or the like in another window.

  Hereinafter, an example of processing in the individual video combination unit 72 will be described with reference to FIG. In FIG. 13, C1s1, C1s2, and C1s3 are images obtained by enlarging or reducing the individual image C1, and C1s2t and C1s3t are images obtained by trimming the enlarged or reduced images C1s2 and C1s3. C3s1 is an image obtained by enlarging or reducing the individual image C3, and C3s1t is an image obtained by trimming the enlarged or reduced image C3s1. C4s1 is an image obtained by enlarging or reducing the individual image C4, and C4s1t is an image obtained by trimming the enlarged or reduced image C4s1. Cns1 is an image obtained by enlarging or reducing the individual image Cn, and Cns1t is an image obtained by trimming the enlarged or reduced image Cns1.

  When the aspect ratio of the display image (display screen) and the aspect ratio of the individual image C1 of the person P1 are greatly different as in the first combination image Q1 in FIG. 13, the individual image combination unit 72 is as follows. Process. As shown in FIG. 13, the individual video combination unit 72 enlarges or reduces the individual video C1 of the person P1 to match the vertical length or horizontal length of the display video, and thereby displays a margin portion (for example, A blanking process is performed such that a video of a single color or a predetermined pattern is added to the hatched portion in FIG. 13 or information other than the individual video C1 of the person P1 such as the score and the elapsed time of the game is added. The first combination video Q1 is generated. When enlarging or reducing the individual video C1 of the person P1, the vertical length of the display video and the vertical length of the individual video are matched, or the horizontal length of the display video and the horizontal length of the individual video are set. Either of them can be selected for matching. However, it is desirable to employ a magnification capable of displaying all of the individual video C1 of the person P1. Also, the enlargement or reduction ratio when matching the vertical length of the display video with the vertical length of the individual video, or the enlargement or reduction when matching the horizontal length of the display video with the horizontal length of the individual video You may make it employ | adopt the one where a rate is small. Next, as in the second combined video Q2 and the third combined video Q3, the individual video combination unit 72 when the aspect ratio of the video of the person Pi and the individual video Ci of the person Pi in the display video is not greatly different. The process will be described. A description will be given except for the part that generates the first combined video Q1 in the video combining unit 72 of FIG. The second combination video Q2 is a case where the display video is longer than the individual video C1 of the person P1, the individual video C3 of the person P3, and the individual video C4 of the person P4. In this case, the individual video C1 of the person P1, the individual video C3 of the person P3, and the individual video C4 of the person P4 are enlarged or reduced to the vertical length of the display video to obtain individual videos C1s2, C3s1, and C4s1. Then, the right and left ends of the enlarged or reduced individual videos C1s2, C3s1, and C4s1 are trimmed (deleted), and the trimmed videos C1s2t, C3s1t, and C4s1t are arranged and distributed as the second combined video Q2. The third combination video Q3 is a case where the display video is horizontally longer than the individual video C1 of the person P1 and the individual video Cn of the person Pn. In this case, the individual video C1 of the person P1 and the individual video Cn of the person Pn are enlarged or reduced to the horizontal length of the display video. Then, the upper and lower ends of the enlarged or reduced individual videos C1s3 and Cns1 are trimmed (deleted), and the trimmed videos C1s3t and Cns1t are arranged side by side and distributed as the third combined video Q3. By doing this, there is an effect that most of the individual video Ci of the person Pi can be distributed. There is also an effect that an individual video as large as possible can be distributed.

Embodiment 5. FIG.
FIG. 14 is a block diagram schematically showing a configuration of a device that performs the video distribution method according to Embodiment 5 of the present invention (that is, video distribution device 15 according to Embodiment 5).

  The video distribution device 15 according to the fifth embodiment is different from the video distribution device 14 according to the fourth embodiment in that a video distribution unit with a selection function 46 is provided. In FIG. 14, the individual video generation unit 6 and the individual video combination unit 72 are the same as those in the fourth embodiment. In the video distribution method according to the fifth embodiment, as shown in FIG. 14, the first to m-th combined videos Q1,..., Qm output from the individual video combination unit 72 are video distribution units with selection functions. 46 is input.

From the first receiving terminal 9 ₁ of FIG. 14, for example, if the first request K1 that wants to see the second combination image Q2 is transmitted to the video distribution device 15 via the network 8, the video delivery with selection function part 46 receives a first request K1, the first receiving terminal 9 via the network 8 and the second combined image Q2 input to the selected function with the video distribution section 46 as the first request video R1 ₁ Deliver to. Similarly, if the second receiving terminal 9 ₂ requests the combination image Qj of the j and a second request K2, the second request K2 is input to the selected function with the video distribution unit 46, with selection function video distribution section 46 distributes the combined image Qj of the j-th in the second receiving terminal 9 ₂ via the network 8 as a second request image R2. Thereafter, similarly, the combination video corresponding to the request from the receiving terminal is distributed to each receiving terminal via the network 8 as the request video from each receiving plan terminal. According to the video distribution method or the video distribution apparatus according to the fifth embodiment, the viewer selects the combination closest to the viewer's request from the plurality of combination videos of the player of interest and the like, and the plurality of selected individual videos At the same time. Further, even if requests from receiving terminals overlap with each other, no problem occurs in the video distribution method of the present invention, and the same combination video can be distributed to the corresponding receiving terminals.

Embodiment 6 FIG.
FIG. 15 is a block diagram schematically showing a configuration of an apparatus that implements the video distribution method according to the sixth embodiment of the present invention (that is, video distribution apparatus 16 according to the sixth embodiment).

  The video distribution device 16 according to the sixth embodiment is provided with a receiving terminal-specific combination video generation unit 73 instead of the individual video combination unit 72 of the fifth embodiment, and the video distribution device 15 according to the fifth embodiment. Is different. As shown in FIG. 15, the video distribution apparatus 16 according to the sixth embodiment includes an individual video generation unit 6, a combination video generation unit 73 for each reception terminal that generates combination video T1, T2,. And a distribution video generation unit 47.

From the first receiving terminal 9 ₁ of FIG. 15, for example, if the first request S1 wants to view only the separate image C1 of the person P1 is requested to the video distribution device 16 via the network 8, by receiving terminal individually The video combination unit 73 receives the first request S1, selects only the individual video C1 of the person P1 from the output of the individual video generation unit 6, and performs the same processing as the individual video combination unit 72 of the fourth embodiment. Then, the first combination video T1 is output to the video distribution unit 47 by receiving terminal. Receiving terminal by a video distribution section 47, the first combined image T1 as first request video U1, the first receiving terminal 9 ₁ via the network 8 on the basis of the destination information of the first request K1 first 1 request video M1 is distributed.

Moreover, those second receiving terminal 9 ₂ to the second request S2, in order from the left of the display scene, individual video C3 person P3, individual image C1 of the person P1, arranged to separate image C4 of the person P4 When the video distribution device 16 requests the second request S2 to simultaneously watch the video, the receiving terminal-specific individual video combination unit 73 receives the second request S2 and outputs the person P1 from the output of the individual video generation unit 6. Individual video C1, individual video C3 of person P3, and individual video C4 of person P4 are selected, and the same processing as that of individual video combination unit 72 of the fourth embodiment is performed to receive second combination video T2 as a receiving terminal. The video is output to another video distribution unit 47. Receiving terminal by a video distribution section 47, a second combination picture T2 as a second request video U2, on the basis of the destination information of the second request S2 via the network 8 to the second receiving terminal 9 _Paragraph 2 request video U2 is distributed.

When the third receiving terminal 9 ₃ requests a third request S3 of the same content as the second request S2 to the video distribution device, the receiving terminal by the individual image combining unit 73 receives the third request S3, individually The individual video C1 of the person P1, the individual video C3 of the person P3, and the individual video C4 of the person P4 are selected from the outputs of the video generation unit 6, and the same processing as the individual video combination unit 72 of the fourth embodiment is performed. Then, the third combined video T3 is output to the receiving terminal-specific video distribution unit 47. At this time, the second combination video T2 and the third combination video T3 are the same. Receiving terminal by a video distribution section 47, a third combination image T3 as a third request video U3, the third through the third network 8 based on the delivery destination information request S3 of the receiving terminal 9 ₃ The third request video M3 is distributed. Thereafter, similarly, a request video corresponding to a request from the receiving terminal is distributed to each receiving terminal via the network 8.

  According to the video distribution method or the video distribution apparatus according to the sixth embodiment, it is possible for the viewer to select and view only individual videos of the attention player or the like that the viewer wants to see at the same time.

Embodiment 7 FIG.
FIG. 16 is a diagram for explaining an extraction video used by the video distribution method and the video distribution apparatus according to Embodiment 7 of the present invention.

  The extraction video used by the video distribution method and the video distribution device according to Embodiments 1 to 6 is one extraction video A1 captured by one imaging device 1, and one imaging device 1 As shown in FIG. 2, the entire stadium was filmed. In contrast, in the video distribution method and the video distribution apparatus according to the seventh embodiment, as shown in FIG. 16, a plurality of imaging apparatuses for person extraction are used, and each imaging apparatus is a stadium, that is, , Share the space to extract people.

  In FIG. 16, person extraction is performed using five imaging devices 1a, 1b, 1c, 1d, and 1e in order to shoot an extraction video. Extraction images A11, A12, A13, A14, and A15, which are outputs of the imaging devices 1a, 1b, 1c, 1d, and 1e, are input to the person extraction unit 2 and the extracted person image generation unit 3. The person extracting unit 2 includes a person extracting unit 2 shown in FIGS. 1, 4, and 5, and a person extracting unit included in the individual video generating unit 6 in FIGS. 6 to 12, 14, and 15. 2 is included. The extracted person video generation unit 3 includes the extracted person video generation unit 3 shown in FIGS. 1, 4, and 5, and the individual video generation unit 6 in FIGS. 6 to 12, 14, and 15. The extracted person video generation unit 3 included in FIG.

In the seventh embodiment, the person extraction unit 2 performs person extraction, and the extraction result Bi of the person Pi includes the information (imaging device identification information) indicating which imaging device is used to capture the extracted person video. Output to the generator. The extracted person video generation unit 3 _i of the extracted person video generation unit receives the extraction videos A11 to A15 and extracts individual information of the person Pi based on the imaging device identification information included in the person extraction result Bi. A video for extraction of a person Pi is selected based on the position information of the representative point included in the extraction result Bi of the person Pi from the selected video for extraction or the position information of the representative point and the size information of the extracted area. Ci is generated. In addition, the handling of the entire video in the display video due to the plurality of video for extraction is performed by using any one video for extraction (for example, A11) as the video for extraction in the first to third embodiments. The extraction video may be handled in the same manner as the overall video A2 in the first to third embodiments.

  In the video distribution method and the video distribution apparatus according to the seventh embodiment, since each imaging apparatus captures a narrow space, it becomes possible to photograph a large person and obtain individual videos of a good person Pi. be able to. In other words, according to the video distribution method or the video distribution apparatus according to the seventh embodiment, the image of the person to be extracted can be viewed in a large or clear manner by taking a large picture of the person photographed by the camera for extracting the person. Is possible. The “quality video” is, for example, a video with a high resolution, a video with a high contrast, a video with an emphasized outline, or a video with little noise.

Embodiment 8 FIG.
FIG. 17 is a diagram for explaining an extraction video used by the video distribution method and the video distribution apparatus according to Embodiment 8 of the present invention.

  In the video distribution method according to the eighth embodiment, there is an overlap in the space captured by the imaging device as shown in FIG. In the case of FIG. 17, the pitcher (person P1 in FIG. 2) is present in three images of the extraction video A11, the extraction video A12, and the extraction video A13. A catcher (person P2 in FIG. 2) and a batter (person P10 in FIG. 2) are also present in the three images. The first hand (person P3 in FIG. 2) exists only in the extraction video A12, and the second hand (person P4 in FIG. 2) exists in the extraction video A11 and the extraction video A12. The extraction video A11 that is the output of the imaging device 1a and the extraction videos A12, A13, A14, and A15 that are the outputs of the imaging devices 1b, 1c, 1d, and 1e are the person extraction unit 2 and the extracted person video generation unit, respectively. 3 is input. The person extracting unit 2 includes a person extracting unit 2 shown in FIGS. 1, 4, and 5, and a person extracting unit included in the individual video generating unit 6 in FIGS. 6 to 12, 14, and 15. 2 is included. The extracted person video generation unit 3 includes the extracted person video generation unit 3 shown in FIGS. 1, 4, and 5, and the individual video generation unit 6 in FIGS. 6 to 12, 14, and 15. The extracted person video generation unit 3 included in FIG.

  FIG. 18 is a block diagram schematically showing the configuration of the person extraction unit 2 of the device that performs the video distribution method according to the eighth embodiment of the present invention (that is, the video distribution device according to the eighth embodiment).

The extraction video A11, which is the output of the imaging device 1a, is input to the _first video extraction unit 211 of the person extraction unit 2. First image extraction unit 21 _1, the extracted video A11 is input, performs the person extracting. For Figure 18, a first image extraction unit 21 _1, could person extracting a pitcher (person P1) and the catcher (person P2) and second baseman (person P4) and shortstop (person P6) and batter (person P10) Then, first image extraction unit 21 _1,
(1) The position information of the representative point of the person P1 or the position information of the representative point and the information of the extracted area together with the information indicating that this information is the information of the person P1, the first video extracting unit and outputs as the extraction result ₂₁ 1 P1 of the person P1 in 21 _1,
(2) The position information of the representative point of the person P2 or the position information of the representative point and the information of the extracted area together with the information indicating that this information is the information of the person P2, the first video extracting unit and outputs as the extraction result ₂₁ 1 P2 of the person P2 at 21 _1,
(3) The position information of the representative point of the person P4 or the position information of the representative point and the information of the extracted region together with the information indicating that this information is the information of the person P4, the first video extracting unit and outputs as the extraction result ₂₁ 1 P4 person P4 in 21 _1,
(4) The first video extracting unit includes the position information of the representative point of the person P6 or the position information of the representative point and the information of the extracted region together with information indicating that this information is the information of the person P6. and outputs as the extraction result ₂₁ 1 P6 person P6 in 21 _1,
(5) The first video extracting unit includes the position information of the representative point of the person P10 or the position information of the representative point and the information of the extracted area together with information indicating that this information is the information of the person P10. and outputs as the extraction result ₂₁ 1 P10 of the person P10 in 21 _1.

Similarly, the extraction video A12 that is the output of the imaging device 1b is input to the _second video extraction unit 212 of the person extraction unit 2. Second video extractor 21 _2, to the extraction image A12 is input, it performs the person extracting. For Figure 18, a second image extraction unit 21 _2, Pitcher (person P1) and first baseman and the catcher (person P2) (person P3) and second baseman (person P4) and can person extracting a batter (person P10) assuming that a second image extraction unit 21 _2,
(1) The position information of the representative point of the person P1 or the position information of the representative point and the information of the extracted region together with the information indicating that this information is the information of the person P1, the second video extracting unit and outputs as the extraction result ₂₁ 2 P1 of the person P1 in 21 _2,
(2) The second video extracting unit includes the position information of the representative point of the person P2 or the position information of the representative point and the information of the extracted region together with information indicating that this information is the information of the person P2. and outputs as the extraction result ₂₁ 2 P2 of the person P2 at 21 _2,
(3) The position information of the representative point of the person P3 or the position information of the representative point and the information of the extracted region together with the information indicating that this information is the information of the person P3, the second video extracting unit and outputs as the extraction result ₂₁ 2 P3 person P3 in 21 _2,
(4) The position information of the representative point of the person P4 or the position information of the representative point and the information of the extracted region together with the information indicating that this information is the information of the person P4, the second video extracting unit and outputs as the extraction result ₂₁ 2 P4 person P4 in 21 _2,
(5) The second video extracting unit includes the position information of the representative point of the person P10 or the position information of the representative point and the information of the extracted region together with information indicating that this information is the information of the person P10. and outputs as the extraction result ₂₁ 2 P10 of the person P10 in 21 _2.

Similarly, the extraction video A13, which is the output of the imaging device 1c, is input to the _third video extraction unit 213 of the person extraction unit 2. Third video extractor 21 _3, the extracted video A13 is input, performs the person extracting. For Figure 18, a third image extraction unit 21 _3, could person extracting a pitcher (person P1) and the catcher (person P2) and third baseman (person P5) and shortstop (person P6) and batter (person P10) Then, the third video extractor 21 _3,
(1) The position information of the representative point of the person P1 or the position information of the representative point and the information of the extracted region together with the information indicating that this information is the information of the person P1, the third video extracting unit and outputs as the extraction result ₂₁ 3 P1 of the person P1 in 21 _3,
(2) A third video extraction unit that combines the position information of the representative point of the person P2 or the position information of the representative point and the information of the extracted region together with information indicating that this information is the information of the person P2. and outputs as the extraction result ₂₁ 3 P2 of the person P2 at 21 _3,
(3) The third video extraction unit includes the position information of the representative point of the person P5 or the position information of the representative point and the information of the extracted area together with information indicating that this information is the information of the person P5. and outputs as the extraction result ₂₁ 3 P5 person P5 in 21 _3,
(4) The third video extraction unit includes the position information of the representative point of the person P6 or the position information of the representative point and the information of the extracted region together with information indicating that this information is the information of the person P6. and outputs as the extraction result ₂₁ 3 P6 person P6 in 21 _3,
(5) The third video extraction unit includes the position information of the representative point of the person P10 or the position information of the representative point and the information of the extracted region together with information indicating that this information is the information of the person P10. and outputs as the extraction result ₂₁ 3 P10 of the person P10 in 21 _3.

Similarly, the extraction video A14 output from the imaging device 1d is input to the _fourth video extraction unit 214 of the person extraction unit 2. The fourth video extracting unit 21 _4, the extracted video A14 is input, performs the person extracting. For Figure 18, the fourth video extracting unit 21 _4, assuming that it is the customer extraction medium-sized hand (person P8) and right fielder (person P9), the fourth image extracting unit 21 _4,
(1) The fourth video extracting unit includes the position information of the representative point of the person P8 or the position information of the representative point and the information of the extracted area together with information indicating that this information is the information of the person P8. and outputs as the extraction result ₂₁ 4 P8 person P8 in 21 _4,
(2) The fourth video extracting unit includes the position information of the representative point of the person P9 or the position information of the representative point and the information of the extracted region together with information indicating that this information is the information of the person P9. and outputs as the extraction result ₂₁ 4 P9 person P9 in 21 _4.

The extraction video A15, which is the output of the imaging device 1e, is input to the _fifth video extraction unit 215 of the person extraction unit 2. Fifth picture extracting portion 21 ₅ of the extracted video A15 is input, it performs the person extracting. For Figure 18, the fifth picture extracting portion 21 ₅ of, assuming that it is the person extraction left hand (person P7) and medium-sized hand (person P8), the video extractor 21 ₅ of the fifth,
(1) The position information of the representative point of the person P7 or the position information of the representative point and the information of the extracted area together with the information indicating that this information is the information of the person P7, the fifth video extracting unit and outputs as the extraction result ₂₁ 5 P7 person P7 in 21 _5,
(2) The fifth video extracting unit includes the position information of the representative point of the person P8 or the position information of the representative point and the information of the extracted area together with information indicating that this information is the information of the person P8. and outputs as the extraction result ₂₁ 5 P8 person P8 in 21 _5.

The extraction result ₂₁ 1 P1 person P1 in the first image extraction unit 21 _1, the extraction result ₂₁ 2 P1 of the person P1 in the second image extraction unit 21 _2, of the person P1 in the third image extraction unit 21 ₃ The extraction result 21 ₃ P1 is input to the _first person determination unit 221 based on the person information that the person of each extraction result is the person P1. The extraction result ₂₁ 1 P2 of the person P2 in the first image extraction unit 21 _1, the extraction result ₂₁ 2 P2 of the person P2 in the second image extraction unit 21 _2, of the person P2 in the third image extraction unit 21 ₃ The extraction result 21 ₃ P2 is input to the _second person determination unit 222 based on the person information that the person of each extraction result is the person P2. The extraction result 21 2 _P3 person P3 in the second image extraction unit _212, the extraction results person based on the information of the person that is a person P3, is input to the third person determination unit 22 _3. The extraction result 21 ₁ P4 of the person P4 in the first video extraction unit 21 ₁ and the extraction result 21 ₂ P4 of the person P4 in the _second video extraction unit 21 ₂ are that the person of each extraction result is the person P4. based on the information of the person, is input to the fourth person determination unit 22 _4. The extraction result 21 3 _P5 person P5 of the third picture extracting portion 21 _3, the extraction results person based on the information of the person that is a person P5, is input to the person determination unit 22 ₅ of the fifth. The extraction result 21 ₁ P6 of the person P6 in the first video extraction unit 21 ₁ and the extraction result 21 ₃ P6 of the person P6 in the _third video extraction unit 21 ₃ are that the person of each extraction result is the person P6. Based on the person information, the information is input to the _sixth person determination unit 226. Extraction result 21 5 _P7 in the fifth picture extracting portion 21 persons in ₅ P7, the extraction results person based on the information of the person that is a person P7, are input to the seventh person determination unit 22 _7. The extraction result ₂₁ 4 P8 person P8 in the fourth image extracting unit 21 _4, the extraction result ₂₁ 5 P8 person P8 in the video extractor 21 ₅ of the fifth, the person of each extraction result is a person P8 Is input to the _eighth person determination unit 228. The extraction result 21 4 _P9 person P9 in the fourth image extracting unit 21 _4, the extraction results person based on the information of the person that is a person P9, is input to the person determination section 22 ₉ of the ninth. The extraction result ₂₁ 1 P10 in person P10 in the first image extraction unit 21 _1, the extraction of the second extraction result ₂₁ 2 P10 and the third person in the video extractor 21 ₃ P10 of the person P10 in the video extractor 21 ₂ the results ₂₁ 3 P10, the person of each extraction result on the basis of the information of the person that is a person P10, is input to the person P10 determination unit _{22 10.}

The first person determination unit 22 _1, the extraction result ₂₁ 2 P1 of the person P1 in the extraction result ₂₁ 1 P1 and the second image extraction unit 21 ₂ of the person P1 in the first image extraction unit 21 ₁ is input first For the extraction result 21 ₃ P1 of the person P1 in the _three video extraction units 21 ₃ , for example, the one in which the person P1 is photographed the largest among the three inputs is selected, or among the three inputs Select the one whose face is most clearly photographed, or select one of the three inputs based on a predetermined criterion such as weighting and judging a plurality of conditions. By the processing, the result P1 of the person P1 is output. Similarly, the second person determining unit 22 ₂ , the fourth person determining unit 22 ₄ , the sixth person determining unit 22 ₆ , the eighth person determining unit 22 ₈ , and the tenth person having a plurality of inputs. determination unit _{22 10,} like the first person determination unit 22 _1, one out of a plurality of input, extraction results B2 output respectively person P2, the extraction result of the extraction result B4, People P6 person P4 B6 The person P8 extraction result B8 and the person P10 extraction result B10 are output. On the other hand, the person determining unit 22 ₅ of the third person determination unit 22 ₃ and the fifth input there is only one person determination unit 22 ₉ of the seventh person determination unit 22 ₇ and 9, as an input, People An extraction result B3 of P3, an extraction result B5 of person P5, an extraction result B7 of person P7, and an extraction result B9 of person P9 are output.

  According to the video distribution method or the video distribution apparatus according to the eighth embodiment, among the plurality of extracted videos of the person, a video in a good state (for example, a video that has been photographed larger or has a clearer expression or the like). (Captured video) can be provided to viewers.

Embodiment 9 FIG.
The video distribution method and video distribution apparatus according to Embodiment 9 of the present invention are modifications of the video distribution method and video distribution apparatus according to Embodiment 8 described above. Accordingly, FIG. 18 is referred to in the description of the video distribution method and the video distribution apparatus according to the ninth embodiment.

The person extracting unit of the apparatus that performs the video distribution method according to the ninth embodiment has a configuration in which the first to tenth person determining units 22 _{1 to} 22 ₁₀ are removed from the person extracting unit 2 shown in FIG. Thus, the person extraction section of an apparatus for carrying out a video distribution method according to the ninth embodiment, the output of the first to fifth image extracting unit 21 ₁ through 21 _5, it is output as it is. In the example shown in FIG. 18 (a configuration in which the first to tenth person determination units 22 _{1 to} 22 ₁₀ are removed), the person extraction unit extracts the person P1 extraction result 21 ₁ in the first video extraction unit 21 ₁ . P1, extraction result ₂₁ 1 P2 of the first image extraction unit 21 ₁ in the person P2, the extraction result ₂₁ 1 P4 of the first image extraction unit 21 ₁ person P4 in, the first image extraction unit 21 ₁ in the person P6 extraction result ₂₁ 1 P6, extraction result ₂₁ 1 P10 person P10 in the first image extraction unit 21 _1, the extraction result ₂₁ 2 P1 of the person P1 in the second image extraction unit 21 _2, the second image extraction unit 21 ₂ extraction result ₂₁ 2 P2 of the person P2 at, extraction result ₂₁ 2 P3 of the second video extractor 21 ₂ in the person P3, extraction result 21 ₂ of the person P4 in the second image extraction unit 21 ₂ 4, the extraction result ₂₁ 2 P10 of the second video extractor 21 ₂ in the person P10, a third extraction result ₂₁ 3 P1 of the person P1 in the image extracting unit 21 _3, the third video extractor 21 ₃ of person P2 extraction result ₂₁ 3 P2, extraction result ₂₁ 3 P5 person P5 of the third image extraction unit 21 _3, extraction result ₂₁ 3 P6 of the third person in the video extractor 21 ₃ P6, the third video extractor 21 ₃ extraction result ₂₁ 3 P10 of the person P10 in the extracted result ₂₁ 4 P8 person P8 in the fourth image extracting unit 21 _4, the extraction result ₂₁ 4 P9 person P9 in the fourth image extracting unit 21 _4, the fifth image extraction result ₂₁ 5 P7 person P7 in the extraction unit 21 _5, and outputs the extraction result ₂₁ 5 P8 person P8 in the video extractor 21 ₅ of the fifth, the extraction person generator 3 Supply.

  In the video distribution method and the video distribution apparatus according to the ninth embodiment, the processing is performed in a state where the number of types of individual videos Ci of the person Pi that is the output of the extracted person generation unit 3 is large (the value of n is large).

  According to the video distribution method or the video distribution apparatus according to Embodiment 9, the types of videos that can be selected by the viewer can be increased, and one extracted person is photographed from a plurality of viewpoints. It becomes possible to watch the video at the same time.

Embodiment 10 FIG.
The video distribution method and video distribution apparatus according to Embodiment 10 of the present invention correspond to modifications of the video distribution method and video distribution apparatus according to Embodiments 3 and 6 above. Therefore, in the description of the video delivery method and the video delivery apparatus according to the tenth embodiment, reference is also made to FIG. 9, FIG. 10, FIG.

  The video distribution method according to the tenth embodiment is characterized in the operation when the video distribution apparatus receives a request signal for the individual video of the person of interest from the receiving terminal. In the video distribution method according to the tenth embodiment, when the video distribution apparatus receives a request signal for the individual video of the person of interest from the receiving terminal, and the requested person of interest is not shown in the extraction video. There is no output of the individual video generation unit 6 that satisfies the request from the receiving terminal. In such a case, the reception terminal-specific combination video generation unit 71 shown in FIGS. 9 to 11 or the reception terminal-specific combination video generation unit 73 shown in FIG. 15 ignores the request signal from the reception terminal. . As a result, according to the video distribution method or the video distribution apparatus according to the tenth embodiment, the individual video that does not satisfy the request from the receiving terminal is not distributed to the receiving terminal via the network 8.

  According to the video distribution method or the video distribution apparatus according to the tenth embodiment, by not displaying an unnecessary window in which no video is displayed, the screen can be easily viewed or another video can be viewed largely. It becomes possible.

Embodiment 11 FIG.
The video distribution method according to Embodiment 11 of the present invention corresponds to a modification of the video distribution method according to Embodiments 3 and 6. Therefore, in the description of the video distribution method according to the tenth embodiment, reference is also made to FIG. 9, FIG. 10, FIG.

  The video distribution method according to the eleventh embodiment is characterized in the operation when the video distribution apparatus receives a request signal for the individual video of the person of interest from the receiving terminal. In the video distribution method according to the eleventh embodiment, when the video distribution apparatus receives a request signal for the individual video of the person of interest from the receiving terminal, and the requested person of interest is not shown in the extraction video. There is no output of the individual video generation unit 6 that satisfies the request from the receiving terminal. In such a case, the reception terminal-specific combination video generation unit 71 shown in FIGS. 9 to 11 or the reception terminal-specific combination video generation unit 73 shown in FIG. 15 does not satisfy the request from the reception terminal. A combined video is generated to display individual video and characters (including sentences), pictures, or symbols indicating that the individual video does not satisfy the request from the receiving terminal. To the receiving terminal. As a result, according to the video distribution method or the video distribution apparatus according to the eleventh embodiment, it is received via the network 8 that there is an individual video that does not satisfy the request from the receiving terminal in response to the request from the receiving terminal. Can be distributed to terminals.

  According to the video distribution method or the video distribution apparatus according to the eleventh embodiment, the viewer is notified that there is no individual video such as the player of interest requested by the viewer, and the viewer is encouraged to move to the next action. As a result, the viewer's anxiety and distrust can be eliminated.

Embodiment 12 FIG.
FIG. 19 is a diagram showing an example of a display video on the receiving terminal of the video distributed by the video distribution method according to Embodiment 12 of the present invention.

  The video distribution method according to the twelfth embodiment corresponds to a specific example of the video distribution method according to the first to third embodiments.

As shown in FIG. 19, the display video Ej of the receiving terminal 9 _j includes the entire video Fj, the individual video area Gj1 of the person P1, and the individual video area Gj2 of the person P10. The individual video area Gj1 of the person P1 and the individual video area Gj2 of the person P10 are superimposed on the entire video Fj. The person extracting unit 2 (shown in FIGS. 1, 4 and 5 or included in the individual video generating unit 6 shown in FIGS. 6 to 11) is the position information of the representative point with respect to the extracted person or The position information of the representative point and the size information of the person extracted area are generated as the extraction result Bi of the person Pi. In FIG. 19, an extraction result B1 (shown in FIG. 1) of a person P1 who is a pitcher and an extraction result B10 of a person P10 who is a batter are generated. Since the extraction result B1 of the person P1 and the extraction result B10 of the person P10 are identification results, they change according to the movement of the pitcher or batter. In the video distribution method according to the twelfth embodiment, the extraction result B1 of the person P1 and the extraction result B10 of the person P10 are output to the distribution video generation unit 4 shown in FIG. Note that the extraction result B1 of the person P1 and the extraction result B10 of the person P10 are converted into the distribution video generation unit 41 shown in FIG. 5, the distribution video generation unit with selection function 42 shown in FIG. 6 or FIG. Is output to the distribution function generating video generation unit 43 shown in FIG. 9, the distribution terminal generating video generation unit 44 shown in FIG. 9 or 10, or the reception terminal specific distribution video generation unit 45 shown in FIG. Also good.

  In the following description, the distribution video generation unit 4 in FIG. 1 or 4, the distribution video generation unit 41 in FIG. 5, the distribution video generation unit with selection function 42 in FIG. 6 or FIG. The delivery video generation unit 43 with the selection function, the delivery video generation unit 44 for each receiving terminal in FIG. 9 or FIG. 10, and the delivery video generation unit 45 for each reception terminal in FIG. It describes. The distribution video generation unit 40 performs display so that the person P1 and the person P10 can be identified on the entire video F1 of FIG. 19 based on the extraction result B1 of the person P1 and the extraction result B10 of the person P10. In the case of FIG. 19, the person P <b> 1 and the person P <b> 10 are identified from the other person P using a rectangular area drawn with a broken line. The rectangular area drawn by the broken line moves on the entire image F1 in accordance with the movement of the person P1 and the person P10. In FIG. 19, a rectangular area drawn with a broken line is used for identification display, but it may be configured to be identified by a display method other than a rectangular line such as coloring or an icon or mark.

  FIG. 20 is a diagram showing another display video by the video distribution method according to Embodiment 12 of the present invention.

  When the positional relationship of the person is important along with the skill of the person of interest like soccer, a lot of information is understood on the receiving side of the distribution video by displaying a different identification display for each extracted person on the entire video. It is easy to communicate and may be of interest to the receiver. A technique for performing different identification display for each extracted person can be realized by adopting identification display corresponding to each extraction result Bi of the person Pi in the distribution video generation unit 40. FIG. 20 shows an example in which the shape of the window frame for displaying the individual video of the person Pi is displayed in the same manner as the identification display on the entire video. When the individual video area G11 of the person P1, the individual video area G12 of the person P2, the individual video area G13 of the person P3, and the individual video area G14 of the person P4 are superimposed on the entire video F1 as the display video E1, The window of the individual video area G11 is surrounded by a solid line frame, and the player holding the ball is also surrounded by the solid line frame on the entire image F1. Further, the window of the individual video area G12 of the person P2 is surrounded by a dotted line, and there is a player surrounded by a dotted line on the entire video F1, and this player is the person P2. Similarly, the window of the individual video area G13 of the person P3 is surrounded by a double frame, and the window of the individual video area G14 of the person P4 is surrounded by a two-dot chain line, and the corresponding person P3 on the entire video F1. And the person P4 are displayed so as to be surrounded by a double frame and a two-dot chain line, respectively. When the video to be distributed is a color display, it is often easy for the receiving side of the distribution video to make the method of making the color of the window frame the same as the color of the identification display for each extracted person on the entire video.

  Also, when the positional relationship between players is important as in American football, for example, when the positional relationship between the offense team's backs (quarterback or backs and receiver) and the defense team's line backer, 1 and the person extracting unit 2 in FIGS. 4 and 5 and the person extracting unit in the individual image generating unit 6 in FIGS. 6 to 11, based on the position at the time when the attack of the game starts and the color of the uniform, etc. The offense team's backs and the defense team's line backers are grouped, and this grouping information is added to the individual video Ci of the person Pi, and the distribution video generation unit 40 Based on the information, a different identification display is performed for each group on the person extracted on the entire video.

  According to the video distribution method or the video distribution apparatus according to the twelfth embodiment, in which position the extracted person watching in another window is present or what kind of movement is being performed in a competition (game, etc.). Become recognizable.

  In addition, according to the video distribution method or the video distribution apparatus according to the twelfth embodiment, in which position the extracted person watching in another window is present in the competition (game, etc.) or how it moves It can be recognized for each extracted person.

  Furthermore, according to the video distribution method or the video distribution apparatus according to the twelfth embodiment, it is possible to clearly display the positions and movements for each role such as the distinction of enemies and allies and defense / attack in the game.

It is a block diagram which shows roughly the structure of the apparatus (namely, video delivery apparatus which concerns on Embodiment 1) which implements the video delivery method which concerns on Embodiment 1 of this invention. It is a figure for demonstrating operation | movement of the person extraction part shown by FIG. It is a block diagram which shows roughly the structure of the extracted person image | video production | generation part shown by FIG. It is a block diagram which shows roughly the structure of the apparatus (namely, other video delivery apparatus which concerns on Embodiment 1) which implements the other video delivery method which concerns on Embodiment 1 of this invention. It is a block diagram which shows roughly the structure of the apparatus (namely, further another video delivery apparatus which concerns on Embodiment 1) which implements the further another video delivery method concerning Embodiment 1 of this invention. It is a block diagram which shows roughly the structure of the apparatus (namely, video delivery apparatus which concerns on Embodiment 2) which implements the video delivery method which concerns on Embodiment 2 of this invention. It is a block diagram which shows roughly the structure of the apparatus (namely, other video delivery apparatus which concerns on Embodiment 2) which implements the other video delivery method which concerns on Embodiment 2 of this invention. It is a block diagram which shows roughly the structure of the apparatus (namely, further another video delivery apparatus which concerns on Embodiment 2) which implements the further another video delivery method concerning Embodiment 2 of this invention. It is a block diagram which shows roughly the structure of the apparatus (namely, video delivery apparatus which concerns on Embodiment 3, 10, and 11) which implements the video delivery method which concerns on Embodiment 3, 10, and 11 of this invention. . 1 schematically shows a configuration of an apparatus that implements another video distribution method according to Embodiments 3, 10, and 11 of the present invention (that is, another video distribution apparatus according to Embodiments 3, 10, and 11). It is a block diagram. The block which shows the structure of the apparatus (namely, further another video delivery apparatus which concerns on Embodiment 3, 10, and 11) which implements the further another video delivery method concerning Embodiment 3, 10, and 11 of this invention FIG. It is a block diagram which shows roughly the structure of the apparatus (namely, video delivery apparatus which concerns on Embodiment 4) which implements the video delivery method which concerns on Embodiment 4 of this invention. It is a block diagram which shows roughly the structure of the separate image | video combination part shown by FIG. It is a block diagram which shows roughly the structure of the apparatus (namely, video delivery apparatus which concerns on Embodiment 5) which implements the video delivery method which concerns on Embodiment 5 of this invention. It is a block diagram which shows roughly the structure of the apparatus (namely, video distribution apparatus which concerns on Embodiment 6, 10, and 11) which implements the video distribution method which concerns on Embodiment 6, 10, and 11 of this invention. . It is a figure for demonstrating the image | video for extraction which the video delivery method and video delivery apparatus which concern on Embodiment 7 of this invention use. It is a figure for demonstrating the video for extraction which the video delivery method and video delivery apparatus which concern on Embodiment 8 of this invention use. It is a block diagram which shows roughly the structure of the person extraction part of the apparatus (namely, video distribution apparatus which concerns on Embodiment 8 and 9) which implements the video distribution method which concerns on Embodiment 8 and 9 of this invention. It is a figure which shows the example of the display video in the receiving terminal of the video delivered by the video delivery method and video delivery apparatus which concern on Embodiment 12 of this invention. It is a figure which shows the other display video in the receiving terminal of the video delivered by the video delivery method and video delivery apparatus which concern on Embodiment 12 of this invention.

Explanation of symbols

1, 1 a, 1 b, 1 c, 1 d, 1 e, 10 imaging device, 2 person extraction unit, 3 extracted person video generation unit, 3 ₁ first extracted person video generation unit, 3 ₂ second extraction person video generation unit, 3 _3rd extracted person video generation unit, 3 _4th fourth extracted person video generation unit, 3 _{ith i} th extracted person video generation unit, 3 _(n-1) th (n-1) extracted person video generation parts, extracts the person image generator of _{3 n} the n, 4 and 41 distribution image generating unit, 6 the individual image generator, 8 network, _{9 1} first receiving terminal, _{9 2} second receiving terminal, _{9 3} a 3 receiving terminal, 9 _j receiving terminal, 9 _m receiving terminal, 11 m, receiving terminal, 11 c, 12 a, 12 b, 12 c, 13 a, 13 b, 13 c, 14, 15, 16 video distribution apparatus, 21 ₁ 1st video extraction unit, 21 ₂ 2nd video extraction unit, 21 ₃ 3rd video extraction Output unit, 21 ₄ 4th video extraction unit, 21 ₅ 5th video extraction unit, 22 ₁ 1st person determination unit, 22 ₂ 2nd person determination unit, 22 ₃ 3rd person determination unit, 22 ₄ the fourth person determination unit, 22 ₅ fifth person determination section, 22 ₆ person determination unit of the sixth, 22 ₇ person determination unit of the seventh, 22 ₈ person determination unit of the eighth, 22 ₉ 9 person determination of , 22 ₁₀ tenth person determination unit, 21 ₁ P1 extraction result of person P1 in _first video extraction unit 21 ₁ , 21 ₁ P2 extraction result of person P2 in _first video extraction unit 21 ₁ , 21 ₁ P4 extraction result of the person P4 in the first image extraction unit 21 _{1, 21} 1 P6 first extraction result of the person P6 in the image extracting unit 21 _{1, 21} 1 P10 extraction result of the second video extractor 21 ₂ in the person P10 , 21 ₂ P1 second video extractor 2 Extraction result of the person P1 in _{2, 21} 2 P2 extraction result of the second video extractor 21 ₂ in the person P2, ₂₁ 2 P3 second extraction result of the person P3 in the video extractor 21 _{2, 21} 2 P4 second extraction result of the person P4 in the image extracting unit 21 _{2, 21} 2 P10 second extraction result of the person P10 in the video extractor 21 _{2, 21} 3 P1 third extraction result of the person P1 in the video extractor 21 _3, 21 ₃ P2 extraction result of the third video extractor 21 ₃ in the person P2, the extraction of ₂₁ 3 P5 third extraction result of the person P5 in the video extractor 21 _{3, 21} 3 P6 third person in the video extractor 21 ₃ P6 result, the extraction of ₂₁ 3 P10 third extraction result of the person P10 in the video extractor 21 _{3, 21} 4 P8 person P8 in the fourth image extractor 21 ₄ Result, in ₂₁ 4 P9 fourth extraction result of the person P9 in the video extractor 21 _{4, 21} 5 P7 extraction result of the fifth picture extracting portion 21 persons in ₅ P7, ₂₁ 5 P8 fifth picture extracting portion 21 ₅ Extraction result of person P8, 42, 43 Video generation unit for distribution with selection function, 44, 45 Video generation unit for distribution by receiving terminal, 46 Video distribution unit with selection function, 47 Video distribution unit by receiving terminal, 70 Individual video combination 71, individual video combination unit for each receiving terminal, 72 individual video combination unit, 73 individual video combination unit for each receiving terminal, A1, A11,..., A15 extraction video, A2 overall video, B1 person P1 extraction result, B2 Extraction result of person P2, B3 Extraction result of person P3, B4 Extraction result of person P4, B5 Extraction result of person P5, B6 Extraction result of person P6, B7 Extraction result of person P7 Outcome result, B8 Extraction result of person P8, B9 Extraction result of person P9, B10 Extraction result of person P10, Extraction result of Bi person Pi, Extraction result of B (n-1) Person P (n-1), Bn person Pn extraction result, C1 Individual video of the person P1, C2 Individual video of the person P2, C3 Individual video of the person P3, C4 Individual video of the person P4, Ci Individual video of the person Pi, C (n-1) Person P (n -1) individual video, Cn individual video of Pn, D1 first distribution video, D2 second distribution video, Dj jth distribution video, Dm mth distribution video, E1 first Display video corresponding to distribution video D1, E2 Display video corresponding to second video D2, Ej Display video corresponding to jth video Dj, Em Display corresponding to mth video Dm Video, F1 Display video E1 An entire image in F2, an entire image in F2 display image E2, an entire image in Fj display image Ej, an entire image in Fm display image Em, an individual image area of person P1 in G11 display image E1, and an individual image of person P2 in G12 display image E1 An individual video area of the person P3 in the G13 display video E1, an individual video area of the person P4 in the G14 display video E1, an individual video area of the person P3 in the G21 display video E2, an individual video area of the person P1 in the G22 display video E2, G23 Individual video area of person P4 in display video E2, Gm1 Individual video area of person P1 in display video Em, Gm2 Individual video area of person Pn in display video Em, Individual video area of person P1 in Gj1 display video Ej, Gj2 display People in video Ej P10 individual video area, H1 first combination video, H2 second combination video, Hm mth combination video, J1 first request video, J2 second request video, J3 third request video, K1 first 1 request, K2 second request, K3 third request, L1 first combination video, L2 second combination video, L3 third combination video, M1 first request video, M2 second request video , M3 third request video, N1 first request video, N2 second request video, N3 third request video, P1, ..., Pi, ..., Pn person, Q1 first combination video, Q2 second Q3 third combination video, Qm mth combination video, R1 first request video, R2 second request video, R3 third request video, U1 first request video, U2 second Request video, U3 3rd request video, T1 1st 1 combination image, T2 second combination image, T3 third combination image, S1 first request, S2 second request, S3 third request, C1s1 first image obtained by enlarging or reducing individual image C1 C1s2 Second video obtained by enlarging or reducing the individual video C1, C1s3 Third video obtained by enlarging or reducing the individual video C1, C3s1 Video obtained by enlarging or reducing the individual video C3, and video obtained by enlarging or reducing the C4s1 individual video C4 Cns1 Video obtained by enlarging or reducing the individual video Cn, video trimmed by C1s2t C1s2, video trimmed by C1s3t C1s3, video trimmed by C3s1t C3s1, video trimmed by C4s1t C4s1, video trimmed by Cns1t Cns1.

Claims (28)

A video distribution method for distributing video via a network by a video distribution device,
Extract one or more people from the video taken by the imaging device,
For each extracted person, an individual image including the extracted person image and the surrounding image of the extracted person is cut out from the image captured by the imaging device,
For each of the extracted persons, all or a part of the cut out single or plural individual videos is converted into a video shot by the imaging device or a video shot by another imaging device different from the imaging device. Generate video for distribution by superimposing using a separate window,
Distributing the distribution video to a receiving terminal via a network. A video distribution method for distributing video via a network by a video distribution device,
Extract multiple people from the video taken by the imaging device,
For each extracted person, an individual image including the extracted person image and the surrounding image of the extracted person is cut out from the image captured by the imaging device,
Generating one or more individual videos by selecting and combining one or more individual videos from the plurality of cut out individual videos; and
For each of the combination videos, a plurality of distribution videos are obtained by superimposing the combination video on a video shot by the imaging device or a video shot by another imaging device different from the imaging device using a separate window. Produces
Receiving a request signal from a receiving terminal that receives video distributed via a network, and selecting one of the plurality of distribution videos according to the received request signal;
Distributing the selected distribution video to a receiving terminal that has issued the request signal via a network. A video distribution method for distributing video via a network by a video distribution device,
Extract multiple people from the video taken by the imaging device,
For each extracted person, an individual image including the extracted person image and the surrounding image of the extracted person is cut out from the image captured by the imaging device,
One or more individual videos out of a plurality of individual videos cut out for each person according to the received request signal, receiving a request signal from a receiving terminal that receives a video distributed via a network To generate a combined video including one or more individual videos by selecting and combining
Superimposing the combined video on a video shot by the imaging device or a video shot by another imaging device different from the imaging device using a separate window to generate a delivery video,
Distributing the distribution video to a receiving terminal that has issued the request signal via a network. A video distribution method for distributing video via a network by a video distribution device,
Extract one or more people from the video taken by the imaging device,
For each extracted person, an individual image including the extracted person image and the surrounding image of the extracted person is cut out from the image captured by the imaging device,
A distribution video is generated from all or part of the cut out single or multiple individual videos,
Distributing the distribution video to a receiving terminal via a network. A video distribution method for distributing video via a network by a video distribution device,
Extract multiple people from the video taken by the imaging device,
For each extracted person, an individual image including the extracted person image and the surrounding image of the extracted person is cut out from the image captured by the imaging device,
Generating one or more individual videos by selecting and combining one or more individual videos from the plurality of cut out individual videos; and
For each combination video, generate a plurality of distribution videos for displaying the combination video,
Receiving a request signal from a receiving terminal that receives video distributed via a network, and selecting one of the plurality of distribution videos according to the received request signal;
Distributing the selected distribution video to a receiving terminal that has issued the request signal via a network. A video distribution method for distributing video via a network by a video distribution device,
Extract multiple people from the video taken by the imaging device,
For each extracted person, an individual image including the extracted person image and the surrounding image of the extracted person is cut out from the image captured by the imaging device,
One or more individual videos out of a plurality of individual videos cut out for each person according to the received request signal, receiving a request signal from a receiving terminal that receives a video distributed via a network To generate a combined video including one or more individual videos by selecting and combining
Generate a distribution video for displaying the above combination video,
Distributing the distribution video to a receiving terminal that has issued the request signal via a network.   The video delivery method according to claim 1, wherein one or a plurality of the imaging devices are provided. The video distribution according to claim 3 or 6, wherein when the cut-out video corresponding to the person requested by the receiving terminal does not exist, the distribution video generation unit ignores the request signal of the receiving terminal. Method. When the clipped video corresponding to the person requested by the receiving terminal does not exist, the distribution video generation unit distributes notification information indicating that the person requested by the receiving terminal has not been extracted. The video distribution method according to claim 3 or 6. A plurality of the imaging devices are provided,
The person is extracted from an image of one imaging device selected using a predetermined criterion when a person is photographed by the plurality of imaging devices. The video delivery method according to any one of the above. A plurality of the imaging devices are provided,
10. When a person is photographed by the plurality of imaging devices, the video extracted by each of the plurality of imaging devices is treated as a different person, and the video is cut out. The video delivery method according to any one of the above.   When the extracted person displayed in the separate window is present on the superimposed video, an identification display for enabling identification of the extracted person is performed on the superimposed video. 4. The video distribution method according to claim 1, wherein identification display information for distribution is distributed.   13. The video distribution method according to claim 12, wherein when there are a plurality of extracted persons, identification display information for performing the identification display different for each of the extracted persons is distributed.   The identification display information for grouping the plurality of extracted persons under a predetermined condition and performing different identification display for each group is distributed when there are a plurality of the extracted persons. 4. The video distribution method according to any one of 1 to 3. A video distribution device for distributing video over a network,
A person extraction unit for extracting one or more persons from the video imaged by the imaging device;
Generation of an extracted person video that outputs the individual video including the extracted video of the person and the video around the extracted person for each of the extracted people from the video taken by the imaging device. And
For each of the extracted persons, all or a part of the cut out single or plural individual videos is converted into a video shot by the imaging device or a video shot by another imaging device different from the imaging device. A video distribution apparatus comprising: a distribution video generation unit configured to generate a distribution video to be distributed to a receiving terminal by being superimposed using another window. A video distribution device for distributing video over a network,
A person extraction unit for extracting a plurality of persons from the video imaged by the imaging device;
Generation of an extracted person video that outputs the individual video including the extracted video of the person and the video around the extracted person for each of the extracted people from the video taken by the imaging device. And
An individual video combining unit that generates a combined video including one or more individual videos by selecting and combining one or more individual videos from the plurality of cut out individual videos;
For each of the combination videos, a plurality of distribution videos are obtained by superimposing the combination video on a video shot by the imaging device or a video shot by another imaging device different from the imaging device using a separate window. A distribution video generation unit for generating
The distribution video generation unit receives a request signal from a receiving terminal that receives a video distributed via a network, and receives the request from the plurality of distribution videos according to the received request signal. A video distribution apparatus for selecting a distribution video to be distributed to a receiving terminal that has transmitted a signal. A video distribution device for distributing video over a network,
A person extraction unit for extracting a plurality of persons from the video imaged by the imaging device;
Generation of an extracted person video that outputs the individual video including the extracted video of the person and the video around the extracted person for each of the extracted people from the video taken by the imaging device. And
One or more individual videos out of a plurality of individual videos cut out for each person according to the received request signal, receiving a request signal from a receiving terminal that receives a video distributed via a network An individual video combining unit that generates a combined video including one or more individual videos by selecting and combining,
The combined video is superimposed on a video shot by the imaging device or a video shot by another imaging device different from the imaging device using a separate window, and distributed to the receiving terminal that issued the request signal. A video distribution apparatus comprising: a distribution video generation unit that generates a distribution video. A video distribution device for distributing video over a network,
A person extraction unit for extracting one or more persons from the video imaged by the imaging device;
Generation of an extracted person video that outputs the individual video including the extracted video of the person and the video around the extracted person for each of the extracted people from the video taken by the imaging device. And
A video distribution apparatus comprising: a distribution video generation unit configured to generate a distribution video distributed to a receiving terminal from all or a part of the cut out single or plural individual videos. A video distribution device for distributing video over a network,
A person extraction unit for extracting a plurality of persons from the video imaged by the imaging device;
Generation of an extracted person video that outputs the individual video including the extracted video of the person and the video around the extracted person for each of the extracted people from the video taken by the imaging device. And
An individual video combining unit that generates a combined video including one or more individual videos by selecting and combining one or more individual videos from the plurality of cut out individual videos;
A distribution video generation unit that generates a plurality of distribution videos for displaying the combination video for each of the combination videos;
The distribution video generation unit receives a request signal from a receiving terminal that receives a video distributed via a network, and receives the request from the plurality of distribution videos according to the received request signal. A video distribution apparatus for selecting a distribution video to be distributed to a receiving terminal that has transmitted a signal. A video distribution device for distributing video over a network,
A person extraction unit for extracting a plurality of persons from the video imaged by the imaging device;
Generation of an extracted person video that outputs the individual video including the extracted video of the person and the video around the extracted person for each of the extracted people from the video taken by the imaging device. And
One or more individual videos out of a plurality of individual videos cut out for each person according to the received request signal, receiving a request signal from a receiving terminal that receives a video distributed via a network An individual video combining unit that generates a combined video including one or more individual videos by selecting and combining,
A video distribution apparatus comprising: a distribution video generation unit configured to generate a distribution video distributed to the receiving terminal that has issued the request signal in order to display the combination video.   21. The video distribution device according to claim 15, wherein one or a plurality of the imaging devices are provided. The video distribution according to claim 17 or 20, wherein, when there is no clipped video corresponding to the person requested by the receiving terminal, the distribution video generation unit ignores the request signal of the receiving terminal. apparatus. When the clipped video corresponding to the person requested by the receiving terminal does not exist, the distribution video generation unit distributes notification information indicating that the person requested by the receiving terminal has not been extracted. The video distribution device according to claim 17 or 20. A plurality of the imaging devices are provided,
When a person is photographed by the plurality of imaging devices, the person extracting unit extracts the person from an image of one imaging device selected using a predetermined criterion. The video distribution device according to any one of claims 15 to 23. A plurality of the imaging devices are provided,
24. When a person is photographed by the plurality of imaging devices, the video extracted by each of the plurality of imaging devices is treated as a separate person, and the video is cut out. The video distribution device according to any one of the above.   When the extracted person displayed in the separate window is present on the superimposed video, an identification display for enabling identification of the extracted person is performed on the superimposed video. 18. The video distribution apparatus according to claim 15, wherein identification display information for distribution is distributed.   27. The video distribution apparatus according to claim 26, wherein when there are a plurality of extracted persons, identification display information for performing different identification displays for each of the extracted persons is distributed.   The identification display information for grouping the plurality of extracted persons under a predetermined condition and performing different identification display for each group is distributed when there are a plurality of the extracted persons. The video distribution device according to any one of 15 to 17.

Images