JP2003179908A - Image-distributing apparatus and image-receiving apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image-distributing apparatus for distributing images where the taste of a viewer is reflected. <P>SOLUTION: The image-distributing apparatus 10 is an apparatus for communicating with an image-receiving apparatus 20 via a communication network 30, and comprises an image acquisition section 110 for acquiring a plurality of images from different viewpoints, an image analysis section 120 for analyzing contents included in the image for generating an analysis result as contents information for each of the images, and a distribution image-matching section 130 for determining the degree of matching between each of the contents information and taste information that is notified by the viewer, determines an image to be distributed, and distributes the determined image. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video distribution device and a video reception device for distributing and receiving videos such as sports programs.

[0002]

2. Description of the Related Art With the development of infrastructure for communication networks, technologies relating to the distribution and reception of video such as sports programs are being developed. As prior arts relating to such video distribution and reception, there are a video information distribution system disclosed in Japanese Patent Laid-Open No. 7-95322 (first publication) and a Japanese Patent Laid-Open No. 2-54646 (second publication). There is a disclosed program distribution device.

The video information distribution system disclosed in the first publication comprises a video center, a video dial tone trunk, and a user terminal. When the user calls the video center, the program desired by the user is transmitted from the video center via the transmission path. The video dial tone trunk receives video information transferred at a high speed from the video center, reproduces the video information at a normal speed, and transmits the video information to the user terminal via the low speed transmission line.

The program distribution device disclosed in the second publication is
A storage device that holds a plurality of moving picture programs and a program distribution request and an advertisement insertion request from a terminal device via the network are received, and the moving picture program and the specified advertising request are divided into information blocks and distributed over the network. And a control device for controlling the charging so as to make the charges different according to the timing of inserting the advertisement specified by the advertisement insertion request.

[0005]

However, in the above-mentioned prior art, the video delivered to the viewer is a video shot only from the creator's intention from a certain specific viewpoint, and the viewer likes it. It is not possible to view the video according to or change the viewpoint. For example, in a program of watching sports such as soccer, even if a viewer has a request to watch a particular player he / she likes, only the other players who appear in only a few scenes. Even if it is a video work that appears, you have to watch it.

Further, the above-mentioned conventional technique has a problem that it is necessary to record a program in a video center or a storage device in advance, and a system for delivering real-time video is not provided. Therefore, the present invention has been made in view of such a situation, and an object of the present invention is to provide a video distribution device and a video reception device capable of distributing a video in which a taste of a viewer is reflected.

Further, the present invention provides a video distribution device and a video reception device capable of distributing not only the accumulated video but also real-time (live) video in which the taste of the viewer is reflected. Also for the purpose.

[0008]

In order to achieve the above object, a video distribution apparatus according to the present invention is a video distribution apparatus that communicates with a video receiving apparatus via a communication network,
Video acquisition means for acquiring a plurality of videos from different viewpoints, video analysis means for analyzing the contents included in the videos for each of the videos, and generating an analysis result as content information, each of the content information, and viewing It is characterized by further comprising: a distribution video matching unit that determines the compatibility with the preference information notified by the person, determines the video to be distributed, and distributes the determined video. That is, it is determined by the degree of conformity between the content information generated for each video from a plurality of videos from different viewpoints and the viewer's preference information, and one video that matches the viewer's preference is selected. Deliver to the receiving device.

Here, the content information may include information for identifying the subject and information for indicating the display position or display area of the subject. Alternatively, the container for obtaining the preference information may be distributed to the video receiving device side, and the preference information may be acquired by inputting the degree of the preference for the subject into the container. Further, when the viewer specifies a position on the screen for the distributed video, the subject at that position may be specified and additional information regarding this subject may be transmitted.

Furthermore, the present invention is a video distribution device which communicates with a video reception device via a communication network, and video acquisition means for acquiring a plurality of videos from different viewpoints.
For each of the videos, there is provided video analysis means for analyzing the content included in the video and generating an analysis result as content information, and video multiplexing means for multiplexing and delivering each video and each content information. It is also possible to provide a video distribution device characterized by. In this case, each content information distributed from the video distribution device on the video reception device side,
The degree of compatibility with the preference information notified by the viewer may be determined, one video to be reproduced may be determined from the plurality of videos distributed from the video distribution device, and the determined video may be reproduced. .

The present invention can also be realized as a program that causes a computer to function as such a characteristic means, or as a recording medium that records the program. The program according to the present invention can be distributed via a communication network such as the Internet or a recording medium.

[0012]

BEST MODE FOR CARRYING OUT THE INVENTION (Embodiment 1) Hereinafter, a video distribution system according to Embodiment 1 of the present invention will be described with reference to the drawings. In addition, in this embodiment, as an image-capturing object in a limited space, an image centering on a player in the case of a sports relay such as soccer is described as an example, but the present invention is not limited to an arbitrary image-capturing space and an image-capturing object. Is applicable to.

FIG. 1 is a block diagram showing a functional configuration of a video distribution system 1 according to the first embodiment of the present invention.
The video distribution system 1 according to the first embodiment of the present invention is a communication system that stream-distributes contents such as video according to the taste of the user, and connects the video distribution device 10 and the video reception device 20 to each other. Communication network 3
It consists of 0 and.

The video distribution apparatus 10 edits the video contents by switching and selecting, for every several frames, one video which matches the user's preference or preference history from a plurality of images (multi-viewpoint images). A distribution server including a computer or the like that is constructed in real time and performs stream distribution to the video reception device 20, and includes a video acquisition unit 110, a video analysis unit 120, a distribution video matching unit 130, a video recording unit 140, and an addition unit. It includes an information providing unit 150, a video information distribution unit 160, and the like.

The image acquisition unit 110 is dispersedly arranged in a predetermined photographing space (for example, a soccer field), and a plurality of images (multi-viewpoints) obtained by photographing a plurality of subjects in a limited photographing space from various viewpoints and angles, respectively. It is a plurality of photographing devices (video cameras, etc.) that acquire images). The multi-view video images acquired by the video acquisition unit 110 are transmitted to the video analysis unit 120 via a cable or wireless communication.

The video analysis unit 120 determines the content of each video (specifically, what subject (eg, athlete) is at what position on the screen).
Is acquired for each frame, and the acquisition result is generated for each frame of each video as content information described in a descriptor (Descriptor) of multimedia content such as MPEG7.

The distribution video matching unit 130, regarding the live content acquired by the video acquisition unit 110 and the storage content held in the video recording unit 140, indicates the user's preference or preference sent from the video receiving device 20. The history was compared with the content information of each video, and one video that matches the user's preference or preference history from multiple videos (multi-viewpoint video) was switched / selected every few frames. The video content is constructed in real time, the multi-view video to which the content information is added is stored in the content database 141 of the video recording unit 140,
The preference value input dialog 146 is generated and stored in the preference database 145.

The video recording unit 140 is a content database 14 that holds storage contents to be distributed.
1 and a preference database 145 for acquiring the preference for each user. The content database 141 includes a mode selection dialog 142 for selecting a live (live broadcast) or storage (broadcast by recording) mode, a content being relayed live, or a content list 14 of stored storage content.
3 and the content 144 itself. Further, the preference database 145 stores a preference value input dialog 146 for each content for inputting a preference value (preference degree) for a subject and a preference history table 147 for each user that stores the preference history input by the user.

The additional information providing unit 150 is information related to the distribution video provided to the viewer for each live and storage content (additional information such as a profile of a subject (object), for example, soccer relay content). For example, it is a hard disk or the like that holds an auxiliary information table 151 in which the profile of a soccer player's birth date etc.) is stored in advance. In the attached information table 151, for example, information of “date of birth”, “main career”, “characteristics”, and “comment of player” is recorded in advance for each player, and the distribution video matching unit 130 Upon receiving the notification specifying the player name and the like, the additional information regarding the specified player is transmitted to the video receiving device 20.

The video information distribution unit 160 is a bidirectional communication interface for communicating with the video receiving device 20 via the communication network 30, driver software, and the like.

The video receiver 20 interacts with the user regarding live and storage mode selection, input of preference values, and the like, and presents the video content distributed from the video distribution device 10 to the user, a mobile phone. , A portable information terminal, a TV for digital broadcasting, etc., including an operation unit 210, a video output unit 220, and a transmitting / receiving unit
It consists of 30 mag.

The operation unit 210 is a device such as a remote controller or a pointing device such as a keyboard or a mouse, and specifies the content desired by the user by interacting with the user or inputs the preference value to input preference value information. The position information of the subject displayed on the video output unit 220 is transmitted to the transmission / reception unit 230.

The transmitting / receiving unit 230 is a communication network 30.
A transmission / reception circuit, driver software, etc. for serial communication with the video distribution device 10 via the.

The communication network 30 includes the video distribution device 1
0 is a bidirectional transmission path connecting the video receiving device 20 and a broadcasting / communication network such as CATV, a telephone network, a communication network such as the Internet such as a data communication network.

The operation of the video distribution system 1 configured as described above will be described in order along the sequence shown in FIG. 2 (main processing flow of this system). In addition,
The sequence of this figure shows the flow of multi-view video at a certain point in time.

The video acquisition unit 110 of the video distribution device 10 is
Multiple image capture devices such as video cameras capable of capturing images are used to capture multiple images of multiple subjects within a limited shooting space from various viewpoints and angles (multi-view images. ) Is acquired (S11).
In the video distribution device 10 of the present embodiment, it is desirable to disperse as many image-capturing devices as possible in the image-capturing space, since it is necessary to capture images of the limited space from various viewpoints and angles. The present invention is not limited to the number of devices, the arrangement position, or the like. The multi-view video acquired by the video acquisition unit 110 is transmitted to the video analysis unit 120 by using a cable or wireless communication. In the present embodiment, all the images acquired by the respective image acquisition units 110 are transmitted to one image analysis unit 120 and are centrally managed, but the image analysis unit 120 does May be equipped with.

The image analysis unit 120 analyzes each image acquired by the image acquisition unit 110, and the content of each image (what position (for example, player) appears in what position on the screen) Is acquired for each frame, and the acquisition result is generated for each frame of each video as content information described in a descriptor (Descriptor) of multimedia content such as MPEG7 (S12). The generation of the content information requires two steps of (1) extraction of the content information and (2) description of the content information. The content information largely depends on the content of the video being shot, but in the case of a sports broadcast such as soccer, most of the video is considered to be the video of a player in competition. Therefore,
In the present embodiment, it is considered that a player included in the video is identified by analyzing the video, and a player name and a position where the player is displayed in the video are generated as content information. Below, first, as an example of extraction of content information,
Two methods (method using a measuring instrument and method using image processing) for identifying the player in the video (who is in the image) and acquiring the display position will be described.

1. Method using a measuring instrument With the method using a measuring instrument, it is possible to measure a three-dimensional position in a coordinate system (hereinafter referred to as a global coordinate system) with an arbitrary point in space as a reference point, and a unique ID number The assigned position sensor (for example, GPS; hereinafter referred to as a position sensor) is attached to each object to be identified. As a result, each object can be identified and the three-dimensional position can be acquired. Next, cameras for capturing images are installed at various positions and angles.

In the first embodiment, the installed camera is fixed and panning and tilting are not performed. Therefore, it is necessary to prepare a camera that can cover the entire shooting space in a fixed state. The position in the global coordinate system and the line-of-sight (collimation) direction vector are obtained for all the cameras whose fixed positions have been determined, and the image analysis unit 120 is notified in advance. It should be noted that the camera used in the present embodiment, as shown in FIG. 3A, has a line-of-sight direction of the camera when the projection direction is represented by a coordinate system fixed to the camera (hereinafter referred to as a camera coordinate system). It is assumed that the projection center coincides with (Z axis), the projection center is located at Z = 0 on the Z axis, and the projection surface is Z = d. From the position sensor attached to the object, the ID number and the three-dimensional position coordinate assigned to each position sensor are input to the image analysis unit 120 in time series. The ID number is necessary to identify the object.

Next, a method of identifying at which position of the image (on the screen) the object is displayed using the information from the position sensor and the position information of the camera will be described. First, the three-dimensional position coordinates of the position sensor in the global coordinate system are converted into an expression in the camera coordinate system.
Assuming that Mvi is the matrix for converting the global coordinate system to the camera coordinate system of the i-th camera and vw is the output of the position sensor in the global coordinate system, the output (coordinates) vc of the position sensor in the camera coordinate system is vc = Mvi. It is calculated by vw. Here, "." Represents a product of a matrix and a vector. Further, this equation is expressed as follows using matrix and vector components.

[Equation 1]

Next, the two-dimensional coordinates of the position sensor on the projection plane of the camera are obtained by using projection conversion.
FIG. 3B is a top view of FIG. 3A along the projection plane.
3 is a side view of FIG. 3A along the projection plane.
From (c), coordinates vp = (xp, y on the projection plane
p) is xp = xc / (zc / d), yp = yc / (z
c / d). Then, it is determined whether or not the calculated xp and yp are within the projection plane (screen) of the camera, and if they are within the projection plane, the coordinates are acquired as the display position. By performing the above processing on all the cameras and all the objects, it is determined which object is currently displayed at which position for each camera.

2. Method using image processing With the method using image processing, the position information is not used and the content information is extracted only from the images acquired by the camera.Therefore, the camera is fixed as when using a measuring instrument. You don't have to. In order to identify the object from the image, it is necessary to cut out only the object from the image and further identify the object. Although there is no particular limitation on the method of cutting out the object from the image, in the above example of sports broadcasting, the background is basically a single color (for example, in the case of soccer or American football broadcasting, the background is the color of the lawn. However, it is possible to separate the background from the object using the color information. Below, the technique for identifying the some target object extracted from the image | video is described.

(1) Template Matching A large number of template images are prepared for each player, the object separated from the background is matched with the template image, and the player considered to be the most suitable image. Identify. Specifically, first, attention is paid to a certain player included in the video, and the smallest rectangle (hereinafter, referred to as “target rectangle”) surrounding the player is obtained. Next, for a certain template (which is assumed to be a rectangle), the size of the rectangle is adjusted by down-sampling if it is larger than the target rectangle and up-sampling if it is smaller. Then, the difference between the pixel value at a certain position of the target rectangle and the pixel value at the same position as that of the template image is calculated. The above processing is performed for all pixels, and the sum S thereof is calculated. It is assumed that the above-described processing is performed on all the template images and the player of the template image having the smallest S is the player who is the identification target.

(2) Motion Prediction In the sports broadcast video, the motion of the athlete is continuous, so
It does not change dramatically between frames. Further, since the moving direction and speed are also limited, if the player's position in the current frame is known, the position in the next frame can be predicted to some extent. Therefore, it is possible to predict the range of possible values of the player position in the next frame from the player position in the current frame, and use the template matching only for that range. In addition, since the positional relationship between the player who is focused on and the players around him does not change dramatically, it can be used as information for motion prediction. For example, if the position of the player displayed next to the player in the image one frame before is known in the current frame, it is highly possible that the player being identified is also present in the vicinity, and the position in the current frame is high. Can be predicted.

(3) Use of pre-acquired information In sports broadcasts, teams competing often wear uniforms of different colors. Since the color of the uniform can be acquired in advance, it is possible to distinguish the team using the color information. In addition, a uniform number is given to the uniform, and the uniform number is never used in duplicate, which is very effective in identifying each player.

The identification of the object and the acquisition of the position where the object is displayed are achieved by combining the methods described above. For example, first, the team is discriminated by matching the color information of the object and the color information of the uniform. Next, many template images are prepared by cutting out only the uniform number of the uniform, and the uniform number is identified using template matching. The identification is completed for the players who can identify the uniform numbers. For players that could not be identified, motion prediction is performed using the image of the previous frame and the positional relationship with surrounding players that have already been identified, and a template that uses the full-body image of the player as a template image for the prediction range. Match. The position is specified by the upper left position and the lower right position of the target rectangle in the main scanning direction and the sub scanning direction.

Next, the description of the acquired content information (Desc)
ription). A description format of multimedia contents such as MPEG-7 is used to describe the contents information. In the present embodiment, the player name extracted in the above procedure and the display position in the image are described as the content information. For example, as shown in FIG. 4, A (for example, Anndo) and B (for example, Niyama) are displayed in the image.
In the case where the two players of (oto) are included, an example of the description format of the content information is as shown in FIG.

In this figure, <Information
> Is a descriptor (tag) indicating the start and end of the content information, and <ID> is a descriptor for identifying each player,
This descriptor identifies the player's name <IDNam
e><IDOrganize to identify descriptors and affiliations
ation> descriptor is included. <RegionL
The ocator> descriptor indicates the displayed position of the player in the image, and is obtained by the above method. The values enclosed by the <Position> descriptor in the <RegionLocator> descriptor are
Upper left X coordinate, Y coordinate, lower right X of the rectangle containing the players
Represents coordinates and Y coordinates. It should be noted that a rectangle including a player can be acquired by a method using image processing, but it cannot be obtained by a method using only a measuring instrument (position sensor / GPS). Therefore, when only the measuring device is used, the same value, that is, the coordinate position of one point is described in the upper left coordinate and the lower right coordinate. The video analysis unit 120 generates the above content information for each of all the videos input from the plurality of cameras. Further, since the content information is generated for each frame, the video and the content information have a one-to-one correspondence.

Next, the distribution video matching unit 130, the video information distribution unit 160 and the video output unit 220 of the video receiving device 20 will be described. The viewer is the video information distribution unit 1
Although the video transmitted to the video output unit 220 via 60 can be viewed, it is possible to notify the distribution video matching unit 130 of its own preference information. In the case of live sports, the center of the video is the athletes participating in the competition, and it is decided in advance which athlete will participate. Therefore, in the present embodiment, the target whose preference degree can be set is an athlete who participates in the competition.

When each content information is generated by the video analysis unit 120, the distribution video matching unit 130 stores the multi-view video and the content information of the live content in the content database 141 (S13). And
The distribution video matching unit 130 generates a preference value input dialog 146 using the template image, the name, and the uniform number used in the template matching method, stores the preference value input dialog 146 in the preference database 145, and then performs live or storage from the content database 141. The mode selection dialog 142 for selecting the mode is read and transmitted (S14). The user of the video receiving device 20 presses the switch button of the mode selection dialog 142 on the operation unit 21.
When one of the modes is designated by clicking with the mouse of 0 or the like (S15), the mode designation information indicating which mode is designated is transmitted from the video reception device 20 to the video distribution device 10 (S16).

When the mode designation information is transmitted, the distribution video matching unit 130 stores the content list 143 of the mode designated by the user in the content database 141.
Read out from the image and transmitted to the video receiver 20 (S
17) A switch (not shown) for switching and delivering the live content and the storage content stored in the video recording unit 140 is switched to the designated side.

The user of the video receiver 20 operates the operation unit 210.
When a desired content is clicked on the mouse or the like to specify the content, the content name designated by the user is transmitted from the video reception device 20 to the video distribution device 10 (S18).

When the content is designated, the distribution video matching unit 130 reads a table for setting the preference information about the designated content based on the content information, the preference value input dialog 146 from the preference database 145, and edit program etc. At the same time, the image is transmitted to the video receiver 20 (S19). The preference value input dialog 146 is composed of, for example, an edit image and a script (name, uniform number, etc.), and is generated by the distribution image matching unit 130 based on the template image used in the template matching method, the name, uniform number, etc. It is stored in the preference database 145 of the video recording unit 140. The transmission of the preference value input dialog 146 may be performed while the live content is being relayed, but it is preferable that the transmission is performed before the relay is started. The reason for this is, for example, the preference history table 147 until the latest preference information is acquired.
This is because there is only a way to select an image based on the preference history acquired for the same card that was previously performed and stored in, so that it is better to select the image with the latest preference as soon as possible.

FIG. 6 shows G of the preference value input dialog 146.
An example of a UI interface is shown. The interface shown in FIG. 6 is the "face image", "name", "back number" of the participating player, and "edit box" for inputting the degree of preference.
(Spin box). The viewer uses the remote controller of the operation unit 210 or a device such as a keyboard to position the cursor on the edit box position of the player whose preference level is to be determined and input the preference level.
Alternatively, it is also possible to place the cursor on the up and down arrow icons next to the edit box and click to raise or lower the preference value to determine it. In this embodiment,
The degree of preference is “0”, the lowest, and the degree of preference “100” is the highest. Although the above method is a method using absolute evaluation, it may be a method of relative evaluation such as ordering the participating players. The preference information acquired by the above method is transmitted to the video distribution device 10 (S2).
0). FIG. 7 shows an example of preference information. As shown in the figure, the preference information is described using a description format of multimedia content such as MPEG-7 as with the content information, and a descriptor <ID> for identifying each player and this description Some children have a descriptor <IDNa that identifies the player's name.
me> and a descriptor <Preferer that identifies the degree of preference
ce> and are included. This preference information is notified to the delivery video matching unit 130 via the video information delivery unit 160 and updated and stored in the preference history table 147 (S).
21).

When the preference information is acquired, the distribution video matching unit 130, based on the plurality of videos to which the content information generated by the video analysis unit 120 is added, and the preference information and its history notified by the viewer. A matching process is executed to determine which video should be delivered to the viewer (S22). Hereinafter, the matching process will be specifically described by two methods (a method of determining an object having the highest degree of preference and a method of comprehensively determining the degree of preference).

1. Method of deciding using object having the highest degree of preference When distributing the video in which the player having the highest degree of preference is displayed, for example, follow the procedure of the flowchart shown in FIG.

(1) The preference information notified by the viewer is analyzed, and the player with the highest degree of preference (hereinafter, also referred to as distribution target player) is determined (S2201).

(2) The content information transmitted from the video analysis means is analyzed to determine the number of videos showing the distribution target player (S2202). Among the videos from a plurality of viewpoints, the video in which the distribution target player determined in (1) is displayed is a distribution video candidate. When the number of videos displayed by the distribution target player is limited to one, the video from the camera is determined (S2203), and this video is distributed to the viewer.

(3) When a player to be distributed is displayed in a plurality of videos, the video considered to be the most suitable is distributed from those videos, but the determination method is not particularly limited. For example, <RegionLocator of content information
When the rectangle information is acquired by the descriptor (Descriptor) of> (Yes in S2204), the area of the rectangle including the distribution target player is calculated, and the image having the largest area is determined (S2205). ), This video is the distribution video.

If the rectangle information is not acquired (No in S2204), the displayed position of the player to be distributed is acquired, and the one closest to the center of the screen is set as the distribution image (S2206). Can be considered. When the number of videos showing the distribution target player is “0”, the next player is determined and the next player is selected in step S2.
The distribution video may be determined by executing the processes of 202 to S2206 (S2207).

2. Method of comprehensively determining from individual preference level When comprehensively determining the distribution video based on the individual preference level of each player, for example, the procedure of the flowchart shown in FIG. 9 is followed.

(1) It is determined whether or not rectangular information has been acquired from the <RegionLocator> descriptor (Descriptor) of the content information for the images from all cameras (S2211). If the rectangle information has been acquired (Yes in S2211), the area of the rectangle including each player is calculated (S2212). When rectangle information is not acquired (No in S2211),
A function that takes a maximum value at the center of the screen and a minimum value at the edge of the screen (for example, f (x, y) = sin (π * x / (2 * x_
mid)) * sin (π * y / (2 * y_mid)) satisfies the above condition. However, x and y are pixel positions, and x_
mid and y_mid are coordinates of the center of the screen, and * indicates a product. ) Is defined and the position of each player is input to obtain the value of the function (S2215).

(2) The product of the value obtained in (1) and the degree of preference of the corresponding player is calculated, and the sum of the values of the players displayed on the screen is calculated to obtain the objective function of the image. The value is set (S2213, S2216).

(3) The video from the viewpoint having the maximum value of (2) is determined as the distribution video (S2214, S221).
7).

Here, if the above processing is performed for each frame, the video may be switched one after another. Therefore, the distribution video matching unit 130 applies the above method every several frames to the viewer. Determine the video to be distributed to.

When the distribution video is determined as described above, the distribution video matching unit 130 streams the determined video (S23 in FIG. 2). Then, the video output unit 220 of the video reception device 20 reproduces the video delivered via the transmission / reception unit 230 on the screen (S24 of FIG. 2).

As described above, according to the video distribution system 1 according to the first embodiment, the video distribution apparatus 10 selects the video that matches the taste of each user from the multi-view video every several frames. Delivered to the receiving device 20,
This is reproduced in the video output unit 220 of the video receiving device 20.

Subsequently, the viewer can obtain the additional information by working on the delivered video (steps S25 to S29 in FIG. 2).
Hereinafter, for example, a method of acquiring additional information by using a pointing device such as a mouse of the operation unit 210 will be described.

For example, in the case where two players A and B are included in the video as shown in FIG. 4, for example, when the user wants to obtain additional information of the player B (Niyamoto) on the right side, the user Place the cursor of the pointing device on the target B and click (S2 in FIG. 2).
5). When clicked, the position information on the screen is notified to the distribution video matching unit 130 via the video information distribution unit 160 of the video distribution device 10 (S26 in FIG. 2).
Then, the delivery video matching unit 130 identifies which target has been selected from the content information attached to the delivery video, and notifies the additional information providing unit 150 of the result (S27 of FIG. 2). For example, when the image on the right side is clicked when the image shown in FIG. 4 is displayed, the delivery video matching unit 130 notifies only Niyamoto based on the content information shown in FIG. . The additional information providing unit 150 determines N which is the selected target.
Additional information about iyamato is attached information table 1
51, the additional information is read from the distribution video matching unit 1
30 and the video information distribution unit 160 to the video output unit 220 of the video reception device 20 (S2 of FIG. 2).
8). As shown in FIG. 10, this additional information is described in the descriptor according to the MPEG7, and the descriptor <ID> for identifying each player and the player's name are identified in this descriptor. Descriptor <IDName>, descriptor <DateOfBirth> that represents the date of birth, descriptor <Carer> that represents the main career, descriptor <SpecialAbility> that represents the characteristics, and descriptor <that represents the player's comment Comment> is included.

When the information related to the selected object is not recorded, a message notifying that the information does not exist is transmitted. Finally, the video output unit 220
Reproduces the additional information distributed via the transmitting / receiving unit 230 on the screen (S29 of FIG. 2).

As described above, according to the video distribution system 1 according to the first embodiment, not only the viewer can view the video that matches his or her taste, but also the video taken from a plurality of viewpoints. Further, by acting on the distributed video, it becomes possible to acquire information (additional information) related to the object of interest.

(Second Embodiment) Next, a video distribution system according to a second embodiment of the present invention will be described with reference to the drawings. It should be noted that, also in the second embodiment, as an image capturing target in a limited space, an image centering on a player in the case of sports relay such as soccer will be described as an example.
The present invention can be applied to any photographing space and subject.

FIG. 11 is a block diagram showing a functional configuration of the video distribution system 2 according to the second embodiment of the present invention. The same numbers are assigned to the functional configurations corresponding to those of the video distribution system 1 of the first embodiment, and detailed description thereof will be omitted. The video distribution system 2 includes a video distribution device 40.
The video distribution system 1 according to the first embodiment in that it is a system configured to include a video reception device 50 and a communication network 30 that connects them, and reproduces a video that matches a user's preference from multi-view video. However, in the first embodiment, the video distribution apparatus 10 determines the content such as the video according to the taste of the user and stream-distributes it, whereas in the video distribution system 2, the video distribution apparatus 4
In 0, all contents (all contents that may be selected) of multi-view video are streamed in advance, and the video receiving device 50 selects and determines the video or the like according to the taste of the user and reproduces it. It is different in that it is set.

Video distribution device 4 of this video distribution system 2
0 represents the video content of a plurality of videos (multi-view video) to which the content information and the additional information are added, and the like.
Is a distribution server including a computer and the like for stream distribution to a video, and includes a video acquisition unit 110 and a video analysis unit 12.
0, an additional information providing unit 410, a video recording unit 420,
A video multiplexing unit 430 and a multiplexed video information distribution unit 440 are provided.

The additional information providing unit 410 includes the video analysis unit 12
0, the content information generated by 0 is searched, the additional information of the subject (object) included in the content information is generated based on the attached information table 151, or the image to which the content information and the added information are attached is recorded on the image recording unit. The content is stored in the content database 421 of 420, or the preference value input dialog 146 is generated and stored in the preference database 145.

The video recording section 420 has an input side connected to the additional information providing section 410 and an output side connected to the video multiplexing section 4.
The content database 421 and the preference database 145 are internally provided. The content database 421 stores the video content 424 itself to which the content information and the additional information are added. The preference history table 147 has been deleted from the preference database 145. This is the video receiver 50
In, in order to select the video according to the taste of the user,
This is because the video distribution device 40 does not need to hold the preference history table 147.

The video multiplexing unit 430 includes the additional information providing unit 4
Live multi-view video with content information and additional information output from the content database 42.
The video content 424 of the storage stored in No. 1 is selected according to the user's mode designation, the video, the content information, and the additional information are multiplexed for each camera, and the information is further multiplexed to obtain one. A bitstream is generated (see FIG. 13). Also, the video multiplexing unit 4
30 indicates the preference value input dialogue 146 by the video receiving device 5
Streamed to 0.

The multiplexed video information distribution unit 440 is a bidirectional communication interface or driver software for communicating with the video receiving device 50 via the communication network 30.

The video receiving device 50 interacts with the user regarding live or storage mode selection, input of preference values, and the like, and separates the video streamed from the video delivery device 40 from the content information and the additional information. Or, a video content that is edited by switching and selecting one video that matches the user's preference or preference history from several videos (multi-view video) every few frames is constructed in real time, and Personal computer to present,
A mobile phone, a personal digital assistant, a digital broadcasting TV, etc., including an operation unit 210, a video output unit 220, and a transmission / reception unit 2.
30, the display image matching unit 510, and the image recording unit 5
And 20.

The display video matching unit 510 separates the video, content information and additional information stream-distributed from the video distribution device 40 for each camera (see FIG. 13).
These are stored in the video recording unit 520, the preference value input dialog 146 distributed from the video distribution device 40 is stored in the video recording unit 520, and the user's preference and the like sent from the operation unit 210 and the video distribution. The content information of each image sent from the device 40 is compared, and the user's preference or preference history is matched from among a plurality of images (multi-view images) 1
Video content is edited in real time by switching and selecting one video every several frames.

The video recording unit 520 has a content database 521 for holding live or storage contents distributed from the video distribution device 40, and a preference database 52 for acquiring the preference for each user.
5 is a hard disk or the like that holds The content database 521 stores the content list 523 of the stored storage content and the content 524 itself. Further, the preference database 525 stores a preference value input dialog 146 for each content sent from the video distribution device 40 and a preference history table 147 storing the preference history input by the user.

The operation of the video distribution system 2 of the present embodiment configured as described above will be described in order along the sequence shown in FIG. 12 (main processing flow of this system). Note that the sequence of this figure also shows the flow of multi-view video at a certain point in time,
Regarding the processing corresponding to the sequence of the first embodiment,
Detailed description is omitted.

When the acquisition of a plurality of videos (multi-view videos) by the video acquisition unit 110 is completed (S11), the video analysis unit 12
0 analyzes the multi-view video and generates content information for each video, and the additional information providing unit 410 searches the content information and generates additional information of the subject (object) included in the content information (S32). For example, when two persons A and B are shown in the video, the additional information of the two persons A and B is generated. When the generation of the additional information is completed, the additional information providing unit 410 displays the video to which the content information and the additional information are added in the video recording unit 42.
0 in the content database 421 (S3
3). Then, as in the case of the first embodiment, transmission of a mode selection dialog (S14), mode designation in the video reception device 50 (S15), transmission of mode designation information (S16), transmission of content list information (S17). , And transmission of content designation (S18) is sequentially performed.

When the content is designated, the video multiplexing unit 430 determines the multi-view video (plural videos) of the designated live or storage content, the content information for each video, and the additional information for each video. Are transmitted after being multiplexed (S39), the preference value input dialog 146 of this content is transmitted.

The display video matching unit 510 separates the multi-view video transmitted from the video distribution device 40, the content information for each video, and the additional information for each video for each camera and stores them in the content database 521. (S4
0), and further stores the preference value input dialog 146 in the preference database 525. Next, the display image matching unit 510 reads the preference value input dialog 146 from the preference database 525, sends it to the image output unit 220 to display it (S41), and stores the preference information input by the user in the preference history table 147 (S42). ), The preference information and the content information are compared with each other, and an image of one viewpoint that matches the user's preference is determined from the multi-view images (S43). The method of determining the video is the same as in the first embodiment. Then, the display image matching unit 510 sends the determined image to the image output unit 220 and reproduces it on the screen (S44).

As described above, according to the video delivery system 2 according to the second embodiment, the video delivery apparatus 40 transmits a plurality of videos (multi-viewpoint videos) to the video reception apparatus 50, and the video reception apparatus 50 uses the video reception apparatus 50. One video that matches the user's preference is selected and determined for every several frames from the multi-view video, and is reproduced.

Subsequently, the user can obtain additional information by working on the delivered image (steps S45 to S4 in FIG. 12).
7). For example, in the state where the video that matches the user's taste is reproduced and the target for which the additional information is to be acquired is displayed in the distributed video, the target displayed by the user on the screen of the cursor of the pointing device of the operation unit 210. When it is clicked on the screen, the display image matching unit 510 is notified of the position information on the screen (S45). Then, the display image matching unit 510,
Which target is selected is specified from the content information added to the video (S46), and only the specified additional information is sent to the video output unit 220 from the corresponding additional information.
For example, when the objects A and B shown in FIG. 4 are displayed and the position on the object B on the right side is clicked, the display image matching unit 510 first determines based on the content information shown in FIG. And specify Niyamoto. Then, the display image matching unit 510 reads only the additional information regarding Niyamato from the additional information regarding the two persons, and sends it to the image output unit 220. by this,
Only the additional information of the target to be acquired is displayed on the video output unit 220 (S47).

As described above, according to the multi-view video distribution system 2 according to the second embodiment, the viewer can only view the video that matches his or her preference from the videos shot from a plurality of viewpoints. Instead, by further acting on the distributed video, it becomes possible to obtain information (additional information) related to the object of interest.

By the way, in the content database 521 of the video recording unit 520, the contents in which all the multi-viewpoint videos sent from the video distribution device 40, the content information for each video, and the additional information for each video are all collected. 524 is stored. Therefore, it is not necessary to re-distribute this content from the video distribution device 40.
The video receiving device 50 can repeatedly reproduce.

Further, at the time of repeated reproduction, the display video matching unit 510 reads the preference value input dialog 146 from the preference database 525 of the video recording unit 520, and a plurality of preference information different from the previous time inputted by the user are used to output a plurality of preference information. A video that matches this preference can be reproduced from the video taken from the viewpoint, and in this case, the user views another edited video centered on a target (player) different from the previous time. be able to.

Although the video distribution system according to the present invention has been described above based on the embodiments, the present invention is not limited to the embodiments and the following modified examples are also applied.

In the above embodiment, the preference value input dialog 146 is displayed and the preference information of the viewer is acquired for each distribution of the video content, but the preference history is used instead of such timing. One image may be selected from the multi-view images. For example, the viewer's preference information or the like acquired in the past may be used as the video distribution device 40.
It is possible to save the trouble of acquiring the preference information from the viewer every time the video content is distributed, by storing the information in the above and referring to the information.

In the first embodiment, the additional information providing section 150 sends the additional information from the video distribution apparatus 10 to the video receiving apparatus 20 only when the position is designated in the video receiving apparatus 20. Alternatively, the additional information about the video to be distributed may be distributed together with the video content in advance without waiting for the designation of the viewer. As a result, the time from when the viewer gives an instruction to when the additional information is acquired is shortened, so that a video distribution system having a quick response can be realized.

Further, contrary to this, the second embodiment
In the above, the additional information providing unit 410 attaches the additional information for each of the multi-view images, but the additional information may be delivered only when the position is designated in the video receiving device 50. As a result, the communication load on the communication network 30 due to the distribution of the additional information of the video content which is unknown whether or not it will be finally selected is reduced.

In the above-described first and second embodiments, live broadcasting of soccer has been described as an example. However, live broadcasting of sports such as baseball played outdoors, live concerts held indoors, plays such as plays, etc. Of course, it can be applied to relay.

Further, in the first and second embodiments described above, in addition to the preference, only the size and position of each object in the image are the evaluation targets when the image is selected. May be added.

That is, in the case of live broadcasting indoors, by installing a motion capture system in this facility, it is possible to detect a violent movement such as an object (singer, etc.) running around on the stage. On the other hand, for example, on a live stage, an effect is performed in which a protagonist (a person who pays attention) is switched in real time while a plurality of subjects are mixed. In such a case, rather than looking at the person who is still, it is the viewer's desire to see the person (active person) who is making a violent movement that is running around on the stage at that time. It is psychological and matches the taste. Therefore, the image analysis unit 120 analyzes the amount of movement of the target displayed in the image obtained using the device of the motion capture system, and includes the amount of movement in the content information. This video may be selected as the degree of interest is high.

(Embodiment 3) FIG. 14 is a diagram showing a stage of a live concert of a certain group "Spade". As shown in the figure, a plurality of (four in the figure) cameras C1 to C4 are fixedly arranged around the stage, and members of spades (from the left in FIG. 14, Kogaki, Shimohara, Maei). , A bag) has a plurality of markers M attached thereto.

Each of the cameras C1 to C4 acquires an image of each color of R, G, B, and is provided with a light emitting section for emitting infrared light and a light receiving section for receiving the infrared light reflected by the marker M. The image is reflected by the marker for each frame and is configured to be captured by the light receiving unit. The marker image for each frame is sent to, for example, the image analysis unit 120 shown in FIG. 1 to analyze the amount of movement of the target.

FIG. 15 shows two marker images (P1, P
It is a figure which shows a mode that a motion amount is analyzed from 2). In addition,
Here, a case is shown in which the amount of movement is analyzed from two marker images in which only the member Shimohara shown in FIG. 14 is shown.

The video analysis unit 120 uses the two marker images P
The respective markers M corresponding to P1 and P2 are compared, and the movement amounts Δv1, Δv2 of the respective parts such as the shoulder, elbow, wrist, ..., Toes are compared.
Δv3, Δv4, ... Δv (n−1), and Δvn are measured. Then, when the measurement of each part is completed, the image analysis unit 120 calculates the sum of these measurement values, and the calculation result is the target displayed in the image at that time.
It is acquired as the movement amount of the singer, and the acquired movement amount is included in the content information. Note that the amount of movement may be calculated in the order of the arm, the wrist, and the like, with the waist, the shoulder, and the like as references. Alternatively, the marker images M obtained from a plurality of viewpoints may be combined to measure a three-dimensional motion vector. In this case, 1
Even when the markers are overlapped in one marker image M, the markers can be discriminated from each other, the situation of incorrect calculation of the motion amount can be avoided, and a highly accurate motion amount can be obtained.

FIG. 16 is a diagram showing an example of content information generated by the video analysis unit 120. In this example, <R
The position having the displayed size of the singer in the image <Posit> in the positionLocator> descriptor
ion> and the position of a point having no size acquired by a measuring device (position sensor / GPS) or the like <Loca
is also described, so that the size of the target on the screen and the position such as the center can be evaluated in object units. further,
In this content information, the <motion> descriptor can be used to evaluate the motion amount in object units.

In this way, when the content information is configured to include not only the size and position of the object but also the amount of movement, the degree of preference of each singer, the size, position, movement of the target on the screen, etc. On the basis of the above, when individual objects are evaluated for each object and the distribution image is decided by making a comprehensive judgment, for example, the procedure of the flowchart shown in FIG. 17 is followed.

First, the distribution video matching unit 130 sets the content information <Reg regarding the video from all the cameras.
IonLocator> descriptor (Descripto
The area of the rectangle including the individual objects and singers is calculated by referring to the rectangle information in r) (S2221). When the calculation of the rectangular area is completed, the distribution video matching unit 130
A function that takes a maximum value at the center of the screen and a minimum value at the edge of the screen (for example, f (x, y) = sin (π * x / (2 * x_
mid)) * sin (π * y / (2 * y_mid)) is used to calculate the value of the function relating to the position of each singer (S2222). When the calculation of the value of the function value is completed, the distribution video matching unit 130 refers to the <motion> descriptor of the content information regarding the videos from all the cameras,
The amount of movement is read (S2223).

When the calculation of the area, the calculation of the function value, and the reading of the motion amount are completed, the distribution video matching unit 130 calculates the product of the area and the preference of the corresponding singer for the videos from all the cameras, Furthermore, the sum of the values of the singer displayed on the screen is calculated, the product of the position and the preference of the singer corresponding to this position is calculated, and the sum of the values of the singer displayed on the screen is calculated. Further, the value of the objective function is obtained by calculating the sum of the values of the movement amount of the singer displayed on the screen (S2224). Then, when the value of the objective function is obtained for the images from all the cameras, the image from the viewpoint with the maximum value of the objective function is determined as the distribution image (S2225).

In this way, when the motion amount is included in the evaluation value, the images of the singer who has a lot of motions that are more active than still are highly evaluated, and the number of highly evaluated images is high. It is supposed to be selected for each frame. As a result, in the video distribution device 10, a video that matches the taste of each user is distributed from the multi-view video.

[0097]

As is apparent from the above description, the video distribution apparatus according to the present invention is a video distribution apparatus that communicates with a video reception apparatus via a communication network, and acquires a plurality of videos from different viewpoints. A video acquisition unit for analyzing the content included in the video for each of the videos and generating an analysis result as content information; the content information; and preference information notified by the viewer. And a distribution video matching unit that determines the compatibility, determines the video to be distributed, and distributes the determined video. That is, it is determined by the degree of conformity between the content information generated for each video from a plurality of videos from different viewpoints and the viewer's preference information, and one video that matches the viewer's preference is selected. Deliver to the receiving device.

As a result, the viewer can selectively view the video that matches his or her taste. Therefore, it is possible to satisfy the viewer's request regarding the selection of the video. Moreover, the real-time video can be targeted for distribution by repeatedly performing the processing by the video acquisition means, the video analysis means, and the distribution video matching means at high speed.

Here, the content information may include information for identifying the subject and information indicating the display position or display area of the subject. Alternatively, the container for obtaining the preference information may be distributed to the video receiving device side, and the preference information may be acquired by inputting the degree of the preference for the subject into the container. Further, when the viewer specifies a position on the screen for the distributed video, the subject at that position may be specified and additional information regarding this subject may be transmitted.

Furthermore, the present invention is a video distribution device which communicates with a video reception device via a communication network, and video acquisition means for acquiring a plurality of videos from different viewpoints.
For each of the videos, there is provided video analysis means for analyzing the content included in the video and generating an analysis result as content information, and video multiplexing means for multiplexing and delivering each video and each content information. It is also possible to provide a video distribution device characterized by. In this case, each content information distributed from the video distribution device on the video reception device side,
The degree of compatibility with the preference information notified by the viewer may be determined, one video to be reproduced may be determined from the plurality of videos distributed from the video distribution device, and the determined video may be reproduced. .

As a result, in the video receiving device which receives each video and each content information distributed from such a video distribution device, the matching degree between each content information and the preference information notified by the viewer is judged and reproduced. By determining the video to be played and reproducing the determined video, the viewer can selectively view the video that matches his or her taste.

The present invention can also be realized as a program that causes a computer to function as such a characteristic means, or as a recording medium recording the program. The program according to the present invention can be distributed via a communication network such as the Internet or a recording medium.

As described above, according to the present invention, a viewer can, for example, selectively watch a video in which a player he / she favors frequently appears in a sports watching program, and have a good time. be able to. Therefore,
The present invention dramatically improves the value of the service provided by the video distribution system, and its practical value is extremely high.

[Brief description of drawings]

FIG. 1 is a block diagram showing a functional configuration of a video distribution system 1 according to a first embodiment of the present invention.

FIG. 2 is a sequence diagram showing an operation of the video distribution system 1.

3 (a) is a perspective view showing a relationship between a position in a camera coordinate system used in Embodiment 1 of the present invention and a position on a projection surface, and FIG. 3 (b) is shown in FIG. ) Is viewed from above along the projection surface, and FIG.
It is the figure which looked at (a) from the side along the projection surface.

4 is a diagram showing an example of a video acquired by a video acquisition unit 110 shown in FIG.

5 is a diagram showing an example of content information generated by the video analysis unit 120 shown in FIG.

6 is a diagram showing an example of a preference value input dialog generated by a distribution image matching unit 130 shown in FIG.

7 is a diagram showing an example of preference information sent from the video reception device 20 shown in FIG.

FIG. 8 is a flowchart executed by the distribution video matching unit 130 when determining a video to be distributed using an object having the highest degree of preference.

FIG. 9 is a flowchart executed when the distribution video matching unit 130 comprehensively judges from individual preference levels and determines a video to be distributed.

10 is a diagram showing an example of additional information sent from an additional information providing unit 150 shown in FIG.

FIG. 11 is a block diagram showing a functional configuration of a video distribution system 2 according to Embodiment 2 of the present invention.

FIG. 12 is a sequence diagram showing an operation of the video distribution system 2.

FIG. 13 is a diagram showing an example of a method of multiplexing / separating a video, content information, and additional information.

FIG. 14 is a diagram showing a stage of a live concert of a certain group “Spade”.

FIG. 15 is a diagram showing how a motion amount is analyzed from two marker images (P1, P2).

16 is a diagram showing an example of content information generated by the video analysis unit 120. FIG.

FIG. 17 is a flowchart executed by the distribution video matching unit 130 when comprehensively judging from individual preference degrees and the like to determine a video to be distributed.

[Explanation of symbols]

1, 2 video distribution system 10,40 Video distribution device 20,50 Video receiver 30 communication network 110 Video acquisition unit 120 Video analysis unit 130 Distribution video matching unit 140, 420, 520 Video recording unit 141,421,521 Content Database 144,424,524 contents 145,525 Preference database 146 Preference value input dialog 147 Preference history table 150,410 Additional information provision section 210 Operation unit 220 Video output section 230 Transmitter / receiver 430 Video Multiplexing Unit 440 Multiplexed video information distribution unit 510 Display image matching unit

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Toshinori Hijiri             1006 Kadoma, Kadoma-shi, Osaka Matsushita Electric             Sangyo Co., Ltd. (72) Inventor Yoshiyuki Mochizuki             1006 Kadoma, Kadoma-shi, Osaka Matsushita Electric             Sangyo Co., Ltd. F term (reference) 5C025 AA09 AA30 BA25 CA09 CB10                       DA05                 5C061 BB05 CC01                 5C064 BA01 BB07 BC07 BC18 BC23                       BD02 BD03 BD08 BD13

Claims (36)

[Claims] 1. A video distribution device for distributing a video via a communication network, the video acquisition means acquiring a plurality of videos from different viewpoints, and analyzing the contents included in the video for each video. A video analysis means for generating an analysis result as content information, and based on the content information and the preference information notified by the viewer, determines the compatibility between the content of the video and the viewer's preference, and the compatibility. A video distribution apparatus comprising: a distribution video matching unit that determines a high video from the plurality of videos and distributes the video. 2. The preference information includes information indicating a viewer's preference for a subject, and the video analysis unit generates content information including information for identifying a subject displayed on a screen, and the distribution The video distribution device according to claim 1, wherein the video matching means distributes a video in which the subject having a high degree of preference is displayed. 3. The image analysis unit generates content information including information indicating a position or area on the screen where the subject is displayed, and the distribution image matching unit displays the subject having a high degree of preference. The video distribution apparatus according to claim 2, wherein the video to be distributed is determined based on the position or area on the screen. 4. The video distribution apparatus according to claim 3, wherein the distribution video matching means distributes a video image of the subject displayed in the center of the screen. 5. The video distribution apparatus according to claim 3, wherein the distribution video matching unit distributes a video in which the area of the subject displayed on the screen is larger. 6. The video analysis means describes the content information using a predetermined descriptor, and the delivery video matching means renders a video to be delivered based on the content information described in the descriptor. The video distribution apparatus according to claim 1, wherein the video distribution apparatus determines. 7. The video distribution device further comprises a measuring means for measuring a state of a subject included in the video, and the video analyzing means generates the content information based on a measurement result of the measuring means. The video distribution device according to claim 1, wherein 8. The preference information includes a descriptor that identifies the subject and a descriptor that quantifies and represents a preference degree of a viewer for each subject, and the video analysis unit measures by the measurement unit. Based on the result, content information including information indicating whether or not a specific subject is displayed on the screen is generated, and the distribution video matching unit displays the subject having a high degree of preference based on the preference information. The video distribution device according to claim 7, wherein the video is distributed. 9. The image analysis unit generates content information including information indicating a position or area on a screen where a specific subject having a high degree of preference is displayed, based on a measurement result of the measurement unit, 9. The video according to claim 8, wherein the distribution video matching unit distributes a video in which the subject having a high degree of preference is displayed more in the center of the screen based on the content information and the preference information. Delivery device. 10. The video analysis unit generates the content information for each frame of the video, and the distribution video matching unit distributes the content information based on the content information generated immediately before the predetermined interval. The video distribution device according to claim 1, wherein the video to be determined is determined. 11. The preference information includes information indicating a viewer's preference degree for each of the plurality of subjects, and the video analysis unit includes content information including information for identifying each of the plurality of subjects displayed on a screen. 2. The video distribution apparatus according to claim 1, wherein the distribution video matching unit distributes a video in which the subject having a high degree of preference is displayed from the plurality of subjects. 12. The image analysis unit generates content information including information indicating the amount of movement of each of the plurality of subjects, and the distribution image matching unit includes the preference degree and the The video distribution device according to claim 11, wherein a subject having the largest function value for evaluating both the amount of motion is identified, and a video in which the identified subject is displayed is distributed. 13. The video analysis unit repeats generating the content information based on a plurality of videos acquired by the video acquisition unit at regular time intervals, and the distribution video matching unit is configured to perform the constant time. At intervals,
13. The video distribution apparatus according to claim 12, wherein selecting one video from the plurality of videos and distributing the video is repeated based on the content information generated by the video analysis unit. 14. The video analysis means generates content information including information indicating the amount of movement of each of the plurality of subjects, and the delivery video matching means has the highest degree of preference among the plurality of videos. The number of images in which the subject is displayed is measured, and when the number is 0, the image in which the subject having the next highest degree of preference is displayed is distributed. When the number is 1, the image is displayed. 12. When the number is 2 or more, the image determined based on at least one of the display position, the display area, and the movement amount of the subject on the screen is delivered. The described video distribution device. 15. The video delivery device further comprises additional information storage means for storing in advance additional information corresponding to each of the plurality of videos, and the delivery video matching means selects from among the plurality of videos. The video distribution device according to claim 1, wherein the additional information corresponding to the selected and determined video is read from the additional information storage means and distributed together with the video. 16. A video distribution device for distributing a video via a communication network, the video acquisition means for acquiring a plurality of videos from different viewpoints, and analyzing the contents contained in the video for each video. A video distribution device comprising: a video analysis unit that generates an analysis result as content information; and a video multiplexing unit that multiplexes and distributes each video and each content information for the plurality of videos. 17. The image analysis means generates the content information including information for identifying a subject included in the image and information indicating whether or not the subject is displayed on the screen, 17. The video distribution device according to claim 16, wherein the video multiplexing means multiplexes the content information into each video and distributes it. 18. The video distribution device according to claim 17, wherein the video analysis unit generates the content information including information indicating a position or an area on the screen where the subject is displayed. 19. The video distribution device according to claim 16, wherein the video analysis unit describes the content information using a predetermined descriptor. 20. The video analysis means further comprises a measurement means for measuring a state of the subject included in the video, and the video analysis means generates the content information based on a measurement result of the measurement means. 16. The method according to claim 16, wherein
The described video distribution device. 21. The video analysis means generates the content information for each frame of the video, and the video multiplexing means multiplexes the content information into each frame of the video for distribution. Claim 1
6. The video distribution device according to 6. 22. A video receiving device for receiving a plurality of videos distributed from the video distribution device according to claim 16, wherein the preference information accepting means accepts input of preference information indicating a preference of a viewer with respect to a subject. Then, based on the received preference information and each content information described in claim 16, the matching degree between the content of the image and the viewer's preference is determined, so that the image having the high matching degree is selected from the received images. An image receiving apparatus comprising: a selection unit for selecting and a display unit for displaying the selected image. 23. A video receiving device for receiving a plurality of videos distributed from the video distribution device according to claim 18, wherein the preference information receiving means receives an input of preference information indicating a preference of a viewer with respect to a subject. The selection means for selecting the image displayed in the center of the screen from the plurality of images by the subject having a high degree of preference based on the content information according to claim 18 and the preference information. And a display unit for displaying the image. 24. A video receiving device for receiving a plurality of videos distributed from the video distribution device according to claim 18, wherein the preference information receiving means receives an input of preference information indicating a preference of a viewer with respect to a subject. 19. Selection means for selecting, from the plurality of videos, an image in which the subject having a high degree of preference is displayed in a larger size on the screen based on each content information according to claim 18 and the preference information. An image receiving apparatus comprising: a display unit for displaying an image. 25. A video receiving device for receiving a plurality of videos distributed from the video distribution device according to claim 21, wherein the preference information receiving means receives an input of preference information indicating a preference of a viewer with respect to a subject. Then, at a predetermined interval, the degree of conformity between each of the content information generated immediately before that and the preference information that has been input is determined, and an image to be displayed is selected from the received images. An image receiving apparatus comprising: a selection unit and a display unit that displays the selected image. 26. A video distribution method for distributing a video via a communication network, comprising: a video acquisition step of acquiring a plurality of videos from different viewpoints; and analyzing contents included in the video for each video. A video analysis step of generating an analysis result as content information, and based on the content information and the preference information notified by the viewer, determine the compatibility between the video content and the viewer's preference, and determine the compatibility. And a distribution video matching step of determining and distributing a high video from the plurality of videos. 27. A video distribution method for distributing a video via a communication network, comprising: a video acquisition step of acquiring a plurality of videos from different viewpoints; and analyzing contents included in the video for each video. A video distribution method comprising: a video analysis step of generating an analysis result as content information; and a video multiplexing step of multiplexing and distributing each video and each content information for the plurality of videos. 28. A video receiving method for receiving a plurality of videos distributed from the video distribution apparatus according to claim 16, wherein a preference information receiving step of receiving input of preference information indicating a degree of preference of a viewer for a subject. Then, based on the received preference information and each content information described in claim 16, the matching degree between the content of the image and the viewer's preference is determined, so that the image having the high matching degree is selected from the received images. A video receiving method comprising: a selection step of selecting and a display step of displaying the selected video. 29. A program used in a video distribution device for distributing a video via a communication network, the program causing a computer to execute the steps according to claim 26. 30. A video distribution system for distributing videos via a communication network, comprising a video distribution device and a video reception device, wherein the video distribution device acquires a plurality of videos from different viewpoints. An acquisition unit, for each of the videos, a video analysis unit that analyzes the content included in the video and generates an analysis result as content information, based on the content information and the preference information notified by the viewer, A distribution video matching unit that determines the compatibility between the content of the video and the taste of the viewer, determines a video with a high compatibility from the plurality of videos, and distributes the video; The distribution device includes a transmission unit that transmits the preference information, a reception unit that receives a video having a high degree of conformity distributed from the video distribution device, and a display unit that displays the received video. A video distribution system that features 31. A video distribution system for distributing videos via a communication network, comprising a video distribution device and a video reception device, wherein the video distribution device acquires a plurality of videos from different viewpoints. An acquisition unit, an image analysis unit that analyzes, for each of the images, the contents included in the image, and generates an analysis result as content information; A video multiplexing device for distributing, wherein the video receiving device receives the video and content information of a plurality of videos distributed from the video distribution device, and a preference indicating a viewer's preference for the subject. Based on the preference information receiving means for receiving the input of information, the received preference information and the content information received by the receiving means, the contents of the video and the viewer's An image characterized by comprising: a selection unit for selecting an image with a high degree of conformity from a plurality of received images by determining the degree of conformity with a taste; and a display unit for displaying the selected image. Delivery system. 32. The image analysis means generates content information including information for identifying each of a plurality of subjects displayed on the screen, and the preference information indicates a degree of preference of a viewer for each of the plurality of subjects. 32. The video distribution system according to claim 31, further comprising information, wherein the selection means selects a video in which the subject having a high degree of preference is displayed from the plurality of subjects. 33. The image analysis unit generates content information including information indicating a movement amount of each of the plurality of subjects, and the selection unit selects the preference degree and the movement amount from the plurality of subjects. 33. The video distribution system according to claim 32, characterized in that a subject having the largest function value for evaluating both of the above is identified, and a video in which the identified subject is displayed is selected. 34. The image analysis unit repeats generating the content information based on a plurality of images acquired by the image acquisition unit at a constant time interval, and the selection unit at the constant time interval. 34. The video distribution system according to claim 33, wherein selecting one video from the plurality of videos is repeated based on the content information generated by the video analysis means. 35. The image analysis unit generates content information including information indicating the amount of movement of each of the plurality of subjects, and the selection unit selects the subject having the highest degree of preference among the plurality of images. The number of displayed images is measured, and if the number is 0, the image showing the subject having the next highest degree of preference is distributed, and if the number is 1, the image is distributed. 33. If the number is 2 or more, the image determined based on at least one of the display position, the display area, and the amount of movement of the subject on the screen is selected. Video distribution system. 36. The video distribution device further comprises additional information storage means for storing in advance additional information corresponding to each of the plurality of videos, and the video multiplexing means corresponds to each of the plurality of videos. Read the additional information from the additional information storage means, multiplex and distribute with the video and the content information, the selection means, in addition to the selection of the video, also select the additional information corresponding to the video, 32. The video distribution system according to claim 31, wherein the display unit displays the additional information selected by the selection unit together with the video.