JP6551107B2 - Server apparatus, server program, terminal program, moving image transmission method, moving image display method, communication system - Google Patents

Description

  The present invention relates to a technical field such as a system for distributing data of a plurality of divided moving images obtained by dividing a moving image into a plurality of display areas through a network in response to a request from a client terminal.

  Conventionally, as disclosed in, for example, Patent Document 1, data of a plurality of divided moving images obtained by dividing a moving image that displays the entire shooting range into a plurality of display areas are received in fixed segment units (in response to requests from client terminals). 2. Description of the Related Art A system that distributes a moving image block (moving image data block) in time units to a client terminal via a network is known. That is, the moving image block is distributed every time a request is made from the client terminal.

Japanese Patent Laying-Open No. 2015-50572

  However, in the case of a moving image in which the viewing range (display range) fluctuates in a short time, such as sports, for example, delivering a moving image block of relatively long segment units (for example, 10 seconds) Since there may be moving image blocks that are displayed for only a few seconds, the amount of data transmission is wasted. On the other hand, if the segment unit is shortened, the waste of the data transmission amount is reduced, but the number of requests from the client terminal increases, so the load on the server or network that distributes the video block becomes larger than necessary. .

  The present invention has been made in view of the above points and the like, and is a server device, a server program, a terminal program, and a moving image transmission capable of transmitting divided moving image data for each more appropriate moving image block in segment units. A method, a moving image display method, and a communication system are provided.

  In order to solve the above-mentioned problem, the invention according to claim 1 is a segment in which data of a plurality of divided videos obtained by dividing a video into a plurality of display areas is a variable time unit according to a request from a terminal device. A server device that transmits to the terminal device for each unit video block, the segment unit corresponding to a display time of the divided video displayed on the terminal device, or a request for the divided video from the terminal device An acquisition unit for acquiring the segment unit according to the number, and transmission to the terminal device of data of the divided moving image requested by the terminal device for each segment moving image block acquired by the acquisition unit And means.

According to a second aspect of the present invention, in the server device according to the first aspect, the acquisition unit includes the plurality of divided moving images in which at least some display areas of the divided moving images are simultaneously displayed on the terminal device. A time proportional to the display time of the divided moving image including the display area having the largest display ratio or the second largest display area is acquired from the terminal device as the segment unit.

According to a third aspect of the present invention, in the server device according to the first aspect, the display range on the display screen in which at least a part of the display area of the divided moving image is simultaneously displayed on the terminal device is indicated for each specific time. Receiving means for receiving display range data from the terminal device, wherein the obtaining means calculates a display time of each of the divided videos based on the display range data received by the receiving means; Of the divided moving images, a time proportional to the display time of the divided moving images including the display area having the largest display ratio or the second largest display area is acquired as the segment unit.

  According to a fourth aspect of the present invention, in the server device according to any one of the first to third aspects, the acquisition unit calculates a cumulative value of a time during which at least a part of the display area of the divided video is displayed. The display time is acquired.

  The invention according to claim 5 is the server apparatus according to any one of claims 1 to 4, wherein the acquiring unit displays the display time of the divided moving image of the same content displayed on a plurality of the terminal devices. The present invention is characterized in that the segment units are acquired by aggregating each acquired and acquired display time.

  According to a sixth aspect of the present invention, in the server device according to the first aspect, the acquisition unit acquires the number of requests for the divided video from each of the plurality of terminal devices, and calculates the number of the acquired requests. The segment unit is obtained by aggregation.

  A seventh aspect of the present invention is the server device according to any one of the first to sixth aspects, wherein the segment unit obtained by acquiring the divided video data requested from the terminal device by the acquisition unit. Further comprising generating means for generating a plurality of moving picture blocks by dividing the terminal apparatus by the transmission means for each moving picture block generated by the generating means for the divided moving picture data requested from the terminal apparatus. It is characterized by transmitting to.

  The invention according to claim 8 is the server device according to any one of claims 1 to 6, wherein the divided moving image data having the same content is stored for each of a plurality of segment units having different time lengths. Data of the divided moving image corresponding to each of the segment units in the storage unit is composed of the moving image blocks divided in each of the segment units, and the transmitting unit is the terminal device The moving image block constituting the data of the divided moving image requested from the moving image, and the moving image block in the unit of segment acquired by the acquiring unit is acquired from the storage unit and transmitted to the terminal device .

  According to the ninth aspect of the present invention, the data of a plurality of divided videos obtained by dividing a video into a plurality of display areas is received for each video block in segment units, which are variable time units, in response to a request from a terminal device. In the computer included in the server device to be transmitted to the device, the segment unit according to the display time of the divided video displayed on the terminal device, or the segment according to the number of requests of the divided video from the terminal device Execute an acquiring step of acquiring a unit, and a transmitting step of transmitting data of the divided moving image requested from the terminal device to the terminal device for each moving image block of the segment unit acquired by the acquiring step It is characterized by

  The invention according to claim 10 is that the terminal device displays the data of a plurality of divided moving images obtained by dividing the moving image into a plurality of display areas on a terminal device that requests the server device according to a user operation. A calculation step for calculating the display time of the divided video, a determination unit for determining a segment unit that is a variable time unit and that corresponds to the display time calculated by the calculation step, and the determination step A notification step of notifying the server device of the segment unit determined by the step, and a receiving step of receiving the requested divided video data from the server device for each video block of the segment unit notified by the notification step; , Using the moving image block received by the receiving step Characterized in that to execute a display step of displaying the image, a.

According to an eleventh aspect of the present invention, in the terminal program according to the tenth aspect, in the calculation step, each of the plurality of divided moving images in which at least some display areas of the divided moving images are simultaneously displayed on the terminal device. The display time is calculated, and the determining step includes the divided moving image including the display region having the largest display ratio or the second largest display region among the plurality of divided moving images in which the at least some display regions are simultaneously displayed. And a time proportional to the display time of the specified divided moving image is determined as the segment unit.

  According to a twelfth aspect of the present invention, a plurality of divided moving image data obtained by dividing a moving image into a plurality of display areas is converted into the terminal for each segment moving image block that is a variable time unit in response to a request from a terminal device. A video transmission method executed by a computer that transmits to a device, wherein the segment unit according to a display time of the divided video displayed on the terminal device, or the number of requests for the divided video from the terminal device An acquiring step of acquiring the segment unit according to a transmitting step of transmitting data of the divided moving image requested from the terminal device to the terminal device for each moving image block of the segment unit acquired by the acquiring step; , And is characterized.

  The invention according to claim 13 is a moving image display method executed by a computer included in a terminal device that requests data of a plurality of divided moving images obtained by dividing a moving image into a plurality of display areas to a server device in accordance with a user operation. A calculation step of calculating a display time of the divided moving image displayed on the terminal device, a segment unit which is a variable time unit, and a segment unit corresponding to the display time calculated in the calculation step A determining step of determining, a notifying step of notifying the server unit of the segment unit determined by the determining step, data of the requested divided moving image for each segment moving image block notified of by the notifying step Receiving from the server device and receiving by the receiving step Characterized in that it comprises a display step of displaying the divided video with video blocks.

  According to the fourteenth aspect of the present invention, the server device converts a plurality of divided moving image data obtained by dividing the moving image into a plurality of display areas, in accordance with a request from the terminal device, a segment unit moving image block that is a variable time unit A communication system that transmits to the terminal device every time, wherein the terminal device is a calculation unit that calculates a display time of the divided video displayed on the terminal device, and a segment unit that is a variable time unit. A determination unit that determines a segment unit according to the display time calculated by the calculation unit; and a notification unit that notifies the server unit of the segment unit determined by the determination unit. Acquisition means for acquiring the segment unit notified from the terminal device, data of the divided moving image requested from the terminal device Transmitting means for transmitting to the terminal device every moving image block of the segment unit acquired by the acquiring means, the terminal device using the moving image block as the divided moving image data transmitted from the server device Receiving means for receiving each time, and display means for displaying the divided moving picture using the moving picture block received by the receiving means.

The invention according to claim 15 is the moving image block in segment units, which is a variable time unit, in response to a request from the terminal device, the server device divides data of a plurality of divided moving images obtained by dividing the moving image into a plurality of display areas. A communication system for transmitting to the terminal device every time, wherein the terminal device indicates a display range in a display range in which at least a part of the display area of the divided video is simultaneously displayed on the terminal device at specific time intervals. A first transmission means for transmitting display range data to the server device, the server device comprising: a first reception means for receiving the display range data transmitted from the terminal device; and the first reception means received by the first reception means based on the display range data, calculates the display time of each of the divided moving among the plurality of divided moving, the display ratio or the largest, large the second The divided moving the display time proportional to the time, including have the display area, an acquisition means for acquiring a segment unit which is a time unit of the variable, the data of the divided video requested from the terminal device, the obtaining unit And transmitting the divided moving image data transmitted from the server device to each of the moving image blocks. And a display unit for displaying the divided moving image using the moving image block received by the second receiving unit.

  According to the first, ninth, twelfth, fourteenth, and fifteenth aspects of the invention, it is possible to transmit the data of the divided moving image in a more appropriate segment unit, and as a result, while reducing waste of the data transmission amount, The load on the server apparatus and the network can be reduced.

  According to the second and eleventh aspects of the invention, since the display time of the divided moving image is calculated on the terminal device side, the load on the server device can be reduced.

  According to the invention described in claim 3, since the display time of the divided moving image is calculated on the server device side, the load on the terminal device can be reduced.

  According to the fourth aspect of the present invention, it is possible to reduce the processing load for calculating the display time of the divided moving image.

  According to the fifth and sixth aspects of the invention, when the number of viewers of the same moving image is large, the load on the server device can be reduced.

  According to the seventh aspect of the present invention, a moving image block can be generated more flexibly and transmitted.

  According to the eighth aspect of the present invention, it is possible to transmit the divided moving image data more quickly in units of segments while reducing the load on the server device.

  According to the invention described in claim 10, it is possible to receive the data of the divided moving image in a more appropriate segment unit. As a result, the load on the server device and the network is reduced while reducing waste of the data transmission amount. It can be reduced.

It is a figure showing an example of outline composition of distribution system S concerning this embodiment. 3 is a conceptual diagram illustrating an example of a moving image block generated by an encoding server 1. FIG. (A) is a diagram showing a moving image block Bn-m generated from one divided moving image DMn in variable segment units Tx along a reproduction time axis t. (B) is a diagram showing a moving image block Bn-m generated from a divided moving image DMn of the same content in units of three segments having mutually different time lengths along the reproduction time axis t. It is a conceptual diagram which shows an example of the display ratio and display time of each division | segmentation moving image DMn in a display range. It is a figure which shows an example of the content of camera work data. (A) is a flowchart which shows an example of the content reproduction process performed by the control part 31 of the client terminal 3a. (B) is a flowchart showing an example of a segment unit notification process executed by the control unit 31 of the client terminal 3a. (C) is a flowchart which shows an example of the camera work data transmission process performed by the control part 31 of the client terminal 3a. (A) is a flowchart illustrating an example of a segment unit acquisition process executed by the control unit 21 of the distribution server 2. (B) is a flowchart showing an example of the camera work data analysis process executed by the control unit 21 of the distribution server 2. (C) is a flowchart showing an example of the segment unit setting process executed by the control unit 11 of the encoding server 1. (A) is a flowchart showing an example of the content distribution process executed by the control unit 21 of the distribution server 2. FIG. 5B is a flowchart illustrating an example of an encoding process executed by the control unit 11 of the encoding server 1. (A) is a flowchart showing an example of segment unit acquisition / setting processing executed by the control unit 21 of the distribution server 2. (B) is a flowchart showing an example of camera work data analysis and segment unit setting processing executed by the control unit 21 of the distribution server 2. (C) is a flowchart showing an example of the content distribution process executed by the control unit 21 of the distribution server 2.

  Hereinafter, embodiments of the present invention will be described based on the drawings. The embodiment described below is an embodiment in which the present invention is applied to a distribution system.

[1. Configuration and Operation of Delivery System S]
First, with reference to FIG. 1, the structure and operation | movement outline | summary of the delivery system S concerning this embodiment are demonstrated. FIG. 1 is a diagram showing an example of a schematic configuration of a distribution system S according to the present embodiment. As shown in FIG. 1, the distribution system S includes an encoding server 1, a distribution server 2, a client terminal 3X (X = a, b, c...) And the like. The encoding server 1 and the distribution server 2 are an example of the server apparatus of the present invention. The distribution server 2 may have the function of the encoding server 1, and in this case, the encoding server 1 becomes unnecessary. The encoding server 1, the distribution server 2, and the client terminal 3X are connected to the network NW. The network NW is configured by, for example, the Internet or the like.

  The encoding server 1 acquires, from an external device, moving image data shot by a video camera (not shown) and audio data collected by a microphone (not shown) in synchronization with moving image shooting. For example, a video camera and a microphone are connected to the encoding server 1 via wired or wireless, and moving image data is acquired from the video camera and audio data is acquired from the microphone. In this embodiment, taking a moving image shot by a video camera as an example, a moving image that displays the entire shooting range is referred to as an “overall moving image”. In addition, a moving image created by motion creation software such as CG or animation other than a moving image shot by a video camera may be used as the entire moving image. A moving image obtained by combining moving images shot by each of a plurality of video cameras may be used as the entire moving image.

  The encoding server 1 is a segment unit which will describe at least one divided moving image DMn among a plurality of divided moving images DMn (n = 1, 2, 3...) Obtained by dividing the entire moving image M into a plurality of display areas. A plurality of moving image blocks Bn-m (m = 1, 2, 3...) Are generated by encoding while dividing by Tx. Note that the encoding server 1 divides the divided moving image DMn (n = 1, 2, 3...) Into segment units Tx, thereby dividing the plurality of moving image blocks Bn-m (m = 1, 2, 3...) May be generated, and the video block Bn-m generated thereafter may be encoded. Here, the segment unit Tx is a variable time unit that changes according to the display time of the divided moving image DMn displayed on the client terminal 3X or the number of requests of the divided moving image DMn from the client terminal 3X (that is, the number of requests). It is. In addition, encoding generally refers to encoding data according to a predetermined rule, and may also include compressing data by a compression method such as MPEG. FIG. 2 is a conceptual diagram illustrating an example of a moving image block generated by the encoding server 1. Here, in the example of FIG. 2, the entire moving image M is divided into 4 × 4 divided moving images DMn (in this example, n = 1 to 16) and encoded in the segment unit Tx on the playback time axis t. A plurality of moving image blocks Bn-m are generated for each divided moving image DMn.

  The distribution server 2 acquires the segment unit Tx corresponding to the display time of the divided video DMn displayed on the client terminal 3X or the segment unit Tx corresponding to the number of requests for the divided video DMn from the client terminal 3X. Details of the method of acquiring the segment unit Tx will be described later. Further, the distribution server 2 transmits content including data of one or more divided moving images DMn to the client terminal 3X for each moving image block Bn-m of the segment unit Tx in response to a request from the client terminal 3X. That is, the distribution server 2 is a moving image block Bn-m of the divided moving image DMn requested from the client terminal 3X, and includes the moving image block Bn-m encoded in the segment unit Tx by the encoding server 1 through the network NW. To the client terminal 3X. The content is transmitted by streaming distribution via the network NW, for example.

  The client terminal 3X distributes only the moving image block Bn-m corresponding to the divided moving image DMn including the display area (at least a part of the display area) displayed in the display range on the display screen in the entire moving image M according to the user operation. Request to server 2 That is, the moving image block Bn-m corresponding to the divided moving image DMn which does not include the display area falling within the display range on the display screen in the entire moving image M is not requested. The client terminal 3X receives the content transmitted from the distribution server 2, decodes one or more video blocks Bn-m included in the received content, and reproduces the divided video DMn.

[2. Configuration and function of each device]
Next, the configuration of each device included in the distribution system S of the present embodiment will be described with reference to FIG. As shown in FIG. 1, the encoding server 1 includes a control unit 11, a storage unit 12, a communication unit 13, an interface unit 14, and the like. These components are connected to the bus 15. The interface unit 14 is connected to, for example, a video camera and a microphone. The communication unit 13 is connected to the network NW. The storage unit 12 includes, for example, a hard disk drive and stores an OS (Operating System), an encoding processing program, and the like. The encoding processing program is a program that causes the control unit 11 as a computer to execute encoding processing and the like. In addition, in the storage unit 12, data of the entire moving image M acquired from the external device, a plurality of divided moving images DMn obtained by dividing the entire moving image M into a plurality of display areas, and audio data correspond to each entire moving image M Attached and memorized. Note that the entire moving image M is assigned an entire moving image ID for identifying the entire moving image M. Further, each divided moving image DMn divided from the entire moving image M is provided with a divided moving image ID for identifying the divided moving image DMn in association with the entire moving image ID. In addition, a moving image block ID for identifying the moving image block Bn-m is assigned to the moving image block Bn-m generated from the divided moving image DMn in association with the divided moving image ID.

  The control unit 11 is configured by a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), and the like. The control unit 11 executes encoding processing according to the encoding processing program. In this encoding process, the control unit 11 generates a plurality of moving image blocks Bn-m by encoding the divided moving image DMn while dividing the divided moving image into segment units Tx. The segment unit Tx is set by a setting command from the distribution server 2, for example. Also, the moving image block Bn-m may be transmitted to the distribution server 2 in real time each time it is generated, or may be transmitted to the distribution server 2 collectively later.

  Next, as shown in FIG. 1, the distribution server 2 includes a control unit 21, a storage unit 22, a communication unit 23, and the like. These components are connected to the bus 24. The storage unit 22 is an example of a storage unit in the present invention. The communication unit 23 is connected to the network NW. The storage unit 22 includes, for example, a hard disk drive and stores an OS, a content distribution processing program, and the like. The content distribution processing program is a program that causes the control unit 21 to execute content distribution processing and the like. The content distribution processing program may be downloaded from a predetermined server, or may be stored and provided in a recording medium such as a CD or a DVD. In addition, the storage unit 22 stores, for example, content including the moving image block Bn-m encoded by the encoding server 1 and audio data. The control unit 21 includes a CPU, a ROM, a RAM, and the like. The control unit 21 functions as an acquisition unit, a generation unit, a transmission unit (second transmission unit), a reception unit (first reception unit), and the like according to the present invention, and executes content distribution processing according to the content distribution processing program. In this content distribution process, the control unit 21 transmits content including data of one or more divided videos DMn for each video block Bn-m of the segment unit Tx via the network NW in response to a request from the client terminal 3X. To the client terminal 3X.

  Specifically, when the control unit 21 receives a request for the divided moving image DMn from the client terminal 3X, the control unit 21 transmits an encoding instruction for the divided moving image DMn to the encoding server 1 via the network NW. Thus, the encoding server 1 divides and encodes the divided moving image DMn, which has been encoded by the distribution server 2, in units of segments Tx set according to the setting instruction from the distribution server 2, thereby encoding the moving image block Bn-. m is generated, and the content including the generated one or more moving image blocks Bn-m is transmitted to the distribution server 2 via the network NW. And the control part 21 receives the content transmitted from the encoding server 1, and transmits the received content to the client terminal 3X via the network NW. The segment unit Tx is appropriately updated according to the setting command from the distribution server 2. FIG. 3A is a diagram showing a moving image block Bn-m generated from one divided moving image DMn in variable segment units Tx along the reproduction time axis t. As shown in FIG. 3A, the segment unit Tx of the moving image block Bn-m changes as time passes. In particular, the segment unit Tx of the moving image blocks Bn-5 to Bn-7 is as short as 3 seconds, and this playback time zone is a time zone in which the display range varies greatly.

  Alternatively, the video block Bn-m generated from the divided video DMn having the same content in a plurality of segment units (fixed segment units) having different time lengths by the encoding server 1 before the request is received from the client terminal 3X. May be transmitted to the distribution server 2. In this case, data of the divided moving image DMn having the same content is stored in the storage unit 22 for each of a plurality of segment units having different time lengths. FIG. 3B shows a video block Bn-m generated from a divided video DMn having the same content in three segment units (20 seconds, 10 seconds, and 5 seconds) having different time lengths along the playback time axis t. FIG. In the example of FIG. 3B, the moving image block Bn-m generated from the divided moving image DMn having the same content every three segment units T1 to T3 is shown, but two or four or more segment units are shown. The moving image block Bn-m may be generated from the divided moving image DMn having the same content every time. In this case, for example, the control unit 21 sets the acquired segment unit Tx as described later, and then updates it every time the segment unit Tx is acquired. Then, when the control unit 21 receives the request for the divided moving image DMn from the client terminal 3X, the control unit 21 stores an example of the moving image block Bn-m (FIG. 3B) stored in units of a plurality of segments for the requested divided moving image DMn. Then, the moving picture block Bn-m corresponding to the set segment unit Tx is acquired from the storage unit 22 among the moving picture blocks Bn-m of 20s version, 10s version and 5s version, and the client terminal 3X is obtained. Send to Here, the moving image block Bn-m corresponding to the segment unit Tx means, for example, the moving image block Bn-m of the segment unit with the shortest time difference from the segment unit Tx. For example, when the segment unit Tx is 6 seconds, the 5-second version moving image block Bn-m shown in FIG. 3B corresponds.

  In the content distribution process described above, the control unit 21 acquires a segment unit Tx corresponding to the display time of the divided moving image DMn or a segment unit Tx corresponding to the number of requests of the divided moving image DMn. Here, first, an example of a method for obtaining the segment unit Tx according to the display time of the divided video DMn will be described in detail. In this case, the control unit 21 selects a divided video DMn including a display area having a relatively large display ratio among the plurality of divided videos DMn in which at least a part of the display area of the divided video DMn is simultaneously displayed on the client terminal 3X. A time proportional to the display time is acquired as a segment unit Tx. Here, the display ratio means the ratio of each divided moving image DMn to the display range on the display screen. That is, the display ratio indicates what percentage of the display range each divided moving image DMn is displayed. Further, it is preferable to set the display area having the largest display ratio as the display area having the largest display ratio, but it may be the display area having the second largest display ratio. The time proportional to the display time may be display time × one time, and in this case, display time = segment unit Tx.

  FIG. 4 is a conceptual diagram showing an example of display ratio and display time of each divided moving image DMn in the display range. FIG. 4A shows the display range Rt-1 at the time of t-1 seconds (t is an integer of 2 or more, for example), and at this time, the display ratio of the divided moving image DM6 is the largest, 90%. ing. Further, FIG. 4B shows the display range Rt at the time of t seconds, and at this time point, the display ratio of the divided moving images DM6 and DM10 is the largest at 80%. FIG. 4C shows the display range Rt + 1 at time t + 1 seconds, and at this time, the display ratio of the divided moving images DM6 and DM7 is the largest at 60%. FIG. 4D shows an average display ratio and display time in a time range of t-1 seconds to t + 1 seconds. In the example of FIG. 4D, the display time at each time point of t-1 sec to t + 1 sec is 1 sec, and the accumulated value is accumulated in the time range of t-1 sec to t + 1 sec. . For example, since the divided video DM2 is partially displayed at each time point of t-1 seconds and t + 1 seconds, the display time at the time point of t-1 seconds is 1 second, and Assuming that the display time is 1 second, an accumulated value (2 seconds) obtained by accumulating these is the display time of the divided moving image DM2 in the time range of t-1 seconds to t + 1 seconds.

  Note that the cumulative value may be reset at any point in time for the divided video DMn in which all the display areas are out of the display range at any point in time. In this case, the accumulated value before being reset is retained. Then, when the divided moving image DMn enters the display range again, accumulation of the display time is started, and the maximum accumulated value in the time range of t-1 seconds to t + 1 seconds is the display time of the divided moving image DMn. However, the display time calculation processing load can be reduced by using the cumulative value not reset as described above as the display time of the divided video DMn. Further, in the example of FIG. 4D, since the display ratio of the divided moving image DM6 is the largest, in the time range of t-1 seconds to t + 1 seconds, a time proportional to the display time of the divided moving image DM6 is segment unit Tx (In this example, the segment unit Tx = “display time of the divided video DM6”). In the example of FIG. 4, the display ratio of each divided video DMn is calculated at three time points, t-1 second time point, t second time point, and t + 1 second time point, and t-1 second to t + 1 second time. In the example shown, the cumulative value in the time range is calculated as the display time of the divided video DMn, but this time range can be set arbitrarily, and the number of points calculated in this time range can also be set arbitrarily It is possible.

  The calculation of the display time of each divided moving image DMn may be performed by the client terminal 3X or may be performed by the distribution server 2. When the display time of each divided moving image DMn is calculated by the client terminal 3X, the control unit 21 acquires segment units Tx corresponding to the display time calculated by the client terminal 3X from the client terminal 3X at predetermined time intervals. . In this case, a segment unit Tx corresponding to the display time of the divided moving image DMn displayed on one client terminal 3X is used to generate a moving image block Bn-m to be transmitted to the client terminal 3X. According to the configuration in which the display time of the divided moving image DMn is calculated on the client terminal 3X side, the load on the distribution server 2 can be reduced. As another example, the control unit 21 acquires the display time (may be in segment units) of the divided moving image DMn of the same content displayed in the plurality of client terminals 3X from the plurality of client terminals 3X, and acquires the display The segment unit Tx may be acquired by totaling time (may be segment unit). As a result, the segment unit Tx that is common among the plurality of client terminals 3X is used to generate the moving image block Bn-m to be transmitted to each client terminal 3X thereafter. Even when the number is large, the load on the distribution server 2 and the encoding server 1 can be reduced. Note that, in the above aggregation, for example, statistical processing of the acquired display time is performed. In the statistical processing, the control unit 21 calculates an average value or median value of a plurality of display times as the segment unit Tx. Alternatively, in the statistical processing, the control unit 21 classifies the plurality of display times into a plurality of clusters (for example, groups in which the display times close to each other are grouped) by clustering, and displays the display time in the cluster including the most display time. A segment unit Tx is calculated as an average value or a median value.

  On the other hand, when calculation of the display time of each divided video DMn is performed by the distribution server 2, the control unit 21 includes a plurality of divided videos DMn in which at least some display areas of the divided video DMn are simultaneously displayed on the client terminal 3X. Camerawork data (an example of display range data) indicating each display range for each specific time is received from the client terminal 3X. And the control part 21 calculates the display time of each division | segmentation video DMn by the method similar to the above by analyzing the received camera work data, and display ratio is relative among several division | segmentation video DMn. The time proportional to the display time of the divided moving image DMn including the extremely large display area is acquired as the segment unit Tx at predetermined time intervals. According to the configuration in which the display time of the divided moving image DMn is calculated on the distribution server 2 side, the load on the client terminal 3X can be reduced. Also in this case, the control unit 21 may acquire the segment unit Tx by aggregating a plurality of display times. That is, the control unit 21 receives the camera work data from each of the plurality of client terminals 3X, and based on the received camera work data, displays the same data displayed on the plurality of client terminals 3X in the same manner as described above. The display time of the divided moving image DMn of the content is acquired, and the plurality of acquired display times are totaled to acquire the segment unit Tx.

  It should be noted that instead of the configuration in which the time proportional to the display time of the divided moving image DMn including the display area having a relatively large display ratio is acquired as the segment unit Tx, at least a partial display area of the divided moving image DMn is simultaneously displayed Of the display times of each of the plurality of divided moving images DMn, a time proportional to a relatively long (for example, the longest) display time may be acquired as a segment unit Tx.

  Next, an example of a method for acquiring the segment unit Tx according to the number of requests for the divided video DMn will be described in detail. In this case, a correspondence table in which the number of requests per unit time is associated with the segment unit Tx is stored in advance in the storage unit 22. In this association table, for example, the segment unit Tx “20 seconds” is associated with the number of requests “0 to 5”, and the segment unit Tx “10 seconds” for the number of requests “6 to 10” Are associated with each other, and the segment unit Tx “5 seconds” is associated with the number of requests “11 to 15”, and the segment unit Tx “3 seconds” corresponds to the number of requests “16 to 20” It is attached. That is, the larger the number of requests per unit time, the shorter the segment unit Tx is associated with. This is because, as the number of requests per unit time increases, the frequency with which the divided moving image DMn displayed on the display screen in the client terminal 3X is switched is high, the purpose of reducing transmission of unnecessary data by shortening the segment unit Tx It is. Instead of the association table, a calculation formula for calculating the segment unit Tx from the number of requests per unit time may be stored in the storage unit 22 in advance.

  Each time the control unit 21 receives a request for a divided video DMn from the client terminal 3X, the control unit 21 stores the reception time of the request in time series. Then, the control unit 21 calculates the number of requests per unit time at predetermined time intervals from the stored reception time, and uses the segment unit Tx associated with the calculated number of requests using the association table or the formula. get. In this case, the segment unit Tx corresponding to the number of requests per unit time from one client terminal 3X is used to generate a moving image block Bn-m to be transmitted to the client terminal 3X. As another example, the control unit 21 obtains the number of requests (number of requests per unit time) of the divided video DMn from each of the plurality of client terminals 3X as described above, and totals the obtained number of requests for each segment. Get Tx. Thereby, since the segment unit Tx that is common among the plurality of client terminals 3X is used to generate the video block Bn-m to be transmitted to each client terminal 3X, for example, the number of viewers of the same entire video M is large. Even in this case, the load on the distribution server 2 and the encoding server 1 can be reduced. In the above aggregation, for example, statistical processing of the number of acquired requests is performed. In the statistical processing, the control unit 21 acquires the segment unit Tx associated with the average value or median value of the plurality of requests using the association table or the calculation formula. Alternatively, in the statistical processing, the control unit 21 classifies the number of requests into a plurality of clusters (for example, a group in which the number of requests having a close difference is collected) by clustering, and calculates the number of requests in the cluster including the largest number of requests. The segment unit Tx associated with the average value or the median value is acquired using a correspondence table or a calculation formula.

  Then, when acquiring the segment unit Tx as described above, the control unit 21 transmits a setting command indicating the acquired segment unit Tx to the encoding server 1 via the network NW. Thereby, the control unit 11 of the encoding server 1 sets the segment unit Tx indicated by the received setting command. Alternatively, when acquiring the segment unit Tx as described above, the control unit 21 sets the acquired segment unit Tx. When a different segment unit Tx is already set, it is changed and set to a new segment unit Tx.

  Next, as shown in FIG. 1, the client terminal 3X includes a control unit 31, a storage unit 32, a video RAM 33, a video processing unit 34, an audio processing unit 35, an operation processing unit 36, a communication unit 37, and the like. Be done. These components are connected to the bus 38. A display unit 34 a is connected to the video processing unit 34. A display screen is displayed on the display unit 34a. A speaker 35 a is connected to the sound processing unit 35. An operation unit 36 a that accepts user operations is connected to the operation processing unit 36. Examples of the operation unit 36a include a mouse, a keyboard, and a remote controller. In addition, the touch panel which combines the display part 34a and the operation part 36a may be applied. The communication unit 37 is connected to the network NW. The storage unit 32 includes, for example, a hard disk drive and stores an OS, a content reproduction processing program, and the like. The content reproduction processing program is a program that causes the control unit 31 to execute content reproduction processing. The control unit 31 includes a CPU, a ROM, a RAM, and the like. The control unit 31 functions as a calculation unit, a determination unit, a notification unit, a first transmission unit, a reception unit (second reception unit), a display unit, and the like according to the present invention in accordance with the content reproduction processing program. Run.

  In this content reproduction process, the control unit 31 specifies a display range to be displayed in the entire moving image M in response to a user operation, and requests a divided moving image DMn that includes at least a part of the display area in the specified display range. It transmits to the distribution server 2 via the network NW. Thereby, the content including the moving image block Bn-m transmitted from the distribution server 2 is received, and the received content is temporarily held, for example, in a buffer memory provided in the RAM. Then, the control unit 31 decodes the moving image block Bn-m held in the buffer memory, reproduces the divided moving image DMn, and outputs it to the video RAM 33. The video processing unit 34 displays a moving image that fits within the display range on the display screen among the divided moving images DMn written to the video RAM 33 according to the control signal from the control unit 31. When audio data is included in the content held in the buffer memory, the audio processing unit 35 generates an analog audio signal from the audio data according to the control signal from the control unit 31, and generates the generated analog audio signal. Is output to the speaker 35a.

  The display range displayed in the entire moving image M is specified as a shooting range of a virtual camera that operates by a pseudo camera work operation (an example of a user operation). By the operation of the pseudo camera work, the specified display range changes, and the moving image block Bn-m is requested to the distribution server 2 following this change. The operation of the pseudo camera work includes, for example, a pan operation to swing the virtual camera left and right, a tilt operation to swing the virtual camera up and down, and a zoom operation to change the angle of view of the virtual camera. Here, the virtual camera refers to a viewpoint virtually set for a moving image projected on a virtual screen in a two-dimensional plane or a three-dimensional virtual space. The pan and tilt operations are realized, for example, by a drag operation of the mouse by the user or a flick operation by a finger or a pen by the user. The zoom operation is realized by, for example, a pinch operation in which the user pinches the display screen with a button provided on an operation unit such as a mouse or with two user fingers.

  Further, as described above, when the display time of each divided moving image DMn is calculated by the client terminal 3X, the control unit 31 calculates the display time of the divided moving image DMn displayed on the display screen, and the calculated display A segment unit Tx corresponding to time is determined at predetermined time intervals. For example, the control unit 31 calculates the display time of each of a plurality of divided moving images DMn in which at least a partial display area of the divided moving image DMn is simultaneously displayed in the client terminal 3X. Then, the control unit 31 is a divided moving image including a display region having a relatively large display ratio calculated as described with reference to FIG. 4 among the plurality of divided moving images DMn in which at least a part of the display region is simultaneously displayed. The DMn is identified, and a time proportional to the display time of the identified divided moving image DMn is determined as the segment unit Tx. Note that a time proportional to a relatively long (for example, the longest) display time among display times of each of the plurality of divided moving pictures DMn in which at least a part of the display area of the divided moving picture DMn is simultaneously displayed is a segment unit Tx You may comprise so that it may determine. Then, the control unit 31 notifies the distribution server 2 of the determined segment unit Tx at predetermined time intervals. That is, the control unit 31 transmits information indicating the determined segment unit Tx to the distribution server 2 via the network NW. The control unit 31 receives the moving image block Bn-m generated according to the notified segment unit Tx from the distribution server 2, and displays the divided moving image DMn on the display screen using the received moving image block Bn-m.

  On the other hand, as described above, when the distribution server 2 calculates the display time of each divided moving image DMn, the control unit 31 specifies the display range to be displayed in the entire moving image M during reproduction of the divided moving image DMn. The camera work data shown at each time is recorded and transmitted to the distribution server 2 at predetermined time intervals. Here, the camerawork data is data indicating the display range for each specific time, for example, center coordinates (x, y) of the display range in the image frame of the entire moving image M (for example, the upper left end of the image frame is an origin Coordinates (x, y)), zoom magnification, and playback position (playback time from the beginning of the movie). FIG. 5 is a diagram illustrating an example of the contents of camera work data. According to such camera work data, the movement of the center point by the pseudo camera work operation and the change of the zoom magnification are stored in time series (that is, every specific time), so the distribution server 2 Since the central coordinates at a certain point in time and the zoom magnification can be obtained by analyzing the camerawork data, the display range on the client terminal 3X can be specified for each specific time. The camera work data includes, as data indicating the display range at specific time intervals, for example, a pan indicating the angle of the horizontal swing of the virtual camera, a tilt indicating the angle of the vertical swing of the virtual camera, You may comprise so that the zoom (zoom) which shows zoom magnification (display magnification) and the reproduction | regeneration position may be included.

[2. Operation of distribution system S]
Next, the details of the operation of the distribution system S will be described separately for the first and second embodiments. In the following description, among the client terminals 3X (X = a, b, c,...), The client terminal 3a will be described as an example.

Example 1
The first embodiment is an example in which a moving image block Bn-m is generated and distributed to the client terminal 3a in real time in response to a request for the divided moving image DMn from the client terminal 3a.

(Operation of Client Terminal 3a in Embodiment 1)
First, the operation of the client terminal 3a in the first embodiment will be described with reference to FIG. FIG. 6A is a flowchart illustrating an example of content reproduction processing executed by the control unit 31 of the client terminal 3a. FIG. 6B is a flowchart illustrating an example of the segment unit notification process executed by the control unit 31 of the client terminal 3a. FIG. 6C is a flowchart showing an example of the camera work data transmission process performed by the control unit 31 of the client terminal 3a. Note that the content reproduction process and the segment unit notification process (or camera work data transmission process) are executed asynchronously. The segment unit notification process is executed when the display time of each divided video DMn is calculated by the client terminal 3a. On the other hand, the camera work data transmission process is executed when the distribution server 2 calculates the display time of each divided moving image DMn.

  As a premise of the content reproduction processing shown in FIG. 6A, the client terminal 3a is assumed to display the content list acquired from the distribution server 2. The content list includes the title of the content that can be distributed from the distribution server 2, the representative image, the divided moving image ID, the entire moving image ID, and the like. Then, when the content to be reproduced is selected from the content list by the user operation, the content reproduction process shown in FIG. 6A is started. When the content reproduction process is started, the control unit 31 specifies a display range to be displayed in the entire moving image M corresponding to the selected content (step S1). In step S1 immediately after the start of the content reproduction process, for example, a default display range is specified. Next, the control unit 31 specifies the divided moving image DMn in which at least a part of the display area is included in the display range specified in Step S1 (Step S2). For example, when the display range Rn shown in FIG. 4B is specified in step S1, the divided moving images DM6, DM7, DM10, and DM11 are specified in step S2.

  Next, the control unit 31 transmits the request for the divided moving image DMn identified in step S2 to the distribution server 2 via the network NW (step S3). Note that the request for the divided moving image DMn includes the divided moving image ID of the divided moving image DMn to be a request target. Next, in response to the request, the control unit 31 receives the content including the moving image block Bn-m distributed from the distribution server 2 (step S4), and the received content is stored in, for example, a buffer memory provided in the RAM. Hold. The received content includes, for example, a playlist file indicating the block ID of the received moving image block Bn-m.

  Next, the control unit 31 executes display processing of the divided moving image DMn according to the playlist file received in step S4 (step S5). In the display process of the divided moving image DMn, the control unit 31 decodes the moving image block Bn-m indicated in the playlist file and held in the buffer memory to reproduce the divided moving image DMn, and outputs the divided moving image DMn to the video RAM 33. Then, the control unit 31 outputs a control signal to the video processing unit 34 to display a moving image that fits within the display range on the display screen among the divided moving images DMn written to the video RAM 33. When audio data is included in the content held in the buffer memory, the control unit 31 generates an analog audio signal from audio data by outputting a control signal to the audio processing unit 35. An analog audio signal is output to the speaker 35a.

  Next, the control unit 31 determines whether the display range displayed in the entire moving image M is displaced (step S6). For example, when the center point of the display range is displaced by a predetermined distance or more, it is determined that the display range is displaced (step S6: YES), and the process returns to step S1. If it returns to step S1, the control part 31 will specify the display range displayed in the whole moving image M corresponding to the content in process of reproduction, and will perform the process after step S2 similarly to the above. On the other hand, when the control unit 31 determines that the display range displayed in the entire moving image M is not displaced (step S6: NO), the control unit 31 proceeds to step S7.

  In step S7, the control unit 31 determines whether or not to end the content reproduction process. For example, when the content has been reproduced to the end, it is determined that the content reproduction process is to be terminated. Further, for example, when a reproduction end instruction is given by a user operation, it is determined that the content reproduction process is to be ended. If the control unit 31 determines that the content reproduction process is not finished (step S7: NO), the process returns to step S4. On the other hand, when the control unit 31 determines that the content reproduction process is to be ended (step S7: YES), the content reproduction process is ended. In addition, when a reproduction end instruction is performed by a user operation, information indicating the reproduction end instruction is transmitted to the distribution server 2.

  On the other hand, the segment unit notification process shown in FIG. 6B is repeatedly executed at predetermined time intervals, for example. When the segment unit notification process is started, the control unit 31 calculates the display time of each of the plurality of divided videos DMn in which at least a part of the display area is simultaneously displayed (that is, displayed within the display range) (Step S31). S11). Next, the control unit 31 calculates the display ratio of each of the plurality of divided moving images DMn in which at least a part of the display area is simultaneously displayed (step S12). Next, the control unit 31 specifies a divided moving image DMn that includes a display area with the largest display ratio calculated in step S12 (step S13). Next, the control unit 31 determines, as the segment unit Tx, a time proportional to the display time of the divided moving image DMn specified in step S13 (the display time calculated in step S11) (step S14). Note that the control unit 31 may determine, as the segment unit Tx, a time proportional to a relatively long display time among the display times of each of the plurality of divided videos DMn in which at least some of the display areas are simultaneously displayed. . Next, the control unit 31 notifies the distribution unit 2 of the segment unit Tx determined in step S14 (step S15), and ends the segment unit notification process. Note that the distribution server 2 may be notified of the display time instead of the segment unit Tx.

  On the other hand, the camera work data transmission process shown in FIG. 6C is started when the content reproduction process shown in FIG. 6A is started. The camera work data transmission process and the content reproduction process are performed by multitasking of the OS. Executed in parallel. When the camera work data transmission process is started, data indicating the display range and the reproduction position are associated and recorded according to the user operation (step S21). Next, the control unit 31 determines whether or not a predetermined time has elapsed since the previous process (that is, the process of the previous step S22) (step S22). When it is determined that the predetermined time has not elapsed since the previous process (step S22: NO), the control unit 31 returns to step S21. On the other hand, when the control unit 31 determines that the predetermined time has elapsed from the previous process (YES in step S22), the process proceeds to step S23. In step S23, the control unit 31 generates camera work data indicating the data indicating the display range recorded in step S21 for each of the recorded reproduction positions. Next, the control unit 31 transmits the camera work data generated in step S23 to the distribution server 2 via the network (step S24). At this time, the data indicating the display range recorded in step S21 and the reproduction position are deleted. Next, as in step S6, the control unit 31 determines whether to end the reproduction of the content (step S25). When the control unit 31 determines that the reproduction of the content is not finished (step S25: NO), the process returns to step S21. On the other hand, when the control unit 31 determines that the reproduction of the content ends (step S25: YES), the control unit 31 ends the camera work data transmission process.

(Operations of the encoding server 1 and the distribution server 2 in the first embodiment)
Next, operations of the encoding server 1 and the distribution server 2 in the first embodiment will be described with reference to FIGS. FIG. 7A is a flowchart illustrating an example of the segment unit acquisition process executed by the control unit 21 of the distribution server 2. FIG. 7B is a flowchart showing an example of the camera work data analysis process executed by the control unit 21 of the distribution server 2. FIG. 7C is a flowchart showing an example of the segment unit setting process executed by the control unit 11 of the encoding server 1. FIG. 8A is a flowchart illustrating an example of content distribution processing executed by the control unit 21 of the distribution server 2. FIG. 8B is a flowchart showing an example of the encoding process performed by the control unit 11 of the encoding server 1. In the distribution server 2, the content distribution process and the segment unit acquisition process (or camera work data analysis process) are executed asynchronously. The segment unit acquisition process is executed when the display time of each divided video DMn is calculated by the client terminal 3a. On the other hand, the camera work data analysis process is executed when the distribution server 2 calculates the display time of each divided moving image DMn. In the encoding server 1, the segment unit setting process and the encoding process are executed asynchronously.

  The segment unit acquisition process shown in FIG. 7A is started when the segment unit Tx from the client terminal 3a is received. When the segment unit acquisition process is started, the control unit 21 records the received segment unit Tx (step S31). The control unit 21 determines whether a predetermined time has elapsed from the previous process (that is, the process of step S31 of the previous time) (step S32). When it is determined that the predetermined time has not elapsed from the previous process (step S32: NO), the control unit 31 ends the segment unit acquisition process. On the other hand, when it is determined that the predetermined time has elapsed since the previous process (step S32: YES), the control unit 31 proceeds to step S33. In step S33, the control unit 21 adds up all the recorded segment units Tx (that is, segment units Tx transmitted from the plurality of client terminals 3X and recorded) as described above, and adds a new segment unit. Get Tx. Next, the control unit 21 transmits a setting command indicating the new segment unit Tx acquired in step S33 to the encoding server 1 via the network NW (step S34), and ends the segment unit acquisition process. In addition, after the process of step S31, step S32 and S33 may not be performed but it may transfer to step S34 and you may comprise so that the segment unit Tx may be transmitted to the encoding server 1. In this case, the segment unit Tx is used only for encoding the divided moving image DMn only at the client terminal 3a that has transmitted it.

  On the other hand, the camerawork data analysis process shown in FIG. 7B is started when the camerawork data from the client terminal 3a is received. When the camerawork data analysis process is started, the control unit 21 analyzes the received camerawork data to display the display time of each of the plurality of divided moving images DMn in which at least a part of the display area is simultaneously displayed. It calculates (step S41). Next, the control unit 21 calculates the display ratio of each of the plurality of divided moving images DMn in which at least a part of the display area is simultaneously displayed (step S42). Next, the control unit 21 specifies the divided moving image DMn that includes the display area with the largest display ratio calculated in step S42 (step S43). Next, the control unit 21 determines, as a segment unit Tx, a time proportional to the display time of the divided video DMn specified in Step S43 (the display time calculated in Step S41) (Step S44). The control unit 21 may determine, as the segment unit Tx, a time proportional to a relatively long display time among the display times of each of the plurality of divided videos DMn in which at least a part of the display area is simultaneously displayed. . Next, the control unit 21 records the segment unit Tx determined in step S44 (step S45).

  Next, the control unit 21 determines whether or not a predetermined time has elapsed since the previous process (that is, the process of the previous step S45) (step S46). When it is determined that the predetermined time has not elapsed since the previous process (step S46: NO), the control unit 31 ends the camera work data analysis process. On the other hand, when it is determined that the predetermined time has elapsed from the previous process (step S46: YES), the control unit 31 proceeds to step S47. In step S47, the control unit 21 totals all the recorded segment units Tx as described above to obtain a new segment unit Tx. Next, the control unit 21 transmits a setting command indicating the new segment unit Tx acquired in step S47 to the encode server 1 via the network NW (step S48), and ends the camera work data analysis process. After the process of step S45, the process may proceed to step S48 so that the segment unit Tx is transmitted to the encoding server 1 without performing steps S46 and S47. In this case, the segment unit Tx is used only for encoding the divided moving image DMn only at the client terminal 3a that has transmitted it.

  Instead of the segment unit acquisition process shown in FIG. 7A and the camera work data analysis process shown in FIG. 7B, a request number analysis process may be performed. This request number analysis process is started when a request for the divided video DMn is received from the client terminal 3a. When the request number analysis process is started, the control unit 21 records the reception time of the received request. Next, the control unit 21 determines whether or not a predetermined time has elapsed since the previous process. Then, when it is determined that the predetermined time has elapsed from the previous process, the control unit 21 calculates the number of requests per unit time, and copes with the segment unit Tx associated with the calculated number of requests as described above. Acquired using an attached table or calculation formula. The number of requests may be calculated for each client terminal 3X or may be calculated across a plurality of client terminals 3X. Then, the control unit 21 transmits a setting command indicating the acquired new segment unit Tx to the encoding server 1 via the network NW.

  On the other hand, the segment unit setting process shown in FIG. 7C is started when the setting command from the distribution server 2 is received. When the segment unit setting process is started, the control unit 11 determines whether or not the segment unit Tx indicated by the received setting command matches the segment unit Tx being set (step S51). If the control unit 11 determines that both segment units Tx match (step S51: YES), the segment unit setting process ends. In this case, the segment unit Tx being set is not changed. On the other hand, when the control unit 11 determines that the two segment units Tx do not match (step S51: NO), the control unit 11 sets the segment unit Tx indicated by the received setting command instead of the segment unit Tx being set (that is, Update) (step S52), and the segment unit setting process is terminated. In this case, the segment unit Tx being set is changed. Note that, instead of the configuration in which the setting command is transmitted from the distribution server 2 to the encoding server 1, the encoding server 1 may be configured to inquire the distribution server 2 about the segment unit Tx. This configuration is effective, for example, when the encoding server 1 is installed in the LAN and cannot be directly accessed from the distribution server 2.

  Next, the content distribution process shown in FIG. 8A is started when a request for a divided moving image DMn from the client terminal 3a is received. When the content distribution process is started, the control unit 21 acquires a divided moving image ID from the received request for the divided moving image DMn (step S61). Next, the control unit 21 transmits the encode command (the encode command of the divided moving image DMn) indicating the divided moving image ID acquired in step S61 to the encoding server 1 via the network NW (step S62).

  On the other hand, the encoding process shown in FIG. 8 (B) is started when the encoding command from the distribution server 2 is received. When the encoding process is started, the control unit 11 acquires, from the storage unit 12, one or more divided moving images DMn to which a divided moving image ID indicated by the encoding command is added (step S71). Next, the control unit 11 obtains the latest segment unit Tx set in step S52 (step S72). Next, the control unit 11 encodes the divided moving image DMn acquired in step S71 from the division end position of the divided moving image DMn in the previous process (step S73).

  Next, the control unit 11 determines whether or not the divided video DMn has been encoded by the segment unit Tx acquired in step S72 (step S74). If the control unit 11 determines that the divided moving image DMn is not encoded by the segment unit Tx (step S74: NO), the control unit 11 returns to step S73 and continues encoding. On the other hand, when the control unit 11 determines that the divided moving image DMn is encoded by segment unit Tx (step S74: YES), that is, when the moving image block Bn-m of the segment unit Tx is generated, the process proceeds to step S75. move on. As a result, it is possible to more flexibly generate the moving image block Bn-m of the appropriate segment unit Tx. When a plurality of divided videos DMn are acquired in step S71, the processes of steps S73 to S74 are performed for each of the divided videos DMn.

  In step S75, the control unit 11 generates content including one or more moving image blocks Bn-m generated in the process of steps S73 to S74 and a playlist file indicating block IDs of the moving image blocks Bn-m. . The content may include an audio data file whose reproduction time is synchronized with that of the moving image block Bn-m. Next, the control unit 11 transmits the content generated in step S75 to the distribution server 2 (step S76), and proceeds to step S77.

  On the other hand, in the process shown in FIG. 8A, the control unit 21 receives the content transmitted from the encoding server 1 in step S76 (step S63). Next, the control unit 21 distributes the content received in step S63 to the client terminal 3a via the network NW (step S64). Next, the control unit 21 determines whether a request for the divided moving image DMn is newly received from the client terminal 3a (step S65). When it is determined that the request for the divided moving image DMn is newly received (step S65: YES), the control unit 21 returns to step S61, acquires the divided moving image ID from the newly received request, and this divided moving image ID Is newly transmitted to the encoding server 1. Such a request is transmitted from the client terminal 3a each time it is determined that the display range has been displaced in step S6 described above. On the other hand, when it determines with the control part 21 not having received the request | requirement of the division | segmentation moving image DMn newly (step S65: NO), it progresses to step S66. Note that a request from the client terminal 3a may be received during content distribution in step S64. In this case, the distribution of the content for the request received later is executed after the distribution of the content for the immediately previous request is completed (that is, the distribution of the content for the request received later is waited).

  In step S66, the control unit 21 determines whether or not to end the content distribution process. For example, when the information indicating the reproduction end instruction is received from the client terminal 3a, or when the transmission of the content from the encoding server 1 is interrupted for a predetermined time or more, the control unit 21 determines that the content distribution process is ended ( Step S66: YES), the content distribution process is ended. On the other hand, when the control unit 21 determines that the content distribution process is not completed (step S66: NO), the process returns to step S63, and continues the reception and transmission of the content.

  On the other hand, in step S77 shown in FIG. 8B, the control unit 11 determines whether or not an encode command has been newly received from the distribution server 2. If it is determined that the encode command has been received (step S77: YES), the control unit 11 returns to step S71, acquires the divided moving image DMn to which the divided moving image ID indicated by the newly received encode command is added, The process after step S72 is performed. On the other hand, when determining that the encode command has not been newly received (step S77: NO), the control unit 11 determines whether to end the encoding process (step S78). For example, when the content is encoded to the end, it is determined that the encoding process is to be ended. If the control unit 11 determines that the encoding process is not completed (step S78: NO), the process returns to step S72, and performs the same process as described above. On the other hand, when it is determined that the encoding process is to be ended (step S78: YES), the control unit 11 ends the encoding process.

  According to the first embodiment, the video block Bn-m generated in real time in a more appropriate segment unit Tx can be distributed in response to the request for the divided video DMn from the client terminal 3a.

(Example 2)
The second embodiment is an example in which a moving image block Bn-m generated in advance and stored in the distribution server 2 is distributed to the client terminal 3a in response to a request for the divided moving image DMn from the client terminal 3a. That is, in the second embodiment, before the request from the client terminal 3a is received, the encoding server 1 generates a plurality of segment units (fixed segment units) having different time lengths from the same divided moving image DMn. It is assumed that the content including the moving image block Bn-m is stored in the storage unit 22 of the distribution server 2. The stored content includes the playlist file described above. The content may include an audio data file whose reproduction time is synchronized with the moving image block Bn-m.

(Operation of Client Terminal 3a in Embodiment 2)
First, the operation of the client terminal 3a in the second embodiment is the same as that of the client terminal 3a in the first embodiment, and the processes shown in FIGS. 6A to 6C are the same as those in the second embodiment. It is also executed in 3a.

(Operation of Distribution Server 2 in Embodiment 2)
Next, with reference to FIG. 9, the operation of the distribution server 2 in the second embodiment will be described. FIG. 9A is a flowchart showing an example of the segment unit acquisition / setting process executed by the control unit 21 of the distribution server 2. FIG. 9B is a flowchart illustrating an example of camera work data analysis / segment unit setting processing executed by the control unit 21 of the distribution server 2. FIG. 9C is a flowchart illustrating an example of content distribution processing executed by the control unit 21 of the distribution server 2. In the distribution server 2, the content distribution process and the segment unit acquisition / setting process (or camera work data analysis / segment unit setting process) are executed asynchronously. The segment unit acquisition / setting process is executed when the display time of each divided video DMn is calculated by the client terminal 3a. On the other hand, the camera work data analysis / segment unit setting process is executed when the distribution server 2 calculates the display time of each divided moving image DMn.

  The segment unit acquisition / setting process shown in FIG. 9A is started when the segment unit Tx from the client terminal 3a is received. When the segment unit acquisition / setting process is started, the control unit 21 determines whether or not the segment unit Tx acquired by reception matches the segment unit Tx being set (step S81). If the control unit 21 determines that both segment units Tx match (step S81: YES), the segment unit acquisition / setting process ends. In this case, the segment unit Tx being set is not changed. On the other hand, when the control unit 21 determines that both segment units Tx do not match (step S81: NO), the acquired segment units Tx are set instead of the segment units Tx being set (that is, updated). (Step S82), the segment unit acquisition / setting process is terminated. In this case, the segment unit Tx being set is changed.

  On the other hand, the camerawork data analysis / segment unit setting process shown in FIG. 9B is started when the camerawork data from the client terminal 3a is received. When the camera work data analysis / segment unit setting process is started, the control unit 21 analyzes each of the received camera work data so that each of a plurality of divided moving images DMn in which at least a part of the display area is simultaneously displayed. The display time of is calculated (step S91). Next, the control unit 21 calculates the display ratio of each of the plurality of divided moving images DMn in which at least a part of the display area is simultaneously displayed (step S92). Next, the control unit 21 specifies the divided moving image DMn that includes the display area with the largest display ratio calculated in Step S92 (Step S93). Next, the control unit 21 determines a time proportional to the display time of the divided moving image DMn identified in step S93 as a segment unit Tx (step S94). The control unit 21 may determine, as the segment unit Tx, a time proportional to a relatively long display time among the display times of each of the plurality of divided videos DMn in which at least a part of the display area is simultaneously displayed. . Next, the control unit 21 determines whether or not the segment unit Tx acquired by the determination of step S94 matches the segment unit Tx being set (step S95). When it is determined that the two segment units Tx match (step S95: YES), the control unit 21 ends the camera work data analysis / segment unit setting process. On the other hand, when determining that both segment units Tx do not match (step S95: NO), the control unit 21 sets the acquired segment units Tx instead of the segment units Tx being set (step S96). The segment unit acquisition / setting process ends.

  The request number analysis process may be performed instead of the segment unit acquisition / setting process shown in FIG. 9A and the camera work data analysis / segment unit setting process shown in FIG. 9B. This request number analysis process is started when a request for the divided video DMn is received from the client terminal 3a. When the request number analysis process is started, the control unit 21 records the reception time of the received request. Next, the control unit 21 determines whether or not a predetermined time has elapsed since the previous process. Then, when it is determined that the predetermined time has elapsed from the previous process, the control unit 21 calculates the number of requests per unit time, and copes with the segment unit Tx associated with the calculated number of requests as described above. Acquired using an attached table or calculation formula. Then, by performing the same processing as steps S94 to S96, the acquired segment unit Tx is set.

  Next, the content distribution process shown in FIG. 9C is started when a request for the divided moving image DMn is received from the client terminal 3a. When the content distribution process is started, the control unit 21 acquires a divided moving image ID from the received request for the divided moving image DMn (step S101). Next, the control unit 21 acquires the latest segment unit Tx set in step S82 or step S96 (step S102). Next, the control unit 21 is the moving image block Bn-m generated from the divided moving image DMn to which the divided moving image ID acquired in step S102 is added, and the time difference with the segment unit Tx acquired in step S102 is the most A short segment moving image block Bn-m is acquired from the storage unit 22 (step S103).

  Next, the control unit 21 generates content including one or more moving image blocks Bn-m acquired in step S103 and a playlist file indicating the block ID of the moving image block Bn-m (step S104). The content may include an audio data file whose reproduction time is synchronized with that of the moving image block Bn-m. Next, the control unit 21 distributes the content generated in step S104 to the client terminal 3a via the network NW (step S105).

  Next, the control unit 21 determines whether a request for the divided moving image DMn is newly received from the client terminal 3a (step S106). When it is determined that the request for the divided video DMn has been newly received (step S106: YES), the control unit 21 returns to step S101. On the other hand, when it determines with the control part 21 not having received the request | requirement of the division | segmentation moving image DMn newly (step S106: NO), it progresses to step S107. In step S107, the control unit 21 determines whether or not to end the content distribution process. If the control unit 21 determines that the content distribution process is to be ended (step S107: YES), the content distribution process is ended. On the other hand, when the control unit 21 determines that the content distribution process is not completed (step S107: NO), the process returns to step S102.

  According to the second embodiment, in response to a request for the divided video DMn from the client terminal 3a, the video block Bn-m generated in a more appropriate segment unit Tx is reduced while reducing the load on the distribution server 2. Can be delivered quickly.

  As described above, according to the above embodiment, the segment unit Tx corresponding to the display time of the divided moving image DMn displayed on the client terminal 3X, or the segment unit corresponding to the number of requests for the divided moving image DMn from the client terminal 3X The data of the divided moving image DMn is transmitted to the client terminal 3X for each moving image block Bn-m of Tx. Therefore, data of the divided moving image DMn requested from the client terminal 3X can be transmitted in an optimal segment unit Tx according to the viewing condition of the user of the client terminal 3X, and as a result, waste of data transmission amount is reduced. However, the load on the server device and the network can be reduced. In addition, according to the above-described embodiment, even when the content is in a time zone in which the viewing range varies greatly (for example, in the case of sports, during a game) and a small time zone (for example, in sports, during a break), Data of the divided video DMn can be transmitted to the client terminal 3X in the segment unit Tx.

Reference Signs List 1 encoding server 2 distribution server 3X client terminal 11 control unit 12 storage unit S distribution system

Claims (15)

A server device that transmits data of a plurality of divided videos obtained by dividing a video into a plurality of display areas to each terminal device in response to a request from the terminal device for each segment video block in variable time units. ,
An acquisition means for acquiring the segment unit according to the display time of the divided video displayed on the terminal device or the segment unit according to the number of requests of the divided video from the terminal device;
Transmitting means for transmitting the data of the divided video requested from the terminal device to the terminal device for each video block of the segment unit acquired by the acquiring unit;
A server apparatus comprising: The acquisition unit includes a divided video including the display area having the highest display ratio or the second largest display area among the plurality of divided videos in which at least a part of the display area of the divided video is simultaneously displayed on the terminal device. The server device according to claim 1, wherein a time proportional to a display time of is acquired from the terminal device as the segment unit. The terminal device further comprises receiving means for receiving, from the terminal device, display range data indicating a display range at a specific time on a display screen on which at least a part of the display area of the divided video is simultaneously displayed.
The acquisition unit calculates a display time of each of the divided videos based on the display range data received by the reception unit, and the display ratio is the largest or second largest among the plurality of divided videos. The server apparatus according to claim 1, wherein a time proportional to the display time of the divided moving image including the display area is acquired as the segment unit.   The server apparatus according to any one of claims 1 to 3, wherein the acquisition unit acquires, as the display time, an accumulated value of time during which at least a part of the display area of the divided moving image is displayed. .   The said acquisition means acquires the display time of the said division | segmentation moving image of the same content displayed in the several said terminal device, respectively, The acquired said display time is totaled and the said segment unit is acquired, It is characterized by the above-mentioned. The server apparatus according to any one of 1 to 4.   The said acquisition means acquires the number of the requests | requirement of the said division | segmentation moving image from each of several said terminal devices, The number of the said acquired requests is totaled, and the said segment unit is acquired, It is characterized by the above-mentioned. Server devices. Further comprising generating means for generating a plurality of moving picture blocks by dividing the divided moving picture data requested from the terminal device in units of the segments acquired by the acquiring means;
The said transmission means transmits the data of the said divided moving image requested from the said terminal device to the said terminal device for every moving image block produced | generated by the said production | generation means. The server device according to item. Further comprising storage means for storing the divided video data having the same content for each of a plurality of segment units having different time lengths,
The data of the divided moving image corresponding to each of the segment units in the storage means is composed of the moving image blocks divided in the respective segment units,
The transmission unit is a moving image block constituting data of the divided moving image requested from the terminal device, and the terminal unit acquires the segment moving image block acquired by the acquisition unit from the storage unit The server device according to claim 1, wherein the server device is transmitted to the server device. Included in a server device that transmits data of a plurality of divided videos obtained by dividing a video into a plurality of display areas to the terminal device in response to a request from the terminal device for each segment video block in variable time units On the computer,
Obtaining the segment unit according to the display time of the divided video displayed on the terminal device, or the segment unit according to the number of requests of the divided video from the terminal device;
Transmitting the data of the divided video requested from the terminal device to the terminal device for each video block of the segment unit acquired by the acquiring step;
A server program characterized by executing. In a computer included in a terminal device that requests data of a plurality of divided moving images obtained by dividing a moving image into a plurality of display areas to a server device according to a user operation,
A calculation step of calculating a display time of the divided moving image displayed on the terminal device;
A segment unit which is a variable time unit, and determining the segment unit according to the display time calculated in the calculation step;
A notification step of notifying the server device of the segment unit determined by the determination step;
Receiving the requested divided video data from the server device for each segment video block notified by the notification step;
A display step of displaying the divided moving image using the moving image block received by the receiving step;
A terminal program characterized by executing. The calculating step calculates a display time of each of the plurality of divided videos in which at least a part of the display area of the divided videos is simultaneously displayed on the terminal device;
The determining step specifies a divided video including the display area having the largest display ratio or the second largest display area among the plurality of divided videos in which the at least some display areas are simultaneously displayed, and the identified division The terminal program according to claim 10, wherein a time proportional to a moving image display time is determined as the segment unit. Executed by a computer that transmits data of a plurality of divided videos obtained by dividing a video into a plurality of display areas to the terminal device in response to a request from the terminal device for each video block in variable segment units. It is a video transmission method, and
Obtaining the segment unit according to the display time of the divided video displayed on the terminal device, or the segment unit according to the number of requests of the divided video from the terminal device;
Transmitting the data of the divided video requested from the terminal device to the terminal device for each video block of the segment unit acquired by the acquiring step;
A video transmission method comprising: A video display method executed by a computer included in a terminal device that requests data of a plurality of divided videos obtained by dividing a video into a plurality of display areas to a server device according to a user operation,
A calculation step of calculating a display time of the divided moving image displayed on the terminal device;
A segment unit which is a variable time unit, and determining the segment unit according to the display time calculated in the calculation step;
A notification step of notifying the server device of the segment unit determined by the determination step;
Receiving the requested divided video data from the server device for each segment video block notified by the notification step;
A display step of displaying the divided moving image using the moving image block received by the receiving step;
An animation display method characterized by including. Communication in which a server device transmits data of a plurality of divided videos obtained by dividing a video into a plurality of display areas to the terminal device for each segment video block in variable time units in response to a request from the terminal device A system,
The terminal device
Calculating means for calculating a display time of the divided moving image displayed on the terminal device;
A segment unit which is a variable time unit, wherein the segment unit is determined according to the display time calculated by the calculation unit;
Notification means for notifying the server device of the segment unit determined by the determination means;
Equipped with
The server device
Acquisition means for acquiring the segment unit notified from the terminal device;
Transmitting means for transmitting the data of the divided video requested from the terminal device to the terminal device for each video block of the segment unit acquired by the acquiring unit;
Equipped with
The terminal device
Receiving means for receiving, for each moving image block, the data of the divided moving image transmitted from the server device;
Display means for displaying the divided moving image using the moving image block received by the receiving means;
A communication system comprising: Communication in which a server device transmits data of a plurality of divided videos obtained by dividing a video into a plurality of display areas to the terminal device for each segment video block in variable time units in response to a request from the terminal device A system,
The terminal device
A first transmission unit configured to transmit display range data indicating a display range in a display range in which at least a part of the display area of the divided moving image is simultaneously displayed in the terminal device to the server device;
The server device
First receiving means for receiving the display range data transmitted from the terminal device;
Based on the display range data received by the first receiving means, the display time of each of the divided moving images is calculated, and the display area having the largest display ratio or the second largest among the plurality of divided moving images. An acquisition means for acquiring a time proportional to the display time of the divided video including a segment unit which is a variable time unit;
Second transmission means for transmitting the data of the divided video requested from the terminal device to the terminal device for each video block of the segment unit acquired by the acquisition unit;
Equipped with
The terminal device
Second receiving means for receiving the divided moving image data transmitted from the server device for each moving image block;
Display means for displaying the divided moving picture using the moving picture block received by the second receiving means;
A communication system comprising: