JP6500808B2 - Communication system, moving picture server device, terminal device, communication method and program - Google Patents

Description

  The present invention relates to the technical field of a communication system in which moving image data is transmitted from a moving image server device to a terminal device via a network, and the terminal device reproduces the moving image data.

  Patent Document 1 discloses a system in which a server divides moving image data captured by a camera, and a client terminal receives and reproduces the divided moving image data. Specifically, the encoding server divides the area of the image frame of the moving image data into a plurality of divided areas, and generates a plurality of divided moving image data corresponding to the plurality of divided areas. The client terminal receives, from the distribution server, the divided moving image data corresponding to the divided area overlapping the drawing area according to the user's operation. Then, the client terminal displays the moving image in the drawing area based on the received divided moving image data.

JP, 2015-49641, A

  In a system in which the display range can be changed according to the user's operation in the entire moving image area as described in Patent Document 1, the user does not know which part of the whole moving image should be viewed, There may be cases where a portion of the video that the user is interested in can not be found. In this case, the user may continue to change the display range unnecessarily, or may keep the display range fixed to a part that many other users do not see. As a result, the user can not make significant use of the system in which the display range of the moving image can be changed according to the operation. Further, due to the state of such a display range, the transmission load of divided moving image data by the moving image server device increases. For example, when the display range is changed, divided moving image data required for the terminal device to reproduce the moving image within the display range changes. Therefore, the moving image server device needs to transmit divided moving image data corresponding to the changed display range to the terminal device each time the display range is changed. Also, for example, in the case of a system that delivers divided moving image data using a CDN (Contents Delivery Network), the CDN stores a cache of divided moving image data stored in the moving image server device. The divided moving image data of the portion viewed by many users is likely to be cached in the CDN, so the CDN can transmit the cache to the terminal device. On the other hand, the divided moving picture data of the part which many users do not see is unlikely to be cached in the CDN. Therefore, the distribution efficiency of the divided moving image data by the CDN is reduced, and the moving image server device needs to transmit the divided moving image data to the CDN.

  The present invention has been made in view of the above points, and enables users to enjoy moving pictures through the use of a system that can change the display range of the moving pictures according to the operation. It is an object of the present invention to provide a communication system, a moving image server apparatus, a terminal apparatus, a communication method and a program which can reduce transmission load.

  In order to solve the above-mentioned subject, in the communication system provided with the terminal device which reproduces a moving image, and the moving image server device which transmits the moving image to the terminal device in order to solve the above-mentioned subject, the moving image server device Moving image data storage means for storing each of a plurality of divided moving image data indicating moving images of a plurality of divided regions obtained by dividing the entire region of the moving image in association with identification information for identifying the divided regions corresponding to the divided moving image data; Identification information receiving means for receiving identification information for identifying at least one of the plurality of divided areas from the terminal device, and the plurality of divided moving picture data stored in the moving picture data storage means Moving image data transmitting means for transmitting divided video data corresponding to the identification information received by the identification information receiving means to the terminal device; The apparatus overlaps a display range specified based on the operation received by the reception unit among the plurality of divided regions, a reception unit that receives an operation of a display range displayed among the entire area of the moving image, and Identification information transmitting means for transmitting identification information for identifying a divided area to the moving picture server device, moving picture data receiving means for receiving the divided moving picture data sent from the moving picture server device, and received by the moving picture data receiving means A display unit for displaying a moving image within the display range specified based on the operation received by the receiving unit among the entire regions of the moving image based on the divided moving image data; Receiving information from a predetermined information server apparatus, camera work information indicating a predetermined display range of the plurality of images along with the elapse of the reproduction time of the moving image The moving image server device or the terminal device increases the transmission load of divided moving image data by the moving image server device according to the state of the display range specified based on the operation received by the receiving device. Determination means for determining whether the degree of transmission exceeds a predetermined degree, and when it is determined that the degree to which the transmission load can be increased exceeds the predetermined degree by the The control unit configured to transmit the information to the terminal device, and when the camerawork information is received by the information reception unit, the identification information transmission unit is configured to use the camerawork information in the plurality of divided areas. Transmitting identification information identifying a divided area overlapping the display range specified based on the display area, the display means including the entire area of the moving image Among the above, it is characterized in that a moving image within a display range specified based on the camera work information received by the information receiving means is displayed.

  In the invention according to claim 2, the determination means determines whether the duration of the operation accepted by the acceptance means exceeds a predetermined time, and the control means determines the duration by the determination means. When it is determined that the predetermined time is exceeded, the camera work information is transmitted.

  In the invention according to claim 3, the determination means determines whether the display range moves beyond a predetermined distance based on the operation accepted by the acceptance means, and the control means determines the determination. When it is determined by the means that the display range moves beyond the predetermined distance, the camerawork information is transmitted.

  In the invention according to claim 4, the communication system includes a plurality of the terminal devices, and the determination means is the same as the reproduction time in which the display range is specified based on the operation accepted by the acceptance means. It is determined whether the display range specified based on the operation received by the receiving unit is an outlier in the distribution of the plurality of display ranges specified by each of the plurality of terminal devices at the playback time of The control means causes the camerawork information to be transmitted when the determination means determines that the display range is the outlier.

  The invention according to claim 5 causes the terminal device to transmit the camerawork information when it is determined by the determination unit and the determination unit that the degree to which the transmission load is increased exceeds the predetermined degree. The control means for transmitting a request to the information server device, wherein the information server device transmits the camera work information to the terminal device when the request is received from the terminal device. Do.

  In the invention according to claim 6, the communication system includes a plurality of the terminal devices, and the terminal device transmits, to the information server device, first camera work information indicating a display range at the start of reproduction of the moving image. And second information transmitting means for transmitting, to the information server apparatus, second camera work information indicating a display range specified based on the operation received by the receiving means. The information server device comprises: first information receiving means for receiving the first camera work information transmitted from the terminal device; and camera work information for the first camera work information received by the first information receiving means. And an information entry to be stored in association with terminal device identification information identifying a terminal device that has transmitted the first camera work information among the plurality of terminal devices. Means, second information receiving means for receiving the second camera work information transmitted from the terminal device, and the second camera work information received by the second information receiving means, the plurality of the terminal devices Adding means for adding to the camera work information stored in the information storage means in association with the terminal device identification information identifying the terminal device that has transmitted the second camera work information, and the information storage means A terminal device different from a terminal device including a receiving unit having received the operation determined to have the degree to which the transmission load is increased to exceed the predetermined degree by the determination unit among a plurality of pieces of stored camera work information And camera work information transmitting means for transmitting the latest camera work information corresponding to the terminal device identification information to be identified.

  In the invention according to claim 7, when the control means determines that the degree to which the transmission load is increased exceeds the predetermined degree by the determination means, the information server device does not use the camera work information. Transmitting the advertisement information indicating the advertisement to the terminal device, the information receiving means receives the advertisement information sent from the information server device, and the display means receives the advertisement information by the information receiving means And displaying the advertisement information.

  In the invention according to claim 8, the judging means judges whether the operation accepted by the accepting means is an operation exceeding a predetermined degree, and the operation by the judging means exceeds the predetermined degree When it is determined that the control unit does not transmit the camera work information by the information server device, the display unit displays a display range when an operation of a display range exceeding the predetermined degree is further performed. And displaying warning information indicating that the operation of.

  The invention according to claim 9 is the moving image server device included in a communication system including a terminal device for reproducing a moving image and a moving image server device for transmitting the moving image to the terminal device, wherein the entire area of the moving image is divided. Moving image data storage means for storing each of a plurality of divided moving image data indicating moving images of a plurality of divided regions in association with identification information for identifying the divided regions corresponding to the divided moving image data; Identification information receiving means for receiving, from the terminal device, identification information for identifying, among the plurality of divided areas, the divided areas overlapping the display area, when an operation of the displayed area among the entire areas is accepted; A portion corresponding to the identification information received by the identification information receiving unit among the plurality of divided moving image data stored in the moving image data storage unit The transmission load of the divided moving image data by the moving image server device is increased according to the moving image data transmission means for transmitting the moving image data to the terminal device and the state of the display range specified based on the operation accepted by the terminal device. Determination means for determining whether the degree of transmission exceeds a predetermined degree, and when it is determined that the degree to which the transmission load can be increased exceeds the predetermined degree by the determination means, a predetermined display of the whole area of the moving image And control means for transmitting camera work information indicating a range along a lapse of reproduction time of the moving image to the terminal device by a predetermined information server device.

  The invention according to claim 10 is that, in the terminal device included in the communication system including a terminal device for reproducing a moving image and a moving image server device for transmitting the moving image to the terminal device, display is performed over the entire area of the moving image. Identifying a division area overlapping a display range specified based on the operation received by the reception unit among a plurality of division areas obtained by dividing the entire area of the moving image, Identification information transmitting means for transmitting the identification information to the moving image server device, and the identification information for identifying the divided regions corresponding to the divided moving image data, corresponding to each of a plurality of divided moving image data indicating moving images of the plurality of divided regions The identification information transmitted by the identification information transmission unit among the plurality of divided moving image data stored in the moving image data storage unit to be added and stored The display range specified in the entire area of the moving image based on the moving image data receiving means for receiving the corresponding divided moving image data from the moving image server device, and the divided moving image data received by the moving image data receiving means The degree to which the transmission load of divided moving image data by the moving image server device is increased is predetermined by the display unit for displaying the moving image in the display unit and the state of the display range specified based on the operation received by the receiving unit. When it is determined that the degree to which the transmission load is increased exceeds the predetermined degree by the judging means for judging whether the degree exceeds the predetermined degree, the predetermined display range of the whole area of the moving picture is the moving picture Request transmitting means for transmitting a request for transmitting camera work information indicated along the passage of reproduction time to a predetermined information server device; Information receiving means for receiving the camera work information transmitted by the server device, and when the camera work information is received by the information receiving means, the identification information transmitting means includes, among the plurality of divided areas, Transmitting identification information identifying a divided area overlapping a display range specified based on the camera work information, and the moving image data receiving unit is configured to select one of the plurality of divided moving image data stored in the moving image data storage unit. The divided moving image data corresponding to the identification information transmitted by the identification information transmitting unit is received from the moving image server apparatus, and the display unit is specified based on the camera work information in the entire area of the moving image. Displaying a moving image within the display range.

  The invention according to claim 11 is a communication method in a communication system including a terminal device for reproducing a moving image, and a moving image server device for transmitting the moving image to the terminal device, wherein the terminal device comprises the entire region of the moving image. Among the plurality of divided areas obtained by dividing the entire area of the moving image, the step of receiving the operation of the display range to be displayed, and the display specified based on the operation received in the step of receiving A first identification information transmission step of transmitting identification information for identifying a divided area overlapping a range to the video server device; and a first identification information reception step of the video server device receiving the identification information from the terminal device; The moving picture server device divides each of a plurality of divided moving picture data indicating moving pictures of the plurality of divided areas into divisional pieces corresponding to the divided moving picture data Divided video data corresponding to the identification information received by the first identification information receiving step among the plurality of divided video data stored in the video data storage unit that stores the video data in association with the identification information that identifies the area A first moving image data transmitting step to transmit to the terminal device; a first moving image data receiving step in which the terminal device receives the divided moving image data transmitted from the moving image server device; and the terminal device A first moving image within the display range specified based on the operation received by the receiving step among all areas of the moving image based on the divided moving image data received by the moving image data receiving step A displaying step, and the identification information received by the first identification information receiving step by the moving image server device or the terminal device; Based on the state of the display range specified based on the operation received in the receiving step, it is determined whether the degree to which the transmission load of the divided moving image data by the moving image server device is increased exceeds a predetermined degree When it is determined that the degree to which the transmission load is increased by the determination step exceeds the predetermined degree, the predetermined display range of the entire area of the moving image Control step of transmitting camera work information to the terminal device by a predetermined information server device along with the lapse of reproduction time of the moving image, and the camera work information transmitted by the information server device by the terminal device Receiving the information, and the terminal device receiving the information receiving step among the plurality of divided areas. A second identification information transmission step of transmitting identification information for identifying a divided area overlapping a display range specified based on the camera work information received by the video camera, and the moving image server apparatus transmits the second identification information transmission step A second identification information receiving step of receiving the identification information transmitted from the terminal device by the terminal device; and the identification received by the second identification information reception step of the plurality of divided moving image data by the moving image server device. A second moving image data transmitting step of transmitting divided moving image data corresponding to information to the terminal device; and the terminal device receiving the divided moving image data transmitted from the moving image server device by the second moving image data transmitting step A second moving image data receiving step, and the terminal device is received by the second moving image data receiving step Displaying a moving image within a display range specified based on the camera work information received by the information receiving step among all the regions of the moving image based on the divided moving image data; It is characterized by

  The invention according to claim 12 is a computer of the moving picture server device included in a communication system including a terminal device for reproducing a moving picture and a moving picture server device for transmitting the moving picture to the terminal device, by the terminal device; When an operation of a display range to be displayed among all the regions of the moving image is received, identification information for identifying a divided region overlapping the display range among a plurality of divided regions obtained by dividing the entire region of the moving image is used as the terminal The identification information receiving step received from the device, and the plurality of divided moving image data indicating moving images of the plurality of divided regions obtained by dividing the entire region of the moving image are associated with identification information for identifying the divided regions corresponding to the divided moving image data The identification information received by the identification information receiving step among the plurality of divided moving image data stored in the moving image data storage unit to be added and stored And transmitting the divided moving image data by the moving image server device according to the state of the display range specified based on the operation accepted by the terminal device. If it is determined that the degree to which the transmission load is increased exceeds the predetermined degree in the determination step of determining whether the degree to which the load is increased exceeds the predetermined degree or not, And control step of transmitting camera work information indicating a predetermined display range along the lapse of the reproduction time of the moving image to the terminal device by the predetermined information server device.

  The invention according to claim 13 is characterized in that a computer of the terminal device included in a communication system comprising a terminal device for reproducing a moving image and a moving image server device for transmitting the moving image to the terminal device Among the plurality of divided areas obtained by dividing the entire area of the moving image, a divided area overlapping the display area specified based on the operation received by the reception step among the plurality of divided areas obtained by dividing the entire area of the moving image A first identification information transmission step of transmitting identification information for identifying the plurality of divided moving image data indicating the moving images of the plurality of divided regions, and identifying the divided regions corresponding to the divided moving image data; The first identification information transmission step among the plurality of divided moving image data stored in the moving image data storage unit stored in association with the identification information A first moving image data receiving step of receiving, from the moving image server apparatus, divided moving image data corresponding to the identification information transmitted by the user, and the divided moving image data received by the first moving image data receiving step; The moving image server apparatus according to a first display step of displaying a moving image within the specified display range of the entire region of the moving image, and a state of a display range specified based on the operation received by the receiving step. If it is determined that the degree to which the transmission load of the divided moving image data is increased exceeds the predetermined degree, it is determined whether the degree to which the transmission load of the divided moving image data is increased exceeds the predetermined degree. Camerawork information indicating a predetermined display range in the entire area of the moving image along with the lapse of the reproduction time of the moving image A request transmission step of transmitting a request to be transmitted to a predetermined information server device, an information reception step of receiving the camerawork information transmitted by the information server device, and the information reception step of the plurality of divided areas A second identification information transmission step of transmitting identification information identifying a divided area overlapping a display range specified based on the received camera work information; and the plurality of divided moving picture data stored in the moving picture data storage unit And a second moving image data receiving step of receiving, from the moving image server apparatus, divided moving image data corresponding to the identification information transmitted in the second identification information transmitting step; and Of the entire area of the moving image based on the divided moving image data, the information receiving step And a second display step of displaying a moving image within a display range specified based on the received camera work information.

  According to the present invention, the transmission load of divided moving image data by the moving image server device is increased by the state of the display range specified based on the operation accepted by the terminal device. If the predetermined degree is exceeded, camera work information is transmitted from the information server device to the terminal device to indicate a predetermined display range in the entire area of the moving image along with the elapsed time of the moving image reproduction time. The terminal device having received the camera work information receives, from the moving image server, the divided moving image data corresponding to the display range specified based on the camera work information. The terminal device displays the moving image within the display range specified based on the camera work information based on the received divided moving image data. Therefore, even if the user does not operate the display range, the display range is automatically determined along with the elapse of the playback time of the moving image. Therefore, the terminal device can display the moving image so that the user can enjoy the moving image even when it is not clear which part of the entire moving image should be viewed. This can prevent the user from continuing to change the display range unnecessarily or keeping the display range fixed to a part that many other users do not see. Therefore, the transmission of the divided moving image data by the moving image server device due to the unnecessary change of the display range and the transmission of the divided moving image data in which the cache is not stored in the CDN are reduced. Thereby, the transmission load of the divided moving image data by the moving image server device can be reduced.

  According to the second aspect of the present invention, it is possible to prevent an increase in the number of transmissions of divided moving image data due to the user continuing to operate the display range for an unnecessarily long time.

  According to the third aspect of the present invention, it is possible to prevent an increase in the number of transmissions of the divided moving image data caused by the user moving the display range for an unnecessarily long distance.

  According to the invention as set forth in claim 4, when the specified display range is set to a portion which can not be seen by many other users in the whole area of the moving image, the display range is statistically an outlier It is determined that In this case, in the terminal device, the display range is set to a predetermined display range indicated by the camera work information. The cache of divided moving image data corresponding to a predetermined display range is highly likely to be stored in the CDN. Therefore, the divided moving image data can be transmitted directly from the CDN to the terminal device, and the operation server device does not have to transmit the divided moving image data to the CDN. Therefore, the distribution efficiency of the divided moving image data by the CDN is increased, and the transmission load of the divided moving image data by the moving image server device can be reduced.

  According to the fifth aspect of the present invention, since the terminal device performs determination and transmission control of camera work information, the processing load of the moving image server device can be reduced.

  According to the invention described in claim 6, in the case of distributing a moving image live to a plurality of terminal devices, the information server device updates camera work information corresponding to each of the terminal devices as the reproduction time of the moving image elapses. Remember. In any one of the terminal devices, the information server device determines that the transmission load of divided moving image data by the moving image server device is increased by the state of the display range specified based on the accepted operation, if the degree exceeds the predetermined degree. , And transmits camera work information corresponding to other terminal devices. Therefore, even in the case of live distribution, the terminal device can receive the latest camera work information according to the current reproduction time.

  According to the seventh aspect of the invention, the advertisement information is displayed when the operation of the display range exceeding the predetermined degree is performed. Therefore, the user's attention can be directed from the video to the advertisement information. Therefore, the unnecessary operation of the display range by the user can be stopped.

  According to the invention described in claim 8, when the operation of the display range exceeding the predetermined degree is performed, the warning information is displayed. The user who sees this knows that the operation of the display range is prohibited when the operation of the display range further exceeds a predetermined degree. Therefore, the unnecessary operation of the display range by the user can be stopped.

It is a figure showing an example of outline composition of communication system S of this embodiment. (A) is a figure which shows an example of the position of the display range in whole moving image. (B) is a figure which shows an example of the screen of the display part 34a of the client 3. [FIG. (A) And (B) is a figure which shows an example of the screen of the display part 34a of the client 3. [FIG. It is a flowchart which shows the process example in the control part 31 of a client. (A) is a flowchart showing an example of processing in the control unit 11 of the distribution server 1. (B) is a flowchart showing an example of processing in the control unit 21 of the CW server 2.

  Hereinafter, embodiments of the present invention will be described based on the drawings.

[1. Configuration and Operation of Communication System S]
FIG. 1 is a diagram showing an example of a schematic configuration of a communication system S of the present embodiment. As shown in FIG. 1, the communication system S includes a distribution server 1, a CW server 2, and a plurality of clients 3. The distribution server 1 is an example of the moving image server device of the present invention. The CW server 2 is an example of the information server device of the present invention. The client 3 is an example of the terminal device of the present invention. The distribution server 1, the CW server 2 and the client 3 can communicate with each other via the network NW. The network NW includes, for example, the Internet, a mobile communication network, and a gateway. The communication system S may include a server device having both the function of the distribution server 1 and the function of the CW server 2 instead of the distribution server 1 and the CW server 2.

  The distribution server 1 transmits the content to the client 3 in response to, for example, a request from the client 3. The content includes video data. Movie data is data representing a movie. Also, the content may include audio data. The transmission of content is performed using, for example, HTTP (HyperText Transfer Protocol) live streaming via the network NW. For example, the distribution server 1 may execute live distribution in which content transmitted from a video camera is distributed in real time during shooting by a predetermined video camera. Alternatively, the distribution server 1 may store content in advance, and may distribute the stored content on demand. The distribution server 1 transmits the chunk to the client 3 as moving image data included in the content. A moving image showing the entire shooting range of the video camera is referred to as a whole moving image, taking the moving image taken by the video camera as an example. The distribution server 1 generates a plurality of chunks from moving image data indicating the entire moving image. A plurality of rectangular areas formed by dividing the whole moving image is referred to as a plurality of divided areas. Moving image data indicating moving images corresponding to each divided area, which are divided into predetermined segment time units, is referred to as a moving image block. The segment time is, for example, a natural number multiple of the moving image frame rate. The distribution server 1 transmits to the client 3 a chunk corresponding to at least one divided area overlapping with the display range designated based on the operation of the operation unit 35a by the user of the client 3 among the plurality of divided areas.

  The client 3 acquires the content distributed from the distribution server 1. The client 3 reproduces the acquired content to display a video as a moving image on the screen of the display unit 34a. During content reproduction, the client 3 receives a pseudo camerawork operation by the user using the operation unit 35a. The camera work is an operation of determining the position of the camera with respect to the subject, the angle of the camera with respect to the subject, and the size of the subject by moving the camera. In the present embodiment, the operation is performed in a pseudo manner by operating the operation unit 35a so that the user moves the camera as if the user were moving the camera with respect to the display target in the plurality of image frames constituting moving image data indicating the entire moving image. Such an operation is called a display range change operation. By this operation, the user can change the display range so that the desired display range can be specified in the entire moving image. The change operation of the display range is an operation of changing the display range. The display range is a range of the video displayed on the screen of the display unit 34 a in the entire moving image. The user can specify the position coordinates of the display range with respect to the entire moving image so as to be different for each image frame by the change operation of the display range. In addition, the user can enlarge or reduce the size of the display range for the entire moving image by changing the display range. Thereby, the image in the drawing area can be enlarged or reduced. The client 3 receives from the distribution server 1 a chunk corresponding to a divided area overlapping the display range specified based on the user's operation among the plurality of divided areas constituting the entire moving image. The client 3 causes the display unit 34 a to display the moving image within the display range of the entire moving image based on the received chunk. The client 3 may be, for example, a personal computer, a smartphone, a mobile phone, a television, a video game console, or the like.

  The CW server 2 receives the upload of camera work data from the client 3 that reproduces the content, and stores the camera work data. The camera work data is information on a pseudo camera work that indicates the display range of a moving image as the playback time of content elapses. The camerawork data includes a set of position coordinates and a size of the display range with respect to the image frame and a reproduction position of the image frame for at least each image frame for which the change operation of the display range is performed. The reproduction position is a position in time from the start of reproduction of the moving image data. The reproduction position is also referred to as a reproduction time in that it is a time elapsed from the start of reproduction of the moving image data.

[2. Configuration of each device]
Next, with reference to FIG. 1, the configuration of each device included in the communication system S of the present embodiment will be described. The distribution server 1 includes, as shown in FIG. 1, a control unit 11, a storage unit 12, an interface unit 13, and the like. These components are connected to the bus 14. The interface unit 13 is connected to the network NW. The control unit 11 is configured by a central processing unit (CPU) as a computer, a read only memory (ROM), a random access memory (RAM), and the like. The storage unit 12 is configured of, for example, a hard disk drive. The storage unit 12 stores an OS, a server program, and the like. The server program is a program that causes the CPU to execute content distribution processing and the like. Also, the storage unit 12 stores moving image data and audio data that constitute content. The moving image data and the audio data are stored in the storage unit 12 in association with the content ID. The content ID is identification information that identifies the content. In addition, the storage unit 12 stores, for each content, a chunk corresponding to each moving image obtained by dividing each of moving images of a plurality of divided areas at segment time intervals. Each chunk is stored in the storage unit 12 in association with the content ID, the divided area ID, and the reproduction position. The content ID indicates the content of the entire moving image including the moving image indicated by the target chunk. The division area ID is identification information for identifying a division area corresponding to the target chunk. The divided area ID is an example of identification information of the present invention. As the reproduction position, the reproduction position at the beginning of the moving image indicated by the target chunk is stored.

  Next, as shown in FIG. 1, the CW server 2 is configured to include a control unit 21, a storage unit 22, an interface unit 23, and the like. These components are connected to the bus 24. The interface unit 23 is connected to the network NW. The control unit 21 includes a CPU as a computer, a ROM, a RAM, and the like. The storage unit 22 is configured of, for example, a hard disk drive. The storage unit 22 stores an OS, a server program, and the like. The server program is a program that causes the CPU to execute reception and distribution processing of camera work data. In addition, the camera work data received from the client 3 is stored in the storage unit 22. Each piece of camera work data is stored in the storage unit 12 in association with the content ID and the user ID. The content ID indicates the content reproduced by the client 3 in the display range indicated by the target camera work data. The user ID is identification information for identifying the user who has performed the pseudo camera work operation indicated by the target camera work data. The user ID is also information for identifying the client 3 used by the user. The user ID is an example of the terminal device identification information of the present invention. Note that the IP address of the client 3 may be used as the terminal device identification information.

  Next, as shown in FIG. 1, the client 3 includes a control unit 31, a storage unit 32, a video RAM 33, a video control unit 34, an operation processing unit 35, an audio control unit 36, an interface unit 37, and the like. Ru. These components are connected to the bus 38. A display unit 34 a having a display is connected to the image control unit 34. The control unit 31 includes a CPU as a computer, a ROM, a RAM, and the like. An operation unit 35 a is connected to the operation processing unit 35. The operation unit 35a includes, for example, a mouse, a keyboard, and a remote control. A touch panel that doubles as the display unit 34a and the operation unit 35a may be applied. The control unit 31 receives an operation instruction from the operation unit 35 a by the user via the operation processing unit 35. A speaker 36 a is connected to the voice control unit 36. The interface unit 37 is connected to the network NW. The storage unit 32 includes, for example, a hard disk drive or a flash memory. The storage unit 32 stores an OS, player software, and the like. The player software is a program that causes the CPU to execute content reception and reproduction processing and the like.

[3. Delivery of camera work data according to the operation of the display range]
Next, delivery of camera work data according to the operation of the display range will be described using FIG. During playback of content, the user may not know which part of the entire video to view, or may not find a part in the entire video where the user is interested. In this case, the user may continue to change the display range unnecessarily, or may keep the display range fixed to a part that many other users do not see. Then, the transmission load of chunks to the client 3 by the distribution server 1 increases. This problem will be specifically described below.

  The client 3 requests the distribution server 1 to distribute a chunk corresponding to a divided area that at least partially overlaps the display range specified based on the operation of the display range among the plurality of divided areas. For example, the client 3 sends to the distribution server 1 a chunk distribution request including the content ID of the content being reproduced, the divided region ID of the specified divided region, the current reproduction position of the content, and the user ID of the user who uses the client 3 Send. The distribution server 1 acquires from the storage unit 12 the chunk corresponding to the content ID, the divided area ID, and the reproduction position included in the chunk distribution request, and transmits the chunk to the client 3. The client 3 causes the display unit 34 a to display the moving image within the specified display range among the entire moving images, based on the chunk received from the distribution server 1. In a state where the display range is not changed, the client 3 can display the moving image for the segment time using only the chunk received from the distribution server 1. However, the display range may be moved to the outside of the display range before the change or the display range may be expanded by the change operation of the display range. Then, at least a part of the moving image within the display range after the change may not be able to be displayed only with the previously received chunk. Therefore, the client 3 requests distribution of the chunk to the distribution server 1 again based on the display range after the change. As the degree of change in display range increases, the request for chunk delivery increases. Therefore, the transmission load of the chunk by the distribution server 1 increases as the degree of the change operation of the display range increases.

  Also, for example, it is assumed that the communication system S includes a CDN composed of a plurality of servers and distributes chunks using the CDN. For example, the client 3 transmits a chunk distribution request to any one of a plurality of servers constituting the CDN. If the chunk requested from the client 3 is not cached in any server of the CDN, the chunk is first transmitted from the distribution server 1 to the CDN. The chunks sent to the CDN are at least cached by the server that received the chunk distribution request from the client among the plurality of servers that configure the CDN, and the chunk is distributed from the server that received the chunk distribution request to the client 3 Ru. When the chunk requested from the client 3 is cached in the server that has received the chunk delivery request among a plurality of servers constituting the CDN, the chunk is delivered directly from the server to the client 3. When the chunk requested from the client 3 is cached in a server different from the server that has received the chunk distribution request among the plurality of servers that configure the CDN, for example, the server that received the chunk distribution request requests the requested chunk. Get a chunk from the caching server. The server receiving the chunk distribution request caches the acquired chunks and transmits the chunks to the client 3. When the amount of chunks cached in the CDN increases, for example, caches of relatively infrequently requested chunks and chunks with old request dates and times are deleted from the servers configuring the CDN. Since the chunk transmission load is distributed to a plurality of servers constituting the CDN, the chunk distribution efficiency is improved. In addition, the transmission load of chunks by the distribution server 1 is reduced. However, in the whole moving image, the lower the probability that another user sees, the higher the probability that the chunk corresponding to that part is not cached in the CDN. Therefore, there is a high probability that the distribution server 1 needs to transmit a chunk corresponding to the portion to the CDN. Therefore, the lower the probability that another user sees the part where the display range is set is, the more the transmission load of the chunk by the distribution server 1 increases.

  Therefore, the distribution server 1 or the client 3 can increase the transmission load of chunks to the client 3 by the distribution server 1 according to the state of the display range specified based on the operation of the display range received from the user by the client 3 It is determined whether the degree exceeds a predetermined degree. The degree to which the transmission load is increased may be, for example, an increase amount, an increase rate, etc. of the transmission load. The distribution server 1 or the client 3 may determine whether the amount of increase exceeds a predetermined amount or may determine whether the rate of increase in transmission load exceeds a predetermined rate. Alternatively, the distribution server 1 or the client 3 may determine whether the transmission load of the chunk exceeds a predetermined load by the increase of the transmission load. If it is determined that the degree to which the transmission load is increased exceeds the predetermined degree, the distribution server 1 or the client 3 causes the CW server 2 to distribute predetermined camera work data to the client 3. For example, the distribution server 1 or the client 3 determines whether or not the received operation of the display range is an operation exceeding a predetermined degree, and when it is determined that the operation exceeds the predetermined degree, the predetermined camera work data is CW It may be distributed to the client 3 by the server 2. When camera work data is distributed by the CW server 2, the distribution server 1 or the client 3 transmits a camera work distribution request to the CW server 2. In the present embodiment, the client 3 performs such determination and transmission of the request, but the distribution server 1 may perform the transmission.

  The client 3 having received the camerawork data from the CW server 2 performs chunk distribution for requesting distribution of a chunk corresponding to a divided area that at least partially overlaps the display range specified based on the received camerawork data Send a request to the distribution server 1 The client 3 receiving the chunk from the distribution server 1 causes the display unit 34a to display the moving image within the display range specified based on the camera work data among the entire moving image based on the received chunk. That is, the client 3 automatically changes the display range as the playback time elapses based on the camera work data. This makes it possible to prevent unnecessary change of the display range by the user or the state in which the display range remains fixed to a part that is not viewed by many other users. Therefore, the user can enjoy the animation through the use of the communication system S. Also, the transmission load of chunks by the distribution server 1 can be reduced.

  The CW server 2 may distribute only one piece of camera work data, or may distribute two or more pieces of camera work data. The client 3 receiving the camera work data from the CW server 2 displays the moving image within the display range based on the current user operation, and displays a sample of how the moving image looks when the received camera work data is used. You may The user selects camerawork data to be used for determining the display range from at least one camerawork data with reference to the sample. The client 3 reproduces the content using the selected camera work data.

  FIG. 2A is a diagram showing an example of the position of the display range in the whole moving image. As shown in FIG. 2A, in the whole moving image HI, the display range VA is moved to the video portion of the illumination based on the operation of the user A. At this time, based on the state of the display range VA, the client 3 used by the user A determines that the extent to which the transmission load of the chunk by the distribution server 1 is increased exceeds a predetermined level. Among the plurality of users viewing the same content as the content viewed by the user A, the CW server 2 generates camera work data of the users B to D for distributing the camera work data of the users B to D to the client 3 of the user A Suppose you decide. In FIG. 2A, the display range DVA1 is a display range specified by the user B. The display range DVA2 is a display range specified by the user C. The display range DVA3 is a display range specified by the user D. The display ranges DVA1 to DVA3 are located in the image portions of the upper body of different persons.

  FIG. 2B is a diagram showing an example of the screen of the display unit 34 a of the client 3. As shown in FIG. 2B, on the screen of the display unit 34a, the main screen MS is displayed. Of the entire moving image HI, the main screen MS displays a moving image within the display range VA. If it is determined that the extent to which the transmission load of chunks by the distribution server 1 is increased exceeds a predetermined degree, sub screens SS1 to SS3 are displayed in addition to the main screen MS. On the sub-screen SS1, still images in the display range DVA1 of the image frames corresponding to the playback position when it is determined that the extent to which the chunk transmission load is increased exceeds the predetermined degree in the entire moving image HI. Is displayed as a sample. On the sub-screen SS2, still images in the display range DVA2 of the image frames corresponding to the reproduction position when it is determined that the extent to which the chunk transmission load is increased exceeds the predetermined degree in the entire moving image HI. Is displayed as a sample. On the sub-screen SS3, a still image in the display range DVA3 of the image frame corresponding to the reproduction position when it is determined that the extent to which the chunk transmission load is increased exceeds the predetermined degree in the entire moving image HI. Is displayed as a sample. The user A can select desired camera work data by selecting any of the subscreens SS1 to SS3. The sub screen may be displayed in the main screen MS.

  As a first example of the state of the display range, there is a state in which the change of the display range is continuing. The client 3 may determine whether the duration of the change operation of the display range accepted by the client 3 exceeds a predetermined time. This determination is an example of determining whether or not the received operation of the display range is an operation exceeding a predetermined degree. As the duration of the change operation of the display range is longer, more chunk distribution requests are transmitted, and the transmission load of the chunk by the distribution server 1 increases. When the duration of the change operation exceeds the predetermined time, the client 3 causes the CW server 2 to distribute camera work data to the client 3.

  As a second example of the state of the display range, there is a state in which the display range is moving. The client 3 may determine whether the moving distance of the display range based on the change operation exceeds a predetermined distance. This determination is an example of determining whether or not the received operation of the display range is an operation exceeding a predetermined degree. As the moving distance of the display range is longer, a large number of chunk distribution requests are transmitted, so the transmission load of chunks by the distribution server 1 increases. Here, the client 3 may specify, for example, a linear distance between the position of the display range before movement and the position of the display range after movement as the movement distance. Also, for example, the client 3 may specify the length of the trace drawn by the display range as the movement distance. In addition, the client 3 may determine that the movement distance of the display range exceeds the predetermined distance each time the cumulative distance of the movement of the display range exceeds the predetermined distance. In addition, the client 3 may determine whether the distance the display range has moved by one change operation exceeds a predetermined distance. Also, for example, the client 3 may determine whether the distance by which the display range has moved within the predetermined time exceeds the predetermined distance.

  A third example of the state of the display range is the position of the display range. The display range specified based on the operation accepted by the client 3 determined to have the degree to which the transmission load is increased exceeds the predetermined degree is referred to as a target display range. The client 3 determines whether the target display range is an outlier in the distribution of the plurality of display ranges specified by each of the plurality of clients 3 at the same playback position as the playback position where the target display range is specified. It is also good. In the whole moving image corresponding to a certain reproduction position, the more the target display range specified by one client 3 deviates from the display range specified by a large number of other clients 3, the division corresponding to the target display range There is a high probability that the chunks of the area are not cached in the CDN. Therefore, the transmission load of the chunk by the distribution server 1 increases. In order to determine whether the target display range is an outlier, the client 3 determines the display range specified by the other client 3 based on the camera work data uploaded from the other client 3 to the CW server 2. It may be specified. For example, the client 3 acquires, from the CW server 2, camera work data of all the other clients 3 in which the client 3 reproduces or is reproducing the same content as the content being reproduced. At this time, the client 3 may obtain at least camera work data corresponding to the current reproduction position. As a method of determining whether the target display range is an outlier, for example, various known methods can be used. For example, when using clustering, the client 3 clusters the plurality of display ranges specified by the plurality of clients 3 at the position of the display range. For example, the client 3 includes display ranges relatively close to each other in the same cluster. The client 3 determines that the target display range is an outlier when the number of display ranges belonging to the cluster into which the target display range is classified is less than a predetermined ratio of the number of all the display ranges. When it is determined whether or not the display range is an outlier on the distribution server 1 side, camera work data may be used as a method of specifying the display range in the same manner as described above. The chunk distribution request sent to may be used. In this case, the distribution server 1 stores the received chunk distribution request in the storage unit 11. The distribution server 1 can roughly specify the display range based on the divided area ID included in the chunk distribution request.

  The camera work data distributed from the CW server 2 to the client 3 when it is determined that the extent to which the transmission load of the chunk to the client 3 by the distribution server 1 is increased exceeds a predetermined degree is, for example, from other clients 3 It may be uploaded camera work data. Since the client 3 requests delivery of a chunk corresponding to the same display range as the display range specified by the other client 3, when using the CDN, the probability that the requested chunk is cached in the CDN is high .

  When camera work data to be distributed is determined from among a plurality of camera work data uploaded from a plurality of other clients 3, the CW server 2 has a predetermined degree to which, for example, the transmission load of chunks by the distribution server 1 is increased. Camerawork data of another user having the same or similar attribute as the attribute of the user who uses the client 3 determined to be above the degree may be determined as the camerawork data to be distributed. Multiple users having the same or similar attributes are likely to manipulate the display range in the same manner. Therefore, the user can enjoy the moving image by reproducing the moving image using camera work data of another user having the same or similar attributes. For example, the storage unit 22 of the CW server 2 may store attributes such as the age of each user. The CW server 2 may determine camera work data of another user having the same age as the user's age as camera work data to be distributed. Further, for example, the distribution server 1 may store the viewing history of the content of each user in the storage unit 12. Then, the CW server 2 may specify, as an attribute of the user, the genre of the content that the user likes based on the viewing history. The CW server 2 may determine, as camera work data to be distributed, camera work data of another user who likes the same genre as the user prefers.

  The CW server 2 may determine, for example, camera work data having a relatively high degree of popularity as camera work data to be distributed. For example, when the client 3 reproduces a content, the CW server 2 transmits a plurality of pieces of camera work data corresponding to the content to the client 3 as candidates for camera work data to be used. The user selects any one of a plurality of camera work data. During playback of content, the client 3 changes the display range according to the elapsed playback time based on the selected camera work data. The more frequently used camerawork data is the more frequently used camerawork data, the more popular it is. Therefore, the higher the degree of popularity of camera work data, the higher the probability that a chunk corresponding to the display range indicated by that camera work data is cached in the CDN. Therefore, the transmission load of chunks by the distribution server 1 can be reduced. In addition, the display range indicated by the highly popular camera work data has a high probability of being set to a highlight part of the entire moving image. Therefore, the user can enjoy the moving image by reproducing the moving image using such camera work data.

  The CW server 2 distributes, for example, camera work data in which the duration of the change operation of the display range does not exceed a predetermined time, or camera work data in which the movement distance of the display range based on the change operation does not exceed the predetermined distance. You may decide to

  In the case of on-demand delivery, for example, a manager of the communication system S, a creator of content, or the like may create camera work data. At this time, camerawork data is created so that the display range is set and changed in the highlight part. The camera work data may be created so that the duration of the change operation of the display range does not exceed the predetermined time, or the movement distance of the display range based on the change operation does not exceed the predetermined distance. The storage unit 22 of the CW server 2 stores in advance one or more camera work data corresponding to each content. The CW server 2 delivers camera work data stored in advance in the storage unit 22 to the client 3.

  The client 3 may determine camera work data to be distributed from the CW server 2 to the client 3.

[4. Modified example]
If it is determined that the extent to which the transmission load of chunks by the distribution server 1 is increased exceeds a predetermined degree, the client 3 may distribute advertisement information to the client 3 by the CW server 2 instead of camera work data. The advertisement information may be, for example, a moving image indicating an advertisement, a still image, character data, or the like. In this case, the storage unit 22 of the CW server 2 stores one or more pieces of advertisement information. The camera work data may not be stored in the storage unit 22. The client 3 having received the advertisement information from the CW server 2 causes the display unit 34 a to display the advertisement information. Note that the advertisement information may be stored in advance in the storage unit 32 of the client 3, and the client 3 may store and display the advertisement information. Unnecessary operation of the display range by the user can be stopped by turning the attention of the user from the content to the advertisement information. Therefore, the transmission load of the chunk by the distribution server 1 can be reduced.

  FIG. 3A is a view showing an example of the screen of the display unit 34 a of the client 3. When it is determined that the extent to which the transmission load of the chunk by the distribution server 1 is increased exceeds a predetermined degree, as shown in FIG. 3A, for example, the advertisement information AD1 to AD3 is displayed in addition to the main screen MS. Be done. Advertisement information may be displayed in the main screen MS. Also, the client 3 may stop the reproduction of the content to display the advertisement information, or may delete the main screen MS to display the advertisement information. In this case, the client 3 does not need to transmit a chunk distribution request to the distribution server 1. Therefore, the transmission load of the chunk by the distribution server 1 can be further reduced.

  When it is determined that the received operation of the display range is an operation exceeding a predetermined degree, the client 3 may cause the display unit 34a to display warning information. The warning information is a message indicating that the operation of the display range is prohibited when the operation of the display range exceeding a predetermined degree is further performed. By displaying such advertisement information, unnecessary operation of the display range by the user can be stopped. Therefore, the transmission load of the chunk by the distribution server 1 can be reduced. In this case, the CW server 2 is unnecessary in the communication system S.

  FIG. 3B is a view showing an example of the screen of the display unit 34 a of the client 3. When it is determined that the received operation of the display range is an operation exceeding a predetermined degree, the warning information AL is displayed on the main screen MS as shown in FIG. 3 (B). As warning information, for example, "an abnormal operation has been detected for a predetermined time or more. If similar operations are continued, it may become impossible to view". Is displayed. The warning information may be displayed on the outside of the main screen MS.

[5. Operation of Communication System S]
Next, the operation of the communication system S will be described with reference to FIGS. 4 and 5. The operation example described below is an example of performing live distribution. FIG. 4 is a flowchart showing an example of processing in the control unit 31 of the client. For example, the user operates the operation unit 35a to select content to be reproduced, and instructs the client 3 to reproduce the content. Thereby, the control unit 31 executes the process shown in FIG.

  As shown in FIG. 4, the control unit 31 sets the position coordinates and size of the display range to default position coordinates and size, and displays a moving image within the display range on the display unit 34a (step S1). Specifically, the control unit 31 sets the content position of the content to be reproduced, the divided region ID of the divided region overlapping the default display range among the plurality of divided regions constituting the whole moving image, the reproduction position set to 0 seconds Send a chunk distribution request including the above to the distribution server 1. The control unit 31 displays the moving image within the display range based on the chunk transmitted from the distribution server 1.

  Next, the control unit 31 generates a set of position coordinates of the current display range, a size, and a reproduction position set to 0 seconds as overall camera work data used for determining the display range, and stores the storage unit 32. Remember. The entire camera work data indicates the display range from the start of reproduction to the current reproduction position. The generated entire camera work data is an example of the first camera work information of the present invention. The control unit 31 transmits a camera work registration request including the content ID of the content to be reproduced, the user ID of the user who uses the client 3, and the entire generated camera work data to the CW server 2 (step S2).

  Next, the control unit 31 determines whether the reproduction of the content ends (step S3). For example, when the user detects an operation of ending the reproduction of the content, the control unit 31 determines that the reproduction of the content is ended. Further, when the control unit 31 receives an end notification from the distribution server 1 in response to the transmission of the chunk distribution request, the control unit 31 determines that the reproduction of the content is ended. When the control unit 31 determines that the reproduction of the content is not completed (step S3: NO), the process proceeds to step S4.

  In step S4, the control unit 31 determines whether camera work data of another user has been received from the CW server 2. At this time, if the control unit 31 determines that camera work data of another user has been received (step S4: YES), the process proceeds to step S5. On the other hand, when the camera work data of another user has not been received (step S4: NO), the control unit 31 proceeds to step S7.

  In step S5, the control unit 31 determines whether the use of camera work data of another user is selected by the user based on the operation of the operation unit 35a by the user. At this time, if the control unit 31 determines that use of camera work data of another user is selected (step S5: YES), the process proceeds to step S6. On the other hand, when the control unit 31 determines that use of camera work data of another user is not selected (step S5: NO), the process proceeds to step S7.

  In step S6, the control unit 31 changes the display range based on camera work data selected by the user among camera work data of other users received from the CW server 2. Specifically, the camera work data selected by the user is stored in the storage unit 32 as camera work data of the entire other user. Further, the control unit 31 acquires position coordinates and a size corresponding to the current reproduction position from the camera work data of the other users stored in the storage unit 32. The control unit 31 changes the position coordinates and size of the current display range to the acquired position coordinates and size.

  Next, the control unit 31 requests the chunk distribution including the content ID of the content to be reproduced, the divided region ID of the divided region overlapping the current display range among the plurality of divided regions constituting the whole moving image, and the current reproduction position Are sent to the distribution server 1 (step S7). Next, the control unit 31 determines whether a chunk has been received from the distribution server 1 (step S8). At this time, when the control unit 31 determines that a chunk has not been received from the distribution server 1 (step S8: NO), the control unit 31 executes the determination of step S8 again. On the other hand, when the control unit 31 determines that a chunk has been received from the distribution server 1 (step S8: YES), the process proceeds to step S9.

  In step S9, the control unit 31 reproduces the received chunk. Specifically, based on the received chunk, the control unit 31 causes the display unit 34 a to display the moving image within the current display range of the entire moving image.

  Next, the control unit 31 determines whether camera work data of another user is currently used (step S10). In step S5, after determining that use of camera work data of another user is selected, control unit 31 determines that camera work data of another user is currently used (step S10: YES). ). In this case, the control unit 31 proceeds to step S11. On the other hand, when the control unit 31 determines that camera work data of another user is not currently used (step S10: NO), the process proceeds to step S12.

  In step S11, the control unit 31 acquires, from the CW server 2 as the latest camera work data, a set including the position coordinates, the size, and the reproduction position of the latest display range among the camera work data of the other users. Then, the camera work data of the other users stored in the storage unit 32 is updated. For example, the control unit 31 transmits, to the CW server 2, a camera work distribution request including the content ID of the content to be reproduced and the user ID of another user corresponding to the camera work data to be used. The control unit 31 receives the latest camera work data transmitted from the CW server 2. Then, the control unit 31 adds the received latest camera work data to the entire camera work data of the other users stored in the storage unit 32.

  Next, the control unit 31 determines whether or not the chunk reproduction has ended (step S12). At this time, when the control unit 31 determines that the reproduction of the chunk is completed (step S12: YES), the process proceeds to step S3. On the other hand, when the control unit 31 determines that the reproduction of the chunk is not completed (step S12: NO), the process proceeds to step S13.

  In step S13, the control unit 31 determines whether a change in the display range is detected. Specifically, when an operation for changing the display range by the user is detected by the operation of the operation unit 35a, the control unit 31 determines that the change in the display range is detected. In addition, when the control unit 31 updates the entire camera work data of the other user in step S11, at least position coordinate and size corresponding to the latest reproduction position among the entire camera work data of the other user. If one is different from at least one of the position coordinates and the size of the current display range, it is determined that the change of the display range is detected. When the control unit 31 determines that the change of the display range is detected (step S13: YES), the process proceeds to step S14. On the other hand, when the control unit 31 determines that the change of the display range is not detected (step S13: NO), the control unit 31 proceeds to step S9 and continues the reproduction of the chunk.

  In step S14, the control unit 31 changes the current display range. When the change operation of the display range by the user is detected, the control unit 31 specifies the position coordinates and the size of the display range after the change based on the change operation. When the entire camera work data of another user is updated in step S11, the control unit 31 acquires position coordinates and a size corresponding to the latest reproduction position from the entire camera work data of the other user. The control unit 31 changes the position coordinates and size of the current display range to the acquired position coordinates and size.

  Next, the control unit 31 generates a set of position coordinates and a size of the display range after the change and the current reproduction position as the latest camera work data. The latest camerawork data generated is an example of the second camerawork information of the present invention. The control unit 31 updates the entire camerawork data used to determine the display range by adding the generated latest camerawork data to the entire camerawork data used to determine the display range. In addition, the control unit 31 transmits a camera work update request including the content ID of the content to be reproduced, the user ID of the user who uses the client 3, and the latest generated camera work data to the CW server 2 (step S15). ).

  Next, the control unit 31 determines whether the extent to which the distribution server 1 increases the transmission load of chunks to the client 3 exceeds a predetermined level, based on the state of the specified display range (step S16). The specific determination method has already been described. If the control unit 31 determines that the degree to which the chunk transmission load is increased exceeds a predetermined degree (step S16: YES), the process proceeds to step S17. On the other hand, when the control unit 31 determines that the extent to which the chunk transmission load is increased does not exceed the predetermined degree (step S16: NO), the process proceeds to step S3.

  In step S17, the control unit 31 determines which user's camera work data is to be distributed from the CW server 2 among a plurality of other users viewing the selected content. The method of determining camera work data distributed from the CW server 2 has already been described. The control unit 31 transmits a camera work distribution request including the determined user ID of at least one other user and the content ID of the content to be reproduced to the CW server 2. Next, the control unit 31 determines whether the latest camera work data of another user has been received from the CW server 2 (step S18). At this time, when the control unit 31 determines that the latest camera work data of another user is received (step S18: YES), the process proceeds to step S19. On the other hand, when it is determined that the latest camera work data of another user is not received (step S18: NO), the control unit 31 executes the determination of step S18 again.

  In step S19, the control unit 31 causes the display unit 34a to display a sample of how the moving image looks when the received camera work data is used based on the received latest camera work data of another user. For example, the control unit 31 acquires position coordinates and a size from each of the received camera work data. The control unit 31 determines the content ID of the content to be reproduced, the divided region ID of the divided region overlapping the display range of the other user indicated by the acquired position coordinates and size among the plurality of divided regions constituting the whole moving image, and A chunk distribution request including the current reproduction position is transmitted to the distribution server 1. The control unit 31 acquires an image frame corresponding to the current reproduction position from the chunk transmitted from the distribution server 1. The control unit 31 displays still images within the display range of the other user as a sample of how the moving image looks based on the acquired image frame. After completing step S19, the control unit 31 proceeds to step S3.

  In step S3, when the control unit 31 determines that the reproduction of the content ends (step S3: YES), the process illustrated in FIG. 4 is ended.

  FIG. 5A is a flowchart showing an example of processing in the control unit 11 of the distribution server 1. For example, when the distribution server 1 is powered on, the control unit 11 executes the process shown in FIG. As shown in FIG. 5A, the control unit 11 determines whether the power OFF of the distribution server 1 has been requested based on the operation by the administrator (step S21). At this time, when the control unit 11 determines that the power OFF is not requested (step S21: NO), the process proceeds to step S22.

  In step S22, the control unit 11 determines whether a chunk distribution request has been received from any of the clients 3. At this time, if the control unit 11 determines that the chunk distribution request has been received (step S22: YES), the process proceeds to step S23. On the other hand, when the control unit 11 determines that the chunk distribution request has not been received (step S22: NO), the control unit 11 proceeds to step S21.

  In step S23, the control unit 11 sets the reproduction position included in the chunk distribution request among the chunks stored in the storage unit 11 corresponding to the content ID and the divided area ID included in the received chunk distribution request. It is determined whether a corresponding chunk exists. At this time, when the control unit 11 determines that there is a chunk (step S23: YES), the process proceeds to step S24. On the other hand, when the control unit 11 determines that there is no chunk (step S23: NO), the process proceeds to step S25.

  In step S24, the control unit 11 transmits the chunk determined to exist to the client 3 that has transmitted the chunk distribution request, and the process proceeds to step S21.

  In step S25, the control unit 11 transmits an end notification to the client 3 that has transmitted the chunk distribution request, and proceeds to step S21.

  In step S21, when it is determined that the power OFF has been requested (step S21: YES), the control unit 11 ends the process illustrated in FIG. 5A.

  FIG. 5B is a flowchart showing an example of processing in the control unit 21 of the CW server 2. For example, when the power supply of the CW server 2 is turned on, the control unit 21 executes the process shown in FIG. 5 (B). As shown in FIG. 5B, the control unit 21 determines whether or not the power OFF of the CW server 2 has been requested based on the operation by the administrator (step S31). At this time, when the control unit 21 determines that the power OFF is not requested (step S31: NO), the process proceeds to step S32.

  In step S32, the control unit 21 determines whether a camera work registration request has been received from any of the clients 3. At this time, if the control unit 21 determines that the camera work registration request has been received (step S32: YES), the process proceeds to step S33. On the other hand, when the control unit 21 determines that the camera work registration request has not been received (step S32: NO), the process proceeds to step S34.

  In step S33, the control unit 21 stores the entire camera work data included in the camera work registration request in the storage unit 22 in association with the content ID and the user ID included in the camera work registration request. Next, the control unit 21 proceeds to step S31.

  In step S34, the control unit 21 determines whether a camera work distribution request has been received from any of the clients 3. At this time, if the control unit 21 determines that the camera work distribution request has been received (step S34: YES), the process proceeds to step S35. On the other hand, when the control unit 21 determines that the camera work distribution request has not been received (step S34: NO), the process proceeds to step S36.

  In step S35, the control unit 21 obtains the latest reproduction position from the entire camera work data stored in the storage unit 22 corresponding to the content ID and the user ID contained in the received camera work distribution request. A set of position coordinates and a size corresponding to the reproduction position is acquired as the latest camera work data. The control unit 21 transmits the acquired latest camerawork data to the client 3 that has transmitted the camerawork distribution request. Next, the control unit 21 proceeds to step S31.

  In step S36, the control unit 21 determines whether a camera work update request has been received from any of the clients 3. At this time, if the control unit 21 determines that the camera work update request has been received (step S36: YES), the process proceeds to step S37. On the other hand, when the control unit 21 determines that the camera work update request has not been received (step S36: NO), the process proceeds to step S31.

  In step S37, the control unit 21 includes the camerawork update request in the entire camerawork data stored in the storage unit 22 corresponding to the content ID and the user ID included in the received camerawork update request. Update the entire camera work data by adding the latest camera work data. Next, the control unit 21 proceeds to step S31.

  In step S31, when the control unit 21 determines that the power OFF has been requested (step S31: YES), the process illustrated in FIG. 5B is ended.

  As described above, according to the present embodiment, the client 3 can increase the transmission load of the chunk by the distribution server 1 according to the state of the display range specified based on the received operation, to a predetermined degree. To determine if When it is determined that the degree to which the transmission load is increased exceeds the predetermined degree, the client 3 causes the CW server 2 to transmit predetermined camera work data to the client 3. The client 3 receives from the distribution server 1 a chunk corresponding to a divided area overlapping a display range specified based on the camera work data received from the CW server 2 among a plurality of divided areas constituting the entire moving image . The client 3 displays the moving image within the display range specified based on the camera work data received from the CW server 2 in the entire moving image based on the received chunk. Therefore, the client 3 can display the moving image so that the user can enjoy the moving image even when it is not known which part of the whole moving image should be viewed. Also, the transmission load of chunks by the distribution server 1 can be reduced.

Reference Signs List 1 distribution server 2 CW server 3 client 11, 21, 31 control unit 12, 22, 32 storage unit 34a display unit 35a operation unit S communication system

Claims (13)

In a communication system comprising: a terminal device for playing a moving image; and a moving image server device for transmitting the moving image to the terminal device,
The video server device is
Moving image data storage means for storing each of a plurality of divided moving image data indicating moving images of a plurality of divided regions obtained by dividing the entire region of the moving image in association with identification information for identifying the divided regions corresponding to the divided moving image data;
Identification information receiving means for receiving, from the terminal device, identification information for identifying at least one of the plurality of divided areas;
A moving image data transmitting unit for transmitting, to the terminal device, divided moving image data corresponding to the identification information received by the identification information receiving unit among the plurality of divided moving image data stored in the moving image data storage unit;
Equipped with
The terminal device is
Accepting means for accepting an operation of a display range to be displayed among all the areas of the moving image;
Identification information transmitting means for transmitting, to the moving picture server device, identification information for identifying a divided area overlapping a display range specified based on the operation accepted by the accepting means among the plurality of divided areas;
Moving image data receiving means for receiving the divided moving image data transmitted from the moving image server apparatus;
A display for displaying a moving image within the display range specified based on the operation received by the receiving unit among all areas of the moving image based on the divided moving image data received by the moving image data receiving unit Means,
Information receiving means for receiving, from a predetermined information server apparatus, camera work information indicating a predetermined display range of all the regions of the moving image along with an elapse of a reproduction time of the moving image;
Equipped with
The video server device or the terminal device is
A determination unit that determines whether a degree to which the transmission load of divided moving image data by the moving image server device is increased exceeds a predetermined degree according to the state of the display range specified based on the operation received by the receiving unit; ,
Control means for causing the information server device to transmit the camera work information to the terminal device when it is determined that the degree to which the transmission load is increased exceeds the predetermined degree by the determination means;
And further
When the camerawork information is received by the information reception means, the identification information transmission means identifies a division area overlapping the display range specified based on the camerawork information among the plurality of division areas Communication is performed by transmitting information, and displaying the moving image within a display range specified based on the camera work information received by the information receiving unit among the entire area of the moving image. system. The determination means determines whether the duration of the operation accepted by the acceptance means exceeds a predetermined time,
The communication system according to claim 1, wherein the control means causes the camerawork information to be transmitted when the determination means determines that the duration time exceeds the predetermined time. The determination means determines whether the display range moves beyond a predetermined distance based on the operation accepted by the acceptance means,
The communication system according to claim 1, wherein the control unit causes the camerawork information to be transmitted when it is determined by the determination unit that the display range moves beyond the predetermined distance. The communication system comprises a plurality of the terminal devices.
In the distribution of a plurality of display ranges specified by each of the plurality of terminal devices at the same reproduction time as the reproduction time in which the display range is specified based on the operation received by the reception means, the determination means Determining whether a display range specified based on the operation accepted by the acceptance unit is an outlier;
The communication according to any one of claims 1 to 3, wherein the control means causes the camerawork information to be transmitted when the determination means determines that the display range is the outlier. system. The terminal device
The determination means;
The control means for transmitting a request for transmitting the camera work information to the information server device when it is determined by the determination means that the extent to which the transmission load is increased exceeds the predetermined degree;
Equipped with
The communication system according to any one of claims 1 to 4, wherein the information server device transmits the camera work information to the terminal device when the request is received from the terminal device. The communication system comprises a plurality of the terminal devices.
The terminal device is
A first information transmitting unit that transmits, to the information server device, first camera work information indicating a display range at the start of reproduction of the moving image;
A second information transmission unit that transmits, to the information server apparatus, second camera work information indicating a display range specified based on the operation received by the reception unit;
And further
The information server device is
First information receiving means for receiving the first camera work information transmitted from the terminal device;
Terminal device identification information that identifies, among the plurality of terminal devices, the terminal device that has transmitted the first camera work information, using the first camera work information received by the first information receiving unit as the camera work information; Information storage means for storing in association with each other
Second information receiving means for receiving the second camera work information transmitted from the terminal device;
The second camera work information received by the second information receiving means is associated with terminal device identification information identifying a terminal device that has transmitted the second camera work information among the plurality of terminal devices, Adding means for adding to the camera work information stored in the information storage means;
A terminal device provided with a receiving unit that has received the operation determined that the degree to which the transmission load is increased by the determining unit exceeds the predetermined degree among the plurality of pieces of camera work information stored in the information storage unit Camera work information transmission means for transmitting the latest camera work information corresponding to the terminal device identification information identifying a different terminal device from the above;
The communication system according to any one of claims 1 to 5, comprising: When the control means determines that the degree to which the transmission load is increased is greater than the predetermined degree by the determination means, the information server device causes the terminal not to display the camerawork information but to display advertisement information indicating an advertisement. Send to device,
The information receiving means receives the advertisement information transmitted from the information server device,
The communication system according to any one of claims 1 to 5, wherein the display means displays the advertisement information when the advertisement information is received by the information receiving means. The determination means determines whether the operation accepted by the acceptance means is an operation exceeding a predetermined degree,
When the determination means determines that the operation is an operation exceeding the predetermined degree, the control means does not transmit the camera work information by the information server device, and the display means exceeds the predetermined degree. The communication system according to any one of claims 1 to 5, wherein warning information indicating that the operation of the display range is prohibited is displayed when the operation of the display range is further performed. In the moving image server device included in a communication system including a terminal device for reproducing a moving image and a moving image server device for transmitting the moving image to the terminal device,
Moving image data storage means for storing each of a plurality of divided moving image data indicating moving images of a plurality of divided regions obtained by dividing the entire region of the moving image in association with identification information for identifying the divided regions corresponding to the divided moving image data;
When an operation of a display range to be displayed among all areas of the moving image is accepted by the terminal device, identification information for identifying a divided area overlapping the display range among the plurality of divided areas is transmitted from the terminal apparatus Identification information receiving means to receive;
A moving image data transmitting unit for transmitting, to the terminal device, divided moving image data corresponding to the identification information received by the identification information receiving unit among the plurality of divided moving image data stored in the moving image data storage unit;
A determination unit that determines whether the extent to which the transmission load of divided moving image data by the moving image server device is increased exceeds a predetermined degree according to the state of the display range specified based on the operation accepted by the terminal device; ,
When it is determined by the determination unit that the degree to which the transmission load is increased is determined to exceed the predetermined degree, camerawork information indicating a predetermined display range in the entire area of the moving picture along with the playback time of the moving picture Control means for transmitting a predetermined information server apparatus to the terminal apparatus;
An animation server apparatus comprising: In the terminal device included in a communication system including a terminal device for reproducing a moving image and a moving image server device for transmitting the moving image to the terminal device,
Accepting means for accepting an operation of a display range to be displayed among all the areas of the moving image;
Identification for transmitting, to the moving image server apparatus, identification information identifying a divided region overlapping a display range specified based on the operation received by the receiving unit among a plurality of divided regions obtained by dividing the entire region of the moving image Information transmission means,
The plurality of divided moving pictures stored in a moving picture data storage unit that stores each of a plurality of divided moving picture data indicating moving pictures of the plurality of divided areas in association with identification information identifying a divided area corresponding to the divided moving picture data Moving image data receiving means for receiving, from the moving image server apparatus, divided moving image data corresponding to the identification information transmitted by the identification information transmitting means among the data;
Display means for displaying a moving image within the specified display range of the entire area of the moving image based on the divided moving image data received by the moving image data receiving means;
A determination unit that determines whether a degree to which the transmission load of divided moving image data by the moving image server device is increased exceeds a predetermined degree according to the state of the display range specified based on the operation received by the receiving unit; ,
When it is determined by the determination unit that the degree to which the transmission load is increased is determined to exceed the predetermined degree, camerawork information indicating a predetermined display range in the entire area of the moving picture along with the playback time of the moving picture Request transmitting means for transmitting a request for transmitting the request to a predetermined information server device;
Information receiving means for receiving the camera work information transmitted by the information server device;
Equipped with
When the camerawork information is received by the information reception means, the identification information transmission means identifies a division area overlapping the display range specified based on the camerawork information among the plurality of division areas Information is transmitted, and the moving image data receiving unit, among the plurality of divided moving image data stored in the moving image data storage unit, divided moving image data corresponding to the identification information transmitted by the identification information transmitting unit, A terminal apparatus, received from the moving image server apparatus, and displaying the moving image within a display range specified based on the camera work information in the entire area of the moving image. A communication method in a communication system, comprising: a terminal device for reproducing a moving image; and a moving image server device for transmitting the moving image to the terminal device,
An accepting step of the terminal device accepting an operation of a display range to be displayed among all areas of the moving image;
The moving image server is provided with identification information for identifying a divided area overlapping a display range specified based on the operation received by the receiving step among the plurality of divided areas obtained by dividing the entire area of the moving picture by the terminal device. Sending first identification information to the device;
A first identification information receiving step of the moving image server device receiving the identification information from the terminal device;
The moving image server device stores the plurality of divided moving image data indicating moving images of the plurality of divided regions in association with identification information for identifying the divided regions corresponding to the divided moving image data, and is stored in moving image data storage means A first moving image data transmission step of transmitting, to the terminal device, divided moving image data corresponding to the identification information received by the first identification information receiving step among the plurality of divided moving image data;
A first moving image data receiving step in which the terminal device receives the divided moving image data transmitted from the moving image server device;
The display range specified by the terminal device based on the operation accepted by the accepting step in the whole area of the moving image based on the divided moving image data received by the first moving image data receiving step A first display step for displaying the moving image in
The moving image server device or the terminal device is based on the identification information received in the first identification information receiving step, according to the state of the display range specified based on the operation received in the receiving step. A determination step of determining whether the degree to which the transmission load of divided moving image data by the moving image server device is increased exceeds a predetermined degree;
When it is determined by the determination step that the degree to which the transmission load is increased exceeds the predetermined degree in the determination step, the moving image server device or the terminal device reproduces the moving image in a predetermined display range of the entire area of the moving image A control step of transmitting camera work information indicated along with the passage of time to the terminal device by a predetermined information server device;
An information receiving step of the terminal device receiving the camera work information transmitted by the information server device;
Second identification information transmission in which the terminal device transmits identification information for identifying, among the plurality of divided areas, a divided area overlapping a display range specified based on the camera work information received in the information receiving step. Step and
A second identification information receiving step of the moving image server device receiving the identification information transmitted from the terminal device in the second identification information transmitting step;
A second moving image data transmission step of transmitting, to the terminal device, the divided moving image data corresponding to the identification information received by the second identification information receiving step among the plurality of divided moving image data;
A second moving image data receiving step in which the terminal device receives the divided moving image data transmitted from the moving image server device in the second moving image data transmitting step;
The terminal device is specified based on the camera work information received by the information receiving step in the entire area of the moving image based on the divided moving image data received by the second moving image data receiving step. A second display step of displaying a moving image within the display range;
A communication method comprising: In a computer of the moving image server device included in a communication system including a terminal device for reproducing a moving image and a moving image server device for transmitting the moving image to the terminal device,
When an operation of a display range to be displayed among all the regions of the moving image is accepted by the terminal device, among the plurality of divided regions obtained by dividing the entire region of the moving image, a divided region overlapping the display range is identified An identification information receiving step of receiving identification information from the terminal device;
A plurality of divided moving image data representing moving images of a plurality of divided regions obtained by dividing the entire region of the moving image are stored in moving image data storage means associated with identification information for identifying the divided regions corresponding to the divided moving image data A moving image data transmitting step of transmitting divided moving image data corresponding to the identification information received in the identification information receiving step among the plurality of divided moving image data to the terminal device;
A determination step of determining whether the extent to which the transmission load of divided moving image data by the moving image server device is increased exceeds a predetermined degree according to the state of the display range specified based on the operation accepted by the terminal device; ,
When it is determined in the determination step that the degree to which the transmission load is increased is determined to exceed the predetermined degree, camerawork information indicating a predetermined display range in the entire area of the moving picture along with the playback time of the moving picture Control step of causing the predetermined information server device to transmit to the terminal device;
A program characterized by causing In a computer of the terminal device included in a communication system including a terminal device for reproducing a moving image and a moving image server device for transmitting the moving image to the terminal device,
An accepting step of accepting an operation of a display range to be displayed among all areas of the moving image;
Among the plurality of divided areas obtained by dividing the whole area of the moving picture, identification information is transmitted to the moving picture server apparatus, which identifies a divided area overlapping the display range specified based on the operation accepted by the accepting step. 1 identification information transmission step;
The plurality of divided moving pictures stored in a moving picture data storage unit that stores each of a plurality of divided moving picture data indicating moving pictures of the plurality of divided areas in association with identification information identifying a divided area corresponding to the divided moving picture data A first moving image data receiving step of receiving, from the moving image server apparatus, divided moving image data corresponding to the identification information transmitted in the first identification information transmission step among the data;
A first display step of displaying a moving image within the specified display range of the entire area of the moving image based on the divided moving image data received by the first moving image data receiving step;
A determination step of determining whether the extent to which the transmission load of divided moving image data by the moving image server device is increased exceeds a predetermined degree according to the state of the display range specified based on the operation received in the receiving step; ,
When it is determined in the determination step that the degree to which the transmission load is increased is determined to exceed the predetermined degree, camerawork information indicating a predetermined display range in the entire area of the moving picture along with the playback time of the moving picture Sending a request to send a request to a predetermined information server device;
An information receiving step of receiving the camera work information transmitted by the information server device;
A second identification information transmission step of transmitting, among the plurality of divided areas, identification information identifying a divided area overlapping a display range specified based on the camerawork information received by the information receiving step;
Among the plurality of divided moving image data stored in the moving image data storage unit, a second moving image which receives, from the moving image server apparatus, divided moving image data corresponding to the identification information transmitted in the second identification information transmission step. Data receiving step,
A moving image within a display range specified based on the camerawork information received by the information receiving step in the entire area of the moving image based on the divided moving image data received by the second moving image data receiving step A second display step for displaying
A program characterized by causing