JP6805341B2 - Information processing device and information processing method - Google Patents

Description

The present invention relates to a technique for delivering video.

Patent Document 1 discloses a technique for delivering an image taken by an unmanned aerial vehicle (drone) to a virtual reality terminal in real time.

Special Table 2017-504863

In providing a service for viewing live video, it is conceivable that a part of the live video is overlooked, for example, when the user temporarily suspends viewing of the live video. In that case, it is convenient for the user to be able to grasp the contents of the missed live video, but if it takes time for that, for example, the distribution of the live video may end in the meantime.
Therefore, an object of the present invention is to make the user grasp the contents of the live video in a short time.

In order to achieve the above object, the present invention is a video acquisition unit that acquires live video and a distribution unit that distributes the acquired live video to a display device, and gives instructions for interruption and resumption from the display device of the distribution destination. Is received, an information processing device including a distribution unit for distributing the first shortened video which is the shortened video of the live video acquired from the interruption to the restart is provided as a shortened video of the live video.

Further, the distribution unit may distribute the second shortened video which is the shortened video of the live video acquired while the shortened video is being delivered.
Further, when the distribution unit receives an instruction for interruption while distributing the shortened video and then receives an instruction for resumption, the distribution portion of the shortened video after the interruption and from the interruption to the resumption The third shortened video, which is the shortened video combined with the shortened video of the live video acquired in the above, may be distributed.
Further, the distribution of the live video has an end time, and the distribution unit displays the video displayed in a time corresponding to the length of the period from the end time of the live video to be shortened to the end time of the distribution. It may be delivered as a shortened video.

Further, when the video acquisition unit acquires live video distributed to a plurality of display devices and is instructed to save the still image by a display device having a function of instructing the storage of the still image, the video acquisition unit is displayed on the display device. The distribution unit includes a storage unit that stores the video as a still image, and the distribution unit displays a display different from that of the display device from the interruption to the restart instructed by the display device or during the distribution of the shortened video to the display device. An image including a still image saved according to an instruction from the device may be distributed as the shortened image.
Further, the evaluation unit for evaluating the stored still image is provided, and the distribution unit distributes a video including the one having a high evaluation by the evaluation unit with priority over the one having a low evaluation as the shortened video. May be good.

In addition, the distribution unit includes a first preference acquisition unit that acquires preference information indicating the preference of each user of the plurality of display devices, and the distribution unit is a display device of a distribution destination of the shortened video based on the acquired preference information. A user's display device having similar tastes to that of the user is specified, and an image containing the still image saved by a storage instruction given by the display device in preference to other still images is defined as the shortened image. It may be delivered.

Further, the present invention has an image acquisition unit for acquiring a live image, a second preference acquisition unit for acquiring preference information indicating a user's preference, and an attribute determination for determining an attribute of an object reflected in the acquired live image. The live image is shortened so as to include a unit and a distribution unit that distributes the acquired live video to the display device of the user, and includes an object for which an attribute related to the preference indicated by the acquired preference information is determined. Provided is an information processing device including a distribution unit for distributing the shortened video.

In addition, in the image displayed by the display device, the first determination unit that determines the attribute of the target that is reflected in the position where the user's line of sight is facing, the image acquisition unit that acquires the live image, and the acquired live image. The second determination unit that determines the attributes of the target, and the distribution unit that distributes the acquired live video to the display device of the user, and the attributes related to the attributes determined by the first determination unit are the above. Provided is an information processing device including a distribution unit that distributes a shortened video obtained by shortening the live video so as to include an object determined by the second determination unit.

Further, a target determination unit for determining whether or not a specific target is reflected in the acquired live video is provided, and the distribution unit uses a moving image and a still image of the video determined to reflect the specific target. The video including one of the moving images and the video including the video determined that the specific target is not reflected on the other of the moving image and the still image may be distributed as the shortened video.

Further, the present invention is a step of acquiring a live image and a step of distributing the acquired live image to a display device, and shortens the live image when receiving an instruction of interruption and resumption from the display device of the distribution destination. As the shortened video, an information processing method including a step of delivering a first shortened video which is the shortened video of the live video acquired from the interruption to the restart is provided.

Further, the present invention has a step of acquiring a live image, a step of acquiring preference information indicating a user's preference, a step of determining an attribute of an object reflected in the acquired live image, and an acquired live image. Is a step of delivering the live video to the display device of the user, and a step of delivering a shortened video obtained by shortening the live video so as to include an object for which an attribute related to the taste indicated by the acquired taste information is determined. Provide an information processing method to have.

Further, the present invention has acquired a first determination step of determining an attribute of an object displayed at a position where the user's line of sight is facing in an image displayed by a display device, and an image acquisition step of acquiring a live image. A second determination step for determining the attribute of the target displayed in the live image and a distribution step for distributing the acquired live image to the display device of the user, which is related to the attribute determined by the first determination step. Provided is an information processing method including a distribution step of delivering a shortened video obtained by shortening the live video so that the attribute to be processed includes an object determined by the second determination step.

According to the present invention, the user can grasp the content of the live video in a short time.

Diagram showing the overall configuration of the virtual travel system according to the embodiment Diagram showing the hardware configuration of the proxy terminal Diagram showing the hardware configuration of the participant terminal Diagram showing the hardware configuration of the distribution server device Diagram showing the functional configuration realized by the virtual travel system Diagram showing an example of a specified range Diagram showing an example of the generated shortened video Diagram showing another example of the generated shortened video Diagram showing another example of the generated shortened video The figure which shows an example of the operation procedure of each apparatus in the provision process Diagram showing an example of a shortened video of a modified example Diagram showing the functional configuration realized in the modified example Diagram showing an example of a shortened video of a modified example Diagram showing the functional configuration realized in the modified example Diagram showing the functional configuration realized in the modified example Diagram showing the functional configuration realized in the modified example Diagram showing the functional configuration realized in the modified example Diagram showing the functional configuration realized in the modified example Diagram showing an example of a shortened video of a modified example Diagram showing an example of a shortened video generated by a modified example Diagram showing the overall configuration of the virtual travel system of the modified example

1 ... Virtual travel system, 10 ... Agent terminal, 20 ... Participant terminal, 30 ... Distribution server device, 101 ... Video shooting unit, 102 ... Peripheral sound recording unit, 103 ... Camera orientation measurement unit, 104 ... Shooting data transmission unit , 201 ... Terminal orientation measurement unit, 202 ... Designated range determination unit, 203 ... Content output unit, 204 ... Suspend / resume instruction unit, 205 ... Still image storage instruction unit, 206 ... Line-of-sight position notification unit, 301 ... Original data acquisition unit , 302 ... Video cutting unit, 303 ... Designated range acquisition unit, 304 ... Live content generation unit, 305 ... Content data storage unit, 306 ... Content data transmission unit, 307 ... Short content generation unit, 308 ... Content distribution unit, 309 ... Still image storage unit, 310 ... Still image evaluation unit, 311 ... Preference information acquisition unit, 312 ... Attribute determination unit, 313 ... Original data storage unit, 314 ... Specific target determination unit.

[1] Example FIG. 1 shows the overall configuration of the virtual travel system 1 according to the embodiment. The virtual travel system 1 is a system for providing a virtual travel service for virtually enjoying a trip without going to a travel destination such as a tourist spot. The virtual travel system 1 is mainly used by two types of users, an agent who shoots a video of a travel destination and a participant who participates in a virtual trip.

The virtual travel system 1 includes a network 2, an agent terminal 10, participant terminals 20-1, 20-2, 20-3, ... (Hereinafter, when they are not distinguished, they are referred to as "participant terminal 20"). And the distribution server device 30. The network 2 is a communication system including a mobile communication network, the Internet, and the like, and relays data exchange between devices accessing the own system. The distribution server device 30 accesses the network 2 by wired communication, and the agent terminal 10 and the participant terminal 20 access by wireless communication. The access to the network 2 may be either wired communication or wireless communication.

The agent terminal 10 is a photographing device that is carried by an agent at the travel destination and captures an image of the travel destination. In this embodiment, the agent terminal 10 is mounted on the agent's head, for example, and is a so-called 360-degree image (also referred to as an omnidirectional image or an omnidirectional image) which is a moving image including the agent's front, back, left, right, and up and down. To shoot. The agent terminal 10 also records a sound with a microphone provided in the own unit and transmits the captured 360-degree image to the distribution server device 30.

The distribution server device 30 distributes the virtual travel content including the video of the travel destination taken by the agent terminal 10 and the recorded sound to the participant terminal 20 (in this embodiment, the plurality of participant terminals 20). It is a distribution device. It should be noted that the content does not have to include only the video and not the sound. The distribution server device 30 cuts out and distributes a video in a range specified from the participant terminal 20 out of the 360-degree video. The participant terminal 20 is an output device that outputs the content distributed by the distribution server device 30, and for example, displays a video included in the content and emits a sound included in the content.

In this embodiment, the participant terminal 20 is an HMD (Head Mounted Display) worn on the participant's head. The participant terminal 20 measures the direction (direction and elevation / depression angle) in which the front of the own terminal is facing, and designates the range of the image corresponding to the measured direction to the distribution server device 30. As a result, for example, if the participant turns east, the image facing east from the position of the agent terminal 10 is delivered, and if the participant turns upward, the image vertically above the agent terminal 10 is delivered.

FIG. 2 shows the hardware configuration of the agent terminal 10. The agent terminal 10 includes a processor 11, a memory 12, a storage 13, a communication device 14, an input device 15, an output device 16, a 360-degree camera 17, a sensor device 18, and a bus 19. It is a computer equipped. The word "device" here can be read as a circuit, a device, a unit, or the like. Further, each device may be included one or more, or some devices may not be included.

The processor 11 operates, for example, an operating system to control the entire computer. The processor 11 may be composed of a central processing unit (CPU) including an interface with a peripheral device, a control device, an arithmetic unit, a register, and the like. Further, the processor 11 reads a program (program code), a software module, data, and the like from the storage 13 and / or the communication device 14 into the memory 12, and executes various processes according to these.

The number of processors 11 that execute various processes may be one, two or more, and two or more processors 11 may execute various processes simultaneously or sequentially. Further, the processor 11 may be mounted on one or more chips. The program may be transmitted from the network via a telecommunication line.

The memory 12 is a computer-readable recording medium, and is composed of at least one such as a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), and a RAM (Random Access Memory). May be done. The memory 12 may be referred to as a register, a cache, a main memory (main storage device), or the like. The memory 12 can store the above-mentioned program (program code), software module, data, and the like.

The storage 13 is a computer-readable recording medium, and is, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, or a magneto-optical disk (for example, a compact disk, a digital versatile disk, Blu-). It may consist of at least one such as a ray® disk), a smart card, a flash memory (eg, a card, stick, key drive), a floppy (registered trademark) disk, a magnetic strip, and the like.

The storage 13 may be referred to as an auxiliary storage device. The storage medium described above may be, for example, a database, server or other suitable medium containing the memory 12 and / or the storage 13. The communication device 14 is hardware (transmission / reception device) for performing communication between computers via a wired and / or wireless network, and is also referred to as, for example, a network device, a network controller, a network card, a communication module, or the like.

The input device 15 is an input device (for example, a keyboard, a mouse, a switch, a button, a sensor, etc.) that receives an input from the outside. Further, the input device 15 includes a microphone as an input device that collects sounds (peripheral sounds) generated around the own terminal and reaching the own terminal. The output device 16 is an output device (for example, a display, a speaker, an LED lamp, etc.) that outputs to the outside.

The 360-degree camera 17 is a photographing device that captures the 360-degree image described above. The 360-degree camera 17 includes, for example, two or more wide-angle cameras, and shoots a 360-degree image by pointing the wide-angle cameras in different directions and keeping all directions within the shooting range (note that all directions are completely set). It doesn't have to be something to shoot, for example, there may be a blind spot at your feet). The sensor device 18 includes a sensor (magnetic sensor or the like) that measures the orientation of the 360-degree camera 17.

The front of the 360-degree camera 17 is defined, and the sensor device 18 measures the direction and elevation / depression angle in the direction in which the front is facing (front direction of the camera). When the agent moves or changes the direction, the direction of the camera in the front direction changes, and the sensor device 18 outputs a measured value indicating the direction. From this measured value, it is possible to know, for example, which part of the 360-degree image taken is the image facing east when viewed from the own terminal, and which part is the image facing vertically upward when viewed from the own terminal. It has become.

The sensor device 18 may be built in the 360-degree camera 17. Further, the microphone included in the input device 15 may also be built in the 360-degree camera 17. Each device such as the processor 11 and the memory 12 is accessible to each other via the bus 19 for communicating information. The bus 19 may be composed of a single bus, or may be composed of different buses between the devices.

Further, the agent terminal 10 and the like are hardware such as a microprocessor, a digital signal processor (DSP: Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). It may be configured to include hardware, and a part or all of each functional block may be realized by the hardware. For example, the processor 11 may be implemented on at least one of these hardware.

FIG. 3 shows the hardware configuration of the participant terminal 20. The participant terminal 20 is a computer including a processor 21, a memory 22, a storage 23, a communication device 24, an input device 25, an output device 26, a sensor device 27, and a bus 28. These devices are of the same type as the devices of the same name shown in FIG. 2, although there are differences in performance or specifications. However, not all of them are the same, so a particularly important difference from each device of FIG. 2 will be described. The sensor device 27 includes a sensor (magnetic sensor or the like) that measures the orientation of the terminal in the front direction, and measures the orientation and elevation / depression angle that the front direction faces.

FIG. 4 shows the hardware configuration of the distribution server device 30. The distribution server device 30 is a computer including a processor 31, a memory 32, a storage 33, a communication device 34, and a bus 35. These devices are of the same type as the devices of the same name shown in FIG. 2, although there are differences in performance or specifications.

A program provided by this system is stored in the agent terminal 10, the participant terminal 20, and the distribution server device 30 included in the virtual travel system 1, and the processor of each device executes the program to control each unit. As a result, the function group described below is realized.
FIG. 5 shows a functional configuration realized by the virtual travel system 1. The agent terminal 10 includes a video shooting unit 101, a peripheral sound recording unit 102, a camera orientation measurement unit 103, and a shooting data transmission unit 104.

The participant terminal 20 includes a terminal orientation measurement unit 201, a designated range determination unit 202, a content output unit 203, and an interruption / restart instruction unit 204. Although only one participant terminal 20 is shown in FIG. 5, each of the plurality of participant terminals 20 realizes the functional configuration shown in FIG. The distribution server device 30 includes the original data acquisition unit 301, the video cutout unit 302, the designated range acquisition unit 303, the live content generation unit 304, the content data storage unit 305, the content data transmission unit 306, and the shortened content. A generation unit 307 is provided.

In the virtual travel system 1, the distribution server device 30 identifies a terminal ID (Identification) that identifies each participant terminal 20, and destination information (IP (Internet Protocol) address) when the distribution server device 30 distributes video to the participant terminals 20. Etc.) are associated and stored. Further, the agent terminal 10 and each participant terminal 20 store the destination information of the distribution server device 30, and can exchange data with the distribution server device 30 as needed.

The video shooting unit 101 of the proxy terminal 10 shoots a video around the proxy. In this embodiment, the video capturing unit 101 controls the 360-degree camera 17 shown in FIG. 2 to shoot a 360-degree video (specifically, a moving image in which 360-degree video is continuous). The video shooting unit 101 continuously shoots 360-degree video during the virtual travel service provision period (the period from the service start time to the service end time), and simultaneously shoots 360-degree video as shooting data. It is supplied to the transmission unit 104.

The peripheral sound recording unit 102 controls the microphone included in the input device 15 shown in FIG. 2 to record the above-mentioned peripheral sound (sound generated around the own terminal and reaching the own terminal). The peripheral sound recording unit 102 supplies the recorded peripheral sound to the shooting data transmission unit 104 in parallel while recording the peripheral sound during the provision period of the virtual travel service.

The camera orientation measuring unit 103 controls the sensor device 18 shown in FIG. 2 to measure the front-facing orientation and elevation / depression angle defined for the 360-degree camera 17. These orientations and elevation / depression angles are information indicating the front orientation of the 360-degree camera 17, and are hereinafter referred to as "camera orientation information". The camera orientation measuring unit 103 repeatedly measures the camera orientation information (direction and elevation / depression angle) during the virtual travel service provision period, and in parallel, repeatedly supplies the measured camera orientation information to the photographing data transmission unit 104. To do.

The shooting data transmission unit 104 transmits shooting data, which is data related to the video shot by the own terminal, to the distribution server device 30. Specifically, the shooting data transmission unit 104 includes 360-degree video supplied from the video shooting unit 101, peripheral sound supplied from the peripheral sound recording unit 102, and camera orientation information supplied from the camera orientation measurement unit 103. And the data indicating the shooting time of the 360-degree video (the shooting time of each 360-degree video shot continuously) is generated as shooting data and transmitted to the distribution server device 30.

The original data acquisition unit 301 of the distribution server device 30 acquires the data (original data) that is the source of the content (content of the virtual tour) distributed by the own device. The original data is shooting data transmitted from the agent terminal 10. The original data acquisition unit 301 acquires the shooting data transmitted from the agent terminal 10 as the original data of the content, and the video indicated by the shooting data, that is, the live video shot by the proxy terminal 10 (this implementation). In the example, a 360-degree image) is acquired. The original data acquisition unit 301 is an example of the "video acquisition unit" of the present invention.

Further, the original data acquisition unit 301 acquires the shooting data, that is, the sound indicated by the shooting data, that is, the sound (ambient sound) reaching the agent terminal 10. The original data acquisition unit 301 supplies the acquired original data to the video cutting unit 302 each time the shooting data is acquired as the original data of the content. The video cutting unit 302 cuts out a video in a range specified by the participant terminal 20 from the 360-degree video indicated by the supplied original data.

The range is specified as follows. The terminal orientation measuring unit 201 of the participant terminal 20 measures the front-facing orientation and elevation / depression angle defined for the own terminal as information indicating the orientation of the own terminal (hereinafter referred to as “terminal orientation information”). The terminal orientation measuring unit 201 repeatedly measures the terminal orientation information at regular time intervals, and repeatedly supplies the measured terminal orientation information to the designated range determination unit 202.

The designated range determination unit 202 determines the designated range to be designated as the range of the image to be displayed on the own terminal based on the terminal orientation information measured by the terminal orientation measuring unit 201. The designated range determining unit 202 determines, for example, the range of the image when the direction indicated by the supplied terminal orientation information is taken by a camera having a predetermined angle of view (for example, 25 degrees in height, 45 degrees in width, etc.) as a designated range. To do.

FIG. 6 shows an example of a specified range. In FIG. 6, a 360-degree video A1 shot by the video shooting unit 101 is shown. The 360-degree image A1 is an image taken with the 360-degree camera 17 facing true north and having an inclination of 0 degrees (a state in which the front direction of the camera is oriented horizontally). Therefore, in the 360-degree image A1, the horizontal line is located at the center (0 degree) in the vertical direction of the image, and the true north direction is located at the center in the horizontal direction of the image. The upper side of the image represents the image vertically above (90 degrees) when viewed from the 360-degree camera 17, and the lower side of the image represents the image vertically below (-90 degrees) when viewed from the 360-degree camera 17.

For example, when the designated range determination unit 202 determines the range of the image shot northward and the elevation angle of 20 degrees as the designated range, the shooting direction B1 indicating the position of the 360-degree image A1 facing north and the elevation angle of 20 degrees is centered. The designated range C1 has been determined. Further, when the designated range determination unit 202 determines the range of the image that faces southeast and has a depression angle of 45 degrees as the designated range, the center is the shooting direction B2 that indicates the position of the image facing southeast and the depression angle of 45 degrees in the 360-degree image A1. This means that the designated range C2 has been determined.

The designated range determination unit 202 generates information indicating the direction and elevation / depression angle indicating the shooting direction, the angle of view, and the terminal ID of the own terminal as the range information indicating the determined designated range, and transmits the information to the distribution server device 30. To do. By receiving the transmitted range information, the designated range acquisition unit 303 of the distribution server device 30 sets the range of the video designated by the participant terminal 20 identified by the terminal ID indicated by the range information, that is, the designated range. get. The designated range acquisition unit 303 supplies the image cutting unit 302 with range information indicating the acquired designated range.

When the original data of the content is supplied from the original data acquisition unit 301, the image cutting unit 302 has a designated range indicated by the range information supplied from the designated range acquisition unit 303 from the 360-degree video indicated by the supplied original data. (In the example of FIG. 6, the image of the designated range C1 or the image of the designated range C2) is cut out. If the front surface of the 360-degree camera 17 is tilted with respect to the horizontal direction, the 360-degree image A1 shown in FIG. 6 becomes an image shifted in the vertical direction (the horizontal line is shifted in the vertical direction).

For example, the image cutting unit 302 corrects this inclination based on the front orientation indicated by the camera orientation information included in the original data to obtain an image such as the 360-degree image A1, and then cuts out an image in a specified range. For this correction, a well-known technique used in VR (Virtual Reality), AR (Augmented Reality), or the like may be used. The image cutting unit 302 may not correct the 360-degree image, but may calculate a position corresponding to the azimuth and elevation / depression angle in the tilted 360-degree image and cut out the image in the specified range.

The video cutting unit 302 supplies the video cut out in this way to the live content generation unit 304 together with the range information and the original data. In the virtual travel system 1, the content showing the live image cut out in this way as it is and the content obtained by shortening the live image are distributed. In the following, the former content will be referred to as "live content" and the latter content will be referred to as "shortened content". When the two are not distinguished, they are simply called "content".

The live content generation unit 304 is a function of generating live content. The live content generation unit 304 generates live content indicating the video supplied from the video cutting unit 302, that is, the live video cut out from the participant terminal 20 in a range specified, and the ambient sound indicated by the original data. .. The live content generation unit 304 generates content data indicating the generated live content and the terminal ID indicated by the supplied range information.

The live content generation unit 304 supplies the generated content data to the content data storage unit 305 and the content data transmission unit 306. The content data storage unit 305 stores the content data supplied from the live content generation unit 304. The content data transmission unit 306 transmits the content data supplied from the live content generation unit 304 to the participant terminal 20 identified by the terminal ID indicated by the content data.

The content output unit 203 of the participant terminal 20 outputs the content indicated by the content data transmitted from the distribution server device 30. When the transmitted content data indicates live content, the content output unit 203 outputs the live image indicated by the content data to the display of the output device 26 and displays it, and outputs the ambient sound indicated by the content data to the output device 26. Output to the speaker of and emit sound.

Participants wearing the participant terminal 20 view the content output in this way. Viewing content means watching the video of the displayed content and listening to the sound of the released content. It should be noted that even when viewing only video content that does not contain sound, it is referred to as "viewing content". In the above example, the participant terminal 20 displays a live video (specifically, a video cut out from the video) acquired by the original data acquisition unit 301 as a video of the content. The participant terminal 20 is an example of the "display device" of the present invention.

The interruption / restart instruction unit 204 of the participant terminal 20 gives an instruction to interrupt the viewing of the content (interruption instruction) and an instruction to resume the interrupted viewing (restart instruction) to the distribution server device 30. For example, the input device 25 of the participant terminal 20 has an operator for the interrupt operation and an operator for the restart operation. When the suspend / resume instruction unit 204 is operated, the suspend / resume instruction unit 204 transmits instruction data indicating the suspend instruction or restart instruction and the current time (representing the instructed time) to the distribution server device 30. Give a suspend instruction and a restart instruction.

The suspend operation and the restart operation are not limited to this. For example, when the participant terminal 20 is provided with a sensor (proximity sensor or the like) for detecting whether or not the own terminal is attached to the participant, the interruption / restart instruction unit 204 is equipped with the own terminal attached to the participant. You may instruct the interruption when the state is removed from the state, and instruct the restart when the terminal is attached to the participant from the state where the terminal is removed.

The instruction data transmitted by the suspend / resume instruction unit 204 is supplied to the content data transmission unit 306 and the shortened content generation unit 307 of the distribution server device 30. In this embodiment, when the content data transmission unit 306 receives the instruction data indicating the interruption instruction, the content data transmission unit 306 interrupts the transmission of the content data to the participant terminal 20 of the transmission source of the instruction data. After that, when the content data transmission unit 306 receives the instruction data indicating the resumption instruction, the content data transmission unit 306 resumes the transmission of the content data to the participant terminal 20 of the transmission source of the instruction data.

The content data transmission unit 306 may continue transmitting the content data from the time when the interruption instruction is received until the time when the restart instruction is received. In that case, the participant terminal 20 continues to output the content, but since the participant has removed the participant terminal 20, the viewing is interrupted, and the participant wears the participant terminal 20 to view the content. Is restarted. In addition, even if the participant continues to watch after the interruption instruction when the interruption and the restart are instructed by the above-mentioned operator, each part of the distribution server device 30 can watch from the interruption instruction to the restart instruction. It may operate as if it were interrupted.

When resuming transmission, the content data transmission unit 306 transmits the content data indicating the shortened content (content obtained by shortening the live video) described above before transmitting the content data indicating the live content in this embodiment. To do. The shortened content generation unit 307 generates the shortened content, and generates content data indicating the generated shortened content and the terminal ID of the participant terminal 20 of the distribution destination.

The shortened content generation unit 307 generates a shortened video obtained by shortening the live video cut out by the video cutting unit 302, and generates shortened content indicating the generated shortened video. The shortened content generation unit 307 generates three types of shortened video, that is, a first shortened video, a second shortened video, and a third shortened video. These shortened images will be described with reference to FIGS. 7 and 8.

FIG. 7 shows an example of the generated shortened video. FIG. 7 shows a period during which the live image D1 displayed on the participant terminal 20 is shot as a part of the 360-degree image, and the image is displayed on the participant terminal 20 to which the live image D1 is distributed below the period. The display period is shown. Further, in the middle of the display period, the time when the interruption instruction is given and the time when the restart instruction is given are shown. In this embodiment, the time difference between the time when the original data of the live image D1 is captured and the time when the live image D1 is cut out and the cut out live image D1 is displayed on the participant terminal 20 is negligibly small. To do.

The participant terminal 20 (content output unit 203) displays the live video D1 until the interruption instruction is given, and interrupts the output of the content from the interruption instruction to the restart instruction. When the restart instruction is given, the participant terminal 20 first displays a shortened video E11 which is a shortened version of the live video D1-1 shot from the interrupt instruction to the restart instruction in the live video D1.

The participant terminal 20 next displays the shortened video E12, which is a shortened version of the live video D1-2 taken during the display of the shortened video E11 of the live video D1. Subsequently, the participant terminal 20 displays the shortened video E13, which is a shortened version of the live video D1-3 taken during the display of the shortened video E12 of the live video D1. Next, the participant terminal 20 displays the shortened video E14, which is a shortened version of the live video D1-4 taken during the display of the shortened video E13 of the live video D1.

Then, the participant terminal 20 displays the live video D1 again after displaying the shortened video E15 which is a shortened version of the live video D1-5 taken during the display of the shortened video E14 of the live video D1. The video obtained by shortening the live video shot from the interruption instruction to the restart instruction, such as the shortened video E11, is referred to as the above-mentioned “first shortened video”. Further, the video obtained by shortening the live video shot during the display of the shortened video such as the shortened video E12 to E15 is referred to as the above-mentioned "second shortened video".

In this embodiment, the video cutting unit 302 continues to cut out the live video within the range specified when the interruption instruction is given. The live content generation unit 304 generates live content indicating the live video cut out in this way even during the period in which viewing is interrupted. The content data storage unit 305 stores content data indicating the content thus generated.

When the shortened content generation unit 307 receives the interruption instruction from the participant terminal 20 and then receives the restart instruction, the content data storage unit 305 generates content data indicating the terminal ID of the participant terminal 20 from which the instruction is sent. read out. In detail, the shortened content generation unit 307 displays a live image (live image D1-1 in the example of FIG. 7) from the time when the interruption instruction is given (the time indicated by the instruction data) to the time when the restart instruction is given. Read the indicated content data.

The shortened content generation unit 307 generates, for example, a shortened video (shortened video E11 in the example of FIG. 7) by evenly omitting a predetermined ratio of videos from the temporally continuous video indicated by the read content data. To do. Further, the shortened content generation unit 307 generates a shortened sound obtained by emitting the ambient sound indicated by the read content data in the same time as, for example, the shortened video, and generates a shortened content in which the shortened video and the shortened sound are superimposed. To do.

The method of generating shortened content is not limited to this. The shortened content generation unit 307 may generate shortened content by using, for example, a well-known digest video generation technique for detecting and extracting a raised scene or a specific scene. As described above, the shortened content generation unit 307 shortens the live video acquired by the original data acquisition unit 301 from the time when the viewing is interrupted by the interruption instruction until the viewing is resumed by the restart instruction, and the first shortening described above. An image (shortened image E11 in the example of FIG. 7) is generated.

Further, the shortened content generation unit 307 is a video cut out from a live video acquired during a period in which content data indicating the shortened content is transmitted, that is, a period in which the shortened content is distributed (live video in the example of FIG. 7). Read the content data indicating D1-2, D1-3, D1-4, D1-5). The shortened content generation unit 307 generates a shortened video (shortened video E12, E13, E14, E15 in the example of FIG. 7) obtained by shortening the live video indicated by the read content data.

Then, the shortened content generation unit 307 generates the shortened sound and also generates the shortened content as in the case of the shortened video E11. In this way, the shortened content generation unit 307 shortens the live video cut out from the 360-degree video acquired by the original data acquisition unit 301 when the shortened video is being distributed, and shortens the live video cut out from the 360-degree video described above (FIG. In the example of 7, the shortened images E12, E13, E14, E15) are generated. In this embodiment, the shortened content generation unit 307 ends the generation of the shortened content when the display time of the second shortened video becomes less than a predetermined time.

As described above, the video cutting unit 302, the designated range acquisition unit 303, the live content generation unit 304, the content data storage unit 305, the content data transmission unit 306, and the shortened content generation unit 307 were acquired by the original data acquisition unit 301. It functions as a content distribution unit 308 that distributes live video to the participant terminal 20. The content distribution unit 308 is an example of the “distribution unit” of the present invention. In addition to the live video, the content distribution unit 308 also distributes the first shortened video (for example, shortened video E11) and the second shortened video (shortened video E12, etc.) generated as described above.

FIG. 8 shows another example of the generated shortened video. In FIG. 8, similarly to FIG. 7, a period in which the live image D2 is captured and a display period in which the image is displayed on the participant terminal 20 are shown below the period. Further, in the middle of the display period, the time when the interruption instruction is given and the time when the restart instruction is given are shown twice. In this example, the second interruption instruction is given while the first shortened video is being distributed.

When the first restart instruction is given, the participant terminal 20 (content output unit 203) displays a shortened video E21 which is a shortened version of the live video D2-1 taken from the interrupt instruction to the restart instruction in the live video D2. Has started. However, since the second interruption instruction was given during the distribution of the shortened image E21, the participant terminal 20 displays the shortened image E211 up to the interruption instruction among the shortened images E21, and the shortened image E212 after the interruption instruction is displayed. The display is temporarily interrupted.

When the second restart instruction is given, the participant terminal 20 interrupts the shortened video E212, which is the distribution part after the interruption instruction in the shortened video E21, and the second interruption from the first restart instruction in the live video D2. Display the shortened video E22 that combines the live video D2-2 shot up to the instruction and the shortened video E222 that is a shortened version of the live video D2-3 shot from the second interruption instruction to the second restart instruction. There is. After that, the participant terminal 20 shortens the live images D2-4, D2-5, and D2-6 taken during the display of the shortened images E22, E23, and E24 of the live images D2, as in the example of FIG. The shortened images E23, E24, and E25 are displayed.

As described above, when the shortened content generation unit 307 receives the interruption instruction while delivering the first shortened video (shortened video E21 in the example of FIG. 8) and then receives the restart instruction, the shortened content generation unit 307 receives the first shortened video. Of these, the distribution part after the interruption (shortened video E212 in the example of FIG. 8) and the shortened video of the live video acquired from the start of displaying the first shortened video to the reception of the restart instruction (shortened video in the example of FIG. 8). A shortened image (shortened image E22 in the example of FIG. 8) combined with E222) is generated.

FIG. 9 shows another example of the generated shortened video. In FIG. 9, similarly to FIG. 7, a period in which the live image D3 is captured and a display period in which the image is displayed on the participant terminal 20 are shown below the period. Further, as in FIG. 8, the time when the interruption instruction is given and the time when the restart instruction is given are shown twice in the middle of the display period. However, in this example, the second interruption instruction is given while the second shortened video is being distributed.

The participant terminal 20 (content output unit 203) first displays a shortened video E31 that is a shortened version of the live video D3-1 taken during the first interruption. Next, the participant terminal 20 has started to display the shortened video E32, which is a shortened version of the live video D3-2 captured while the shortened video E31 is being displayed. However, since the second interruption instruction was given during the distribution of the shortened video E32, the participant terminal 20 displayed the shortened video E321 up to the interruption instruction among the shortened video E32, and the shortened video E322 after the interruption instruction. The display is temporarily interrupted.

When the second restart instruction is given, the participant terminal 20 is the second time from the start of display of the shortened video E322, which is the distribution portion of the shortened video E32 after the interruption instruction, and the shortened video E32 of the live video D3. A shortened video E33 is displayed, which is a combination of a live video D3-3 shot up to the interruption instruction and a shortened video E332 that is a shortened version of the live video D3-4 shot from the second interruption instruction to the second restart instruction. ing. After that, the participant terminal 20 is a shortened video E34, E35 obtained by shortening the live video D3-5, D3-6 taken while displaying the shortened video E33, E34 of the live video D3, as in the example of FIG. Is displayed.

As described above, when the shortened content generation unit 307 receives the interruption instruction while delivering the second shortened video (shortened video E32 in the example of FIG. 9) and then receives the restart instruction, the shortened content generation unit 307 receives the second shortened video. Of these, the distribution part after the interruption (shortened video E322 in the example of FIG. 9) and the shortened video of the live video acquired from the start of displaying the second shortened video to the reception of the restart instruction (shortened video in the example of FIG. 9). A shortened image (shortened image E33 in the example of FIG. 9) combined with E332) is generated.

When the content distribution unit 308 receives the interruption instruction during the distribution of the shortened video and then the restart instruction, the content distribution unit 308 distributes the shortened video E22 generated as described above in the example of FIG. In the example, the shortened video E33 generated as described above is delivered. As described above, the shortened video, such as the shortened video E22 and E33, is a combination of the delivered portion of the delivered shortened video after the interruption and the shortened video of the live video acquired from the interruption to the restart. It shall be called "third shortened video".

Each device included in the virtual travel system 1 performs a provision process of providing the contents of the virtual travel to the participants based on the above configuration.
FIG. 10 shows an example of the operation procedure of each device in the providing process. This operation procedure is started, for example, when the start time of the virtual travel service is reached. First, the agent terminal 10 (video shooting unit 101, peripheral sound recording unit 102, camera orientation measuring unit 103) captures a 360-degree image (live image) around the agent, records ambient sound, and is suitable for the camera. Information is measured (step S11).

Next, the agent terminal 10 (shooting data transmission unit 104) transmits the shooting data obtained in each operation of step S11 to the distribution server device 30 (step S12). The distribution server device 30 (original data acquisition unit 301) acquires the transmitted shooting data as the original data of the content distributed by the own device (step S13). Next, the participant terminal 20 (terminal orientation measuring unit 201) measures information indicating the orientation of the own terminal (terminal orientation information) (step S21).

Subsequently, the participant terminal 20 (designated range determination unit 202) determines a designated range of the image to be displayed on the own terminal based on the measured terminal orientation information (step S22), and a range indicating the determined designated range. Information is transmitted to the distribution server device 30 (step S23). The distribution server device 30 (designated range acquisition unit 303) acquires the designated range by receiving the transmitted range information (step S24).

Next, the distribution server device 30 (video cutting unit 302) cuts out the acquired video in the designated range from the 360-degree video indicated by the original data acquired in step S13 (step S25). Subsequently, the distribution server device 30 (live content generation unit 304) generates live content indicating the cut out live video and the recorded ambient sound (step S26).

Then, the distribution server device 30 (content data transmission unit 306) transmits the content data indicating the generated live content to the participant terminal 20 that has designated the range of the video (step S27). The participant terminal 20 (content output unit 203) outputs the live content indicated by the transmitted content data (step S28). The distribution server device 30 (content data storage unit 305) stores content data indicating the generated live content (step S29).

Here, the participant terminal 20 (interruption / resumption instruction unit 204) accepts the interruption operation for interrupting viewing (step S31), and transmits instruction data indicating the interruption instruction to the distribution server device 30 (step S32). When the interrupt operation is accepted, the participant terminal 20 (content output unit 203) interrupts the output of the content (step S33). Even if the output of the content is interrupted, the operations of steps S11 to S13 and the operations of steps S21 to S26 and S29 are continuously repeated, and the content data indicating the live content is accumulated.

Next, when the participant terminal 20 (interruption / resumption instruction unit 204) accepts the resumption operation for resuming viewing (step S34), instruction data indicating the resumption instruction is transmitted to the distribution server device 30 (step S35). When the distribution server device 30 (shortened content generation unit 307) is instructed to restart by the instruction data, the distribution server device 30 generates shortened content including the shortened live video captured during the interruption of viewing (step S41).

Next, the distribution server device 30 (content data transmission unit 306) transmits the content data indicating the generated shortened content to the participant terminal 20 that has instructed the restart (step S42). The participant terminal 20 (content output unit 203) outputs the shortened content indicated by the transmitted content data (step S43). Subsequently, the distribution server device 30 (shortened content generation unit 307) generates shortened content including the shortened video obtained by shortening the live video captured while displaying the shortened video (step S51).

Next, the distribution server device 30 (content data transmission unit 306) transmits the content data indicating the generated shortened content to the participant terminal 20 (step S52). The participant terminal 20 (content output unit 203) outputs the shortened content indicated by the transmitted content data (step S53). After that, the operations from steps S51 to S53 are repeated, and when the display time of the shortened video included in the generated shortened content becomes less than a predetermined time, this operation procedure ends, and the operation is performed again from step S11. Will be done.

In this embodiment, a shortened video that is a shortened version of the live video is delivered, so that the user (participant in this embodiment) can grasp the content of the live video in a shorter time than when only the live video is delivered. be able to. For example, by delivering the first shortened video which is a shortened video of the live video captured during the suspension of viewing, the user can grasp the content of the live video during the suspension of viewing in a short time.

In addition, by delivering the second shortened video, which is a shortened live video shot during the display of the shortened video, the user can grasp the content of the live video being displayed in the shortened video in a short time. Can be done. Further, even if the interruption is instructed during the display of the shortened video, the remaining portion of the interrupted shortened video is included by delivering the third shortened video including the portion of the shortened video that has not been viewed. The content of the live video can be grasped by the user in a short time.

[2] Modifications The above-mentioned examples are merely examples of the implementation of the present invention, and may be modified as follows.

[2-1] Shortening method 1
The method of shortening the live image is not limited to the method described in the examples. For example, as described in the examples, the virtual travel service has a fixed period of provision. In other words, the end time is fixed for the distribution of live video. Therefore, the shortened content generation unit 307 generates a video displayed as a shortened video in a time corresponding to the length of the period from the end time of the live video to be shortened to the end time of the distribution.

FIG. 11 shows an example of a shortened image of this modified example. In FIG. 11 (a), the live video D4-1 having a displayed length of T1 in the live video D4 is to be shortened, and in FIG. 11 (b), the same displayed length of the live video D4 is displayed. The live video D4-2 of T1 is targeted for shortening. The length of the period from the end time of the live video D4-1 to the end time of the distribution of the live video D4 T2 is the length of the period from the end time of the live video D4-2 to the end time of the distribution of the live video D4 T3. Longer than.

The shortened content generation unit 307 generates a shortened video E41 that shortens the live video D4-1 and generates a shortened video E42 that shortens the live video D4-2. The display time T41 of the shortened video E41 is longer than the display time T42 of the shortened video E42. As described above, the shortened content generation unit 307 generates as the shortened video the video that is displayed for a longer time as the period from the end time of the live video to be shortened to the end time of distribution is longer.

The content distribution unit 308 distributes the shortened video generated in this way to the participant terminal 20. In this modification, as described above, the shortened video that is displayed for a shorter time is generated as the delivery end time approaches, so that the delivery end time may be reached while the shortened video is being displayed. It can be made difficult.

[2-2] Saving a still image When a moving image (360-degree image in the example) is displayed as a video on the participant terminal 20 as in the embodiment, a video of a favorite scene is taken like a photograph. It may be possible to save it as a still image.
FIG. 12 shows the functional configuration realized in this modification. In FIG. 12, a participant terminal 20a having a still image storage instruction unit 205 in addition to each unit shown in FIG. 5 and a distribution server device 30a having a still image storage unit 309 in addition to each unit shown in FIG. 5 are shown. There is.

The still image saving instruction unit 205 gives an instruction to the distribution server device 30a to save the image displayed on the own terminal as a still image when the still image saving operation is performed. The saving operation may be performed using the input device 25, or may be performed by a predetermined gesture represented by the terminal orientation information. The still image saving instruction unit 205 transmits instruction data indicating the time when the saving operation is performed and the instruction to save the still image to the distribution server device 30a. As described above, the participant terminal 20a has a function of instructing the storage of the still image.

When the still image storage unit 309 of the distribution server device 30a receives the transmitted instruction data, the content data indicating the terminal ID of the participant terminal 20a of the transmission source is read from the content data storage unit 305, and the read content data is generated. Of the indicated images, the image at the time indicated by the instruction data is saved as a still image (the terminal ID is associated so that which participant terminal 20a is instructed can be identified). In this way, when the participant terminal 20a instructs the participant terminal 20a to save the still image, the still image storage unit 309 saves the image displayed on the participant terminal 20a as a still image. The still image storage unit 309 is an example of the "storage unit" of the present invention.

The method of saving the still image is not limited to the above method. For example, the still image saving instruction unit 205 captures the image of the content output by the content output unit 203 when the saving operation is performed, and transmits the captured image to the distribution server device 30a to obtain a still image. The storage unit 309 may save the image as a still image. In either case, the still image storage unit 309 stores the still image in a storage location accessible by the participant using, for example, a smartphone or the like in addition to the participant terminal 20a. This allows participants to take pictures of their favorite travel destinations, save them like photographs, and enjoy them.

[2-3] Shortening method 2
The live image may be shortened by using the above still image.
FIG. 13 shows an example of a shortened image of this modified example. In FIG. 13, the 360-degree video D5 indicated by the original data acquired by the original data acquisition unit 301 is shown. The 360-degree video D5-1 represents, for example, a video acquired from the participant terminal 20a shown in FIG. 12 from the instruction of interruption to the instruction of resumption.

In the 360-degree video D5-1, it is shown that nine still images, F5-1, F5-2, ..., F5-9, are stored. The difference in the vertical position of each still image represents the difference in the direction indicated by the still image, and the difference in the horizontal position represents the difference in the saved time. These still images are stored according to an instruction from another participant terminal 20a different from the participant terminal 20a whose viewing is interrupted.

The shortened content generation unit 307 generates a video including these still images as a shortened video. Specifically, the shortened content generation unit 307 generates, for example, a shortened video that displays a still image for a predetermined time (for example, a shortened image that displays nine still images for 5 seconds each with a display time of 45 seconds). Although the shortened video in this case represents only a still image, the shortened content generation unit 307 may generate a shortened video including both a shortened portion of the live video and a portion representing the still image.

The content distribution unit 308 displays the shortened video generated in this way, that is, a still image saved by an instruction from the participant terminal 20a different from the participant terminal 20a from the interruption to the restart instructed by the participant terminal 20a. Deliver the included video as a shortened video. The 360-degree video D5-1 is not limited to the video from interruption to resumption, and may be a video during distribution of the shortened video.

In that case, the content distribution unit 308 delivers the generated shortened video, that is, a still image saved by an instruction from the participant terminal 20a different from the participant terminal 20a during the distribution of the shortened video to the participant terminal 20a. The video including the above is delivered as a shortened video. In either case, since the shortened video including the still image saved by the other participant is delivered, it is possible to grasp the video that the other participant paid attention to while the participant was not watching.

[2-4] Priority of Still Images If there are too many still images described above, those selected from those still images may be used for the shortened video.
FIG. 14 shows the functional configuration realized in this modification. In FIG. 14, a distribution server device 30b including a still image evaluation unit 310 in addition to the units shown in FIG. 12 is shown.

The still image evaluation unit 310 evaluates the still image stored by the still image storage unit 309. The still image evaluation unit 310 is an example of the "evaluation unit" of the present invention. The still image evaluation unit 310 evaluates a still image using, for example, a well-known technique disclosed in Japanese Patent Application Laid-Open No. 2008-83892. For example, the still image evaluation unit 310 evaluates the still image as having less blur and blur. The evaluation criteria are not limited to this, and may be based on brightness, focus, orientation of a person's face, number of faces, appearance of a face, and the like.

The still image evaluation unit 310 reads out the still image saved by the still image storage unit 309 and evaluates it, and gives the evaluation result as, for example, metadata of the still image. As described in the explanation of FIG. 13, the shortened content generation unit 307 uses a number or less of still images according to the length of the display time of the shortened video when generating the shortened video including the still image. For example, if the display time is 1 minute and one still image is displayed for 5 seconds or more, 12 or less still images are used.

The shortened content generation unit 307 generates a video that includes a video that is highly evaluated by the still image evaluation unit 310 over a video that has a low evaluation as a shortened video. When there are 13 or more still images in the above example, the shortened content generation unit 307 generates a shortened video including 12 still images, for example, from the one with the highest evaluation. The content distribution unit 308 distributes the shortened video generated in this way, that is, the shortened video including those having a high evaluation with priority over those having a low evaluation.

In this modified example, for example, if a good-looking still image is highly evaluated, participants can be given priority in viewing a high-evaluated, that is, good-looking image. As a result, it is possible to deliver a shortened video that attracts the interest of the participants as compared with the case where the selected still image is used regardless of the evaluation. The method of selecting a still image is not limited to the above method.

For example, a still image saved by another participant who has similar tastes to the participant who is interrupting viewing may be selected.
FIG. 15 shows another functional configuration realized in this modification. In FIG. 15, a distribution server device 30c including a preference information acquisition unit 311 in addition to each unit shown in FIG. 12 is shown. The preference information acquisition unit 311 acquires preference information indicating the preference of each participant of the plurality of participant terminals 20a. The preference information acquisition unit 311 is an example of the "first preference acquisition unit" of the present invention.

The preference information acquisition unit 311 reads, for example, the stored preference information when the participant has registered his / her own preference information in advance and the distribution server device 30c stores the registered preference information. Acquire the preference information of participants. The participant terminal 20a may store the preference information. In that case, the preference information acquisition unit 311 requests the preference information from each participant terminal 20a and acquires the preference information transmitted in response to the request. To do.

The preference information acquisition unit 311 supplies the acquired preference information of the participant to the still image storage unit 309 in association with the terminal ID of the participant terminal 20a of the participant. The still image storage unit 309 stores the still image associated with the same terminal ID and the preference information in association with each other. The shortened content generation unit 307 identifies the participant terminal 20a of the participant whose taste is similar to that of the participant terminal 20a to which the shortened video is distributed, based on the preference information acquired by the preference information acquisition unit 311.

For example, the shortened content generation unit 307 defines in advance groups of similar tastes (sports, gourmet, history, vehicles, etc.) and tastes included in each group (baseball, soccer, basketball, etc. for sports), and includes them in the same group. Judge that the tastes are similar to each other. The shortened content generation unit 307 generates a video that includes the still image saved by the save instruction given from the specified participant terminal 20a with priority over other still images as the shortened video.

The content distribution unit 308 distributes the shortened video generated in this way. In this modified example, the participant can see a shortened video including a still image that is noticed by another participant who has similar tastes to himself / herself. This still image is more likely to be of interest to the participant than the still image of interest to the participants with dissimilar tastes, so when the selected still image is used regardless of the similarity of tastes. In comparison, it is possible to deliver a shortened image that attracts the interest of the participants.

[2-5] Shortening method 3
An image showing an object that suits the tastes of the participants may be a shortened image.
FIG. 16 shows the functional configuration realized in this modification. In FIG. 16, a distribution server device 30d including a preference information acquisition unit 311, an attribute determination unit 312, and an original data storage unit 313 in addition to the units shown in FIG. 5 is shown.

The preference information acquisition unit 311 of this modified example acquires preference information indicating the preference of the participant. The preference information acquisition unit 311 in this case is an example of the "second preference acquisition unit" of the present invention. The preference information acquisition unit 311 acquires preference information as described in the explanation of FIG. The attribute determination unit 312 determines the attribute of the target reflected in the live video acquired by the original data acquisition unit 301. The attribute determination unit 312 is an example of the "attribute determination unit" of the present invention.

Targets are, for example, vehicles, buildings (general buildings, historic buildings, etc.), people, natural objects (flowers, trees, mountains, sea, etc.), animals, and the like. The attribute determination unit 312 stores, for example, images of those objects and attributes corresponding to each object. The attribute determination unit 312 stores, for example, an image of a train, a station, an iron bridge, etc. in association with an attribute of "railroad", and associates an image of a triumphal arch, the Eiffel Tower, the Palace of Versailles, etc. with an attribute of "historical monument". And remember.

The attribute determination unit 312 reads, for example, content data indicating a live image during a period during which the participant is not viewing (interruption period, shortened image display period) from the content data storage unit 305, and the read content data indicates the live. Pattern matching processing is performed using the matching image stored in advance for the video. The attribute determination unit 312 determines the attribute associated with the target that matches the matching image as the attribute of the target shown in the live image.

The content data in this case may be data indicating the terminal ID of the participant terminal 20 to which the shortened video is delivered, or data indicating the terminal ID of the other participant terminal 20 (that is, another participant has seen it). Content data indicating an image) may be used. The attribute determination unit 312 stores the determined attribute and the time when the object for which the attribute is determined is displayed as the determination result.

The shortened content generation unit 307 is shortened so as to include an object for which an attribute related to the preference indicated by the preference information acquired by the preference information acquisition unit 311 is determined (specifically, a video showing the object is included). Generate video. The abbreviated content generation unit 307 includes, for example, a combination of tastes and attributes related to each other, such as "railroad lover", "shooting iron" and "ride iron", and a combination of attributes "railroad", "history lover" and "history lover". Memorize the combination of the preference of "historical connoisseur" and the attributes of "historic sites", "ruins" and "historical monuments".

The shortened content generation unit 307 reads the preference information of the participant terminal 20 to which the shortened video is delivered from the preference information acquisition unit 311 and stores the combination with the preference indicated by the read preference information (that is, is related). ) The determination result indicating the attribute is read from the attribute determination unit 312. The shortened content generation unit 307 generates a shortened video including a video of the time indicated by the read determination result, that is, a video showing an object whose attributes related to the preference indicated by the acquired preference information are determined.

The content distribution unit 308 distributes the shortened video generated in this way. In the above example, the attribute determination unit 312 determines the attributes of the live video cut out from the participant terminal 20 in the specified range, but even if the attribute determination unit 312 determines the attributes of the live video cut out in the specified range. Good. The original data storage unit 313 accumulates the live video (360-degree image) taken by the agent terminal 10 by accumulating the original data acquired by the original data acquisition unit 301.

The attribute determination unit 312 reads from the original data storage unit 313 the original data indicating the live image during the period during which the viewing is not performed (interruption period, display period of the shortened image), and is reflected in the live image indicated by the read original data. Determine the attributes of the target. Regardless of which live video the attribute is judged from, the target with the attribute related to the participant's preference will be reflected in the shortened video, so compared to the case where the participant's preference and the shortened video are not related, participation It is possible to deliver a shortened video that attracts people's interest.

[2-6] Shortening method 4
In the displayed video, a shortened video that matches the tendency of the target that the participant is watching may be delivered.
FIG. 17 shows the functional configuration realized in this modification. In FIG. 17, a participant terminal 20e having a line-of-sight position notification unit 206 in addition to each unit shown in FIG. 5 and a distribution server device including an attribute determination unit 312 and an original data storage unit 313 in addition to each unit shown in FIG. 30e is represented.

The line-of-sight position notification unit 206 of the participant terminal 20e notifies the distribution server device 30e of the position where the line-of-sight of the participant is facing in the video displayed on the own terminal. The participant terminal 20e is provided with a photographing device for photographing the eyes of the wearer of the own terminal. The line-of-sight position notification unit 206 identifies, for example, the positions of the inner corner of the eye and the iris from the captured image of the eye, and determines the position where the line of sight is directed based on those positions and the mutual positional relationship.

The line-of-sight position notification unit 206 determines, for example, that if the iris is far from the inner corner of the right eye, it is looking at the right side, and if the iris is close to the inner corner of the right eye, it is looking at the left side. The method for determining the position where the line of sight is directed is not limited to this, and other well-known techniques may be used. The line-of-sight position notification unit 206 transmits to the distribution server device 30e the line-of-sight information indicating the position on the image that the participant's line of sight is looking at and the time when the image is displayed.

In the distribution server device 30e, the transmitted line-of-sight information is supplied to the attribute determination unit 312. The attribute determination unit 312 determines the attribute of the target (hereinafter referred to as “first attribute”) reflected in the position where the line of sight of the participant is facing in the image displayed by the participant terminal 20e. The attribute determination unit 312 in this case is an example of the "first determination unit" of the present invention. The attribute determination unit 312 reads the content data indicating the image displayed on the participant terminal 20e at the time indicated by the line-of-sight information from the content data storage unit 305, and performs pattern matching processing as described in the description of FIG.

The attribute determination unit 312 determines as the first attribute the attribute associated with the target that matches the matching image at the position indicated by the line-of-sight information. Further, as described in the explanation of FIG. 16, the attribute determination unit 312 determines the attribute of the target (hereinafter referred to as “second attribute”) reflected in the live video acquired by the original data acquisition unit 301. The attribute determination unit 312 in this case is an example of the "second determination unit" of the present invention.

The attribute determination unit 312 determines the first attribute during the period in which the participant wearing the participant terminal 20e is watching the live video, and notifies the shortened content generation unit 307 of the determined first attribute. In addition, the attribute determination unit 312 determines the second attribute during the period when the participant is not watching the live video (the period during which the participant is interrupted and the period during which the shortened video is being viewed), and shortens the determined second attribute. Notify the content generation unit 307.

The shortened content generation unit 307 generates a shortened video in which the live video is shortened so as to include the target for which the second attribute related to the determined first attribute is determined. For example, the Arc de Triomphe and the Eiffel Tower are associated with the attribute "historical monument", and the Colosseum and Roman Forum are associated with the attribute "ruins" or "historic sites". The abbreviated content generation unit 307 stores "historical buildings", "ruins", and "historic sites" as attributes related to each other because they are all related to history.

For example, when the abbreviated content generation unit 307 determines "ruins" as the first attribute, the abbreviated content generation unit 307 determines that "ruins", "historic sites", or "historical buildings", which are attributes related to "ruins", as the second attribute. The range including the target is cut out from the original live image (360 degree image). Even if the first attribute and the second attribute are the same as in this example, they are treated as related attributes. Moreover, the relationship of attributes related to each other is not limited to this. For example, "ruins" and "historic sites" may be related to each other, but they may not be related to "historical monuments". The relationship of attributes related to each other is determined by, for example, a virtual travel service provider.

The image may be cut out by instructing the image cutting unit 302. If the shortened content generation unit 307 is too long as a shortened video, the shortened content generation unit 307 generates a shortened video as a shortened video. If the cut-out video is too short as the shortened video, the shortened content generation unit 307 generates a shortened video by adding the video cut out in the specified range at the time of interruption as in the embodiment.

The content distribution unit 308 distributes the shortened video generated in this way. In the example of FIG. 17, the shortened content generation unit 307 determines the target to be included in the shortened video based on the relationship between the attributes of the target shown in the video. For example, the preference information acquisition unit 311 shown in FIG. 16 is used. In preparation for the participant terminal 20e, the preference information acquisition unit 311 acquires the preference information indicating the preference related to the determined first attribute, and the shortened content generation unit 307 sets the preference indicated by the acquired preference information. The object for which the related second attribute is determined may be included in the shortened video.

In either case, the user (participant) often looks at the object that he or she is interested in, so the first attribute (including the preferences related to the first attribute) represents the field that the user is interested in. Prone. Therefore, the second attribute related to the first attribute is more likely to represent a field in which the user is more likely to be interested than the other attributes, so that the target for which the second attribute is determined is reflected in the shortened video. , It is possible to deliver a shortened video that attracts the interest of the participants, as compared with the case where the second attribute and the shortened video are not related.

[2-7] Shortening method 5
In the above modification, the still image is saved when the participant performs the save operation, but the still image may be saved when the distribution server device determines. Further, a shortened video in which a still image and a moving image are mixed may be delivered.

FIG. 18 shows the functional configuration realized in this modification. In FIG. 18, a distribution server device 30f including a specific target determination unit 314 in addition to each unit shown in FIG. 5 is shown. The specific target determination unit 314 determines whether or not a specific target is reflected in the live video acquired by the original data acquisition unit 301. Specific objects include, for example, objects that want to see the movement of people, animals, vehicles, waterfalls, etc., objects that want to see three-dimensionally, such as sculptures and objects, or objects that want to listen to the sounds of musical instruments and the stage together. Is determined.

For example, the specific target determination unit 314 stores an image of a specific target in advance, reads the stored content data from the content data storage unit 305, and shows a live image (acquired live image) indicated by the read content data. The presence or absence of a specific target in (1 example) is determined by using a pattern matching technique. The specific target determination unit 314 supplies the shortened content generation unit 307 together with the content data with the determination result indicating the time when the specific object is displayed and the time when the specific object is not displayed.

The shortened content generation unit 307 includes an image determined by the specific target determination unit 314 to show a specific target as a moving image, and includes an image determined by the specific target determination unit 314 that the specific object is not shown. The video included in the still image is generated as a shortened video. The content distribution unit 308 distributes the shortened video generated in this way.
FIG. 19 shows an example of a shortened image of this modified example. In FIG. 19, the live video D6 indicated by the content data is shown.

The live video D6 from the interruption instruction to the restart instruction includes moving images D6-1 and D6-2 showing a specific target. The shortened content generation unit 307 generates a shortened video E61 including the moving images D6-1 and D6-2 and still images F11, F12, ..., F18 included in other parts of the live video D6. There is. These still images are extracted images of a fixed time interval in a portion of the live image D6 in which a specific object is not displayed.

As the number of still images included in the shortened video increases, the amount of data in the shortened video decreases, and communication delays are less likely to occur. In the example of FIG. 19, by including the still image in this way, the delay in communication can be suppressed, and the object whose movement is desired can be shown to the participants as a moving image. Contrary to the above example, the shortened content generation unit 307 includes a still image that is determined to show a specific target, and a moving image that is determined not to show a specific target. The image included in may be generated as a shortened image.

In this case, for example, paintings, landscapes, buildings, etc. are defined as specific objects. As a result, it is possible to show the participants a still image of an object that they want to see without moving it like a painting. As described above, the shortened content generation unit 307 of this modification includes the video determined to show a specific target in one of the moving image and the still image, and determines that the specific target is not shown. A video including the video as one of the moving image and the still image is generated as a shortened video.

[2-8] Shortening method 6
The shortened content generation unit 307 may generate the shortened content by a method different from each of the above examples. A method of generating shortened content of this modification will be described with reference to FIG.
FIG. 20 shows an example of a shortened image generated in this modified example.

In FIG. 20, a shortened video E7 is generated by shortening the live video D7. Upon receiving the restart instruction from the participant terminal 20, the shortened content generation unit 307 starts generating the shortened video E7 for the live video D7 acquired after the interruption instruction. The shortened content generation unit 307 starts generating the shortened video E7 in which, for example, the playback speed (speed at which the moving image is displayed) of the live video D7 is multiplied by N (N is a number greater than 1.0).

The shortened content generation unit 307 supplies the content data indicating the generated shortened video E7 to the content data transmission unit 306 in parallel with the generation of the shortened video E7. By transmitting the supplied content data by the content data transmission unit 306, the content output unit 203 of the participant terminal 20 outputs the shortened video E7 indicated by the transmitted content data.

The parallel execution of the acquisition of the live video by the distribution server device 30 and the output of the shortened video by the participant terminal 20 is, for example, a well-known chase reproduction technique (viewing is started from the middle after the distribution of the live video is started). In some cases, this may be done using a technique for reproducing the live video from the beginning). The shortened content generation unit 307 ends the generation of the shortened video E7 when the output of the shortened video E7 catches up with the live video D7 acquired.

In this modification, the larger the magnification of the playback speed described above, the faster the time when the shortened video catches up with the live video, and the smaller the magnification, the easier it is to grasp the content of the shortened video. On the contrary, the magnification of the playback speed may be calculated by calculating back from the time when the shortened video is desired to catch up with the live video. For example, it is assumed that a time before a predetermined time (for example, 30 minutes) before the end time of the live video is set as a target time and the shortened video is caught up with the live video.

The shortened content generation unit 307 is the time from the time when the restart instruction is given to the target time (the playback time of the shortened video E7 in the example of FIG. 20) from the time when the interruption instruction is given to the target time (FIG. 20). In the case of the above example, the value obtained by dividing the playback time of the live video D7) is calculated as the magnification. If the shortened video is played back at this magnification, it will reach the same playback position as the live video at the target time.

In addition, the shortened content generation unit 307 may change the magnification according to the degree to which an object matching the taste of the participant is displayed in the live video. Specifically, the shortened content generation unit 307 calculates the ratio of the time during which the target that matches the taste of the participant is displayed in the live video until the interruption instruction is given, and the larger the calculated ratio (that is, that is). Change the magnification smaller (the more the live video shows more objects that match the tastes of the participants).

The determination of the image showing the target matching the taste of the participant may be performed by the preference information acquisition unit 311 and the attribute determination unit 312 shown in FIG. As a result, the more the content that the participant wants to see is included in the interrupted video, the easier it is to grasp the content of the shortened video.

[2-9] In the embodiment, the shortened video content distribution unit 308 distributes the shortened video generated by the shortened content generation unit 307, but the present invention is not limited to this. For example, the content distribution unit 308 adds time information (start time and end time of the part) of the live video to the original data indicating the live video as meta information (also tagged). The shortened video may be delivered by transmitting (referred to as).

[2-10] Shortened video during continuous viewing The shortened video may be delivered even when the participant does not interrupt the viewing. For example, when a participant wants to see a live video delivered before the live video being delivered or a shortened video of a live video seen by another participant, an operation of instructing the delivery of the shortened video (a specific controller). Or perform a specific gesture, etc.). At that time, a period (start time, end time) and a video (video of oneself or another participant, etc.) that are the targets of the shortened video may be input.

When these operations are performed, the participant terminal 20 transmits instruction data instructing the generation of the shortened video to the distribution server device 30. Upon receiving this instruction, the shortened content generation unit 307 generates a shortened video obtained by shortening the video for the instructed period. The content distribution unit 308 distributes the shortened video generated in this way. Also in this modified example, as in the embodiment, the user can grasp the content of the live video in a short time as compared with the case where the shortened video is not delivered.

[2-11] Multiple Agent Terminals There may be a plurality of agent terminals that capture images of travel destinations.
FIG. 21 shows the overall configuration of the virtual travel system 1g of this modified example. In the virtual travel system 1, instead of the agent terminal 10 shown in FIG. 1, the agent terminals 10g-1, 10g-2, 10g-3, ... (If the following are not distinguished, "agent terminal 10g"" ) Is provided.

Each of the agent terminals 10g has the same hardware configuration and functional configuration as the agent terminal 10 shown in FIG. The original data acquisition unit 301 of the distribution server device 30 acquires the shooting data transmitted from each agent terminal 10g as the original data of the content. At each participant terminal 20, for example, an operation of selecting an agent terminal 10g for capturing a video included in the content to be distributed is performed. This operation may be performed by using the input device 25 or by a predetermined gesture represented by the terminal orientation information.

The designated range determination unit 202 of the participant terminal 20 transmits range information indicating the terminal ID of the selected agent terminal 10g in addition to the determined designated range to the distribution server device 30. By receiving the transmitted range information, the designated range acquisition unit 303 acquires the range of the video specified in the video of the agent terminal 10g identified by the terminal ID indicated by the range information, that is, the designated range.

The video cutting unit 302 cuts out the range of the video indicated by the acquired range information, that is, the designated range in the video of the agent terminal 10g selected by the participant. The live content generation unit 304 generates content data indicating the video cut out in this way, that is, the video cut out from the video shot by the agent terminal 10g selected by the participant. The content data transmission unit 306 transmits the generated content data to the participant terminal 20.

As described above, in the present modification, the content distribution unit 308 distributes the content including the video cut out from the video captured by the agent terminal 10g selected by the participant to the participant terminal 20 of the participant. In addition, the participant may change the agent (agent terminal 10g) for shooting the image he / she wants to see while outputting the content. Further, the places taken by the plurality of agents may be different places in the same tourist spot (for example, near the entrance, the center, the exit in the park, etc.), or may be different tourist spots. .. In either case, the video that the participant wants to see can be specified from a wider range of video as compared with the case where there is only one agent.

[2-12] Participant Terminal In the embodiment, a head-mounted display (HMD) is used as a participant terminal, but the present invention is not limited to this. For example, a smartphone, a tablet terminal, a personal computer, or the like may be used as a participant terminal. In short, any display device may be used as the participant terminal as long as it is a device capable of displaying live video and shortened video.

In addition, the participant terminal may have an operation device connected by wire or wirelessly. The device for operation is, for example, a controller that is operated by holding it by hand or a wearable controller that is attached to a body (for example, a hand or foot) and operated by the movement of the body. A wearable controller is useful, especially when the participant terminal is an HMD, because the hand cannot be seen. At this time, information that can be used as a reference for operation on the wearable controller (for example, a cursor indicating a position on the screen selected by the wearable controller) may be displayed on the display of the participant terminal. ..

[2-13] Devices for Realizing Each Part The devices for realizing each function shown in FIGS. 5 and the like are not limited to the devices shown in those figures. For example, the distribution server device 30 may realize the designated range determination unit 202 included in the participant terminal 20. Further, in the example of FIG. 17, the attribute determination unit 312 has determined both the first attribute and the second attribute, but these may be determined by different functions. Further, each function provided by one device (agent terminal, participant terminal, and distribution server device) may be shared and realized by two or more devices. In short, as long as these functions are realized in the virtual travel system as a whole, the virtual travel system may have any number of devices.

[2-14] System In each of the above examples, a system for providing a virtual travel service (virtual travel system) has been described, but the present invention is also applicable to other systems. For example, it may be applied to a system for virtually performing performances, sports games, viewing museums, and the like. It may also be applied to a system that delivers live video captured by a robot or drone. In short, the present invention may be applied to any system as long as it delivers live video. In either system, the viewer of the live video becomes the user, and the user can grasp the content of the live video in a short time as compared with the case where the shortened video is not delivered.

[2-15] Category of Invention The present invention can be regarded as an information processing system such as a virtual travel system provided with each information processing device such as an agent terminal, a participant terminal and a distribution server device. Further, the present invention can be regarded as an information processing method for realizing the processing performed by each device, and also as a program for operating a computer that controls each device. This program may be provided in the form of a recording medium such as an optical disk in which it is stored, or may be provided in the form of being downloaded to a computer via a network such as the Internet, installed and made available. May be done.

[2-16] Processing Procedures, etc. The order of the processing procedures, sequences, flowcharts, etc. of each embodiment described in the present specification may be changed as long as there is no contradiction. For example, the methods described herein present elements of various steps in an exemplary order, and are not limited to the particular order presented.

[2-17] Handling of input / output information, etc. The input / output information, etc. may be stored in a specific location (for example, a memory) or may be managed by a management table. Input / output information and the like can be overwritten, updated, or added. The output information and the like may be deleted. The input information or the like may be transmitted to another device.

[2-18] Software Software, whether referred to as software, firmware, middleware, microcode, hardware description language, or by any other name, is an instruction, instruction set, code, code segment, program code, program. , Subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc. should be broadly interpreted to mean.

Further, software, instructions, and the like may be transmitted and received via a transmission medium. For example, the software uses wired technology such as coaxial cable, fiber optic cable, twist pair and digital subscriber line (DSL) and / or wireless technology such as infrared, wireless and microwave to websites, servers, or other When transmitted from a remote source, these wired and / or wireless technologies are included within the definition of transmission medium.

[2-19] Information, Signals The information, signals, etc. described herein may be represented using any of a variety of different techniques. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be voltage, current, electromagnetic waves, magnetic fields or magnetic particles, light fields or photons, or any of these. It may be represented by a combination of.

[2-20] Systems, Networks The terms "system" and "network" as used herein are used interchangeably.

[2-21] Meaning of "based on" The phrase "based on" as used herein does not mean "based on" unless otherwise stated. In other words, the statement "based on" means both "based only" and "at least based on".

[2-22] "and", "or"
In the present specification, for configurations that can be implemented by either "A and B" or "A or B", the configuration described in one expression may be used as the configuration described in the other expression. For example, when "A and B" are described, they may be used as "A or B" as long as they are not inconsistent with other descriptions and can be implemented.

[2-23] Variations of Aspects, etc. Each of the examples described in the present specification may be used alone, in combination, or switched with execution. Further, the notification of predetermined information (for example, the notification of "being X") is not limited to the explicit one, but is performed implicitly (for example, the notification of the predetermined information is not performed). May be good.

Although the present invention has been described in detail above, it is clear to those skilled in the art that the present invention is not limited to the examples described herein. The present invention can be implemented as modifications and modifications without departing from the spirit and scope of the present invention as defined by the claims. Therefore, the description of the present specification is for the purpose of exemplifying explanation and does not have any restrictive meaning to the present invention.

Claims (12)

The video acquisition department that acquires live video and
It is a distribution unit that distributes the acquired live video to the display device, and when it receives an instruction to suspend and resume from the display device of the distribution destination, it is acquired as a shortened video of the live video from the interruption to the restart. The distribution unit that delivers the first shortened video, which is the shortened video of the live video ,
It is equipped with a target determination unit that determines whether or not a specific target is reflected in the acquired live video .
The distribution unit includes one of the moving image and the still image, which is the image determined to show the specific object, and the moving image and the still image, which is the image determined not to show the specific object. An information processing device that distributes an image included in the other of the two as the shortened image . The information processing device according to claim 1, wherein the distribution unit distributes a second shortened video which is the shortened video of the live video acquired while the shortened video is being delivered. When the distribution unit receives an instruction for interruption while distributing the shortened video and then receives an instruction for restarting, the distribution unit acquires the distribution portion of the shortened video after the interruption and from the interruption to the restart. The information processing apparatus according to claim 1 or 2, wherein the third shortened video, which is the shortened video combined with the shortened live video, is distributed. There is an end time for the live video distribution,
The distribution unit distributes the video displayed as the shortened video in a time corresponding to the length of the period from the end time of the live video to be shortened to the end time of the distribution, any one of claims 1 to 3. The information processing device described in the section. The video acquisition unit acquires live video to be distributed to a plurality of display devices, and obtains live video.
When the storage is instructed by a display device having a function of instructing the storage of a still image, a storage unit for saving the image displayed on the display device as a still image is provided.
The distribution unit includes an image including a still image saved by an instruction from a display device different from the display device from the interruption to the restart instructed by the display device or during the distribution of the shortened image to the display device. The information processing apparatus according to any one of claims 1 to 4, wherein the image is delivered as the shortened video. It is equipped with an evaluation unit that evaluates the stored still image.
The information processing apparatus according to claim 5, wherein the distribution unit distributes a video including a video having a high evaluation by the evaluation unit with priority over a video having a low evaluation as the shortened video. A first preference acquisition unit for acquiring preference information indicating the preference of each user of the plurality of display devices is provided.
Based on the acquired preference information, the distribution unit identifies a display device of a user whose taste is similar to that of the user of the display device to which the shortened video is distributed, and saves the image according to a storage instruction given from the display device. The information processing apparatus according to claim 5 or 6, wherein an image including the still image having priority over the other still images is distributed as the shortened image. The video acquisition department that acquires live video and
The second preference acquisition unit that acquires preference information indicating the user's preference,
An attribute judgment unit that determines the attributes of the target shown in the acquired live video,
It is a distribution unit that distributes the acquired live video to the display device of the user, and is a shortened video obtained by shortening the live video so as to include a target for which an attribute related to the preference indicated by the acquired preference information is determined. and a delivery unit to deliver,
It is equipped with a target determination unit that determines whether or not a specific target is reflected in the acquired live video .
The distribution unit includes one of the moving image and the still image, which is the image determined to show the specific object, and the moving image and the still image, which is the image determined not to show the specific object. An information processing device that distributes an image included in the other of the two as the shortened image . The first determination unit that determines the attribute of the target that is reflected in the position where the user's line of sight is facing in the image displayed by the display device, and
The video acquisition department that acquires live video and
The second judgment unit that judges the attributes of the target shown in the acquired live video,
The distribution unit that distributes the acquired live video to the display device of the user, and the attributes related to the attributes determined by the first determination unit include the target determined by the second determination unit. and a delivery unit for delivering a short video that was shortened to live video,
It is equipped with a target determination unit that determines whether or not a specific target is reflected in the acquired live video .
The distribution unit includes one of the moving image and the still image, which is the image determined to show the specific object, and the moving image and the still image, which is the image determined not to show the specific object. An information processing device that distributes an image included in the other of the two as the shortened image . Steps to get live footage and
It is a step of distributing the acquired live video to the display device, and when an instruction for interruption and resumption is received from the display device of the distribution destination, the live video is acquired as a shortened video from the interruption to the resumption. The step of delivering the first shortened video, which is the shortened video of the live video ,
Have a determining whether a particular subject on the obtained live video is reflected,
In the first shortened video distribution step, the video determined to show the specific target is included in one of the moving image and the still image, and the video determined not to show the specific target is included. An information processing method for delivering a video including the other of a moving image and a still image as the shortened video . Steps to get live footage and
Steps to acquire preference information indicating user preferences,
Steps to determine the attributes of the target shown in the acquired live video,
A shortened video obtained by shortening the live video so as to include a target whose attributes related to the taste indicated by the acquired taste information are determined, which is a step of delivering the acquired live video to the display device of the user. the method comprising the steps of delivery,
Have a determining whether a particular subject on the obtained live video is reflected,
In the shortened video distribution step, the video determined to show the specific target is included in one of the moving image and the still image, and the video determined not to show the specific target is included in the moving image. An information processing method for delivering a video included in the other of the still images as the shortened video . The first determination step of determining the attribute of the target displayed at the position where the user's line of sight is facing in the image displayed by the display device, and
Video acquisition steps to acquire live video and
The second judgment step to judge the attribute of the target reflected in the acquired live video, and
In the distribution step of delivering the acquired live video to the display device of the user, the attribute related to the attribute determined by the first determination step includes the target determined by the second determination step. and a distribution step of distributing a short video that was shortened to live video,
Have a determining whether a particular subject on the obtained live video is reflected,
In the shortened video distribution step, the video determined to show the specific target is included in one of the moving image and the still image, and the video determined not to show the specific target is included in the moving image. An information processing method for delivering a video included in the other of the still images as the shortened video .

Images