JP7075202B2 - Terminal device - Google Patents

Description

The present invention relates to a terminal device.

Ultra-high-definition high-resolution video content (high-resolution video content) such as 8K-SHV is becoming widespread. Such high-resolution video content has the characteristics that high reproducibility can be obtained and that the viewer can feel a three-dimensional effect as if looking at the real thing.

However, the current situation is that the reproduction environment for reproducing the above-mentioned high-resolution video content on a terminal device such as a mobile phone, a smartphone, or a tablet terminal used by the user is not sufficiently prepared. For example, as a method of providing video content to a viewer, a Broadcasting type in which the video content is transmitted by a broadcast wave, a Streaming type in which the video content is received by a terminal device and sequentially played from the received portion, and the entire video content is played on the terminal. There is a Download type that is generated after being received by the device. Since the data capacity of high-resolution video content is large, it is difficult to apply the above-mentioned Streaming type, and it is conceivable to apply a Download type such as Video Podcast. Further, considering the above-mentioned reception environment, it is not easy to apply the Broadcasting type at present.

Further, in recent years, some terminal devices are provided with a display capable of displaying 2K / 4K level images. However, at present, it is difficult to mount a display capable of displaying a higher resolution 8K level image on a terminal device from the viewpoint of cost and the like.

By the way, with the recent increase in speed and price of communication services and the widespread use of terminal devices such as smartphones, users have come to consume (view) various contents regardless of location. In addition, with the spread of social media, user content consumption tends to be more personal. Under such a tendency, it is necessary not only to produce content that attracts viewers, but also to provide content in a manner suitable for the consumption behavior of the content by the viewer, the consumption environment of the content by the viewer, and the like.

For example, Non-Patent Document 1 discloses a technique for viewing content in cooperation with two terminal devices (smartphones). In this technique, content is delivered to one terminal device from the viewpoint of a certain character, and content is delivered to the other terminal device from the viewpoint of another character. In this technology, when the content is viewed separately on each terminal device, the content ends without the two characters meeting, and when the two terminal devices are arranged side by side to view the content, the two characters meet. The production is given.

Further, Non-Patent Document 2 discloses a technique in which a plurality of terminal devices are arranged side by side in a row so that the content can be viewed virtually like one screen of the plurality of terminal devices.

"You can experience the" Kataware time "of Taki and Mitsuha by arranging two smartphones side by side !? A special video is now available on the" Yahoo! JAPAN "app! , [Online], [Search on November 22, 2017], Internet <URL: http://www.animatetimes.com/news/details.php?id=1501043635> "Let's connect smartphones together and enjoy the Christmas-only brilliant parade!" SYNC! ILLUMINATION "", [online], [Search on November 22, 2017], Internet <URL: http: //www.tokyodisneyresort.jp/blog/pr151029/ ＞

In the techniques disclosed in Non-Patent Documents 1 and 2, each of a plurality of terminal devices is connected to an external server (distribution server) on the network and grouped by a group ID assigned by the server. Then, the external server is notified by numbering in the order of belonging to the group, and a plurality of terminal devices are arranged in the order of the numbered numbers. The external server distributes different contents to the terminal devices of each number, and makes the user view one content as a whole.

In the technique as described above, the arrangement of the plurality of terminal devices is fixed based on the number assigned to each terminal device or the like. That is, the terminal device cannot autonomously detect the relative positional relationship with other terminal devices. Therefore, it is not possible to flexibly respond to changes in the arrangement of terminal devices.

An object of the present invention made in view of the above problems is to provide a terminal device capable of autonomously detecting a relative positional relationship between a self-device and another terminal device.

In order to solve the above problems, the terminal device according to the present invention is a terminal device that determines a relative positional relationship with another terminal device arranged on a plane or a three-dimensional surface together with the own device, and is a touch surface. When at least one of a plurality of outer edge regions set along the outer edge of the touch surface is touched in the touch surface by the slide operation of detecting the touch position by the touch operation with respect to the touch position and sliding the touch position. The sensor information generated by the detection unit is obtained by direct communication between the touched outer edge region and the detection unit that generates sensor information indicating the timing at which the outer edge region is touched, and the other terminal device. The shared unit that transmits to the terminal device and receives the sensor information from the other terminal device synchronizes the own device with the other terminal device, and the shared unit is between the other terminal device. The detection unit includes a determination unit that determines the relative positional relationship between the own device and the other terminal device based on the sensor information transmitted and received in, and the detection unit is the local time between the own device and the other terminal device. The determination unit further detects the difference between the own device and the other terminal device, and the determination unit synchronizes the own device with the other terminal device based on the difference in the local time between the own device and the own device as a reference among the own device and the other terminal device. The determination unit generates the manifest file from a distribution device that generates a plurality of divided videos obtained by dividing the video to be distributed and generates a manifest file including information indicating the storage location of each of the plurality of divided videos. The divided video corresponding to the position of the own device, which was acquired and based on the relative positional relationship between the own device and the other terminal device determined, was acquired based on the manifest file and acquired by the determination unit. It further includes a reconstructing unit that displays the divided video on the display unit of the own device .

Further, in the terminal device according to the present invention, it is preferable that the touch surface is rectangular and the outer edge region is provided corresponding to each of the four sides of the rectangular touch surface.

Further, in the terminal device according to the present invention, it is preferable that a plurality of outer edge regions are provided along at least one of the four sides of the touch surface.

Further, in order to solve the above problems, the terminal device according to the present invention is a terminal device that determines a relative positional relationship with another terminal device arranged on a plane or a three-dimensional surface together with the own device. The detection unit that detects the movement distance and movement direction of the own device from the reference position in the relative coordinate system in the three-dimensional space, and the other terminal device according to the overlap between the own device and the other terminal device. Information about the relative coordinate system in the three-dimensional space is transmitted and received by direct communication between the two, and the shared portion that matches the relative coordinate system with the other terminal device and the relative coordinate system by the shared portion. A determination unit for determining a relative positional relationship with the other terminal device based on the movement distance and the movement direction of the own device detected by the detection unit after the match is provided.

Further, in the terminal device according to the present invention, the terminal device further includes a camera unit arranged on one surface of the own device, and the detection unit has the other terminal device superimposed on the one surface based on the captured image of the camera unit. It is preferable to detect that.

Further, in the terminal device according to the present invention, when the determination unit detects that the own device is separated from the plane or the three-dimensional surface by a predetermined distance or more, the determination unit directly communicates with the own device and the common unit. It is preferable to determine that the own device is excluded from the group consisting of other terminal devices.

According to the terminal device according to the present invention, it is possible to autonomously detect the relative positional relationship between the own device and another terminal device.

It is a figure which shows the structural example of the image display system which concerns on one Embodiment of this invention. It is a figure which shows an example of the display mode of the content by a plurality of terminal devices shown in FIG. It is a figure which shows the configuration example of the distribution apparatus and the terminal apparatus shown in FIG. It is a figure which shows an example of the division and the resolution adjustment of the video to be distributed by the division part shown in FIG. It is a figure which shows another example of the division and the resolution adjustment of the video to be distributed by the division part shown in FIG. FIG. 3 is a diagram showing still another example of division / resolution adjustment of the video to be distributed by the division unit shown in FIG. 3. FIG. 3 is a diagram showing still another example of division / resolution adjustment of the video to be distributed by the division unit shown in FIG. 3. It is a figure for demonstrating the display of the image by the terminal apparatus shown in FIG. It is a figure which shows an example of the reconstruction pattern of the image to be delivered by the terminal apparatus shown in FIG. It is a figure which shows another example of the reconstruction pattern of the image to be delivered by the terminal apparatus shown in FIG. 1. It is a figure which shows still another example of the reconstruction pattern of the image to be delivered by the terminal apparatus shown in FIG. 1. It is a figure for demonstrating the divided image received by each terminal apparatus in the reconstruction pattern A shown in FIG. 6A. It is a figure for demonstrating the image displayed by the terminal apparatus at the upper left end in the reconstruction pattern A2 shown in FIG. 7A. It is a figure for demonstrating the divided image received by each terminal apparatus in the reconstruction pattern B shown in FIG. 6B. It is a figure for demonstrating the divided image received by each terminal apparatus in the reconstruction pattern C shown in FIG. 6C. It is a figure which shows an example of the arrangement which combined the vertical direction and the horizontal direction of the plurality of terminal devices shown in FIG. 1. It is a figure which shows another example of the arrangement which combined the vertical direction and the horizontal direction of the plurality of terminal devices shown in FIG. 1. It is a figure which shows an example of the display of the image corresponding to the orientation of the terminal apparatus shown in FIG. It is a figure which shows an example of the reproduction state of the content by a plurality of terminal devices shown in FIG. It is a figure which shows the structural example which concerns on the determination of the relative positional relationship with other terminal apparatus in the terminal apparatus shown in FIG. It is a figure which shows an example of the outer edge region provided on the touch surface of the touch sensor shown in FIG. It is a figure which shows the state which the touch operation is performed with respect to the terminal apparatus shown in FIG. It is a figure which shows another example of the outer edge region provided on the touch surface of the touch sensor shown in FIG. It is a figure for demonstrating the detection of the movement distance and the movement direction in the relative coordinate system in the three-dimensional space by the terminal apparatus shown in FIG. It is a figure for demonstrating the method of determining the relative positional relationship with other terminal apparatus by the 2nd method by the terminal apparatus shown in FIG. It is a figure which shows an example of the detection result of the relative positional relationship with other terminal apparatus by the 2nd method by the terminal apparatus shown in FIG. It is a figure which shows an example of switching between landscape display and Portrait display by the terminal apparatus shown in FIG. 1.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. In each figure, the same reference numerals indicate the same or equivalent components.

FIG. 1 is a diagram showing a configuration example of a video display system 1 according to an embodiment of the present invention.

The video display system 1 shown in FIG. 1 includes a distribution device 10 and a plurality of terminal devices 20. The distribution device 10 can communicate with each of the plurality of terminal devices 20 via the network 2 by wired communication or wireless communication. The video display system 1 according to the present embodiment displays video content distributed from the distribution device 10 on a plurality of terminal devices 20.

The distribution device 10 distributes the video content to the terminal device 20 via the network 2. The video content distributed by the distribution device 10 includes, for example, ultra-high-definition high-resolution video content (high-resolution video content) represented by 8K-SHV.

The terminal device 20 is a device owned by the user, such as a mobile phone, a smartphone, or a tablet terminal. The terminal device 20 has a display unit, and displays the video content (video) to be distributed by the distribution device 10 on the display unit.

FIG. 2 is a diagram showing an example of a display mode of video content distributed from the distribution device 10 by the terminal device 20 according to the present embodiment.

As shown in FIG. 2, in the present embodiment, a plurality of terminal devices 20 are arranged on a plane so that the display unit can be viewed, and the video content (video) to be distributed by the distribution device 10 is distributed to the plurality of terminal devices. Displayed by 20. That is, each of the plurality of terminal devices 20 displays the video in which the video to be distributed is divided, and makes the user view the video to be distributed as a whole. A plurality of terminal devices 20 may be arranged on a three-dimensional surface so that the display unit can be viewed, and the video content (video) to be distributed by the distribution device 10 may be displayed by the plurality of terminal devices 20.

Next, the configurations of the distribution device 10 and the terminal device 20 will be described.

FIG. 3 is a diagram showing a configuration example of the distribution device 10 and the terminal device 20 according to the present embodiment. Note that, in FIG. 3, among the configurations of the terminal device 20, the configuration related to the display (reproduction) on the display unit (not shown) of the video to be distributed will be mainly described. First, the configuration of the distribution device 10 will be described.

The distribution device 10 shown in FIG. 3 includes a division unit 11 and a distribution unit 12.

When the video content to be distributed (for example, high-resolution video) is input, the division unit 11 generates a distribution file for distributing the content. Specifically, the division unit 11 generates a plurality of divided videos obtained by dividing the video to be distributed as a distribution file. Here, the division unit 11 divides the video to be distributed into different division patterns according to the display mode by the plurality of terminal devices 20, and divides the plurality of division videos for each division pattern into a division group (division group 1, 2, ...) Is generated. As the display mode by the plurality of terminal devices 20, the number of terminal devices 20 for displaying the image to be distributed, the arrangement of the plurality of terminal devices 20, and the switching of the display according to the rotation of the terminal devices 20 (Landscape display (landscape display)). / Portrait display (portrait display)) is supported or not. The division unit 11 divides the video to be distributed according to the division patterns according to various display modes, and generates the divided video. Further, the division unit 11 may adjust the resolution of the video to be distributed according to the display mode.

4A to 4D are diagrams showing an example of division and resolution adjustment of the video to be distributed by the division unit 11. In FIGS. 4A to 4D, the resolution of the video to be distributed is shown in size.

FIG. 4A is a diagram showing an example in which the video to be distributed (original video) is not divided and the resolution is reduced (for example, reduced from 8K to 2K).

FIG. 4B is a diagram showing an example in which the video to be distributed is divided into four. FIG. 4B shows an example in which the resolution of the video to be distributed is reduced and then divided into four (2 × 2), and an example in which the resolution of the video to be distributed is divided into four as it is.

FIG. 4C is a diagram showing an example in which the video to be distributed is divided into nine. FIG. 4C shows an example in which the resolution of the video to be distributed is reduced and then divided into 9 parts (3 × 3). Although FIG. 4C shows an example in which the resolution of the video to be distributed is reduced and then divided into nine, the video to be distributed may be divided into nine while the resolution remains the same.

FIG. 4D is a diagram showing an example in which the video to be distributed is divided into 16 parts. FIG. 4D shows an example of 16 divisions (4 × 4) while maintaining the resolution of the video to be distributed.

Referring to FIG. 3 again, the division unit 11 further generates a manifest file as a distribution file. The manifest file contains information (for example, a URL (Uniform Resource Locator)) indicating the storage location of each of the plurality of divided videos in which the video to be distributed is divided. In addition, the manifest file contains information regarding the display (reconstruction) of the video to be distributed, including the division pattern of the video to be distributed.

The dividing unit 11 may not only reduce the resolution of the video to be distributed, but also increase the size of the video to be distributed and then divide the video. For example, at the time of reconstruction in the terminal device 20, only a part of the divided image is displayed on the display unit of the terminal device 20, that is, the image to be distributed is assumed to be reproduced by trimming a part of the divided image. The size of the device may be doubled vertically and horizontally, and then divided into four parts.

The distribution unit 12 distributes the plurality of divided images and manifest files generated by the division unit 11 to the terminal device 20. As a distribution method, for example, there is a method of publishing a manifest file and a divided video on a Web server as in the case of an existing podcast.

Next, the configuration of the terminal device 20 will be described.

The terminal device 20 shown in FIG. 3 includes a receiving unit 21, a synchronization unit 22, and a reconstructing unit 23.

The receiving unit 21 receives the manifest file released by the distribution device 10 and the divided video based on the received manifest file among the plurality of divided videos obtained by dividing the video to be distributed via the network 2. More specifically, the receiving unit 21 receives the divided video corresponding to the portion to be displayed by the own device among the plurality of divided videos obtained by dividing the video to be distributed. Therefore, the manifest file is received by all terminal devices 20. On the other hand, the divided video is received only by the terminal device 20 that displays the divided video. That is, the receiving target of the divided video is different in each terminal device 20. Therefore, each terminal device 20 does not need to receive the entire video to be distributed, so that the amount of communication can be reduced.

The synchronization unit 22 displays a video to be distributed by a plurality of terminal devices 20 arranged on a plane or a three-dimensional surface in order to display the video to be distributed by an arbitrary method, and the display mode thereof. The position of the device (relative positional relationship between the own device and the other terminal device 20) is detected. In the following, an example in which a plurality of terminal devices 20 are arranged on a plane will be described.

As shown in FIG. 2, when viewing the content distributed from the distribution device 10, the plurality of terminal devices 20 are arranged in a grid pattern on a plane. The synchronization unit 22 supports the number of terminal devices 20 for displaying the video to be distributed, the position of the own device (lattice coordinates) in the grid arrangement, and the presence / absence of switching of the display according to the rotation of the other terminal devices 20. Etc. are detected. Further, the synchronization unit 22 detects, for example, a deviation in the local time between the own device and the other terminal device 20.

The synchronization unit 22 transmits and receives various information such as detection results of various sensors (gyro sensor, ground axis sensor, etc.) included in the terminal device 20 and operation input to the terminal device 20 to and from another terminal device 20. Then, the synchronization unit 22 detects the display mode of the content, the position of the own device in the display mode, and the like, based on the information transmitted to and received from the other terminal device 20. The synchronization unit 22 transmits and receives various information by short-range wireless communication with another terminal device 20, that is, without going through the network 2. Therefore, the terminal device 20 can autonomously detect the display mode of the image to be distributed by the plurality of terminal devices 20 and the position of the own device in the display mode even in an environment where the network 2 cannot be accessed.

When the synchronization unit 22 detects the display mode of the video to be distributed by the plurality of display terminals 20 and the position of the own device, the synchronization unit 22 distributes the video in a division pattern according to the detected display mode shown in the manifest file received by the reception unit 21. Among the plurality of divided images in which the target image is divided, the receiving unit 21 is made to receive the divided image corresponding to the detected position of the own device. Further, the synchronization unit 22 outputs the detected display mode and the position of the own device to the reconstruction unit 23.

When the synchronization unit 22 detects a position change and rotation of the own device, an addition of the terminal device 20 for reproducing the content, or the like, the synchronization unit 22 requests the reception unit 21 and the reconfiguration unit 23 to reprocess. By doing so, even if the display mode is changed, the video to be distributed can be autonomously displayed according to the changed display mode.

Based on the manifest file received by the receiving unit 21, the reconstructing unit 23 displays the divided image received by the receiving unit 21 on the display unit by enlarging / reducing it according to the display mode detected by the synchronization unit 22. do. In addition, the reconstruction unit 23 plays, stops, pauses, and the like of the content by a predetermined operation input. Further, when the reconfiguration unit 23 is requested to be reprocessed due to the position change and rotation of the own device or another terminal device 20, the addition of the terminal device 20 for reproducing the content, or the like, the reconfiguration unit 23 responds to the changed display mode. The displayed image is displayed on the display unit.

Next, the operation of the distribution device 10 and the terminal device 20 in the video display system 1 according to the present embodiment will be described.

FIG. 5 is a diagram for explaining the display of the video to be distributed by the terminal device 20 according to the present embodiment. In FIG. 5, the video to be distributed will be described as an 8K video.

The distribution device 10 divides the video to be distributed (8K video) into 16 resolutions (2K video), the video to be distributed into 4 parts (4K × 4), and the video to be distributed into 16 parts. A divided video (2K × 16) or the like is generated in advance.

When the terminal device 20 displays the image to be distributed by one unit, for example, as shown in FIG. 5, the terminal device 20 displays the image in which the resolution of the image to be distributed is lowered.

One terminal device 20 for displaying the image to be distributed is added. For example, as shown in FIG. 5, when two terminal devices 20 are arranged adjacent to each other in the vertical direction, the two terminal devices 20 are arranged. In each case, the display mode of the video to be distributed (the number of video to be distributed and its arrangement), the positional relationship between the own device and the other terminal device 20, etc. are detected, and the division pattern corresponding to the detected display mode is used. Of the divided video (divided video divided into four), the divided video corresponding to the position of the own device is received and displayed on the display unit.

Further, as shown in FIG. 5, when three terminal devices 20 for displaying the image to be distributed are added, each of the five terminal devices 20 has a display mode of the image to be distributed, its own device, and other terminals. The positional relationship with the device 20 is detected, and among the divided images (16 divided images) divided by the divided pattern corresponding to the detected display mode, the divided image corresponding to the position of the own device is received. Display on the display.

In this way, the distribution device 10 generates a plurality of divided videos in which the video to be distributed is divided into different division patterns according to the display mode of the video to be distributed. The terminal device 20 detects a display mode in which the video to be distributed is displayed on the plurality of terminal devices 20 and the position of the own device in the display mode, and the video to be distributed is divided by a division pattern according to the detected display mode. Of the plurality of divided images, the divided image corresponding to the position of the own device is received and displayed. Therefore, it is possible to display the video more flexibly according to the display mode of the video to be distributed by the plurality of terminal devices 20 without going through a server device or the like.

6A to 6C are diagrams showing an example of a reconstruction pattern of a video to be distributed according to the number of terminal devices 20.

In the reconstruction pattern (reconstruction pattern A) shown in FIG. 6A, when the number of terminal devices 20 displaying the images to be distributed is one, the terminal devices 20 display the undivided images to be distributed. do. When the number of terminal devices 20 for displaying images to be distributed is 2-4, each terminal device 20 has a divided image corresponding to the position of its own device in a display mode of 2 × 2 grid arrangement. Is displayed. Further, when the number of the terminal devices 20 for displaying the video to be distributed is 5-16, each terminal device 20 corresponds to the position of the own device in the display mode of the 4 × 4 grid arrangement. Display split video.

In the reconstruction pattern (reconstruction pattern B) shown in FIG. 6B, when the number of terminal devices 20 displaying the images to be distributed is one, the terminal devices 20 display the undivided images to be distributed. do. When the number of terminal devices 20 for displaying images to be distributed is 2-4, each terminal device 20 has a divided image corresponding to the position of its own device in a display mode of 2 × 2 grid arrangement. Is displayed. Further, when the number of the terminal devices 20 for displaying the video to be distributed is 5-9, each terminal device 20 corresponds to the position of the own device in the display mode of the 3 × 3 grid arrangement. Display split video. Further, when the number of the terminal devices 20 for displaying the video to be distributed is 10 to 16, each terminal device 20 corresponds to the position of the own device in the display mode of the 4 × 4 grid arrangement. Display split video.

In the reconstruction pattern (reconstruction pattern C) shown in FIG. 6C, when the number of terminal devices 20 displaying the images to be distributed is one, the terminal devices 20 display the undivided images to be distributed. do. When the number of terminal devices 20 for displaying images to be distributed is 2-16, each terminal device 20 has a divided image corresponding to the position of its own device in a display mode of 4 × 4 grid arrangement. Is displayed.

In this way, even if the number of terminal devices 20 that display the video to be distributed is the same, various reconstruction patterns can be set. In the manifest file, the division unit 11 specifies the division pattern of the video to be distributed and the reconstruction pattern of the video to be distributed. By doing so, the distribution side can display the video to be distributed in a desired reconstruction pattern.

Further, even if the reconstruction pattern is the same, the divided video received by each terminal device 20 may be different. Hereinafter, a case where the divided video received by each terminal device 20 is different even in the same reconstruction pattern will be described.

FIG. 7A is a diagram showing a divided image received by each terminal device 20 when the reconstruction pattern A described with reference to FIG. 6A is used as the reconstruction pattern. In FIG. 7A, it is assumed that an image in which the resolution of the image to be distributed is lowered, a divided image in which the image to be distributed is divided into four, and a divided image in which the image to be distributed is divided into 16 are prepared. Further, in the following, each rectangle of the reconstruction pattern indicates each terminal device 20, and the number assigned to each rectangle indicates the divided image received by the terminal device 20 corresponding to the rectangle.

As described with reference to FIG. 6A, in the reconstruction pattern A, when the number of terminal devices 20 for displaying the video to be distributed is 2-4, the display mode is a 2 × 2 grid arrangement. , Each terminal device 20 displays a divided image corresponding to the position of its own device. Further, when the number of terminal devices 20 for displaying the video to be distributed is 5-16, each terminal device 20 is divided according to the position of its own device in the display mode of 4 × 4 grid arrangement. Display the image.

In the reconstruction pattern A1, as shown in FIG. 7A, when the number of terminal devices 20 displaying the images to be distributed is 2-4, each terminal device 20 displays a 2 × 2 grid arrangement. In the embodiment, the divided video corresponding to the position of the own device in the 2 × 2 grid arrangement is displayed from the divided video in which the video to be distributed is divided into four. Further, when the number of terminal devices 20 for displaying the images to be distributed is 5 to 16, each terminal device 20 is divided into 16 parts of the images to be distributed in a display mode of a 4 × 4 grid arrangement. From the divided images, the divided images corresponding to the positions of the own device in the 4 × 4 grid arrangement are displayed.

In the reconstruction pattern A2, as shown in FIG. 7A, when the number of terminal devices 20 displaying the images to be distributed is 2-4, each terminal device 20 displays a 2 × 2 grid arrangement. In the embodiment, the divided video corresponding to the position of the own device in the 2 × 2 grid arrangement is displayed from the divided video in which the video to be distributed is divided into four.

Further, when the number of terminal devices 20 for displaying the video to be distributed is 5 to 16, each terminal device 20 is divided into four in a display mode of a 4 × 4 grid arrangement. From the divided images, the divided images corresponding to the positions of the own device in the 4 × 4 grid arrangement are displayed. That is, for example, when the position of the terminal device 20 corresponds to the position of four units on the upper left of the 4 × 4 grid arrangement, the terminal device 20 is divided into four parts of the image to be distributed. , Receive the split video 2 on the upper right. Then, for example, when the position of the own device corresponds to the position of the upper left end of the 4 × 4 grid arrangement, the terminal device 20 has the upper left of the received divided video 2 as shown in FIG. 7B. The image 2A of a quarter part of the above is displayed.

FIG. 8 is a diagram showing a divided image received by each terminal device 20 when the reconstruction pattern B described with reference to FIG. 6B is used as the reconstruction pattern. In FIG. 8, the resolution of the video to be distributed is lowered, the video to be distributed is divided into four parts, the video to be distributed is divided into nine parts, and the video to be distributed is divided into 16 parts. It is assumed that a split video is prepared.

As described with reference to FIG. 6B, in the reconstruction pattern B, when the number of terminal devices 20 for displaying the video to be distributed is 2-4, the display mode is a 2 × 2 grid arrangement. , Each terminal device 20 displays a divided image corresponding to the position of its own device. Further, when the number of terminal devices 20 for displaying the video to be distributed is 5-9, each terminal device 20 is divided according to the position of its own device in the display mode of 3 × 3 grid arrangement. Display the image. Further, when the number of terminal devices 20 for displaying the video to be distributed is 10 to 16, each terminal device 20 is divided according to the position of its own device in the display mode of 4 × 4 grid arrangement. Display the image.

In the reconstruction pattern B1, as shown in FIG. 8, when the number of terminal devices 20 for displaying the video to be distributed is 2-4, each terminal device 20 displays a 2 × 2 grid arrangement. In the embodiment, the divided video corresponding to the position of the own device in the 2 × 2 grid arrangement is displayed from the divided video in which the video to be distributed is divided into four. Further, when the number of terminal devices 20 for displaying the images to be distributed is 5-9, each terminal device 20 is divided into 9 parts of the images to be distributed in a display mode of a 3 × 3 grid arrangement. From the divided images, the divided images corresponding to the positions of the own device in the 3 × 3 grid arrangement are displayed. Further, when the number of terminal devices 20 for displaying the images to be distributed is 10 to 16, each terminal device 20 is divided into 16 parts of the images to be distributed in a display mode of a 4 × 4 grid arrangement. From the divided images, the divided images corresponding to the positions of the own device in the 4 × 4 grid arrangement are displayed.

In the reconstruction pattern B2, as shown in FIG. 8, when the number of terminal devices 20 for displaying the video to be distributed is 2-4, each terminal device 20 displays a 2 × 2 grid arrangement. In the embodiment, the divided video corresponding to the position of the own device in the 2 × 2 grid arrangement is displayed from the divided video in which the video to be distributed is divided into four.

When the number of terminal devices 20 for displaying the video to be distributed is 5-9, the terminal device 20 located at the upper left end, the upper right end, the lower left end, and the lower right end divides the image to be distributed into four. From the divided video, the divided video at the corresponding position is received. That is, the terminal device 20 at the upper left end receives the divided video 2 on the upper left of the divided video in which the video to be distributed is divided into four. Further, the terminal device 20 at the upper right end receives the divided video 3 on the upper right of the divided video in which the video to be distributed is divided into four. Further, the terminal device 20 at the lower left end receives the divided video 4 at the lower left of the divided video in which the video to be distributed is divided into four. Further, the terminal device 20 at the lower right end receives the divided video 5 at the lower right of the divided video in which the video to be distributed is divided into four. Further, the other terminal device 20 corresponds to the position of the own device in the 3 × 3 grid arrangement from the divided video in which the image to be distributed is divided into 9 in the display mode of the 3 × 3 grid arrangement. Display the split video. Similar to FIG. 7B, the terminal devices 20 located at the upper left end, the upper right end, the lower left end, and the lower right end each display a part of the received divided images according to the position of the own device on the display unit. ..

Further, when the number of terminal devices 20 for displaying the video to be distributed is 10 to 16, each terminal device 20 is divided into four in a display mode of a 4 × 4 grid arrangement. From the divided images, the divided images corresponding to the positions of the own device in the 4 × 4 grid arrangement are displayed. That is, for example, when the position of the terminal device 20 corresponds to the position of four units on the upper left of the 4 × 4 grid arrangement, the terminal device 20 is divided into four parts of the image to be distributed. , Receives the split video 2 on the upper left. Then, for example, when the position of the own device corresponds to the position of the upper left end in the grid pattern arrangement of 4 × 4, the terminal device 20 is a part of the received divided video (as in FIG. 7B). The image of the upper left quarter) is displayed on the display.

FIG. 9 is a diagram showing a divided image received by each terminal device 20 when the reconstruction pattern C described with reference to FIG. 6C is used as the reconstruction pattern. In FIG. 9, it is assumed that an image in which the resolution of the image to be distributed is lowered, a divided image in which the image to be distributed is divided into four, and a divided image in which the image to be distributed is divided into 16 are prepared.

As described with reference to FIG. 6C, in the reconstruction pattern C, when the number of terminal devices 20 for displaying the video to be distributed is 2-16, the display mode is a 4 × 4 grid arrangement. , Each terminal device 20 displays a divided image corresponding to the position of its own device.

In the reconstruction pattern C1, as shown in FIG. 9, when the number of terminal devices 20 for displaying the video to be distributed is 2-16, each terminal device 20 displays a 4 × 4 grid arrangement. In the embodiment, the divided video corresponding to the position of the own device in the 4 × 4 grid arrangement is displayed from the divided video in which the video to be distributed is divided into 16.

In the reconstruction pattern C2, as shown in FIG. 9, when the number of terminal devices 20 for displaying the video to be distributed is 2-16, each terminal device 20 displays a 4 × 4 grid arrangement. In the embodiment, the divided video corresponding to the position of the own device in the 4 × 4 grid arrangement is displayed from the divided video in which the video to be distributed is divided into four. That is, for example, when the position of the terminal device 20 corresponds to the position of four units on the upper left of the 4 × 4 grid arrangement, the terminal device 20 is divided into four parts of the image to be distributed. , Receives the split video 2 on the upper left. Then, for example, when the position of the own device corresponds to the position of the upper left end in the grid pattern arrangement of 4 × 4, the terminal device 20 is a part of the received divided video (as in FIG. 7B). The image of the upper left quarter) is displayed on the display.

As described with reference to FIG. 7A, in the reconstruction pattern A2, when the number of terminal devices 20 displaying the video to be distributed is 5-16, the video to be distributed is divided into four. Video is used. Further, as described with reference to FIG. 8, in the reconstruction pattern B2, when the number of the terminal devices 20 displaying the images to be distributed is 10 to 16, the images to be distributed are divided into four. The divided video is used. Further, in the reconstruction pattern C2, when the number of terminal devices 20 for displaying images is 2-16, a divided image in which the image to be distributed is divided into four is used. That is, in these reconstruction patterns A2, B2, and C2, it is not necessary to prepare a divided video obtained by dividing the video to be distributed into 16 parts. Therefore, it is possible to reduce the number of division groups generated by the division unit 11 and reduce the processing load, the storage capacity for storing the divided video, and the like.

In this way, the division unit 11 may divide the video to be distributed by the number of divisions smaller than the number of terminal devices 20 that display the video to be distributed. That is, the division unit 11 may divide the video to be distributed in a division pattern such that the divided video is larger than the video displayed by one terminal device 20. In this case, the reconstruction unit 23 displays a part of the divided video received by the reception unit 21 on the display unit according to the position of the own device detected by the synchronization unit 22. That is, the reconstruction unit 23 trims a part of the divided video received by the reception unit 21 and displays it on the display unit. By doing so, the number of division groups generated by the division unit 11 can be reduced.

For example, in the case of the reconstruction pattern C2 shown in FIG. 9, the terminal device 20 receives a divided image having a size four times the size displayed by the own device. The terminal device 20 trims the divided video having a size four times as large as that. In this case, the terminal device 20 can be arranged not only horizontally for landscape display (landscape display) but also vertically for portrait display (portrait display). Therefore, as shown in FIGS. 10A and 10B, it is also possible to arrange the vertically oriented terminal device 20 and the horizontally oriented terminal device 20 in combination to display the image to be distributed. Note that FIG. 10A shows an example in which the number of terminal devices 20 for displaying the video to be distributed is four. Further, FIG. 10B shows an example in which the number of terminal devices 20 for displaying the video to be distributed is 10.

Further, when the video to be distributed is divided by a division pattern such that the divided video is larger than the video displayed by one terminal device 20, the reconstructing unit 23 is the own device detected by the synchronization unit 22. Depending on the orientation of the above, a part of the divided video received by the receiving unit 21 may be displayed on the display unit. That is, as shown in FIG. 11, when the terminal device 20 is landscape-oriented (when landscape display is performed), the reconstruction unit 23 is a part of the landscape-oriented (horizontally long) video (diagonal line) of the divided video. (Parts marked with) are displayed on the display unit, and when the terminal device 20 is in portrait orientation (when displaying Portrait), a part of the vertically oriented (portrait) video (parts with diagonal lines) is displayed. It may be displayed on the display unit.

Further, as shown in FIG. 12, in the manifest file generated by the division unit 11, among the plurality of terminal devices 20 that display the distributed contents, the terminal at a specific position in the display mode by the plurality of terminal devices 20 Instructions may be included to cause the device 20 to output audio. In the example of FIG. 12, among the terminal devices 20 arranged in a 4 × 4 grid pattern, the terminal device 20 at the upper left end and the terminal device 20 third from the top to the third from the left output audio. An example is shown.

Next, a method of determining the relative positional relationship between the own device and another terminal device 20 by the terminal device 20 will be described.

FIG. 13 is a diagram showing a configuration example relating to the determination of the relative positional relationship between the terminal device 20 and the other terminal device 20.

The terminal device 20 shown in FIG. 13 includes a detection unit 24, a common unit 25, and a determination unit 26. The detection unit 24, the common unit 25, and the determination unit 26 constitute, for example, a synchronization unit 22.

The detection unit 24 uses the touch sensor 27 included in the terminal device 20, the sensor unit 28 composed of various sensors, the camera unit 29, and the like to determine the relative positional relationship between the own device and another terminal device 20. It collects various information (hereinafter referred to as "preparation information") such as information that can be used for the camera and information related to the display of the image to be distributed on the own device. Here, the detection unit 24 collects the preparation information within the range that can be collected by the own device without requiring access to the network 2.

The information collected by the detection unit 24 includes various information such as the local time of the own device, the screen size of the display unit included in the own device, and the orientation of the own device. The detection unit 24 outputs the collected preparation information to the sharing unit 25.

The common unit 25 performs short-range wireless communication such as Wifi (registered trademark) and Bluetooth (registered trademark) with another terminal device 20 to form a group. Here, the shared unit 25 constitutes a group with another terminal device 20 capable of communicating by short-range wireless communication without going through an external server or the like connected to the network 2. The sharing unit 25 transmits the preparation information output from the detection unit 24 to the other terminal devices 20 constituting the group, and receives the preparation information from the other terminal devices 20 constituting the group. That is, the sharing unit 25 shares the preparation information with other terminal devices 20 constituting the group. Hereinafter, a set of preparation information shared between the terminal devices 20 constituting the group may be referred to as mutual position information. The shared unit 25 outputs mutual position information to the determination unit 26. Further, when the detection unit 24 detects a change in the position of the own device, rotation of the own device, or the like (preparation information is updated), the sharing unit 25 shares the updated preparation information with the other terminal device 20. And update the mutual location information.

In addition, the sharing unit 25 may limit the sharing process of the preparation information based on a predetermined pre-rule. For example, the sharing unit 25 may impose restrictions such as not allowing sharing of preparation information among N or more units, and not allowing sharing with terminal devices 20 having different screen sizes, aspect ratios, and the like of the display unit. Further, the shared unit 25 may adjust the frequency of detecting whether or not the preparation information has been changed.

The determination unit 26 synchronizes with other terminal devices 20 constituting the group based on the mutual position information output from the shared unit 25. Further, the determination unit 26 has a relative positional relationship with the other terminal devices 20 forming a group together with the own device (position of the own device (lattice-like coordinates)) based on the mutual position information output from the shared unit 25. To determine.

The determination unit 26 determines the terminal device 20 as the reference for synchronization based on, for example, the order of addition to the group, the median local time of each terminal device 20, and the local time of the reference terminal device 20. Synchronize with other terminal devices 20 that make up the group, such as by taking the difference from the local time of the own device.

Next, a method of determining the relative positional relationship with the other terminal device 20 by the determination unit 26 will be described.

As one of the methods for determining the relative positional relationship with the other terminal device 20, there is a method (first method) of using a touch operation on the touch surface of the touch sensor 27 included in the terminal device 20. Further, as another determination method, there is a method (second method) in which the sensor unit 28 and the camera unit 29, which are composed of various sensors included in the terminal device 20, are used. In recent years, many terminal devices 20 such as smartphones and tablet terminals are equipped with a touch sensor 27 that detects a touch position by a touch operation on a touch surface with a finger, a stylus pen, or the like. The determination unit 26 can determine the position of the own device based on the touch operation on the touch surface. Further, in recent years, many terminal devices 20 such as smartphones and tablet terminals are equipped with a sensor unit 28 and a camera unit 29 made of various sensors used for detecting the posture of the terminal device 20. The determination unit 26 can determine the position of the own device based on the detection result of the sensor unit 28 and the captured image captured by the camera unit 29. Hereinafter, the first method will be described first.

In the first method, the detection unit 24 detects a touch by a touch operation on the touch surface of the touch sensor 27. Then, when at least one of the plurality of outer edge regions set along the outer edge of the touch surface is touched in the touch surface by the slide operation of sliding the touch position, the detection unit 24 touches the touched outer edge region and the touched outer edge region. Sensor information indicating the timing (time, etc.) of touching the outer edge region is generated and output to the shared unit 25.

FIG. 14 is a diagram showing an example of setting an outer edge region on the touch surface 27a included in the terminal device 20.

Usually, the touch surface 27a is provided so as to be superimposed on the display unit included in the terminal device 20, and the shape thereof is generally rectangular. A plurality of outer edge regions are set in the touch surface 27a along the outer edge of the touch surface 27a. In FIG. 14, the outer edge region 27T (Top) is set along the upper end of the touch surface 27a, the outer edge region 27R (Right) is set along the right end of the touch surface 27a, and the outer edge is set along the lower end of the touch surface 27a. An example is shown in which a region 27B (Bottom) is set and an outer edge region 27L (Left) is provided along the left end of the touch surface 27a.

FIG. 15 is a diagram showing a state in which a plurality of terminal devices 20 are arranged on a plane and a touch operation is performed so as to straddle the adjacent terminal devices 20. In FIG. 15, it is assumed that the terminal devices 20-1 to 20-4 are arranged sideways in a 2 × 2 grid pattern. Then, a touch operation (touch operation 1) straddling the terminal device 20-3 arranged in the lower left from the terminal device 20-1 arranged in the upper left, and a terminal arranged in the upper right from the terminal device 20-1 arranged in the upper left. A touch operation (touch operation 2) straddling the device 20-2 and a touch operation (touch operation 3) straddling the terminal device 20-4 arranged in the lower right from the terminal device 20-2 arranged in the upper right are performed. Suppose.

By the touch operation 1, the detection unit 24 of the terminal device 20-1 generates sensor information indicating that the outer edge region 27L has been touched and the timing at which the outer edge region 27L has been touched. Further, the detection unit 24 of the terminal device 20-3 generates sensor information indicating that the outer edge region 27R has been touched and the timing at which the outer edge region 27R has been touched. Here, the timing (timing when the outer edge region 27R is touched) shown in the sensor information generated by the detection unit 24 of the terminal device 20-3 is shown in the sensor information generated by the detection unit 24 of the terminal device 20-1. Immediately after the timing (the timing when the outer edge region 27L is touched). Therefore, from these sensor information, it can be seen that the terminal devices 20-1 and 20-3 are arranged so that the left end of the terminal device 20-1 and the right end of the terminal device 20-3 are in contact with each other.

By the touch operation 2, the detection unit 24 of the terminal device 20-1 generates sensor information indicating that the outer edge region 27B has been touched and the timing at which the outer edge region 27B has been touched. Further, the detection unit 24 of the terminal device 20-2 generates sensor information indicating that the outer edge region 27T has been touched and the timing at which the outer edge region 27T has been touched. Here, the timing (timing when the outer edge region 27T is touched) shown in the sensor information generated by the detection unit 24 of the terminal device 20-2 is shown in the sensor information generated by the detection unit 24 of the terminal device 20-1. Immediately after the timing (the timing when the outer edge region 27B is touched). Therefore, from these sensor information, it can be seen that the terminal devices 20-1 and 20-2 are arranged so that the lower end of the terminal device 20-1 and the upper end of the terminal device 20-2 are in contact with each other.

By the touch operation 3, the detection unit 24 of the terminal device 20-2 generates sensor information indicating that the outer edge region 27L has been touched and the timing at which the outer edge region 27L has been touched. Further, the detection unit 24 of the terminal device 20-4 generates sensor information indicating that the outer edge region 27R has been touched and the timing at which the outer edge region 27R has been touched. Here, the timing (timing when the outer edge region 27R is touched) shown in the sensor information generated by the detection unit 24 of the terminal device 20-4 is shown in the sensor information generated by the detection unit 24 of the terminal device 20-2. Immediately after the timing (the timing when the outer edge region 27L is touched). Therefore, from these sensor information, it can be seen that the terminal devices 20-2 and 20-4 are arranged so that the left end of the terminal device 20-2 and the right end of the terminal device 20-4 are in contact with each other.

As described above, when any one of the plurality of outer edge regions set along the outer edge of the touch surface 27a of each terminal device 20 is touched, the detection unit 24 touches the touched outer edge region and the outer edge region thereof. Generates sensor information indicating the timing. The sharing unit 25 transmits the sensor information generated by the detection unit 24 to the other terminal device 20, and also receives the sensor information from the other terminal device 20. Then, the determination unit 26 determines the relative positional relationship between the own device and the other terminal device 20 based on the sensor information transmitted and received by the shared unit 25 to and from the other terminal device 20.

In the first method, the positional relationship between the terminal devices 20 can be determined only by touching each terminal device 20 (sliding operation across the adjacent terminal devices 20). Therefore, the terminal device 20 can autonomously determine the relative positional relationship between the own device and another terminal device 20 without using an external server or the like connected to the network 2.

In FIG. 14, an example in which one outer edge region is provided on each of the four sides of the touch surface 27a has been described, but the present invention is not limited to this. A plurality of outer edge regions may be set along at least one of the four sides of the touch surface.

FIG. 16 is a diagram showing an example in which a plurality of outer edge regions are set on one side of the touch surface 27a. FIG. 16 shows an example in which two outer edge regions 27RT and 27RD are set along the right end of the touch surface 27a of the terminal device 20-5. The outer edge region 27RT extends in the touch surface 27a along the right end of the touch surface 27a from the upper end to the lower end of the touch surface 27a to a substantially half position. Further, the outer edge region 27RD extends from the lower end to the upper end of the touch surface 27a along the right end of the touch surface to a substantially half position on the touch surface 27a.

As shown in FIG. 16, the terminal device 20-5 is arranged vertically, the terminal device 20-6 is arranged horizontally, and the lower end of the terminal device 20-6 is arranged so as to be in contact with the lower right end of the terminal device 20-5. If this is the case, it is assumed that the slide operation is performed so as to straddle the terminal device 20-6 from the terminal device 20-5. In this case, the detection unit 24 of the terminal device 20-5 generates sensor information indicating that the outer edge region 27RD has been touched and the timing at which the outer edge region 27RD has been touched. Further, the detection unit 24 of the terminal device 20-6 generates sensor information indicating that the outer edge region 27T has been touched and the timing at which the outer edge region 27T has been touched. Here, the timing (timing when the outer edge region 27T is touched) shown in the sensor information generated by the detection unit 24 of the terminal device 20-6 is shown in the sensor information generated by the detection unit 24 of the terminal device 20-5. Immediately after the timing (the timing when the outer edge region 27RD is touched). Therefore, from these sensor information, it can be seen that the terminal devices 20-5 and 20-6 are arranged so that the lower right end of the terminal device 20-5 and the upper end of the terminal device 20-4 are in contact with each other.

In this way, by providing a plurality of outer edge regions along one side of the touch surface 27a, it is possible to more accurately detect the relative positional relationship with the other terminal device 20.

Next, the second method will be described.

As described above, many of the terminal devices 20 such as smartphones and tablet terminals are equipped with various sensors such as an acceleration sensor, a gyro sensor, and a geomagnetic sensor in order to detect the posture of the terminal device 20 and the like. Then, in recent years, in the terminal device 20, as shown in FIG. 17, a relative coordinate system in a three-dimensional space is virtually set by using these sensors, and the origin (reference) of the relative coordinate system is set. Some have a function of detecting the moving distance and the moving direction of the terminal device 20 from the position). The detection unit 24 detects the movement distance and the movement direction of the terminal device 20 in the relative coordinate system in the three-dimensional space as sensor information from the detection result of the sensor unit 28 included in the terminal device 20. In the second method, the terminal device 20 detects the relative positional relationship between the own device and the other terminal device 20 by exchanging this sensor information with the other terminal device 20. At this time, it is necessary to align the coordinate axes by using a geomagnetic sensor or the like so that the axes of the relative coordinate system do not shift in each terminal device 20.

Specifically, first, as shown in FIG. 18, the user superimposes the two terminal devices 20-7 and 20-8 so that the display unit faces upward. Many of the terminal devices 20 in recent years are equipped with a camera (front camera) arranged toward the user with the display unit facing the user. Therefore, the camera unit 29 of the lower terminal device 20-7 is covered by the upper terminal device 20-8. Therefore, the captured image captured by the camera unit 29 of the terminal device 20-7 becomes dark. The detection unit 24 of the terminal device 20-7 detects that another terminal device 20 is superimposed on the upper side of the own device from the captured image captured by the camera unit 29. That is, the detection unit 24 of the terminal device 20-7 is placed on one surface of the terminal device 20 (the surface on which the camera unit 29 is arranged) based on the captured image captured by the camera unit 29 arranged on one surface of the terminal device 20. It is detected that the other terminal devices 20 are overlapped with each other.

When the terminal device 20-7 detects that another terminal device 20 is superposed on the upper side of the own device, the terminal device 20-7 notifies the nearby terminal device 20 by short-range wireless communication, for example. When the detection unit 24 of the upper terminal device 20-8 receives a notification from the lower terminal device 20-7 that the other terminal device 20 is superposed on the upper side, the detection unit 24 of the sensor unit 28 before and after the notification. When it is determined from the detection result that the own device is moving, it is detected that the own device is superposed on the upper side of the terminal device 20-7. Further, the detection unit 24 of the terminal device 20-8 detects that the own device is superposed on the upper side of the terminal device 20-7 by inputting a predetermined operation (for example, a touch operation on the touch surface). May be good.

When the shared unit 25 detects that the own device and the other terminal device 20 are superposed (according to the superposition of the own device and the other terminal device 20), the shared unit 25 and the other terminal device 20 are short-range wireless. Communication is performed, information about the relative coordinate system in the three-dimensional space set by the detection unit 24 is transmitted and received, and the relative coordinate system in the three-dimensional space is matched (the origin is matched). For example, the shared portion 25 of the upper terminal device 20 changes the relative coordinate system in the three-dimensional space set in the own device to the relative coordinate system in the three-dimensional space set in the lower terminal device 20. Match.

As shown in FIG. 18, the determination unit 26 of the terminal device 20-8 is a detection unit when the terminal device 20-8 moves after matching the relative coordinates in the three-dimensional space with the lower terminal device 20-7. Based on the movement distance and the movement direction of the own device detected by 24, the relative positional relationship with the other terminal devices 20-7 arranged on the lower side is determined.

That is, in the second method, each terminal device 20 calculates (sets) the relative coordinate system by various sensors included in the own device. Next, each terminal device 20 aligns the axes of the set relative coordinate system by using a geomagnetic sensor or the like. Next, by superimposing the terminal devices 20 on each other, the origins of the set coordinate systems are matched between the superposed terminal devices 20. Next, when the own device moves, the terminal device 20 detects a position (moving direction and moving distance) in the set relative coordinate system.

The determination unit 26 determines the position (coordinates) of its own device in the grid arrangement according to the number of coordinates corresponding to the number of terminal devices 20 that display the video to be distributed, based on a predetermined rule. As a pre-rule, for example, as shown in FIG. 19, when the video to be distributed is displayed on a maximum of 16 terminal devices 20, the number of terminal devices 20 constituting the group must be less than 16. , A rule is conceivable to determine the position of the own device so that the divided video of the central part of the video to be distributed is displayed as much as possible. The determination unit 26 determines the position of its own device, for example, by setting the number of terminal devices 20 constituting the group as the terminal device 20 for displaying the image to be distributed. Further, the number of terminal devices 20 constituting the group may be input to the terminal device 20 by the user.

Further, the determination unit 26 may determine that the own device is excluded from the group formed together with the other terminal device 20 by a predetermined operation input, for example, a touch operation on the touch surface 27a. Further, when the determination unit 26 detects from the detection result of the detection unit 24 that the own device is separated from the plane arranged together with the other terminal device 20 by a predetermined distance or more, the own device forms together with the other terminal device 20. It may be determined that the person has been excluded from the group. In the first method as well, the determination unit 26 similarly performs a predetermined operation input, that the own device is separated from the plane or the three-dimensional surface arranged together with the other terminal device 20 by a predetermined distance or more. Based on this, it may be determined that the group has been excluded.

Further, as a method of arranging the terminal device 20, it may be fixed to either a horizontal arrangement for displaying Landscape or a vertical arrangement for displaying Portratt. Further, the number of the terminal devices 20 for landscape display and the number of terminal devices 20 for portratit display may be varied according to the number of terminal devices 20 for displaying the video to be distributed.

Further, it may be determined in advance as a pre-rule whether to display either the Landscape display or the Portrait display or both the Landscape display and the Portrait display for each terminal device 20. When both Landscape display and Portrait display are performed, for example, as shown in FIG. 20, the terminal device 20 displays different parts of the divided video depending on whether the Landscape display or the Portrait display is performed. It may be displayed in.

As described above, according to the present embodiment, the terminal device 20 detects the touch position by the touch operation with respect to the touch surface 27a, and slides the touch position to slide the touch position in the touch surface 27a along the outer edge of the touch surface 27a. When at least one of the plurality of outer edge regions set in the above is touched, the detection unit 24 that generates sensor information indicating the touched outer edge region and the timing at which the outer edge region is touched, and the other terminal device 20 By direct communication, the sensor information generated by the detection unit 24 is transmitted to the other terminal device 20, and the shared unit 25 receives the sensor information from the other terminal device 20, and the shared unit 25 communicates with the other terminal device 20. It includes a determination unit 26 that determines a relative positional relationship between the own device and another terminal device 20 based on sensor information transmitted and received between the terminals.

By sending and receiving sensor information to and from another terminal device 20 by direct communication, and determining the relative positional relationship between the own device and the other terminal device 20 based on the sensor information, an external server or the like can be used. It is possible to autonomously determine the relative positional relationship between the own device and another terminal device without intervention.

Further, according to the present embodiment, the terminal device 20 includes a detection unit 24 that detects the movement distance and the movement direction of the own device in the relative coordinate system in the three-dimensional space from the reference position, and the own device and other terminal devices. According to the superposition with 20, information about the relative coordinate system in the three-dimensional space is transmitted and received by direct communication with the other terminal device 20, and the relative coordinate system is matched with the other terminal device 20. A determination unit that determines the relative positional relationship between the shared unit 25 to be used and the other terminal device 20 based on the moving distance and moving direction of the own device detected by the detecting unit 24 after the shared coordinate system is matched by the shared unit 25. 26 and.

Information about the relative coordinate system in the three-dimensional space is transmitted and received by direct communication with the other terminal device 20 according to the superposition with the other terminal device 20, and the relative coordinate system with the other terminal device 20. By matching and determining the relative positional relationship between the own device and the other terminal device 20 based on the movement distance and movement direction of the own device after the matching of the relative coordinate system, without going through an external server or the like. , It is possible to autonomously determine the relative positional relationship between the own device and another terminal device.

Although the above embodiments have been described as representative examples, it will be apparent to those skilled in the art that many modifications and substitutions are possible within the spirit and scope of the invention. Therefore, the present invention should not be construed as being limited by the above-described embodiments, and various modifications and modifications can be made without departing from the scope of claims. For example, it is possible to combine a plurality of the constituent blocks described in the configuration diagram of the embodiment into one, or to divide one constituent block into one.

1 Video display system 2 Network 10 Distribution device 11 Division 12 Distribution unit 20, 20-1 to 20-8 Terminal device 21 Reception unit 22 Synchronization unit 23 Reconstruction unit 24 Detection unit 25 Sharing unit 26 Determination unit 27 Touch sensor 27a Touch Surface 27T, 27R, 27B, 27L, 27RT, 27RD Outer edge area 28 Sensor part 29 Camera part

Claims (3)

It is a terminal device that determines the relative positional relationship with other terminal devices arranged on a plane or a three-dimensional surface together with the own device.
By the slide operation of detecting the touch position by the touch operation with respect to the touch surface and sliding the touch position, at least one of a plurality of outer edge regions set along the outer edge of the touch surface is touched in the touch surface. In the case, a detection unit that generates sensor information indicating the touched outer edge region and the timing at which the outer edge region is touched, and
By direct communication with the other terminal device, the sensor information generated by the detection unit is transmitted to the other terminal device, and the shared unit receives the sensor information from the other terminal device.
The relative positional relationship between the own device and the other terminal device based on the sensor information transmitted and received by the shared unit between the own device and the other terminal device while synchronizing the own device with the other terminal device. With a decision-making part to decide,
The detection unit further detects the difference in local time between the own device and the other terminal device, and further detects the difference.
The determination unit synchronizes the own device with the other terminal device based on the difference in the local time between the own device and the own device as a reference among the own device and the other terminal device .
The determination unit acquires the manifest file from a distribution device that generates a plurality of divided videos obtained by dividing the video to be distributed and generates a manifest file including information indicating the storage location of each of the plurality of divided videos. Based on the manifest file, the divided video corresponding to the position of the own device based on the relative positional relationship between the own device and the other terminal device determined is acquired.
A terminal device further comprising a reconstructing unit that displays a divided image acquired by the determination unit on a display unit included in the own device. In the terminal device according to claim 1,
The touch surface is rectangular and has a rectangular shape.
The terminal device is characterized in that the outer edge region is provided corresponding to each of the four sides of the rectangular touch surface. In the terminal device according to claim 2,
A terminal device characterized in that a plurality of outer edge regions are provided along at least one of the four sides of the touch surface.

Images