JP2011217036A - Index content generation device, and video retrieval system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To form an efficient screen configuration in terms of video retrieval when reproducing a plurality of short videos on the same screen at the same time.SOLUTION: A server device 10 includes an index content generation part 16 for generating an index content used for reproducing a plurality of short videos each showing the outline of a main video on the same screen. The index content generation part 16 calculates an expectation value of ease of finding for each short video for each divided region with respect to a plurality of divided regions arranged in a video display region in the screen, and determines the short video to be reproduced in each divided region, based on the expectation value.

Description

  The present invention relates to an index content generation device and a video search system.

  2. Description of the Related Art Conventionally, there has been known a video search system for reproducing a short video showing an outline of a main video on a screen so that a viewer can search and view a desired video from a plurality of videos. For example, in Non-Patent Document 1, when a plurality of short videos are presented to a viewer in order by reproducing video data obtained by connecting a plurality of short videos on the screen, and the viewer selects the short video being played, The main video corresponding to the short video is played on the screen.

Shungo Kamikata, Keiichiro Hoashi, Kazunori Matsumoto, Yasuhiro Takishima, “Study on Index Video Generation Method for CGM Video Search”, IPSJ Winter Conference, pp.8-7, December 2008

  However, in Non-Patent Document 1 described above, since the short videos are reproduced one by one in order, the viewer must wait while watching the short videos one by one until a desired video is found. One solution to this problem is to reduce the search time by simultaneously playing multiple short videos on the same screen. However, because of screen size limitations, short videos that can be played back on the same screen. The number is limited. For this reason, when a plurality of short videos are simultaneously reproduced on the same screen, it is important which short video is reproduced at which position in the screen.

  The present invention has been made in consideration of such circumstances, and when a plurality of short videos are reproduced on the same screen at the same time, an index content can be generated which can be an efficient screen structure for video search. It is an object to provide an apparatus and a video search system.

  In order to solve the above problems, an index content generation device according to the present invention is an index content generation device that generates index content for reproducing a plurality of short videos showing an outline of a main video on the same screen. For each of the plurality of divided areas provided in the video display area, an expected value calculation unit that calculates an expected value of ease of finding for each short video for each divided area is provided, and each divided area is based on the expected value. The short video to be reproduced is determined.

  In the index content generation device according to the present invention, the expected value calculation unit calculates the expected value based on a ratio of the area of the divided area that is an expected value calculation target to the total area of the divided areas in the video display area. It is characterized by.

  In the index content generation device according to the present invention, the expected value calculation unit calculates the expected value based on the priority of each short video.

  The index content generation device according to the present invention includes a short video priority determination unit that increases the priority of a short video as the ratio of the short video playback time to the main video playback time is small. Features.

  The index content generation apparatus according to the present invention includes a short video priority determining unit that increases the priority of a short video as the ratio of the resolution of the short video to the resolution of the main video is large.

  In the index content generation device according to the present invention, the short video priority determination unit uses a coefficient set for each type of the main video supply source when calculating the priority of the short video. Priority is calculated.

  In the index content generation device according to the present invention, a plurality of clusters for classifying short videos are provided, and the expected value calculation unit is configured to calculate the expected value for each cluster based on the ease of finding a short video according to the playback order of the clusters. Is calculated.

  The index content generation apparatus according to the present invention includes an index content reproduction configuration determination unit that determines a schedule for reproducing a plurality of short videos classified into one cluster based on a reproduction time of each short video, and The content playback configuration determining unit is characterized in that the total playback time of the cluster is set to the longest playback time among the playback times of each short video belonging to the cluster.

  The index content generation apparatus according to the present invention includes an index content reproduction configuration determination unit that determines a schedule for reproducing a plurality of short videos classified into one cluster based on a reproduction time of each short video, and The content playback configuration determination unit is characterized in that the total playback time of the cluster is set to an integral multiple of the playback time of the short video having the highest priority among the short videos belonging to the cluster.

  The index content generation apparatus according to the present invention includes an index content reproduction configuration determination unit that determines a schedule for reproducing a plurality of short videos classified into one cluster based on a reproduction time of each short video, and The content playback configuration determination unit is characterized in that the total playback time of the cluster is set to the least common multiple of the playback time of each short video belonging to the cluster.

  A video search system according to the present invention corresponds to any one of the index content generation devices described above, a playback device that plays back the index content generated by the index content generation device on a screen, and a short video included in the index content. A link operation information generation unit that generates link operation information for acquiring a main video, and a link operation cooperation unit that performs an operation of acquiring a main video corresponding to a short video using the link operation information. It is characterized by.

  According to the present invention, when a plurality of short videos are reproduced on the same screen at the same time, it is possible to obtain an effect that an efficient screen configuration can be obtained for video search.

It is a block diagram which shows the structure of the video search system which concerns on one Embodiment of this invention. It is a structural example of the metadata stored in the data storage 11, 12, 13, 14 shown in FIG. It is a structural example of the metadata stored in the short video data storage 22 shown in FIG. It is a flowchart which shows the whole flow of the index content production | generation process which concerns on one Embodiment of this invention. 2 is a configuration example of a screen display area 100 and a video display area 200. It is an example of a screen structure of the image | video display area 200 which concerns on one Embodiment of this invention. It is an example of a screen structure of the image | video display area 200 which concerns on one Embodiment of this invention. It is an example of a screen structure of the image | video display area 200 which concerns on one Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a video search system according to an embodiment of the present invention. In FIG. 1, the video search system includes a server device 10 and a client device 30. Server device 10 and client device 30 are connected by a communication line. This communication line may be a wireless line or a wired line. As the wireless line, a wireless line of a wide area wireless network such as a mobile phone network may be used, or a wireless line using a short-range wireless communication device may be used. The client device 30 may be a stationary device or a portable device. The client device 30 is a mobile phone, for example, and may be connected to the server device 10 using a mobile phone line.

  The server device 10 includes data storages 11, 12, 13, and 14 for storing the main video data and metadata, a storage cooperation unit 15, an index content generation unit 16, an index content transmission unit 17, and a short video priority determination. Unit 18, index content screen configuration determination unit 19, index content playback configuration determination unit 20, link operation information generation unit 21, and short video data storage 22.

  The Internet video data storage 11 stores the main video data released on the Internet. The Internet video data storage 11 may be, for example, a data storage managed by a video sharing service developed on the Internet, or a video search system user (hereinafter simply referred to as a user) It may be a data storage that stores video data downloaded from above to a user-owned personal computer.

  The mobile phone video data storage 12 stores the main video data stored in the data storage in the user's mobile phone. The mobile phone video data storage 12 may be, for example, a data storage that stores video data taken by a user with a camera mounted on a mobile phone, or acquired from an e-mail or a mobile phone internet site. It may be a data storage that stores video data. The mobile phone video data storage 12 stores, for example, data transferred to the server device 10 for backing up the main video data stored in the data storage in the mobile phone.

The TV video data storage 13 stores the main video data broadcast on the television. The TV video data storage 13 is, for example, a data storage that stores video data of TV broadcasts recorded by a user using a recording device.
The camera video data storage 14 stores main video data shot by a user using a camera.

  FIG. 2 is a configuration example of metadata stored in each data storage 11, 12, 13, 14. The data storages 11, 12, 13, and 14 store the main video data and metadata accompanying the main video data. This metadata is information related to the main video, and includes a video identifier (video ID), a title, a playback time, a resolution (vertical and horizontal), an acquisition date and time, a shooting date and time or a recording date and time, and a priority. Further, the metadata related to the Internet video has a URL (Uniform Resource Locator) where the main video data is acquired, and the metadata related to the TV video has a URL (program information URL) from which program information related to the main video data can be acquired. . The priority is a priority in video search for the main video, which is given in advance for each main video.

  The data storage for storing the main video data and metadata is not limited to the four types shown in FIG. 1, and various types of data storage can be prepared.

  The short video data storage 22 stores short video data and metadata indicating an outline of the main video data stored in the data storage 11, 12, 13, 14. The short video data may be created using, for example, video data partially extracted from the main video data, or may be created in advance for a short video.

  FIG. 3 is a configuration example of metadata stored in the short video data storage 22. The short video data storage 22 stores short video data and metadata accompanying the short video data. This metadata is information on a short video, and includes a video identifier (video ID), an identifier of a data storage (main video storage image ID) storing main video data corresponding to the short video, playback time, resolution ( Vertical, horizontal) and priority. This priority is determined by the short video priority determination unit 18 for each short video.

  The storage cooperation unit 15 acquires the metadata of the main video from the data storages 11, 12, 13, and 14 and supplies it to the index content generation unit 16. The index content generation unit 16 generates index content using the main video metadata supplied from the storage cooperation unit 15 and the short video data and metadata stored in the short video data storage 22. The index content is configured to simultaneously reproduce a plurality of short videos on the same screen. In the index content generation process, the index content generation unit 16 cooperates with the short video priority determination unit 18, the index content screen configuration determination unit 19, the index content reproduction configuration determination unit 20, and the link operation information generation unit 21. The index content transmission unit 17 transmits the index content to the client device 30.

  The short video priority determination unit 18 determines the priority of the short video using the metadata of the main video and the metadata of the short video. The index content screen configuration determination unit 19 determines an arrangement in a screen when a plurality of short videos are simultaneously reproduced on the same screen. The index content reproduction configuration determination unit 20 determines a reproduction schedule for reproducing a plurality of short videos. The link operation information generation unit 21 generates information (link operation information) for acquiring the main video data corresponding to the short video.

  The client device 30 includes an index content receiving unit 31, an index content reproduction unit 32, and a link operation cooperation unit 33. The index content receiving unit 31 receives index content from the server device 10. The index content playback unit 32 plays back the index content on the screen. The link operation cooperation unit 33 uses the link operation information to perform an operation of acquiring main video data corresponding to the short video.

  Next, an overall flow of operations when the video search system shown in FIG. 1 generates index contents will be described with reference to FIG. FIG. 4 is a flowchart showing an overall flow of index content generation processing according to the present embodiment. In step S <b> 1, the storage cooperation unit 15 acquires the main video metadata corresponding to the short video data in the short video data storage 22 from the data storages 11, 12, 13, and 14 and supplies the metadata to the index content generation unit 16. To do. In step S2, it is determined whether or not the acquisition of metadata has been completed.

  In step S3, the index content generation unit 16 supplies the metadata of the main video and the metadata of the short video to the short video priority determination unit 18, and the short video priority determination unit 18 stores the metadata of the main video and the short video. The priority of the short video is determined using the metadata.

  In step S4, the index content screen configuration determination unit 19 determines the arrangement in the screen when the index content is reproduced. In step S 5, the index content generation unit 16 clusters the short video data in the short video data storage 22.

  In steps S6 and S7, for each cluster, the index content playback configuration determination unit 20 determines the playback schedule of the short video, and the link operation information generation unit 21 generates link operation information. In step S8, it is determined whether the processing for each cluster has been completed, and if completed, the process proceeds to step S9. In step S9, the index content generation unit 16 generates index content.

  Next, processing related to index content generation according to the present embodiment will be sequentially described in detail.

[Process to determine priority of short video]
The short video priority determination unit 18 determines the priority of the short video (short video priority) using the metadata of the main video and the metadata of the short video. In this short video priority determination process, each short video priority is determined for all the short video data in the short video data storage 22.

  First, the policy for determining the short video priority according to the present embodiment will be described. The smaller the ratio of the playback time length of the short video to the playback time length of the main video, the more the content of the main video can be expressed by the short video in a short time. It can be said that it is a video. In addition, as the ratio of the resolution of the short video to the resolution of the main video increases, it is thought that it is more important to show the short video with the resolution of the main video. It can be said that there is. However, it is assumed that the resolution of the short video is not larger than the resolution of the main video.

Under such a policy, the short video priority (Vs) is calculated by the following equation (1).
Vs = d × Vo × (1 ÷ Ptso) × Prso (1)
However, Vo is the priority of the main video. Ptso is the ratio (Ts ÷ To) of the playback time (Ts) of the short video to the playback time (To) of the main video. Prso is the ratio of the resolution of the short video (vertical: Rsr, horizontal: Rsc) to the resolution of the main video (vertical: Ror, horizontal: Roc) (the larger of (Rsr ÷ Ror) or (Rsc ÷ Roc)) It is. d is a coefficient set for each data storage in which the main video data is stored. In the present embodiment, the data storage for storing the main video data differs depending on where the main video data is supplied. Accordingly, d is set for each type of main video data supply source.

  According to the above equation (1), the higher the priority of the main video, the shorter the playback time of the short video relative to the playback time of the main video, the shorter the resolution of the short video with respect to the resolution of the main video. The shorter the priority, the higher the short video priority.

  In this embodiment, the short video priority is calculated by the equation (1), but the short video priority calculation formula may be changed as appropriate based on the above-described policy.

  In this embodiment, the short video priority is calculated based on the above policy, but the policy for determining the short video priority is not limited to the above policy and may be changed as appropriate. For example, the priority of the main video may be set to the short video priority as it is. Also, the short video priority may be determined when the short video is created.

[Process to determine screen configuration]
The index content screen configuration determination unit 19 determines an arrangement in the screen when reproducing the index content. The index content is configured to simultaneously reproduce a plurality of short videos on the same screen. Therefore, the index content screen configuration determination unit 19 determines the arrangement in the screen when a plurality of short videos are simultaneously reproduced on the same screen.

  FIG. 5 shows a display area (screen display area) 100 for displaying the playback video when the client device 30 plays back the index content on the screen, and the video can be displayed in the screen display area 100. An area (video display area) 200 is shown. In FIG. 5, the video display area 200 is a rectangular area surrounded by four coordinates (Xas, Yas), (Xas, Yae), (Xae, Yas), (Xae, Yae). Each coordinate value is expressed as a relative coordinate when a point on the screen display area 100 (indicated by a point in FIG. 5) is used as a reference.

  6, 7, and 8 are screen configuration examples of the video display area 200 according to the present embodiment. In FIG. 6, the video display area 200 is provided with four divided areas 201, 202, 203, and 204. In each divided area 201, 202, 203, 204, a short video is reproduced one by one. Of the divided areas 201, 202, 203, and 204, the divided area 201 has the largest area, and the other divided areas 202, 203, and 204 have the same area. The divided areas 202, 203, and 204 are arranged side by side below the divided area 201.

  In FIG. 7, the image display area 200 is provided with eleven divided areas 201 to 211. In each of the divided areas 201 to 211, a short video is reproduced one by one. Of the divided regions 201 to 211, the divided region 201 has the largest area, and the other divided regions 202 to 211 have the same area. The divided areas 202 to 211 are arranged vertically by five on both sides of the divided area 201.

  In FIG. 8, the video display area 200 is provided with five divided areas 201 to 205. In each of the divided areas 201 to 205, a short video is reproduced one by one. Of the divided areas 201 to 205, the divided area 201 has the largest area, and the other divided areas 202 to 205 have smaller areas in order. The divided areas 202 to 205 are arranged side by side below the divided area 201.

  The index content screen configuration determination unit 19 receives input information for specifying the screen configuration, and selects a screen configuration for reproducing the index content from a plurality of screen configurations according to the input information. For example, the screen configurations shown in FIGS. 6, 7, and 8 are presented as selection candidates to the user by the client device 30, and information indicating the screen configuration selected by the user is transmitted from the client device 30 to the server device 10 as input information. Then, the index content screen configuration determination unit 19 selects the screen configuration indicated by the input information from the screen configurations of FIGS. 6, 7, and 8.

  Note that the screen configuration example of the video display area 200 is not limited to the above-described FIGS. 6, 7, and 8, and may be changed as appropriate.

[Processing for clustering short videos]
The index content generation unit 16 clusters the short video data in the short video data storage 22. In this clustering process, clustering is performed for all the short video data in the short video data storage 22. In this embodiment, an expected value of ease of finding for each short video is provided, and a cluster to which each short video belongs is determined by obtaining a cluster that maximizes the expected value. This will be specifically described below.

  Let M be the total number of short video data. The total number of clusters (C: natural number) is set in advance. A cluster number (n: a natural number from 1 to C) is assigned to each cluster. The cluster number indicates the reproduction order when the index content is reproduced. Therefore, data is reproduced in order from the cluster with the smallest cluster number. The number of short videos belonging to one cluster is the number of divided areas in the video display area 200 determined by the index content screen configuration determination unit 19. Accordingly, all the short videos belonging to one cluster are simultaneously reproduced on the video display area 200. In addition, a divided area number (q: a natural number from 1 to Q, Q is the total number of divided areas in the video display area 200) is assigned to each divided area in the video display area 200. Note that the video display area 200 having a different divided area configuration may be used for each cluster.

The expected value (E (n, q, i)) of a short video (video ID = i) is defined by the following equation (2) in the qth divided region of the nth cluster.
E (n, q, i) = E1 × E2 × E3 (2)
Here, E1 is the short video priority of the short video (video ID = i). E1 represents the ease of finding a short video (video ID = i) based on the short video priority. E2 is represented by the following formula (3). E2 represents the ease of finding a short video (video ID = i) according to the playback order of the nth cluster.
E2 = 1 − ((cluster number−1) ÷ C) ² (3)
E3 is represented by the following equation (4). E3 represents the ease of finding a short video (video ID = i) by the q-th divided area in the video display area 200.
E3 = (area of the qth divided area) / (total area of the divided areas in the video display area 200) (4)

  First, in the first cluster, the index content generation unit 16 sets the number of expected values (E (1) for all short videos (total number is M) for each divided region (divided region number (q) is 1 to Q). , Q, i)). As a result, in the first cluster, M expected values (E (1, q, i)) are calculated for each divided region (divided region number (q) is 1 to Q). Next, the index content generation unit 16 performs the maximum expectation among the M expected values (E (1, q, i)) calculated for each divided region (divided region number (q) is 1 to Q). A short video corresponding to the value (E (1, q, i)) is assigned to the divided area of the first cluster. At this time, when there are a plurality of maximum expected values (E (1, q, i)) for the q-th divided region, the short video with the higher short video priority is selected. Then, the short video with the higher priority of the main video is selected. As a result, in the first cluster, short videos are assigned one by one to Q divided areas (with divided area numbers (q) ranging from 1 to Q). The short video assigned to the q-th divided area of the first cluster is reproduced in the q-th divided area in the video display area 200 related to the first cluster. Next, the index content generation unit 16 excludes Q short videos classified into the first cluster from the clustering targets.

  Next, the index content generation unit 16 targets the remaining (M−Q) short videos as expected for the second cluster (E (2, q, i) as in the case of the first cluster. )) And the allocation of the short video to each divided area in the second cluster, and the Q short videos classified into the second cluster are excluded from the clustering targets. Thereafter, similarly, clustering is performed up to the C-th cluster in ascending order of cluster numbers.

[Process to determine playback configuration]
The index content playback configuration determination unit 20 determines a playback schedule of a short video for each cluster. This reproduction schedule determination process will be described for one cluster. First, the total reproduction time (Tc) of the cluster is determined. The total playback time (Tc) of a cluster is the longest playback time among the playback times of each short video belonging to the cluster.

  Next, a short video playback schedule for the cluster is created. In this playback schedule, for a short video whose playback time is equal to the total playback time (Tc) of the cluster, playback of the short video is started simultaneously with the start of playback of the cluster, and playback of the short video is ended simultaneously with the end of playback of the cluster. To schedule. On the other hand, for a short video whose playback time is shorter than the total playback time (Tc) of the cluster, the short video starts to be played at the same time as the cluster playback starts. Then, scheduling is performed so that the reproduction of the short video is completed simultaneously with the reproduction of the cluster.

  Note that the playback schedule determination method is not limited to the above method, and may be changed as appropriate. For example, the total playback time (Tc) of a cluster may be an integer multiple of the playback time of a short video having the maximum short video priority among the short videos belonging to the cluster. In this case, the short video having the highest short video priority will not be interrupted during playback. Alternatively, the total playback time (Tc) of the cluster may be the least common multiple of the playback time of each short video belonging to the cluster. In this case, the entire short video is not interrupted during playback.

[Process to generate link operation information]
The link operation information generation unit 21 generates link operation information for acquiring main video data corresponding to a short video. Two examples of the link operation information generation processing will be described below.

(Example 1 of link operation information generation processing)
In this example 1, while the user plays back the index content by the client device 30 and simultaneously views a plurality of short videos on the same screen, the main video corresponding to the short video being played is played back. Link operation information for interrupting and viewing is generated.

  The link operation information includes a function for providing a short video selection unit in the video display area 200 for selecting a specific short video being reproduced, and a function for acquiring main video data corresponding to each short video selection unit. Is included in the client device 30. As the short video selection unit, for example, a selection area is provided in each divided area in the video display area 200 so that the user can specify an arbitrary selection area by operating a pointing device such as a mouse or a cursor. Alternatively, as a short video selection unit, a division region number is displayed in each division region in the video display region 200, and the user can designate an arbitrary short video selection unit by inputting the division region number with a numeric key or the like. Like that.

  The link operation cooperation unit 33 of the client device 30 performs an operation of acquiring the main video data corresponding to the short video using the link operation information. Specifically, a short video selection unit is provided in the video display area 200, and main video data corresponding to the short video selection unit designated by the user is acquired. Thus, the main video data corresponding to the short video selection unit designated by the user is reproduced on the video display area 200 while the reproduction of the short video is interrupted.

(Example 2 of link operation information generation processing)
In this example 2, after the user finishes reproducing all the index contents being reproduced by the client device 30, the link operation information for viewing the main video is generated.

  The link operation information includes a function for providing a cluster selection unit in the video display area 200 for selecting a specific cluster being played back, and information for specifying a short video belonging to the cluster corresponding to each cluster selection unit (for example, , A list of video IDs or a screen capture of the video display area 200) and a short video selection unit for selecting the specific short video for the recording in the video display area 200 according to a user request. Information for providing the client device 30 with a function to display and a function to acquire main video data corresponding to each short video selection unit is included. The short video selection unit is the same as in Example 1 above.

  The link operation cooperation unit 33 of the client device 30 performs an operation of acquiring the main video data corresponding to the short video using the link operation information. Specifically, a cluster selection unit is provided in the video display area 200, and a list of video IDs corresponding to the cluster selection unit designated by the user or a screen capture of the video display area 200 is recorded. The recorded video ID list or screen capture is displayed on the video display area 200 in response to a user request together with a short video selection unit for selecting a specific short video, and corresponds to the short video selection unit designated by the user. The main video data to be acquired is acquired. As a result, the main video data corresponding to the short video selection unit designated by the user is reproduced on the video display area 200 in response to the user's request.

  The main video data may be played back by a playback device different from the client device 30.

[Process to generate index contents]
The index content generation unit 16 generates index content. The index content includes the video ID of the short video data classified for each cluster, the screen configuration information for specifying the screen configuration of the video display area 200 used for each cluster, the playback schedule used for each cluster, and the link operation Include information.

  The index content reproduction unit 32 of the client device 30 acquires the short video data of the video ID included in the index content received from the server device 10 from the server device 10. Then, the index content reproduction unit 32 reproduces the short video data on the video display area 200 based on the screen configuration information and the reproduction schedule for each cluster in ascending order of the cluster numbers. As a result, for each cluster in ascending order of the cluster number, a plurality of short videos are simultaneously reproduced on each divided area of the same video display area 200 according to the reproduction schedule.

  According to the above-described embodiment, when a plurality of short videos are simultaneously played back on the same screen, which short video is played back at which position in the screen is determined based on the expected value of the ease of finding each short video. Can be determined. As a result, when a plurality of short videos are simultaneously played on the same screen, each short video is played in a state that is easy for the user to find, so that an efficient screen configuration can be achieved for video search. Become.

  In addition, when a short video is reproduced on the same screen, the user may miss another short video while viewing one short video. However, according to the present embodiment, since a plurality of short videos are classified and reproduced for each cluster, the user can easily find a short video that has been missed by playing or skipping in units of clusters. Can do.

  In addition, since the user can view a plurality of short videos simultaneously on the same screen, it is possible to contribute to shortening the search time. In addition, since the screen configuration and playback configuration of the index content can be changed, it can be expected that the user searches while enjoying the index content.

As mentioned above, although embodiment of this invention was explained in full detail with reference to drawings, the specific structure is not restricted to this embodiment, The design change etc. of the range which does not deviate from the summary of this invention are included.
For example, the video search system according to the above-described embodiment may be realized by dedicated hardware, or is configured by a computer system such as a personal computer, and functions of each unit of the apparatus shown in FIG. You may implement | achieve the function by running the program for implement | achieving.

In addition, each device is connected to an input device, an output device, and the like (none of which are shown) as peripheral devices. Here, the input device refers to an input device such as a keyboard and a mouse, a reading device that reads data from a recording medium, and the like. Examples of the output device include a display device such as a CRT (Cathode Ray Tube) and a liquid crystal display device, a recording device for a recording medium, and a printing device.
The peripheral device may be connected directly to each device or may be connected via a communication line.

  Note that the video search system according to the above-described embodiment can be used for various purposes. For example, in recent years, mobile phones have been able to handle video data such as downloading and viewing video data from the Internet and viewing television broadcasts. As a result, a video search system for mobile phones is desired, but it is complicated to search while watching a short video on a mobile phone, so it is desirable to reduce the burden on the user as much as possible. If the video search system according to the present embodiment is applied as such a video search system for mobile phones, it can be expected that the user can quickly find a desired short video or reduce the frequency of looking back on the short video. It is possible to reduce the burden on the user, shorten the search time, reduce the communication cost, and the like.

  Also, even if the video search system according to the present embodiment is applied to a video search system for a large amount of video data stored in various video data storages, an efficient screen configuration is provided for video search. Therefore, the effect of shortening the search time can be expected.

DESCRIPTION OF SYMBOLS 10 ... Server apparatus 11, 12, 13, 14 ... Video data storage, 15 ... Storage cooperation part, 16 ... Index content production | generation part, 17 ... Index content transmission part, 18 ... Short video priority determination part, 19 ... Index content Screen configuration determination unit, 20 ... index content playback configuration determination unit, 21 ... link operation information generation unit, 22 ... short video data storage, 30 ... client device, 31 ... index content reception unit, 32 ... index content playback unit, 33 ... Link operation cooperation department

Claims (11)

An index content generation device for generating index content for reproducing a plurality of short videos on the same screen showing an outline of the main video,
With respect to a plurality of divided areas provided in the video display area in the screen, an expected value calculation unit that calculates an expected value of ease of finding for each short video for each divided area,
An index content generation device that determines a short video to be reproduced in each divided region based on the expected value.   The said expectation value calculation part calculates the said expectation value based on the ratio of the area of the division area of the expectation value calculation object with respect to the total area of the division area in an image | video display area. Index content generation device.   The index content generation apparatus according to claim 1, wherein the expected value calculation unit calculates the expected value based on a priority of each short video.   4. The index content according to claim 3, further comprising a short video priority determining unit that increases the priority of the short video as the ratio of the short video playback time to the main video playback time is small. Generator.   5. The index content generation device according to claim 3, further comprising: a short video priority determination unit that increases the priority of the short video as the ratio of the resolution of the short video to the resolution of the main video increases. .   The short video priority determination unit calculates the priority of a short video using a coefficient set for each type of supply source of the main video when calculating the priority of the short video. The index content generation device according to claim 4 or 5. Set up multiple clusters to classify short videos,
The index according to any one of claims 1 to 6, wherein the expectation value calculation unit calculates the expectation value for each cluster based on ease of finding a short video according to a reproduction order of the clusters. Content generation device. An index content playback configuration determination unit that determines a schedule when playing back a plurality of short videos classified into one cluster based on the playback time of each short video;
8. The index content generation apparatus according to claim 7, wherein the index content playback configuration determination unit sets the total playback time of the cluster to the longest playback time among the playback times of each short video belonging to the cluster. An index content playback configuration determination unit that determines a schedule when playing back a plurality of short videos classified into one cluster based on the playback time of each short video;
8. The index content playback configuration determination unit according to claim 7, wherein the total playback time of the cluster is set to an integral multiple of the playback time of the short video having the highest priority among the short videos belonging to the cluster. Index content generation device. An index content playback configuration determination unit that determines a schedule when playing back a plurality of short videos classified into one cluster based on the playback time of each short video;
8. The index content generation apparatus according to claim 7, wherein the index content playback configuration determination unit sets the total playback time of the cluster to the least common multiple of the playback times of each short video belonging to the cluster. The index content generation device according to any one of claims 1 to 10,
A playback device that plays back the index content generated by the index content generation device on a screen;
A link operation information generating unit for generating link operation information for acquiring a main video corresponding to a short video included in the index content;
A link operation linkage unit that performs an operation of acquiring a main video corresponding to a short video using link operation information;
A video search system characterized by comprising:

Images