JP2021175037A - Information processing device - Google Patents

Abstract

To set an image that is likely to be noticed by a viewer in a moving image as an image used when a moving image to be reproduced is selected.SOLUTION: A counting unit 12 counts the number of times (that is, the number of times of reproduction of moving image data from the position to which the marker is attached) in which each marker selected by a user on each of a plurality of user terminals 20 as a display device. An identification unit 13 identifies still image data corresponding to the moving image data of the portion where the number of times of reproduction counted by the counting unit 12 satisfies a determined condition. A setting unit 14 sets the still image data identified by the identification unit 13 as thumbnail image data for displaying an image used when moving image data to be reproduced is selected on the user terminal 20.SELECTED DRAWING: Figure 4

Description

The present invention relates to a technique for setting a thumbnail image used when selecting a moving image to be played back.

For example, there is known a mechanism for capturing images of sports such as soccer and recreation such as travel, storing the video data in the cloud, and sharing the video data. Patent Document 1 discloses a system in which a plurality of images obtained by capturing the same subject by a plurality of cameras are shared by users of the plurality of cameras.

Japanese Unexamined Patent Publication No. 2015-226321

When selecting a viewing target from a plurality of videos stored on the cloud, for example, the images at the beginning of those videos are listed as thumbnail images, and the user refers to the thumbnail images to obtain the desired video. Is selected as a viewing target. At this time, the thumbnail image displayed for each moving image is preferably an image that can convey the content and highlights of the moving image to the user in an easy-to-understand manner.

An object of the present invention is to set an image that is likely to be noticed by a viewer in a moving image as an image used when selecting a moving image to be reproduced.

In order to solve the above problems, the present invention has a counting unit that counts the number of playbacks played in each part of the moving image data, and a stationary portion corresponding to the moving image data of the portion where the counted number of playbacks satisfies a predetermined condition. An information processing device including a specific unit for specifying image data and a setting unit for setting the specified still image data as image data for displaying an image used when selecting moving image data to be played back. offer.

When the added data assigned to an arbitrary position of the moving image data is selected and the reproduction of the moving image data is requested, the counting unit determines the number of times the added data is selected at the time of reproducing the moving image data. It is counted as the number of times of reproduction, and the specific unit may specify the still image data having a predetermined relationship with the position of the given data that satisfies the condition that the number of times of reproduction counted in the moving image data is determined. good.

The specific unit is used when the positions of the plurality of granted data in the moving image data fall within a predetermined range and the total number of reproductions for each of the plurality of granted data satisfies a predetermined condition. Still image data having a predetermined relationship with the position of any of the given data among the given data may be specified.

In the specific unit, when the positions of the plurality of assigned data in the moving image data fall within a predetermined range, the difference in the number of reproductions for each of the plurality of assigned data is less than the threshold value, and the plurality of assigned data When the total number of playbacks for each condition satisfies a predetermined condition, the still image data having a predetermined relationship with the position of the given data given to the earliest position among the plurality of given data is specified. May be good.

Even if the positions of the plurality of added data in the moving image data fall within a predetermined range, the specific unit can perform the moving image data when the difference in the number of times of reproduction for each of the plurality of given data is equal to or more than a threshold value. It is also possible to specify the still image data corresponding to the moving image data of the portion where the number of times of reproduction counted for each of all the given data given to is satisfied.

In the specific unit, when the positions of the plurality of assigned data in the moving image data fall within a predetermined range, the difference in the number of reproductions for each of the plurality of assigned data is equal to or greater than the threshold value, and the plurality of assigned data When the total number of playbacks for each satisfies a predetermined condition, the still image data having a predetermined relationship with the position of the granted data, which is the maximum number of playbacks for each of the plurality of assigned data, is specified. You may do so.

Even if the specific unit is the given data in which the number of times of reproduction counted in the moving image data satisfies the determined condition, if the content of the given data satisfies the determined condition as an exception, the assigned data of the given data Still image data having a predetermined relationship with the position may not be specified.

The setting unit responds to the attribute of a user who selects the still image data and browses the video data from the still image data group corresponding to the video data of the portion where the counted number of playbacks satisfies the determined condition. Still image data may be set.

When the added data assigned to an arbitrary position of the moving image data is selected and the reproduction of the moving image data is requested, the setting unit selects the still image data and browses the moving image data for each user. In addition, the tendency of the grant data selected by the user is analyzed.
Among the still image data groups corresponding to the video data of the portion where the counted number of playbacks satisfies the determined condition, the still image data according to the tendency of the given data selected by each user is set. May be good.

The setting unit is a region or area when the moving image data is viewed by selecting the still image data from the still image data group corresponding to the moving image data of the portion where the counted number of playbacks satisfies the predetermined condition. Still image data may be set according to the day and time.

According to the present invention, it is possible to set an image that is likely to be noticed by a viewer in a moving image as an image used when selecting a moving image to be reproduced.

It is a figure which shows an example of the apparatus configuration of an information processing system 1. It is a figure which shows the hardware composition of the server apparatus 10. It is a figure which shows the hardware composition of the user terminal 20. It is a figure which shows an example of the functional structure of the information processing system 1. It is a flowchart which shows an example of the operation of the server apparatus 10. It is a schematic diagram which illustrates the relationship between the moving image data and the given data. It is a schematic diagram which illustrates the structure of the given data. It is a figure which illustrates the image displayed on the user terminal 20. It is a figure which exemplifies the state which recorded the number of times of reproduction of a marker. It is a flowchart which shows an example of the operation of the server apparatus 10. It is a schematic diagram which illustrates the relationship with moving image data, marker and still image data. It is a figure which illustrates the list of the thumbnail image displayed on the user terminal 20.

[composition]
FIG. 1 is a block diagram illustrating an apparatus configuration of an information processing system 1 according to an embodiment of the present invention. The information processing system 1 is a system for capturing a moving image of, for example, playing soccer, and reproducing the captured moving image. In the information processing system 1, the imaging target is not limited to sports such as soccer or competitions, and may be any object.

The information processing system 1 includes a server device 10 that mainly performs processing related to storage, editing, and distribution of moving image data, and a plurality of user terminals 20 that mainly perform processing related to imaging or display of moving image data. The server device 10 and the user terminal 20 are communicably connected via the network 30. The network 30 is, for example, a LAN (Local Area Network), a WAN (Wide Area Network), or a combination thereof, and includes a wired section or a wireless section.

The server device 10 is a computer device that functions as an example of the information processing device according to the present invention. The server device 10 has functions such as storage, editing, and distribution of moving image data. The number of server devices 10 shown in the figure is an example, and may be 1 or more.

The user terminal 20 is, for example, a smart phone, a digital camera, a tablet, or a computer device such as a wearable device or a personal computer. The user terminal 20 has at least one of a moving image imaging function and a moving image display function. The user terminal 20 having a moving image imaging function functions as an imaging device for capturing a moving image. The user terminal 20 having a moving image display function functions as a display device for displaying the moving image. The user terminal 20 having a moving image imaging function and a moving image display function functions as an imaging device and a display device. The user terminal 20 as an imaging device is used by a user who images a moving image. The moving image data showing the moving image captured by the user terminal 20 as the imaging device is transmitted to the server device 10 via the network 30 by wireless or wired communication. The user terminal 20 as a display device is used by a user who browses a moving image. The user terminal 20 as a display device acquires the moving image data distributed by the server device 10 via the network 30 by wireless or wired communication, and displays the moving image based on the moving image data. The number of user terminals 20 shown in the figure is an example, and may be 1 or more.

FIG. 2 is a block diagram illustrating a hardware configuration of the server device 10 as an information processing device. It is a figure which shows an example of the hardware composition of the server apparatus 10. The server device 10 is physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus connecting them, and the like. In the following description, the word "device" can be read as a circuit, a device, a unit, or the like. The hardware configuration of the server device 10 may be configured to include one or more of the devices shown in the figure, or may be configured not to include some of the devices.

For each function in the server device 10, the processor 1001 performs calculations by loading predetermined software (programs) on hardware such as the processor 1001 and the memory 1002, and controls communication by the communication device 1004, or the memory 1002. And by controlling at least one of reading and writing of data in the storage 1003.

Processor 1001 operates, for example, an operating system to control the entire computer. The processor 1001 may be configured by a central processing unit (CPU) including an interface with a peripheral device, a control device, an arithmetic unit, a register, and the like.

The processor 1001 reads a program (program code), a software module, data, and the like from at least one of the storage 1003 and the communication device 1004 into the memory 1002, and executes various processes according to these. As the program, a program that causes a computer to execute at least a part of the operations described later is used. The functional block of the server device 10 may be realized by a control program stored in the memory 1002 and operating in the processor 1001. Various processes may be executed by one processor 1001, but may be executed simultaneously or sequentially by two or more processors 1001. Processor 1001 may be implemented by one or more chips. The program may be transmitted to the server device 10 via a telecommunication line.

The memory 1002 is a computer-readable recording medium, and is composed of at least one such as a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), and a RAM (Random Access Memory). May be done. The memory 1002 may be referred to as a register, a cache, a main memory (main storage device), or the like. The memory 1002 can store a program (program code), a software module, or the like that can be executed to carry out the method according to the present embodiment.

The storage 1003 is a computer-readable recording medium, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, an optical magnetic disk (for example, a compact disk, a digital versatile disk, a Blu-ray). It may consist of at least one (registered trademark) disk), smart card, flash memory (eg, card, stick, key drive), floppy (registered trademark) disk, magnetic strip, and the like. The storage 1003 may be referred to as an auxiliary storage device.

The communication device 1004 is hardware (transmission / reception device) for communicating between computers via at least one of a wired network and a wireless network, and is also referred to as, for example, a network device, a network controller, a network card, a communication module, or the like. The transmission / reception unit may be physically or logically separated from each other in the transmission unit and the reception unit.

The input device 1005 is an input device (for example, a keyboard, a mouse, a microphone, a switch, a button, etc.) that receives an input from the outside. The output device 1006 is an output device (for example, a display, a speaker, an LED lamp, etc.) that outputs to the outside. The input device 1005 and the output device 1006 may have an integrated configuration (for example, a touch panel).

Each device such as the processor 1001 and the memory 1002 is connected by a bus for communicating information. The bus may be configured by using a single bus, or may be configured by using a different bus for each device.

Further, the server device 10 includes hardware such as a microprocessor, a digital signal processor (DSP: Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). It may be configured, and the hardware may realize a part or all of each functional block. For example, processor 1001 may be implemented using at least one of these hardware.

FIG. 3 is a diagram showing a hardware configuration of a user terminal 20 that functions as an image pickup device and a display device. The user terminal 20 is physically configured as a computer device including a processor 2001, a memory 2002, a storage 2003, a communication device 2004, an input device 2005, an output device 2006, a positioning device 2011, a bus connecting them, and the like. .. For each function in the user terminal 20, by loading predetermined software (program) on the hardware such as the processor 2001 and the memory 2002, the processor 2001 performs an calculation and controls the communication by the communication device 2004, or the memory 2002. And by controlling at least one of reading and writing of data in the storage 2003. The processor 2001 also functions as a timekeeping device that measures the date and time based on the clock. The processor 2001, memory 2002, storage 2003, communication device 2004, input device 2005, and output device 2006 are the same as the processor 1001, memory 1002, storage 1003, communication device 1004, input device 1005, and output device 1006 included in the server device 10. Although it is a group of devices, the following points are different.

The communication device 2004 includes, for example, a high frequency switch, a duplexer, a filter, a frequency synthesizer, and the like in order to realize at least one of frequency division duplex (FDD) and time division duplex (TDD). It may be composed of. For example, the transmission / reception antenna, the amplifier unit, the transmission / reception unit, the transmission line interface, and the like may be realized by the communication device 1004.

The positioning device 2011 is, for example, a GPS (Global Positioning System) unit, and positions the position of the user terminal 20.

FIG. 3 illustrates the hardware configuration of the user terminal 20 that functions as an image pickup device and a display device. Therefore, the input device 2005 includes, for example, a keyboard, a mouse, switches, buttons, and the like, a camera 2007 as an imaging unit, and a microphone 2008 as a sound collecting unit. Further, the output device 2006 includes a display 2009 as a display unit and a speaker 2010 as a sound emitting unit, and may also include an LED lamp or the like. In the user terminal 20 that functions only as an imaging device, the display 2009 as a display unit and the speaker 2010 as a sound emitting unit are not indispensable. In the user terminal 20 that functions only as a display device, the camera 2007 as an imaging unit and the microphone 2008 as a sound collecting unit are not indispensable. The hardware configuration of the user terminal 20 may be configured to include one or more of the devices shown in the figure, or may be configured not to include some of the devices.

FIG. 4 is a block diagram illustrating the functional configuration of the information processing system 1. FIG. 4 illustrates the functional configuration of the entire system including the user terminal 20 that functions as an image pickup device and a display device. In the user terminal 20, the moving image data generation unit 21 generates moving image data including an image captured by the camera 2007 and a sound picked up by the microphone 2008. The moving image data includes the position determined by the positioning device 2011 (imaging position) and the date and time measured by the processor 2001 (imaging date and time) as metadata at the time of imaging.

The user can perform an operation of adding added data called a "marker" while taking an image by the user terminal 20 or playing back the captured image on the user terminal 20. For example, for a scene where a goal is scored in soccer, an example of adding a marker including character information such as "goal!" Can be considered. In response to this operation, the marker assigning unit 23 of the user terminal 20 assigns a marker including the character information of "goal!" Input by the user to an arbitrary position designated by the user in the moving image data. Here, the position specified by the user in the moving image data is a part of the moving image data corresponding to the scene in which the goal is determined in the above example. The marker includes character information input by the user and data indicating a position to which the marker is attached in the moving image data (for example, a time stamp indicating an elapsed time from the start of imaging of the moving image data). This marker is used to reproduce the moving image data from the position to which the marker is attached.

In the user terminal 20, the transmission unit 22 transmits various data to the server device 10 via the network 30. For example, in the user terminal 20, the transmission unit 22 transmits the moving image data and the marker generated by the moving image data generation unit 21 to the server device 10 via the network 30.

In the user terminal 20 that functions as a display device, the user can view the moving image captured by the user terminal 20 that functions as an image pickup device. In this case, the user can browse the moving image from the scene desired by himself / herself by selecting one of the plurality of markers attached to the moving image data on the user terminal 20 as the display device. For example, in a soccer video, by selecting a marker containing the character information of "goal" from a group of markers including character information such as "pass", "shoot", and "goal", the marker is given in the video data. The video can be viewed from the position, that is, the scene of the goal in soccer. In the user terminal 20 as a display device, the marker selection unit 24 identifies the selected marker when any one of the plurality of markers attached to the moving image data is selected by the user. In the user terminal 20 as a display device, the transmission unit 22 transmits a marker identifier that identifies the marker specified by the marker selection unit 24 to the server device 10 via the network 30.

In the user terminal 20, the output unit 25 displays an image corresponding to the moving image data on the display 2009, and emits a sound corresponding to the moving image data from the speaker 2010.

In the server device 10, the acquisition unit 11 acquires various data transmitted from the user terminal 20 via the network 30. For example, the acquisition unit 11 acquires the moving image data captured by each of the plurality of user terminals 20 as the imaging device and the markers given to the moving image data via the network 30. Further, the acquisition unit 11 acquires the marker identifier of the marker selected by the user from each of the plurality of user terminals 20 as the display device via the network 30.

In the server device 10, the counting unit 12 uses the number of times the marker is selected for each marker selected by the user in each of the plurality of user terminals 20 as a display device (that is, moving image data from the position where the marker is assigned). Counts the number of times that has been played. That is, the counting unit 12 counts the number of times of reproduction reproduced in each part of the moving image data.

The identification unit 13 specifies the still image data corresponding to the moving image data of the portion where the number of reproductions counted by the counting unit 12 satisfies the condition determined. The determined condition referred to here is, for example, corresponding to a marker in which the maximum number of playbacks is counted in moving image data which is one data file. That is, the specific unit 13 specifies the still image data corresponding to the marker having the largest number of reproductions for each moving image data.

The setting unit 14 is a thumbnail image data for displaying the still image data specified by the specific unit 13 on the user terminal 20 as an image (hereinafter referred to as a thumbnail image) used when selecting a moving image data to be played back. Set to.

In the server device 10, the reproduction unit 15 reproduces the moving image data on the user terminal 20. For example, when any one of the plurality of markers assigned to the moving image data is selected by the user, the playback unit 15 starts with a portion corresponding to the position to which the marker specified by the counting unit 12 is assigned. Start playing the video data. Further, when any one of the list of thumbnail images displayed on the user terminal 20 is specified, the playback unit 15 starts playback of the moving image data corresponding to the thumbnail image. At this time, the reproduction unit 15 may reproduce the moving image data corresponding to the thumbnail image from the position at the beginning thereof, or may reproduce the moving image data from the position corresponding to the thumbnail image specified in the moving image data.

[motion]
Next, the operation of this embodiment will be described. In the following, first, the operation from the acquisition of the moving image to the reproduction thereof will be described, and then the generation of the list of thumbnail images will be described.

[Operation from video capture to playback]
The user who is an imager operates the user terminal 20 to start the image pickup process by the camera 2007 and the microphone 2008. In response to this, the moving image data generation unit 21 of the user terminal 20 generates moving image data. The user performs an operation of adding a marker while continuing the imaging by the user terminal 20 or playing back the captured image on the user terminal 20. In response to this operation, the marker assigning unit 23 of the user terminal 20 assigns a marker including character information input by the user to a position designated by the user in the moving image data. The transmission unit 22 of the user terminal 20 transmits video data and markers to the server device 10 via the network 30 according to an arbitrary protocol such as RTMP (Real-Time Messaging Protocol) or HTTPS (Hypertext Transfer Protocol Secure). The acquisition unit 11 of the server device 10 acquires the moving image data and the marker transmitted by the transmission unit 22 of the user terminal 20 via the network 30 (step S11 in FIG. 5) and stores them (step S12).

Here, FIG. 6 is a schematic diagram illustrating the relationship between the moving image data and the markers. As shown in the figure, a plurality of markers M1 to M5 are assigned to different positions on the time axis in the moving image data. Then, as illustrated in FIG. 7, each marker M is a position data indicating a position to which the marker M is assigned in the moving image data (for example, a time stamp indicating an elapsed time from the start of imaging) and a marker identifier that identifies the markers. And the text information entered by the user and other ancillary information.

In FIG. 5, the acquisition unit 11 of the server device 10 groups items having overlapping imaging positions and imaging dates and times included as metadata in the respective moving image data acquired from the plurality of user terminals 20 (step S13). .. Specifically, the acquisition unit 11 includes moving image data in which the image pickup position of the moving image is included in the range of a circle having a radius of Xm, and at least a part of the period from the moving image imaging start time to the moving image imaging end time overlaps. Are extracted and grouped by assigning unique group identifiers to them. As a result, one or more moving image data that are assumed to have the same imaging target are grouped. Each grouped moving image data is in a playable state on the user terminal 20 as a display device.

Then, when a certain moving image data is specified from one of the user terminals 20 and a playback start is requested (step S14; YES), the playback unit 15 of the server device 10 reads out the designated moving image data and the user. By transmitting to the terminal 20, the reproduction is started (step S15). FIG. 8 is a diagram showing a display example when the moving image data is reproduced on the user terminal 20. In the display 2009 of the user terminal 20, a moving image corresponding to the moving image data is displayed in the moving image display area 102, and the information group 101 specified from the metadata of the moving image data or the marker attached to the moving image data is displayed. The included character information group 103 is displayed. In the character information group 103, the one on the left side in the figure corresponds to the marker assigned to the previous position on the time axis of the moving image data, and the one on the right side in the figure corresponds to the time axis of the moving image data. Corresponds to the marker given at the back position in. By designating the operator image 104, the user causes the character information group corresponding to each marker to be so-called rewind or fast forward on the time axis, and taps any character information to perform the character information (that is, the marker). ) Can be selected.

Here, when any character information is selected by the user (step S16; YES in FIG. 5), the marker identifier of the marker corresponding to the selected character information is notified from the user terminal 20 to the server device 10. The counting unit 12 of the server device 10 identifies the selected marker by the notified marker identifier. In response to this, the reproduction unit 15 changes the reproduction position and performs reproduction by transmitting the moving image data to the user terminal 20 from the position to which the specified marker is attached (step S17). As a result, the user can view the video from the scene corresponding to the marker selected by the user. Then, the counting unit 12 of the server device 10 counts and records the number of times of reproduction in which the marker is selected and reproduced (step S18). As a result, as illustrated in FIG. 9, the cumulative number of times the marker is selected and played by the user is recorded in association with the moving image data identifier of each moving image data, the marker identifier of the marker, and the character information. .. In the video data, the position of the marker that has been played many times corresponds to the scene that has been viewed many times by many users, that is, the scene that is likely to be noticed by many users because of its popularity. Become.

[Thumbnail image setting operation]
Next, the setting operation of the thumbnail image will be described with reference to FIG. The identification unit 13 identifies the still image data corresponding to the marker that satisfies the condition in which the number of reproductions counted by the counting unit 12 is determined. As described above, this condition corresponds to the marker in which the maximum number of playbacks is counted in the moving image data which is one data file. That is, the still image data corresponding to the marker having the largest number of playbacks is specified as the thumbnail image data.

Here, the relationship between the moving image data, the marker, and the still image data will be described with reference to FIGS. 11 to 12. As illustrated in FIG. 11, in the moving image data, one frame of images corresponding to each position is a still image every predetermined period ΔT (for example, 60 seconds) on the time axis from the head position of the data. It is set as groups g1 to g7. Then, among the markers M1 to M5, the number of reproductions counted by the counting unit 12 is before the imparting position mt3 of the marker (referred to as marker M3) having the largest number of reproductions, and is present on the time axis. The still image (still image g3 in the figure) closest to the given position mt3 of the marker M3 is specified as thumbnail image data for displaying the thumbnail image used when selecting the moving image data to be reproduced.

In FIG. 11, when there is a marker that satisfies the above conditions (step S21; YES), the setting unit 14 uses the still image data specified by the specific unit 13 based on the position of the marker, and this moving image data. Set to the representative thumbnail image data (step S22).

On the other hand, when there is no marker satisfying the above conditions in the moving image data, for example, reproduction by selecting a marker has never occurred in the moving image data (step S21; NO), the setting unit 14 is predetermined. (For example, the still image data at the beginning of the moving image data) is set as thumbnail image data (step S23).

As a result, each thumbnail image S set for various moving image data is displayed in a list as illustrated in FIG. The user refers to such a list of thumbnail images S and specifies a desired thumbnail image. In response to this designation, the processing after step S14 in FIG. 5 is started, and the moving image corresponding to the thumbnail image is played back. For example, the reproduction unit 15 may reproduce the moving image data corresponding to the specified thumbnail image from the portion corresponding to the position corresponding to the thumbnail image. Specifically, in FIG. 11, when the still image g3 is set as the thumbnail image, the moving image data is reproduced from the position corresponding to the still image g3 (when ΔT × 2 has elapsed from the start of the moving image data). Will be done. As a result, the user can view the moving image from the continuation of the designated thumbnail image.

According to the embodiment described above, by making good use of the marker assigned to view the moving image from a desired position, a still image that is likely to be noticed in the moving image is selected as a moving image to be reproduced. It is possible to set it as a thumbnail image used at times.

[Modification example]
The present invention is not limited to the embodiments described above. The above-described embodiment may be modified as follows. Further, the following two or more modified examples may be combined and carried out.

[Modification 1]
In the embodiment, the user terminal 20 accepts the operation of assigning a marker by a user who is an imager, but the imaging device for capturing a moving image and the marker assigning device for imparting a marker are separate devices. You may. Specifically, a user who is an imager operates an imaging device (for example, a smart phone or a video camera) to perform imaging, while a marker assigning device (for example, a remote controller for a smart phone or a smart watch connected to a smart phone) is used. The wearable terminal) may be operated to add a marker.

[Modification 2]
When a plurality of marker groups are close to each other on the time axis of the moving image data, the server device 10 may set a thumbnail image using a value obtained by totaling the number of times of reproduction of these marker groups. When multiple marker groups are close to each other on the time axis of video data, markers given to events to be imaged that are the highlights in a short period of time, such as a pass, a shoot, and a goal in soccer. It is supposed to be a group. In such a case, if the number of playbacks of these markers is counted individually, it may not be recognized as a marker for a series of continuous scenes that are popular with viewers. Therefore, when the positions of the plurality of markers in the moving image data fall within a predetermined time range on the time axis, and the sum of the number of times selected by each of the plurality of markers satisfies a predetermined condition, the plurality of markers Still image data corresponding to the position of any of the markers may be set as thumbnail image data. The determined condition here is, for example, that the total number of playbacks for a plurality of markers exceeds the threshold value, or that the total number of playbacks for a plurality of markers is the largest including other counted playbacks. It is a condition of. That is, when the positions of the plurality of grant data in the moving image data fall within a predetermined range, the specific unit 13 grants the plurality of grants when the sum of the specified number of times for each of the plurality of grant data satisfies a predetermined condition. Still image data having a predetermined relationship with the position of any of the given data may be specified. As the still image data having a predetermined relationship with the position of any of the given data among the plurality of given data, the following examples can be considered.

For example, assuming that the markers M1 to M3 are markers that are attached in close proximity to each other in time and the markers M4 are markers that are separated in time from these markers M1 to M3, the number of reproductions for each marker is Suppose that:
Marker M1 has been played 15 times Marker M2 has been played 20 times Marker M3 has been played 9 times Marker M4 has been played 40 times Marker M4 has been played back 40 times. Since the total number of reproductions is 44, while the total number of reproductions of the markers M4 is 40, the total number of reproductions of the markers M1 to M3> the number of reproductions of the marker M4. In this case, in a plurality of still images set for each ΔT as illustrated in FIG. 11, the markers M1 to M3 exist before the marker M1 assigned to the earliest position on the time axis, and , The still image closest to the marker M1 on the time axis (still image g1 in FIG. 11) is specified.

Here, the total number of reproductions of the markers may be used as described above only when the difference in the number of reproductions for each of the plurality of markers given in close time is less than the threshold value. That is, in the specific unit 13, when the positions of the plurality of markers in the moving image data fall within a predetermined range, the difference in the number of reproductions for each of the plurality of markers is less than the threshold value, and the difference between the plurality of markers is less than the threshold value. When the total number of playbacks satisfies a predetermined condition, the still image data having a predetermined relationship with the position of the marker assigned to the earliest position among the plurality of markers is specified as thumbnail image data. May be good. For example, similarly to the above, when the markers M1 to M3 are attached markers in temporal proximity to each other and the markers M4 are markers temporally separated from these markers M1 to M3, the markers are used. It is assumed that the number of times of reproduction of M1 is 15 times, the number of times of reproduction of marker M2 is 20, the number of times of reproduction of marker M3 is 9, and the number of times of reproduction of marker M4 is 40 times. Here, assuming that the threshold value for the difference in the number of reproductions is 15, the difference between the number of reproductions of the marker M1, the number of reproductions of the marker M2, and the number of reproductions of the marker M3 is less than the threshold value of 15. Therefore, the total number of reproductions of the marker M1, the number of reproductions of the marker M2, and the total number of reproductions of the marker M3 are used, and the total number of reproductions is 44, while the number of reproductions of the marker M4 is 40. The total number of playbacks> the number of playbacks of the marker M4. In this case, in a plurality of still images set for each ΔT as illustrated in FIG. 11, the markers M1 to M3 exist before the marker M1 assigned to the earliest position on the time axis, and , The still image closest to the marker M1 on the time axis (still image g1 in FIG. 11) is specified.

On the other hand, when a plurality of marker groups are close to each other on the time axis of the moving image data, the number of reproductions of each of the respective marker groups is not the same, and the number of reproductions of any one marker is outstanding. There are many cases. For example, if the markers M1 and M2 are markers that are attached in close proximity to each other in time and the markers M3 are markers that are temporally separated from these markers M1 and M2, the number of reproductions for each marker is Suppose that:
Marker M1 has been played twice,
Marker M2 has been played 100 times,
The number of reproductions of the marker M3 is 101 times, and the threshold value regarding the difference in the number of reproductions is 50. Since the difference between the markers M1 and M2 that are close in time is 98, it is 50 or more of the threshold value. In this case, the sum of the number of times the marker M1 is reproduced and the number of times the marker M2 is reproduced is not considered. That is, since the marker M3 is the largest among the markers M1 to M3, as illustrated in FIG. 11, in a plurality of still images set for each ΔT, the number of reproductions is larger than that of the marker M3 on the time axis. A still image (still image g3 in FIG. 11) that exists before and is closest to the marker M3 on the time axis is specified. That is, even if the positions of the plurality of markers in the moving image data fall within a predetermined range, the specific unit 13 assigns the moving image data to the moving image data when the difference in the number of reproductions for each of the plurality of markers is equal to or greater than the threshold value. It is also possible to specify the still image data corresponding to the moving image data of the portion where the number of times of reproduction counted for each of all the markers satisfies the predetermined condition.

Further, in the specific unit 13, when the positions of the plurality of markers in the moving image data fall within a predetermined range, the difference in the number of reproductions for each of the plurality of markers is equal to or greater than the threshold value, and the specific unit 13 has a reference to each of the plurality of markers. When the total number of playbacks satisfies a predetermined condition, the still image data having a predetermined relationship with the position of the marker having the highest number of playbacks among the plurality of playbacks for each of the plurality of markers is specified. good. Similar to the above, for example, assuming that the markers M1 and M2 are attached in close time to each other and the marker M3 is a marker temporally separated from these markers M1 and M2, each marker is used. It is assumed that the number of plays for is as follows.
Marker M1 has been played twice,
Marker M2 has been played 100 times,
The number of reproductions of the marker M3 is 101 times, and the threshold value regarding the difference in the number of reproductions is 50. Since the difference between the markers M1 and M2 that are close in time is 98, the threshold value is 50 or more, but the sum of the number of reproductions of the marker M1 and the number of reproductions of the marker M2 is considered. Here, the sum of the number of reproductions of the marker M1 and the number of reproductions of the marker M2> the number of reproductions of the marker M3, and further, the number of reproductions of the marker M1 <the number of reproductions of the marker M2. In this case, in a plurality of still images set for each ΔT as illustrated in FIG. 11, the image is present on the time axis before the marker M2, which is the maximum number of reproductions among adjacent markers, and is on the time axis. Above, the still image closest to the marker M2 (still image g2 in FIG. 11) is specified.

[Modification 3]
When a marker including a certain character information is given, the still image corresponding to the marker may not be set as the thumbnail image. The specific character information referred to here is not only the character information naturally given to the image data (“soccer” for the soccer video data), but also the character information having a very common meaning. .. That is, even if the number of playbacks counted in the moving image data is a marker that satisfies the determined condition, the specific unit 13 is concerned if the content (character information) of the marker satisfies the determined condition as an exception. Still image data having a predetermined relationship with the position of the marker may not be specified.

[Modification example 4]
Thumbnail images may be set according to the attributes of the user who is the viewer. That is, the setting unit 14 sets as a thumbnail image the still image data according to the attribute of the user who browses the moving image data among the still image data group corresponding to the marker whose counted number of playbacks satisfies the predetermined condition. You may do so. For example, the setting unit 14 includes a database that stores attributes such as the user's age, gender, and hobbies / preferences. A still image corresponding to a marker including the determined character information (for example, character information "goal" for a man in his twenties and character information including the name of a popular player for a woman in his teens) is set as a thumbnail image.

[Modification 5]
A thumbnail image may be set according to the tendency of the character information included in the marker selected in the past by the user who is the viewer. That is, the setting unit 14 analyzes the tendency of the character information of the marker selected by the user for each user who selects the thumbnail image and browses the moving image data, and sets the still image according to the tendency as the thumbnail image. You may try to do it. For example, the setting unit 14 includes a database that stores character information included in markers selected by the user in the past, and when setting a thumbnail image, the character information of a group of markers whose number of playbacks is equal to or greater than a threshold value. A still image corresponding to a marker containing character information having a meaning similar to is set as a thumbnail image.

[Modification 6]
Thumbnail images may be set according to the viewing area or viewing date and time of the video data. That is, the setting unit 14 is the still image data according to the region or the date and time when the moving image data is browsed among the still image data group corresponding to the moving image data of the portion where the counted number of times of reproduction satisfies the predetermined condition. May be set.

[Other variants]
The block diagram used in the description of the above embodiment shows a block of functional units. These functional blocks (components) are realized by any combination of hardware and / or software. Further, the means for realizing each functional block is not particularly limited. That is, each functional block may be realized by one physically and / or logically coupled device, or directly and / or indirectly by two or more physically and / or logically separated devices. (For example, wired and / or wireless) may be connected and realized by these a plurality of devices. For example, at least a part of the functions of the server device 10 may be implemented in the user terminal 20.

Each aspect / embodiment described herein includes LTE (Long Term Evolution), LTE-A (LTE-Advanced), SUPER 3G, IMT-Advanced, 4G, 5G, FRA (Future Radio Access), W-CDMA. (Registered Trademarks), GSM (Registered Trademarks), CDMA2000, UMB (Ultra Mobile Broadband), IEEE 802.11 (Wi-Fi), IEEE 802.16 (WiMAX), IEEE 802.20, UWB (Ultra-WideBand), It may be applied to systems utilizing Bluetooth®, other suitable systems and / or next-generation systems extended based on them.

The order of the processing procedures, sequences, flowcharts, etc. of each aspect / embodiment described in the present specification may be changed as long as there is no contradiction. For example, the methods described herein present elements of various steps in an exemplary order, and are not limited to the particular order presented.
Each aspect / embodiment described in the present specification may be used alone, in combination, or switched with execution.

The terms "system" and "network" as used herein are used interchangeably.

The terms "determining" and "determining" as used herein may include a wide variety of actions. "Judgment" and "decision" are, for example, judgment, calculation, computing, processing, deriving, investigating, looking up (for example, table). , Searching in a database or another data structure), confirming (ascertaining) may be regarded as "judgment" or "decision". In addition, "judgment" and "decision" are receiving (for example, receiving information), transmitting (for example, transmitting information), input (input), output (output), and access. (Accessing) (for example, accessing data in memory) may be regarded as "determination" or "decision". In addition, "judgment" and "decision" mean that "resolving", "selecting", "choosing", "establishing", "comparing", etc. are regarded as "judgment" and "decision". Can include. That is, "judgment" and "decision" may include that some action is regarded as "judgment" and "decision".

The present invention may be provided as an information processing method including steps of processing performed in the information processing system 1 or the server device 10. Further, the present invention may be provided as a program executed by the server device 10. Such a program may be provided in a form recorded on a recording medium such as an optical disk, or may be provided in a form such as being downloaded to a computer via a network such as the Internet and being installed and made available. It is possible.

Software, instructions, etc. may be transmitted and received via a transmission medium. For example, the software uses wired technology such as coaxial cable, fiber optic cable, twisted pair and digital subscriber line (DSL) and / or wireless technology such as infrared, wireless and microwave to websites, servers, or other When transmitted from a remote source, these wired and / or wireless technologies are included within the definition of transmission medium.

The information, signals, etc. described herein may be represented using any of a variety of different techniques. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description are voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, light fields or photons, or any of these. It may be represented by a combination of.

The terms described herein and / or the terms necessary for understanding the present specification may be replaced with terms having the same or similar meanings. For example, the channel and / or symbol may be a signal. Also, the signal may be a message. Further, the component carrier (CC) may be referred to as a carrier frequency, a cell or the like.

As long as "inclusion," "comprising," and variations thereof are used herein or in the claims, these terms are as comprehensive as the term "comprising." Intended to be targeted. Furthermore, the term "or" as used herein or in the claims is intended not to be an exclusive OR.

Throughout this disclosure, if articles are added by translation, for example a, an, and the in English, unless the context clearly indicates that these articles are not. It shall include more than one.

Although the present invention has been described in detail above, it is clear to those skilled in the art that the present invention is not limited to the embodiments described herein. The present invention can be implemented as modifications and modifications without departing from the spirit and scope of the invention as defined by the claims. Therefore, the description of the present specification is for the purpose of exemplification and does not have any limiting meaning to the present invention.

1 ... Information processing system, 10 ... Server device, 11 ... Acquisition unit, 12 ... Count unit, 13 ... Specific unit, 14 ... Setting unit, 15 ... Playback unit, 20 ... user terminal, 21 ... video data generation unit, 22 ... transmission unit, 23 ... marker addition unit, 24 ... marker selection unit, 25 ... output unit, 30 ... Network, 1001 ... Processor, 1002: Memory, 1003: Storage, 1004 ... Communication device, 1005 ... Input device, 1006 ... Output device, 2001 ... Processor, 2002 ... Memory, 2003 ... Storage, 2004 ... Communication device, 2005 ... Input device, 2006: Output device, 2007 ... Camera, 2008 ... Microphone, 2009 ... Display, 2010 ... Speaker, 2011.・ ・ Positioning device.

Claims (10)

A count unit that counts the number of playbacks played in each part of the video data,
A specific unit that identifies the still image data corresponding to the video data of the portion where the counted number of playbacks satisfies the determined condition, and
An information processing device including a setting unit that sets the specified still image data as image data for displaying an image used when selecting moving image data to be played back. When the added data assigned to an arbitrary position of the moving image data is selected and the reproduction of the moving image data is requested,
The counting unit
The number of times the given data is selected during playback of the moving image data is counted as the number of playbacks.
The information according to claim 1, wherein the specific unit identifies still image data having a predetermined relationship with the position of the given data in which the number of times of reproduction counted in the moving image data satisfies a predetermined condition. Processing equipment. The specific part is
When the positions of the plurality of assigned data in the moving image data fall within a predetermined range and the sum of the number of times of reproduction for each of the plurality of assigned data satisfies a predetermined condition.
The information processing apparatus according to claim 2, wherein still image data having a predetermined relationship with the position of any of the plurality of assigned data is specified. The specific part is
When the positions of the plurality of assigned data in the moving image data fall within a predetermined range, the difference in the number of reproductions for each of the plurality of assigned data is less than the threshold value, and the number of reproductions for each of the plurality of assigned data When the sum meets the specified conditions
The information processing apparatus according to claim 3, wherein still image data having a predetermined relationship with the position of the given data given to the earliest position among the plurality of given data is specified. The specific part is
Even if the positions of the plurality of assigned data in the moving image data fall within a predetermined range, if the difference in the number of playbacks for each of the plurality of assigned data is equal to or greater than the threshold value,
The fourth aspect of claim 4, wherein the still image data corresponding to the moving image data of the portion where the number of times of reproduction counted for each of all the added data given to the moving image data satisfies the predetermined condition is specified. Information processing equipment. The specific part is
When the positions of the plurality of assigned data in the moving image data fall within a predetermined range, the difference in the number of reproductions for each of the plurality of assigned data is equal to or greater than the threshold value, and the number of reproductions for each of the plurality of assigned data When the sum meets the specified conditions
The information processing apparatus according to claim 3, further comprising specifying still image data having a predetermined relationship with the position of the given data, which is the highest number of times of reproduction for each of the plurality of assigned data. Even if the specific unit is the given data in which the number of times of reproduction counted in the moving image data satisfies the determined condition, if the content of the given data satisfies the determined condition as an exception, the given data can be obtained. The information processing apparatus according to any one of claims 1 to 6, wherein the still image data having a predetermined relationship with the position is not specified. The setting unit responds to the attribute of a user who selects the still image data and browses the video data from the still image data group corresponding to the video data of the portion where the counted number of playbacks satisfies the determined condition. The information processing apparatus according to any one of claims 1 to 7, wherein the still image data is set. When the added data assigned to an arbitrary position of the moving image data is selected and the reproduction of the moving image data is requested,
The setting unit
For each user who selected the still image data and viewed the moving image data, the tendency of the given data selected by the user was analyzed.
Among the still image data groups corresponding to the video data of the portion where the counted number of playbacks satisfies the determined condition, the still image data is set according to the tendency of the given data selected by each user. The information processing apparatus according to any one of claims 1 to 7. The setting unit is a region or area when the moving image data is viewed by selecting the still image data from the still image data group corresponding to the moving image data of the portion where the counted number of playbacks satisfies the determined condition. The information processing apparatus according to any one of claims 1 to 7, wherein still image data is set according to the date and time.

Images