JP6550180B2 - INFORMATION PROCESSING APPARATUS, CONTROL METHOD FOR INFORMATION PROCESSING APPARATUS, AND CONTROL PROGRAM - Google Patents

Description

  The present invention relates to a mechanism for editing video. In particular, the present invention relates to a mechanism for connecting videos extracted from at least a part of a plurality of video files to generate a connected video.

A partial moving image including a portion in which an image signal or an audio signal meets a predetermined standard is extracted from at least a part of a plurality of moving image files captured within a predetermined period, and these are combined to generate an edited file An apparatus is known (see, for example, Patent Document 1).
The editing apparatus described in Patent Document 1 analyzes frame images and sounds constituting a moving image, and includes a portion to which a forced extraction signal is given at the time of shooting, a portion zoomed in at the time of shooting, a portion with a large recorded volume, etc. The partial moving image including the portion is preferentially extracted from the moving image file.

Japanese Patent Application Laid-Open No. 2002-176613

  A plurality of video files, each of which has an object whose appearance may change with the passage of time (for example, a person, a fetus, an animal, a plant, a microorganism, a cell, a landscape, etc.), is taken over a relatively long period of time is there. If suitable portions are extracted from the plurality of video files and connected in order of shooting time, it can be a connected video representing the transition of the object which is the subject.

  If a method of prioritizing a portion having a relatively high priority based on the analysis result as in the editing device described in Patent Document 1 is adopted for extraction of a video, a portion that would be highly valuable to the user is easily extracted. On the other hand, since there is unlikely to be a uniform distribution of shooting times of videos including portions with relatively high priorities based on the analysis results on the time axis, there is a bias in the shooting times of videos extracted by this method. Likely to happen.

  The problem to be solved by the present invention is to suppress the bias of the photographing time when extracting each of the video to be incorporated into the connected video from at least a part of the plurality of video files as the material.

To solve the above problems, "information processing apparatus" which is one embodiment of the present invention includes: any Niso Re respective sorting sorting means of a plurality of divided according to the time shooting the image file of multiple,
Hardly selected as the image file of a large number division of a video file to be sorted by the previous SL sorting means the weight to be taken into account when a plurality of the selected file to select the constant to the material of the connection image from the plurality of image files setting means for setting so as to include a.
To solve the above problem, "method of controlling an information processing apparatus" which is one embodiment of the present invention includes: any Niso Re respective sorting sorting step a plurality of sections in accordance with the time shooting the image file of multiple ,
Hardly selected as the image file of a large number division of a video file to be sorted in the previous SL sorting step the weight to be taken into account when a plurality of the selected file to select the constant to the material of the connection image from the plurality of image files including, a setting step of setting so.
To solve the above problems, which is one embodiment of the present invention "control program" includes any Niso Re respective sorting sorting function of a plurality of sections in accordance with the time shooting the image file of multiple, said plurality of such that hardly is selected as the image file of a large number division of a video file to be sorted by the previous SL sort function weights are taken into account when a plurality of the selected file to select the constant to the material of the consolidated image from a video file a setting function to set the to realize the computer of the information processing apparatus.
To solve the above problem, a control program recorded computer readable to an embodiment "recording medium" of the present invention, Re or Niso a plurality of sections in accordance with the time shooting the image file of multiple a respective sorting sort function, a large number of image files are sorted by the previous SL sort function weights are taken into account when a plurality of selected constant selection files to the material of the consolidated image from the plurality of image files a setting function to set as less likely to be selected as the image file of the segment, the realizing on the computer of the information processing apparatus.

In the present invention, “video file” refers to content (for example, a combination of at least one of moving image data and still image data or a combination of the at least one and audio data) and metadata (for example, video files). , Shooting time, shooting position, etc.).
In the present invention, “video file” is “related to a specific object” means a specific object (for example, an object whose appearance may change with the passage of time (for example, a person, a fetus, an animal, a plant, a microorganism, a cell, Landscape etc.)) or contains a high possibility of including a video (for example, moving image, still image). Note that, for example, a video file stored in a directory associated with a specific object, added with a tag or comment associated with a specific object, or given a title associated with a specific object , It can be said that there is a high possibility of including an image obtained by photographing the object.
In the present invention, the "predetermined period" is not particularly limited. For example, calendar periods such as one week, one month, three months, half a year, and one year are suitable.
In the present invention, “connected video” refers to a series of videos in which a plurality of different videos are displayed continuously. The “connected video” may be a set of a plurality of different videos each recorded in one video file, or may be a set of a plurality of different videos continuously reproduced based on the reproduction list. .
In the present invention, “incorporate into a connected video” means to record the content of a video file (connected video file) having the linked video as the content, or to incorporate it into a reproduction list for playing back the connected video.
In the present invention, the "specified length" is not particularly limited. For example, “extraction part of specified length” is an image (X: an appropriate positive real number) of X seconds from a certain point (start point) to another point (end point) in the selected file (a series of plural still images) (I.e., a moving image)) is preferable, but it may be an image (a single frame image) at a certain point in time in the selected file. The value of X may be uniformly specified in all selection files or may be individually specified for each selection file. When the extracted portion is a single still image, the still image is continuously displayed for a predetermined time in the connected video.
In the present invention, the process "select a plurality of selection files ..." may be executed by the "information processing apparatus" or may be executed by another apparatus.
In the present invention, “weight” refers to data indicating the degree of ease of selection. The “weight” may be set uniformly to all the video files belonging to a certain section, or may be set individually for each video file. Also, part or all of the "weight" set once may be changed according to the situation.
In the present invention, “adding in” the “weight” means selecting by a method in which a video file having a high degree of ease of selection indicated by the “weight” is selected preferentially or with high probability. . For example, a method may be adopted in which the number of selections is assigned to each section according to the total value of weights set in each video file, and a video file for the number of allocations is selected from each section. A predetermined numerical range is divided according to the ratio of weight sizes, and each video file is associated with one of the divided ranges, respectively. A pseudo-random number of the numerical range is generated to generate a pseudo-random number. A method of selecting the selected video file may be adopted.
In the present invention, “weight” is less likely to be selected for video files of a section having a larger number of video files ”is defined as a function of“ the number of video files belonging to the section ”. Weight is said to decrease monotonously with the increase of "the number of video files belonging to the section". For example, it is preferable to set, in each video file, a weight that is inversely proportional to the number of video files sorted into the section to which the video file belongs.

The above-described “information processing apparatus” may have the technical limitations exemplified below. In addition, the technical limitations of the same purpose may be added to the “control method of the information processing apparatus”, the “control program”, and the “recording medium”.
For example, the setting unit may not select another video file having a predetermined relationship with the video file every time one video file is selected, or may be more difficult to select as compared to before resetting. resetting the weights, further comprising selecting means for sequentially selecting a plurality of the selected file in consideration of the latest weight that is set by the setting unit, it may be added to the technical limitation that.
Here, “adding the latest weight” and “selecting the selected file sequentially” resets the weight to at least a part of the video file every time the selected file of 1 is selected, and sets the weight after resetting. A series of procedures of selecting a new selection file in consideration is repeated until the number of selection files reaches a desired number.
Here, “adding the latest weight” means selecting by a method in which a video file having a relatively high degree of selection indicated by the “weight” is selected preferentially or with a high probability. For example, a method may be adopted in which a video file having a relatively high set weight is selected with the highest priority, or a predetermined numerical range may be selected according to the ratio of the magnitudes of the weights set in each video file. A method is adopted in which a numerical value is divided and each video file is associated with any of the divided ranges, and a pseudo random number of the numerical range is generated to select a video file associated with the divided range including the generated pseudo random number. May be

The technical limitations exemplified below may be further added to the “information processing apparatus” to which the technical limitations regarding the above “resetting” have been added. In addition, the technical limitations of the same purpose may be added to the “control method of the information processing apparatus”, the “control program”, and the “recording medium”.
For example, the setting means is selected so that at least a part of another video file belonging to the same segment as the video file is not selected every time one video file is selected or compared before the resetting. the re-setting the weight to be Nikuku, may be added to the technical limitation that.
Specifically, the sorting means is close to the extent that the shooting time meets a predetermined standard (for example, the video file is divided into short-term segments (time zone, shooting date, shooting week, etc., relatively short-range than “segment”) Grouping of the plurality of video files in the division so that the plurality of video files belong to the same group, and the video recording time belongs to the same short-term division when the video data is sorted into resetting the weights to the first video file is less likely to be selected as compared to the prior way or resetting other relevant video file is not is selected belonging to the video files of the same group each time it is selected The technical limitations may be added.

Various technical limitations may be further added to the “information processing apparatus” to which the above-mentioned “grouping” has been technically limited, as exemplified below. In addition, the technical limitations of the same purpose may be further added to the “control method of the information processing apparatus”, the “control program”, and the “recording medium”.
For example, at least part of the shooting times of the sorting unit mutually overlap (for example, the shooting start time and the shooting end time of the other video file within a period from the shooting start time of one video file to the shooting end time) Groups of video files are in the same group, and the setting unit belongs to the same group as the video file each time one video file is selected. the other related image file is re-set the weight so will not be selected, it may be further added to the technical limitation that.
As a condition for further grouping the plurality of video files such that the plurality of video files in which at least a part of the shooting time overlaps one another belong to the same group, They may be close to each other (for example, when the linear distance between the imaging positions does not exceed a predetermined threshold) or when the same directory stores the same tag data.

Various technical limitations may be further added to the “information processing apparatus” to which the technical limitations regarding “grouping” have been added, as exemplified below. In addition, the technical limitations of the same purpose may be further added to the “control method of the information processing apparatus”, the “control program”, and the “recording medium”.
For example, presenting means for causing the display device to display the connected video in which a plurality of extracted portions specified in the plurality of selected files are sequentially displayed, and displaying the connected video (for example, during normal playback or slow playback) And editing means for replacing a designated part designated by a predetermined action (for example, an utterance, a gesture, a mouse operation, a button operation, a touch operation) of the viewer during substitute pause, etc. Limitations may be added.
At this time, the plurality of substitutes each including at least one of the other portion of the selection file of the extraction source of the designated portion and the portion of the other related video file belonging to the same group as the selection file After the designated portion is designated (for example, immediately after the designated portion is designated, after the display of the coupled video is finished, etc.), the candidate concatenated video obtained by linking the video candidates is further displayed on the display device, and the editing is performed The technical limitation is that the means takes in a designated candidate designated by a designated operation (for example, an utterance, a gesture, a mouse operation, a button operation, a touch operation) of a viewer during display of the candidate connected video into the alternative video. You may add further.
In addition, the presenting unit simultaneously displays the selection file and the candidate for the extracted portion specified in the other related video file belonging to the same group as the selection file on a screen divided into a plurality of sections. A touch operation (for example, a single tap operation, a double tap, etc.) for displaying the connected video including divided video on the display device and the editing unit designating the specified portion when the specified portion includes the divided video A technical limitation may be further added in which the candidate displayed in the designated section designated together by the operation etc.) is taken into the alternative video.
In addition, the presenting unit simultaneously displays the selection file and the candidate for the extracted portion specified in the other related video file belonging to the same group as the selection file on a screen divided into a plurality of sections. A first touch operation (for example, a single tap operation) for designating the connected video including the split video on the display device and the editing unit designating the designated portion when the designated portion includes the split video The candidate displayed in the designated section specified together with flick operation in a specific direction different from the second touch operation, swipe operation, etc.) is taken into the alternative video, and the presentation unit Second touch operation (eg, double tap operation, to a specific direction different from the first touch operation) for specifying the designated portion when Designate a candidate combined video in which a plurality of alternatives of the candidate video including the other part of the selection file of the extraction source of the candidate displayed in the designated section which is also displayed together by flick operation, swipe operation etc. After the section is specified, it is further displayed on the display device, and the editing means is specified by the designating operation (for example, the utterance, the gesture, the mouse operation, the button operation, the touch operation) of the viewer during the display of the candidate concatenated video In addition, technical limitations may be added to capture designated candidates to be included in the alternative video.
In addition, the presenting unit simultaneously displays the selection file and the candidate for the extracted portion specified in the other related video file belonging to the same group as the selection file on a screen divided into a plurality of sections. A first touch operation (for example, a single tap operation) for designating the connected video including the split video on the display device and the editing unit designating the designated portion when the designated portion includes the split video The candidate displayed in the designated section specified together with flick operation in a specific direction different from the second touch operation, swipe operation, etc.) is taken into the alternative video, and the presentation unit Second touch operation (eg, double tap operation, to a specific direction different from the first touch operation) for specifying the designated portion when A screen in which a plurality of alternative video image candidates each including other portions of the selection file of the extraction source of the candidate displayed in the designated area specified together by flick operation, swipe operation, etc.) are divided into a plurality of areas The candidate division video simultaneously displayed on the display section is further displayed on the display device after the designated section is designated, and the editing means performs the touch operation (for example, single tap operation, etc.) of the viewer while the candidate division video is displayed. A technical limitation may be added in which the candidate displayed in the designated section designated by the double tap operation or the like is captured in the alternative image.

The technical limitation regarding the above “resetting” (in particular, the technical limitation assuming “at least a part of another video file belonging to the same category as the selected video file” as “predetermined relationship”) The “information processing apparatus” may further have various technical limitations, as exemplified below. In addition, the technical limitations of the same purpose may be further added to the “control method of the information processing apparatus”, the “control program”, and the “recording medium”.
For example, every time one video file is selected, the setting unit approaches the video file and the shooting time so as to cross the boundary of the division and satisfy a predetermined standard (for example, the shooting interval is within a predetermined number of days) there, subinterval obtained by equally divided into n to "segment" is a relationship adjacent) other video files to reset the weight so less likely to be selected, may be added to the technical limitation that.

Various technical limitations may be further added to the “information processing apparatus” to which the above-described “resetting” technical limitations have been added, as exemplified below. In addition, the technical limitations of the same purpose may be further added to the “control method of the information processing apparatus”, the “control program”, and the “recording medium”.
For example, the setting means, the weight as other video file the video file with the imaging device or the author every time one image file is selected (the user account when posts) match is hardly selected You may add the technical limitation of resetting.

The present invention reduces the possibility of video being extracted from only a plurality of video files that are temporally close by setting video files taken at a time when there are relatively many video files to be relatively difficult to select. Let
Therefore, according to the present invention, when extracting a video to be incorporated into a connected video from at least a part of a plurality of video files as materials, the photographing time is not likely to be uneven.

It is explanatory drawing of the specific example of a weight setting. (Embodiment) It is explanatory drawing of the example of a network configuration of the system of an Example. (Example) It is an explanatory view of the example of hardware constitutions of a server apparatus. (Example) It is an explanatory view of the example of hardware constitutions of a user device. (Example) It is explanatory drawing of the function structural example of a user terminal, a delivery management server, and a file management server. (Example) It is explanatory drawing of the function structural example of a user terminal, an edit management server, and a file management server. (Example) FIG. 6 is an explanatory diagram of an example item of metadata attached to a moving image file. (Example) It is explanatory drawing of a connection moving image generation procedure. (Example) It is explanatory drawing of a grouping procedure. (Modification 1A) It is explanatory drawing of a connection moving image generation procedure. (Modification 1A) It is explanatory drawing of a weight setting procedure. (Modification 1B) It is explanatory drawing of a connection moving image generation procedure. (Modification 1B) It is explanatory drawing of a connection moving image editing procedure. (Modification 2A) It is explanatory drawing of a connection moving image editing procedure. (Modification 2B)

[1. Embodiment]
[1-1. Overview]
Extract suitable images from multiple image files, each of which has an object whose appearance can change with the passage of time (for example, a person, a fetus, an animal, a plant, a microorganism, a cell, a landscape, etc.) Thus, a connected video is generated that represents the transition of the object that is the subject.
In this embodiment, when each video is extracted from at least a part of a plurality of video files as materials, the video is shot at a time when there are a relatively large number of video files in order to suppress the bias of the shooting time. By setting the video file to be relatively difficult to select, the possibility of video being extracted from only a plurality of video files that are temporally close to each other is reduced.

[1-2. Information processing apparatus]
The information processing apparatus according to the present embodiment incorporates a plurality of video files related to a specific object into a sorting unit for sorting each of the plurality of video files into any one of a plurality of divisions divided at predetermined time intervals according to the photographing time. An image classified by the sorting unit with respect to the plurality of video files, with a weight taken into consideration when selecting a plurality of selection files from among the plurality of video files, in which a plurality of extraction files of specified lengths to be extracted should be specified respectively And a setting unit configured to set each of the video files in a section having a large number of files so as to be less likely to be selected.

A specific example of setting of weights is shown with reference to FIG.
For example, it is assumed that a result of sorting a plurality of video files into a plurality of sections (for example, section n to section n + 3 (n: an appropriate natural number)) according to shooting timing is as shown in FIG. In the graph of FIG. 1, the horizontal axis represents division (i), and the vertical axis represents the number of video files (N (i)). According to this result, the ratio of the number of video files per section is expressed as shown in the following [Equation 1].
At this time, as shown in the following [Equation 2], if the weight (W (i)) is set by the ratio of the reciprocal of the number of video files, video files of sections having a large number of video files become more difficult to select. In the present embodiment, an extraction portion of a designated length that should constitute a concatenated video is extracted from the video file selected in consideration of the weight set in this manner.

[1-3. Implementation Example of Information Processing Device]
The present invention can be implemented in the following modes.
The server device generates a concatenated video and provides it to the user device, and the user device displays the concatenated video. In this implementation aspect, the server device corresponds to the “information processing device” according to the present invention.
The server apparatus creates a reproduction list and provides the user apparatus with the reproduction list, and the user apparatus sequentially displays individual videos constituting the concatenated video based on the reproduction list. In this implementation aspect, the server device corresponds to the “information processing device” according to the present invention.
The user device generates a concatenated video, and the user device displays the concatenated video. In this implementation aspect, the user apparatus corresponds to the "information processing apparatus" according to the present invention.
The user device creates a play list, and the user device sequentially displays individual videos constituting the concatenated video based on the play list. In this implementation aspect, the user apparatus corresponds to the "information processing apparatus" according to the present invention.

[2. Example]
[2-1. Overview]
By extracting suitable parts from a plurality of moving image files (an example of a “video file”) each having a specific person (for example, an infant) as a subject, and connecting them in ascending order of photographing time, the growth process of the person who is the subject To generate a connected moving image (an example of “connected video”) representing
In this embodiment, in order to suppress the bias of the photographing time when extracting the video to be recorded to the connected moving image from at least a part of the plurality of moving image files as the material, the moving image file is relatively large. By setting the captured moving image file to be relatively difficult to select, it is possible to reduce the possibility of the video being extracted from only a plurality of moving image files that are close in time.

[2-2. Network configuration]
FIG. 2 shows an example of the network configuration of the system of the embodiment.
The system of this embodiment includes a distribution management server 10, an editing management server 20 (an example of an "information processing apparatus"), a file management server 30, and a plurality of user terminals 40 (40-1, 40-2, ... , 40-n).
The distribution management server 10 is a user terminal of a range (for example, a specific online community to which a poster belongs (for example, a group in SNS (Social Networking Service)) in which a moving image file posted by a certain user terminal 40 is designated. Provide a service to be distributed to 40 (hereinafter referred to as a "video distribution service"). On the other hand, the editing management server 20 provides a service (hereinafter referred to as “connected moving image generation service”) that generates a connected moving image using a moving image file managed by the moving image distribution service as a material.

The distribution management server 10, the editing management server 20, and the user terminal 40 can exchange data via the communication network 50, respectively. Also, the distribution management server 10 and the editing management server 20 can access data (in the present embodiment, a moving image file) stored in the storage device 31 via the file management server 30.
The communication network 50 is an existing network (for example, the Internet, a mobile phone network, a wireless wide area network (WAN), a wireless local area network (LAN), Ethernet (registered trademark), etc.). At least one may be included.

2-2-1. Delivery Management Server]
In FIG. 2, the delivery management server 10 is a server apparatus (general-purpose computer) on which a Web server program (also referred to as an HTTP daemon (HyperText Transfer Protocol Daemon)) is installed.
For example, in response to a predetermined request (request) for specifying a moving image file, the distribution management server 10 acquires the specified moving image file from the storage device 31 via the file management server 30, and responds to the request source Response function).
Note that it is also possible to configure a distribution management system by linking a plurality of server devices and to distribute the functions of the distribution management server 10. For example, the delivery management server 10 provides link information to an external delivery server, or transfers (redirects) a predetermined request to the delivery server, thereby responding the specified moving image file to the request source. It may be borne by the external distribution server.

2-2-2. Editing Management Server]
In FIG. 2, the editing management server 20 is a server apparatus (general-purpose computer) on which a Web server program (also referred to as an HTTP daemon (HyperText Transfer Protocol Daemon)) and an application program are installed.
The editing management server 20 has a function of, for example, generating a connected moving image in response to a request for generating a connected moving image, and providing information about the generated connected moving image to a request source.
Note that it is also possible to configure an editing management system by linking a plurality of server devices and to distribute the functions of the editing management server 20. For example, a server apparatus (Web server) on which a web server program is installed and a server apparatus (application server) on which an application program is installed are separately prepared, and a function and linked moving image corresponding to access from the user terminal 40 The functions to be generated may be distributed. In addition, the editing management server 20 provides link information to an external distribution server, or transfers (redirects) a predetermined request to the distribution server, thereby responding the designated moving image file to the request source. It may be borne by the external distribution server. In addition, for example, by causing the file management server 30 to manage the generated linked moving image file in the same manner as other moving image files, the file management server 30 executes processing for responding the generated linked moving image file to the request source. It is also good.

2-2-3. File Management Server]
In FIG. 2, the file management server 30 is a server apparatus (general-purpose computer) in which a file server program is installed.
For example, the file management server 30 has a function of storing a file acquired from a request source in response to a file storage request in the storage device 31 and a file source requesting a file extracted from the storage device 31 in response to a file extraction request. And the function of responding to
Note that it is also possible to configure a file management system by linking a plurality of server devices and to distribute the functions of the file management server 30. It is also possible to distribute data in a plurality of storage devices that the file management server 30 incorporates or can be connected externally. Besides, it may be configured using a dedicated device called NAS (Network Attached Storage).

2-2-4. User terminal]
In FIG. 2, the user terminal 40 is a user device (general-purpose computer) having a data display function, a data communication function, a video shooting function, and the like.
In the system of this embodiment, portable user devices such as a mobile phone, a smart phone (smartphone), a tablet (tablet) terminal, a tablet PC (personal computer), a small PC, and a wearable device as the user terminal 40 Can be used.

[2-3. Hardware configuration]
[2-3-1. Server device]
FIG. 3 shows an example of the hardware configuration of the server device.
A typical server device includes a control processing device 310 including a Micro-Processing Unit (MPU) and a Read Only Memory (ROM), a main storage device 320 including a Random Access Memory (RAM), and a Hard Disc Drive (HDD). And an input device 340 including a mouse and a keyboard, an output device 350 including a display and a speaker, and a communication control device 360 including a network interface card.

The main storage unit 320, the auxiliary storage unit 330, the input unit 340, the output unit 350, and the communication control unit 360 are connected to the control processing unit 310 through bus lines.
The control processing unit 310 (1) reads the program stored in the auxiliary storage unit 330 onto the main storage unit 320, and (2) at least the input unit 340, the auxiliary storage unit 330 and the communication control unit 360 according to the instructions of the program. After receiving data from either (3) computing and processing the acquired data according to the procedure specified in the program, (4) communicating control with auxiliary storage device 330 and output device 350, and data that has been computed and processed Send to at least one of the device 360.

2-3-2. User device]
FIG. 4 shows an example of the hardware configuration of the user apparatus.
A typical user device includes an MPU 411 constituting a control processing unit, a RAM 421 constituting a main storage unit, a ROM 422 and an Electrically Erasable Programmable Read-Only Memory (EEPROM) 423 constituting an auxiliary storage unit, and an input / output unit. Photographed with a touch panel display 431, an NIC (Network Interface Controller) 441 and a wireless LAN (Local Area Network) chip 442 constituting a communication control unit, and an imaging device (for example, a Complementary Metal-Oxide Semiconductor (CMOS) sensor) A camera 451 that converts an image into a digital signal, a microphone 452 that converts mechanical vibration such as a diaphragm generated by sound waves into an electrical signal, and predetermined signals respectively transmitted from a plurality of satellites GPS chip that outputs position information indicating the calculated current position Having at least a 61, a clock 462 that outputs the current time, the.

The RAM 421, the ROM 422, the EEPROM 423, the touch panel display 431, the NIC 441, the wireless LAN chip 442, the camera 451, the microphone 452, the GPS chip 461, and the clock 462 are connected to the MPU 411 via a bus line. Ru.
The MPU 411 reads (1) the program stored in the EEPROM 423 onto the RAM 421 and (2) the touch panel display 431, the EEPROM 423, the NIC 441, the wireless LAN chip 442, the camera 451, the microphone 452, the GPS chip 461 and the clock 462 according to the instructions of the program. And (3) operation and process the acquired data according to the procedure defined in the program, and then (4) the operation completed / processed data into the EEPROM 423, the touch panel display 431, and the NIC 441. It sends it out to at least one of the wireless LAN chip 442.

[2-4. Functional configuration]
FIG. 5 shows an example of the functional configuration of the distribution management server, the file management server, and the user terminal regarding the “moving image distribution service”.
The function of the delivery management server 10 is realized by installing an operating system (OS) for the server apparatus and a web server program operating on the OS in the server apparatus. The function of the file management server 30 is realized by installing an OS (Operating System) for a server device and a file server program operating on the OS in the server device. In addition, the functions of the user terminal 40 include an OS for the user device, a browser program operating on the OS, and various programs (for example, a driver program or an application program for driving the camera 451 and the microphone 452) installed in the user device. It is realized by being done.

FIG. 6 shows an example of the functional configuration of the editing management server, the file management server and the user terminal related to the “connected moving image generation service”.
The function of the editing management server 20 is realized by installing an operating system (OS) for the server device and a web server program and an application program operating on the OS in the server device. Among the functions of the file management server 30 and the user terminal 40, those having the same reference numerals as those in FIG. 5 have the same functions as those shown in FIG.

The program to be installed on the server device is recorded in various recording media (for example, CD (Compact Disc), DVD (Digital Versatile Disk), MO disc (Magneto-Optical disk), flash memory, etc.). It may be distributed as it is and read from the recording medium to the server device, or may be supplied to the server device superimposed on a carrier wave via a communication network. Moreover, it may be installed from the beginning of shipping.
Generally, the program to be installed on the user device is supplied to the user device by being superimposed on a carrier wave via a communication network. The program may be distributed in a state of being recorded on various recording media (for example, a CD, a DVD, an MO disk, a flash memory, etc.) and read from the recording medium to the user device. Moreover, it may be installed from the beginning of shipping.

[2-4-1. Functional configuration of video distribution service]
As shown in FIG. 5, the user terminal 40 includes an imaging unit 4010, a storage unit 4020, a detection unit 4030, a request unit 4040, a reception unit 4050, and a display unit 4060.
Among them, the photographing unit 4010 is configured to include a camera 451 and a microphone 452. The storage unit 4020 is configured to include an EEPROM 423. The detection unit 4030 and the display unit 4060 are configured to include a touch panel display 431. The request unit 4040 and the reception unit 4050 are configured to include at least one of the NIC 441 and the wireless LAN chip 442.

The photographing unit 4010 generates a moving image file including content obtained by encoding the light-received video and collected sound in a predetermined format, and metadata attached to the content, and causes the storage unit 4020 to store the moving-image file.
The metadata includes the type of the user terminal (shooting device), position information (shooting position) obtained from the GPS chip 461, and time information (shooting time) obtained from the clock 462.

The request unit 4040 posts (posts) a moving image specified from the moving image files stored in the storage unit 4020 by the touch operation detected by the detecting unit 4030 to the distribution management server 10, and requests management thereof (moving image Management request). Further, the distribution management server 10 is requested to distribute the designated moving image specified from the moving images managed by the distribution management server 10 by the touch operation detected by the detection unit 4030 (moving image distribution request).
The receiving unit 4050 receives from the distribution management server 10 a notification (reception completion notification) to the effect that the posted video has been received. In addition, information on a specified moving image file (specified moving image file) (for example, specified moving image file itself, link information for manually requesting distribution of specified moving image file, redirect information for automatically requesting distribution of specified moving image file Etc.) from the delivery management server 10. Thereafter, the user terminal 40 acquires the designated moving image as needed and causes the display unit 4060 to display the specified moving image.

As shown in FIG. 5, the file management server 30 comprises a file management unit 3010 and a file storage unit 3020.
The file management unit 3010 stores the moving image file (posted moving image file) posted to the file storage unit 3020 in response to the storage request from the outside, and is stored in the file storage unit 3020 in response to the extraction request from the outside. Provide a specified video file.

FIG. 7 exemplifies main items of the meta information of the moving image file stored in the file storage unit 3020.
As exemplified in FIG. 7, the meta information includes “moving image ID” (key item), “file name”, “directory path” indicating storage location, “poster of file”, and compression format of content Indicating “file type”, “frame size (width, height)”, “frame rate”, “length” (reproduction time), “shooting time”, “shooting position (longitude, latitude, Advanced), "shooting device", one or more "tags", and "comments".

As shown in FIG. 5, the distribution management server 10 includes a reception unit 1010, a management unit 1020, and a response unit 1030.
The receiving unit 1010 receives a video management request and a video distribution request from the user terminal 40.
The management unit 1020 requests the file management unit 3010 to assign a unique ID to the post moving image file posted from the logged-in user terminal 40 and store it in the file storage unit 3020 in association with the post ID. Do. Further, the file management unit 3010 is requested to extract the designated moving image file designated by the user terminal 40 from the file storage unit 3020.
The response unit 1030 responds to the user terminal 40 with information on the acceptance completion notification and the designated moving image file.

[2-4-2. Functional configuration related to linked video generation service]
As shown in FIG. 6, the user terminal 40 includes a detection unit 4030, a request unit 4040, a reception unit 4050, and a display unit 4060.
Among them, the detection unit 4030 and the display unit 4060 are configured to include a touch panel display 431. The request unit 4040 and the reception unit 4050 are configured to include at least one of the NIC 441 and the wireless LAN chip 442.
In response to the touch operation detected by the detection unit 4030, the request unit 4040 requests generation of a connected moving image using a plurality of moving image files specified from among the moving image files stored in the storage unit 4020 as materials (connection Video generation request).
The receiving unit 4050 is access information for accessing the generated combined moving image file (for example, link information for manually requesting distribution of a connected moving image file, redirect information for automatically requesting distribution of a connected moving image file Etc.) from the editing management server 20. Thereafter, the user terminal 40 acquires the connected moving image file in the same procedure as acquiring the specified moving image and causes the display unit 4060 to display the file.

As shown in FIG. 6, the editing management server 20 includes a receiving unit 2010, a sorting unit 2020, a setting unit 2030, a selecting unit 2040, a specifying unit 2050, an extracting unit 2060, a connecting unit 2070, and a presenting unit. And 2080.
The receiving unit 2010 receives a linked moving image generation request from the user terminal 40.
The sorting unit 2020 sorts a plurality of moving image files related to a specific person into any one of a plurality of sections divided at predetermined intervals according to a photographing time. The setting unit 2030 sets weights on a plurality of moving image files such that moving image files of a section having a large number of moving image files sorted by the sorting unit 2020 are less likely to be selected.

The selecting unit 2040 selects a plurality of moving image files (selected files) from among the plurality of moving image files in consideration of the weight set by the setting unit 2030. The identifying unit 2050 identifies, in each of the plurality of selection files selected by the selecting unit 2040, an extraction portion of a designated length which should constitute the linked moving image. The extraction unit 2060 extracts the extraction portions specified by the specifying unit 2050 from the plurality of selection files. The linking unit 2070 links the video extracted by the extracting unit 2060 to generate a linked moving image, and requests the file management unit 3010 to store a linked moving image file having the generated linked moving image as a content in the file storage unit 3020. Do. Subsequently, the linked moving image file is specified by a distribution subject (server name), a part of a directory path (storage position), and a URL (Uniform Resource Locator) to which file names are linked.
The presentation unit 2080 responds to the user terminal 40 with the access information of the linked moving image file generated by the linking unit 2070.

[2-5. Procedure for generating connected video]
FIG. 8 exemplifies a procedure of generating a linked video by the editing management server.
In response to the request from the user terminal 40, the editing management server 20 generates a connected video (connected moving image) according to the procedure shown in FIG.
[S802] The receiving unit 2010 receives a linked moving image generation request (request) from the user terminal 40. The linked moving image generation request is a display of a link element (for example, text, an image, a button, etc.) included in a menu commonly displayed on each page of the “moving image distribution service” or individually arranged on any page. It is assumed that the user terminal 40 transmits an area to the editing management server 20 when the area is designated by the user's touch operation. In addition, when making it possible to generate a plurality of types of linked moving images (for example, 30 seconds version and 3 minutes version), it is possible to arrange a plurality of link elements respectively corresponding to the version of the connected moving image. In this case, the linked moving image generation request may include a parameter that can identify the version. In addition, when the number of moving image files to be the material is insufficient, the link element may be invalidated (hidden or grayed out).

  [S804] The sorting unit 2020 sorts a plurality of moving image files related to a specific person into any of a plurality of divisions divided by month according to the photographing time. In the present embodiment, in consideration of the possibility that a moving image file relating to a shooting error is mixed, a moving image file whose “length” of the content is 6 seconds or more is targeted for sorting. In addition, the person is stored in a directory associated with a specific person, or a tag or comment associated with the specific person is added, or a title related to the specific person is given, etc. A moving image file that has a high possibility of containing captured images is targeted for sorting.

[S808] The setting unit 2030 sets, for each of the plurality of materials belonging to the category, weights inversely proportional to the number of moving image files sorted into the category by the sorting unit 2020 for each category.
[S810a] The selecting unit 2040 selects a plurality of moving image files (selected files) from among a plurality of moving image files in consideration of the weight set by the setting unit 2030. In this embodiment, a predetermined numerical range is divided according to the ratio of the weight sizes set in each moving image file, and each video file is associated with any one of the divided ranges, and pseudo random numbers of the numerical range are generated. The process of selecting a moving image file associated with the division section including the pseudo random numbers generated is repeated. The number of selections is set according to the length of the connected video. For example, the number of selections is set to 30, when generating a 30-second version of the connected moving image, and is set to 180 when generating a 180-second version of the connected moving image.

[S818] The specifying unit 2050 specifies, in the plurality of selection files selected by the selecting unit 2040, extraction portions of a designated length (one second in the present embodiment) which should constitute the concatenated moving image. In the present embodiment, the extraction process is specified at random within the range from the point 5 seconds after the head to the point 10 seconds after, thereby speeding up the identification processing.
[S820] The extraction unit 2060 extracts the extracted portions specified by the specifying unit 2050 from the plurality of selected files.

[S822] The linking unit 2070 links the video extracted by the extracting unit 2060 in ascending order of shooting time while leaving the original audio, adds BGM (background music) as necessary, and generates a linked moving image. The file management server 30 (storage device 31) manages a connected moving image file whose content is the generated connected moving image. When the video of a selected file is vertically long, it is preferable to adjust the height to the horizontally long video by cutting off at least one of the upper part and the lower part of the frame image or reducing the size of the frame image.
[S824] The presentation unit 2080 returns the access information of the linked moving image generated by the linking unit 2070 to the user terminal 40 as a response. It should be noted that, since generation of the linked moving image requires a corresponding time, a page displayed as “during creation”, for example, is once returned as a response to the request of S802, and thereafter it is sent to the editing management server 20 from the user terminal 40 A page update request may be sent, and when the linked video is completed, the access information of the linked video may be returned. In addition, notification of completion of the linked moving image file may be provided to the user of the designated range using an electronic mail or a notification function.

[3. Modified example]
[3-1. Modification 1: Update weights every time a moving image file is selected]
Every time any moving image file is selected as a selection file, the weight (selectability degree) of another moving image file having a predetermined relationship with the selection file is halved or 0 (or an invalid value). Good.
As a result, if moving image files are sequentially selected in consideration of the latest weight, the possibility that other moving image files having a specific relationship with the selected moving image file will be selected thereafter is relatively reduced. There is a relative increase in the possibility that the movie file of will be selected later.
In the following, as predetermined relationships, an example (Modification 1A and Modification 1B) in which shooting times are close or partially overlapping and an example (Modification 1C) in which a photographer overlaps are described. I will illustrate. Modifications 1A to 1C may be combined with each other.

[3-1-1. Modification 1A]
Every time a moving image file is selected as a selection file, at least a part of the weight (selectability) of another moving image file belonging to the same category may be halved or 0 (or a non-valid value) .
As a result, if moving image files are sequentially selected in consideration of the latest weight, there is a relatively low possibility that another moving image file sorted in the same category as the selected moving image file will be selected thereafter. At the same time, since the possibility that the moving image files sorted into other categories will be selected later is relatively increased, as a result, it becomes more difficult to bias the photographing time.

Specifically, a plurality of moving image files whose shooting times are close (for example, the shooting date is the same) are grouped, and another related moving image file of the same group is selected each time one is selected as a selection file (“related One example of “image file” is to reduce the weight (degree of selection ease) to half or 0 (or an invalid value). For example, if the moving image file exists as shown in FIG. 9, the photographing date is set in the moving image file "Y Year M Month D Day" _{<a 1 ,a 2 ,a 3 ,b 1} ,b 2 ,b 3> and shooting date is set _<a 4 each group the ,a _5> of the moving image file of "Y year M month (D + 1) day".
As a result, if the moving image file is sequentially selected in consideration of the latest weight, the possibility that the selected moving image file and another related moving image file whose shooting time is near will be selected will be reduced relatively at the same time. Since the possibility that the moving image file of will be selected later is relatively increased, as a result, the photographing time is less likely to be biased.

In particular, a plurality of moving image files in which at least a part of shooting time mutually overlaps are grouped, and the weight (selectability degree) of another related moving image file in the same group is set to 0 each time any one is selected as a selection file. It is preferable to set (or an invalid value). For example, if the video file is present as shown in FIG. 9, of the moving image file that time shooting shooting date is "Y year M month D day" partially overlap set _{<a 1 ,b 1>, <a} 2, b _1>, grouping _<a 3 _{,b 1>} or a combination thereof _{<a 1 ,a 2 ,a 3 ,b 1} >.
Thereby, if the moving image file is sequentially selected in consideration of the latest weight, another related moving image file having a high possibility of including the image obtained by shooting the same scene as the selected moving image file may be selected thereafter. As a result, the duplication of the video recorded in the connected animation is eliminated.

The grouping condition may be limited to the case where shooting positions of a plurality of moving image files are extremely close to each other. Alternatively, it may be limited to the case where a plurality of moving image files are stored in the same directory or the same tag data is added to a plurality of moving image files.
As a result, the identification accuracy of other related moving image files, which are highly likely to include a video of the same scene, is improved.

FIG. 10 exemplifies a modification of the procedure of linked video generation by the editing management server.
In response to a request from the user terminal 40, the editing management server 20 may generate a connected video (connected moving image) according to the procedure shown in FIG. In addition, the same code | symbol is attached | subjected to the process equivalent to an Example (FIG. 8), and duplication description is abbreviate | omitted.
[S806] The sorting unit 2020 further groups the moving image file. For example, it is preferable to group a plurality of moving image files in which shooting times are close to each other or at least a part of the shooting times overlap each other. In addition, grouping conditions may be limited to the case where shooting positions of a plurality of moving image files are extremely close, or a plurality of moving image files are stored in the same directory, or the same tag is included in a plurality of moving image files. It may only be added.

[S810b] The selecting unit 2040 selects a single moving image file (selected file) from among a plurality of materials in consideration of the latest weight set by the setting unit 2030. In this embodiment, a predetermined numerical range is divided according to the weight ratio set for each moving image file, each video file is associated with any of the divided ranges, and pseudo random numbers of the numerical range are generated and generated. The moving image file associated with the divided range including the pseudo random number is selected.
[S812b] The selecting unit 2040 determines whether the number of selected files is equal to the upper limit number. If not equal (S812b: No), the process proceeds to S814b. On the other hand, if they are equal (S812b: Yes), the process exits the loop and proceeds to S818. Note that the upper limit value of the number of selections is set according to the length of the linked moving image. For example, the number of selections is set to 30, when generating a 30-second version of the connected moving image, and is set to 180 when generating a 180-second version of the connected moving image.

[S814b] The selecting unit 2040 determines whether there is another related moving image file belonging to the same group as the moving image file selected immediately before. If it exists (S 814 b: Yes), the process proceeds to S 816 b. On the other hand, when there is not (S814b: No), it returns to S810b.
[S816b] The setting unit 2030 resets the weights to other related moving image files belonging to the same group as the moving image file selected immediately before. For example, it is preferable to set the weight of other related moving image files whose shooting time is close to 1/2 or to set the weight of other related moving image files in which at least a part of the shooting time mutually overlaps each other to 0 (or invalid value) .

[3-1-2. Modification 1B]
Every time a moving image file is selected as a selection file, weights of other moving image files whose shooting time is close (for example, the shift of the shooting date is within a certain number of days) across the boundary between the moving image file and the section The degree of ease) may be reduced. For example, when moving image files are distributed as shown in FIG. 11, a moving image file belonging to one sub-division is present between sub-division 3 of the (n + 1) -th division and sub-division 1 of the (n + 2) -th division. Every time it is selected, the weights of other moving image files belonging to the other sub-division are uniformly reduced to 2/3.
As a result, if the moving image file is sequentially selected in consideration of the latest weight, there is a relative possibility that another moving image file whose photographing time is close across the boundary between the selected moving image file and the division may be subsequently selected. Since the possibility that other moving image files will be selected later is relatively increased at the same time, the disadvantage that the photographing time is biased immediately before and immediately after the division boundary time is resolved.

Note that each time a moving image file is selected as a selection file, the shooting time approaches the moving image file across the section boundary (for example, the shift of the shooting date is within a certain number of days) the weight of another moving image file ( The degree of easiness of selection may be reduced stepwise in accordance with the degree of deviation of the photographing time. For example, the weight of the moving image file whose i-th day (for example, 1 ≦ i ≦ 10) is shifted between the selected moving image file and the shooting date across the section boundary is set to (i + 1) / (i + 2).
Thus, the process of sorting into sub-divisions can be omitted.

FIG. 12 exemplifies a modification of the procedure of linked video generation by the editing management server.
In response to a request from the user terminal 40, the editing management server 20 may generate a connected video (connected moving image) according to the procedure shown in FIG. The same processing as that of the embodiment (FIG. 8) or the modification 1A (FIG. 10) is denoted by the same reference numeral, and the redundant description will be omitted.
[S804] The sorting unit 2020 sorts a plurality of moving image files related to a specific person into any of a plurality of divisions divided by month according to the photographing time. In addition, if necessary, the plurality of moving image files are further divided into subdivisions into which the divisions are subdivided.

[S814c] The selecting unit 2040 determines whether there is another moving image file whose shooting time is close across the boundary between the moving image file selected immediately before and the division. If it exists (S 814 c: Yes), the process proceeds to S 816 c. On the other hand, when there is not (S814 c: No), it returns to S810 b.
[S816c] The setting unit 2030 resets the weights of the moving image file selected immediately before and other moving image files whose shooting times are close to each other across the boundary of the section. For example, the weight of another moving image file belonging to a subdivision adjacent to a division boundary is set to 2/3, or the shift of the photographing date crosses the boundary of the division on the i day (for example, 1 ≦ i ≦ 10) It is preferable to set the weight of a certain moving image file to (i + 1) / (i + 2).

[3-1-3. Modification 1C]
Every time a moving image file is selected as a selection file, the weight (selectability) of another moving image file that matches the moving image file and the photographing apparatus or the contributor may be halved.
As a result, if the moving image file is sequentially selected in consideration of the latest weight, there is a possibility that another moving image file having a high possibility of being photographed by the same photographer as the selected moving image file may be subsequently selected. Since the possibility of the other moving image files being selected later increases relatively at the same time as the relative decrease, the bias of the photographer can be suppressed.

[3-2. Variation 2: Replace designated part of linked video with alternative video]
The designated part specified by the user's predetermined action (for example, voice, gesture, mouse operation, button operation, touch operation, etc.) while the linked moving image is displayed is such that the image of the specified part is close to or at least partially captured A mechanism for replacing an alternative image overlapping the above may be further added to the embodiment, the modification 1A, the modification 1B or the modification 1C.
Since the image of the designated portion and the shooting time of the alternative video image are close to or at least partially overlap with each other, the combined moving image after editing is less likely to be biased at the shooting time.

[3-2-1. Modification 2A]
In particular, a candidate connected moving image in which a plurality of alternative video candidates are connected may be further presented to the user, and a candidate corresponding to a timing designated by a touch operation detected during display of the candidate connected moving image may be captured in the alternative video.
The modification 2A can be operated intuitively because the configuration is simple. In addition, the change from the embodiment and the modification can be reduced.

For example, at timing when the video A and the video B of the connected moving image (FIG. 13A) are displayed on the display unit 4060, a predetermined touch operation (for example, a tap operation) targeting the connected moving image display area by the detecting unit 4030 ) Are detected respectively.
At this time, the editing management server 20 presents the user with the candidate concatenated moving image (FIG. 13 (b)) for the video A and the candidate concatenated moving image (FIG. 13 (c)) for the video B according to the designated timing. The substitute image to be replaced with the designated part (image A and image B) is selected respectively.
When the alternative video is selected, the editing management server 20 generates a new combined moving image in which the designated parts (video A and video B) of the connected moving image are replaced with the alternative video, respectively, and presents them to the user.

The candidate connected moving image may be generated, for example, by extracting at least a part of the next video as a candidate for the substitute video and linking these in the order of shooting time or randomly.
An image of a single or a plurality of designated lengths extracted from a moving image file (selection file) from which an image of the designated part is extracted. For example, a video of a designated length which is divided into a plurality of parts according to the number of extractions and which is extracted from parts which do not include the video of the designated part.
A plurality of moving image files in which the moving image file (selection file) from which the specified part image is extracted and the shooting time are close to each other or at least a part of the shooting time mutually overlaps (when grouped as in modification 1A Video of specified length extracted at least one part each from other related moving image files belonging to the same group.

3-2-2. Modification 2B]
In particular, a single or a plurality of divided videos (for example, candidates extracted respectively from a plurality of moving image files whose shooting times overlap at least partially are a plurality of sections (for example, a section of m rows and n columns, a single main section and a single section or Presenting to the user a connected moving image including a video simultaneously displayed on a screen divided into a plurality of subdivisions), and replacing the candidate corresponding to the division designated by the touch operation detected during display of the divided video It may be captured in a video.
The modification 2B presents the user with a connected moving image having options from the beginning, and the predetermined touch operation doubles as specifying a timing and selecting a candidate, so the number of processes for editing the connected moving image can be reduced.

For example, it is assumed that the divided video C (FIG. 14 (b) or FIG. 14 (c)) is included in the original combined moving image (FIG. 14 (a)).
The divided video C illustrated in FIG. 14B has a screen divided equally into a total of four sections (1A, 1B, 2A, 2B) in two rows and two columns, and a plurality of different moving image files (for example, When four moving image files a ₁ , a ₂ , a ₃ and b ₁ shown in FIG. 9 are grouped and one of them is selected as a selected file, four moving image files in the group including the selected file It is assumed that the video of the designated length randomly extracted from each is displayed simultaneously in each section. At this time, the correspondence between the extracted video and the section in which the video is displayed may be determined arbitrarily.
On the other hand, the divided video C illustrated in FIG. 14C includes three sub-partitions (4A, 4B, 4C) disposed in front of the display range of one main partition (3A) and the main partition. The screen is divided into a total of four sections, and a plurality of different moving image files (for example, four moving image files a ₁ , a ₂ , a ₃ , b ₁ shown in FIG. 9 are grouped, any of which is When selected as a selection file, video of a designated length randomly extracted from four moving image files in a group including the selection file is simultaneously displayed in each section. At this time, the video extracted from the selected file may be displayed on the main section (3A), and the video extracted from the related moving image file other than the selected file may be displayed on the sub section. Note that the main sections and the sub sections may be arranged such that the display areas do not overlap with each other.

Then, it is assumed that a predetermined touch operation (for example, a tap operation) targeting any section is detected by the detection unit 4030 at the timing when the divided video is displayed on the display unit 4060.
At this time, the editing management server 20 generates a new combined moving image in which the designated part (divided video C) corresponding to the designated timing has been replaced with the video corresponding to the designated segment, and presents it to the user.

3-2-3. Modification 2C]
In particular, a first moving operation including a single or a plurality of divided images is presented to the user, and a first touch operation detected during display of the divided images (for example, a flick operation in a specific direction different from a single tap operation and a second touch operation) Alternatively, the second touch operation (eg, double tap operation, press operation, first touch operation) different from the second touch operation (eg, double tap operation, press operation, first touch operation) detected while displaying the divided video, while capturing the candidate corresponding to the section specified by swipe operation) The candidate connected moving image is further presented to the user by connecting the other part of the moving image file of the candidate extraction source corresponding to the section specified by the flick operation or swipe operation in a specific direction), etc. The candidate corresponding to the timing designated by the touch operation may be taken into the alternative video.

Modification 2C presents to the user a connected moving image having options from the beginning, and the predetermined touch operation (the first touch operation and the second touch operation) serves both as the designation of timing and the selection of a section (candidate). It takes less steps to edit linked videos.
In addition, it is possible to select whether to adopt the displayed candidate as it is or to examine the portions before and after the candidate by a predetermined touch operation (the first touch operation and the second touch operation). Editing can be done intuitively.

  The candidate concatenated moving image is, for example, a video of a single or a plurality of designated lengths extracted from the moving image file of the extraction source of the video corresponding to the designated section (for example, the moving image file is divided into a plurality of portions according to the number of extractions And at least a part of the video of the designated length extracted respectively from the part not including the video corresponding to the designated section) as a candidate of the substitute video, and generated by connecting these in the order of photographing time or randomly. It is good to do.

3-2-4. Modification 2D]
In particular, a first moving operation including a single or a plurality of divided images is presented to the user, and a first touch operation detected during display of the divided images (for example, a flick operation in a specific direction different from a single tap operation and a second touch operation) Alternatively, the second touch operation (eg, double tap operation, press operation, first touch operation) different from the second touch operation (eg, double tap operation, press operation, first touch operation) detected while displaying the divided video, while capturing the candidate corresponding to the section specified by swipe operation) The user is further presented to the user a candidate divided moving image obtained by connecting other parts of the moving image file of the candidate extraction source corresponding to the section designated by the flick operation or swipe operation in a specific direction) The candidate corresponding to the section specified by the touch operation may be taken into the alternative video.

Similar to Modified Example 2C, Modified Example 2D presents to the user a combined moving image having options from the beginning, and also performs predetermined touch operations (first touch operation and second touch operation) on timing designation and sections (candidates). In addition, the process for editing the connected moving image can be reduced.
In addition, it is possible to select whether to adopt the displayed candidate as it is or to examine the portions before and after the candidate by a predetermined touch operation (the first touch operation and the second touch operation). Editing can be done intuitively.

[3-3. Other Modifications]
In the embodiment, only a moving image file having a content length of 6 seconds or more is targeted, but the threshold can be set arbitrarily.
In the embodiment, the extraction portion is specified at random within the range from 5 seconds after the beginning of the moving image content to 10 seconds after the start, but the range for specifying the extraction portion can be set arbitrarily.
Although the extraction part is specified at random in the embodiment (S 820 in FIG. 8, FIG. 10, FIG. 12), it may be specified in accordance with the feedback from the viewer. For example, the viewer may specify some operation while displaying the moving image file, and the extraction portion may be specified so that the portion including the number of times the operation has been performed in a large number in a certain period is included.

10 Distribution Management Server 20 Editing Management Server 30 File Management Server 31 Storage Device 40 User Terminal 50 Communication Network

Claims (16)

And one Niso Re respective sorting sorting means of a plurality of sections depending on the time taken multiple video files,
Hardly selected as the image file of a large number division of a video file to be sorted by the previous SL sorting means the weight to be taken into account when a plurality of the selected file to select the constant to the material of the connection image from the plurality of image files setting means for setting so that,
An information processing apparatus equipped with It said setting means, the weight to be less likely to be selected as compared to the previous another video file so can not be selected or reconfigured with the video file and the predetermined relationship to the time the first video file is selected Reset and
The system further includes selection means for sequentially selecting a plurality of the selection files in consideration of the latest weight set by the setting means.
An information processing apparatus according to claim 1. The setting means is less likely to be selected so that at least a part of other video files belonging to the same division as the video file is not selected every time one video file is selected, or compared to before re-setting resetting the weights so,
The information processing apparatus according to claim 2. The sorting unit further groups the plurality of video files in the division such that a plurality of video files close to each other such that the photographing time satisfies a predetermined standard belongs to the same group.
It said setting means, wherein such less likely to be selected as compared to the previous other such relevant video file is no longer selected or reconfigured belonging to the video files of the same group each time the first video file is selected Reset weights,
The information processing apparatus according to claim 3. The sorting means groups a plurality of video files in which at least a part of shooting time mutually overlaps, to belong to the same group,
The setting means resets the weight such that the other related video file belonging to the same group as the video file is not selected each time one video file is selected.
The information processing apparatus according to claim 4. The sorting unit further groups the plurality of video files such that a plurality of video files overlapping at least a part of the shooting time belong to the same group only when the shooting positions are close enough to satisfy a predetermined standard. ,
The information processing apparatus according to claim 5. The plurality of videos may be arranged such that a plurality of video files overlapping at least a part of the photographing time belong to the same group only when the sorting means is stored in the same directory or the same tag data is added. Group files further,
The information processing apparatus according to claim 5. Presenting means for causing the display device to display the connected video in which a plurality of extracted portions respectively specified in the plurality of selected files are sequentially displayed;
Editing means for replacing a designated part designated by a predetermined action of the viewer while the connected video is displayed with a substitute video;
The information processing apparatus according to any one of claims 4 to 7, further comprising: A plurality of candidates for the alternative image, wherein the presenting means includes at least one of the other portion of the selection file of the extraction source of the designated portion and the portion of the other related image file belonging to the same group as the selection file Displaying the candidate connected video image obtained by connecting the video files on the display device after the designated portion is specified,
The editing unit takes a designated candidate designated by a designation operation of a viewer during display of the candidate concatenated video as the alternative video.
The information processing apparatus according to claim 8. A divided video displayed simultaneously on the screen in which the candidate for the extracted portion specified in the selection file and the other related video file belonging to the same group as the selection file is specified in the plurality of sections. Displaying the connected video including the
When the designated part includes the divided video, the editing unit takes the candidate displayed in the designated section which is designated together by the touch operation for designating the designated part into the substitute video.
The information processing apparatus according to claim 8. A divided video displayed simultaneously on the screen in which the candidate for the extracted portion specified in the selection file and the other related video file belonging to the same group as the selection file is specified in the plurality of sections. Displaying the connected video including the
When the specified part includes the divided video, the editing unit takes into the alternative video the candidate displayed in the specified partition which is also specified by the first touch operation for specifying the specified part,
In addition to the selection file of the extraction source of the candidate displayed in the designated section which is simultaneously designated by the second touch operation for designating the designated part when the designated part includes the divided video, the presenting means may Displaying a candidate combined video obtained by linking a plurality of candidates for the substitute video, each including a portion of に, on the display device after the designated section is designated,
The editing unit takes a designated candidate designated by a designation operation of a viewer during display of the candidate concatenated video as the alternative video.
The information processing apparatus according to claim 8. A divided video displayed simultaneously on the screen in which the candidate for the extracted portion specified in the selection file and the other related video file belonging to the same group as the selection file is specified in the plurality of sections. Displaying the connected video including the
When the specified part includes the divided video, the editing unit takes into the alternative video the candidate displayed in the specified partition which is also specified by the first touch operation for specifying the specified part,
In addition to the selection file of the extraction source of the candidate displayed in the designated section which is simultaneously designated by the second touch operation for designating the designated part when the designated part includes the divided video, the presenting means may The candidate divided video displayed simultaneously on the screen in which the plurality of alternatives of the alternative video, each of which includes the part of, is divided into a plurality of sections is further displayed on the display device after the designated section is designated,
The editing unit takes the candidate displayed in the designated section designated by the touch operation of the viewer during display of the candidate divided video into the alternative video;
The information processing apparatus according to claim 8. Said setting means, wherein as the video file and the photographing time every time one image file is selected is less likely to be the selected other image files to be proximate to the extent that satisfies a predetermined criterion across the boundary of said section Reset weights,
The information processing apparatus according to any one of claims 3 to 12. The setting means resets the weight such that it becomes difficult to select another video file that matches the video file and the photographing apparatus or the contributor each time one video file is selected.
The information processing apparatus according to any one of claims 2 to 13. And one Niso Re respective sorting sorting step of a plurality of sections depending on the time taken multiple video files,
Hardly selected as the image file of a large number division of a video file to be sorted in the previous SL sorting step the weight to be taken into account when a plurality of the selected file to select the constant to the material of the connection image from the plurality of image files a setting step of setting so that,
And a control method of the information processing apparatus. And one Niso Re respectively sorting sorting function of a plurality of sections depending on the time taken multiple video files,
Is selected as the image file of a large number division of a video file to be sorted by the previous SL sort function weights are taken into account when a plurality of the selected file to select the constant to the material of the consolidated image from the plurality of image files and setting function to set in such a way that Nikuku,
The Ru control program to be implemented by a computer in an information processing apparatus.

Images