JP2021132328A - Information processing method, information processing device, and computer program - Google Patents

Abstract

To provide an information processing method, an information processing device, and a computer program that can be expected to facilitate the editing of a moving image.SOLUTION: In an information processing method according to an embodiment in which an information processing device generates moving image data, the information processing device acquires moving image data, identifies the feature of the acquired moving image data, and edits the moving image data according to the specified features. Further, the information processing device may specify a plurality of features at the same time point in the moving image data, and edit the moving image data according to a combination of the specified plurality of features. Further, the information processing device may extract a plurality of pieces of partial moving image data from the moving image data, edit the extracted pieces of partial moving image data, and combine the pieces of edited partial moving image data.SELECTED DRAWING: Figure 7

Description

The present invention relates to an information processing method, an information processing device, and a computer program that perform editing processing on moving image data.

In recent years, devices capable of capturing moving images have become widespread, and many users can easily capture moving images. However, the editing process for the captured moving image data requires a certain amount of knowledge and skill, and editing the moving image is a high threshold for general users.

In Patent Document 1, an evaluation value is calculated by quantifying the facial expression of the operator from the video of the operator captured at the time of capturing or playing back the moving image, and the calculated evaluation value is used on the same timeline as the original moving image. A moving image processing device has been proposed that records and sequentially extracts partial moving images of the original moving image based on the recorded evaluation value to generate a digest.

Japanese Unexamined Patent Publication No. 2014-112787

However, the moving image processing device described in Patent Document 1 merely extracts a partial moving image from the original moving image to generate a digest, and is insufficient for assisting the user in editing the moving image.

The present invention has been made in view of such circumstances, and an object of the present invention is to provide an information processing method, an information processing device, and a computer program which can be expected to facilitate editing of moving images. It is in.

The information processing method according to one embodiment is an information processing method in which an information processing device generates moving image data, and the information processing device acquires moving image data and identifies the characteristics of the acquired moving image data. , The moving image data is edited according to the specified feature.

In the case of one embodiment, it can be expected that the editing of moving images will be facilitated.

It is a schematic diagram for demonstrating the outline of the information processing system which concerns on this Embodiment. It is a block diagram which shows the structure of the server apparatus which concerns on this embodiment. It is a schematic diagram which shows an example of an editing method determination table. It is a block diagram which shows the structure of the terminal apparatus which concerns on this embodiment. It is a schematic diagram which shows an example of the moving image reproduction screen displayed by a terminal device. It is a flowchart which shows the procedure of the process performed by the terminal apparatus which concerns on this embodiment. It is a schematic diagram for demonstrating the editing process of moving image data performed by a server apparatus. It is a schematic diagram for demonstrating an example of an editing process which superimposes an image. It is a flowchart which shows the procedure of the process performed by the server apparatus in this embodiment. It is a schematic diagram which shows an example of the edit setting screen displayed by the terminal apparatus which concerns on modification 1. FIG. It is a schematic diagram for demonstrating the structure of the information processing system which concerns on modification 2. FIG.

A specific example of the information processing system according to the embodiment of the present invention will be described below with reference to the drawings. It should be noted that the present invention is not limited to these examples, and is indicated by the scope of claims, and is intended to include all modifications within the meaning and scope equivalent to the scope of claims.

<System configuration>
FIG. 1 is a schematic diagram for explaining an outline of an information processing system according to the present embodiment. The information processing system according to the present embodiment includes a server device 1 that provides a moving image editing service, and a terminal device 3 such as a smartphone or tablet terminal device owned by a user who uses this service. There is. The server device 1 and the terminal device 3 can communicate via a network N including a mobile phone communication network, a wireless LAN (Local Area Network), the Internet, and the like.

For example, the user gives an instruction to the terminal device 3 to automatically edit the moving image data obtained by taking a moving image with a camera mounted on the terminal device 3. In response to this instruction, the terminal device 3 transmits the moving image data to be edited to the server device 1 by communicating with the server device 1 via the network N. The server device 1 acquires the moving image data transmitted from the terminal device 3, performs appropriate editing processing on the moving image data, and returns the edited moving image data to the terminal device 3. The terminal device 3 receives and stores the edited moving image data from the server device 1, and performs processing such as reproduction (display) of the moving image data or posting to the SNS (Social Networking Service).

FIG. 2 is a block diagram showing a configuration of the server device 1 according to the present embodiment. The server device 1 according to the present embodiment includes a processing unit 11, a storage unit (storage) 12, a communication unit (transceiver) 13, and the like. In the present embodiment, it is assumed that the processing is performed by one server device 1, but a plurality of server devices 1 may be distributed to perform the processing.

The processing unit 11 uses an arithmetic processing unit such as a CPU (Central Processing Unit), an MPU (Micro-Processing Unit) or a GPU (Graphics Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory) and the like. It is composed of. The processing unit 11 reads and executes the server program 12a stored in the storage unit 12 to perform various processes related to the editing of moving image data.

The storage unit 12 is configured by using a large-capacity storage device such as a hard disk. The storage unit 12 stores various programs executed by the processing unit 11 and various data required for processing by the processing unit 11. In the present embodiment, the storage unit 12 stores the server program 12a executed by the processing unit 11, the feature identification model 12b used for the editing process, and the editing method determination table 12c.

In the present embodiment, the server program 12a is provided in a mode of being recorded on a recording medium 99 such as a memory card or an optical disk, and the server device 1 reads the server program 12a from the recording medium 99 and stores it in the storage unit 12. However, the server program 12a may be written to the storage unit 12 at the manufacturing stage of the server device 1, for example. Further, for example, in the server program 12a, the server device 1 may acquire what is distributed by another remote server device or the like by communication. For example, in the server program 12a, the writing device may read what has been recorded on the recording medium 99 and write it in the storage unit 12 of the server device 1. The server program 12a may be provided in the form of distribution via the network, or may be provided in the form of being recorded on the recording medium 99.

The server device 1 according to the present embodiment edits moving image data by utilizing so-called artificial intelligence, and has a feature-specific model 12b used for the editing process. The feature-specific model 12b is a learned learning model that has been machine-learned in advance, and for example, a learning model such as a neural network or SVM (Support Vector Machine) can be adopted. The feature-specific model 12b may be provided, for example, together with the server program 12a via the recording medium 99, or may be distributed by another server device or the like separately from the server program 12a, and is provided in any manner. You may. The server device 1 according to the present embodiment acquires the feature-specific model 12b that has been machine-learned in advance and stores it in the storage unit 12. Further, in the present embodiment, the process of generating the feature identification model 12b by machine learning is performed by a device different from the server device 1, but the present invention is not limited to this, and the server device 1 is a machine. You may study. Further, the server device 1 does not have to include the feature-specific model 12b, and the server device 1 requests a process using the feature-specific model 12b from another device having the feature-specific model 12b, and the server from the other device. The device 1 may acquire the processing result.

The feature-specific model 12b is a learning model that outputs information that identifies the features of the scene included in the moving image data in response to the input of the moving image data. As the feature-specific model 12b, various learning models such as CNN (Convolutional Neural Network) or RNN (Recurrent Neural Network) can be adopted. In the present embodiment, the data that the feature identification model 12b accepts for input is moving image data, but in addition to the moving image data, various information such as position information or time information by GPS (Global Positioning System) is input. May be good. The information output by the feature-specific model 12b includes, for example, information indicating what is reflected in a moving image (person, automobile, bicycle, building, tree, animal, plant, etc.), and attributes (facial expression) of what is reflected. Information indicating age, gender and movement, etc., information indicating where the moving image was taken (indoor, outdoor, sea, mountain, forest and city), time zone when the moving image was taken (morning) , Day, evening or night, etc.), and various information such as information indicating the weather (fine, rain, cloudy, snow, etc.) when the moving image was taken may be included. Note that the feature-specific model 12b is not realized as one learning model, but a plurality of learning models such as a learning model that detects what is reflected in a moving image, a learning model that detects attributes of what is reflected, and the like. It may be realized as a set of learning models.

The editing method determination table 12c is a table in which the scene information, which is one or more information related to the features specified for the moving image data, and the editing method performed for the moving image data are stored in association with each other. .. FIG. 3 is a schematic view showing an example of the editing method determination table 12c. In the illustrated editing method determination table 12c, features such as weather, place, time zone, presence / absence of children, presence / absence of adults, and presence / absence of automobiles related to moving image data are exemplified as features included in the scene information. Further, in the illustrated editing method determination table 12c, two editing methods, method 1 and method 2, are predetermined for the combination of the features of the scene information.

In the editing method determination table 12c of this example, the characteristics that the weather is fine, the place is outdoors, the time zone is daytime, the child is shown, and the gender is male and smiling are specified from the moving image data as the scene information. In this case, it is defined as an editing method to perform editing to add a laughing effect image and editing to add a bright BGM. Also, if the scene information is indoors, and the feature that an adult is shown and represents anger is specified, edit to add an anger effect image and change the voice of the person reflected in the moving image. It is stipulated as an editing method to perform editing. In addition, when the feature that the place is indoors and the child is high-high (crawl on all fours, crawling, crawling) is specified as the scene information, editing to add a character image is defined as the editing method. There is. In addition, when the characteristics that the weather is rainy, the place is outdoors, the time zone is evening, and the car is in the picture and the car is running are specified, the editing method is defined as slow-playing the video.

The content of the above-mentioned editing method determination table 12c is an example, and is not limited to this. The scene information may include various features other than weather, place, time zone, presence / absence of children, presence / absence of adults, and presence / absence of automobiles. The editing method may be one or three or more for one combination in the scene information, instead of two.

The communication unit 13 communicates with various devices via a network N including a mobile phone communication network and the Internet. In the present embodiment, the communication unit 13 communicates with one or a plurality of terminal devices 3 via the network N. The communication unit 13 transmits the data given by the processing unit 11 to another device, and gives the data received from the other device to the processing unit 11.

The storage unit 12 may be an external storage device connected to the server device 1. Further, the server device 1 may be a multi-computer including a plurality of computers, or may be a virtual machine virtually constructed by software. Further, the server device 1 is not limited to the above configuration, and may include, for example, a reading unit that reads information stored in a portable storage medium, an input unit that accepts operation input, a display unit that displays an image, and the like. ..

Further, in the processing unit 11 of the server device 1 according to the present embodiment, the processing unit 11 reads out and executes the server program 12a stored in the storage unit 12, thereby causing the moving image acquisition unit 11a and the partial moving image extraction unit. 11b, a feature specifying unit 11c, an editing method determining unit 11d, an editing processing unit 11e, a combining processing unit 11f, an edited moving image transmitting unit 11g, and the like are realized in the processing unit 11 as software-like functional units.

The moving image acquisition unit 11a performs a process of acquiring moving image data to be automatically edited from the terminal device 3. For example, the moving image acquisition unit 11a receives the moving image data transmitted together with the request for performing the editing process from the terminal device 3 in the communication unit 13, and stores the received moving image data in an empty area of the storage unit 12 or the like. By doing so, the moving image data is acquired. Further, the moving image acquisition unit 11a may acquire information such as the date and time or place where the moving image data was taken, together with the moving image data. The shooting date and time information can be attached to the moving image data based on, for example, the calendar function and the clock function of the terminal device 3. The information on the shooting location can be specified based on, for example, a GPS signal received by the terminal device 3 and attached to the moving image data.

The partial moving image extraction unit 11b performs a process of extracting one or a plurality of partial moving image data from the moving image data to be edited. The partial moving image extraction unit 11b performs a moving image extraction process for generating a so-called digest. In the partial moving image extraction unit 11b, for example, a part where a specific person or an object is projected, a part where the person being photographed has a large movement, a part where the person being photographed is smiling, and a large number of people are photographed. A partial image having a predetermined feature, such as a part, a part where a scene is switched, or a part where the volume of sound is loud, is extracted from the entire moving image data. Since the partial moving image data extraction process by the partial moving image extraction unit 11b is an existing technique, detailed description thereof will be omitted. For example, the partial moving image extraction unit 11b digitizes the facial expression of the operator captured at the time of capturing or reproducing the moving image and calculates the evaluation value by the same technique as the moving image processing device described in Patent Document 1. , Partial moving image data may be extracted based on the calculated evaluation value. Further, for example, the partial moving image extraction unit 11b can specify the features of one or a plurality of scenes included in the moving image data by the feature specifying model 12b, and can extract the scenes having predetermined features as the partial moving image data.

The feature specifying unit 11c uses the feature specifying model 12b stored in the storage unit 12, and the scene included in the partial moving image data with respect to one or more partial moving image data extracted by the partial moving image extracting unit 11b. Performs processing to identify the characteristics of. The feature identification unit 11c inputs the extracted partial moving image data into the feature identification model 12b, and acquires the feature identification result output by the feature identification model 12b. The feature specifying unit 11c creates scene information summarizing one or a plurality of features specified for the partial moving image data. Further, the feature specifying unit 11c may be configured to input information such as the shooting date and time and the shooting location of the partial moving image data to the feature specifying model 12b.

The editing method determining unit 11d determines a method of editing processing performed on the partial moving image data based on the scene information related to the feature specified by the feature specifying unit 11c and the editing method determining table 12c stored in the storage unit 12. Perform the process of determining. The editing method determination unit 11d refers to the editing method determination table 12c based on one or a plurality of features specified in the scene information, and obtains the editing method associated with the specified feature to obtain the editing method. To determine.

In the present embodiment, the editing method determination unit 11d is configured to determine the editing method using the editing method determination table 12c, but the present invention is not limited to this, and for example, for inputting moving image data, scene information, and the like. The editing method may be determined using a learning model that has been machine-learned in advance so as to output a suitable editing method. In the case of a configuration in which a learning model is used to determine the editing method, for example, an evaluation of the editing method can be received from a user who has viewed the edited moving image data, and the learning model can be relearned based on the received evaluation. ..

The editing processing unit 11e performs editing processing on the partial moving image data according to the editing method determined by the editing method determining unit 11d. In the present embodiment, the editing processing unit 11e performs editing processing for superimposing various images such as a decorative image, a character image, and an effect image on a moving image. Further, for example, the editing processing unit 11e performs editing processing for changing the time zone of the scene included in the moving image (from daytime to nighttime, from nighttime to daytime, or from daytime to evening, etc.). Further, for example, the editing processing unit 11e performs an editing process for changing the style of the moving image (from a normal style moving image to a painting style, an animation style, or the like). Further, for example, the editing processing unit 11e performs an editing process for adding a sound effect or a background sound to the moving image data. Further, for example, the editing processing unit 11e performs a process of changing the voice color, voice sound, or the like of the voice spoken by the person reflected in the moving image. Further, for example, the editing processing unit 11e performs an editing process for changing the reproduction speed of the moving image data (slow reproduction, frame advance reproduction, double speed reproduction, fast forward reproduction, etc.). The above editing process is an example, and the editing processing unit 11e may be configured to perform various editing processes other than these.

The combining processing unit 11f performs a process of generating digest moving image data by combining a plurality of partial moving image data extracted by the partial moving image extracting unit 11b and edited by the editing processing unit 11e. ..

The edited moving image transmitting unit 11g performs a process of transmitting the digest moving image data generated by combining the partial moving image data to the terminal device 3 which is the request source of the editing process.

FIG. 4 is a block diagram showing the configuration of the terminal device 3 according to the present embodiment. The terminal device 3 according to the present embodiment includes a processing unit 31, a storage unit (storage) 32, a communication unit (transceiver) 33, a display unit (display) 34, an operation unit 35, a camera 36, and the like. .. The terminal device 3 may be configured by using an information processing device such as a smartphone, a tablet-type terminal device, or a personal computer equipped with a function of capturing a moving image by the camera 36. Further, the terminal device 3 may be a photographing device such as a video camera that captures a moving image.

The processing unit 31 is configured by using an arithmetic processing unit such as a CPU or MPU, a ROM, and the like. By reading and executing the program 32a stored in the storage unit 32, the processing unit 31 performs various processing such as shooting processing of the moving image by the camera 36 and display processing of the shot moving image on the display unit 34. ..

The storage unit 32 is configured by using a non-volatile memory element such as a flash memory. The storage unit 32 stores various programs executed by the processing unit 31 and various data required for processing by the processing unit 31. In the present embodiment, the storage unit 32 stores the program 32a executed by the processing unit 31. In the present embodiment, the program 32a is distributed by a remote server device or the like, which is acquired by the terminal device 3 by communication and stored in the storage unit 32. However, the program 32a may be written to the storage unit 32, for example, at the manufacturing stage of the terminal device 3. For example, in the program 32a, the terminal device 3 may read the program 32a recorded on the recording medium 98 such as a memory card or an optical disk and store it in the storage unit 32. For example, in the program 32a, the writing device may read what was recorded on the recording medium 98 and write it in the storage unit 32 of the terminal device 3. The program 32a may be provided in a mode of distribution via a network, or may be provided in a mode recorded on a recording medium 98.

The communication unit 33 communicates with various devices via a network N including a mobile phone communication network and the Internet. In the present embodiment, the communication unit 33 communicates with the server device 1 via the network N. The communication unit 33 transmits the data given by the processing unit 31 to another device, and gives the data received from the other device to the processing unit 31.

The display unit 34 is configured by using a liquid crystal display or the like, and displays various images, characters, and the like based on the processing of the processing unit 31.

The operation unit 35 accepts the user's operation and notifies the processing unit 31 of the accepted operation. For example, the operation unit 35 accepts a user's operation by an input device such as a mechanical button or a touch panel provided on the surface of the display unit 34. Further, for example, the operation unit 35 may be an input device such as a mouse and a keyboard, and these input devices may be configured to be removable with respect to the terminal device 3.

The camera 36 is configured by using an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The camera 36 is arranged at an appropriate position in the housing of the terminal device 3, for example. The camera 36 gives the image captured by the image sensor to the processing unit 11. In the present embodiment, the camera 36 can capture a moving image. In the present embodiment, the terminal device 3 is provided with the camera 36, and the moving image data captured by the camera 36 is edited, but the present invention is not limited to this. For example, the moving image data captured by another device such as a digital video camera may be acquired by the terminal device 3 as the target of the editing process, and the terminal device 3 may obtain the moving image data published on the Internet or the like. The acquired one may be edited.

Further, in the terminal device 3 according to the present embodiment, the processing unit 31 reads out and executes the program 32a stored in the storage unit 32, so that the photographing processing unit 31a, the display processing unit 31b, the editing instruction receiving unit 31c, and the moving image are executed. The image transmitting unit 31d, the moving image receiving unit 31e, and the like are realized in the processing unit 31 as software-like functional units. The program 32a may be a program dedicated to the information processing system according to the present embodiment, or may be a general-purpose program such as an Internet browser or a web browser. The program 32a may be, for example, an application program of an SNS (Social Networking Service) that shares a moving image with another user.

The shooting processing unit 31a performs processing related to shooting a moving image by the camera 36. The photographing processing unit 31a controls, for example, the shutter speed, frame rate, ISO sensitivity, exposure, aperture value, and the like of the camera 36. Further, the photographing processing unit 31a acquires the moving image data photographed by the camera 36 and stores the moving image data in an appropriate file format such as MP4 or AVI (Audio Video Interleave) in the storage unit 32.

The display processing unit 31b performs a process of reproducing the moving image data stored in the storage unit 32 and displaying it on the display unit 34. The moving image data displayed by the display processing unit 31b in the present embodiment includes the moving image data taken by the camera 36 and the moving image data edited by the server device 1. In addition, the display processing unit 31b displays a menu screen, a home screen, a setting screen, or the like for the user to use the system. The data required for displaying these screens is stored in the storage unit 32 together with the program 32a.

The editing instruction receiving unit 31c performs a process of receiving an instruction from the user to automatically edit the moving image data by the server device 1 based on the operation performed on the operation unit 35. For example, the editing instruction receiving unit 31c edits the moving image data in response to a touch operation, a tap operation, a click operation, or the like on a button or icon provided on the screen on which the display processing unit 31b reproduces and displays the moving image data. Accepts processing execution instructions. Further, for example, the display processing unit 31b displays a list of the file names or thumbnail images of the captured moving image data, and the editing instruction receiving unit 31c displays the list displayed moving image data as a target for editing processing. By accepting a selection operation of a plurality of moving image data, an instruction to execute an editing process for the selected moving image data is received. The method of receiving the editing instruction by the editing instruction receiving unit 31c is an example, and is not limited to this.

When the editing instruction receiving unit 31c receives the editing instruction, the moving image transmitting unit 31d reads the moving image data to be edited from the storage unit 32, and transmits the read moving image data to the server device 1 by the communication unit 33. Perform the processing to be performed. The moving image transmitting unit 31d transmits the moving image data to the server device 1 together with a message requesting the execution of the editing process and the like. At this time, the moving image transmitting unit 31d may transmit information such as conditions or settings for automatic editing of moving image data to the server device 1.

The moving image receiving unit 31e performs a process of receiving the edited moving image data edited by the server device 1 in the communication unit 33. The moving image receiving unit 31e stores the received moving image data in the storage unit 32. In the present embodiment, the server device 1 transmits the edited moving image data to the terminal device 3, and the terminal device 3 stores the edited moving image data in the storage unit 32, but the present invention is limited to this. It's not a thing. For example, when the server device 1 stores the edited moving image data and the terminal device 3 reproduces and displays the edited moving image data, the edited moving image data from the server device 1 each time. A so-called streaming playback configuration, in which the data is acquired and played back, may be adopted.

<Editing instruction reception process>
FIG. 5 is a schematic diagram showing an example of a moving image reproduction screen displayed by the terminal device 3. The terminal device 3 according to the present embodiment displays the moving image reproduction screen on the display unit 34, and reproduces and displays the moving image data. For example, the terminal device 3 displays a character string such as "Title: Elementary school athletic meet" indicating the title of the moving image to be reproduced at the top of the moving image reproduction screen. The title of the moving image may be, for example, a user's prior name, or may be, for example, a file name attached to the moving image data. The terminal device 3 reproduces and displays a moving image in a rectangular reproduction area provided below the character string of the title. Icons and the like for controlling playback, stop, fast forward, and the like are arranged side by side in the lower part of the reproduction area, and the terminal device 3 controls the reproduction of moving images according to the user's operation on these icons.

Further, an information display area for displaying information related to the moving image data is provided below the operation icon, and the terminal device 3 displays information such as the date and time or place where the moving image data was taken in this area. do. In the present embodiment, an icon 101 labeled "automatic editing" and an icon 102 labeled "video sharing" are provided side by side at the bottom of the information display area of the moving image reproduction screen. ing. The icon 101 is for receiving an instruction for automatic editing from the user on the moving image displayed on the moving image reproduction screen. When a touch operation, a tap operation, a click operation, or the like on the icon 101 is accepted, the terminal device 3 transmits the moving image data to the server device 1 and requests automatic editing of the moving image data. The icon 102 posts the moving image data to, for example, a moving image sharing site or an SNS, and accepts an operation for publishing the moving image data to one or a plurality of other users. Since the sharing of moving image data is an existing technology, detailed description thereof will be omitted.

In response to the request for the editing process from the terminal device 3, the server device 1 acquires the moving image data transmitted from the terminal device 3 and automatically performs the editing process on the moving image data. In the present embodiment, the server device 1 extracts an appropriate scene from the original moving image data, performs appropriate image processing, audio processing, and the like to combine the extracted scenes to create a digest moving image. Process automatically. The server device 1 transmits the edited moving image data to the requesting terminal device 3.

The terminal device 3 that has transmitted the moving image data to the server device 1 in response to the operation for the icon 101 displays a message such as "Please wait for a while" superimposed on the moving image playback screen, and is transmitted from the server device 1. Waits for the edited video data to be received. When the edited moving image data is received, the terminal device 3 reproduces and displays the edited moving image data received from the server device 1 in the reproduction area instead of the moving image data before editing.

Further, when the user who has viewed the edited moving image data is dissatisfied with the content of the editing process performed on the moving image data, for example, the moving image data can be operated by performing the operation for the automatic editing icon 101 again. It may be possible to request a re-editing process for. In response to a request for re-editing from the terminal device 3, the server device 1 can edit the moving image data with contents different from the previous ones and transmit the moving image data to the terminal device 3.

FIG. 6 is a flowchart showing a procedure of processing performed by the terminal device 3 according to the present embodiment. When the display processing unit 31b of the processing unit 31 of the terminal device 3 according to the present embodiment receives, for example, a selection operation of one moving image data stored in the storage unit 32, the selected moving image data is displayed. In order to reproduce, the moving image reproduction screen having the configuration shown in FIG. 5 is displayed on the display unit 34 (step S1). The display processing unit 31b determines whether or not the reproduction operation has been performed based on whether or not the operation for the reproduction icon or the like provided on the moving image reproduction screen is accepted, for example (step S2). When the reproduction operation is performed (S2: YES), the display processing unit 31b reads the moving image data from the storage unit 32, reproduces the read moving image data, and performs a reproduction process of displaying the read moving image data on the display unit 34 (step S3). ), End the process.

When the playback operation is not performed (S2: NO), the editing instruction receiving unit 31c of the processing unit 31 receives the operation from the user based on whether or not the operation for the automatic editing icon 101 provided on the moving image playback screen is performed. It is determined whether or not an instruction for automatic editing of moving image data has been given (step S4). When the instruction for automatic editing is not given (S4: NO), the processing unit 31 returns the processing to step S1.

When an instruction for automatic editing is given (S4: YES), the moving image transmitting unit 31d of the processing unit 31 reads the moving image data to be edited from the storage unit 32, and sends the read moving image data to the server device 1. Transmit (step S5). After that, the moving image receiving unit 31e of the processing unit 31 determines whether or not the edited moving image data transmitted by the server device 1 has been received (step S6). When the edited moving image data is not received (S6: NO), the moving image receiving unit 31e waits until the moving image data is received from the server device 1. When the moving image receiving unit 31e receives the edited moving image data from the server device 1 (S6: YES), the display processing unit 31b reproduces the received edited moving image data and displays it on the display unit 34. The reproduction process is performed (step S7), and the process is completed.

<Editing process>
FIG. 7 is a schematic diagram for explaining the editing process of moving image data performed by the server device 1. The server device 1 according to the present embodiment edits the moving image data transmitted from the terminal device 3 together with the editing request, and performs a process of generating digest moving image data. In this figure, the moving image data acquired by the server device 1 from the terminal device 3 is shown at the top as a whole moving image.

First, the server device 1 according to the present embodiment performs a process of extracting one or a plurality of partial moving images from the whole moving image. Since the technique of extracting the partial moving image from the whole moving image to generate the digest moving image is existing, the detailed description of the method of extracting the partial moving image performed by the server device 1 will be omitted. The server device 1 may extract a partial moving image from the whole moving image by any method. In the illustrated example, the server device 1 extracts three partial moving images from the whole moving image.

For example, the server device 1 can extract a part in which a smiling person is projected and a portion in which more smiling people are projected in the whole moving image. Further, for example, the server device 1 can extract a part in which a specific person or an object is projected. Further, for example, the server device 1 can extract a portion where the movement or change of a person or an object displayed in the whole moving image is large, and may extract a portion where the movement or change is small. Further, for example, the server device 1 can extract a portion where the volume of the conversation of the person shown in the moving image exceeds the threshold value. The above method for extracting a partial moving image is an example, and is not limited to this.

Next, the server device 1 performs a process of specifying the characteristics of the projected scene for each extracted partial moving image. In the present embodiment, the server device 1 inputs the partial moving image data into the feature specifying model 12b stored in the storage unit 32, and uses the output information that specifies the features of the scene included in the partial moving image data as the feature specifying model. Obtained from 12b. In the illustrated example, the weather, shooting location, time zone, presence / absence and condition of a car, presence / absence and state of person 1 (children and men), and presence / absence and state of person 2 (adults and women) with respect to a partial moving image. Features such as are specified. In addition, for a car, whether it is running or stopped is specified as a feature, for person 1 it is specified whether it is a smile or not, and for person 2 it is specified whether it is talking or not. There is. The features shown in the illustration are merely examples, and are not limited to these features. Various features other than these may be specified from the moving image data. For example, it may be specified whether or not a bicycle, a building, a tree, a plant, an animal, etc. is reflected in the moving image data, and the type of facial expression, age, gender, movement, etc. may be specified as the attribute of the person or object in the image. It may be specified as a feature.

In the feature-specific model 12b, for example, a plurality of frames constituting moving image data are input in time series. The feature-specific model 12b identifies the above features for each frame input in time series. Based on the information output by the feature-specific model 12b, the server device 1 can acquire information on the time-series features specified for the moving image data. The server device 1 may specify a feature for each frame constituting the moving image data, may specify a feature for each set of a predetermined number of frames, and have a predetermined playback time of the moving image data such as 1 second. Features may be specified on an hourly basis. In any case, the feature specified by the server device 1 according to the present embodiment is a time-series feature that can change with the passage of time.

As the feature identification model 12b, the server device 1 classifies, for example, whether the weather of the scene reflected in the moving image data is sunny, cloudy, rainy, snow, or the like with respect to the input of the moving image data. A learning model can be used. This feature-specific model 12b is generated by performing machine learning in advance using, for example, teacher data in which moving image data and weather labels are associated with each other. Further, the server device 1 uses the feature identification model 12b as a learning model for classifying whether the shooting location of the scene reflected in the moving image data is indoors or outdoors with respect to the input of the moving image data, for example. Can be used. Further, the server device 1 uses, for example, a learning model that classifies whether the time zone of the scene reflected in the moving image data is morning, daytime, evening, or night with respect to the input of the moving image data. Can be done.

Further, the server device 1 uses the feature identification model 12b as a feature-specific model 12b, for example, for inputting moving image data, whether or not a car is shown in the moving image data, the position of the car being copied, and copying. As an attribute of the automobile, a learning model for specifying whether the vehicle is running or stopped can be used. In the illustrated example, the period during which the stopped vehicle is projected in the partial moving image 1 is specified. By acquiring the time-series features from the feature-specific model 12b, the server device 1 not only determines whether or not the car is shown in the partial moving image 1, but also determines the period during which the car is shown in the partial moving image 1. Can be identified.

Similarly, the server device 1 uses the feature identification model 12b as a feature-specific model 12b, for example, with respect to the input of moving image data, whether or not a person is reflected in the moving image data, the position of the person being copied, and the copied person. A learning model that specifies facial expressions, age, gender, etc. can be used as attributes of the person. In the illustrated example, the period during which the male child is projected in the partial moving image 1 is specified, and the period during which the child's facial expression is smiling is specified. Further, in the illustrated example, the period in which the adult woman is projected in the partial moving image 1 is specified, and the period in which the woman is talking is further specified.

The server device 1 stores a plurality of learning models for specifying the plurality of features as described above from the moving image data as the feature identification model 12b in the storage unit 32. The server device 1 can specify a plurality of features from the moving image data by inputting moving image data to each of the plurality of learning models and acquiring the information output by each learning model. However, the feature-specific model 12b may be generated as one learning model that outputs these plurality of features.

The server device 1 that has specified the time-series features of each partial moving image determines the editing process to be performed on each partial moving image by referring to the editing method determination table 12c of the storage unit 32 based on the specified features. do. The server device 1 searches for a combination that matches the combination of time-series features of the specified partial moving image from a plurality of combinations defined as scene information in the editing method determination table 12c. When a combination matching the combination of features specified from the partial moving image exists in the editing method determination table 12c, the server device 1 acquires the editing method associated with this combination from the editing method determination table 12c.

For example, in the example shown in FIG. 7, there is a timing in which the combination of the characteristics that the weather is fine, the shooting location is outdoors, the time zone is daytime, and the male child smiles is specified. The combination of these features exists first in the editing method determination table 12c shown in FIG. 3, and the server device 1 has two types of corresponding editing methods, "laughter effect image addition" and "bright BGM". It can be obtained from the editing method determination table 12c.

The server device 1 acquires an editing method in time series from the editing method determination table 12c for a combination of a plurality of features specified in time series for a partial moving image, and determines the editing method in time series. For example, when the feature is specified for each frame of the partial moving image, the server device 1 can determine the editing method for each frame. However, even when the feature is specified for each frame, the server device 1 may determine the editing method for each predetermined frame such as every 10 frames or every 100 frames, and for example, the reproduction of a moving image. The editing method may be determined at predetermined time intervals such as every 1 second or every 10 seconds of the time. Further, for example, the server device 1 selects one or a plurality of combinations of features that appear over the longest time in the partial moving image as representative features, and based on the selected representative features, edits the partial moving image. You may decide.

The server device 1 that has determined the editing method for all the partial moving images extracted from the whole moving image performs the editing process of the partial moving image by the determined editing method. In the present embodiment, the server device 1 can perform the following editing processing, for example. However, the editing processes listed below are examples, and the server device 1 may perform various editing processes other than these.
-Editing process to superimpose images such as decorative images, character images or effect images-Editing process to change the time zone of the scene included in the moving image-Editing process to change the style of the moving image-Add sound effect or background sound Editing process to change the voice color or voice sound, etc. Editing process to change the playback speed

FIG. 8 is a schematic diagram for explaining an example of an editing process for superimposing images. In the editing process of superimposing images, the server device 1 can transform a character into an astronaut by superimposing a decorative image of a space suit on a person projected on a moving image, for example. Further, for example, the server device 1 can decorate a character by superimposing a decorative image of glasses or sunglasses on a person's face projected on a moving image. Further, for example, the server device 1 can change the clothes of the characters by superimposing the decorative image of the clothes on the person projected on the moving image. Further, for example, the server device 1 can superimpose the character image of the chick near the baby projected on the moving image. Further, for example, the server device 1 can superimpose an effect image on a soccer ball existing at the feet of a soccer player projected on a moving image.

These images superimposed on the moving image by the server device 1 may move by animation as the moving image is reproduced. The data of these images superimposed on the server device 1 is stored in advance in the storage unit 12. Which of the large number of images stored in advance is to be superimposed may be determined, for example, in the editing method determination table 12c, or, for example, an image associated with a specific feature specified in advance may be superimposed. Alternatively, for example, an image to be superimposed may be selected based on a random number, and an image to be superimposed may be determined by various methods other than these. The server device 1 performs image processing for superimposing the superimposed image on an appropriate position of the original moving image. At this time, the server device 1 detects, for example, the position of a person or an object in a moving image, the face of the person, the posture of the person, the moving direction or the moving speed of the person or the object, and the like. , The position and orientation of the superimposed image can be determined.

Further, the server device 1 can change the time zone of the scene included in the moving image by performing image processing for changing the hue, saturation, brightness, etc. of the original moving image, for example. As a result, the server device 1 can perform image processing for changing the time zone such as from daytime to evening or nighttime, from nighttime to daytime or evening, and from evening to daytime or nighttime.

Further, the server device 1 can perform an editing process for changing the style of the moving image by using a learning model of so-called style conversion. Since it is an existing technique, detailed description is omitted, but for example, a style conversion learning model is a model that outputs a converted image in which a style (style) is converted with respect to an input image, and is close to the input image and the style image. Machine learning is performed in advance so as to output the converted image. The learning model is generated for each style to be converted, and the server device 1 can store and use a plurality of learning models for style conversion in the storage unit 12. Which of the plurality of convertible styles to be converted may be determined, for example, in the editing method determination table 12c, and for example, a style associated with a specific specific feature specified in advance may be specified. It may be adopted, or the style may be determined based on, for example, a random number, and the style may be determined by various methods other than these. As a result, the server device 1 can change, for example, a photographed normal style moving image into a style such as a painting style or an animation style.

Further, the server device 1 can perform an editing process for adding a sound effect or a background sound to the moving image, and the data of the added sound effect or the background sound is stored in the storage unit 12 in advance. The server device 1 reads, for example, data corresponding to the sound effect or background sound defined in the editing method determination table 12c from the storage unit 12, and performs a process of adding the sound effect or background sound to the moving image data.

Further, the server device 1 changes the voice color or voice sound of the voice emitted by a person or an animal or the like reflected in the moving image, for example, converting a male voice into a female voice or converting a human voice into a specific animation character. It is possible to perform editing processing such as converting to the voice of. The server device 1 changes the voice color or voice sound by, for example, extracting a voice emitted by a person from a moving image and performing processing such as frequency conversion of the extracted voice.

Further, the server device 1 changes the reproduction speed of the moving image data, for example, performs a speed change process such as slow reproduction, frame advance reproduction, double speed reproduction, or fast forward reproduction. Of these plurality of speed changing methods, which method is used for speed changing may be specified in, for example, the editing method determination table 12c, or is associated with, for example, a specific feature specified in advance. The method may be adopted, or the speed changing method may be determined based on, for example, a random number, or the speed changing method may be determined by various methods other than these.

In the present embodiment, the server device 1 uses a predetermined method (predetermined method) for editing processing such as superimposing an image, changing a time zone, adding a sound effect or a background sound, changing a voice color or a voice sound, and changing a playback speed. The moving image shall be edited by performing image processing or sound processing according to the rule), but the present invention is not limited to this. The server device 1 may also perform the editing process using the trained learning model in the same manner as the editing process of changing the style.

The server device 1 that has performed editing processing on all the partial moving images combines a plurality of partial moving images to generate one moving image data. The moving image data generated thereby is transmitted from the server device 1 to the editing request source terminal device 3 as the edited digest moving image data.

The server device 1 may accept a request for re-editing from the terminal device 3 after transmitting the edited moving image data to the terminal device 3. The server device 1 that has received the re-editing request may, for example, perform the editing process again from the unedited whole moving image data, and change, add, or delete the edited contents of the edited digest moving image data. May be done. For example, the server device 1 may randomly change the editing method determined in the editing method determination table 12c to another editing method. Further, for example, a plurality of editing methods are stored in the editing method determination table 12c, such as the second editing method, the third editing method, and so on, and the server device 1 stores a plurality of editing methods defined in the editing method determination table 12c. The editing methods may be carried out in order. Further, for example, the server device 1 may store in advance a table in which the previous editing method and the editing method performed in the re-editing are associated with each other, and use this table to determine the editing method for the re-editing. The server device 1 may determine the editing method for re-editing.

FIG. 9 is a flowchart showing a procedure of processing performed by the server device 1 in the present embodiment. The processing unit 11 of the server device 1 according to the present embodiment starts this processing in response to a request from the terminal device 3. First, the moving image acquisition unit 11a of the processing unit 11 acquires the moving image data transmitted together with the request for performing the editing process from the terminal device 3 as the data of the entire moving image to be edited (step S11). The data of the entire moving image acquired by the moving image acquisition unit 11a is temporarily stored in, for example, the storage unit 12.

Next, the partial moving image extraction unit 11b of the processing unit 11 extracts the data of one or a plurality of partial moving images from the data of the whole moving image acquired in step S11 (step S12). The feature identification unit 11c of the processing unit 11 uses the feature identification model 12b stored in the storage unit 12 to perform a process of specifying time-series features of the data of each partial moving image extracted in step S12 (. Step S13). The editing method determination unit 11d of the processing unit 11 refers to the editing method determination table 12c stored in the storage unit 12 based on the characteristics of each partial moving image specified in step S13, and displays the editing method determination table 12c in the editing method determination table 12c. By acquiring the defined editing method, the editing method to be performed on each partial moving image is determined (step S14).

Next, the editing processing unit 11e of the processing unit 11 edits the data of each partial moving image according to the editing method determined in step S14 (step S15). The combination processing unit 11f of the processing unit 11 combines the data of all the partial moving images edited in step S15 in chronological order (step S16). The edited moving image transmitting unit 11g of the processing unit 11 transmits the edited moving image data obtained by combining the partial moving images in step S16 to the terminal device 3 of the requesting source of the editing process (step). S17), the process is terminated.

<Summary>
The server device 1 according to the present embodiment having the above configuration acquires moving image data to be edited from the terminal device 3, identifies the characteristics of the acquired moving image data, and moves the moving image according to the specified characteristics. Edit the image data. As a result, the server device 1 can automatically perform editing processing suitable for the characteristics of the moving image data, and the user does not have to perform the editing processing of the moving image data by himself / herself. Therefore, the user can edit the moving image data. It can be expected to be facilitated.

Further, the server device 1 according to the present embodiment identifies a plurality of features at the same time in the moving image data, determines an editing method according to a combination of the specified plurality of features, and edits the moving image data. .. As a result, it can be expected that the server device 1 performs various editing processes on the moving image data.

Further, the server device 1 according to the present embodiment has an editing process for superimposing a decorative image or the like, an editing process for changing the time zone of a scene, an editing process for changing a style, an editing process for adding a sound effect or a background sound, and audio. At least one of the editing process for changing the playback speed and the editing process for changing the playback speed is performed. As a result, the server device 1 can be expected to create moving image data with high entertainment or taste. The editing process performed by the server device 1 is not limited to the above, and the server device 1 may perform various editing processes other than these.

Further, the server device 1 according to the present embodiment extracts a plurality of partial moving image data from the entire moving image data acquired from the terminal device 3, edits each extracted partial moving image, and edits the extracted partial moving image. Digest moving image data is generated by combining a plurality of partial moving image data. As a result, the server device 1 can generate the digest moving image data in which the playing time is shortened and the editing process is performed, based on the moving image data having a long playing time. In the present embodiment, the server device 1 extracts a partial moving image from the whole moving image and performs editing processing, but the present invention is not limited to this, and the partial moving image is not extracted and the whole moving image is subjected to the editing process. Editing processing may be performed. This is suitable when the reproduction time of the entire moving image is short. In other words, when the server device 1 extracts the partial moving image from the whole moving image, the server device 1 may extract the whole moving image itself as one partial moving image.

Further, the terminal device 3 according to the present embodiment displays an icon 101 for receiving an instruction to execute an editing process on the moving image data on the moving image reproduction screen together with the moving image, and executes the editing process by accepting an operation on the icon 101. Accept instructions. When the execution instruction is received, the terminal device 3 gives a request for editing processing to the server device 1, the server device 1 edits the moving image data in response to this request, and the edited moving image data is sent to the terminal device 3 Send to. On the playback screen, the terminal device 3 reproduces and displays the edited moving image data received from the server device 1 instead of the moving image data before editing. As a result, the user can easily give an instruction to execute the editing process of the moving image data, and can expect to easily view the edited moving image data.

In the present embodiment, the information processing system has a configuration in which the server device 1 acquires moving image data from the terminal device 3 and performs editing processing, and transmits the edited moving image data from the server device 1 to the terminal device 3. However, the present invention is not limited to this, and for example, the terminal device 3 may be configured to perform editing processing and the like. In this case, the information processing system may not include the server device 1. The information processing described in the present embodiment may be performed by the cooperation of a plurality of devices, or may be performed by a single device.

Further, in the present embodiment, the server device 1 performs editing processing on one moving image data, but the present invention is not limited to this. For example, the server device 1 acquires a plurality of moving image data from the terminal device 3, extracts one or a plurality of partial moving images from each of the plurality of whole moving images, performs editing processing, and edits the edited plurality of partial moving images. They may be combined to generate one digest video.

Further, in the present embodiment, the server device 1 uses a learning model that outputs the features of the moving image data in response to the input of the moving image data. For example, the server device 1 performs editing processing using the following learning model. May be good. For example, a learning model in which machine learning is performed so as to perform the editing process described as the process of the server device 1 in the present embodiment may be generated for the input of the moving image data. The server device 1 can input the moving image data acquired from the terminal device 3 into the learning model, acquire the edited moving image data output by the learning model, and transmit it to the terminal device 3.

Further, for example, the server device 1 may use a learning model that outputs an editing method for input of moving image data, scene information, or the like, or for input of a feature specified by the feature specifying model 12b. After the server device 1 transmits the edited moving image data to the terminal device 3 and the terminal device 3 reproduces and displays the edited moving image data, the terminal device 3 acquires the user's evaluation for the edited content. You may. For example, when the operation for the video sharing icon 102 provided on the moving image playback screen shown in FIG. 5 is performed, it is assumed that the edited content is highly evaluated, and the second and subsequent times for the automatic editing icon 101. When an operation is performed (that is, when a request for re-editing is made), the terminal device 3 can acquire and store an evaluation of the edited content as if the edited content was given a low evaluation. The evaluation acquired by the terminal device 3 is fed back to the server device 1 and can be used for re-learning the learning model that outputs the editing method. By using a learning model that has been relearned based on the user's evaluation, it is possible to realize an editing process that more reflects the user's preference.

Further, in the present embodiment, the moving image data captured by the terminal device 3 is targeted for the editing process, but the present invention is not limited to this. The server device 1 may acquire the moving image data taken by a device such as a video camera different from the terminal device 3, perform an editing process, and transmit the edited moving image data to the terminal device 3. Further, the user may acquire the moving image data published on the Internet or the like on the terminal device 3 and edit the acquired moving image data. Further, the state of the game played on the game machine may be saved as moving image data, and the moving image data may be edited. In this case, the editing process may be performed by the server device 1 or the game machine.

<Modification example 1>
FIG. 10 is a schematic view showing an example of an edit setting screen displayed by the terminal device 3 according to the modified example 1. In the information processing system according to the first modification, the user can set whether or not to execute each editing process for various editing processes performed by the server device 1. The terminal device 3 displays the illustrated edit setting screen on the display unit 34 when, for example, a setting item related to the editing process is selected on a menu screen (not shown) or the like.

On the edit setting screen, the title character string of "edit setting" is displayed at the top, and the edit processing methods that can be executed are listed together with a check box below it. The terminal device 3 toggles and displays the presence or absence of a check according to the user's operation on each check box. In the illustrated example, "Add decorative image", "Add character image", "Add effect image", "Change time zone", "Change style", "Add sound effect", "Add background sound", " Nine items of "sound change" and "playback speed change" are shown as editable editing methods. Of these, the two items "change time zone" and "change playback speed" are not checked in the check boxes, and it is considered that the user has excluded them from the editing method.

A button labeled "OK" is provided at the bottom of the edit setting screen. When the terminal device 3 receives a touch operation, a tap operation, a click operation, or the like for the OK button, the terminal device 3 acquires the check state of the check box of each item displayed on the edit setting screen, and whether or not each edit method can be adopted. To determine. When requesting the server device 1 to edit the moving image data, the terminal device 3 transmits the setting information indicating whether or not each editing method is possible to the server device 1.

The server device 1 receives the setting information transmitted from the terminal device 3 and determines whether or not each editing method can be applied based on the received setting information. For example, the server device 1 determines the editing method by specifying from the moving image data and referring to the editing method determination table 12c based on the combination of features, but the editing method defined in the editing method determination table 12c cannot be applied. If is set to, the editing process using this editing method is not performed. In this case, the server device 1 may perform the editing process by an alternative editing method, or may not perform the editing process.

<Modification 2>
FIG. 11 is a schematic diagram for explaining the configuration of the information processing system according to the second modification. In the information processing system according to the second modification, the server device 1 acquires moving image data taken by one or more cameras 5 installed in a facility such as a theme park, an amusement park, a zoo, an event venue, or a wedding hall. .. The server device 1 extracts partial moving images from a plurality of moving image data acquired from the camera 5 and generates digest moving image data. The server device 1 transmits the generated digest moving image data to a predetermined user terminal device 3.

The server device 1 according to the second modification generates a plurality of partial moving images by extracting a scene in which the user is projected from a plurality of moving image data, for example, for a user in which a face image or the like is registered in advance. The server device 1 can generate digest moving image data obtained by performing the above-mentioned editing processing on these plurality of partial moving images and combining them. The server device 1 can transmit the generated moving image data to the user's e-mail address or the like registered together with the face image.

The embodiments disclosed this time should be considered as exemplary in all respects and not restrictive. The scope of the present invention is indicated by the scope of claims, not the above-mentioned meaning, and is intended to include all modifications within the meaning and scope equivalent to the scope of claims.

1 Server device 3 Terminal device 5 Camera 11 Processing unit 11a Moving image acquisition unit 11b Partial moving image extraction unit 11c Feature identification unit 11d Editing method determination unit 11e Editing processing unit 11f Combined processing unit 11g Edited moving image transmission unit 12 Storage unit 12a Server program 12b Feature identification model 12c Editing method determination table 13 Communication unit 31 Processing unit 31a Shooting processing unit 31b Display processing unit 31c Editing instruction reception unit 31d Video transmission unit 31e Video reception unit 32 Storage unit 32a Program 33 Communication unit 34 Display Unit 35 Operation unit 36 Camera 98,99 Recording medium 101,102 Icon

The information processing method according to one embodiment is an information processing method in which an information processing apparatus generates moving image data, and the information processing apparatus obtains moving image data taken by one or more cameras installed in a facility. From the acquired moving image data, a plurality of partial moving image data in which the registered user is projected are extracted, the features of the extracted partial moving image data are specified, and the partial moving image is described according to the specified features. There line editing processing data, combines the partial moving image data edited, the video data bound, and transmits to the registered terminal apparatus.

The information processing method according to one embodiment is an information processing method in which an information processing apparatus generates moving image data, and the information processing apparatus obtains moving image data taken by one or a plurality of cameras installed in a facility. Information that extracts a plurality of partial moving image data in which the registered user is projected from the acquired moving image data, accepts the moving image data as input, and identifies the characteristics of the scene included in the moving image data. The characteristics of the partial moving image data are specified by inputting the extracted partial moving image data into the learning model and acquiring the information output by the learning model using the learning model machine-learned to output. Then, the partial moving image data is edited based on the editing method associated with the information , the edited partial moving image data is combined, and the combined moving image data is transmitted to the registered terminal device. ..

Claims (8)

An information processing method in which an information processing device generates moving image data.
The information processing device
Get moving image data,
Identify the characteristics of the acquired moving image data and
The moving image data is edited according to the specified feature.
Information processing method. The information processing device
Identifying multiple features at the same time in the moving image data,
Editing processing is performed on the moving image data according to a combination of a plurality of specified features.
The information processing method according to claim 1. In the editing process,
Processing for superimposing a decorative image, a character image, or an effect image on the moving image data,
Processing to change the time zone of the scene included in the moving image data,
The process of changing the style of the moving image data,
Processing to add sound effects or background sounds to the moving image data,
Processing to change the sound included in the moving image data, and
Includes at least one process of changing the reproduction speed of the moving image data.
The information processing method according to claim 1 or 2. The information processing device
A plurality of partial moving image data are extracted from the moving image data, and
The editing process is performed on the extracted partial moving image data.
Combine the edited partial moving image data,
The information processing method according to any one of claims 1 to 3. The information processing device
Accepting the settings related to the editing process
Perform the editing process according to the received settings.
The information processing method according to any one of claims 1 to 4. An image that receives an instruction to execute an editing process on the moving image data is output together with the moving image data.
When the execution instruction is received, the information processing device edits the moving image data, and the information processing device edits the moving image data.
Instead of the moving image data before editing, the moving image data after editing is output.
The information processing method according to any one of claims 1 to 5.
The acquisition unit that acquires moving image data, and
A specific unit that identifies the characteristics of the moving image data acquired by the acquisition unit, and
An information processing device including an editing unit that edits the moving image data according to the features specified by the specific unit. On the computer
Get moving image data,
Identify the characteristics of the acquired moving image data and
A computer program that executes a process of editing the moving image data according to the specified features.

Images