JP2013126113A - Information processor, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To extract images of a scene having an impact, a distinctive scene, etc. from a moving image and gather the images, thereby providing a mechanism which enables a user to grasp the content of the moving image at a glance.SOLUTION: In advance of extracting still images from the moving image, this information processor accepts selection of a template having data to be considered to extract the still images set therein, and extracts the still images on the basis of extraction conditions set in the selected template, from the moving image as the target of the extraction of the still images.

Description

  The present invention relates to a technique for extracting a still image from a moving image.

  In addition to the large amount of data in the conventional moving image, there is a problem that the computer processing capacity, the recording medium capacity, and the transfer performance are insufficient, and image quality has been sacrificed in order to reduce the data capacity of the moving image. This can be confirmed by looking at the image when the video is stationary, since the image quality is considerably poor.

  However, in recent years, in addition to advances in video compression technology, each processing capability has also improved, eliminating traditional problems. As a result, even if the image of one scene when the moving image is stopped is seen as a photograph, the quality is comparable.

  Digital video cameras can shoot movies for a long time, but in addition to this, it has become an environment that can shoot movies with digital cameras, mobile phones, and smartphones.

  In this way, it has become an environment where high-quality video can be shot easily, but unlike photos, it is difficult to grasp the contents at a glance, and it is necessary to play the entire video, and it takes a lot of time. Resulting in. For this reason, once a video is taken, it will continue to accumulate on the recording medium without being watched many times, except for those that have a lot of impact and content to be conveyed.

  Patent Document 1 describes a technique for cutting out frames in moving image data as still image data.

JP 2008-160171 A

  SUMMARY OF THE INVENTION An object of the present invention is to provide a mechanism capable of grasping the contents of a moving image at a glance by extracting images such as a scene with impact and a characteristic scene from the moving image and collecting the images.

  The present invention includes a moving image data input unit that receives input of moving image data, a still image extraction instruction receiving unit that receives an instruction to extract a still image from moving image data input by the input unit, and the moving image data input unit. A template setting receiving unit that receives a template setting in which an extraction condition for extracting a still image from a moving image is set, and a still image that extracts a still image from the moving image using the template received by the template setting receiving unit And an extracting means.

  The present invention is also an information processing method in an information processing apparatus, wherein the moving image data means of the information processing apparatus receives a moving image data input step, and the still image extraction instruction reception means of the information processing apparatus. However, the still image extraction instruction receiving step for receiving an instruction to extract a still image from the moving image data input in the input step, and the template setting receiving unit of the information processing apparatus A template setting receiving step for receiving a template setting in which an extraction condition for extracting a still image is set, and a moving image using the template received by the still image extracting unit of the information processing apparatus by the template setting receiving step. A still image extraction step of extracting a still image from the image.

  The present invention is also a program executable in an information processing apparatus, wherein the information processing apparatus extracts a still image from moving image data input means for receiving input of moving image data and moving image data input by the input means. A still image extraction instruction receiving unit that receives an instruction to perform, a template setting receiving unit that receives setting of a template in which an extraction condition for extracting a still image from a moving image input by the moving image data input unit is set, and the template setting It is characterized by functioning as a still image extracting unit that extracts a still image from a moving image using a template whose setting is received by the receiving unit.

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to provide the structure which can grasp | ascertain the content of a moving image at a glance.

It is a figure which shows an example of a structure of the information processing system of this invention. It is a figure which shows an example of the hardware constitutions of the information processing apparatus 101 of FIG. 4 is a flowchart illustrating album creation processing performed by the information processing apparatus 101 according to the embodiment of this invention. 4 is a flowchart illustrating album creation processing performed by the information processing apparatus 101 according to the embodiment of this invention. 5 is a flowchart illustrating a photo change process performed by the information processing apparatus 101 in the embodiment of the present invention. It is a figure which shows an example of a template setting screen. It is a figure which shows an example of a text setting screen. It is a figure which shows an example of a photo album preview screen. It is a figure which shows an example of a photograph change setting screen. It is a figure which shows an example of a template table. It is a figure which shows an example of a text information table.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram showing an example of a system configuration of an information processing system according to the present invention.

  As illustrated in FIG. 1, in the information processing system according to the present embodiment, an information processing apparatus 101, a server apparatus 102, and a camera 103 are connected via a network 104 so as to be able to communicate with each other.

  The information processing apparatus 101 acquires data captured by the camera 103. Further, the data photographed by the camera 103 may be stored once in the server apparatus 102, and the information processing apparatus 101 may acquire the data stored in the server apparatus 102.

  Further, in the present invention, it is only necessary that the information processing apparatus 101 can acquire data captured by the camera, and it is not necessary to be connected to be communicable.

  Hereinafter, each apparatus which comprises the information processing system of this invention is demonstrated.

  Hereinafter, an example of the hardware configuration of the information processing apparatus 101 illustrated in FIG. 1 will be described with reference to FIG.

  In FIG. 2, reference numeral 201 denotes a CPU that comprehensively controls each device and controller connected to the system bus 204. Further, the ROM 203 or the external memory 211 is necessary to realize a BIOS (Basic Input / Output System) or an operating system program (hereinafter referred to as an OS), which is a control program of the CPU 201, or a function executed by each server or each PC. Various programs are stored.

  A RAM 202 functions as a main memory, work area, and the like for the CPU 201. The CPU 201 implements various operations by loading a program necessary for execution of processing from the ROM 203 or the external memory 211 into the RAM 202 and executing the loaded program.

  An input controller 205 controls input from the input device 209 or the like. A video controller 206 controls display on a display device 210 such as a liquid crystal display. The display device is not limited to a liquid crystal display, and may be a CRT display or the like. These are used by clients as needed.

  A memory controller 207 is connected to the hard disk (HD), flexible disk (FD), or PCMCIA card slot for storing a boot program, various applications, font data, user files, editing files, various data, etc. via an adapter. The access to the external memory 211 such as a compact flash (registered trademark) memory is controlled.

  A communication I / F controller 208 connects and communicates with an external device via a network (for example, the LAN 400 shown in FIG. 1), and executes communication control processing in the network. For example, communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the display device 210 by executing outline font rasterization processing on a display information area in the RAM 202, for example. Further, the CPU 201 enables a user instruction with a mouse cursor (not shown) on the display device 210.

  Various programs that operate on the hardware are recorded in the external memory 211 and are executed by the CPU 201 by being loaded into the RAM 202 as necessary.

  It should be noted that not all devices have these configurations, and it is only necessary to provide necessary devices.

  Next, the album creation processing performed by the information processing apparatus 101 in the embodiment of the present invention will be described with reference to FIGS.

  3 and 4 is a process in which the CPU 201 of the information processing apparatus 101 reads and executes a predetermined control program.

  In step S301, the CPU 201 of the information processing apparatus 101 receives a selection of a moving image to be used as a photo album from a user via a screen (not shown).

  In step S302, the CPU 201 of the information processing apparatus 101 displays a template setting screen (FIG. 6) for setting a photo album template, and accepts a template selection from the user. The template selected here determines a criterion for determining what kind of photograph is extracted (what kind of element is taken into consideration in extracting the photograph). Specifically, it is registered in the table shown in FIG.

  In step S303, the CPU 201 of the information processing apparatus 101 displays a text setting screen (FIG. 7) for setting information to be displayed in the text area of the photograph, and accepts setting of text information from the user. The text data to be added is determined based on information registered in the table shown in FIG. It should be noted that the original moving image data is recorded with data necessary to be added as text, such as position information. If no data is recorded, the setting of the text related to the data may not be accepted.

  In step S304, the CPU 201 of the information processing apparatus 101 determines whether an instruction to create a photo album has been received from the user.

  Specifically, the instruction is accepted by pressing the OK button 704 in FIG.

  If a photo album creation instruction has been received from the user (step S304: YES), the process proceeds to step S305.

  If the creation instruction has not been received, the process of this flowchart is terminated.

  In step S305, the CPU 201 of the information processing apparatus 101 executes photo album creation processing. Details of the processing in step S305 will be described later with reference to the flowchart of FIG.

  Next, a photo album creation process will be described with reference to FIG.

  In step S401, the CPU 201 of the information processing apparatus 101 extracts a scene (still image) from the moving image based on the information on the template selected in step S302. As a condition for extraction here, extraction is performed based on position information, shooting direction, smile recognition, and the like registered in the table of FIG.

  In step S402, the CPU 201 of the information processing apparatus 101 narrows down the scene extracted in step S401 based on the shooting information. Here, when narrowing down, it narrows down based on information such as focus, zoom, and composition.

  In step S403, the CPU 201 of the information processing apparatus 101 further narrows down the scene narrowed down in step S402 based on audio information and the like.

  In step S404, the CPU 201 of the information processing apparatus 101 displays a photo album preview screen (FIG. 8).

  In step S405, the CPU 201 of the information processing apparatus 101 determines whether a photo change instruction has been received (whether the change button 802 has been pressed).

  If a change instruction has been received (step S405: YES), the process proceeds to step S407.

  If the change instruction has not been received (step S405: NO), the process proceeds to step S406.

  In step S406, the CPU 201 of the information processing apparatus 101 determines whether or not the confirm button has been pressed.

  If the confirm button is pressed (step S406: YES), the process of this flowchart is terminated. This completes the photo album. In this photo album, characteristic scenes of the video data will be collected, so it is possible to grasp the contents easily (without taking time) without playing back all the video data. Become.

  If the confirm button 803 is not pressed (step S406: NO), the process returns to step S405 and waits for an instruction from the user.

  In step S407, the CPU 201 of the information processing apparatus 101 executes photo change processing. Details of the processing in step S407 will be described later with reference to the flowchart of FIG.

  Next, a photo change process performed by the information processing apparatus 101 in the embodiment of the present invention will be described with reference to FIG.

  Note that the processing shown in the flowchart of FIG. 5 is processing in which the CPU 201 of the information processing apparatus 101 reads and executes a predetermined control program.

  When the selection of a photo album including a photo to be changed is received from the user, the CPU 201 of the information processing apparatus 101 displays a photo change screen (FIG. 9) for setting a photo to be changed in step S501.

  Here, on the photo change screen, scenes that are narrowed down from the original moving image data to a certain range before and after the change target photo are displayed centering on the change target photo (903).

  In step S502, the CPU 201 of the information processing apparatus 101 determines whether a new scene has been set by the user.

  If a new scene is set by the user (step 502: YES), the process proceeds to step S503.

  If a new scene has not been set by the user (step S502: NO), the processing shown in this flowchart ends.

In step S503, the CPU 201 of the information processing apparatus 101 replaces the change target photograph with the new scene set in step S502. Then, the process shown in this flowchart is terminated.
Next, the template setting screen shown in FIG. 6 will be described.

  The template setting screen shown in FIG. 6 is a screen displayed in step S302.

  Reference numeral 601 denotes an area for receiving selection of which template to use from the user. The method for extracting a photo from a moving image differs depending on the template selected here. Information for extracting a photo is set in the table shown in FIG. 10, and the photo is extracted from the moving image according to the information. For example, when a domestic travel template is selected, a photo is extracted based on the position information and the surrounding information.

  In addition, when an athletic meet template is selected, a photo is extracted in consideration of information and voice volume by face recognition.

  Reference numeral 602 denotes a preview screen that displays what kind of photo is extracted. The user can determine which template should be selected with reference to the photograph displayed in the area 602.

  Reference numeral 603 denotes a cancel button for canceling the setting, and reference numeral 604 denotes a button for confirming the setting.

  Next, FIG. 7 will be described. The screen shown in FIG. 7 is a text setting screen. This is a screen for setting what kind of comment (text) is added or displayed for each photo.

  Reference numeral 701 denotes an area for accepting selection of what kind of text to add. For example, when a date is selected, the date when the image was taken is added.

  What information is added is set in the table shown in FIG.

  Further, instead of information set in advance, a comment input by the user may be received and the comment may be added.

  Reference numeral 702 denotes a photo preview area to which a comment is added.

  Reference numeral 703 denotes a cancel button for canceling the setting, and reference numeral 704 denotes a button for confirming the setting.

  Next, FIG. 8 will be described. The screen shown in FIG. 8 is a photo album preview screen. On the screen for confirming the created photo album, an instruction to change the photo in the photo album is received from the user.

  Reference numeral 801 denotes a preview area of the created photo album, and album pages can be switched by a controller at the bottom. The numerical value on the lower right indicates the total number of pages and the currently displayed page number.

Reference numeral 802 denotes a button for accepting a photo change. When the change button is pressed, the screen shown in FIG. 9 is displayed, and the process shown in FIG. 5 is executed.
Reference numeral 803 denotes a button for confirming the created photo album.

  Next, FIG. 9 will be described. The screen shown in FIG. 9 is a screen for changing the photo of the created photo album.

  Reference numeral 901 denotes a moving image preview area. This is an area for reproducing the original moving image of the photo album selected as including the photo to be changed. Playback / stop / position control is possible with the controller at the bottom.

  Reference numeral 902 denotes a photo album preview area. By accepting selection from the user for the photo displayed here, selection of the photo to be changed is accepted.

  The photo selected as the change target is displayed so as to be distinguishable from other photos (for example, a photo frame is highlighted).

  The page of the album can be switched by the controller at the bottom.

Note that when the page is switched, the selection as a change target may be cleared.
Reference numeral 903 denotes an area where a change candidate photo is displayed.

  From the position in the moving image of the photo selected as the change target, the extraction process is executed again for the preceding and succeeding scenes. The photos extracted by the extraction process are displayed as change candidate photos in this area.

  When one of the change candidate photos is selected by the user, a display that can be distinguished from other photos, such as a frame of the selected photo is highlighted.

  Further, the position of the controller of the moving image preview 901 is controlled in conjunction with the selected photo, and the moving images before and after the scene are displayed.

  The highlighting of the photo frame is canceled when the playback or position is changed in the video preview. Further, since the change target is also released when the page is switched in 902, the display here is also released.

  Reference numeral 904 denotes a button for changing the photo to be changed to the photo selected in 903.

  Reference numeral 905 denotes a cancel button that accepts an instruction to cancel all changes. Reference numeral 906 denotes an instruction button for confirming all changes.

  With the above processing, it is possible to provide a mechanism that can grasp the contents of a moving image at a glance.

  It should be noted that the configuration and contents of the various data described above are not limited to this, and it goes without saying that the various data and configurations are configured according to the application and purpose.

  Moreover, the program in this invention is a program which a computer can perform the processing method of FIGS. The program in the present invention may be a program for each processing method of each apparatus in FIGS.

  As described above, a recording medium that records a program that implements the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by reading and executing.

  In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium recording the program constitutes the present invention.

  As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, nonvolatile memory card, ROM, EEPROM, silicon A disk or the like can be used.

  Further, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on an instruction of the program is actually It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the processing and the processing is included.

  Furthermore, after the program read from the recording medium is written to the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is based on the instructions of the program code. It goes without saying that the case where the CPU or the like provided in the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  The present invention may be applied to a system constituted by a plurality of devices or an apparatus constituted by a single device. Needless to say, the present invention can be applied to a case where the present invention is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

  Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network using a communication program, the system or apparatus can enjoy the effects of the present invention. In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

101 Information processing apparatus 102 Server apparatus 103 Camera 104 Network

Claims (4)

Video data input means for receiving input of video data;
A still image extraction instruction receiving means for receiving an instruction to extract a still image from the moving image data input by the input means;
Template setting accepting means for accepting setting of a template in which extraction conditions for extracting still images from the moving picture input by the moving picture data input means are set;
A still image extracting means for extracting a still image from a moving image using a template whose setting is received by the template setting receiving means;
An information processing apparatus comprising: A change target receiving means for receiving selection of a still image to be changed among the still images extracted by the still image extracting means;
The still image extracting means re-extracts a still image as a change candidate from the moving image data,
2. The information according to claim 1, wherein the still image re-extracted by the still image extracting unit replaces the still image that has been selected by the user with the still image that has been selected by the change target receiving unit. Processing equipment. An information processing method in an information processing apparatus,
A moving image data input step in which the moving image data means of the information processing apparatus receives input of moving image data;
A still image extraction instruction receiving unit of the information processing apparatus for receiving an instruction to extract a still image from the moving image data input in the input step;
A template setting receiving step in which the template setting receiving means of the information processing apparatus receives a template setting in which an extraction condition for extracting a still image from the moving image input by the moving image data input step is set;
A still image extracting step in which the still image extracting means of the information processing apparatus extracts a still image from a moving image using the template whose setting is received in the template setting receiving step;
An information processing method comprising: A program executable in the information processing apparatus,
The information processing apparatus;
Video data input means for receiving input of video data;
A still image extraction instruction receiving means for receiving an instruction to extract a still image from the moving image data input by the input means;
Template setting accepting means for accepting setting of a template in which extraction conditions for extracting still images from the moving picture input by the moving picture data input means are set;
An information processing apparatus that functions as a still image extraction unit that extracts a still image from a moving image using a template whose setting is received by the template setting reception unit.

Images