JP2015156658A - Information processing unit, control method of the same and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing unit which facilitates specified work of a target frame different in a scene and to provide a control method of the unit and a program.

SOLUTION: A plurality of frames displayed in a display section are specified in accordance with the number of reduced images displayed in a display section from a plurality of frames constituting moving image data stored in a storage device. In a mechanism for displaying the reduced images of the plurality of specified frames in the display section, it is determined whether the frame different in a scene exists in the frames by analyzing the frame in the specified frames. When the frame different in the scene is determined to exist, the frame determined to be different is specified as the frame displayed in the display section.

COPYRIGHT: (C)2015,JPO&INPIT

Description

  The present invention relates to an information processing apparatus, a control method therefor, and a program, and more particularly to a technique for facilitating and reducing the specific work of a frame for a different purpose by a user.

  Conventionally, in a mechanism for editing a movie, in order to search for a frame of a movie to be edited, the user plays the entire movie and confirms the frame, or fast-forwards while operating the playback slider 104 or the like. , Check the frame in the video to edit.

  FIG. 1 shows an example of a conventional frame display screen 100 that displays a frame of a moving image for performing moving image editing.

  Conventionally, the user specifies a target frame while confirming one frame displayed in the moving image display area 101. For example, the user operates each object in the movie controller area 102 (movie playback stop button 103, playback slider 104 linked with the position of the frame being played back, frame return button 105, frame advance button 106) to display the moving image display area 101. While the user confirms one frame displayed on the screen, the user determines from which frame the moving image is cut out. In FIG. 1, reference numeral 107 denotes a reproduction time display area linked to the position of the frame being reproduced, and reference numeral 108 denotes a frame determination button.

  Thus, in order to specify the target frame, the user conventionally requires many operations.

  In Patent Document 1, in order to find a target video, a screen for selecting a genre is displayed, and a video of a set time, a search of a representative scene, etc. are searched from the video of the selected genre. It is described to do.

  In Patent Document 2, a plurality of frames of a predetermined time interval of a moving image are displayed on the display window, the time interval between thumbnails is changed by operating the left / right direction instruction key, and by operating the up / down direction instruction key. It is described that a plurality of thumbnails displayed on the display window can be moved and displayed (scrolled) between the display windows.

JP 09-247602 A JP 2006-279267 A

  However, although the above-mentioned patent document 1 can display a video of a set time and a searched representative scene, it is practically rare to use the searched representative scene as it is as a target frame. In practice, the user often confirms a plurality of (previous and subsequent) frames in the vicinity of the representative scene and determines them as target frames.

  Therefore, the user still has to reproduce and confirm the frames of the moving image before and after the searched representative scene, and the user can confirm the video displayed on one reproduction screen while aiming. The frame has to be specified, and the user still has to memorize the frames of the preceding and succeeding moving images and decide which frame is better, making it difficult to make the decision easily.

  In addition, as in Patent Document 2, it is possible to specify a target frame by changing the time interval between thumbnails. However, for example, when specifying a different frame in a scene, the user Still, many frames must be verified and many operations are required.

  Therefore, an object of the present invention is to identify a plurality of frames to be displayed on the display unit according to the number of reduced images to be displayed on the display unit from among a plurality of frames constituting the moving image data, In the mechanism that displays a reduced image of the frame on the display unit, the frame between the specified frames is analyzed to determine whether there is a different frame between the frames, and the frame is determined to be different and displayed. By specifying the frame to be displayed on the part, it is possible to facilitate the specification work of the target frame having a different scene, and to reduce the specification work.

  The present invention is an information processing apparatus including a storage unit that stores moving image data, and a display unit that displays a plurality of frames constituting the moving image data and a reduced image of the frame, and stores the storage unit in the storage unit Specifying means for specifying a plurality of frames to be displayed on the display unit according to the number of reduced images to be displayed on the display unit from among a plurality of frames constituting the moving image data, and a plurality of items specified by the specifying unit Display means for displaying a reduced image of the frame on the display unit; and determination means for determining whether there is a frame having a different scene between the frames by analyzing the frame between the frames specified by the specifying means; When the determination unit determines that there is a frame with a different scene between the frames, the specifying unit determines the frame determined to be different. The arm, and identifies as a frame to be displayed on the display unit.

  Further, the present invention is a method for controlling an information processing apparatus comprising storage means for storing moving image data, and a display unit that displays a plurality of frames constituting the moving image data and reduced images of the frames, A plurality of frames to be displayed on the display unit according to the number of reduced images displayed on the display unit among a plurality of frames constituting the moving image data stored in the storage unit by the specifying unit of the information processing device. A specifying step for specifying, a display step for displaying the reduced images of the plurality of frames specified in the specifying step on the display unit, and a determining unit for the information processing device Analyzing the frames between the frames identified in the process to determine whether there are frames with different scenes between the frames, and the identifying process comprises: In serial determination step, when the scene is determined to have different frames between the frame, the different between the determined frame, and identifies as a frame to be displayed on the display unit.

  The present invention also provides a program that can be read and executed by an information processing apparatus that includes a storage unit that stores moving image data, and a display unit that displays a plurality of frames constituting the moving image data and reduced images of the frames. The information processing apparatus identifies a plurality of frames to be displayed on the display unit according to the number of reduced images to be displayed on the display unit from among a plurality of frames constituting the moving image data stored in the storage unit. Identifying means, a display means for displaying a reduced image of a plurality of frames specified by the specifying means on the display unit, and analyzing a frame between the frames specified by the specifying means. It functions as a determination unit that determines whether there is a frame with a different scene. If it is determined that there is over-time, the different between the determined frame, and identifies as a frame to be displayed on the display unit.

  The present invention specifies a plurality of frames to be displayed on the display unit according to the number of reduced images to be displayed on the display unit from among a plurality of frames constituting the moving image data, and reduces the reduced images of the specified plurality of frames. In the display unit, the frame between the identified frames is analyzed to determine whether there is a different frame between the frames, and the scene is determined to be different and the frame is displayed on the display unit. By specifying as a frame, it is possible to facilitate the specification work of a target frame having a different scene, and to reduce the specification work.

It is a figure which shows the example of the conventional frame display screen. It is a figure which shows the structure of the moving image editing system in embodiment of this invention. It is a block diagram which shows the hardware constitutions of the information processing apparatus applicable to the moving image editing apparatus 202 shown in FIG. It is a figure which shows the frame display screen 400 for displaying the flame | frame of moving image data and editing moving image data in this Embodiment. FIG. 10 is a diagram for explaining transition of a thumbnail screen displayed in a thumbnail display area 408 by frame narrowing processing. It is a figure which shows the flowchart of the moving image editing process performed with the moving image editing apparatus. It is a flowchart which shows the detailed process of a frame narrowing-down process (step S609). It is a flowchart which shows the detailed process of a change process (step S610) of the number of thumbnail displays. It is a flowchart which shows the detailed process of the process of step S600. It is a figure which shows an example of a difference value thumbnail number relation table.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 2 is a diagram showing a configuration of the moving image editing system in the embodiment of the present invention.

  Note that the moving image editing system shown in FIG. 2 will be described by taking a moving image file, which is moving image data obtained by shooting a moving image with the camera 200, as an editing target. It goes without saying that data is also subject to editing.

  The moving image editing system includes a camera 200 and a moving image editing apparatus 202 which is an information processing apparatus of the present invention.

  The camera 200 is a camera (such as a digital camera or a digital video camera) that can shoot a moving image.

  A moving image file 201 photographed and generated by the camera 200 is input to a moving image editing apparatus 202 which is an information processing apparatus of the present invention.

  Then, the moving image editing apparatus 202 stores the edited moving image file 203 obtained as a result of the moving image editing process in the external memory.

  Next, the hardware configuration of the moving image editing apparatus 202 in the present embodiment will be described with reference to FIG.

  FIG. 3 is a block diagram showing a hardware configuration of an information processing apparatus applicable to the moving image editing apparatus 202 shown in FIG.

  In FIG. 3, reference numeral 301 denotes a CPU that comprehensively controls each device and controller connected to the system bus 304.

  Further, the ROM 302 or the external memory 311 is necessary to realize a BIOS (Basic Input / Output System) or an operating system program (hereinafter referred to as OS) that is a control program of the CPU 301, or a function executed by each server or each PC. Various programs to be described later are stored.

  A RAM 303 functions as a main memory, work area, and the like for the CPU 301.

  The CPU 301 implements various operations by loading a program or the like necessary for execution of processing from the ROM 302 or the external memory 311 to the RAM 303 and executing the loaded program.

  An input controller 305 controls input from a keyboard (KB) 309 or a pointing device such as a mouse (not shown).

  A video controller 306 controls display on a display device (display unit) such as a CRT display (CRT) 310. In FIG. 3, although described as CRT 310, the display device may be not only a CRT but also other display devices such as a liquid crystal display. These are used by the administrator as needed.

  A memory controller 307 is provided in an external storage device (hard disk (HD)), flexible disk (FD), or PCMCIA card slot for storing a boot program, various applications, font data, user files, editing files, various data, and the like. Controls access to an external memory 311 such as a CompactFlash (registered trademark) memory connected via an adapter.

  A communication I / F controller 308 is connected to and communicates with an external device via a network, and executes communication control processing on the network. For example, communication using TCP / IP is possible.

  Note that the CPU 301 enables display on the CRT 310 by executing, for example, outline font development (rasterization) processing on a display information area in the RAM 303. Further, the CPU 301 enables a user instruction with a mouse cursor (not shown) on the CRT 310.

  Various programs to be described later for realizing the present invention are recorded in the external memory 311 and are executed by the CPU 301 by being loaded into the RAM 303 as necessary. Further, files and various tables used at the time of executing the program are also stored in the external memory 311.

  FIG. 4 is a diagram showing a frame display screen 400 for displaying a frame of moving image data and editing the moving image data in the present embodiment.

  Here, a frame is an image that constitutes a moving image.

  A user (user) can specify a frame of moving image data (also simply referred to as a moving image) to be displayed via the frame display screen 400 using a keyboard or a mouse.

  In this embodiment, it is possible to specify both the in point (edit start point) and the out point (edit end point) of the frame, but it goes without saying that only the in point or only the out point can be specified.

  When the moving image editing apparatus 202 reads out moving image data input from the camera 200 and stored in the external memory 311, the moving image editing device 202 displays the frame display screen 400 on a display unit such as the CRT 310.

  Then, the moving image editing apparatus 202 displays the frame of the read moving image data in the moving image display area 401 in the frame display screen 400.

  Reference numeral 408 denotes a thumbnail display area, which displays the thumbnails of the frames of the read moving image whose display number is determined by processing to be described later. The thumbnail is an application example of the reduced image of the present invention. The moving image editing apparatus 202 can generate a thumbnail of the frame based on the frame of the moving image. The thumbnail used in the later description is appropriately generated based on the moving image frame and displayed in the thumbnail display area.

  When the user presses the thumbnail display increase button 410, the number of thumbnail displays can be increased (for example, it can be doubled), and when the thumbnail display decrease button 409 is pressed, the thumbnail display number is decreased. (For example, halved).

  When the scene search check box 413 is pressed, the scene search process is set to be valid, and when pressed again, the scene search process is set to be invalid. Details of these thumbnail display areas will be described later.

  When the user presses the playback button 402 using an input device such as a mouse, the video playback in the video display area 401 is started.

  Further, when the playback button 402 is pressed again during the playback of the moving image, the playback is stopped.

  When the frame return button 406 and the frame advance button 407 are pressed while playback is stopped, the frames displayed in the moving image display area can be updated and displayed in units of frames.

  If necessary, buttons such as fast forward and rewind may be provided on the frame display screen.

  A playback time slider 403 indicates the current playback time (data position of the moving image file) of the frame displayed in the moving image display area 401.

  The left end of the slider is the beginning of the moving image, the right end of the slider is the end of the moving image, and the display position of the playback time slider knob 404 is the playback time of the frame currently displayed in the moving image display area 401.

  The user can know the playback time of the moving image in the time display area 405 indicating the position of the playback time slider knob 404 and the playback time at that position, and also by moving the playback time slider knob 404 directly with the mouse, Can be changed arbitrarily.

  If the in-point button 411 or the out-point button 412 is pressed while the frame to be searched is displayed in the moving image display area 401, a mark indicating the in-point or out-point is displayed on the playback time slider 403. The

  Further, the in point or the out point can be canceled by pressing the in point button 411 or the out point button 412 again while the mark indicating the in point or the out point is displayed.

  Reference numeral 414 denotes a determination button for determining the contents in which the in point and / or the out point are set by pressing the in point button 411 and / or the out point button 412.

  Next, the moving image editing process executed by the moving image editing apparatus 202 will be described with reference to FIG.

  FIG. 6 is a flowchart of the moving image editing process executed by the moving image editing apparatus 202.

  6 is realized by the CPU 301 of the moving image editing apparatus 202 loading a program stored in a memory such as the external memory 311 into the RAM 303 and executing it.

  First, the moving image editing apparatus 202 acquires a moving image file stored in the external memory 311 and analyzes the moving image file. Then, as a result of the analysis, the number of thumbnails to be displayed in the thumbnail display area (display number) and the thumbnails to be displayed are determined, and the determined thumbnails are displayed in the thumbnail display area 408 by the determined number of thumbnails ( Step S600).

  At that time, the moving image editing apparatus 202 extracts a frame for generating a thumbnail to be displayed in the thumbnail display area 408 from the moving image file, and generates a thumbnail generated based on the extracted frame time and the extracted frame. And remember.

  Detailed processing in step S600 will be described later in detail with reference to FIG.

  Next, the moving image editing apparatus 202 displays a moving image frame corresponding to the thumbnail stored in step S600 in the moving image display area 401 (step S601). Here, in step S601, the frame at the time stored in step S600 is displayed.

  When there are a plurality of thumbnails displayed in step S600, for example, the moving image frame of the thumbnail having the earliest (playback) time among the plurality of thumbnails is displayed in the moving image display area 401.

  Here, the moving image editing apparatus 202 advances one frame when the frame advance button 407 is pressed and returns one frame when the frame return button 406 is pressed according to the operation of the keyboard, mouse, and the like by the user.

  Next, when the user wants to check thumbnails with a smaller time interval than the thumbnail displayed in the thumbnail display area 408 while maintaining the number of thumbnails displayed in the thumbnail display area 408, the thumbnail is displayed in the thumbnail display area 408. Select a thumbnail that you want to check at smaller time intervals from the multiple thumbnails that are displayed.

  When the moving image editing apparatus 202 determines that the user has selected a thumbnail from the plurality of thumbnails displayed in the thumbnail display area 408 (first receiving unit) (step 602: Yes). The frame narrowing process is executed (step S609).

  Detailed processing of the frame narrowing processing (step S609) will be described later with reference to FIG.

  When the frame narrowing process is executed, the process is returned to step S601, and the frame at the time stored by executing the frame narrowing process is displayed in the moving image display area 401 (step S601).

  When it is determined that the user has not accepted a thumbnail selection from the plurality of thumbnails displayed in the thumbnail display area 408 (step S602: NO), the video editing apparatus 202 has a thumbnail display number reduction button. It is determined whether any of the button 409 or the thumbnail display increase button 410 has been pressed by the user (step S603). That is, it is determined whether or not an instruction to change the number of thumbnails to be displayed has been received (second receiving means) according to an operation by the user. If it is determined that the button has been pressed (step 603: Yes), the thumbnail display number changing process is executed (step S610). When the thumbnail display number changing process is executed, the process returns to step S601, and the time frame stored by executing the thumbnail display number changing process is displayed in the moving image display area 401 (step S601).

Detailed processing of the thumbnail display number changing process (step S610) will be described later with reference to FIG.

  When the moving image editing apparatus 202 determines that neither the thumbnail display number decrease button 409 or the thumbnail display number increase button 410 is pressed by the user (step 603: No), the user selects the in-point button. It is determined whether or not the button 411 or the out point button 412 has been pressed (step 604). If it is determined that the button has been pressed (step 604: Yes), the time of the pressed in point or out point is stored and saved. (Step S611).

  Then, the moving image editing apparatus 202 displays the frame of the time stored in step S611 in the moving image display area 401 (step S601).

  At this time, if the in-point button 411 is pressed, the video editing apparatus 202 stores the time displayed in the time display area 405 (the time stored in step S611) as the in-point, and the playback time slider 403 A mark indicating the IN point is displayed on the position indicating the time. If the out point button 412 has been pressed, the moving image editing apparatus 202 stores the time displayed in the time display area 405 (the time stored in step S611) as the out point, and the playback time slider 403. A mark indicating the out point is displayed on the position indicating the time.

  In addition, when it is determined that the in-point button 411 or the out-point button 412 has not been pressed by the user (step 604: No), the video editing apparatus 202 determines whether the user has pressed the enter button 414. (Step 605), and if it is determined that the enter button 414 has been pressed (step 605: Yes), the currently stored time of the in point and / or the out point is changed to the edited video. The file 203 is stored as a reproduction start point and / or a reproduction end point (step S606).

  If it is determined that the user has not pressed the enter button 414 (step S605: NO), the video editing apparatus 202 returns to processing step S602 and waits for an instruction from the user.

  The moving image editing apparatus 202 edits the read moving image file 201 by cutting the reproduction start point time and / or the reproduction end point time stored in step S606. Then, an edited moving image file is generated as the playback start point and / or playback end point (step S607). Then, the moving image editing apparatus 202 stores the generated edited moving image file in the external memory (step S608).

  Next, detailed processing of the frame narrowing processing (step S609) will be described with reference to FIG.

  FIG. 7 is a flowchart showing detailed processing of the frame narrowing processing (step S609).

  7 is realized by the CPU 301 of the moving image editing apparatus 202 loading a program stored in a memory such as the external memory 311 into the RAM 303 and executing it.

  When the user presses a thumbnail at a location where the user wants to view the frame contents in more detail from among the thumbnails displayed in the thumbnail display area 408 (Yes in step 602), the video editing apparatus 202 first selects in step S700. The display of the time display area 405 is updated at the time of the thumbnail displayed. Then, with the selected thumbnail as the center, the frames within the time of the previous and subsequent thumbnails displayed in the thumbnail display area 408 are processed, and the time of the frame between the previous and subsequent thumbnails is displayed in the thumbnail display area 408. By dividing by the number of displayed thumbnails, the time interval between thumbnails displayed in the thumbnail display area 408 is calculated. Then, by dividing the frame to be processed at the calculated time interval, the time of the thumbnail of the divided frame is stored as the time of the thumbnail to be displayed in the thumbnail display area 408. The frame is also stored (step 700).

  For example, FIG. 5 will be described as an example.

  FIG. 5 is a diagram for explaining transition of the thumbnail screen displayed in the thumbnail display area 408 by the frame narrowing process.

  As shown in FIG. 5, when the user selects a thumbnail 501 as a place where the user wants to see the frame contents in more detail, the frame of the thumbnail 500 in front of the selected thumbnail displayed in the thumbnail display area 408 is displayed. And the time of the frame of the rear thumbnail 502 are obtained from the storage area in the RAM 303, and the frame of the time interval divided by the number of thumbnails is set as a new thumbnail for the moving image frame in the time range, and the thumbnail It is displayed in the display area 408. Here, for the new thumbnail, the selected thumbnail 501 is displayed at the center of the thumbnail display area 408 (thumbnail 503), and the frame of the front thumbnail 500 and the frame of the rear thumbnail 502 are not subject to thumbnails (thumbnail 504, thumbnail 505). The thumbnail display area 408 is not displayed.

  Next, the moving image editing apparatus 202 determines whether or not the scene search check box 413 is checked (step S701). If it is determined that the scene search check box 413 is checked (step 701: Yes), it is determined whether there is a frame with a different scene for each time of the thumbnail stored in step S700. If it is determined that there is a frame with a different scene, the frame used in the determination (one frame used in the determination) and the time of the frame are changed to the frame determined to have a different scene and the frame The time is replaced and stored (step S702), and the process of step S609 is terminated.

  If it is determined that the scene search check box 413 is not checked (step 701: NO), the video editing apparatus 202 ends the process of step S609.

  When the process of step S609 ends, the video editing apparatus 202 displays the thumbnails of the frames at the stored time in the thumbnail display area 408 in time series, and the process proceeds to step S601. In the time display area 405, the time of the thumbnail selected by the user is set and displayed.

  Next, in step S702, whether or not there is a frame with a different scene for each thumbnail time is determined as follows, for example.

  The moving image editing apparatus 202 extracts the frame at the thumbnail time stored in step S700 from the moving image and records it in the storage area (memory A) in the RAM 303.

  In addition, the moving image editing apparatus 202 extracts a frame as the next frame from the moving image and records it in a storage area (memory B) in the RAM 303.

  The moving image editing apparatus 202 calculates the difference between the pixel values constituting the frames stored in the memory A and the memory B, and stores the result in the storage area (memory C) of the RAM 303.

  In this embodiment, each pixel is composed of three values of R, G, and B. These values indicate the amount of each color when the original color is expressed by a mixed color of the three primary colors of red, green, and blue. Yes.

  When one pixel taken out from the memory A is (Ra, Ga, Ba) and one pixel taken out from the memory B at the same position is (Rb, Gb, Bb), one pixel (Rc, Gc) in the same position in the memory C , Bc) is calculated as (Ra-Rb, Ga-Gb, Ba-Bb).

  This calculation is repeated for all the pixels included in the memory A and the memory B.

  When the difference between the images stored in the memory C is smaller than a certain threshold, the moving image editing apparatus 202 moves the image in the storage area (memory B) to the storage area (memory A) and becomes the next frame. The frame image is taken out and recorded in a storage area (memory B) in the RAM 303.

  The moving image editing apparatus 202 performs the calculation of the difference amount and the process of checking the threshold between thumbnail times. When it is determined that the amount of image difference is greater than a certain threshold, a thumbnail at a time closest to the time of the scene is replaced as a different scene.

  In the present embodiment, the pixel is configured by three values of R, G, and B. However, this is an example, and other color expression formats can be used. Even when another color expression method is used, the difference between pixel values can be calculated by a method similar to the present embodiment. Therefore, the present invention can be implemented even when a color expression format other than the three values of R, G, and B is used.

  The CPU 301 displays the thumbnails recorded in the storage area in the RAM 303 in the thumbnail display area 408, and the moving image display area 401 displays the time frame displayed in the time display area 405.

  Next, detailed processing of the thumbnail display number changing process (step S610) will be described with reference to FIG.

  FIG. 8 is a flowchart showing a detailed process of the thumbnail display number changing process (step S610).

  8 is realized by the CPU 301 of the moving image editing apparatus 202 loading a program stored in a memory such as the external memory 311 into the RAM 303 and executing it.

  The video editing apparatus 202 determines whether or not the user has pressed the thumbnail display increase button 410 (step S800), and determines that the thumbnail display increase button 410 has been pressed (step S800: Yes). Then, the time that is intermediate between the times of the thumbnails displayed in the thumbnail display area 408 and the thumbnail at the time are stored (step S801), and the process proceeds to step S802.

  On the other hand, if it is determined that the thumbnail display increase button 410 has not been pressed (step S801), the moving image editing apparatus 202 moves the process to step S802.

  Next, the video editing apparatus 202 determines whether or not the thumbnail display number decrease button 409 has been pressed by the user (step S802), and if it is determined that the thumbnail display number decrease button 409 has been pressed (step S802: In (Yes), the even-numbered (or odd-numbered) thumbnails are deleted from the stored times of the thumbnails displayed in the thumbnail display area 408 (step S803), and the process proceeds to step S804. .

  Here, the even number (or odd number) is a number indicating whether the number of the thumbnail displayed in the thumbnail display area 408 is even or odd. For example, six thumbnails are displayed in the thumbnail display area 408 in FIG. 4, but the first, second, third, fourth, fifth, etc. from the thumbnail displayed on the leftmost side of the thumbnail display area 408. , No. 6 is stored together with each time, and among these, even numbered thumbnails (No. 2, No. 4, No. 6) and each thumbnail time are deleted or odd numbered (No. 1, (No. 3 and No. 5) and the time of each thumbnail are deleted.

  If it is determined that the thumbnail display number reduction button 409 has not been pressed (step S802: NO), the moving image editing apparatus 202 proceeds to step S804.

  Next, the video editing apparatus 202 determines whether or not the scene search check box 413 is checked (step S804). If it is determined that the scene search check box 413 is checked (step 804: Yes), it is currently stored. It is determined whether there is a frame with a different scene between the times of the thumbnails, and if it is determined that there is a frame with a different scene, the frame used in the determination (one frame used in the determination) and The time of the frame is replaced with the frame determined to have a different scene and the time of the frame (step S805), and the process of step S610 is terminated. The processing in step S805 determines whether or not the scene is different in the same manner as in step 702 and replaces it.

  If it is determined that the scene search check box 413 is not checked (step 804: NO), the moving image editing apparatus 202 ends the process of step S610.

  Then, when the moving image editing apparatus 202 ends the process of step S610, the moving image editing apparatus 202 proceeds to step S601.

  In addition, the user may want to return the frame display screen 400 to the state before the thumbnail is pressed, to select a different thumbnail, or to return to the state before changing the number of thumbnails displayed. A “return” button or the like for returning to the frame display screen 400 in a state before being selected may be added to the frame display screen 400.

  Next, detailed processing of the processing in step S600 will be described with reference to FIG.

  FIG. 9 is a flowchart showing detailed processing of step S600.

  The processing of each step shown in FIG. 9 is realized by the CPU 301 of the moving image editing apparatus 202 loading a program stored in a memory such as the external memory 311 into the RAM 303 and executing it.

  First, the moving image editing apparatus 202 acquires a moving image file (moving image data) that is captured and generated by the camera 200 and stored in the external memory 311, and extracts all frames from the moving image data (moving image). (Step S900). In step S900, if the playback time (or the total number of frames) of the acquired moving image is equal to or longer than the predetermined time (or the predetermined number of frames), not all frames are extracted, but frames at predetermined intervals are extracted. Also good.

  Next, the moving image editing apparatus 202 repeatedly executes the processing from step S902 to step S903 until it finishes executing all the frames extracted in step S900.

  First, the pixel difference between the frames extracted in step S900 is calculated (step S902).

  Here, an example of a method for calculating the pixel difference (value) between frames in step S902 will be described.

  The moving image editing apparatus 202 records the currently processed frame in a storage area (memory A) in the RAM 303.

  In addition, the moving image editing apparatus 202 records a frame as a next frame in a storage area (memory B) in the RAM 303.

  The moving image editing apparatus 202 calculates the difference between the pixel values constituting the frames stored in the memory A and the memory B, and stores the result in the storage area (memory C) of the RAM 303.

  In this embodiment, each pixel is composed of three values of R, G, and B. These values indicate the amount of each color when the original color is expressed by a mixed color of the three primary colors of red, green, and blue. Yes.

  When one pixel taken out from the memory A is (Ra, Ga, Ba) and one pixel taken out from the memory B at the same position is (Rb, Gb, Bb), one pixel (Rc, Gc) in the same position in the memory C , Bc) is calculated as (Ra-Rb, Ga-Gb, Ba-Bb).

  This calculation is repeated for all the pixels included in the memory A and the memory B. Then, the difference value of the pixel value of the frame calculated by repeatedly calculating all the pixels is calculated as the difference (value) of the pixel between frames.

  Next, the pixel differences (values) between frames calculated in step S903 are accumulated and stored in the memory as accumulated difference values.

  Then, in order to process the frame of the next frame, the image (frame) currently stored in the storage area (memory B) is moved to the storage area (memory A). Are stored in a storage area (memory B) in the RAM 303, and a difference between pixel values constituting the frame is calculated.

  Next, when the moving image editing apparatus 202 executes the processing of step S902 and step S903 for all the frames extracted in step S900, in step S905, the moving image editing apparatus 202 corresponds to the accumulated difference value stored in step S903. Then, the number of thumbnails to be displayed (the number of thumbnails) to be displayed in the thumbnail display area 408 is determined (step S905).

  In step S905, the thumbnail display number (thumbnail number) to be displayed in the thumbnail display area 408 is determined using the difference value thumbnail number relation table shown in FIG. 10 stored in the external memory 311.

  FIG. 10 is a diagram illustrating an example of the difference value thumbnail number relation table.

  The difference value thumbnail number relation table includes items of “difference between frames” and “number of thumbnails to be displayed”. The “difference between frames” stores a range of accumulated difference values. The “number of thumbnails to be displayed” defines the number of thumbnails displayed in the thumbnail display area 408.

  In the example of FIG. 10, “difference value 1 between frames” is stored as the range of accumulated difference values.

If the accumulated difference value stored in step S903 is a value within the accumulated difference value within the range defined by “difference value between frames 1”, the number of thumbnails displayed in the thumbnail display area 408 is three. Indicates that it will be decided.

  In step S905, referring to the difference value thumbnail number relation table (FIG. 10), the number of thumbnails displayed (thumbnail number) to be displayed in the thumbnail display area 408 according to the accumulated difference value accumulated and stored in step S903. decide.

  Then, the moving image editing apparatus 202 sets a value obtained by dividing the total reproduction time of the moving image file acquired from the external memory 311 by the number of thumbnails determined in step S905 as a time interval between thumbnails displayed in the thumbnail display area 408. Then, the frame of the time interval and the time of the frame are stored (step S906), whereby the thumbnails can be displayed in the thumbnail display area 408 at equal intervals among all the frames of the moving image file.

  Next, the moving image editing apparatus 202 determines whether or not to perform a scene search with reference to setting information that is preset by the user and that indicates whether or not to perform a scene search (step S907). This setting information is stored in the memory.

  If it is determined that a scene search is to be performed (step S907: YES), the moving image editing apparatus 202 performs a scene search using the frame at the time stored in step S906 as a processing target (step S908). Specifically, it is determined whether there is a frame with a different scene between the thumbnail times stored in step S906. If it is determined that there is a frame with a different scene, the frame ( One frame used in the determination) and the time of the frame are replaced with the frame determined to have a different scene and the time of the frame (step S908), and the process proceeds to step S909.

  Here, since the process of step S908 determines whether or not there is a frame with a different scene by the same method as step S702 described above, the description thereof is omitted here.

  If it is determined in step 907 that no scene search is performed (step S907: NO), the process proceeds to step S909.

  In step S909, the thumbnails of the frames at the stored time are displayed in the thumbnail display area 408 in chronological order, and the moving picture frame of the thumbnail having the earliest (playback) time is displayed in the moving picture display area 401. At this time, the time display area 405 displays the earliest time among the times of the thumbnail frames displayed in the thumbnail display area 408.

  Then, when the moving image editing apparatus 202 executes the process of step S909, the moving image editing apparatus 202 executes the process of step S601 of FIG.

  As described above, according to the present embodiment, a frame search can be performed only by narrowing down frames from thumbnails. The frame you want to search exists in various positions depending on the content of the movie, but you can select from the first half, middle, or second half of the entire movie, and you can also select thumbnails from the selected thumbnail range to the required place. You can search. Therefore, while maintaining the simple operability that was the advantage of the conventional method, it is possible to search for a certain frame in a short time and with a simple operation from the grasp of the whole movie, which was difficult with the conventional method. It becomes.

  Next, by selecting and pressing one of the thumbnails, a thumbnail of a frame at a time interval obtained by dividing the time interval of the previous and subsequent thumbnails by the number of thumbnails is displayed centering on the thumbnail. By repeating this operation, it is possible to narrow down the range and search for frames with more detailed time intervals.

  Furthermore, a scene search check box is added, and when this check box is checked, frames corresponding to the number of thumbnails for which the scene is largely switched are detected and displayed from the time interval between the previous and next thumbnails. As a result, it is possible to easily search for a position where a frame is switched even at a place where similar frames are continued.

As described above, according to the present embodiment, the plurality of frames to be displayed on the display unit are identified according to the number of reduced images to be displayed on the display unit from among the plurality of frames constituting the moving image data. In the mechanism for displaying reduced images of a plurality of frames on the display unit, the frames between the specified frames are analyzed to determine whether there are frames with different scenes between the frames, and the frames that are determined to have different scenes. By specifying the frame as a frame to be displayed on the display unit, it is possible to facilitate the identification work of a target frame having a different scene and reduce the identification work.

The embodiment of the present invention has been described in detail above. However, the present invention can take an embodiment as a system, an apparatus, a method, a program that can be read and executed by the apparatus, a storage medium, or the like. In addition, the present invention may be applied to a system composed of a plurality of devices, or may be applied to an apparatus composed of a single device.

Another object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the above-described embodiments to a system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores the storage medium. Needless to say, this can also be achieved by reading and executing the program code stored in.

In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program code itself and the storage medium storing the program code constitute the present invention.

As a storage medium for supplying the program code, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (basic system or operating system) running on the computer based on the instruction of the program code. Needless to say, a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.

Further, after the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function is determined based on the instruction of the program code. It goes without saying that the CPU or the like provided in the expansion board or function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

200 Camera 201 Movie 202 Movie Editing System 203 Movie after Editing

Claims (7)

An information processing apparatus comprising storage means for storing moving image data, and a display unit that displays a plurality of frames constituting the moving image data and reduced images of the frames,
A specifying unit for specifying a plurality of frames to be displayed on the display unit according to the number of reduced images to be displayed on the display unit from among a plurality of frames constituting the moving image data stored in the storage unit;
Display means for displaying a reduced image of a plurality of frames specified by the specifying means on the display unit;
Determining means for determining whether there is a frame with a different scene between the frames by analyzing a frame between the frames specified by the specifying means;
With
When the determining unit determines that there is a frame having a different scene between the frames, the specifying unit specifies the frame determined to be different as a frame to be displayed on the display unit. Information processing apparatus. A calculation for calculating a difference value indicating a difference between a pixel value of a frame between frames specified by the specifying unit and a pixel value of a frame between other frames of the frame and the frame specified by the specifying unit. Further comprising means,
The information processing apparatus according to claim 1, wherein the determination unit determines whether there is a frame having a different scene between the frames specified by the specifying unit according to the difference value calculated by the calculation unit. . A determination unit that determines the number of reduced images to be displayed on the display unit according to the difference value calculated by the calculation unit;
The specifying unit specifies a plurality of frames to be displayed on the display unit from a plurality of frames constituting the moving image data stored in the storage unit according to the number of reduced images determined by the determining unit. The information processing apparatus according to claim 1 or 2. A first accepting means for accepting selection of the reduced image displayed on the display means according to an operation by the user;
The specifying means further includes, among the reduced images displayed by the display means, a frame between frames with respect to the reduced images before and after the reduced image received by the first receiving means. The information processing apparatus according to claim 1, wherein a plurality of frames to be displayed on the display unit are specified according to the number of reduced images to be displayed. A second accepting unit for accepting an instruction to change the number of reduced images to be displayed on the display unit according to an operation by the user;
The specifying means further includes:
A plurality of frames to be displayed on the display unit are specified from among a plurality of frames constituting the moving image data stored in the storage unit according to the number of reduced images received by the second receiving unit. The information processing apparatus according to any one of claims 1 to 4. A control method for an information processing apparatus comprising storage means for storing moving image data, and a display unit for displaying a plurality of frames constituting the moving image data and a reduced image of the frames,
A plurality of frames to be displayed on the display unit according to the number of reduced images displayed on the display unit among a plurality of frames constituting the moving image data stored in the storage unit by the specifying unit of the information processing device. A specific process to identify;
A display step in which the display unit of the information processing apparatus displays a reduced image of a plurality of frames specified in the specifying step on the display unit;
A determination step of determining whether there is a frame having a different scene between the frames by analyzing a frame between the frames specified in the specifying step;
With
In the determining step, when it is determined in the determining step that there is a frame having a different scene between the frames, the frame determined to be different is specified as a frame to be displayed on the display unit. Control method for information processing apparatus. There is a program that can be read and executed by an information processing apparatus that includes a storage unit that stores moving image data, and a display unit that displays a plurality of frames constituting the moving image data and a reduced image of the frame,
The information processing apparatus;
A specifying unit for specifying a plurality of frames to be displayed on the display unit according to the number of reduced images to be displayed on the display unit from among a plurality of frames constituting the moving image data stored in the storage unit;
Display means for displaying a reduced image of a plurality of frames specified by the specifying means on the display unit;
By analyzing the frames between the frames specified by the specifying means, it functions as a determining means for determining whether there is a different frame between the frames,
When the determining unit determines that there is a frame having a different scene between the frames, the specifying unit specifies the frame determined to be different as a frame to be displayed on the display unit. Program to do.

Images