JP2019102943A - Information processing device, control method thereof, and program - Google Patents

Abstract

To provide a mechanism for efficiently setting an IN-point or an OUT-point for editing moving image data.SOLUTION: An information processing device identifies time or frame in which a person has framed in from moving image data in which the person is captured, and identifies time or frame in which the person has started speaking from the moving image data. Next, an IN-point for editing the moving image data is set at a position specified on basis of the time or frame at which the person has started speaking. Then, images of the frames to the frame in which the person has started speaking from the frame in which the person has framed in are analyzed, and the analyzed result is notified.SELECTED DRAWING: Figure 5

Description

  The present invention relates to an information processing apparatus, a control method of the information processing apparatus, and a program, and more particularly to a mechanism for efficiently setting an in point or an out point for editing moving picture data.

  Conventionally, in order to cut out a part of a moving image from moving images, the user manually inputs and specifies the cutout position of the moving image while checking the video of the moving image, and performs the cutout process, and the work is It was complicated.

  Patent Document 1 describes that a user manually inputs and designates a cutting start time and a cutting end time from an operation key while confirming a series of moving pictures, and performs a cutting process from moving picture data.

JP, 2010-178010, A

  For example, a service may be considered that generates animation data for each student as a student's graduation album. For example, in such a service, in order to shoot a plurality of students efficiently, one camera starts shooting, student A enters the shooting range of the camera, says a single comment, and then the students As A goes out of the shooting range and the next student B enters the shooting range of the camera and says a single comment without stopping shooting, one moving image file including moving images of each student is generated Cases are conceivable.

  That is, it is conceivable that one camera continuously shoots each student who turns into a shooting range and a plurality of students alternately enter a shooting range and says a single comment, and generates one moving image file including moving images of each student. .

  Conventionally, in order to cut out a moving image file in which the student is shown from each moving image file obtained by photographing in this manner, the user checks the video of the one moving image file, It was necessary to manually enter and specify the start time and end time of the cut, and the work was complicated. In addition, at that time, the user also checks a video (a video in which a student is not shown) when a plurality of students are replaced, and it has been difficult to perform the cutting work efficiently.

  Therefore, an object of the present invention is to provide a mechanism for efficiently setting an in point or an out point for editing moving image data.

  The present invention is a first specifying means for specifying a time or frame in which a person framed in video data in which a person is photographed, and a second specifying means for specifying a time or frame in which a person starts speaking from the moving image data Specifying means, setting means for setting an in point for editing moving image data at a position specified based on a time or frame specified by the second specifying means, and a person specified by the first specifying means Providing analysis means for analyzing an image of a frame from a frame framed in to a frame at which the person specified by the second identification means starts speaking, and notification means for notifying an analysis result by the analysis means It features.

  Further, the present invention is a control method of an information processing apparatus including a first specifying means for specifying a time or a frame at which a person enters a frame out of moving image data in which a person is photographed. A second identification step of identifying a time or frame at which the speaker started speaking, a setting step of setting an in point for editing moving image data at a position identified based on the time or frame identified in the second identification step An analysis step of analyzing an image of a frame from a frame in which a person identified by the first identification means enters a frame to a frame where the person identified in the second identification step starts talking; analysis results in the analysis step And a notifying step of notifying.

  Further, the present invention is a program that can be read and executed by an information processing apparatus including first specifying means for specifying a time or a frame at which a person enters a frame from moving image data in which a person is photographed, the information processing apparatus Editing the moving image data at a position specified based on the time or frame specified by the second specifying means, and a second specifying means for specifying a time or frame when a person starts speaking from the moving image data Analyzing the image of the frame from the frame in which the person identified by the first identifying means to the setting means for setting the in point for the frame, to the frame in which the person identified by the second identifying means started speaking It is characterized in that it functions as an analysis means to perform, and a notification means to notify an analysis result by the analysis means.

  Further, according to the present invention, a first specifying means for specifying a time or frame in which a person framed out of moving image data in which a person was photographed, and a time or frame in which the person ended speaking from the moving image data Second specifying means, setting means for setting an out point for editing moving image data at a position specified based on the time or frame specified by the second specifying means, and specified by the second specifying means Analysis means for analyzing an image of a frame from a frame where a person has finished talking to a frame for which a person specified by the first identification means has framed out, and a notification means for notifying an analysis result by the analysis means It is characterized by

  Further, the present invention is a control method of an information processing apparatus including a first specifying means for specifying a time or frame in which a person framed out of moving image data in which a person is photographed, which is a person among the moving image data. A second specifying step of specifying a time or frame in which the speaker has finished talking, and a setting step of setting an out point for editing moving picture data at a position specified based on the time or frame specified in the second specifying step Analyzing the image of the frame from the frame in which the person identified in the second identifying step ends to the frame in which the person identified by the first identifying means out of the frame; and the analysis result in the analyzing step And a notifying step of notifying.

  Further, the present invention is a program that can be read and executed by an information processing apparatus including first specifying means for specifying a time or frame in which a person framed out of moving image data in which a person is photographed, the information processing apparatus Editing the moving picture data at a position specified based on the time or frame specified by the second specifying means, and a second specifying means for specifying a time or frame in which the person has finished speaking from the moving picture data Analysis of an image of a frame from a frame in which the person specified by the second specifying means has finished talking to a frame in which the person specified by the first specifying means is framed out It is characterized in that it functions as an analysis means to perform, and a notification means to notify an analysis result by the analysis means.

According to the present invention, it is possible to efficiently set an in point or an out point for editing moving image data.

1 shows an example of a system configuration of an information processing system of the present invention. It is a block diagram which shows an example of the hardware constitutions of the information processing apparatus applicable to PC101 in embodiment of this invention. FIG. 7 is an example of a diagram showing the relationship of the position (time) of each frame of a moving image with the start point 302 of the file, the end point 303 of the file, the IN point 304, and the OUT point 305. It is a figure which shows an example of a moving image edit screen. It is a figure which shows an example of an animation detailed edit screen. It is an example of the flowchart which shows the processing concerning the animation edit of a 1st embodiment. It is a figure showing an example of a person list of a subject. It is an example of the flowchart which shows the process which concerns on the moving image edit of this embodiment. It is an example of the flowchart which shows the processing which relates to the animated picture compilation of 2nd execution form. It is a figure which shows an example of the conceptual diagram of one moving image file 1001 containing the moving image of a plurality of students by which a plurality of users (for example, students) were taken alternately and obtained.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The embodiment described below shows an example when the present invention is specifically implemented, and is one of the specific embodiments of the configuration described in the claims.

  FIG. 1 shows an example of the system configuration of the information processing system of the present invention.

  The PC 101 is an application example of the information processing apparatus of the present invention, and is a PC such as a desktop personal computer, a notebook personal computer, and a tablet personal computer.

  Also, the camera 104 is a digital camera or digital video camera capable of capturing still images including moving images and photographs. The camera 104 has a function of transmitting and receiving data to and from the PC 101 by wired or wireless communication. Therefore, the camera 104 can transmit the moving image file of the moving image captured by the camera 104 to the PC 101 by the wired or wireless communication, and record the moving image file in the storage unit such as the memory of the PC 101.

  In addition, the camera 104 can be mounted with a portable memory (portable recording medium) such as an SD card, and has a function of recording a moving image file of a moving image captured by the camera 104 in the portable memory.

  The imaging range (imaging range) of the camera 104 is an imaging range in which an object (person 103) sitting on the chair 105 can be imaged.

  When the camera 104 receives a shooting instruction from the user, the camera 104 starts shooting a moving image (video). In addition, the camera 104 stores the captured moving image and still image in the storage unit of the PC 101 through communication, or records the captured moving image and the still image in the portable memory. When stored in the portable memory, the portable memory is taken out from the camera 104, and the portable memory taken out is attached to the PC 101, and the moving picture and still picture stored in the portable memory are transferred to the PC 101. Copy (expand) to the memory of.

  Thus, the PC 101 can acquire a moving image and a still image captured by the camera 104.

  After the camera 104 starts shooting a moving image, a person (user) enters the imaging range of the camera 104, and the person sits on the chair 105. And a person says a single word comment.

  Then, a person (user) sitting on the chair 105 stands up, moves out of the imaging range of the camera 104, and performs a frame out.

  Then, without stopping shooting, the next different person comes into the imaging range of the camera 104, sits on the chair 105, and performs the same operation. Thus, the camera 104 generates one moving image file including moving images of a plurality of students by the plurality of students alternately entering the shooting range and saying a single comment, and the generated moving image file is used as the PC 101. The storage means of will be stored.

  FIG. 10 is a view showing an example of a conceptual diagram of one moving image file 1001 (moving image data) including moving images of a plurality of students, obtained by alternately photographing a plurality of users (for example, students).

  As shown in FIG. 10, one moving image file 1001 including videos of a plurality of students includes a moving image 1002 with a single comment by Taro Kiyano, and then one Jiro Kiyano Video 1003 with comment is included, followed by video 1004 with comment by Saburo Kiyano, and then video 1005 with comment by Shiro Kiyano Indicates that it is included.

  Further, a person list (FIG. 7) of the subject is stored in advance in the storage means (memory) of the PC 101, and shooting is performed in the order shown in the person list (FIG. 7).

  FIG. 7 is a diagram showing an example of the person list of the subject.

  As shown in FIG. 7, Taro Kiyano is shown at the first, Jiro Kiyano is shown at the second, and Saburo Kiyano is shown at the third In the fourth place, Shiro Koyano is shown.

  In addition, the path of the moving image file of each person is associated and registered. The moving image file path is stored not in advance but at the timing of steps S619 and S919 described later.

  Next, the basic operation of the information processing system of the present invention will be described with reference to FIG. FIG. 3 is an example of a diagram showing the relationship of the position (time) of each frame of the moving image with the start point 302 of the file, the end point 303 of the file, the IN point 304, and the OUT point 305.

  Although the frame 308 between the start point 302 of the file and the IN point 304 shown in FIG. 3 and FIG. 5 described later is shown only for the sake of simplifying the explanation, even if a plurality of frames are included. Good. Similarly, not only the frame 307 but a plurality of frames may be included between the OUT point 305 and the end point 303 of the file.

  The start point 302 of the file is set to a position (time) between the frame 308 in which the person could not be detected and the frame 306 determined to have detected the person.

  The end point 303 of the file is set to a position (time) between the frame 307 determined to have finally detected a person and the frame 309 that has not detected a person.

  The IN point 304 detects the voice of a person, and is set a predetermined time (for example, one second) before the volume of the voice reaches a predetermined value.

  The OUT point 305 is set after a predetermined time (for example, one second) after the volume of the voice of the person becomes smaller than a predetermined value.

  Then, at the time of moving image file generation, the moving image is cut at the positions of the IN point 304 and the OUT point 305, and a moving image file for each name (user) is generated.

  As a result, while the user confirms the video of the moving image, it is possible to reduce the time and effort required to manually input and specify the cutout position of the moving image and perform the cutout processing.

  By the way, when cutting out a moving image by the above-mentioned method, for example, when a person is doing something without speaking a word in a frame (frame 307) between the OUT point 305 and the end point 303 of the file, for example, There was a problem that the video was not played back.

  Therefore, in the present invention, in order to solve the problems described above, in the first embodiment, whether the time between the frame (frame 306) between the start point 302 of the file and the IN point 304 exceeds a predetermined time , Determine whether the time (the number of frames) between the frame (frame 307) between the OUT point 305 and the end point 303 of the file exceeds a predetermined time, and if so, do something without speaking a word in between To notify the editor of the video file to prompt confirmation.

  In the second embodiment, the frame between the start point 302 of the file and the frame between the IN point 304 (frame 306) and the frame between the OUT point 305 and the end point 303 of the file (frame 307). The frame between them is analyzed, and when it is determined that the person is performing an operation, the editor of the moving image file is notified to urge confirmation.

  The editor of the moving image file that has received the notification adjusts the IN point and the OUT point by the IN point control 503 and the OUT point control 504 on the moving picture detailed editing screen shown in FIG. FIG. 5A shows a state before accepting editing from the editor, and the frame 501 and the frame 502 are frames determined to be performing an operation, and each of the frames is an editor. A notification (in the present embodiment, “!”) For confirmation is issued. It is sufficient that the user can identify a frame determined to be performing an operation, so that the frame 501 may be blinked or identified by surrounding the frame 501 with a specific color.

  Then, as shown in FIG. 5B, the editor moves the IN point control 503 to the left of the frame 501 and the OUT point control 504 to the right of the frame 502, thereby converting the frame 501 and the frame 502 into a moving image file. It is possible to include. The notification disappears when the frame 501 and the frame 502 are included in the movie file.

  If the person is doing something without speaking in the frame between the IN point and the start of the file and the frame between the OUT point and the end of the file by performing the above mentioned notification and editing, It becomes possible to solve the problem that the moving image is not reproduced.

  The processing in the present invention will be described below. First, the hardware configuration of the PC 101 will be described with reference to FIG.

  FIG. 2 is a block diagram showing an example of a hardware configuration of an information processing apparatus applicable to the PC 101 in the embodiment of the present invention. The respective devices have the same configuration, and therefore will be described using the same reference numerals.

  In FIG. 2, reference numeral 201 denotes a CPU, which centrally controls devices and controllers connected to the system bus 204. Further, the ROM 202 or the external memory 211 may be a BIOS (Basic Input / Output System) which is a control program of the CPU 201, an operating system program (hereinafter referred to as an OS), and various kinds of functions described later. Programs and the like are stored.

  A RAM 203 functions as a main memory, a work area, and the like of the CPU 201. The CPU 201 loads programs necessary for execution of processing from the ROM 202 or the external memory 211 to the RAM 203, and implements various operations by executing the loaded programs.

  An input controller 205 controls an input from a pointing device such as a keyboard (KB) 209 or the like. Reference numeral 206 denotes a video controller which controls display on a display such as a display 210 (whether liquid crystal or CRT).

  A memory controller 207 is an external storage device (hard disk (HD)) for storing a boot program, various applications, font data, user files, editing files, various data, etc., a flexible disk (FD), or a PCMCIA card slot. It controls access to external memory 211 such as Compact Flash (registered trademark) memory connected via an adapter.

  A communication I / F controller 208 connects and communicates with an external device via a network, and executes communication control processing in the network. For example, communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the display 210 by executing, for example, outline font rasterization processing on a display information area in the RAM 203. In addition, the CPU 201 enables user instruction with a mouse cursor (not shown) or the like on the display 210.

  Various programs to be described later for realizing the present invention are stored in the external memory 211, and are executed by the CPU 201 by being loaded into the RAM 203 as necessary. Furthermore, setting files and the like used at the time of execution of the program are also stored in the external memory 211, and a detailed description of these will be described later. This is the end of the description of FIG.

  Next, processing executed by the PC 101 in the first and second embodiments will be described using the flowchart in FIG. 8.

  FIG. 8 is an example of a flowchart showing processing relating to moving image editing of this embodiment, and the processing of FIG. 8 is processing common to the first and second embodiments.

  First, when the predetermined control program is activated, the PC 101 displays a moving image editing screen on a display unit such as the display 210.

  Then, in step S801, the PC 101 receives and reads the selection of the person list of the subject shown in FIG. 7 to be processed by the user. The PC 101 specifies, among the person list read in step S801, the name (information with a low number) having the earliest order (information identifying a subject) as a processing target.

  In step S802, the PC 101 corresponds to the person list selected in step S801, receives an instruction to read one moving image file to be processed by the user, and starts reading the moving image file.

  For example, a moving image file for each class is generated, and for example, a person list of subjects as shown in FIG. 7 is stored for each class of students, and it is selected which moving image of students of the class is to be processed. You can load a movie file of that class as a processing target.

  The start of the moving image file reading process in step S802 means that reading is started sequentially from the first frame of the moving image.

  In step S803, the PC 101 executes processing relating to moving image editing. Details of the process of FIG. 8 will be described using FIG. 6 for the first embodiment, and using FIG. 9 for the second embodiment.

  In step S804, the PC 101 determines whether one of the moving images of each name listed on the moving image editing screen in FIG. 4 is selected by the user and the user accepts the pressing of the play button 413. By doing this, it is determined whether or not an instruction to play back the moving image has been received.

  Here, the moving image before performing the editing process by accepting the user operation in step S616 and step S917 described later, or the moving image after the editing process of S616 and step S917 (the position of the IN point or the OUT point is an arbitrary position It is determined whether or not the reproduction instruction for the (moving image) changed to is received.

  In step S805, when it is determined that the reproduction instruction of the moving image is accepted, the PC 101 reads the moving image file of the moving image, and reproduces the moving image. Here, the frame (group) before the IN point control 503 and the frame (group) after the OUT point control 504 are not reproduced.

  In step S806, if the reproduction of the moving image is ended (step S806: YES), the PC 101 ends the processing. If the reproduction of the moving image is not ended, the PC 101 continues to reproduce the moving image. . This is the end of the description of FIG.

  Next, processing executed by the PC 101 in the first embodiment will be described using the flowchart in FIG.

  FIG. 6 is an example of a flowchart showing processing relating to moving image editing according to the first embodiment.

  FIG. 6 shows a process in which the CPU 201 of the PC 101 reads and executes a predetermined control program.

  In step S601, the PC 101 reads a moving image (frame), analyzes the read moving image (frame), and includes a person in the frame, that is, can not detect a person in the frame. Determine if

  Then, when it is determined that the person is not included in the frame, that is, the person in the frame can not be detected (step S601: NO), the PC 101 reads the next frame, and the reading is performed. The process of step S601 is performed on the selected frame.

  Step S601 is an example of a first specifying means for specifying a time or a frame at which a person frames in the moving image data in which the person is photographed in the present invention.

  If the PC 101 determines that a person is included in the frame, that is, it is determined that the person in the frame has been detected (step S601: YES), the frame in which the person could not be detected, and the person. The moving image file start point (the file start point 302 in FIG. 3) is set at a position (time) between the frame determined to have been detected (step S602).

  In step S603, the PC 101 detects the voice emitted by the person and determines whether the level (volume) of the voice has reached a predetermined value. Then, when it is determined that the voice level has reached the predetermined value (step S603: YES), the PC 101 is more than the frame when it is determined in step S604 that the voice level has reached the predetermined value. An IN point (IN point 304 in FIG. 3) is set to a frame before a predetermined time (for example, one second).

  Step S603 is an example of a second specifying unit for specifying a time or a frame at which a person starts speaking from the moving image data in the present invention.

  Step S604 is an example of setting means for setting an in point for editing moving picture data at a position specified based on the time or frame specified by the second specifying means in the present invention.

  In step S605, the PC 101 determines whether the time (number of frames) from the start point of the moving image file set in step S602 to the IN point set in step S604 exceeds a predetermined time (predetermined number of sheets). The predetermined time in step S605 is, for example, 10 seconds.

  If the predetermined time is exceeded (step S605: YES), the PC 101 determines that something is being performed between the start point of the moving image file and the IN point, and in step S606 the identification information is added to the moving image file. Add The identification information is information for displaying an identification display 408 of FIG. 4 described later and “!” Displayed on the frame 501 of FIG. 5.

In step S607, the PC 101 determines whether the level (volume) of the sound emitted by the person has decreased to a predetermined value. When it is determined that the voice level has decreased to a predetermined value (step S607: YES), the PC 101 determines in step S608 that the voice level has decreased to a predetermined value (for example, a predetermined time). If it is determined that the predetermined time has elapsed (step S 608: YES), the OUT point (OUT point 305 in FIG. 3) is set in the frame after the predetermined time has elapsed (step S 608) S609).
Step S 607 is an example of a second specifying means for specifying a time or a frame at which the person has finished speaking from the moving image data in the present invention.

  Step S609 is an example of setting means for setting an out point for editing moving picture data at a position specified based on the time or frame specified by the second specifying means in the present invention.

  In step S610, the PC 101 determines whether a person is not included in the frame to be currently processed, that is, whether or not a person in the frame can not be detected.

  When it is determined that the person is included in the frame, that is, the person in the frame can be detected (S610: NO), the PC 101 sets the next frame as a processing target, and performs the processing in S610 again. Do the processing.

  Step S610 is an example of a first specifying means for specifying a time or a frame at which a person framed out of moving image data in which a person is photographed in the present invention.

  In step S611, if it is determined that the frame does not include a person in the frame, that is, the person in the frame can not be detected (S610: YES), it is determined that the person is not included. The moving image file end point (the end point 303 of the file in FIG. 3) is set at the position (time) between the frame and the frame immediately preceding it (the frame in which a person is detected).

  In step S612, the PC 101 determines whether the time (number of frames) from the OUT point set in step S609 to the end point of the moving image file set in step S611 exceeds a predetermined time (predetermined number of sheets). The predetermined time in step S605 is, for example, 10 seconds.

  If the predetermined time is exceeded (step S612: YES), the PC 101 determines that something is being performed between the OUT point and the end point of the moving image file, and in step S613, identifies the identification information in the moving image file. Add The identification information is information for displaying an identification display 408 in FIG. 4 described later and “!” Displayed on the frame 502 in FIG. 5.

  In step S614, the PC 101 cuts out the moving image file read in step S802 at the position (time) where the file start point is set in step S602 and the position (time) where the file end point is set in step S611. The extracted moving image file and the name of the current processing target (information for identifying the subject) are associated with each other and temporarily stored in the external memory 211. Also, the information of the position (time) of the IN point set in step S604, the information of the position (time) of the OUT point set in step S609, the identification information added in step S606, and the addition in step S613. The stored identification information is also temporarily stored in the external memory 211.

  In step S615, the PC 101 determines whether all the moving image files read in step S801 have been subjected to the processing in steps S601 to S614, or all names in the person list read in step S801. Whether or not the process of cutting out the moving image file read in step S802 and setting the IN point and the OUT point is ended by determining whether or not the process from step S601 to step S614 is performed with Determine

  In step S615, the PC 101 targets all of the moving image files read in step S801 for the processing in steps S601 to S614, or all names in the person list read in step S801 If it is determined that the process from step S601 to step S614 has been executed, it is determined that the process of cutting out the moving image file read in step S802 and setting the IN point and OUT point is ended (step S615: YES ), The process proceeds to step S616.

  In step S615, the PC 101 does not process all the moving image files read in step S801, or all names in the person list read in step S801. If it is determined that the process from S601 to S614 has not been executed, it is determined that the process of cutting out the moving image file read in step S802 and setting the IN point and OUT point is not completed ( (S615: NO), among the unprocessed names in the person list read in step S801, the name with the earliest (low numbered) name is to be processed, and the next frame of the moving image file read in step S802 is The processing is shifted to S601 as a processing target.

  In step S616, the PC 101 displays a list (list) of the moving image file read in step S802 and names registered in association with the moving image file on the moving image editing screen (FIG. 4).

  Step S616 is the time or frame number from the time or frame when the person specified by the first specifying means to the frame in the present invention to the time or frame when the person specified by the second specifying means starts talking Is an example of a notification means for notifying to confirm that the in-point set by the setting means should be corrected, using a time or a frame at which the person specified by the second specifying means has finished talking The notification means for notifying to confirm whether the out point set by the setting means should be corrected by using the time or the number of frames up to the time or the frame when the person specified by the first specifying means framed out It is an example.

  Here, FIG. 4 will be described. FIG. 4 is a diagram showing an example of a moving image editing screen.

  Reference numeral 401 denotes the value of the order of the person list shown in FIG. 7, and reference numeral 401 denotes the name. The moving image files stored in step S 914 described later in association with the information for identifying the subject are shown in 403 and 404 as a moving image timeline. 403 indicates the limeline of the moving image between the IN point (IN point 304 in FIG. 3) and the OUT point (OUT point 305 in FIG. 3); 404 indicates the OUT point and the file end point (file in FIG. 3) The timeline of the animation between the end point 303) of the is shown. Reference numeral 411 denotes a moving image after the end of the file.

  Reference numeral 402 denotes a reduced image (for example, a thumbnail image) of the first frame of the moving image between the IN point and the OUT point or the moving image between the IN point and the OUT point.

  Also, reference numeral 412 denotes a moving image timeline between the file start point (the file start point 302 in FIG. 3) and the IN point.

  Reference numeral 405 denotes an area in which the waveform of the sound included in the clipped moving image file is displayed.

  In step S614, the moving image file extracted in step S914 to be described later is associated (registered) with the current processing target name (information identifying the subject) and is registered (set) by the user's instruction. In step S 917 described later, editing (modification) of IN point and OUT point is arbitrarily set, and a button for selecting a processing target of a moving image file cut out and registered based on the IN point and OUT point (instruction acceptance Department). That is, it is a button for selecting which moving image is to be processed.

  As shown in FIG. 4, the above-mentioned 401 to 406, 411, and 412 are listed and displayed for each name (step S614, for each moving image file cut out in step S914 described later). Reference numeral 410 denotes a file generation button.

  As shown in FIG. 4, the above-mentioned 401 to 406, 411, and 412 are listed and listed for each name (step S614, each moving image file cut out in step S914 described later). When a name (information for identifying a subject) is selected, a moving image editing screen (FIG. 4) has a display area 407 for displaying a preview of the moving image. Reference numeral 413 denotes a play button, which displays a preview of the moving image in the display area 407 when any one of the moving images or names (information for identifying the subject) is selected and the reproduction button 413 is pressed by the user. .

  Reference numeral 409 denotes a display area in which either the moving image or the name displayed in a list is selected, and the user receives an instruction to edit the IN point and OUT point of the selected moving image. Specifically, the display area 409 is, for example, a display area in which FIG. 5 (A) or FIG. 5 (B) is displayed.

  When the identification information is added to the moving image file in step S606, step S613, and steps S906 and S913 described later, the identification display 408 enables the user to recognize the moving image file to which the identification information is added. Surrounded by

  In addition, as long as the user can identify the moving image file to which the identification information is added, identification may be performed by blinking the column of the moving image file or changing the color of the name 401.

  By performing the identification display 408, the user can easily make a moving image file in which the person does something without speaking in the frame between the IN point and the start point of the file and the frame between the OUT point and the end point of the file It becomes possible to execute editing of the moving image file (correction of IN point and OUT point) smoothly.

  If identification information is added to the moving image file in step S606, step S613, step S906 described later, or step S913, FIG. 5 (A) or FIG. 5 (B) is displayed in the display area 409. Also in the above, the frames (frame 501 and frame 502) determined to be performing an operation are identified and displayed.

  This completes the description of FIG. 4 and returns to the description of FIG.

  In step S617, the PC 101 receives an operation instruction from the user via the moving image editing screen (FIG. 4).

  For example, the PC 101 moves (changes) the IN point control 503 and the OUT point control 504 to a position between arbitrary frames according to the operation of the user. This makes it possible to edit a moving image by changing the positions of the IN point and the OUT point to any position.

  Further, in S617, the PC 101 displays the selected moving image and name moving image of the moving images and names listed on the moving image editing screen (FIG. 4) in the display area 409, and performs the same operation for each moving image. It can be done.

  Then, the PC 101 receives, from the user, the selection of each moving image and each name button 406 (instruction receiving unit) displayed in a list on the moving image editing screen (FIG. 4), and receives the pressing of the file generation button 410.

  If it is determined in step S617 that the operation content accepted by the user is an editing instruction for editing a moving image by changing the position of the IN point or the OUT point to an arbitrary position in step S617, An editing process is performed to register the position at which the IN point or the OUT point is arbitrarily changed by the user operation.

  In step S 617, the PC 101 receives the selection of the button 406 (instruction accepting unit) of each moving image and each name displayed in the list as the operation content accepted by the user, and the instruction for accepting the pressing of the file generation button 410 ( If it is determined in step S618 that the instruction is a generation instruction, the file of the selected moving image is generated. Specifically, the moving image is cut at the positions of each IN point and each OUT point currently registered, and a moving image file for each name (user) is generated. That is, when the editing process of step S617 is performed, the moving image is cut at the position of the edited IN point and / or OUT point, and a moving image file for each name (user) is generated.

  For example, as shown in FIG. 5A, the IN point control 503 is set at the position between the frame 501 and the frame 505, and the OUT point control 504 is set at the position between the frame 506 and the frame 502. If YES, the PC 101 cuts out a frame (group) between the IN point control 503 and the OUT point control 504 in step S619 and step S919 described later, and generates one moving image file.

  This process is executed for each moving image (name (user)) selected by the user in S617, and a moving image file for each name (user) is generated (step S619). Then, the process ends. This is the end of the description of FIG.

  Next, processing executed by the PC 101 in the second embodiment will be described using the flowchart in FIG. 9.

  FIG. 9 is an example of a flowchart showing processing relating to moving image editing of the second embodiment.

  FIG. 9 shows a process in which the CPU 201 of the PC 101 reads and executes a predetermined control program.

  The processes in steps S901 to S904 are the same as the processes in steps S601 to S604 in FIG.

  In step S905, the PC 101 analyzes a frame from the start point of the moving image file set in step S902 to the IN point set in step S604, and determines whether the person is performing an operation. The method of determining whether the motion is performed is a method of determining that the motion is performed when the amount of change of the frame between the start point of the moving image file and the IN point is equal to or more than a predetermined amount. If an image in the running state is stored as a comparison image, and the image is being operated when the similarity between the image and each frame between the start point of the moving image file and the IN point is less than or equal to a predetermined value A method of judging etc. can be considered.

  If the person is performing an operation (step S 905: YES), the PC 101 adds identification information to the moving image file in step S 906. The identification information is information for displaying the identification display 408 of FIG. 4 or “!” Displayed on the frame 501 of FIG.

  The processes in steps S 907 to S 911 are the same as the processes in steps S 607 to S 611 in FIG.

  In step S912, the PC 101 analyzes a frame between the OUT point set in step S609 and the end point of the moving image file set in step S611, and determines whether the person is performing an operation. The method of determining whether the motion is performed is a method of determining that the motion is performed when the amount of change of the frame from the OUT point to the end point of the moving image file is equal to or more than a predetermined amount. If an image in the running state is stored as a comparison image, and the operation is performed when the degree of similarity between the image and each frame between the OUT point and the end point of the moving image file is less than or equal to a predetermined level A method of judging etc. can be considered.

  If the person is performing an operation (step S912: YES), the PC 101 adds identification information to the moving image file in step S913. The identification information is information for displaying the identification display 408 of FIG. 4 and “!” Displayed on the frame 502 of FIG.

  In step S914, the PC 101 cuts out the moving image file read in step S802 into the position (time) where the file start point is set in step S902 and the position (time) where the file end point is set in step S911. The extracted moving image file and the name of the current processing target (information for identifying the subject) are associated with each other and temporarily stored in the external memory 211. Also, the information of the position (time) of the IN point set in step S904, the information of the position (time) of the OUT point set in step S909, the identification information added in step S906, and the information added in step S913. The stored identification information is also temporarily stored in the external memory 211.

  The processes in steps S915 to S919 are the same as the processes in steps S615 to S619 in FIG.

  This is the end of the description of FIG.

  As described above, according to the present invention, it is possible to efficiently set an in point or an out point for editing moving image data.

  The present invention can also be embodied as, for example, a system, an apparatus, a method, a program, a storage medium, etc. Specifically, the present invention may be applied to a system composed of a plurality of devices, The present invention may be applied to an apparatus consisting of two devices.

  Note that the present invention includes one that directly or remotely supplies a program of software that implements the functions of the above-described embodiments to a system or an apparatus. The present invention is also included in the present invention if the computer of the system or apparatus reads out and executes the supplied program code.

  Therefore, the program code itself installed in the computer to realize the functional processing of the present invention by the computer also implements the present invention. That is, the present invention also includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of an object code, a program executed by an interpreter, script data supplied to an OS, or the like.

  Examples of recording media for supplying the program include a flexible disk, a hard disk, an optical disk, a magneto-optical disk, an MO, a CD-ROM, a CD-R, and a CD-RW. There are also magnetic tapes, non-volatile memory cards, ROMs, DVDs (DVD-ROMs, DVD-Rs) and the like.

  In addition, as a program supply method, a browser on a client computer is used to connect to an Internet home page. Then, the program can be supplied by downloading the computer program of the present invention itself or a compressed file including an automatic installation function from the home page to a recording medium such as a hard disk.

  The present invention can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from different home pages. That is, the present invention also includes a WWW server which allows a plurality of users to download program files for realizing the functional processing of the present invention by a computer.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, and distributed to users, and the user who has cleared predetermined conditions downloads key information that decrypts encryption from the homepage via the Internet. Let Then, it is possible to execute the program encrypted by using the downloaded key information and install it on a computer.

  Also, the functions of the above-described embodiments are realized by the computer executing the read program. In addition, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiment can be realized by the processing.

  Furthermore, the program read from the recording medium is written to a memory provided in a function expansion board inserted in the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program, a CPU or the like provided in the function expansion board or the function expansion unit performs part or all of the actual processing, and the function of the above-described embodiment is also realized by the processing.

  The embodiments described above merely show examples of implementation in practicing the present invention, and the technical scope of the present invention should not be interpreted in a limited manner by these. That is, the present invention can be implemented in various forms without departing from the technical concept or the main features thereof.

101 PC

Claims (10)

A first specifying means for specifying a time or a frame at which a person framed in moving image data in which a person is photographed;
A second specifying means for specifying a time or a frame at which a person starts speaking from the moving image data;
Setting means for setting an in point for editing moving picture data at a position specified based on the time or frame specified by the second specifying means;
Analysis means for analyzing an image of a frame from a frame in which the person specified by the first specifying means is frame-in to a frame in which the person specified by the second specifying means starts to speak;
An information processing apparatus comprising: notification means for notifying an analysis result by the analysis means.   The analysis means determines whether the person is moving in a frame from the frame in which the person specified by the first specifying means has entered the frame to the frame where the person specified by the second specifying means has started talking The information processing apparatus according to claim 1, wherein analysis is performed. The notification means displays images of a plurality of frames of the moving image data in time series, and notifies a screen on which a control regarding an in point set by the setting means is displayed at a position between the plurality of images.
Accepting means for accepting an instruction to change the position of the control via the screen;
The information processing apparatus according to claim 1 or 2, wherein the display position of the control with respect to the image and the position of the in point set by the setting unit are corrected according to the change instruction received by the reception unit. . A plurality of persons are photographed alternately in the moving image data, and the first specifying unit specifies a time or a frame at which each person framed in the moving image data,
Generating means for dividing the moving image data at division positions specified based on the time or frame specified by the first specifying means, and individually generating moving image data for each person. The information processing apparatus according to any one of to 5. Storage means for storing a person list in which identification information for individually identifying each person included in the moving image data is determined corresponding to the order of generation of the moving image data by the generating means;
Registration means for registering moving image data sequentially divided and generated from the head of the moving image data in association with identification information defined in the person list in correspondence with the order in which the moving image data is generated;
The information processing apparatus according to claim 4, comprising: A control method of an information processing apparatus, comprising: first specifying means for specifying a time or a frame at which a person framed in moving image data in which a person is photographed,
A second identification step of identifying a time or a frame at which a person starts speaking from the moving image data;
A setting step of setting an in point for editing moving image data at a position specified based on the time or frame specified in the second specifying step;
An analysis step of analyzing an image of a frame from a frame in which a person specified by the first specifying means frames into a frame to a frame where the person specified in the second specifying step starts talking;
And a notification step of notifying an analysis result in the analysis step. It is a program that can be read and executed by an information processing apparatus including a first specifying unit that specifies a time or a frame at which a person framed in moving image data in which a person is photographed,
The information processing apparatus
A second specifying means for specifying a time or a frame at which a person starts speaking from the moving image data;
Setting means for setting an in point for editing moving picture data at a position specified based on the time or frame specified by the second specifying means;
Analysis means for analyzing an image of a frame from a frame in which the person specified by the first specifying means is frame-in to a frame in which the person specified by the second specifying means starts to speak;
A program characterized in that it functions as notification means for notifying an analysis result by the analysis means. A first specifying means for specifying a time or a frame at which a person framed out of moving image data in which a person is photographed;
A second specifying means for specifying a time or a frame at which a person has finished talking from the moving image data;
Setting means for setting an out point for editing moving picture data at a position specified based on the time or frame specified by the second specifying means;
Analysis means for analyzing an image of a frame from a frame where the person specified by the second specifying means has finished talking to a frame where the person specified by the first specifying means is out of frame;
An information processing apparatus comprising: notification means for notifying an analysis result by the analysis means. A control method of an information processing apparatus, comprising: first specifying means for specifying a time or frame in which a person framed out of moving image data in which a person is photographed.
A second identification step of identifying a time or a frame at which a person has finished talking from the moving image data;
A setting step of setting an out point for editing moving image data at a position specified based on the time or frame specified in the second specifying step;
An analysis step of analyzing an image of a frame from a frame in which the person identified in the second identification step has finished talking to a frame in which the person identified by the first identification means is out of frame;
And a notification step of notifying an analysis result in the analysis step. It is a program that can be read and executed by an information processing apparatus including first specifying means for specifying a time or a frame at which a person framed out of moving image data in which a person is photographed,
The information processing apparatus
A second specifying means for specifying a time or a frame at which a person has finished talking from the moving image data;
Setting means for setting an out point for editing moving picture data at a position specified based on the time or frame specified by the second specifying means;
Analysis means for analyzing an image of a frame from a frame where the person specified by the second specifying means has finished talking to a frame where the person specified by the first specifying means is out of frame;
A program characterized in that it functions as notification means for notifying an analysis result by the analysis means.

Images