JP2006211191A - Editing operation auxiliary method, device, program, and medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To automatically perform editing based on the operation content of a user in editing without allowing a user to be conscious of the subsequent editing of a video on viewing. <P>SOLUTION: An editing result which meets the viewing operation of the user is obtained with the use of an editing operation auxiliary method by recording the content operated by the user in viewing, so as to automatically analyze the operation content which is recorded in editing (S401), and performing editing processing (S402). Moreover, editing information is corrected by using the amount of features such as the scene change of video data, so that the editing result with higher precision is obtained. When the past operation content is used as a template, application is performed to the editing of the video which is not viewed yet. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to video editing corresponding to editing video based on the recorded operation content by recording the content of the video viewing operation.

Conventionally, video editing such as commercial cut includes a step of inputting an operation and a step of inputting an editing point, so that a section to be cut or not to be cut included in the video to be edited at the time of editing The user manually specified for each section. (For example, refer to Patent Document 1.) However, with the advent of a recording device capable of recording for a long time, such as a hard disk recorder, the amount of video data to be recorded has increased, and the user has to spend a lot of time and effort on editing work. There was a problem of taking time. Furthermore, as a normal operation of the user, the recorded video data is often viewed once, and then only the favorite video data is edited and left on DVD media, etc. The same video is viewed and edited twice. There was a waste of money. In addition, edit points specified by the user during viewing often deviate from the target edit points intended by the user, such as scene breaks, and contain errors. In order to meet the above, it is necessary to check and correct video frames one by one. Furthermore, since there is no editing point information for a video that has never been viewed and for which editing point information has not been created, editing cannot be performed.
JP 2002-117653 A

  The problem to be solved is that in video editing such as commercial cut, a user must manually specify a section to be cut or a section not to be cut for each section. An edit point designated by the user is an error. In addition, editing cannot be automatically performed on a video for which no editing point is designated.

  The main feature of the present invention is that, during video editing, the section to be automatically cut or the section not to be cut is specified based on the recording of the operation content at the time of viewing by the user. The most important feature is to automatically correct the section to be cut or the section not to be cut. In addition, the main feature is that when there is no editing point information, automatic editing is performed based on data of past operation contents.

  The editing operation assisting device of the present invention includes an operation content extracting means for extracting operation content from an operation signal transmitted from a viewing operation operated by a user using a remote controller, for example, when viewing a video, and data of the extracted operation content. Operation content storage means for storing, operation data analysis means for automatically generating editing information by analyzing operation content data stored in the operation content storage means during video editing, and the operation data analysis By providing video data editing means for editing the video based on the editing information generated by the means, the user's operation content at the time of editing without the user being aware that the video being viewed is edited later. There is an advantage that editing based on can be automatically performed.

  Also, based on the video feature extraction means for extracting the feature amount of the video, the video feature information storage means for storing the extracted video feature information, and the video feature information stored in the video feature information storage means at the time of editing the video By further comprising editing information correction means for automatically correcting the editing point of the editing information, the editing information generated based on the user's operation content is changed to a video changing point, such as a scene change point. There is an advantage that the error of the user's operation can be absorbed and the editing information can be corrected according to the user's request.

  In addition, the operation content data stored in the operation content storage means is used to compare with the recording record information held by the selected video, and automatically selected from the stored operation content data. In addition, by further comprising an operation content automatic selection means that is used to generate editing information of the operation data analysis means, the user can edit the video that the user has not yet viewed without inputting edit points. There is an advantage that you can.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(Embodiment 1)
FIG. 1 shows a configuration of an editing operation assisting device according to an embodiment of the present invention. The editing operation assisting device 110 according to this embodiment includes an input / output interface unit 111, a control unit 112 (operation content extraction unit, operation data analysis unit, video data editing unit, editing information correction unit, operation content automatic selection unit), storage. The unit 113 (operation content storage means) is connected to the operation signal 101, the output signal 102, and the network 103.

  The input / output interface unit 111 is, for example, input / output such as TV remote control reception, keyboard / mouse / TV tuner input, network interface board, composite input / output terminal, RGB input / output terminal, 1394 input / output terminal, and USB input / output terminal. It is an apparatus, and exchanges the operation signal 101, the output signal 102, the input / output signal of the network 103, and the signal of the control part 112 mutually.

  The control unit 112 includes a calculation unit 112a and a memory unit 112b. The calculation unit 112a is a calculation device such as a central processing unit (CPU), for example, and executes various programs and controls each unit of the device. The memory unit 112b is a storage device such as a semiconductor memory, for example, and stores programs executed by the arithmetic unit 112a, data necessary for processing, and the like. In this configuration, the calculation unit 112a and the memory unit 112b are described separately. However, even if two functions such as a system LSI are provided, a plurality of calculation units and memory units are provided as in a parallel computer. You may have.

  The storage unit 113 is, for example, a storage device such as a hard disk, a semiconductor memory, an optical disk medium, or a magnetic medium. The storage unit 113 may include only one or a plurality of storage devices. The accumulation unit 113 accumulates video data to be viewed and edited by the editing operation assisting device, accumulates operation contents at the time of viewing by the user, and accumulates editing information and editing result video data. .

  In the configuration of the present embodiment, viewing and editing operations are performed by a single device. For example, viewing and editing are performed separately, such as viewing on a mobile terminal and editing on a home server. The apparatus may have a configuration in which operation content data stored during viewing is used during editing via a network or a recording medium.

  Next, in the embodiment configured as described above, when the user views a video, an operation content is extracted from the operation signal of the user viewing operation and stored in the storage unit 113. 2 will be described.

  In step S201, the operation signal input from the operation signal 101 is detected by the calculation unit 112a in the control unit 112 via the input / output interface unit 111, and the detected operation signal is stored in the memory unit 112b by the calculation unit 112a. The data is converted into operation content data and stored in the storage unit 113.

  In step S202, video data stored in the storage unit 113 is read based on the operation signal detected in step S201, playback is controlled based on the operation signal, and video output is performed via the input / output interface unit 111. I do.

  Here, the operation signal is, for example, a signal generated by operating a TV remote controller, a signal generated by operating a keyboard or a mouse, a signal transmitted from another device via a tuner input, A reproduction operation signal transmitted via the Internet.

  In addition, as shown in FIG. 3, the operation content data includes at least information for specifying a video to be viewed such as a data path, operation commands such as playback, stop, fast forward, rewind, and pause, It includes information for specifying the position of the video when an operation command such as a frame number and time information is executed, and further includes electronic program information and recording time information for the user to specify a program. The reproduction control means control for operations related to video reproduction such as reproduction, stop, fast forward, rewind, and pause.

  In this embodiment, the operation contents are accumulated first in step S201. However, since step S201 and step S202 can be performed independently, the reproduction control in step S202 is performed first. The same effect can be obtained. Further, the same effect can be obtained even if step S201 and step S202 are performed at the same time.

  Next, an operation of automatically generating editing information and performing editing processing using the operation content data stored in the storage unit 113 when the user edits video will be described with reference to the flowchart of FIG. . In step S 401, an operation signal related to editing, such as an editing start signal, a video file selection, or an editing range specification input from the operation signal 101, is calculated in the control unit 112 via the input / output interface unit 111. Operation content data detected by the unit 112a and corresponding to the video to be edited is read from the storage unit 113 by the calculation unit 112a. Further, editing information is generated by analyzing the read operation content data. Here, the generation method of editing information can be generated by various methods by using the operation content data. By comparing the operation content with a specific editing rule, for example, as shown in FIG. As described above, based on the rule that the range from the playback command start point to another operation command is selected and the playback is 10 seconds or less, the selected part of the video data is generated as editing information. Can do. In addition, by searching the operation content data to determine how many times the same portion of the video data has been reproduced, it is possible to use a portion with a large number of reproductions as an important point of the video as a representative video such as an opening or a title. In addition, in the case of viewing operation content data in which speed adjustment such as double speed playback is performed, the importance can be calculated and reflected in the editing information based on the difference or change in the playback speed.

  Note that the viewing operation reflects the individuality of each user in the operation method. Therefore, the unnecessary portion is not always skipped by a viewing operation such as fast-forwarding. For this reason, it is possible to obtain an editing result more suited to the user's wishes by combining with other editing assistance functions such as a commercial detection function.

  In step S402, video editing processing such as cuts and effects is performed based on the editing information generated in step S401, and the editing result is output as an output signal via the input / output interface unit 111. Here, the editing result is to create another video data from the original video data, or to reproduce or specially reproduce only a specific part of the original video like a video playlist. Also, special playback is to perform playback by adding a slow or effect effect or synthesizing two videos. In the editing process, it is important to confirm that the editing result is as expected by the user, so only the specific part is reproduced using the original video once in the form of preview. Alternatively, it is possible to perform a special reproduction and follow the procedure of creating another video data after confirmation by the user. The output signal is compressed video data after editing, or a video signal that can be displayed on a TV receiver or personal computer in a composite format or RGB format. From the output signal, it is possible to display on a TV screen or to record on a DVD medium. It is also possible to transmit the editing result and output signal to other devices via the network 103.

  Next, an operation for automatically correcting the editing point of the editing information using the video feature information of the video to be edited will be described with reference to the flowchart of FIG. In step S601, the same operation as in step S401 is performed to generate editing information. In step S602, the video feature information obtained by analyzing the video to be edited is read from the storage unit 113 by the calculation unit 112a, and the editing information generated in step S601 is corrected. Here, the video feature information is analysis information related to video features such as information on the amount of scene change acquired from the difference between the front and back of the video image frame and the reproduction position estimated as a silent section from the change in the volume of the video audio. . In addition, the timing of creating the video feature information is automatically detected in advance during recording, viewing or editing, and stored in the storage unit 113, detected during editing, or separately via the network 103. Can be acquired from the video feature information stored in the server, and compression information such as a motion vector of video data to be edited can be used.

  Various correction methods can be considered for correction of editing information. For example, if there is change point information in the analysis information in the vicinity of a specific range of the start point and end point of the edit information, the start point and end point are determined. By changing the point to the change point, it is possible to correct the change point according to the video. Moreover, it is possible to exclude from the editing information a section having a high possibility of commercial. In addition, it is possible to exclude from the editing information portions where the video shakes heavily or portions that are too dark. In the example of the present embodiment, the method of using the feature amount of the video is described. However, by analyzing the user's habit in advance, from the user information included in the operation content, The correction including the habit of the viewing operation of the operator such as the playback timing can be performed by changing the editing information only by the delay time, for example, by setting that the user delays a certain operation button. The correction can also be performed with the same configuration.

  In step S603, an operation similar to that in step S402 is performed to perform editing processing.

Next, an operation of editing unviewed video data by using the operation content data stored in the storage unit 113 will be described with reference to a flowchart of FIG.

  In step S <b> 701, an operation signal related to editing such as a signal for starting editing, selection of a video file, or specification of an editing range input from the operation signal 101 is calculated in the control unit 112 via the input / output interface unit 111. Recording information detected by the unit 112 a and corresponding to the video to be edited is acquired from the storage unit 113. In addition, the past operation content data stored in the storage unit 113 is compared with the recording information, and similar operation content data is selected. Here, the recording information is information at the time of recording including at least the start date, the end time, and the channel number including the year, month, day, hour and minute of the recording. What to do or included in the video data.

  The operation content data selection is, for example, selecting the operation content data closest to the recording date among the operation content data of the same channel, the same recording start time and the same recording end time. It is to be. In addition, by searching on a weekly basis, operation content data for the same day of the week can be selected, operation content data for the same recording time length can be selected, and program names such as electronic program information can be recorded as recording information. When available, it is possible to select operation content data having the same program name. If there is no similar operation content data, the user is prompted to have no similar operation content data, and the user can directly specify similar operation content data or perform viewing.

  In step S702, the operation content data selected in step S701 is used in place of the operation content data viewed in step S401, so that the same operation is performed and edit information is generated.

  In step S703, the same operation as in step S402 is performed to perform editing processing.

  In this embodiment, the operation content data is searched for data stored in the storage unit 113. However, the operation content data stored in another device via the network 103 is also searched. It is possible to obtain the effect. The operation content data acquired in step S201 can be stored in advance in another device via the network 103, so that the operation content data can be shared with other users. The network described in this embodiment is intended for all networks such as the Internet, wireless communication, infrared communication, and home network communication.

  The editing information assisting device according to the present invention uses the operation content at the time of viewing, so that the editing process can be performed without the user specifying the editing point at the time of editing. Useful as an aid.

The figure which showed the structure of the edit operation assistance apparatus in Embodiment 1 of this invention The flowchart which showed the flow of the edit operation assistance apparatus at the time of viewing-and-listening in Embodiment 1 of this invention The figure which showed the example of the operation content data of the edit operation assistance apparatus in Embodiment 1 of this invention The flowchart which showed the flow of the edit operation assistance apparatus at the time of the edit in Embodiment 1 of this invention The figure which showed the example of the production | generation of the edit information of the edit operation assistance apparatus in Embodiment 1 of this invention The flowchart which showed the flow of the edit operation assistance apparatus containing the correction process at the time of edit in Embodiment 1 of this invention The flowchart which showed the flow of the edit operation assistance apparatus at the time of the edit with respect to the unviewed video in Embodiment 1 of this invention

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Operation signal 102 Output signal 103 Network 110 Editing operation assistance apparatus 111 Input / output interface part 112 Control part (Operation content extraction means, operation data analysis means, video data editing means, editing information correction means, operation content automatic selection means)
112a operation unit 112b memory unit 113 storage unit (operation content storage unit)

Claims (6)

An operation content extraction step for extracting operation content from an operation signal generated from a user's viewing operation during viewing of the video, an operation content storage step for storing data of the extracted operation content, and the operation content at the time of video editing Editing including an operation data analysis step for generating editing information by analyzing the operation content data stored in the storage step, and a video data editing step for editing video based on the editing information generated in the operation data analysis step Operation assistance method. Based on the video feature extraction step for extracting the video feature amount, the video feature information storage step for storing the extracted video feature information, and the video feature information stored in the video feature information storage step when editing the video, The editing operation assisting method according to claim 1, further comprising an editing information correcting step of automatically correcting an editing point of the editing information generated in the operation data analyzing step. The operation content data stored in the operation content storage step is used to compare with the information held in the selected video, and the operation data is automatically selected from the stored operation content data. The editing operation assisting method according to claim 1, further comprising an operation content automatic selection step used for generation of editing information in the analysis step. An editing operation assisting device for editing data by the method according to any one of claims 1 to 3. A program for operating a computer including the method according to any one of claims 1 to 3. A medium on which the program according to claim 5 is recorded.

Images