JP2007124550A - Video-editing apparatus and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To edit video/audio data, while classifying signals for each specific phase in the middle of the video/audio data by stably detecting the phase, regardless of its length. <P>SOLUTION: A video-editing apparatus includes a receiving section 1 for receiving vide/audio data, and reproducing sections 3, 11, 14 for reproducing video/audio data. The video-editing apparatus then comprises a monochromatic frame detection section 11a for detecting a frame wherein an overall screen is monochromatic, in a video image; a frame position information recording section 11b for recording reproduction time information indicating a temporal position of the detected frame; and an editing section 11c for constructing a first file and a second file by classifying first video data, wherein a frame interval partitioned by the reproduction time information is settled within a predetermined time, and second video data with the frame interval over the predetermined time. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a video editing apparatus and method, and more particularly to an apparatus and method for detecting a specific signal section included in the middle of video / audio data and editing video / audio data.

Television broadcast signals are usually provided with commercial (CM) times at program boundaries or in the middle of the program. In the recording / reproducing apparatus, as a method for detecting the CM section, there is a method for detecting a black frame between the main part and a specific section which is a CM section. There is a technique for reproducing the main part while skipping the CM section based on the detection information of the CM section (for example, Patent Document 1). With this technique, normal playback is resumed when the skip time continues for a long time.
Japanese Patent Laid-Open No. 11-8835

  With the conventional specific section detection method, malfunction may occur depending on the content of the video, and improvement in reliability is desired. In addition, if the specific section continues for a long time, there is a problem that the conventional method automatically returns to normal reproduction.

  Therefore, in the present invention, the specific section is stably detected regardless of the length of the specific section (for example, the CM section) in the middle of the video / audio data, and the signal for each section is classified and edited, and the edited signal It is an object of the present invention to provide a video editing apparatus and method that facilitates handling.

  In order to achieve the above object, according to the present invention, a receiving unit that receives video / audio data, a recording unit that records the received video / audio data on a recording medium, and reproduces the recorded video / audio data; A monochrome frame detection unit for detecting a frame whose entire screen is monochrome in the video reproduced by the reproduction unit; a frame position information recording unit for recording reproduction time information indicating a time position of the detected frame; A file for the first video data, wherein the first video data in which the frame interval divided by the reproduction time information falls within a predetermined time and the second video data that does not fall within the predetermined time are classified. And an editing unit for constructing a file for the second video data.

  By the above means, it is possible to stably detect a specific section regardless of the length of the specific section, classify and edit signals for each section, and facilitate handling of the edited signal.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 shows a configuration example of a signal processing apparatus to which the present invention is applied. This signal processing apparatus can be applied to, for example, a digital television receiving apparatus or an information recording / reproducing apparatus.

  The tuner 1 receives, for example, a digital broadcast signal, demodulates the received signal, and supplies a demodulated output to the transport decoder 2. The video data / audio data of the program selected by the transport decoder 2 is input to an audio video (AV) decoder 3 for each packet and demodulated. The audio output demodulated by the AV decoder 3 is output to the output terminal 4A, and the video output is output to the output terminal 4P. The video data from the on-screen display (OSD) controller 6 may be synthesized with the video data at the output terminal 4P by the synthesis circuit 5.

  The direct RDRAM 7 is used for temporarily storing data from the AV decoder 3 or the OSD controller 6. The SDRAM 8 is used for temporarily storing data, for example, when performing error correction processing of a received signal. The EEPROM 9 is used, for example, for storing programs or parameters for executing the functions of the apparatus.

  Reference numeral 10 denotes a main bus, which is connected to the transport decoder 2, AV decoder 3, OSD controller 6, SDRAM 8, EEPROM 9, and the like. The main bus 10 is connected to a CPU 11 as a control unit that controls the apparatus. Furthermore, this apparatus can be connected to an external device via the bus 10. For this purpose, a modem interface 12a, a remote control interface 12d, and an ATAPI interface 12e are connected to the main bus 10. It is also possible to connect the hard disk drive 13 via the interface 12e. An AV encoder 14 is connected to the main bus 10 and can convert video data into a predetermined format (for example, DVD standard) for recording on a recording medium.

  Here, in the CPU 11, a frame position detection unit 11a, a frame position information recording unit 11b, and an editing unit 11c are provided. Furthermore, a silent section detector 11d is provided. A metadata adding unit 11e, a file selecting unit 11f, and a recording / reproducing control unit 11g are also provided.

  The tuner 1 and the transport decoder 2 function as a receiving unit that receives video / audio data. The AV decoder 3, the CPU 11, the encoder 14 and the like function as a playback unit that records received video / audio data on a recording medium and plays back the recorded video / audio data. The recording medium is the HDD 13, the memory 8, or the like.

  The frame detection unit 11a detects a frame whose entire screen is monochromatic in the video reproduced by the reproduction unit. The frame position information recording unit 11 b records reproduction time information indicating the detected time position of the frame in the HDD 13 or the memories 8 and 9. Then, the editing unit 11c classifies the first video data in which the frame interval divided by the reproduction time information falls within a predetermined time, and the second video data that does not fall within the predetermined time, and then classifies the first video data. The video data file and the second video data file are constructed. Further, the silent section detection unit 11d can detect that the voice level has become equal to or lower than a predetermined level for a predetermined time, detect a silent section, and generate time information indicating the section.

  The frame position recording unit 11b records the reproduction time information in the memory when the time of the frame detected by the monochromatic frame detection unit 11a and the time of the silent section overlap.

  FIG. 2 conceptually shows the arrangement of frames of the video stream 200. In the case of a monochromatic frame, since there is no picture, only a direct current component can be obtained even if differential processing is performed, for example. Further, the DC output of a specific color component continues for one frame period. Using this fact, a monochrome frame is detected. When a monochrome frame is detected, the reproduction time information is recorded in the memory. In the illustrated example, for example, the frames f1, f2, and f3 are monochromatic frames.

  FIG. 3 shows an example in which the reproduction time information of a monochrome frame is recorded when a predetermined condition is satisfied when the reproduction time information is recorded in the memory. In the example, the frames f3, f5, f6, and f7 of the video stream are continuously detected as single color frames. Here, the times between adjacent frames are T1, T2, and T3, respectively. Assume that T1 <A, T2 <A, and T3> A. That is, the time intervals T1 and T2 are each smaller than the threshold A, but the interval T3 is larger than the threshold B. In such a case, in this embodiment, the reproduction time information of the first and last frames of a section where intervals smaller than the threshold A are continuous is recorded.

  In this embodiment, for example, it is assumed that one commercial is shorter than a predetermined time (threshold A). However, even if a plurality of such commercials are continued for a long time, it is possible to detect the beginning and the end of the commercial section.

  FIG. 4 shows yet another embodiment. In this example, when the time interval between adjacent monochromatic frames is a multiple of a predetermined time, the continuous section is determined as the specific section. Assume that single-color frames f8, f9, and f10 are detected in the video stream. Here, it is assumed that the time interval between adjacent frames is T4 = 10 seconds and T5 = 20 seconds. Further, it is assumed that the predetermined time B referred to here is B = 10 seconds. Then, the continuous time intervals T4 and T5 are each a multiple of the predetermined time B. Therefore, the reproduction time information of f8 and f10 is recorded in the memory, assuming that the reproduction time information is the first and last frames of the CM section.

  FIG. 5 further shows another embodiment of the present invention. In this example, when the beginning and the end of a commercial section are specified, the video data of that section is given text data. The metadata adding unit 11e adds the text data. That is, the text data is stored in, for example, a memory in association with the reproduction time information. When the video data is played back, the text data is multiplexed with the video data and output in a specific section (originally the CM section). Of course, this embodiment may be combined with the embodiment described with reference to FIGS.

  Various embodiments of the replacement method for the specific section (CM section) are possible. During the playback of the video stream, when a specific section is reached, for example, a video of only text data is output, and the time is always constant.

  In each of the embodiments described above, as a condition for recording the reproduction time information in the memory, a silent section of the audio data is further detected, and the reproduction time information is recorded when the time of the silent section and the reproduction time overlap. It may be. Thereby, a specific area can be managed more accurately.

  FIG. 6 shows a state in which editing is performed by the editing unit 11c using the reproduction time information after detecting a specific section as described above. A specific section of the video stream 200 is determined. When editing is performed, a first file for video data and a second file for video data (CM video data) in the specific section are formed. The In the first file 201, video data of a specific section is extracted and the main video data is connected. In the second file 202, video data of the main part is extracted and video data (CM video data) of a specific section is connected. Of course, when both files are recorded on the recording medium, they are encoded and compressed by the encoder and recorded.

  7 and 8 are explanatory views showing still another embodiment of the present invention. As a method for detecting a specific section, in addition to the above-described embodiment for detecting a monochrome frame, fade-in and fade-out may be detected. In FIG. 7, the frame f30 is a single color frame, and the frames f26 to f29 are gradually darkened and fade in. Then, for example, a CM section is started after the monochrome frame f30. In FIG. 8, the frame f40 is a single color frame, the frames f41 to f45 are gradually brightened and faded out, and normal video data (main video data) continues.

  In the apparatus of the present invention, when it fades in and becomes a monochromatic frame, it is the start position of the CM section, and when it fades out from the monochromatic frame and becomes the main video, the monochromatic frame position is the end position of the CM section. Is determined. Then, the reproduction time information of the frame at the start position and the reproduction time information of the frame at the end position are recorded in the memory as judgment information of the specific section.

  FIG. 9 shows an example of the format of management information recorded in the memory together with the reproduction time information in the above embodiment. First, a recording area 901 for a frame identifier of a monochrome frame is secured. In the example of FIG. 2, they are f1, f2, and f3. 3 are f4 and f6, f8 and f10 are described in the example of FIG. 4, and f11 and f12 are described in the example of FIG. Next, an area 902 for recording reproduction time information is secured. Next, a text data recording area 903 is secured. The text data is, for example, information such as the program name of the next main part (or chapter) and performers. Therefore, this text data may be input by the user, or may be acquired from electronic program information and recorded.

  The next recording area 904 describes an identifier for identifying the screen direction described with reference to FIG. For example, “1” is described when the previous frame from the frame fades in, and “2” is described when the subsequent frame from the frame fades out. Note that fade-in / fade-out detects changes in the average brightness of each frame of video data, detects a section that gradually changes from high brightness to low brightness, detects a section that changes gradually from low brightness to high brightness, It can be readily determined by detecting a decrease and an increase in level.

  FIG. 10 is a flowchart showing an operation example in the embodiment of the apparatus of the present invention. This operation is an example of creating management information, and the management information creating unit 11b1 may be included in the frame position information recording unit 11b.

  When the editing processing operation is started, initialization of a counter and the like is performed (step SA1), and processing is started for the designated program. The designated program may be video / audio data received by the receiving unit. Further, the designated program may be a signal obtained by reproducing the video / audio data recorded on the recording medium by the reproduction unit.

  It is determined whether there is a frame to be inspected (step SA2). It is determined whether or not the frame is a single color frame (step SA3).

  If a monochrome frame is detected, whether the audio level is below a predetermined value and whether a period satisfying the predetermined level has continued for a predetermined period, and whether the time when the monochrome frame is detected are within the predetermined period. Determine (step SA4). When this condition is satisfied, management information relating to the current monochromatic frame is recorded in the memory (step SA5).

  Next, when there are a plurality of management information for a single color frame, it is determined whether or not the value of the interval measurement timer that measures the time interval between the previous management information and the current management information is equal to or less than a predetermined threshold A. (Step SA6).

  If it is greater than or equal to the predetermined value A, the monochrome frame counter is set to 1 (step SA7). The frame at this time becomes the head candidate of the CM section. Next, for example, CM is described in the text data of the management information (step SA8). Next, the text data of the management information of the previous monochrome frame is emptied (step SA9).

  If the value of the interval measurement timer is smaller than the predetermined value A in step SA6, 1 is added to the monochrome frame counter (step SA11), and the process proceeds to the next step SA12. In step SA12, it is determined whether or not the value of the monochrome frame counter is equal to or less than a predetermined number. If it is equal to or less than the predetermined number, in this example, the interval measurement timer is initialized assuming that the CM section continues (step SA13), and the process returns to step SA2. In step SA12, if the value of the monochrome frame counter exceeds a predetermined number, the management information corresponding to the previous monochrome frame is deleted, and the current management information is saved. The management information this time is set as the last frame of the CM section.

  As described above, according to the present invention, it is possible to stably detect a specific section regardless of the length of the entire specific section, classify and edit signals for each section, and easily handle the edited signal. In order to detect a silent section, means for monitoring the level of audio data is used.

  Of course, the single color may be any color such as black, white, dark blue, or gray. Further, a predetermined number of single-color frames are counted in step SA12 in FIG. 10. For example, this number is three. 3 and FIG. 4, the predetermined value A and the predetermined time B are set, but this value Aha is, for example, 60 seconds, and B is 10 seconds or 15 seconds.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

It is a figure which shows the block configuration of the signal processing apparatus to which this invention was applied. It is explanatory drawing of the video stream shown in order to demonstrate one Embodiment of this invention. It is explanatory drawing of the video stream shown in order to demonstrate other embodiment of this invention. It is explanatory drawing of the video stream shown in order to demonstrate further another embodiment of this invention. It is explanatory drawing of the video stream shown in order to demonstrate other embodiment of this invention. It is explanatory drawing of the video stream and file shown in order to demonstrate further another embodiment of this invention. It is explanatory drawing of the video stream shown in order to demonstrate other embodiment of this invention. It is explanatory drawing of the video stream shown in order to demonstrate further another embodiment of this invention. It is explanatory drawing which shows the example of the format of the management information employ | adopted by this invention. 3 is a flowchart shown for explaining an operation example of the present invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Tuner, 2 ... Transport decoder, 3 ... AV decoder, 14 ... AV encoder, 11 ... Control part (CPU), 11a ... Monochromatic frame detection part, 11b ... Frame position information recording part, 11c ... Editing part, 11d ... Silent section detecting unit, 11e... Metadata adding unit, 11f.

Claims (15)

A receiver for receiving video / audio data;
A recording unit for recording received video / audio data on a recording medium, and reproducing the recorded video / audio data;
A monochrome frame detection unit for detecting a frame whose entire screen is monochrome in the video reproduced by the reproduction unit;
A frame position information recording unit for recording reproduction time information indicating a time position of the detected frame;
The first video data in which the frame interval divided by the reproduction time information falls within a predetermined time and the second video data exceeding the predetermined time are classified, and a file for the first video data An image editing apparatus comprising: an editing unit that constructs a file for the second image data. A silent section detecting unit for detecting that the voice level is equal to or higher than a predetermined time and lower than a predetermined level;
2. The video according to claim 1, wherein the frame position recording unit records the reproduction time information when a time of a frame detected by the monochrome frame detection unit overlaps a time of the silent section. Editing device.   The frame position recording unit, when the interval between a predetermined number of consecutive frames detected by the monochrome frame detecting unit is equal to or less than a predetermined threshold A, respectively, reproduces the start time and the last frame of the consecutive frames. 2. The video editing apparatus according to claim 1, wherein the information is stored as management information.   4. The video editing apparatus according to claim 3, wherein text data is added to the video data between the reproduction time information of the first and last frames by a text data adding unit.   The frame position recording unit reproduces the first and last frames of the continuous frame when the interval between the predetermined number of frames detected by the monochrome frame detection unit is a multiple of a predetermined time B, respectively. 2. The video editing apparatus according to claim 1, wherein the time information is stored as management information.   6. The video editing apparatus according to claim 5, wherein text data is added to the video data between the playback time information of the first and last frames by a text data adding unit.   The editing unit connects a plurality of the classified first video data as commercial video data and stores them in the first file, and connects the second video data as a main video data and connects the second video data. The video editing apparatus according to claim 1, wherein the video editing apparatus is a file.   The frame position recording unit, when the interval between a predetermined number of consecutive frames detected by the monochrome frame detecting unit is equal to or less than a predetermined threshold A, respectively, reproduces the start time and the last frame of the consecutive frames. When the information is stored as management information, or the interval between a predetermined number of consecutive frames detected by the monochrome frame detection unit is a multiple of a predetermined time B, the beginning and end of the consecutive frames 8. The video editing apparatus according to claim 7, wherein any one of the reproduction time information of the frames is stored as management information.   9. The video editing apparatus according to claim 8, wherein text data is added to the video data between the reproduction time information of the first and last frames by a text data adding unit.   2. The frame position detection unit includes a fade-in detection unit that detects a fade-in state that shifts to a monochromatic frame, and the time when the fade-in state changes to a single-color frame is set to the beginning of the specific section. The video editing apparatus described.   The frame position detection unit includes a fade-in detection unit that detects a fade-in state that shifts to a first monochromatic frame, and when the fade-in state is detected, the first monochromatic frame is set to the beginning of a specific section, A fade-out detection unit that detects a fade-out state that shifts from a single-color frame to a normal frame including a picture, and when the fade-out state is detected, the second single-color frame ends at the specific section. Item 1. The video editing apparatus according to Item 1.   The frame position recording unit reproduces the start and last frames of the consecutive frames when the interval between the predetermined number of frames detected by the monochromatic frame detection unit is a predetermined threshold value of 60 seconds or less, respectively. 2. The video editing apparatus according to claim 1, wherein the time information is stored as management information.   The frame position recording unit is configured such that when the interval between a predetermined number of consecutive frames detected by the monochromatic frame detecting unit is a multiple of a predetermined time of 10 seconds or 15 seconds, respectively, 2. The video editing apparatus according to claim 1, wherein the reproduction time information of the first and last frames is stored as management information.   2. The video editing apparatus according to claim 1, wherein the single color detected by the frame detection means is any one of black, white, dark blue, and gray. A receiving unit for receiving video / audio data, a playback unit for recording the received video / audio data on a recording medium, and reproducing the recorded video / audio data, a monochromatic frame detecting unit, and a frame position information recording unit And an editorial department,
The monochrome frame detection unit detects a frame whose entire screen is monochrome in the video reproduced by the reproduction unit,
The frame position information recording unit records reproduction time information indicating a time position of the detected frame,
The editing unit classifies the first video data in which the frame interval divided by the reproduction time information falls within a predetermined time and the second video data that exceeds the predetermined time, and the first video data A video editing method comprising: building a data file and the second video data file.

Images