KR20050015720A - Error frame detecting appatrus of moving picture data and method thereof - Google Patents

Abstract

PURPOSE: An apparatus and a method for detecting an abnormal frame of moving picture data are provided to detect an abnormal phenomenon of a moving picture by extracting pixel information of each frame and comparing pixel information, and separately store information related to an abnormal frame, thereby improving the accuracy of an inspection result and increasing the reliability of a moving picture. CONSTITUTION: A frame extracting unit(510) receives a video signal among moving picture signals, and extracts consecutive frames configuring a moving picture. A frame comparing unit(520) extracts predetermined pixels configuring the consecutive frames for comparing pixel information corresponding to the pixels. If an abnormal frame is generated, an error frame managing unit(530) stores information related to the abnormal frame. An output unit(540) provides contents of the comparison to a user.

Description

ERROR FRAME DETECTING APPATRUS OF MOVING PICTURE DATA AND METHOD THEREOF}

The present invention relates to detection of abnormal frames of moving picture data, and more particularly, to an apparatus and method for detecting an abnormal phenomenon occurring in a moving picture screen using pixel information of each frame constituting a moving picture.

With the development of audio and video signal processing technologies, various types of audio or video formats have been proposed, and video storage media or video playback media using the formats have emerged. In general, the video screen provides 30 frames per second for NTSC (National Television System Committee), which is one of the color television systems, and 25 frames per second for PAL (Phase Alternation Line) or SECAM. In the case of DVD, 60 frames per second are provided, and frames of the same information are continuously contiguous between each frame, a large amount of information is lost when compressing the video data, or the video data stored in the video storage medium during playback of the video storage medium is normal. If it doesn't, it will play an abnormal video. In the related art, since such a phenomenon is visually discriminated, it is difficult to accurately determine an abnormal video screen, and even if found through the human eye, it is very difficult to accurately select a frame in which an abnormal video screen occurs.

Accordingly, there is a need to automatically detect whether an abnormal frame is included in the moving picture storage medium or whether the moving picture playback medium can be played without generating an abnormal screen, thereby ensuring the quality of the moving picture storage medium or the moving picture reproducing medium.

The present invention has been made to solve the above problems, by extracting and comparing the pixel information for each frame constituting the video screen to detect the abnormal phenomenon of the video screen according to the change of the pixel information, the phenomenon occurs An apparatus and method for separately storing information about a frame are provided.

In order to achieve the above object, an apparatus for detecting an abnormal frame of moving picture data according to an embodiment of the present invention receives a video signal and extracts a predetermined first frame and a second frame consecutive to the first frame from the signal. And an extractor, and a frame comparator configured to extract pixels corresponding to common pixel position information of the extracted first frame and the second frame, and compare pixel information of the extracted pixels. Preferably, the pixel position information includes line information.

Preferably, the apparatus for detecting an abnormal frame of the moving picture data includes an error frame storing frame time information and a frame image file of the first frame and the second frame when a result of comparing the pixel information falls within a predetermined error range. It further includes a management unit. In this case, preferably, the image file may further include an output unit for providing a graphic user interface, wherein the graphic user interface includes an area indicating a time at which an abnormal frame is detected, and selects a time at which an abnormal frame is detected. The apparatus further includes an area for providing an image corresponding to the selected time information.

In order to achieve the above object, an abnormal frame detection method of moving picture data according to an embodiment of the present invention receives a video signal, and extracts a predetermined first frame and a second frame continuous to the first frame from the signal; A first step may include extracting a pixel corresponding to the common pixel position information of the extracted first frame and the second frame, and a third step of comparing pixel information of the extracted pixel. Preferably, the pixel position information includes line information.

Preferably, the method for detecting an abnormal frame of the moving image data includes a fourth method of storing frame time information and a frame image file of the first frame and the second frame when a result of comparing the pixel information is within a predetermined error range. It further comprises a step. In this case, the method may further include a fifth step of providing the image file to the graphical user interface. Preferably, the graphical user interface includes an area indicating a time at which an abnormal frame is detected. When the time at which an abnormal frame is detected is selected, the graphic user interface may further include an area for providing an image corresponding to the selected time information.

Hereinafter, an apparatus and method for detecting an abnormal frame (hereinafter, referred to as an “abnormal frame” in the description of the present invention) of moving image data according to an embodiment of the present invention will be described with reference to the accompanying drawings.

1 is an exemplary view showing a product production line to which the present invention can be applied, and more particularly, a line for producing a device capable of playing a video screen such as a VCR and a DVD player (hereinafter referred to as a 'video playback device'). It is shown.

The production line 100 may be roughly divided into four steps, an assembly process 105, a completion process 110, an inspection process 115, and a shipment process 120. In addition, the work manual providing device 160, 162, 164 for providing a work guide indicating the work contents of the workers in each process step, the inspection system 152, 154, 156 for inspecting a video screen, and information on each process step are monitored. Monitoring terminal devices 172 and 174 that can be connected to the server 150 for managing and providing a variety of information associated with the production line 100 is connected via a dedicated test line indicated by the solid line in FIG. Meanwhile, since the server 150 is connected to an external network separately from the inspection-only line, it is possible to access information on the production line 100 through the monitoring terminal device 170 from the outside. The test condition editing apparatus 158 for registering or updating the content of the test condition for inspection of the moving picture screen is also connected to the external network, and the test condition editing apparatus 158 may be located on the inspection-only line. .

Looking at each process step of the production line 100 shown in Figure 1 in detail as follows.

The assembly process 105 is a process of assembling the components constituting the VCR or DVD player device. When the assembly of the components is completed, the assembled product is transferred to the completion process 110 using the material balance 180.

Completion process 110 is to create a complete video playback device using the assembled product, and to connect the power for the operation of the device. In addition, a video storage medium such as a video tape or a DVD or a video-CD is loaded into the apparatus for inspecting a moving picture screen. At this time, the video storage medium should be guaranteed the integrity (integrity).

The inspection step 115 is a step of checking whether the moving picture reproducing apparatus normally extracts data of the moving picture storage medium to provide a moving picture screen, and is a step to which the present invention can be applied.

In the shipment process 120, the device in which no defect is found in the inspection process 115 is packaged and a box label is attached. The device in which the defect is found in the inspection process 115 may be collected and managed separately.

Information about the assembly process 105, the completion process 110, the inspection process 115, the shipping process 120 may be shared through the inspection-only line indicated by the solid line in Figure 1, the information is a server Can be stored at 150

FIG. 2 is an exemplary view showing an inspection system arranged on the product production line of FIG. 1 to inspect the quality of a moving picture screen.

The inspection system includes a moving device 200 such as a conveyor belt and an output unit 215 for outputting an audio / video signal and a control device 220 for operating the moving picture reproducing device 210. And a signal divider 230 including an interface unit 235 for receiving an audio / video signal from the output unit 215, and receiving video data from the signal divider 230 and analyzing the data. The apparatus may include an abnormal frame detection apparatus 240 that performs quality inspection of a video screen, and a display apparatus 250 that provides the inspection result to the inspector.

Looking at the operation of the inspection system shown in Figure 2 in detail as follows.

When the moving image reproducing apparatus 210 is moved by the carrying apparatus 200, the moving image reproducing apparatus 210 is operated by using the control apparatus 220 to check the quality of the moving image screen. At this time, the control device 220 may be a wireless remote control device, the inspector directly manipulates the wireless remote control, or pre-set the test items to the abnormal frame detection device 240, the abnormal frame detection device ( 240 may be connected to the wireless remote control device to automatically operate the remote control. The inspection item may be stored in the server 150 illustrated in FIG. 1 and then transferred to the inspection system 152, 154, or 156.

When the video reproducing apparatus 210 is operated, video data is read from the video storage medium loaded in the previous step, and an audio or video signal is output through the output unit 215. The output signal is collected by the signal distributor 230 through the interface unit 235. Although not shown in FIG. 2, the signal splitter 230 may include two or more interface units 235 to collect audio or video signals from several video reproducing apparatuses at one time.

The signal splitter 230 transmits data about the collected signal to the abnormal frame detection apparatus 240. At this time, the data communication may be implemented as a parallel interface or a high speed serial interface such as IEEE1394.

The abnormal frame detection apparatus 240 analyzes the collected video data to determine whether the video reproducing apparatus 210 normally reads the video data. In addition, the abnormal frame detection apparatus 240 provides the inspector with the video screen currently being played and the video screen inspection result through the display device 250 such as a monitor. If two or more video playback devices are being inspected, the display device may provide the inspector with a test result for each video playback device by dividing the screen. In this case, the abnormal frame detection apparatus 240 may include the signal splitter 230 or the display apparatus 250.

On the other hand, the result collected by the abnormal frame detection apparatus 240 may be stored in the server 150 through the inspection-only line shown in solid line in FIG.

3 is an exemplary view showing a hardware configuration of the abnormal frame detection apparatus 240 according to an embodiment of the present invention.

The abnormal frame detection apparatus 240 has one or more central processing units 310. The CPU 310 is coupled to the system memories 320 and 330 and various other elements via the system bus 300. The system bus 300 may then be any of several forms of bus structures including a memory bus or a memory controller, a peripheral bus, and a local bus using any of a variety of bus structures. It may be of. For example, such a bus structure may include an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an improved ISA (EISA) bus, and the Video Electronics Standards Association. Association (VESA) local bus, and Peripheral Component Interconnect (PSI) bus, also known as Mezzanie bus. Read Only Memory 320 may be a basic input / output system (BIOS) that is coupled to the system bus 330 and controls certain basic functions of the device.

3 also shows I / O adapter 340 and communication adapter 350 coupled to system bus 300. I / O adapter 340 may be a small computer system interface (SCSI) adapter that communicates with a hard disk or tape storage device. The communication adapter 350 interconnects an external network and a system bus 300 to allow the abnormal frame detection apparatus to communicate with other systems. The display device 372 is connected to the system bus 300 by the display adapter 370 and may include a graphics adapter to enhance the performance of the graphics intensive application and the video controller. In one embodiment, the adapters 340, 350, 370 may be connected to one or more I / O buses that are connected to the system bus 300 via an intermediate bus bridge (not shown).

The user interface adapter 360 connects an input device such as a keyboard 362, a mouse 364, or a speaker 366 to the system bus 300.

The abnormal frame detection apparatus 240 receives video data from the signal splitter 230 shown in FIG. 2 through the I / O adapter 340 or the communication adapter 350. In this case, the received video data is analyzed by an application program for inspecting video data stored in the RAM 330. At this time, the video screen currently being played may be provided to the inspector through the display adapter 370.

Meanwhile, the information about the inspected video screen may be stored in the hard disk through the I / O adapter 340, and may be stored in the server 150 through the communication dedicated line through the inspection-only line shown in FIG. 1 through the communication adapter 350. Can be stored.

4 is a diagram illustrating another inspection system to which an apparatus for detecting an abnormal frame according to an exemplary embodiment of the present invention is applicable, and illustrates a system for inspecting a quality of a storage medium by reproducing a storage medium in which moving image data is stored. At this time, the reproduction apparatus for reproducing the storage medium should ensure integrity.

The inspection system includes media playback devices 410 and 420 for playing video storage media 414 and 424 including outputs 412 and 422 for outputting audio / video signals, and audio / video signals from the outputs 412 and 422. Signal distributor 430 including an interface unit 432, 434 receiving the input and the abnormal frame detection device that receives the video data from the signal distributor 430, and analyzes the data to perform a quality check of the video screen 440 and a display device 450 that provides the test result to the inspector.

The inspector directly or automatically reproduces the two or more media playback devices 410 and 420 loaded with the video storage media 414 and 424. When the media player 410 or 420 performs an operation, an audio / video signal is output through the output units 412 and 422. The process of the output signal is processed by the signal splitter 430, the abnormal frame detection device 440, the display device 450 is the same as the process shown in FIG. In this case, the abnormal frame detection device 440 may include the signal splitter 430 or the display device 450.

5 is an exemplary view showing a logical block diagram of an abnormal frame detection apparatus according to an embodiment of the present invention, the video data abnormal frame detection apparatus 500 receives a video signal of the video signal, and constitutes a video screen In the frame extracting unit 510 and the frame comparing unit 520 extracting predetermined pixels constituting the continuous frame and comparing pixel information corresponding to the pixels. An error frame management unit 530 that stores information about the abnormal frame when the abnormal frame is generated as a result of comparing pixel information, and an output unit 540 which provides the user with the contents compared by the frame comparing unit 520. It can be configured as.

The frame extractor 510 receives a video signal generated by extracting video information included in a digital video storage medium such as a DVD or output signals of various digital video playback devices such as a DVD player or a digital camcorder. In this case, the frame extractor 510 extracts a continuous frame from the received video signal. For example, in the case of a DVD player providing 60 frames per second, a continuous frame may be extracted by extracting the first and second frames of the 60 frames and then extracting the second and third frames. In this case, the period of extracting the frame may be set in advance by the inspector. When the video reproducing apparatus receives a video signal from an output terminal of the video reproducing apparatus in order to check whether the video reproducing apparatus can normally read the video data, the video storage medium reproduced by the video reproducing apparatus should not have a rim phenomenon. In addition, the frame extractor 510 may be implemented using a video image caption board.

After the frame extractor 510 extracts the consecutive frames, the frame comparator 520 extracts the pixels constituting each continuous frame. At this time, all the pixels may be extracted, or pixels corresponding to common pixel position information preset by the inspector may be extracted. In this case, the pixel position information may be position information of pixels located on a specific horizontal line, or position information of pixels located on a specific vertical line, and may be located on a horizontal line or a vertical line included in a predetermined range designated by an inspector. It may also be position information of pixels located.

The frame comparison unit 520 extracts a pixel and then compares pixel information with respect to the pixel, wherein the pixel information is a predetermined bit string constituting the pixel, or the band-passed extracted pixel ( Band-pass) may be a result obtained by passing through the filter, and may be frequency information about the result. The frequency information can be obtained by a signal processing method such as fast fourier transform (FFT).

After comparing the pixel information of two consecutive frames extracted by the frame comparator 520, if the pixel information is the same or an error within a preset range by the inspector, it is determined that an abnormal frame has occurred, and an error frame The management unit 530 stores the play time information of the abnormal frame and the image of the frame in the form of an image file such as .jpg. The inspector can accurately identify the abnormal frame through the information stored in the error frame manager 530.

On the other hand, the content or the result of the pixel information compared by the frame comparison unit 520 may be transmitted to the output unit 540, where the output unit 540 is a monitor (not shown) in the form of text or graphics It can be provided to the inspector through the printer, or saved in the form of a report, and the printer can be printed out.

6 is an exemplary diagram illustrating a logical block diagram for detecting an abnormal frame of a video screen by receiving a plurality of video signals according to another embodiment of the present invention, and the frame extractor 610 receives one or more video signals as inputs. To extract frames for multiple video signals at the same time. The frame comparator 620 compares the extracted frames in the same manner as the frame comparator 520 shown in FIG. 5 to determine whether an abnormal frame is present. The error frame manager 630 may classify and manage error frame storage spaces corresponding to the types of video signals received by the frame extractor 610. In addition, the output unit 640 may divide and display the displayed screen by a video signal input to the frame extractor 610.

When the inspector starts the application program for checking the abnormal frame (S700), a queue for temporarily storing the frame is extracted to extract the abnormal frame (S720).

When the queue is generated, a process for checking an abnormal frame is performed (S740). The application provides a test result to the examiner whenever the inspection of the abnormal frame is ended, and the playback of the moving picture screen is terminated or the abnormal frame detection process is terminated by the inspector's selection (S760).

8 is a flowchart illustrating a process of checking an abnormal frame according to an embodiment of the present invention. When a queue is generated (S720), an abnormal frame check is performed (S740).

When the abnormal frame detection apparatus receives the video signal (S810), temporarily stores data information on the received signal in the buffer (S815). At this time, the buffer serves as a buffer between the processing speed of the application for detecting the abnormal frame and the speed of receiving the video signal, and is preferably located in the RAM 330 shown in FIG. 3. When a plurality of video signals are input, buffers may be generated as many as the number of input signals.

The application may extract video data from the buffer in units of frames (S820), open a window for playing the frame, and provide a screen to be played to the inspector (S830).

The application stores each frame to be reproduced in a queue generated in step S720 (S830). In this case, frame information may be stored in the queue, and the frame information may be inspected when the time information at which the frame is played, the image file information of the frame, and a specific portion of the frame are inspected. The location information may be included. In addition, when the plurality of video signals are input as shown in FIG. 6, the queue is generated by the number of input signals. Preferably, the RAM 330 of the bad element processing apparatus shown in FIG. 3 is used. )

The method for determining an abnormal frame includes extracting a pixel corresponding to pixel position information preset by an inspector from successive frames constituting a moving image screen, comparing pixel information about the extracted pixel, and then determining whether an abnormal frame has occurred. Determine. The pixel position information uses horizontal line or vertical line information of a video screen, and thus the number of pixels is plural. If the pixel information is the same or within an error range preset by the inspector, it is determined that an abnormal frame is generated (S835).

After the application determines whether an abnormal frame is generated for a continuous frame (S835), the time information on which the frame is reproduced is separately stored for the abnormal frame (S840). The time information is synchronized with the time information stored in the queue in step S830.

The application or a thread or child processor generated by the application sequentially extracts frames from the queue (S845). In this case, the frame including the same time information as the time information stored in step S840 can be regarded as an abnormal frame, it is regarded as an error frame. In this case, the frame information for the error frame is stored separately. In this case, the frame information may be frame information stored in a queue in step S830.

9 is a flowchart illustrating a method of providing an abnormal frame inspection result according to an exemplary embodiment of the present invention. An inspector may check the abnormal frame inspection result using the error frame information stored in operation S955.

The application for detecting an abnormal frame sequentially displays time information on the stored error frame according to the reproduced time in the form of a graphic user interface or text (S910). At this time, if the examiner selects the time information, the application generates a separate window to provide an image file for the error frame (S940).

FIG. 10 is an exemplary diagram illustrating a graphical user interface 1000 for detecting an abnormal frame by receiving a single video signal according to an embodiment of the present invention, wherein the region indicating the time at which a frame including the abnormal frame is reproduced ( 1010 and an area 1020 indicating information on a queue for temporarily storing a frame in order to extract a frame in which an abnormal frame has occurred.

At this time, the region 1010 representing the time information is implemented in step S910 shown in FIG. At this time, when the examiner clicks on any time information in the region, the application that executes the graphical user interface 1000 performs an operation S930 shown in FIG. 10 to display an image of a frame corresponding to the time information clicked on by the examiner. The file will be provided in a separate window. FIG. 11A illustrates a normal video screen currently being played through a separate window, and FIG. 11B illustrates a screen on which an abnormal frame is detected.

On the other hand, comparing all the pixels between successive frames requires a CPU 310 having a high performance processing capability and may take a lot of system load. Therefore, an efficient inspection may not be performed. Therefore, an abnormal frame only for pixels selected by the inspector It can be determined whether or not. For example, the inspector inputs the number of horizontal lines for obtaining pixel information, such as 1030, and compares the pixel information corresponding to the number to determine whether the frame is abnormal.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited to drawing.

By using the apparatus and method for detecting abnormal frame of moving picture data according to the embodiment of the present invention, it is possible to automatically determine abnormal moving picture screen of minute parts, and by storing information about abnormal frame, it is possible to improve the accuracy of inspection result and reliability of moving picture screen. There is an effect that can be increased, unattended automatic inspection.

1 is an exemplary view showing a product production line to which the present invention can be applied.

FIG. 2 is an exemplary view showing an inspection system for inspecting the quality of a moving picture screen disposed on the product production line of FIG. 1.

3 is an exemplary diagram illustrating a hardware configuration of an apparatus for detecting an abnormal frame of video data according to an embodiment of the present invention.

 4 is an exemplary view illustrating another inspection system to which an apparatus for detecting an abnormal frame of video data according to an embodiment of the present invention is applicable.

5 is a logical block diagram of an apparatus for detecting an abnormal frame according to an embodiment of the present invention.

6 is an exemplary diagram illustrating a logical block diagram of an apparatus for detecting an abnormal frame of a video screen by receiving a plurality of video signals according to another embodiment of the present invention.

7 is a flowchart illustrating a method of detecting an abnormal frame of a video screen according to an embodiment of the present invention.

8 is a flowchart illustrating a process of inspecting an abnormal frame according to an embodiment of the present invention.

9 is a flowchart illustrating a method of providing an abnormal frame inspection result according to an embodiment of the present invention.

10 is an exemplary diagram illustrating a graphical user interface for detecting an abnormal frame by receiving a single video signal according to an embodiment of the present invention.

11A is an exemplary diagram illustrating a normal screen of an apparatus for detecting an abnormal frame according to an embodiment of the present invention.

11B is an exemplary view illustrating a screen on which an abnormal frame detection apparatus detects an abnormal frame according to an embodiment of the present invention.

* Description of the symbols for the main parts of the drawings *

200: conveying device

210: video playback device

230: signal splitter

240: abnormal frame detection device

250: display device

Claims (18)

A frame extracting unit which receives a video signal and extracts a predetermined first frame and a second frame continuous to the first frame from the signal; Apparatus for detecting abnormal frames of moving image data including a frame comparator for extracting pixels corresponding to common pixel position information of the extracted first and second frames and comparing pixel information of the extracted pixels The method of claim 1, Apparatus for detecting abnormal frames of video data, wherein the pixel position information is line information The method of claim 1, The pixel information is an abnormal frame detection apparatus for moving picture data including the continuous digital bit information constituting the pixel The method of claim 1, The pixel information is an abnormal frame detection device of the moving picture data to be a result obtained by band-pass filtering the extracted pixel The method of claim 4, wherein The pixel information is abnormal frame detection apparatus of the moving picture data including the frequency information on the result value The method of claim 1, When the result of comparing the pixel information is within a predetermined error range, the frame error detection apparatus further comprises an error frame management unit for storing the frame time information and the frame image file of the first frame and the second frame The method of claim 6, Apparatus for detecting abnormal frames of moving image data further comprising an output unit for providing the image file to a graphical user interface Following the claim 7, The graphic user interface includes an abnormal frame detection apparatus for moving image data including an area indicating a time at which an abnormal frame is detected. Following the claim 8 The graphic user interface may further include an area for providing an image corresponding to the selected time information when the time when the abnormal frame is detected is selected. A first step of receiving a video signal and extracting a predetermined first frame and a second frame continuous to the first frame from the signal; Extracting a pixel corresponding to common pixel position information of the extracted first frame and the second frame; And The abnormal frame detection method of the moving picture data including a third step of comparing the pixel information for the extracted pixels The method of claim 10, The method of detecting an abnormal frame of video data, wherein the pixel position information is line information. The method of claim 10, The pixel information is an abnormal frame detection method of the moving picture data comprising the continuous digital bit information constituting the pixel The method of claim 10, The pixel information is an abnormal frame detection method of the moving picture data to be a result obtained by band-pass filtering the extracted pixel The method of claim 13, The pixel information is abnormal frame detection method of the moving picture data comprising the frequency information for the result value The method of claim 10, If the result of comparing the pixel information falls within a predetermined error range, further comprising a fourth step of storing frame time information and a frame image file of the first frame and the second frame; The method of claim 15, Method for detecting abnormal frames of the moving picture data further comprising the step of providing the image file to the graphical user interface Following the claim 16, The graphical user interface may detect an abnormal frame of moving image data including an area indicating a time at which an abnormal frame is detected. Following the 17 When the graphic user interface selects a time when an abnormal frame is detected, the graphic user interface further includes a region for providing an image corresponding to the selected time information.