[Description] [Invention Title]
FRAME INSPECTION APPARATUS OF MOVING PICTURE DATA AND METHOD THEREOF
[Technical Field]
The present invention relates to a frame test apparatus and a frame test method of moving image data, and, more particularly, to a frame test apparatus and a frame test method of moving image data that are capable of detecting abnormal phenomena generated in moving images and testing frames of the moving images based on the detection.
[ Background Art ]
Recently, with the development of video and audio signal processing technologies, various types of audio or video formats are proposed. In this context, moving image storage media or moving image reproduction media based on such formats are shown on the market. In general, in the case that moving images are processed, they are processed at a range of 30 frames per second in a National Television Standards Committee (NTSC) format, and at a range of 25 frames per second in Phases Alternating Line (PAL) or SECOM, in which NTSC, PAL and SECOM are television standards. Also, they can be processed at a range of 60 frames in an MPEG2 format DVD. On the other hand, if frames with identical pixel information are successive in the moving images, if a great deal of information is lost when moving images are compressed or if moving image data cannot be extracted from a moving image storage medium when the moving image storage medium is reproduced, abnormal moving images are reproduced. In the prior art, an examiner directly tests moving images from a moving
image reproduction device with the naked eye, in order to examine whether the moving image reproduction device outputs an abnormal moving image.
However, when testing performance of the moving image reproduction device with the naked eye, it is difficult to precisely determine an abnormal moving image.
Also, even if abnormal moving images are detected with the naked eye, since frames generating the abnormal moving images cannot be found out, the specific cause of the abnormalities present in the moving images cannot be determined. Accordingly, there exists a need to precisely detect whether any error frame is contained in a moving image storage medium contains or moving images can be reproduced from a moving image reproduction medium without any error, and to secure quality of the moving image storage medium or the moving image reproduction medium.
[Disclosure of Invention] [Technical Problem]
Therefore, it is an aspect of the invention to provide a frame test apparatus and a frame test method of moving image data that are capable of automatically testing states of moving images.
It is another aspect of the invention to provide a frame test apparatus and a frame test method of moving image data that are capable of detecting abnormal phenomena of moving images and storing information of error frames based on the detection.
[Technical Solution]
Additional aspects and/or advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
In accordance with an aspect of the present invention, the above and other objects can be accomplished by the provision of a frame test apparatus of moving image data comprising: a frame extracting unit for extracting a plurality of successive frames from reproduced moving images; and a frame comparator for comparing pixel information between the plurality of frames and testing states of reproduced moving images.
Preferably, the pixel information may be located at a common position of each frame.
Preferably, the pixel in the common position may be located at a specific horizontal line or a specific vertical line.
Preferably, the pixel information may be a sequence of bits to express levels of color components of red (R), green (G) and glue (B) composing a pixel.
Preferably, the pixel information may be a result value obtained as the sequence of bits pass through a band-pass filter. Preferably, the pixel information may include frequency components of the result value.
Preferably, the plurality of frames may include a first frame composing the moving images and a second frame successive to the first frame.
Preferably, the comparator determines that the moving image may be abnormal if the pixel information of each frame is identical or if the difference of pixel information of each frame is within a predetermined range.
Preferably, the frame test apparatus may further comprise an error frame manager for storing time information and image information of an error frame included in the moving images if there is an error in the moving images. Preferably, the frame test apparatus may further comprise an output unit for displaying time information of an error frame and image information through a graphic user interface (GUI).
Preferably, the GUI may include a portion indicative of time information of an error frame. Preferably, the GUI may include a portion indicative of image information corresponding to the time information of the error frame.
Preferably, the moving images may be outputted from a moving image storage medium or a moving image reproduction device such that the moving image storage medium or the moving image reproduction device is tested.
In accordance with another aspect of the present invention, there is provided a frame test apparatus of moving image data comprising: a frame extracting unit for receiving video signals and extracting a first frame from the video signals and a second frame successive to the first frame; and a frame comparator for extracting pixels corresponding to position information of common pixels in the first and second frames and comparing pixel information of the extracted pixels. In accordance with another aspect of the present invention, there is provided a frame test method comprising: extracting a plurality of frames successive in reproduced moving images; and comparing pixel information between the plurality of frames and testing state of the moving images.
Preferably, the pixel information is obtained at a common position of each frame.
Preferably, the pixel information includes a sequence of bits to express levels of color components of R, G, B composing a pixel, a result value obtained as the sequence of bits pass through a band-pass filter, or frequency components of the result value. In accordance with another aspect of the present invention, there is provided a frame test method comprising: receiving video signals and extracting a first frame from the video signals and a second frame successive to the first frame; extracting pixels corresponding to position information of common pixels in the first and second frames; and comparing pixel information of the extracted pixels. In accordance with another aspect of the present invention, there is provided a production line for fabricating a frame test apparatus of moving image data, comprising: a test device for automatically testing a state of electronic devices fabricated through the production line; a server for storing a test result transmitted from the test device; and a terminal for monitoring states of the production line based on the confirmation of the test result stored in the server.
Preferably, the electronic device includes a moving image reproduction
device.
In accordance with yet another aspect of the present invention, there is provided a method for monitoring a production line for fabricating an electronic device, comprising: automatically testing state of the electronic device fabricated in the production line; storing the test result in a server; and monitoring state of the production line based on confirmation of the test result stored in the server.
[Advantageous Effects]
As appreciated through the above aspects, since the frame test apparatus and the frame test method according to the present invention can compare pixel information between successive frames and automatically test states of the moving images, reliability of test results is relatively high.
Also, since the frame test apparatus and the frame test method according to the present invention can store information of error frames when moving images are reproduced, an examiner can easily determine the cause of the error frames.
[Description of Drawings]
These and/or other aspects and advantages of the invention will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a view illustrating a production line for a moving image reproduction device to which the present invention is applied; FIG. 2 is a view illustrating a test system for testing quality of moving images displayed on a screen, wherein the test system is aligned in the production line of FIG. 1 ;
FIG. 3 is a view illustrating a frame test apparatus of moving image data according to one embodiment of the present invention; FIG. 4 is a view illustrating another test system adopting the frame test apparatus of moving image data according to one embodiment of the present
invention;
FIG. 5 is a schematic block diagram of a frame test apparatus of moving image data according to one embodiment of the present invention;
FIG. 6 is a schematic block diagram of a frame test apparatus of moving image data according to one embodiment of the present invention, to receive a plurality of video signals and test frames of moving image screens;
FIG. 7 is a flowchart describing a frame test method of moving image data according to one embodiment of the present invention;
FIG. 8 is a flowchart describing processes of testing error frames in the frame test method of moving image data according to one embodiment of the present invention;
FIG. 9 is a flowchart describing processes of testing error frames using a frame test method of moving image data and providing the test result thereto;
FIG. 10 is a graphic user interface screen for receiving a video signal and detecting an error frame based on the received video signal using a frame test method of moving image data;
FIG. 11 is a normal screen outputted from a frame test apparatus of moving image data according to one embodiment of the present invention; and
FIG. 12 is an error frame test screen outputted from a frame test apparatus of moving image data according to one embodiment of the present invention.
[Best Mode]
Reference will now be made in detail to the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to like elements throughout. The embodiments are described below to explain the present invention by referring to the figures. More specifically, an apparatus and method for detecting error frames of moving image data (hereinafter, referred to simply as 'error frame") according to one embodiment of the present invention are described in detail below. FIG. 1 is a view illustrating a production line for a moving image
reproduction device to which the present invention is applied. More specifically, the production line serves to fabricate a moving image reproduction device such as a VCR, a DVD player, etc.
The production line 100 is roughly classified into four processes, which are an assembly process 105, a completion process 110, a testing process 115 and a shipment process 120. Also, work guideline providing devices 160, 162, and 164 for providing work guideline indicative of working contents of workers in each process, test systems 152, 154, and 156 for performing moving image screen tests, monitoring terminals 172 and 174 for monitoring information related to each process, and a server 150 for managing various information related to the production line 100 are connected to each other via an exclusive line for test, denoted by a solid line.
Here, since the server 150 is also connected to an external network, a remote user can access information for the production line 100 through a terminal 170. Also, a test condition editor 158 for recording or updating test conditions for a moving image screen test is connected to the external network. The test condition editor 158 may be located on the test exclusive line.
Referring to FIG. 1, each of the processes of the production line 100 is described in detail below. The assembly process 105 serves to assemble parts included in a VCR or DVD player into a finished product. After assembling, a forklift 180 carries the assembled product to a location for performing a completion process 110.
The completion process 1 10 serves to fabricate a moving image reproduction device using the assembled product and supplies power to the moving image reproduction device to tests its operations. Also, a moving image storage medium such as a video tape, a DVD or a video CD is loaded on the moving image reproduction device for moving image screen test. Here, the moving image storage medium should guarantee integrity.
The testing process 1 15 serves to test whether a moving image reproduction device can normally extract data from a moving image storage medium and provide a moving image screen thereto, which is characterized by the present invention.
The shipment process 120 serves to pack the moving image reproduction device having no defect, i.e., passing through the testing process 115, and then attach a box label. On the other hand, a defective moving image reproduction device, detected in the testing process 115, is deposited at a specific place for management.
Meanwhile, information related to the four respective processes 105, 1 10, 115 and 120 is shared via the exclusive line for test, denoted by a solid line, and may be stored in the server 150.
FIG. 2 is a view illustrating a test system for testing quality of moving images displayed on a screen, wherein the test system is aligned in the production line of FIG. 1. The test system includes a transporting device 200 such as a conveyor belt, a moving image reproduction device 210 including an output unit 215 for outputting audio/video signals, a control device 220 for operating the moving image reproduction device 210, a signal distributor 230 including an interface unit 235 for inputting audio/video signals from the output unit 215, and a testing device 240 for inputting moving image data from the signal distributor 230, analyzing the moving image data and performing a moving image quality test based on the analysis.
Operations of the test system of FIG. 2 are described in detail below. When the moving image reproduction device 210 is transported by a transporting device 200, the control device 220 operates the moving image reproduction device 210 to test a moving image quality test. Here, the control device 220 is implemented with a wireless remote controller. The frame test device 240 is controlled as an examiner directly manipulates the wireless remote controller or is automatically controlled as an examiner manipulates the wireless remote controller connected to the frame test device 240 to which test items are previously set. Here, the test items may be stored in the server 150 of FIG. 1 and then transmitted to the test systems 152, 154 and 156.
When the moving image reproduction device 210 is operated, moving image data loaded on an moving image storage medium in a previous process is readout from the moving image storage medium and then the output unit 215
outputs audio and video signals based on the readout image data. The outputted signals are collected at the signal distributor 230 through the interface unit 235. Although the signal distributor 230 is not illustrated in detail in FIG. 2, it includes more than two interface units 235 to simultaneously collect audio and video signals from a number of moving image reproduction devices.
The signal distributor 230 transmits collected data corresponding to the audio and video signals to the frame test device 240. The communication between the signal distributor 230 and the frame test device 240 is implemented with a parallel interface or high-speed serial interface such as IEEE 1394. The frame test device 240 analyzes collected moving image data of the collected data and determines whether the moving image reproduction device 210 normally reads image data based on the analysis. Also, the frame test device 240 provides a currently reproduced moving image screen and a test result of moving image screen to a display device (372 of FIG. 3) such as a monitor. If the frame test device 240 is testing more than two moving image reproduction devices, the display device (372 of FIG. 3) can simultaneously display test results through divided screens on a monitor screen.
On the other hand, collected results in the frame test device 250 can be stored in the server 150 through the exclusive line for test denoted by the solid line shown in FIG. 1.
FIG. 3 is a view illustrating a frame test apparatus of moving image data according to one embodiment of the present invention. The frame test apparatus 240 includes more than one central processing unit (CPU) 310. The CPU 310 is connected to system memories 320 and 330 and a plurality of other elements via a system bus 300. Here, the system bus 300 may be implemented with one of various bus types to communicate with electronic elements, including a memory bus or memory controller, peripheral bus, and a local bus including various bus types. For example, there has been known types of bus such as Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) but, Extended ISA (EISA) bus, Video Electronics Standard Association (VESA) local bus and Peripheral Component Interconnect (PCI) bus, which is also known as a Mezzanine
bus. A Read-Only Memory (ROM) 320 is connected to the system bus 330 and may store Basic Input/Output System (BIOS) for controlling basic functions of the apparatus.
An input/output (I/O) adapter 340 and a communication adapter 350 are connected to the system bus 300. The I/O adapter 340 is implemented with a small computer system interface (SCSI) adapter for communicating with a hard disc and a tape recording device. The communication adapter 350 connects the system bus 300 with an external network such that the frame test apparatus can communicate with other systems. A display device 372 is connected to the system bus 300 by a display adapter 370 and may be a graphic adapter to enhance performance of a graphic intensive application and a vide controller. According to one embodiment of the present invention, the adapters 340, 350 and 370 may be connected to more than one I/O bus connected to the system bus 300 through a bridge (not shown). A user interface adapter 360 serves to connect an input device, such as a keyboard 362 and a mouse 354, and a speaker 366 to the system bus 300.
The frame test apparatus 240 receives moving image data from the signal distributor 230 of FIG. 2 through the I/O adapter 340 or the communication adapter
350. Here, the received moving image data is analyzed by an application program for testing moving image data stored in the RAM 330. Also, currently reproduced moving image screens are provided to an examiner through the display adapter 370.
On the other hand, information for the tested moving image screens is stored in the hard disc through the I/O adapter 340. It may be also stored in the server 150 through the communication adapter 350 via the exclusive line for test as shown in FIG. 1.
FIG. 4 is a view illustrating another test system adopting the frame test apparatus of moving image data according to one embodiment of the present invention, in which the test system tests quality of a storage medium as moving image data stored in the storage medium are reproduced. Here, the storage medium should guarantee integrity.
The test system includes medium reproduction devices 410 and 420 for
playing moving image storage media 412 and 424, in which the medium reproduction devices 412 and 424 include output units 412 and 422 for outputting audio/video signals, respectively. Also, the test system includes a signal distributor 430 in which interface units 432 and 434 inputting audio/video signals from the output units 412 and 422 are installed. In addition, the test system includes a frame test apparatus 440 inputting and analyzing moving image data from the signal distributor 430 and performing a moving image quality test based on the analysis.
When more than two medium reproduction devices 410 and 420 in which moving image storage media 414 and 424 are installed are operated by an examiner (or are automatically operated), audio/video signals are outputted from the output units 312 and 422 of the medium reproduction devices 410 and 420. Since the procedure that the signal distributor 430 and the frame test apparatus 440 process the outputted audio/video signals is the same as that of FIG. 2, a detailed description is omitted following. FIG. 5 is a schematic block diagram of a frame test apparatus of moving image data according to one embodiment of the present invention. The frame test apparatus 240 includes a frame extraction unit 510 for receiving video signals of moving image signals and extracting successive frames composing the moving image screen, a frame comparator 520 for comparing pixel information of the extracted frames, an error frame manager 530 for storing information for an error frame based on the comparison result of the pixel information in the frame comparator 520, and an output unit 540 for providing the comparison result of the frame comparator 520 to the examiner.
The frame extracting unit 510 receives video signals which are generated based on extraction of information of moving images stored in moving image storage media such as a DVD or video signals from output terminals of various moving image reproduction devices such as a DVD player, a camcorder, etc. After that, the frame extracting unit 510 extracts two successive frames from the received video signals. For example, in case of a DVD player providing 60 frames per second, the extracting processes are performed as two successive frames of the 60 frames are extracted; the first and second frames of the 60 frames are extracted and
then the second and third frames are extracted, and so on.
Here, factors relating to extraction, such as a period of extracting frames, etc., are previously set by an examiner. In the case that video signals from the output terminals of the moving image reproduction device are received to test whether the moving image reproduction device can normally readout moving image data, a rim phenomenon should be removed from the moving image storage medium played by the moving image reproduction device. Also, the frame extracting unit 510 may be implemented with an image caption board of moving images.
After the frame extracting unit 510 extracts successive frames, the frame comparator 520 extracts pixels composing respective successive frames. Here, the frame comparator 520 may extract all pixels or pixels in a common area previously set by an examiner. The pixels in the common area may be located at a specific horizontal line or at a specific vertical line. Also, the pixels in the common area may be located at a horizontal line or in a vertical line within a predetermined area set by an examiner. As such the frame comparator 520 does not compare the entire pixels in the frames but only pixels at specific positions such as a horizontal line or a vertical line, thereby increasing testing reliability and decreasing test time.
Pixel information compared in the frame comparator 520 may be a sequence of bits allocated to color components of red (R), green (G) and blue (B) to determine levels of respective color components of R, G, and B constituting a pixel (for example, the sequence of bits is allocated by 8 bits to determine each level of color components of R, G, B) or a result value obtained as the sequence of bits passes through a band-pass filter. Also, the pixel information may be a value obtained by transforming the filtering result value into frequency components. Here, the transformation may be performed by signal processing such as a Fast Fourier Transformation (FFT).
After comparing pixel information of two successive frames extracted in the frame comparator 520, if the pixel information is identical to each other or if difference between the pixel information is within a predetermined range, it is determined that an error frame is present. After that, the error frame manager 530 stores reproduction time information of the error frame and image information of the
frame in image file formats, such as JPG. Therefore, an examiner can precisely recognize the error frame through information stored in the error frame manager 530.
On the other hand, the contents or result based on the comparison of pixel information in the frame comparator 520 may be transmitted to the output unit 540.
Here, the output unit 540 provides the contents or result in the text or graphic format to the display device 373 or prints in a predetermined format through a printer.
FIG. 6 is a schematic block diagram of a frame test apparatus of moving image data according to one embodiment of the present invention, to receive a plurality of video signals and test frames of moving image screens. The frame extracting unit 610 inputs more than one video signal and simultaneously extracts frames for a plurality of video signals. The frame comparator 620 compares frames extracted from each video signal using the same method of the frame comparator 520 of FIG. 5 and determines the presence or absence of the error frame based on the video signal.
On the other hand, the error frame manager 630 can classify and manage error frame storage spaces based on the number of the kinds of video signals received by the frame extracting unit 610. Also, the output unit 640 can divide the display screen into a number of areas equal to the number of video signals inputted from the frame extracting unit 610 such that it can simultaneously display the moving images through the divided screen.
FIG. 7 is a flowchart describing a frame test method of moving image data according to one embodiment of the present invention.
Firstly an application program is operated to test error frames in step S700, and a queue for temporarily storing frames is generated to extract error frames in step S720.
When generating the queue, processes for testing error frames are preformed in step S740. The application program provides the testing result to the examiner at every time when a test for error frames is terminated in step S760. After that, process of reproducing moving image screen is terminated or a frame detection process is terminated by examiner's selection in step S780.
FIG. 8 is a flowchart describing processes of testing error frames in the frame test method of moving image data according to one embodiment of the present invention. When generating the queue in step S720, a test for error frames is performed in step S740. When the frame test apparatus receives the moving image signals in step
5741, information for the received signals is temporarily stored in a buffer in step
5742. Here, the buffer is properly performed to control processing speed of the application program for detecting error frames and receiving speed of the moving images. The buffer is preferably located in the RAM 330 as shown in FIG. 3. In the case that a plurality of moving image signals are inputted, the number of buffers can be installed by the same as that of the inputted signals.
The application program extracts the moving image data from the buffer based on frame units in step S 743, and a window for reproducing frames is opened and the reproduced screen is provided to the examiner in step S744. The application program stores each reproduced frame in the queue, generated in step S720, in step S745. Here, frame information stored in the queue may include time information for reproduced frames, image information of frames, and position information for a particular portion in a frame, wherein the particular portion is tested, etc. Also, as shown in FIG. 6, the number of queues is generated by the same as that of inputted video signals if a plurality of moving image signals is inputted. Preferably, the queues are positioned in the RAM 330 of the frame test apparatus as shown in FIG. 3.
A method for discriminating error frames serves to extract pixels from successive frames composing moving images such that the pixels correspond to pixel position information previously set by an examiner, compare pixel information for the extracted pixels and determine whether error frames are present in step S 746. The pixel position information is based on horizontal line information or vertical line information of a moving image screen, in which the horizontal line or vertical line includes a plurality of pixels. If pixel information between two frames is identical (for example, if sequences of bits of R for the same portions in two successive frames are identical to each other) or if the difference between both pixel
information of the two successive frames is within a predetermine range previously set by the examiner, it is determined that an error frame occurs.
After the application program determines whether the error frame for the successive frames occurs in step S746, time information when the error frame is reproduced is stored in step S750. Here, the time information is synchronized with time information stored in the queue in step S745.
An application program, a thread generated by the application program, or a child processor extracts frames from the queue in step S747. After that the extracted frames are determined whether they have errors in step S748. Here, since a frame including time information identical to time information stored in step S750 is regarded as an error frame, the frame is deemed to be an error frame. In this case, the error frame manager 510 stores frame information for the error frame in step S749. Here, the frame information is frame information stored in the queue in step S745. FIG. 9 is a flowchart describing processes of testing error frame in the frame test method of moving image data and providing the test result. An examiner can confirm the testing result of the error frame using the error frame information stored in step S750.
The application for detecting the error frames displays, in order, time information for stored error frames in the graphic user interface or text format according to reproduction time in step S910. When time information is selected in step S920, the application generates a window and provides an image file based on the error frame in step S930.
FIG. 10 is a graphic user interface screen for receiving a video signal and detecting an error frame based on the received video signal using a frame test method of moving image data. The graphic user interface screen 1000 includes a portion 1010 indicative of time of reproducing frames including an error frame and a portion 1020 indicative of information for the queue temporarily storing frames in order to extract frames in which an error frame occurs. Here, the portion 1010 is implemented in step S910 as shown in FIG. 9.
When time information in the portion 1010 is clicked, image information of frame
corresponding to the clicked time information is provided to an examiner through a newly generated window as the application executing the GUI 1000 performs step S930 of FIG. 10. FIG. 11 is a normal moving image screen currently reproduced through an additionally generated window, and FIG. 12 is a screen for a detected error frame.
On the other hand, if all pixels between successive frames are compared with each other, a CPU 310 with high performance for processing a lot of data should be needed and system load can be relatively high. Therefore, the apparatus according to the present invention determines the presence and absence of an error frame as only the pixels selected by the examiner to determine are tested. For example, an examiner inputs the number of horizontal lines in a portion 1030, as shown in FIG. 10, such that the pixel information corresponding to the number of horizontal lines can be compared therewith, thereby determining an error frame.
Although a few embodiments of the present invention have been shown and described, it would be appreciated by those skilled in the art that changes may be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the claims and their equivalents.