JP2006033733A - Method and device for inspectng moving image of electric product - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method for inspecting moving images of an electric product to inspect whether the moving images of the inspected object are consistent or not. <P>SOLUTION: In the method for inspecting moving images of the electric product, a reference moving image consisting of two or more still images and a moving image of the inspected object consisting of two or more still images are investigated to see if they are consistent, and consistency/inconsistency of the moving images of the inspected object is determined. In this method, more than one still images of the reference moving image are selected, it is determined whether a frame consistent with the selected still image exits in a frame of the moving image of the inspected object or not based on the previously set threshold, and it is determined that the reference moving image is consistent with the moving image of the inspected object if all selected still images exit in the frame of the moving image of the inspected object. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention examines the consistency between a reference moving image consisting of a plurality of still images and a moving image of a subject to be inspected consisting of a plurality of still images, and judges a match / mismatch of the moving images of the subject to be inspected. The present invention relates to a method and a moving image inspection apparatus for an electric product suitable for carrying out such a moving image inspection method for an electric product.

  Recently, as information terminals such as mobile phones and other electrical products, a liquid crystal display unit has been provided so that movies can be played on the liquid crystal display unit, and received videos can be played back. Things are widely available.

  Before shipping such an electrical product from the factory, a quality / reliability test is conducted to determine whether the display screen can accurately play back the video at startup and whether the received video can be played back correctly. Has been done.

  By the way, as a method of comparing moving images, for example, a plurality of moving image data is synchronized, each is reproduced as a video, and the reproduced video is synthesized and displayed, thereby comparing the videos. A recording medium on which an apparatus and a video comparison program are recorded has already been proposed.

  FIG. 9 is a block diagram schematically showing a configuration of a conventional video comparison apparatus, FIG. 10 is a conceptual diagram showing an outline of functions of the video comparison apparatus shown in FIG. 9, and FIG. 10 is a flowchart showing an outline of the operation of the video comparison apparatus shown in FIG.

  The video comparison apparatus 101 includes an MPU 104, a memory 112, a hard disk drive (HDD) 109, a mouse 108, an input processing unit 110 that inputs user instructions from input means such as a keyboard 106, and a display device 105. A display control unit 111 that generates an image to be displayed on the display screen 105a and a video input unit 102 that inputs a video (moving image) from the outside are provided.

  The video comparison apparatus 101 includes a first recording unit 109a that records first moving image data, a first time setting unit that displays a specific time in the first moving image data, and a second moving image. Second recording means 109b for recording image data, second time setting means for displaying a specific time in the second moving image data, and each recording means according to the setting of the time setting means. Synchronizing means 114 for reading moving image data, video reproducing means 113a and 113b for reproducing videos from the read moving image data, synthesizing means 115 for synthesizing videos reproduced by the video reproducing means, and synthesis And a display screen 105a for displaying the video synthesized by the means 115.

  In the video comparison apparatus 101, as shown in FIGS. 11 and 12, two moving image data are synchronized to reproduce each video, and the reproduced video is synthesized and displayed.

More specifically, in this video comparison apparatus 101, the instructor's sliding image and the instructor's sliding image are imaged using an imaging means, and the instructor's sliding image ((A) in FIG. 12), Play the synchronized video of the instructor's plan ((B) in Fig. 12), compare the instructor's status with the instructor's status, and examine the instructor's plan Can be done.
JP 2001-186471 A

  However, the above-described conventional video comparison apparatus 101 determines whether or not two videos match with each other by observing the video synthesized by the synthesizing unit 115 by a person using this device. It is assumed that two videos are moving in the same way.

In addition, in this image comparison apparatus 101, two different images (the instructor's sliding image ((A) in FIG. 12) and the instructor's sliding image ((B) in FIG. 12)) are synchronized. It is premised on playing.
For this reason, such as the quality control department of an electric product equipped with a liquid crystal display or the like, whether the display screen can accurately reproduce the moving image at the start-up and whether or not the received moving image can be accurately reproduced. In areas where quality and reliability tests are performed many times over a long time, a large number of people are required for confirmation and human error (for example, oversight) occurs. There is a problem that it cannot be introduced.

  In addition, when a situation occurs in which a product that cannot be played back is played, such a product becomes a defective product in the market, so an electrical product that does not send such a defective product to the market. It is now possible for unattended machines to perform quality / reliability tests, such as whether or not the display screen can correctly play a video at startup and whether or not the received video can be played correctly. Development of a moving image inspection method for electric products and a moving image inspection apparatus for electric products is desired.

  Moreover, in the above-mentioned conventional image comparison apparatus 101, two different images (the instructor's sliding image ((A) in FIG. 12) and the instructor's sliding image ((B) in FIG. 12)) are displayed. For example, as shown in FIG. 13, if there is a difference between the playback times of two moving images, all the video information is different. Even if the video comparison device 101 is used to play back the video of two identical videos and can be performed unattended by a machine, the display screen of the electrical product plays back the video accurately at startup. Even if it is a product that is not a defective product that can be reproduced or that the received video can be accurately reproduced, there is a possibility that it may be judged as a defective product. Video inspection It is difficult to use as the location, there is also a problem that.

  The present invention has been made to solve the above-described problems. Before shipping from the factory, whether or not the display screen of the electrical product can accurately reproduce the moving image at the time of start-up is received. The quality and reliability tests such as whether or not the reproduced video can be reproduced accurately can be performed by an unmanned machine, and the video playback time to be compared is different and all video information is different. In order to provide a moving image inspection method for electric products and a moving image inspection apparatus for electric products, in which the display screen operates normally but does not recognize this as a defective product. Yes.

  The method of inspecting a moving image of an electric product according to claim 1 checks the coincidence between a reference moving image composed of a plurality of still images and a moving image of an object to be inspected composed of a plurality of still images. In the video inspection method for electrical appliances for determining inconsistencies, one or more reference video still images are extracted, and whether or not a frame that matches the extracted still image is in the frame of the video to be inspected is set in advance. The determination is made based on the threshold value, and if it is determined that all the extracted still images are in the frame of the moving image to be inspected, it is determined that the reference moving image matches the moving image to be inspected.

The method of inspecting a moving image of an electric product according to claim 2 shoots a certain moving image displayed on the display screen of the electric product which is a standard of quality / reliability test, and from the start to the end of the captured moving image. Multiple still images are extracted from the images, and the video is played back on the display screen of the electrical product that is the subject of the quality / reliability test, and each of the still images is sequentially selected as the subject of the quality / reliability test. The moving image being reproduced on the display screen of the electrical product is captured and compared with the frame of the captured moving image, and the matching ratio between a certain frame of the captured moving image and a frame corresponding to each of a plurality of still images is determined in advance. When it is within the set threshold range, it is determined that the still image and a certain frame of the captured moving image match, and all of the plurality of extracted still images are in the frame of the moving image to be inspected. If judged, quality / reliability test On the display screen of the electronic products in question, and so it is determined that, video playback is correct.
The moving image inspection method for an electrical product according to claim 3 is a method of rearranging a plurality of extracted still images in the order of appearance of the moving image inspection method for an electrical product according to claim 1 or 2, In the order of appearance, a moving image being reproduced is displayed on the display screen of the electrical product that is the subject of the quality / reliability test, the frames of the captured moving image are compared in the order of appearance of the frames, and one of the still images When it is determined that the image matches a certain frame of the captured moving image frame, the next still image is compared with the next frame of the certain frame of the captured moving image frame.

  The moving image inspection method for an electric product according to claim 4 is configured such that the threshold used in the moving image inspection method for an electric product according to any one of claims 1 to 3 is red, green, and blue, which are the three primary colors of light as a pixel comparison. The threshold value is preset for the total number of pixels exceeding the permissible error density for all the pixels of the frame for which the permissible error density is preset and compared.

The video inspection apparatus for electrical products according to claim 5 is a quality / reliability test standard and an imaging unit for imaging a display screen of the target electrical product, and a quality / reliability test standard imaged by the imaging unit. And display means for displaying the moving image displayed on the display screen of the target electric product, and the start and end of the moving image displayed on the display screen of the electric product used as a reference for the quality / reliability test imaged by the imaging means The means to extract multiple still images from the previous images and the video is played back on the display screen of the electrical product that is the subject of the quality and reliability test, and each of the multiple still images is sequentially quality and reliable. The moving image reproduced on the display screen of the electrical product to be subjected to the property test is captured by the imaging means, and is compared for each frame of the captured moving image, and each frame of the captured moving image and each of the plurality of still images With the corresponding frame When the matching ratio is within a preset threshold range, a determination unit that determines that a still image and a certain frame of the captured moving image match, and a determination unit includes a plurality of extracted still images When it is determined that everything is in the frame of the moving image to be inspected, it is determined that the moving image is correctly reproduced on the display screen of the electrical product to be subjected to the quality / reliability test. I made it.
The moving image inspection apparatus for electrical products according to claim 6 is further characterized by that the moving image inspection apparatus for electrical products according to claim 5 further rearranges a plurality of extracted still images in order of appearance, and a plurality of extracted Each of the still images is rearranged in the order of appearance by the image rearrangement means, and in the order of appearance, the moving image being reproduced on the display screen of the electrical product subject to the quality / reliability test is captured, and the captured moving image Comparing in order of appearance of frames frame by frame, and determining means for determining that one image of a still image matches a certain frame of a captured moving image frame; Comparing means for comparing the next still image from a frame next to a certain frame of the captured moving image frame when it is determined that the frame matches a certain frame of the captured moving image frame.

  The moving image inspection device for an electrical product according to claim 7 is a frame of the captured moving image in which the determination unit of the moving image inspection device for the electrical product according to claim 5 or 6 is configured such that one image of the still image is captured. The threshold for determining that the frame matches a certain frame of the image is set as a permissible error density for each of the three primary colors red, green, and blue as a pixel comparison, and the still image to be compared and all the pixels of the frame are compared. This is a threshold set in advance for the total number of pixels exceeding the allowable error density.

  The moving image inspection apparatus for an electric product according to claim 8 is a moving image to be displayed on a display screen as a reference and a quality / reliability test standard of the moving image inspection apparatus for an electric product according to any one of claims 5 to 7. Storage means for storing information for calling the site, and external input means input operation means for inputting information for calling the moving image site stored in the storage means to the external input means of the electrical product.

  In the moving image inspection method for an electrical product according to claim 1, one or more still images of a reference moving image are extracted, and whether or not a frame that matches the extracted still image is in a frame of a moving image to be inspected. Judgment is made based on a preset threshold, and if it is determined that all the extracted still images are in the frame of the moving image to be inspected, it is determined that the reference moving image and the moving image to be inspected match. Therefore, the inspection of the moving image of the electric product can be performed by an unmanned machine with accuracy.

  The method of inspecting a moving image of an electric product according to claim 2 does not judge whether or not the moving image is correctly reproduced on the display screen based on a difference between the two images by reproducing the two images synchronously. Since each frame of the moving image is sequentially compared for each image selected from the moving image, although the two images are reproduced without being synchronized, there is no problem in the operability of the display screen. Therefore, it is not determined that the inspection target is a defective product that cannot reproduce the display screen of the electrical product.

  In addition, in this moving image inspection method, when comparing one image selected from the moving image and each frame of the moving image, a threshold value is used instead of visual observation. Quality and reliability tests such as whether or not the moving image can be accurately reproduced and whether or not the received moving image can be accurately reproduced can be performed by an unmanned machine.

The method of inspecting a moving image of an electrical product according to claim 3, wherein the plurality of extracted still images are arranged in the order of appearance, and each of the still images is displayed in the order of appearance of the electrical product to be subjected to the quality / reliability test. Since the video being played is captured on the screen and compared for each frame of the captured video, whether or not the display screen of the electrical product can play the video correctly at startup and received The time required for quality / reliability tests, such as whether or not the video can be accurately reproduced, can be reduced.
5. The method of inspecting a moving image of an electric product according to claim 4, wherein for each image selected from the moving image, the threshold value used when sequentially comparing each frame of the moving image is compared with the shape and size of the two pieces of image information to be compared. Rather, RGB allowable error densities (density threshold values) for the three primary colors of RGB are set for each of RGB, and then a threshold value (pixel threshold value) for the RGB total count of the number of pixels exceeding the set allowable error density ) Is set. Since this pixel threshold value is used to determine whether the extracted individual still images match or not, there is no need to recognize each of a plurality of still image information and each frame of the moving image.

  An electric product moving image inspection apparatus according to claim 5 defines an electric product moving image inspection device that implements the electric product moving image inspection method according to claim 1 or claim 2, and includes two images. The video displayed on the display screen of the electrical product captured by the imaging means, rather than determining whether the video is correctly played back on the display screen due to the difference between the two images Since the means for extracting a plurality of still images from the image from the start to the end of the image compares one image selected from the plurality of frames constituting the moving image with each frame of the moving image, As a result of the images being reproduced without being synchronized, the inspection object is not determined to be a defective product that cannot reproduce the display screen of the electrical product, although there is no problem in the operability of the display screen.

  Further, in this moving image inspection apparatus, the means for extracting a plurality of still images from the image from the start to the end of the moving image displayed on the display screen of the electric product captured by the image capturing means includes a plurality of moving images. When comparing one image selected from the frame with each frame of the moving image, a threshold value is used instead of visual observation, so that the display screen of the electric product can reproduce the moving image accurately at startup In addition, quality and reliability tests such as whether or not the received moving image can be accurately reproduced can be performed by an unmanned machine.

  The moving image inspection apparatus for an electrical product according to claim 6 sequentially reproduces each of the plurality of still images arranged in the order of appearance on the display screen by the image rearranging unit that rearranges the extracted plurality of still images in the order of appearance. Compared to each frame, the display screen of the electrical product can play back the movie correctly at startup, whether the received movie can be played back correctly, etc. The time for quality and reliability tests can be shortened.

  8. The moving image inspection apparatus for an electrical product according to claim 7, wherein RGB allowable error densities (density threshold values), which are the three primary colors of light, are set for each of RGB, and then the RGB of the number of pixels exceeding the set allowable error density A threshold value (pixel threshold value) is set for the total count. Since this pixel threshold value is used to determine whether the extracted individual still images match or not, there is no need to recognize each of a plurality of still image information and each frame of the moving image.

  The apparatus for inspecting video of electrical products according to claim 8 can automatically call a video site to be displayed on the display screen of the target product and the standard of quality / reliability test by the apparatus. Therefore, quality and reliability tests, such as whether or not the display screen of the electrical product can play the video correctly at startup and whether or not the received video can be played correctly, are started from the video site call stage. Can be done by machine, unattended.

  Hereinafter, an example of a moving image inspection method for an electrical product according to the present invention and an apparatus for carrying out the method will be described in more detail with reference to the drawings.

  FIG. 1 is a block diagram schematically illustrating an example of the configuration of a moving image inspection apparatus for electrical products according to the present invention.

FIG. 2 is an explanatory view schematically showing the concept of the moving image inspection method for electric products according to the present invention, and FIG. 3 is stored in the storage unit of the moving image inspection device for electric products shown in FIG. FIG. 4 is a flowchart schematically showing an example of a moving image inspection program, and FIG. 4 is a detailed flowchart for checking a match between a still image indicated by A in FIG. 3 and a frame.
The moving image inspection apparatus 1 for an electrical product includes an imaging unit 2 that captures an image of a display screen Sa of an electrical product (in this example, a mobile phone that supports video) S, and an arithmetic processing unit 3.

  The arithmetic processing unit 3 includes a control device 4 including an arithmetic processing unit and a storage unit, a display unit 5, and an external input unit 6 having a numeric keypad, function keys, character input keys, and other keys.

  Further, in this example, although not particularly limited to those shown below, a CCD camera (solid-state imaging unit) is used as the imaging unit 2.

  Moreover, the moving image inspection apparatus 1 of the electric product includes a voice input unit 9 for acquiring the sound of the electric product (mobile phone that supports moving images in this example) S. In this example, a microphone is used, although not particularly limited to the following.

  In the moving image inspection apparatus 1 for electrical products, the quality and reliability test standards and the target electrical product S are installed in a predetermined place of the moving image inspection apparatus 1 for electrical products.

  The quality and reliability test standards and the target electrical product S are installed in a dark box 10 indicated by a two-dot chain line in order to block external light, other disturbances, and the like.

  In FIG. 1, a member device denoted by 7 includes an external input means input operation means for pressing and operating a key input unit (external input means for the electric product S) Sb of an electric product (a mobile phone that supports moving images in this example) S. Show.

  In this example, as the external input means input operation means 7, actuator means such as pneumatic, hydraulic or electromagnetic is provided so as to correspond to the number of key input sections (external input means of the electrical product S) Sb. Is used.

  The moving image inspection apparatus 1 for electrical products is installed in a place where the temperature and humidity are kept constant in order to maintain the quality and reliability of the inspection.

  The standard of the quality / reliability test and the target electric product S are such that the display screen Sa falls within the field of view of the imaging means 2 and the key of the electric product (in this example, a mobile phone that supports moving images) S Each input unit (external input unit of the electrical product S) Sb is set so that each actuator unit of the external input unit input operation unit 7 can be correctly pushed.

  The external input means input operation means 7 stores information (access information, usually a telephone number or an Internet homepage address) for calling a moving image site in the storage unit of the arithmetic processing means 3, and the arithmetic processing means When a call signal is input from the storage unit 3 or the external input means 6, information for calling a video site (access information, usually a telephone number or an Internet homepage address) The key input unit (external input means of the electrical product S) Sb of the S is configured to be pressed so as to dial (input).

  In the video inspection device 1 of the electrical product, the key input unit (external input means of the electrical product S) Sb of the electrical product (in this example, a mobile phone that supports video) S is called and displayed by dialing (input). The moving image displayed on the screen Sa is picked up by the image pickup means 2, and the moving image picked up by the image pickup means 2 is stored in the storage unit of the arithmetic processing means 3 (more specifically, the control device 4). Yes.

  The moving image captured by the imaging unit 2 and stored in the storage unit of the arithmetic processing unit 3 (more specifically, the control device 4) is displayed on the display unit 5.

  In this video inspection apparatus 1 for electrical products, a person who performs a quality / reliability test of the electrical product S uses, for example, the mouse 8 and displays images (from the start to the end of the video displayed on the display means 5). A plurality of still images can be extracted from a plurality of frames).

  More specifically, the moving image inspection apparatus 1 for electrical appliances includes a determination screen shown in FIG. 5 and a parameter setting screen shown in FIGS. 6 and 7, and selection of a determination screen by a screen selection key. The parameter setting screen can be selected.

  When extracting a plurality of still images from a moving image, a parameter selection screen is selected using a screen selection key.

  Then, the moving image displayed on the display screen Sa of the electric product S captured by the imaging unit 2 is displayed in the moving image display area P1 of the display unit 5 of the arithmetic processing unit 3.

  An icon of an operation key is provided at the lower part of the moving image display area P1, and the image receiving frame portions F1, F2, F3, F4, F5, extracted from the moving image are displayed in the horizontal position of the moving image display area P1. F6, F7, F8, F9, and F10 are provided.

  In this example, as the operation keys, the reproduction key K1, the pause key K2, the rewind key K3, the fast forward key K4, the stop key K5, and still images extracted from the moving images are stored in the image storage frames F1, F2, F3, respectively. , F4, F5, F6, F7, F8, F9, and F10, an OK key F21, and a cancel key F22 that once cancels a still image selected from the moving image.

  Further, below the moving image display area P1, the number of moving image frames stored in the storage unit of the arithmetic processing unit 3 (more specifically, the control device 4) and the moving image currently displayed in the moving image display area P1 are displayed. The frame number is displayed.

  Further, in this example, an image is captured by the imaging unit 2 stored in the storage unit of the arithmetic processing unit 3 (more specifically, the control device 4) in the horizontal position where the operation key icon is provided. The file name of the moving image and the file name of the moving image captured by the image pickup means 2 when performing the quality / reliability test of the display unit Sa of the electrical product S to be tested are displayed in a two-stage format. It has become.

  In this example, a maximum of 10 frames can be extracted as a still image for determination from a moving image, but the number of still images serving as determination points is limited to 10. Never happen.

  In the moving image inspection apparatus 1 of the electric product, when extracting each still image used as a determination point from each frame of the moving image, a person who performs a quality / reliability test of the electric product S, for example, The mouse 8 is used to click the reproduction key K1, and the moving image displayed on the moving image display area P1 of the display unit 5 is picked up by the image pickup unit 2, and the moving image picked up by the image pickup unit 2 is calculated by the arithmetic processing unit 3 (more specifically, The moving image stored in the storage unit of the control device 4) is reproduced.

  Then, during playback of a moving image, a frame to be extracted as a still image is selected with the mouse 8 and input to each of the image storage frame portions F1, F2, F3, F4, F5, F6, F7, F8, F9, and F10. .

  The information input to each of the image storage frame portions F1, F2, F3, F4, F5, F6, F7, F8, F9, and F10, together with the frame number, is sequentially calculated by the arithmetic processing means 3 (more specifically, the control device). 4).

  In the moving image inspection apparatus 1 for an electrical product, an image rearranging unit (not shown) is provided in the arithmetic processing unit 3, and images (a plurality of frames) from the start to the end of the moving image are provided by the image rearranging unit. Each of the plurality of still images extracted from is rearranged in the order of appearance of the moving images.

  In this example, for example, the frame numbers of a plurality of still images extracted from a moving image are arranged in ascending order, so that they are rearranged in the order of appearance of the moving image.

  Therefore, when a plurality of still images are extracted from an image (a plurality of frames) from the start to the end of the moving image displayed on the display means 5, a plurality of image storage frame portions (in this example) shown in FIG. Then, in each of the image storage frame portions F1, F2, F3, F4, F5, F6, F7, F8, F9, and F10, the image storage frame portions F1, F2, F3, F4, F5, F6, F7, F8, and F9 are included. It is not necessary to store images (a plurality of frames) from the start to the end of the moving image in the order of F10 as still images in the order of reproduction.

  In the moving image inspection apparatus 1 of the electrical product, each of the plurality of still image information extracted from the image from the start to the end of the moving image displayed on the display screen of the electrical product S, which is captured by the imaging unit 2, A unique ID is assigned, the light is separated into three primary colors of red, green, and blue light, and stored in the arithmetic processing means 3 as the number of red pixels, the number of green pixels, and the number of blue pixels.

  Further, when setting a threshold value used when performing a quality / reliability test of whether or not a moving image can be accurately reproduced on the display screen Sa of the electrical product S, a display means is used by using a screen selection key. 5. Call the parameter setting screen shown in FIG.

  Then, for each of the still images extracted in each of the image storage frame portions F1, F2, F3, F4, F5, F6, F7, F8, F9, and F10, an allowable error of RGB (red green blue) that is the three primary colors of light Density (density threshold value) is set for each of RGB, and then a threshold value (pixel threshold value) is set for the RGB total count of the number of pixels exceeding the set allowable error density. Based on this pixel threshold value, matching / mismatching of the extracted individual still images is determined.

  In this example (refer to the parameter setting shown in FIG. 7), the icon key K6 for setting the red density threshold in the range of 0 to 255 and the green density threshold in the range of 0 to 255 are set. And an icon key K8 for setting a blue density threshold in the range of 0 to 255, and an icon key K9 for setting the pixel threshold in the range of 0 to 1000. The density threshold values for red, green, and blue operate each of the icon key K6, icon key K7, and icon key K8, and the pixel threshold value operates the icon key K9. The threshold values designated by the icon keys K6 to K9 are stored in the storage unit of the arithmetic processing means 3 (more specifically, the control device 4) by clicking the OK key F23. .

  On the other hand, when the set threshold value is changed once, when the cancel key F24 is clicked, the permissible ranges of the number of red pixels, the number of green pixels, and the number of blue pixels can be initialized.

  In FIG. 7, the density threshold values of red, green, and blue are set to 10 and the pixel threshold value is set to 300. Therefore, first, the number of pixels in which red exceeds ± 10 from the reference density is checked, then the number of pixels in which green exceeds ± 10 from the reference density, and then blue exceeds ± 10 from the reference density. Check the number of pixels. If the total number of these pixels exceeds 300, it is determined that the still images do not match.

  When the above threshold value setting operation is finished and the OK key F23 is clicked, the determination screen shown in FIG.

  In FIG. 5, each of F1, F2, F3, F4, F5, F6, F7, F8, F9, and F10 is an image storage frame portion that displays a plurality of still images, which is used as a determination point on the determination screen. Each of F11, F12, F13, F14, F15, F16, F17, F18, F19, and F20 is an image storage frame portion that displays each frame of a moving image to be inspected, and F25 is a determination start key for starting determination. , L1 indicates a comprehensive determination lamp for displaying a determination result.

  Next, using the external input means input operation means 7, information (access information, usually a telephone number or an Internet homepage address) stored in the storage unit of the arithmetic processing means 3 for calling a video site is Input to the key input unit (external input means for the electrical product S) Sb of the product S.

  Alternatively, when a moving image is stored in the memory of the electrical product S, the external input unit input operation unit 7 is used to store the moving key reproduction key pressing operation information stored in the storage unit of the arithmetic processing unit 3. The key input unit (external input means for the electric product S) Sb of the electric product S is input.

  In this electrical product moving image inspection apparatus 1, a moving image displayed on the display screen of the electrical product S is captured by the imaging unit 2 by operating the key input unit (external input unit of the electrical product S) Sb of the electrical product S. Extracted from the frames from the start to the end of the moving image displayed on the display screen Sa of the electrical product S, which was previously imaged by the imaging unit 2. The threshold value set for each of the plurality of still image information is compared.

  More specifically, in the moving image inspection apparatus 1 for an electrical product, the key input unit (external input means for the electrical product S) Sb of the electrical product S is operated to display on the display screen of the electrical product S. The moving image is imaged by the imaging means 2. Then, a frame of a captured moving image that matches the extracted still images is sequentially searched.

  As shown in the flowcharts of FIGS. 3 and 4, in this method, first, the red density of each pixel is set with respect to the reference density (the density of the extracted still image) for the first frame of the captured moving image. Whether the density threshold value (density threshold value in FIG. 7) has been exceeded is checked, and the number of pixels exceeding the density threshold value is counted. Next, similarly for green and blue, the number of pixels exceeding the density threshold is counted. If the total number of pixels exceeding the density threshold exceeds a set threshold (pixel threshold in FIG. 7), it is determined that the extracted still image does not match the frame, and the next frame Check for match / mismatch for.

  If the set pixel threshold value is not exceeded, it is determined that the frame matches the extracted still image, and the next extracted still image is searched for a frame of the captured moving image that matches from the next frame. At this time, values set for each extracted still image are used as the density threshold and the pixel threshold.

  This is repeated, and if there is a frame that matches all the extracted still images, it is determined that the moving image being reproduced on the display screen Sa of the electric product S is being reproduced normally. If there is at least one extracted still image that does not match the frame, it is determined that the moving image reproduced on the display screen Sa of the electric product S is not normally reproduced.

  Next, an example of an inspection method of the moving image inspection apparatus 1 for an electrical product will be described in more detail using a flowchart.

  3 and 4 are flowcharts schematically showing an example of a moving image inspection program stored in the storage unit of the moving image inspection apparatus 1 for an electrical product shown in FIG.

  FIG. 4 is a subroutine showing details of step 32 in FIG. 3, and is a flowchart for determining whether one extracted still image (reference image) matches one frame (inspected image). FIG. 3 is a flowchart for performing the operation of FIG. 4 on all the extracted still images and determining whether or not the moving image to be inspected is acceptable.

  First, FIG. 4 will be described. In performing the operation of FIG. 4, the arithmetic processing means 3 (more specifically, the control device 4) sets various variables, and stores the set variables in a register (not shown) in the arithmetic processing means 3. (Step S11). This variable will be described. The variable i is the number of the pixel that executes the process, and the initial value is 1. The variable GN is the total number of pixels, and this corresponds to the number of effective pixels (the number of pixels used for imaging) of the imaging means 2 (CCD camera in this example). The variable RGB indicates whether the color being processed is R (red) / G (green) / B (blue). If RGB = 1, R represents RGB, and RGB = 2 represents G. = 3 indicates processing for B. The array variable error (RGB) indicates the number of errors of each color. For example, when RGB = 2, error (2) is obtained and the number of G errors is obtained. The initial value of error (1) is 0, the initial value of error (2) is 0, and the initial value of error (3) is 0. The variable error indicates the total number of R / G / B errors, and the initial value is 0.

  The variable Tn is the number of the extracted still image for executing processing. The array variable T (Tn, RGB) indicates the R / G / B density threshold value of each extracted still image. For example, when Tn = 3, RGB = 1, T (3, 1) is 3 The density threshold value of R of the first extracted still image is shown. The array variable T (Tn) indicates the R / G / B pixel threshold value of each of the extracted still images. For example, when Tn = 2, T (2) indicates the pixel threshold value of the second extracted still image. . The array variable T (Tn, RGB, i) indicates the density of each R / G / B pixel of each extracted still image. For example, when Tn = 5, RGB = 3, i = 200, T (5, 3, 200) indicates the density of the 200th pixel of B of the fifth extracted still image.

  The variable Fn is a frame number for executing the process. The array variable F (Fn, RGB, i) indicates the density of each R / G / B pixel in each frame. For example, when Fn = 20, RGB = 3, i = 200, T (20 , 3, 200), indicating the density of the 200th pixel of B in the 20th frame.

  When the setting of step 1 is completed, the arithmetic processing means 3 is designated by the density of the pixel designated by the variable i and the density designated by the variable Tn of the color designated by the variable RGB in the frame having the number designated by the variable Fn. The absolute value of the density difference of the pixel specified by the variable i of the color specified by the variable RGB of the extracted still image of the number specified by the variable RGB is obtained, and the extracted still image of the number specified by the variable Tn is obtained. It is checked whether or not the density is equal to or less than the density threshold value of the color designated by the variable RGB (step S12).

  After step S12, if the variable i is not GN, that is, if the pixel number being processed is not the final number (N in step S13), the variable i is incremented (added by 1) (step S14), Next, the pixel number to be processed is set, and the process returns to step S12. If the pixel number being processed is the final number (Y in step S13), the variable i is set to 1 (step S15), and whether or not the variable RGB is 3, that is, whether or not the final color is B. (Step S16). If it is not the final color B (N in step S16), the variable RGB is incremented (step S17), that is, the color to be processed is next, and the process returns to step S12. If the final color is B (Y in step S16), the extracted still image with the number of the variable Tn and the frame of the variable Fn are checked for coincidence / mismatch for all pixels of all R / G / B. Since it is within the threshold value, this comparison is judged to match, and it is displayed that there is a frame in the moving image to be inspected that matches the extracted still image with the number of the variable Tn (step S18), and the subroutine is terminated.

  If it is equal to or higher than the density threshold value in step S12, the variable error (RGB) is incremented (step S19), and the variable error is incremented (step S20). That is, the number of errors in the density of the color being processed and the total number of errors are incremented by one. If the total number of errors counted up is within the pixel threshold (Y in step S21), the process proceeds to step S13. If the total number of errors is not within the pixel threshold value (N in step S21), it is displayed that the extracted still image with the variable Tn number and the frame with the variable Fn number do not match (step S22), and the subroutine is immediately terminated.

  Next, FIG. 3 will be described. In performing the operation of FIG. 3, the arithmetic processing means 3 sets the variables as follows (step 31). A variable Tn, which is the number of the extracted still image to be processed, is set to 1. Let the variable TN be the total number of extracted still images. A variable Fn, which is the number of a frame for executing processing, is set to 1. Let the variable FN be the total number of frames.

  For the extracted still image with the number specified by the variable Tn and the frame with the number specified by the variable Fn, match / mismatch determination processing shown in FIG. 4 is performed (step S32). If it is determined that they match, that is, if it is determined that an inspected moving image matches the extracted still image with the number specified by the variable Tn (Y in step S32), whether or not the variable Tn is TN. That is, it is checked whether or not the number of the extracted still image being processed is the final number (step S33). If the number of the extracted still image being processed is not the final number (N in step S33), the variable Tn and the variable Fn are incremented, that is, the number of the extracted still image to be processed and the frame number are set to the next number. (Step S34), the process returns to Step S32. If the number of the extracted still image being processed is the final number (Y in step S33), it is determined that there is a match among all the extracted still images in the inspected video, and the inspected video is correct. It is displayed that it is being reproduced (step S35).

  If it is determined in step S32 that the extracted still image of the variable Tn and the frame of the variable Fn do not match, it is determined whether or not the variable Fn is FN, that is, whether or not the number of the frame being processed is the final number. It investigates (step S36). If the number of the frame being processed is not the final number (N in step S36), the variable Fn is incremented, that is, the number of the frame to be processed is set to the next number (step S37), and the process returns to step S32. If the number of the frame being processed is the final number (Y in step S36), it is displayed that the inspected moving image is not correctly reproduced, assuming that there is an extracted still image that does not match in the inspected moving image ( Step S38).

  Next, an example of a method for performing a quality / reliability test of a mobile phone (electric product S) corresponding to a moving image using the moving image inspection apparatus 1 for the electric product will be schematically described.

  First, as shown in FIG. 1, a mobile phone (electric product S) is set in the moving image inspection apparatus 1 for the electric product.

  Next, the access information (telephone number, Internet address number, etc.) to the video site stored in advance in the storage unit of the arithmetic processing means 3 (more specifically, the control device 4) is called to the outside. The input means input operation means 7 is driven, and the key input part (external input means of the electric product S) Sb of the mobile phone (electric product S) is pushed and operated to display a moving image on the display screen Sa of the mobile phone (electric product S). Reproduce.

  The moving image reproduced on the display screen Sa of the cellular phone (electric product S) is captured by the imaging unit 2 and stored in the storage unit of the arithmetic processing unit 3 (more specifically, the control device 4).

  A person who conducts a quality / reliability test of the mobile phone (electric product S) displays the parameter setting screen shown in FIG. 6 on the display means 5, and displays a video image displayed on the video display area P 1 of the display means 5. A frame to be extracted as a still image is selected with the mouse 8 and input to each of the image storage frame portions F1, F2, F3, F4, F5, F6, F7, F8, F9, and F10.

  Next, a person who performs a quality / reliability test of the cellular phone (electric product S) displays the parameter setting screen shown in FIG. 7 on the display means 5 and displays the image storage frame portions F1, F2, F3, F4, F5. , F6, F7, F8, F9, and F10, the still images inputted to each of them are sequentially called from the storage unit of the arithmetic processing means 3 (more specifically, the control device 4), and the threshold value of each still image is set. To do.

  Next, the determination screen shown in FIG.

  Then, the access information (telephone number, Internet address number, etc.) to the video site stored in advance in the storage unit of the arithmetic processing unit 3 (more specifically, the control unit 4) is called and externally input. The means input operation means 7 is driven, and the key input part (external input means of the electric product S) Sb of the mobile phone (electric product S) is pushed and operated to reproduce the moving image on the display screen Sa of the mobile phone (electric product S). To do.

  The moving image reproduced on the display screen Sa of the mobile phone (electrical product S) is imaged by the imaging unit 2, and each frame of the moving image captured by the imaging unit 2 has a threshold value corresponding to a still image used as a determination point. Compared to ascending order of still images, if there is a moving image frame within the threshold value corresponding to the still image, “normal”, if there is no moving image frame with a threshold value corresponding to the still image, “defective product” Is determined according to the procedure of the flowchart shown in FIGS.

  In addition, in the moving image inspection apparatus 1 of this electric product, when there are moving image frames corresponding to a plurality of still images used as determination points, as shown in FIG. 8, a plurality of determination points used as determination points on a determination screen are used. The image storage frame portions F1, F2, F3, F4, F5, below the image storage frame portions F1, F2, F3, F4, F5, F6, F7, F8, F9, and F10 displaying still images. Each of the frames of the moving image within the threshold value of the still image displayed in each of F6, F7, F8, F9, and F10 is an image storage frame portion F11, F12, F13, F14, F15, F16, F17, F18, A person who performs a quality / reliability test of the mobile phone (electrical product S) displayed on F19 and F20 can accurately reproduce the moving image on the display screen Sa of the mobile phone (electrical product S). The So that the can be sure.

  On the other hand, in the moving image inspection apparatus 1 of the electrical product, when there is no moving image frame corresponding to each of the plurality of still images used as the determination points, the plurality of still images used as the determination points on the determination screen are displayed. The image storage frame portions F11, F12, F13, F14, F15, F16, which are provided in the lower stages of the image storage frame portions F1, F2, F3, F4, F5, F6, F7, F8, F9, F10, In “F17”, “F18”, “F19”, and “F20”, “blank” indicating that there is no corresponding moving image frame is displayed.

Then, in the case of “normal”, the comprehensive determination lamp L1 on the determination screen is lit in “blue”, and in the case of “defective product”, the comprehensive determination lamp L1 on the determination screen is lit in “red”.
In the quality / reliability test of the mobile phone (electric product S), the above test is performed about 500 times for one mobile phone (electric product S), and the display screen Sa of the mobile phone (electric product S) is displayed. Shipped from the factory after confirming that the video can be played correctly.

  As is clear from the above description, in the moving image inspection apparatus 1 for an electric product, one or more still images of the reference moving image are extracted, and a frame that matches the extracted still image is a frame of the moving image to be inspected. Is determined based on a preset threshold, and if it is determined that all the extracted still images are in the frame of the video to be inspected, the reference video and the video to be inspected match. Therefore, since the moving image of the electric product can be inspected accurately and unattended by a machine.

  In addition, the moving image inspection apparatus 1 of the electrical product reproduces two images in synchronization with each other, and does not determine whether the moving image is accurately reproduced on the display screen based on the difference between the two images. Since each frame of the moving image is sequentially compared for each image selected from the above, the two images are reproduced without being synchronized, so that there is no problem in the operability of the display screen. The inspection object is not determined to be a defective product in which the display screen Sa of the electrical product S cannot be reproduced.

  In addition, in the moving image inspection apparatus 1 of the electrical product, when comparing one image selected from the moving image and each frame of the moving image, a threshold value is used instead of visual observation. However, quality / reliability tests such as whether or not the moving image can be accurately reproduced at the time of startup and whether or not the received moving image can be accurately reproduced can be performed by an unmanned machine.

  Further, in the moving image inspection apparatus 1 of the electrical product, the threshold value used when sequentially comparing each frame of the moving image for each image selected from the moving image is not the shape or size of the two image information to be compared. , RGB allowable error densities (density threshold values) for the three primary colors of RGB are set for each of RGB, and then the threshold value (pixel threshold value) is set for the RGB total count of the number of pixels exceeding the set allowable error density Set. Since this pixel threshold value is used to determine whether the extracted individual still images match or not, there is no need to recognize each of a plurality of still image information and each frame of the moving image.

  Moreover, in this video inspection device 1 for electrical products, since the device can automatically call a video site to be displayed on the display screen Sa of the electrical product S, the display screen Sa displays a video at startup. Quality / reliability tests, such as whether or not the video can be correctly played back and whether or not the received video can be played back accurately, can be performed unattended by a machine from the stage of calling the video site.

  Since the moving image inspection method and the moving image inspection apparatus for an electric product according to the present invention can be inspected by an unattended machine to check whether or not a moving image can be accurately reproduced on a liquid crystal display unit or other display unit such as a mobile phone, It can be widely used for quality inspection of information terminals such as mobile phones and other electrical appliances that can reproduce moving images on a liquid crystal display unit and other display units.

It is a block diagram which illustrates roughly an example of a structure of the moving image test | inspection apparatus of the electric product which concerns on this invention. It is explanatory drawing which shows typically the concept of the moving image inspection method of the electric product which concerns on this invention. It is a flowchart which shows typically an example of the moving image test | inspection program stored in the memory | storage part of the moving image test | inspection apparatus of the electric product shown in FIG. FIG. 4 is a detailed flowchart for checking a match between a still image and a frame shown in S <b> 32 in FIG. 3. FIG. It is a figure which shows the determination screen provided in the moving image inspection apparatus of the electric product shown in FIG. It is a figure which shows the parameter setting screen provided in the moving image inspection apparatus of the electric product shown in FIG. It is a figure which shows the parameter setting screen provided in the moving image inspection apparatus of the electric product shown in FIG. It is a figure which shows an example of the judgment screen in case a moving image is reproduced | regenerated correctly on the display screen of an electric product. It is a block diagram which shows the structure of the conventional image | video comparison apparatus roughly. It is a conceptual diagram which shows the outline of the function of the image | video comparison apparatus shown in FIG. It is a flowchart which shows the outline | summary of operation | movement of the image | video comparison apparatus shown in FIG. It is a figure which shows the synthetic | combination image | video reproduced | regenerated by synchronizing two moving image data of the image | video comparison apparatus shown in FIG. FIG. 10 is a diagram illustrating a composite video when two video data of the video comparison device illustrated in FIG. 9 are out of synchronization.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Movie inspection device of electric product 2 Imaging means 3 Arithmetic processing means 4 Control device 5 Display means 6 External input means 7 External input means input operation means 8 Mouse 9 Voice input means 10 Dark box S Electric appliance Sa Display screen Sb Key input part

Claims (8)

In the video inspection method for electrical products, the consistency between the reference video consisting of a plurality of still images and the video of the test subject consisting of a plurality of still images is checked to determine whether the video of the test target matches or not.
Extracting one or more still images of the reference moving image, determining whether a frame matching the extracted still image is in a frame of the moving image to be inspected based on a preset threshold; A method for inspecting a moving image of an electrical product, wherein if it is determined that all of the extracted still images are in a frame of the moving image to be inspected, it is determined that the reference moving image and the moving image to be inspected match. Take a video that is displayed on the display screen of the electrical product that is the standard for quality / reliability testing, extract multiple still images from the images from the start to the end of the video,
The video is reproduced on the display screen of the electrical product subject to the quality / reliability test, and each of the plurality of still images is sequentially reproduced on the display screen of the electrical product subject to the quality / reliability test. The moving image is captured and compared with the frame of the captured moving image, and a matching ratio between a certain frame of the captured moving image and a frame corresponding to each of the plurality of still images is within a preset threshold range. In some cases, it is determined that the still image matches a certain frame of the captured moving image, and it is determined that all of the extracted still images are in the frame of the moving image to be inspected. In this case, the moving image inspection method of the electric product is such that it is determined that the moving image is accurately reproduced on the display screen of the electric product to be subjected to the quality / reliability test. The extracted still images are rearranged in the order of appearance, and each of the still images is captured in the order of appearance, and a moving image being reproduced on the display screen of the electrical product to be subjected to the quality / reliability test is captured and captured. When each frame of the moving image is compared in the order of appearance of the frames and it is determined that one image of the still image matches a certain frame of the captured moving image frame, the next still image is captured. The moving image inspection method for an electric product according to claim 1, wherein comparison is made from a frame next to a certain frame of the frames of the moving image. The threshold value is set in advance as an allowable error density for each of the three primary colors of light, red, green, and blue, as a pixel comparison, and the total number of pixels that exceed the allowable error density for all the pixels of the still image to be compared and the frame is previously set. The moving image inspection method for an electrical product according to any one of claims 1 to 3, wherein the threshold value is set. Imaging means for imaging quality and reliability test standards and a display screen of a target electrical product;
Display means for displaying the moving image displayed on the display screen of the standard and the target electrical product of the quality / reliability test imaged by the imaging means;
Means for extracting a plurality of still images from the image from the start to the end of the moving image displayed on the display screen of the electrical product that is the standard of the quality / reliability test imaged by the imaging means;
The video is reproduced on the display screen of the electrical product subject to the quality / reliability test, and each of the plurality of still images is sequentially displayed on the display screen of the electrical product subject to the quality / reliability test. The moving image being reproduced is imaged by the imaging means, and is compared for each frame of the captured moving image, and a matching ratio between a certain frame of the captured moving image and a frame corresponding to each of the plurality of still images is Determining means for determining that the still image and a certain frame of the captured moving image coincide with each other when in a preset threshold range;
When the determination unit determines that all of the extracted still images are in the frame of the moving image to be inspected, on the display screen of the electrical product to be subjected to the quality / reliability test, An electronic product video inspection device that judges that video playback has been performed accurately. Image rearranging means for rearranging the extracted still images in the order of appearance;
A moving image in which each of the extracted plurality of still images is rearranged in the order of appearance by the image rearrangement unit and is reproduced on the display screen of the electrical product to be subjected to the quality / reliability test in the order of appearance. A determination unit that captures images, compares each captured moving image frame by frame appearance order, and determines that one image of the still image matches a certain frame of the captured moving image frame;
When the determining means determines that one image of the still image coincides with a certain frame of the captured moving image frame, the next still image is the next of the certain frame of the captured moving image frame. The moving image inspection apparatus for an electric product according to claim 5, further comprising a comparison unit that compares the frame from the frame. The threshold for determining that one image of the still image coincides with a certain frame of the captured moving image is an allowable error for each of red, green, and blue as the three primary colors of light as a pixel comparison. 7. The electrical product according to claim 5, wherein the threshold value is preset for a total number of pixels exceeding the allowable error density for all pixels of the frame in which the density is set in advance and compared. 8. Movie inspection device. Storage means for storing information for calling a video site to be displayed on the quality and reliability test standards and a target display screen;
The electrical product according to any one of claims 5 to 7, further comprising external input means input operation means for inputting information for calling a video site stored in the storage means to the external input means of the electrical product. Movie inspection device.