JPH03107720A - Image processing method in remotely controlled automatic inspection device - Google Patents

Abstract

PURPOSE:To automatically and accurately check the moderation feeling of a push-botton switch, a correct signal output, and a liquid crystal display by dividing an image picked up by an image pickup camera into a specific number of picture elements and obtaining an inspection image by binarizing each picture element. CONSTITUTION:A pressing device which presses the push-button switch 5 of a wireless remote controller 1 with the liquid crystal display is driven by a robot 33 and the pressure i s detected when the push-button switch 5 is turned on. Further, an infrared-ray signal which is outputted at this time is received by a receiver 36 and an image of a display appearing at a liquid crystal display part 3 is picked up by an image pickup camera 37. Then the image picked up by the image pickup camera 37 is divided into a specific number of picture elements, which are converted into binary data to obtain the inspection image; and the number of dots which are decides as black dots in the inspection image is compared with the number of dots of a black part of a reference image of good quality which is inputted previously to decide whether or not the liquid crystal display part 3 is normal. Consequently, the inspection of characteristics of the remote controller 1 is automated and the positional deviation of a display in a permissible error range at the time of liquid crystal manufacture is never decided as a defective.

Description

DETAILED DESCRIPTION OF THE INVENTION [Field of Industrial Application] The present invention relates to an automatic remote control testing device for automatically testing the characteristics of a wireless remote controller with a liquid crystal display.

[Conventional technology]

Some infrared wireless remote controllers used to remotely control televisions, video decks, air conditioners, etc. have a liquid crystal display section to display the current operating status of the equipment operated by the wireless remote controller to the user. be.

The wireless remote control with liquid crystal display (hereinafter referred to as the remote control) (1) has a projection on the front for outputting an infrared signal toward the light receiving window of the device that corresponds to the remote control (1), as shown in Fig. 11. It has a light window (2), and on its surface is a liquid crystal display section (3) and an operation section (4) on which push button switches (5) for instructing various operations are arranged.
is the provision.

In addition, the push button switch (5) provided in the operation section (4)
(5)... are openings (7) (7) provided in a synthetic resin sheet member (6) as shown in FIGS. 12 and 13.
)... has a structure in which push button switches (5) (5)... are integrally formed on top thereof via thin-walled connecting portions (8) (8)... so as to be freely movable up and down. In addition, the above push button switch (
5) is formed with a conductive land (9) that serves as a contact point for connecting a pair of opposing conductive lands (11) (11) formed by a wiring pattern on a printed circuit board (10) to be described later. has been done. Then, as shown in FIG. 14, the sheet member is placed on a printed circuit board (10) built into the remote control (1), and the push button switch (5) (5) is projected onto the sheet member (6). )・・
The connecting portion (8) supporting the push-button switch (5) on the opening (7) of the sheet member (6) in a state where the . ) by pressing down against the elastic force of the push button switch (5) and bringing the conductive lands (9) on the bottom of the push button switch (5) into contact with the opposing conductive lands (11) (11) on the printed circuit board (10). I am trying to make it conductive. Further, the push button switch (5) is designed to have a sense of moderation when turning on the push button switch (5) due to the elastic force of the connecting portion (8). The pressing force is usually around 130g.

Before the remote control (1) having the above structure is shipped, a characteristic test is performed to check whether the various functions operate normally. This characteristic test is carried out as shown in FIG. 17) is set in front of the workbench (18), and performs the test by operating the remote control (1) according to the work instructions (19) hanging on the side of the inspection machine (17). That is, the inspector (15) presses the push button switch (5) of the remote control (1) as instructed in step 1 of the work instruction (19), and at the same time checks the moderation of the push button switch (5). , then remote control (1)
A receiver (16) and a tester (17) are used to determine whether the transmission code of the infrared signal transmitted from the transmitter is correct, and further,
Visually check whether the display corresponding to the inserted pushbutton switch (5) is displayed correctly on the liquid crystal display section (3).
The test for the two pushbutton switches (5) is completed. From then on, according to the work order displayed in the work instructions (19),
All pushbutton switches (5) on the remote control (1)
(5) Perform the above test on... and complete the test on - remote controllers (1,).

[Problem to be solved by the invention]

As mentioned above, in the characteristic inspection performed before shipping the remote control (1), the moderation of each push button switch (5) is checked, and when the push button switch (5) is pressed, There are three types of checks that must be performed: a check to see if the correct signal is being output, and a check to see if the LCD display is being performed correctly.
Due to the increasing number of functions, many pushbutton switches (5) are provided, so if the inspector (15) were to perform all the above inspections manually, it would be very time consuming.
There were problems in that it placed a heavy burden on the staff and was prone to inspection errors.

Furthermore, when attempting to automate the above characteristic inspection and increase inspection efficiency, the quality of the liquid crystal display section is normally determined by capturing the liquid crystal display section with an imaging camera, processing the image at that time, and using it as a non-defective standard image. Comparisons are used to determine pass/fail, but it is very difficult to reliably capture the display on the liquid crystal display with an imaging camera and use image processing to determine pass/fail. 1
There was also the problem that it was becoming a bottleneck.

[Means to solve the problem]

An examination table having an inspection section that holds a wireless remote control with a liquid crystal display, a pressing device that presses a push button switch of the wireless remote controller with a liquid crystal display and detects the pressing force at this time, and a support frame that supports the pressing device. In order to press any pushbutton switch on the wireless remote control with LCD display using the pressing device, a robot installed on the side of the inspection department and a robot placed at the back of the inspection department, A remote control automatic inspection device is constituted by a receiver for receiving an output infrared signal, and an imaging camera placed above the inspection section for photographing the liquid crystal display section of the wireless remote control with a liquid crystal display, and the said imaging camera After dividing the captured image into a predetermined number of pixels and binarizing each pixel to obtain a test image,
The quality of the liquid crystal display is determined by comparing the number of dots in the black part of this inspection image with the number of dots in the black part of the non-defective standard image, which has been manually created in advance. .

[Effect]

As mentioned above, the robot drives the pressing device that presses the push button switch of the wireless remote control with a liquid crystal display,
The pressure when the push button switch is turned on is detected, the infrared signal output at this time is received by a receiver, and the display appearing on the liquid crystal display section is photographed by an imaging camera, and the inspection image obtained from this image is obtained. By comparing the number of dots in the black part between the image and the non-defective standard image to determine whether the liquid crystal display is good or bad, it is possible to automate the characteristic inspection of a wireless remote control with a liquid crystal display.

〔Example〕

FIG. 1 shows a remote control automatic inspection bag ff (3) according to the present invention.
This shows the overall configuration of 0). The remote control automatic inspection device (30) shown in this figure has an inspection section (
In order to sequentially press the push button switches (5) of the remote control (1) set on the inspection table (31) and the inspection section (32), which are set on the inspection section (32). Cartesian coordinate robot (33) and robot (33)
) is attached to a support frame (34) extending from Bag W (35) (35
)..., the receiver (36) placed behind the inspection section (32) receives the infrared signal transmitted from the remote control (1) when the push button switch (5) is pressed.
) and each remote control (
1), four imaging cameras (37) (37)... for photographing the liquid crystal display section (3), and a lighting device (38) for illuminating the liquid crystal display section (3) of the remote control (1). ) The main part is composed of.

In addition, a control panel (39) placed on the side of the inspection table (31) that controls the various devices described above includes a robot controller (40) that controls the movement of the robot (33), and an f-quantity image camera (37). ) (37) An image processing device (41) that processes image signals from..., a serial processor that converts an infrared signal composed of a serial signal received by the receiver (36) into a parallel signal. Parallel converter! (42), the above pressing device (35) (35)
. . . A computer (43) for determining the quality of the remote control (1) based on signals from the image processing device (41) and the serial/parallel converter (42). A CRT (44) is incorporated for displaying results externally.

The support frame (34) extending from the above robot (34)
) has a length sufficient to straddle the four remote controllers (1) (1)... set on the inspection section (32). Additionally, four pressing devices (35) (35) are supported above each remote control (1) by a support frame (34).
... has a structure as shown in FIGS. 2 and 3. That is, each of the above-mentioned pressing devices (35) is attached to the support frame (3
A shaft (46) supported by a hollow bush (45) fixed to the shaft (4) so as to be movable up and down;
A cylindrical support block (47) screwed into the tip of the support block (47), and a cap nut (4) screwed into the outer periphery of the support block (47).
8), a locking nut (49) for positioning and fixing the cap nut (48) with respect to the support block (47), and a tip (50a) protruding below the cap nut (48), A resin tentacle (5) is supported within the space formed between the support block (47) and the cap nut (48).
0) and a pressure sensor (51) interposed between the support block (47) and the contactor (50), and when the tip of the contactor (50) contacts the push button switch (5), , the contact pressure at that time can be detected by a pressure sensor (51). In addition, a flat plate (5
2) is buried, with a feeler (50) and a pressure sensor (51).
) to ensure a successful hit. In addition, a lead (51a) extending from the pressure sensor (51) is provided at one location on the outer periphery of the bag neck (48) that supports the feeler (50).
) is provided with a slit (48a) for leading out the bag to the outside.
The lower end surface (49a) of (49) is tapered to ensure contact between the two.

Furthermore, the lower end surface of the bush (45) and the shaft (46)
) A spring (54) is press-fitted between the shaft (54) and a nut (53) screwed onto the outer periphery of the shaft (46), and the shaft (46) is constantly pressed downward by the pressing force of the spring (54). If the pressing force against the pushbutton switch (5) by the feeler (50) placed below the shaft (46) exceeds a certain value for some reason, the shaft (46) is compressed while compressing the spring (54). 46) is raised to prevent a pressing force exceeding a certain value from being applied to the push button switch (5).

Further, by pressing the push button switch (5) with the toucher (50), the pressure waveform output from the pressure sensor (51) becomes as shown in FIG. 4. That is, when the pressure rises to a certain value, the push button switch (5) is supported.
The push button switch (5) is lowered against the elastic force of the connecting portion (8) shown in FIGS. 12 and 13, and the push button switch (5)
) is turned on, and at this time, the pressure decreases momentarily, and since the push button switch (5) cannot be lowered thereafter, the pressure increases again. Therefore, the first peak (
P, ) is the pressure when the push button switch (5) is turned on, and as mentioned above, the push button switch (5) is designed so that this pressure is usually around 130 g. Therefore, in the present invention, the pressure waveform is sent to the computer (43), the characteristics of the pressure waveform are analyzed, and the first peak (Pl
) is within the range of 130g±30g, thereby determining whether the moderation feeling of the push button switch (5) is normal.

Each remote controller (1) is pressed by pressing the push button switch (5) of each remote controller (1) by the E-labeled pressing device (35) (35) supported by a support frame (34) extending from the robot (33). The receiving device (36) that receives infrared signals transmitted from the light projection window (2) of ) is provided with four independent light receiving windows (36a (36a)... 4 remote controllers set in (
1) The infrared signals output from (1) . . . almost simultaneously can be received all at once. Also, each remote control (
All infrared signals output from 1) are serial signals, and the timing of their transmission may vary due to subtle differences in the positional relationship between the push button switch (5) of each remote control (1) and each pressing device (35). As shown in Fig. 5, since there is a slight deviation, the signals from each remote controller (1) are
), it is difficult to input all the signals to the computer (43) as they are and determine whether the signals are good or bad. Therefore, the four serial signals (a) received by the receiver (36)
(a)... is sent to the serial-parallel converter (42) built into the control panel (39) on -100, and is converted into parallel signals (b) (b)... for each remote control. (
All signals from 1) are parallel signals (b) (b)...
(when converted into ) point, the parallel signal (b) corresponding to each remote control (1)
By reading (b)... into the computer (43), it is possible to instantly determine whether the infrared signals output from each remote controller (1) are good or bad.

Further, when the push button switch (5) is pressed by the pressing device (35), the liquid crystal display section (3) of the remote control (1) is turned on.
), four CCD cameras (37) (37)... are used as an imaging camera (37) for photographing the liquid crystal display section (3). Each CCD camera (37) is connected to an inspection section (32).
) LCD display section (3) of each remote control (1) set in
It is like taking a picture. And each CCD camera (
Image processing for determining whether the liquid crystal display section (3) of the remote control (1) is good or bad is performed as follows based on the image taken by the remote controller (1). That is, the image of the liquid crystal display section (3) captured by each CCD camera (37) is processed by the image processing device (41) into a predetermined number of pixels (i,) having a size of about 100 μ square.
After the brightness of each point is divided into "0" or "1" depending on whether it is black or white, this binary inspection image (m) is obtained. ) is sent to the computer (43), and as shown in the explanatory diagram of FIG. 6, the non-defective reference image (n
), and the number of dots in the part of the inspection image (m) determined to be black (the shaded part in the figure) and the non-defective standard image (
It is determined whether or not the number of black dots in item n) matches, and if they match, it is determined that the test is passed.

The reason why the pass/fail of the inspection image (m) is compared based on the number of dots rather than by comparing the position of the black part of the good quality reference image (ri) and the black part of the inspection image (m) is as follows. It is. In other words, when displaying characters, for example, on a liquid crystal display, the accuracy of the position where the characters are formed on the liquid crystal display is several 10.
Since the distance is about .mu., a positional deviation of about several tens of .mu. is within the manufacturing tolerance range. 1. However, when the quality of this display is determined by comparing the positions of the non-defective standard image (n) and the inspection image (m), even if the positional deviation is within the above tolerance range, it is determined to be a failure. This is because there are things.

On the other hand, if the above-mentioned method of counting the number of dots is used, as shown in FIG. Even if there is a misalignment, if the shapes of the characters and symbols displayed on the liquid crystal display (3) are accurate, the number of dots will be the same on both, and it will be determined that the test has passed, and the above-mentioned trouble will not occur. It is from.

Also, the threshold value when dividing the image of the liquid crystal display section (3) taken by the CCD camera (37) into black or white depending on the brightness of each point and converting it into two values, that is, the 21'ffi conversion level. is set to the optimum value in accordance with the characters, symbols, etc. displayed on the liquid crystal display section (3). That is, as shown in FIG. 8, the display on the liquid crystal display section (3)l includes, in addition to the character (A), a blank character (B) and a symbol drawn with an Oda line (
There are various problems such as (c); (1) If the binarization level is fixed at a constant value, white characters, thin lines, etc. cannot be binarized accurately. Therefore, the images captured by the CCD camera (37) are divided into the area where normal characters are drawn (the area that captures the standard display) (A), the area where white characters are drawn (the area that captures the standard display), and the area where the white characters are drawn (the area that captures the standard display). The part that captured) (B),! tII
Divide it into arbitrary ranges, such as the part where symbols etc. are drawn with lines (the part that captures the display with a large white area) (C),
Set the binarization level for each divided area0
For example, an area (A) with normal characters (a) is set to the standard binarization level, and an area (B) with white characters (b) is set to a binarization level higher than the standard. , the area (C) having symbols (C) drawn with thin lines, etc., the binarization level is set to be lower than the standard.

Then, after obtaining an inspection image (m) that has been binarized at the optimal binarization level for each area, the above-mentioned method of counting the number of dots between this inspection image (m) and the non-defective reference image (・n). This is to compare the quality of the product and determine whether it is a good product or a defective product. In this case, the quality standard image (n) is also stored for each area, the above comparison is performed for each area, and only when each area passes, the inspection at that time is determined to pass. .

Each remote control (1
) The illumination device (38), which serves as a light source when photographing the liquid crystal display section (3), is equipped with four CCD cameras (37) (37)... Two straight fluorescent lamps (55) placed in parallel on both sides of the CCD camera (37) (37)...
(55) and a cover member (56) with an opening at the bottom to support this, and these two straight tube fluorescent lamps (55) (55) allow the inspection section (32
) 4 remote controls set on top (1) (1)...
The liquid crystal display sections (3) are simultaneously and uniformly illuminated. Also, CCD camera (37) (3
7) Straight tube fluorescent lights (55) on both sides of (55)
This arrangement prevents shadows from appearing on the display on the liquid crystal display section (3) during lighting, and at the same time prevents the light source itself from being reflected on the liquid crystal display section (3), resulting in clear and clear images. This is so that the image can be obtained. Furthermore, this straight tube type fluorescent lamp (55) (55) uses high frequency lighting using an inverter for the purpose of preventing flicker during lighting and making it possible to adjust the illuminance.

In addition, a first
As shown in the figure, an acceptance sealing device (57) is arranged.
A pass mark is stamped on the back side of a remote control (1) that has passed the inspection by the remote control automatic inspection device (30).

In order to test the characteristics of the remote controller (1) using the remote control automatic testing device (30) having the above configuration, first, four remote controllers (1) (1) are placed in the testing section (32) of the testing table (31).
)... manually by the worker, and then presses an inspection start switch (not shown). Then, the robot (33) of the remote control automatic inspection device (30) starts first, and the four press bags '11 (35) (35) attached to the support frame (□34) extending from the robot (33)
Each of the touches (50) is located above a preset push button switch (5) of the corresponding remote control (1).

Next, by lowering the support frame (34), the contact (50) of each pressing device (35) comes into pressure contact with the corresponding push button switch (5) of each remote control (1), and each push button switch (5) ) turn on almost simultaneously. At this time, the computer (43) performs characteristic analysis of the pressure waveform output from the pressure sensor (51) built into each press device (35), and each push button switch (5) weighs 130 g.
It is determined whether it is turned on within the range of ±30g.

In this way, after checking the moderation of the first push button switch (5) of each remote control (1), each remote control (
The infrared signal composed of the serial signal output from 1) is transmitted to the four light receiving windows (36a) of the receiver (36).
(36a)°°, and each received serial signal 1(a) is sent to the serial-to-parallel converter e (42)'. Then, when each serial signal (a) is all converted into a parallel signal (b),
The four parallel sets (No. 8 (b), (b), etc.) corresponding to each remote controller (1) are read into the computer (43), and from each remote controller (1), the ONL button is pressed. It is determined whether accurate infrared signals corresponding to the switches (5) have been output.

When the infrared signal check is completed in this way, each push button switch (5) is turned on to display the display on the liquid crystal display (3) of each remote controller (1). Each corresponding CCD camera (37) captures the image, and the image at this time is sent to the image processing bag ff (41), and as described above, the inspection image (m) is binarized for each pre-divided area. This inspection image (m
) and the non-defective standard image (n) inputted in advance to the computer (43) are compared by the dot counting method described above, and each liquid crystal display section (3) of each remote control (1)
Above, a determination is made as to whether or not an accurate display corresponding to the push button switch (5) that has just been turned on is displayed.
The test for one pushbutton switch (5) of each remote control (1) is completed.

In addition, the liquid crystal display section (3) is displayed by the CCD camera (37).
) If the support frame (34) extending from the robot (33) becomes a shadow and obstructs the photographing, turn on the push button switch (5) and then remove the support frame (34) from the robot (33).
4) is programmed to retreat to a position where it will not interfere with photography.

Once the inspection for one pushbutton switch (5) is completed as described above, all the pushbutton switches (5) (5) and
For ..., the above inspection is automatically and continuously performed. The inspection for all push button switches (5) (5)... has been completed, and the remote control (1) has passed all inspections.
A pass stamp is automatically stamped on the pass mark by the pass stamp device (57) disposed below the inspection section (32), and the current characteristic test is completed.

In this way, when the characteristics test for the four remote controllers (1) (1)... set on the inspection section (32) is completed, these four remote controllers (1) (1,)... is removed from the inspection section (32), then the following four remote controllers (t
)(1) .

In addition, since the remote control automatic inspection device (30) according to the present invention is designed so that all movements of each device can be controlled by the computer (43), the remote control automatic inspection device (30)
), if the type of remote control (1) to be tested changes, this can be easily handled by simply changing part of the program input to the computer (43), making it possible to test the characteristics of many types of remote controls (1). This can be done by one remote control automatic inspection device (30).

Further, in the above embodiment, four remote controllers (1) (1)...
・I have elaborately explained the example of making it possible to carry out the characteristics inspection of the press device F (35) and the receiver (3
6) number of light receiving windows (36a) and CCD camera (3
By changing the number in step 7), the maximum number of remote controllers (1) that can be tested at one time can be arbitrarily changed.

〔Effect of the invention〕

As described above, if the remote control automatic inspection device according to the present invention is used, just by setting the remote control in the inspection section of the inspection table, the moderation of the push button switch of the remote control can be checked, and when the push button switch is pressed, the correct signal can be sent. It is now possible to perform all three types of checks automatically and accurately: checking whether the output is being output, and checking whether the liquid crystal display is being performed correctly, which previously had to be done manually by workers. Compared to conventional characteristic tests, the test time can be significantly shortened, and at the same time, the test accuracy can be greatly improved. In addition, the present invention uses a dot counting method to compare the binarized inspection image captured by an imaging camera with a non-defective reference image, so that the error falls within the tolerance range for LCD manufacturing. There is no need to worry about identifying misalignment of the display as a defective product, and it is possible to accurately determine whether the liquid crystal display section is good or bad.

[Brief explanation of drawings]

Fig. 1 is a perspective view showing the remote control automatic inspection device according to the present invention, Fig. 2 is a front view of the pressing device, Fig. 3 is an enlarged sectional view of the main part of the pressing device, and Fig. 4 is the output from the pressure sensor. A graph showing a pressure waveform, FIG. 5 is an explanatory diagram showing the operating state of the serial-parallel converter, FIGS. 6 and 7 are explanatory diagrams for explaining the dot counting method according to the present invention,
Fig. 8 is a plan view showing an example of display on the liquid crystal display section, Fig. 9 is a drawing showing an example of dividing an image captured by a CCD camera into arbitrary areas, and Fig. 10 is a plan view showing an example of a display on a liquid crystal display. Schematic diagram showing the state when the liquid crystal display section is illuminated, 1st
Fig. 1 is a plan view showing an example of a remote control, Fig. 12 is a plan view of a push button switch, Fig. 13 is a sectional view taken along the line 1-I in Fig. 12, and Fig. 14 shows the relationship between the push button switch and the printed circuit board. The sectional view and FIG. 15 are perspective views for explaining a conventional remote control inspection method. (1) (3) (30) (31) (33) (35) (37) (m) 1. Wireless remote control with LCD display, 1. LCD display, (5) 1. Push button switch, . . .
Remote control automatic inspection device, - Inspection table, (32) - Inspection section, - obot, (34) - Support frame, - Pressing device, (36) - Receiver, - Imaging camera, (2)
- One pixel, - Inspection image, (n) - Good quality standard image. Patent applicant: Aiko Giken Co., Ltd. Agent: Gangwon Province
■ ■ Figure 11 - Figure Figure 0 Figure X1 Prisoner Figure 15

Claims (1)

[Claims] (1) An examination table having an inspection section that holds a wireless remote control with a liquid crystal display, a pressing device that presses the push button switch of the wireless remote controller with a liquid crystal display and detects the pressing force at this time, and a device that supports the pressing device. By moving the support frame that is attached to the screen, the press device can press any pushbutton switch on the wireless remote control with an LCD display. In the automatic remote control inspection device, which includes a receiver for receiving an infrared signal output from a wireless remote control, and an imaging camera disposed above the inspection section for photographing the liquid crystal display section of the wireless remote control with a liquid crystal display, the above-mentioned After dividing the image captured by the imaging camera into a predetermined number of pixels and binarizing each pixel to obtain an inspection image, the number of dots in the portion of this inspection image determined to be black,
An image processing method in a remote control automatic inspection device, characterized in that the quality of a liquid crystal display is determined by comparing the number of dots in a black part of a non-defective standard image inputted in advance.