JPH1049332A - Computer display support device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve the visibility for improvement of an interactive interface to a computer and to improve the working efficiency of the computer by displaying with emphasis a specific part of an image or a graphic form corresponding to the selected one of identifiers of an 'object' and a 'person'. SOLUTION: An image display means 1 shows the images of both surface and rear surface sides of a PCB that is photographed by an image pickup device on a display screen of a personal computer 10. An identifier display means 2 shows the proper name of a defective parts sent from a PCB tester on the display screen of the computer 10. A pointing device 3 displays with emphasis and a crucial mark the mounting position of the parts shown by the means 2 at the relevant part of the image of the upper or rear surface side of the PCB. Then a conversion means 5 performs the conversion of coordinates to convert the coordinate data used by a production machine and showing the position of the defective product into the coordinate data on the display screen of the computer 10 which are used by the means 3.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system (navigation system) aiming at various guides by a computer.
It is about.

[0002]

2. Description of the Related Art Conventionally, an invention has been made in which a map is displayed on, for example, a display screen, and when a destination is input, a route from a departure place to a destination is displayed on the map. Alternatively, in the production site of "things", for example, in the manufacturing, inspection, and test processes of electronic devices, particularly printed boards, work is performed while comparing design and manufacturing drawings with actual products. Recent printed boards have been mounted at a high density, and the size of the design / manufacturing drawing is also A3 / A2.

[0003]

The conventional method of displaying a map on a display screen as described above has poor visibility and is not intuitive. The scale of the map was also fixed, and a map of another scale could not be used. In addition, there is a problem that it is inefficient to work while looking at the drawings. In view of the above, an object of the present invention is to provide means for improving visibility and improving a dialog interface with a computer or improving work efficiency.

[0004]

The above object is achieved by displaying an image on a display screen. FIG. 1 is a diagram illustrating the principle of the present invention. Items that specify the present invention include at least one of the identification name designation unit 4 and the identification name selection unit 6 and the image display unit 1.
, Identification name display means 2, coordinate conversion means 5, and pointing means 3. The functions of the matters specifying these inventions are as follows. (1). The image display means 1 displays at least one image or figure on the display screen of the image display device. When displaying a plurality of images, an area on the display screen is divided for each image. (2). The identification name display means 2 displays “thing” on the display screen.
Alternatively, at least one identifier of “human” is displayed.
The identification name of “thing” is a unique name of an article, a part, a building, or the like. The “human” identification name is a name or address.
“Thing” or “human” is specified by these identifiers. Note that there are a case where the image display area and the identification name display area on the display screen are divided (see FIG. 2), and a case where the image and the identification name are superimposed (see FIG. 3). (3). The coordinate conversion means 5 converts the coordinate data from the first coordinate system (x, y) to the second coordinate system (X, Y) (claim 2), or converts the coordinate data to the second coordinate system (x, y) for position adjustment. The coordinate data is converted from the coordinate system (X, Y) of the second coordinate system to the second coordinate system (X ′, Y ′). That is, the coordinate conversion may follow the conversion path of (x, y)-(X, Y)-(X ', Y'), or may be (x, y)-(X ',
The conversion path may be Y ′). The first coordinate system (x,
The relationship between y) and the second coordinate system (X, Y) may be a simple linear transformation or a non-linear transformation. Here, the linear transformation refers to a linear transformation in which X = Ax + B, A is a fixed value, and the non-linear transformation refers to A = A (x)
Is a case where the relationship between X and x such that A becomes a fluctuating coefficient is a conversion other than a linear expression. (4). The pointing means 3 highlights a specific portion in the image or the figure based on the coordinate data of the second coordinate system. Here, the term “highlighted” means that a “cross” mark is added to the specific portion, blinking is performed, a highlight is displayed, or a specific color is displayed. (5). The identification name designation means 4 designates an identification name of the "thing" or "human" corresponding to a specific portion to be highlighted in an image or a figure. (6). The identification name selection means 6 selects a specific one from the identification names of the "thing" or "human" displayed by the identification name display means. A specific location in the image or graphic corresponding to the selected one is highlighted.

[0005]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The following embodiments can be considered as embodiments. (1). In the example of the map described in the section of the prior art,
Instead of a map, for example, "aerial photograph" is displayed on the display screen, the names of a plurality of buildings are displayed, and a desired one is selected from the buildings. A cross mark is displayed at the position of the building in the "aerial photograph". (2). A built-in image of the human body is displayed on the display screen, and "stomach, liver, kidney, ..." is displayed as the identification name. For example, when "stomach" is selected, a cross mark is displayed at the position of "stomach" on the display screen. (3). The following embodiments are conceivable in the manufacturing and testing processes of electronic devices. . The front and back surfaces of the printed board on which the components are mounted are imaged by an imaging device, and the imaged data is sent to a personal computer and displayed on a display screen. On the other hand, when the unique name of the part determined to be defective is sent from the testing machine, the unique name is displayed on the display screen, and also corresponds to the defective part in the image of the printed board on the display screen. Highlight the position to be made (for example, put a cross mark)
I do. The operator performs necessary operations such as checking and repairing a defective portion while comparing the highlighted portion of the image with the actual printed board. . The front and back surfaces of the unmounted printed circuit board are imaged by an imaging device, and the imaged data is sent to a personal computer and displayed on a display screen. That is, the wiring pattern is displayed on the display screen. On the other hand, when a net name determined to be defective is sent from a testing machine that performs a continuity / short circuit test (short / open test), the unique name (net name) is displayed on the display screen and The position of the wiring pattern corresponding to the defective net in the image of the printed board on the display screen is highlighted (for example,
(With a cross mark). The operator checks the defective portion while comparing the highlighted portion in the image with the actual printed board.

[0006]

[Embodiment] The above-mentioned (3). The computer display support device in the “testing process of a printed board on which components are mounted” will be described. FIG. 4 is a configuration diagram of an embodiment of the present invention. 10 is a computer display support device (so-called "PC"), 20 is an imaging device such as a digital camera, 30 is a printed board (hereinafter, referred to as "PCB") on which components are mounted, and 40 is a PCB testing machine (for example, an in-circuit tester). ICT). Computer display support device (PC)
Reference numeral 10 includes an image display unit 1, an identification name display unit 2, a pointing unit 3, an identification name designation unit 4, a coordinate conversion unit 5, a first coordinate 7, a second coordinate 8, a control unit 9, and the like. The image display means 1 displays both images of the front and back surfaces of the PCB imaged by the imaging device 20 on a display screen of the personal computer 10. Identification name display means 2
The unique name of the defective part sent from the testing machine 40 is displayed on the display screen of the personal computer 10. The pointing means 3 highlights the mounting position of the component displayed by the identification name display means 2 by attaching a cross mark or the like to a corresponding portion of the image on the front or back surface of the PCB. In this case, the coordinate data indicating the mounting position of the defective component is data for a manufacturing machine such as a mounter or an inserter, and the coordinate data used by the pointing means 3 is a vertical or horizontal grid ( Dot) coordinates, that is, pixels (eg, 768 vertical dots, 1024 horizontal dots). Therefore, it is necessary to convert the coordinate data for the manufacturing machine into the coordinate data on the display screen. The coordinate conversion means 5 is a means for performing this coordinate conversion, the first coordinates 7 are coordinates for the manufacturing machine, and the second coordinates 8 are coordinates on the display screen. The first coordinate data of all components mounted on the PCB is stored in an external storage device of the personal computer 10 (not shown). The first coordinate data of all the components mounted on the PCB is generated by a so-called CAD system or manually before manufacturing the PCB. Control unit 9
Controls the operation of the PCB tester 40 and the imaging device 20 such as the start of operation. FIG. 5 shows a mode switching menu command displayed at the top of the display screen 52. By this mode switching, the "identification name selection" mode for selecting one from the plurality of displayed "things" or "human" identification names, or only one identification name is selected by some means (for example, a keyboard or the like). It is possible to select any one of the designated "identification name designation" modes. FIG. 6 is a flowchart for indicating the image position of a defective component in the PCB test. Hereinafter, an embodiment of the present invention will be described with reference to FIG. (1). The control unit 9 of the personal computer 10 sends a test start command to the PCB tester 40. As a result, the PCB testing machine 40 starts the test on the actual PCB 30. (S1
00, S101) (2). The PCB tester 40 applies a voltage to an input pin of a component mounted on the actual PCB 30, measures a voltage value of an output pin, and compares it with an expected value (the ICT). The quality of each component is determined, and the unique name of the defective component is sent to the personal computer 10. (S102, S103) The identification name display means 2 displays the unique name on the screen. (3). The control unit 9 of the personal computer 10 outputs an imaging instruction of the actual PCB 30 to be tested to the imaging device 20, and the imaging device 20 sends the imaging data to the personal computer 10. (S104, S105) This imaging command may be output simultaneously with the test start command. When the imaging and the test are performed simultaneously and in parallel, and there is no defective component, the imaging is consequently useless. It takes time. Alternatively, the control unit 9 may autonomously image the actual PCB 30 to be tested and output the imaging result to the personal computer 10 without outputting the imaging command. (4). The image display means 1 displays an image on a screen. The identifier designation means 4 finds the first coordinates of the defective component from the correspondence table between the unique names and the first coordinates, and sends them to the coordinate conversion means 5. (S106, S107) The identifier designation unit 4 sends the unique name of the defective component to the identifier display unit 2 and displays it on the screen. (S108)

[0007] The following points are problematic in the coordinate conversion. . The origin of the first coordinates 7 and the origin of the second coordinates 8 are of course different positions. The unit system of the first coordinates 7 is mi1 (inch system) or μm (metric system). On the other hand, the unit system of the second coordinates 8 is the grid position from the origin with the origin at the upper left of the screen. Furthermore, the specific value of each of the first coordinates 7 may be-(minus, negative), or the change (Δx, Δy) from the immediately preceding coordinate value may be expressed. . The vertical and horizontal sizes of the image PCB and the actual vertical and horizontal sizes are generally different. Further, the size of the aspect ratio of the image PCB may be different from the size of the aspect ratio of the actual product. . There is a possibility that the coordinate system (second coordinates 8) on the image PCB has a mirror relationship with the coordinate system (first coordinates 7) of the actual PCB. That is, there is a possibility that the image on the PCB is upside down or left and right. . In order to make it easier for the operator to view the image, there is a possibility that the original image itself is enlarged or reduced by means such as rubber bound. The size of the aspect ratio of the original image may be different from the size of the aspect ratio of the final image. . The actual position (x, y) is not always mapped to the position (X, Y) on the screen in the form of a linear function. This is because “distortion” occurs in the image due to the characteristics of the imaging device and other causes. In consideration of the above points, the coordinate conversion will be described next.

(5). Coordinate conversion from actual position (x, y) to position (X, Y) on screen This will be described with reference to FIGS. (X, Y) and (X ′, Y ′) described below are as described above.
(X, Y) is a value obtained by initially converting (x, y),
(X ′, Y ′) is a value obtained by adjusting the position of (X, Y). FIGS. 7 and 8 are diagrams for explaining the coordinate conversion from the actual position (x, y) to the final position (X ′, Y ′) on the screen. That is, this is the case of the conversion path of (x, y)-(X ', Y'). FIG. 9 and FIG. 10 are explanatory diagrams in the case where the initial coordinates are adjusted so that the position of each component is correctly converted. That is, (x, y)-(X, Y)-
This is the case of the conversion path of (X ′, Y ′). 7 and 8 indicate the position (x, y) of the component on the actual PCB, and □ indicates the position (X, Y) on the screen corresponding to the component.
Is shown.

[0009] FIG. 7 shows a case where a component on the actual PCB is enlarged or reduced while maintaining the relative position and displayed on the screen 54 as an image. In this case, (x,
y) and (X ′, Y ′) are represented by X ′ = mx + n,
Y ′ = py + q. Coefficients m and p are ratios of enlargement or reduction of the image to the actual PCB, and constants n and q are values for adjusting the position between the origin of the dot coordinates on the display screen and the origin of the image. In order to obtain the parameters m, n, p, and q, two specific points (x1, y1), (x2, y
2) and corresponding (X'1, Y'1), (X'2,
Y′2) may be determined and calculated.

[0010] FIG. 8 shows a case where the image is point-symmetric with respect to the actual PCB. That is, assuming that the actual PCB is rectangular, the image is point-symmetric with respect to the intersection of straight lines connecting diagonal points of the rectangle. In this case, the relationship between (x, y) and (X ′, Y ′) is X ′ = my +
n, Y '= px + q. Coefficients m and p are actual PCB
Is the ratio of the enlargement or reduction of the image to
Is a position adjustment value between the origin of the dot coordinates on the display screen and the origin of the image. In order to obtain the parameters m, n, p, and q, two specific points (x1, y1), (x2,
y2) and corresponding (X'1, Y'1), (X '
2, Y'2).

[0011] FIG. 9 shows a case where the enlargement or reduction ratio of the image is not constant depending on the actual position on the PCB. That is, the. In this case, the coefficients m and p are not constant and are functions of the position (x, y). In the initial coordinate conversion, the part A is correctly converted to the position of the part A on the screen 55, but the other parts B, C, D, and E are not correctly converted. Assuming that the mode is the selection mode by the above-described mode switching (see FIG. 5), when the component name “B” is selected, the screen 55
Some mark (for example, a red circle mark) is attached to the position of ● in B of FIG. Originally, this mark must be attached to the position of B in □ like the part “A”. The same applies to the other components C, D, and E. FIG. 10 shows a final image conversion state, and shows a result obtained by adjusting the positions of the components shown in FIG.

[0012] FIG. 11 shows that coordinate conversion is performed by specifying a specific part or a group of parts. That is, the above. This is a case where coordinate conversion cannot be performed by a simple operation as described above. In this case, the position (x, y) of the component on the actual PCB by specifying the specific component or the component group
And the position on the screen (X, Y). The worst case is (x, y) and (X, Y) for every single part.
It is necessary to find the relationship between the two and create a correspondence table.

[0013] FIG. 12 shows a case where the coefficient m (p) is expressed by a linear expression of x (y). Whether or not the coefficient m (p) can be represented by a linear expression of x (y) is determined as follows. That is, a part A near the origin of the image, a part C near the center point, and a part E near the maximum value of the coordinates (x, y).
The rate of expansion or contraction m (p) is calculated, and the m
If (p) is on a straight line, the coefficient m (p) may be considered as a linear expression of x (y). Here, the method of obtaining the enlargement or reduction rate m (p) of the part A is m = xA / X′A, p = yA
/ Y'A. xA and yA are the coordinates of the actual part A on the PCB, and X'A and Y'A are the coordinates on the image.
The other parts C and E can be similarly obtained. The origin on the image is obtained by translating the origin on the dot coordinates of the screen in parallel.

[0014] FIGS. 13 to 15 show operations such as enlargement and reduction in order to match the result of the initial transformation of the first coordinates 7 with the position of each component on the screen. FIG.
FIG. 14 shows the coordinates 50b obtained by vertically mirror-inverting the result 50a of the initial conversion and the coordinates 50c obtained by flipping the horizontal mirror. FIG.
0e, the horizontal movement coordinate 50f. FIG. 15 shows coordinates 50h obtained by vertically extending the result 50g of the initial conversion, coordinates 50i obtained by horizontally extending, and coordinates 50j obtained by extending both the vertical and horizontal directions.

[0015] FIG. 16 is a diagram illustrating coordinate conversion by designating a diagonal component. The actual PCB 30 is virtually divided into rectangles, and a position (second coordinate 8) on the display corresponding to a component position (first coordinate 7) of a diagonal end point of the rectangle is designated. The position of the other component position on the display (second coordinate 8) is calculated.
In FIG. 16, positions on the display of the components A and E on the actual PCB 30 indicated by ● (second coordinates 8).
Is specified, the positions (second coordinates 8) of the other components B, C, and D on the display are calculated, and the result is displayed on the display screen 57.

[0016] Also, the original image is enlarged or reduced to make it easier to see the image on the screen, or partially enlarged or reduced.
Although reduction may be performed, any one of the following methods may be used in this case. In the first method, the above-described coordinate conversion is performed on the original image, the position is adjusted, and then the original image is enlarged or reduced. It is necessary to further convert the coordinates after the position adjustment. In this case, the coordinate conversion can be performed by the simple linear conversion described above. The second method is to enlarge / reduce the original image,
This is a method for performing the above coordinate conversion.

(6). The coordinate conversion means 5 sends the coordinates (X, Y) on the screen to the pointing means 3, and the pointing means 3 sends the coordinates (X, Y) of the defective part to the corresponding position (X, Y).
Y) is highlighted. (S109, S110)

[0018]

As described above, after performing an operation such as enlargement / reduction of an image or a graphic on the display screen, it is possible to highlight necessary portions, to improve visibility, and to perform various operations. This will lead to improved efficiency.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating the principle of the present invention.

[Figure 2] Area division on the display screen

[Figure 3] Superimposed display on the display screen

FIG. 4 is a configuration diagram of an embodiment of the present invention.

FIG. 5 Mode (designation or selection) switching

FIG. 6 is a flowchart for indicating a position of an image of a defective component in a PCB test.

[FIG. 7] The actual component position on the PCB and the component position on the image (1)

FIG. 8 shows the actual component position on the PCB and the component position on the image (2).

FIG. 9: Initial coordinate conversion state

FIG. 10: Final coordinate transformation state

FIG. 11: Coordinate transformation by specifying a specific part or a group of parts

FIG. 12 shows a case where a coefficient m or p is a linear function of coordinates x or y.

FIG. 13: Image vertical and horizontal mirror inversion function

FIG. 14: Vertical and horizontal movement functions of an image

FIG. 15: Vertical and horizontal image enlargement functions

FIG. 16: Coordinate transformation by designating a diagonal part

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 Image display means 2 Identifier display means 3 Pointing means 4 Identifier designation means 5 Coordinate conversion means 6 Identifier selection means 7 First coordinate 8 Second coordinate 9 Control unit 10 Computer display support device 20 Imaging device 30 P
CB actual 40 PCB testing machine 50-57, 50a-50j Display screen S100-S110 Processing procedure

Claims (10)

[Claims] 1. An image display device, comprising: at least one of an identification name designation unit and an identification name selection unit;
Image display means, identification name display means, coordinate conversion means,
Pointing means, wherein the image display means displays at least one image or figure on a display screen of the image display device, and the identification name display means displays a `` thing '' or a `` human '' on the display screen. At least one identification name is displayed, the coordinate conversion means converts the coordinate data from the first coordinate system to the second coordinate system, and the pointing means is an image or a graphic based on the coordinate data of the second coordinate system. And the identification name designation means designates the identification name of the "thing" or "human" corresponding to the particular location to be highlighted in the image or the figure, and A computer display support device, wherein the name selection means selects a specific one from the identification names of the "thing" or "human" displayed by the identification name display means. 2. A coordinate system according to claim 1, wherein said coordinate conversion means converts all or a part of the coordinate data of said "thing" or "human" expressed in a first coordinate system to a second coordinate system. A computer display support device characterized by performing initial conversion. 3. The object according to claim 2, wherein the value of the initial coordinate of the second coordinate system is the coordinate value of the corresponding “thing” or “human” of the image.
Alternatively, a computer display support device characterized by marking "human". 4. The image processing apparatus according to claim 3, wherein when the mark is different from a correct position of a corresponding “thing” or “human” in the image, the value of the initial coordinate of the second coordinate system is adjusted. Corresponding "thing" or "human"
Computer display support device, wherein the display positions are matched with each other. 5. The computer display support device according to claim 1, wherein an area on the display screen is divided into an area for displaying an image or a figure and an area for displaying an identification name. 6. The computer display support device according to claim 1, wherein an image or a figure and an identification name are superimposed and displayed on a display screen. 7. A computer display support apparatus according to claim 5, wherein a mode can be switched from either one of the identifier designation means and the identifier selection means to the other means. . 8. The image on the display screen according to claim 4 or 7, wherein the image on the display screen is a captured image of the front surface or the back surface or both the front surface and the back surface of the unmounted printed circuit board, and “mono” means the land or The through-hole or the wiring pattern, the identification name of “thing” is the unique name of the land or the through-hole or the wiring pattern, and the coordinate data of the first coordinate system is the data obtained from the manufacturing data of the printed circuit board or the display screen. A computer display support device, wherein the coordinates are grid coordinates, and the coordinate data of the second coordinate system is grid coordinates of a display screen. 9. The image information on the display screen according to claim 4 or 7, wherein the image information on the front surface or the back surface or both the front surface and the back surface of the mounted printed board on which the component is mounted is image information. The component mounted on the printed circuit board, the identifier of “thing” is the unique name of the component, and the coordinate data of the first coordinate system is data obtained from the mounting data of the component or grid coordinates of the display screen. Wherein the coordinate data of the second coordinate system is grid coordinates of a display screen. 10. The computer display support device according to claim 8, wherein the identification name designation means designates the identification name of “thing” based on the data sent from the testing machine.