JP2006318215A - Data storage device and data display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technique for effectively utilizing information, such as images, keywords, etc. to be stored or being already stored regardless of a user. <P>SOLUTION: An image picked up in a predetermined process is input. A plurality of image information regarding the predetermined process is received. The input image and the plurality of item information are displayed. For the plurality of item information and the image which are displayed, specification of a reference order which is considered to be effective for determining a phenomenon caused in the predetermined process is received. The plurality of item information and the image which are displayed are stored in association with the reference order if there is the reference order specified respectively. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a technique for effectively using images and information captured and accumulated in a predetermined process.

  Conventionally, data accumulation that can be considered as a reference in the future has been performed in various situations. For example, in a facility where an experiment is performed, not only data of a successful experiment but also data obtained by an unsuccessful experiment may be accumulated. For example, in the manufacturing process of industrial products, when a defective product occurs, data related to the generation of the defective product is accumulated. The data accumulated in this way is referred to and used to estimate factors when similar events occur, and to prevent experimental failures or defective products.

For example, a technology has been proposed that enables search for case data by keywords by creating and storing foreign matter / defect images in the thin film device manufacturing process, and case data consisting of keywords representing the features and countermeasures of foreign matter / defects. (See Patent Document 1).
JP 2002-269109 A

  However, beginners do not understand what judgment should be made based on each presented image and each keyword only by presenting the image and keyword as a search result of the accumulated case data. I wanted. For this reason, there is a problem that the accumulated case data is not utilized smoothly.

  For example, suppose a case in which the cause of failure is examined using a case database in which images and keywords relating to failures that occurred in the past in the substrate mounting process are accumulated. At this time, it is assumed that a plurality of images and a plurality of keywords as shown in FIG. 10 are obtained as search results. In this case, if it is an expert, he can understand what kind of judgment should be performed based on the acquired image and keyword. Specifically, since the “discovery process” is the “reflow process” and the “defective species” is “S-wetting”, the expert understands that the image after reflow should be viewed. And the expert understands that the floating defect has occurred in the 4th pin by looking at the image after reflow, and from that, “primary factor”, “image after solder printing”, “secondary factor”, And it can be understood that the factors should be judged in the order of “cause process”.

  On the other hand, for beginners, even if an image or keyword obtained as a search result is presented, what item should be referred to first, what part of which image should be looked at, and what judgment should be made, It may not be understood at all. In such a case, even if useful images and keywords are obtained as search results, it is impossible to make a desired decision by effectively using these images and keywords.

  Therefore, an object of the present invention is to provide a technology capable of effectively utilizing information such as images and keywords that are or will be accumulated from now on regardless of who the user is. To do.

In order to solve the above problems, the present invention provides an apparatus for accumulating data such as images and the like so as to facilitate the utilization of the accumulated data and the utilization of the accumulated data as follows. It takes two aspects of an apparatus for displaying the accumulated data.

  A first aspect of the present invention is a data storage device, and includes an image input unit, an information input unit, a display unit, an order designation unit, and a storage unit. The image input means inputs an image captured in a predetermined process. The information input means can input a plurality of item information related to a predetermined process. The display means displays the input image and a plurality of item information. The order designating unit can designate a reference order that is valid for judging an event that has occurred in a predetermined process for a plurality of item information and images displayed on the display unit. The storage unit stores the plurality of input item information and images in association with the reference order if there is a reference order designated for each item information and image.

  According to the first aspect of the present invention configured as described above, in the storage unit, when a plurality of input item information and images have a reference order designated for each, the information is stored in association with the reference order. Is done. Therefore, when a reference order is designated and stored by a person who understands how to refer to images and item information, such as an expert, the beginner can easily know the reference order. Even a beginner can effectively use the stored image and item information by referring to the image and item information according to the same reference order as the expert.

  The first aspect of the present invention may be configured to further include correspondence specifying means that enables specification of correspondence between item information and an image. In this case, the storage unit is configured to further store the association between the item information and the image.

  According to the first aspect of the present invention configured as described above, for example, when referring to certain item information, an image that is desired to be referred to can be stored in association with the item information. Become. For this reason, by designating such association by an expert or the like, even a beginner can easily know an effective relationship between item information and an image. Therefore, it is possible to effectively use the accumulated data even for beginners.

  The information input means according to the first aspect of the present invention may be configured to further enable input of image information relating to a characteristic portion appearing on the image. In this case, the storage unit is configured to further store image information input for the image in association with the image.

  According to the first aspect of the present invention configured as described above, for example, the content of a characteristic portion to be noted about a certain image is input as image information. For this reason, by inputting image information by a skilled person or the like, even a beginner can easily know a noticeable part or noticeable content in an image. Therefore, it is possible to effectively use the accumulated data even for beginners.

A second aspect of the present invention is a data display device, which includes storage means, display means, and designation means. The storage means includes an image captured in the predetermined process and a plurality of item information related to the predetermined process, and a reference order that is valid for determining an event that has occurred in the predetermined process with respect to the plurality of item information and the image. Store it in association. The display means includes a first display area and a second display area. The first display area displays a plurality of item information and images stored in the storage means. The second display area displays the item information and the image according to the reference order stored in the storage unit. The designation means allows the user to designate item information and an image displayed in the second display area. The first display area displays the item information in a manner different from other item information when the item information is designated by the designation unit, and displays the image when the item is designated by the designation unit. The characteristic part included in the image is displayed in a visible manner.

  According to the second aspect of the present invention, a plurality of item information and images are displayed in the second display area in accordance with the reference order specified for each. For this reason, when the reference order designated by a person who understands how to refer to images and item information, such as a skilled person, is stored in the storage means, by looking at the display in the second display area The beginner can easily learn the reference order. For this reason, even a beginner can effectively use the stored image and item information (stored in the storage means) by referring to the image and item information in the same reference order as the expert. It becomes.

  The storage means in the second aspect of the present invention may be configured to further store the association between the item information and the image. In this case, when the image associated with the item information designated by the designation unit is stored in the storage unit, the first display area can visually recognize the characteristic portion included in the image. Configured to display in various ways.

  According to the second aspect of the present invention configured as described above, for example, when referring to certain item information, an image that is desired to be referred to is stored in association with the item information. The item information and the image are displayed in the first display area. For this reason, by specifying such correspondence by an expert or the like, even a beginner can easily know the effective relationship between the item information and the image and visually recognize it on the same screen. It becomes possible. Therefore, it is possible to effectively use the accumulated data even for beginners.

  The storage means in the second aspect of the present invention may be configured to further store image information relating to a characteristic portion appearing on the image in association with the image. In this case, the first display area is configured to further display image information stored in association with the image in the storage unit when displaying the image.

  According to the second aspect of the present invention configured as described above, for example, the contents of a characteristic portion to be noted about a certain image are stored in association with this image as image information. When this image is displayed, the corresponding image information is also displayed. For this reason, by inputting image information by a skilled person or the like, even a beginner can easily know a noticeable part or noticeable content in an image. Therefore, it is possible to effectively use the accumulated data even for beginners.

  The present invention may be realized by a program being executed by an information processing apparatus. That is, the present invention can specify the processing executed by each means described above as a program for causing the information processing apparatus to execute, or a recording medium on which the program is recorded. Further, the present invention may be specified by a method in which the information processing apparatus executes the processing executed by each of the above-described means.

  According to the present invention, it is possible to effectively utilize information such as images and keywords that are or will be accumulated from now on regardless of who the user is.

[First embodiment]
〔System configuration〕
First, the data storage device 1 will be described as a first embodiment. The data storage device 1 is a device for storing (accumulating) data of an image captured in a predetermined process, a plurality of item information, image information, and the like in a storage device. The predetermined process is a process in which an image is captured in the process to determine whether or not the process is successful and whether or not an object to be processed is good or bad. Specifically, the predetermined process is, for example, a process such as an industrial product manufacturing process or a product quality control process. Hereinafter, a case where “predetermined processing” is a substrate mounting process of an industrial product manufacturing process and “an event occurring in the predetermined processing” is a defect generated on the substrate will be described. The board mounting process is a process of mounting and inspecting a board on which no parts are mounted, and includes, for example, the following six processes. The six processes are: the process of printing solder with a solder printer, the process of inspecting the degree of printing of solder with an inspection apparatus after solder printing, the process of placing parts on the solder with a mounter, and the parts being soldered with an inspection apparatus after mounting. A step of inspecting whether or not the solder is placed on the substrate, a step of melting the solder at a high temperature by a reflow device and bonding the component and the solder, and a step of inspecting whether the solder and the component are bonded by an inspection device after reflow It is. The board mounting process constituted by these six processes is an example of the board mounting process, and the data storage device 1 may be applied to the board mounting process constituted by other processes.

  The item information is information related to a predetermined process and includes an item name and its contents. In the case of the present embodiment, the item information includes, for example, the name of the process in which a defect is found among a plurality of processes obtained by further subdividing the board mounting process, and information related to the process in which imaging is performed (process name and execution date and time) Etc.), information on parts and materials mounted on the board (part name, type of solder used, etc.), information on the environment where the board was mounted (room temperature, humidity, work manager name, etc.) It includes information (such as primary factors, secondary factors, and defect types) related to defects caused by processing.

  Further, the image information is information relating to a characteristic part appearing on the image, in other words, information relating to a notable part in the image. For example, information such as the color or shape of a characteristic portion that has appeared on the image due to a defect, or a comment input by the user regarding this characteristic portion. Such image information is utilized by other users. That is, by referring to such image information by another user, the other user can know a notable part in the image. The image information is composed of an item name and its contents.

The data storage device 1 includes a CPU (central processing unit), a main storage device (RAM), an auxiliary storage device, and the like connected via a bus in terms of hardware. The auxiliary storage device is configured using a nonvolatile storage device. The nonvolatile storage device referred to here is a so-called ROM (Read-Only Memory: including EEPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), mask ROM, etc.), FRAM (Ferroelectric RAM). ), Hard disk, etc.

  FIG. 1 is a diagram illustrating functional blocks of the data storage device 1. The data storage device 1 is loaded with various programs (OS, applications, etc.) stored in the auxiliary storage device and executed by the CPU, whereby the input unit 2, the image input unit 3, the control unit 4, It functions as a device including the storage unit 5, the display unit 6, and the like. The control part 4 is implement | achieved when a program is run by CPU. The control unit 4 may be configured as a dedicated chip. Next, each functional unit included in the data storage device 1 will be described.

<Input section>
The input unit 2 is configured using an input device. Any existing input device may be applied to the input unit 2. The input unit 2 is configured using, for example, a keyboard, a pointing device (mouse, trackball, tablet, etc.), a touch panel, a numeric keypad, various buttons, a voice input device, and the like.

The user can input item information and image information to the data storage device 1 by operating the input unit 2 and inputting text data. In this case, the input unit 2 functions as information input means.

  Further, the user can designate the reference order for item information and images displayed on the display unit 6 described later by operating the input unit 2. The reference order is an order that is recognized as effective for judging an event that has occurred in a predetermined process by referring to item information or an image according to the order. In the case of this embodiment, the reference order is recognized to be effective for estimating the cause of the defect that has occurred in the substrate. The user can specify the reference order for each selected item information or image by selecting item information or an image according to the reference order. The user can also change the reference order once designated by operating the input unit 2. In this case, the input unit 2 functions as an order specifying unit.

  Further, the user can specify the association between the item information and the image by operating the input unit 2. In this case, when referring to certain item information, it is desirable that the item information is associated with an image that helps to estimate the cause of the defect that has occurred on the substrate by referring to the item information at the same time.

  For example, the input unit 2 may be configured so that the association can be specified by continuously selecting an image and item information to be associated after selecting a button for performing the association. For example, the input unit 2 may be configured so that the association can be specified by dragging and dropping the other item information or image with respect to one image or item information to be associated. The user can also specify the association of a plurality of images with respect to one item information, or can specify the association of the same image with each of a plurality of different item information. In this case, the input unit 2 functions as a correspondence specifying unit.

<Image input section>
The image input unit 3 functions as an interface for inputting data of an image captured in a predetermined process (hereinafter simply referred to as “image”) to the data storage device 1. In the case of the present embodiment, the image input unit 3 functions as an interface for inputting images of the substrate imaged in a plurality of steps included in the substrate mounting step. Image data is input to the data storage device 1 by the image input unit 3. The image input unit 3 may be configured using any existing technique for inputting image data to the data storage device 1.

For example, image data is input to the data storage device 1 via a network (for example, a local area network or the Internet) from an imaging device that performs imaging in a predetermined process (in this embodiment, a device that images a substrate). May be. In this case, the image input unit 3 is configured using a network interface. Further, image data may be input to the data storage device 1 from a digital camera, a scanner, a personal computer, a recording device (for example, a hard disk drive), or the like. In this case, the image input unit 3 is a standard (for example, USB (Universal Serial Bus) or SCSI (Small Computer System Interface)) that connects the digital camera, personal computer, recording device, and the like to the data storage device 1 so that data communication is possible. It is configured according to a wired connection or a wireless connection standard such as Bluetooth (registered trademark). In addition, image data recorded on a recording medium (for example, various flash memories, a floppy (registered trademark) disk, a CD (Compact Disk), or a DVD (Digital Versatile Disc, Digital Video Disc)) is input to the data storage device 1. Also good. In this case, the image input unit 3 is configured using a device (for example, a flash memory reader, a floppy disk drive, a CD drive, or a DVD drive) that reads data from a recording medium.

Further, the image input unit 3 may be configured to take an image. In this case, the image input unit 3 may be configured as an imaging device using a CCD (Charge-Coupled Device), a CMOS (Complementary Metal-Oxide Semiconductor) sensor, or the like. The image input unit 3
May be configured to be able to respond to a plurality of cases described above.

<Control part>
The control unit 4 receives item information, image information, and image data input via the input unit 2 and the image input unit 3 and stores them in the storage unit 5. In addition, when the reference order is specified for the item information or image, the control unit 4 stores the item information or image data in the storage unit 5 in association with the reference order specified for each item information or image. Further, when the association between the item information and the image is designated, the control unit 4 further stores this association in the storage unit 5.

  In addition, the control unit 4 instructs the display unit 6 to display item information, image information, and an image based on the contents stored in the storage unit 5. Specific examples of display contents will be described later.

<Storage unit>
The storage unit 5 is configured using a so-called nonvolatile storage device. The storage unit 5 stores item information, image information, and image data in accordance with instructions from the control unit 4. Further, when there is a reference order designated for item information or image data, the storage unit 5 stores the item information or image data in association with the reference order. In addition, when the association between the item information and the image is designated, the storage unit 5 also stores this association.

<Display section>
The display unit 6 is configured using a display device. The display unit 6 may be configured using any existing display device such as a CRT (Cathode Ray Tube) display, a liquid crystal display, a PDP (Plasma Display Panel), or an organic EL (Electro-Luminescent) display. good.

  The display unit 6 displays item information, image information, and images in accordance with instructions from the control unit 4. The user can select item information, image information, and an image displayed on the display unit 6 via the input unit 2.

  FIG. 2 is a diagram illustrating a display example when item information is input. In the display example shown in FIG. 2A, only the names of the items constituting the item information are displayed, and the contents of the items are not yet input. The name of each item may be arbitrarily input by the user, or may be set in the data storage device 1 in advance. After the screen of FIG. 2A is displayed, the user can input specific contents (values) for each item. FIG. 2B shows a display example when specific contents are input for each item by the user. Finally, a list of item information input by the user is displayed as shown in FIG.

  FIG. 3 is a diagram illustrating a display example when image information is input. In the display example shown in FIG. 3A, three images input via the image input unit 3 are displayed. When the user designates each image using the input unit 2 and inputs the item name of the image information, each image and the item name of each image information are displayed. FIG. 3B is a diagram illustrating a display example when each image and the item name of each image information are displayed. In FIG. 3B, the images are displayed vertically and the item names of the image information are displayed horizontally. In FIG.3 (b), the input frame for inputting the content regarding each image information about each image is provided in matrix form. When the user inputs the content of each image information in each input frame, the input content is displayed as shown in FIG. In this case, there are four types of image information having item names of image name, defect information, non-defective quality, and comment, and each type of image information exists for each of the three images. That is, in the case of FIG. 3C, 12 pieces of image information exist. Then, the item name and contents of each image information are stored in association with each image. Finally, as shown in FIG. 3C, a list of input images and image information input by the user is displayed.

  FIG. 4 is a diagram illustrating a display example when the reference order is designated. For example, in the display of FIG. 2B, the user sequentially selects the discovery process and the defective type, and then selects the top image in the display of FIG. 3C, and the display of FIG. 2B. When the primary factor, the secondary factor, and the originating process are selected in order, the reference order is set in the selected order. Then, the result of the set reference order is displayed as a flowchart as shown in FIG. In the case of FIG. 4, the item name of the item information and the item name of the image information corresponding to the image are used for displaying the flowchart. That is, when a reference order is specified for an image, instead of being displayed as a part of the image flowchart, the item name of the image information corresponding to this image and its contents (in the case of FIG. Information ") is displayed. When the image is included in the flowchart, the item name and content of the corresponding image information may be displayed as a part of the flowchart, and the thumbnail of the image may be displayed on the flowchart side. Further, the image itself may be displayed as a part of the flowchart.

  In addition, when an image is associated with item information, a display to the effect that an image is associated with the item information is displayed. In the display example of FIG. 4, an image is associated with item information having an item name of a primary factor. That is, the number of images associated with the item information having the item name of the primary factor is displayed as “1”. In addition, as long as it is understood that the images are associated with each other, the display to that effect may be made in any manner.

[Operation example]
FIG. 5 is a flowchart showing an operation example of the data storage device 1. An operation example of the data storage device 1 will be described with reference to FIG. First, the control unit 4 receives an input of image data via the image input unit, and the image data is input to the data storage device 1 (S01). The control unit 4 stores the input image data in the storage unit 5 and causes the display unit 6 to display the data. In accordance with this instruction, the display unit 6 displays the input image (S02). In addition, the control unit 4 receives input of item information and image information via the input unit 2. By referring to the displayed image, the user operates the input unit 2 to input item information and image information to the data storage device 1 (S03). The control unit 4 stores the input item information and image information in the storage unit 5 and displays them on the display unit 6 (S04).

  Next, the control unit 4 receives designation of association between item information and an image via the input unit 2. By referring to the displayed item information and image, the user operates the input unit 2 to specify the association between the item information and the image (S05). In addition, the control unit 4 receives designation of the reference order of item information and images via the input unit 2. The user operates the input unit 2 to specify the reference order (S06). And the control part 4 complete | finishes accumulation | storage of item information, image information, and an image by further memorize | storing the designated matching and reference order in the memory | storage part 5 (S07).

[Action / Effect]
The data storage device 1 does not simply store the image captured in the predetermined process and the item information that is information related to the predetermined process independently of each other. The data storage device 1 stores these images and item information in association with a reference order that is recognized as effective for determining an event that has occurred in a predetermined process. For this reason, even a beginner who does not know how to use the stored image and item information can easily know the reference order. And even such a beginner can refer to the image and item information stored in the data storage device 1 according to the reference order specified by other users, thereby causing defects (in a predetermined process) It is possible to determine whether or not the event has occurred and the cause thereof.

[Modification]
The reference order and association stored in the data storage device 1 are preferably designated by a person skilled in determining events that have occurred in a predetermined process. By being specified by such an expert, the accuracy of the data stored in the data storage device 1 is improved, and at the same time, the processing accuracy of the person who performs the subsequent processing based on the stored data is improved. be able to.

[Second Embodiment]
〔System configuration〕
Next, the data display device 7 will be described as a second embodiment. The data display device 7 is a device that displays the images, item information, image information, and the like stored by the data storage device 1 so that the user can effectively use the stored data. Hereinafter, the data display device 7 that displays the data stored in the storage unit 4 by the data storage device 1 described above will be described. Note that the use of the data display device 7 does not have to be limited to displaying a substrate mounting process of an industrial product manufacturing process or an image related to a defect generated on the substrate. In other words, the data display device 7 displays the accumulated data when the data storage device 1 stores data on other “predetermined processes” and other “events occurring in the predetermined processes”. You may do it. Note that the definitions of item information, image information, images, and the like in the following description are the same as the definitions in the first embodiment.

In terms of hardware, the data display device 7 includes a CPU (Central Processing Unit), a main storage device (RAM), an auxiliary storage device, and the like connected via a bus. The auxiliary storage device is configured using a nonvolatile storage device. The nonvolatile storage device referred to here is a so-called ROM (Read-Only Memory: including EEPROM (Erasable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), mask ROM, etc.), FRAM (Ferroelectric RAM). ), Hard disk, etc.

  FIG. 6 is a functional block diagram of the data display device 7. The data display device 7 is loaded with various programs (OS, applications, etc.) stored in the auxiliary storage device and executed by the CPU, whereby the input unit 8, the control unit 9, the storage unit 10 and the display are displayed. It functions as a device including the unit 11 and the like. The control unit 9 is realized by executing a program by the CPU. The control unit 9 may be configured as a dedicated chip. Next, each functional unit included in the data display device 7 will be described.

<Input section>
The input unit 8 is configured using an input device. Any existing input device may be applied to the input unit 8. The input unit 8 is configured using, for example, a keyboard, a pointing device (mouse, trackball, tablet, etc.), a touch panel, a numeric keypad, various buttons, a voice input device, and the like.

  The user can designate (select) item information and images displayed on the display unit 11 described later by operating the input unit 8. In this case, the input unit 8 functions as a designation unit.

<Control part>
The control unit 9 instructs the display unit 11 to display an initial screen based on item information, image information, and images stored in the storage unit 10. When item information or an image is designated via the input unit 8, data relating to the designation is received from the input unit 8, and a change in display content is performed based on the designated item information or image. To instruct. Specific examples of the initial screen and display contents will be described later.

<Storage unit>
The storage unit 10 is configured using a so-called nonvolatile storage device. The storage unit 10 stores the same data as the storage unit 4 in the data storage device 1. That is, the storage unit 10 stores item information, image information, images, reference order, association between item information and images, and the like stored by the data storage device 1. However, the storage content of the storage unit 10 is not necessarily stored only by the data storage device 1, and may be stored by another device as long as similar data is stored.

<Display section>
The display unit 11 is configured using a display device. The display unit 11 may be configured using any existing display device such as a CRT (Cathode Ray Tube) display, a liquid crystal display, a PDP (Plasma Display Panel), or an organic EL (Electro-Luminescent) display. good.

  The display unit 11 displays item information, image information, and images in accordance with instructions from the control unit 9. The display screen of the display unit 11 includes a first display area and a second display area. FIG. 8 is a diagram illustrating an example of a display screen by the display unit 11. FIG. 8A is a diagram illustrating a display example of the initial screen. In the example of the display screen shown in FIG. 8A, the display screen has four areas (hereinafter, each area is referred to as “upper left area”, “lower left area”, “upper right area”, “lower right area”, respectively). Called).

  The first display area performs display regardless of the reference order. In FIG. 8A, the upper left area, the upper right area, and the lower right area are first display areas. In the upper left area, a list of item information (for example, the display example of FIG. 2B) is displayed. In the upper right area, a list of images and image information (for example, the display example of FIG. 3C) is displayed. FIG. 7 is a diagram illustrating a display example of the lower right area. In the lower right area, the image is displayed in such a manner that a characteristic portion included in the image can be visually recognized. For example, an image larger than the image displayed in the upper right area is displayed in the lower right area. If the image is displayed in such a large size, it is possible to visually recognize the details of the image, and as a result, the user can visually recognize the characteristic portion included in the image. In the lower right area, image information related to the displayed image may be further displayed. For example, the content of the comment in the image information may be displayed in a display frame “context details”. Hereinafter, the lower right area is referred to as an image display area.

  The second display area displays item information and images according to the reference order. In FIG. 8A, the lower left area is the second display area. In the second display area, for example, item names and images of item information are displayed as a flowchart according to the reference order (for example, the display example of FIG. 4). The user can specify a part (each item name) of the flowchart displayed in the second display area by using the input unit 8.

FIG. 8B is a diagram illustrating a display example after the “primary factor” that is the item name of the image information is designated in the second display area of the initial screen. When such designation is made, the control unit 9 determines from the stored contents of the storage unit 10 that the designated item name is image information. Then, the control unit 9 reads an image corresponding to the image information and the image information from the storage unit 10 and instructs the display unit 11 to perform display according to the contents. Then, the display unit 11 performs a display as shown in FIG. In FIG. 8B, an image corresponding to the image information designated by the user is displayed in the image display area. Also, image information corresponding to this image is displayed in the image display area. In addition, the corresponding image in the list display of the images displayed in the upper right area of the first display area and the image information related to the image are displayed in a manner different from the image information related to the other images (for example, highlight display, reverse display, enlarged display Display). Hereinafter, a case of performing highlight display will be described as an example of display in a mode different from image information regarding other images.

  When the item name of the item information is designated in the second display area, the same item name in the list display of the item information displayed in the upper left area of the first display area is highlighted. If there is an image associated with the specified item information, the image is displayed in the image display area.

[Operation example]
FIG. 9 is a flowchart showing an operation example when item information is specified among the operation examples of the data display device 7. An operation example of the data display device 7 will be described with reference to FIG. First, the control unit 9 instructs the display unit 11 to display item information, image information, and a list of images stored in the storage unit 10 in the first display area as an initial screen. The display unit 11 performs display in the first display area according to this instruction (S08). In addition, the control unit 9 reads the reference order stored in the storage unit 10 and instructs the display unit 11 to display the second display area according to the reference order. The display unit 11 performs display in the second display area in accordance with this instruction (S09). These displays may be performed simultaneously.

  Next, the control unit 9 determines whether or not item information is designated by the user in the second display area (S10). When designated (S10-YES), the control unit 9 instructs the display unit 11 to highlight-display the same item information in the upper left area of the first display area. The display unit 11 performs display according to this instruction (S11).

  Next, the control unit 9 determines whether there is an image associated with the specified item information (S12). When there is such an image (S12-YES), the control unit 9 instructs the display unit 11 to display the corresponding image in the image display area. The display unit 11 performs display according to this instruction (S13).

  Next, the control unit 9 determines the presence or absence of image information for the image displayed in the image display area (S14). When there is such image information (S14-YES), the control unit 9 instructs the display unit 11 to display the corresponding image information in the image display area. The display unit 11 performs display according to this instruction (S15). Then, the control unit 9 instructs the display unit 11 to highlight the same image information in the upper right area of the first display area, and the display unit 11 performs display according to this instruction.

  When the condition is not satisfied in any of the determinations of S10, S12, and S14 (S10-NO, S12-NO, S14-NO), or after the process of S15, the control unit 9 is accumulated in the storage unit 10. It is determined whether there is an instruction to end the display of the data. When there is no end instruction (S16-NO), the processes after S10 are repeated. On the other hand, if there is an end instruction (S16-YES), the process ends.

[Action / Effect]
The data display device 7 does not simply display each item information, image information, and image stored by the data storage device 1 independently. The data display device 7 displays these images and item information in the second display area in accordance with the reference order designated by another user. When the user specifies item information displayed in the second display area, the corresponding item information is highlighted in a list display (display of the upper left area of the first display area) showing details of the item information. Is displayed. For this reason, even a beginner who does not know how to use the stored image and item information can easily know the reference order. Even for such a beginner, various images and item information displayed in the first display area of the data display device 7 are displayed in the flow of the flowchart displayed in the second display area (designated by another user). By referring according to the reference order), it is possible to determine whether or not a defect has occurred on the substrate (an event that has occurred in a predetermined process), its cause, and the like.

It is a figure which shows the example of a functional block of a data storage device. It is a figure which shows the example of a display of a display part. It is a figure which shows the example of a display of a display part. It is a figure which shows the example of a display of a display part. It is a flowchart which shows the operation example of a data storage device. It is a figure which shows the example of a functional block of a data display apparatus. It is a figure which shows the example of a display of a display part. It is a figure which shows the example of a display of a display part. It is a flowchart which shows the operation example of a data display apparatus. It is a figure which shows the example of a display of the conventional search result.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Data storage device 2 Input part 3 Image input part 4 Control part 5 Storage part 6 Display part 7 Data display apparatus 8 Input part 9 Control part 10 Storage part 11 Display part

Claims (10)

Image input means for inputting an image captured in a predetermined process;
Information input means for enabling input of a plurality of item information relating to the predetermined processing;
Display means for displaying the input image and a plurality of item information;
An order designating unit for designating a plurality of item information and images displayed on the display unit, which can be designated to be valid for judging an event that has occurred in the predetermined process;
Storage means for storing a plurality of input item information and images in association with the reference order if there is a reference order specified for each;
Including data storage device. A correspondence designating means for enabling designation of the association between the item information and the image;
The data storage device according to claim 1, wherein the storage unit further stores association between the item information and the image. The information input means further enables input of image information relating to a characteristic portion appearing on the image with respect to the image,
The data storage device according to claim 1, wherein the storage unit further stores the image information input for the image in association with the image. Associating an image captured in a predetermined process and a plurality of item information related to the predetermined process with a reference order that is valid for determining an event occurring in the predetermined process with respect to the plurality of item information and the image Storage means for storing
A display including a first display area for displaying a plurality of item information and images stored in the storage means, and a second display area for displaying the item information and images according to a reference order stored in the storage means Means,
Specifying means for allowing a user to specify item information and images displayed in the second display area,
The first display area displays the item information in a manner different from other item information when the item information is designated by the designation means, and displays the image when the designation means designates the image. A data display device that displays a characteristic portion included in the image in a visible manner. The storage means further stores a correspondence between the item information and the image,
When the image associated with the item information designated by the designation unit is stored in the storage unit, the first display area can visually recognize a characteristic portion included in the image. 5. The data display device according to claim 4, wherein the data display device is displayed in such a manner. The storage means further stores image information relating to a characteristic portion appearing on the image in association with the image,
6. The data display device according to claim 4, wherein the first display area further displays the image information stored in association with the image in the storage unit when displaying the image. An image input means for inputting an image, an information input means for enabling the user to input information, a display means for displaying, an order specifying means for specifying the data order, and data are stored An information processing device including a storage unit, through the image input unit, to input an image captured in a predetermined process;
The information processing apparatus accepting input of a plurality of item information related to the predetermined process via the information input means;
Instructing the display means to display the input image and a plurality of item information by the information processing apparatus;
Designation of a reference order that is valid for the information processing apparatus to determine an event that has occurred in the predetermined process for a plurality of item information and images displayed on the display means via the order designation means A step of accepting,
When the information processing apparatus stores a plurality of inputted item information and images in the storage means in association with the reference order if there is a reference order designated for each of the information and the image;
Data storage method. Associating an image captured in a predetermined process and a plurality of item information related to the predetermined process with a reference order that is valid for determining an event occurring in the predetermined process with respect to the plurality of item information and the image An information processing apparatus including: a storage unit that stores data; a display unit that displays in the first display region and the second display region; and a designation unit that enables designation of data displayed on the display unit. Instructing the display means to display a plurality of item information and images stored in the storage means in the first display area;
Instructing the display means to display the item information and the image in the second display area in accordance with a reference order stored in the storage means;
The information processing apparatus accepting designation of item information and an image displayed in the second display area via the designation unit;
When the information processing apparatus designates item information via the designation means, the information processing apparatus instructs the display means to display the item information in the first display area in a manner different from other item information. Steps,
When the information processing apparatus designates an image via the designation means, the image is displayed in the first display area in such a manner that a characteristic part included in the image can be visually recognized. Instructing the display means;
Data display method. An image input means for inputting an image, an information input means for enabling the user to input information, a display means for displaying, an order specifying means for specifying the data order, and data are stored For an information processing apparatus including storage means,
Inputting an image picked up in a predetermined process via the image input means;
Receiving a plurality of item information regarding the predetermined process via the information input means;
Instructing the display means to display the input image and a plurality of item information;
Receiving a designation of a reference order that is valid for determining an event that has occurred in the predetermined process for a plurality of item information and images displayed on the display means via the order designation means;
A plurality of input item information and images, if there is a reference order designated for each, and associating with the reference order, storing in the storage means;
A program for running Associating an image captured in a predetermined process and a plurality of item information related to the predetermined process with a reference order that is valid for determining an event occurring in the predetermined process with respect to the plurality of item information and the image For an information processing apparatus including a storage means for storing, a display means for displaying in the first display area and the second display area, and a specifiable means for enabling designation of data displayed on the display means,
Instructing the display means to display a plurality of item information and images stored in the storage means in the first display area;
Instructing the display means to display the item information and the image in the second display area according to a reference order stored in the storage means;
Receiving the designation of the item information and image displayed in the second display area via the designation means;
Instructing the display means to display the item information in the first display area in a manner different from other item information when the item information is designated via the designation means;
When an image is designated through the designation means, the display means is instructed to display the image in the first display area in a manner in which a characteristic portion included in the image can be visually recognized. And steps to
A program for running

Images