WO2014141534A1

WO2014141534A1 - Comparison system, terminal device, server device, comparison method, and program

Info

Publication number: WO2014141534A1
Application number: PCT/JP2013/080637
Authority: WO
Inventors: 陽三平木; 正安達
Original assignee: 日本電気株式会社
Priority date: 2013-03-13
Filing date: 2013-11-13
Publication date: 2014-09-18
Also published as: JP6123881B2; CN105008251B; JPWO2014141534A1; CN105008251A

Abstract

This comparison system (1) has: a corresponding information search unit (13) that acquires, from corresponding information, identification information associated with level information and the address of a steel member that is the subject of comparison of which the input has been received; an output unit (17) that displays an image in a finder and displays a specific frame in an overlapping manner; an image capture unit (14) that captures the image displayed at the finder; an image recognition unit (15) that, using only a partial image within the specific frame in the captured image, performs an image recognition process to extract an identifying mark notated at the surface of a steel member, and identifies identification information using the extracted identifying mark; and a comparison unit (16) that determines whether or not the identification information acquired by the corresponding information search unit (13) and the identification information recognized by the image recognition unit (15) match.

Description

Verification system, terminal device, server device, verification method and program

The present invention relates to a collation system, a terminal device, a server device, a collation method, and a program.

In the manufacture of steel products, as semi-finished steel products, slabs (thick or thin plate processed), billets (cylindrical or prismatic), blooms (shallow-shaped), beam blanks (A shape close to an H-shape). These steel materials such as slabs are stacked and stored in a plurality of stages in each of a plurality of areas each assigned an address. The manager manages the storage state of a plurality of steel materials by using storage information indicating which identification information (eg, lot number) of steel material is stored at which address and what level. The storage information is updated when an event occurs in which a new steel material is added to the storage location, the stored steel material is shipped, or the storage address is moved to another address. If such storage information is used, when a steel material having certain identification information is shipped, the storage location of the steel material can be easily specified.

However, it cannot be completely excluded that the stored information contains errors due to some kind of malfunction such as human error. Therefore, at the time of shipment, the identification information attached to the surface of the steel material actually stored in the location specified using the storage information (eg, printed) matches the identification information of the steel material to be shipped. Work (verification work) to confirm whether or not In addition, at the specified timing (example: inventory timing), collation work is performed using the identification information (eg: printed) attached to the surface of the steel material stored at the specified position and the storage information. Check that the stored information is correct.

Patent Document 1 discloses a camera for photographing certificates for acquiring image data of certificates transmitted by a customer who wants to loan to a loan examination apparatus, and a frame line for dividing each description item in the certificates Among them, there is disclosed a certificate photographing camera characterized by having photographing frame display means for displaying a photographing frame that matches at least a part of the frame line on a finder.

JP 2012-74804 A

Conventionally, collation work at the time of shipment and at a predetermined timing as described above has been performed manually. That is, the operator visually compares storage information with identification information (for example, printed) attached to the surface of a steel material stored at a predetermined position. Such an operation is very troublesome and requires a lot of time. In addition, human error may occur.

This invention makes it a subject to provide the technique for performing efficiently the collation operation | work of the steel materials piled up and stored in each of the several area where each address was allocated in multiple steps.

According to the present invention,
A collation system for collating a plurality of steel materials that are stacked and stored in each of a plurality of areas each assigned an address,
The identification information of each of the plurality of steel materials stored, the address of the area in which each of the steel materials is stored, and stage information indicating the position in the steel material group stacked in a plurality of stages are associated with each other. Storage means for storing correspondence information;
Input accepting means for accepting input of the address of the steel material to be verified and the step information;
Corresponding information search means for referring to the correspondence information and acquiring the identification information associated with the address and the stage information received by the input receiving means;
A viewfinder, displaying a pre-imaged image and / or an imaged image on the viewfinder, and overlaying the image with a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image Output means for displaying on the viewfinder,
Imaging means for capturing the image displayed on the viewfinder;
Image recognition processing is performed using only a partial image in the specific frame in the image picked up by the image pickup means, and an identification mark written on the surface of each of the plurality of steel materials is extracted and extracted. Image recognition means for recognizing the identification information using the identification mark;
Collation means for determining whether or not the identification information acquired by the correspondence information search means matches the identification information recognized by the image recognition means;
A verification system is provided.

Further, according to the present invention, there is provided a terminal device including the input receiving unit, the output unit, and the imaging unit included in the verification system.

Moreover, according to the present invention,
A viewfinder, displaying a pre-imaged image and / or an imaged image on the viewfinder, and overlaying the image with a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image Output means for displaying on the viewfinder,
Imaging means for capturing the image displayed on the viewfinder;
There is provided a terminal device comprising: a transmission unit that transmits only a partial image within the specific frame in the image captured by the imaging unit to an external device.

Moreover, according to the present invention,
A viewfinder, displaying a pre-imaged image and / or an imaged image on the viewfinder, and overlaying the image with a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image Output means for displaying on the viewfinder,
Imaging means for capturing the image displayed on the viewfinder;
There is provided a terminal device comprising: transmission means for transmitting the image to an external device together with information for identifying a partial image in the specific frame in the image captured by the imaging means.

Further, according to the present invention, there is provided a server device comprising the storage means, the correspondence information search means, and the collation means that the collation system has.

Moreover, according to the present invention,
A program for a terminal device provided with an imaging means for capturing an image displayed on a viewfinder,
Computer
A pre-imaged and / or already-captured image is displayed on the finder, and a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image is superimposed on the image and displayed on the finder. Output means,
Transmitting means for transmitting only a partial image within the specific frame of the image captured by the imaging means to an external device;
A program for functioning as a server is provided.

Moreover, according to the present invention,
A program for a terminal device provided with an imaging means for capturing an image displayed on a viewfinder,
Computer
A pre-imaged and / or already-captured image is displayed on the finder, and a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image is superimposed on the image and displayed on the finder. Output means,
Transmitting means for transmitting the image to an external device together with information for identifying a partial image in the specific frame in the image captured by the imaging means;
A program for functioning as a server is provided.

Moreover, according to the present invention,
A program for a collation system that collates a plurality of steel materials that are stacked and stored in a plurality of stages in each of a plurality of areas each assigned an address,
Computer
The identification information of each of the plurality of steel materials stored, the address of the area in which each of the steel materials is stored, and stage information indicating the position in the steel material group stacked in a plurality of stages are associated with each other. Storage means for storing correspondence information;
An input receiving means for receiving the address of the steel material to be verified and the input of the step information;
Correspondence information search means for referring to the correspondence information and acquiring the identification information associated with the address and the stage information received by the input reception means;
A pre-imaged and / or already-captured image is displayed on the finder, and a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image is displayed on the finder so as to overlap the image. Output means,
Imaging means for capturing the image displayed on the viewfinder;
Image recognition processing is performed using only a partial image in the specific frame in the image picked up by the image pickup means, and an identification mark written on the surface of each of the plurality of steel materials is extracted and extracted. Image recognition means for recognizing the identification information using the identification mark;
Collation means for determining whether or not the identification information acquired by the correspondence information search means matches the identification information recognized by the image recognition means;
A program for functioning as a server is provided.

Moreover, according to the present invention,
A collation method for collating a plurality of steel materials that are stacked and stored in each of a plurality of areas each assigned with an address,
Computer
The identification information of each of the plurality of steel materials stored, the address of the area in which each of the steel materials is stored, and stage information indicating the position in the steel material group stacked in a plurality of stages are associated with each other. Remember the correspondence information,
An input receiving step of receiving input of the address of the steel material to be verified and the step information;
A correspondence information search step of referring to the correspondence information and acquiring the identification information associated with the address and the step information received in the input acceptance step;
A pre-imaged and / or already-captured image is displayed on the finder, and a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image is displayed on the finder so as to overlap the image. An output step;
An imaging step of imaging the image displayed on the viewfinder;
Image recognition processing is performed using only a partial image in the specific frame in the image captured in the imaging step, and identification marks written on the surfaces of the plurality of steel materials are extracted and extracted. An image recognition step for recognizing the identification information using the identification mark;
A collation step for determining whether or not the identification information acquired in the correspondence information search step matches the identification information recognized in the image recognition step;
Is provided.

According to the present invention, it is possible to efficiently perform a collation operation of steel materials stacked and stored in a plurality of stages in each of a plurality of areas each assigned an address.

The above-described object and other objects, features, and advantages will be further clarified by a preferred embodiment described below and the following drawings attached thereto.

It is a figure which shows an example of the functional block diagram of the collation system of this embodiment. It is a figure for demonstrating the example of the area which stores steel materials. It is a figure which shows the example of the steel materials stacked | piled up and stored in the multistage. It is a figure which shows an example of the correspondence information of this embodiment. It is a figure which shows an example of the user interface which the output part of this embodiment displays. It is a figure which shows an example of the user interface which the output part of this embodiment displays. It is a figure which shows an example of the user interface which the output part of this embodiment displays. It is a flowchart which shows an example of the flow of a process of the collation method of this embodiment. It is a figure which shows an example of the user interface which the output part of this embodiment displays. It is a figure which shows an example of the user interface which the output part of this embodiment displays. It is a figure which shows an example of the user interface which the output part of this embodiment displays. It is a figure which shows an example of the user interface which the output part of this embodiment displays. It is a figure which shows an example of the user interface which the output part of this embodiment displays. It is a figure which shows an example of the user interface which the output part of this embodiment displays. It is a figure which shows an example of the user interface which the output part of this embodiment displays. It is a figure which shows an example of the user interface which the output part of this embodiment displays. It is a figure which shows an example of the user interface which the output part of this embodiment displays. It is a figure which shows an example of the user interface which the output part of this embodiment displays. It is a figure which shows an example of the functional block diagram of the collation system of this embodiment. It is a figure which shows an example of the functional block diagram of the collation system of this embodiment. It is a sequence diagram which shows an example of the flow of a process of the collation method of this embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

Note that the system and apparatus of this embodiment include a CPU (Central Processing Unit), a memory, and a program loaded in the memory (a program stored in the memory in advance from the stage of shipping the apparatus, a CD (Including programs downloaded from storage media such as (Compact Disc), servers on the Internet, etc.), storage units such as hard disks that store the programs, and any combination of hardware and software, centering on the network connection interface It is realized by. It will be understood by those skilled in the art that there are various modifications to the implementation method and apparatus.

Further, the functional block diagram used in the description of the present embodiment shows functional unit blocks, not hardware unit configurations. In these drawings, each device is described as being realized by one device, but the means for realizing it is not limited to this. That is, it may be a physically separated configuration or a logically separated configuration.

<First Embodiment>
The inventors of the present invention have studied a technique for realizing, with a computer, verification work of steel materials stacked and stored in a plurality of stages in each of a plurality of areas each assigned an address. First, storage information indicating which identification information (lot number or the like) of steel material is stored at which address and what level is managed by electronic data. Then, image recognition technology is used for the collation work. Specifically, first, an image of an identification mark (for example, printed) attached to the surface of a steel material to be verified is imaged. Then, an identification mark is extracted from an image captured using an image recognition technique, and identification information is recognized using the identification mark. Further, the storage information is searched using the position of the steel material to be verified (information indicating the address and the number of steps) as a key, and the identification information associated with the key is acquired. Then, it is verified whether the identification information recognized using the image recognition technology matches the identification information acquired from the storage information. According to such a technique, human error can be eliminated. However, in the case of this technique, the following problems peculiar to the collation work of steel materials may occur.

Steel imaging needs to be done at the steel storage location. That is, the steel material cannot be moved for imaging. There are various storage locations for steel materials, which may be stored outdoors or indoors. For example, the steel material may be stored in an environment that is not preferable for imaging, such as in a low illuminance environment. In such a case, if the image recognition process is performed using the captured image as it is, there is a possibility that sufficient recognition accuracy cannot be obtained. As a means for solving the problem, a means for imaging the steel material by changing the setting on the camera side to be suitable for each environment can be considered. However, busy workers in the field want to avoid such troublesome changes in camera settings. In addition, it takes time to change the camera settings, and the work efficiency of the entire collation work deteriorates.

Therefore, in order to improve the authentication accuracy, it is necessary to improve the accuracy of the image recognition processing using various image recognition technologies (correction processing, etc.). In such a case, the processing time required for the image recognition process is increased, and the work efficiency of the entire collation work is deteriorated. Even if the waiting time for computer processing is different by a few seconds, the mental impact on the workers on site is great.

Therefore, the present inventors have invented an authentication processing technique that realizes sufficient work efficiency without requiring troublesome operations on site workers. Details will be described below.

FIG. 1 shows an example of a functional block diagram of the matching system 1 of the present embodiment. As shown in the figure, the collation system 1 of the present embodiment includes a storage unit 11, an input reception unit 12, a correspondence information search unit 13, an imaging unit 14, an image recognition unit 15, a collation unit 16, and an output unit. 17. The collation system 1 of the present embodiment may be realized by a single device (for example, a mobile terminal device), or may be realized by two or more devices configured to be able to communicate with each other by wire and / or wirelessly. Good. That is, one apparatus may include all the units shown in FIG. Alternatively, each of the two or more devices may include at least a part of the units illustrated in FIG. 1, and the matching system 1 including all the units illustrated in FIG. 1 may be realized by combining them. An embodiment in which the verification system 1 is realized by two or more devices will be described in the following embodiment.

The collation system 1 of this embodiment is a system for collating a plurality of steel materials stacked and stored in a plurality of stages in each of a plurality of areas each assigned an address.

FIG. 2 shows an example of a plurality of areas each assigned an address. AA1 to AF4 are addresses. Note that the plurality of areas do not necessarily have to be regularly arranged as shown in the figure, and may have a random positional relationship. Further, each of the plurality of areas may be located away from each other. For example, the environments may be different from each other, with some areas being indoors and other areas being outdoors. Moreover, the shape of the area to show in figure is an example, and is not limited to a square.

Fig. 3 shows an example of a plurality of steel materials that are stacked and stored in a plurality of stages. In the illustrated example, plate-like slabs are stacked in five stages. In the present embodiment, the shape of the steel material is not particularly limited. The shape of the steel material may be a plate shape as shown in the figure, or may be other shapes such as a square shape and a rod shape. However, it is preferable to stack the same type of steel materials (the same shape, size, components, etc.) on each other. The number of steels stacked on top of each other is a design matter.

In the example shown in FIG. 3, a plurality of steel materials are stacked in contact with each other, but may be stacked with an intermediate member interposed between the steel materials. For example, each steel material may be mounted on a predetermined mounting member (for example, mounting table), and a plurality of steel materials may be laminated together with the mounting member.

As shown in FIG. 3, an identification mark indicating each identification information is written on the surface of each steel material. For example, an identification mark may be printed on the surface of each steel material by a machine. Or the label (for example, the label which printed the identification mark produced with the computer) which described the identification mark may be stuck on the surface of each steel material. Any form that can be recognized by a conventional image recognition technique can be adopted as the identification mark. For example, the identification mark may be identification information itself made up of alphanumeric characters or the like as shown in the figure, or may be a barcode or a two-dimensional code. In the example shown in the figure, identification information consisting of alphanumeric characters is described in one column, but may be described in two columns and three columns. Such a description form can be changed according to the surface shape of steel materials. However, it is preferable to adopt the same description form for the same type of steel materials (the same shape, size, components, etc.).

The storage unit 11 shown in FIG. 1 includes identification information for each of a plurality of stored steel materials, an address of an area in which each of the steel materials is stored, and stage information indicating positions in a steel material group stacked in a plurality of stages. Is stored in correspondence information. The stage information may be, for example, information indicating the number of stages counted from the bottom, or information indicating the number of stages counted from the top. In the following, it is assumed that the stage information is information indicating the number of stages counted from the bottom. FIG. 4 shows an example of correspondence information. According to the correspondence information shown in the figure, it can be seen that the steel material of the identification information “20130101AB001” is stored in the first row from the bottom of the AA1 address. The correspondence information is updated when an event occurs in which a steel material to be stored is newly added, a steel material to be stored is shipped, or an address to be stored is moved to another address. For example, the content of the correspondence information may be updated based on a human input operation.

Referring back to FIG. 1, the input receiving unit 12 receives the input of the steel material address and step information to be verified. For example, when an operator ships a steel material stored at a certain number of steps at a certain address, this steel material is used as a verification target. Then, the worker inputs the address and stage information indicating the number of stages. In addition, the operator may sequentially check a plurality of steel materials in order to check whether there is an error in the correspondence information stored in the storage unit 11 at a timing such as inventory.

FIG. 5 shows an example of a user interface for the input receiving unit 12 to receive input of the steel material address and step information to be verified. In the example shown in the figure, an address and stage information can be selected by a pull-down menu. Note that the example of the user interface shown in the figure is merely an example, and the present invention is not limited to this (the premise is the same for all user interfaces shown below). For example, a user interface using other GUI (graphical user interface) components may be used. The means by which the input receiving unit 12 receives an input is not particularly limited, and can be realized using any input device such as a touch panel display, an input button, a microphone, a keyboard, and a mouse.

Returning to FIG. 1, the correspondence information search unit 13 refers to the correspondence information (see FIG. 4) stored in the storage unit 11, and is associated with the address and stage information at which the input reception unit 12 has accepted the input. Get the identification information of steel.

The output unit 17 has a finder. The viewfinder can be composed of a display, for example. The viewfinder may be a touch panel display, for example. An image captured by the imaging unit 14 described below (an image before imaging) and / or an image captured by the imaging unit 14 (an image captured) is displayed on the finder. For example, when an imaging instruction is input while an image is displayed on the finder, the image displayed on the finder is captured and imaging data is stored. In addition, a captured image is displayed on the viewfinder using the stored imaging data.

The output unit 17 displays on the viewfinder a specific frame indicating a partial area to be subjected to image recognition processing in the image displayed on the viewfinder. The image recognition process corresponds to an image recognition process executed by the image recognition unit 15 described below. The output unit 17 is configured to be capable of executing at least one of (1) a process of displaying a specific frame superimposed on an image before imaging, and (2) a process of displaying a specific frame superimposed on a captured image. Is done. Below, the output part 17 demonstrates as what performs the process which superimposes and displays a specific frame on the image before imaging (1).

FIG. 6 shows an example in which the output unit 17 displays a specific frame superimposed on an image on a display (finder). In the illustrated display 100, a part of steel materials (see FIG. 3) stored in a plurality of stages is displayed as an image before imaging. More specifically, the identification mark part of the steel materials stacked and stored in a plurality of stages is displayed. On the display 100, the specific frame F is displayed over the image. When the input receiving unit 12 receives an imaging instruction input (e.g., a touch of a shooting button) in the state illustrated, an image displayed on the display 100 is captured. However, the target of the image recognition process is not all the images displayed on the display 100 but only the image in the specific frame F.

The shape of the specific frame F is not limited to a square and may be other shapes. In addition, at least one of the size and shape of the specific frame F and the display position in the display 100 may be changed according to the input of the operator. For example, in the case of a touch panel type display capable of recognizing a plurality of points, there is a method of changing by a method such as pinch-in / pinch-out when changing the size, and an arbitrary position within a specific frame when changing the display position There are methods such as touching and dragging. Or, in the case of a touch panel type display that can recognize only one point, there is a method (touch and slide) such as touching and dragging the intersection of one side or two sides constituting a specific frame to change the display size. When doing, there is a method (touch and slide) such as touching and dragging an arbitrary position in a specific frame. Alternatively, in the case of a display that is not a touch panel type, there is a display using a predetermined button. In addition, when the identification mark is printed on the steel with a machine, or when the label printed with the computer-generated identification mark is affixed to the steel, the form of the identification mark (one line writing, two lines writing, the shape of the identification mark) , The shape of the display area of the identification mark, etc.) is unified in a predetermined state without variation. For this reason, a specific frame F having a shape suitable for the form of the identification mark may be held in the output unit 17 in advance.

Returning to FIG. 1, the imaging unit 14 captures an image displayed on the display 100. The operator inputs an imaging instruction in a state where the identification mark of the steel material to be collated is within the specific frame F. It is preferable to input an imaging instruction in a state where the identification marks of the steel materials other than the verification target are not included in the specific frame F. The imaging unit 14 associates information (specific frame position information) indicating the position of a specific frame at the time of imaging (eg, a position in the image data, a position in the display 100) with the image data of the captured image.

The image recognition unit 15 performs image recognition processing using only a partial image within a specific frame in the image captured by the imaging unit 14. When the image recognition unit 15 acquires the image data of the image captured by the imaging unit 14, the image recognition unit 15 specifies a partial image in the specific frame F using specific frame position information associated with the image data. Then, image recognition processing is performed using only the image data of the specified image.

The image recognition process includes a process of extracting the identification mark written on the surface of the steel material from the image to be processed, and a process of recognizing identification information using the extracted identification mark. Details of the image recognition process are not particularly limited, and any conventional technique can be applied. The image recognizing unit 15 holds feature information (feature amount) indicating the feature of the identification mark in advance, and can perform identification mark extraction and authentication processing using the feature information. The image recognition unit 15 executes various processes such as noise removal, smoothing, sharpening, two-dimensional filtering processing, binarization, thinning, normalization (enlargement / reduction, parallel movement, rotation movement, density change, etc.). can do. Note that it is not always necessary to execute all of the processes exemplified here.

The collation unit 16 determines whether the identification information acquired by the correspondence information search unit 13 matches the identification information recognized by the image recognition unit 15.

The output unit 17 can display the determination result by the verification unit 16 on the display 100. FIG. 7 shows an example in which the output unit 17 displays the determination result on the display 100. In the case of the illustrated example, the address and step information of the steel material to be verified are displayed on the display 100, and the determination result (authentication result) by the verification unit 16 and the recognition result of the image recognition process by the image recognition unit 15 are displayed. Has been.

Next, an example of the processing flow of the collation method of this embodiment will be described using the flowchart of FIG.

First, the input receiving unit 12 receives the input of the address and step information of the steel material to be verified (S1). For example, the input receiving unit 12 receives an input of address and stage information via a user interface as shown in FIG. 5 displayed on the display 100 by the output unit 17. Here, it is assumed that the input receiving unit 12 receives an input “AA1” and the “2” level from the bottom.

Then, the correspondence information search unit 13 searches the correspondence information stored in the storage unit 11 using the address and step information received by the input reception unit 12 as keys, and acquires the steel material identification information associated with the key. (S2). Here, it is assumed that the correspondence information is searched for the correspondence information shown in FIG. 4 using the combination of “AA1” and “2” as a key, and the identification information “20130101AB002” is acquired.

When the input receiving unit 12 receives the input of the address and step information, the collation system 1 enters the imaging mode. The order of the transition / execution to the imaging mode and the processing of S2 is not limited to the order shown in FIG. 8, and these may be executed in parallel. When the verification system 1 is shifted to the imaging mode, the display on the display 100 is switched. The output unit 17 displays the image to be imaged on the display 100 and displays the specific frame F so as to overlap the image (see FIG. 6). The operator adjusts the position, orientation, and the like of the collation system 1 to display the identification mark attached to the surface of the steel material to be collated on the display 100 and place the identification mark in the specific frame F. Then, the worker inputs an imaging instruction (for example, touching the shooting button) while maintaining the state. Then, the imaging unit 14 captures an image displayed on the display 100. The imaging unit 14 then associates information (specific frame position information) indicating the position of the specific frame F at the time of imaging (eg, position in the image data, position in the display 100) with the image data of the captured image ( S3). Here, it is assumed that the imaging unit 14 captures an image in the state illustrated in FIG.

Then, the image recognition unit 15 performs image recognition processing using only a partial image within the specific frame F in the image captured by the imaging unit 14. The image recognition unit 15 extracts the identification mark written on the surface of each of the plurality of steel materials by the image recognition process (S4), and recognizes the identification information using the extracted identification mark (S5). Here, it is assumed that the image recognition unit 15 has recognized the identification information “20130101AB002”.

Thereafter, the collation unit 16 determines (collation) whether the identification information acquired by the correspondence information search unit 13 in S2 matches the identification information recognized by the image recognition unit 15 in S5 (S6). And the output part 17 outputs the collation result of the collation part 16 in S6 (S7). For example, the output unit 17 outputs a collation result as shown in FIG.

In addition, when the recognition of the image recognition part 15 in S5 is "20130101AB00?", It is an example of the display method which shows the case where the identification mark of the last part was not able to be recognized. In this case, the identification information recognized in S5 is not correctly recognized, and as a result, does not match the identification information acquired in S2, so that the collation result of the collation unit 16 is inconsistent (NG). In such a case, the output unit 17 outputs a collation result as shown in FIG. According to the display, the operator can recognize that the collation result is NG because the recognition accuracy of the image recognition process is insufficient.

In such a case, the worker visually recognizes the recognition mark attached to the steel material to be verified (steel material stored at a predetermined stage at a predetermined address) and inputs the visually recognized identification information (input receiving unit 12). You may comprise so that it can do. In such a case, the collation unit 16 determines (collates) whether the identification information received by the input receiving unit 12 matches the identification information acquired by the correspondence information search unit 13 in S2.

For example, touching “to input screen” on the user interface shown in FIG. 9 may cause a transition to the input screen shown in FIG. In this screen, the recognition result “20130101AB00” by the image recognition unit 15 is displayed as an initial value, and the last numeric part that could not be recognized is blank. The input receiving unit 12 may receive an input of identification information from such a user interface, for example.

Up to this point, the description has been made on the assumption that the output unit 17 executes (1) the process of displaying the specific frame F on the image before imaging. When the output unit 17 executes (2) the process of displaying the specific frame F on the captured image, the following process can be performed. First, before S1, before S2, or after S2, the verification system 1 accepts user input to select one of the captured images. The user images in advance the identification mark attached to the surface of the steel material to be verified, and stores the image data. And here, the image in which the identification mark attached | subjected to the surface of the steel material of collation object is displayed is selected. The collation system 1 executes a process of displaying the specific frame F on the display 100 by superimposing the selected image on the captured image instead of shifting to the imaging mode after S2. Thereafter, the user changes at least one of the size and shape of the specific frame F and the display position in the display 100 as necessary, and puts the identification mark in the specific frame F. Then, the worker performs imaging input (for example, touching the imaging button) while maintaining the state. Then, the imaging unit 14 includes, in the image data of the image displayed on the display 100, information indicating the position of the specific frame F at the time of receiving the imaging input (eg, position in the image data, position in the display 100). Data associated with (specific frame position information) is created (imaging processing) and saved (S3). The processing after S4 is the same as the above example. The process flow is applicable to all the following embodiments.

According to the collation system of the present embodiment described above, it is possible to realize a collation operation of steel materials stacked and stored in a plurality of stages in each of a plurality of areas each assigned with an address by processing by a computer. For this reason, it is possible to avoid occurrence of human error.

By the way, in the collation work of the above-mentioned steel material, since the steel material may be imaged in an unfavorable imaging environment, it is necessary to improve the accuracy of the image recognition processing by using various image recognition technologies (correction processing, etc.). There is. However, when such an image recognition technique (correction processing or the like) is adopted, the processing time required for the image recognition processing increases due to this, and there is a possibility that the work efficiency of the entire collation work is deteriorated.

The collation system 1 of the present embodiment is configured to be able to solve such a problem. That is, the collation system 1 of the present embodiment does not perform image recognition processing using all the captured images, but performs image recognition processing using only the images specified by the specific frame F in the captured images. For this reason, the amount of data to be processed can be reduced. As a result, the processing time can be shortened.

As described above, according to the verification system 1 of the present embodiment, it is possible to efficiently and accurately perform the verification work of the steel materials stacked and stored in a plurality of stages in each of the plurality of areas each assigned with an address. It becomes possible.

<Second Embodiment>
The verification system 1 of this embodiment is different from the verification system 1 of the first embodiment in that a plurality of steel materials stored at the same address can be targeted for verification at a time. Hereinafter, this embodiment will be described. In addition, about the structure similar to the collation system 1 of 1st Embodiment, omission is demonstrated suitably.

An example of a functional block diagram of the collation system 1 of the present embodiment is shown in FIG. 1 as in the first embodiment.

The input reception part 12 can receive the input of the address of the steel material of collation object, for example using a user interface as shown in FIG. When the input receiving unit 12 receives an input of an address, the correspondence information searching unit 13 searches the correspondence information stored in the storage unit 11 and is associated with the address at which the input receiving unit 12 has received the input. Information (thing with which the identification information of steel materials is matched) is acquired. Thereafter, the output unit 17 displays a list of the stage information acquired by the correspondence information search unit 13.

FIG. 12 shows an example in which the output unit 17 displays a list of column information on the display 100. Here, five pieces of step information (circle 1 to circle 5) are displayed. The number of the stage information displayed in a list here corresponds to the number of steel materials managed to be stored at the address in the correspondence information. That is, in the case of the example shown in FIG. 12, it is managed that five steel materials are stacked and stored in the AA1 address in five stages in correspondence information. The operator can find an error existing in the correspondence information by comparing the number displayed in the list with the number of steel materials actually stored at the address. When the number of laminated steel materials is sufficiently small (e.g., in the single digit range), it is difficult to cause inconvenience that a confirmation error by an operator occurs.

The input receiving unit 12 receives an input of selecting one or a plurality of pieces of step information displayed in a list, and receives input of step information of one or a plurality of steel materials to be verified. In the example shown in FIG. 12, one or a plurality of pieces of stage information can be selected by checking a check box displayed in association with each piece of stage information. The output unit 17 displays the same number (one or more) of specific frames F as the number of stage information received by the input receiving unit 12 on the display 100.

Hereinafter, the configuration of each unit when the input receiving unit 12 receives input of a plurality of pieces of stage information and the output unit 17 displays a plurality of specific frames F on the display 100 will be described. In addition, when the input reception part 12 receives the input of one step information, and the output part 17 displays the one specific frame F on the display 100, the structure of each part can be made the same as that of 1st Embodiment.

FIG. 13 shows an example in which the output unit 17 displays a plurality of specific frames F on the display 100. In the illustrated display 100, a part of steel materials (see FIG. 3) that are stacked and stored in a plurality of stages are displayed. On the display 100, two specific frames F1 and F2 are displayed so as to overlap the image. Each of the plurality of specific frames F1 and F2 displayed on the display 100 is associated with each piece of stage information received by the input receiving unit 12. The output unit 17 may display a plurality of specific frames F1 and F2 so that the associated stage information can be identified.

In the case of the example shown in FIG. 13, the circled numbers displayed in the upper left corner of each of the specific frames F1 and F2 indicate the stage information associated with each. That is, it can be identified that the specific frame F1 is associated with the stage information of the third stage from the bottom, and the specific frame F2 is associated with the stage information of the fourth stage from the bottom. Using such information, the operator can grasp how many steel material identification marks should be placed in each of the plurality of specific frames F1 and F2.

It should be noted that the stage information associated with each specific frame may be identified and displayed by other display modes. FIG. 14 shows another example. In the illustrated example, auxiliary frames G1 to G3 are displayed above and below the specific frames F1 and F2 in addition to the specific frames F1 and F2. In the case of this example, the stage information can be identified by the positions in the plurality of frame groups including the specific frames F1 and F2 and the auxiliary frames G1 to G3. For example, the specific frame F1 shown in FIG. 14 is located at the third level from the bottom in the frame group. From this, it can be seen that the step information associated with the specific frame F1 is the third step from the bottom. The auxiliary frames G1 to G3 may have the same design as the specific frames F1 and F2 and may differ only in shape and size, or may have different designs as shown in FIG. The auxiliary frames G1 to G3 can be made smaller than the specific frames F1 and F2. In this way, it is possible to reduce the inconvenience that the visibility of the image to be captured displayed on the display 100 by the auxiliary frames G1 to G3 is impaired.

Even if the specific frames F1 and F2 displayed on the display 100 can individually change at least one of the display position, shape, and size in the display 100 in accordance with a user input. Good. In addition, when at least one of the display position, shape, and size of one specific frame F is changed, the display position, shape, and size of the other specific frame F may be similarly changed. For example, in the case of a touch panel type display capable of recognizing a plurality of points, there is a method of changing by a method such as pinch-in / pinch-out when changing the size, and an arbitrary position within a specific frame when changing the display position There are methods such as touching and dragging. Or, in the case of a touch panel type display that can recognize only one point, there is a method (touch and slide) such as touching and dragging the intersection of one side or two sides constituting a specific frame to change the display size. When doing, there is a method (touch and slide) such as touching and dragging an arbitrary position in a specific frame. Alternatively, in the case of a display that is not a touch panel type, there is a display using a predetermined button.

When the image capturing unit 14 captures an image, information (specific frame position information) indicating the position of the specific frame F at the time of image capturing (eg, position in the image data, position in the display 100) in the image data of the captured image. Associate. If a plurality of specific frames F are displayed at the time of imaging, specific frame position information indicating the positions of the plurality of specific frames F is associated with the image data. Each of the plurality of specific frame position information is associated with stage information associated with the specific frame F.

When a plurality of specific frame position information is associated with the image data of the image captured by the image capturing unit 14, the image recognition unit 15 performs image recognition using only each partial image specified by each specific frame position information. Process. Then, the image recognition unit 15 obtains a plurality of recognition results (identification information). The contents of the image recognition process are the same as in the first embodiment. Each of the plurality of pieces of identification information recognized by the image recognition unit 15 is associated with step information associated with each specific frame position information.

The correspondence information search unit 13 searches the correspondence information stored in the storage unit 11, and selects a plurality of identification information associated with the address at which the input reception unit 12 has received the input and any one of the plurality of stage information. get.

The collation unit 16 determines whether or not the plurality of identification information acquired by the correspondence information search unit 13 and the plurality of identification information recognized by the image recognition unit 15 match. Specifically, identification information with which the corresponding stage information matches is compared to determine whether or not they match. And the collation part 16 obtains a discrimination | determination result for every stage information.

Here, FIG. 15 shows an example in which the output unit 17 displays the discrimination result of the collation unit 16 on the display 100. In this example, all five steel materials stored at address AA1 are subject to collation, and the respective recognition results and collation results are shown. The steel material in the second stage from the bottom has insufficient accuracy of recognition by the image recognition unit 15, and as a result, the authentication result is NG. When the “NG” button is touched in the user interface, the screen shown in FIG. 10 may be displayed. Processing using the user interface shown in FIG. 10 is the same as in the first embodiment.

According to the collation system 1 of the present embodiment described above, the same operational effects as those of the first embodiment can be realized. Moreover, since several steel materials can be made into the collation object at once, the working efficiency of collation processing improves. Moreover, since the identification marks of each of the plurality of steel materials are identified and identified in each of the plurality of specific frames F, the accuracy of the process of extracting the identification marks from the image can be improved.

<Third Embodiment>
The verification system 1 of this embodiment is different from the verification system 1 of the first embodiment in that a plurality of steel materials stored at the same address can be targeted for verification at a time. Hereinafter, this embodiment will be described. In addition, about the structure similar to the collation system 1 of 1st Embodiment, omission is demonstrated suitably.

The input reception part 12 can receive the input of the address of the steel material of collation object, for example using a user interface as shown in FIG. Then, the correspondence information search part 13 searches the correspondence information memorize | stored in the memory | storage part 11, and specifies the number of the steel materials (1st steel material) stored in the address which the input reception part 12 received the input. . For example, the correspondence information search unit 13 searches the correspondence information stored in the storage unit 11 and recognizes the number of pieces of steel material identification information associated with the address at which the input reception unit 12 has accepted the input. The number of the first steel materials stored at the address may be specified. Then, the output part 17 displays the 1 or several specific flame | frame F of the same number as the number of 1st steel materials on a finder (display).

Hereinafter, the configuration of each part when the number of the first steel materials is plural will be described. The structure of each part in case the number of 1st steel materials is one can be made the same as that of 1st Embodiment.

FIG. 16 shows an example in which the output unit 17 displays the same number of specific frames F as the number of first steel materials on the display 100. The display 100 displays five stacked steel materials. In addition, five specific frames F1 to F5 are displayed on the steel material image. Each of the five specific frames F1 to F5 is associated with stage information. The output unit 17 displays a plurality of specific frames F1 to F5 so that the associated stage information can be identified. In the illustrated example, the first to fifth stages are associated in order from the bottom according to the arrangement order of the five specific frames F1 to F5. That is, the worker can identify the stage information associated with each of the specific frames F1 to F5 based on the arrangement order of the plurality of specific frames F1 to F5. Using such information, the operator can grasp how many steel material identification marks should be placed in each of the plurality of specific frames F1 to F5. In addition, the stage information matched with each specific frame can also be identified and displayed by the structure similar to 2nd Embodiment.

In the example shown in FIG. 16, a cross mark M is displayed in association with each specific frame F. When the cross mark M is touched, the specific frame associated with the cross mark M may disappear, or may change to the auxiliary frame described in the second embodiment. That is, the input reception part 12 may receive the input of the stage information of the steel materials to be verified by receiving an input for selecting one or more of the plurality of specific frames F1 to F5. In the case of the example shown in FIG. 16, the step information corresponding to the specific frame F not touched with the cross mark M, in other words, the specific frame F remaining on the display 100 when the input receiving unit 12 receives the imaging instruction input. Corresponding step information is input as step information of the steel material to be verified.

Even if the specific frames F1 to F5 displayed on the display 100 can individually change at least one of the display position, shape, and size in the display 100 in accordance with a user input. Good. In addition, when at least one of the display position, shape, and size of one specific frame F is changed, the display position, shape, and size of the other specific frame F may be similarly changed. For example, in the case of a touch panel type display capable of recognizing a plurality of points, there is a method of changing by a method such as pinch-in / pinch-out when changing the size, and an arbitrary position within a specific frame when changing the display position There are methods such as touching and dragging. Or, in the case of a touch panel display that can recognize only one point, when changing the size, there is a method such as touching and dragging the intersection of one side or two sides that make up a specific frame, and when changing the display position, within the specific frame There is a method such as touching and dragging an arbitrary position of. Alternatively, in the case of a display that is not a touch panel type, there is a display using a predetermined button.

Here, FIG. 15 shows an example in which the output unit 17 displays the discrimination result of the collation unit 16 on the display 100. In this example, all five steel materials stored at address AA1 are subject to collation, and the respective recognition results and collation results are shown. The steel material in the second level from the bottom has insufficient recognition accuracy by the image recognition unit 15, and as a result, the collation result is NG. When the “NG” button is touched in the user interface, the screen shown in FIG. 10 may be displayed. Processing using the user interface shown in FIG. 10 is the same as in the first embodiment.

According to the verification system 1 of the present embodiment described above, the same operational effects as those of the first and second embodiments can be realized. Moreover, since several steel materials can be made into the collation object at once, the working efficiency of collation processing improves. Moreover, since the identification marks of each of the plurality of steel materials are identified and identified in each of the plurality of specific frames F, the accuracy of the process of extracting the identification marks from the image can be improved.

<Fourth Embodiment>
The collation system 1 of this embodiment is based on the configuration of the second embodiment and the third embodiment that can target a plurality of steel materials at one time. That is, the collation system 1 of the present embodiment can display a plurality of specific frames F on the display 100.

By the way, when the positions of the identification marks of a plurality of steel materials stacked and stored in a plurality of stages are substantially aligned in one row as shown in FIG. 3 (eg, one row in the stacking direction; the vertical direction in FIG. 3), Each of a plurality of identification marks can be accommodated in each of a plurality of specific frames F arranged in a line as shown in FIGS. However, as shown in FIG. 17, the identification marks are not aligned in a line, and their positions may vary. In such a case, as shown in the diagram on the left side of FIG. 17, it is impossible to fit each of the plurality of identification marks in each of the plurality of specific frames F arranged in a line.

Therefore, the input receiving unit 12 of the present embodiment can individually move a plurality of specific frames F (the diagram on the right side of FIG. 17). For example, in the user interface shown in FIG. 17, the display position of the specific frame F may be moved by touching and sliding the specific frame F. As a result, as shown in the diagram on the right side of FIG. 17, even if the identification marks are not aligned, each of the plurality of identification marks can be contained in each of the plurality of specific frames F.

Other configurations of the collation system 1 of the present embodiment are the same as those of the first to third embodiments.

According to the verification system 1 of the present embodiment described above, the same operational effects as those of the first to third embodiments can be realized. Further, even when the positions of the identification marks of the plurality of steel materials stacked and stored in a plurality of stages are not aligned and vary, the plurality of identification marks are stored in each of the plurality of specific frames F. be able to.

<Fifth Embodiment>
The collation system 1 of this embodiment is based on the configuration of the second embodiment and the third embodiment that can target a plurality of steel materials at one time. That is, the collation system 1 of the present embodiment can display a plurality of specific frames F on the display 100.

The collation system 1 of the present embodiment has a fourth problem in the case where the positions of the identification marks of a plurality of steel materials stacked and stored in a plurality of stages are not aligned in one line (eg, one line in the stacking direction) and vary. The configuration is different from that of the embodiment and can be solved.

The input receiving unit 12 receives a designation input for designating a part of the plurality of specific frames F displayed on the display 100 and an imaging instruction input for imaging in a state where some of the specific frames F are designated. Accept. The imaging unit 14 captures an image according to the imaging instruction input received by the input receiving unit 12. Then, the image recognition unit 15 performs image recognition processing using only a partial image in the specific frame F designated at the time of image capturing in the image captured by the image capturing unit 14. Note that the output unit 17 may display the specific frame F that has been imaged in the designated state and the specific frame F that has not been imaged in the designated state in an identifiable manner. This will be described in more detail below using specific examples.

FIG. 18 shows a display example by the output unit 17. In the case of the illustrated example, a part of the plurality of steel materials is displayed on the display 100. The positions of the identification marks displayed on each of the plurality of steel materials are not aligned in one row (eg, one row in the stacking direction), but vary. On the display 100, three specific frames F1 to F3 are displayed. Three symbols are written in the upper left corner of each of the specific frames F1 to F3. These three symbols are, in order from the left, “information indicating the associated stage information”, “information indicating whether or not the image has been captured in the specified state”, “whether or not specified. Information ”. “Information indicating the associated stage information” is as described in the second embodiment.

“Information indicating whether or not an image has been taken in a specified state” is a character “completed” or “uncompleted”. “Done” indicates that the image has been picked up in the specified state, and “Not” indicates that the image has not been picked up in the specified state. “Information indicating whether or not it is designated” is a check box that can be input by an operator. The specific frame F that is checked is the specified specific frame F, and the specific frame F that is not checked is the specific frame F that is not specified. Note that the specific frame F that has been imaged in the designated state cannot be checked.

For example, as shown in FIG. 18, when only a part of a plurality of specific frames F (F1 in the figure) contains an identification mark in the frame, the worker designates only a part of the identification marks. That is, check the check box. Alternatively, one or a plurality of specific frames F are designated, and a predetermined steel material identification mark is placed in the designated specific frames F. Then, an imaging instruction is input (touching the imaging button) while maintaining the state. When the input receiving unit 12 receives an imaging instruction input, the imaging unit 14 captures an image, and information (specific frame position information) indicating the position of the specific frame F1 specified at the time of imaging in the image data of the captured image. Associate. Moreover, the input reception part 12 receives the step information matched with the specific flame | frame F1 designated at the time of imaging as step information of the steel materials of collation object. The step information received by the input receiving unit 12 is associated with the image data of the image.

The output unit 17 may continue the screen display illustrated in FIG. 18 even after the imaging unit 14 captures an image in the state illustrated in FIG. However, since the specific frame F1 is captured in the designated state, the “unfinished” character in the upper left corner is replaced with “done”. Further, like the specific frame F3, the check box cannot be selected. By visually recognizing such a display, the operator can recognize that it is the second stage steel material identification mark that has not yet been imaged.

The operator can input an instruction to start the collation process (touch the collation button) after imaging one or a plurality of steel identification marks. When the input receiving unit 12 receives an instruction input for starting such a collation process, the image recognition unit 15, the collation unit 16, Collation processing by the correspondence information search unit 13 and the storage unit 11 and collation result output by the output unit 17 are performed. The contents of collation processing by the image recognition unit 15, collation unit 16, correspondence information retrieval unit 13 and storage unit 11, and collation result output by the output unit 17 are the same as those in the first to fourth embodiments.

According to the verification system 1 of the present embodiment described above, the same operational effects as those of the first to fourth embodiments can be realized. In addition, even when the positions of the identification marks of the plurality of steel materials stacked and stored in a plurality of stages are not aligned in a line and vary, each of the plurality of identification marks is individually included in each of the plurality of specific frames F. Can be captured and imaged. The worker refers to the “information indicating whether or not the image has been captured in the specified state” associated with each specific frame F, so that a plurality of stacked and stored in a plurality of stages are stored. Steel materials that have not yet been verified can be recognized.

<Sixth Embodiment>
The collation system 1 of this embodiment is different from the first to fifth embodiments in that it includes a terminal device and a server device that are configured to be able to communicate with each other by wire and / or wirelessly.

FIG. 19 shows an example of a functional block diagram of the verification system 1 of the present embodiment. The terminal device 2 includes an input reception unit 12, an imaging unit 14, an output unit 17, and a terminal side transmission / reception unit 18. The server device 3 includes a storage unit 11, a correspondence information search unit 13, an image recognition unit 15, a collation unit 16, and a server side transmission / reception unit 19. The terminal device 2 and the server device 3 can communicate with each other via the terminal side transmission / reception unit 18 and the server side transmission / reception unit 19.

FIG. 20 shows another example of a functional block diagram of the verification system 1 of the present embodiment. The terminal device 2 includes an input reception unit 12, an imaging unit 14, an image recognition unit 15, an output unit 17, and a terminal side transmission / reception unit 18. The server device 3 includes a storage unit 11, a correspondence information search unit 13, a collation unit 16, and a server side transmission / reception unit 19. The terminal device 2 and the server device 3 can communicate with each other via the terminal side transmission / reception unit 18 and the server side transmission / reception unit 19.

19 are the same as those of the first to fifth embodiments except for the terminal-side transceiver unit 18 and the server-side transceiver unit 19 shown in FIG.

The terminal-side transmitting / receiving unit 18 and the server-side transmitting / receiving unit 19 are configured to be able to communicate with each other by wire and / or wirelessly, and can transmit and receive data.

The terminal-side transmitting / receiving unit 18 may transmit only the image data of a partial image in the specific frame F in the image captured by the imaging unit 14 to the server device 3 (external device). Alternatively, the terminal-side transmission / reception unit 18 includes information for identifying a partial image in the specific frame F in the image captured by the imaging unit 14 (eg, specific frame position information indicating the position of the specific frame F) and the image Data may be transmitted to the server device 3 (external device).

Hereinafter, an example of the processing flow of the matching method of the present embodiment will be described with reference to the sequence diagram of FIG. The terminal-side transmitting / receiving unit 18 includes information for identifying a partial image in the specific frame F in the image captured by the imaging unit 14 (for example, specific frame position information indicating the position of the specific frame F) and the image It is assumed that data is transmitted to the server device 3 (external device).

First, the input receiving unit 12 of the terminal device 2 receives the input of the address of the steel material to be verified through, for example, a user interface as shown in FIG. 11 (S10). Then, the terminal side transmission / reception unit 18 of the terminal device 2 transmits the address information to the server device 3 (S11). The server device 3 receives the address information via the server side transmission / reception unit 19. Thereafter, the correspondence information search unit 13 of the server device 3 searches the correspondence information (see FIG. 4) stored in the storage unit 11 using the address as a key, and the step information (steel material identification information) associated with the key. Are associated with each other) (S12). Then, the server side transmission / reception unit 19 of the server device 3 returns the acquired stage information to the terminal device 2 (S13). The terminal device 2 acquires the stage information via the terminal side transmission / reception unit 18. The stage information transmitted and received here may be associated with the address received in S11.

Then, the output unit 17 of the terminal device 2 displays the acquired stage information on the display 100 as a list as shown in FIG. And the input reception part 12 receives the input which designates one or several step information from the said user interface (S14). When receiving an input designating one or more pieces of stage information, the terminal device 2 switches to the imaging mode. That is, the output unit 17 displays an image to be imaged on the display 100 as shown in FIG. Further, the output unit 17 displays the same number of specific frames F1 and F2 as the stage information specified in S14 on the display 100. Note that the circled numbers displayed in the upper left corner of each of the specific frames F1 and F2 indicate the stage information associated with each. Using such information, the operator can grasp how many steel material identification marks should be placed in each of the plurality of specific frames F1 and F2.

The operator adjusts the position, orientation, etc. of the verification system 1 to place a predetermined identification mark in each of the displayed one or more specific frames F. Then, the worker inputs an imaging instruction (for example, touching the shooting button) while maintaining the state. Then, the imaging unit 14 captures an image displayed on the display 100 (S15). Then, the imaging unit 14 associates information (specific frame position information) indicating the position of each of the one or more specific frames F displayed at the time of imaging with the image data of the captured image. When a plurality of pieces of specific frame position information are associated with each other, the stage information associated with each specific frame F is associated with each.

Then, the terminal-side transmission / reception unit 18 of the terminal device 2 transmits the image data of the captured image to the server device 3 together with the specific frame position information and the step information that are associated with each other (S16). The server device 3 receives the image data of the captured image, the specific frame position information, and the step information via the server side transmission / reception unit 19. The image data, the specific frame position information, and the stage information transmitted / received here may be associated with the address associated with the stage information received in S13.

Thereafter, the image recognition unit 15 of the server device 3 performs image recognition processing using only a partial image within a specific frame in the image captured by the imaging unit 14. The image recognition unit 15 extracts the identification mark written on the surface of each of the one or more steel materials, and recognizes the identification information using the extracted identification mark (S17). Further, the correspondence information search unit 13 searches the correspondence information in the storage unit 11 using the address and step information acquired in S16 as a key, and acquires one or a plurality of identification information. And the collation part 16 discriminate | determines whether these match using the identification information which the corresponding | compatible information search part 13 acquired, and the identification information which the image recognition part 15 recognized (S18: collation process). When there are a plurality of pieces of identification information acquired by the correspondence information search unit 13 and a plurality of pieces of identification information recognized by the image recognition unit 15, the identification information with the matching step information is collated.

Then, the server side transmission / reception unit 19 of the server device 3 returns the determination result of S18 to the terminal device 2 (S19). The terminal device 2 acquires the determination result via the terminal side transmission / reception unit 18. Note that the determination result transmitted and received here may be associated with an address and stage information. Thereafter, the output unit 17 of the terminal device 2 creates, for example, a user interface as shown in FIG. 15 and displays it on the display 100 (S20).

According to the verification system 1 of the present embodiment described above, the same operational effects as those of the first to fifth embodiments can be realized.

<Appendix>
Hereinafter, examples of the reference form will be added.
1. A collation system for collating a plurality of steel materials that are stacked and stored in each of a plurality of areas each assigned an address,
The identification information of each of the plurality of steel materials stored, the address of the area in which each of the steel materials is stored, and stage information indicating the position in the steel material group stacked in a plurality of stages are associated with each other. Storage means for storing correspondence information;
Input accepting means for accepting input of the address of the steel material to be verified and the step information;
Corresponding information search means for referring to the correspondence information and acquiring the identification information associated with the address and the stage information received by the input receiving means;
A viewfinder, displaying a pre-imaged image and / or an imaged image on the viewfinder, and overlaying the image with a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image Output means for displaying on the viewfinder,
Imaging means for imaging an image displayed on the viewfinder;
Image recognition processing is performed using only a partial image in the specific frame in the image picked up by the image pickup means, and an identification mark written on the surface of each of the plurality of steel materials is extracted and extracted. Image recognition means for recognizing the identification information using the identification mark;
Collation means for determining whether or not the identification information acquired by the correspondence information search means matches the identification information recognized by the image recognition means;
A collation system.
2. In the verification system according to 1,
The collating system in which the output means outputs a discrimination result of the collating means.
3. In the verification system according to 1 or 2,
The output unit is a collation system that outputs a recognition result by the image recognition unit.
4). In the verification system according to any one of 1 to 3,
The verification system can target a plurality of the steel materials stored at the same address at a time,
The input accepting means can accept input of the address and a plurality of the step information in which a plurality of the steel materials to be collated are stored,
The collating system in which the output means displays a plurality of the specific frames on the finder in the same number as the number of the stage information accepted by the input accepting means.
5. In the verification system according to 4,
Each of the plurality of specific frames is associated with each of the stage information received by the input receiving unit,
The collation system, wherein the output means displays a plurality of the specific frames so that the associated stage information can be identified.
6). In the verification system according to 4 or 5,
The correspondence information search means acquires the stage information associated with the address at which the input reception means has received an input,
The output means displays a list of the stage information acquired by the correspondence information search means,
The said input reception means is a collation system which receives the input of the said step information of the said steel materials of collation object by receiving the input which selects one or more in the said step information currently displayed by the list.
7). In the verification system according to any one of 1 to 3,
The verification system can target a plurality of the steel materials stored at the same address at a time,
The correspondence information search means is configured to associate the number of the first steel materials that are the steel materials stored at the address that the input reception means has accepted with the address in the correspondence information. By recognizing the number of the identification information of
The said output means is the collation system which displays the said specific frame of the same number as the number of said 1st steel materials on the said finder.
8). In the verification system according to 7,
Each of the specific frames is associated with the step information associated with each of the first steel materials,
The collation system, wherein the output means displays a plurality of the specific frames so that the associated stage information can be identified.
9. In the verification system according to 8,
The said input reception means is a collation system which accepts the input of the said step information of the said steel materials of collation object by receiving the input which selects one or more in the said specific frame currently displayed on the said finder.
10. In the verification system according to any one of 4 to 9,
The collation system which can change at least one of the display position, shape, and size in the finder individually for the plurality of specific frames displayed on the finder.
11. In the verification system according to any one of 4 to 10,
The input receiving means includes a designation input for designating a part of the plurality of specific frames displayed on the finder, and an imaging instruction input for imaging in a state where some of the specific frames are designated. Accept,
The imaging unit images in accordance with the imaging instruction input received by the input receiving unit,
The collation system in which the image recognition means performs an image recognition process using only a partial image within the specific frame designated at the time of image capture of the image captured by the image capture means.
12 In the verification system according to 11,
The output unit displays the specific frame that has been imaged in a specified state and the specific frame that has not been imaged in a specified state in a distinguishable manner.
13. In the verification system according to any one of 1 to 12,
The verification system includes a terminal device configured to be able to communicate with each other, and a server device,
The terminal device includes the input receiving unit, the output unit, and the imaging unit.
The server device includes the storage unit, the correspondence information search unit, and the collation unit,
A verification system in which either the terminal device or the server device includes the image recognition means.
14 A terminal device comprising the input receiving unit, the output unit, and the imaging unit included in the collation system according to any one of 1 to 12.
15. A viewfinder, displaying a pre-imaged image and / or an imaged image on the viewfinder, and overlaying the image with a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image Output means for displaying on the viewfinder,
Imaging means for capturing the image displayed on the viewfinder;
And a transmission unit configured to transmit only a partial image within the specific frame in the image captured by the imaging unit to an external device.
16. A viewfinder, displaying a pre-imaged image and / or an imaged image on the viewfinder, and overlaying the image with a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image Output means for displaying on the viewfinder,
Imaging means for capturing the image displayed on the viewfinder;
A terminal device comprising: transmission means for transmitting the image to an external device together with information for identifying a partial image in the specific frame in the image captured by the imaging means.
17. A server apparatus comprising: the storage unit included in the verification system according to any one of 1 to 12, the correspondence information search unit, and the verification unit.
18. The server apparatus according to claim 17, further comprising the image recognition means included in the collation system according to any one of 1 to 12.
19. A program for a terminal device provided with an imaging means for capturing an image displayed on a viewfinder,
Computer
A pre-imaged and / or already-captured image is displayed on the finder, and a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image is superimposed on the image and displayed on the finder. Output means,
Transmitting means for transmitting only a partial image within the specific frame of the image captured by the imaging means to an external device;
Program to function as.
20. A program for a terminal device provided with an imaging means for capturing an image displayed on a viewfinder,
Computer
A pre-imaged and / or already-captured image is displayed on the finder, and a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image is superimposed on the image and displayed on the finder. Output means,
Transmitting means for transmitting the image to an external device together with information for identifying a partial image in the specific frame in the image captured by the imaging means;
Program to function as.
21. A program for a collation system that collates a plurality of steel materials that are stacked and stored in a plurality of stages in each of a plurality of areas each assigned an address,
Computer
The identification information of each of the plurality of steel materials stored, the address of the area in which each of the steel materials is stored, and stage information indicating the position in the steel material group stacked in a plurality of stages are associated with each other. Storage means for storing correspondence information;
An input receiving means for receiving the address of the steel material to be verified and the input of the step information;
Correspondence information search means for referring to the correspondence information and acquiring the identification information associated with the address and the stage information received by the input reception means;
A pre-imaged and / or already-captured image is displayed on the finder, and a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image is displayed on the finder so as to overlap the image. Output means,
Imaging means for capturing the image displayed on the viewfinder;
Image recognition processing is performed using only a partial image in the specific frame in the image picked up by the image pickup means, and an identification mark written on the surface of each of the plurality of steel materials is extracted and extracted. Image recognition means for recognizing the identification information using the identification mark;
Collation means for determining whether or not the identification information acquired by the correspondence information search means matches the identification information recognized by the image recognition means;
Program to function as.
21-2. 21. In the program described in 21,
A program for causing the output means to output a discrimination result of the collating means.
21-3. In the program described in 21 or 21-2,
A program for causing the output means to output a recognition result by the image recognition means.
21-4. In the program according to any one of 21 to 21-3,
In order to target a plurality of the steel materials stored in the same address at the same time,
The input receiving means is configured to accept input of the address and a plurality of the step information in which a plurality of the steel materials to be verified are stored,
A program for causing the output unit to display the plurality of specific frames on the finder in the same number as the number of the stage information received by the input receiving unit.
21-5. In the program described in 21-4,
Associating each of the plurality of specific frames with each of the stage information received by the input receiving means;
A program that causes the output means to display a plurality of the specific frames so that the associated stage information can be identified.
21-6. In the program described in 21-4 or 21-5,
Causing the correspondence information search means to acquire the stage information associated with the address at which the input reception means has received an input;
The output means displays a list of the stage information acquired by the correspondence information search means,
A program for causing the input receiving means to accept an input for selecting one or more of the step information displayed in the list, thereby accepting an input of the step information of the steel material to be verified.
21-7. In the program according to any one of 21 to 21-3,
In order to target a plurality of the steel materials stored in the same address at the same time,
In the correspondence information search means, the number of the first steel materials that are the steel materials stored at the address that the input reception means has accepted is associated with the address in the correspondence information. By recognizing the number of the identification information of
A program for causing the output means to display a plurality of the specific frames equal to the number of the first steel materials on the finder.
21-8. In the program described in 21-7,
Each of the specific frames is associated with the step information associated with each of the first steel materials,
A program that causes the output means to display a plurality of the specific frames so that the associated stage information can be identified.
21-9. In the program described in 21-8,
The program which makes the said input reception means accept the input of the said step information of the said steel materials of collation object by accepting the input which selects one or more in the said specific frame currently displayed on the said finder.
21-10. In the program described in any one of 21-4 to 21-9,
The computer,
A program for causing a plurality of the specific frames displayed on the finder to individually function as means for changing at least one of a display position, a shape, and a size in the finder.
21-11. In the program described in any one of 21-4 to 21-10,
A designation input for designating a part of the plurality of specific frames displayed on the finder and an imaging instruction input for imaging in a state in which some of the specific frames are designated to the input reception unit. Accept,
Causing the imaging means to take an image in accordance with the imaging instruction input received by the input receiving means;
A program for causing the image recognition means to perform image recognition processing using only a partial image within the specific frame designated at the time of image pickup of the image picked up by the image pickup means.
21-12. In the program described in 21-11,
A program for causing the output means to display the specific frame that has been imaged in a specified state and the specific frame that has not been imaged in a specified state in an identifiable manner.
22. A collation method for collating a plurality of steel materials that are stacked and stored in each of a plurality of areas each assigned with an address,
Computer
The identification information of each of the plurality of steel materials stored, the address of the area in which each of the steel materials is stored, and stage information indicating the position in the steel material group stacked in a plurality of stages are associated with each other. Remember the correspondence information,
An input receiving step of receiving input of the address of the steel material to be verified and the step information;
A correspondence information search step of referring to the correspondence information and acquiring the identification information associated with the address and the step information received in the input acceptance step;
A pre-imaged and / or already-captured image is displayed on the finder, and a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image is displayed on the finder so as to overlap the image. An output step;
An imaging step of imaging the image displayed on the viewfinder;
Image recognition processing is performed using only a partial image in the specific frame in the image captured in the imaging step, and identification marks written on the surfaces of the plurality of steel materials are extracted and extracted. An image recognition step for recognizing the identification information using the identification mark;
A collation step for determining whether or not the identification information acquired in the correspondence information search step matches the identification information recognized in the image recognition step;
The matching method to execute.
22-2. In the verification method according to 22,
In the output step, a collation method for outputting a discrimination result in the collation step.
22-3. In the verification method described in 22 or 22-2,
In the output step, a collation method for outputting a recognition result in the image recognition step.
22-4. In the verification method according to any one of 22 to 22-3,
The verification method can target a plurality of the steel materials stored at the same address at a time,
In the input receiving step, it is possible to receive input of the address and a plurality of the step information in which a plurality of the steel materials to be verified are stored,
In the output step, a collation method for displaying the plurality of specific frames on the finder in the same number as the number of the step information received in the input receiving step.
22-5. In the collation method described in 22-4,
Each of the plurality of specific frames is associated with each of the step information received in the input receiving step,
In the output step, a plurality of the specific frames are displayed so that the associated step information can be identified.
22-6. In the verification method described in 22-4 or 22-5,
In the correspondence information search step, the step information associated with the address that has received the input in the input reception step is acquired,
In the output step, the stage information acquired in the correspondence information search step is displayed as a list,
In the input receiving step, a verification method for receiving input of the stage information of the steel material to be verified by receiving an input for selecting one or more of the stage information displayed in the list.
22-7. In the verification method according to any one of 22 to 22-3,
The verification method can target a plurality of the steel materials stored at the same address at a time,
In the correspondence information search step, the number of the first steel material that is the steel material stored in the address that has received the input in the input reception step is associated with the address in the correspondence information. By recognizing the number of the identification information of
In the output step, a matching method for displaying a plurality of the specific frames of the same number as the number of the first steel materials on the finder.
22-8. In the matching method described in 22-7,
Each of the specific frames is associated with the step information associated with each of the first steel materials,
In the output step, a plurality of the specific frames are displayed so that the associated step information can be identified.
22-9. In the matching method described in 22-8,
In the input receiving step, a collation method for accepting an input of the step information of the steel material to be collated by receiving an input for selecting one or a plurality of the specific frames displayed on the finder.
22-10. In the matching method according to any one of 22-4 to 22-9,
A collation method in which a plurality of the specific frames displayed on the finder can individually change at least one of a display position, a shape, and a size in the finder.
22-11. In the verification method according to any one of 22-4 to 22-10,
In the input receiving step, a designation input for designating a part of the plurality of specific frames displayed on the finder, and an imaging instruction input for imaging in a state where some of the specific frames are designated Accept,
In the imaging step, imaging is performed according to the imaging instruction input received in the input reception step,
In the image recognition step, a collation method in which image recognition processing is performed using only a partial image within the specific frame specified at the time of image capturing in the image captured in the image capturing step.
22-12. In the collation method described in 22-11,
In the output step, the specific frame that has been imaged in the designated state and the specific frame that has not been imaged in the designated state are displayed in a distinguishable manner.

This application claims priority based on Japanese Patent Application No. 2013-050843 filed on Mar. 13, 2013, the entire disclosure of which is incorporated herein.

Claims

A collation system for collating a plurality of steel materials that are stacked and stored in each of a plurality of areas each assigned an address,
The identification information of each of the plurality of steel materials stored, the address of the area in which each of the steel materials is stored, and stage information indicating the position in the steel material group stacked in a plurality of stages are associated with each other. Storage means for storing correspondence information;
Input accepting means for accepting input of the address of the steel material to be verified and the step information;
Corresponding information search means for referring to the correspondence information and acquiring the identification information associated with the address and the stage information received by the input receiving means;
A viewfinder, displaying a pre-imaged image and / or an imaged image on the viewfinder, and overlaying the image with a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image Output means for displaying on the viewfinder,
Imaging means for imaging an image displayed on the viewfinder;
Image recognition processing is performed using only a partial image in the specific frame in the image picked up by the image pickup means, and an identification mark written on the surface of each of the plurality of steel materials is extracted and extracted. Image recognition means for recognizing the identification information using the identification mark;
Collation means for determining whether or not the identification information acquired by the correspondence information search means matches the identification information recognized by the image recognition means;
A collation system.
The verification system according to claim 1,
The collating system in which the output means outputs a discrimination result of the collating means.
The verification system according to claim 1 or 2,
The output unit is a collation system that outputs a recognition result by the image recognition unit.
In the collation system according to any one of claims 1 to 3,
The verification system can target a plurality of the steel materials stored at the same address at a time,
The input accepting means can accept input of the address and a plurality of the step information in which a plurality of the steel materials to be collated are stored,
The collating system in which the output means displays a plurality of the specific frames on the finder in the same number as the number of the stage information accepted by the input accepting means.
The verification system according to claim 4,
Each of the plurality of specific frames is associated with each of the stage information received by the input receiving unit,
The collation system, wherein the output means displays a plurality of the specific frames so that the associated stage information can be identified.
In the collation system according to claim 4 or 5,
The correspondence information search means acquires the stage information associated with the address at which the input reception means has received an input,
The output means displays a list of the stage information acquired by the correspondence information search means,
The said input reception means is a collation system which receives the input of the said step information of the said steel materials of collation object by receiving the input which selects one or more in the said step information currently displayed by the list.
In the collation system according to any one of claims 1 to 3,
The verification system can target a plurality of the steel materials stored at the same address at a time,
The correspondence information search means is configured to associate the number of the first steel materials that are the steel materials stored at the address that the input reception means has accepted with the address in the correspondence information. By recognizing the number of the identification information of
The said output means is the collation system which displays the said specific frame of the same number as the number of said 1st steel materials on the said finder.
The verification system according to claim 7,
Each of the specific frames is associated with the step information associated with each of the first steel materials,
The collation system, wherein the output means displays a plurality of the specific frames so that the associated stage information can be identified.
The verification system according to claim 8,
The said input reception means is a collation system which accepts the input of the said step information of the said steel materials of collation object by receiving the input which selects one or more in the said specific frame currently displayed on the said finder.
The verification system according to any one of claims 4 to 9,
The collation system which can change at least one of the display position, shape, and size in the finder individually for the plurality of specific frames displayed on the finder.
The collation system according to any one of claims 4 to 10,
The input receiving means includes a designation input for designating a part of the plurality of specific frames displayed on the finder, and an imaging instruction input for imaging in a state where some of the specific frames are designated. Accept,
The imaging unit images in accordance with the imaging instruction input received by the input receiving unit,
The collation system in which the image recognition means performs an image recognition process using only a partial image within the specific frame designated at the time of image capture of the image captured by the image capture means.
The verification system according to claim 11,
The output unit displays the specific frame that has been imaged in a specified state and the specific frame that has not been imaged in a specified state in a distinguishable manner.
The verification system according to any one of claims 1 to 12,
The verification system includes a terminal device configured to be able to communicate with each other, and a server device,
The terminal device includes the input receiving unit, the output unit, and the imaging unit.
The server device includes the storage unit, the correspondence information search unit, and the collation unit,
A verification system in which either the terminal device or the server device includes the image recognition means.
A terminal device comprising the input receiving means, the imaging means, and the output means included in the collation system according to any one of claims 1 to 12.
A viewfinder, displaying a pre-imaged image and / or an imaged image on the viewfinder, and overlaying the image with a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image Output means for displaying on the viewfinder,
Imaging means for capturing the image displayed on the viewfinder;
And a transmission unit configured to transmit only a partial image within the specific frame in the image captured by the imaging unit to an external device.
A viewfinder, displaying a pre-imaged image and / or an imaged image on the viewfinder, and overlaying the image with a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image Output means for displaying on the viewfinder,
Imaging means for capturing the image displayed on the viewfinder;
A terminal device comprising: transmission means for transmitting the image to an external device together with information for identifying a partial image in the specific frame in the image captured by the imaging means.
A server device comprising: the storage unit included in the verification system according to any one of claims 1 to 12, the correspondence information search unit, and the verification unit.
The server apparatus according to claim 17, further comprising the image recognition means included in the collation system according to any one of claims 1 to 12.
A program for a terminal device provided with an imaging means for capturing an image displayed on a viewfinder,
Computer
A pre-imaged and / or already-captured image is displayed on the finder, and a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image is superimposed on the image and displayed on the finder. Output means,
Transmitting means for transmitting only a partial image within the specific frame of the image captured by the imaging means to an external device;
Program to function as.
A program for a terminal device provided with an imaging means for capturing an image displayed on a viewfinder,
Computer
A pre-imaged and / or already-captured image is displayed on the finder, and a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image is superimposed on the image and displayed on the finder. Output means,
Transmitting means for transmitting the image to an external device together with information for identifying a partial image in the specific frame in the image captured by the imaging means;
Program to function as.
A program for a collation system that collates a plurality of steel materials that are stacked and stored in a plurality of stages in each of a plurality of areas each assigned an address,
Computer
The identification information of each of the plurality of steel materials stored, the address of the area in which each of the steel materials is stored, and stage information indicating the position in the steel material group stacked in a plurality of stages are associated with each other. Storage means for storing correspondence information;
An input receiving means for receiving the address of the steel material to be verified and the input of the step information;
Correspondence information search means for referring to the correspondence information and acquiring the identification information associated with the address and the stage information received by the input reception means;
A pre-imaged and / or already-captured image is displayed on the finder, and a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image is displayed on the finder so as to overlap the image. Output means,
Imaging means for capturing the image displayed on the viewfinder;
Image recognition processing is performed using only a partial image in the specific frame in the image picked up by the image pickup means, and an identification mark written on the surface of each of the plurality of steel materials is extracted and extracted. Image recognition means for recognizing the identification information using the identification mark;
Collation means for determining whether or not the identification information acquired by the correspondence information search means matches the identification information recognized by the image recognition means;
Program to function as.
A collation method for collating a plurality of steel materials that are stacked and stored in each of a plurality of areas each assigned with an address,
Computer
The identification information of each of the plurality of steel materials stored, the address of the area in which each of the steel materials is stored, and stage information indicating the position in the steel material group stacked in a plurality of stages are associated with each other. Remember the correspondence information,
An input receiving step of receiving input of the address of the steel material to be verified and the step information;
A correspondence information search step of referring to the correspondence information and acquiring the identification information associated with the address and the step information received in the input acceptance step;
A pre-imaged and / or already-captured image is displayed on the finder, and a specific frame indicating a partial area to be subjected to image recognition processing in the displayed image is displayed on the finder so as to overlap the image. An output step;
An imaging step of imaging the image displayed on the viewfinder;
Image recognition processing is performed using only a partial image in the specific frame in the image captured in the imaging step, and identification marks written on the surfaces of the plurality of steel materials are extracted and extracted. An image recognition step for recognizing the identification information using the identification mark;
A collation step for determining whether or not the identification information acquired in the correspondence information search step matches the identification information recognized in the image recognition step;
The matching method to execute.