KR20140046486A - Finishing assistance apparatus, finishing assistance method and finishing assistance system - Google Patents

Abstract

This correction operation support apparatus is an apparatus which supports the correction | amendment operation of a steel plate, The imaging apparatus which image | photographs the steel plate surface, the display apparatus which displays an image on a steel plate surface, and correction which concerns on the correction operation of the steel plate acquired from the information management apparatus. Based on the related information and the picked-up image obtained from the imaging device, the correction criteria and the correction method necessary for the scratch removal operation are displayed as job support information in the correction point where the scratch removal operation is performed as a correction operation or the surrounding thereof. A control device for controlling the display device is provided.

Description

Corrective work support device, correction work support method and correction work support system {FINISHING ASSISTANCE APPARATUS, FINISHING ASSISTANCE METHOD AND FINISHING ASSISTANCE SYSTEM}

TECHNICAL FIELD This invention relates to the correction work support apparatus which supports the correction work of a steel plate, the correction work support method, and a correction work support system.

This application claims priority based on Japanese Patent Application No. 2012-023173 for which it applied to Japan on February 06, 2012, and uses the content here.

The correction operation of the steel sheet covers various aspects such as dimensional measurement, stencil printing, rudder angle, etc. in addition to removal by scratches or the like. At present, the work instruction to an operator is made by the paper printed as a work instruction table. In the content of this work instruction, the input result is reflected in the inspection process which is a previous process.

At the time when the steel sheet, which is the target material, arrives at the process, the operator checks the surface of the target material again, contrasting with this work instruction table, writes in the trimmed point, confirms the dimensional measurement position, and prints by stencil. After judging the necessity of a steering angle etc., it starts.

After the corrective work is completed, the worker checks the surface of the steel sheet as the target material again, writes the result in the work order table by hand, and inputs the corrective work result into the business computer to complete the series of work steps.

In recent years, the workless table is electronicized and paperless is displayed by displaying an image on a tablet terminal. Moreover, the dimension measurement result is transmitted as an electronic information from a previous process, and it is aimed at reducing work burden by receiving at the said tablet terminal side. In addition, the flaw position is input as coordinate information in the flaw inspection process for display on a tablet terminal.

However, the point which requires work on the steel plate by the worker which affects multiple times, such as the marking work which performs a stencil, a steering angle, etc. on the target material, the correction work after that, and the confirmation work after completion | finish of work, is not different from before. . For this reason, the further improvement was calculated | required from the point of the improvement of work efficiency and the safety of a worker.

Patent Literature 1 discloses the use of a self-propelled scratch removal device equipped with a CCD imaging device for the scratch removal method of a steel sheet. Although the scratch removal work is automated by this device, the work of performing various markings, dimensional measurements, rudders, etc. according to the kind of the scratches on the steel sheet prior to the scratch removal work is not automated. The point which needs work etc. is the same as before.

Japanese Patent Application Publication No. 2000-296453

An object of the present invention is to provide a correction work support device, a correction work support method, and a correction work support system that can realize an improvement in the efficiency of corrective work of a steel sheet and reduce the burden on an operator.

MEANS TO SOLVE THE PROBLEM This invention employs the following means in order to solve the said subject and achieve this objective.

In other words,

(1) The correction operation support apparatus according to one embodiment of the present invention is a correction operation support apparatus for supporting a correction operation of a steel sheet, and an image pickup apparatus for photographing the steel sheet surface of the steel sheet, and a display for displaying an image on the steel sheet surface. Based on the correction related information related to the correction | amendment operation | movement of the said steel plate acquired from the information management apparatus, and the picked-up image obtained from the said imaging device, Among the correction-related information in the correction part or its periphery on the said steel plate surface, A control device for controlling the display device such that information necessary for a correction work at the correction point is displayed as job support information; the job displayed at or around the correction point at which a scratch removal operation is performed as the correction job; The assistance information includes correction criteria and correction methods necessary for the scratch removal operation.

(2) The correction job support device according to (1), wherein the control device recognizes an operation of an operator who performs the correction job based on the photographed image, and the display state of the job support information is determined by the operator. It is preferable to control the display device to change according to the operation of.

(3) The correction job support device according to (2), wherein the control device switches the display and non-display of the job support information according to the operation of the operator under the control of the display device, and supports the job. It is preferable to perform at least one of the change of the display position of the information, the change in the display size of the job support information, and the additional display of supplemental information relating to the job support information.

(4) The correction job support device according to (1), wherein the control device recognizes an operation of an operator who performs the correction operation based on the captured image, and controls a peripheral device according to the operation of the worker. It is desirable to.

(5) The correction work support device according to (4), wherein the peripheral device is a lighting device that illuminates the surface of the steel sheet, and the control device controls the brightness of the lighting device according to the operation of the operator. desirable.

(6) The correction job support device according to any one of (1) to (5), wherein the control device works in the job end mark writing area displayed around the correction point or together with the job support information. When recognizing that the end mark is written based on the picked-up image, it is preferable to determine that the correcting work of the correcting point is finished.

(7) In the correction work support device described in (6) above, when the control device determines that the correction work is finished, the control device instructs another correction point to be corrected next to a predetermined position on the surface of the steel sheet. Preferably, the display device is controlled to display an arrow.

(8) In the correction job support device according to (6) or (7), when the control device determines that the correction job has been completed, the control device determines the corrected location where the correction job is completed based on the captured image. It is preferable to perform an inspection and to transmit the inspection result to the said information management apparatus.

(9) In the correction work support device according to any one of (6) to (8), the control device is located at a predetermined position on the surface of the steel sheet when it is determined that the correction work is completed for all the correction points. It is preferable to control the display device such that a previous job end message is displayed.

(10) The correction job support device according to any one of (1) to (9), wherein the control device is additionally displayed along with the periphery of the correction point or the job support information based on the captured image. It is preferable to read the additional process code written in the process code writing area, and to transmit the read additional process code to the information management apparatus.

(11) The correction operation support device according to any one of (1) to (10), wherein the control device measures the dimensions of the steel sheet based on the picked-up image, and the measured value of the dimensions is predetermined. It is preferable to determine whether the specification is satisfied, and to transmit the determination result and the measured value of the dimension to the information management apparatus.

(12) The correction job support device according to any one of (1) to (11), wherein the control device performs an operation of instructing an operator who performs the correction job to instruct an additional correction point based on the captured image. When it is recognized that it is done, it is preferable to control the said display device so that a scratch code writing area | region may be displayed with the said work support information in the said additional correction point on the said steel plate surface, or its periphery.

(13) The correction operation support device according to (12), wherein the control device reads the scratch code written in the scratch code writing area based on the captured image, and the read scratch code and the read It is preferable to transmit the positional information of the additional correction point to the information management device.

(14) The correction operation support device according to any one of (1) to (13), wherein the display device is preferably a laser drawing device that irradiates a laser beam onto the surface of the steel sheet to display an image.

(15) The correction work support device according to any one of the above (1) to (14) is provided so as to be movable in an in-plane direction and out-of-plane direction of the steel plate surface, and further includes a grooming device used for the correction work. It is preferable.

(16) The correction operation support device according to (15), wherein the grooming device preferably includes at least one of a scratch grinding mechanism, a scratch cutting mechanism, a painting printing mechanism, and a stamping mechanism.

Also,

(17) The correction operation support method according to one embodiment of the present invention is a correction operation support method for supporting a correction operation of a steel sheet, the process of acquiring correction related information relating to the correction operation of the steel sheet, and the steel sheet of the steel sheet. Based on the process of acquiring the picked-up image of the surface, and the correction point in the said steel plate surface or the periphery based on the said correction related information and the said captured image, it is necessary for the correction operation in the said correction point among the said correction related information. The work support information displayed in or around the correction point at which the scratch removal operation is performed as the correction operation, has a step of displaying information as job support information, and includes correction criteria and correction methods necessary for the scratch removal operation. do.

(18) The correction job support method described in (17) includes a step of recognizing an operation of an operator who performs the correction operation based on the photographed image, and a change of the display state of the job support information according to the operation of the worker. It is preferable to further have a process to make it.

(19) In the correction work support method described in (18) above, in the step of changing the display state of the work support information, the display and the non-display are switched between the work support information and the work support according to the operation of the worker. It is preferable to perform at least one of the change of the display position of the information, the change in the display size of the job support information, and the additional display of supplemental information relating to the job support information.

(20) The correction job supporting method according to (17) further includes a step of recognizing an operation of an operator who performs the correction operation based on the captured image, and a step of controlling a peripheral device according to the operation of the worker. It is preferable.

(21) In the correction work support method described in (20) above, in the step of controlling the peripheral device, it is preferable to control the brightness of the lighting device that illuminates the surface of the steel sheet in accordance with the operation of the operator.

(22) The correction job support method according to any one of the above (17) to (21) is based on the photographed image in a job end mark writing area displayed around the correction point or together with the job support information. It is preferable to further have a process of recognizing the written operation | movement end mark, and the process of determining that the correction | amendment work of the said correction location was complete | finished when the said operation | work end mark was recognized.

(23) The correction work supporting method according to the above (22), when it is determined that the correction work is finished, a step of displaying an arrow indicating another correction point that should be corrected next to a predetermined position on the surface of the steel sheet. It is preferable to have more.

(24) The correction work supporting method according to (22) or (23) includes a step of inspecting a correction point at which the correction work is completed, based on the photographed image, when it is determined that the correction work is finished; It is preferable to further have the process of enabling inspection of the test result of the said correction | amendment point.

(25) In the correction work support method according to any one of (22) to (24) above, when it is determined that the correction work is completed for all the correction points, the previous work end message is sent to a predetermined position on the surface of the steel sheet. It is preferable to have the process of displaying further.

(26) The correction job support method according to any one of (17) to (25) above is based on the photographed image in an additional process code entry area displayed around the correction point or together with the job support information. It is preferable to further have a process of reading the written additional process code, and the process of enabling the reading of the read said additional process code.

(27) The correction work supporting method according to any one of (17) to (26) above is a step of measuring the dimensions of the steel sheet based on the photographed image and whether the measured value of the dimensions satisfies a predetermined specification. It is preferable to further have a process of determining whether it is a step, and the process which makes it possible to read the determination result of the measured value of the said dimension, and the measured value of the said dimension.

(28) The correction job support method according to any one of (17) to (27) includes a step of recognizing that an operator who performs the correction job has instructed an additional correction point based on the photographed image; It is preferable to further have a process of displaying a flaw code writing area | region with the said work support information around the said further correction point in the said steel plate surface.

(29) The correction job supporting method according to (28) includes a step of reading a scratch code written in the scratch code writing area based on the photographed image, the read scratch code and the positional information of the additional correction point. It is preferable to further have a process which makes it possible to read.

Also,

(30) The correction work support system according to one embodiment of the present invention relates to the correction work support device according to any one of the above (1) to (16), which supports the correction work of the steel sheet, and to the correction work of the steel sheet. And an information management device for providing correction related information to the correction job support device.

According to the correction-work support apparatus as described in said (1), or the correction-work support method as described in said (17), at the time of the correction | amendment of a steel plate, the correction | amendment work in the correction | amendment location in the correction point or its periphery on the steel plate surface. Since the information necessary for the operation (especially, the correction criteria and the correction method at the correction point where the scratch removal operation is performed) is displayed as the job support information, the operator can easily find the position of the correction point on the surface of the steel sheet and the correction operation at the correction point. The information can be recognized, and as a result, the improvement of the efficiency of correcting the steel sheet and the burden on the worker can be realized.

According to the correction work support apparatus described in the above (2) or the correction work support method described in the above (18), since the operator can intentionally change the display state of the work support information, the correction work efficiency can be further improved. .

According to the correction job support device described in (3) above or the correction job support method described in (19) above, for example, switching of display and non-display of the job support information or the display position of the job support information according to the operation of the operator. By changing the value of, the display of the work support information can be prevented from interfering with the corrective work, and by changing the display size of the work support information, the worker can easily recognize the work support information. In addition, by additionally displaying supplementary information about the work support information, it is possible to facilitate understanding of the work support information by the operator.

According to the correction work support apparatus described in the above (4) or the correction work support method described in the above (20), since the operator can remotely operate the peripheral device while working on the steel sheet, the correction work efficiency can be further improved.

According to the correction work support device described in (5) or the correction work support method described in (21) above, for example, when the peripheral device is a lighting device that illuminates the steel plate surface, an operator can remotely control the brightness of the lighting device. Therefore, when the operator visualizes the correction information displayed on the surface of the steel sheet, the brightness of the lighting device can be darkened to improve the visibility of the correction information, and when the operator performs the correction work, the brightness of the lighting device is brightened to improve workability. Can be improved.

According to the correction work support apparatus as described in said (6), or the correction work support method as described in said (22), a control apparatus can automatically recognize the correction point in which the correction work was complete | finished on the steel plate surface.

According to the correction work support apparatus as described in said (7), or the correction work support method as described in said (23), after an operator finishes the correction work in any correction point on the steel plate surface, it corrects next. Since the correction point which needs to be made can be found easily, the correction work efficiency can be further improved.

According to the correction work support apparatus as described in said (8), or the correction work support method as described in said (24), the correction point where the correction work was complete | finished on the steel plate surface can be inspected automatically, and the inspection result is the information. Since it is gathered by the management apparatus and can be read, quality check of the steel plate after completion of a corrective work process becomes easy.

According to the correction work support apparatus as described in said (9), or the correction work support method as described in said (25), since an operator can easily recognize that the correction work in all the correction points is complete | finished on the steel plate surface, Improved corrective action

According to the correction work support apparatus described in the above (10) or the correction work support method described in the above (26), when an operator needs an additional work at a certain correction point, the worker performs an additional step of performing the additional work. By simply writing the additional process code indicated in the vicinity of the correction point or in the additional process code entry area, the additional process code can be collected and viewed in the information management apparatus, so that the additional process newly added after the completion of the correction work process is easy. You can check it.

According to the correction work support apparatus described in the above (11) or the correction work support method described in the above (27), it is possible to automatically determine whether the size of the steel sheet satisfies a predetermined specification, and the determination result and dimensions Since the measured value of is gathered in the information management apparatus and can be viewed, the size check of the steel sheet after the completion of the corrective work process becomes easy.

According to the correction work support apparatus described in the above (12) or the correction work support method described in the above (28), when an operator finds a new surface scratch on the surface of the steel sheet, the position of the surface scratch (additional correction point) You can display job support information.

According to the correction job support device described in (13) or the correction job support method described in (29) above, since the positional information and the scratch code of the additional correction point newly added as described above are collected in the information management device and can be viewed, After the completion of the corrective work step, the worker can easily check the position of the newly discovered surface scratch and the state of the scratch on the steel sheet surface.

According to the correction job support device described in (14) above, since the laser drawing device is used as the display device, the visibility of the job support information displayed on the steel sheet surface is improved.

According to the correction work support apparatus described in (15) above, since the trimming device used for the correction work is provided to be movable in the in-plane direction and out-of-plane direction of the steel plate surface, the correction work efficiency can be further improved.

According to the correction work support apparatus described in (16) above, any correction work can be coped, whereby the efficiency of correction work can be further improved.

According to the correction work support system described in (30) above, the operator can easily recognize the position of the correction point on the surface of the steel sheet and the information necessary for the correction operation at the correction point, and as a result, the correction work efficiency of the steel sheet. It is possible to realize the improvement and the burden on the worker.

1 is a schematic configuration diagram of a correction work support apparatus 1 according to an embodiment of the present invention.
2 is a system configuration diagram of a correction work support system 500 constructed by using a production management system 600 of an iron making plant.
3A is an operation flowchart of the correction task support apparatus 1.
3B is an operation flowchart of the correction task support apparatus 1.
4 is a diagram illustrating a state in which work support information W1 and W2 are displayed in the vicinity of each of the correction points P1 and P2 on the steel plate surface 101.
FIG. 5: is a figure which shows the state in which the arrow AR which instruct | indicates another correction point which should be correct | amended next in the steel plate surface 101 when it is determined that a correction | amendment operation is complete | finished.
FIG. 6 is a diagram showing a state in which the pre-work end message M is displayed at a predetermined position on the steel plate surface 101 when it is determined that all the correcting work is finished on the steel plate surface 101.
FIG. 7: is a figure which shows the structure which installed the care device 14 which enables automatic correction work in the correction job support apparatus 1. As shown in FIG.

EMBODIMENT OF THE INVENTION Hereinafter, one Embodiment of this invention is described, referring drawings.

1 is a schematic configuration diagram of a correction work support apparatus 1 according to the present embodiment. The correction work support device 1 supports correction work (such as a scratch removal work or a painting print work) of the steel sheet 100 by an operator, the imaging device 11, the laser drawing device 12, The control apparatus 13 is provided.

In addition, the steel plate 100 is a steel plate conveyed to a correction work process through a rolling process, a cutting process, and a surface inspection process in an ironworks plant. That is, the steel sheet 100 is molded so that each dimension of thickness, length, and width satisfies customer specifications in the rolling process and the cutting process, and the surface scratches are inspected in the surface inspection process (such as the position, type, and depth of the surface scratches). Confirmation). Such a steel plate 100 is mounted in the work bench for a worker to perform a correction work in a correction work process.

The imaging device 11 and the laser drawing device 12 of the correction work support device 1 are provided above the work bench. The imaging device 11 is a CCD camera etc., for example, image | photographs the surface (steel plate surface 101) of the steel plate 100, and outputs the picked-up image data which shows the picked-up image to the control apparatus 13. As shown in FIG. In addition, when the whole image of the steel plate surface 101 cannot be image | photographed completely by one imaging device 11, you may provide multiple imaging devices 11.

The laser drawing apparatus 12 irradiates the laser beam L to the steel plate surface 101, and displays an image under control by the control apparatus 13. For example, as shown in FIG. 1, the specific corner of the steel plate 100 is made into the coordinate origin O, XY which makes the long side of the steel plate 100 the X axis, and the short side of the steel plate 100 the Y axis. Assuming a coordinate system, the laser drawing device 12 changes the intensity of the laser light L while scanning the laser light L two-dimensionally in this XY coordinate system, thereby making a two-dimensional image on the steel plate surface 101. Is displayed.

In addition, although it is necessary to use the laser drawing apparatus 12 which can scan the whole surface of the steel plate surface 101 at least, when the whole surface of the steel plate surface 101 cannot be fully scanned by one laser drawing apparatus 12, You may provide two or more laser drawing apparatuses in the inside. In addition, as a display device which displays an image on the steel plate surface 101, not only the said laser drawing apparatus 12 but a projection type display apparatus (so-called projector) etc. which use a light emitting diode, a halogen lamp, etc. as a light source can also be used. do.

The control apparatus 13 inputs from the imaging device 11 the correction related information concerning the correction | amendment operation | work of the steel plate 100 acquired from the information management apparatus (business computer 2, database server 4) mentioned later. Based on the picked-up image data (that is, the picked-up image of the steel plate surface 101), the information necessary for the correction operation in the correction point among the correction-related information in or around the correction point in the steel plate surface 101. The laser drawing apparatus 12 is controlled so that is displayed as work support information.

In addition, although the above-mentioned work support information may be displayed in either the correction location on the steel plate surface 101 or its periphery, below, the case where operation support information is displayed around a correction point is demonstrated.

Here, the correction related information of the steel plate 100 includes surface inspection data of the steel plate 100 (table data in which the XY coordinates of the surface scratches present in the steel plate 100 and the scratch code indicating the type of the surface scratches correspond). , Correction criteria and correction methods necessary for the scratch removal operation, the number of the stencil template used in the stamp printing operation (for example, a stencil operation), the XY coordinate of the printing location, and the like.

Although details will be described later, the control device 13 displays, among the correction related information, a scratch code, a correction criterion, and a correction method as job support information, around a correction point where a scratch removal operation is performed, for example, as a correction operation. The laser drawing apparatus 12 is controlled as much as possible. In addition, the control apparatus 13 makes the laser drawing apparatus 12 so that the number of a stencil template among the said correction related information may be displayed as job support information around the correction point where a stencil operation is performed as a correction operation, for example. To control. Moreover, this control apparatus 13 controls the laser drawing apparatus 12 so that a job end mark writing area and an additional process code writing area may be displayed with the said job support information in each correction point.

The correction work support device 1 configured as described above is connected to the production management system 600 of the steelmaking plant, as shown in FIG. 2. The production management system 600 of the steelmaking plant is, for example, the business computer 2 of the upper tier, the process computer 3 and the database server 4 of the upper tier, the process equipment 5 and the field apparatus of the lower tier. It consists of the hierarchical system of three-layer structure of (6).

The business computer 2 is a top-level computer which collectively manages the production plan of the steel plate 100 in the steelmaking plant, and is communicatively connected to the process computer 3 via the host network HN. The business computer 2 includes scratches in the correction-related information other than the customer specifications of the steel sheet 100 (each specification such as thickness, length and width of the steel sheet 100 required by the customer). Correction criteria and correction methods required for the removal operation, and various kinds of information such as the number of the stencil template used in the stencil operation and the XY coordinates of the printing location are registered in advance.

The process computer 3 is communicatively connected to the business computer 2 via the upper network HN, and the database server 4, the process facility 5 and the field via the lower network LN. It is connected with the apparatus 6 so that communication is possible. This process computer 3 is based on the process data (measurement data such as temperature, table rotation speed, flow rate, pressure, etc.) received from the field device 6 and the production plan and customer specifications received from the business computer 2. To control the process equipment 5 of each process, or to display the manufacturing instructions or the process data based on the production plan and customer specifications to the workers of each process.

The database server 4 makes a database and manages various data such as process data received from the field device 6 through the lower network LN and surface inspection data of the steel sheet 100 obtained from the surface inspection process. Computer. In addition, a manufacturing number is assigned to every sheet of steel plate 100, and said surface inspection data is made into a database corresponding to the manufacturing number of each steel plate 100. As shown in FIG.

The process equipment 5 includes conveyance equipment, such as a belt conveyor, etc. besides the production equipment of each process, such as a rolling mill and a cutting machine, for example. In addition, actually operating the process facility 5 according to control by the process computer 3 is a subordinate control apparatus, such as a programmable logic controller (PLC) installed in the process facility 5.

The field device 6 is a measurement device such as a thermometer, a tachometer, a flowmeter, a pressure gauge, a valve positioner, or the like installed in the process facility 5.

The control apparatus 13 of the correction work support apparatus 1 is connected to the lower network LN of the production management system 600 mentioned above, and receives the surface inspection data of the steel plate 100 from the database server 4. While acquiring, various information such as correction criteria and a correction method required for the scratch removal work of the steel sheet 100 from the business computer 2 and the XY coordinates of the printing location through the process computer 3 are obtained. Acquire.

In this way, the correction work support apparatus 1 is connected to the production management system 600 of the steelmaking plant, and the business computer 2 and the database server 4 are connected to the correction work support apparatus 1 with the correction related information. By using it as an information management apparatus to provide, the correction work support system 500 of this invention can be constructed.

In addition, in the correction work support system 500 shown in FIG. 2, since the correction related information of the steel plate 100 is divided and registered in each of the business computer 2 and the database server 4, the business computer 2 In the case where a part of correction related information is transmitted from the correction work support device 1 to the correction work support device 1, it is necessary to pass it through the process computer 3.

That is, in the correction work support system 500 shown in FIG. 2, although the process computer 3 is an essential component, the correction related information is collectively managed by one computer (information management device), and By making the correction work support device 1 directly communicateable, the process computer 3 can construct an unnecessary correction work support system.

Next, the operation of the correction work support apparatus 1 will be described.

3A and 3B are flowcharts of operations of the correction task support apparatus 1. First, as shown in FIG. 3A, when the control apparatus 13 detects that the steel plate 100 is mounted on the work bench of a correction | amendment work process, the captured image data input from the imaging device 11 (namely, the steel plate surface ( The picked-up image of 101], the manufacturing number of the steel plate 100 printed on the predetermined position of the steel plate surface 101 is read out (step S1).

Subsequently, the control apparatus 13 acquires the surface inspection data corresponding to the manufacturing number of the steel plate 100 from the database server 4, and stores it in an internal memory (step S2). In addition, the control apparatus 13, through the process computer 3, the correction criteria and the correction method required for the scratch removal operation of the steel sheet 100 from the business computer 2, the number of the stencil template used for the stencil operation, Various information, such as XY coordinate of a printing location, is acquired and stored in an internal memory (step S3). As a result, all correction related information is stored in the internal memory of the control device 13.

Subsequently, the control apparatus 13 is based on the correction related information stored in the internal memory and the picked-up image data input from the imaging apparatus 11, around the correction point in the steel plate surface 101, Of the correction related information, the laser drawing apparatus 12 is controlled so that the information required for the correction operation at the correction point is displayed as the operation support information (step S4).

Specifically, in step S4, the control device 13 first recognizes the specific corner of the steel plate 100 as the coordinate origin O by image processing based on the captured image data, and the coordinate origin The long side and short side of the steel plate 100 extending from O are recognized as X-axis and Y-axis, respectively (see Fig. 1). And the control apparatus 13 is based on the XY coordinate system recognized as mentioned above, the XY coordinate of the surface flaw stored in the internal memory, and the XY coordinate of the printing location of each correction point in the steel plate surface 101. Know your location.

And as shown in FIG. 4, the control apparatus 13 has the steel plate surface 101 around the correction part (namely, the position of a surface flaw) P1 in which the flaw removal operation | movement is performed as a correction | amendment work, for example. Among the correction related information stored in the internal memory, the laser drawing apparatus 12 is controlled so that the scratch code, the correction criteria, and the correction method are displayed as the job support information W1.

Here, as shown in FIG. 4, it is assumed that the characters "401", "5L8Y6", and "02015" are arranged as the job support information W1, for example. "401" is a scratch code indicating the type of surface scratch. In "5L8Y6", "5" is an appearance reference | standard, "L" is a care method, "8" is the number of times, "Y" has shown whether welding repair is possible and "6" has shown welding conditions. "02015" has shown the lower limit plate thickness.

That is, since such work support information W1 is displayed around the correction point P1, the operator who performs a correction work uses five appearance criteria as a correction reference in addition to the state of a surface flaw, and roughness is eight times as a correction method. Using a method of grinding surface scratches in the rolling direction (L direction) using the number of abrasives (grinding material), however, welding repair (or repair welding) under six welding conditions is also possible to comply with the lower limit plate thickness. Information necessary for corrective work (scratch removal work) such as a thing can be recognized easily.

Similarly, as shown in FIG. 4, the control device 13 includes a correction point (that is, a printing point by a stencil operation) on the steel plate surface 101 where a stencil operation is performed, for example, as a correction operation. In the periphery, the laser drawing apparatus 12 is controlled so that the number (for example, "No. 3") of the stencil template may be displayed as the work support information W2. That is, since such job assistance information W2 is displayed around correction point P2, the operator who corrects easily makes the information necessary for correction | amendment work (stencil job) to perform a stencil job using three stencil templates. I can recognize it.

In addition, although FIG. 4 exemplifies the case where the job support information W1 and W2 are displayed on the right side of the correction points P1 and P2, the positions of the correction points P1 and P2 are planarly viewed as long as they do not interfere with the correction work. You may display the job support information W1 and W2 in any position up, down, left, and right. The distance between the correction points P1 and P2 and the work support information W1 and W2 is not particularly limited, but is also possible from the viewpoint that the operator recognizes the positions of the correction points P1 and P2 by the display of the work support information W1 and W2. It is preferable to display the job support information W1, W2 at a position close to one of the correction points P1, P2.

In addition, as shown in FIG. 4, the control device 13 adds the work end mark writing area B1 to the correction points P1 and P2 of the steel plate surface 101 together with the job support information W1 and W2. The laser drawing apparatus 12 is controlled so that process code writing area B2 may be displayed. The work end mark writing area B1 is an area for the operator to write a work end mark (for example, a V mark) at the end of the correcting work at the correction points P1 and P2. The additional process code writing area B2 is an additional process code (for example, three-digit number) indicating an additional process in which the additional work is performed when additional work is required at the end of the correction work at the correction points P1 and P2. Is an area for writing.

By the process of step S4 mentioned above, the information required for the correction | amendment in each correction point P1 and P2 is displayed as work support information W1 and W2 around each correction point P1 and P2 in the steel plate surface 101. Thus, the worker is ready to perform the corrective work on the steel plate surface 101. Thereby, an operator can easily recognize the position of each correction point P1, P2 of the steel plate surface 101, and the information required for the correction operation in each correction point P1, P2, As a result, the steel plate 100 It is possible to improve the efficiency of corrective work and to reduce the burden on the operator.

Subsequently, as shown to FIG. 3A, the control apparatus 13 is based on the picked-up image data input from the imaging device 11, The correction point which an operator currently performs corrective work (henceforth a current correction point). ), The operator's operation at the current correction point is recognized, and it is determined whether the operator has made a specific operation (step S5). Moreover, as a technique which recognizes the motion of a person by the image processing based on picked-up image data, a well-known technique, such as the technique of Unexamined-Japanese-Patent No. 2009-176059, for example can be used.

The control device 13 shifts to the processing of step S7 to be described later in the case of NO in the above step S5, and in the case of "yes" in the above step S5, the controller 13 corrects the current according to the operation of the recognized operator. The laser drawing apparatus 12 is controlled so that the display state of the work support information at a point may change (step S6).

Specifically, in step S6, the control device 13 is controlled by the laser drawing device 12, for example, in accordance with the operation of the operator, for example, switching of the display and non-display of the job support information, and the job. At least one of the change of the display position of the support information, the change of the display size of the job support information, and the additional display of supplemental information about the job support information are performed.

As described above, according to the operation of the operator, for example, the display of the work support information is hindered by the corrective work by switching the display and non-display of the work support information or changing the display position of the work support information. Can be prevented. In addition, according to the operation of the operator, for example, by changing the display size of the job support information, it is possible to facilitate the recognition of the job support information by the worker. In addition, according to the operation of the operator, for example, additional display of supplemental information regarding the job support information can be facilitated, so that the worker can easily understand the job support information.

Thus, by having the control apparatus 13 recognize the operation | movement of the operator who performs correction | amendment, and having the function to control the laser drawing apparatus 12 so that the display state of work support information may change according to an operator's operation, Since it is possible to intentionally change the display state of the job support information, the correction work efficiency can be further improved.

In addition, when the control apparatus 13 is a "Yes" in the said step S5, if the operation | movement of the recognized operator relates to operation of a peripheral apparatus, you may provide the step of controlling a peripheral apparatus according to the operation of the operator separately. do. Here, the peripheral device refers to a device other than the correction work support device 1 provided in the correction work process. For example, when the peripheral device is a lighting device that illuminates the steel plate surface 101, the control device 13 controls the brightness of the lighting device according to the recognized operator's operation.

Thereby, when an operator confirms the content of the work support information at the current correction point, the brightness of the lighting device can be darkened to improve the visibility of the work support information, and when the worker performs the corrective work at the current correction point, Workability can be improved by brightening the brightness of the lighting device. In this way, the control device 13 has a function of recognizing the operation of the operator who performs the correction work and controlling the peripheral device in accordance with the operation of the worker, thereby remotely operating the peripheral device while the worker is working on the steel plate 100. Since this can be done, the corrective work can be further improved.

Subsequently, the control device 13 based on the captured image data input from the imaging device 11, a job end mark (eg, in the job end mark writing area displayed together with the job support information around the current correction point). For example, it is determined whether or not the V-shaped mark has been written (step S7). Such a work end mark is written by the worker using chalk etc., at the time when the corrective work in the current correction point is complete | finished.

The control device 13 returns to the processing of the step S5 in the case of NO in the above step S7, and monitors the operation of the worker. When the control device 13 is "yes" in the step S7, the correcting work at the current correction point. It is determined that the process has ended (step S8).

In addition, it is not necessary to necessarily display the work end mark writing area on the steel plate surface 101, and if the work end mark is written around the current correcting point, the function of judging that the correcting work at the current correcting point is finished is performed. The control device 13 may be provided.

Subsequently, as shown in FIG. 3B, the control device 13 writes additional process codes displayed together with the job support information around the current correction point based on the captured image data input from the imaging device 11. It is determined whether or not the additional process code is written in the area (step S9). This additional process code is, for example, in order to register in the database server 4 an additional process in which the additional operation is performed when an additional operation is required at the end of the correction operation at the current correction point. It was written using chalk.

The control apparatus 13 shifts to the process of step S11 mentioned later when "No" in said step S9, and if it is "yes" in the said step S9, the control apparatus 13 writes the additional process code written in the additional process code writing area | region. It reads and transmits to the database server 4 (step S10). In this way, when an operator needs additional work at the current correction point, the operator simply writes the additional process code in the additional process code writing area at the current correction point, and the additional process code is the database server 4. It can be gathered (registered) and viewed, so that additional steps newly added after the completion of the corrective work process can be easily confirmed.

In addition, it is not necessary to necessarily display the additional process code writing area on the steel plate surface 101, and if an additional process code is written around the current correction point, it controls the function of reading it and transmitting it to the database server 4; The device 13 may be provided.

Subsequently, the control device 13 determines whether the correction work at all the correction points has ended or in other words, whether the job end mark has been written in all the job end mark writing areas (step S11). When the control device 13 is "no" at the said step S11, for example, as shown in FIG. 5, the control apparatus 13 will go to the predetermined | prescribed position of the steel plate surface 101 (for example, to the present correction | amendment point judged that the corrective work was complete | finished). In the adjacent position), the laser drawing apparatus 12 is controlled so that the arrow AR which instructs another correction point which should be corrected next is displayed (step S12). In addition, as long as the display position of arrow AR is a position which an operator is easy to recognize, any position may be sufficient.

Thereby, the operator can easily find another correction point which should be corrected after the correction work at the current correction point is completed on the steel plate surface 101, thereby further improving the efficiency of the correction work. It is possible to make it especially effective when the size of the steel plate 100 is large. In addition, the control apparatus 13 returns to the process of the said step S5 after the said step S12 is complete | finished, and monitors the operation | movement of the operator in the next correction | amendment point.

On the other hand, when the control apparatus 13 is "Yes" in the said step S11, ie, when it judges that the corrective work of all the correction points is complete | finished, as shown in FIG. 6, for example, of the steel plate surface 101 The laser drawing apparatus 12 is controlled so that the pre-work end message M may be displayed at the predetermined position (for example, the center position) (step S13). As a result, the operator can easily recognize that the corrective work at all the corrected points has been completed on the steel plate surface 101, and thus, the corrective work efficiency can be further improved. In addition, as long as it is a position which an operator is easy to recognize, the display position of the pre-work end message M may be any position.

As described above, according to the present embodiment, the operator can easily recognize the position of the correction point on the steel plate surface 101 and the information (work support information) necessary for the correction work at the correction point. As a result, the improvement of the corrective work efficiency of the steel plate 100 and the burden of an operator can be realised.

In addition, this invention is not limited to the said embodiment, The following modified examples are mentioned.

(1) For example, based on the picked-up image data input from the imaging device 11, the control apparatus 13 performs the inspection of the correction point which judged that the correction operation was complete | finished, and returns the inspection result to a database server ( It may have a function of transmitting to 4) to enable reading.

In order to realize this function, in the flowchart shown to FIG. 3A and FIG. 3B, for example, after step S8 and step S9, the control apparatus 13 is based on the picked-up image data input from the imaging device 11, What is necessary is just to provide the step which performs the test | inspection of the current correction point which judged that the correction work was complete | finished, and the control apparatus 13 transmits the test result of the current correction point to the database server 4.

Specifically, when the control apparatus 13 performs inspection of the correction point which performed the flaw removal operation, for example, whether the surface flaw was removed to the extent which satisfy | fills an external standard by image processing based on picked-up image data. Judge. In addition, when the control apparatus 13 performs inspection of the correction point which performed the stencil operation, for example, the character printed after the stencil operation is correct by the image processing based on the photographed image data (it is used for the stencil operation). Determine whether the stencil template is correct).

Thereby, the correction point which the correction | amendment operation | work completed on the steel plate surface 101 can be inspected automatically, and the inspection result is gathered in the database server 4, and can be viewed, after completion | finish of a correction | amendment work process The quality check of the steel plate 100 becomes easy.

(2) For example, while the dimension of the steel plate 100 is measured to the control apparatus 13 based on the picked-up image data input from the imaging device 11, the measured value of the dimension is predetermined specification. It may be determined whether or not (customer specification) is satisfied, and the measurement result of the determination result and the dimension are transmitted to the database server 4 so as to enable reading.

In order to realize this function, in the flowchart of FIG. 3B, for example, after step S13, the control device 13 measures the dimensions (length and width dimensions) of the steel sheet 100 based on the captured image data. Step, the control device 13 determines whether the measured value of the dimension satisfies the customer specification, and the control device 13 determines the determination result and the dimension of whether the measured value of the dimension satisfies the customer specification. What is necessary is just to provide the step of sending the measured value of to the database server 4.

As a result, it is possible to automatically determine whether or not the dimensions of the steel sheet 100 satisfy the customer specification, and the determination result and the measured values of the dimensions are collected in the database server 4 and can be viewed. The dimension check of the steel plate 100 after completion | finish becomes easy.

(3) For example, based on the picked-up image data input from the imaging device 11, the control device 13 performs the operation | movement which instruct | indicates a further correction point (especially the position of a surface flaw) by the operator who performs correction work. In the case of recognizing what has been done, the laser drawing apparatus 12 is controlled so that a scratch code writing area is displayed with the job support information containing only a correction criterion and a correction method in the vicinity of the additional correction point on the steel plate surface 101, or the periphery. The scratch code written in the scratch code writing area based on the photographing data and the captured image data, and transmits the read scratch code and position information (XY coordinates) of the additional correction point to the database server 4 for reading. You may have a function which makes it possible.

In order to realize these functions, in the flowchart of FIG. 3A, for example, after step S4, the control device 13 performs an operation of instructing an operator to perform additional correction points based on the picked-up image data. The step of recognizing that the control device 13 is configured to display the scratch code writing area together with the job support information including only the correction criteria and the correction method at or near the additional correction point on the steel plate surface 101. A step of controlling the drawing device 12, a step of the control device 13 reading a scratch code written in the scratch code writing area based on the captured image data, and a scratch code read by the control device 13. And a step of transmitting the XY coordinates of the additional correction points to the database server 4.

Thereby, when a worker finds a new surface flaw in the steel plate surface 101, work support information can be displayed in the position (additional correction point) of the surface flaw, and a flaw code is written in a flaw code entry area | region. By writing, the state of scratches in the additional correction point can also be input to the control device 13. In addition, since the XY coordinates and the scratch code of the additional correction point newly added as described above can be registered and viewed in the database server 4, the operator newly discovers the steel sheet 100 after the completion of the correcting work step. The position of the surface scratch and the state of the surface scratch can be easily confirmed.

(4) Although the above-mentioned embodiment exemplifies a case where an operator performs correction work on the steel plate surface 101 in accordance with the job support information drawn by the laser drawing apparatus 12, the in-plane direction of the steel plate surface 101 is illustrated. (The direction in the XY plane) and the trimming device 14 which is movable in the out-of-plane direction (Z-axis direction orthogonal to the XY plane) are provided, and the job assistance information which the laser drawing device 12 draws to the imaging device 11. By taking a picture and adopting a configuration in which the control device 13 controls the grooming device 14 based on the picked-up image data, the correction work can be automatically performed.

For example, as shown in FIG. 7, the grooming device 14 includes a door frame 20, a trolley 21, a strut 22, a turret mechanism 23, a scratch grinding mechanism 24, and painting printing. It is comprised by the mechanism 25. Specifically, the door frame 20 which is movable beyond the steel plate 100 in the X-axis direction is provided, and the trolley 21 which can move the upper side of the door frame 20 in the Y-axis direction is driven, Allow 21 to move to any position on the steel plate surface 101. In the trolley | bogie 21, the support | pillar 22 is installed so that a lifting and lowering is possible through the groove | channel of the upper side of the trolley | bogie 21 and the door-shaped frame 20, and the flaw grinding mechanism (at the lower end part through the turret mechanism 23) 24) and the spray coating printing mechanism 25 are arrange | positioned. That is, the support 22 moves (elevates) the turret mechanism 23 in the Z-axis direction.

In such a configuration, in the state where the work support information is drawn on the steel plate surface 101 by the laser drawing device 12, the steel plate surface 101 is imaged by the imaging device 11, and the control device 13 captures a photographed image. On the basis of the job support information stamped on, the scratch removal operation can be automatically performed by moving the scratch grinding mechanism 24 in the XYZ direction.

In the case where work by the scratches grinding mechanism 24 is necessary due to circumstances such as special surface scratches, the painting printing mechanism 25 is rotated by the turret mechanism 23 at the position (correction point) of the surface scratches. It can be used for stencil work for displaying a product number, a shipping address, and the like.

In addition, although the case where the care device 14 is equipped with the scratch grinding mechanism 24 and the painting-printing mechanism 25 was illustrated in FIG. What is necessary is just to provide at least one. Here, a scratch grinding mechanism means the mechanism which grinds and removes a surface scratch mechanically with a grinder etc. (for example, a grindstone or a belt grinder). The flaw cutting mechanism refers to a mechanism for removing surface scratches by air arc or gas gouging.

By adopting the configuration using the above-described cleaning device 14, the work on the steel plate 100 by the worker is unnecessary in principle, the work load of the worker is greatly reduced, and the work efficiency is greatly improved, and the worker It is also effective in securing safety.

According to the present invention, it is possible to realize an improvement in the efficiency of correcting the steel sheet and to reduce the burden on the worker. Therefore, a large industrial effect can be expected by implementing the present invention.

1: Corrective work support device
2: business computer (information management device)
3: process computer
4: database server (information management device)
5: process equipment
6: field device
11: imaging device
12: laser drawing device (display device)
13: control device
14: trimming device
100: steel plate
101: steel plate surface
500: correction work support system
600: Production Management System

Claims (30)

It is a correction work support device that supports the correction work of the steel sheet,
An imaging device for photographing the surface of the steel sheet of the steel sheet;
A display device for displaying an image on the surface of the steel sheet;
Based on the correction related information relating to the correction operation of the steel sheet obtained from the information management device and the picked-up image obtained from the imaging device, the correction point among the correction related information on or around the correction point on the surface of the steel sheet. And a control device for controlling the display device so that the information necessary for the correction job in the job is displayed as the job support information.
And the job assistance information displayed on or around the correction point where the scratch removal operation is performed as the correction job includes a correction criterion and a correction method required for the scratch removal operation. The display apparatus according to claim 1, wherein the control device recognizes the operation of the worker who performs the correcting operation based on the captured image, and changes the display device so that the display state of the job support information changes in accordance with the operation of the worker. Corrective operation support device, characterized in that the control. The said control apparatus is a control apparatus of Claim 2, Comprising: The switching of display and non-display of the said work support information, the change of the display position of the said work support information, and the said work support by control of the said display apparatus. And at least one of a change in the display size of the information and an additional display of supplemental information relating to the job assistance information. The correction operation support apparatus according to claim 1, wherein the control device recognizes an operation of the operator who performs the correction operation based on the captured image, and controls a peripheral device in accordance with the operation of the operator. . The correction work support apparatus according to claim 4, wherein the peripheral device is a lighting device that illuminates the surface of the steel sheet, and the control device controls the brightness of the lighting device according to the operation of the operator. The said control apparatus WHEREIN: The said image | photographing apparatus of any one of Claims 1-5 in which the job end mark was written in the job end mark writing area displayed around the said correction | amendment point, or with the said job support information. When it recognizes based on an image, it is determined that the correction work of the said correction point was complete | finished, The correction job support apparatus characterized by the above-mentioned. The said control apparatus controls the said display apparatus of Claim 6 so that when it determines with the said corrective operation being complete | finished, the arrow which instructs another correction point which should be corrected next is displayed in the predetermined position of the said steel plate surface. Corrective work support device, characterized in that. The control apparatus according to claim 6, wherein, when it is determined that the correction operation is completed, the control device inspects the correction point at which the correction operation is completed, based on the photographed image, and transmits the inspection result to the information management apparatus. Corrective work support device, characterized in that. The said control apparatus is a said any one of Claims 6-8, Comprising: When it determines with the said correct | amendment work being complete | finished with respect to all the said correction | amendment points, the said so that a pre-work end message may be displayed in the predetermined position on the said steel plate surface. The correction operation support apparatus, characterized by controlling the display apparatus. The additional process according to any one of claims 1 to 9, wherein the control device is written in an additional process code entry area displayed along with the work support information or the periphery of the correction point based on the captured image. And correcting the code, and transmitting the read additional process code to the information management device. The said control apparatus measures the dimension of the said steel plate based on the said picked-up image, determines whether the measured value of the said dimension satisfy | fills a predetermined specification, The said control apparatus in any one of Claims 1-10. The determination result and the measured value of the said dimension are sent to the said information management apparatus, The correction work support apparatus characterized by the above-mentioned. The said steel plate surface as described in any one of Claims 1-11, when the said control apparatus recognizes that the operator who performs the said correction | correction operation performed the operation | movement which instruct | indicates a further correction point based on the said picked-up image. And the display device so that a scratch code writing area is displayed together with the job support information at or near the additional correction point in the correction job support device. 13. The control apparatus according to claim 12, wherein the control device reads the scratch code written in the scratch code writing area on the basis of the photographed image, and manages the information on the read scratch code and the position information of the additional correction point. The corrective job support device characterized by the above-mentioned. The correction work support apparatus according to any one of claims 1 to 13, wherein the display device is a laser drawing device that displays an image by irradiating a laser beam onto the surface of the steel sheet. The correction work support according to any one of claims 1 to 14, further comprising a grooming device which is provided to be movable in an in-plane direction and an out-of-plane direction of the steel plate surface and is used for the correction work. Device. The correction operation support apparatus according to claim 15, wherein the grooming apparatus includes at least one of a scratch grinding mechanism, a scratch cutting mechanism, a painting printing mechanism, and a rudder angle mechanism. Correction work support method to support the correction work of the steel sheet,
Acquiring correction-related information relating to the correction operation of the steel sheet;
Obtaining a photographed image of the surface of the steel sheet of the steel sheet;
Based on the correction-related information and the picked-up image, a step of displaying, as job support information, information necessary for a correction operation at the correction point among the correction-related information on or near the correction point on the surface of the steel sheet. Have,
The correction operation support method, characterized in that the job assistance information displayed on or around the correction point at which the scratch removal operation is performed as the correction operation includes correction criteria and a correction method necessary for the scratch removal operation. 18. The method of claim 17, further comprising: recognizing an operation of an operator who performs the correction operation based on the captured image;
And a step of changing the display state of the job support information according to the operation of the worker. 19. The process according to claim 18, wherein in the step of changing the display state of the work support information, switching of display and non-display of the work support information, change of the display position of the work support information, and the work in accordance with the operation of the worker. And at least one of a change in the display size of the support information and additional display of the supplemental information relating to the job support information. 18. The method of claim 17, further comprising: recognizing an operation of an operator who performs the correction operation based on the captured image;
And a step of controlling a peripheral device according to the operation of the worker. 21. The method of claim 20, wherein in the step of controlling the peripheral device, the brightness of the lighting device illuminating the surface of the steel sheet is controlled according to the operation of the worker. The job end mark written in the job end mark writing area displayed with the periphery of the said correction location or with the said job support information based on the said picked-up image is recognized based on any one of Claims 17-21. Fair,
And a step of determining that the correcting work at the correcting point is finished when the work end mark is recognized. The correction method according to claim 22, further comprising a step of displaying an arrow indicating another correction point to be corrected next at a predetermined position on the surface of the steel sheet when it is determined that the correction operation is completed. How to support work. The process according to claim 22 or 23, wherein in the case where it is determined that the correction operation is completed, a step of inspecting a correction point at which the correction operation is completed based on the photographed image;
The correction work support method further comprises the process of enabling the inspection result of the said correction location to be read. 25. The method according to any one of claims 22 to 24, further comprising the step of displaying a pre-work end message at a predetermined position on the surface of the steel sheet when it is determined that the correcting work has been completed for all the correcting points. Correction work support method. The method according to any one of claims 17 to 25, wherein an additional process code written in the additional process code writing area displayed around the correction point or together with the job assistance information is read based on the captured image. Fair,
And a step of enabling the reading of the read additional process code. The process of any one of Claims 17-26 which measures the dimension of the said steel plate based on the said picked-up image,
Determining whether the measured value of the dimension satisfies a predetermined specification;
And a step of enabling a view of the determination result of whether the measured value of the said dimension satisfies the said specification and the measured value of the said dimension, It is characterized by the above-mentioned. The process of any one of Claims 17-27 which recognizes that the operator who performs the said correction | amendment operation performed the operation | movement which instruct | indicates a further correction point based on the said picked-up image,
And a step of displaying a scratch code entry region together with the work support information around the additional correction point on the surface of the steel sheet. 29. The process of claim 28, further comprising: reading a scratch code written in the scratch code writing area based on the photographed image;
And a step of enabling reading of the scratch code read out and the positional information of the additional correction point. The correction work support apparatus in any one of Claims 1-16 which support the correction work of a steel plate,
And an information management device for providing correction related information related to the correction operation of the steel sheet to the correction operation support device.

Images