JP2019204295A - Vehicle body information management system and vehicle body information management method - Google Patents

Abstract

To provide a vehicle body information management technique capable of associating a test result handwritten on a handwritten recording medium with an indicated part for transformation into text data.SOLUTION: The vehicle body information management system 1 manages information related to results of inspecting a vehicle body, and includes: an extraction unit 34 that extracts handwritten image data Ic corresponding to inspection result information B from image data Ia of a recording sheet 10 as a handwritten recording medium on which the inspection result information B including a leader line D and quality information C is handwritten with respect to a contour Wa representing a component W of the vehicle body; a detection unit 35 that detects coordinates of a start point of the leader line D extended from the contour Wa in the inspection result information B of the handwritten image data Ic extracted by the extraction unit 34, and the quality information C located around an end point of the leader line D; and a conversion unit 36 that converts the quality information C detected by the detection unit 35 to text data associated with the coordinates of the start point of the leader line D.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technique for managing information related to vehicle body inspection results.

  Conventionally, in the painting process of the car body production line, the car body after painting that is being conveyed continuously is inspected, and the inspection results (status of appearance defects, dust adhering, etc.) are recorded on a single sheet for each unit. There is a known method for managing by handwriting on paper with letters, numbers, symbols, and the like. However, such paper information on recording paper is disadvantageous for comprehensively managing the inspection results for all the vehicle bodies. Therefore, there is a demand for a technique that can comprehensively manage inspection results for a plurality of vehicle bodies by converting paper information into text data.

  Therefore, Patent Document 1 below proposes a production information management apparatus for achieving this type of technology. This production information management apparatus has a function of extracting characters and the like from a paper information image of a recording sheet and converting it into text data. Therefore, it is effective for comprehensively managing paper information handwritten on a plurality of recording sheets.

JP 2008-257679 A

  By the way, when a recording sheet such as a form is used, the format such as the shape, size, position, and orientation of information that can be entered by handwriting is not easily restricted, and the degree of freedom of handwriting is high. For this reason, in a vehicle body production line, the merit by using a recording sheet is large. On the other hand, the worker needs to complete the entry on the recording paper within a limited time during which the car body is transported. Variations can occur in the format of the information being processed.

For such problems, the function of the production information management device disclosed in Patent Document 1 is effective for recognizing typical information handwritten at a fixed position on a recording sheet and converting it into text data. However, there is a problem that it is difficult to associate text handwritten on a recording sheet with text to make it into text data.
Such a problem occurs not only in the painting process of the vehicle body production line but also in the case of converting information handwritten on the recording paper in various production processes such as a welding process, an assembly process, and an inspection process. obtain.

  The present invention has been made in view of the above problems, and is intended to provide a vehicle body information management technique capable of converting a test result handwritten on a handwritten recording medium into text data in association with an indicated location. .

One embodiment of the present invention provides:
A vehicle body information management system for managing information related to vehicle body inspection results,
An extraction unit for extracting handwritten image data corresponding to the inspection result information from image data of a handwritten recording medium in which inspection result information including a leader line and quality information is handwritten with respect to an outline representing a component of the vehicle body; ,
Detection for detecting the start point coordinates of the leader line drawn from the contour and the quality information located around the end point of the leader line in the inspection result information of the handwritten image data extracted by the extraction unit And
A conversion unit that converts the quality information detected by the detection unit into text data associated with the start point coordinates of the leader line;
A vehicle body information management system,
It is in.

Another aspect of the present invention is:
A vehicle body information management method for managing information related to inspection results of a vehicle body,
An extraction step of extracting handwritten image data corresponding to the inspection result information from image data of a handwritten recording medium in which inspection result information including lead lines and quality information is handwritten with respect to the contour representing the components of the vehicle body; ,
Detection step of detecting the start point coordinates of the leader line drawn from the contour and the quality information located around the end point of the leader line in the inspection result information of the handwritten image data extracted in the extraction step When,
A conversion step for converting the quality information detected in the detection step into text data associated with the start point coordinates of the leader line;
Including vehicle body information management method,
It is in.

  In each of the above aspects, handwritten image data corresponding to the inspection result information is extracted from the image data of the handwritten recording medium in which the inspection result information is handwritten with respect to the contour. The starting point coordinates of the leader line and the quality information are detected from the handwritten image data. The detected quality information is converted into text data associated with the start point coordinates.

  Here, the leader line is a line drawn from the outline of the component. For this reason, by detecting the start point coordinates of the start point that is the leader of the leader line, it is possible to recognize which point to be pointed out among the components of the vehicle body. In addition, the product type information is handwritten at the peripheral position of the end point that is the leader of the leader line. For this reason, the specific content of the inspection result can be recognized by detecting the product type information.

  Then, the text data converted into data is obtained by connecting the start point coordinates of the leader line and the product type information. As a result, it becomes clear which position on the contour of the component the quality information is, that is, which point to be inspected. For this reason, it becomes possible to comprehensively manage the inspection results for a plurality of vehicle bodies based on the text data.

  As described above, according to the above-described aspect, it is possible to provide a vehicle body information management technique capable of converting the inspection result handwritten on the handwritten recording medium into text data in association with the indicated location.

1 is a system configuration diagram of a vehicle body information management system according to a first embodiment. The figure which shows the image data of the recording paper before test result information is handwritten. The figure which shows the image data of the recording paper by which test result information was handwritten. The figure which shows the processing flow in the vehicle body information management system of FIG. The figure for demonstrating the process in the 3rd step of FIG. The figure which shows the handwritten image data extracted by the 4th step of FIG. The figure which shows the information for determination. The figure for demonstrating a part of process in the 5th step of FIG. The figure for demonstrating a part of process in the 5th step of FIG. The figure for demonstrating a part of process in the 5th step of FIG. The figure for demonstrating a part of process in the 5th step of FIG. The figure for demonstrating a part of process in the 5th step of FIG. The figure for demonstrating a part of process in the 5th step of FIG. The figure for demonstrating a part of process in the 5th step of FIG. The figure which shows the text data converted by the 7th step of FIG. The figure for demonstrating a part of process equivalent to the 5th step of FIG. 4 in the vehicle body information management system of Embodiment 2. FIG.

  Preferred embodiments of the above aspects are described below.

  In the vehicle body information management system, it is preferable that the origin coordinates of the contour in the handwriting recording medium are stored in advance, and the detection unit detects the start point coordinates of the leader line based on the origin coordinates. .

  According to this management system, the starting point coordinates of the leader line can be detected based on the relative positional relationship between the contour of the component and the starting point of the leader line. For this reason, even when the layout of the contour ring on the handwritten recording medium is changed due to a change in the format or the like, the start point coordinates of the leader line can be easily detected by using the origin coordinates as a reference.

  In the vehicle body information management system, it is preferable that the detection unit detects information on an extension line of the leader line as the quality information.

  According to this management system, it is possible to accurately detect the quality information handwritten on the extension line along with the leader line.

  In the vehicle body information management system, the detection unit preferably detects information similar to any of a plurality of pieces of determination information registered in advance as the quality information.

  According to this management system, it is possible to selectively detect only information that is likely to be quality information from information located around the end point of the leader line. This simplifies the quality information detection process.

  In the vehicle body information management system, the detection unit includes the coordinates of one leader line end point located in the inner region surrounded by the outline among the leader line end points on both sides of the leader line in the handwritten image data. It is preferable to detect it as coordinates.

  According to this management system, the end points on both sides of the leader line can be easily distinguished into the start point and the end point depending on whether the end points are in the inner region or the outer region of the contour of the component. Thereby, the detection accuracy of the starting point coordinates of the leader line can be increased.

  In the vehicle body information management system, the extraction unit uses the image data as first image data, and secondly stores image data on the handwriting recording medium before the inspection result information is handwritten on the contour. When image data is used, it is preferable that the handwritten image data is extracted from the first image data as a foreground with respect to the second image data by performing a background subtraction on the second image data from the first image data.

  According to this vehicle body information management system, handwritten image data can be selectively extracted by using the process of background subtracting the second image data from the first image data.

  In the vehicle body information management system, the inspection result information is handwritten in a color different from the contour on the handwritten recording medium, and the extraction unit extracts the handwritten image data from the first image data. In addition, it is preferable that the handwritten image data is identified and extracted by the difference in color from the second image data corresponding to the contour.

  According to this vehicle body information management system, handwritten image data can be easily extracted from the first image data by operating the handwritten recording medium so that the inspection result information is handwritten in a color different from the outline.

  In the vehicle body information management system, the detection unit detects an indication range surrounding the start point of the leader line as the inspection result information, and outputs text data indicating the size of the indication range in association with the quality information. It is preferable to do this.

  According to this vehicle body information management system, the user can grasp the size of the indication range based on the output text data.

  In the vehicle body information management system, the detection unit, as the text data indicating the size of the indication range, between the centroid of the indication range and a separation point farthest from the centroid in the indication range. It is preferable to output a range radius corresponding to the maximum distance.

  According to this vehicle body information management system, the user can easily grasp the size of the indication range from the value of the range radius.

  The vehicle body information management system preferably includes an image input device for inputting an image of the handwritten recording medium, and the image input device is preferably connected to the data acquisition unit so that the image data can be transmitted. .

  According to this vehicle body information management system, the image data of the handwritten recording medium can be acquired in cooperation with the image input device.

  In the vehicle body information management system, it is preferable that the image input device is disposed at each of a plurality of inspection points in the vehicle body production line.

  According to this vehicle body information management system, an operator can input an image of a handwritten recording medium pointed out at each inspection point on the vehicle body production line and handwritten inspection result information after inspection by an image input device. become.

  Hereinafter, the vehicle body information management system of this embodiment will be described with reference to the drawings.

(Embodiment 1)
As shown in FIG. 1, a vehicle body information management system (hereinafter also simply referred to as “management system”) 1 according to the first embodiment is for managing information related to inspection results of a vehicle body 2. In the management system 1, a recording sheet 10 is used. The recording paper 10 is a thin paper handwritten recording medium on which an operator U can record information by handwriting.

  In the vehicle body production line, the advantage of using such a recording sheet 10 having a high degree of freedom of handwriting is great, but the operator U can record the recording sheet 10 within a limited time during which the vehicle body 2 is being transported. It is necessary to complete the entry, and even if it is the same worker U, even if it is a different worker U, the format of information to be handwritten may vary.

  Therefore, the management system 1 is for coping with such problems, and includes an image input device 20, a processing device 30, an output device 40, a server 50, and a LAN 60.

  The image input device 20 is for inputting an image on the recording paper 10 and outputting image data I obtained by digitizing the image. Although details will be described later, the image data I of the recording sheet 10 includes first image data Ia indicating an image in which a plurality of indication information B is handwritten with respect to the contour Wa representing the component W of the vehicle body 2; And second image data Ib indicating an image before a plurality of indication information B is handwritten.

  Typically, a scanner or a camera can be used as the image input device 20. The image input device 20 is connected to the data acquisition unit 31 of the processing device 30 so that the image data I can be transmitted. At this time, the image input device 20 may be used in a state where it is always connected to the processing device 30, or is usually used so as to be separated from the processing device 30 and connected to the processing device 30 as necessary. May be. Accordingly, the processing device 30 can acquire the image data I of the recording paper 10 in cooperation with the image input device 20.

  The processing device 30 has a function of processing the image data I sent from the image input device 20. The processing device 30 is constituted by a desktop or notebook personal computer (PC) having a monitor (display means), a keyboard (input means), a mouse (selection means), a CPU, a ROM, a RAM, and the like.

  The processing device 30 includes a data acquisition unit 31, a data processing unit 32, a storage unit 37, and an input / output unit 38. The data processing unit 32 further includes an adjustment unit 33, an extraction unit 34, a detection unit 35, and a conversion unit 36. ing.

  The data acquisition unit 31 includes image data I sent from the image input device 20, image data sent via the server 50 and the input / output unit 38, and data sent via the LAN 60 and the input / output unit 23. It has a function to acquire acquired image data.

  The storage unit 37 includes image data I sent from the image input device 20, image data sent via the server 50 and the input / output unit 38, image data sent via the LAN 60 and the input / output unit 38, and the like. It has a function to store. The storage unit 37 stores in advance information related to the origin coordinates (the origin coordinates P0 described later) of the contour Wa of the component W on the recording paper 10.

  The input / output unit 38 has a function of transmitting / receiving data to / from an external device. The external device includes a plurality of OA terminals connected to the output device 40, the server 50, and the LAN 60, respectively.

  The output device 40 includes at least one of a printer that outputs data by printing, a monitor that outputs data by display, and a speaker that outputs data by voice.

  The server 50 stores data input via the LAN 60, and has a function of reading the stored data in accordance with a control signal from the request destination and transmitting the data to the request destination.

  The adjustment unit 33 of the data processing unit 32 is configured to perform processing for adjusting the size and orientation of the image data I based on the template image data. According to the adjustment unit 33, each of the two image data Ia and Ib can be adjusted.

  Since the two image data Ia and Ib are hardly displaced with respect to the template image data, the adjustment unit 33 can be omitted when adjustment processing of the two image data Ia and Ib is not required. .

  The extraction unit 34 of the data processing unit 32 corresponds to the inspection result information B including the lead line D and the quality information C from the first image data Ia using the two image data Ia and Ib adjusted by the adjustment unit 33. It is configured to perform processing for extracting handwritten image data Ic.

  The detection unit 35 of the data processing unit 32 includes quality information C, a leader line D, a leader line end point E, and an indication range F, all as inspection result information B from the handwritten image data Ic extracted by the extraction unit 34. And are respectively detected.

  The quality information C is information indicating the inspection result handwritten with characters, symbols, numbers, and the like. The leader line D is a leader line drawn from the outline Wa of the component W. The leader line end point E is an end point on both sides of the leader line D drawn from the outline Wa of the component W. The indication range F is a range surrounding the starting point of the leader line D drawn from the outline Wa of the component W.

  The conversion unit 36 of the data processing unit 32 includes text data (text data TD described later) associated with the start point coordinates (start point coordinates P1, P2, P3, P4 described later) of the quality information C detected by the detection unit 35. ).

  Here, each of the two image data Ia and Ib will be specifically described.

  As shown in FIG. 2, in the second image data Ib, four areas A1, A2, A3, and A4 are provided on the surface of the recording paper 10.

  An outline Wa representing the component W of the vehicle body 2 is written in advance in the area A1 of the recording paper 10. When the worker U finds an indication item during the vehicle body inspection, the operator U can record the inspection result information B as the indication item by hand on the outline Wa of the area A1.

  Here, the component W of the vehicle body 2 may be the vehicle body 2 itself, or may be an element such as a door that is a part of the vehicle body 2. Moreover, the thing of the state which looked at the component W from various directions, such as a side, the front, back, can be used as the outline Wa.

  The three areas A2, A3, A4 of the recording paper 10 are arranged side by side above the area A1. The vehicle body management information is handwritten in these three areas A2, A3 and A4. "Car number" is handwritten in the second area A2, "paint color" is handwritten in the third area A3, and "date" is handwritten in the fourth area A4.

  If necessary, at least one of these three areas A2, A3, and A4 can be diverted to an area where other vehicle body management information is handwritten. Further, the number and arrangement of the areas where the vehicle body management information is handwritten is not limited to this, and can be changed as appropriate.

  The four corners 10a printed on the recording paper 10 are used for adjustment processing for matching the size and orientation of the image data with the template image data for each of the two image data Ia and Ib. Typically, projection conversion (homography conversion) is used as this adjustment processing.

  Note that, for example, when the four corners 10 a are not printed on the recording paper 10, four markers for alignment can be embedded near the four corners of the recording paper 10 as necessary. In this case, the number of markers is not limited to four, and can be changed to a number larger than four as necessary. For example, the recording paper 10 may be divided into a plurality of rectangles and markers may be embedded in the vicinity of the four corners of each rectangle.

  As shown in FIG. 3, in the first image data Ia, a plurality of inspection result information B for the contour Wa of the area A1 of the recording paper 10 includes four pieces of quality information C1, C2, C3, and C4 (in the following description). , Simply “quality information C”), four leader lines D1, D2, D3, D4 (also simply called “leader line D” in the following description), and four leader line end points E1, E2. , E3, E4 (also simply referred to as “leader line end point E” in the following description) and two indication ranges F1 and F3 (also simply referred to as “indication range F” in the following description). It is.

  As the leader line D, various shapes such as a straight line, a curved line, a wavy line, and a zigzag line can be adopted. The quality information C is located around the end point of the leader line D and is on the extension line of the leader line D.

  In the case of the post-painting inspection of the vehicle body 2, the quality information C includes, for example, the letters “ske” indicating that the paint is too little and the underlying color can be seen through or the paint is dripping too much. The word “sag” indicating the state, the word “buzz” indicating that the solid surface such as dust is on the surface of the paint film, and unevenness such as wrinkles, wrinkles and folds are generated on the paint film surface. It is indicated by “wrinkle” indicating the state.

  The leader line end point E is a start point and an end point of the leader line D. That is, the leader line end point E1 is the start point and the end point of the leader line D1. The leader line end point E2 is the start point and the end point of the leader line D2. The leader line end point E3 is a start point and an end point of the leader line D3. The leader line end point E4 is the start point and the end point of the leader line D4.

  The enclosing portion surrounding the starting point of the leader line D in order to specify the indication range F is typically configured by a closed shape such as “circle” or “ellipse”.

  In the present embodiment, the indication range F1 is handwritten with respect to the quality information C1, and the indication range F3 is handwritten with respect to the quality information C3. On the other hand, since the quality information C2 and C4 are pinpointed, the indicated range is not handwritten.

  Next, a vehicle body information management method for managing information by the management system 1 will be described with reference to FIGS. 1 and 4 to 15.

  As shown in FIG. 4, this process is executed by steps from the first step S101 to the eighth step S108. One or a plurality of steps may be added to these steps as necessary, or a plurality of steps may be integrated. Moreover, the order of each step can also be changed as needed.

  The first step S101 is a step of inputting an image of the recording paper 10 in which the inspection result information B is handwritten to the image input device 20. According to the first step S <b> 101, a desired image on the recording paper 10 is input to the image input device 20. The first step S101 may be performed by the worker U himself who has handwritten the inspection result information B on the recording paper 10, or may be performed by an administrator different from the worker U. Further, the image input device 20 outputs the first image data Ia while being connected to the processing device 30.

  About 1st step S101, it is preferable that the image input device 20 is arrange | positioned in each of the some test location in a vehicle body production line. Thereby, the operator U can input the image of the recording paper 10 pointed out at each inspection point of the vehicle body production line and handwritten with the inspection result information B after the inspection by the image input device 20.

  Further, in this case, it is preferable to operate so that one recording sheet 10 is transported together with the vehicle body 2 and the inspection result information B is additionally written on the recording sheet 10 at each inspection location by handwriting. As a result, the number of inspection result information B handwritten on the recording paper 10 increases as the recording paper 10 goes through each inspection location. Accordingly, the first image data Ia of the number of recording sheets 10 corresponding to the number of inspection points can be obtained, which helps to manage the change over time of the indications for the vehicle body 2.

  The processing after the second step S102 in the processing flow of FIG.

  The second step S102 is an acquisition step for acquiring the image data Ia and Ib output from the image input device 20. The second step S102 is executed by the data acquisition unit 31 of the processing device 30. According to the second step S102, the image data Ia and Ib are taken into the processing device 30. In this case, the acquisition source of the image data Ia and Ib may be the image input device 20, or the storage unit 37 or the server 50. The image data Ia and Ib are stored in the storage unit 37 as needed from the data acquisition unit 31 and then indirectly sent to the adjustment unit 33 of the data processing unit 32 or directly adjusted from the data acquisition unit 31. Sent to the unit 33.

  The third step S103 is an adjustment step for adjusting the shape and orientation of the image data Ia and Ib acquired in the second step S102. The third step S103 is executed by the adjustment unit 33 of the processing device 30. This adjustment is executed for each of the two image data Ia and Ib.

  As shown in FIG. 5, for the adjustment of the image data Ia, the coordinates of the four corners 10a included in the image data Ia are detected, and the positions of the four corners 10a are defined at the four corners of the template image data 10b. The shape and orientation of the image data Ia are adjusted so as to match the position. The adjustment of the image data Ib is the same as the adjustment of the image data Ia, and thus the description thereof is omitted.

  The fourth step S104 is an extraction step for extracting the handwritten image data Ic from the first image data Ia. The fourth step S104 is executed by the extraction unit 34 of the processing device 30. In the fourth step S104, the handwritten image data Ic is extracted from the first image data Ia as the foreground with respect to the second image data Ib by performing background subtraction on the second image data Ib from the first image data Ia.

  The “background difference” here refers to comparing the pixel values of the first image data Ia and the second image data Ib and determining the background if the difference between the pixel values is less than or equal to a threshold value, otherwise the foreground. It is a known method for determining that.

  According to the fourth step S104, as shown in FIG. 6, the handwritten image is obtained by omitting the second image data Ib corresponding to the contour Wa (see FIG. 2) of the component W from the first image data Ia. Data Ic is extracted. That is, only the result information B handwritten in the area A1 and the information handwritten in the three areas A2, A3, and A4 remain in the handwritten image data Ic. As described above, the handwritten image data Ic can be selectively extracted using the process of background subtracting the second image data Ib from the first image data Ia.

  In addition, for the fourth step S104, it is preferable that the inspection result information B is handwritten on the recording paper 10 in a color different from the outline Wa of the component W. In this case, when extracting the handwritten image data Ic from the first image data Ia, the extracting unit 34 identifies the handwritten image data Ic by the color difference from the second image data Ib corresponding to the contour W. . As a result, by operating the test result information B on the recording paper 10 so as to be handwritten in a color different from the outline Wa of the component W, the handwritten image data Ic can be easily extracted from the first image data Ia.

  In addition, there may be cases where the first image data Ia includes information having a low relevance to the quality information C, such as a seal of the person in charge of inspection or the person in charge of inspection. In such a case, in order to prevent the detection of the quality information C, the processing for deleting the information indicating the seal from the handwritten image data Ic based on the color, and the information indicating the seal on the handwritten image data based on the shape It is preferable to perform any one of the processes for erasing from Ic. For example, the information indicating the seal can be erased by setting the seal to black, which is the same color as the frame line. In addition, information surrounded by characters having a shape such as a circle, an ellipse, or a rectangle can be detected and deleted as information indicating a seal.

  The fifth step S105 is a detection step in which the handwritten image data Ic is decomposed to individually detect the quality information C, the leader line D, the leader line end point E, and the indication range F. In the fifth step S105, the quality information C is detected as information on the extension line of the leader line D, so that the quality information C handwritten on the extension line together with the leader line D can be detected with high accuracy. The sixth step S106 is a detection step for detecting the vehicle body management information. Both of these two steps S105 and S106 are executed by the detection unit 35 of the processing device 30.

  Here, a plurality of pieces of determination information are registered in advance in the storage unit 37 for each of the quality information C, the leader line D, the leader line end point E, and the indication range F. For this reason, information similar to any of the plurality of pieces of determination information can be selected.

  As shown in FIG. 7, the plurality of pieces of determination information JC for the quality information C include images of characters such as “suke”, “sag”, “butsu”, and “wrinkle”, images indicating symbols, and the like. It is. The plurality of determination information JD for the leader line D includes images of a plurality of lines having different shapes. The plurality of determination information JE for the leader line end point E includes a plurality of line end shape images. The plurality of determination information JF for the indication range F includes an image of a surrounding portion (circular, elliptical, etc.) surrounding the line end.

  As shown in FIG. 8, the quality information C1, C2, C3, and C4 is detected by the detection unit 35 in the fifth step S105. These quality information C1, C2, C3, and C4 are all similar to any of the plurality of determination information JC. Therefore, the quality information C1, C2, C3, and C4 is determined by comparison with a plurality of pieces of determination information JC. Further, the detection unit 35 detects, as coordinates, the pixel where each of the four pieces of quality information C1, C2, C3, and C4 is located.

  As described above, the detection unit 35 is information that is located around the end point of the leader line D and on the extension line of the leader line D, and is similar to any of the plurality of pieces of judgment information JC registered in advance. Is detected as quality information C. In this case, only information that is highly likely to be quality information can be selectively detected, so that the quality information C detection process is simplified.

  As shown in FIG. 9, lead lines D1, D2, D3, and D4 are detected by the detection unit 35 in the fifth step S105. These lead lines D1, D2, D3, and D4 are all similar to any of the plurality of determination information JD. For this reason, leader lines D1, D2, D3, and D4 are determined by comparison with a plurality of pieces of determination information JD.

  In the fifth step S105, the leader line end points E1, E2, E3, and E4 are detected by the detecting unit 35. These leader line end points E1, E2, E3, and E4 are all similar to any of the plurality of determination information JE. Therefore, leader line end points E1, E2, E3, and E4 are determined by comparison with a plurality of pieces of determination information JE. Moreover, the detection part 35 detects the pixel in which each of these leader line end points E1, E2, E3, and E4 is located as a coordinate.

  As shown in FIG. 10, since one of the leader line end points E1 on both sides of the leader line D1 is located in the inner area Sa surrounded by the outline Wa, it is recognized as the starting point E1a of the leader line D1. The On the other hand, since the other of the leader line end points E1 on both sides of the leader line D1 is located in the outer area Sb of the outline Wa, it is recognized as the end point E1b of the leader line D1.

  Similarly, one of the leader line end points E2 on both sides of the leader line D2 is recognized as the start point E2a of the leader line D2, and the other is recognized as the end point E2b of the leader line D2. Further, one of the leader line end points E3 on both sides of the leader line D3 is recognized as the start point E3a of the leader line D3, and the other is recognized as the end point E3b of the leader line D3. Further, one of the leader line end points E4 on both sides of the leader line D4 is recognized as the start point E4a of the leader line D4, and the other is the end point E4b of the leader line D4.

  In this way, the end points on both sides of the leader lines D1, D2, D3, and D4 are set to the start points E1a, E2a, E3a, and E4a depending on whether the end points are in the inner region Sa or the outer region Sb of the contour Wa of the component W. And the end points E1b, E2b, E3b, E4b can be easily distinguished. Thereby, the detection accuracy of the starting point coordinates P1, P2, P3, and P4 of the leader lines D1, D2, D3, and D4 can be increased.

  Further, the detection unit 35 uses the pixel coordinates of the start points E1a, E2a, F3a, and E4a of the lead lines D1, D2, D3, and D4 as the start point coordinates P1 (x1, y1), P2 (x2, y2), and P3 (x3, y3). ), P4 (x4, y4). On the other hand, the origin coordinate P0 (x0, y0) is set in advance for the contour Wa of the component W, and information relating to the origin coordinate P0 is stored in the storage unit 37. The position of each part of the inner area Sa of the contour Wa is specified with reference to the origin coordinate P0. For this reason, the point indicated by the start points E1a, E2a, F3a, E4a can be specified by detecting the start point coordinates P1, P2, P3, P4.

  In this case, the starting point E1a of the leader lines D1, D2, D3, and D4 is based on the relative positional relationship between the contour Wa of the component W and the starting points E1a, E2a, F3a, and E4a of the leader lines D1, D2, D3, and D4. , E2a, F3a, E4a can be detected. For this reason, even when the layout of the contour ring Wa on the recording paper 10 is changed due to a change in the format or the like, the starting points E1a, E2a, F3a, E4a of the leader lines D1, D2, D3, D4 are set by using the origin coordinates P0 as a reference. Can be easily detected.

  As shown in FIG. 11, in the fifth step S <b> 105, the indication information F <b> 1 and F <b> 3 is detected by the detection unit 35. These indication information F1 and F3 are both similar to any of the plurality of determination information JF. For this reason, indication information F1 and F3 are determined by comparison with a plurality of pieces of determination information JF. The detection unit 35 detects the pixel coordinates of the start point E1a surrounded by the indication range F1 as the coordinates of the indication range F1, and detects the pixel coordinates of the start point E3a surrounded by the indication range F3. Detect as coordinates.

  Here, as shown in FIG. 12, when the detection unit 35 detects the indication ranges F1 and F3 surrounding the start points of the lead lines D1 and D3 as the inspection result information B, these indication ranges are determined as F1 and F3. It is preferable to output the paint color image data Id painted in a predetermined color.

  Thus, the worker U outputs the quality information C1 by outputting the paint color image data Id in the state in which the indication ranges F1 and F3 surrounding the start points of the lead lines D1 and D3 are painted to the output device 40 or printing them out. , C3 is easy to visually recognize which indication range is targeted.

  In the fifth step S105, the detection unit 35 is configured to output text data T1 and T3, which will be described later, indicating the size of the indication ranges F1 and F3 in association with the quality information C1 and C3. Thereby, the user U can grasp the size of the indication range F1 corresponding to the leader line D1 and the size of the indication range F3 corresponding to the leader line D3 based on the output text data T1 and T3. .

  As shown in FIG. 13, the text data T1 is a range radius r1 corresponding to the maximum distance between the centroid G1 of the indicated range F1 and the separation point H1 farthest from the centroid G1 in the indicated range F1. . This range radius r1 corresponds to the radius of the virtual circle V1 with the center of gravity G1 as the center point. Thereby, the user U can easily grasp the size of the indication range F1 from the value of the range radius r1.

  Similarly, as shown in FIG. 14, the text data T3 includes a range radius corresponding to the maximum distance between the center of gravity G3 of the indicated range F3 and the separation point H3 farthest from the center of gravity G3 in the indicated range F3. r3. This range radius r3 corresponds to the radius of the virtual circle V3 with the center of gravity G3 as the center point. Thereby, the user U can easily grasp the size of the indication range F3 from the value of the range radius r3.

  As the text data T1, the area of the virtual circle V1 may be output instead of or in addition to the range radius r1. Similarly, instead of or in addition to the range radius r3, the area of the virtual circle V3 may be output as the text data T3.

  In the sixth step S106, information handwritten in each of the three regions A2, A3, A4 is detected as text data by the detection unit 35. As a result, text data indicating “vehicle number”, “paint color”, and “date” is obtained for the vehicle corresponding to the current recording sheet 10.

  Here, as shown in FIG. 7, “0” to “9” are stored in the storage unit 37 as determination information JG for determining information handwritten in each of the three regions A2, A3, and A4. ”, Alphabets from“ A ”to“ Z ”,“ / ”and“ # ”symbols are registered in advance. For this reason, for example, for information handwritten in the area A2, the detection unit 35 divides the information in the area A2 character by character, and selects information similar to each character from the determination information JG. Thereby, the information handwritten in each of the three areas A2, A3, A4 can be determined with high accuracy.

  In the seventh step S107, the quality information C1, C2, C3, C4 detected in the fifth step S105 is converted into text data linked to the start point coordinates P1, P2, P3, P4 of the lead lines D1, D2, D3, D4. This is a conversion step. The seventh step S107 is executed by the conversion unit 36 of the processing device 30. According to the seventh step S107, text data in which quality information C1, C2, C3, and C4 are stored in a database is output.

  As shown in FIG. 15, the text data TD is information in which the information detected in step S105 and step S106 in FIG. 4 is databased in the seventh step S107. As an example, a case where a plurality of combinations of indication information and quality information are described for three vehicle bodies having the same car number from T-A001 to T-A003 and the same paint color as CL-01 is shown. Yes.

  In this text data TD, the character data “suke” indicating the quality information C1 includes the symbol “K1” indicating the position of the starting point E1a of the leader line D1 (pointed point Q1) and the value of the range radius r1 of the pointed point Q1. "A" to be shown is linked. Further, the character data “sag” indicating the quality information C2 is associated with the symbol “K2” indicating the position of the start point E2a of the leader line D2 (pointed point Q2). In addition, in the character data “butsu” indicating the quality information C3, a symbol “K3” indicating the position of the starting point E3a of the leader line D3 (pointed point Q3) and “b” indicating the value of the range radius r3 of the pointed point Q3. And are linked. Further, the character data “wrinkle” indicating the quality information C4 is associated with the symbol “K4” indicating the position of the start point E4a of the leader line D4 (pointed portion Q4). In this way, the inspection result indicating which part of the vehicle body 2 is pointed out is converted into text data.

  Note that the data output conditions such as the format of the text data TD, the contents and number of items are not limited to those shown in FIG. 13, and can be changed as needed. For example, instead of a form in which the pointed out part is represented by a combination of alphabets and numbers, it can be represented using kanji, hiragana or katakana. Moreover, it can replace with the form which describes quality information in katakana, and can also display using one or more of a Chinese character, a hiragana, an alphabet, and a number.

  The eighth step S108 is a step of storing the text data TD (see FIG. 13) obtained in the seventh step S107. The text data TD is temporarily stored in the storage unit 37 and then sent to the server 50 and saved as needed. The stored text data TD is read from the server 50 as necessary, processed into a desired data format, and used for analysis for vehicle body quality maintenance management and vehicle body production line evaluation.

  According to the first embodiment described above, the following operational effects can be obtained.

  In the management system 1 described above, handwritten image data Ic corresponding to the inspection result information B is extracted from the first image data Ia of the recording paper 10 on which the inspection result information B is handwritten with respect to the contour Wa of the component W. Extracted in From the handwritten image data Ic, the start point coordinates P1, P2, P3, P4 of the lead lines D1, D2, D3, D4 and the quality information C1, C2, C3, C4 are detected by the detection unit 35. The detected quality information C1, C2, C3, and C4 is converted into text data TD associated with the start point coordinates P1, P2, P3, and P4 by the conversion unit 36.

  Here, all the lead lines D1, D2, D3, and D4 are lines drawn from the outline Wa of the component W. Therefore, by detecting the start point coordinates P1, P2, P3, and P4 of the start points E1a, E2a, E3a, and E4a that are the leaders of the lead lines D1, D2, D3, and D4, the lead lines P1, P2, P3, and P4 are detected. It can be recognized which point indicated by P4 in the component W of the vehicle body. In addition, product type information C1, C2, C3, and C4 are handwritten at peripheral positions of the end points E1b, E2b, E3b, and E4b that are the destinations of the lead lines D1, D2, D3, and D4. Therefore, the specific contents of the inspection result can be recognized by detecting the product information C1, C2, C3, C4.

  Then, the text coordinates TD obtained by converting the start point coordinates P1, P2, P3, P4 of the lead lines D1, D2, D3, D4 and the product information C1, C2, C3, C4 into data are obtained. Thereby, it becomes clear which quality information C1, C2, C3, C4 is information about which position of the outline Wa of the component W, that is, which inspection point is the inspection result. For this reason, it becomes possible to comprehensively manage the inspection results for a plurality of vehicle bodies based on the text data TD. In this case, it is effective to keep the man-hour required for data input low compared with the case where data handwritten on the recording paper 10 is converted into data by manual input.

  As described above, according to the first embodiment, the vehicle body information management technique (the vehicle body information management system 1 and the vehicle body information management method) that enables the inspection result information B handwritten on the recording sheet 10 to be converted into text data in association with the indicated location. Can be provided.

  Hereinafter, another embodiment related to the first embodiment will be described with reference to the drawings. In other embodiments, the same elements as those of the first embodiment are denoted by the same reference numerals, and the description of the same elements is omitted.

(Embodiment 2)
The management system 1A according to the second embodiment (see FIG. 1) is different from the management system 1 according to the first embodiment only in the method in which the detection unit 35 detects each leader line D in the fifth step S105 in FIG. ing.
Other configurations are the same as those of the first embodiment.

  As illustrated in FIG. 16, the detection unit 35 extracts the contour line La of the detection body Da by image processing. Thereafter, the detection unit 35 obtains a quadrangle Lb that approximates the contour line La. And the detection part 35 determines whether the detection body Da is the leader line D based on the dimension of the rectangle Lb.

  In this determination, the detection unit 35 pays attention to the aspect ratio (aspect ratio) of the quadrangle Lb, and when the ratio (d2 / d1) of the short side dimension d2 to the long side dimension d1 is below the threshold value, the detection body Da. Or a method for determining that the detection body Da is the leader line D when the dimension d1 of the long side of the rectangle Lb exceeds the threshold value can be employed. Thereby, the elongated detection body Da is determined as the leader line D, and the detection bodies Da of other shapes are not determined as the leader line D.

According to the second embodiment, even when there is no information similar to the leader line D in the plurality of determination information JD (see FIG. 7) of the first embodiment, the leader line D can be detected. For this reason, the determination accuracy of the leader line D can be increased.
In addition, the same effects as those of the first embodiment are obtained.

  The present invention is not limited only to the above-described embodiments, and various applications and modifications can be considered without departing from the object of the present invention. For example, the following embodiments applying the above-described embodiment can be implemented.

  In the above-described embodiment, the case where the quality information C, the leader line D, the leader line end point E, and the indication range F are individually detected in the fifth step S105 in FIG. 4 is exemplified. Only the quality information C and the start point coordinates P1, P2, P3, and P4 may be detected as the minimum information necessary for creating the text data.

  In the above-described embodiment, the case where the start point coordinates P1, P2, P3, and P4 are detected based on the origin coordinate P0 of the contour Wa of the component W is illustrated, but instead, based on the origin coordinates of the recording paper 10. The starting point coordinates P1, P2, P3, and P4 may be detected.

  In the above-described embodiment, the case where the information that is located around the end point of the leader line D and is on the extension line of the leader line D is detected as the quality information C is exemplified, but instead or in addition, Even if the information is not on the extension line of the leader line D, if the information is located around the end point of the leader line D, for example, information within a specified range from the end point of the leader line D can be detected as the quality information C. .

  In the above-described embodiment, the case where the quality information C is determined by comparison with the determination information JC is exemplified, but instead, the quality information C may be directly detected without using the determination information JC. Good.

  In the above-described embodiment, the thin recording paper 10 is used as the handwritten recording medium. However, the thickness, size, material, and the like of the handwritten recording medium to be used can be changed as appropriate.

  In the above-described embodiment, the management system 1 effective for managing the inspection result information of the painting process of the vehicle body production line has been exemplified. However, the management system 1 is not only applied to the painting process of the vehicle body production line, It can also be used to manage inspection result information in various production processes such as an assembly process and an inspection process.

1,1A Body information management system (management system)
2 Car body 10 Recording paper (handwriting recording medium)
20 Image Input Device 31 Data Acquisition Unit 34 Extraction Unit 35 Detection Unit 36 Conversion Unit B Inspection Result Information C, C1, C2, C3, C4 Quality Information D, D1, D2, D3, D4 Leader E, E1, E2, E3 , E4 Lead line end point E1a, E2a, E3a, E4a Start point E1b, E2b, E3b, E4b End point F, F1, F2, F3, F4 Pointing range G1, G3 Center of gravity H1, H3 Separation point I Image data Ia First image data Ib Second image data Ic Handwritten image data Id Painted color image data JC Information for determination P0 Origin coordinates P1, P2, P3, P4 Start point coordinates r1, r3 Range radius Sa Inner region T1, T3, TD Text data W Component element Wa Contour S104 Fourth step (extraction step)
S105 5th step (detection step)
S107 7th step (conversion step)

Claims (12)

A vehicle body information management system for managing information related to vehicle body inspection results,
An extraction unit for extracting handwritten image data corresponding to the inspection result information from image data of a handwritten recording medium in which inspection result information including leader lines and quality information is handwritten with respect to the contour representing the components of the vehicle body; ,
Detection for detecting the start point coordinates of the leader line drawn from the contour and the quality information located around the end point of the leader line in the inspection result information of the handwritten image data extracted by the extraction unit And
A conversion unit that converts the quality information detected by the detection unit into text data associated with the start point coordinates of the leader line;
A vehicle body information management system. The origin coordinates of the contour in the handwritten recording medium are stored in advance,
The vehicle body information management system according to claim 1, wherein the detection unit detects the start point coordinates of the leader line based on the origin coordinates.   The vehicle body information management system according to claim 1, wherein the detection unit detects information on an extension line of the leader line as the quality information.   The vehicle body information management system according to any one of claims 1 to 3, wherein the detection unit detects information similar to any of a plurality of pieces of determination information registered in advance as the quality information.   The said detection part detects the coordinate of one leader line end point located in the inner area | region enclosed by the said outline among the leader line end points of the both sides of the said leader line in the said handwritten image data as said starting point coordinate. Vehicle information management system given in any 1 paragraph of -4.   The extraction unit uses the image data as the first image data, and the image data of the handwriting recording medium before the inspection result information is handwritten on the contour as the second image data. The said handwritten image data is extracted from said 1st image data as a foreground with respect to said 2nd image data by the process which background-differs said 2nd image data from 1 image data. Car body information management system. The test result information is handwritten in a color different from the contour on the handwritten recording medium,
The extraction unit, when extracting the handwritten image data from the first image data, identifies and extracts the handwritten image data based on a color difference from the second image data corresponding to the contour. The vehicle body information management system according to claim 6.   The detection unit detects an indication range surrounding the start point of the leader line as the inspection result information, and outputs text data indicating the size of the indication range in association with the quality information. The vehicle body information management system according to any one of the above.   The detection unit, as the text data indicating the size of the indication range, a range radius corresponding to the maximum distance between the center of gravity of the indication range and a separation point farthest from the center of gravity in the indication range The vehicle body information management system according to claim 8, which outputs the vehicle information management system.   The image input device for inputting the image of the handwritten recording medium, and the image input device is connected to a data acquisition unit so as to be able to transmit the image data. Body information management system described.   The vehicle body information management system according to claim 10, wherein the image input device is disposed at each of a plurality of inspection points in a vehicle body production line. A vehicle body information management method for managing information on inspection results of a vehicle body,
An extraction step of extracting handwritten image data corresponding to the inspection result information from image data of a handwritten recording medium in which inspection result information including a leader line and quality information is handwritten with respect to the contour representing the components of the vehicle body; ,
Detection step of detecting the start point coordinates of the leader line drawn from the contour and the quality information located around the end point of the leader line in the inspection result information of the handwritten image data extracted in the extraction step When,
A conversion step for converting the quality information detected in the detection step into text data associated with the start point coordinates of the leader line;
Including vehicle body information management method.

Images