JP7054423B2 - Period arithmetic unit and period arithmetic program. - Google Patents

Description

The present invention relates to a period calculation device and a period calculation program for determining damage to an article from a photographed image and calculating a period for repairing or repairing the article .

In recent years, Internet sales sites dealing with reused products have been expanding, and the trading market for reused (used) products such as used clothing, books, video software, and furniture has become active. The rise in the second-hand goods market is not simply due to the low prices of products, but also the growing consumer awareness of reduce, reuse, and recycle to reduce the environmental burden. Involved. And, in the market of such second-hand goods, it is also practiced to repair and sell the failed part. In the commercial transaction of second-hand goods, information on whether or not the repair is possible and the cost required for the repair is indispensable.

Conventionally, the use of photographic images has been considered for determining the faulty part. For example, in Patent Document 1 (Japanese Unexamined Patent Publication No. 2002-149866), an electronic image of a defective device among the devices used by a user and a defective device attribute information indicating the attribute of the defective device are used. , Techniques for dealing with various defects of the equipment used by the user have been proposed. That is, the captured image received by the server is binarized to determine the outer shape of the shooting device, and the matching process is performed with the external shape data of the device held in the device management DB, and the device is presumed to correspond to the defective device. A technique has been proposed in which a user or a server operator identifies a defective device from the selected device by displaying the selected device, a photographed image from the user, and device attribute information.

Further, a technique for determining defects such as defects using photographs has been proposed in Patent Document 2 (Japanese Unexamined Patent Publication No. 2002-240953). In this document, in order to detect a defect that occurs during product transportation, a pre-transport image information receiving means that receives pre-transport image information (pre-transport image information) transmitted from the terminal device and transmission from the terminal device. Is there a problem with product transportation based on the post-transport image information receiving means that receives the image information (post-transport image information) of the product after transportation, the pre-transport image information, and the post-transport image information? We are proposing a server device equipped with a determination means for determining whether or not the image is present.

The buying and selling of second-hand goods has traditionally been widespread in the automobile field. Therefore, also in the field of automobiles, a technique for analyzing damage based on a photographed image has been proposed. For example, in Patent Document 3 (Japanese Unexamined Patent Publication No. 2006-85270), as an image analysis system capable of analyzing deformation caused by an accident of a vehicle photographed by a mobile terminal, the object ID of the object to be photographed and the object ID are described. A data table that stores wire frame data that expresses the outline of the three-dimensional figure of the target object corresponding to the above with mesh-like lines, an image taken with reference to the wire frame data stored in the data table, and stored in the data table. An image analysis system including a database server that compares with the obtained wire frame data and identifies an area where there is a difference between the two data has been proposed.

Japanese Unexamined Patent Publication No. 2002-149866 Japanese Patent Application Laid-Open No. 2002-240953 Japanese Unexamined Patent Publication No. 2006-85270

In the conventional method of determining a defect, damage, discoloration, etc. using a photographed image, it is necessary to identify a defect, damage, or discolored article in advance in order to compare images. Therefore, when there is no knowledge about the damaged article and it is difficult to identify the damaged article, it is not possible to determine the defect, damage, discoloration, etc. even if the photographed image is used. Therefore, it is an object of the present invention to provide a damage determination device capable of determining a defect, damage or color of an article by artificial intelligence.

The present invention provides a damage determination device that uses artificial intelligence to determine at least one of a defective part, a damaged part, a degree of damage, and a color of a damaged article, at least in order to solve the above-mentioned problems. It is a thing.

In one embodiment of the present invention, a damage determination device for determining a defect, damage, or color of an article based on a photographed image, a photographed image data acquisition means for acquiring photographed image data, and an acquired photographed image. Provided is a damage determination device provided with an image determination means for analyzing data by artificial intelligence executed by a computer and determining at least one of a defective part, a damaged part, a degree of damage, and a color of the photographed article. do.

In such a damage determination device, the image determination means includes artificial intelligence executed by a computer, and the artificial intelligence performs an image search based on captured image data to identify an article to be photographed. By acquiring an image of a legitimate article having a reference shape and color of the specified article and comparing the image of the legitimate article with the photographed image data, the photographed article is defective or damaged. It can be configured to determine at least one of location, degree of damage and color.

Further, the damage determination device may further include an imaging guide means for transmitting imaging guide information for guiding the imaging method to the imaging means located outside the damage determination device.

Further, the image of the regular article may be a plurality of images of the regular article taken from a plurality of directions, or an image of a plurality of colors for the regular article.

Further, in another embodiment of the present invention, the period / schedule calculation device for calculating the period or schedule for repairing or repairing an article, the damage determination device according to the embodiment of the present invention, and the damage determination device. Provided is a period / schedule calculation device comprising a calculation means for acquiring a judgment result of an image judgment means and calculating at least one of a period and a schedule for repairing or repairing a defect, damage or color of a photographed article. ..

Further, in another embodiment of the present invention, it is a repair / repair cost calculation device for calculating the cost of repairing or repairing an article, and the damage determination device according to the embodiment of the present invention and the image in the damage determination device. The parts man-hour extraction means and the parts man-hour extraction means for extracting at least one of the parts and man-hours required for repairing or repairing the defect, damage or color of the photographed article by acquiring the judgment result of the judgment means, and the parts man-hour extraction means. Provided is a repair / repair cost calculation device, which is a repair cost estimation means for integrating the extraction results.

Further, in another embodiment of the present invention, the integrated result in the repair / repair cost calculation device according to the other embodiment of the present invention, which is at least a used product sales system for selling damaged, defective or broken articles, is obtained. Provided is a second-hand goods sales system provided with a repair cost output means for displaying the price of the goods.

In one aspect of the present invention, it is possible to provide a damage determination device capable of determining a defect, damage or color of an article by artificial intelligence.

Overall configuration diagram showing the processing contents of the damage determination device according to this embodiment A sequence diagram showing the processing of the damage judgment device, the period / schedule calculation device, and the repair / repair cost calculation device. Screen transition diagram showing the flow of the article selection process Schematic diagram showing image search processing in artificial intelligence Schematic diagram showing the process of determining the presence or absence of damage and the degree of damage in artificial intelligence Schematic diagram showing the sales screen of used parts Display screen of calculation result by period / schedule arithmetic unit A block diagram showing the configuration of the damage determination device according to the present embodiment. A block diagram showing a configuration of a period / schedule arithmetic unit according to this embodiment. A block diagram showing the configuration of the repair / repair cost calculation device according to the present embodiment. Computer hardware configuration diagram

Hereinafter, the damage determination device 30 according to the present embodiment, the repair / repair cost calculation device 50 and the period / schedule calculation device 40 using the damage determination device 30 will be specifically described with reference to the drawings. In particular, the present embodiment is mainly described for commercial transactions of used parts of automobiles, but other articles can also be targeted. Further, the embodiments may be appropriately modified without departing from the gist of the present invention.

FIG. 1 is an overall configuration diagram showing the processing contents of the damage determination device 30 according to the present embodiment. As shown in FIG. 1, the damage determination device 30 according to the present embodiment is configured to transmit and receive various information by using the Internet or other information network 520. Specifically, a photographed image of the article transmitted from the first user 11 such as the seller or the owner of the article to be judged (hereinafter referred to as "target article 10") is acquired and acquired. The captured image is used to search for information existing on the information net, and the target article 10 is inspected for at least one of the presence / absence of defects, the presence / absence of damage, the degree of damage, and the color (for example, discoloration). .. If there is a defect, damage, or discoloration, the defect, the damaged part, the degree of damage, or the discoloration is determined.

In order to start a series of processes according to the present embodiment, it is necessary to first acquire an image (photographed image) of the article. The captured image may be acquired via a network from a terminal such as a computer, in addition to acquiring an image captured by a camera-equipped mobile phone via the network. Further, the photographed image acquired by the damage determination device 30 may be a photographed image published on the Internet, for example, an image registered in an e-commerce site (for example, a second-hand goods trading site). This is because second-hand goods are listed as products, and if they are damaged, you may want to know the degree and repair costs.

When acquiring the photographed images of various articles as described above, the photographed image data acquired by the photographed image data acquisition means 32 needs to be photographed at least one of a defective part, a damaged part, a degree of damage, and a color of the article. There is. This is because the damage determination device 30 according to the present embodiment determines these based on the captured image.

Further, the target article 10 is photographed by the first user 11 and transmitted to the damage determination device 30. The first user 11 may be an owner or a seller of the target article 10, and may be, for example, an individual, a seller or a purchaser of a used product (part or finished product), or the like. These first users 11 can shoot the target article 10 using a camera-equipped mobile phone or a camera, and use a terminal such as a camera-equipped mobile phone or a computer to capture the shot image in information communication such as the Internet. It can be transmitted to the damage determination device 30 via the network.

The photographed image data acquired by the above processing is analyzed by an artificial intelligence 33 executed by a computer in the image determination means, and at least one of the defective part, the damaged part, the damage degree and the color of the photographed article is determined. Will be done.

For determination of at least one of a defective part, a damaged part, a degree of damage, and a color of an article executed by the artificial intelligence 33 of the image determination means, for example, the artificial intelligence 33 performs an image search based on captured image data. , It is possible to execute after identifying the article to be photographed. Then, an image of a genuine article having a shape or color that serves as a reference for the article is acquired for the specified article, and this is compared with the acquired photographed image data (photographed image data showing damage or the like). By doing so, it is possible to determine at least one of the defective part, the damaged part, the degree of damage and the color of the photographed article. As a result, it is possible to solve the problem of improving the accuracy and realizing the automation process by using the artificial intelligence 33.

The image search by the artificial intelligence 33 can target data stored in a computer connected by a network 520 (including the Internet and an intranet). Further, when the damage determination device 30 is accompanied by a database, the database can be targeted. In this image search, in addition to directly acquiring an image of an article in a normal state having a reference shape or color of the article to be searched, the name and model of the article are acquired by image search, and based on this name and model. Therefore, it can be configured to extract the article image in the normal state. Here, the reference shape is a shape without damage or damage, and the reference color can be a color that has not been discolored. Then, the image of the article in the normal state should be configured so as to focus on the reference shape when judging damage or defect, and to focus on the reference color when judging the color. Can be done. As a matter of course, in the image search, it is possible to pay attention to both the reference shape and the color and to acquire the article image in the normal state.

The above-mentioned information on the presence or absence of defects or damage, its location, degree, or color is stored in the storage means provided in the damage determination device 30 together with the information for identifying the target article 10. As a result, the second user 21, such as a purchaser or an insurer, accesses the damage determination device 30, searches for the target article 10, and uses the target article 10 as information for defects or damages related to the target article 10. It is also possible to obtain information on the presence / absence, its location and degree, or color.

In the damage determination device 30 according to the present embodiment, as the target article 10, FIG. 1 shows electrical appliances such as electric fans, furniture such as chairs, automobiles, and automobile parts, but the objects are limited thereto. Instead, it is possible to target various articles having a certain form.

That is, the damage determination device 30 according to the present embodiment can be used for various articles having a certain shape such as daily necessities, furniture, electric appliances, vehicles, aircrafts, and ships. However, when the captured image is an image obtained by capturing visible light, it is necessary to determine damage to the shape, structure, or color that can be seen from the outside. On the other hand, when the photographed image is an image of light transmitted through an article such as X-rays, it is possible to determine damage not only on the appearance but also on the internal structure. Furthermore, in the case of an image taken using light having a certain wavelength such as ultraviolet light or infrared light, or electromagnetic waves having directivity such as laser light, the surface roughness is invisible. Damage can be judged for the characteristics.

FIG. 2 is a sequence diagram showing an example of processing contents in the damage determination device 30, the period / schedule calculation device 40, and the repair / repair cost calculation device 50. As shown in this figure, the process by the damage determination device 30 can be started by the "use request transmission" step S1 from the first user 11. In particular, in this embodiment, the photographic image is configured to be uploaded in a conversational format with the damage determination device 30, but in addition, the photographic image may be configured to be attached to an e-mail and transmitted. good. Further, when the access request is made from the first user 11, user authentication or the like can be performed. In particular, by registering as a user, or at least registering a reply e-mail address, the damage determination device 30 transmits a unique reception ID to the terminal of the first user 11 when the transmitted photographed image is received. I can do things.

When the damage determination device 30 receives the usage request transmitted from the first user 11 (use request transmission step S1), the damage determination device 30 selects and damages the target article 10 in the "article selection, damage portion selection, shooting direction instruction" step S2. It is possible to request input such as selection of a portion, and further provide instruction information of an imaging direction based on the input information to the first user 11. However, the request for use in step S2 is not always required, and this can be omitted. For example, the damage determination device 30 can start the process by transmitting the captured image from the first user 11. In this case, the first user 11 can be specified by the e-mail address to which the image is sent. In the case of the damage determination device 30 that simply receives a photographic image and starts processing without requiring the selection of the target article 10, the target article 10 is photographed and photographed simply by transmitting the photograph. The artificial intelligence 33 executed by the damage determination device 30 can determine whether or not the target article 10 is missing or damaged, its location and degree, or discoloration, and the knowledge about the target article 10 in the first user 11 can be determined. It can be made unnecessary and the trouble of selecting an article can be omitted.

FIG. 3 is a screen transition diagram showing the flow of the article selection process in the process content shown in FIG. 2. As shown in this figure, in the present embodiment, the terminal operated by the first user 11 is configured to select an article. In particular, in the selection of this article, the target article 10 such as "automobile", "electrical appliances", "furniture", "exercise equipment", "fishing gear", "clock", "bicycle", "ship", etc. Is classified by a large concept, and it is not necessary to specify detailed items such as manufacturer and model in each classification. Then, after selecting the target article 10, the terminal of the first user 11 is displayed with a damaged portion selection screen for identifying a portion having a defect, damage, or discoloration. This damaged part selection screen is configured so that a defective or damaged part can be identified by displaying an item that can be a damaged part corresponding to the article selected on the article selection screen. In particular, in FIG. 3, when an automobile is selected, the damaged parts are displayed as "front", "rear", "right side", "left side", etc. corresponding to the automobile. ing.

Then, after the category of the target article 10 is selected in this way and the defective or damaged portion thereof is identified, the photographing direction of the target article 10 is extracted by the photographing guide means 35 based on this information, and the first method is taken. Displayed on the terminal of user 11. As a result, the first user 11 can shoot the target article 10 according to the shooting direction instruction screen in the "photographing" step S3, and shoot from all the designated directions.

The shooting guide means 35 functions to transmit shooting guide information for guiding the shooting method to the shooting means (located outside the damage determination device 30) for shooting an image. This is because when taking a picture of a defect or damage of various articles, the picture may differ depending on the method of taking the picture. The photographing guide means 35 provides an explanation and a photographing frame for displaying which part, from which direction, and in what size, for each article to be photographed, and for each defective or damaged part of the article. Etc. can be configured to be transmitted as shooting guide information. In addition, it is also possible to transmit information for controlling a photographing mechanism such as a lens or a shutter in the photographing apparatus for photographing the target article 10 as photography guide information, and control the photographing device for photographing the object article 10. .. Thereby, even when various articles are targeted, the problem of being able to take an image suitable for the articles can be solved.

By transmitting the photographing guide information to the photographing means, it is possible to acquire the optimum photographed image for each article to be photographed, or for each position and degree of defect or damage. Therefore, the accuracy of analysis in the artificial intelligence 33 can be improved.

As described above, after the shooting is completed under the instruction of the shooting guide means 35, the plurality of shot images are transmitted to the damage determination device 30 in the “shooting image transmission” step S4. The processing of selecting an article, the processing of selecting a damaged part, and the processing of instructing an imaging direction can be performed interactively with the damage determining device 30, as shown in FIG. 2, but in addition, for example, It can also be executed by processing by the application installed in the terminal operated by the first user 11.

As described above, when the captured image is transmitted from the terminal on the first user 11 side to the damage determination device 30, the damage determination device 30 receives the captured image in the “captured image reception” step S5. Then, the feature portion of the captured image is extracted in the "feature portion extraction" step S6, and the feature portion of the captured image is used as a search key to perform an image search on an image database holding a plurality of image data or on the Internet. The execution of such an image search can be performed by the artificial intelligence 33 executed by the damage determination device 30 including a computer. The image retrieval by the artificial intelligence 33 is performed by the CBIR (Content Based Image Retrieval) method, which is a similar image retrieval technique for determining the similarity using various feature quantities such as the color, shape, texture, and feature points of the captured image. In addition, it can be performed by the TBIR (Text Based Image Retrieval) method in which text data is associated with an image and searched based on the text, or the combined use of the CBIR method and the TBIR method. Of course, it is also possible to use other image search methods.

The image database can be constructed as a database that holds a plurality of images (hereinafter referred to as "pseudo images") of the target article 10 in different directions, colors, and the like. For example, if the target article 10 is a bumper of an automobile, it can be composed of images viewed from various directions such as up, down, left, right, or diagonal directions, and can be further composed of images of various patterns having different colors. In addition to being created by the damage determination device, such a pseudo image can also be created by distributed computing using another computer existing on an information communication network such as the Internet. In particular, by using distributed computing, the throughput can be improved and various pseudo images can be efficiently created.

FIG. 4 is a schematic diagram showing an image search process in the artificial intelligence 33. As shown in this figure, the terminal operated by the first user 11 transmits a photographed image of the target article 10 having a defect, damage, or the like to the damage determination device 30. In the damage determination device 30, in the "article search / extraction" step S7, the artificial intelligence 33 searches for an image similar to the transmitted image. At this time, the image extracted by the search is an image without damage (having a reference shape and color of the specified article). Extraction of such an undamaged image can be performed by searching for a plurality of images of the same type and then identifying the image having the most common points with the image transmitted from the first user 11. In this figure, an image having a common feature such as a contour, a window shape, and a position and shape of a doorknob is extracted from the target article 10. In particular, in this "article search / extraction" step S7, after constructing an image database holding the plurality of pseudo images, the captured images received in the "captured image reception" step S5 for the image database are used. By performing an image search, it is possible to extract a undamaged image more quickly and accurately.

As described above, after searching and extracting an undamaged image (an image of a genuine article having a reference shape or color of the article) in the target article 10 based on the photographed image of the target article 10, " In the “damaged portion extraction” step S8, the presence or absence of damage to the captured image and the degree of damage are compared and determined. FIG. 5 is a schematic diagram showing a process of determining the presence or absence of this damage and the degree of damage. In the present embodiment, the presence / absence of damage and the location / degree of damage are extracted by comparing the image extracted by the image search process with the photographed image of the target article 10 transmitted from the first user 11. You can judge. In the present embodiment, by comparing both images, it can be determined that the target article 10 has a recessed door panel portion. Such a determination can be made by the damage determination device 30 as shown in FIG.

Then, the damage determination device 30 can calculate the cost for repairing or repairing the defective part, the damaged part / damage degree, and at least one of the discoloration of the article. The calculation of the repair cost can be performed by the repair / repair cost calculation device 50 configured by using the damage determination device 30.

For example, when distributing second-hand goods (including parts; the same shall apply hereinafter), they may be traded in a state of being damaged or damaged, and if the user is not concerned about the loss or damage of the goods, or the transaction is applicable. In some cases, parts are taken out from an article and used. Therefore, in the present embodiment, it is an object to provide a repair / repair cost calculation device for calculating the cost required for repairing or repairing a defect, damage, or color of a photographed article, and to solve the problem. Further, it is possible to provide a repair / repair cost calculation device for calculating the cost required for repairing or repairing a defect, damage or color of a photographed article.

In the "repair cost calculation" step S9, the repair / repair cost calculation device 50 is based on at least one of the determination results of the defective part, the damaged part, the degree of damage, and the color of the article extracted / determined by the damage determination device 30. , The parts man-hour extraction means can be configured to extract the parts and man-hours required for repairing or repairing the article. In particular, when the target article is a vehicle or a vehicle part (outer plate or the like) and the determination result of the damage determination device 30 is damage such as dent, discoloration or scratch, in the "damaged portion extraction" step S8. The degree of the damage can also be specified by artificial intelligence, and the "repair cost calculation" step S9 can be executed after considering the degree of the damage.

Where it is necessary to select replacement parts and repair materials and calculate work man-hours when calculating damage repair costs, this is equipped with the damage judgment device 30 or a parts / man-hour database that can be configured as an external database. This can be done by the component man-hour extraction means 51. Then, the price and wage of the extracted parts can be calculated by the repair cost estimation means 52 based on the respective prices and costs. The selection of such replacement parts and repair materials can be performed by the operation of the operator, but can also be performed by the processing by the artificial intelligence 33.

Conventionally, the repair cost and work man-hours are calculated by the operator specifying the damaged part, damaged range, and degree in the estimation program using a pointing device such as a mouse on the screen or inputting from the keyboard. However, for that purpose, for example, it was a prerequisite to specify vehicle information in advance (see, for example, Japanese Patent Application Laid-Open No. 10-329664). On the other hand, according to the present embodiment, since the similar image is discriminated from the captured image, the vehicle information can be automatically acquired.

When the repair cost estimation means 52 integrates the extraction result of the parts man-hour extraction means 51, the value obtained by multiplying the man-hours by a certain value is integrated as the wage, and for the parts, the unit price of the parts is multiplied by the required number. The value can be integrated as the parts cost.

After calculating the presence or absence of damage and the repair cost (parts cost / wage) for the target article 10 as described above, this information is displayed on the sales site as one item of the transaction information of the target article 10. You can do it (“Posting on sales site” step S10). FIG. 6 is a schematic diagram showing a sales screen of used parts. In the present embodiment, as shown in this figure, the repair cost calculated by the damage determination device 30 is calculated together with the information of the target parts provided by the first user or acquired from another used parts distribution site. The information (sales information of used parts) written together is displayed. As a result, as shown in FIG. 5, the second user 21 (purchaser of goods) who can access the sales information of the used parts accesses the information in the "viewing / inquiry" step S11, and the repair cost is also described. After comparing and weighing the sales information of used parts, it is possible to determine which target article 10 to purchase. In particular, in the present embodiment, a door panel that does not require repair is displayed at a parts price of 25,000 yen, and a door panel having minor damage such as line scratches has a parts price of 15,000 yen and its repair cost of 3,000 yen. A total of 18,000 yen is displayed, and for a door panel that is damaged with a dent, a total of 17,000 yen is displayed, which is a part price of 7,000 yen and a repair cost of 10,000 yen. Therefore, the second user 21 can specify which door panel to purchase after comparing and weighing this price. In particular, in the present embodiment, the repair cost is displayed as a reference price, and it is possible to buy and sell in a state where the damage remains without performing the repair. In addition, the repair of the damage can be sold after the seller has repaired it. That is, in this embodiment, the above-mentioned sales method can be realized by separately displaying the price of the transaction target article itself, which is determined regardless of the presence or absence of damage, and the repair cost of the transaction target article. ..

That is, according to the damage determination device 30 according to the present embodiment, more specifically, the repair / repair arithmetic unit, it is possible to realize the commercial transaction of the used parts after confirming the state of the damage and the repair cost. ..

Further, the damage determination device 30 calculates a period or schedule for repairing or repairing the article by the period / schedule calculation device 40 after determining at least one of the defective part, the damaged part, the damage degree and the color of the article. ("Repair period calculation" step S12).

When repairing a defective or damaged item, the time required for the repair is also one of the user's concerns. In particular, when repairing a vehicle such as an automobile, the insurance company may manage the repair, and in that case, it is necessary to manage the progress of the repair. Therefore, in the present embodiment, it is an object to provide a period required for repairing or repairing the photographed article, a period for calculating a schedule, and a schedule calculation device, and the problem is solved and the photograph is taken. It is possible to provide a period / schedule calculation device for calculating a period required for repairing or repairing an article or a schedule.

The period / schedule calculation device 40 can be configured with a database that holds the man-hours required for repairs and repairs and the average period. This database may be provided in the computer constituting the period / schedule calculation means, or may be stored outside connected by a network. In addition, when a separate part or component is required for repair or repair, the availability of the component or component and the delivery date when the component is out of stock are configured to be obtained from an external computer system connected via a network. You can also do it. Then, the repair / repair period and schedule of the article can be calculated based on the acquisition timing of the part or member and the man-hours required for repair or repair.

The repair / repair period and schedule of the article calculated as described above can be provided not only to the requester of the repair / repair but also to a third party in the “repair status inquiry” step S13. As a result, for example, if the item to be repaired / repaired is a vehicle, it can be provided to the insurance company with which the vehicle is contracted, and the insurance company manages the period / schedule of the vehicle. Things will also be possible.

FIG. 7 shows a display screen of the calculation result by the period / schedule calculation device 40. On the display screen shown in FIG. 7, a "user ID" and an "article ID" for specifying the target article 10 are displayed, and the user can repair or repair the target article by inputting the ID. You can access the period and schedule. In addition, a photographed image of the article acquired by the damage determination device 30 is displayed on the display screen, whereby the initial state of the target article 10 can be confirmed. Then, on the display screen, the "work content" of the repair / repair from the warehousing date to the scheduled completion date of the target article 10 and the "scheduled date" are displayed according to the calculation result of the period / schedule calculation device 40. .. Then, according to the actual work status, the date when the work is completed is input in the "progress status" field. This allows a specific user to access the repair / repair period and schedule of accessible articles and quickly check the current repair / repair status.

FIG. 8 is a block diagram showing the configuration of the damage determination device 30 according to the present embodiment. The damage determination device 30 is provided with a communication interface 31 for connecting to an information communication network such as the Internet, and the photographed image data acquisition means 32 is connected to the communication interface 31, and the first is via the Internet. Acquires captured image data captured by one user 11. The acquired captured image data is output to an image determination means 34 equipped with artificial intelligence 33 executed by a computer, and at least one of a defective portion, a damaged portion, a damage degree, and a color of the photographed article is analyzed. .. Further, the image determination means 34 is also connected to the communication interface 31, so that an image search can be performed via the Internet. Further, the damage determination device 30 shown in this embodiment includes a shooting guide means 35 for transmitting shooting guide information to a terminal operated by the first user 11, which is also connected to the communication interface 31. ..

Further, FIG. 9 is a block diagram showing a configuration of the period / schedule calculation device 40 according to the present embodiment. The period / schedule calculation device 40 shown in this figure is configured by using the damage determination device 30, and further acquires the determination result of the image determination means to repair the defect, damage, or color of the photographed article. Alternatively, it is provided with a calculation means (period / schedule calculation means 41) for calculating at least one of the repair period and the schedule. The period / schedule calculation device 40 can also be configured by incorporating the period / schedule calculation means 41 into the damage determination device 30.

FIG. 10 is a block diagram showing a configuration of the repair / repair cost calculation device 50 according to the present embodiment. The repair / repair cost calculation device 50 shown in this figure is configured by using the damage determination device 30, and further acquires the determination result of the image determination means to determine the defect, damage, or color of the photographed article. The component man-hour extraction means 51 for extracting at least one of the parts and man-hours required for repair or repair is provided. Then, the repair cost integrating means 52 for calculating the repair cost from the parts price and the work coefficient based on the extraction result of the parts man-hour extraction means 51 is provided. The parts man-hour extraction means 51 and the repair cost estimation means 52 may be configured by incorporating either or both of them into the damage determination device 30.

FIG. 11 is a computer hardware configuration diagram constituting the damage determination device 30, the period / schedule calculation device 40, and the repair / repair cost calculation device 50. However, the computer 500 of FIG. 11 merely shows a typical configuration example, and may be configured as a dedicated device as long as it is provided with an arithmetic unit, a memory, and a program for executing the above-mentioned processing.

The computer 500 shown in FIG. 11 has a CPU 501, a memory 502, an audio output device 503, a network interface 504, a display controller 505, a display 506, an input device interface 507, a keyboard 508, a mouse 509, an external storage device 510, and an external recording medium drive. It is configured to include device 511 and a bus 512 connecting these components to each other.

The CPU 501 controls the operation of each component of the computer 500, controls the execution of the above-mentioned artificial intelligence treatment and the like under the control of the OS, and controls the operation. The memory 502 is usually composed of a ROM (Read Only Memory) which is a non-volatile memory and a RAM (Random Access Memory) which is a volatile memory. A program or the like executed when the computer 500 is started is stored in the ROM. In the RAM, an application program executed by the CPU 501 and executing the processing of each device, a database program, and data used during execution by those programs (for example, data or a script read from a database or a file system). ) Is temporarily stored.

The voice output device 503 is a device that outputs voice such as a speaker, and the communication interface 504 is an interface for connecting to a network 520 for exchanging information with various devices. The display controller 505 is a dedicated controller for actually processing the drawing command issued by the CPU 501. The drawing data processed by the display controller 505 is once written in the graphic memory and then output to the display 506 as a display unit.

The input device interface 507 receives a signal input from an input / output device such as a keyboard 508, a mouse 509, or a touch pad, and provides a predetermined command to the CPU 501 according to the signal pattern. The keyboard 508 and the mouse 509 are required for performing operations such as program execution and setting.

The external storage device 510 is also included in the category of storage means in the present specification. The external storage device 510 can be configured by a storage device such as a hard disk drive (HDD). The above-mentioned programs and data are recorded in this device, and are loaded into the RAM of the memory 502 from there as needed at the time of execution.

The external recording medium drive device 511 accesses and records on the recording surface of a portable external recording medium 530 such as a CD (Compact Disc), MO (Magnet-Optical Disc), or DVD (Digital Versaille Disc). It is a device that reads the existing data.

The damage determination device 30 according to the present embodiment analyzes the photographed image data acquisition means 32 for acquiring the photographed image data and the acquired photographed image data by the artificial intelligence 33 executed by the computer, and the photographed image is taken. Since it is equipped with an image determination means for determining at least one of the missing part, the damaged part, the degree of damage, and the color of the article, the presence or absence of the missing, the presence or absence of damage, and the damage of the article are simply obtained by acquiring the photographed image. The identification of at least one of the degree and color of the image can be automated by the artificial intelligence 33. Therefore, even if there is no knowledge about the damaged article and it is difficult to identify the article, it is not difficult to judge whether the article is defective, whether it is damaged, the degree of damage, and at least one of the colors. Can be done. In addition, it simplifies the work that previously required the placement of an operator to identify at least one of the damaged article, whether the article is missing, whether it is damaged, the degree of damage, and the color. , Can be automated by artificial intelligence 33 executed by a computer.

Further, the period / schedule calculation device 40 according to the present embodiment acquires the judgment results of the damage judgment device 30 and the image judgment means in the damage judgment device 30, and repairs or damages the photographed article. Since it is equipped with a repair period calculation means for calculating at least one of the repair period and schedule, the period and schedule required for repairing or repairing the photographed article can be calculated based on the photographed image data. Can be done. Thereby, it is possible to promptly provide the user with a period and a schedule for repairing or repairing the defect or damage of the article.

Then, the repair / repair cost calculation device 50 according to the present embodiment acquires the judgment results of the damage judgment device 30 and the image judgment means in the damage judgment device 30, and repairs the missing or damaged of the photographed article. Alternatively, since it is equipped with a parts man-hour extraction means for extracting parts and man-hours required for repair and a repair / repair cost estimation means for integrating the extraction results of the parts man-hour extraction means, based on the photographed image data. It is possible to calculate the cost of repairing or repairing a defect, damage or color of the photographed article. As a result, repair / repair costs can be provided easily and quickly without the intervention of an operator.

The damage determination device according to the present invention can be used as a device for confirming the presence or absence of defects or damage in an article having a certain shape. Further, the period / schedule calculation device using this damage determination device can be used as a device that allows an insurer or the like to easily confirm the progress of the damage repair work. Further, according to the repair / repair cost calculation device using this damage determination device, it can be used as a device that can easily calculate the repair cost simply by taking an image of the target article and transmitting the image.

10 Target article 11 1st user 21 2nd user 30 Damage judgment device 31 Communication interface 32 Photographed image data acquisition means 33 Artificial intelligence 34 Image judgment means 35 Shooting guide means 40 Period / schedule calculation device 41 Period / schedule calculation means 50 Repair / schedule Repair cost arithmetic unit 51 Parts man-hour extraction means 52 Repair cost estimation means 500 Computer

Claims (2)

A period arithmetic unit that calculates the period for repairing or repairing an article.
Damage determination means for determining damage to an article based on the captured image,
A calculation means for calculating the period for repairing the damage of the article based on the damage determined by the damage determination means is provided.
The damage determination means includes a photographed image data acquisition means for acquiring photographed image data, artificial intelligence executed by a computer for analyzing the acquired photographed image data, and an image determination for determining the degree of damage to the photographed article. With means,
The artificial intelligence extracts a feature portion from the captured image in the acquired captured image data, and performs an image search using the feature portion as a search key to perform an image search of the image of a regular article having a reference shape and color of the photographed article. To get,
The image determination means determines the degree of damage to the photographed article by comparing the image of the regular article with the photographed image data.
The arithmetic unit is a period arithmetic unit, characterized in that it calculates a period for repairing damage to an article based on a determination result of a degree of damage determined by the image determination unit.
A period calculation program executed by a computer to calculate the period for repairing an article.
A damage determination program that determines damage to an article based on images taken by a computer and a period for repairing damage to the article based on the damage determined by the damage determination program are calculated. It consists of an arithmetic program
The damage determination program includes a captured image data acquisition step for acquiring captured image data, and a captured image data acquisition step.
It consists of an image judgment step that analyzes the acquired photographed image data by artificial intelligence executed by a computer and determines the degree of damage to the photographed article .
In the image determination step, artificial intelligence extracts a feature portion from the captured image in the acquired captured image data, and performs an image search using the feature portion as a search key to obtain a reference shape and color of the photographed article. By acquiring an image of the genuine article to be provided and comparing the image of the regular article with the photographed image data, the degree of damage to the photographed article is determined .
The calculation program is a period calculation program characterized in that a period for repairing damage to the article is calculated based on the degree of damage determined by the image determination step .

Images