KR20220103271A - System and Method for Estimating Damage of Device - Google Patents

Abstract

According to one embodiment of the present invention, a system for estimating damage of a device. The system includes: a terminal to be a target of estimation of exterior damage; an application executed on a device and estimating exterior damage of the device; and a damage analyzer receiving image data for the exterior of the terminal from the application to perform estimation of exterior damage of the device. According to one embodiment of the present invention, the system for estimating damage of a device has an effect of not requiring a tertiary filming device because the device to be estimated can autonomously film the exterior of the device to estimate whether the device is damaged, and has an effect of fundamentally blocking attempts to use other terminals, not the device to be estimated, to exploit the system for estimating damage by using damage analysis authentication information.

Description

Terminal damage determination system and method {System and Method for Estimating Damage of Device}

The present invention relates to a terminal damage determination system and method, and more particularly, to a terminal damage determination system and method capable of determining whether the terminal is damaged by photographing the appearance of the terminal by itself.

In general, a smart terminal refers to a product that does not have limited functions and can change or expand a significant part of its functions through applications. can be heard

With the development of information and communication technology, the need and requirements for adding more improved new functions in smart terminals are increasing, and manufacturers are continuously releasing new models in response to these requirements.

On the other hand, since such a smart terminal has a feature that a user always carries and uses, there is a risk of damage due to carelessness in use. In addition, smart terminals are traded as used terminals, or in the case of newly purchased new terminals, insurance products against damage are developed.

Korean Patent Application Laid-Open No. 10-2019-0107594 relates to an exterior photographing analysis system for evaluating the value of a used terminal, and a used terminal for photographing the exterior of a used terminal and analyzing the captured image in order to evaluate the value of the used terminal It relates to an exterior photographing analysis system for the valuation of , there is a limit that requires a darkroom in which used terminals are placed.

In the second-hand transaction for smart terminals, standardized smart terminal appearance damage determination is required, and an accurate damage determination method for the appearance of smart terminals is also required for price calculation of insurance products.

Republic of Korea Patent Publication No. 10-2019-0107594

An object of the present invention for solving the above problems is to provide a terminal damage determination system and method capable of determining whether the terminal is damaged by photographing the external appearance of the terminal to be determined by itself.

Terminal damage determination system according to an embodiment of the present invention for solving the above problems is a terminal that is a target of external damage determination; an application executed in the terminal, for determining the appearance damage of the terminal; and a damage analyzer that receives image data on the appearance of the terminal from the application and determines the appearance of damage to the terminal.

Here, further comprising a mirror for photographing the exterior of the terminal using the camera of the terminal, the application generates image data for the front surface of the terminal on which the display unit is formed, using the front camera of the terminal, , it may be to provide the generated image data to the breakage analyzer.

Here, the damage analyzer uses the provided image data of the terminal to determine whether the terminal is damaged, but the damage may be classified into cracks, dents and peelings.

Here, the damage analyzer may classify the damage by learning a plurality of standard image data and the image data for the appearance of the same terminal as the terminal.

Here, the application may be to generate damage analysis authentication information including a damage analysis authentication ID provided from the damage analyzer and a unique ID of the terminal.

Here, the damage analysis authentication information is formed in a QR code, and may further include information about the shooting time and shooting location of the image data.

Here, the breakage analysis authentication ID is generated by the breakage analyzer and provided to the application, and through comparison with the breakage analysis authentication ID of the breakage analysis authentication information of the application received from the breakage analyzer, the damage analysis is normal It may be to authenticate whether the operation is performed.

Here, the application may operate so that a white screen is formed on the display unit of the terminal when the front side of the terminal is photographed.

Here, the application may be to use the rear camera of the terminal to further generate image data for the rear of the terminal, and to provide the generated image data to the damage analyzer.

A method for determining damage to a terminal according to another embodiment of the present invention for solving the above problems includes the steps of generating a damage analysis authentication ID in a damage analyzer for determining external damage of a terminal and providing it as an application executed in the terminal; generating damage analysis authentication information by receiving the breakage analysis authentication ID from the application; generating image data for the appearance of the terminal by using a mirror in the application; providing the damage authentication information and the image data to the damage analyzer in the application; and performing an appearance damage determination of the terminal using the damage authentication information and the image data in the damage analyzer.

Here, the generating of the image data for the appearance of the terminal may include generating image data for the front surface of the terminal on which the display unit is formed by using the front camera of the terminal.

Here, the generating of the image data for the appearance of the terminal may include further generating image data obtained by photographing the rear of the terminal by using the rear camera of the terminal.

Here, the damage analysis authentication information is formed in a QR code, and may further include information about the shooting time and shooting location of the image data.

Here, the step of determining the appearance damage of the terminal is through comparison between the damage analysis authentication ID generated by the damage analyzer and the damage analysis authentication ID of the damage analysis authentication information of the application received from the damage analyzer, It may be to authenticate whether the damage analysis is operating normally.

Here, in the step of performing the external damage determination of the terminal, it is determined whether the terminal is damaged, and the damage may be classified into cracks, dents and peelings.

Here, the step of determining the appearance damage of the terminal may be to classify the damage through a plurality of standard image data for the appearance of the same terminal as the terminal and learning the image data.

Here, when the image data for the front surface of the terminal on which the display unit is formed is generated using the front camera of the terminal, it may be operated so that a white screen is formed on the display unit of the terminal.

According to the terminal damage determination system according to an embodiment of the present invention, it is possible to determine whether the terminal is damaged by photographing the external appearance of the terminal to be determined by itself. That is, there is an advantage that a third photographing device is not required.

In addition, since the damage analysis authentication information including the damage analysis authentication ID and the unique ID of the terminal is used, there is an effect that can fundamentally block attempts to abuse the damage determination system using a terminal other than the target terminal.

In particular, when photographing the front of the terminal in which the display unit of the terminal is located, the display unit of the terminal operates to form a white screen, thereby minimizing errors due to reflection, etc., so that damage determination can be performed more efficiently.

In addition, there is an advantage in that the classification and analysis of damage can be more accurately determined through the learning of a plurality of standard image data and image data for the appearance of the same terminal as the damage determination target terminal.

1 is a view for explaining a terminal damage determination system according to an embodiment of the present invention.
2 is a flowchart illustrating a method for determining damage to a terminal according to another embodiment of the present invention.
3 is a view for explaining a process of determining the damage of the terminal in the terminal damage determination system and method according to an embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings, embodiments of the present invention will be described in detail so that those of ordinary skill in the art to which the present invention pertains can easily implement them. The present invention may be embodied in several different forms and is not limited to the embodiments described herein.

In order to clearly describe the present invention, parts irrelevant to the description are omitted, and the same reference numerals are assigned to the same or similar elements throughout the specification.

Throughout the specification, when a part is "connected" with another part, this includes not only the case of being "directly connected" but also the case of being "electrically connected" with another element interposed therebetween. . Also, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated.

When a part is referred to as being “above” another part, it may be directly on top of the other part or the other part may be involved in between. In contrast, when a part refers to being "directly above" another part, no other part is involved in between.

The terms first, second, third, etc. are used to describe, but are not limited to, various parts, components, regions, layers and/or sections. These terms are used only to distinguish one part, component, region, layer or section from another part, component, region, layer or section. Accordingly, a first part, component, region, layer or section described below may be referred to as a second part, component, region, layer or section without departing from the scope of the present invention.

The terminology used herein is for the purpose of referring to specific embodiments only, and is not intended to limit the invention. As used herein, the singular forms also include the plural forms unless the phrases clearly indicate the opposite. As used herein, the meaning of "comprising" specifies a particular characteristic, region, integer, step, operation, element and/or component, and the presence or absence of another characteristic, region, integer, step, operation, element and/or component. It does not exclude additions.

Terms indicating a relative space such as “below” and “above” may be used to more easily describe the relationship of one part shown in the drawings to another part. These terms are intended to include other meanings or operations of the device in use with the meanings intended in the drawings. For example, if the device in the drawings is turned over, some parts described as being "below" other parts are described as being "above" other parts. Thus, the exemplary term “down” includes both the up and down directions. The device may be rotated 90 degrees or at other angles, and terms denoting relative space are interpreted accordingly.

Although not defined otherwise, all terms including technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the art to which the present invention belongs. Commonly used terms defined in the dictionary are additionally interpreted as having a meaning consistent with the related technical literature and the presently disclosed content, and unless defined, are not interpreted in an ideal or very formal meaning.

Hereinafter, with reference to the accompanying drawings, embodiments of the present invention will be described in detail so that those of ordinary skill in the art can easily implement them. However, the present invention may be embodied in various different forms and is not limited to the embodiments described herein.

1 is a view for explaining a terminal damage determination system according to an embodiment of the present invention. 2 is a flowchart illustrating a method for determining damage to a terminal according to another embodiment of the present invention. 3 is a view for explaining a process of determining the damage of the terminal in the terminal damage determination system and method according to an embodiment of the present invention.

1 and 3 together, the terminal damage determination system 100 according to an embodiment of the present invention includes a terminal 110 that is a target of external damage determination; The application is executed in the terminal, the application 120 for determining the appearance damage of the terminal; and a damage analyzer 130 that receives image data on the appearance of the terminal from the application to determine the appearance of damage to the terminal.

The terminal 110 is a terminal that is a target of external damage determination, and may generally be a product such as a smartphone or a smart pad, but is not limited thereto, and all terminals requiring external damage determination for the terminal are applicable. it could be

The application 120 may be executed in the form of a program in the terminal 110 , and may perform operations such as authentication and photographing in order to determine the appearance of the terminal 110 .

The damage analyzer 130 may receive image data on the appearance of the terminal 110 from the application 120 to determine the appearance damage of the terminal 110 .

On the other hand, the application 120 is to perform the external damage determination of the terminal 110 through communication with the damage analyzer 130, the damage analyzer 130 may be implemented in the form of a website, this In this case, the application 120 may be implemented in the form of a minimal access program that can connect to the breakage analyzer 130 . Accordingly, the application 120 may be implemented as a program with a minimized size.

In addition to the terminal 110, the application 120 and the damage analyzer 130, the terminal damage determination system 100 according to an embodiment of the present invention, using the camera of the terminal 110, the terminal ( 110) further includes a mirror 140 for photographing the exterior, and the application 120 uses the front camera of the terminal to generate image data for the front surface where the display unit of the terminal 110 is formed, The generated image data may be provided to the breakage analyzer 130 .

The mirror 140 is for photographing the exterior of the terminal 110 , and the front camera of the terminal 110 may be used to photograph the front of the terminal, and the rear camera of the terminal 110 may be used to photograph the mirror 140 . It may be possible to photograph the back of the terminal. However, using the feature that the display unit is formed on the front surface of the terminal 110, only the front surface of the terminal may be photographed and used.

The application 120 may be to use the front camera of the terminal to generate image data for the front surface where the display unit of the terminal 110 is formed, and to provide the generated image data to the damage analyzer 130 . have.

In addition, the damage analyzer 130 will be able to determine whether the terminal is damaged by using the provided image data of the terminal, and the damage to the object to be determined in the damage analyzer 130 is broken or stamped. and peeling.

Cracked is a dictionary meaning used in mineralogy to indicate the shape of a mineral surface that is broken in a direction other than the cracked plane, and usually refers to a fine crack in an object. Stamped refers to a mark that appears when pressed, and refers to a mark that is pressed by an external impact on the terminal. Peeled means torn or peeled apart from the body, and refers to the gun from which the external part of the terminal is peeled off.

As described above, if the damage to the determination target for the terminal in the damage analyzer 130 is classified into cracks, dents, and peelings, most of the damage can be classified, but is not limited thereto.

The damage analyzer 130 may classify the damage by learning a plurality of standard image data and the image data for the appearance of the same terminal as the terminal.

The breakage analyzer 130 may be to use a deep learning algorithm of a Faster-R-CNN (Faster Region of Convolutional Neural Network) series, and the breakage analyzer 130 is the same terminal as the terminal 110 in the deep learning algorithm. Learning to apply a plurality of standard image data for the appearance of and a plurality of image data for the terminal 110 may be performed.

Referring to FIG. 3, it shows that the damage analyzer 130 of the terminal damage determination system 100 according to an embodiment of the present invention determines the damage to the terminal 100, and is indicated by an arrow in the figure on the left. You can see that there is a damaged part in the marked part. In this case, the breakage analyzer 130 uses a Faster-R-CNN (Faster Region of Convolutional Neural Network) series deep learning algorithm, as can be seen in the figure on the right, to determine several breakage regions. There will be, and in order to increase the accuracy of the determination of damage, the threshold is set at the level of 85%, and only the case where the degree of damage exceeds 85% may be determined as damage.

The application 120 may be to generate damage analysis authentication information including the damage analysis authentication ID provided from the damage analyzer 130 and the unique ID of the terminal.

On the other hand, the damage analysis authentication information is formed in a QR code, it may be to further include the shooting time and shooting location information of the image data.

In addition, the breakage analysis authentication ID is generated by the breakage analyzer and provided to the application, and through comparison with the breakage analysis authentication ID of the breakage analysis authentication information of the application received from the breakage analyzer, normal operation of the breakage analysis It may be to verify whether or not

More specifically, first, the damage analyzer 130 receives a request for determining the damage of the terminal, generates the damage analysis authentication ID, and passes the generated damage analysis authentication ID to the application 120 . will be able

The application 120 may generate damage analysis authentication information including a terminal unique ID in the received damage analysis authentication ID. When the terminal unique ID is formed of unique information that can be assigned to each terminal, it may include, for example, manufacturer information, model number, and international mobile equipment identity (IMEI) of the terminal.

Since the damage analysis authentication information formed according to the above procedure will be shared with the damage analyzer 130 and the application 120, it will be possible to fundamentally block cases of misuse and abuse of performing damage determination using other terminals. .

The application 120 may operate so that a white screen is formed on the display unit of the terminal when the front of the terminal 110 is photographed. Here, the white-based color may exemplarily refer to a range of 239 or more RGB in the range of [0, 255]. This will minimize the error on the image data that may occur due to reflection or the like in the case of photographing the front of the terminal 110, so that damage determination can be performed more efficiently.

The application 120 may be to use the rear camera of the terminal 110 to further generate image data for the rear of the terminal, and to provide the generated image data to the damage analyzer. By using the image data photographed not only on the front side of the terminal 110 but also on the back side, it will be possible to more accurately determine the overall damage of the terminal.

2 and 3 together, the terminal damage determination method according to an embodiment of the present invention generates a damage analysis authentication ID in the damage analyzer that performs the external damage determination of the terminal and provides it as an application executed in the terminal step (S210); generating damage analysis authentication information by receiving the damage analysis authentication ID from the application (S220); Using a mirror in the application, generating image data for the appearance of the terminal (S230); providing the damage authentication information and the image data to the damage analyzer in the application (S240); and performing an appearance damage determination of the terminal using the damage authentication information and the image data in the damage analyzer (S250).

The step (S210) of generating a breakage analysis authentication ID in the breakage analyzer that performs the external damage determination of the terminal and providing it as an application executed in the terminal (S210) is performed in the breakage analyzer for damage analysis authentication with the application in the breakage analyzer The generated breakage analysis authentication ID may be provided to the application.

The step (S220) of receiving the breakage analysis authentication ID from the application to generate breakage analysis authentication information includes the breakage analysis authentication ID generated by the breakage analyzer and the breakage analysis authentication information of the application received from the breakage analyzer. Through comparison with the damage analysis authentication ID, the damage authentication information may be generated in order to authenticate whether the damage analysis is normally operated.

In addition, the application 120 will be able to generate damage analysis authentication information including the terminal unique ID in the received damage analysis authentication ID. When the terminal unique ID is formed of unique information that can be assigned to each terminal, it may include, for example, manufacturer information, model number, and international mobile equipment identity (IMEI) of the terminal.

The step (S230) of generating image data on the appearance of the terminal by using a mirror in the application may be generating image data on the front surface of the terminal on which the display unit is formed by using the front camera of the terminal. . In addition, by using the rear camera of the terminal, the image data of the rear of the terminal may be further generated.

The step of providing the damage authentication information and the image data to the damage analyzer in the application (S240) may be to provide the image data for the terminal to the damage analyzer for damage determination, and the damage analysis authentication information is Since it will be shared only between the damage analyzer and the application, it will be possible to fundamentally block the case of misuse and abuse of performing damage determination using other terminals.

In the damage analyzer, the step of determining the appearance damage of the terminal using the damage authentication information and the image data (S250) is a plurality of standard image data for the appearance of the same terminal as the terminal and learning of the image data. It may be to classify the damage through

In the step (S250) of performing the appearance damage determination of the terminal, it may be to use a Faster-R-CNN (Faster Region of Convolutional Neural Network) series deep learning algorithm, and the damage analyzer is the same as the terminal in the deep learning algorithm. Learning to apply a plurality of standard image data for the appearance of the terminal and a plurality of image data for the terminal may be performed.

In the step (S220) of receiving the damage analysis authentication ID from the application and generating the damage analysis authentication information (S220), the damage analysis authentication information is formed in a QR code, and further includes information about the shooting time and shooting location of the image data can

The step of performing the external damage determination of the terminal (S250) is through comparison between the damage analysis authentication ID generated by the damage analyzer and the damage analysis authentication ID of the damage analysis authentication information of the application received from the damage analyzer, It may be to authenticate whether the damage analysis is operating normally.

In addition, it is determined whether the terminal is damaged in the step (S250) of performing the external damage determination of the terminal, and the damage may be classified into cracks, dents and peelings.

When the image data for the front surface of the terminal is formed using the front camera of the terminal in the step (S230) of generating image data for the appearance of the terminal, a white screen is displayed on the display of the terminal. It may be working to form this.

On the other hand, the white-based color may exemplarily refer to a range of 239 or more RGB in the range of [0, 255]. This will minimize the error on the image data that may occur due to reflection or the like in the case of photographing the front of the terminal 110, so that damage determination can be performed more efficiently.

Although the embodiments of the present invention have been described with reference to the accompanying drawings, those of ordinary skill in the art to which the present invention pertains can realize that the present invention can be embodied in other specific forms without changing its technical spirit or essential features. you will be able to understand For example, those skilled in the art may change the material, size, etc. of each component according to the field of application, or combine or substitute the disclosed embodiments in a form not explicitly disclosed in the embodiment of the present invention, but this is also without departing from the scope of the invention. Therefore, the embodiments described above should not be understood as illustrative and limiting in all respects, and these modified embodiments should be said to be included in the technical spirit described in the claims of the present invention.

100: terminal damage determination system
110: terminal
120: application
130: breakage analyzer
140: mirror

Claims (17)

Terminals subject to external damage determination;
an application running on the terminal, for determining the appearance damage of the terminal; and
Terminal damage determination system comprising a; damage analyzer for receiving image data on the appearance of the terminal from the application to determine the appearance damage of the terminal. The method of claim 1,
Further comprising a mirror for photographing the exterior of the terminal using the camera of the terminal,
The application is a terminal damage determination system, characterized in that by using the front camera of the terminal, generating image data for the front surface of the terminal where the display unit is formed, and providing the generated image data to the damage analyzer. According to claim 1,
The damage analyzer uses the provided image data of the terminal to determine whether the terminal is damaged, but the damage is classified into cracks, dents and peelings. 4. The method of claim 3,
The damage analyzer is a terminal damage determination system, characterized in that for classifying the damage through the learning of a plurality of standard image data and the image data for the appearance of the same terminal as the terminal. According to claim 1,
The application is a terminal damage determination system, characterized in that for generating damage analysis authentication information including the damage analysis authentication ID and the unique ID of the terminal provided from the damage analyzer. 6. The method of claim 5,
The damage analysis authentication information is formed in a QR code,
Terminal damage determination system, characterized in that it further includes information about the shooting time and shooting location of the image data. 6. The method of claim 5,
The breakage analysis authentication ID is generated by the breakage analyzer and provided to the application,
Terminal damage determination system, characterized in that for authenticating whether the normal operation of the damage analysis through the comparison with the damage analysis authentication ID of the damage analysis authentication information of the application received from the damage analyzer. 3. The method of claim 2,
The application is a terminal damage determination system, characterized in that when the front photographing of the terminal is operated to form a white screen on the display unit of the terminal. 3. The method of claim 2,
The application uses the rear camera of the terminal, further generating image data for the rear of the terminal, and terminal damage determination system, characterized in that providing the generated image data to the damage analyzer. Generating a damage analysis authentication ID in the damage analyzer that performs the external damage determination of the terminal and providing it to an application executed in the terminal;
generating damage analysis authentication information by receiving the breakage analysis authentication ID from the application;
generating image data for the appearance of the terminal by using a mirror in the application;
providing the damage authentication information and the image data to the damage analyzer in the application; and
Using the damage authentication information and the image data in the damage analyzer to determine the appearance damage of the terminal; terminal damage determination method comprising a. 11. The method of claim 10,
The generating of image data for the appearance of the terminal comprises generating image data for the front surface of the terminal on which the display unit is formed by using the front camera of the terminal. 12. The method of claim 11,
Generating the image data for the appearance of the terminal, using a rear camera of the terminal, terminal damage determination method, characterized in that further generating the image data photographed the rear of the terminal. 11. The method of claim 10,
The damage analysis authentication information is formed in a QR code, the terminal damage determination method, characterized in that it further comprises a recording time and photographing location information of the image data. 11. The method of claim 10,
The step of performing the external damage determination of the terminal is through a comparison between the damage analysis authentication ID generated by the damage analyzer and the damage analysis authentication ID of the damage analysis authentication information of the application received from the damage analyzer, the damage analysis Terminal damage determination method, characterized in that authenticating whether the normal operation of the. 11. The method of claim 10,
In the step of performing the external damage determination of the terminal, it is determined whether the terminal is damaged, and the damage is classified into cracks, dents and peelings. 16. The method of claim 15,
The step of determining the appearance damage of the terminal is a terminal damage determination method, characterized in that by classifying the damage through the learning of a plurality of standard image data and the image data for the appearance of the same terminal as the terminal. 12. The method of claim 11,
Using the front camera of the terminal, when generating image data for the front surface of the terminal on which the display unit is formed, the terminal damage determination method, characterized in that the operation so as to form a white screen on the display unit of the terminal.

Images