KR102336760B1 - Method for identifying ladle and electronic device thereof - Google Patents

Abstract

The present invention relates to a method for identifying a ladle and an electronic device thereof, the electronic device comprising an image sensor, a memory, and a processor operatively coupled to the image sensor and the memory, the processor comprising: detecting a ladle from an image obtained through an image sensor, extracting first identification information of the ladle and second identification information of the ladle from the image in which the ladle is detected, the first identification information and the second identification It may be configured to determine the identification information of the ladle based on the information. Other embodiments are possible.

Description

Ladle identification method and electronic device thereof

The present invention relates to a method for identifying a ladle and an electronic device thereof, and more particularly, to a method for identifying a ladle using an image sensor and an electronic device thereof.

A ladle for transporting ingot steel is formed at the bottom of a wall made of refractory material, a plug capable of blowing an inert gas to equalize the temperature or composition in the molten steel, and at the bottom of the wall to cast the finished molten steel. It may include an outlet capable of discharging the molten steel.

A top nozzle is inserted into the outlet provided in the ladle, and a shroud nozzle connected to the caster is installed under the ladle, and a sliding gate may be installed between the top nozzle and the shroud nozzle.

Background art of the present invention is disclosed in Republic of Korea Patent Registration No. 10-1654358 (2016.08.30. Ladle management system and method).

According to one aspect of the present invention, the present invention provides a method and an electronic device for identifying a ladle by acquiring an image of the ladle by using an image sensor and analyzing the acquired image.

An electronic device according to an aspect of the present invention includes an image sensor, a memory, and a processor operatively coupled to the image sensor and the memory, wherein the processor includes an image acquired through the image sensor Detect a ladle from, extract the first identification information of the ladle and the second identification information of the ladle from the image in which the ladle is detected, based on the first identification information and the second identification information of the ladle It may be set to determine identification information.

In the present invention, as at least part of the operation of detecting the ladle, the processor may be configured to extract a feature from an image acquired through the image sensor, and detect the ladle from the image based on the extracted feature. .

In the present invention, the processor, as at least part of the operation of extracting the first identification information of the ladle and the second identification information of the ladle, extracts a feature from the image in which the ladle is detected, and based on the extracted feature By recognizing the first identification number included in the first area of the ladle, extracting the first identification information, and recognizing the second identification number included in the second area of the ladle based on the extracted characteristics , may be set to extract the second identification information.

In the present invention, the first identification number may be composed of a decimal number, and the second identification number may be composed of a embossed 6-digit binary number.

In the present invention, as at least part of the operation of determining the identification information of the ladle, the processor determines whether the first identification information and the second identification information are the same, and the first identification information and the second identification information When the information is the same, the first identification information or the second identification information is determined as the identification information of the ladle, and when the first identification information and the second identification information are not the same, the second identification information is It can be set to determine the identification information of the ladle.

In the present invention, the electronic device further includes an input/output device, and the processor, when the first identification information of the ladle and the second identification information of the ladle are not extracted from the image in which the ladle is detected, the input/output device It may be set to output information for guiding that at least one of the ladle or the image sensor is contaminated through the device.

In the present invention, the electronic device further includes a communication interface, and the processor, when the first identification information of the ladle and the second identification information of the ladle are not extracted from the image in which the ladle is detected, the communication The interface may be configured to transmit information indicating that at least one of the ladle or the image sensor is contaminated to an external electronic device.

According to one aspect of the present invention, it is possible to provide an effect of accurately identifying the ladle photographed through the image sensor by obtaining an image obtained by photographing the ladle using an image sensor and analyzing the obtained image.

1 is a block diagram of an electronic device according to various embodiments of the present disclosure;
2 is an exemplary diagram illustrating an example of an image obtained by photographing a ladle according to various embodiments of the present disclosure;
3 is a flowchart illustrating an example of a method for recognizing a ladle in an electronic device according to various embodiments of the present disclosure;
4 is a flowchart illustrating a method of extracting identification information of a ladle in an electronic device according to various embodiments of the present disclosure;
5 is a flowchart illustrating a method of determining identification information of a ladle in an electronic device according to various embodiments of the present disclosure;
6 is a flowchart illustrating another example of a method for identifying a ladle in an electronic device according to various embodiments of the present disclosure;

Hereinafter, a ladle identification method and an electronic device thereof according to the present invention will be described with reference to the accompanying drawings.

In this process, the thickness of the lines or the size of the components shown in the drawings may be exaggerated for clarity and convenience of explanation. In addition, the terms to be described later are terms defined in consideration of functions in the present invention, which may vary according to the intention or custom of the user or operator. Therefore, definitions of these terms should be made based on the content throughout this specification.

Examples and terms used therein are not intended to limit the technology described in this document to a specific embodiment, but it should be understood to include various modifications, equivalents, and/or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for like components. The singular expression may include the plural expression unless the context clearly dictates otherwise. In this document, expressions such as “A or B” or “at least one of A and/or B” may include all possible combinations of items listed together. Expressions such as "first", "second", "first", or "second" may modify the corresponding elements regardless of order or importance, and may be used to distinguish one element from another element. However, the components are not limited. When an (eg, first) component is referred to as being “(functionally or communicatively) connected” or “connected” to another (eg, second) component, that component is It may be directly connected to the component or may be connected through another component (eg, a third component).

In this document, "configured (or configured to)" means "suitable for", "having the ability to", "modified to" depending on the context, for example, hardware or software. “,” “made to,” “capable of,” or “designed to,” may be used interchangeably. In some circumstances, the expression “a device configured to” may mean that the device is “capable of” with other devices or parts. For example, the phrase “a processor configured (or configured to perform) A, B, and C” refers to a dedicated processor (eg, an embedded processor) for performing the operations, or by executing one or more software programs stored in a memory device. , may refer to a general-purpose processor (eg, a CPU or an application processor) capable of performing corresponding operations.

1 is a block diagram of an electronic device according to various embodiments of the present disclosure; 2 is an exemplary diagram illustrating an example of an image obtained by photographing a ladle according to various embodiments of the present disclosure;

1 and 2 , the electronic device 100 may include at least some of a processor 120 , a memory 130 , an image sensor 140 , an input/output device 150 , and a communication interface 160 . have.

According to various embodiments, the processor 120 may control a plurality of hardware or software components connected to the processor 120 by driving an operating system or an application, and may perform various data processing and operations. According to an embodiment, the processor 320 may be implemented as a system on chip (SoC). The processor 120 may load and process instructions or data received from at least one of the other components into the memory 130 , and store various data in the memory 130 .

According to various embodiments, the processor 120 may detect a ladle from an image acquired through the image sensor 140 . For example, the processor 120 may detect a ladle from the acquired image by acquiring an image periodically, aperiodically, or in real time through the image sensor 140 and analyzing the acquired image. According to an embodiment, in order to more easily detect the ladle from the image, the processor 120 may extract a feature from the image and detect the ladle from the image based on the extracted feature. In this case, the processor 120 may extract a feature from the image by using the LBP.

According to various embodiments, in response to detecting the ladle from the image, the processor 120 may extract identification information of the ladle from the image in which the ladle is detected. For example, the processor 120, as shown in FIG. 2, when the ladle 201 is detected from the image, by recognizing the identification number 205 of the decimal number included in the first area 203 of the ladle 201, By extracting the first identification information of the ladle, and recognizing the six-digit binary number 209 embossed in the second area 207 of the ladle 201, the second identification information of the ladle can be extracted. According to an embodiment, the processor 120 extracts a feature from the image in which the ladle is detected so that it is easier to extract the identification information of the ladle from the image, and the first area of the ladle from the first area of the ladle based on the extracted feature The identification information may be extracted, and the second identification information of the ladle may be extracted from the second area of the ladle based on the extracted features. In this case, the processor 120 may extract a feature from the image in which the ladle is detected by using a local binary pattern (LBP). According to an embodiment, as shown in FIG. 2 , around the binary number pattern, an embossed patterned area designation pattern may be added to define the binary number pattern area.

According to various embodiments, the processor 120 may determine the identification information of the ladle based on the identification information of the ladle extracted from the image. For example, when the first identification information and the second identification information of the ladle are the same, the processor 120 determines the first identification information or the second identification information as the identification information of the ladle, and the first identification information and the second identification information When the information is different, the second identification information may be determined as identification information of the ladle. For another example, when the first identification information is obtained from the first area of the ladle, the processor 120 determines the first identification information as the identification information of the ladle, and the first identification information is obtained from the first area of the ladle However, when the second identification information is obtained from the second area of the ladle, the second identification information is determined as the identification information of the ladle, and the first identification information and the second identification information from the first area and the second area of the ladle are If not obtained, information indicating that at least one of the ladle and the image sensor is contaminated is output through the input/output device 150 or information indicating that at least one of the ladle and the image sensor is contaminated through the communication interface 160 is transmitted to an external electronic device can be sent to the device.

According to various embodiments, the image sensor 140 is disposed around the movement path of the ladle, and may take an image including the moving ladle. According to an embodiment, the image sensor 140 may include one or more lenses, image sensors, or image signal processors. According to an embodiment, the image sensor 140 may include a plurality of image sensors 140 - 1 to 140 -N in order to continuously photograph a moving ladle.

According to various embodiments, the input/output device 150 may receive an input for controlling the electronic device 100 and output information. According to an embodiment, the input/output device 150 may include an input device such as a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus pen) and an output device such as a display, a hologram device, or a projector.

According to various embodiments, the communication interface 160 may include an interface for data communication between the electronic device 100 and an external electronic device. According to an embodiment, the communication interface 160 may support wireless or wired communication.

3 is a flowchart illustrating an example of a method for recognizing a ladle in an electronic device according to various embodiments of the present disclosure;

Referring to FIG. 3 , in operation 301 , the processor (eg, the processor 120 of FIG. 1 ) of the electronic device (eg, the electronic device 100 of FIG. 1 ) transmits an image sensor (eg, the image sensor 140 of FIG. 1 ) )) from the image obtained from the ladle can be detected. For example, the processor 120 may acquire an image periodically, aperiodically, or in real time through the image sensor 140 , and analyze the acquired image to detect a ladle from the image. According to an embodiment, in order to more easily detect the ladle from the image, the processor 120 may extract a feature from the image and detect the ladle from the image based on the extracted feature. In this case, the processor 120 may extract a feature from the image by using the LBP.

In operation 303, the processor 120 may extract first identification information and second identification information of the ladle from the image in which the ladle is detected. For example, the processor 120 extracts the first identification information of the ladle by recognizing the identification number of a decimal number included in the first area of the ladle, and is included in the second area of the ladle and is embossed binary patterned By recognizing the identification number, it is possible to extract the second identification information of the ladle. For another example, the processor 120 extracts a feature from the image using the LBP, and recognizes the identification number of a decimal number included in the first area of the ladle based on the extracted feature, so that the first identification information of the ladle By extracting and recognizing the identification number included in the second area of the ladle and embossed binary patterned on the basis of the extracted features, it is possible to extract the second identification information of the ladle.

In operation 305, the processor 120 may determine the identification number of the ladle based on the first identification information and the second identification information. For example, when the first identification information and the second identification information are the same, the processor 120 may determine the first identification information or the second identification information as identification information of the ladle. For another example, when the first identification information and the second identification information are not the same, the processor 120 may determine the second identification information as identification information of the ladle.

As described above, the electronic device 100 may identify the ladle by analyzing an image obtained by photographing the ladle and determining identification information of the ladle based on the analysis. Also, the electronic device 100 extracts two pieces of identification information from the image and determines the identification information of the ladle by using the extracted two pieces of identification information, thereby further enhancing the reliability of the identification information of the ladle.

4 is a flowchart illustrating a method of extracting identification information of a ladle in an electronic device according to various embodiments of the present disclosure; The following description may be a detailed operation of the operation of extracting the first identification information and the second identification information of the ladle from the image in which the ladle is detected in operation 303 of FIG. 3 .

Referring to FIG. 4 , in operation 401 , the processor (eg, the processor 120 of FIG. 1 ) of the electronic device (eg, the electronic device 100 of FIG. 1 ) may extract a feature from the image in which the ladle is detected. . For example, the processor 120 may extract a feature from the image in which the ladle is detected by using the LBP.

In operation 403 , the processor 120 may extract first identification information from the first area of the ladle based on the extracted feature. For example, the processor 120 may extract the first identification information by recognizing the decimal identification number included in the first area of the ladle from the converted image using the LBP.

In operation 405 , the processor 120 may extract second identification information from the second area of the ladle based on the extracted feature. For example, the processor 120 may extract the second identification information by recognizing the embossed binary patterned identification number in the second area of the ladle from the converted image using the LBP.

In the above description, the electronic device 100 performs operation 405 after performing operation 403 , but the electronic device 100 may change the order of operations 403 and 405 . For example, the electronic device 100 may simultaneously perform operations 403 and 405 in parallel or perform operation 405 and then perform operation 403 .

As described above, the electronic device 100 extracts features from the image before extracting the identification information of the ladle, so that even if changes in environmental factors such as external lighting changes occur, the identification information of the ladle can be extracted. have.

5 is a flowchart illustrating a method of determining identification information of a ladle in an electronic device according to various embodiments of the present disclosure; The following description may be a detailed operation of the operation of determining the identification information of the ladle based on the first identification information and the second identification information in operation 305 of FIG. 3 .

Referring to FIG. 5 , in operation 501 , the processor (eg, the processor 120 of FIG. 1 ) of the electronic device (eg, the electronic device 100 of FIG. 1 ) determines whether the first identification information and the second identification information are the same. can decide whether The processor 120 may perform operation 503 when the first identification information and the second identification information are the same, and perform operation 505 when the first identification information and the second identification information are not the same.

In operation 503, when the first identification information and the second identification information are the same, the processor 120 may determine the first identification information or the second identification information as identification information of the ladle.

In operation 505, when the first identification information and the second identification information are not the same, the processor 120 may determine the second identification information as identification information of the ladle. According to an embodiment, the processor 120 may output information indicating that the identification number of the decimal number included in the first area of the ladle is in a contaminated state through the input/output device 150 after determining the identification information of the ladle. have. According to an embodiment, after determining the identification information of the ladle, the processor 120 transmits information indicating that the decimal identification number included in the first area of the ladle is in a contaminated state through the communication interface 160 to the external electronic device. can be sent to Accordingly, the user of the electronic device 100 or the manager of the facility may recognize that the decimal identification number included in the first area of the ladle is contaminated.

As described above, the electronic device 100 may further increase the reliability of the identification information of the ladle by determining the identification information of the ladle using two pieces of identification information.

6 is a flowchart illustrating another example of a method for identifying a ladle in an electronic device according to various embodiments of the present disclosure;

Referring to FIG. 6 , in operation 601 , the electronic device (eg, the processor of the electronic device 100 of FIG. 1 (eg, the processor 120 of FIG. 1 )) transmits an image sensor (eg, the image sensor 140 of FIG. 1 ). . According to an embodiment, in order to more easily detect a ladle from the image, the processor 120 may extract a feature from the image and detect the ladle from the image based on the extracted feature. In this case, the processor 120 may extract a feature from the image by using the LBP.

In operation 603, the processor 120 may extract a feature from the image in which the ladle is detected. For example, the processor 120 may extract a feature from the image by converting the image using the LBP.

In operation 605, the processor 120 may determine whether the first identification information is obtained from the first area of the ladle based on the extracted feature. For example, the processor 120 may determine whether a decimal identification number included in the first area of the ladle is recognized from the image converted using the LBP. The processor 120 may perform operation 607 when the first identification information is obtained from the first area of the ladle, and perform operation 609 when the first identification information is not obtained from the first area of the ladle.

In operation 607, when the first identification information is obtained from the first area of the ladle based on the extracted feature, the processor 120 may determine the first identification information as the identification information of the ladle.

In operation 609, if the first identification information is not obtained from the first area of the ladle based on the extracted feature, the processor 120 determines whether the second identification information is obtained from the second area of the ladle based on the extracted feature can decide whether For example, the processor 120 may determine whether an embossed binary patterned identification number is recognized in the second region of the ladle from the image converted by using the LBP. The processor 120 may perform operation 611 when the second identification information is obtained from the second area of the ladle, and perform operation 613 when the second identification information is not obtained from the second area of the ladle.

In operation 611 , when the second identification information is obtained from the second area of the ladle based on the extracted feature, the processor 120 may determine the second identification information as the identification information of the ladle.

In operation 613 , when the second identification information is not obtained from the second area of the ladle based on the extracted feature (or both the first identification information and the second identification information are not obtained), the processor 120 performs input/output Information indicating that at least one of the ladle and the image sensor is contaminated may be output through the device 150 . According to an embodiment, instead of outputting information indicating that at least one of the ladle and the image sensor is contaminated through the input/output device 150 , the processor 120 transmits at least one of the ladle and the image sensor through the communication interface 160 . Transmitting information indicating contamination to an external device or outputting information indicating that at least one of the ladle and the image sensor is contaminated through the output device 150, and at least one of the ladle and the image sensor is contaminated through the communication interface 160 It is possible to transmit information indicating that the

In the above description, the electronic device 100 determines whether the first identification information is obtained and then determines whether the second identification information is obtained. However, according to various embodiments of the present disclosure, the electronic device 100 is An operation of determining whether the second identification information is obtained may be performed first, and then an operation of determining whether the first identification information is obtained may be performed. For example, when the second identification information is obtained from the second area of the ladle based on the extracted feature, the electronic device 100 determines the second identification information as the identification information of the ladle, and based on the extracted feature When the second identification information is not obtained from the second area of the ladle, it may be determined whether the first identification information is obtained from the first area of the ladle based on the extracted feature.

As described above, even if the first identification information of the ladle is not obtained from the image, the electronic device 100 may determine the identification information of the ladle by obtaining the second identification information of the ladle. Accordingly, it is possible to further reduce the occurrence of a situation in which identification information of the ladle is not recognized due to contamination occurring in some areas of the ladle.

As described above, the present invention has been described with reference to the embodiment shown in the drawings, but this is merely exemplary, and various modifications and equivalent other embodiments are possible by those of ordinary skill in the art to which this technology belongs. will understand the point. Therefore, the technical protection scope of the present invention should be defined by the following claims. Implementations described herein may also be implemented as, for example, a method or process, an apparatus, a software program, a data stream, or a signal. Although discussed only in the context of a single form of implementation (eg, discussed only as a method), implementations of the discussed features may also be implemented in other forms (eg, as an apparatus or program). The apparatus may be implemented in suitable hardware, software and firmware, and the like. A method may be implemented in an apparatus such as, for example, a processor, which generally refers to a computer, a microprocessor, a processing device, including an integrated circuit or programmable logic device, or the like. Processors may also include communication devices such as computers, cell phones, portable/personal digital assistants (“PDAs”) and other devices that facilitate communication of information between end-users.

100: electronic device
120: processor
130: memory
140: image sensor
150: input/output device
160: communication interface

Claims (7)

image sensor;
Memory; and
a processor operatively coupled to the image sensor and the memory, the processor comprising:
Detecting the ladle from the image acquired through the image sensor,
Extracting the first identification information of the ladle and the second identification information of the ladle from the image in which the ladle is detected, and
Set to determine the identification information of the ladle based on the first identification information and the second identification information,
The processor, as at least part of the operation of determining the identification information of the ladle,
determining whether the first identification information and the second identification information are the same;
When the first identification information and the second identification information are the same, the first identification information or the second identification information is determined as the identification information of the ladle, and
When the first identification information and the second identification information are not the same, it is set to determine the second identification information as the identification information of the ladle,
The processor, as at least part of the operation of extracting the first identification information and the second identification information of the ladle,
Extracting features from the image in which the ladle is detected,
By recognizing a first identification number consisting of a decimal number included in the first area of the ladle based on the extracted feature, the first identification information is extracted, and
An electronic device configured to extract the second identification information by recognizing a second identification number composed of a 6-digit binary number embossed and patterned in the second area of the ladle based on the extracted feature.
According to claim 1,
The processor, as at least part of the operation of detecting the ladle,
extracting features from the image acquired through the image sensor, and
An electronic device configured to detect a ladle from the image based on the extracted feature.
delete delete delete According to claim 1,
Further comprising an input/output device,
The processor is
When the first identification information of the ladle and the second identification information of the ladle are not extracted from the image in which the ladle is detected, information for guiding that at least one of the ladle or the image sensor is contaminated through the input/output device An electronic device that is set to output.
According to claim 1,
further comprising a communication interface;
The processor is
When the first identification information of the ladle and the second identification information of the ladle are not extracted from the image in which the ladle is detected, information indicating that at least one of the ladle or the image sensor is contaminated through the communication interface is transmitted to an external electronic device. An electronic device that is set up to transmit to the device.

Images