KR20130006878A - Method for restoring an image of object using base marker in smart device, and smart device for restoring an image of object using the base marker - Google Patents

Abstract

PURPOSE: Object image reconstruction method using base markers in smart device and the smart device reconstructing object image using the base markers are provided for sellers to photograph picture of product which adhered the base markers, thereby provide detailed information about the product and primitive color of the product to consumer. CONSTITUTION: User takes a picture of object through camera of smart device. Processor of the smart device inputs identifying information of base markers included in the object picture(S310). The processor detects the base markers from the object picture(S320). The processor obtains size and color data of base markers from the extracted base markers(S330). The smart device receives desired length measured position and color extraction location information from the user(S340). The processor calculates size and color information of object corresponding to the inputted position information(S350). [Reference numerals] (AA) Start; (BB) End; (S310) Acquiring a target photo, inputting basic marker identification information; (S320) Detecting a basic marker from a target photo; (S330) Acquiring color and size data of a basic marker; (S340) Inputting a color extraction position, a length measuring position of an object; (S350) Restoring color information and an object length by calculating errors between color information and basic marker size recognition; (S360) Outputting colors and a length of a restored object

Description

Method for restoring an image of object using base marker in smart device, and smart device for restoring an image of object using the base marker}

The present invention relates to restoring an object image in a smart device, and more particularly, to a method for restoring an object image using a basic marker and a smart device for restoring an object image using the basic marker.

Recently, as a high resolution camera is mounted on a smart device, a technology for recognizing an object using a camera, using a character, a symbol, a code, or servicing a virtual augmented reality has been actively progressed. Representative conventional techniques include photographing paper cards to automatically extract personal information contained in business cards, or recognizing information stored in one-dimensional barcodes and two-dimensional QR codes, based on geographic information, Augmented reality technology that identifies things and shows additional information.

However, in order to recognize an object using a conventional technology or to recognize a symbol and a code including specific information, there is a problem of precisely adjusting a focus and an area by artificially adjusting a distance between the camera and the object.

In the prior art, it is difficult to accurately calculate a distance between a camera and an object, and it is difficult to calculate a raw size of an actual object, and thus, a tool having an additional standard size is required in a smart device service that needs to recognize a raw size.

In addition, the prior art has a problem that the color value can not be obtained accurately in the field of application services for extracting the circular color due to the deformation or distortion of the raw color of the object photographed by the camera under the influence of external light.

The problem to be solved by the present invention is that it is difficult to accurately calculate the distance between the camera and the object when shooting the object with a camera built into the smart device, it is difficult to calculate the raw size of the object, the color of the raw state of the object accurately due to the external brightness To solve the problem of difficult to extract data about the information (color, saturation, brightness), and to recover the raw color values of objects transformed by external light and the technology of calculating the distance between the camera and the object of the smart device described above To this end, it provides standardized auxiliary markers including step size and color values essential for image recognition so that the markers can be attached to the object to be recognized or placed in a neighboring position and photographed together to accurately recognize the size and color of the object. To provide a method for restoring an object image using a basic marker in a smart device.

Another object of the present invention is to provide a smart device for restoring an object image by using the basic marker.

The present invention also provides a recording medium that can be read by a processor of a smart device that records a program for executing the object image restoration method using the basic marker on the smart device.

In the object image restoration method using the basic marker according to the characteristics of the present invention for achieving the above object, by taking a target picture or download the target picture, the smart device is a public basic marker of the target picture data and the target picture Obtaining information; Detecting a basic marker included in the target photograph by a processor executing an application program stored in the smart device; Comparing, by the processor, the detected basic marker with the published basic marker information, recognizing the size of the detected basic marker and calculating an error of color information; And displaying, by the processor, the object on the smart device by reflecting the calculated error of the size and color information to the object included in the target picture.

In accordance with an aspect of the present invention, there is provided a method for restoring an object image using a basic marker, wherein the smart device obtains the target photo data by capturing a target photo or downloading the target photo. Inputting identification information of an open basic marker included in the target photograph into a smart device when there are a plurality of marks; (b) detecting, by a processor executing an application program stored in the smart device, the basic marker included in the target picture; (c) the processor obtaining the size and color data of the base marker from the extracted base marker; (d) receiving location information of an object that the user wants to restore from the target picture from the user; (e) recognizing the size of the extracted base marker by comparing the size and color information of the published base marker corresponding to the identification information input in step (a) with the size and color data obtained in step (c); Calculating the size and color information of the object corresponding to the position information of the object input in the step (d) by calculating an error of the color information; (f) outputting the calculated size and color information of the object to the smart device.

In order to achieve the above object, a smart device for restoring an object image using a basic marker according to a feature of the present invention includes: a photo file storage unit for obtaining and storing target photo data; A user interface unit receiving identification information of an open base marker included in the target picture when the base marks are plural, and receiving location information of an object that the user wants to restore from the target picture; Detecting the basic marker included in the target picture to calculate the size and color data of the basic marker, and corresponds to the calculated size and color data of the basic marker and the identification information of the basic marker input through the user interface unit Comparing the size and color data of the base marker to recognize the size of the detected base marker and calculate the error of the color information to calculate the size and color information of the object corresponding to the position information of the object input through the user interface unit A processor executing an application program; And an object output unit configured to output the calculated size and color information of the object.

The application program includes a basic marker detection module for detecting a basic marker included in the target picture; A basic marker recognition module for calculating size and color data of the basic marker from the extracted basic marker; And comparing the calculated size and color data of the basic marker with the size and color data of the published basic marker corresponding to the identification information input from the user interface unit to recognize the detected size of the basic marker and to obtain an error of the color information. And an object image restoration module for calculating a size and color information of the object corresponding to the position information of the object input through the user interface unit.

The present invention also provides a recording medium that can be read by a smart device that records a program for executing the above-described invention on a smart device.

According to the method for restoring an image of an object using a basic marker and a smart device for restoring an object image using the basic marker according to the present invention, in an online shopping mall, a seller may provide a consumer with information about an accurate size and color of a product. To do so, the user can purchase a product having the size and color desired by the user by attaching the basic marker to take a picture and providing information about the detailed length, angle and area of the product and the raw color of the product.

In addition, according to the present invention, after photographing road signs and signboards using a camera, noise is removed from a photograph taken in an application requiring accurate recognition of letters and symbols, or by distinguishing the correct colors of letters or symbols. It is very useful in the field of recognition, and it is possible to read the information accurately by artificially adjusting the distance by photographing the base marker at the neighboring positions of the 1D barcode and the 2D QR code.

In addition, according to the present invention, by using a portable smart device to restore the exact color of the object deformed by various external lighting in the field of recognizing the correct skin color in the jaundice disease of the newborn, or inspecting defective products in an automated factory system This can minimize errors in more accurate medical services and rejects.

1 is a block diagram of a smart device for providing a method for restoring the original size and color of an image captured by using a basic marker according to an embodiment of the present invention.
2 shows a block diagram of the modules that make up the application 142.
3 is a flowchart illustrating a method of restoring the original size and color of an image photographed object by using a basic marker according to an embodiment of the present invention.
4A illustrates a detailed flow of step S320 in a method of restoring the original size and color of an image photographed object using a basic marker according to an embodiment of the present invention.
4B is a diagram illustrating a detailed flow of step S330 in a method of restoring the original size and color of an image photographed object using a basic marker according to an embodiment of the present invention.
FIG. 5 illustrates a screen for setting a step and a unit of a marker in a smart device for capturing an image by using a basic marker according to an embodiment of the present invention.
FIG. 6 is a diagram illustrating a configuration of a color of a basic marker and a ratio of the total area of the foundation marker according to the exemplary embodiment of the present invention.
FIG. 7 illustrates a screen representing information on horizontal, vertical, area, and three primary colors (R / G / B) of an object photographed by using a smart device using a basic marker according to a temporary embodiment of the present invention. .
FIG. 8 illustrates a situation of photographing with a smart device and transmitting a calculated screen to a smart device of another person by using a basic marker according to a temporary embodiment of the present invention.
FIG. 9 illustrates a situation of recognizing a road sign, a signage, a one-dimensional barcode, and a two-dimensional QR code by a smart device using a basic marker according to one embodiment of the present invention.
FIG. 10 illustrates a stand type, a mobile phone ring type, a sticker type, and a plastic chip shape of various sizes as various types of basic markers according to one embodiment of the present invention.
FIG. 11 illustrates a situation in which a seller photographs a product in an internet shopping mall and provides information on an accurate size and color of the product on an internet screen by using a basic marker according to an embodiment of the present invention.
FIG. 12 illustrates a situation in which the color and the size of the object are accurately recognized and used for education by photographing together with plants and animals by using a smart device and a basic marker according to one embodiment of the present invention.
FIG. 13 illustrates a situation in which accurate numerical information on jaundice of a newborn is collected by using a smart device and a basic marker according to one embodiment of the present invention.
FIG. 14 illustrates a situation of recognizing a defective product for a component moving in a conveyor belt of a production plant using a basic marker according to one embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. In the following detailed description of the preferred embodiments of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. In the drawings, like reference numerals are used throughout the drawings.

In addition, in the specification, when a part is 'connected' to another part, it is not only 'directly connected' but also 'indirectly connected' with another element in between. Include. In addition, the term "comprising" a certain component means that the component may further include other components, except for the case where there is no contrary description.

First, terms used in the present invention will be defined. The base marker used in the present invention refers to a label having a size and a color, and the shape and the color may be variously modified. 6 illustrates an example of the base marker. In addition, the basic marker is open so that its shape and color information can be shared among users. In addition, the object picture used in the present invention refers to a picture taken together with the object to know the size and color using the base marker and the base marker.

In addition, the smart device according to the present invention refers to a device which is not limited in function and can change or expand a substantial part of the function through an application program, and may be a smart phone, a tablet PC, a portable computer, and a desktop computer. However, the smart device according to the present invention is not limited to the above-described devices, and if the original size and color of an image photographed object can be restored and provided by utilizing the basic marker of the present invention, the present invention can be used regardless of the form. Can act as a smart device.

1 is a block diagram illustrating a configuration of a smart device for restoring an image of an object using a basic marker according to an embodiment of the present invention, wherein the photo file storage unit 110, the processor 120, and the user interface unit ( 130 and the output unit 150, and may further include a camera 160.

The photo file storage unit 110 obtains and stores the target photo data.

In order to know the size or color of an object using a basic marker, a user of the smart device needs a photo taken with the basic marker and the object first, and the smart device user needs to directly photograph the target photo or the target photo file. . And the size of the base marker included in the target picture is preferably provided when the target picture is generated. For example, when a photograph taken together with a basic marker and a product is provided in a web page or a homepage in an online shopping mall, size information of the basic marker is provided in advance.

The user interface 130 receives identification information of the open base marker included in the target picture when the base marks are plural, and receives location information of an object that the user wants to restore from the target picture. The user interface unit 130 performs input / output with a touch screen provided in the smart device of the present invention, receives an input signal from the smart device user, and provides calculated information. In this case, the input may be made of a remote control device such as a mouse and a keyboard, not a touch screen, and the output may be transmitted as a video message or an image file to a screen and another smart device output through the screen. have.

The processor 120 extracts the basic marker included in the target picture to calculate the size and color data of the basic marker, and calculates the size and color data of the calculated basic marker and the basic marker input through the user interface unit. Compare the size and color data of the base marker corresponding to the identification information to recognize the size of the extracted base marker, calculate the error of the color information and the size of the object corresponding to the location information of the object input through the user interface unit and An application program 142 for calculating color information is executed.

2 is a block diagram illustrating a module constituting an application program 142. The application program 142 is stored in a memory 140 of a smart device, and includes a basic mark detection module 210 and a basic marker recognition module ( 220) and the object image restoration module 230.

The basic marker detection module 210 detects information on the basic marker included in the target picture. The base marker information includes an outline, a color, and the like of the base marker. The basic marker detection module 210 acquires the brightness, shadow, curvature, etc. of the photographed image input from the camera 100 when the basic marker is detected, and detects the outline and color of the basic marker.

The basic marker recognition module 220 calculates the size and color data of the basic marker from the extracted basic marker. The object image restoration module 230 compares the calculated size and color data of the basic marker and the size and color data of the published basic marker corresponding to the identification information input from the user interface unit, thereby detecting the size of the detected basic marker. Recognize and calculate the error of the color information to calculate the size and color information of the object corresponding to the position information of the object input through the user interface.

The output unit 150 outputs the size and color information of the calculated object.

The camera 160 is a camera or a general digital camera provided in a smart device according to an embodiment of the present invention. The camera 160 photographs a target object and recognizes a basic marker. In the present invention, the shape of the basic marker is detected from the photographed picture, and the length and the color are calculated using the detected information of the basic marker. At this time, the camera 160 photographs the basic marker and the target object to provide a picture.

3 is a flowchart illustrating a method of restoring an image of an object using a basic marker according to an embodiment of the present invention, and with reference to FIGS. 1 to 3, an image of an object using a basic marker according to an embodiment of the present invention. The restoration method, that is, a method of restoring the original size and color of the photographed object will be described.

Taking the target picture or downloading the target picture file through the camera 160 and storing the target picture file in the picture file storage unit 110, and when the plurality of the base marks are plural, the target picture through the user interface 130. Input identification information of the included basic marker to the smart device (step S310). Here, information about the basic marker included in the target picture is provided to the user. For example, in the case of a target photograph where a product is photographed together with a basic marker in an online shopping mall, information of the basic marker, for example, size information and color information, is provided to the user. The smart device user inputs the information of the basic marker included in the target picture to his smart device through the user interface 130. The base marker used in the present invention may be provided in various sizes and may be provided in various ways, and the person providing the target photo and the person using the target photo share information of the basic mark. In addition, the smart device user may preset the size unit of the object through the user interface 130 when the size of the desired object is displayed on the smart device using the basic marker. For example, when there is an object photograph taken with the basic marker and clothes, when displaying the size and color of the clothes, and when the size of the clothes is to be viewed in mm or cm, the expression unit to be measured in advance Can be set in mm or cm.

After the basic mark information and the length representation unit are set as described above, and the target photograph is input to the smart device, the processor 120 for executing the application program stored in the smart device is executed by the basic mark detection module of the application program 142. The basic marker included in the target photograph is detected by executing 210. (S320) The basic marker detection may be performed by detecting an outline of the basic marker from the target photograph. In more detail, the outline information is detected by analyzing the colors of the pixels constituting the target picture, and the outline information of the base marker can be detected by comparing the outline information of the pre-opened public marker and the detected outline information. Can be. 4A is a flow chart that describes step S320 in more detail. Referring to FIG. 4A, in order to detect a basic marker from a target picture input from a smart device, first, an outline of all objects in the target picture is detected from the target picture of the smart device. Detects the outlines of all objects, including base markers and objects adjacent to the target object. The outline may be detected by analyzing the color of the pixels constituting the target picture by the detection algorithm of the basic marker detection module 210. When an outline of all objects in the target picture is detected as described above, a base marker is detected from the detected outlines (step S420). The outline of the base marker includes outline information of a previously input published base marker and the detected outline. By comparing the information and measuring the similarity, it is possible to detect the outline of the base marker.

The processor 120 acquires the size and color data of the basic marker from the extracted basic marker by executing the basic marker recognition module 220 of the application program using the detected outline of the basic marker. )

FIG. 4B is a flowchart illustrating the details of the step S330, and may include a step S450 of detecting the size of the base marker, and may further include a step S460 of detecting the color of the base marker. .

The processor 120 of the smart device may recognize the size of the basic marker through the basic marker recognition module 220 from the information of the basic marker input to the smart device and the detected outline information of the basic marker. That is, the detected size of the outline of the base marker may be calculated by a conventional measurement algorithm of the base marker recognition module 220 of the application program. For example, if the detected outline size is 10 pixels by the measurement algorithm, the size of one pixel may be calculated based on the basic marker information input by the user. For example, if the size of the base marker input by the user is 10 cm, and the detected size of the outline of the base marker corresponds to 10 pixels, one pixel size is 1 cm.

And the color of the base marker can be detected as follows. Referring to step S520 of FIG. 5, the color of the base marker may be detected as an RGB value from the information of the base marker received in step S310 and the outline information of the detected base marker. The color value may be calculated by the measurement algorithm of the basic marker recognition module 220, and may be detected as a color error value of the real world through the internal information and the pixel value of the outline information. That is, the color error value may be detected by comparing pixel values of pixels existing in the detected basic marker outline with those of pixels constituting the basic marker input in operation S310.

In this way, the user's smart device secures a standard for size and color through the basic marker, and then, via the user interface 130, location information of the object that the user wants to restore from the target picture, that is, the desired length measurement position from the user. And color extraction location information (step S340). The user may input a length and color coordinates of a desired location and receive a result value of the corresponding location.

In order to provide the length and color of the specific part of the target object that the user wants to know, when the user specifies the object to know the length in the target picture, the user calculates the length of the object corresponding to the specified location information. Will be displayed to. In addition, when the user specifies a specific part of the object to know the color in the target picture, the color for the specified location information is calculated and displayed to the user.

In order to display the length of the object with respect to the specified location information to the user, the processor 130 executes the object image restoration module of the application program, as described above, the size and color data obtained in step S330 and the step S310. The object corresponding to the location information of the object input in step S340 by comparing the size and color information of the published basic marker corresponding to the identification information input in step S340 and using the error of the calculated color information. Calculate the size and color information of the (S350 step).

The calculated size and color information of the object is output through the output unit 150 of the smart device. (Step S360) The smart device output may be displayed on the screen of the smart device or transmitted to a smart device of another person. . The information on the target object output in step S360 may include a value for inputting the length of the user and information on inputting color coordinates of the user. In addition, the smart device can visually output information about an object since visual output or message output is possible.

FIG. 5 is a diagram illustrating a process of selecting and displaying a size of a basic marker by a user in a method of restoring the original size and color of an image captured by using a basic marker according to an embodiment of the present invention, and a unit according to length 501. ), A configuration screen for selecting a country 502, and the like. In the present invention, when there are a plurality of basic markers as described above, the size can be selected.

FIG. 6 is a diagram illustrating a color configuration of a basic marker and a ratio of the total area according to an embodiment of the present invention.

FIG. 7 illustrates an accurate length 700 of an object, a value 702 of a raw color, and an inclination 701 that may be used in terms of a method of restoring a raw size and color of an image photographed by using a basic marker. FIG. 8 illustrates a screen displaying a value on a smart device, and FIG. 8 illustrates a screen on which a calculated value of a photographed object is transmitted to a smart device of another person (703) and output on the screen.

9 illustrates a situation of recognizing a road sign, a signage, a one-dimensional barcode, and a two-dimensional QR code by a smart device using a basic marker according to a temporary embodiment of the present invention. And Figure 10 shows the shape of the plastic chip of various types of stand-type, mobile phone ring, sticker, various sizes as the basic marker in accordance with one embodiment of the present invention.

FIG. 11 illustrates a situation in which a seller photographs a product in an internet shopping mall and provides information on an accurate size and color of the product on an internet screen by using a basic marker according to an embodiment of the present invention. FIG. 12 illustrates a situation in which the color and the size of the object are accurately recognized and used for education by photographing together with plants and animals by using a smart device and a basic marker according to one embodiment of the present invention.

FIG. 13 illustrates a situation in which accurate numerical information on jaundice of a newborn is collected by using a smart device and a basic marker according to one embodiment of the present invention. FIG. 14 illustrates a situation of recognizing a defective product for a component moving in a conveyor belt of a production plant using a basic marker according to one embodiment of the present invention.

According to the method of the present invention, the basic marker tool including the standard size and color information of each stage is attached to or adjacent to the object and photographed together to calculate the exact distance from the object, the geographical position in terms of the photographed object, the size of the external light, It can be implemented by the smart device embedded software to restore the original color of the object damaged by the brightness of the.

The present invention can be embodied as code that can be read by a computer (including all devices having an information processing function) in a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored. Examples of computer-readable recording devices include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

110: picture file storage unit 120: processor 130: user interface unit
140: memory 142: application program 150: output unit
160: camera 600: foundation marker
610: Indicator indicating direction in the foundation marker
611: gray border 704: two-dimensional QR code
705: one-dimensional barcode 710: basic marker in the form of a stand
720: basic marker in the form of a portable ring 730: basic marker in the form of a sticker
740: set of base markers of various sizes and shapes

Claims (10)

When the cover of which size and color information is disclosed is called a basic marker, and an object having the size and color and the photograph taken together with the basic marker are called a target photograph, the target photograph is taken or the target photo is downloaded and downloaded. Acquiring, by a device, the subject photo data and the published basic marker information of the subject photo;
Detecting a basic marker included in the target photograph by a processor executing an application program stored in the smart device;
Comparing, by the processor, the detected basic marker with the published basic marker information, recognizing the size of the detected basic marker and calculating an error of color information; And
And displaying, by the processor, the object on the smart device by reflecting the calculated error of the size and color information to the object included in the target picture, on the smart device. Restore method.
The method of claim 1,
When there are a plurality of published basic markers, basic marker identification information for identifying the plurality of basic marks is provided to a smart device user, and the smart device user further inputs the basic marker identification information to the smart device. Method for restoring an image of an object using a basic marker in a smart device comprising a.
(a) When the cover of which size and color information is disclosed is called a base marker, and an object having a size and color and a picture taken together with the base marker is a target photo, the target photo is taken or the target photo is taken. Downloading and acquiring the target photograph data by the smart device, and inputting identification information of the published basic marker included in the target photograph into the smart device when the base mark is plural;
(b) detecting, by a processor executing an application program stored in the smart device, the basic marker included in the target picture;
(c) the processor obtaining the size and color data of the base marker from the extracted base marker;
(d) receiving location information of an object that the user wants to restore from the target picture from the user;
(e) recognizing the size of the extracted base marker by comparing the size and color information of the published base marker corresponding to the identification information input in step (a) with the size and color data obtained in step (c); Calculating the size and color information of the object corresponding to the position information of the object input in the step (d) by calculating an error of the color information;
and (f) outputting the calculated size and color information of the object to a smart device.
The method of claim 3, wherein step (a)
The method for restoring an image of an object using a basic marker in a smart device, further comprising setting a size unit when outputting the size of the object in the step (f).
The method of claim 3, wherein in step (b) the detection of the base marker is
Analyzing the colors of the pixels constituting the target picture to detect outline information, and comparing the detected outline information with outline information of a previously input published basic marker and selecting a high degree of similarity. Image restoration method of object using basic marker in smart device.
The method of claim 3, wherein in step (f) the smart device output
Method for restoring an image of an object using a basic marker in a smart device, comprising displaying on a screen of a smart device or transmitting a video message or a file to another smart device.
A picture file storage unit for acquiring and storing the target picture data when the cover having the size and color information is disclosed as a base marker and an object having a size and color and a picture taken together with the base marker are a target picture. ;
A user interface unit receiving identification information of an open base marker included in the target picture when the base marks are plural, and receiving location information of an object that the user wants to restore from the target picture;
Detecting the basic marker included in the target picture to calculate the size and color data of the basic marker, and corresponds to the calculated size and color data of the basic marker and the identification information of the basic marker input through the user interface unit Comparing the size and color data of the base marker to recognize the size of the detected base marker and calculate the error of the color information to calculate the size and color information of the object corresponding to the position information of the object input through the user interface unit A processor executing an application program; And
Smart device for restoring the image of the object using the basic marker, characterized in that it comprises an object output unit for outputting the calculated size and color information of the object.
The method of claim 7, wherein
Further comprising a camera for taking the target picture,
The photo file storage unit
Smart device for restoring the image of the object using the base marker, characterized in that for storing the target picture taken by the camera.
The method of claim 7, wherein the application program
A basic marker detection module for detecting the basic marker included in the target photograph;
A basic marker recognition module for calculating size and color data of the basic marker from the extracted basic marker; And
By comparing the calculated size and color data of the basic marker and the size and color data of the published basic marker corresponding to the identification information input from the user interface unit to recognize the size of the detected basic marker and to correct the error of the color information. And an object image restoration module configured to calculate and calculate size and color information of the object corresponding to the position information of the object input through the user interface unit.
A recording medium readable by a smart device having recorded a program for executing the invention according to any one of claims 1 to 6 on a smart device.

Images