KR102187232B1 - A program for loading information of objects using pattern generation of objects recognized by a camera - Google Patents

Abstract

The present invention is a program for recognizing the object and providing information on the object to a user through image capture of an object having an identification unit, wherein (a) in the simplification module 110, the image of the photographed object is monochromatic The step of being simplified to tone (S100); (b) in the block module 130, a step (S110) in which a first block area 210 is given on the image of the object simplified in step (a) (S100); (c) In the calculation module 150, the first block area 210 including a part of the area of the identification unit is divided into a second block area 230 that is smaller than the size of the first block area 210. Step S120; (d) In the calculation module 150, coordinates are assigned to the positions of each of the second block areas 230, and relative to the second block areas 230 in the one first block area 210 Step (S130) of generating pattern information (D1) of the object by calculating the contrast ratio as a numerical value and assigning a relative value to the coordinates respectively; (e) transmitting the pattern information (D1) of the object calculated in the (d) step (S130) to the database module 170 (S140); And (f) providing, in the database module 170, information on an object matching the pattern information D1 of the object to a user (S150). It provides a program, including.

Description

A program for loading information of objects using pattern generation of objects recognized by a camera}

The present invention is a program that loads information of an object by using pattern generation of an object recognized through a camera, and more particularly, by using the difference in the relative contrast ratio on the image of the object recognized through the camera, the pattern information of the object is It is about the program to be created.

With the development of computer technology and the Internet, too much content is informationized, accumulated and stored. Since such information is not systematically databased according to a unified standard within a single integrated system, the importance of search is also very high, and various search techniques are being developed.

A known search method is to use'text' as a search term. This is a method of presenting content that includes text that is the same or similar to the search word.

For example, even when searching for an image, a search word is input in a text format, and an image combined with text identical or similar to the corresponding text is extracted and presented from the images.

However, there are certain limitations to search by text. For example, let's say a user who has a picture of a piece of clothing wants to search the Internet for it. The only information the user can present is images.

More precisely, the only real information is the image of a specific object (clothing) contained within the photographic image. In this case, the image itself cannot be used as a currently known search method, and the only method is to perform text search after converting the user's interpretation of the image into text.

Meanwhile, Korean Application No. 10-2001-0015695, which is a prior art, discloses an image search method and apparatus. More specifically, a query image, a query image produced by a user, and text (keyword) are 2 Disclosed is a method and apparatus for retrieving images using combinations of more than one sequence.

As described above, conventionally, only a configuration in which text search is inevitable for image search is disclosed, and the user cannot provide the information desired by the user only with the image itself. The need for technologies that can be provided is emerging.

(Patent Document 1) Korean Laid-Open Patent No. 10-2002-0075600

The present invention was devised to solve the above problems.

Specifically, it is intended to propose a configuration in which the user does not need to perform a search using text, and provides information desired by the user through image recognition of objects.

In addition, in the process of recognizing an object, by recognizing the image as a pattern, not as an image itself, it is intended to propose a configuration capable of providing information to a user in a faster time.

An embodiment of the present invention for solving the above problems is a program for recognizing the object and providing information on the object to a user through image capture of an object having an identification unit, (a) a simplified module ( In 110), the step of simplifying the image of the photographed object to a monochrome tone (S100); (b) in the block module 130, a step (S110) in which a first block area 210 is given on the image of the object simplified in step (a) (S100); (c) In the calculation module 150, the first block area 210 including a part of the area of the identification unit is divided into a second block area 230 that is smaller than the size of the first block area 210. Step S120; (d) In the calculation module 150, coordinates are assigned to the positions of each of the second block areas 230, and relative to the second block areas 230 in the one first block area 210 Step (S130) of generating pattern information (D1) of the object by calculating the contrast ratio as a numerical value and assigning a relative value to the coordinates respectively; (e) transmitting the pattern information (D1) of the object calculated in the (d) step (S130) to the database module 170 (S140); And (f) providing, in the database module 170, information on an object matching the pattern information D1 of the object to a user (S150). It provides a program, including.

In addition, the first and second block areas 210 and 230 are both square, and coordinates are assigned to each of the first block areas 210, and in step (c) (S120), the calculation module ( 150), among the first block areas including a part of the area of the identification unit, a first block area in which any neighboring first block area 210 is not included in the area of the identification unit is referred to as a corner block 210c. And, the (d) step (S130) further includes generating the contour pattern information (D2) of the object through the coordinates of the corner blocks 210c, and the (e) step (S140), Further comprising transmitting the contour pattern information (D2) of the object to the database module 170, and before the step (f) (S150), (f0) of the object in the database module 170 It is preferable to further include a step (S142) of first filtering the information on the object through the outline pattern information (D2).

In addition, the first block area 210 is made up of n second block areas 230, and the step (d) (S130) is a second block area in the one first block area 210 ( 230) is preferably given a value of 1 to n, respectively, depending on the relative contrast ratio.

In addition, in the step (d) (S130), the second block regions 230 of the second block regions 230 constituting one of the first block regions 210 having no difference in relative contrast ratio have the same value. It is desirable to be given.

In addition, coordinates are assigned to each of the first block areas 210, and in step (f) (S150), the database module 170, 1 to n assigned in step (d) (S130) The coordinates of the second block area 230 with a specific value between; And it is preferable to match the pattern information D1 of the object and information about the object through the coordinates of the first block area 210 to which the second block area 230 belongs.

In addition, in step (f) (S150), it is preferable that the information on the object provided to the user includes a description and an advertisement on the object.

In addition, the object having the identification unit is photographed by a camera provided in the user's terminal, and information about the object provided to the user is preferably output to the display unit of the user's terminal.

In addition, the identification unit is preferably formed on the outer surface of the object or the packaging package of the object.

In addition, it is preferable that the second block region 230 is formed in units of one pixel.

The program according to the present invention simplifies an image photographed through a camera of a user terminal, divides it into a first block area and a second block area, and then uses the difference in the relative contrast between the second block areas. It has an effect that can be generated by quantifying pattern information of objects.

In addition, by performing the step of first generating contour pattern information of an object using the first block area, it is possible to shorten the processing time in the matching process with information previously stored in the database module. .

1 is a block diagram of a program according to the present invention.
2 is a flowchart of a program according to the present invention.
3 schematically shows a process of partitioning an image of an object using a first block area and a second block area of a program according to the present invention.
FIG. 4 schematically illustrates that the second block area shown in FIG. 3 is numerically calculated according to a difference in relative contrast ratio.
5 schematically illustrates a process of partitioning contour pattern information of an object among the images of the object illustrated in FIG. 3.
FIG. 6 schematically shows the numericalization of the first block area in relation to the process of partitioning the contour pattern information of the object illustrated in FIG. 5.
7 is a use state diagram schematically showing a process of providing information desired by a user to a display unit of a user terminal using a program according to the present invention.

Hereinafter, a program according to the present invention will be described in detail with reference to the drawings. Here, the constituent elements constituting the present invention may be used integrally or separately used as necessary. In addition, some components may be omitted depending on the type of use. Various modifications are possible in the form and number of components of the present invention.

Composition of the program

1 is a block diagram of a program according to the present invention. Referring to FIG. 1, the program according to the present invention includes a simplification module 110, a block module 130, an operation module 150, and a database module 170.

First, the simplification module 110 is a component that simplifies an image of an object photographed through a camera of a user terminal. At this time, the image of the object may be simplified to a monochromatic tone through the simplification module 110, and the monochromatic tone may be determined as a dominant color or a similar tone of the image of the object, and only the difference in the relative contrast ratio exists. do.

Further, the simplification module 110 may be simplified by a filter, and such a filter may be changed by a user's selection.

The block module 130 partitions the first block area 210 made of a virtual line on the image of the object simplified by the simplification module 110, and this partition is independent of the image of the object, and has a square shape. Can be formed as

The calculation module 150 is formed to divide the inside of each first block area 210 into a second block area 230 again, and the second block area 230 may also be formed in a square shape.

Specifically, the length of one side of the first block area 210 having a square shape is N times the length of the side of the second block area 230, and N ² second blocks 230 in the first block area 210 This includes.

In addition, in the calculation module 150, the relative contrast ratio between the N ² second block areas 230 in one first block area 210 is calculated numerically, and the positions of each of the second block areas 230 As coordinates are given for each, a relative value is assigned to each coordinate of the second block areas 230, so that pattern information D1 of an object is numerically generated and generated.

Further, the pattern information D1 of the object generated by the calculation module 150 is transmitted to the database module 170.

Information for identifying the pattern information D1 of an object is previously stored in the database module 170, and this may be stored in the form of meta data.

The database module 170 identifies the pattern information D1 of the object transmitted from the operation module 150, matches it with information stored in advance, and provides information about the object to the user.

Accordingly, the user may obtain information on a description, advertisement, and cautions about the object by outputting information about the object from the display of the user terminal.

Program behavior

2 is a flowchart of a program according to the present invention.

Referring to Figure 2, the program according to the present invention, in the simplification module 110, in the step (S100) of simplifying the image of the photographed object to a monochrome tone, in the block module 130, in the step (S100) In the step (S110) in which the first block area 210 is given on the simplified image of the object (S110), in the calculation module 150, the first block area 210 including a part of the area of the identification unit is The step of dividing into a second block area 230 that is smaller than the size of the first block area 210 (S120), in the calculation module 150, coordinates are assigned to the positions of the respective second block areas 230, , The relative contrast ratio between the second block areas 230 in the one first block area 210 is calculated as a numerical value and a relative value is given to each of the coordinates, thereby generating pattern information D1 of the object. (S130), in the step (S140) of transmitting the pattern information (D) of the object calculated in the step (S130) to the database module 170, and in the database module 170, the pattern information of the object ( It includes a step (S150) of providing information on the object matched to D) to the user.

To describe this in detail, reference is made to FIGS. 3 and 4 together.

First, in step S100, an image of an object photographed by the user's terminal is simplified into a monochrome tone by the simplification module 110. Accordingly, the characters “A” and “A” shown in FIG. 3 also undergo a process of being processed into the same monochromatic tone, unlike the original color, so that the image is converted into an image in which only a difference in relative contrast ratio exists.

In step S110, a first block area 210 is provided, and the first block area 210 is a square shape having the same size, and seamlessly on the image of the object converted by the simplification module 110 It is formed to be divided.

On the other hand, the object photographed through the user's terminal has an identification unit formed in advance, and this identification unit may be formed on the outer surface of the object or may be formed on the packaging package of the object. Certain forms that give the impression of a person can play the role of identification.

In Fig. 3, characters "A" and "A" having a predetermined thickness serve as the identification unit.

In step S120, the first block area 210 including a part of the area of the identification unit is transferred to the second block area 230 which is smaller than the size of the first block area 210 through the calculation module 150. It is partitioned.

In this case, the first block area 210 that does not include part of the area of the identification unit may also be divided into the second block area 230, but the first block area 210 (1 , 4)) may be regarded as an empty space by the calculation module 150.

In step S130, coordinates are given to the positions of each of the second block areas 230 through the calculation module 150, and relative to the second block areas 230 in one first block area 210 The contrast ratio is calculated as a numerical value and a relative value is given to each of the coordinates, thereby generating pattern information D1 of the object.

Specifically, the pattern information D1 of the object is generated through a first block area including a part of the identification unit, and in FIG. 3, a first block area 210 including a part of the identification unit among the first block areas 210 ( 2, 3)).

The first block area 210 (2, 3) is divided into a square second block area 230, and a relative contrast ratio may be different for each second block area 230.

In this case, coordinates are assigned to each of the second block regions 230 in an (x, y) manner, where x denotes a row within the first block region 210 and y denotes a column.

In the calculation module 150, the relative contrast ratio is calculated numerically for each of the second block areas 230, and in the process of calculating the relative contrast ratio numerically, the rank value of the relative contrast ratio between them is the second block. Each of the zones 230 may be assigned.

For example, when the first block area 210 is made up of n second block areas 230, the rank of the relative contrast ratio between the second block areas 230 may be given a numerical value from 1 to n, if, If there is no difference in the relative contrast ratio between the second block regions 230, the same value may be assigned.

In this case, the second block area 230 may be formed of a plurality of pixels, which is a minimum unit, and a numerical value may be assigned based on the area of the identification unit occupying the second block area 230.

In addition, when there is a second block area 230 to which the same value is assigned, when a value is assigned to the second block area 230 of the next priority, the corresponding ranking may be skipped.

In FIG. 4, the relative contrast ratio of the first block area 210 (2, 3) corresponding to the coordinates (2, 3) of the first block area 210 of FIG. 3 is numerically shown.

Of the second block area 230 of FIG. 4, coordinates (1, 3), (1, 4), (2, 4) and (3, 4) all have the same relative contrast ratio as 1, and the coordinates ( Although the relative contrast ratio of the second block regions 230 (4, 4) of 4 and 4) is assigned as 2, as described above, the relative contrast ratio by skipping the ranking corresponding to the same value may be given as 5. .

In this way, each first block area 210 is given a value using the relative contrast ratio between the second block areas 230 constituting it, and these values are again the coordinates of the first block area 210 By combining, the final object pattern information D1 is generated.

In step S140, the pattern information D1 of the object generated in step S130 is transmitted to the database module 170, which is preferably automatically transmitted through a wireless communication network.

In step S150, information on an object matching the received object pattern information D1 is loaded from the database module 170, and is wirelessly provided to the user. Information can be obtained.

On the other hand, in step (S120), the calculation module 150, among the first block area 210b including a part of the area of the identification unit, the area of the identification unit in any one of the neighboring first block areas 210 It may be determined that the first block area not included in the corner block 210c.

In this case, the step (S130) further includes generating the contour pattern information (D2) of the object through the coordinates of the corner blocks (210c), step (S140), the contour pattern information (D2) of the object Is transmitted to the database module 170.

To this end, prior to step S150, the database module 170 may further include a step S142 of first filtering information on the object through the contour pattern information D2 of the object.

For specific description, referring to FIGS. 5 and 6, the image of the object simplified in step S100 is composed of first block areas 210 to which coordinates are assigned, and a first area in which a part of the identification unit is not included. It consists of a block area 210a and a first block area 210b and 210c including at least a part of the identification area.

In this case, the first block area including at least a part of the area of the identification unit includes a corner block 210c, which is a first block area not included in the area of the identification unit, and the adjacent first block area 210 Any one of 1 blow area 210 is composed of a first block area 210b included in the area of the identification unit.

The corner block 210c is related to the contour of the identification unit, and through the coordinates of the corner block 210c, the contour pattern information D2 of the object may be generated. In the case of FIG. 5, coordinates (1, 2) ), (1, 3), (2, 1), (2, 3), (3, 1), (3, 4), (4, 2) and (4, 3) It is a block 210c, and generates contour pattern information D2 of an object through the coordinates.

In this way, prior to step S150, when the object pattern information D1 is matched on the database module 170 by first filtering information on the object through the contour pattern information of the object, the database module By reducing the number of targets to be matched with the object pattern information D1 stored in advance in 170, the speed of the matching process can be increased.

In addition, this process, as shown in FIG. 6, assigns a value of 1 to the first block area including even a part of the identification unit among the first block area 210, and the first block that does not include any part of the identification unit. By assigning a value of 0 to the zone, this can be simplified and quantified.

7 is a use state diagram schematically showing a process of providing information desired by a user to a display unit of a user terminal using a program according to the present invention.

Referring to FIG. 7, when the user acquires an image by photographing the outer surface of an object using a camera provided in the terminal, the identification unit is automatically determined by the above-described steps, and matching in the database module 170 After performing the process, the database module 170 may provide information about the object to the user.

In this case, providing information on the object to the user may be provided to the display unit of the user terminal using a wireless communication network, and is implemented on the display unit through various methods such as images, texts, and videos. In addition, information about the object may be provided by voice through the voice output unit of the user terminal.

In the above, the present specification has been described with reference to the embodiments shown in the drawings so that those skilled in the art can easily understand and reproduce the present invention, but this is only exemplary, and those skilled in the art can use various modifications and equivalents from the embodiments of the present invention. It will be appreciated that embodiments are possible. Therefore, the scope of protection of the present invention should be determined by the claims.

100: Program 110: Simplification Module
130: block module 150: calculation module
170: database module 210: first block area
230: second block area

Claims (9)

As a program for providing information on the object to a user by recognizing the object by taking an image of an object having an identification unit,
(a) In the simplification module 110, the step of simplifying the captured image of the object to a monochrome tone (S100);
(b) in the block module 130, a step (S110) in which a first block area 210 is given on the image of the object simplified in step (a) (S100);
(c) In the calculation module 150, the first block area 210 including a part of the area of the identification unit is divided into a second block area 230 that is smaller than the size of the first block area 210. Step S120;
(d) In the calculation module 150, coordinates are assigned to the positions of each of the second block areas 230, and relative to the second block areas 230 in the one first block area 210 Step (S130) of generating pattern information (D1) of the object by calculating the contrast ratio as a numerical value and assigning a relative value to the coordinates respectively;
(e) transmitting the pattern information (D1) of the object calculated in the (d) step (S130) to the database module 170 (S140); And
(f) providing, in the database module 170, information on an object matching the pattern information D1 of the object to a user (S150); Including,
Both the first and second block areas 210 and 230 are in a square shape, and coordinates are assigned to each of the first block areas 210,
In the step (c) (S120), the calculation module 150 includes any one of the first block areas in which a portion of the area of the identification unit is included, the area of the identification unit if any of the neighboring first block areas 210 are It is determined that the first block area not included in the corner block 210c,
The step (d) (S130) further includes generating the contour pattern information (D2) of the object through the coordinates of the corner blocks (210c),
The (e) step (S140) further includes transmitting the outline pattern information (D2) of the object to the database module 170,
Before step (f) (S150),
(f0) first filtering information on the object through the contour pattern information D2 of the object in the database module 170 (S142); a method further comprising,
A program stored on a computer-readable recording medium.
delete The method of claim 1,
The first block area 210 consists of n second block areas 230,
The (d) step (S130),
In the second block area 230 in the one first block area 210, a method in which values of 1 to n are respectively assigned according to the relative contrast ratio is performed,
A program stored on a computer-readable recording medium.
The method of claim 3,
The (d) step (S130),
Among the second block areas 230 constituting one of the first block areas 210, the second block areas 230 having no difference in relative contrast ratio are assigned the same value.
A program stored on a computer-readable recording medium.
The method of claim 3,
Coordinates are assigned to each of the first block areas 210,
In the step (f) (S150), the database module 170,
The coordinates of the second block area 230 having a specific value between 1 and n assigned in step (D) S130; And
Through the coordinates of the first block area 210 to which the second block area 230 belongs,
A method of matching the pattern information D1 of the object and information about the object is performed,
A program stored on a computer-readable recording medium.
The method of claim 1,
In the (f) step (S150), the information on the object provided to the user is performed by a method including a description and advertisement on the object,
A program stored on a computer-readable recording medium.
The method of claim 6,
The object having the identification unit is photographed by a camera provided in the user's terminal, and information about the object provided to the user is output to the display unit of the user's terminal.
A program stored on a computer-readable recording medium.
The method of claim 1,
The identification unit is formed on the outer surface of the object or is formed on the packaging package of the object is performed,
A program stored on a computer-readable recording medium.
The method of claim 1,
The second block region 230 is formed in units of one pixel,
A program stored on a computer-readable recording medium.

Images