KR101835780B1 - System for providing information according to thing recognition used Personal Response Code - Google Patents

Abstract

The present invention relates to an object recognition information providing system using a PR code. The present invention is to increase user convenience by providing additional information necessary for users only by an object recognition without requiring an extra additional search by extracting text information and/or shape information included in a scanned image and additional information matched with the location information of a user terminal from a data server and providing the extracted information for a user terminal. To this end, the object recognition information providing system using a PR code disclosed by the present invention includes: a data transmission/reception unit which receives location information and scanned images transmitted from a user terminal; a recognition unit which receives the scanned image and extracts text information included in the scanned image; and a matching unit which receives text information from the recognition unit, receives location information from the data transmission/reception unit, and extracts additional information matched with location information and text information from information stored in a data server, wherein the extracted additional information is transmitted to the user terminal through the data transmission/reception unit.

Description

[0001] The present invention relates to a system for providing object identification information using a PR code,

The present invention relates to a system for recognizing an object, and for providing additional information extracted by combining the shape, color and text of the recognized object with position information.

In a user terminal such as a mobile phone or a smart phone, various information searches can be performed through the Internet or an application. However, in such information retrieval, it is general to use keywords such as a text form to use products, personal information, and business information.

In addition, in order to obtain information about an object in which the user has image information or a search is required, the text information contained in the image or object may be separately searched by a text format keyword, or a business name, a product name, There is an inconvenience in obtaining additional information.

In addition, the QR Code (Quick Response Code) can be published or attached by issuing a code containing the information desired by the information provider to a combination of formulated machine words, and when the QR code issued is scanned, the information contained in the QR code Can be confirmed. Such a QR code includes information, but a QR code is required to use it.

SUMMARY OF THE INVENTION The present invention has been made to overcome the above-mentioned problems of the prior art, and it is an object of the present invention to provide an information processing apparatus and method, Extracting and providing the extracted information to the user terminal, it is possible to provide additional information necessary for the user only by recognizing the object without requiring additional search or the like, and thus provides the object recognition information providing system using the PR code .

According to an aspect of the present invention, there is provided a system for providing object recognition information using a PR code, the system comprising: a data transceiver for receiving a scanned image and position information transmitted from a user terminal; A recognizing unit that recognizes text information included in the scanned image; and a recognizing unit that receives the text information from the recognizing unit, receives the position information from the data transmitting and receiving unit, And a matching unit for extracting additional information matched with the location information, and the extracted additional information can be transmitted to the user terminal through the data transmitting and receiving unit.

The recognition unit may recognize the text information and the shape information on the overall shape and color of the product when the scanned image includes the entire product shape in addition to the text.

The recognition unit may include a text recognition unit that extracts the text information included in the scanned image, and a shape recognition unit that recognizes the shape information that is the overall shape of the product included in the scanned image.

The matching unit receives the text information and the shape information from the recognition unit, receives the position information from the data transmission / reception unit, and selects the text information, the shape information, and the position information Additional information to be matched can be extracted.

Wherein the matching unit extracts product addition information on a product corresponding to the text information and the shape information from information stored in the data server and stores store addition information, which is information on a store using the same text as the text information, Information, and provide the extracted data to the user terminal through the data transmission / reception unit.

The scanned image may be an image recognizing an object including a mutual name, a trademark, a logo, a billboard, a business card, a book cover, and an album jacket displayed on the dedicated program screen after executing the dedicated program in the user terminal.

If the text information is vast or contains personal information, the matching unit may extract additional information that matches 90% or more of the information stored in the data server with the text information, and transmit the extracted additional information to the user terminal through the data transmitting / receiving unit.

The additional information may include at least one of text, image, video and music streaming, location information, a map, and a specific page link.

The object identification information providing system using the PR code according to the present invention extracts the text information and / or the shape information included in the object and the additional information matched with the location information of the user terminal from the data server and provides the extracted information to the user terminal, It is possible to provide the additional information necessary for the user only by recognizing the object without requiring additional search or the like, thereby increasing the convenience of the user.

Further, in the object recognition information providing system utilizing the PR code according to the present invention, when the scanned image includes personal information such as a business card, additional information matching at least 90% with the text information included in the scanned image is stored in the data server And provides the extracted information to the user terminal. Thus, the additional information about the individual described in the plurality of business cards held can be easily provided, and the individual of the business card that can not be memorized can be identified and the convenience can be increased.

1 is a block diagram illustrating a network connection relationship of a system for providing object identification information using a PR code according to an exemplary embodiment of the present invention.
Fig. 2 is a block diagram showing an enlarged relationship between the configuration of the recognition unit and other configurations in the object recognition information providing system utilizing the PR code of Fig. 1;
3A to 3C are examples of scanned images transmitted from the user terminal of FIG.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The embodiments of the present invention are described in order to more fully explain the present invention to those skilled in the art, and the following embodiments may be modified into various other forms, It is not limited to the embodiment. Rather, these embodiments are provided so that this disclosure will be more faithful and complete, and will fully convey the scope of the invention to those skilled in the art.

In the following drawings, thickness and size of each layer are exaggerated for convenience and clarity of description, and the same reference numerals denote the same elements in the drawings. As used herein, the term "and / or" includes any and all combinations of one or more of the listed items. In the present specification, the term " connected "means not only the case where the A member and the B member are directly connected but also the case where the C member is interposed between the A member and the B member and the A member and the B member are indirectly connected do.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms "a," "an," and "the" include singular forms unless the context clearly dictates otherwise. Also, " comprise "and / or" comprising "when used herein should be interpreted as specifying the presence of stated shapes, numbers, steps, operations, elements, elements, and / And does not preclude the presence or addition of one or more other features, integers, operations, elements, elements, and / or groups.

Although the terms first, second, etc. are used herein to describe various elements, components, regions, layers and / or portions, these members, components, regions, layers and / It is obvious that no. These terms are only used to distinguish one member, component, region, layer or section from another region, layer or section. Thus, a first member, component, region, layer or section described below may refer to a second member, component, region, layer or section without departing from the teachings of the present invention.

It is to be understood that the terms related to space such as "beneath," "below," "lower," "above, But is used for an easy understanding of other elements or features. Terms related to such a space are for easy understanding of the present invention depending on various process states or use conditions of the present invention, and are not intended to limit the present invention. For example, if an element or feature of the drawing is inverted, the element described as "lower" or "below" will be "upper" or "above." Therefore, "lower" is a concept covering "upper" or "lower".

Further, the matching unit and / or other related configurations in accordance with the present invention may be implemented using any suitable hardware, firmware (e.g., on-demand semiconductor), software, or any appropriate combination of software, firmware, and hardware. For example, various components of the matching unit and / or other related configurations according to the present invention may be formed on one integrated circuit chip or on a separate integrated circuit chip. In addition, the various components of the matching portion may be separately implemented on the flexible printed circuit film and formed on the same substrate as the tape carrier package, the printed circuit board, or the matching portion. The various components of the matching unit may also be processes or threads running on one or more processors in one or more computing devices which execute computer program instructions to perform the various functions described below, Elements. The computer program instructions are stored in a memory that can be executed on a computing device using standard memory devices, such as, for example, random access memory. The computer program instructions may also be stored in other non-transitory computer readable media, such as, for example, CD-ROMs, flash drives, and the like. Further, those skilled in the art will appreciate that the functions of the various computing devices may be combined with one another, integrated into one computing device, or the functionality of a particular computing device may be implemented within one or more other computing devices Lt; / RTI > can be dispersed in the < / RTI >

Referring to FIG. 1, there is shown a block diagram illustrating a network connection relationship of a system for providing object recognition information using a PR code according to an exemplary embodiment of the present invention. Referring to FIG. 2, there is shown a block diagram showing an enlarged relationship between the configuration of the recognition unit and other configurations in the object recognition information providing system utilizing the PR code of FIG. Hereinafter, a configuration and a driving method of the object recognition information providing system using the PR code of the present invention will be described with reference to FIG. 1 and FIG.

The object recognition information providing system 100 using the PR code includes a data transmitting and receiving unit 110 for receiving the image A1 and the position information A2 scanned from the user terminal 10, The recognition unit 120 receives the scanned image A1 from the transceiving unit 110 and recognizes the text and the shape of the scanned image A1. The text and shape recognized by the recognition unit 120 are stored in the data server 140 A matching unit 130 for extracting matching information C to be matched with the user terminal 10 and providing the matching information 130 to the user terminal 10 via the data transmitting and receiving unit 110, A server 140, and the like.

The data transmitting and receiving unit 110 receives the image A1 scanned by the user terminal 10 by the user. The data transmitting and receiving unit 110 may receive not only the scanned image A1 but also the position information A2 which is the position at which the user terminal 10 transmits the scanned image A1. The scanned image A1 executes a mobile application (hereinafter referred to as "dedicated program") provided by the user to use the object recognition information providing system 100 using the PR code at the user terminal 10, It may be an image of an object recognized through a dedicated program. The scanned image A1 may be an image that is displayed on a dedicated program execution screen of the user terminal 10, rather than a photographed image.

The scanned image A1 may be, for example, but not limited to, an image for a trade name, a trademark, a logo, a billboard, a business card, and a product. Here, the product may be any one of an image representative of a product such as an album jacket or a book cover, a clothing, a shoe, a bag, a glass, an electronic product, and other household goods containing a logo. But is not limited to.

The recognition unit 120 receives the scanned image A1 received from the data transmitting and receiving unit 110 and receives text information B1 included in the scanned image A1 and the shape information of the overall product, (B2) can be recognized. The recognition unit 120 includes a text recognition unit 121 for recognizing text information included in the scanned image A1 and a recognition unit for recognizing shape information about the overall shape and color of the product included in the scanned image A1 And a shape recognizing unit 122 for recognizing the shape of the object. At this time, if there is no other shape information in the scanned image A1, the recognition unit 120 can recognize only the text information B1 through the text recognition unit 121 and transmit the recognized text information to the matching unit 130. [ In addition, the shape recognition unit 122 can analyze the color combination of the product of the scanned image A1 three-dimensionally (red, green, blue) by level.

The matching unit 130 receives the text information B1 and the shape information B2 transmitted from the recognition unit 120 and transmits the scanned image A1 to the user terminal The position information A2 of the position information A2 is compared with the number of pieces of information stored in the data server 140 and the position information A2 is compared with the text information B1 and the shape information B2, Information C is extracted. The matching unit 130 may compare information of the position information A2, the text information B1, and the shape information B2 with the information of the data server 140 through artificial intelligence to extract matching information . Herein, the artificial intelligence refers to information that is matched with the text information B1 and the shape information B2 recognized by the recognition unit 120 without converting the text information B1 and the shape information B2 into digital information or the like And extracting it from the data server 140.

However, when a large amount of data is matched, it may take a long time in information matching of the server. Therefore, when only the text information B1 is transmitted from the recognition unit 120, the matching unit 130 extracts the position information A2 and the text information B1 ) May be used to extract the additional information (C). The matching unit 130 receives only the text information B1 from the recognizing unit 120. If the text information B1 is vast or contains information about the individual, the matching unit 130 extracts the additional information C only by the text information B1 It may be extracted. The driving of the matching unit 130 will be described in more detail below.

Also, the matching unit 130 may transmit the extracted additional information C to the user terminal 10 through the data transmission / reception unit 110. Here, the additional information C may include at least one of text, image, video and music streaming, location information, a map, and a specific page link.

The operation of the recognition unit 120 and the matching unit 130 of the object recognition information providing system 100 using the PR code will be described in detail with reference to FIGS. 3A to 3C. 3A to 3C, three representative examples of the scanned image A1 are shown, but the scanned image A1 of the present invention is not limited to three. Hereinafter, an operation example of the object recognition information providing system 100 using the PR code according to the scanned image A1 received from the user terminal 10 will be described with reference to FIGS. 3A and 3C.

First, the scanned image A1 shown in FIG. 3A is an example of an image of a logo or the like displayed on a signboard or a product, and is hereinafter referred to as a first scanned image A11. When the first scanned image A11 is transmitted to the recognizing unit 120, the recognizing unit 120 recognizes the logo and the logo, which are the text information B1 included in the first scanned image A11, And transmits it to the matching unit 130. Here, if there is no other shape information in the first scanned image A11, the recognition unit 120 may recognize only the text information B1 through the text recognition unit 121, and may transmit the recognition result to the matching unit 130 .

The matching unit 130 receives the text information B1 and the position information A2 for the user terminal 10 and outputs text information B1 and position information A2 from the data server 140 Extracts matching additional information C, and provides it to the user terminal 10. More specifically, the matching unit 130 searches the information stored in the data server 140 from the user terminal 10 and the information stored in the data server 140 through the first scanned image A11 and the location information A2 in which the user terminal 10 is located And may provide additional information (C) about the store in which the logo and logos are used in close proximity to the location. Here, it is possible to store all the stores such as the merchandise store or service center where the name and logo included in the first scanned image A11 are used. In addition, the store information can provide contact information, location information, products that can be sold or services, price information of products, available hours, homepages, etc. as images or texts, and can also provide promotional videos of products or stores. In the present invention, the store information is not limited to the above-described configuration, and may further include information required to be additionally provided for the convenience of the user.

Accordingly, the user can easily recognize that the logo and the logo included in the first scanned image A11 are used only with the first scanned image A11 for the recognized object after executing the dedicated program in the user terminal 10, Additional information (C) about the center can be provided in the order of proximity to the user's location.

The scanned image A1 shown in FIG. 3B is an example of an image for a business card, hereinafter referred to as a second scanned image A12. When the second scanned image A12 is transmitted to the recognizing unit 120, the recognizing unit 120 recognizes the text information B1 included in the second scanned image A12, such as name, Facsimile, e-mail, homepage, job title, and the like, and delivers the extracted information to the matching unit 130. Here, if there is no other shape information in the second scanned image A12, the recognizing unit 120 recognizes only the text information B1 through the text recognizing unit 121 and transmits it to the matching unit 130 have.

If the transmitted text information B1 includes a vast or personal information such as a business card, the matching unit 130 may not add the text information B1 to the data server 140, Information C can be extracted. The magnitude of the text information B1 may be at least 20 characters or at least 40 letters or more. In addition, Hangul can be recognized as information of the same size as 1 character, 2 letters in English or numbers. For example, when the text information B1 is 10 alphanumeric characters, the English alphanumeric characters are 22 characters, and the alphanumeric characters are 42 alphanumeric characters, the text information is enormous information. Also, in the case of personal information, it may be information of a form such as a contact, an address, an e-mail, and the like.

The matching unit 130 that receives the text information B1 for the second scanned image A12 does not match the text information B1 from the data server 140 without the separate location information A2 Extracts the additional information C, and provides it to the user terminal 10. More specifically, the matching unit 130 may provide the additional information C for the individual matching 90% or more of the information stored in the data server 140 with the text information B1 of the second scanned image A12 have. Here, if there is no information in the data server 140 that matches at least 90% with the text information B1, the matching unit 130 may provide only the basic information on the name displayed on the card in the additional information C.

Also, the matching unit 130 provides only the case where the text information B1 of the second scanned image A12 and the information of the data server 140 are not equal to 100% but equal to 90% or more, It is possible to prevent inconvenience that the additional information C is not provided to the data server 140 when some personal information such as a contact or a contact is changed. Since the matching unit 130 provides the text information B1 of the second scanned image A12 and the information of the data server 140 at 90% or more, the matching unit 130 does not need the personal information stored in the data server 140 It is possible to prevent leakage.

Here, the additional information (C) may be stored in the server for self-promotion by the actual owner of the personal information described in the card, or may be stored in a self-introduction article, image, video and music streaming, Personal information is not limited to the above-described configuration.

Accordingly, after executing the exclusive program in the user terminal 10, the additional information C for the individual described in the plurality of card holders can be easily provided by only the second scanned image A12 of the recognized object, You can identify individuals who can not do business cards.

The scanned image A1 shown in FIG. 3C is an example of an image for a product including a logo, hereinafter referred to as a third scanned image A13. When the third scanned image A13 is transmitted to the recognizing unit 120, the recognizing unit 120 recognizes the logo A13a, which is the text information B1 included in the third scanned image A13, Recognizes the shape and color of the entire product, which is the information B2, and transfers the recognized shape and color to the matching unit 130. [ That is, when the third scanned image A13 is applied to the recognition unit 120, the text recognition unit 121 recognizes the logo A13a, which is the text information B1 contained in the third scanned image A13 , The shape recognition unit 122 recognizes the shape information B2 which is the overall shape and color of the bag included in the third scanned image A13 and transmits the recognized shape information B2 to the matching unit 130. [

The matching unit 130 receives the text information B1 and the shape information B2 from the recognizing unit 120 and receives the position information A2 from the data transmitting and receiving unit 110 and receives the text information B1, The additional information C for the product matching the shape information B2 and the additional information C for the store matching the position information A2 can be extracted. That is, the matching unit 130 extracts the additional information C from the data server 140 through the text information B1, the shape information B2, and the position information A2 for the third scanned image A13 And provides it to the user terminal 10. In more detail, the matching unit 130 may add (add) a product matching the shape information B2 among the products matching the text information B1 of the third scanned image A13 among the information stored in the data server 140 (C) for the store in which the logo, which is the text information (B1), is used in the order closest to the user terminal (10) from the information stored in the data server (140) have.

Here, the additional information (C) about the product can be provided in the form of image or text about the price of the product, the color and specification of the product, the quantity of the stock, and the online address of the retailer. , But the present invention is not limited thereto. In addition, the additional information (C) for the store further stores the store information for the seller or service center that sells the products contained in the third scanned image (A13) in the order of the user's location information (A2) ). ≪ / RTI >

 Therefore, since the additional information C of the product can be obtained only by the third scanned image A13 of the recognized object after the execution of the dedicated program in the user terminal 10, The user can know the retailer of the product of the product or can purchase the product by confirming the required specification or color. Thus, the product can be easily purchased and the convenience of the user can be increased.

In addition, the object recognition information providing system 100 using the PR code can search the book cover in the user terminal 10 for music that can be heard when reading a book scanned through music streaming, So you can use music book music with the book.

In this way, the object recognition information providing system 100 using the PR code can extract text information B1 and / or shape information B2 contained in the scanned image A1, position information A2 of the user terminal 10 The additional information C that is matched with the additional information C is extracted from the data server 140 and is provided to the user terminal 10 so that additional information such as C ), It is possible to increase the convenience of the user.

The above description is only one embodiment for implementing the object identification information providing system utilizing the PR code according to the present invention, and the present invention is not limited to the above-described embodiment, It will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

100; Object recognition information providing system using PR code
110; A data transmission / reception unit 120; Recognition unit
121; A text recognition unit 122; The shape recognition unit
130; A matching unit 140; Data server

Claims (8)

A data transmitting and receiving unit for receiving the scanned image and the position information transmitted from the user terminal;
Recognizing the text information included in the scanned image, receiving the scanned image, recognizing text information included in the scanned image, and, when the scanned image includes an entire product shape other than text, recognizes shape information on the overall shape and color of the product ; And
Receiving the text information and the shape information from the recognition unit, receiving the position information from the data transmission / reception unit, and selecting, from among the products stored in the data server, products matching the shape information among products matching the text information Extracts additional information on the store, and stores additional information on the store where the text, which is the text information, in the order closest to the user terminal, A matching unit for extracting the image; / RTI >
The extracted additional information is transmitted to the user terminal through the data transmitting and receiving unit,
Wherein the matching unit extracts additional information about a store that sells a product matching the text information at the lowest price, extracts additional information about a store in which an inventory quantity of a product matching the shape information exists,
When the book cover information is received from the recognition unit, the matching unit extracts good music information or music information previously allocated to the book when reading a book corresponding to the book cover information according to a predetermined algorithm, And the data is transmitted to the user terminal through the data transmitting and receiving unit,
Wherein the matching unit extracts additional information corresponding to 90% or more of the information stored in the data server and transmits the extracted additional information to the user terminal through the data transmitting / receiving unit when the text information is vast or includes personal information. doing
Object Identification Information Providing System Using PR Code. delete The method according to claim 1,
The recognition unit
A text recognition unit for extracting the text information included in the scanned image; And
And a shape recognition unit for recognizing shape information on the overall shape and color of the product included in the scanned image. The method according to claim 1,
The matching unit receives the text information and the shape information from the recognition unit, receives the position information from the data transmission / reception unit, and selects the text information, the shape information, and the position information And extracting additional information to be matched. delete The method according to claim 1,
Wherein the scanned image is an image recognizing an object including a mutual name, a trademark, a logo, a billboard, a business card, a book cover, and an album jacket displayed on the dedicated program screen after executing the dedicated program in the user terminal A system for providing object recognition information using PR code. delete The method according to claim 1,
Wherein the additional information includes at least one of text, image, image and music streaming, location information, a map, and a specific page link.

Images