KR20170065186A - Payment system based on image recognition - Google Patents

Payment system based on image recognition Download PDF

Info

Publication number
KR20170065186A
KR20170065186A KR1020150171310A KR20150171310A KR20170065186A KR 20170065186 A KR20170065186 A KR 20170065186A KR 1020150171310 A KR1020150171310 A KR 1020150171310A KR 20150171310 A KR20150171310 A KR 20150171310A KR 20170065186 A KR20170065186 A KR 20170065186A
Authority
KR
South Korea
Prior art keywords
image
client terminal
information
image recognition
recognition server
Prior art date
Application number
KR1020150171310A
Other languages
Korean (ko)
Inventor
서영우
Original Assignee
주식회사 제피러스플랫폼테크놀로지
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 제피러스플랫폼테크놀로지 filed Critical 주식회사 제피러스플랫폼테크놀로지
Priority to KR1020150171310A priority Critical patent/KR20170065186A/en
Publication of KR20170065186A publication Critical patent/KR20170065186A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/083—Shipping
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/08—Payment architectures
    • G06Q20/12—Payment architectures specially adapted for electronic shopping systems
    • H04N5/2257—

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Finance (AREA)
  • Software Systems (AREA)
  • Economics (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Development Economics (AREA)
  • General Engineering & Computer Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Human Resources & Organizations (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The present invention relates to an image recognition technology, and more particularly, it relates to a method and apparatus for comparing a captured image with a predetermined matching pattern to enable a user to operate a desired program or to provide desired information, To a payment system via image recognition.
The feature of the present invention is that the image recognition server 30 analyzes the photographed image data photographed by the client terminal 20 so that a predetermined application for a service of a predetermined content related to the image is executed in the client terminal 20, The content application is characterized by comprising any one of a consultation character screen application, a predetermined reservation application, a predetermined online market application, and a predetermined payment application.

Description

{PAYMENT SYSTEM BASED ON IMAGE RECOGNITION}

The present invention relates to an image recognition technology, and more particularly, it relates to a method and apparatus for comparing a captured image with a predetermined matching pattern to enable a user to operate a desired program or to provide desired information, To a payment system via image recognition.

[0002] In general, a mobile phone is advanced not only to make a telephone conversation but also to transmit and receive text information such as characters, and to exchange various information through a web connection in recent years.

In addition, portable smart terminals such as smart phones are widely used to provide a more convenient information access. Various smart terminals are being used for various purposes. For this purpose, smart terminals are provided with various functions to perform various functions .

Nevertheless, in order to provide a variety of services, it is difficult to inquire about uncomfortable contents or to know contents that have not been known yet. However, it is difficult to know exactly what contents are desired, It is not known whether it is proceeding or not, so it is passed to various divisions and users are left unresolved.

Therefore, there is a desperate need for technical support that makes advanced services more convenient and easy to use.

Registered Patent No. 10-0582110 (issued on May 22, 2006) Published Patent No. 10-2007-0052426 (published May 22, 2007)

In order to solve the above problems, the present invention has a purpose of allowing a user to easily open a dialogue window of a desired service even if only a character or a picture he wants to know is opened or a reservation application is executed, .

Another object of the present invention is to provide a terminal that automatically extracts desired items through automatic classification, automatic matching,

Yet another object of the present invention is to provide various matching contents suitable for a variety of user environments in order to satisfy various service demands of a user so that a service desired by a user can be performed in various environments or conditions.

It is still another object of the present invention to provide a method and system for automatically purchasing a photograph or an article associated with a product to be purchased by a user, and automatically searching for and delivering the nearest store.

According to an aspect of the present invention, an image recognition server (30) analyzes captured image data captured by a client terminal (20), and a predetermined application for performing a service of a predetermined content related to an image is provided to a client terminal 20), wherein the content application is made up of a predetermined consultation character screen application, a predetermined reservation application, a predetermined online market application, and a predetermined payment application. Content-payment method.

In the present invention, the image capturing transmission step (S20) of transmitting the captured image data taken by the client terminal (20) to the image recognition server (30); An image element extraction step (S30) for receiving the photographed image data photographed by the image recognition server (30), storing the photographed image data in the image recognition database (40), and extracting a predetermined characteristic element from the photographed image data; An image feature matching step S40 for performing a matching process with predetermined feature elements extracted in the image element extraction step S30 in the image recognition server 30 that has read the matching data for image analysis from the image recognition database 40 ); In step S40, the image content link information or the image content application information associated with the matching data is read from the image recognition database 40. The image recognition server 30 reads the image content link information, Or transmitting application information to the client terminal 20 (S50); Payment server 50 of the corresponding image content to the link address of the image content link information received from the client terminal 20 and displays the corresponding content screen information on the screen of the client terminal 20, And a content execution step (S60) for executing the content.

In the present invention, predetermined image extraction algorithm data for extracting a predetermined feature element from the photographed image data by the manager of the image recognition server 30, matching data for matching with the extracted predetermined feature element, And a matching data input step (S10) in which data including image content link information related to the information is inputted through the image recognition server (30) and stored in the image recognition database (40) Provide payment method.

In the present invention, a merchandise image photographing transmission step (S120) for transmitting photographed image data of a commodity that has taken one of a commodity photograph, a commodity name, a commodity description and a commodity commodity to the image recognition server (30) ; The image recognition server 30 receives the photographed image data and stores the photographed image data in the image recognition database 40. The photographed image data is stored in the image recognition database 40 as any one of the product photograph information, A product image element extracting step (S130) for extracting a predetermined feature element for the image feature element; The image recognition server 30 that has read the matching data for image analysis from the image recognition database 40 performs a matching process with predetermined feature elements extracted in the image element extracting step S30 to obtain a product Image feature matching step S140; The merchandise image feature matching step S 140 reads the merchandise purchase link information and the purchase application information associated with the predetermined merchandise related to the matching data from the image recognition database 40, (S150) of transferring purchase link information and purchase application information to the client terminal (20); And an application for purchasing goods received from the client terminal 20, receives the goods purchase real time information from the goods purchase information providing server 60 at the address of the goods purchase link information, And a goods purchase payment step (S160) for purchasing goods, and searches the goods purchase information providing server (60) for a nearby shop related to the goods according to GPS information of the client terminal (20) The method comprising the steps of:

In the present invention, the service transmits the photographed image data obtained by photographing the face photograph of the user at the client terminal 20 to the image recognition server 30, so that the image recognition server 30 transmits the link to the content server 71 The client terminal 20 receives the character picture data and the photo content application execution data in connection with the content server 71 and generates edit picture data in which the face picture and the character picture are synthesized, A photo editing sharing service for sharing with a user; The image recognition server 30 provides the link information to the augmented reality server 72 related to the portrait by transmitting the photographed image data of the portrait image taken by the client terminal 20 to the image recognition server 30, Text, and e-mail information that is shared with the person who is photographed when the client terminal 20 is connected to the augmented reality server 72 and displays it on the screen of the client terminal 20. When the photographed person is a missing person, A person-added-reality service for causing related information to be displayed on the screen of the client terminal 20 or transmitting characters to an organization related to the person; The image recognition server 30 provides link information to the product recognition server 73 by transmitting the photographed image data of the product taken by the client terminal 20 to the image recognition server 30, A goods recognition service for providing on-line lowest purchase information, online shopping mall link information, and payment order information to the client terminal 20 and displaying it on the screen, The image recognition server 30 provides the link information to the traffic recognition server 74 by transmitting the photographed image data of the road taken by the client terminal 20 to the image recognition server 30, A traffic recognition service for accessing the traffic recognition server 74 and displaying information on the road, real-time traffic information in the vicinity of the area, news and image information of the road to the client terminal 20 and displaying the information on a screen; The image recognition server 30 provides the link information to the climate recognition server 75 by transmitting the photographed image data of the sky taken by the client terminal 20 to the image recognition server 30, A weather recognition service for accessing the weather recognition server 75 to display today's weather data, weather information for this week, seasonal weather information, weather related news, photographs, image data and weather content application execution data and displaying the data on the screen; The image recognition server 30 provides the link information to the local place recognition server 76 by transmitting the photographed image data of the road, the scenery and the building taken from the client terminal 20 to the image recognition server 30 A local place recognition service for receiving data of news, information, photographs, and images related to roads, buildings, and areas in the client terminal 20 and displaying the received data on a screen when the client terminal 20 accesses the local place recognition server 76; The method comprising the steps of: (a) receiving a content-based payment request;

In the present invention, a predetermined feature element is extracted from photographed image data photographed by the client terminal 20, and the image content link information is transmitted to the client terminal 20 for performing a service of a predetermined content matched by a predetermined matching algorithm The present invention provides an image recognition server through image recognition.

In the present invention, the image information receiving and storing unit 31 receives the photographed image data photographed by the client terminal 20 and stores the photographed image data in the image recognition database. An image characteristic element extracting unit 32 for extracting a predetermined characteristic element from the photographed image data photographed by the image recognition server 30; An image feature matching unit (33) for reading matching data for image analysis in the image recognition database (40) and performing a matching process with predetermined feature elements extracted by the image feature extraction unit (32); And an image content searching unit 34 for reading image content link information related to matching data by the image feature matching unit 33 in the image recognition database 40 and transmitting the image content link information to the client terminal 20 The present invention provides an image recognition server through image recognition.

In the present invention, the image information receiving and storing unit 31 classifies and stores the photographed image data photographed by the client terminal 20 as a single image, moving image, or character image. And provides an image recognition server through recognition.

In the present invention, the terminal control unit 21 includes a terminal control unit 21 for controlling a memory, a display, an image capturing, and a predetermined application to be executed. The terminal control unit 21 transmits the captured image data, The image recognition server 30 receives the image content link information related to the object to be photographed, requests the corresponding image content at the link address of the image content link information, And displays the received data on a display screen and executes a predetermined application.

In the present invention, the terminal control unit 21 may include an image recognition drive function for transmitting photographed image data to the image recognition server 30; And a content application drive function for requesting a corresponding image content from a link address of the image content link information received from the image recognition server 30 and executing an application related to the image content, Lt; / RTI >

In the present invention, the image recognition server 30; And an image recognition database (40) including the client terminal (20) and storing predetermined data received from the image recognition server (30); And transmitting the information of the content corresponding to the link address information to the client terminal 20 in response to a request from the client terminal 20 that has received the link address information extracted in the matching process for the image from the image recognition server 30 And a content-payment server (50) for receiving the content.

In the present invention, the image recognition server 30; And an image recognition database (40) including the client terminal (20) and storing predetermined data received from the image recognition server (30); And a client terminal (20) which receives the predetermined product information through the matching process for the image in the image recognition server (30), transmits application information and purchase related information of a predetermined product to the client terminal And a merchandise purchase information providing server (60) for transmitting the merchandise purchase information to the server (60).

In the present invention, the image recognition server 30; And an image recognition database (40) including the client terminal (20) and storing predetermined data received from the image recognition server (30); And the client terminal 20 transmits the photographed image data photographed by the client terminal 20 to the image recognition server 30 in order to perform a photo editing sharing service for photographing, , The image recognition server 30 includes a content server 71 that provides link information to the content server 71 and provides character picture data and photo content application execution data at the request of the client terminal 20 The present invention provides a service providing system through image recognition.

In the present invention, the image recognition server 30; And an image recognition database (40) including the client terminal (20) and storing predetermined data received from the image recognition server (30); The client terminal 20 transmits the photographed image data photographed by the client terminal 20 to the image recognition server 30 in order to perform a person augmented reality service for photographing a portrait of a person and providing related information, The image recognition server 30 provides link information to the augmented reality server 72 related to a portrait photograph. The client terminal 20 searches for a call, text, and e-mail information, An augmented reality server 72 for providing relevant information to the terminal 20 and displaying the related information on the screen of the client terminal 20 or transmitting the text to an institution related to the person, when the photographed person is a person who is registered as a missing person, And providing a service providing system through image recognition.

In the present invention, the image recognition server 30; And an image recognition database (40) including the client terminal (20) and storing predetermined data received from the image recognition server (30); And the client terminal 20 transmits the photographed image data photographed by the client terminal 20 to the image recognition server 30 in order to perform a product recognition service for photographing a product and purchasing and paying the product, The recognition server 30 provides the link information to the product recognition server 73. The client terminal 20 sends the online lowest price purchase information related to the product, online shopping mall link information, and payment order information to the client terminal 20, And a merchandise recognition server (73) for providing the merchandise recognition server (20) with a merchandise recognition service.

In the present invention, the image recognition server 30; And an image recognition database (40) including the client terminal (20) and storing predetermined data received from the image recognition server (30); The client terminal 20 transmits photographed image data photographed by the client terminal 20 to the image recognition server 30 in order to perform a traffic recognition service for photographing a road and providing traffic information to the client terminal 20, The server 30 provides the link information to the traffic recognition server 74. In response to the request from the client terminal 20, information about the road, real-time traffic information near the area, news on the road, And a traffic recognition server (74) provided to the terminal (20).

In the present invention, the image recognition server 30; And an image recognition database (40) including the client terminal (20) and storing predetermined data received from the image recognition server (30); The client terminal 20 transmits the photographed image data photographed by the client terminal 20 to the image recognition server 30 in order to perform a climate recognition service for photographing the sky and providing climate related information to the client terminal 20, The server 30 provides the link information to the weather recognition server 75. The client terminal 20 can request information of today's weather, this week's weather, seasonal weather, weather related news, And a weather recognition server (75) for transmitting weather content application execution data to the client terminal (20).

In the present invention, the image recognition server 30; And an image recognition database (40) including the client terminal (20) and storing predetermined data received from the image recognition server (30); Scenery and a building from the client terminal 20 in order to implement a local place recognition service for photographing roads, scenery and buildings from the client terminal 20 and providing information related to cities and regions, The image recognition server 30 provides the link information to the local area recognition server 76. The request from the client terminal 20 allows the user to receive information related to roads, And a local place recognition server (76) for providing data of information, photograph, and image to the client terminal (20).

According to the present invention configured as described above, the user can open a question window of a desired service even if only a character or a picture he / she wants to know is photographed, or a reservation application can be executed to conveniently use various services.

The other effect of the present invention is that the user is automatically transferred to the association recognition server even when the user simply takes a picture, and extracts desired items through automatic classification, automatic matching, and the like.

Further, another effect of the present invention is to allow various matching contents corresponding to a variety of user environments to be input in order to satisfy various service demands of a user, thereby allowing a user to provide desired contents in various environments or conditions.

Further, another effect of the present invention is that an application for purchasing a product when the user photographs a photograph or an article related to the product to be purchased is automatically executed, and the retrieval or delivery of a nearby shop is performed.

1 is an exemplary diagram showing an embodiment in which a consultation application for train operation is executed in the settlement system according to the present invention.
FIG. 2 is an example of an embodiment in which a reservation application for train booking is executed in the payment system according to the present invention.
FIG. 3 is an example of an embodiment in which an online market application for making use of an online market in the billing system according to the present invention is executed.
4 is a diagram illustrating an example of an embodiment in which a financial settlement application for performing information inquiry, transfer or the like of a financial institution is executed in the settlement system according to the present invention.
5 is a configuration diagram of a payment system according to the present invention.
6 is a flowchart of a content-payment method according to the present invention.
FIG. 7 is a flow chart of a method of purchasing-paying according to the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

That is, the billing system and the content-settlement method using image recognition according to the present invention, as shown in FIGS. 1 to 7, include an image recognition server 30 according to the present invention; And a client terminal 20 connected to the image recognition server 30 through a network to transmit image information and receive link information to execute a predetermined application.

An image recognition database 40 for storing predetermined data received from the image recognition server 30; And a content-payment server 50 for transmitting the requested content information to the client terminal 20 at the link address extracted by the image recognition server 30 in the matching process for the image.

Examples of the contents-payment server 50 may include a KTX operation server 51 for carrying out a character answer for consultation or a train reservation when the KTX train is operated as shown in FIGS. 1 and 2 . A variety of content-payment servers such as an online mart server such as a bank server, a card company server, or an e-mart can be applied.

In addition, the image recognition server 30 analyzes the photographed image data photographed by the client terminal 20 according to the present invention. The content recognition server 30 analyzes the photographed image data of the content- The payment method is performed.

The content application may be any one of a consultation character screen application, a predetermined reservation application, a predetermined online market application, and a predetermined payment application.

Hereinafter, a content-payment method and an image recognition server according to the present invention will be described in detail.

The client terminal 20 used by a plurality of users includes a terminal control unit 21 for controlling memory, display, image capturing, and execution of a predetermined application.

The terminal control unit 21 transmits the photographed image data of the photographed object to the image recognition server 30, receives the image content link information related to the photographed object from the image recognition server 30, And displays the data received from the image recognition server 30 on the display screen to execute a predetermined application.

The terminal control unit 21 of the client terminal 20 may further include an image recognition drive function for transmitting the photographed image data to the image recognition server 30; And requesting the corresponding image content from the link address of the image content link information received from the image recognition server 30 and executing a content application drive function for executing an application related to the image content.

In the execution of the content-payment method in the present invention, first, the predetermined image extraction algorithm data for extracting a predetermined feature element from the photographed image data by the manager of the image recognition server 30, Matching data to be matched and data including image content link information related to the matched information is inputted through the image recognition server 30 and stored in the image recognition database 40. [ Thus, in the following process, matching data is used as reference information to classify or discriminate the image into a predetermined object or a meaning. It is desirable that such matching data can satisfy various demands of the user by inputting and storing a lot of data as far as it is possible to classify even more various situations.

In the present invention, the image recognition server 30 will be described as a server performing basic driving information and image analysis.

That is, the image recognition server 30 is connected to the client terminals 20 of users through a network, transmits data such as a program according to the present invention to the client terminal 20, .

Then, a predetermined feature element is extracted from the photographed image data photographed by the client terminal 20, and related image content link information is transmitted to the client terminal 20 in order to perform a service of a predetermined content matched by a predetermined matching algorithm.

More specifically, the image recognition server 30 includes an image information receiving and storing unit 31 for receiving the photographed image data photographed by the client terminal 20 and storing the photographed image data in the image recognition database. That is, the user's client terminal 20 receives and stores the photographed image data photographed by the camera.

And transmits the photographed image data photographed by the client terminal 20 to the image recognition server 30 and received by the image information receiving and storing unit 31 and stored in the image recognition database 40 ).

As described above, the captured image information taken by the individual users is a variety of photographed images taken according to the user's needs, so a process of classifying them is necessary.

For this purpose, the photographed image data photographed by the client terminal 20 is classified into a single image, a moving image, and a character image by the image information receiving and storing unit 31 and the image capturing transmitting step (S20) .

That is, when driving a desired application, when a character such as 'train consultation' is photographed, it is classified and stored as a character, and characters matching process can be performed in the following process. In addition, when a figure or a shape such as a train shape or a logo of 'KTX' is photographed, it can be classified and stored as a sheet photo image, thereby performing image analysis and matching process. Furthermore, when a moving picture is taken such as a train passes through, a motion analysis algorithm is categorized so that it can be executed.

Thereafter, the image recognition server 30 includes an image feature extraction unit 32 for extracting predetermined feature elements from the captured image data captured by the image recognition server 30.

In addition, the image feature extraction unit 32 receives the captured image data captured by the image recognition server 30, stores the captured image data in the image recognition database 40, extracts a predetermined feature element from the captured image data, Step S30 is performed.

Thus, in the photographed image data classified as a character, a character recognition algorithm is executed to extract a characteristic element as a character and recognize and analyze the character.

In the case of a normal logo or a picture, the corresponding logo or picture is analyzed with pollen, contrast, color, etc., and predetermined feature elements of the corresponding logo or picture are extracted to recognize the shape information. In addition, in the case of a moving image, an image is analyzed by dividing each frame, and a moving object recognition process is performed by extracting and analyzing predetermined characteristic elements such as a motion in an entire moving image.

As described above, the predetermined characteristic elements for discriminating the images taken by the individual users are extracted, and classified into characters, images, moving images, and the like, so that it can be analyzed more accurately without being confused with customized ones.

Next, an image feature matching unit 33 that reads matching data for image analysis in the image recognition database 40 and performs a matching process with predetermined feature elements extracted by the image feature extraction unit 32 do.

In addition, the image feature matching unit 33 reads the matching data for image analysis in the image recognition database 40 and performs image feature matching for performing matching with predetermined feature elements extracted in the image element extracting step S30 Step S40 is performed.

The predetermined feature elements extracted from the photographed image data are subjected to a matching process with pre-stored matching data.

For the following process, the image feature matching unit 33 reads the image content link information related to the matching data in the image recognition database 40, and transmits the image content link information to the client terminal 20 And includes a search unit 34.

In addition, the image content searching unit 34 reads the image content link information or the image content application information related to the matching data in the image recognition database 40 by performing the image feature matching step S40, Information, or application information to the client terminal 20 (S50).

Then, the client terminal 20 requests the content-payment server 50 of the corresponding image content with the link address of the image content link information received from the client terminal 20 and displays the corresponding content screen information on the screen of the client terminal 20, (Step S60).

As shown in FIG. 1, if a video image photographed in a character is discriminated as a 'KTX' character or a logo and a consultation character application is executed, the consultation character application is executed.

When an image or character for train purchase is photographed as shown in FIG. 2, an application for train booking is activated and a payment process for train booking can be performed while the application is being executed. In this case, A payment system may be established such that the payment process is performed such as connection with a server.

Also, as shown in FIG. 3, a dedicated application for purchasing goods is executed or a dedicated application for payment is executed as shown in FIG.

As described above, according to the present invention, if there is a desired item, the user captures a text, a logo, a picture or a moving picture related to the contents and transmits the picture to the server, It is possible to easily operate an application desired. In addition, it has the advantage of being able to easily consult or purchase or settle an object in a subsequent association process.

Next, the user uses the client terminal 20 such as his smart phone to shoot a photograph, a name, an explanation, or other photograph or article of the product he / she intends to purchase, .

That is, the above-described image recognition server 30; And an image recognition database 40 for storing predetermined data transmitted from the image recognition server 30. The image recognition database 40 includes a client terminal 20, The image recognition database 40 may include various goods information inputted by the user, and may retrieve and use the information of the portal if necessary.

In addition, the client terminal 20 receiving the predetermined product information through the matching process of the image in the image recognition server 30 transmits the application information of the purchase of the predetermined product and the product purchase related information to the client terminal 20 20 to the purchaser information providing server (60).

Thus, if the image recognition server 30 discriminates a product by image matching, it can perform a purchase procedure for the product.

A process of transmitting a product image data of a product, which has taken a product photograph, a product name, a product description, and a product product, to the image recognition server 30 by using the client terminal 20 of the user And performs a video shooting transmission step (S120).

Then, the image recognition server 30 receives the photographed image data and stores the photographed image data in the image recognition database 40. Then, the photographed image data of the commodity, (S130) for extracting a predetermined feature element for the selected image feature element.

Then, the image recognition server 30 which has read the matching data for image analysis from the image recognition database 40 performs a matching process with the predetermined feature elements extracted in the image element extracting step S30, The merchandise image feature matching step (S140) is performed to specify information about the merchandise.

As described above, the merchandise image feature matching step S140 reads the merchandise purchase link information and purchase application information related to the predetermined merchandise related to the matching data from the image recognition database 40, And transmits the goods purchase link information and the purchase application information to the client terminal 20 (S150).

Thus, the user can confirm whether there is purchase information for the product, and if the purchase information is provided, the process of purchasing the product is performed.

That is, an application for purchasing goods received from the client terminal 20, receives the goods purchase real time information from the goods purchase information providing server 60 at the address of the goods purchase link information, (S160) of purchasing a product to purchase the product.

In addition to the product purchase process, the product purchase information providing server 60 searches for a nearby shop related to the product in accordance with the GPS information of the client terminal 20 and processes the delivery order. It is also possible to provide contents information such as search of a near-near store, discount information search, coupon information for the product, advertisements related to the product, music, drama, etc. to the klient terminal 20.

Further, in the client terminal 20, when the initial operation of the client terminal, the unlocking operation, and the authentication process when purchasing or paying the goods are performed, the client terminal 20 may be the person himself / herself by facial recognition, fingerprint recognition, pupil recognition, After the process of authentication is performed, it may be arranged to perform a process of inputting a card number, a card password, and a payment process.

According to the present invention as described above, the image recognition server 30 analyzes the photographed image data photographed by the client terminal 20, and a predetermined application for performing a service of a predetermined content related to the image is transmitted to the client terminal 20 ), And the content application is configured to be implemented by any one of a predetermined consultation character screen application, a predetermined reservation application, a predetermined online market application, and a predetermined payment application, Provide payment method.

Accordingly, in addition to the services of settlement and purchase of goods by the KTX, the client terminal 20 transmits the photographed image data of the face image of the client 20 to the image recognition server 30, The recognition server 30 provides link information to the content server 71 and receives character picture data and photo content application execution data from the client terminal 20 in connection with the content server 71. The face image and the character picture A photo editing sharing service for generating the synthesized edited photo data and sharing it with the social network service friends can be provided.

The image recognition server 30 provides the link information to the augmented reality server 72 related to the portrait by transmitting the photographed image data of the portrait image taken by the client terminal 20 to the image recognition server 30 Character, and e-mail information that have been shared with the person who is photographed when the client terminal 20 is connected to the augmented reality server 72 and displays it on the screen of the client terminal 20. When the photographed person is a missing person, If the person is registered as a criminal, the related information may be displayed on the screen of the client terminal 20 or may be provided to the person associated with the person.

The image recognition server 30 provides the link information to the product recognition server 73 by transmitting the photographed image data of the product taken by the client terminal 20 to the image recognition server 30, The online shopping mall link information and payment order information may be provided to the client terminal 20 to be displayed on the screen.

The image recognition server 30 provides the link information to the traffic recognition server 74 by transmitting the photographed image data of the road taken by the client terminal 20 to the image recognition server 30, The traffic recognition server 74 provides the traffic recognition service for providing the client terminal 20 with information on the road, real-time traffic information in the vicinity of the corresponding area, news on the road, and image information on the road, .

In addition, the image recognition server 30 provides link information to the climate recognition server 75 by transmitting the photographed image data of the sky taken by the client terminal 20 to the image recognition server 30, 20 is connected to the weather recognition server 75 and receives weather data, weather data, weather data, weather data, weather data, weather data, weather information, Services may be provided.

The image recognition server 30 provides the link information to the local area recognition server 76 by transmitting the photographed image data of the road, the scenery and the building taken from the client terminal 20 to the image recognition server 30 A local place recognition service may be provided in which the client terminal 20 accesses the local place recognition server 76 and receives data of news, information, photographs, and images related to roads, buildings, and areas and displays the received data on a screen.

As a service providing system for performing such a service, the image recognition server 30; And a content server 71 including the client terminal 20 and an image recognition database 40 for storing predetermined data transmitted from the image recognition server 30.

In this content server 71, in order to execute a photo editing sharing service for photographing, editing and sharing a face of a user's face in the client terminal 20, The image recognition server 30 provides the link information to the content server 71 and provides character picture data and photo content application execution data at the request of the client terminal 20 .

The service providing system includes an augmented reality server 72. In the augmented reality server 72, in order to execute the augmented reality service, which captures a portrait of a person at the client terminal 20 and provides related information, The image recognition server 30 transmits the photographed image data obtained by photographing a portrait photograph on the terminal 20 and provides the link information to the augmented reality server 72 related to the portrait photograph, Character, and e-mail information, which is shared with the photographed person, and provides the retrieved information to the client terminal 20. When the photographed person is a person who is registered as a missing person, a witness, or a criminal, To be displayed on the screen of the terminal 20 or to transmit the text to an institution related to the person.

The service providing system is provided with a goods recognition server 73. In order to perform the goods recognition service in which the client terminal 20 shoots the goods and purchases the goods and makes a payment, The image recognition server 30 sends linkage information to the product recognition server 73 and the client terminal 20 sends a request to the image recognition server 30, Online shopping mall link information, and payment order information associated with the product, to the client terminal 20.

In addition, the service providing system includes a traffic recognition server 74. In the traffic recognition server 74, in order to perform a traffic recognition service in which the client terminal 20 photographs a road and provides traffic information, 20 to the image recognition server 30 and the image recognition server 30 provides link information to the traffic recognition server 74. In response to a request from the client terminal 20 , Information on the road, real-time traffic information in the vicinity of the area, news on the road, and image information to the client terminal 20.

In addition, the service providing system is provided with a climate recognition server 75. In the climate recognition server 75, in order to perform the climate recognition service for capturing the sky and providing climate-related information at the client terminal 20, The image recognition server 30 transmits the photographed image data photographed by the terminal 20 to the image recognition server 30. The image recognition server 30 provides link information to the climate recognition server 75, The weather information, the weather information, the seasonal weather information, the weather related news, the photograph, the image data, and the weather content application execution data to the client terminal 20 at the request.

In addition, the service providing system includes a local place recognition server 76. In the local place recognition server 76, the client terminal 20 is a region for photographing roads, scenery, buildings and providing information related to cities and regions The image recognition server 30 transmits the photographed image data of the road, the scenery and the building taken from the client terminal 20 to the image recognition server 30 in order to perform the location recognition service. Link information, and provides data of news, information, photos, and images related to roads, buildings, and areas to the client terminal 20 at a request from the client terminal 20. [

As described above, the user uses the client terminal 20 to photograph various objects, transmit the captured image data to the image recognition server 30, analyze the images, and provide various services related to the object to be photographed. You can.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The technical idea of the present invention should not be construed as being limited.

10: client terminal 30: image recognition server
40: image recognition database

Claims (18)

The image recognition server 30 analyzes the photographed image data photographed by the client terminal 20 so that a predetermined application for executing a service of a predetermined content related to the image is executed in the client terminal 20,
The content application,
A predetermined consultation character screen application, a predetermined reservation application, a predetermined online market application, and a predetermined payment application.
The method according to claim 1,
An image capturing transmission step (S20) of transmitting the captured image data taken by the client terminal (20) to the image recognition server (30);
An image element extraction step (S30) for receiving the photographed image data photographed by the image recognition server (30), storing the photographed image data in the image recognition database (40), and extracting a predetermined characteristic element from the photographed image data;
An image feature matching step S40 for performing a matching process with predetermined feature elements extracted in the image element extraction step S30 in the image recognition server 30 that has read the matching data for image analysis from the image recognition database 40 );
In step S40, the image content link information or the image content application information associated with the matching data is read from the image recognition database 40. The image recognition server 30 reads the image content link information, Or transmitting application information to the client terminal 20 (S50); And
The client terminal 20 requests the content-payment server 50 of the corresponding image content with the link address of the image content link information received from the client terminal 20 and displays the corresponding content screen information on the screen of the client terminal 20 or executes the corresponding content application (S60);
Wherein the content-payment method comprises:
3. The method of claim 2,
Predetermined image extraction algorithm data for extracting a predetermined feature element from the photographed image data by the manager of the image recognition server 30, matching data for matching with the extracted predetermined feature element, image data related to the matched information And a matching data input step (S10) in which data including link information is inputted through the image recognition server (30) and stored in the image recognition database (40).
The method according to claim 1,
A merchandise image photographing and transmitting step (S120) of transmitting photographed image data of a commodity that has photographed a commodity photograph, a commodity name, a commodity description and a commodity commodity to the image recognition server 30 at the client terminal 20;
The image recognition server 30 receives the photographed image data and stores the photographed image data in the image recognition database 40. The photographed image data is stored in the image recognition database 40 as any one of the product photograph information, A product image element extracting step (S130) for extracting a predetermined feature element for the image feature element;
The image recognition server 30 that has read the matching data for image analysis from the image recognition database 40 performs a matching process with predetermined feature elements extracted in the image element extracting step S30 to obtain a product Image feature matching step S140;
The merchandise image feature matching step S 140 reads the merchandise purchase link information and the purchase application information associated with the predetermined merchandise related to the matching data from the image recognition database 40, (S150) of transferring purchase link information and purchase application information to the client terminal (20); And
Receives the goods purchase real time information from the goods purchase information providing server 60 at the address of the goods purchase link information, executes the application of the goods purchase transmitted from the client terminal 20, And a purchase step (S160)
Wherein the nearest shop related to the product is searched by the product purchase information providing server (60) according to the GPS information of the client terminal (20) and a delivery order is processed.
The method according to claim 1,
The service includes:
The image recognition server 30 provides the link information to the content server 71 by transmitting the photographed image data of the face image taken by the client terminal 20 to the image recognition server 30, A photo editing sharing service for receiving character picture data and photo content application execution data when connected to the contents server 71 and generating edited picture data in which face pictures and character pictures are combined and sharing them with social network service buddies;
The image recognition server 30 provides the link information to the augmented reality server 72 related to the portrait by transmitting the photographed image data of the portrait image taken by the client terminal 20 to the image recognition server 30, Text, and e-mail information that is shared with the person who is photographed when the client terminal 20 is connected to the augmented reality server 72 and displays it on the screen of the client terminal 20. When the photographed person is a missing person, A person-added-reality service in which related information is displayed on a screen of the client terminal 20 or a character is transmitted to an organization related to the person;
The image recognition server 30 provides link information to the product recognition server 73 by transmitting the photographed image data of the product taken by the client terminal 20 to the image recognition server 30, A goods recognition service for providing on-line lowest purchase information, online shopping mall link information, and payment order information to the client terminal 20 and displaying it on the screen,
The image recognition server 30 provides the link information to the traffic recognition server 74 by transmitting the photographed image data of the road taken by the client terminal 20 to the image recognition server 30, A traffic recognition service for accessing the traffic recognition server 74 and displaying information on the road, real-time traffic information in the vicinity of the area, news and image information of the road to the client terminal 20 and displaying the information on a screen;
The image recognition server 30 provides the link information to the climate recognition server 75 by transmitting the photographed image data of the sky taken by the client terminal 20 to the image recognition server 30, A weather recognition service for accessing the weather recognition server 75 to display today's weather data, weather information for this week, seasonal weather information, weather related news, photographs, image data and weather content application execution data and displaying the data on the screen; And
The image recognition server 30 provides the link information to the local place recognition server 76 by transmitting the photographed image data of the road, the scenery and the building from the client terminal 20 to the image recognition server 30, A local place recognition service for receiving data of news, information, photographs, and images related to roads, buildings, and areas in the client terminal 20 and displaying the received data on a screen when the client terminal 20 accesses the local place recognition server 76;
And the content-paying method using the image recognition.
Extracting a predetermined feature element from the photographed image data photographed by the client terminal (20), and transmitting the image content link information to the client terminal (20) in order to perform service of the predetermined content matched by the predetermined matching algorithm Image recognition server through recognition.
The method according to claim 6,
An image information receiving and storing unit 31 for receiving the photographed image data photographed by the client terminal 20 and storing the photographed image data in the image recognition database;
An image characteristic element extracting unit 32 for extracting a predetermined characteristic element from the photographed image data photographed by the image recognition server 30;
An image feature matching unit (33) for reading matching data for image analysis in the image recognition database (40) and performing a matching process with predetermined feature elements extracted by the image feature extraction unit (32); And
An image content search unit 34 for reading image content link information related to matching data by the image feature matching unit 33 in the image recognition database 40 and transmitting image content link information to the client terminal 20, ;
And an image recognition server for recognizing the image through the image recognition.
8. The method of claim 7,
The image information receiving and storing unit 31 classifies the captured image data taken by the client terminal 20 into one image, moving image, or character image, and stores the captured image data. server.
And a terminal control unit (21) for controlling the execution of a memory, a display, an image capturing, and a predetermined application,
The terminal control unit (21)
And transmits the photographed image data obtained by photographing the photographed object to the image recognition server 30,
The image recognition server 30 receives the image content link information related to the subject and requests the corresponding image content to the link address of the image content link information to transmit the data received from the image recognition server 30 And displays on the display screen and executes a predetermined application related thereto.
10. The method of claim 9,
The terminal control unit (21)
An image recognition drive function for transmitting the photographed image data to the image recognition server 30; And
Wherein the client terminal requests the corresponding image content to the link address of the image content link information received from the image recognition server (30) and executes a content application drive function for executing an application related to the image content.
An image recognition server (30) according to any one of claims 6 to 8; And
A client terminal (20) according to claim 9 or claim 10,
An image recognition database 40 for storing predetermined data received from the image recognition server 30; And
In response to a request from the client terminal 20 that has received the extracted link address information from the image recognition server 30, the client terminal 20 transmits the content information corresponding to the link address information to the client terminal 20 And a contents-payment server (50).
An image recognition server (30) according to any one of claims 6 to 8; And
A client terminal (20) according to claim 9 or claim 10,
An image recognition database 40 for storing predetermined data received from the image recognition server 30; And
The client terminal 20 receives the application information of the purchase of the predetermined product and the product purchase related information from the client terminal 20 in response to the information request from the client terminal 20 that has received the predetermined product information by the matching process of the image in the image recognition server 30, And a commodity purchase information providing server (60) for transmitting the commodity purchase information to the server.
An image recognition server (30) according to any one of claims 6 to 8; And
A client terminal (20) according to claim 9 or claim 10,
An image recognition database 40 for storing predetermined data received from the image recognition server 30; And
The client terminal 20 transmits the photographed image data photographed by the client terminal 20 to the image recognition server 30 in order to perform a photo editing sharing service for photographing and editing the user's own face, The image recognition server 30 includes a content server 71 that provides link information to the content server 71 and provides character picture data and photo content application execution data at the request of the client terminal 20 Service Providing System through Image Recognition.
An image recognition server (30) according to any one of claims 6 to 8; And
A client terminal (20) according to claim 9 or claim 10,
An image recognition database 40 for storing predetermined data received from the image recognition server 30; And
In order to implement a person augmented reality service that captures a portrait of a person in the client terminal 20 and provides related information, the client terminal 20 transmits the captured image data to the image recognition server 30, The recognition server 30 provides the link information to the augmented reality server 72 related to the portrait of the person. The client terminal 20 searches for the call, text, and e-mail information shared with the captured person, The augmented reality server 72 for displaying related information on the screen of the client terminal 20 or transmitting the text to an institution related to the person is provided when the captured person is a person who is registered as a missing person, The service providing system comprising:
An image recognition server (30) according to any one of claims 6 to 8; And
A client terminal (20) according to claim 9 or claim 10,
An image recognition database 40 for storing predetermined data received from the image recognition server 30; And
The client terminal 20 transmits the photographed image data photographed by the client terminal 20 to the image recognition server 30 in order to conduct a product recognition service for photographing a product and purchasing the product and making a payment, The server 30 provides the link information to the goods recognition server 73. The client terminal 20 sends the online lowest price purchase information related to the product, online shopping mall link information, and payment order information to the client terminal 20 20. A system for providing services through image recognition, the system comprising:
An image recognition server (30) according to any one of claims 6 to 8; And
A client terminal (20) according to claim 9 or claim 10,
An image recognition database 40 for storing predetermined data received from the image recognition server 30; And
The client terminal 20 transmits the photographed image data photographed by the client terminal 20 to the image recognition server 30 in order to conduct a traffic recognition service for photographing a road and providing traffic information, 30 provides the link information to the traffic recognition server 74. In response to the request from the client terminal 20, information about the road, real-time traffic information in the vicinity of the area, news on the road, And a traffic recognition server (74) for providing the traffic information to the server (20).
An image recognition server (30) according to any one of claims 6 to 8; And
A client terminal (20) according to claim 9 or claim 10,
An image recognition database 40 for storing predetermined data received from the image recognition server 30; And
The client terminal 20 transmits the photographed image data photographed by the client terminal 20 to the image recognition server 30 in order to perform a climate recognition service for photographing the sky and providing climate related information, (30) provides link information to the weather recognition server (75). In response to a request from the client terminal (20), the weather information, today's weather, seasonal weather information, weather related news, And a climate recognition server (75) for transmitting the content application execution data to the client terminal (20).
An image recognition server (30) according to any one of claims 6 to 8; And
A client terminal (20) according to claim 9 or claim 10,
An image recognition database 40 for storing predetermined data received from the image recognition server 30; And
In order to execute a local place recognition service that captures a road, a landscape, and a building from the client terminal 20 and provides information related to the city and the area, the client terminal 20 displays the captured image data photographed on the road, And the image recognition server 30 provides link information to the local area recognition server 76. The request from the client terminal 20 is used to transmit information related to roads, And a local place recognition server (76) for providing the client terminal (20) with the data of the photo, the image and the image.
KR1020150171310A 2015-12-03 2015-12-03 Payment system based on image recognition KR20170065186A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150171310A KR20170065186A (en) 2015-12-03 2015-12-03 Payment system based on image recognition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150171310A KR20170065186A (en) 2015-12-03 2015-12-03 Payment system based on image recognition

Publications (1)

Publication Number Publication Date
KR20170065186A true KR20170065186A (en) 2017-06-13

Family

ID=59218588

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150171310A KR20170065186A (en) 2015-12-03 2015-12-03 Payment system based on image recognition

Country Status (1)

Country Link
KR (1) KR20170065186A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20220165468A (en) * 2021-06-08 2022-12-15 인하대학교 산학협력단 Automatic payment method and online image recognition system for non-contact vending machines

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20220165468A (en) * 2021-06-08 2022-12-15 인하대학교 산학협력단 Automatic payment method and online image recognition system for non-contact vending machines

Similar Documents

Publication Publication Date Title
US10772765B2 (en) Image capture and identification system and process
US10331729B2 (en) System and method for accessing electronic data via an image search engine
US8180396B2 (en) User augmented reality for camera-enabled mobile devices
CN110033298B (en) Information processing apparatus, control method thereof, system thereof, and storage medium
CN103369049B (en) Mobile terminal and server exchange method and system thereof
KR101729938B1 (en) Integrative image searching system and service method of the same
US20160070809A1 (en) System and method for accessing electronic data via an image search engine
JP5395920B2 (en) Search device, search method, search program, and computer-readable recording medium storing the program
US20170169495A1 (en) System and method for accessing electronic data via an image search engine
CN104504155B (en) A kind of data capture method and system based on picture search
KR20190141410A (en) System and method for providing service using kiosk
US20140236722A1 (en) System And Method For Accessing Electronic Data Via An Image Search Engine
KR20200119385A (en) Artificial intelligence appraisal system, artificial intelligence appraisal method and storage medium
WO2007116500A1 (en) Information presenting system, information presenting terminal, and server
KR101781890B1 (en) Real estate mediating system
CN109978552B (en) Payment processing method, device and equipment based on identity card information
US20100142758A1 (en) Method for Providing Photographed Image-Related Information to User, and Mobile System Therefor
US20160034496A1 (en) System And Method For Accessing Electronic Data Via An Image Search Engine
WO2012075589A1 (en) Method and system for virtual shopping
US20230111437A1 (en) System and method for content recognition and data categorization
KR20160149185A (en) Integrative image searching system and service method of the same
US20230360098A1 (en) Methods and systems for providing information about a location with image analysis
KR20170065186A (en) Payment system based on image recognition
US20160379188A1 (en) Methods and apparatus for financial transactions
KR101758712B1 (en) Method of managing receipt and apparatus for the same

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E601 Decision to refuse application