WO2020032404A1 - Augmented reality content providing system and method - Google Patents

Augmented reality content providing system and method Download PDF

Info

Publication number
WO2020032404A1
WO2020032404A1 PCT/KR2019/008582 KR2019008582W WO2020032404A1 WO 2020032404 A1 WO2020032404 A1 WO 2020032404A1 KR 2019008582 W KR2019008582 W KR 2019008582W WO 2020032404 A1 WO2020032404 A1 WO 2020032404A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
augmented reality
image
product
reality content
Prior art date
Application number
PCT/KR2019/008582
Other languages
French (fr)
Korean (ko)
Inventor
이용수
Original Assignee
주식회사 소울핑거
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 소울핑거 filed Critical 주식회사 소울핑거
Priority to JP2021530758A priority Critical patent/JP2021534518A/en
Publication of WO2020032404A1 publication Critical patent/WO2020032404A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0273—Determination of fees for advertising
    • G06Q30/0275—Auctions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0242—Determining effectiveness of advertisements
    • G06Q30/0246—Traffic
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality

Definitions

  • the present invention relates to a system and method for providing content based on augmented reality, and to a system and method for maximizing an advertisement effect by recognizing a registered image such as a corporate logo or a product and providing a 3D advertisement as an augmented reality. will be.
  • the augmented reality technology is a technology that provides a reality such that the object exists in the real world by matching and providing objects such as 3D objects to the image of the real world.
  • An object of the present invention is to allow a user to shoot a product with a user terminal to provide a realistic augmented reality content even without a separate advertisement.
  • An object of the present invention is to enable a user to identify a product by an image of a part of a photographed product, so that a user can receive augmented reality content even when photographing a part of the product.
  • An object of the present invention is to identify a part of a product by an image of a part of a photographed product so that a user can be provided with augmented reality content for information of a specific part of a desired product.
  • An object of the present invention is to select the augmented reality content information to be transmitted to the user terminal based on the augmented reality content exposure cost information, so that advertisers who want to provide the same augmented reality content can compete fairly through the augmented reality content exposure costs. do.
  • An object of the present invention is to determine the augmented reality content information to be transmitted based on the correspondence of location information and local information, so that advertisers who want to provide content in a limited area can efficiently provide content.
  • the augmented reality content providing system includes an augmented reality information receiving unit for receiving product image information and augmented reality content information, product image information and augmented reality received from the augmented reality information receiving unit.
  • An augmented reality information database storing content information, a photographing image receiving unit receiving an image captured by a camera from a user terminal, and identifying product image information corresponding to the photographed image among product image information stored in the augmented reality information database It may include an image identification unit, augmented reality information transmission unit for transmitting augmented reality content information corresponding to the identified product image information to the user terminal.
  • the product image information may include one or more images of at least a part of the product
  • the augmented reality information database may store the augmented reality content information corresponding to each of the images of the at least part of the product, and identify the image.
  • the unit identifies an image of at least a portion of the product corresponding to the photographed image
  • the augmented reality information transmitter transmits the augmented reality content information corresponding to the image of at least a portion of the identified product to the user terminal. It can be configured to feature.
  • the product image information may further include product identification information, and the image identification unit may identify the product image information by identifying the product identification information corresponding to the photographed image, and may be included in the identified product image information. It may be configured to identify an image corresponding to the captured image from the image of at least a part of the product.
  • the augmented reality information receiver further receives the augmented reality content exposure cost information, and the augmented reality information transmission unit, the augmented reality content exposure cost information when the received product image information is duplicated in the augmented reality information database It may be configured to select the augmented reality content information to be transmitted to the user terminal based on.
  • the augmented reality information receiving unit may further include local information corresponding to the augmented reality content, and the augmented reality information transmitting unit receives location information of the user terminal from the user terminal, and the location information and the local information of the local information. And determining the augmented reality content information to be transmitted based on the correspondence.
  • the present invention allows the user to photograph the product with the user terminal to provide a realistic augmented reality content even without a separate advertisement.
  • the present invention enables the user to identify the product by the image of the partly photographed product, so that the user can be provided with the augmented reality content even when photographing a part of the product.
  • the present invention enables the user to be provided with augmented reality content for information of a specific part of a desired product by identifying a part of the product by an image of a part of the photographed product.
  • the present invention selects augmented reality content information to be transmitted to a user terminal based on augmented reality content exposure cost information, so that advertisers who want to provide the same augmented reality content can compete fairly through augmented reality content exposure costs.
  • the present invention determines the augmented reality content information to be transmitted based on whether the location information and the local information correspond, so that advertisers who want to provide content in a limited area can efficiently provide the content.
  • FIG. 1 is a view illustrating a technique for providing an augmented reality advertisement by recognizing a marker displayed on a conventional advertisement.
  • FIG. 2 is a diagram illustrating a configuration of an augmented reality content providing system according to an embodiment of the present invention.
  • FIG. 3 is a diagram illustrating an example of providing augmented reality-based content after capturing a front image that is an image of a part of a product with a camera according to an embodiment of the present invention.
  • FIG. 4 is a diagram illustrating an example of providing augmented reality-based content after capturing a side view image of a part of a product with a camera according to an embodiment of the present invention.
  • FIG. 5 is a diagram illustrating an example of providing augmented reality-based content after capturing a detailed image that is an image of a part of a product with a camera according to an embodiment of the present invention.
  • FIG. 6 is a flowchart illustrating a method for providing augmented reality content according to an embodiment of the present invention.
  • the augmented reality content providing system includes an augmented reality information receiving unit for receiving product image information and augmented reality content information, product image information and augmented reality received from the augmented reality information receiving unit.
  • An augmented reality information database storing content information, a photographing image receiving unit receiving an image captured by a camera from a user terminal, and identifying product image information corresponding to the photographed image among product image information stored in the augmented reality information database It may include an image identification unit, augmented reality information transmission unit for transmitting augmented reality content information corresponding to the identified product image information to the user terminal.
  • the product image information may include one or more images of at least a part of the product
  • the augmented reality information database may store the augmented reality content information corresponding to each of the images of the at least part of the product, and identify the image.
  • the unit identifies an image of at least a portion of the product corresponding to the photographed image
  • the augmented reality information transmitter transmits the augmented reality content information corresponding to the image of at least a portion of the identified product to the user terminal. It can be configured to feature.
  • the product image information may further include product identification information, and the image identification unit may identify the product image information by identifying the product identification information corresponding to the photographed image, and may be included in the identified product image information. It may be configured to identify an image corresponding to the captured image from the image of at least a part of the product.
  • the augmented reality information receiving unit further receives the augmented reality content exposure cost information, and the augmented reality information transmission unit augmented reality content exposure cost information, if the received product image information is duplicated in the augmented reality information database It may be configured to select the augmented reality content information to be transmitted to the user terminal based on.
  • the augmented reality information receiving unit may further include local information corresponding to the augmented reality content, and the augmented reality information transmitting unit receives location information of the user terminal from the user terminal, and the location information and the local information of the local information. And determining the augmented reality content information to be transmitted based on the correspondence.
  • Augmented reality content providing system may be configured in the form of a server having a central processing unit (CPU) and a memory (Memory, storage device) and connectable to other terminals via a communication network, such as the Internet.
  • CPU central processing unit
  • memory memory, storage device
  • the present invention is not limited by the configuration of the central processing unit and the memory.
  • the augmented reality content providing system according to the present invention may be physically configured as a single device, may be implemented in a distributed form in a plurality of devices, the present invention is not limited by the configuration of such a physical device No.
  • FIG. 2 is a diagram illustrating a configuration of an augmented reality content providing system according to an embodiment of the present invention.
  • Augmented reality content providing system comprises augmented reality information receiving unit 210, augmented reality information database 220, photographed image receiving unit 230, image identification unit 240, augmented reality information transmission unit 250
  • Each component may be a software module operating in the same physical computer system, and two or more separate computer systems may be configured to operate in conjunction with each other.
  • Various embodiments including the same belong to the scope of the present invention.
  • the augmented reality information receiver 210 receives product image information and augmented reality content information.
  • the image of the product received by the augmented reality information receiving unit 210 may be an image including the information of the product to be advertised, the augmented reality content information may include information such as advertising or instructions for use of the product to be advertised.
  • the user's terminal may be matched with an image of a product photographed by the user to output information about the product or may include an image of a character or a person for promoting the product.
  • the product image information received by the augmented reality information receiver 210 includes one or more images of at least a part of the product.
  • the product image information received by the augmented reality information receiver 210 may be an image of a part of the entire product to be advertised.
  • the product image information may be one of the image of the side of the car, the image of the front, and the image of the rear.
  • the image of the product such as the handle of the car, the dashboard of the car, and the wheel of the car.
  • the information can be all parts that make up the automobile.
  • the product image information received by the augmented reality information receiver 210 includes product identification information.
  • the product identification information received by the augmented reality information receiver 210 may be information about a part of the product, and may include information about a part as well as the entire product to be advertised. For example, if the product you want to advertise is A car, product image information is A car, A car side, A car front, A car rear, A car dashboard, A car handle, A wheel It may include detailed identification information of a related product.
  • Product image information received by the augmented reality information receiver 210 as the product identification information may be any information that can identify a product consisting of a logo, a character, a QR code, a barcode, a character or an image.
  • the augmented reality information receiving unit 210 receives augmented reality content exposure cost information.
  • the augmented reality information receiver 210 may receive cost information according to a frequency or time at which the augmented reality content is exposed to the consumer. Advertisers who wish to advertise their products must pay for exposing augmented reality content associated with a product they want to product, and the augmented reality information receiver 210 receives augmented reality content exposure cost information, which is an advertisement cost that an advertiser wants to pay. Can be received.
  • the augmented reality information receiving unit 210 includes local information corresponding to the augmented reality content.
  • the augmented reality information receiving unit 210 may include local information corresponding to the augmented reality content containing the content to be advertised.
  • the augmented reality content includes the product advertising content, the product to be advertised may be located in a limited region or irrelevant to the region.
  • the augmented reality information receiver 210 may receive information matching the augmented reality content and local information.
  • the augmented reality content containing the information of the product to be advertised in a limited area does not want to expose the augmented reality information received from the augmented reality information receiver 210 by matching the information that does not include local information Can be.
  • the augmented reality information database 220 stores product image information and augmented reality content information received from the augmented reality information receiver 210.
  • the augmented reality information database 220 stores the product image information including the partial image or the whole image of the product received by the augmented reality information receiver 210 and the augmented reality content information including the advertising content of the product to be advertised Can be.
  • the augmented reality information database 220 stores the augmented reality content information corresponding to each image of at least a part of the product.
  • the augmented reality information database 220 may store product image information including a partial image of a product and augmented reality content information including promotional information of a product to be advertised.
  • the vehicle dashboard which is a part of the image of automobile A, is stored in the augmented reality information database 220, and the augmented reality content information including the advertisement information about the vehicle dashboard of the automobile A is augmented reality information database 220 ) Can be stored.
  • the augmented reality information database 220 may store and match the augmented reality content information including the advertisement information for the vehicle instrument panel image of the vehicle A and the vehicle instrument panel of the A vehicle product.
  • the captured image receiving unit 230 receives an image captured by the camera from the user terminal.
  • the photographed image receiver 230 may receive an image and an image of a product photographed by a user by a camera of the user terminal.
  • the image of the product photographed by the user may be an image or a whole image of a portion of the product.
  • the image identification unit 240 identifies product image information corresponding to the captured image among the product image information stored in the augmented reality information database 220.
  • the image identification unit 240 may search for the image photographed by the user of the camera of the user terminal in the product image information stored in the augmented reality information database 220 to identify the product photographed by the user of the camera of the user terminal.
  • the product photographed by the user is identified by the image of the car A stored in the augmented reality information database 220 based on the captured image. You can see that.
  • the image identification unit 240 identifies an image of at least a part of the product corresponding to the captured image.
  • the image identification unit 240 may identify a product photographed by the camera of the user terminal by searching for some images of the product photographed by the camera of the user terminal in the product image information stored in the augmented reality information database 220. have.
  • the augmented reality information database 220 stores the entire image of the product, the image identification unit 240 is based on the image of the part of the product photographed by the user of the entire image stored in the augmented reality information database 220 Can be identified.
  • the augmented reality information database 220 may store an image corresponding to the entire vehicle A.
  • the user photographs the side of the A car with the camera of the user terminal, and the image identification unit 240 is stored in the augmented reality information database 220 to extract a part of the image related to the side of the A car from the entire image of the A car. It is possible to identify that the image of a part of the product photographed by the user is A car.
  • the image identification unit 240 identifies product image information by checking product identification information corresponding to the captured image.
  • the image identification unit 240 may identify a product to be advertised through the image photographed by the user terminal. For example, when the vehicle A is photographed by the user terminal, the image identification unit 240 may identify that the image photographed by the user is vehicle A.
  • the image identification unit 240 identifies an image corresponding to the captured image among images of at least a part of the product included in the identified product image information.
  • the image identification unit 240 analyzes the image of the part photographed by the user to recognize the product to be advertised, and the part of the product the part of the product the user wants to advertise. Can be identified.
  • the image identification unit 240 may identify that the information of the motor vehicle A and the motor vehicle of the A vehicle through the image photographed by the user.
  • the augmented reality information transmitting unit 250 transmits augmented reality content information corresponding to the identified product image information to the user terminal.
  • the augmented reality information transmitting unit 250 may transmit augmented reality content information matching the product image information identified based on the image photographed by the user to the user terminal.
  • the augmented reality content information may be content related to a product to be advertised, and may provide an advertisement about a product included in an image captured by the user.
  • the augmented reality information transmission unit 250 transmits augmented reality content information corresponding to an image of at least a part of the identified product to the user terminal.
  • the augmented reality information transmitting unit 250 may transmit augmented reality content information of a product to be advertised in which a part of the product matches the photographed image to the user terminal.
  • the user may receive advertisements and promotions about the A dashboard of the A car from the user terminal based on augmented reality.
  • the augmented reality information transmitter 250 selects augmented reality content information to be transmitted to the user terminal based on augmented reality content exposure cost information when the product image information received from the augmented reality information database 220 overlaps.
  • the augmented reality information transmitting unit 250 may transmit augmented reality content having a high cost of exposing augmented reality content when an image of a product to be advertised overlaps.
  • the augmented reality content of the advertiser may be transmitted to the user's terminal, which shows a higher augmented reality content exposure cost that the advertiser intends to pay for the advertisement cost.
  • Advertisers may propose augmented reality content exposure costs in order to provide augmented reality content.
  • the augmented reality information receiving unit 210 may receive augmented reality content exposure costs presented by three people.
  • the augmented reality information transmission unit 250 includes the augmented reality content information of the (C) advertiser having the highest exposure cost of augmented reality content among three advertisers. Can be selected and transmitted to the user terminal.
  • the augmented reality information transmitter 250 receives the location information of the user terminal from the user terminal, and determines the augmented reality content information to be transmitted based on whether the location information and the local information correspond.
  • the augmented reality information transmitting unit 250 receives location information of the user terminal from the user's terminal, and matches the user terminal location information with the local information corresponding to the augmented reality content received by the augmented reality information receiving unit 210.
  • the augmented reality content corresponding to the product photographed by the user may be transmitted.
  • the user is located in Seocho-dong and the augmented reality information transmission unit 250 may receive information that the user terminal is located in Seocho-dong.
  • the augmented reality information receiving unit 210 may receive augmented reality content of the advertiser (C) advertisers in the A car sales business in Seocho-dong. If the user wants to receive the augmented reality content information by photographing the side of the A car, (C) the advertiser receives the augmented reality content, the user may receive the content transmitted by the (C) advertiser.
  • the advertiser is a car dealership in Seocho-dong, but if you want to send augmented reality content information including your own product information to Yeoksam-dong, you can specify the area to Seocho-dong and Yeoksam-dong, located in Seocho-dong and Yeoksam-dong. While transmitting the augmented reality content information for the vehicle A can be transmitted to the user.
  • FIG. 3 is a diagram illustrating an example of providing augmented reality-based content after capturing a front image that is an image of a part of a product with a camera according to an embodiment of the present invention.
  • the product image information includes one or more images of at least a part of the product
  • the augmented reality information database 220 stores the augmented reality content information corresponding to each image of at least a part of the product, and stores the image identification unit 240. May identify an image of at least a part of the product corresponding to the captured image, and the augmented reality information transmitter 250 may transmit augmented reality content information corresponding to the image of at least a part of the identified product to the user terminal. .
  • the augmented reality content corresponding to the front of the vehicle A, the object is located in the driver's seat 301 may be provided to explain the contents such as the precautions when driving the vehicle A.
  • the augmented reality information transmission unit 250 recognizes the information that the front side of the A vehicle was photographed and the augmented reality content by positioning the object in the driver's seat in the user's terminal Can be transmitted.
  • FIG. 4 is a diagram illustrating an example of providing augmented reality-based content after capturing a side view image of a part of a product with a camera according to an embodiment of the present invention.
  • the product image information includes one or more images of at least a part of the product
  • the augmented reality information database 220 stores the augmented reality content information corresponding to each image of at least a part of the product, and stores the image identification unit 240. May identify an image of at least a part of the product corresponding to the captured image, and the augmented reality information transmitter 250 may transmit augmented reality content information corresponding to the image of at least a part of the identified product to the user terminal. .
  • the augmented reality content corresponding to the side of the car A provides information on various advertisements and promotions such as the car's driving precautions or fueling when the object holding the stick is located on the side of the car. Content may be provided.
  • the information on the side of the vehicle A was recognized and the augmented reality information transmission unit 250 augmented with the object holding the stick on the user's terminal located on the side of the vehicle. Real content can be transmitted.
  • FIG. 5 is a diagram illustrating an example of providing augmented reality-based content after capturing a detailed image that is an image of a part of a product with a camera according to an embodiment of the present invention.
  • the product image information includes one or more images of at least a part of the product
  • the augmented reality information database 220 stores the augmented reality content information corresponding to each image of at least a part of the product, and stores the image identification unit 240. May identify an image of at least a part of the product corresponding to the captured image, and the augmented reality information transmitter 250 may transmit augmented reality content information corresponding to the image of at least a part of the identified product to the user terminal. .
  • the augmented reality content corresponding to the dashboard of the automobile A may be provided with content that provides information on the description of the dashboard in text.
  • the augmented reality information transmitter 250 recognizes the information that the instrument panel of the A vehicle is photographed, and the engine tachometer, speedometer, fuel gauge, Augmented reality content with a callout, such as a odometer, may be transmitted.
  • FIG. 6 is a flowchart illustrating a method for providing augmented reality content according to an embodiment of the present invention.
  • the augmented reality content providing system may be implemented and realized by a method for providing augmented reality content, and the technical idea of the augmented reality content providing system may be applied as it is.
  • Such augmented reality content providing method may be implemented in the form of program instructions that may be implemented as an application or executed through various computer components, and recorded in a computer readable recording medium.
  • the computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination.
  • the program instructions recorded on the computer-readable recording medium are those specially designed and configured for the present invention, and may be known and available to those skilled in the computer software arts.
  • Product image information and augmented reality content information receiving step (S601) receives the product image information and augmented reality content information.
  • the product image information and the image of the product received in the augmented reality content information receiving step (S601) may be an image including the information of the product to be advertised, the augmented reality content information includes the advertising content for the product to be advertised. .
  • the product image information received in the product image information and augmented reality content information receiving step (S601) includes one or more images of at least a part of the product.
  • Product image information received in the product image information and augmented reality content information receiving step (S601) may be an image of a portion of the entire product to be advertised.
  • the product image information received in the product image information and augmented reality content information receiving step S601 includes product identification information.
  • the product identification information received in the product image information and augmented reality content information receiving step S601 may be information about a part of the product, and may include information about a part as well as the entire product to be advertised.
  • the product image information received in the product image information and augmented reality content information receiving step (S601) may be any information that can identify the product to be advertising consisting of a QR code, a barcode, numbers or letters.
  • Product image information and augmented reality content information receiving step (S601) receives augmented reality content exposure cost information.
  • the product image information and augmented reality content information receiving step (S601) may receive the cost information according to the frequency or time that the augmented reality content is exposed to the consumer. Advertisers who wish to advertise their products must pay for exposing augmented reality content associated with products they want to product, and step S601 of receiving product image information and augmented reality content information is an augmentation that is an advertisement cost that an advertiser intends to pay. Real content exposure cost information may be received.
  • the product image information and augmented reality content information receiving step (S601) includes local information corresponding to the augmented reality content.
  • Product image information and augmented reality content information receiving step (S601) may include local information corresponding to the augmented reality content containing the content to be advertised.
  • the augmented reality content includes the product advertising content, the product to be advertised may be located in a limited region or irrelevant to the region.
  • information matching the augmented reality content and local information may be received in a product image information and augmented reality content information receiving step (S601). .
  • the augmented reality content containing the information of the product to be advertised in a limited area does not want to expose the product image information and augmented reality content information matching step by matching the information that does not include the local information It can be received at (S601).
  • the storing of the content information in the augmented reality information database stores the product image information and the augmented reality content information received in the augmented reality content information receiving step (S601).
  • the step of storing the content information in the augmented reality information database (S602) is product image information and product image information including a part image or the entire image of the product received in the augmented reality content information receiving step (S601) and the product to be advertised Augmented reality content information, including the advertising content of the can be stored.
  • the step of storing the content information in the augmented reality information database stores the augmented reality content information corresponding to each image of at least a part of the product.
  • the step of storing the content information in the augmented reality information database may store the product image information including the partial image of the product and the augmented reality content information containing the promotional information of the product to be advertised.
  • Receiving the captured image receives the image captured by the camera from the user terminal.
  • the user may receive an image and an image of a product photographed by a camera of the user terminal.
  • the image of the product photographed by the user may be an image or a whole image of a part of the product.
  • Identifying the product image information (S604) identifies the product image information corresponding to the captured image of the product image information stored in the step (S602) of storing the content information in the augmented reality information database.
  • Identifying the product image information is to retrieve the image taken by the user of the camera of the user terminal in the product image information stored in the step of storing the content information in the augmented reality information database (S602) so that the user of the camera of the user terminal Products can be identified by the camera.
  • Identifying product image information (S604) identifies an image of at least a portion of the product corresponding to the captured image.
  • Identifying the product image information is a user retrieves a part of the image of the product photographed by the user of the camera of the user terminal in the product image information stored in the step of storing the content information in the augmented reality information database (S602)
  • a product photographed with a camera of a terminal can be identified.
  • the step of storing the content information in the augmented reality information database (S602) is stored the entire image of the product to identify the product image information (S604) to store the content information in the augmented reality information database (S602)
  • the product can be identified based on an image of a part of the product photographed by the user among the entire images.
  • Identifying product image information (S604) identifies product image information by checking product identification information corresponding to the captured image.
  • Identifying product image information may identify a product to be advertised through an image captured by the user terminal.
  • Identifying product image information (S604) identifies an image corresponding to the captured image among images of at least a part of the product included in the identified product image information.
  • step S604 when the user photographs a part of the product, the product image information may be analyzed to recognize a product to be advertised by analyzing the part of the photographed product, and the part of the image photographed by the user may advertise. It can identify which part of the product it is.
  • the augmented reality content information is transmitted to the user terminal.
  • the augmented reality content information corresponding to the identified product image information is transmitted to the user terminal.
  • the augmented reality content information matching the product image information identified based on the image photographed by the user may be transmitted to the user terminal.
  • the augmented reality content information may be content related to a product to be advertised, and may provide an advertisement about a product included in an image captured by the user.
  • the augmented reality content information is transmitted to the user terminal.
  • the augmented reality content information corresponding to the image of at least a part of the identified product is transmitted to the user terminal.
  • augmented reality content information of a product to be matched with a photographed image of a part of the product may be transmitted to the user terminal.
  • step S605 of transmitting the augmented reality content information to the user terminal when the product image information received in the step S602 of storing the content information in the augmented reality information database is duplicated, the user based on the augmented reality content exposure cost information. Select augmented reality content information to be transmitted to the terminal.
  • step S605 of transmitting the augmented reality content information to the user terminal receiving the location information of the user terminal from the user terminal, and determines the augmented reality content information to be transmitted based on whether the location information and the local information correspond.
  • the augmented reality content information may be transmitted to the user terminal, and the location information of the user terminal may be received from the user terminal.
  • the augmented reality content corresponding to the product photographed by the user may be transmitted.
  • Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CDROMs, DVDs, and magneto-optical media such as floptical disks. And hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like.
  • Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.
  • the hardware device may be configured to operate as one or more software modules to perform the process according to the invention, and vice versa.
  • the present invention relates to a system and a method for maximizing an advertisement effect by recognizing a registered image such as a corporate logo or a product and providing a 3D advertisement as an augmented reality, and receiving product image information and augmented reality content information.
  • Augmented reality information receiving unit augmented reality information database for storing the received product image information and augmented reality content information, a recording image receiving unit for receiving the image taken by the camera from the user terminal, corresponding to the image taken from the stored product image information
  • an augmented reality-based content providing system and method comprising an image identification unit for identifying product image information, augmented reality information transmission unit for transmitting augmented reality content information corresponding to the identified product image information to the user terminal.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Finance (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Game Theory and Decision Science (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Economics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The present invention relates to a system and a method for maximizing an advertisement effect by recognizing a registered image such as a corporate logo or a product and providing a 3D advertisement as augmented reality. The present invention provides an augmented reality-based content providing system and method, comprising: an augmented reality information receiving unit for receiving product image information and augmented reality content information; an augmented reality information database for storing the received product image information and augmented reality content information; a captured image receiving unit for receiving, from a user terminal, an image captured by a camera; an image identification unit for identifying product image information corresponding to the captured image among the stored product image information; and an augmented reality information transmission unit for transmitting, to the user terminal, augmented reality content information corresponding to the identified product image information.

Description

증강현실 컨텐츠 제공 시스템 및 방법Augmented reality content providing system and method
본 발명은 증강현실 기반의 컨텐츠 제공 시스템 및 방법에 관한 것으로, 기업 로고 또는 제품 등의 등록된 이미지를 인식하여 3D 광고를 증강현실로 제공함으로써, 광고 효과를 극대화할 수 있도록 하는 시스템 및 방법에 관한 것이다.The present invention relates to a system and method for providing content based on augmented reality, and to a system and method for maximizing an advertisement effect by recognizing a registered image such as a corporate logo or a product and providing a 3D advertisement as an augmented reality. will be.
증강현실 기술은 현실세계의 영상에 3D 오브젝트 등의 객체를 정합하여 제공함으로써, 실제 현실세계에 해당 오브젝트가 존재하는 것과 같은 현실감을 제공할 수 있도록 하는 기술이다.The augmented reality technology is a technology that provides a reality such that the object exists in the real world by matching and providing objects such as 3D objects to the image of the real world.
종래기술인 한국공개특허 제10-2016-0092292호, "광고물에 대한 증강현실 서비스 제공 시스템 및 방법"은 광고물에 표시된 마커를 인식하여 증강현실 광고를 제공하도록 하는 기술인데, 도 1을 보면 카메라로 광고물에 표시된 마커를 촬영하면 마커를 인식하여 증강현실 광고를 제공할 수 있도록 하는 것으로 이와 같은 광고를 구현하기 위해서는 소비자에게 마커가 포함된 광고물을 전달해야 하는 불편함이 있다.Prior art Korean Patent Publication No. 10-2016-0092292, "Augmented reality service providing system and method for advertisement" is a technology to provide augmented reality advertising by recognizing the markers displayed on the advertisement, see Figure 1 By photographing the markers displayed on the advertisement, it is possible to provide augmented reality advertisement by recognizing the marker. In order to implement such an advertisement, it is inconvenient to deliver the advertisement containing the marker to the consumer.
따라서, 별도의 광고물 등이 없이도 현실감 있는 증강현실 광고를 제공할 수 있도록 하는 시스템 및 방법이 요구된다.Accordingly, there is a need for a system and method for providing realistic augmented reality advertisement without a separate advertisement.
본 발명은 사용자가 사용자 단말기로 제품을 촬영하여 별도의 광고물 등이 없어도 현실감 있는 증강현실 컨텐츠를 제공 받을 수 있도록 하는 것을 목적으로 한다.An object of the present invention is to allow a user to shoot a product with a user terminal to provide a realistic augmented reality content even without a separate advertisement.
본 발명은 일부 촬영된 제품의 이미지로 제품을 식별할 수 있도록 함으로써 사용자가 제품의 일부분을 촬영하여도 증강현실 컨텐츠를 제공받을 수 있도록 하는 것을 목적으로 한다.An object of the present invention is to enable a user to identify a product by an image of a part of a photographed product, so that a user can receive augmented reality content even when photographing a part of the product.
본 발명은 일부 촬영된 제품의 이미지로 그 제품의 일부분을 식별함으로써 사용자가 원하는 제품의 특정 부분의 정보를 위한 증강현실 컨텐츠를 제공받을 수 있도록 하는 것을 목적으로 한다.An object of the present invention is to identify a part of a product by an image of a part of a photographed product so that a user can be provided with augmented reality content for information of a specific part of a desired product.
본 발명은 증강현실 컨텐츠 노출 비용 정보를 기초로 사용자 단말기로 전송할 증강현실 컨텐츠 정보를 선정함으로써 동일한 증강현실 컨텐츠를 제공하고자 하는 광고주가 증강현실 컨텐츠 노출 비용을 통한 공정한 경쟁을 할 수 있도록 하는 것을 목적으로 한다.An object of the present invention is to select the augmented reality content information to be transmitted to the user terminal based on the augmented reality content exposure cost information, so that advertisers who want to provide the same augmented reality content can compete fairly through the augmented reality content exposure costs. do.
본 발명은 위치 정보 및 지역정보의 대응 여부에 기초하여 전송할 증강현실 컨텐츠 정보를 결정함으로써, 한정된 지역에서 컨텐츠를 제공하고자 하는 광고주가 효율적으로 컨텐츠를 제공할 수 있도록 하는 것을 목적으로 한다.An object of the present invention is to determine the augmented reality content information to be transmitted based on the correspondence of location information and local information, so that advertisers who want to provide content in a limited area can efficiently provide content.
이러한 목적을 달성하기 위하여 본 발명의 일 실시예에 따른 증강현실 컨텐츠 제공 시스템은 제품 이미지 정보 및 증강현실 컨텐츠 정보를 수신하는 증강현실 정보 수신부, 상기 증강현실 정보 수신부에서 수신한 제품 이미지 정보 및 증강현실 컨텐츠 정보를 저장하는 증강현실 정보 데이터베이스, 사용자 단말기로부터 카메라를 통해 촬영된 영상을 수신하는 촬영 영상 수신부, 상기 증강현실 정보 데이터베이스에 저장된 제품 이미지 정보 중 상기 촬영된 영상에 대응되는 제품 이미지 정보를 식별하는 이미지 식별부, 상기 식별된 제품 이미지 정보에 대응되는 증강현실 컨텐츠 정보를 상기 사용자 단말기로 전송하는 증강현실 정보 전송부를 포함하여 구성될 수 있다.In order to achieve the above object, the augmented reality content providing system according to an embodiment of the present invention includes an augmented reality information receiving unit for receiving product image information and augmented reality content information, product image information and augmented reality received from the augmented reality information receiving unit. An augmented reality information database storing content information, a photographing image receiving unit receiving an image captured by a camera from a user terminal, and identifying product image information corresponding to the photographed image among product image information stored in the augmented reality information database It may include an image identification unit, augmented reality information transmission unit for transmitting augmented reality content information corresponding to the identified product image information to the user terminal.
또한, 상기 제품 이미지 정보는 제품의 적어도 일부에 대한 이미지를 하나 이상 포함하고, 상기 증강현실 정보 데이터베이스는 상기 제품의 적어도 일부에 대한 이미지 각각에 상기 증강현실 컨텐츠 정보를 대응시켜 저장하고, 상기 이미지 식별부는 상기 촬영된 영상에 대응되는 상기 제품의 적어도 일부에 대한 이미지를 식별하고, 상기 증강현실 정보 전송부는 상기 식별된 제품의 적어도 일부에 대한 이미지에 대응되는 상기 증강현실 컨텐츠 정보를 상기 사용자 단말기로 전송하는 것을 특징으로 하여 구성될 수 있다.The product image information may include one or more images of at least a part of the product, and the augmented reality information database may store the augmented reality content information corresponding to each of the images of the at least part of the product, and identify the image. The unit identifies an image of at least a portion of the product corresponding to the photographed image, and the augmented reality information transmitter transmits the augmented reality content information corresponding to the image of at least a portion of the identified product to the user terminal. It can be configured to feature.
또한, 상기 제품 이미지 정보는 제품 식별 정보를 더 포함하고, 상기 이미지 식별부는 상기 촬영된 영상에 대응되는 상기 제품 식별 정보를 확인하여 상기 제품 이미지 정보를 식별하고, 상기 식별된 제품 이미지 정보에 포함된 상기 제품의 적어도 일부에 대한 이미지 중에서 상기 촬영된 영상에 대응되는 이미지를 식별하는 것을 특징으로 하여 구성될 수 있다.The product image information may further include product identification information, and the image identification unit may identify the product image information by identifying the product identification information corresponding to the photographed image, and may be included in the identified product image information. It may be configured to identify an image corresponding to the captured image from the image of at least a part of the product.
또한, 상기 증강현실 정보 수신부는 상기 증강현실 컨텐츠 노출 비용 정보를 더 수신하고, 상기 증강현실 정보 전송부는 상기 증강현실 정보 데이터베이스에서 상기 수신한 제품 이미지 정보가 중복되는 경우, 상기 증강현실 컨텐츠 노출 비용 정보를 기초로 상기 사용자 단말기로 전송할 증강현실 컨텐츠 정보를 선정하는 것을 특징으로 하여 구성될 수 있다.The augmented reality information receiver further receives the augmented reality content exposure cost information, and the augmented reality information transmission unit, the augmented reality content exposure cost information when the received product image information is duplicated in the augmented reality information database It may be configured to select the augmented reality content information to be transmitted to the user terminal based on.
또한, 상기 증강현실 정보 수신부는 상기 증강현실 컨텐츠에 대응되는 지역정보를 더 포함하고, 상기 증강현실 정보 전송부는 상기 사용자 단말기로부터 상기 사용자 단말기의 위치 정보를 수신하고, 상기 위치 정보 및 상기 지역정보의 대응 여부에 기초하여 상기 전송할 증강현실 컨텐츠 정보를 결정하는 것을 특징으로 하여 구성될 수 있다.The augmented reality information receiving unit may further include local information corresponding to the augmented reality content, and the augmented reality information transmitting unit receives location information of the user terminal from the user terminal, and the location information and the local information of the local information. And determining the augmented reality content information to be transmitted based on the correspondence.
본 발명은 사용자가 사용자 단말기로 제품을 촬영하여 별도의 광고물 등이 없어도 현실감 있는 증강현실 컨텐츠를 제공 받을 수 있도록 한다.The present invention allows the user to photograph the product with the user terminal to provide a realistic augmented reality content even without a separate advertisement.
본 발명은 일부 촬영된 제품의 이미지로 제품을 식별할 수 있도록 함으로써 사용자가 제품의 일부분을 촬영하여도 증강현실 컨텐츠를 제공받을 수 있도록 한다.The present invention enables the user to identify the product by the image of the partly photographed product, so that the user can be provided with the augmented reality content even when photographing a part of the product.
본 발명은 일부 촬영된 제품의 이미지로 그 제품의 일부분을 식별함으로써 사용자가 원하는 제품의 특정 부분의 정보를 위한 증강현실 컨텐츠를 제공받을 수 있도록 한다.The present invention enables the user to be provided with augmented reality content for information of a specific part of a desired product by identifying a part of the product by an image of a part of the photographed product.
본 발명은 증강현실 컨텐츠 노출 비용 정보를 기초로 사용자 단말기로 전송할 증강현실 컨텐츠 정보를 선정함으로써 동일한 증강현실 컨텐츠를 제공하고자 하는 광고주가 증강현실 컨텐츠 노출 비용을 통한 공정한 경쟁을 할 수 있도록 한다.The present invention selects augmented reality content information to be transmitted to a user terminal based on augmented reality content exposure cost information, so that advertisers who want to provide the same augmented reality content can compete fairly through augmented reality content exposure costs.
본 발명은 위치 정보 및 지역정보의 대응 여부에 기초하여 전송할 증강현실 컨텐츠 정보를 결정함으로써, 한정된 지역에서 컨텐츠를 제공하고자 하는 광고주가 효율적으로 컨텐츠를 제공할 수 있도록 한다.The present invention determines the augmented reality content information to be transmitted based on whether the location information and the local information correspond, so that advertisers who want to provide content in a limited area can efficiently provide the content.
도 1은 종래기술인 광고물에 표시된 마커를 인식하여 증강현실 광고를 제공하도록 하는 기술을 도면이다.1 is a view illustrating a technique for providing an augmented reality advertisement by recognizing a marker displayed on a conventional advertisement.
도 2는 본 발명의 일실시예에 따른 증강현실 컨텐츠 제공 시스템의 구성도를 도시한 도면이다.2 is a diagram illustrating a configuration of an augmented reality content providing system according to an embodiment of the present invention.
도 3은 본 발명의 일실시예에 따른 카메라로 제품의 일부에 대한 이미지인 전면 영상을 촬영한 후에 증강현실 기반의 컨텐츠를 제공하는 일례를 도시한 도면이다.3 is a diagram illustrating an example of providing augmented reality-based content after capturing a front image that is an image of a part of a product with a camera according to an embodiment of the present invention.
도 4는 본 발명의 일실시예에 따른 카메라로 제품의 일부에 대한 이미지인 측면 영상을 촬영한 후에 증강현실 기반의 컨텐츠를 제공하는 일례를 도시한 도면이다.4 is a diagram illustrating an example of providing augmented reality-based content after capturing a side view image of a part of a product with a camera according to an embodiment of the present invention.
도 5는 본 발명의 일실시예에 따른 카메라로 제품의 일부에 대한 이미지인 세부 영상을 촬영한 후에 증강현실 기반의 컨텐츠를 제공하는 일례를 도시한 도면이다.5 is a diagram illustrating an example of providing augmented reality-based content after capturing a detailed image that is an image of a part of a product with a camera according to an embodiment of the present invention.
도 6은 본 발명의 일실시예에 따른 증강현실 컨텐츠 제공 방법의 순서도를 도시한 도면이다.6 is a flowchart illustrating a method for providing augmented reality content according to an embodiment of the present invention.
이러한 목적을 달성하기 위하여 본 발명의 일 실시예에 따른 증강현실 컨텐츠 제공 시스템은 제품 이미지 정보 및 증강현실 컨텐츠 정보를 수신하는 증강현실 정보 수신부, 상기 증강현실 정보 수신부에서 수신한 제품 이미지 정보 및 증강현실 컨텐츠 정보를 저장하는 증강현실 정보 데이터베이스, 사용자 단말기로부터 카메라를 통해 촬영된 영상을 수신하는 촬영 영상 수신부, 상기 증강현실 정보 데이터베이스에 저장된 제품 이미지 정보 중 상기 촬영된 영상에 대응되는 제품 이미지 정보를 식별하는 이미지 식별부, 상기 식별된 제품 이미지 정보에 대응되는 증강현실 컨텐츠 정보를 상기 사용자 단말기로 전송하는 증강현실 정보 전송부를 포함하여 구성될 수 있다.In order to achieve the above object, the augmented reality content providing system according to an embodiment of the present invention includes an augmented reality information receiving unit for receiving product image information and augmented reality content information, product image information and augmented reality received from the augmented reality information receiving unit. An augmented reality information database storing content information, a photographing image receiving unit receiving an image captured by a camera from a user terminal, and identifying product image information corresponding to the photographed image among product image information stored in the augmented reality information database It may include an image identification unit, augmented reality information transmission unit for transmitting augmented reality content information corresponding to the identified product image information to the user terminal.
또한, 상기 제품 이미지 정보는 제품의 적어도 일부에 대한 이미지를 하나 이상 포함하고, 상기 증강현실 정보 데이터베이스는 상기 제품의 적어도 일부에 대한 이미지 각각에 상기 증강현실 컨텐츠 정보를 대응시켜 저장하고, 상기 이미지 식별부는 상기 촬영된 영상에 대응되는 상기 제품의 적어도 일부에 대한 이미지를 식별하고, 상기 증강현실 정보 전송부는 상기 식별된 제품의 적어도 일부에 대한 이미지에 대응되는 상기 증강현실 컨텐츠 정보를 상기 사용자 단말기로 전송하는 것을 특징으로 하여 구성될 수 있다.The product image information may include one or more images of at least a part of the product, and the augmented reality information database may store the augmented reality content information corresponding to each of the images of the at least part of the product, and identify the image. The unit identifies an image of at least a portion of the product corresponding to the photographed image, and the augmented reality information transmitter transmits the augmented reality content information corresponding to the image of at least a portion of the identified product to the user terminal. It can be configured to feature.
또한, 상기 제품 이미지 정보는 제품 식별 정보를 더 포함하고, 상기 이미지 식별부는 상기 촬영된 영상에 대응되는 상기 제품 식별 정보를 확인하여 상기 제품 이미지 정보를 식별하고, 상기 식별된 제품 이미지 정보에 포함된 상기 제품의 적어도 일부에 대한 이미지 중에서 상기 촬영된 영상에 대응되는 이미지를 식별하는 것을 특징으로 하여 구성될 수 있다.The product image information may further include product identification information, and the image identification unit may identify the product image information by identifying the product identification information corresponding to the photographed image, and may be included in the identified product image information. It may be configured to identify an image corresponding to the captured image from the image of at least a part of the product.
또한, 상기 증강현실 정보 수신부는 상기 증강현실 컨텐츠 노출 비용 정보를 더 수신하고, 상기 증강현실 정보 전송부는 상기 증강현실 정보 데이터베이스에서 상기 수신한 제품 이미지 정보가 중복되는 경우, 상기 증강현실 컨텐츠 노출 비용 정보를 기초로 상기 사용자 단말기로 전송할 증강현실 컨텐츠 정보를 선정하는 것을 특징으로 하여 구성될 수 있다.The augmented reality information receiving unit further receives the augmented reality content exposure cost information, and the augmented reality information transmission unit augmented reality content exposure cost information, if the received product image information is duplicated in the augmented reality information database It may be configured to select the augmented reality content information to be transmitted to the user terminal based on.
또한, 상기 증강현실 정보 수신부는 상기 증강현실 컨텐츠에 대응되는 지역정보를 더 포함하고, 상기 증강현실 정보 전송부는 상기 사용자 단말기로부터 상기 사용자 단말기의 위치 정보를 수신하고, 상기 위치 정보 및 상기 지역정보의 대응 여부에 기초하여 상기 전송할 증강현실 컨텐츠 정보를 결정하는 것을 특징으로 하여 구성될 수 있다.The augmented reality information receiving unit may further include local information corresponding to the augmented reality content, and the augmented reality information transmitting unit receives location information of the user terminal from the user terminal, and the location information and the local information of the local information. And determining the augmented reality content information to be transmitted based on the correspondence.
이하, 본 발명의 바람직한 실시예를 첨부된 도면들을 참조하여 상세히 설명한다. 본 발명을 설명함에 있어, 관련된 공지 구성 또는 기능에 대한 구체적인 설명이 본 발명의 요지를 흐릴 수 있다고 판단되는 경우에는 그 상세한 설명은 생략하기로 한다. 또한 본 발명의 실시예들을 설명함에 있어 구체적인 수치는 실시예에 불과하며 이에 의하여 발명의 범위가 제한되지 아니한다.Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In describing the present invention, when it is determined that the detailed description of the related well-known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted. In addition, in describing the embodiments of the present invention, specific numerical values are only examples, and the scope of the present invention is not limited thereto.
본 발명에 따른 증강현실 컨텐츠 제공 시스템은 중앙처리장치(CPU) 및 메모리(Memory, 기억장치)를 구비하고 인터넷 등의 통신망을 통하여 다른 단말기와 연결 가능한 서버의 형태로 구성될 수 있다. 그러나 본 발명이 중앙처리장치 및 메모리 등의 구성에 의해 한정되지는 아니한다. 또한, 본 발명에 따른 증강현실 컨텐츠 제공 시스템은 물리적으로 하나의 장치로 구성될 수도 있으며, 복수의 장치에 분산된 형태로 구현될 수도 있어, 본 발명은 이와 같은 물리적인 장치의 구성에 의하여 한정되지 아니한다.Augmented reality content providing system according to the present invention may be configured in the form of a server having a central processing unit (CPU) and a memory (Memory, storage device) and connectable to other terminals via a communication network, such as the Internet. However, the present invention is not limited by the configuration of the central processing unit and the memory. In addition, the augmented reality content providing system according to the present invention may be physically configured as a single device, may be implemented in a distributed form in a plurality of devices, the present invention is not limited by the configuration of such a physical device No.
도 2는 본 발명의 일실시예에 따른 증강현실 컨텐츠 제공 시스템의 구성도를 도시한 도면이다.2 is a diagram illustrating a configuration of an augmented reality content providing system according to an embodiment of the present invention.
본 발명에 따른 증강현실 컨텐츠 제공 시스템은 증강현실 정보 수신부(210), 증강현실 정보 데이터베이스(220), 촬영 영상 수신부(230), 이미지 식별부(240), 증강현실 정보 전송부(250)로 구성될 수 있으며, 각각의 구성요소들은 물리적으로 동일한 컴퓨터 시스템 내에서 동작하는 소프트웨어 모듈일 수 있으며, 물리적으로 2개 이상으로 분리된 컴퓨터 시스템이 서로 연동하여 동작할 수 있도록 구성된 형태일 수 있는데, 동일한 기능을 포함하는 다양한 실시형태가 본 발명의 권리범위에 속한다.Augmented reality content providing system according to the present invention comprises augmented reality information receiving unit 210, augmented reality information database 220, photographed image receiving unit 230, image identification unit 240, augmented reality information transmission unit 250 Each component may be a software module operating in the same physical computer system, and two or more separate computer systems may be configured to operate in conjunction with each other. Various embodiments including the same belong to the scope of the present invention.
증강현실 정보 수신부(210)는 제품 이미지 정보 및 증강현실 컨텐츠 정보를 수신한다.The augmented reality information receiver 210 receives product image information and augmented reality content information.
증강현실 정보 수신부(210)에서 수신하는 제품의 이미지는 광고하고자 하는 제품의 정보를 포함한 이미지 일 수 있으며, 증강현실 컨텐츠 정보는 광고하고자 하는 제품에 대한 광고 또는 사용 설명 등의 정보를 포함할 수 있으며, 사용자의 단말기 내에서 사용자가 촬영한 제품에 대한 이미지와 정합되어 해당 제품에 대한 정보를 출력하거나, 해당 제품을 홍보하기 위한 캐릭터 또는 인물의 영상이 포함될 수도 있다.The image of the product received by the augmented reality information receiving unit 210 may be an image including the information of the product to be advertised, the augmented reality content information may include information such as advertising or instructions for use of the product to be advertised. The user's terminal may be matched with an image of a product photographed by the user to output information about the product or may include an image of a character or a person for promoting the product.
증강현실 정보 수신부(210)에서 수신하는 제품 이미지 정보는 제품의 적어도 일부에 대한 이미지를 하나 이상 포함한다.The product image information received by the augmented reality information receiver 210 includes one or more images of at least a part of the product.
증강현실 정보 수신부(210)에서 수신하는 제품 이미지 정보는 광고하고자 하는 제품의 전체 중에 일부분에 대한 이미지 일 수 있다. 예를 들면, 광고하고자 하는 제품이 자동차일 경우 제품 이미지 정보는 자동차의 측면의 이미지, 정면의 이미지, 후면의 이미지 중 하나 일 수 있으며, 자동차의 손잡이, 자동차의 계기판, 자동차의 바퀴 등 제품의 이미지 정보는 자동차를 구성하고 있는 모든 부품일 수 있다.The product image information received by the augmented reality information receiver 210 may be an image of a part of the entire product to be advertised. For example, if the product to be advertised is a car, the product image information may be one of the image of the side of the car, the image of the front, and the image of the rear. The image of the product, such as the handle of the car, the dashboard of the car, and the wheel of the car. The information can be all parts that make up the automobile.
증강현실 정보 수신부(210)에서 수신하는 제품 이미지 정보는 제품 식별 정보를 포함한다.The product image information received by the augmented reality information receiver 210 includes product identification information.
증강현실 정보 수신부(210)에서 수신하는 제품 식별 정보는 제품의 일부에 대한 정보일 수 있으며, 광고하고자 하는 제품 전체뿐만 아니라 일부분에 대한 정보를 포함할 수 있다. 예를 들면, 광고하고자 하는 제품은 A자동차일 경우 제품 이미지 정보는 A자동차, A자동차의 측면, A자동차의 정면, A자동차의 후면, A자동차의 계기판, A자동차의 손잡이, A자동차의 바퀴와 관련된 제품의 세부적인 식별 정보를 포함할 수 있다.The product identification information received by the augmented reality information receiver 210 may be information about a part of the product, and may include information about a part as well as the entire product to be advertised. For example, if the product you want to advertise is A car, product image information is A car, A car side, A car front, A car rear, A car dashboard, A car handle, A wheel It may include detailed identification information of a related product.
증강현실 정보 수신부(210)에서 상기 제품 식별 정보로 수신하는 제품 이미지 정보는 로고, 캐릭터, QR 코드, 바코드, 문자 또는 이미지로 이루어진 제품을 식별할 수 있는 모든 정보일 수 있다.Product image information received by the augmented reality information receiver 210 as the product identification information may be any information that can identify a product consisting of a logo, a character, a QR code, a barcode, a character or an image.
증강현실 정보 수신부(210)는 증강현실 컨텐츠 노출 비용 정보를 수신한다.The augmented reality information receiving unit 210 receives augmented reality content exposure cost information.
증강현실 정보 수신부(210)는 증강현실 컨텐츠가 소비자에게 노출되는 빈도 또는 노출되는 시간에 따른 비용 정보를 수신할 수 있다. 자신의 제품을 광고하고자 하는 광고주는 제품하고자 하는 제품과 관련된 증강현실 컨텐츠를 노출하는 비용을 지불해야 하며, 증강현실 정보 수신부(210)는 광고주가 지불하고자 하는 광고비용인 증강현실 컨텐츠 노출 비용 정보를 수신할 수 있다.The augmented reality information receiver 210 may receive cost information according to a frequency or time at which the augmented reality content is exposed to the consumer. Advertisers who wish to advertise their products must pay for exposing augmented reality content associated with a product they want to product, and the augmented reality information receiver 210 receives augmented reality content exposure cost information, which is an advertisement cost that an advertiser wants to pay. Can be received.
증강현실 정보 수신부(210)는 증강현실 컨텐츠에 대응되는 지역정보를 포함한다.The augmented reality information receiving unit 210 includes local information corresponding to the augmented reality content.
증강현실 정보 수신부(210)는 광고하고자 하는 내용이 포함되어 있는 증강현실 컨텐츠에 대응되는 지역정보를 포함할 수 있다. 증강현실 컨텐츠는 제품 광고 내용을 포함하고 있으며, 광고하고자 하는 제품은 한정적인 지역에 위치하거나 지역과는 무관한 제품일 수 있다. 광고하고자 하는 제품의 정보가 포함된 증강현실 컨텐츠를 한정적인 지역에서 노출하고자 하는 경우 증강현실 컨텐츠와 지역정보가 매칭된 정보를 증강현실 정보 수신부(210)에서 수신할 수 있다. 또한, 광고하고자 하는 제품의 정보가 포함된 증강현실 컨텐츠를 한정적인 지역에서 노출하고자 하지 않는 경우에도 증강현실 컨텐츠가 지역정보를 포함하고 있지 않다는 정보를 매칭하여 증강현실 정보 수신부(210)에서 수신할 수 있다.The augmented reality information receiving unit 210 may include local information corresponding to the augmented reality content containing the content to be advertised. The augmented reality content includes the product advertising content, the product to be advertised may be located in a limited region or irrelevant to the region. When exposing augmented reality content including information of a product to be advertised in a limited area, the augmented reality information receiver 210 may receive information matching the augmented reality content and local information. In addition, even if the augmented reality content containing the information of the product to be advertised in a limited area does not want to expose the augmented reality information received from the augmented reality information receiver 210 by matching the information that does not include local information Can be.
증강현실 정보 데이터베이스(220)는 증강현실 정보 수신부(210)에서 수신한 제품 이미지 정보 및 증강현실 컨텐츠 정보를 저장한다.The augmented reality information database 220 stores product image information and augmented reality content information received from the augmented reality information receiver 210.
증강현실 정보 데이터베이스(220)는 증강현실 정보 수신부(210)에서 수신한 제품의 일부 이미지 또는 전체 이미지를 포함하고 있는 제품 이미지 정보와 광고하고자 하는 제품의 광고내용을 포함하고 있는 증강현실 컨텐츠 정보를 저장할 수 있다.The augmented reality information database 220 stores the product image information including the partial image or the whole image of the product received by the augmented reality information receiver 210 and the augmented reality content information including the advertising content of the product to be advertised Can be.
증강현실 정보 데이터베이스(220)는 제품의 적어도 일부에 대한 이미지 각각에 증강현실 컨텐츠 정보를 대응시켜 저장한다.The augmented reality information database 220 stores the augmented reality content information corresponding to each image of at least a part of the product.
증강현실 정보 데이터베이스(220)는 제품의 일부 이미지를 포함하는 제품 이미지 정보와 광고하고자 하는 제품의 홍보 정보가 있는 증강현실 컨텐츠 정보를 대응시켜 저장할 수 있다.The augmented reality information database 220 may store product image information including a partial image of a product and augmented reality content information including promotional information of a product to be advertised.
예를 들면, A자동차 제품의 일부 이미지인 자동차 계기판이 증강현실 정보 데이터베이스(220)에 저장되어 있고, A자동차의 자동차 계기판에 대한 광고 정보가 포함되어 있는 증강현실 컨텐츠 정보가 증강현실 정보 데이터베이스(220)에 저장되어 있을 수 있다. 증강현실 정보 데이터베이스(220)는 A자동차 제품의 일부 이미지인 자동차 계기판 이미자와 A자동차의 자동차 계기판에 대한 광고 정보가 포함되어 있는 증강현실 컨텐츠 정보를 매칭시켜 저장할 수 있다.For example, the vehicle dashboard, which is a part of the image of automobile A, is stored in the augmented reality information database 220, and the augmented reality content information including the advertisement information about the vehicle dashboard of the automobile A is augmented reality information database 220 ) Can be stored. The augmented reality information database 220 may store and match the augmented reality content information including the advertisement information for the vehicle instrument panel image of the vehicle A and the vehicle instrument panel of the A vehicle product.
촬영 영상 수신부(230)는 사용자 단말기로부터 카메라를 통해 촬영된 영상을 수신한다.The captured image receiving unit 230 receives an image captured by the camera from the user terminal.
촬영 영상 수신부(230)는 사용자가 사용자 단말기의 카메라로 촬영한 제품의 이미지 및 영상을 수신할 수 있다. 사용자가 촬영한 제품의 이미지는 제품의 일부분의 이미지 또는 전체 이미지 일 수 있다.The photographed image receiver 230 may receive an image and an image of a product photographed by a user by a camera of the user terminal. The image of the product photographed by the user may be an image or a whole image of a portion of the product.
이미지 식별부(240)는 증강현실 정보 데이터베이스(220)에 저장된 제품 이미지 정보 중 촬영된 영상에 대응되는 제품 이미지 정보를 식별한다.The image identification unit 240 identifies product image information corresponding to the captured image among the product image information stored in the augmented reality information database 220.
이미지 식별부(240)는 사용자가 사용자 단말기의 카메라로 촬영한 이미지를 증강현실 정보 데이터베이스(220)에 저장된 제품 이미지 정보에서 검색하여 사용자가 사용자 단말기의 카메라로 촬영한 제품을 식별할 수 있다.The image identification unit 240 may search for the image photographed by the user of the camera of the user terminal in the product image information stored in the augmented reality information database 220 to identify the product photographed by the user of the camera of the user terminal.
예를 들면, 사용자가 사용자 단말기의 카메라로 A자동차를 촬영하였을 경우 촬영된 이미지를 기반으로 증강현실 정보 데이터베이스(220)에 저장되어 있는 A자동차의 이미지를 식별하여 사용자가 촬영한 제품이 A자동차라는 것을 확인할 수 있다.For example, when a user photographs the car A with the camera of the user terminal, the product photographed by the user is identified by the image of the car A stored in the augmented reality information database 220 based on the captured image. You can see that.
이미지 식별부(240)는 촬영된 영상에 대응되는 제품의 적어도 일부에 대한 이미지를 식별한다.The image identification unit 240 identifies an image of at least a part of the product corresponding to the captured image.
이미지 식별부(240)는 사용자가 사용자 단말기의 카메라로 촬영한 제품의 일부 이미지를 증강현실 정보 데이터베이스(220)에 저장된 제품 이미지 정보에서 검색하여 사용자가 사용자 단말기의 카메라로 촬영한 제품을 식별할 수 있다. 증강현실 정보 데이터베이스(220)에는 제품의 전체 이미지가 저장되어 있어 이미지 식별부(240)는 증강현실 정보 데이터베이스(220)에 저장되어 있는 전체의 이미지 중에서 사용자가 촬영한 제품 일부의 이미지를 기초로 제품을 식별할 수 있다.The image identification unit 240 may identify a product photographed by the camera of the user terminal by searching for some images of the product photographed by the camera of the user terminal in the product image information stored in the augmented reality information database 220. have. The augmented reality information database 220 stores the entire image of the product, the image identification unit 240 is based on the image of the part of the product photographed by the user of the entire image stored in the augmented reality information database 220 Can be identified.
예를 들면, 증강현실 정보 데이터베이스(220)에는 A자동차의 전체에 해당하는 이미지가 저장되어 있을 수 있다. 사용자가 사용자 단말기의 카메라로 A자동차의 측면을 촬영하고, 이미지 식별부(240)는 증강현실 정보 데이터베이스(220)에 저장되어 A자동차 전체의 이미지 중 A자동차의 측면과 관련된 이미지의 일부를 추출하여 사용자가 촬영한 제품 일부의 이미지가 A자동차라는 것을 식별할 수 있다.For example, the augmented reality information database 220 may store an image corresponding to the entire vehicle A. The user photographs the side of the A car with the camera of the user terminal, and the image identification unit 240 is stored in the augmented reality information database 220 to extract a part of the image related to the side of the A car from the entire image of the A car. It is possible to identify that the image of a part of the product photographed by the user is A car.
이미지 식별부(240)는 촬영된 영상에 대응되는 제품 식별 정보를 확인하여 제품 이미지 정보를 식별한다.The image identification unit 240 identifies product image information by checking product identification information corresponding to the captured image.
이미지 식별부(240)는 사용자가 사용자 단말기로 촬영한 이미지를 통해 광고하고자 하는 제품을 확인할 수 있다. 예를 들면, 사용자 단말기로 A자동차를 촬영하였을 경우 이미지 식별부(240)는 사용자가 촬영한 이미지가 A자동차라는 것을 식별할 수 있다.The image identification unit 240 may identify a product to be advertised through the image photographed by the user terminal. For example, when the vehicle A is photographed by the user terminal, the image identification unit 240 may identify that the image photographed by the user is vehicle A.
이미지 식별부(240)는 식별된 제품 이미지 정보에 포함된 제품의 적어도 일부에 대한 이미지 중에서 촬영된 영상에 대응되는 이미지를 식별한다.The image identification unit 240 identifies an image corresponding to the captured image among images of at least a part of the product included in the identified product image information.
이미지 식별부(240)는 사용자가 제품의 일부를 촬영하였을 경우 사용자가 촬영한 그 일부의 이미지를 분석하여 광고하고자 하는 제품을 인식하고, 사용자가 촬영한 일부의 영상이 광고하고자 하는 제품의 어떤 부분인지 식별할 수 있다. When the user photographs a part of the product, the image identification unit 240 analyzes the image of the part photographed by the user to recognize the product to be advertised, and the part of the product the part of the product the user wants to advertise. Can be identified.
예를 들면, 사용자는 단말기를 통해 A자동차의 계랑기를 촬영하면 이미지 식별부(240)는 사용자가 촬영한 이미지를 통해 A자동차라는 정보와 A자동차의 계랑기라는 것을 식별할 수 있다. 또한 증강현실 정보 데이터베이스(220)에 저장되어 있는 A자동차의 계랑계의 이미지와 대응되는 제품 이미지 정보를 식별할 수 있다.For example, when the user photographs the motor vehicle of the A automobile through the terminal, the image identification unit 240 may identify that the information of the motor vehicle A and the motor vehicle of the A vehicle through the image photographed by the user. In addition, it is possible to identify the product image information corresponding to the image of the porch of the car stored in the augmented reality information database 220.
증강현실 정보 전송부(250)는 식별된 제품 이미지 정보에 대응되는 증강현실 컨텐츠 정보를 사용자 단말기로 전송한다.The augmented reality information transmitting unit 250 transmits augmented reality content information corresponding to the identified product image information to the user terminal.
증강현실 정보 전송부(250)는 사용자가 촬영한 영상을 기반으로 식별된 제품 이미지 정보에 매칭되는 증강현실 컨텐츠 정보를 사용자 단말기로 전송할 수 있다. 증강현실 컨텐츠 정보는 광고하고자 하는 제품과 관련된 컨텐츠 일 수 있으며, 사용자가 촬영한 영상에 포함되어 있는 제품에 관한 광고를 제공할 수 있다.The augmented reality information transmitting unit 250 may transmit augmented reality content information matching the product image information identified based on the image photographed by the user to the user terminal. The augmented reality content information may be content related to a product to be advertised, and may provide an advertisement about a product included in an image captured by the user.
증강현실 정보 전송부(250)는 식별된 제품의 적어도 일부에 대한 이미지에 대응되는 증강현실 컨텐츠 정보를 사용자 단말기로 전송한다.The augmented reality information transmission unit 250 transmits augmented reality content information corresponding to an image of at least a part of the identified product to the user terminal.
증강현실 정보 전송부(250)는 제품의 일부가 촬영된 이미지와 매칭되는 광고하고자 하는 제품의 증강현실 컨텐츠 정보를 사용자 단말기로 전송할 수 있다.The augmented reality information transmitting unit 250 may transmit augmented reality content information of a product to be advertised in which a part of the product matches the photographed image to the user terminal.
예를 들면, A자동차의 일부에 대한 이미지인 사용자가 A자동차의 계기판을 촬영하였을 경우 사용자는 사용자 단말기로 A자동차 계기판에 대한 광고 및 홍보를 증강현실 기반으로 전송받을 수 있다.For example, when a user, which is an image of a part of the A car, photographs the A dashboard of the A car, the user may receive advertisements and promotions about the A dashboard of the A car from the user terminal based on augmented reality.
증강현실 정보 전송부(250)는 증강현실 정보 데이터베이스(220)에서 수신한 제품 이미지 정보가 중복되는 경우, 증강현실 컨텐츠 노출 비용 정보를 기초로 사용자 단말기로 전송할 증강현실 컨텐츠 정보를 선정한다.The augmented reality information transmitter 250 selects augmented reality content information to be transmitted to the user terminal based on augmented reality content exposure cost information when the product image information received from the augmented reality information database 220 overlaps.
증강현실 정보 전송부(250)는 광고하고자 하는 제품에 대한 이미지가 중복되는 경우, 증강현실 컨텐츠 노출 비용이 높은 증강현실 컨텐츠를 전송할 수 있다. 증강현실 정보 데이터베이스(220)에 동일한 제품 이미지 정보가 수신될 경우 광고주가 광고 비용으로 지불하고자 하는 증강현실 컨텐츠 노출 비용을 좀더 높게 제시한 광고주의 증강현실 컨텐츠를 사용자의 단말기로 전송될 수 있다. The augmented reality information transmitting unit 250 may transmit augmented reality content having a high cost of exposing augmented reality content when an image of a product to be advertised overlaps. When the same product image information is received in the augmented reality information database 220, the augmented reality content of the advertiser may be transmitted to the user's terminal, which shows a higher augmented reality content exposure cost that the advertiser intends to pay for the advertisement cost.
예를 들면, 서초동에서 A자동차 판매업을 하고 있는 (가)광고주, (나)광고주, (다)광고주가 있다. (가)광고주, (나)광고주, (다)광고주는 증강현실 컨텐츠를 제공하고자 증강현실 컨텐츠 노출 비용을 제시할 수 있으며, (가)광고주는 A자동차 증강현실 컨텐츠 노출을 위하여 10만원, (나)광고주는 A자동차 증강현실 컨텐츠 노출을 위하여 12만원, (다)광고주는 A자동차 증강현실 컨텐츠 노출을 위하여 13만원에 해당하는 증강현실 노출 비용을 제시하였다. 증강현실 정보 수신부(210)는 세명이 제시한 증강현실 컨텐츠 노출 비용을 수신받을 수 있다. 이때 서초동에서 사용자가 A자동차를 촬영하여 증강현실 컨텐츠에 대한 정보를 수신하고자 한다면 증강현실 정보 전송부(250)는 세명의 광고주 중에서 증강현실 컨텐츠 노출 비용이 가장 높은 (다)광고주의 증강현실 컨텐츠 정보를 선정하여 사용자 단말기에 전송할 수 있다.For example, there are (A) Advertiser, (B) Advertiser, and (C) Advertiser who sells A car in Seocho-dong. (A) Advertisers, (b) Advertisers, and (c) Advertisers may propose augmented reality content exposure costs in order to provide augmented reality content. The advertiser suggested KRW 120,000 to expose A-car augmented reality content, and the advertiser suggested KRW 130,000 augmented reality exposure cost to expose A-car augmented reality content. The augmented reality information receiving unit 210 may receive augmented reality content exposure costs presented by three people. In this case, if the user wants to receive information about augmented reality content by photographing a car A in Seocho-dong, the augmented reality information transmission unit 250 includes the augmented reality content information of the (C) advertiser having the highest exposure cost of augmented reality content among three advertisers. Can be selected and transmitted to the user terminal.
증강현실 정보 전송부(250)는 사용자 단말기로부터 사용자 단말기의 위치 정보를 수신하고, 위치 정보 및 지역정보의 대응 여부에 기초하여 전송할 증강현실 컨텐츠 정보를 결정한다.The augmented reality information transmitter 250 receives the location information of the user terminal from the user terminal, and determines the augmented reality content information to be transmitted based on whether the location information and the local information correspond.
증강현실 정보 전송부(250)는 사용자의 단말기로부터 사용자 단말기의 위치 정보를 수신하고, 증강현실 정보 수신부(210)에서 수신한 증강현실 컨텐츠에 대응되는 지역정보와 사용자 단말기 위치 정보를 매칭하여 사용자가 제품을 촬영하는 경우 사용자가 촬영한 제품에 해당하는 증강현실 컨텐츠를 전송할 수 있다.The augmented reality information transmitting unit 250 receives location information of the user terminal from the user's terminal, and matches the user terminal location information with the local information corresponding to the augmented reality content received by the augmented reality information receiving unit 210. When photographing a product, the augmented reality content corresponding to the product photographed by the user may be transmitted.
예를 들면, 사용자가 서초동에 위치하고 있으며 증강현실 정보 전송부(250)는 사용자의 단말기가 서초동에 위치하고 있는 정보를 수신할 수 있다. 또한, 증강현실 정보 수신부(210)는 서초동에서 A자동차 판매업을 하고 있는 (다)광고주의 증강현실 컨텐츠를 수신할 수 있다. 사용자가 A자동차의 측면을 촬영하여 증강현실 컨텐츠 정보를 수신하고자 한다면, (다)광고주의 증강현실 컨텐츠를 수신하여 사용자는 (다)광고주가 전송한 컨텐츠를 전송받을 수 있다. 또한, (다)광고주는 서초동에서 A자동차 판매업을 하고 있지만 역삼동에도 자신의 제품 정보가 포함된 증강현실 컨텐츠 정보를 전송하고자 한다면 지역정보를 서초동과 역삼동으로 지역을 지정할 수 있으며, 서초동과 역삼동에 위치하면서 A자동차에 대한 증강현실 컨텐츠 정보를 수신하고자 하는 사용자에게 전송할 수 있다.For example, the user is located in Seocho-dong and the augmented reality information transmission unit 250 may receive information that the user terminal is located in Seocho-dong. In addition, the augmented reality information receiving unit 210 may receive augmented reality content of the advertiser (C) advertisers in the A car sales business in Seocho-dong. If the user wants to receive the augmented reality content information by photographing the side of the A car, (C) the advertiser receives the augmented reality content, the user may receive the content transmitted by the (C) advertiser. In addition, (c) the advertiser is a car dealership in Seocho-dong, but if you want to send augmented reality content information including your own product information to Yeoksam-dong, you can specify the area to Seocho-dong and Yeoksam-dong, located in Seocho-dong and Yeoksam-dong. While transmitting the augmented reality content information for the vehicle A can be transmitted to the user.
도 3은 본 발명의 일실시예에 따른 카메라로 제품의 일부에 대한 이미지인 전면 영상을 촬영한 후에 증강현실 기반의 컨텐츠를 제공하는 일례를 도시한 도면이다.3 is a diagram illustrating an example of providing augmented reality-based content after capturing a front image that is an image of a part of a product with a camera according to an embodiment of the present invention.
제품 이미지 정보는 제품의 적어도 일부에 대한 이미지를 하나 이상 포함하고, 증강현실 정보 데이터베이스(220)는 제품의 적어도 일부에 대한 이미지 각각에 증강현실 컨텐츠 정보를 대응시켜 저장하고, 이미지 식별부(240)는 촬영된 영상에 대응되는 제품의 적어도 일부에 대한 이미지를 식별하고, 증강현실 정보 전송부(250)는 식별된 제품의 적어도 일부에 대한 이미지에 대응되는 증강현실 컨텐츠 정보를 사용자 단말기로 전송할 수 있다.The product image information includes one or more images of at least a part of the product, and the augmented reality information database 220 stores the augmented reality content information corresponding to each image of at least a part of the product, and stores the image identification unit 240. May identify an image of at least a part of the product corresponding to the captured image, and the augmented reality information transmitter 250 may transmit augmented reality content information corresponding to the image of at least a part of the identified product to the user terminal. .
예를 들면, A자동차의 정면에 대응되는 증강현실 컨텐츠는 자동차 운전석에 오브젝트가 위치(301)하여 A자동차의 운전시 주의사항과 같은 설명을 하는 컨텐츠가 제공될 수 있다. 사용자가 사용자 단말기로 A자동차의 정면을 촬영하였을 경우, A자동차의 정면을 촬영하였다는 정보를 인식하고 증강현실 정보 전송부(250)는 사용자의 단말기에 자동차 운전석에 오프젝트를 위치시킨 증강현실 컨텐츠를 전송할 수 있다.For example, the augmented reality content corresponding to the front of the vehicle A, the object is located in the driver's seat 301 may be provided to explain the contents such as the precautions when driving the vehicle A. When the user photographed the front side of the A vehicle with the user terminal, the augmented reality information transmission unit 250 recognizes the information that the front side of the A vehicle was photographed and the augmented reality content by positioning the object in the driver's seat in the user's terminal Can be transmitted.
도 4는 본 발명의 일실시예에 따른 카메라로 제품의 일부에 대한 이미지인 측면 영상을 촬영한 후에 증강현실 기반의 컨텐츠를 제공하는 일례를 도시한 도면이다.4 is a diagram illustrating an example of providing augmented reality-based content after capturing a side view image of a part of a product with a camera according to an embodiment of the present invention.
제품 이미지 정보는 제품의 적어도 일부에 대한 이미지를 하나 이상 포함하고, 증강현실 정보 데이터베이스(220)는 제품의 적어도 일부에 대한 이미지 각각에 증강현실 컨텐츠 정보를 대응시켜 저장하고, 이미지 식별부(240)는 촬영된 영상에 대응되는 제품의 적어도 일부에 대한 이미지를 식별하고, 증강현실 정보 전송부(250)는 식별된 제품의 적어도 일부에 대한 이미지에 대응되는 증강현실 컨텐츠 정보를 사용자 단말기로 전송할 수 있다.The product image information includes one or more images of at least a part of the product, and the augmented reality information database 220 stores the augmented reality content information corresponding to each image of at least a part of the product, and stores the image identification unit 240. May identify an image of at least a part of the product corresponding to the captured image, and the augmented reality information transmitter 250 may transmit augmented reality content information corresponding to the image of at least a part of the identified product to the user terminal. .
예를 들면, A자동차의 측면에 대응되는 증강현실 컨텐츠는 스틱을 들고 있는 오브젝트가 자동차의 측면에 위치하여 A자동차의 운전시 주의사항 또는 주유하는 방법과 같은 다양한 광고 및 홍보에 대한 정보를 제공하는 컨텐츠가 제공될 수 있다. 사용자가 사용자 단말기로 A자동차의 측면을 촬영하였을 경우, A자동차의 측면을 촬영하였다는 정보를 인식하고 증강현실 정보 전송부(250)는 사용자의 단말기에 스틱을 들고 있는 오브젝트가 자동차 측면에 위치한 증강현실 컨텐츠를 전송할 수 있다.For example, the augmented reality content corresponding to the side of the car A provides information on various advertisements and promotions such as the car's driving precautions or fueling when the object holding the stick is located on the side of the car. Content may be provided. When the user photographed the side of the vehicle A with the user terminal, the information on the side of the vehicle A was recognized and the augmented reality information transmission unit 250 augmented with the object holding the stick on the user's terminal located on the side of the vehicle. Real content can be transmitted.
도 5는 본 발명의 일실시예에 따른 카메라로 제품의 일부에 대한 이미지인 세부 영상을 촬영한 후에 증강현실 기반의 컨텐츠를 제공하는 일례를 도시한 도면이다.5 is a diagram illustrating an example of providing augmented reality-based content after capturing a detailed image that is an image of a part of a product with a camera according to an embodiment of the present invention.
제품 이미지 정보는 제품의 적어도 일부에 대한 이미지를 하나 이상 포함하고, 증강현실 정보 데이터베이스(220)는 제품의 적어도 일부에 대한 이미지 각각에 증강현실 컨텐츠 정보를 대응시켜 저장하고, 이미지 식별부(240)는 촬영된 영상에 대응되는 제품의 적어도 일부에 대한 이미지를 식별하고, 증강현실 정보 전송부(250)는 식별된 제품의 적어도 일부에 대한 이미지에 대응되는 증강현실 컨텐츠 정보를 사용자 단말기로 전송할 수 있다.The product image information includes one or more images of at least a part of the product, and the augmented reality information database 220 stores the augmented reality content information corresponding to each image of at least a part of the product, and stores the image identification unit 240. May identify an image of at least a part of the product corresponding to the captured image, and the augmented reality information transmitter 250 may transmit augmented reality content information corresponding to the image of at least a part of the identified product to the user terminal. .
예를 들면, A자동차의 계기판에 대응되는 증강현실 컨텐츠는 계기판에 대한 설명을 텍스트로 정보를 제공하는 컨텐츠가 제공될 수 있다. 사용자가 사용자 단말기로 A자동차의 계기판을 촬영하였을 경우, A자동차의 계기판을 촬영하였다는 정보를 인식하고 증강현실 정보 전송부(250)는 사용자가 촬영한 계기판 이미지에 엔진회전계, 속도계, 연료계, 주행거리계와 같은 설명선이 추가된 증강현실 컨텐츠를 전송할 수 있다.For example, the augmented reality content corresponding to the dashboard of the automobile A may be provided with content that provides information on the description of the dashboard in text. When the user has photographed the instrument panel of the A vehicle with the user terminal, the augmented reality information transmitter 250 recognizes the information that the instrument panel of the A vehicle is photographed, and the engine tachometer, speedometer, fuel gauge, Augmented reality content with a callout, such as a odometer, may be transmitted.
도 6은 본 발명의 일실시예에 따른 증강현실 컨텐츠 제공 방법의 순서도를 도시한 도면이다.6 is a flowchart illustrating a method for providing augmented reality content according to an embodiment of the present invention.
이상의 증강현실 컨텐츠 제공 시스템은 증강현실 컨텐츠 제공 방법으로 구현되어 실현될 수 있으며, 상기 증강현실 컨텐츠 제공 시스템의 기술적인 사상을 그대로 적용할 수 있다.The augmented reality content providing system may be implemented and realized by a method for providing augmented reality content, and the technical idea of the augmented reality content providing system may be applied as it is.
이와 같은, 증강현실 컨텐츠 제공 방법은 애플리케이션으로 구현되거나 다양한 컴퓨터 구성요소를 통하여 수행될 수 있는 프로그램 명령어의 형태로 구현되어 컴퓨터 판독 가능한 기록 매체에 기록될 수 있다. 상기 컴퓨터 판독 가능한 기록 매체는 프로그램 명령어, 데이터 파일, 데이터 구조 등을 단독으로 또는 조합하여 포함할 수 있다.Such augmented reality content providing method may be implemented in the form of program instructions that may be implemented as an application or executed through various computer components, and recorded in a computer readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination.
상기 컴퓨터 판독 가능한 기록 매체에 기록되는 프로그램 명령어는 본 발명을 위하여 특별히 설계되고 구성된 것들이거니와 컴퓨터 소프트웨어 분야의 당업자에게 공지되어 사용 가능한 것일 수도 있다.The program instructions recorded on the computer-readable recording medium are those specially designed and configured for the present invention, and may be known and available to those skilled in the computer software arts.
제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)는 제품 이미지 정보 및 증강현실 컨텐츠 정보를 수신한다.Product image information and augmented reality content information receiving step (S601) receives the product image information and augmented reality content information.
제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)에서 수신하는 제품의 이미지는 광고하고자 하는 제품의 정보를 포함한 이미지 일 수 있으며, 증강현실 컨텐츠 정보는 광고하고자 하는 제품에 대한 광고 내용을 포함하고 있다.The product image information and the image of the product received in the augmented reality content information receiving step (S601) may be an image including the information of the product to be advertised, the augmented reality content information includes the advertising content for the product to be advertised. .
제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)에서 수신하는 제품 이미지 정보는 제품의 적어도 일부에 대한 이미지를 하나 이상 포함한다.The product image information received in the product image information and augmented reality content information receiving step (S601) includes one or more images of at least a part of the product.
제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)에서 수신하는 제품 이미지 정보는 광고하고자 하는 제품의 전체 중에 일부분에 대한 이미지 일 수 있다.Product image information received in the product image information and augmented reality content information receiving step (S601) may be an image of a portion of the entire product to be advertised.
제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)에서 수신하는 제품 이미지 정보는 제품 식별 정보를 포함한다.The product image information received in the product image information and augmented reality content information receiving step S601 includes product identification information.
제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)에서 수신하는 제품 식별 정보는 제품의 일부에 대한 정보일 수 있으며, 광고하고자 하는 제품 전체뿐만 아니라 일부분에 대한 정보를 포함할 수 있다. 제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)에서 수신하는 제품 이미지 정보는 QR 코드, 바코드, 숫자 또는 문자로 이루어진 광고하고자 하는 제품을 식별할 수 있는 모든 정보일 수 있다.The product identification information received in the product image information and augmented reality content information receiving step S601 may be information about a part of the product, and may include information about a part as well as the entire product to be advertised. The product image information received in the product image information and augmented reality content information receiving step (S601) may be any information that can identify the product to be advertising consisting of a QR code, a barcode, numbers or letters.
제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)는 증강현실 컨텐츠 노출 비용 정보를 수신한다.Product image information and augmented reality content information receiving step (S601) receives augmented reality content exposure cost information.
제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)는 증강현실 컨텐츠가 소비자에게 노출되는 빈도 또는 노출되는 시간에 따른 비용 정보를 수신할 수 있다. 자신의 제품을 광고하고자 하는 광고주는 제품하고자 하는 제품과 관련된 증강현실 컨텐츠를 노출하는 비용을 지불해야 하며, 제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)는 광고주가 지불하고자 하는 광고비용인 증강현실 컨텐츠 노출 비용 정보를 수신할 수 있다.The product image information and augmented reality content information receiving step (S601) may receive the cost information according to the frequency or time that the augmented reality content is exposed to the consumer. Advertisers who wish to advertise their products must pay for exposing augmented reality content associated with products they want to product, and step S601 of receiving product image information and augmented reality content information is an augmentation that is an advertisement cost that an advertiser intends to pay. Real content exposure cost information may be received.
제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)는 증강현실 컨텐츠에 대응되는 지역정보를 포함한다.The product image information and augmented reality content information receiving step (S601) includes local information corresponding to the augmented reality content.
제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)는 광고하고자 하는 내용이 포함되어 있는 증강현실 컨텐츠에 대응되는 지역정보를 포함할 수 있다. 증강현실 컨텐츠는 제품 광고 내용을 포함하고 있으며, 광고하고자 하는 제품은 한정적인 지역에 위치하거나 지역과는 무관한 제품일 수 있다. 광고하고자 하는 제품의 정보가 포함된 증강현실 컨텐츠를 한정적인 지역에서 노출하고자 하는 경우 증강현실 컨텐츠와 지역정보가 매칭된 정보를 제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)에서 수신할 수 있다. 또한, 광고하고자 하는 제품의 정보가 포함된 증강현실 컨텐츠를 한정적인 지역에서 노출하고자 하지 않는 경우에도 증강현실 컨텐츠가 지역정보를 포함하고 있지 않다는 정보를 매칭하여 제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)에서 수신할 수 있다.Product image information and augmented reality content information receiving step (S601) may include local information corresponding to the augmented reality content containing the content to be advertised. The augmented reality content includes the product advertising content, the product to be advertised may be located in a limited region or irrelevant to the region. When exposing augmented reality content including information of a product to be advertised in a limited area, information matching the augmented reality content and local information may be received in a product image information and augmented reality content information receiving step (S601). . In addition, even if the augmented reality content containing the information of the product to be advertised in a limited area does not want to expose the product image information and augmented reality content information matching step by matching the information that does not include the local information It can be received at (S601).
컨텐츠 정보를 증강현실 정보 데이터베이스에 저장하는 단계(S602)는 제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)에서 수신한 제품 이미지 정보 및 증강현실 컨텐츠 정보를 저장한다.The storing of the content information in the augmented reality information database (S602) stores the product image information and the augmented reality content information received in the augmented reality content information receiving step (S601).
컨텐츠 정보를 증강현실 정보 데이터베이스에 저장하는 단계(S602)는 제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)에서 수신한 제품의 일부 이미지 또는 전체 이미지를 포함하고 있는 제품 이미지 정보와 광고하고자 하는 제품의 광고내용을 포함하고 있는 증강현실 컨텐츠 정보를 저장할 수 있다.The step of storing the content information in the augmented reality information database (S602) is product image information and product image information including a part image or the entire image of the product received in the augmented reality content information receiving step (S601) and the product to be advertised Augmented reality content information, including the advertising content of the can be stored.
컨텐츠 정보를 증강현실 정보 데이터베이스에 저장하는 단계(S602)는 제품의 적어도 일부에 대한 이미지 각각에 증강현실 컨텐츠 정보를 대응시켜 저장한다.The step of storing the content information in the augmented reality information database (S602) stores the augmented reality content information corresponding to each image of at least a part of the product.
컨텐츠 정보를 증강현실 정보 데이터베이스에 저장하는 단계(S602)는 제품의 일부 이미지를 포함하는 제품 이미지 정보와 광고하고자 하는 제품의 홍보 정보가 있는 증강현실 컨텐츠 정보를 대응시켜 저장할 수 있다.The step of storing the content information in the augmented reality information database (S602) may store the product image information including the partial image of the product and the augmented reality content information containing the promotional information of the product to be advertised.
촬영된 영상을 수신하는 단계(S603)는 사용자 단말기로부터 카메라를 통해 촬영된 영상을 수신한다.Receiving the captured image (S603) receives the image captured by the camera from the user terminal.
촬영된 영상을 수신하는 단계(S603)는 사용자가 사용자 단말기의 카메라로 촬영한 제품의 이미지 및 영상을 수신할 수 있다. 사용자가 촬영한 제품의 이미지는 제품의 일부분의 이미지 또는 전체 이미지 일 수 있다.In the receiving of the captured image (S603), the user may receive an image and an image of a product photographed by a camera of the user terminal. The image of the product photographed by the user may be an image or a whole image of a part of the product.
제품 이미지 정보를 식별하는 단계(S604)는 컨텐츠 정보를 증강현실 정보 데이터베이스에 저장하는 단계(S602)에 저장된 제품 이미지 정보 중 촬영된 영상에 대응되는 제품 이미지 정보를 식별한다.Identifying the product image information (S604) identifies the product image information corresponding to the captured image of the product image information stored in the step (S602) of storing the content information in the augmented reality information database.
제품 이미지 정보를 식별하는 단계(S604)는 사용자가 사용자 단말기의 카메라로 촬영한 이미지를 컨텐츠 정보를 증강현실 정보 데이터베이스에 저장하는 단계(S602)에 저장된 제품 이미지 정보에서 검색하여 사용자가 사용자 단말기의 카메라로 촬영한 제품을 식별할 수 있다.Identifying the product image information (S604) is to retrieve the image taken by the user of the camera of the user terminal in the product image information stored in the step of storing the content information in the augmented reality information database (S602) so that the user of the camera of the user terminal Products can be identified by the camera.
제품 이미지 정보를 식별하는 단계(S604)는 촬영된 영상에 대응되는 제품의 적어도 일부에 대한 이미지를 식별한다.Identifying product image information (S604) identifies an image of at least a portion of the product corresponding to the captured image.
제품 이미지 정보를 식별하는 단계(S604)는 사용자가 사용자 단말기의 카메라로 촬영한 제품의 일부 이미지를 컨텐츠 정보를 증강현실 정보 데이터베이스에 저장하는 단계(S602)에 저장된 제품 이미지 정보에서 검색하여 사용자가 사용자 단말기의 카메라로 촬영한 제품을 식별할 수 있다. 컨텐츠 정보를 증강현실 정보 데이터베이스에 저장하는 단계(S602)에는 제품의 전체 이미지가 저장되어 있어 제품 이미지 정보를 식별하는 단계(S604)는 컨텐츠 정보를 증강현실 정보 데이터베이스에 저장하는 단계(S602)에 저장되어 있는 전체의 이미지 중에서 사용자가 촬영한 제품 일부의 이미지를 기초로 제품을 식별할 수 있다.Identifying the product image information (S604) is a user retrieves a part of the image of the product photographed by the user of the camera of the user terminal in the product image information stored in the step of storing the content information in the augmented reality information database (S602) A product photographed with a camera of a terminal can be identified. In the step of storing the content information in the augmented reality information database (S602) is stored the entire image of the product to identify the product image information (S604) to store the content information in the augmented reality information database (S602) The product can be identified based on an image of a part of the product photographed by the user among the entire images.
제품 이미지 정보를 식별하는 단계(S604)는 촬영된 영상에 대응되는 제품 식별 정보를 확인하여 제품 이미지 정보를 식별한다.Identifying product image information (S604) identifies product image information by checking product identification information corresponding to the captured image.
제품 이미지 정보를 식별하는 단계(S604)는 사용자가 사용자 단말기로 촬영한 이미지를 통해 광고하고자 하는 제품을 확인할 수 있다.Identifying product image information (S604) may identify a product to be advertised through an image captured by the user terminal.
제품 이미지 정보를 식별하는 단계(S604)는 식별된 제품 이미지 정보에 포함된 제품의 적어도 일부에 대한 이미지 중에서 촬영된 영상에 대응되는 이미지를 식별한다.Identifying product image information (S604) identifies an image corresponding to the captured image among images of at least a part of the product included in the identified product image information.
제품 이미지 정보를 식별하는 단계(S604)는 사용자가 제품의 일부를 촬영하였을 경우 사용자가 촬영한 그 일부의 이미지를 분석하여 광고하고자 하는 제품을 인식하고, 사용자가 촬영한 일부의 영상이 광고하고자 하는 제품의 어떤 부분인지 식별할 수 있다. In step S604, when the user photographs a part of the product, the product image information may be analyzed to recognize a product to be advertised by analyzing the part of the photographed product, and the part of the image photographed by the user may advertise. It can identify which part of the product it is.
증강현실 컨텐츠 정보를 사용자 단말기로 전송하는 단계(S605)는 식별된 제품 이미지 정보에 대응되는 증강현실 컨텐츠 정보를 사용자 단말기로 전송한다.In operation S605, the augmented reality content information is transmitted to the user terminal. The augmented reality content information corresponding to the identified product image information is transmitted to the user terminal.
증강현실 컨텐츠 정보를 사용자 단말기로 전송하는 단계(S605)는 사용자가 촬영한 영상을 기반으로 식별된 제품 이미지 정보에 매칭되는 증강현실 컨텐츠 정보를 사용자 단말기로 전송할 수 있다. 증강현실 컨텐츠 정보는 광고하고자 하는 제품과 관련된 컨텐츠 일 수 있으며, 사용자가 촬영한 영상에 포함되어 있는 제품에 관한 광고를 제공할 수 있다.In operation S605 of transmitting augmented reality content information to the user terminal, the augmented reality content information matching the product image information identified based on the image photographed by the user may be transmitted to the user terminal. The augmented reality content information may be content related to a product to be advertised, and may provide an advertisement about a product included in an image captured by the user.
증강현실 컨텐츠 정보를 사용자 단말기로 전송하는 단계(S605)는 식별된 제품의 적어도 일부에 대한 이미지에 대응되는 증강현실 컨텐츠 정보를 사용자 단말기로 전송한다.In operation S605, the augmented reality content information is transmitted to the user terminal. The augmented reality content information corresponding to the image of at least a part of the identified product is transmitted to the user terminal.
증강현실 컨텐츠 정보를 사용자 단말기로 전송하는 단계(S605)는 제품의 일부가 촬영된 이미지와 매칭되는 광고하고자 하는 제품의 증강현실 컨텐츠 정보를 사용자 단말기로 전송할 수 있다.In operation S605 of transmitting augmented reality content information to a user terminal, augmented reality content information of a product to be matched with a photographed image of a part of the product may be transmitted to the user terminal.
증강현실 컨텐츠 정보를 사용자 단말기로 전송하는 단계(S605)는 컨텐츠 정보를 증강현실 정보 데이터베이스에 저장하는 단계(S602)에서 수신한 제품 이미지 정보가 중복되는 경우, 증강현실 컨텐츠 노출 비용 정보를 기초로 사용자 단말기로 전송할 증강현실 컨텐츠 정보를 선정한다.In the step S605 of transmitting the augmented reality content information to the user terminal, when the product image information received in the step S602 of storing the content information in the augmented reality information database is duplicated, the user based on the augmented reality content exposure cost information. Select augmented reality content information to be transmitted to the terminal.
증강현실 컨텐츠 정보를 사용자 단말기로 전송하는 단계(S605)는 광고하고자 하는 제품에 대한 이미지가 중복되는 경우, 증강현실 컨텐츠 노출 비용이 높은 증강현실 컨텐츠를 전송할 수 있다. 컨텐츠 정보를 증강현실 정보 데이터베이스에 저장하는 단계(S602)에 동일한 제품 이미지 정보가 수신될 경우 광고주가 광고 비용으로 지불하고자 하는 증강현실 컨텐츠 노출 비용을 좀더 높게 제시한 광고주의 증강현실 컨텐츠를 사용자의 단말기로 전송될 수 있다. In operation S605 of transmitting augmented reality content information to a user terminal, when an image of a product to be advertised is overlapped, augmented reality content having a high cost of exposing augmented reality content may be transmitted. When the same product image information is received in the step of storing the content information in the augmented reality information database (S602), the augmented reality content of the advertiser to present the augmented reality content exposure cost higher than the advertiser wants to pay for the advertisement cost of the user terminal Can be sent to.
증강현실 컨텐츠 정보를 사용자 단말기로 전송하는 단계(S605)는 사용자 단말기로부터 사용자 단말기의 위치 정보를 수신하고, 위치 정보 및 지역정보의 대응 여부에 기초하여 전송할 증강현실 컨텐츠 정보를 결정한다.In step S605 of transmitting the augmented reality content information to the user terminal, receiving the location information of the user terminal from the user terminal, and determines the augmented reality content information to be transmitted based on whether the location information and the local information correspond.
증강현실 컨텐츠 정보를 사용자 단말기로 전송하는 단계(S605)는 사용자의 단말기로부터 사용자 단말기의 위치 정보를 수신하고, 제품 이미지 정보 및 증강현실 컨텐츠 정보 수신 단계(S601)에서 수신한 증강현실 컨텐츠에 대응되는 지역정보와 사용자 단말기 위치 정보를 매칭하여 사용자가 제품을 촬영하는 경우 사용자가 촬영한 제품에 해당하는 증강현실 컨텐츠를 전송할 수 있다.In operation S605, the augmented reality content information may be transmitted to the user terminal, and the location information of the user terminal may be received from the user terminal. When the user photographs the product by matching the location information with the location information of the user terminal, the augmented reality content corresponding to the product photographed by the user may be transmitted.
컴퓨터 판독 가능한 기록 매체의 예에는, 하드 디스크, 플로피 디스크 및 자기 테이프와 같은 자기 매체, CDROM, DVD 와 같은 광기록 매체, 플롭티컬 디스크(floptical disk)와 같은 자기-광 매체(magneto-optical media), 및 ROM, RAM, 플래시 메모리 등과 같은 프로그램 명령어를 저장하고 수행하도록 특별히 구성된 하드웨어 장치가 포함된다.Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CDROMs, DVDs, and magneto-optical media such as floptical disks. And hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like.
프로그램 명령어의 예에는, 컴파일러에 의해 만들어지는 것과 같은 기계어 코드뿐만 아니라 인터프리터 등을 사용해서 컴퓨터에 의해서 실행될 수 있는 고급 언어 코드도 포함된다. 상기 하드웨어 장치는 본 발명에 따른 처리를 수행하기 위해 하나 이상의 소프트웨어 모듈로서 작동하도록 구성될 수 있으며, 그 역도 마찬가지이다.Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform the process according to the invention, and vice versa.
이상에서는 실시예들을 참조하여 설명하였지만, 해당 기술 분야의 숙련된 당업자는 하기의 특허 청구범위에 기재된 본 발명의 사상 및 영역으로부터 벗어나지 않는 범위 내에서 본 발명을 다양하게 수정 및 변경시킬 수 있다.Although described above with reference to the embodiments, those skilled in the art may variously modify and change the present invention without departing from the spirit and scope of the invention described in the claims below.
본 발명은 기업 로고 또는 제품 등의 등록된 이미지를 인식하여 3D 광고를 증강현실로 제공함으로써, 광고 효과를 극대화할 수 있도록 하는 시스템 및 방법에 관한 것으로, 제품 이미지 정보 및 증강현실 컨텐츠 정보를 수신하는 증강현실 정보 수신부, 수신한 제품 이미지 정보 및 증강현실 컨텐츠 정보를 저장하는 증강현실 정보 데이터베이스, 사용자 단말기로부터 카메라를 통해 촬영된 영상을 수신하는 촬영 영상 수신부, 저장된 제품 이미지 정보 중 촬영된 영상에 대응되는 제품 이미지 정보를 식별하는 이미지 식별부, 식별된 제품 이미지 정보에 대응되는 증강현실 컨텐츠 정보를 사용자 단말기로 전송하는 증강현실 정보 전송부를 포함하는 증강현실 기반의 컨텐츠 제공 시스템 및 방법이 제공된다.The present invention relates to a system and a method for maximizing an advertisement effect by recognizing a registered image such as a corporate logo or a product and providing a 3D advertisement as an augmented reality, and receiving product image information and augmented reality content information. Augmented reality information receiving unit, augmented reality information database for storing the received product image information and augmented reality content information, a recording image receiving unit for receiving the image taken by the camera from the user terminal, corresponding to the image taken from the stored product image information There is provided an augmented reality-based content providing system and method comprising an image identification unit for identifying product image information, augmented reality information transmission unit for transmitting augmented reality content information corresponding to the identified product image information to the user terminal.

Claims (11)

  1. 제품 이미지 정보 및 증강현실 컨텐츠 정보를 수신하는 증강현실 정보 수신부;An augmented reality information receiver configured to receive product image information and augmented reality content information;
    상기 증강현실 정보 수신부에서 수신한 제품 이미지 정보 및 증강현실 컨텐츠 정보를 저장하는 증강현실 정보 데이터베이스;An augmented reality information database storing product image information and augmented reality content information received by the augmented reality information receiver;
    사용자 단말기로부터 카메라를 통해 촬영된 영상을 수신하는 촬영 영상 수신부;A photographed image receiving unit which receives an image photographed through a camera from a user terminal;
    상기 증강현실 정보 데이터베이스에 저장된 제품 이미지 정보 중 상기 촬영된 영상에 대응되는 제품 이미지 정보를 식별하는 이미지 식별부;An image identification unit identifying product image information corresponding to the captured image among product image information stored in the augmented reality information database;
    상기 식별된 제품 이미지 정보에 대응되는 증강현실 컨텐츠 정보를 상기 사용자 단말기로 전송하는 증강현실 정보 전송부;An augmented reality information transmitter configured to transmit augmented reality content information corresponding to the identified product image information to the user terminal;
    를 포함하는 증강현실 컨텐츠 제공 시스템.Augmented reality content providing system comprising a.
  2. 제 1항에 있어서,The method of claim 1,
    상기 제품 이미지 정보는The product image information
    제품의 적어도 일부에 대한 이미지를 하나 이상 포함하고,Include one or more images of at least some of your products,
    상기 증강현실 정보 데이터베이스는 상기 제품의 적어도 일부에 대한 이미지 각각에 상기 증강현실 컨텐츠 정보를 대응시켜 저장하고,The augmented reality information database stores the augmented reality content information corresponding to each image of at least a portion of the product,
    상기 이미지 식별부는The image identification unit
    상기 촬영된 영상에 대응되는 상기 제품의 적어도 일부에 대한 이미지를 식별하고,Identify an image of at least a portion of the product corresponding to the captured image,
    상기 증강현실 정보 전송부는The augmented reality information transmission unit
    상기 식별된 제품의 적어도 일부에 대한 이미지에 대응되는 상기 증강현실 컨텐츠 정보를 상기 사용자 단말기로 전송하는 것Transmitting the augmented reality content information corresponding to an image of at least a portion of the identified product to the user terminal.
    을 특징으로 하는 증강현실 컨텐츠 제공 시스템.Augmented reality content providing system characterized in that.
  3. 제 2항에 있어서,The method of claim 2,
    상기 제품 이미지 정보는The product image information
    제품 식별 정보를 더 포함하고,Further includes product identification information,
    상기 이미지 식별부는The image identification unit
    상기 촬영된 영상에 대응되는 상기 제품 식별 정보를 확인하여 상기 제품 이미지 정보를 식별하고,Identifying the product image information by checking the product identification information corresponding to the captured image,
    상기 식별된 제품 이미지 정보에 포함된 상기 제품의 적어도 일부에 대한 이미지 중에서 상기 촬영된 영상에 대응되는 이미지를 식별하는 것Identifying an image corresponding to the captured image among images of at least a portion of the product included in the identified product image information
    을 특징으로 하는 증강현실 컨텐츠 제공 시스템.Augmented reality content providing system characterized in that.
  4. 제 1항에 있어서,The method of claim 1,
    상기 증강현실 정보 수신부는The augmented reality information receiver
    상기 증강현실 컨텐츠 노출 비용 정보를 더 수신하고,Further receiving the augmented reality content exposure cost information,
    상기 증강현실 정보 전송부는The augmented reality information transmission unit
    상기 증강현실 정보 데이터베이스에서 상기 수신한 제품 이미지 정보가 중복되는 경우, 상기 증강현실 컨텐츠 노출 비용 정보를 기초로 상기 사용자 단말기로 전송할 증강현실 컨텐츠 정보를 선정하는 것Selecting the augmented reality content information to be transmitted to the user terminal based on the augmented reality content exposure cost information when the received product image information is overlapped in the augmented reality information database;
    을 특징으로 하는 증강현실 컨텐츠 제공 시스템.Augmented reality content providing system characterized in that.
  5. 제 1항에 있어서,The method of claim 1,
    상기 증강현실 정보 수신부는The augmented reality information receiver
    상기 증강현실 컨텐츠에 대응되는 지역정보를 더 포함하고,Further comprising local information corresponding to the augmented reality content,
    상기 증강현실 정보 전송부는The augmented reality information transmission unit
    상기 사용자 단말기로부터 상기 사용자 단말기의 위치 정보를 수신하고, 상기 위치 정보 및 상기 지역정보의 대응 여부에 기초하여 상기 전송할 증강현실 컨텐츠 정보를 결정하는 것Receiving location information of the user terminal from the user terminal, and determining augmented reality content information to be transmitted based on whether the location information and the local information correspond to each other;
    을 특징으로 하는 증강현실 컨텐츠 제공 시스템.Augmented reality content providing system characterized in that.
  6. 증강현실 정보 수신부에서 제품 이미지 정보 및 증강현실 컨텐츠 정보를 수신하는 단계;Receiving product image information and augmented reality content information in the augmented reality information receiver;
    증강현실 정보 데이터베이스에 상기 증강현실 정보 수신부에서 수신한 제품 이미지 정보 및 증강현실 컨텐츠 정보를 증강현실 정보 데이터베이스에 저장하는 단계;Storing product image information and augmented reality content information received by the augmented reality information receiver in an augmented reality information database in an augmented reality information database;
    촬영 영상 수신부에서 사용자 단말기로부터 카메라를 통해 촬영된 영상을 수신하는 단계;Receiving an image captured by a camera from a user terminal in a captured image receiving unit;
    이미지 식별부에서 상기 증강현실 정보 데이터베이스에 저장된 제품 이미지 정보 중 상기 촬영된 영상에 대응되는 제품 이미지 정보를 식별하는 단계;Identifying, by an image identification unit, product image information corresponding to the captured image among product image information stored in the augmented reality information database;
    증강현실 정보 전송부에서 상기 식별된 제품 이미지 정보에 대응되는 증강현실 컨텐츠 정보를 상기 사용자 단말기로 전송하는 단계;Transmitting augmented reality content information corresponding to the identified product image information by the augmented reality information transmitting unit to the user terminal;
    를 포함하는 증강현실 컨텐츠 제공 방법.Augmented reality content providing method comprising a.
  7. 제 6항에 있어서,The method of claim 6,
    상기 제품 이미지 정보는The product image information
    제품의 적어도 일부에 대한 이미지를 하나 이상 포함하고,Include one or more images of at least some of your products,
    상기 증강현실 정보 데이터베이스는 상기 제품의 적어도 일부에 대한 이미지 각각에 상기 증강현실 컨텐츠 정보를 대응시켜 저장하고,The augmented reality information database stores the augmented reality content information corresponding to each image of at least a portion of the product,
    상기 제품 이미지 정보를 식별하는 단계는Identifying the product image information
    상기 촬영된 영상에 대응되는 상기 제품의 적어도 일부에 대한 이미지를 식별하고,Identify an image of at least a portion of the product corresponding to the captured image,
    상기 증강현실 컨텐츠 정보를 상기 사용자 단말기로 전송하는 단계는The step of transmitting the augmented reality content information to the user terminal
    상기 식별된 제품의 적어도 일부에 대한 이미지에 대응되는 상기 증강현실 컨텐츠 정보를 상기 사용자 단말기로 전송하는 것Transmitting the augmented reality content information corresponding to an image of at least a portion of the identified product to the user terminal.
    을 특징으로 하는 증강현실 컨텐츠 제공 방법.Augmented reality content providing method characterized in that.
  8. 제 7항에 있어서,The method of claim 7, wherein
    상기 제품 이미지 정보는The product image information
    제품 식별 정보를 더 포함하고,Further includes product identification information,
    상기 제품 이미지 정보를 식별하는 단계는Identifying the product image information
    상기 촬영된 영상에 대응되는 상기 제품 식별 정보를 확인하여 상기 제품 이미지 정보를 식별하고,Identifying the product image information by checking the product identification information corresponding to the captured image,
    상기 식별된 제품 이미지 정보에 포함된 상기 제품의 적어도 일부에 대한 이미지 중에서 상기 촬영된 영상에 대응되는 이미지를 식별하는 것Identifying an image corresponding to the captured image among images of at least a portion of the product included in the identified product image information
    을 특징으로 하는 증강현실 컨텐츠 제공 방법.Augmented reality content providing method characterized in that.
  9. 제 6항에 있어서,The method of claim 6,
    상기 제품 이미지 정보 및 증강현실 컨텐츠 정보를 수신하는 단계는Receiving the product image information and augmented reality content information
    상기 증강현실 컨텐츠 노출 비용 정보를 더 수신하고,Further receiving the augmented reality content exposure cost information,
    상기 증강현실 컨텐츠 정보를 상기 사용자 단말기로 전송하는 단계는The step of transmitting the augmented reality content information to the user terminal is
    상기 증강현실 정보 데이터베이스에서 상기 수신한 제품 이미지 정보가 중복되는 경우, 상기 증강현실 컨텐츠 노출 비용 정보를 기초로 상기 사용자 단말기로 전송할 증강현실 컨텐츠 정보를 선정하는 것Selecting the augmented reality content information to be transmitted to the user terminal based on the augmented reality content exposure cost information when the received product image information is duplicated in the augmented reality information database;
    을 특징으로 하는 증강현실 컨텐츠 제공 방법.Augmented reality content providing method characterized in that.
  10. 제 6항에 있어서,The method of claim 6,
    상기 제품 이미지 정보 및 증강현실 컨텐츠 정보를 수신하는 단계는Receiving the product image information and augmented reality content information
    상기 증강현실 컨텐츠에 대응되는 지역정보를 더 포함하고,Further comprising local information corresponding to the augmented reality content,
    상기 증강현실 컨텐츠 정보를 상기 사용자 단말기로 전송하는 단계는The step of transmitting the augmented reality content information to the user terminal
    상기 사용자 단말기로부터 상기 사용자 단말기의 위치 정보를 수신하고, 상기 위치 정보 및 상기 지역정보의 대응 여부에 기초하여 상기 전송할 증강현실 컨텐츠 정보를 결정하는 것Receiving location information of the user terminal from the user terminal, and determining augmented reality content information to be transmitted based on whether the location information and the local information correspond to each other;
    을 특징으로 하는 증강현실 컨텐츠 제공 방법.Augmented reality content providing method characterized in that.
  11. 제6항 내지 제10항 중 어느 한 항의 방법을 실행하기 위한 프로그램을 기록한 기록매체.A recording medium on which a program for executing the method of any one of claims 6 to 10 is recorded.
PCT/KR2019/008582 2018-08-08 2019-07-11 Augmented reality content providing system and method WO2020032404A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2021530758A JP2021534518A (en) 2018-08-08 2019-07-11 Augmented reality content provision system and method

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR20180092131 2018-08-08
KR10-2018-0092131 2018-08-08
KR1020190029206A KR20200017325A (en) 2018-08-08 2019-03-14 Augmented Reality Contents Providing System and Method
KR10-2019-0029206 2019-03-14

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/801,538 Continuation US10887596B2 (en) 2018-07-02 2020-02-26 CCLM-based intra-prediction method and device

Publications (1)

Publication Number Publication Date
WO2020032404A1 true WO2020032404A1 (en) 2020-02-13

Family

ID=69413744

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2019/008582 WO2020032404A1 (en) 2018-08-08 2019-07-11 Augmented reality content providing system and method

Country Status (3)

Country Link
JP (1) JP2021534518A (en)
KR (1) KR20200017325A (en)
WO (1) WO2020032404A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110042474A (en) * 2009-10-19 2011-04-27 삼성에스디에스 주식회사 System and method of augmented reality-based product viewer
KR20110097305A (en) * 2010-02-25 2011-08-31 연세대학교 산학협력단 User manual providing system and method using augmented reality
KR20110125866A (en) * 2010-05-14 2011-11-22 퍼펙트데이타시스템 주식회사 Method and apparatus for providing information through augmented reality
KR20120057942A (en) * 2010-11-29 2012-06-07 주식회사 팬택 Mobile terminal and information display method using the same
KR20140128654A (en) * 2013-04-29 2014-11-06 주식회사 제이엠랩 Apparatus for providing augmented reality and method thereof
KR20160092292A (en) * 2015-01-27 2016-08-04 주식회사 아이마카 System and method for providing augmented reality service of materials for an promotional objects

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5544250B2 (en) * 2010-09-02 2014-07-09 エヌ・ティ・ティ・コムウェア株式会社 Display image search method
JP5685436B2 (en) * 2010-12-28 2015-03-18 新日鉄住金ソリューションズ株式会社 Augmented reality providing device, augmented reality providing system, augmented reality providing method and program
JP5593356B2 (en) * 2012-08-22 2014-09-24 ヤフー株式会社 Advertisement distribution device, advertisement distribution method, and advertisement distribution program
JP6286123B2 (en) * 2012-12-27 2018-02-28 サターン ライセンシング エルエルシーＳａｔｕｒｎ Ｌｉｃｅｎｓｉｎｇ ＬＬＣ Information processing apparatus, content providing method, and computer program
JP6731605B2 (en) * 2014-12-11 2020-07-29 株式会社リリピア Information presenting device, information presenting system, information presenting method, and information presenting program

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110042474A (en) * 2009-10-19 2011-04-27 삼성에스디에스 주식회사 System and method of augmented reality-based product viewer
KR20110097305A (en) * 2010-02-25 2011-08-31 연세대학교 산학협력단 User manual providing system and method using augmented reality
KR20110125866A (en) * 2010-05-14 2011-11-22 퍼펙트데이타시스템 주식회사 Method and apparatus for providing information through augmented reality
KR20120057942A (en) * 2010-11-29 2012-06-07 주식회사 팬택 Mobile terminal and information display method using the same
KR20140128654A (en) * 2013-04-29 2014-11-06 주식회사 제이엠랩 Apparatus for providing augmented reality and method thereof
KR20160092292A (en) * 2015-01-27 2016-08-04 주식회사 아이마카 System and method for providing augmented reality service of materials for an promotional objects

Also Published As

Publication number Publication date
KR20200017325A (en) 2020-02-18
JP2021534518A (en) 2021-12-09

Similar Documents

Publication Publication Date Title
WO2019143157A1 (en) Apparatus and method for delivering advertisement content to connected vehicles
WO2012020927A1 (en) Integrated image search system and a service method therewith
WO2015194907A1 (en) Parking location checking system and parking location checking method using same
WO2013055125A2 (en) Method and system for providing an instant messaging service
WO2012081887A2 (en) Method and apparatus for providing advertisement service in mobile communication system
WO2020209503A1 (en) Payment service device for providing information about products in offline affiliated store on basis of location information and assisting payment process based on virtual currency, and operation method of same
WO2021132793A1 (en) System for managing big data material information on basis of automatic swatch recognition
WO2013168890A1 (en) Advertising system and targeted advertising method
WO2022039318A1 (en) Artificial intelligence training method and system using de-identified image data
CN108596670A (en) Advertisement sending method, apparatus and system
KR20190114854A (en) Method, apparatus and computer readable storage medium having instructions for providing contents for display to an occupant of a motor vehicle
WO2018164532A1 (en) System and method for enhancing augmented reality (ar) experience on user equipment (ue) based on in-device contents
WO2016186289A1 (en) System and method for providing information using image recognition technique
WO2013147484A1 (en) System for operating queue tickets and method for operating same
WO2020032404A1 (en) Augmented reality content providing system and method
JP2010134143A (en) Advertisement information display system
WO2012070766A2 (en) Method for generating video markup data on the basis of video fingerprint information, and method and system for providing information using same
KR20200064387A (en) Apparatus for providing transportation passengers customized digital signage systems
WO2014010783A1 (en) 411 telephone number directory assistance system providing associated company information, and information service method of same
WO2013157897A1 (en) Method for providing video advertisement service in bus through bidding by section and time zone
WO2019194584A1 (en) Advertisement service system for simultaneously providing advertisements to local signage and user device according to reference regions
WO2021045246A1 (en) Apparatus and method for providing extended function to vehicle
WO2015129987A1 (en) Service apparatus for providing object recognition-based advertisement, user equipment for receiving object recognition-based advertisement, system for providing object recognition-based advertisement, method therefor and recording medium therefor in which computer program is recorded
WO2015093743A1 (en) Method for lending portable charger with transfer of advertisements
WO2023282380A1 (en) Information provision method and apparatus for installation service

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19847711

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021530758

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 19/05/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19847711

Country of ref document: EP

Kind code of ref document: A1