KR102539212B1 - Method, system and non-transitory computer-readable recording medium for managing augmented reality interface related to contents provided on digital signage - Google Patents

Abstract

According to one aspect of the present invention, as a method for managing an augmented reality interface related to content provided in digital signage, obtaining an image captured by a device regarding content provided in digital signage. and estimating identification information about the content by referring to content to be compared with respect to the content included in the content pool, and based on the identification information about the content, an augmented reality interface corresponding to the content captures the image. There is provided a method comprising the step of causing display together with an image to be displayed.

Description

Method, system and non-temporary computer readable recording medium for managing augmented reality interface for content provided in digital signage ON DIGITAL SIGNAGE}

The present invention relates to a method, system, and non-transitory computer readable recording medium for managing an augmented reality interface for content provided in digital signage.

The so-called digital signage or smart signage is installed in places such as restaurants, offline stores, airports, shopping malls, subways, bus stops, hotels, etc. to provide advertisement contents intended by advertisers. It refers to video equipment, and is used for various purposes such as publicity, customer service, and informational media.

Although these digital signages are installed and used in various places as above, most of them are one-way digital signages that provide information to users unilaterally, and touch screens such as order kiosks at fast food restaurants and ticket vending machines at movie theaters, etc. An interactive digital signage configured to have an input means to interact with a user has a limited use or installation location.

The reasons why unidirectional digital signage is mainly used are that unidirectional digital signage is cheaper than interactive digital signage, and software that enables users to interact with interactive digital signage in the case of companies without or lacking developers. The burden of development is high, and since several people cannot use one interactive digital signage at the same time, the cost burden is high because several units must be installed in one place.

On the other hand, most of the interactive digital signage has a touch screen as an input means, and it is recommended to refrain from using it in terms of public health, especially during epidemic epidemics.

Accordingly, the present inventor(s) proposes a technology that not only supports the use of unidirectional digital signage in a state in which interaction with a user is possible like interactive digital signage, but also supports the use of interactive digital signage in a non-contact manner. is to do

Publication No. 10-2015-0055302 (May 21, 2015)

The object of the present invention is to solve all the problems of the prior art described above.

In addition, the present invention obtains an image captured by a device in relation to the content provided in the digital signage, and identifies the above content by referring to the content to be compared to the above content included in the content pool. Another object is to estimate information and display an augmented reality interface corresponding to the above content together with the captured image based on the identification information on the above content.

Another object of the present invention is to support the use of unidirectional digital signage in a state in which interaction with a user is possible like bidirectional digital signage.

In addition, another object of the present invention is to support the use of digital signage in a non-contact manner.

In addition, another object of the present invention is to support several people to use one digital signage at the same time.

In addition, the present invention supports the use of unidirectional digital signage in a state in which interaction with users is possible like interactive digital signage, and supports the use of one digital signage by several people at the same time, so that digital signage Another objective is to reduce installation costs.

Representative configurations of the present invention for achieving the above object are as follows.

According to one aspect of the present invention, obtaining an image captured by a device for content provided in digital signage, and comparing the content included in a content pool (Pool) to compare the content. Estimating identification information about the content, and displaying an augmented reality interface corresponding to the content together with the captured image based on the identification information about the content.

According to another aspect of the present invention, with reference to an image acquisition unit for acquiring an image captured by a device for content provided in digital signage, and comparison target content for the content included in the content pool (Pool), the A system including an augmented reality interface management unit that estimates identification information about content and displays an augmented reality interface corresponding to the content together with the captured image based on the identification information about the content.

In addition to this, another method for implementing the present invention, another system, and a non-transitory computer readable recording medium recording a computer program for executing the method are further provided.

According to the present invention, an image captured by a device for content provided in digital signage is acquired, and identification information about the above content is obtained by referring to content to be compared with respect to the above content included in a content pool. It is possible to estimate , and based on the identification information on the above content, an augmented reality interface corresponding to the above content is displayed together with the above captured image.

In addition, according to the present invention, the unidirectional digital signage can be used in a state in which interaction with the user is possible like the interactive digital signage.

Also, according to the present invention, digital signage can be used in a non-contact manner.

In addition, according to the present invention, several people can use one digital signage at the same time.

In addition, according to the present invention, by supporting the use of unidirectional digital signage in a state in which interaction with users is possible like interactive digital signage, and by supporting several people to use one digital signage at the same time, digital signage can reduce installation costs.

1 is a diagram showing a schematic configuration of an entire system for managing an augmented reality interface for content provided from digital signage according to an embodiment of the present invention.
2 is a diagram showing in detail the internal configuration of a service providing system according to an embodiment of the present invention.
3 to 6 exemplarily illustrate a process of displaying an augmented reality interface according to an embodiment of the present invention.
7 is a diagram exemplarily illustrating a process of implementing an augmented reality interface according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The detailed description of the present invention which follows refers to the accompanying drawings which illustrate, by way of illustration, specific embodiments in which the present invention may be practiced. These embodiments are described in sufficient detail to enable any person skilled in the art to practice the present invention. It should be understood that the various embodiments of the present invention are different from each other but are not necessarily mutually exclusive. For example, specific shapes, structures, and characteristics described herein may be implemented from one embodiment to another without departing from the spirit and scope of the present invention. It should also be understood that the location or arrangement of individual components within each embodiment may be changed without departing from the spirit and scope of the present invention. Therefore, the detailed description to be described later is not performed in a limiting sense, and the scope of the present invention should be taken as encompassing the scope claimed by the claims and all scopes equivalent thereto. Like reference numbers in the drawings indicate the same or similar elements throughout the various aspects.

Hereinafter, various preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings in order to enable those skilled in the art to easily practice the present invention.

In this specification, content or content is a concept that collectively refers to digital information or individual information elements composed of text, code, voice, sound, image, video, etc. accessible through a communication network. Such content may include, for example, data such as text, image, video, audio, link (eg, web link), or a combination of at least two of these data.

Composition of the whole system

1 is a diagram showing a schematic configuration of an entire system for managing an augmented reality interface for content provided from digital signage according to an embodiment of the present invention.

As shown in FIG. 1 , the entire system according to an embodiment of the present invention may include a communication network 100 , a service providing system 200 , a device 300 and a digital signage 400 .

First, the communication network 100 according to an embodiment of the present invention may be configured regardless of communication aspects such as wired communication or wireless communication, and may include a local area network (LAN) and a metropolitan area network (MAN). ), a wide area network (WAN), and the like. Preferably, the communication network 100 referred to in this specification may be the well-known Internet or the World Wide Web (WWW). However, the communication network 100 may include, at least in part, a known wired/wireless data communication network, a known telephone network, or a known wire/wireless television communication network without being limited thereto.

For example, the communication network 100 is a wireless data communication network, WiFi communication, WiFi-Direct communication, Long Term Evolution (LTE) communication, 5G communication, Bluetooth communication (low power Bluetooth (BLE) ; Bluetooth Low Energy) communication), infrared communication, ultrasonic communication, and the like may be implemented in at least a part thereof. For another example, the communication network 100 is an optical communication network, and may implement a conventional communication method such as LiFi (Light Fidelity) in at least a part thereof.

Next, the service providing system 200 according to an embodiment of the present invention obtains an image taken by a device in relation to the contents provided in the digital signage, and relates to the above contents included in the contents pool. Performs a function of estimating identification information on the above content by referring to the content to be compared, and displaying an augmented reality interface corresponding to the above content together with the image being captured based on the identification information on the above content. can do.

The configuration and functions of the service providing system 200 according to the present invention will be described in detail through the following detailed description.

Next, the device 300 according to an embodiment of the present invention is a digital device having a function to communicate after accessing the service providing system 200, such as a smartphone, tablet, smart watch, smart band, smart Any digital device equipped with memory means and equipped with a microprocessor, such as glass, desktop computer, notebook computer, workstation, PDA, web pad, mobile phone, etc. can

In particular, the device 300 may include an application (not shown) that supports a user to receive a service according to the present invention from the service providing system 200 . Such an application may be downloaded from the service providing system 200 or an external application distribution server (not shown). On the other hand, the characteristics of these applications are the image acquisition unit 210, the augmented reality interface management unit 220, the performance information management unit 230, the communication unit 240 and the control unit 250 of the service providing system 200 and Overall, they may be similar. Here, at least a part of the application may be replaced with a hardware device or a firmware device capable of performing substantially the same or equivalent functions as necessary.

Next, according to an embodiment of the present invention, the digital signage 400 performs a function of communicating with the service providing system 200 or a content management server (not shown) and controlling content to be provided to people. It may include a set-top box (not shown), which is a component. In addition, according to an embodiment of the present invention, the digital signage 400 may further include a display unit such as an LCD panel or an OLED panel, and a speaker for sound output.

According to an embodiment of the present invention, the digital signage 400 may be installed in public places such as restaurants, offline stores, airports, shopping malls, subways, bus stops, hotels, etc., but these are only illustratively listed. It should be noted that the place where the digital signage 400 according to the present invention is installed is not necessarily limited to those listed above.

Composition of service provision system

Hereinafter, the internal configuration of the service providing system 200 that performs important functions for the implementation of the present invention and the functions of each component will be reviewed.

2 is a diagram showing in detail the internal configuration of a service providing system 200 according to an embodiment of the present invention.

As shown in FIG. 2, the service providing system 200 according to an embodiment of the present invention includes an image acquisition unit 210, an augmented reality interface management unit 220, a performance information management unit 230, and a communication unit 240. And it may be configured to include a control unit 250. According to an embodiment of the present invention, at least some of the image acquisition unit 210, the augmented reality interface management unit 220, the performance information management unit 230, the communication unit 240, and the control unit 250 are external systems ( It may be a program module that communicates with (not shown). These program modules may be included in the service providing system 200 in the form of an operating system, application program modules, or other program modules, and may be physically stored in various well-known storage devices. Also, these program modules may be stored in a remote storage device capable of communicating with the service providing system 200 . Meanwhile, these program modules include routines, subroutines, programs, objects, components, data structures, etc. that perform specific tasks or execute specific abstract data types according to the present invention, but are not limited thereto.

Meanwhile, according to an embodiment of the present invention, the service providing system 200 may perform a function of providing source data of content provided by the digital signage 400, but may perform a function of providing source data of content. A content management server (not shown) may exist as a component separate from the service providing system 200 .

On the other hand, although the service providing system 200 has been described as above, this description is exemplary, and at least some of the components or functions of the service providing system 200 are provided as needed by the device 300 and the digital signage 400. ) or a content management server (not shown), or may be included in the device 300, the digital signage 400, or a content management server (not shown).

First, the image acquisition unit 210 according to an embodiment of the present invention may perform a function of obtaining an image captured by the device 300 with respect to content provided from the digital signage 400 .

Specifically, the user may capture at least a portion of the content provided in the digital signage 400 using the device 300, and the image acquisition unit 210 according to an embodiment of the present invention may capture the captured image. image can be obtained. Here, it should be understood that the image captured by the device 300 does not necessarily include all of the above content, and it is sufficient if the above content is included only to the extent that identification information on the above content can be estimated. Meanwhile, estimating identification information about content will be described later.

In addition, according to an embodiment of the present invention, the content provided by the digital signage 400 can be changed as the time, place or surrounding situation changes, and can be dynamically changed by user manipulation of the augmented reality interface. may be

3 is a diagram exemplarily illustrating a process of displaying an augmented reality interface according to an embodiment of the present invention.

For example, referring to (a) of FIG. 3 , the digital signage 400 may provide specific content 410 through a display, and the content 410 may be photographed by the device 300. there is. Also, the image acquisition unit 210 according to an embodiment of the present invention may obtain an image 310 captured by the device 300 .

Meanwhile, the image acquisition unit 210 according to an embodiment of the present invention may perform a function of pre-processing the obtained image. And, according to an embodiment of the present invention, at least one of image simplification and feature detection may be included in such preprocessing.

Specifically, according to an embodiment of the present invention, the above pre-processing may refer to a process of compressing and converting the obtained image in order to estimate identification information on the content provided by the digital signage 400. there is.

For example, the image acquiring unit 210 according to an embodiment of the present invention may perform preprocessing to simplify the obtained image by adjusting the resolution, size, color information, etc. of the obtained image.

Continuing the example, the image acquisition unit 210 according to an embodiment of the present invention may perform preprocessing for detecting features in the obtained image. Such feature detection may be performed after simplifying the obtained image above, and can be performed using canny edge detection, Harris corner detection, Scale-Invariant Feature Transform (SIFT), and Speeded-Invariant Feature Transform (SURF). It can be performed using various feature detection algorithms such as Up Robust Features (ORB) and Oriented FAST and Rotated BRIEF (ORB).

However, the type of preprocessing that can be performed by the image acquisition unit 210 and the method for performing the preprocessing according to an embodiment of the present invention are not limited to those listed above, and the object of the present invention can be achieved. It can be variously changed within the range. In addition, this pre-processing is not necessarily performed by the image acquisition unit 210 according to an embodiment of the present invention, and the image obtained by the image acquisition unit 210 according to an embodiment of the present invention is stored in a content management server ( The obtained image may be pre-processed by a content management server (not shown) by transmitting to a content management server (not shown).

Next, the augmented reality interface management unit 220 according to an embodiment of the present invention, when an image captured by the device 300 with respect to the content provided by the digital signage 400 is obtained, the content pool It is possible to perform a function of estimating identification information about the above content by referring to the content to be compared to the above content included in .

Specifically, the augmented reality interface management unit 220 according to an embodiment of the present invention compares the obtained image with comparison target content related to the content provided in the digital signage 400, thereby Identification information can be estimated. Here, according to an embodiment of the present invention, the identification information on the content may mean information capable of identifying the corresponding content. For example, it may mean the file name of the corresponding content, the content name of the corresponding content, the metadata of the corresponding content, etc., but is not limited thereto.

For example, according to an embodiment of the present invention, the above comparison is performed using various algorithms such as histogram comparison, template matching, feature matching, and ANN (Approximate Nearest Neighbor)-based keypoint matching. It may be performed, and may be performed using a machine learning-based object detection algorithm. And, as a result of the above comparison, the comparison target content that is determined to be the most similar to the above obtained image is derived from among the comparison target contents, and is provided in the digital signage 400 with reference to the derived comparison target content. Identification information about the content can be estimated.

Meanwhile, according to an embodiment of the present invention, the content to be compared may be the content itself (ie, the original content) being provided in the digital signage 400, but the original content may be preprocessed. Therefore, the augmented reality interface management unit 220 according to an embodiment of the present invention, the image obtained by the image acquisition unit 210 according to an embodiment of the present invention is pre-processed, the above pre-processed original content (that is, , comparison target content), it is possible to estimate identification information about the content being provided in the digital signage 400 . Meanwhile, the pre-processing of the original content may mean a process of compressing and converting the original content, and is performed in the same manner as the pre-processing of the image obtained by the image acquisition unit 210 according to an embodiment of the present invention described above. Therefore, a detailed description will be omitted.

On the other hand, according to an embodiment of the present invention, the content pool may include comparison target content, and when the comparison target content is preprocessed original content, it may further include original content (ie, unpreprocessed content). . And, according to an embodiment of the present invention, the content pool may exist as one component of the service providing system 200, but a content management server (not shown), which is a separate component from the service providing system 200. ) may be included.

On the other hand, the augmented reality interface management unit 220 according to an embodiment of the present invention, based on the identification information about the content estimated by the augmented reality interface management unit 220, the augmented reality interface corresponding to the above content device It can perform a function to be displayed together with an image captured by 300 .

Specifically, when content provided from the digital signage 400 is identified, the augmented reality interface management unit 220 according to an embodiment of the present invention determines an augmented reality interface corresponding to the content based on the identification information. can Also, the augmented reality interface management unit 220 according to an embodiment of the present invention may display the determined augmented reality interface together with an image captured by the device 300 .

Meanwhile, according to an embodiment of the present invention, such an augmented reality interface may correspond to a category of content provided by the digital signage 400, and a service provider related to the digital signage 400 may set the augmented reality interface. A default augmented reality interface may be provided according to the category of content so that the service providing system 200 can be used without directly implementing it. Further, according to an embodiment of the present invention, the above content categories may be classified based on metadata (eg, tags) of the corresponding content or metadata of comparison target content related to the corresponding content.

For example, if the content provided by the digital signage 400 is related to the restaurant business (ie, if the category of the above content is classified as the restaurant business), the augmented reality interface corresponding to the content orders food. It may be a default augmented reality interface that basically provides related functions (eg, search, order, payment, etc.).

Also, the augmented reality interface management unit 220 according to an embodiment of the present invention may support execution of a function related to the augmented reality interface based on a user manipulation of the augmented reality interface. And, according to an embodiment of the present invention, at least some of the augmented reality interface and functions associated with the augmented reality interface may be implemented based on an application programming interface (API).

Specifically, according to an embodiment of the present invention, functions related to the augmented reality interface may include ordering, reservation, search, payment, purchase, information provision, communication support, and the like. However, the functions associated with the augmented reality interface are not limited to those listed above, and may be variously changed within the scope of achieving the object of the present invention. In addition, these functions may be executed based on user manipulation of the augmented reality interface, such as when the user touches a specific graphic element included in the augmented reality interface or inputs a voice command, and at least a portion of the augmented reality interface may be executed based on the above user manipulation. can be dynamically changed according to Furthermore, at least a part of the content provided in the digital signage 400 may be dynamically changed according to the above user manipulation.

Also, the augmented reality interface management unit 220 according to an embodiment of the present invention includes the device 300, the digital signage 400, and peripheral devices of the digital signage 400 (eg, a payment module, a printer, etc.) ), by controlling at least one of the service providing system 200 or a content management server (not shown), it is possible to support the execution of the above functions.

Continuing, according to an embodiment of the present invention, an application programming interface that allows a service provider related to the digital signage 400 to provide an augmented reality interface and functions related to the augmented reality interface to users while maintaining an existing system is provided. It can be distributed to the terminal device (not shown) of the above service provider. In addition, the augmented reality interface management unit 220 according to an embodiment of the present invention implements the augmented reality interface and functions related to the augmented reality interface using the application programming interface distributed by the service provider, and implements the augmented reality interface and the function associated with the augmented reality interface, It can perform a function that supports linkage. For example, when the above service provider creates an ordering function in an augmented reality interface, the augmented reality interface management unit 220 according to an embodiment of the present invention creates an application programming interface related to the ordering function, thereby It can support service providers to link existing systems and ordering functions.

3 to 6 exemplarily illustrate a process of displaying an augmented reality interface according to an embodiment of the present invention.

For example, referring to (b) of FIG. 3 , the augmented reality interface management unit 220 according to an embodiment of the present invention estimates identification information about the content 410 provided from the digital signage 400. If so, based on the estimated identification information, the augmented reality interface 320 corresponding to the above content 410 may be displayed together with the image 310 captured by the device 300. Continuing, for example, when the user touches a specific graphic element (eg, new collection) included in the augmented reality interface 320, a function associated with the graphic element (eg, information about new clothing) is displayed. Displayed together with the image 310 being photographed above) may be executed.

For another example, referring to FIG. 4 , the augmented reality interface management unit 220 according to an embodiment of the present invention includes content (eg, menu board) provided from digital signage (eg, menu board). If identification information on various menus provided in) is estimated, based on the estimated identification information, a function of displaying an augmented reality interface corresponding to the above content together with an image captured by the device may be performed. Continuing the example, when the user touches a specific graphic element included in the augmented reality interface (eg, placing an order), a function associated with the graphic element is executed (eg, payment for ordering a selected menu). modules can be interlocked and executed).

As another example, referring to FIG. 5 , the augmented reality interface management unit 220 according to an embodiment of the present invention includes content provided from a digital signage (eg, a guide kiosk installed in a shopping mall) (eg, For example, if identification information on a map of a shopping mall is estimated, an augmented reality interface (eg, store information in a shopping mall) corresponding to the above content is displayed on a device (eg, smart glasses) based on the estimated identification information. ) can perform a function to be displayed together with an image captured by. Continuing the example, when a user touches a specific graphic element included in the augmented reality interface or inputs a voice command (eg, search for a Nike store), a function associated with the graphic element (eg, a Nike store) An interface providing information about may be displayed along with an image captured by a device, a Nike store location displayed on a map provided from digital signage, etc.) may be executed. Continuing the example, if the user selects a road guide in the augmented reality interface, the corresponding function may be provided as another augmented reality interface.

For another example, referring to FIG. 6 , the augmented reality interface management unit 220 according to an embodiment of the present invention includes content (eg, Namsan Mountain) provided in a digital signage (eg, a tour guide display). If identification information about the tourist information about the tower) is estimated, an augmented reality interface (eg, traffic guide, map, nearby restaurants, etc.) corresponding to the above content is photographed by the device based on the estimated identification information. It can perform a function to be displayed together with the image to be displayed. Continuing the example, when the user touches a specific graphic element (eg, traffic guidance) included in the augmented reality interface, a function associated with the graphic element (eg, information about transportation to Namsan Tower) can be displayed along with an image captured by the device, the content provided in the digital signage is changed to information about transportation to Namsan Tower, etc.) can be executed.

7 is a diagram exemplarily illustrating a process of implementing an augmented reality interface according to an embodiment of the present invention.

For example, referring to FIG. 7 , the augmented reality interface according to an embodiment of the present invention may be implemented in multi-layers, and the augmented reality interface management unit 220 according to an embodiment of the present invention includes an augmented reality interface and Functions associated with the augmented reality interface (eg, search, order, purchase, reservation, payment, and other additional functions) may be implemented based on the application programming interface.

Meanwhile, the augmented reality interface management unit 220 according to an embodiment of the present invention may provide an augmented reality interface customized for each user based on the user's personal information obtained from the device 300 . Here, the user's personal information may include identification information about the user or the device 300, setting values previously set by the user for an augmented reality interface, etc., but is not limited thereto.

Next, the performance information management unit 230 according to an embodiment of the present invention refers to the image captured by the device 300 with respect to the content provided by the digital signage 400, and the digital signage 400 ) is estimated, based on the identification information about the above content and the identification information about the digital signage 400, the performance information about the above content and the digital signage 400 It may perform a function of deriving at least one of performance information about

Specifically, according to an embodiment of the present invention, an identification marker for identifying the digital signage 400 is included in the image captured by the device 300 in relation to the content provided by the digital signage 400. ) may be included. More specifically, this identification marker may mean an identifier given to the digital signage to identify the digital signage 400, and may be expressed in the form of an ID, graphic, or the like. In addition, such an identification marker may be included in the content provided by the digital signage 400 or may be disposed on or around the body of the digital signage 400 . However, the format and position of the identification marker for identifying the digital signage 400 is not limited to those listed above, and may be variously changed within the scope of achieving the object of the present invention.

Subsequently, the performance information management unit 230 according to an embodiment of the present invention refers to the identification marker included in the image captured by the device 300 with respect to the content provided by the digital signage 400, Identification information about the digital signage 400 of can be estimated. And, the performance information management unit 230 according to an embodiment of the present invention, based on the identification information about the content provided by the digital signage 400 and the identification information about the digital signage 400 , Information on how many users the digital signage 400 is used for (ie, performance information on the digital signage) and how many users are viewing or viewing the content provided by the digital signage 400 above. At least one of information about whether the user viewed (or was filming or filming) (ie, performance information about the content provided in the digital signage) may be derived. Furthermore, the performance information management unit 230 according to an embodiment of the present invention further based on the user's personal information obtained from the device 300, the performance information on the content and the digital signage 400 At least one of the performance information about can be derived in more detail.

Next, the communication unit 240 according to an embodiment of the present invention performs a function of enabling data transmission/reception from/to the image acquisition unit 210, the augmented reality interface management unit 220, and the performance information management unit 230. can do.

Finally, the control unit 250 according to an embodiment of the present invention controls the flow of data between the image acquisition unit 210, the augmented reality interface management unit 220, the performance information management unit 230, and the communication unit 240. can be performed. That is, the control unit 250 according to the present invention controls the data flow from/to the outside of the service providing system 200 or the data flow between each component of the service providing system 200, so that the image acquisition unit 210, The augmented reality interface management unit 220, the performance information management unit 230, and the communication unit 240 may each be controlled to perform unique functions.

Embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and recorded on a computer-readable recording medium. The computer readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and usable to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floptical disks. medium), and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter or the like as well as machine language codes generated by a compiler. A hardware device may be modified with one or more software modules to perform processing according to the present invention and vice versa.

Although the present invention has been described above with specific details such as specific components and limited embodiments and drawings, these are only provided to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments, and the present invention Those with ordinary knowledge in the technical field to which the invention belongs may seek various modifications and changes from these descriptions.

Therefore, the spirit of the present invention should not be limited to the above-described embodiments and should not be determined, and all scopes equivalent to or equivalently changed from the claims as well as the claims described below are within the scope of the spirit of the present invention. will be said to belong to

100: communication network
200: service provision system
210: image acquisition unit
220: augmented reality interface management unit
230: Performance information management department
240: communication department
250: control unit
300: device

Claims (9)

As a method for managing an augmented reality interface for content provided in digital signage,
Obtaining an image captured by a device in relation to content provided in digital signage;
Identification information about the content is estimated by referring to content to be compared with respect to the content included in the content pool, and based on the identification information about the content, the augmented reality interface corresponding to the content is the captured image. to be displayed together with; and
If the identification information on the digital signage is estimated with reference to the photographed image, the performance information on the content and the digital signage are calculated based on the identification information on the content and the identification information on the digital signage. Including the step of deriving performance information about,
Identification information about the digital signage is estimated by referring to an identification marker included in the photographed image,
The performance information on the content and the performance information on the digital signage are derived based on the number of users using the content and the digital signage, respectively.
method. According to claim 1,
Further comprising supporting a function associated with the augmented reality interface to be executed based on a user manipulation of the augmented reality interface.
method. According to claim 2,
Based on the user manipulation, at least one of at least a portion of the augmented reality interface and at least a portion of the content is dynamically changed.
method. According to claim 1,
At least some of the augmented reality interface and functions associated with the augmented reality interface are implemented based on an application programming interface (API).
method. According to claim 1,
The acquiring step further includes pre-processing the obtained image,
The content to be compared is obtained by pre-processing the content,
The preprocessing includes at least one of image simplification and feature detection.
method. delete delete A non-temporary computer readable recording medium storing a computer program for executing the method according to claim 1. As a system for managing an augmented reality interface for content provided in digital signage,
An image acquisition unit for obtaining an image captured by a device in relation to content provided in digital signage;
Identification information about the content is estimated by referring to content to be compared with respect to the content included in the content pool, and based on the identification information about the content, the augmented reality interface corresponding to the content is the captured image. An augmented reality interface management unit to be displayed together with, and
If the identification information on the digital signage is estimated with reference to the photographed image, the performance information on the content and the digital signage are calculated based on the identification information on the content and the identification information on the digital signage. Including a performance information management department that derives performance information about
Identification information about the digital signage is estimated by referring to an identification marker included in the photographed image,
The performance information on the content and the performance information on the digital signage are derived based on the number of users using the content and the digital signage, respectively.
system.

Images