KR20240074058A - Method and device for providing advertisements using augmented reality - Google Patents

Abstract

According to one aspect according to the technical spirit of the present disclosure, a method executed by a user device, comprising: receiving location information of the user device; adding advertising content including global advertising content and local advertising content to an advertising candidate content pool based on location information of the user device; Obtain characteristic information of the user device including at least one of search information, advertisement click information, and movement trajectory information of the user device, and prioritize advertising content included in the advertising candidate content pool based on the characteristic information of the user device. deciding step; Receiving sensing data obtained according to the location of the user device; Processing sensing data through a real-time 3D plane detection model to determine an advertising available plane; Selecting one or more advertising areas to output one or more advertising contents from the advertising available plane based on the feature points of the advertising available plane; A method is disclosed that includes outputting one or more advertisement contents to one or more advertisement areas according to the priority of the advertisement contents.

Description

Method and device for providing advertising content using augmented reality {METHOD AND DEVICE FOR PROVIDING ADVERTISEMENTS USING AUGMENTED REALITY}

The technical idea of the present disclosure relates to a method and device for providing advertising content using augmented reality, and more specifically, a method and device for providing advertising content to a peripheral plane of a user device using augmented reality. It's about devices.

Recently, as virtual and augmented reality (VR·AR) has attracted attention, various products such as HMD (Head Mounted Display) and AR glasses are being released at home and abroad. Among them, AR glasses are products that apply augmented reality, showing 3D virtual objects overlaid on the real world. Starting with Google Glass developed by Google in 2012, several companies are developing AR glasses and related components. With the advancement of these technologies, it is expected that many people will be able to experience expanded reality through AR in their daily lives using AR-providing devices such as AR glasses. Accordingly, space has infinite scalability as an aspect of combination with the virtual world.

However, services utilizing current AR technology are output based on markers and are consumed mainly in limited areas centered on entertainment content. Various types of content that are currently expressed digitally need to be applied to AR. Among them, the field that can be utilized the most is the advertising market.

The technical problem to be achieved by the technical idea of the present disclosure is to provide a method and device for providing advertisements on the surrounding plane of a user device using AR, which can express extended reality by combining reality and virtuality. .

The technical challenges to be achieved by the method and device for providing advertising content in augmented reality according to the technical idea of the present disclosure are not limited to the challenges mentioned above, and other challenges not mentioned will become clear to those skilled in the art from the description below. It will be understandable.

In order to achieve the above object, according to an aspect according to the technical spirit of the present disclosure, there is provided a method executed by a user device, comprising: receiving location information of the user device; adding advertising content including global advertising content and local advertising content to an advertising candidate content pool based on location information of the user device; Obtain characteristic information of the user device including at least one of search information, advertisement click information, and movement trajectory information of the user device, and prioritize advertising content included in the advertising candidate content pool based on the characteristic information of the user device. deciding step; Receiving sensing data obtained according to the location of the user device; Processing sensing data through a real-time 3D plane detection model to determine an advertising available plane; Selecting one or more advertising areas to output one or more advertising contents from the advertising available plane based on the feature points of the advertising available plane; A method is disclosed that includes outputting one or more advertisement contents to one or more advertisement areas according to the priority of the advertisement contents.

According to an exemplary embodiment, the step of selecting one or more advertising areas to output one or more advertising content from the advertising available plane based on the feature points of the advertising available plane includes selecting the advertising area from the advertising available plane based on the feature points of the advertising available plane. extracting one or more advertising areas from the plane; calculating the output suitability of the advertising area using at least one of the area of the advertising area, the location of the advertising area, the shape of the advertising area, and the characteristic information of the plane where the advertising available plane is located; Comparing the output suitability of the advertising area with an output judgment threshold; And if the output suitability of the advertising area is greater than the output judgment threshold, selecting the advertising area as an advertising area to output advertising content and giving priority to the advertising areas in the order of the output suitability of the advertising area, further comprising: The step of outputting one or more advertising contents to one or more advertising areas according to the priority of advertising content further includes outputting one or more advertising contents to one or more advertising areas according to the priority of advertising content and the priority of advertising areas. It can be included.

According to an exemplary embodiment, the step of outputting one or more advertising content to one or more advertising areas according to the priority of the advertising content includes determining the advertising state of the user device when the advertising content output to the user device is greater than the advertising availability threshold. A step of setting the process to a standby state and not additionally outputting advertising content to the advertising area may be further included.

According to an exemplary embodiment, global advertising content is advertising content that can be output to the advertising area regardless of the location information of the user device, and local advertising content may be advertising content that can be output to the advertising area based on the location information of the user device. .

According to an exemplary embodiment, the step of determining the priority of advertising content included in the advertising candidate content pool based on the characteristic information of the user device includes the characteristic information of the user device and the size of the advertising content, the category of the advertising content, and the advertisement The method may further include determining the priority of advertising content included in the advertising candidate content pool based on at least one of the unit prices of the content.

According to an exemplary embodiment, the method includes receiving location information of a user device at predetermined time intervals; determining a movement direction of the user device based on changes in location information of the user device over time; sequentially outputting advertising content according to the moving direction of the user device; and deleting the output advertising content from the advertising candidate content pool and adding advertising content not included in the advertising candidate content pool to the advertising candidate content pool.

According to an exemplary embodiment, the step of selecting one or more advertising areas to output one or more advertising contents from the advertising available plane based on the feature points of the advertising available plane includes the first advertising available plane and the second advertising available plane changing from each other. When sharing, a first advertising area on a first advertiseable plane that includes a side shared with the second advertiseable plane and a second advertising area on the second advertiseable plane that includes a side shared with the first advertiseable plane. It further includes the step of selecting one advertising area to output advertising content, and the step of outputting one or more advertising content to one or more advertising areas according to the priority of advertising content includes selecting a first advertising area and a second advertising area. Preprocessing advertising content so that it can be displayed in an advertising area including; And the step of outputting the pre-processed advertising content to the advertising area may be further included.

According to another aspect according to the technical spirit of the present disclosure, at least one processor; Memory; Sensing unit; and an output unit, wherein the processor receives location information of the user device, adds advertisement content including global advertisement content and local advertisement content to the advertisement candidate content pool based on the location information of the user device, and Obtaining characteristic information of the user device including at least one of search information, advertisement click information, and movement trajectory information, and determining the priority of advertising content included in the advertising candidate content pool based on the characteristic information of the user device, Receives sensing data obtained according to the location of the user device, processes the sensing data through a real-time 3D plane detection model to determine an advertising available plane, and extracts one or more advertising contents from the advertising available plane based on the feature points of the advertising available plane. Disclosed is a user device that selects one or more advertisement areas to be output and controls an output unit to output one or more advertisement contents to the one or more advertisement contents according to the priority of the advertisement contents.

According to an exemplary embodiment, the processor extracts one or more advertising areas from the advertising available plane based on feature points of the advertising available plane, including an area of the advertising area, a location of the advertising area, a shape of the advertising area, and The output suitability of the advertising area is calculated using at least one of the characteristic information of the plane where the advertising available plane is located, the output suitability of the advertising area is compared with the output judgment threshold, and the output suitability of the advertising area is greater than the output judgment threshold. , select an advertising area as the advertising area to output advertising content, give priority to the advertising area in the order of the advertising area's output suitability, and assign one or more advertising areas according to the priority of the advertising content and the priority of the advertising area. The output unit can be controlled to output one or more advertising contents.

According to an exemplary embodiment, when the advertising content output to the user device is greater than the advertising enablement threshold, the processor sets the advertising state of the user device to a standby state and controls the output unit not to additionally output advertising content to the advertising area. can do.

According to an exemplary embodiment, global advertising content is advertising content that can be output to the advertising area regardless of the location information of the user device, and local advertising content may be advertising content that can be output to the advertising area based on the location information of the user device. .

According to an example embodiment, the processor determines the priority of advertising content included in the advertising candidate content pool based on characteristic information of the user device and at least one of the size of the advertising content, the category of the advertising content, and the unit price of the advertising content. You can.

According to an exemplary embodiment, the processor receives location information of the user device at predetermined time intervals, determines a movement direction of the user device based on changes in the location information of the user device over time, and determines the direction of movement of the user device. Advertising content can be sequentially output according to the direction of movement, output advertising content can be deleted from the advertising candidate content pool, and advertising content not included in the advertising candidate content pool can be added to the advertising candidate content pool.

According to an example embodiment, the processor may be configured to, when the first advertiseable plane and the second advertiseable plane share a side with each other, display a first advertisement on the first advertiseable plane that includes a side shared with the second advertiseable plane. Selecting a second advertising area on a second advertising area, including an area and a side shared with the first advertising area, as one advertising area to output advertising content, and comprising the first advertising area and the second advertising area. The advertising content can be preprocessed so that it can be displayed in the advertising area, and the output unit can be controlled to output the preprocessed advertising content to the advertising area.

According to another aspect according to the technical idea of the present disclosure, a computer program stored in a computer-readable recording medium coupled with hardware to execute the above-described method is disclosed.

According to another aspect according to the technical idea of the present disclosure, a computer-readable recording medium storing a computer program in combination with hardware to execute the above-described method is disclosed.

A method and device for providing advertising content in augmented reality according to the technical idea of the present disclosure is an extra plane of real space, for example, a building, using augmented reality that can provide expanded reality by combining reality and virtuality. You can enjoy marketing effects by providing advertisements on the exterior walls.

The method and device for providing advertising content in augmented reality according to the technical idea of the present disclosure uses augmented reality, so advertising can be provided without installing physical facilities such as existing outdoor advertising and electronic billboard advertising, thereby achieving marketing effectiveness at low cost. It can be achieved.

Furthermore, the method and device for providing advertising content in augmented reality according to the technical idea of the present disclosure can provide advertising content in augmented reality and at the same time provide a link to the corresponding advertisement, enabling efficient marketing.

In addition, the method and device for providing advertising content in augmented reality according to the technical idea of the present disclosure can expose three-dimensional advertising content using augmented reality technology, thereby providing high advertising effectiveness.

The effects that can be obtained by the method and device for providing advertising content in augmented reality according to the technical idea of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned can be obtained from the description below. It will be clearly understandable to those with ordinary knowledge in the relevant technical field.

In order to more fully understand the drawings cited in this disclosure, a brief description of each drawing is provided.
1 is a flowchart of a method for providing advertising content in augmented reality according to an embodiment of the present disclosure.
Figure 2 illustrates a process in which global advertising content and local advertising content are added to an advertising candidate content pool according to an embodiment of the present disclosure.
Figure 3 shows sensing data acquired by a user device according to an embodiment of the present disclosure.
Figures 4 to 7 illustrate a process of processing sensing data acquired by a user device and outputting advertising content according to an embodiment of the present disclosure.
8 to 10 illustrate a process of selecting an advertising area and outputting advertising content according to an embodiment of the present disclosure.
Figure 11 shows a gradient of the advertising state of a user device according to an embodiment of the present disclosure.
Figure 12 is a block diagram of a user device that provides advertising content in augmented reality according to an embodiment of the present disclosure.
Figure 13 is a block diagram of a system for providing advertising content in augmented reality according to an embodiment of the present disclosure.

Illustrative embodiments according to the technical idea of the present disclosure are provided to more completely explain the technical idea of the present disclosure to those skilled in the art, and the examples below can be modified into various other forms. may be possible, and the scope of the technical idea of the present disclosure is not limited to the examples below. Rather, these embodiments are provided to make the present disclosure more faithful and complete and to fully convey the technical idea of the present invention to those skilled in the art.

Although the terms first, second, etc. are used in this disclosure to describe various members, regions, layers, portions, and/or components, these members, parts, regions, layers, portions, and/or components are referred to by these terms. It is obvious that it should not be limited by . These terms do not imply any particular order, superiority, inferiority, or superiority or inferiority, and are used only to distinguish one member, region, region, or component from another member, region, region, or component. Accordingly, the first member, region, portion, or component described in detail below may refer to the second member, region, portion, or component without departing from the teachings of the technical idea of the present disclosure. For example, a first component may be referred to as a second component without departing from the scope of the present disclosure, and similarly, the second component may also be referred to as a first component.

Unless otherwise defined, all terms used herein, including technical terms and scientific terms, have the same meaning as commonly understood by those skilled in the art in the technical field to which the concept of the present disclosure pertains. Additionally, commonly used terms, as defined in dictionaries, should be interpreted to have meanings consistent with what they mean in the context of the relevant technology, and should not be used in an overly formal sense unless explicitly defined herein. It should not be interpreted.

In cases where an embodiment can be implemented differently, a specific process sequence may be performed differently from the described sequence. For example, two processes described in succession may be performed substantially at the same time, or may be performed in an order opposite to the order in which they are described.

In the accompanying drawings, variations of the depicted shape may be expected, depending, for example, on manufacturing techniques and/or tolerances. Therefore, embodiments based on the technical spirit of the present disclosure should not be construed as being limited to the specific shape of the area shown in the present disclosure, but should include, for example, changes in shape that occur during the manufacturing process. The same reference numerals are used for the same components in the drawings, and duplicate descriptions thereof are omitted.

As used herein, the term 'and/or' includes each and every combination of one or more of the mentioned elements.

Hereinafter, embodiments based on the technical idea of the present disclosure will be described in detail with reference to the attached drawings.

1 is a flowchart of a method for providing advertising content in augmented reality according to an embodiment of the present disclosure.

Referring to Figure 1, the method of the present disclosure is a method executed by a user device, receiving location information of the user device (S110), including global advertising content and local advertising content based on the location information of the user device. Adding the advertising content to the advertising candidate content pool (S120), obtaining characteristic information of the user device including at least one of search information, advertisement click information, and movement trajectory information of the user device, and characteristic information of the user device. Based on this, determining the priority of advertising content included in the advertising candidate content pool (S130), receiving sensing data obtained according to the location of the user device (S140), sensing data through a real-time 3D plane detection model Processing to determine an advertising available plane (S150), selecting one or more advertising areas to output one or more advertising content from the advertising available plane based on the feature points of the advertising available plane (S160), priority of the advertising content It includes a step (S170) of outputting one or more advertisement contents to one or more advertisement areas according to the ranking.

Specifically, the user device of the present disclosure can receive location information of the user device. The user device may receive location information of the user device using a global positioning system (GPS). Although the use of GPS is described, other wireless positioning systems such as GALILEO, GNSS, LORAN, GLONASS, etc. may also be used.

The user device of the present disclosure may add advertising content including global advertising content and local advertising content to the advertising candidate content pool based on the location information of the user device. Here, the advertising candidate content pool may be a stack within the user device.

According to one embodiment, global advertising content may be advertising content that can be output to the advertising area regardless of the location information of the user device, and local advertising content may be advertising content that can be output to the advertising area based on the location information of the user device.

Figure 2 illustrates a process in which global advertising content and local advertising content are added to an advertising candidate content pool according to an embodiment of the present disclosure.

The augmented reality service can provide advertising content that can be output in each area. One local advertising content has a unique area that can be output within a predetermined range. In contrast, global advertising content can be output to all users who use the augmented reality service regardless of location.

Referring to FIG. 2, on the map, there are areas belonging to area ①, areas belonging to area ②, areas belonging to area ③, and area ④ corresponding to the entire area. Since one local advertising content has a unique area that can be output within a certain range, the first local advertising content can be output in the area belonging to area ①, and the second local advertising content can be output in area ②. It can be output in the area it belongs to, and the third local advertising content can be output in the area it belongs to area ③. Global advertising content can be output to all users who use the augmented reality service regardless of location, so it can be output in area ④, which corresponds to the entire region.

The local advertising content and global advertising content that a user device can output may be different depending on where the user device is located. Additionally, the user device may add local advertising content and global advertising content that can be output at the location of the user device to the advertising candidate content pool 130.

The user device in FIG. 2 is located in an area where area ① and area ② overlap. Accordingly, the user device stores local advertising content that can be output in area ①, local advertising content that can be output in area ②, and global advertising content that can be output in area ④ into the advertising candidate content pool 130. can be added to

Returning to FIG. 1, the user device of the present disclosure acquires characteristic information of the user device including at least one of search information, advertisement click information, and movement trajectory information, and retrieves the search information and advertisement information of the user device. The priority of advertising content included in the advertising candidate content pool may be determined based on characteristic information of the user device including at least one of click information and movement trajectory information.

According to one embodiment, when the user device determines the priority of advertising content included in the advertising candidate content pool based on the characteristic information of the user device, the user device determines the priority of the advertising content included in the advertising candidate content pool based on the characteristic information of the user device and the size of the advertising content. The priority of advertising content included in the advertising candidate content pool may be determined based on at least one of the category and the unit price of the advertising content.

And the user device of the present disclosure can receive sensing data acquired by the user device. Sensing data may be obtained from a sensing unit of the user device. The sensing unit is not limited to this, but may include, for example, an image capture device, a lidar sensor, a radar sensor, etc. Accordingly, the sensing data may include image data acquired from an image capture device, data acquired from a lidar sensor, data acquired from a radar sensor, etc. Additionally, the user device can acquire data in real time using the sensing unit. For example, the user device may acquire image data by capturing one image or multiple images in real time.

Figure 3 shows sensing data acquired by a user device according to an embodiment of the present disclosure. The user device can sense the surrounding environment in real time, and in this case, the sensing data sensed by the user device may include one or more sensing data over time. Referring to FIG. 3, the user device can sense the surrounding environment in real time through a camera and acquire N pieces of image data 310 captured over time.

Additionally, the user device of the present disclosure can determine an advertising available plane by processing sensing data through a real-time 3D plane detection model. The user device may select one or more advertising areas to output one or more advertising content from the advertising available plane based on the feature points of the advertising available plane. Thereafter, the user device may output one or more advertising content to one or more advertising areas according to the priority of the advertising content.

Figures 4 to 7 illustrate a process of processing sensing data acquired by a user device and outputting advertising content according to an embodiment of the present disclosure.

Referring to FIG. 4, the user device may extract a candidate advertisement available plane as a predicted value of a 3D plane detection model. Then, the user device calculates the advertisement suitability of each candidate advertisement available plane. Here, advertising suitability can be calculated using the position of the candidate advertising possible plane and a classification algorithm of the sensing data.

The user device may determine an advertising available plane by comparing the advertising suitability of each candidate advertising available plane with an advertising suitability threshold. That is, the user device determines the plane as an ad-capable plane if the ad suitability of each candidate ad-capable plane is greater than the ad-suitability threshold, and determines the plane as an ad-capable plane if the ad suitability of each candidate ad-capable plane is not greater than the ad-suitability threshold. You may not. Referring to FIG. 5, the user device may determine whether an advertisement is available by calculating the advertisement suitability for the candidate advertisement available plane extracted in FIG. 4. Specifically, the user device may calculate the advertisement suitability for the planes 410 to 450 shown in FIG. 4, compare the advertisement suitability of the planes 410 to 450 with an advertisement suitability threshold, and determine the plane 410 as an advertisement available plane.

According to one embodiment, when the user device selects one or more advertising areas to output one or more advertising content from the advertising available plane based on the feature points of the advertising available plane, the user device selects one or more advertising areas to output one or more advertising content based on the feature points of the advertising available plane. One or more advertising areas can be extracted from the advertising available plane. Here, the feature points of the advertisement available plane may include coordinate information of the advertisement available plane, characteristics of the object where the advertisement available plane is located, for example, depth information of the object, etc. Additionally, the user device may output one or more advertising content to one or more advertising areas according to the priority of the advertising content.

In FIG. 6 , the user device may extract the advertising area 610 from the advertising available plane 410 based on the feature points of the advertising available plane 410. Additionally, the user device may pre-process and output the advertising content so that it can be output in the advertising area 610. For example, the user device may convert advertising content to fit the advertising area 610 using coordinate information, location information, depth, etc., and output it. Accordingly, as shown in FIG. 7 , advertising content may be converted to fit the advertising area 710 and output.

According to one embodiment, when the user device selects one or more advertising areas to output one or more advertising content from the advertising available plane based on the feature points of the advertising available plane, the user device selects one or more advertising areas to output one or more advertising content based on the feature points of the advertising available plane. One or more advertising areas can be extracted from the advertising available plane. Additionally, the user device may calculate the output suitability of the advertising area using at least one of the area of the advertising area, the location of the advertising area, the shape of the advertising area, and the characteristic information of the plane where the advertising available plane is located. The user device may compare the calculated output suitability of the advertisement area with the output judgment threshold. If the output suitability of the advertising area is greater than the output determination threshold, the user device may select the advertising area as an advertising area to output advertising content and give priority to the advertising areas in the order of the advertising area's output suitability. Additionally, the user device may output one or more advertising content to one or more advertising areas according to the priority of the advertising content and the priority of the advertising area.

According to one embodiment, when selecting one or more advertising areas to output one or more advertising content from the advertising available plane based on the feature points of the advertising available plane, the user device may cause the first advertising available plane and the second advertising available plane to change from each other. When sharing, a first advertising area on a first advertiseable plane that includes a side shared with the second advertiseable plane and a second advertising area on the second advertiseable plane that includes a side shared with the first advertiseable plane. You can select one advertising area to output advertising content. Additionally, the user device may pre-process the advertising content so that it can be displayed in the advertising area including the first advertising area and the second advertising area, and output the pre-processed advertising content to the advertising area.

8 to 10 illustrate a process of selecting an advertising area and outputting advertising content according to an embodiment of the present disclosure.

The user device may select one or more advertising areas to output one or more advertising content from the advertising available plane based on the feature points of the advertising available plane. As shown in FIG. 8 , the user device may extract one or more feature points 810 from the ad-capable plane. The user device may form one or more advertising areas based on one or more feature points 810 of the advertising available plane. Additionally, the user device may calculate the output suitability of the advertising area using at least one of the area of the advertising area, the location of the advertising area, the shape of the advertising area, and the characteristic information of the plane where the advertising available plane is located. The user device compares the calculated output suitability of the advertising area with the output judgment threshold, and if the output suitability of the advertising area is greater than the output judgment threshold, the user device may select the advertising area as an advertising area to output advertising content.

In FIG. 9 , the user device may select an advertising area 910 or 920 whose output suitability is higher than an output determination threshold among one or more advertising areas existing on an advertising available plane. Specifically, when selecting one or more advertising areas to output one or more advertising content from an advertising available plane based on the feature points of the advertising available plane, if the advertising available planes share sides with each other, the user device may display an advertisement sharing the side. You can select an area as one advertising area.

In this case, the user device may preprocess the advertising content so that it can be output to different advertising areas that share one side. For example, the user device may preprocess advertising content so that it can be displayed three-dimensionally on different advertising areas that share sides. And the user device can output the preprocessed advertising content to the advertising area as shown in FIG. 10.

Accordingly, the method of providing advertising content in augmented reality according to the technical idea of the present disclosure can expose advertising content with a three-dimensional effect by utilizing augmented reality technology, thereby providing high advertising effectiveness.

According to one embodiment, the user device may receive location information of the user device at predetermined time intervals and determine a movement direction of the user device based on changes in the location information of the user device over time. Additionally, the user device may output advertising content sequentially according to the direction of movement of the user device. In this case, the user device may delete the output advertising content from the advertising candidate content pool and add advertising content not included in the advertising candidate content pool to the advertising candidate content pool.

According to one embodiment, if the advertising content output on the user device is greater than the advertising availability threshold, the user device may set the advertising state of the user device to a standby state and not output additional advertising content in the advertising area.

11 shows a diagram of a change in advertising status of a user device according to an embodiment of the present disclosure.

Referring to FIG. 11, the advertising state of the user device begins with the standby state 1110 of FIG. 11 when the augmented reality service starts. Here, the standby state 1110 indicates a state in which no additional advertising content is output to the advertising area. The user device can receive location information, add advertising content to the advertising candidate content pool, process sensing data to select advertising areas, and sequentially output advertising content to advertising areas according to the priority of advertising content. . As an example, after the augmented reality service starts, the user device in the standby state may change to the output-capable state (1120) after loading advertising content to be displayed on the user device. Here, the output enabled state 1120 indicates a state in which advertising content can be additionally output to the advertising area. That is, when advertising content is loaded, the user device switches from the standby state (1110) to the output state (1120). Additionally, if the advertising content displayed on the user device is greater than the advertising availability threshold, the output enabled state 1120 may be switched to the standby state 1110. In other words, the number of advertising content to be displayed at one time on the user device may be set as an advertising availability threshold.

A method of providing advertising content in augmented reality according to the technical idea of the present disclosure uses augmented reality, which can provide expanded reality by combining reality and virtuality, to advertise on an extra plane of real space, for example, on the outer wall of a building. You can enjoy marketing effects by providing .

The method of providing advertising content in augmented reality according to the technical idea of the present disclosure uses augmented reality, so advertising can be provided without installing physical facilities such as existing outdoor advertising and electronic billboard advertising, so marketing effects can be achieved at low cost. there is.

Furthermore, the method of providing advertising content in augmented reality according to the technical idea of the present disclosure can provide advertising content in augmented reality and at the same time provide a link to the corresponding advertisement, enabling efficient marketing.

FIG. 12 is a block diagram of a user device 1200 that provides advertising content in augmented reality according to an embodiment of the present disclosure.

The user device 1200 of the present disclosure includes at least one processor 1210, a memory 1220, a sensing unit 1230, and an output unit 1240. Specifically, the processor 1210 of the user device receives location information of the user device, and adds advertising content including global advertising content and local advertising content to the advertising candidate content pool based on the location information of the user device, Obtain characteristic information of the user device including at least one of search information, advertisement click information, and movement trajectory information of the user device, and prioritize advertising content included in the advertising candidate content pool based on the characteristic information of the user device. You can decide.

Furthermore, the processor 1210 receives sensing data obtained according to the location of the user device, processes the sensing data through a real-time 3D plane detection model, determines an advertising available plane, and allows advertising based on the feature points of the advertising available plane. One or more advertising areas can be selected from the plane to output one or more advertising content. Additionally, the processor 1210 may control the output unit to output one or more advertisement contents to one or more advertisement areas according to the priority of the advertisement contents.

Specifically, the user device 1200 of the present disclosure may receive location information of the user device. The user device 1200 may receive location information of the user device 1200 using a global positioning system (GPS). Although the use of GPS is described, other wireless positioning systems such as GALILEO, GNSS, LORAN, GLONASS, etc. may also be used.

The processor 1210 of the present disclosure may add advertising content, including global advertising content and local advertising content, to the advertising candidate content pool based on location information of the user device. Here, the advertising candidate content pool may be a stack within the user device.

According to one embodiment, global advertising content may be advertising content that can be output to the advertising area regardless of the location information of the user device, and local advertising content may be advertising content that can be output to the advertising area based on the location information of the user device. The local advertising content and global advertising content that the user device 1200 can output may be different depending on where the user device is located.

The processor 1210 of the present disclosure acquires characteristic information of the user device, including at least one of search information, advertisement click information, and movement trajectory information of the user device, and searches information, advertisement click information, and movement trajectory of the user device. The priority of advertising content included in the advertising candidate content pool may be determined based on characteristic information of the user device including at least one of the information.

According to one embodiment, the processor 1210 prioritizes the advertising content included in the advertising candidate content pool based on at least one of the characteristic information of the user device and the size of the advertising content, the category of the advertising content, and the unit price of the advertising content. can be decided.

And the user device 1200 of the present disclosure can receive sensing data acquired by the user device. Sensing data may be obtained from the sensing unit 1230 of the user device. The sensing unit 1230 is not limited to this, but may include, for example, an image capture device, a lidar sensor, a radar sensor, etc. Accordingly, the sensing data may include image data acquired from an image capture device, data acquired from a lidar sensor, data acquired from a radar sensor, etc. Additionally, the processor 1210 can acquire data in real time using the sensing unit 1230. For example, the sensing unit 1230 may acquire image data by capturing one image or multiple images in real time.

Additionally, the processor 1210 can process the sensing data through a real-time 3D plane detection model to determine an advertising available plane. The processor 1210 may select one or more advertising areas to output one or more advertising contents from the advertising available plane based on the feature points of the advertising available plane. Thereafter, the processor 1210 may output one or more advertisement contents to one or more advertisement areas according to the priority of the advertisement contents.

According to one embodiment, the processor 1210 extracts one or more advertising areas from the advertising available plane based on the feature points of the advertising available plane, the area of the advertising area, the location of the advertising area, and the shape of the advertising area. , and at least one of the characteristic information of the plane where the advertising possible plane is located is used to calculate the output suitability of the advertising area, the output suitability of the advertising area is compared with the output judgment threshold, and the output suitability of the advertising area is greater than the output judgment threshold. If it is large, select the advertising area as the advertising area to output the advertising content, give priority to the advertising area in the order of the advertising area's output suitability, and one or more advertisements according to the priority of the advertising content and the priority of the advertising area. The output unit can be controlled to output one or more advertisement contents to the area.

Specifically, the user device may select one or more advertising areas to output one or more advertising content from the advertising available plane based on the feature points of the advertising available plane. The user device may extract one or more feature points from the ad-capable plane. The user device may form one or more advertising areas based on one or more feature points of the advertising available plane. Additionally, the user device may calculate the output suitability of the advertising area using at least one of the area of the advertising area, the location of the advertising area, the shape of the advertising area, and the characteristic information of the plane where the advertising available plane is located. The user device compares the calculated output suitability of the advertising area with the output judgment threshold, and if the output suitability of the advertising area is greater than the output judgment threshold, the user device may select the advertising area as an advertising area to output advertising content. The user device may select an advertising area whose output suitability is higher than an output determination threshold among one or more advertising areas existing on an advertising available plane.

According to one embodiment, if the advertising content output to the user device is greater than the advertising enablement threshold, the processor 1210 sets the advertising state of the user device to a standby state and outputs the advertising content so that no additional advertising content is output in the advertising area. You can control your wealth.

Specifically, the advertising state of the user device starts in a standby state when the augmented reality service is started. The user device can receive location information, add advertising content to the advertising candidate content pool, process the sensing data to select an advertising area, and sequentially output advertising content to the advertising area according to the priority of the advertising content. . As an example, a user device that is in a standby state after the augmented reality service starts may load advertising content to be displayed on the user device and then change to an output-capable state. In other words, when advertising content is loaded, the user device switches from the standby state to the output state. Additionally, if the advertising content displayed on the user device is greater than the advertising enablement threshold, the output state may be switched to the standby state. In other words, the number of advertising content to be displayed at one time on the user device may be set as an advertising availability threshold.

According to one embodiment, the processor 1210 receives location information of the user device at predetermined time intervals and determines a movement direction of the user device based on changes in the location information of the user device over time, Advertising content can be output sequentially according to the movement direction of the user device, output advertising content can be deleted from the advertising candidate content pool, and advertising content not included in the advertising candidate content pool can be added to the advertising candidate content pool.

According to one embodiment, processor 1210 is configured to, when the first advertiseable plane and the second advertiseable plane share a side with each other, the processor 1210 configures the 1 A second advertising area on a second advertising plane, including an advertising region and a side shared with the first advertising plane, is selected as one advertising region to output advertising content, and the first advertising region and the second advertising region are selected. The advertising content can be preprocessed so that it can be displayed in the included advertising area, and the output unit can be controlled to output the preprocessed advertising content to the advertising area.

Specifically, when selecting one or more advertising areas to output one or more advertising content from an advertising available plane based on the feature points of the advertising available plane, if the advertising available planes share sides with each other, the user device may display an advertisement sharing the side. You can select an area as one advertising area.

In this case, the user device may preprocess the advertising content so that it can be output to different advertising areas that share one side. For example, the user device may preprocess advertising content so that it can be displayed three-dimensionally on different advertising areas that share sides. And the user device can output the pre-processed advertising content to the advertising area as shown in FIG. 10.

Accordingly, the method of providing advertising content in augmented reality according to the technical idea of the present disclosure can expose advertising content with a three-dimensional effect by utilizing augmented reality technology, thereby providing high advertising effectiveness.

A user device that provides advertising content in augmented reality according to the technical idea of the present disclosure may be placed on an extra plane of real space, for example, on the outer wall of a building, using augmented reality, which can provide expanded reality by combining reality and virtuality. You can enjoy marketing effects by providing advertisements.

The user device that provides advertising content in augmented reality according to the technical idea of the present disclosure uses augmented reality and can provide advertising without installing physical facilities such as existing outdoor advertising and electronic billboard advertising, thereby achieving marketing effects at low cost. You can.

Furthermore, a user device that provides advertising content in augmented reality according to the technical idea of the present disclosure can provide advertising content on augmented reality and at the same time provide a link to the corresponding advertisement, enabling efficient marketing.

Figure 13 is a block diagram of a system 1300 for providing advertising content in augmented reality according to an embodiment of the present disclosure.

Referring to FIG. 13, a system 1300 for providing advertising content using augmented reality includes one or more first user devices 1310 and one or more servers 1320, and one or more first user devices 1310. and one or more servers 1320 are connected through a network 1330.

For more specific components and operating processes of one or more first user devices 1310, refer to the above-described method of FIGS. 1 to 11 and the description of the user device 100 of FIG. 12.

One or more first user devices 1310 may include all types of devices including an output unit and a communication unit capable of displaying or outputting information received from the server 1320. For example, one or more first user devices 1310 may include a smartphone, tablet PC, PC, smart TV, mobile phone, personal digital assistant (PDA), laptop, media player, micro server, global positioning system (GPS) device, It may include digital broadcasting terminals, navigation, and other mobile or non-mobile computing devices. Additionally, one or more first user devices 1310 may include wearable devices such as watches, glasses, hair bands, and rings equipped with output functions and communication functions.

Meanwhile, for convenience of explanation, only one first user device 1310 among one or more first user devices 1310 is shown in FIG. 13, but the number of terminals may vary depending on the embodiment. As long as the processing capacity of the server 1320 allows, the number of terminals is not particularly limited.

As shown in FIG. 13 , one or more first user devices 1310 and one or more servers 1320 may be connected through a network 1330 . According to one embodiment, the network 1330 refers to a connection structure that allows information exchange between nodes such as a plurality of terminals and servers. An example of such a network 1330 includes a LAN (Local Area Network), MAN (Metropolitan Area Network), GSM (Global System for Mobile Network), EDGE (Enhanced Data GSM Environment), HSDPA (High Speed Downlink Packet Access), W-CDMA (Wideband Code Division Multiple Access), CDMA (Code Division Multiple Access) ), TDMA (Time Division Multiple Access), Bluetooth, Zigbee, Wi-Fi, VoIP (Voice over Internet Protocol), LTE Advanced, IEEE802.16m, WirelessMAN-Advanced, HSPA+, 3GPP Long Term Evolution (LTE), Mobile WiMAX (IEEE 802.16e), UMB (formerly EV-DO Rev. C), Flash-OFDM, iBurst and MBWA (IEEE 802.20) systems, HIPERMAN, Beam-Division Multiple Access (BDMA) , Wi-MAX (World Interoperability for Microwave Access), and 5G, various types of wired or wireless networks may be used, but are not limited to these.

The server 1320 of the present disclosure may receive location information of the first user device 1310 from the first user device 1310. And the server 1320 may transmit local advertising content and global advertising content that can be provided from the location information of the first user device 1310 to the first user device 1310. Additionally, the server 1320 sends the characteristic information of the first user device 1310, including at least one of search information, advertisement click information, and movement trajectory information of the first user device 1310, to the first user device 1310. It can be sent to .

The description of the above-described embodiments is merely an example with reference to the drawings for a more thorough understanding of the present disclosure, and should not be construed as limiting the technical idea of the present disclosure.

In addition, it will be clear to those skilled in the art to which this disclosure pertains that various changes and modifications can be made without departing from the basic principles of the present disclosure.

Claims (16)

A method executed by a user device, comprising:
Receiving location information of the user device;
adding advertising content including global advertising content and local advertising content to an advertising candidate content pool based on the location information of the user device;
Obtain characteristic information of the user device including at least one of search information, advertisement click information, and movement trace information of the user device, and display advertising content included in the advertisement candidate content pool based on the characteristic information of the user device. determining priorities;
Receiving sensing data obtained according to the location of the user device;
Processing the sensing data through a real-time 3D plane detection model to determine an advertising available plane;
selecting one or more advertising areas to output the one or more advertising content from the advertising available plane based on feature points of the advertising available plane;
Outputting the one or more advertising contents to the one or more advertising areas according to the priority of the advertising content.
How to include .
According to claim 1,
The step of selecting one or more advertising areas to output the one or more advertising content from the advertising possible plane based on the feature points of the advertising possible plane,
extracting one or more advertising areas from the advertising available plane based on feature points of the advertising available plane;
calculating an output suitability of the advertising area using at least one of an area of the advertising area, a location of the advertising area, a shape of the advertising area, and characteristic information of a plane where the advertising available plane is located;
Comparing the output suitability of the advertisement area with an output judgment threshold; and
If the output suitability of the advertising area is greater than the output determination threshold, selecting the advertising area as an advertising area to output the advertising content and giving priority to the advertising area in order of the output suitability of the advertising area.
It further includes,
The step of outputting the one or more advertising contents to the one or more advertising areas according to the priority of the advertising content,
Outputting the one or more advertising contents to the one or more advertising areas according to the priority of the advertising content and the priority of the advertising area.
Containing more,
method.
According to claim 1,
The step of outputting the one or more advertising contents to the one or more advertising areas according to the priority of the advertising content,
If the advertising content output to the user device is greater than the advertising availability threshold, setting the advertising state of the user device to a standby state and not additionally outputting the advertising content to the advertising area.
Containing more,
method.
According to claim 1,
The global advertising content is advertising content that can be output to an advertising area regardless of the location information of the user device, and the local advertising content is advertising content that can be output to an advertising area based on the location information of the user device.
method.
According to claim 1,
The step of determining the priority of advertising content included in the advertising candidate content pool based on the characteristic information of the user device,
Determining the priority of advertising content included in the advertising candidate content pool based on at least one of the characteristic information of the user device and the size of the advertising content, the category of the advertising content, and the unit price of the advertising content.
Containing more,
method.
According to claim 1,
The above method is,
Receiving location information of the user device at predetermined time intervals;
determining a movement direction of the user device based on changes in location information of the user device over time;
sequentially outputting the advertising content according to the moving direction of the user device; and
Deleting the output advertising content from the advertising candidate content pool and adding advertising content not included in the advertising candidate content pool to the advertising candidate content pool.
How to include more.
According to claim 1,
The step of selecting one or more advertising areas to output the one or more advertising content from the advertising possible plane based on the feature points of the advertising possible plane,
When the first advertiseable plane and the second advertiseable plane share a side with each other, a first advertising area on the first advertiseable plane including a side shared with the second advertiseable plane and the first advertiseable plane; Selecting a second advertising area on a second advertising available plane including a shared side as one advertising area to output the advertising content.
It further includes,
The step of outputting the one or more advertising contents to the one or more advertising areas according to the priority of the advertising content,
Preprocessing the advertising content so that it can be displayed in an advertising area including the first advertising area and the second advertising area; and
Outputting the preprocessed advertising content to the advertising area
Containing more,
method.
at least one processor;
Memory;
Sensing unit; and
output unit
Includes,
The processor,
Receive location information of the user device,
Adding advertising content including global advertising content and local advertising content to the advertising candidate content pool based on the location information of the user device,
Obtain characteristic information of the user device including at least one of search information, advertisement click information, and movement trace information of the user device, and display advertising content included in the advertisement candidate content pool based on the characteristic information of the user device. decide priorities,
Receive sensing data obtained according to the location of the user device,
Process the sensing data through a real-time 3D plane detection model to determine an advertising available plane,
Selecting one or more advertising areas to output the one or more advertising content from the advertising available plane based on the feature points of the advertising available plane,
Controlling the output unit to output the one or more advertising contents to the one or more advertising areas according to the priority of the advertising content,
User device.
According to clause 8,
The processor,
extracting one or more advertising areas from the advertising available plane based on the feature points of the advertising available plane;
Calculate the output suitability of the advertising area using at least one of the area of the advertising area, the location of the advertising area, the shape of the advertising area, and the characteristic information of the plane where the advertising available plane is located,
Compare the output suitability of the advertising area with an output judgment threshold,
If the output suitability of the advertising area is greater than the output judgment threshold, select the advertising area as an advertising area to output the advertising content and give priority to the advertising area in order of the output suitability of the advertising area,
Controlling the output unit to output the one or more advertising contents to the one or more advertising areas according to the priority of the advertising content and the priority of the advertising area,
User device.
According to clause 8,
The processor,
If the advertising content output to the user device is greater than the advertising availability threshold, setting the advertising state of the user device to a standby state and controlling the output unit not to further output the advertising content to the advertising area,
User device.
According to clause 8,
The global advertising content is advertising content that can be output to an advertising area regardless of the location information of the user device, and the local advertising content is advertising content that can be output to an advertising area based on the location information of the user device.
User device.
According to clause 8,
The processor,
Determining the priority of advertising content included in the advertising candidate content pool based on at least one of the characteristic information of the user device and the size of the advertising content, the category of the advertising content, and the unit price of the advertising content,
User device.
According to clause 8,
The processor,
Receiving location information of the user device at predetermined time intervals,
Determine the direction of movement of the user device based on changes in location information of the user device over time,
Outputting the advertising content sequentially according to the moving direction of the user device,
Deleting the output advertising content from the advertising candidate content pool and adding advertising content not included in the advertising candidate content pool to the advertising candidate content pool.
User device.
According to clause 8,
The processor,
When the first advertiseable plane and the second advertiseable plane share a side with each other, a first advertising area on the first advertiseable plane including a side shared with the second advertiseable plane and the first advertiseable plane; Selecting a second advertising area on a second advertising available plane including a shared side as one advertising area to output the advertising content,
Preprocessing the advertising content so that it can be displayed in an advertising area including the first advertising area and the second advertising area,
Controlling the output unit to output the preprocessed advertising content to the advertising area,
User device.
A computer program combined with hardware and stored in a computer-readable recording medium to execute the method of claim 1.
A computer-readable recording medium storing a computer program in combination with hardware to execute the method of claim 1.