TW201719525A - An immersive advertisement broadcasting system - Google Patents

Abstract

The present invention provides an immersive advertisement broadcasting system for merging an advertisement on a 3D panoramic image, comprising a demarcating server, an advertisement submitting platform, a matching server, and an advertisement merging server. The demarcating server is for demarcating a block in the 3D panoramic image, and giving a meta data to the block and then saving the meta data. The advertisement submitting platform is for receiving a broadcasting need of an advertisement owner. The matching server is for matching the broadcasting need with the block saved in the demarcating server while receiving the broadcasting need. The advertisement merging server is for merging the block with an advertisement which the advertisement owner wants to broadcast. Compared to the prior art, the present invention fulfills a technology that merging an advertisement in the 3D panoramic image.

Description

Immersive advertising communication system

The present invention relates to an immersive advertisement communication system, and more specifically to a method for merging and playing an advertisement in a panoramic stereoscopic image by using Virtual Reality (VR) or Augmented Reality (AR). An immersive advertising communication system.

Since the establishment of human society and the development of industry and commerce, the industry has no way of trying to make their products visible to consumers, so advertising has become a useful tool to promote their own goods. Whether it's leaflets, postage ads, huge posters, TV shows, and web windows, it's a good medium. The way to use the web window to advertise is to dig a section on the page of a website, webpage, social network or mobile application (Application, APP), or put a banner on the webpage, or At the top of the screen, a window page pops up to serve the ad. However, there is a disadvantage in that or how much of the advertisement window, page or banner occupies the user's view of the content to be viewed.

Since the beginning of technology to Virtual Reality (VR), network panoramic maps (such as Google Map), so that the development of Augmented Reality (AR), the media has been further increased. The spatial projection window that has been seen anywhere in science fiction movies that jumps out of any position (even if it still needs to be achieved with special glasses and operating equipment) will have the opportunity to be realized, even with the use of network panoramic maps, for example in the use of augmented reality ( AR) device browsing When viewing a street view, jump out of the space projection window in the panoramic map, or attach the space projection window to the building of the panoramic map to play the advertisement.

And so far, the prior art does not have similar invention cases with the aforementioned Combine the technical features or visual presentation of VR or AR in a panoramic map of the network. In addition, if the concept of advertising in the past on the Internet, webpage, social network or mobile application (Application, APP) is directly applied to the panoramic map of the network, the aforementioned shortcomings will still exist, such as application expansion. When you use the Augmented Reality technology to create a panoramic view, or when you use Augmented Reality technology in an indoor space, the advertising window suddenly occupies most of the user's field of vision. In addition to the user's discomfort, if the user is walking, There is a possibility of an accident.

In response to the foregoing problems, the present invention provides an immersive advertisement communication system that attaches an advertisement content to a panoramic stereoscopic image, so that a user can view the panoramic stereoscopic image, and can construct the wall surface and surface in the panoramic stereoscopic image. The top view is attached to the wall or surface advertising content without affecting the viewing field. And when the user turns to change the visual field position, the presentation ratio of the advertisement content also changes.

The immersive advertisement distribution system of the present invention comprises a calibration server, an advertisement submission platform, a mediation server, and an advertisement fusion server. The calibration server is configured to calibrate a calibration block that can be affixed to the advertisement content in the panoramic stereoscopic image, and assign a data to the calibration block after the data is stored (Mata Data); the advertisement submission platform is configured to receive an advertisement. One of the advertisement contents proposed by the owner transmits the demand; the mediation server is connected with the calibration server and the advertisement submission platform, and is used for the calibration server to find the calibration block that meets the communication requirement when receiving the communication demand from the advertisement submission platform. And the ad fusion server is connected to the media server for advertising The content is merged into the calibration block.

Compared with the prior art, the implementation of the immersive advertising communication system proposed by the present invention The technology of embedding advertisements in panoramic stereoscopic images allows users to receive advertising messages while viewing or viewing a panoramic stereoscopic image through augmented reality without affecting the viewing horizon, while providing a good browsing experience. .

1‧‧‧Immersive Advertising Communication System

10‧‧‧ Panorama Database

11‧‧‧ Calibration server

111‧‧‧Image Processing Module

112‧‧‧Available space calibration module

113‧‧‧After data storage module

114‧‧‧ Brand Database

12‧‧‧Advertising Submission Platform

13‧‧‧ Matching server

131‧‧‧ Matching Information Update Module

14‧‧‧Advertising Fusion Server

15‧‧‧Advertising Module

A1‧‧‧ first algorithm

A2‧‧‧ second algorithm

P1~P12, S1~S15‧‧‧ steps

1 is a block diagram of a system in accordance with an embodiment of the present invention.

FIG. 2 is a flow chart of an algorithm according to an embodiment of the present invention.

FIG. 3 is a flow chart showing the algorithm of another embodiment of the present invention.

First, please refer to FIG. 1. FIG. 1 is a block diagram of a system according to an embodiment of the present invention. The present invention provides an immersive advertisement communication system 1 for integrating an advertisement content into a panoramic stereoscopic image, comprising a panoramic database 10, a calibration server 11, an advertisement submission platform 12, a mediation server 13, An advertisement fusion server 14 and an advertisement playing module 15. The panoramic database 10 is connected to the calibration server 11, and the mediation server 13 is connected to the panoramic database 10, the calibration server 11, the advertisement submission platform 12, and the advertisement fusion server 14. Finally, the advertisement playback module 15 and the advertisement fusion servo The device 14 is connected.

The technical content of the present invention for realizing the advertising content of the present invention to the panoramic stereoscopic image will be described in detail below. First, the panoramic database 10 stores a panoramic stereoscopic image obtained by requesting authorization from a known existing database, such as Google Map, or by using a panoramic fisheye camera by the service provider of the present invention. . The photographed photos are corrected and combined into a panoramic stereoscopic image, and then stored in the panoramic database 10.

Then, the calibration server 11 is used to calibrate the panoramic stereo image to be affixed to the wide A calibration block of the content is given, and the Meta Data is used to store the Meta Data. The calibration server 11 further includes an image processing module 111 and an available space calibration. The module 112, a data storage module 113 and a brand database 114 are stored, and a first algorithm A1 is stored. The available space calibration module 112 is respectively associated with the image processing module 111, a post-data storage module 113, and a brand database 114. The calibration server 11 performs the definition of the calibration block according to the first algorithm A1, and processes and stores the data of the Meta Data.

Please refer to FIG. 1 and FIG. 2 simultaneously. FIG. 2 illustrates a specific embodiment of the present invention. Algorithm flow chart. The definition of the calibration block by the calibration server 11 in accordance with the first algorithm A1, and the details of the operation of the Meta Data will be described below. The algorithm A1 includes steps S1 to S15. Among them, the first algorithm A1 is the definition of the calibration block automatically by the computer software and hardware. First, step S1 is performed: inputting a set of panoramic stereoscopic images. The image processing module 111 of the calibration server 11 obtains a set of panoramic stereoscopic images from the panoramic database 10, and the set of panoramic stereoscopic images includes a plurality of panoramic stereoscopic images, and according to the shooting time sequence, and the traveling direction when shooting. To arrange.

Then proceed to step S2: converting the first image into a fifth-order grayscale image. image The processing module 111 first converts the first image in the panoramic stereoscopic image group into a fifth-order grayscale image, so as to proceed to the next step S3: performing edge measurement and feature point calibration by using the MBB (Median Threshold Bitmap) algorithm. . The image processing method of the image processing module 111 is not limited to the fifth-order gray-scale processing described above, and those skilled in the art can replace it with other image processing methods without further violating the spirit of the present invention. After the image processing module 111 ends the image processing, The fifth-order grayscale image of the first image is transmitted to the available space calibration module 112 to proceed to step S3. The technical details of the MTB (Median Threshold Bitmap) algorithm should be well-known techniques, and the description is not repeated here. After the feature points are calibrated, step S4 can be performed: selecting a calibration block according to the calibration feature points. The calibration block is an area enclosed by the calibration feature points, which is expected to be merged with the advertisement content.

Then step S5 is performed: checking whether the calibration block is a color block or a graphic. If the result of the check is yes, proceed to step S6: set the calibration block to an available block, and give a post-set data and store it. Since the calibration block enclosed by the calibration feature points is not necessarily a positive polygon that can be attached to the advertisement content, it is checked. If the result of the check is YES, the available space calibration module 112 proceeds to step S6, sets the calibration block as an available block, and gives a set of available blocks (Mata Data), and then The data is stored in the post data storage module 113. The rear data (Mata Data) is the data describing the data, and the post data of the present invention includes the geographic location of the panoramic stereo image, the coordinate position of the calibration block in the panoramic stereo image, the size, and the calibration block. One of or a combination of spatial properties (Spatial Performance). Wherein, the spatial property is the geographic region to which the indicator block is located (for example, Taipei, Taiwan), the size of the pigment block (for example, 600×400 pixels), the background color (including but not limited to yellow, white, or red background), Ad-posting time, price required to attach an ad, and location information (including but not limited to restaurants, stations, hair salons, etc.).

If the result of the check is no, then proceed to step S14: check if the calibration block is an existing brand. At this time, the available space calibration module 112 compares with the current existing brand data stored in the brand database 114 to check whether the calibration block contains an existing brand that is currently known, and if the calibration block is If there is an existing brand, proceed to step S6 to calibrate the label. The block is set as an available block, and a set of available data (Meta Data) is given to the available block, and the post-set data is stored in the post-data storage module 113. If the calibration block does not contain an existing brand, then step S15 is performed to mark the calibration block as an unavailable block.

After the step S6 is performed, the image processing module 111 then performs the steps. S7: Input the next image and convert it to a 5th-order grayscale image. Then, step S8 is performed: edge measurement and feature point calibration are performed by using the MTB (Median Threshold Bitmap) algorithm. The details of steps S7 and S8 are as described in the previous paragraph, and are not described herein again. When the execution of step S8 is finished, the process proceeds to step S9: it is checked whether there is a new calibration block and is a color block or a graphic. If there is no new calibration block and is not a color block or a graphic, then step S10 is performed: the first image and the second image are compared by using a Projection Model (here, the next one mentioned above) Feature points within the image) to determine the calibration block available within the second image.

The above steps involve the following conditions, except for the first image and the second image. The image has the same and complete calibration block; or if the first image and the second image have complete calibration blocks, respectively, the complete advertisement content can be placed in the calibration block. However, if the feature point in the second image is more than the first image, and the calibration block surrounded by the feature points in the second image is the calibration block surrounded by the feature points in the first image. If only the calibration block area of the second image is larger than the calibration block of the first image, the area of the same advertisement content that can be placed in the calibration block of the second image will be larger than the calibration block of the first image. It is also possible to display the portion of the advertisement content, and it is necessary to consider the display ratio of the advertisement content seen from the perspective of the camera projection, or if there is a change in the angle of view between the first image and the second image (for example, camera steering). In this case, it is also necessary to consider the display ratio of the advertisement content seen by the camera projection angle.

After considering the foregoing situation and completing step S10, step S11 can be performed: Set the calibration block to an available block and store it after a set of data. Then step S12 is performed: checking if it is the last image. In step S12, it is checked whether the second image is the last image of the panoramic stereo image group, and if so, step S13 is performed to complete the calibration. If not, the process returns to step S7 and steps S7 to S12 are repeated until step S13 is completed.

And if it is checked in step S9 that there is a new calibration block and is a color block or a picture Form, proceed to step S14: check if the calibration block is an existing brand. At this time, the available space calibration module 112 compares with the current existing brand data stored in the brand database 114 to check whether the calibration block contains an existing brand that is currently known, and if the calibration block is If there is an existing brand, step S6 is performed, the calibration block is set as an available block, and a set of available data (Meta Data) is given, and the post-set data is stored in the subsequent data storage mode. Group 113. If the calibration block does not contain an existing brand, then step S15 is performed to mark the calibration block as an unavailable block.

The above description is based on the definition of the calibration block of the computer software and hardware, and Manage and save the details of the work of Mata Data. However, the present invention further has another second algorithm A2 that manually defines the calibration block to maintain a certain degree of definition of the block definition. The first algorithm A1 and the second algorithm A2 are simultaneously or alternatively stored in the calibration server 11. Referring to FIG. 3, FIG. 3 is a flowchart of an algorithm of another embodiment of the present invention. The step flow of the second algorithm A2 is simpler than the first algorithm A1. The process flow is as follows: First, step P1 is performed: inputting a set of panoramic stereo images. The image processing module 111 of the calibration server 11 obtains a set of panoramic stereoscopic images from the panoramic database 10, and the set of panoramic stereoscopic images includes a plurality of panoramic stereoscopic images, and is in accordance with the shooting time sequence and the shooting time. Arrange in the direction of travel.

Then proceed to step P2: input the first image and manually mark it manually A calibration block is determined, which is where the second algorithm A2 is different from the first algorithm A1, and the calibration block is defined manually. Subsequent steps P3 to P8 correspond to steps S2, S3 and S6 to S9 of the first algorithm A1, respectively. This specification is not described here. In step P8, if it is found that there is a new calibration block in the second image (here, the next image mentioned above) and is a color block or a graphic, then step P13 is performed: manual manual The mode is labeled as an available block. Then, step P10 is performed: the calibration block is set as an available block, and a post-set data is given and stored. Then proceed to step P11: check if it is the last image. In step P11, it is checked whether the second image is the last image of the panoramic stereo image group, and if so, step P12 is performed to complete the calibration. If not, the process returns to step P6 and steps P6 to P11 are repeated until step P12 is completed.

If it is checked in step P8 that there is no new calibration block and it is not a color block or a picture Form, proceed to step P9: using a camera perspective model (Projection Model) to compare feature points in the first image and the second image (here, the aforementioned next image) to determine the second image Available calibration blocks. The technical details of step P9 are the same as those of step S10, and details are not described herein again.

After completing step P9, step P10 can be performed: setting the calibration block to one The available blocks are given and given a post-set data for storage. Then proceed to step P11: check if it is the last image. In step P11, it is checked whether the second image is the last image of the panoramic stereo image group, and if so, step P12 is performed to complete the calibration. If not, the process returns to step P6 and steps P6 to P11 are repeated until step P12 is completed.

The above examples are intended to illustrate how the invention can be automated or manual. The process of stepping up the advertising content can be calibrated in the panoramic stereo image. Referring now to Figure 1, it will be explained how the present invention combines the needs of an advertiser with the present invention.

The advertisement submission platform 12 of the present invention is provided to an advertisement owner, for example, to attach A direct downstream customer of the advertisement, or a platform for the mid-marketer in the advertising industry, to collect and receive the demand for the advertisement. The aforementioned propagation requirements include one or a combination of layout size, spatial performance, play time, price range, number of plays, and play area required for the advertisement content. These propagation requirements are transmitted to the match server 13 and then by the match server 13 from the calibration server 11, or more specifically from the post data storage unit 113 of the calibration server 11, by the comparison propagation requirements. And post-design materials to find calibration blocks that meet the needs of advertising content. In addition, the match server 13 includes a match information update module 131. When the match server 13 finds the back data from the calibration server 11 that can match the propagation demand, the match information update module 131 Update the information of the back-up data that has been matched by the media, and update the information of the advertising owner to the back-up data that has been matched by the media to indicate which advertising owner the marked block has been used by the post-setting material. .

When the communication demand has been successfully combined with the post-designed information, the advertisement fusion server 14 The advertising content is fused to the calibration block that meets the advertising content distribution requirements. Finally, the advertisement content attached to the calibration block is played by the advertisement playing module 15 in the panoramic stereo image. Among them, there is more than one advertisement that can be attached to a calibration block, for example, advertisement A is played in a certain time interval (for example, AM 0900-PM 1800), and played in another time interval (for example, PM 1800-PM 2300). Advertisement B, and the advertisement C is played in another time interval (for example, PM 2300-AM 0900).

In summary, the present invention provides an immersive advertising communication system, from a full The panoramic stereo image is extracted from the scene database and processed by the image, and then the first algorithm is automatically used by the computer system using a calibration server, or the image is processed manually by the second algorithm. The calibration block for attaching the advertisement is calibrated, and the calibration block is described by a post-set data. After the advertisement submission platform receives an advertisement request from the advertisement provider to attach the advertisement content, the media server is asked to find the post-configuration data conforming to the communication requirement from the calibration server for mediation. The advertising content is merged with the calibration block by the advertisement fusion server, and played by the advertisement playing module.

Compared with the prior art, the implementation of the immersive advertising communication system proposed by the present invention The technology of embedding advertisements in panoramic stereoscopic images allows users to receive advertisement information while viewing or viewing a panoramic stereoscopic image through augmented reality without affecting the viewing field and providing a good browsing experience.

1‧‧‧Immersive Advertising Communication System

10‧‧‧ Panorama Database

11‧‧‧ Calibration server

111‧‧‧Image Processing Module

112‧‧‧Available space calibration module

113‧‧‧After data storage module

114‧‧‧ Brand Database

12‧‧‧Advertising Submission Platform

13‧‧‧ Matching server

131‧‧‧ Matching Information Update Module

14‧‧‧Advertising Fusion Server

15‧‧‧Advertising Module

Claims (10)

An immersive advertisement communication system for merging an advertisement content into a panoramic stereoscopic image, the immersive advertisement distribution system comprising: a calibration server for calibrating the advertisement content in the panoramic stereo image a calibration block, and the post-setting data is stored in the calibration block to store the post-set data; an advertisement submission platform for receiving an advertisement request of the advertisement content proposed by the advertisement owner; a mediation server And connecting to the calibration server and the advertisement submission platform, when the distribution request is received from the advertisement submission platform, searching for the calibration block that meets the propagation requirement from the calibration server; and an advertisement fusion server The advertisement fusion server is connected to the mediation server for fusing the advertisement content to the calibration block. The immersive advertisement communication system according to claim 1, further comprising a panoramic database connected to the calibration server and storing the panoramic stereo image. The immersive advertisement propagation system of claim 1, wherein the post-data includes a geographic location of the panoramic stereoscopic image, a coordinate position, a size, and a calibration area of the calibration block in the panoramic stereoscopic image. One or a combination of the spatial properties of the block. The immersive advertisement communication system according to claim 1, wherein the communication requirement includes a layout size, a spatial property, a play time, a price range, a play quantity, and a play area of the advertisement content. One or a combination thereof. An immersive advertising communication system as described in claim 1, wherein the calibration server The way to calibrate the calibration block includes automatic system identification and manual manual identification. The immersive advertisement propagation system of claim 1, wherein the calibration server comprises an image processing module for converting the panoramic stereo image into a fifth-order grayscale image. The immersive advertisement communication system of claim 6, wherein the calibration server includes a usable space calibration module for calibrating the calibration area on the fifth-order grayscale image to which the advertisement content can be affixed. Piece. The immersive advertisement communication system of claim 7, wherein the calibration server comprises a post-data storage unit for storing the post-set data after the post-setting data is defined for the calibration block. The immersive advertisement distribution system of claim 1, further comprising an advertisement playing module, wherein the advertisement playing module is connected to the advertisement fusion server for attaching the advertisement to the calibration block The content is played in the panoramic stereo image. The immersive advertisement communication system of claim 1, wherein the mediation server includes a mediation information update module, and the mediation information is used after the calibration block is combined with the propagation demand. The update module marks and updates a message of the advertisement owner to the post-set data.