KR20230090899A - Virtual advertisement insertion system using area and object recognition of broadcast image and method thereof - Google Patents

Abstract

The present invention relates to a virtual advertisement insertion system and method for inserting virtual advertisements into broadcast images and, more specifically, to a virtual advertisement insertion system and method using the area and object recognition of a broadcast image that inserts a virtual advertisement into the broadcast image provided online and provides it to a viewer, recognizes an object of the broadcast image, overlays and inserts the virtual advertisement in a similar area whose size corresponds to the size of the overlay area of the virtual advertisement to be inserted to the object and a background, tracks the movement of the object, and inserts the virtual advertisement by moving a virtual advertisement insertion position within the similar area according to the movement of the object. The system includes: an advertisement programming server; and a virtual advertisement server.

Description

Virtual advertisement insertion system using area and object recognition of broadcast image and method thereof}

The present invention relates to a virtual advertisement insertion system and method for inserting a virtual advertisement into a broadcast video, and more particularly, to insert a virtual advertisement into a broadcast video and provide it to viewers, recognizing objects in the broadcast video, and among the objects and the background. A virtual advertisement is overlaid and inserted in a similar area having a size corresponding to the size of the overlay area of the virtual advertisement to be inserted, and the motion of the object is tracked to move the virtual advertisement insertion position within the similar area according to the motion of the object. It relates to a system and method for inserting a virtual advertisement using region and object recognition of a broadcast image into which a .

In general, advertisements are divided into print media and propagation media advertisements, and are becoming more diverse, such as installation media advertisements, traffic advertisements, and Internet advertisements.

In particular, television advertisements of media advertisements are video-based advertisements, and their effects are good, so advertisers are willing to spend a lot of money on them.

Television commercials produce commercials at a high cost, and then organize and provide commercials during the airing of each broadcasting company's broadcasting programs or between broadcasting programs through over-the-air broadcasting. There is a problem with high advertising costs.

In order to minimize the advertisement time limitation problem and increase the broadcasting time of television commercials, a virtual television advertisement method has been developed to insert virtual advertisements (hereinafter referred to as "virtual advertisements") into a part of the broadcast image during the broadcast of a certain broadcast program. It is being served along with regular television commercials.

A conventional virtual advertisement insertion system inserts a virtual advertisement by inserting a virtual advertisement into a part of a video during a broadcast program by receiving a designated position to insert a virtual advertisement in a pre-organized part from a broadcast manager who monitors in real time, or inserting a virtual advertisement in the case of a recorded broadcast program. It is inserted in the corresponding position in advance before the broadcast program video is transmitted.

As described above, in the case of a real-time broadcasting program such as a live broadcast, the conventional virtual advertisement insertion system has cumbersome and inconvenient problems because the broadcasting manager must continuously monitor the corresponding broadcasting program image.

In addition, since the conventional virtual advertisement is overlaid and displayed at a position once inserted for a preset advertisement programming time, it covers the object and background of the video, which may reduce the enjoyment of the broadcast program or cause inconvenience to the viewer. .

In addition, as the Internet, wireless communication, and mobile terminal technology develop rapidly, a ubiquitous environment in which communication can be performed by accessing an information communication network such as the Internet anytime and anywhere is established, the demand for Internet advertisement is increasing, but the conventional virtual advertisement The insertion system has a problem in that it is not applied to Internet broadcasting images.

Republic of Korea Patent Publication No. 10-2000-0054304 (published on September 5, 2000)

Therefore, an object of the present invention is to insert a virtual advertisement into a broadcast video and provide it to viewers, recognize an object of the broadcast video, and place a virtual advertisement in a similar area having a size corresponding to the size of the overlay area of the virtual advertisement to be inserted among the objects and backgrounds. A system and method for inserting a virtual advertisement using region and object recognition of a broadcast video in which a virtual advertisement is inserted by overlaying and inserting a virtual advertisement, and inserting a virtual advertisement by moving a virtual advertisement insertion position within the similar area according to the motion of the object by tracking the motion of the object is in providing

In order to achieve the above object, a system for inserting virtual advertisements using region and object recognition of a broadcast image according to the present invention: acquires broadcast programming information, advertisement programming condition information, and virtual advertisements; an advertisement scheduling server which determines a broadcast program to insert a virtual advertisement among broadcast programming information, generates advertisement scheduling information, and transmits advertisement management information including the advertisement scheduling information and the acquired virtual advertisement; and receives the advertisement operation information from the advertisement scheduling server, separates and stores advertisement scheduling information and virtual advertisements, and transmits the broadcast programming information inputted from at least one broadcasting company encoder to a broadcast program according to the advertisement scheduling of the advertisement scheduling information. and a virtual advertisement server overlaying and inserting a virtual advertisement into a virtual advertisement insertion section of the advertisement programming information of the corresponding broadcast video, and then transmitting the virtual advertisement to the user terminal unit.

The advertisement scheduling server includes an advertisement storage unit including an advertisement scheduling DB for storing broadcast schedule information and advertisement schedule information and an advertisement DB for storing a plurality of virtual advertisements and advertisement schedule condition information corresponding to each virtual advertisement; an advertisement communication unit that connects to a wired/wireless data communication network and performs data communication with devices connected to the wired/wireless data communication network; an advertisement encoding unit that receives virtual advertisement and format information, encodes the virtual advertisement into a video format of the format information, and outputs the encoded video; and obtaining the broadcast programming information and virtual advertisements, storing them in an advertisement programming DB and an advertisement DB of the advertisement storage unit, respectively, determining a broadcast program to insert a virtual advertisement among broadcast programs of the broadcast programming information, and generating advertisement scheduling information. and an advertisement scheduling control unit that transmits the advertisement scheduling information and advertisement operation information including the virtual advertisement encoded by the advertisement encoding unit to the virtual advertisement server through the advertisement communication unit.

The advertisement programming control unit may include: a broadcasting schedule information acquisition unit for obtaining broadcast schedule information from a broadcasting company through the advertisement communication unit and storing the obtained broadcast schedule information in the advertisement schedule DB; an advertisement acquisition unit receiving virtual advertisements and advertisement scheduling condition information from either an advertiser terminal unit or a manager terminal unit through the advertisement communication unit and storing them in the advertisement DB; an advertisement conversion unit outputting format information corresponding to the virtual advertisement stored in the advertisement DB and a broadcast video format of a broadcasting company into which the virtual advertisement is to be inserted to the advertisement encoding unit, receiving the converted virtual advertisement and storing the virtual advertisement in an advertisement DB; and an advertisement operation information provider generating advertisement operation information including the advertisement organization information and the converted virtual advertisement and transmitting the generated advertisement operation information to a virtual advertisement server through the advertisement communication unit.

The virtual advertisement server may include a virtual advertisement storage unit including an advertisement schedule DB for storing advertisement schedule information and a virtual advertisement DB for storing virtual advertisements for each of a plurality of broadcasting video formats; a server communication unit that connects to a wired/wireless data communication network and performs data communication with devices connected to the wired/wireless data communication network; and receives the advertisement management information from the advertisement scheduling server, separates the advertisement scheduling information from the virtual advertisement, and stores the virtual advertisement in the virtual advertisement storage unit's advertisement scheduling DB and virtual advertisement DB, respectively, and virtual advertisements according to the advertisement scheduling of the advertisement scheduling information. to a similar region of the broadcast image corresponding to the size of the overlay region of the virtual advertisement in the virtual advertisement insertion section of the advertisement schedule information of the corresponding broadcast video among the broadcast images of the broadcast program of the broadcast programming information input from at least one broadcaster encoder. It is characterized in that it includes a virtual advertisement control unit for transmitting to a user terminal unit after overlaying and inserting the advertisement.

The virtual advertisement control unit receives the advertisement operation information from the advertisement scheduling server, detects advertisement scheduling information and virtual advertisements from the advertisement management information, and stores the advertisements in the advertisement scheduling DB and virtual advertisement DB of the virtual advertisement storage unit, respectively. operation information acquisition unit; a broadcast reception processing unit for receiving and outputting a broadcast image from a broadcaster encoder of a specific broadcaster when a broadcast image request event for a broadcast program of a specific broadcaster occurs; Among the broadcast images for the broadcast program of the broadcasting program information of the broadcasting company output from the broadcast reception processing unit, a similar region of the broadcast image corresponding to the size of the overlay region of the virtual advertisement in the virtual advertisement insertion section of the advertisement schedule information of the corresponding broadcast image an insertion area detection unit that detects; a virtual advertisement insertion unit overlaying the virtual advertisement on the similar area detected by the insertion area detection unit and inserting the virtual advertisement; and a video transmission unit that transmits the broadcast video into which the virtual advertisement is inserted to a corresponding user terminal unit.

The insertion area detection unit applies an object detection artificial intelligence model, and an object detection unit detecting an object in the broadcast video of the virtual advertisement insertion section through the object detection artificial intelligence model; a similar region spatial detector detecting at least one similar region having a predetermined size or more in the broadcasting image of the virtual advertisement insertion section; and determining an insertion position for determining a similar region corresponding to the size of an overlay region of the virtual advertisement among one or more similar regions of the detected object and background as a virtual advertisement insertion position, and outputting the determined virtual advertisement insertion position information to a virtual advertisement insertion unit. The virtual advertisement inserting unit inserts the virtual advertisement into the similar area in the broadcast video corresponding to the virtual advertisement insertion location information.

The insertion area detection unit may further include an object location tracking unit that tracks the location of the detected object and outputs object location information to the virtual advertisement insertion unit, wherein the virtual advertisement insertion unit is configured to detect objects corresponding to the locations of the detected objects. It is characterized in that the virtual advertisement is inserted by overlaying the virtual advertisement in the similar area so as not to overlap with the advertisement.

The insertion location determiner may determine the similar area of the object as the similar area for insertion of the virtual advertisement if there exists an entity having a similar area corresponding to the size of the overlay area of the virtual advertisement among the detected objects.

The insertion position determination unit, if there is no similar area larger than the size of the overlay area of the virtual advertisement, selects a similar area having the largest area, provides size information of the selected similar area to the virtual advertisement insertion unit, and The insertion unit adjusts the size of the overlay area (virtual advertisement) of the virtual advertisement to be smaller than the size of the similar area when the size information of the similar area is input from the insertion position determination unit, and then overlays and inserts the size of the similar area. do.

The insertion position determining unit determines a similar area corresponding to the size of the virtual advertisement overlay area as the virtual advertisement insertion position, and determines a similar area closest to an object corresponding to the advertising content of the virtual advertisement.

In order to achieve the above object, a method for inserting a virtual advertisement using region and object recognition of a broadcast video according to the present invention: an advertisement scheduling server obtains broadcast scheduling information, advertisement scheduling condition information, and virtual advertisement, and the advertisement scheduling condition An advertisement scheduling process of determining a broadcast program to insert a virtual advertisement among broadcast programs of the broadcast programming information according to information, generating advertisement scheduling information, and then transmitting advertisement management information including the advertisement scheduling information and the acquired virtual advertisement. ; and a virtual advertisement server receives the advertisement operation information from the advertisement scheduling server, separates and stores advertisement scheduling information and virtual advertisements, and stores the broadcasting schedule information input from at least one broadcasting company encoder according to the advertisement schedule of the advertisement schedule information. It is characterized by including a virtual advertisement providing process of overlaying and inserting a virtual advertisement into a virtual advertisement insertion section of advertisement programming information of the broadcasting video of the broadcasting program, and then transmitting the virtual advertisement to a user terminal unit.

The advertisement programming process may include a broadcast schedule information acquisition step in which the advertisement schedule controller of the advertisement schedule server acquires broadcast schedule information from a broadcasting company through a broadcast schedule information acquisition unit and stores the broadcast schedule information in an advertisement schedule DB; an advertisement acquisition step in which the advertisement programming control unit receives virtual advertisements from an advertiser terminal unit and a manager terminal unit through an advertisement acquisition unit and stores them in an advertisement DB; The advertisement programming control unit outputs the virtual advertisement stored in the advertisement DB through the advertisement conversion unit and the format information corresponding to the broadcast video format of the broadcaster to insert the virtual advertisement to the advertisement encoding unit to output the virtual advertisement corresponding to the broadcast video format. An advertisement conversion step of storing the virtual advertisement converted into a format in an advertisement DB; and an advertisement operation information providing step of generating, by the advertisement scheduling control unit, advertisement management information including the advertisement scheduling information and the converted virtual advertisement through an advertisement operation information providing unit, and then transmitting the generated advertisement operation information to a virtual advertisement server through an advertisement communication unit. It is characterized by doing.

In the virtual advertisement providing process, the virtual advertisement control unit of the virtual advertisement server receives the advertisement operation information from the advertisement organizing server through the advertisement operation information acquisition unit, detects advertisement scheduling information and virtual advertisements from the advertisement operation information, and then detects the virtual advertisement. obtaining advertisement operation information stored in an advertisement programming DB and a virtual advertisement DB of an advertisement storage unit; a broadcast reception processing step in which the virtual advertisement control unit receives and outputs a broadcast image from a broadcaster encoder of a specific broadcaster when a broadcast image request event for a broadcast program of a specific broadcaster occurs through the broadcast reception processing unit; The overlay area of the virtual advertisement in the virtual advertisement insertion section of the advertisement schedule information of the corresponding broadcast video among the broadcast images of the broadcast program of the broadcast program information of the broadcasting company output from the real-time broadcast receiving processing unit through the insertion area detector by the virtual advertisement control unit. an insertion region detection step of detecting a similar region of the broadcast image corresponding to the size; a virtual advertisement insertion step in which the virtual advertisement control unit overlays and inserts the virtual advertisement into the similar area detected by the insertion area detection unit through the virtual advertisement insertion unit; and an advertisement insertion video transmission step in which the virtual advertisement control unit transmits the broadcasting video in which the virtual advertisement is inserted through a video transmission unit to a corresponding user terminal unit.

The insertion area detection step may include an object detection step of detecting an object in a broadcast image of the virtual advertisement insertion section through an object detection unit to which the object detection artificial intelligence model is applied by the insertion area detection unit of the virtual advertisement control unit; a similar area space detection step in which the insertion area detection unit detects at least one similar area having a predetermined size or more in the broadcast image of the virtual advertisement insertion section through the similar area space detection unit; and the insertion area detection unit determines, as a virtual advertisement insertion position, a similar area corresponding to the size of an overlay area of the virtual advertisement among one or more similar areas of the detected object and background through the insertion location determination unit, and the determined virtual advertisement insertion location information. and an insertion position determining step of outputting to a virtual advertisement inserting unit, wherein in the virtual advertisement inserting step, the virtual advertisement inserting unit inserts the virtual advertisement into the similar region in the broadcast video corresponding to the virtual advertisement insertion position information. to be

The insertion area detection step may further include an object location tracking step in which the insertion area detection unit tracks the location of the detected object through an object location tracking unit and outputs object location information to the virtual advertisement insertion unit, wherein the virtual advertisement is inserted. In the step, the virtual advertisement insertion unit overlays and inserts the virtual advertisement into the similar area so that the virtual advertisement does not overlap with objects corresponding to the positions of the detected objects.

In the insertion location determination step, if there exists an object having a similar area corresponding to the size of the overlay area of the virtual advertisement among the objects detected by the insertion location determining unit, the similar area of the object is determined as a similar area to be inserted into the virtual advertisement. to be

The present invention automatically detects an object and identifies a similar area in a section video corresponding to preset advertisement scheduling information of a real-time broadcast video, and avoids the object in the similar area corresponding to the size of the overlay area of a virtual advertisement to be inserted. Since the virtual advertisement is displayed, there is an effect of providing the virtual advertisement without affecting the screen displayed in the broadcasting video as much as possible.

In addition, since the present invention determines a virtual advertisement insertion area according to automatic recognition of similar areas and objects according to advertisement programming information and inserts a virtual advertisement, various virtual advertisements can be efficiently displayed in broadcasting images for multiple broadcasting companies provided over the Internet. There is an effect that can be freely inserted and provided.

In addition, since the present invention can display a virtual advertisement corresponding to an object corresponding to advertisement content, there is an effect of improving advertisement efficiency.

1 is a diagram showing the configuration of a communication system including a system for inserting virtual advertisements using region and object recognition of a broadcast image according to the present invention.
2 is a diagram showing a detailed configuration of an advertisement organizing server of a virtual advertisement insertion system using region and object recognition of a broadcast video according to the present invention.
3 is a diagram showing a detailed configuration of a virtual advertisement server of a virtual advertisement insertion system using region and object recognition of a broadcast video according to the present invention.
4 is a diagram showing the detailed configuration of the insertion area detection unit of the virtual advertisement server in the virtual advertisement insertion system according to the present invention.
5 is a flowchart illustrating a virtual advertisement insertion method using region and object recognition of a broadcast video according to the present invention.
6 is a flowchart illustrating a method for detecting a virtual advertisement insertion area among virtual advertisement insertion methods using region and object recognition of a broadcast video according to the present invention.

Hereinafter, with reference to the accompanying drawings, the configuration and operation of a virtual advertisement insertion system using region and object recognition of a broadcast video according to the present invention will be described in detail, and a virtual advertisement insertion area detection method and virtual advertisement insertion method in the system will be described. do.

1 is a diagram showing the configuration of a communication system including a system for inserting virtual advertisements using region and object recognition of a broadcast image according to the present invention.

A virtual advertisement insertion system 30 using region and object recognition of a broadcast image according to the present invention is a user terminal unit 10, a broadcaster encoder 20, an advertiser terminal unit 40, and a manager through a wired and wireless data communication network 1 It is connected to the terminal unit 50 and the like to perform mutual data communication.

The wired/wireless data communication network 1 includes an internet network including a WiFi network and a local area network (LAN), a mobile communication network including 3G, 4G, and 5G, and WiBro It may be a data communication network to which one or more of the networks are coupled.

The user terminal unit 10 selects a broadcasting program of an arbitrary broadcasting company, receives and displays the corresponding broadcasting image, and receives and displays the broadcasting image into which the virtual advertisement is inserted through the virtual advertisement insertion system 30. The user terminal unit 100 may be a computer terminal 11 such as a desktop computer, a personal computer, or a laptop computer or a mobile terminal 12 such as a smart phone or a smart pad.

The broadcasting company encoder 20 is configured for each broadcasting company and transmits the broadcasting image according to the broadcasting program of the broadcasting organization information to the virtual advertisement insertion system 30 according to the Real Time Message Protocol (RTMP) through the wired/wireless data communication network. do. The broadcasting company encoder 20 will provide the virtual advertisement insertion system 30 with access information of the user terminal unit 10 that has selected its own broadcasting company and broadcasting program.

The advertiser terminal unit 40 may provide virtual advertisement request information including advertisement scheduling condition information of the virtual advertisement to the virtual advertisement insertion system 30 through the wired/wireless data communication network 1 . The advertisement scheduling condition information may include a broadcast program in which a virtual advertisement is to be inserted, information about a virtual advertisement insertion section of the corresponding broadcast program, and advertisement content. The content of the advertisement will include detailed information such as the type of virtual advertisement and product information according to the type.

The advertiser terminal unit 40 may provide the created virtual advertisement to the virtual advertisement insertion system 30 through the wired/wireless data communication network 1 .

The virtual advertisement insertion system 30 includes the advertisement scheduling server 100 and the virtual advertisement server 200, and obtains broadcast scheduling information, advertisement scheduling condition information, and virtual advertisements for at least one or more broadcasting stations, and obtains the advertisement scheduling conditions. After the virtual advertisement is inserted into a broadcast image for a corresponding broadcast program of broadcast programming information according to information, the broadcast image for the broadcast program is provided to the user terminal unit 10 that requested the broadcasting program. Preferably, the advertisement scheduling server 100 and the virtual advertisement server 200 are connected through a local network of the wired/wireless data communication network 1 . Also, the advertisement scheduling server 100 and the virtual advertisement server 200 may be configured in one device or may be configured in separate devices.

Specifically, the advertisement programming server 100 obtains broadcast programming information, advertisement programming condition information, and virtual advertisements, and determines a broadcast program to insert a virtual advertisement among broadcast programs of the broadcast programming information based on the advertisement programming condition information, After generating the advertisement scheduling information, the advertisement operation information including the advertisement scheduling information and the obtained virtual advertisement is transmitted to the virtual advertisement server 200 . The virtual advertisement may be obtained from the advertiser terminal unit 40 or directly through the manager terminal unit 50 of the system manager.

The virtual advertisement server 200 receives the advertisement management information from the advertisement scheduling server 100, separates and stores advertisement scheduling information and virtual advertisements, and distributes virtual advertisements to at least one broadcaster according to the advertisement scheduling of the advertisement scheduling information. After overlaying and inserting the virtual advertisement insertion section of the advertisement scheduling information of the corresponding broadcasting video among the broadcasting images for the broadcasting program of the broadcasting programming information input from the encoder 20, the user terminal unit 10 that requested the broadcasting video send. The access information for the user terminal unit 10 may be input from the broadcasting company encoder 20 or obtained from a separate broadcasting company server (not shown) that provides a means for selecting broadcast images.

2 is a diagram showing a detailed configuration of an advertisement organizing server of a virtual advertisement insertion system using region and object recognition of a broadcast video according to the present invention. The detailed configuration and operation of the advertisement scheduling server 100 will be described with reference to FIG. 2 .

The advertisement scheduling server 100 includes an advertisement storage unit 110 , an advertisement communication unit 20 , an advertisement encoding unit 130 and an advertisement scheduling control unit 140 .

The advertisement storage unit 110 includes a program area for storing a control program for controlling the overall operation of the advertisement scheduling server 100 according to the present invention, a temporary area for temporarily storing data generated during execution of the control program, and the control program. It includes a data area for semi-permanently storing data necessary for the program and data generated during the execution of the control program. According to the present invention, an advertisement scheduling DB 111 and an advertisement DB 112 will be configured in the data area.

The advertisement programming DB 111 stores broadcast programming information for each broadcasting company and advertisement programming information synchronized with the broadcasting programming information for each broadcasting company, and stores virtual advertisement identification information for the advertisement programming information.

The advertisement DB 112 stores a plurality of virtual advertisements, virtual advertisement identification information of each virtual advertisement, and advertisement scheduling condition information. The virtual advertisement may include a virtual advertisement provided as it is received from the advertiser and a converted virtual advertisement converted into a broadcast image format of a broadcasting program to be provided by a broadcasting company. If the video format of the provided virtual advertisement and the format of the broadcast video are the same, the provided virtual advertisement will become a converted virtual advertisement.

The advertisement communication unit 120 includes a user terminal unit 10, a broadcaster encoder 20, and an advertiser terminal unit 40 that are connected to the wired and wireless data communication network 1 by either wire or wireless and access the wired or wireless data communication network 1. Devices such as the manager terminal unit 50 and the virtual advertisement server 200 and the advertisement scheduling control unit 140 can perform data communication with each other.

The advertisement encoding unit 130 encodes the virtual advertisement input from the advertisement scheduling control unit 140 into a format corresponding to the video format information (control data) input from the advertisement scheduling control unit 140, and then the advertisement scheduling control unit 140 ) is provided.

The advertisement encoding unit 130 may be configured as a separate server.

The advertisement programming control unit 140 includes a broadcast programming information acquisition unit 141, an advertisement acquisition unit 142, an advertisement conversion unit 143, and an advertisement management information providing unit 144, and an advertisement scheduling server according to the present invention ( 100) controls the overall operation.

The broadcasting schedule information acquisition unit 141 obtains broadcast schedule information from a broadcasting company, the manager terminal unit 50 of a system manager, etc. through the advertisement communication unit 120 and stores it in the advertisement schedule DB 111 .

The advertisement acquisition unit 142 receives advertisement scheduling condition information, virtual advertisements, and the virtual advertisements from any one of the advertiser terminal unit 40 of the advertiser and the manager terminal unit 50 of the system manager through the advertisement communication unit 120. Virtual advertisement information is received and stored in the advertisement DB 112 . The virtual advertisement information includes meta information, which is additional information about the virtual advertisement, and to the meta information, homepage lending URL, information for collecting statistics on the number of viewers, and the like may be added.

The advertisement conversion unit 143 outputs format information about the format of a broadcast video of a broadcasting company into which the virtual advertisement is to be inserted according to the virtual advertisement and advertisement programming information stored in the advertisement DB 112 to the advertisement encoding unit 130 and , the converted virtual advertisement is received and stored in the advertisement DB 112 .

The advertisement operation information provider 144 generates advertisement operation information including the advertisement schedule information stored in the advertisement schedule DB 111 and the converted virtual advertisement stored in the advertisement DB 112, and the virtual advertisement server 200 ) is sent to

Advertisement scheduling information and virtual advertisements transmitted by the advertisement management information providing unit 144 may generate and transmit advertisement management information including entire advertisement scheduling information and virtual advertisements thereof, or advertisements added to previous advertisement management information. It may be possible to transmit only advertising operation information including only programming information and virtual advertisements.

3 is a diagram showing a detailed configuration of a virtual advertisement server of a virtual advertisement insertion system using region and object recognition of a broadcast video according to the present invention.

Referring to FIG. 3 , the virtual advertisement server 200 includes a virtual advertisement storage unit 210 , a server communication unit 220 and a virtual advertisement control unit 230 .

The virtual advertisement storage unit 210 includes a program area for storing a control program for controlling the overall operation of the virtual advertisement server 200 according to the present invention, a temporary area for temporarily storing data generated during execution of the control program, and the control program. It includes a data area for semi-permanently storing data required for execution and data generated during the execution of the control program. According to the present invention, an advertisement scheduling DB 211 and a virtual advertisement DB 212 will be configured in the data area.

The advertisement scheduling DB 211 stores advertisement scheduling information.

The virtual advertisement DB 212 stores a plurality of virtual advertisement identification information and virtual advertisements corresponding to the virtual advertisement identification information.

The server communication unit 220 includes a user terminal unit 10, a broadcaster encoder 20, and an advertiser terminal unit 40 that are connected to the wired and wireless data communication network 1 by either wire or wireless and access the wired or wireless data communication network 1. Devices such as the manager terminal unit 50 and the advertisement scheduling server 100 and the virtual advertisement control unit can perform data communication with each other.

The virtual advertisement controller 230 includes an advertisement operation information acquisition unit 231, a broadcast reception processing unit 232, an insertion area detection unit 233, a virtual advertisement insertion unit 234, and an image transmission unit 235, The overall operation of the virtual advertisement server 200 according to the above is controlled.

The advertisement operation information acquisition unit 231 receives the advertisement operation information from the advertisement scheduling server 100, detects advertisement scheduling information and virtual advertisement (including virtual advertisement identification information) from the advertisement operation information, and detects the virtual advertisement. It is stored in each of the advertisement schedule DB 211 and the virtual advertisement DB 212 of the storage unit 200 .

When a broadcast video request event for a broadcast program of a specific broadcaster occurs, the broadcast receiving processing unit 232 receives a broadcast video from the broadcaster encoder 20 of the corresponding broadcaster through the server communication unit 220 and sends it to the insertion area detection unit 233. print out

The insertion area detection unit 233 refers to the advertisement schedule information of the advertisement schedule DB 211 for the broadcast video of the broadcast program received from the broadcast reception processing unit 232, and the virtual advertisement non-insertion section and virtual advertisement where virtual advertisements are not overlaid. divides the virtual advertisement insertion section in which is overlaid, and in the virtual advertisement non-insertion section, the broadcast video is transmitted to the user terminal 10 that requested the broadcast through the server communication unit 220 as it is through the video transmission unit 235, , In a virtual advertisement insertion section in which a virtual advertisement is inserted according to the advertisement scheduling information, after detecting a similar area of the broadcast image corresponding to the size of the overlay area of the virtual advertisement, the virtual advertisement insertion unit ( 234) is output.

The virtual advertisement insertion unit 234 overlays the virtual advertisement on the similar area detected by the insertion area detection unit 233 and inserts the virtual advertisement.

The video transmission unit 235 transmits the broadcast video input from the broadcast reception processing unit 232 and the virtual advertisement insertion unit 234 to the user terminal unit 10 that has requested it.

4 is a diagram showing the detailed configuration of the insertion area detection unit of the virtual advertisement server in the virtual advertisement insertion system according to the present invention. A detailed configuration and operation of the insertion area detection unit 233 will be described with reference to FIG. 4 .

The insertion area detection unit 233 includes an object detection unit 241, a similar area space detection unit 242, and an insertion location determining unit 244, but may further include an object location tracking unit 243 according to an embodiment. .

The object detection unit 241 has an object detection artificial intelligence model learned for a plurality of various objects, detects objects present in an input broadcasting image through the object detection artificial intelligence model, and converts the broadcasting image into a background and It is divided into objects, and the type and location information of the detected object and background information are output. The location information may be coordinate information of a bounding box of the detected object, and the background information may be information about a part excluding the object.

The similar area space detection unit 242 receives type and location information of the detected object and background information from the object detection unit 241, detects at least one similar area from the object and background of the input broadcasting image, and detects the similar area. Similar region information for is output to the insertion position determination unit 244. The similar area is an area of a certain size or larger having the same pattern and color, and may be a background or an area on an object. In addition, the similar area information may be coordinate information of a bounding box forming a similar area, and the shape of the bounding box may be a triangle, a rectangle, a circle, a polygon, etc., but a rectangle is preferable. The similar area boundary box may be configured in any shape, but it is preferable to have a rectangular shape including the similar area as much as possible in order to insert a virtual advertisement.

The insertion position determination unit 244 receives similar area information about one or more similar areas detected from the similar area space detection unit 242 and receives information from the advertisement operation information acquisition unit 231 included in the advertisement scheduling condition information of the advertisement management information. Upon receiving virtual advertisement overlay area size (ratio) information, a similar area having a size corresponding to the size of the virtual advertisement overlay area among the similar areas of the similar area information is determined as a virtual advertisement insertion position, and the virtual advertisement insertion unit 234 determines Output similar area information for similar areas.

In addition, if there is no similarity area corresponding to the size of the virtual advertisement overlay area, the insertion position determining unit 244 selects the largest similarity area among the similarity areas and transmits similarity area information for the selected similarity area to the virtual advertisement insertion unit. will output as (234).

In addition, the insertion position determination unit 244 receives the type and location information of the object from the object detection unit 241 and receives the advertisement content included in the advertisement organization condition information from the advertisement operation information acquisition unit 231, so that the advertisement If there is a similar area corresponding to the size of the virtual advertisement overlay area in the object corresponding to the content, the similar area is first selected and output, and if there is no similar area corresponding to the size of the virtual advertisement overlay area in the object , It may be configured to select and output a similar area closest to the object corresponding to the advertisement content information.

In addition, the insertion position determiner 244 may be configured to select and output a similar region closest to the set position when a preset position (eg, lower right, lower left, center, etc. of a broadcast image) is determined.

The object position tracking unit 243 tracks the changed position of each of the objects detected by the object detection unit 241 and outputs it to the virtual advertisement insertion unit 234 . Then, the virtual advertisement insertion unit 234 displays the virtual advertisement in the determined similar area, but if an object outside the similar area enters the similar area and the size of the similar area is maintained, the virtual advertisement is continuously overlaid and inserted into the similar area. and, if the size is not maintained, requesting the insertion position determining unit 244 to reselect the similar region.

In addition, when the similar area to which the virtual advertisement is to be inserted is determined, the virtual advertisement insertion unit 243 continuously inserts the virtual advertisement into the initially determined position of the similar area (it does not matter if it is not the similar area thereafter) regardless of an intrusion of an object. may be configured to do so.

5 is a flowchart illustrating a virtual advertisement insertion method using region and object recognition of a broadcast video according to the present invention.

Referring to FIG. 5 , the advertisement scheduling server 100 obtains programming information for each broadcasting company and stores it in the advertisement scheduling DB 111 (S111).

The advertisement scheduling server 100 monitors whether virtual advertisements and advertisement scheduling condition information are obtained from either the advertiser terminal unit 40 or the manager terminal unit 50 (S113).

When virtual advertisements and advertisement scheduling condition information are acquired, the advertisement scheduling server 100 organizes virtual advertisements into broadcast programs for each broadcasting company in response to the broadcasting scheduling information and advertisement scheduling condition information, and generates advertisement scheduling information according to the virtual advertisement programming. After that, it is stored in the advertisement schedule DB 111 (S115).

The advertisement scheduling server 100 converts the video to correspond to the video format of the broadcasting company to provide the virtual advertisement, and then stores it in the advertisement DB 112 (S117).

When the virtual advertisement conversion according to the advertisement scheduling information and the virtual advertisement programming is completed, the advertisement scheduling server 100 generates advertisement operation information including the advertisement scheduling information and the converted virtual advertisement (S119), and then the virtual advertisement server 200 ) is provided (S120).

When the advertisement management information is received from the advertisement organization server 100, the virtual advertisement server 200 separates the advertisement organization information and the virtual advertisement from the received advertisement management information and stores them in the advertisement organization DB 211 and the virtual advertisement DB 212, respectively. Save (S121).

When a broadcast video request event occurs, the broadcasting company encoder 20 loads the broadcast video requested by the broadcast video request event (S123) and transmits it to the virtual advertisement server 200 (S125). The broadcasting video request event may be generated according to a broadcasting schedule of a broadcasting company or may be generated by a request for the broadcasting video by an arbitrary viewer, that is, a user. Preferably, the broadcast video is transmitted to the virtual advertisement server 200 through Real Time Message Protocol (RTMP).

After receiving the advertisement operation information, the virtual advertisement server 200 monitors whether a broadcast video is received from the broadcasting company encoder 20 (S127), and when the broadcast video is received, refers to the advertisement scheduling information to determine whether the broadcast video is organized in the received broadcast video. It is determined whether a virtual advertisement exists (S129).

If the organized virtual advertisement exists, the virtual advertisement server 200 transmits the broadcasting video in real time through the wired/wireless data communication network 1, detects the advertisement insertion position, and determines the virtual advertisement insertion similarity area in the broadcasting video (S131).

When the similar area is determined, the virtual advertisement server 200 overlays and inserts the virtual advertisement on the determined similar area of the broadcast video in the virtual advertisement insertion section according to the advertisement programming information of the broadcast video (S133).

When the virtual advertisement is inserted, the virtual advertisement server 200 transmits the broadcast video with the virtual advertisement inserted to the user terminal units 10 (S135).

6 is a flowchart illustrating a method for detecting a virtual advertisement insertion area among virtual advertisement insertion methods using region and object recognition of a broadcast video according to the present invention.

Referring to FIG. 6 , the virtual advertisement control unit 230 of the virtual advertisement server 200 detects the insertion position of the virtual advertisement by referring to advertisement programming information when a broadcast video to be transmitted to the user terminal unit 10 is received from the broadcasting company encoder 20 . It is monitored whether an event, that is, a similar region detection event occurs (S211).

In other words, the virtual advertisement control unit 230 monitors whether the section of the broadcast video being transmitted is the starting point of the insertion section of the virtual advertisement in the advertisement programming information during transmission of the broadcast video.

When a virtual advertisement insertion position detection event occurs, the virtual advertisement control unit 230 converts the broadcasting image of the virtual advertisement insertion section to the object detection artificial intelligence model of the object detection unit 241 in frame image units or in a certain time unit (eg, second unit). It is applied to detect an object in the broadcasting image, and determines the type and location of the detected object (S213).

When the type and location of the object are detected, the virtual advertisement control unit 230 tracks the location of each object through the object location tracking unit 243 (S215), and detects one or more similar regions in the object and background of the continuous frame image. (S217).

When a similar area is detected, the virtual advertisement control unit 230 checks whether a similar area having a size corresponding to the size of the virtual advertisement overlay area exists through the insertion position determining unit 244 (S219).

As a result of the inspection, if a similar area having a size corresponding to the size of the virtual advertisement overlay area exists, the virtual advertisement control unit 230 overlays and inserts the virtual advertisement into the similar area through the virtual advertisement insertion unit 234, When an arbitrary object enters the similar area according to the location tracking of the above object, a virtual advertisement is inserted in the similar area or another similar area by reflecting the object entering the similar area (S221).

Meanwhile, if the similar area is a similar area on an object, the virtual advertisement control unit 230 overlays the virtual advertisement on the object according to the movement of the object and displays the virtual advertisement.

On the other hand, if there is no similar area having a size corresponding to the size of the virtual advertisement overlay area, the virtual advertisement control unit 230 selects the largest similar area among the similar areas detected through the insertion position determining unit 244, and After reducing the size of the corresponding virtual advertisement to correspond to the selected similar area through the advertisement insertion unit 234, the virtual advertisement is overlaid and inserted into the similar area (S223).

On the other hand, it is common knowledge in the art that the present invention is not limited to the above-described typical preferred embodiments, but can be implemented by various improvements, changes, substitutions, or additions within the scope of the present invention. If you have the , you can easily understand. If the implementation by such improvement, change, substitution or addition falls within the scope of the appended claims below, the technical idea should also be regarded as belonging to the present invention.

1: wired/wireless data communication network 10: user terminal
20: broadcaster encoder 30: virtual advertisement insertion system
40: advertiser terminal unit 50: manager terminal unit
100: advertisement organizing server 110: advertisement storage unit
111: Advertisement programming DB 112: Advertisement DB
120: advertisement communication unit 130: advertisement encoding unit
140: advertisement programming control unit 141: broadcast programming information acquisition unit
142: advertisement acquisition unit 143: advertisement conversion unit
144: advertisement operation information provider 200: virtual advertisement server
210: virtual advertisement storage unit 211: advertisement programming DB
212: virtual advertisement DB (212) 220: server communication unit
230: virtual advertisement control unit 231: advertisement operation information acquisition unit
232: broadcast reception processing unit 233: insertion area detection unit
234: virtual advertisement insertion unit 235: video transmission unit
241: object detection unit 242: similar region space detection unit
243: object location tracking unit 244: insertion location determining unit

Claims (16)

After acquiring broadcast programming information, advertisement scheduling condition information, and virtual advertisements, determining a broadcast program to insert a virtual advertisement among broadcast programs of the broadcast programming information according to the advertisement scheduling condition information, generating advertisement scheduling information, the advertisement an advertisement scheduling server that transmits advertising operation information including scheduling information and the acquired virtual advertisement; and
Receives the advertisement management information from the advertisement scheduling server, separates and stores advertisement scheduling information and virtual advertisements, and stores information about the broadcasting program from the broadcasting schedule information input from at least one broadcaster encoder according to the advertisement schedule of the advertisement schedule information. and a virtual advertisement server overlaying and inserting a virtual advertisement into a virtual advertisement insertion section of the advertisement programming information of the corresponding broadcast video, and then transmitting the virtual advertisement to the user terminal unit. insertion system.
According to claim 1,
The advertisement organizing server,
an advertisement storage unit including an advertisement schedule DB for storing broadcast schedule information and advertisement schedule information and an advertisement DB for storing a plurality of virtual advertisements and advertisement schedule condition information corresponding to each virtual advertisement;
an advertisement communication unit that connects to a wired/wireless data communication network and performs data communication with devices connected to the wired/wireless data communication network;
an advertisement encoding unit that receives virtual advertisement and format information, encodes the virtual advertisement into a video format of the format information, and outputs the encoded video; and
After acquiring the broadcast programming information and virtual advertisements, storing them in the advertisement programming DB and advertisement DB of the advertisement storage unit, respectively, determining a broadcast program to insert a virtual advertisement among broadcast programs of the broadcast programming information, and generating advertisement scheduling information. and an advertisement scheduling control unit for transmitting advertisement operation information including the advertisement scheduling information and the virtual advertisement encoded by the advertisement encoding unit to the virtual advertisement server through the advertisement communication unit. Virtual advertisement insertion system using recognition.
According to claim 2,
The advertisement scheduling control unit,
a broadcasting schedule information obtaining unit for obtaining broadcast schedule information from a broadcasting company through the advertisement communication unit and storing the obtained broadcast schedule information in the advertisement schedule DB;
an advertisement acquisition unit receiving virtual advertisements and advertisement scheduling condition information from either an advertiser terminal unit or a manager terminal unit through the advertisement communication unit and storing them in the advertisement DB;
an advertisement conversion unit outputting format information corresponding to the virtual advertisement stored in the advertisement DB and a broadcast video format of a broadcasting company into which the virtual advertisement is to be inserted to the advertisement encoding unit, receiving the converted virtual advertisement and storing the virtual advertisement in an advertisement DB; and
and an advertisement operation information provider for generating advertisement management information including the advertisement organization information and the converted virtual advertisement and transmitting the advertisement management information to a virtual advertisement server through the advertisement communication unit. Virtual ad insertion system.
According to claim 1,
The virtual advertisement server,
a virtual advertisement storage unit including an advertisement schedule DB for storing advertisement schedule information and a virtual advertisement DB for storing virtual advertisements for each broadcasting video format;
a server communication unit that connects to a wired/wireless data communication network and performs data communication with devices connected to the wired/wireless data communication network; and
The advertisement operation information is received from the advertisement scheduling server, and the advertisement scheduling information and virtual advertisement are separated and stored in the virtual advertisement storage unit's advertisement scheduling DB and virtual advertisement DB, respectively, and the virtual advertisement is displayed according to the advertisement scheduling information. Overlay on the similar area of the broadcast video corresponding to the size of the overlay area of the virtual advertisement in the virtual advertisement insertion section of the advertisement scheduling information of the corresponding broadcast video among the broadcast images of the broadcast program of the broadcast programming information input from at least one broadcasting company encoder. A virtual advertisement insertion system using region and object recognition of a broadcast image, characterized in that it includes a virtual advertisement control unit for transmitting the virtual advertisement to a user terminal after inserting it.
According to claim 4,
The virtual advertisement control unit,
an advertisement management information acquisition unit receiving the advertisement management information from the advertisement scheduling server, detecting advertisement scheduling information and virtual advertisements from the advertisement management information, and storing them in an advertisement scheduling DB and a virtual advertisement DB of the virtual advertisement storage unit, respectively;
a broadcast reception processing unit for receiving and outputting a broadcast image from a broadcaster encoder of a specific broadcaster when a broadcast image request event for a broadcast program of a specific broadcaster occurs;
Among the broadcast images for the broadcast program of the broadcasting program information of the broadcasting company output from the broadcast reception processing unit, a similar region of the broadcast image corresponding to the size of the overlay region of the virtual advertisement in the virtual advertisement insertion section of the advertisement schedule information of the corresponding broadcast image an insertion area detection unit that detects;
a virtual advertisement insertion unit overlaying the virtual advertisement on the similar area detected by the insertion area detection unit and inserting the virtual advertisement; and
A virtual advertisement insertion system using region and object recognition of a broadcast video, characterized in that it comprises a video transmission unit for transmitting the broadcast video into which the virtual advertisement is inserted to a corresponding user terminal unit.
According to claim 5,
The insertion area detection unit,
an object detection unit which applies an object detection artificial intelligence model and detects an object in the broadcast video of the virtual advertisement insertion section through the object detection artificial intelligence model;
a similar region spatial detector detecting at least one similar region having a predetermined size or more in the broadcasting image of the virtual advertisement insertion section; and
An insertion location determiner configured to determine a similar area corresponding to the size of an overlay area of the virtual advertisement among one or more similar areas of the detected object and background as a virtual advertisement insertion position, and output the determined virtual advertisement insertion position information to the virtual advertisement insertion unit. include,
and the virtual advertisement inserting unit inserts the virtual advertisement into the similar area in the broadcast video corresponding to the virtual advertisement insertion position information.
According to claim 6,
The insertion area detection unit,
Further comprising an object location tracking unit for tracking the location of the detected object and outputting object location information to the virtual advertisement insertion unit;
The virtual advertisement insertion unit,
The virtual advertisement insertion system using region and object recognition of a broadcast image, characterized in that the virtual advertisement is inserted by overlaying it on the similar area so as not to overlap with objects corresponding to the positions of the detected objects.
According to claim 7,
The insertion position determining unit,
If there is an entity having a similar area corresponding to the size of the overlay area of the virtual advertisement among the detected objects, the similar area of the object is determined as a similar area to be inserted into the virtual advertisement. Virtual ad insertion system.
According to claim 8,
The insertion position determining unit,
If there is no similar area larger than the size of the overlay area of the virtual advertisement, a similar area having the largest area is selected, and size information of the selected similar area is provided to a virtual advertisement insertion unit;
The virtual advertisement insertion unit,
When the size information of the similar area is input from the insertion position determining unit, the size of the overlay area (virtual advertisement) of the virtual advertisement is adjusted to be smaller than the size of the similar area, and then overlayed and inserted into the similar area. Virtual advertisement insertion system using area and object recognition of
According to claim 9,
The insertion position determining unit,
A similar area corresponding to the size of the virtual advertisement overlay area is determined as a virtual advertisement insertion position, and a similar area closest to an object corresponding to the advertisement content of the virtual advertisement is determined. Virtual advertisement insertion system used.
An advertisement scheduling server obtains broadcast scheduling information, advertisement scheduling condition information, and virtual advertisements, determines a broadcast program to insert a virtual advertisement among broadcast programs of the broadcast scheduling information according to the advertisement scheduling condition information, and generates advertisement scheduling information. Afterwards, an advertisement organizing process of transmitting advertisement management information including the advertisement scheduling information and the acquired virtual advertisement; and
A virtual advertisement server receives the advertisement operation information from the advertisement scheduling server, separates and stores advertisement scheduling information and virtual advertisements, and stores the broadcast scheduling information input from at least one broadcasting company encoder according to the advertisement scheduling information. A region and object of a broadcast image comprising a virtual advertisement provision process of overlaying and inserting a virtual advertisement into a virtual advertisement insertion section of advertisement programming information of the broadcast program among broadcast images and then transmitting the virtual advertisement to a user terminal unit. A virtual advertisement insertion method using recognition.
According to claim 11,
The advertisement organizing process
a broadcasting schedule information acquisition step in which the advertisement schedule control unit of the advertisement schedule server acquires broadcast schedule information from a broadcasting company through a broadcast schedule information acquisition unit and stores the broadcast schedule information in an advertisement schedule DB;
an advertisement acquisition step in which the advertisement programming control unit receives virtual advertisements from an advertiser terminal unit and a manager terminal unit through an advertisement acquisition unit and stores them in an advertisement DB;
The advertisement programming control unit outputs the virtual advertisement stored in the advertisement DB through the advertisement conversion unit and the format information corresponding to the broadcast video format of the broadcaster to insert the virtual advertisement to the advertisement encoding unit to output the virtual advertisement corresponding to the broadcast video format. An advertisement conversion step of storing the virtual advertisement converted into a format in an advertisement DB; and
An advertisement operation information providing step in which the advertisement scheduling control unit generates advertisement operation information including the advertisement scheduling information and the converted virtual advertisement through an advertisement operation information providing unit and transmits the advertisement operation information to a virtual advertisement server through an advertisement communication unit A virtual advertisement insertion method using region and object recognition of a broadcast image, characterized in that.
According to claim 11,
The process of providing virtual advertisements,
The virtual advertisement control unit of the virtual advertisement server receives the advertisement operation information from the advertisement organizing server through the advertisement operation information acquisition unit, detects the advertisement scheduling information and virtual advertisement from the advertisement operation information, and stores the advertisement scheduling DB of the virtual advertisement storage unit. and obtaining advertisement operation information stored in each virtual advertisement DB;
a broadcast reception processing step in which the virtual advertisement control unit receives and outputs a broadcast image from a broadcaster encoder of a specific broadcaster when a broadcast image request event for a broadcast program of a specific broadcaster occurs through the broadcast reception processing unit;
The overlay area of the virtual advertisement in the virtual advertisement insertion section of the advertisement schedule information of the corresponding broadcast video among the broadcast images of the broadcast program of the broadcast program information of the broadcasting company output from the real-time broadcast receiving processing unit through the insertion area detector by the virtual advertisement control unit. an insertion region detection step of detecting a similar region of the broadcast image corresponding to the size;
a virtual advertisement insertion step in which the virtual advertisement control unit overlays and inserts the virtual advertisement into the similar area detected by the insertion area detection unit through the virtual advertisement insertion unit; and
and a step of transmitting, by the virtual advertisement control unit, the broadcasting video with the virtual advertisement inserted therein to a corresponding user terminal unit through a video transmission unit, wherein the virtual advertisement insertion method using region and object recognition of the broadcasting video comprises: .
According to claim 13,
In the insertion region detection step,
an object detection step of detecting an object in a broadcast image of the virtual advertisement insertion section through an object detection unit to which an object detection artificial intelligence model is applied by the insertion area detection unit of the virtual advertisement control unit;
a similar area space detection step in which the insertion area detection unit detects at least one similar area having a predetermined size or more in the broadcast image of the virtual advertisement insertion section through the similar area space detection unit; and
The insertion area detection unit determines a similar area corresponding to the size of the overlay area of the virtual advertisement among one or more similar areas of the detected object and background through the insertion location determining unit as a virtual advertisement insertion location, and the determined virtual advertisement insertion location information Including the step of determining the insertion position outputted to the virtual advertisement insertion unit,
In the virtual advertisement insertion step,
A method of inserting a virtual advertisement using region and object recognition of a broadcast image, characterized in that the virtual advertisement insertion unit inserts the virtual advertisement into the similar area in the broadcast video corresponding to the virtual advertisement insertion location information.
According to claim 14,
In the insertion region detection step,
Further comprising an object location tracking step in which the insertion area detection unit tracks the location of the detected object through the object location tracking unit and outputs object location information to the virtual advertisement insertion unit,
In the virtual advertisement insertion step,
The method of inserting a virtual advertisement using region and object recognition of a broadcast image, characterized in that the virtual advertisement insertion unit inserts the virtual advertisement by overlaying it on the similar area so as not to overlap with objects corresponding to the positions of the detected objects.
According to claim 15,
In the insertion position determination step
The area of the broadcasting image characterized in that if there exists an object having a similar area corresponding to the size of the overlay area of the virtual advertisement among the objects detected by the insertion position determining unit, the similar area of the object is determined as a similar area to be inserted into the virtual advertisement. and a virtual advertisement insertion method using object recognition.

Images