WO2019078038A1 - Advertisement system - Google Patents

Advertisement system Download PDF

Info

Publication number
WO2019078038A1
WO2019078038A1 PCT/JP2018/037366 JP2018037366W WO2019078038A1 WO 2019078038 A1 WO2019078038 A1 WO 2019078038A1 JP 2018037366 W JP2018037366 W JP 2018037366W WO 2019078038 A1 WO2019078038 A1 WO 2019078038A1
Authority
WO
WIPO (PCT)
Prior art keywords
advertisement
moving
moving body
moving image
detection means
Prior art date
Application number
PCT/JP2018/037366
Other languages
French (fr)
Japanese (ja)
Inventor
友昭 天野
Original Assignee
ｅｍｍｍＲ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ｅｍｍｍＲ株式会社 filed Critical ｅｍｍｍＲ株式会社
Publication of WO2019078038A1 publication Critical patent/WO2019078038A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00—Advertising or display means not otherwise provided for
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2543—Billing, e.g. for subscription services
    • H04N21/2547—Third Party Billing, e.g. billing of advertiser
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay

Definitions

  • the present invention relates to an advertisement system that displays advertisements during video playback.
  • the improvement of the advertisement effect is required, so in Japanese Patent Application Laid-Open No. 2002-73321, an advertisement target person is photographed, and a characteristic (sex or age) of the advertisement target person is determined from the photographed image.
  • the invention which displays the advertisement corresponding to the feature is disclosed. According to this invention, the advertising effect can be improved by making the advertisement to be displayed different according to the advertisement target person.
  • the present invention has been made to solve the problems as described above, and it is an object of the present invention to provide an advertisement system capable of more effective advertisement.
  • the present invention is an advertisement system that displays an advertisement in a moving image being played back during moving image playback, and detects a moving object in the moving image and detects the detected movement of the moving object.
  • the apparatus is characterized by comprising: a moving body detection means; and an advertisement display means for displaying an advertisement based on the movement of the moving body detected by the moving body detection means.
  • the apparatus further comprises: an advertisement display area determining unit configured to determine a predetermined portion of the moving object detected by the moving object detecting unit as an advertisement display area; Displaying an advertisement on the advertisement display area moving with movement of a moving body in the moving image.
  • the advertisement display means displays an advertisement when the motion of the moving object in the moving image being played during the moving image playback is a predetermined motion.
  • an advertisement is displayed based on the movement of a moving object focused while watching a moving image, so an advertisement system capable of enhancing the visibility of the advertisement and performing more effective advertisement is provided. be able to.
  • an advertisement is displayed at a predetermined location of a moving object to which the line of sight of an advertisement target person is likely to be directed. Therefore, an advertisement system capable of enhancing advertisement visibility and performing more effective advertisement. Can be provided.
  • the advertisement is displayed when the movement of the moving body is a predetermined movement, the line of sight of the advertisement target person is likely to face the advertisement, the visibility of the advertisement is enhanced, and more effective.
  • FIG. 7 is a diagram illustrating an example of an execution environment of an advertisement system according to a second embodiment.
  • FIG. 1 is a block diagram showing a configuration of an embodiment of an advertisement system according to the present invention.
  • the advertisement system 100 includes a moving image capturing unit 101 for capturing a moving image, a moving object detecting unit 102 for detecting a moving object in the moving image captured by the moving image capturing unit 101, and an area for displaying an advertisement in the moving image.
  • An advertisement display area determination unit 103 determined as an area, and an advertisement display unit 104 displaying an advertisement in the advertisement display area determined by the advertisement display area determination unit 103 are configured.
  • Each configuration may be configured by hardware or software.
  • the moving picture photographing means 101 has a camera (for example, the camera 11 in FIG. 2) for photographing a moving picture and a sensor (for example, the sensor 12 in FIG. 2) capable of measuring the distance to the photographed object.
  • the camera and the sensor have a fixed positional relationship.
  • the moving image capturing means 101 may be a stereo camera that can obtain the distance from the moving image capturing means 101 to each point in the moving image using parallax as a configuration that combines a camera and a sensor, for example, KINECT (registered trademark) It may be an RGB-D camera such as.
  • the moving object detection means 102 is, for example, the distance from each of a plurality of points in the moving image to the moving image shooting means 101 based on the information from the camera or sensor of the moving image shooting means 101, that is, the depth of each of the plurality of points in the moving image. It has a depth detection unit 105 that detects depth information (depth information), and a skeleton detection unit 106 that detects skeleton information (bone information) indicating the skeleton of a moving object in a moving image based on the depth information by the depth detection unit 105, for example. .
  • the detection of depth information and the detection of skeletal information may use any known method.
  • the moving object detection means 102 for example, when there is a group of depth information by the depth detection means 105 being the depths in the vicinity among a plurality of points in the moving image, changes in the depth information of the plurality of points in the moving image Along with this, when the group indicates that they move together, the moving body is detected by regarding the group as one moving body.
  • the moving object detection means 102 may detect the contour of the moving object based on the edge of color or lightness in the moving image. Motion detection may be performed using any known method.
  • the moving body detection unit 102 detects the movement of the moving body by, for example, tracking changes in the depth information by the depth detection unit 105 over time.
  • the moving object detection means 102 can also detect the movement of the moving object, for example, by tracking the change over time of the skeleton information by the skeleton detection means 106. Any known method of motion detection may be used.
  • the moving body detected by the moving body detection means 102 may be an inanimate object such as a vehicle, or may be an organism such as a person or an animal.
  • the skeleton information by the skeleton detection means 106 may be a set of predetermined detection points (not limited to actual bones) detected according to the type of moving body.
  • the moving body detection unit 102 is not limited to a configuration for detecting a moving body in a moving image captured by the moving image capturing unit 101, and may be configured to detect a moving body in a moving image stored in a storage device (not shown).
  • the advertisement display means 104 displays the advertisement determined by the advertisement determination means 107 when reproducing the moving image stored in the storage device.
  • This moving image is stored in the storage device together with information necessary for detecting a moving body in the moving image (for example, the distance from the moving image capturing device to each point in the moving image).
  • the advertisement display area determination means 103 determines an advertisement display area which is an area for displaying an advertisement in a moving image.
  • the advertisement display area may be fixed to the upper right corner of the screen for reproducing the moving image, or the like, or a predetermined part of the moving body detected by the moving body detection means 102 (a part of a person's chest, a part of a person's head,
  • the position may be determined on the belly of an animal such as a racehorse, the central portion of the body of a racing car, or the like, or may be determined at a predetermined mark position (for example, chroma key) in a moving image.
  • the mark position may be provided on a moving body, and the person as the moving body may wear clothes having a color key portion of the chroma key so that the mark position moves in accordance with the movement of the person.
  • the advertisement display means 104 has a device (for example, a display, a monitor) capable of reproducing a moving image toward the advertisement target person. Further, the advertisement display means 104 has an advertisement determination means 107 for determining an advertisement to be displayed.
  • the advertisement determination means 107 may determine an advertisement defined in advance as a contract with the advertiser as the advertisement to be displayed, or, for example, by real time bidding (RTB), a plurality of advertisement display timings (impressions) may be displayed.
  • RTB real time bidding
  • An advertiser may bid and decide as an advertisement to be displayed.
  • the advertisement may be characters, still images, or moving images.
  • the advertisement display means 104 displays the advertisement determined by the advertisement determination means 107 when displaying the moving image photographed by the moving image photographing means 101.
  • the timing at which the advertisement display means 104 displays the advertisement may be always displayed or may be displayed only at a predetermined timing.
  • the advertisement display means 104 may display the advertisement determined by the advertisement determination means 107 when the movement of the moving body detected by the moving body detection means 102 is a predetermined movement.
  • the advertisement display means 104 uses the fact that the line of sight of the advertisement target person is generally directed toward moving, and the advertisement display means 104 makes an advertisement based on the movement of the moving object detected by the moving object detection means 102. Can be provided to increase the visibility of advertisements and provide an advertisement system capable of more effective advertisement.
  • the advertisement display area determination means 103 determines a predetermined place in the moving body detected by the moving body detection means 102 as the advertisement display area, and places the line of sight of the advertisement target person at the predetermined place Since the advertisement is displayed, it is possible to provide an advertisement system capable of enhancing the visibility of the advertisement and performing more effective advertisement.
  • the advertisement display area determination means 103 determines the mark position in the moving object detected by the moving object detection means 102 as the advertisement display area, thereby enhancing the visibility of the advertisement and more effective advertisement. Can provide an advertising system that can
  • the advertisement display means 104 displays the advertisement when the movement of the moving object detected by the moving object detection means 102 is a predetermined movement, so the line of sight of the advertisement target person faces the advertisement. It is possible to provide an advertising system which can easily improve the visibility of advertisements and perform more effective advertising.
  • the moving object detection means 102 detects the moving object in the moving image photographed by the moving image photographing means 101, so immediacy can be enhanced and the interest of the advertisement target person in the moving image can be intensified. .
  • the moving body detection means 102 detects the moving body and the movement of the moving body based on the depth information detected by the depth detecting means 105, so detection of the moving body and detection of the movement of the moving body Can be done more accurately.
  • the moving body detection means 102 detects the movement of the moving body based on the skeleton information detected by the skeleton detection means 106, so that the movement of the moving body can be detected more accurately. .
  • the advertisement determination means 107 determines the advertisement to be displayed by real-time bidding, so that the request of the advertiser and the request of the advertisement medium are balanced to perform appropriate advertisement.
  • An advertisement system can be provided.
  • FIG. 2 is a block diagram showing the configuration of the advertisement system according to the first embodiment of the present invention.
  • the advertisement system 10 of the present embodiment advertises based on a camera 11 for capturing video which is a moving image, a sensor 12 for acquiring depth information of each point in the video captured by the camera 11, and depth information obtained from the sensor 12
  • a PC personal computer 13 for outputting an advertisement arranged at the display position
  • a SYNC synchronizer
  • switcher 15 for combining the advertisement from the PC with the image taken by the camera 11 and outputting it.
  • a monitor 16 for reproducing the video in which the advertisement from the switcher 15 is synthesized.
  • the camera 11 corresponds to the moving image shooting means 101 of FIG.
  • the sensor 12 corresponds to the moving image capturing means 101, the moving object detecting means 102, and the depth detecting means 105 of FIG.
  • the PC 13 corresponds to the advertisement display area determination unit 103, the advertisement display unit, and the advertisement determination unit 107 in FIG.
  • the SYNC 14 corresponds to the advertisement display means 104 of FIG.
  • the switcher 15 corresponds to the advertisement display means 104 of FIG.
  • the monitor 16 corresponds to the advertisement display means 104 of FIG.
  • the sensor 12 corresponds to the moving image photographing means 101, the moving object detection means 102, the depth detection means 105, and the skeleton detection means 106 of FIG. 1, and the skeleton information is transmitted from the sensor 12 to the PC 13. Good.
  • An image captured by the camera 11 is input to the switcher 15.
  • This video is transmitted by HD-SDI.
  • the switcher 15 outputs the video input from the camera 11 to the PC 13 as a calibration video.
  • the calibration video is transmitted by HD-SDI.
  • the depth information acquired by the sensor 12 is input to the PC 13.
  • the sensor 12 and the PC 13 are connected by USB.
  • the sensor 12 emits, for example, infrared light (or other light) with a predetermined pattern into the moving image shooting range, restores the three-dimensional structure of the object from the geometric distortion of the pattern, and obtains depth information It may be one. Further, the sensor 12 may obtain depth information by the TOF method in which the distance is measured based on the arrival time of light.
  • the PC 13 determines an advertisement display area based on the calibration image input from the switcher 15 and the depth information input from the sensor 12.
  • the PC 13 includes a storage device (not shown), stores a plurality of types of advertisements in the storage device, and determines an advertisement to be displayed this time from among the plurality of types of advertisements. Effects (for example, advertisement) and alpha (for example, mask information) are transmitted from the PC 13 to the switcher 15 by HD-SDI. Information of the advertisement to be displayed and the advertisement display area is transmitted from the PC 13 to the switcher 15 by this effect and alpha.
  • the SYNC 14 synchronizes the PC 13 with the switcher 15.
  • the switcher 15 synthesizes an advertisement with the video inputted from the camera 11 with the effect and alpha from the PC 13 to make a video with effect (a video on which the advertisement is synthesized) and outputs this to the monitor 16.
  • FIG. 3 is a flowchart showing the flow of processing of the advertising system of the first embodiment.
  • photographing is performed by the camera 11 and the sensor 12 (step S300).
  • the PC 13 recognizes a person in the image using the calibration image from the switcher 15 and the depth information from the sensor 12 (step S301).
  • the recognition of the moving body has been described above, whether or not the recognized moving body is a person is, for example, information stored in advance as a feature of the person (for example, the shape of the moving body, movement manner) and the current moving body. Information may be collated, and in the case of coincidence or approximation, it may be determined that the moving body is a person.
  • the PC 13 places an advertisement at the position (for example, the position of the chest) of the person recognized in step S301 (step S302).
  • This information is sent from the PC 13 to the switcher 15 as an effect and alpha, and the switcher 15 combines the video and the advertisement (step S303) to create an image with effects, and outputs the video with effects to the monitor 16.
  • the monitor 16 to which the effect-added video is input reproduces the effect-added video, that is, the image combined with the advertisement (step S304).
  • FIG. 4 is a diagram illustrating an example of an execution environment of the advertisement system of the first embodiment.
  • the server 20 includes the PC 13, the SYNC 14 and the switcher 15 shown in FIG. 2.
  • the PC 13 in the server 20 is connected to the advertiser's PC 21a, PC 21b, and PC 21c by a network such as the Internet, for example.
  • the server 20 distributes the effect-added video to the monitors 16 of a plurality of viewers (advertising target persons).
  • the distribution of the effect-added video may be terrestrial television broadcasting, satellite broadcasting, cable television broadcasting, or Internet distribution such as YouTube (registered trademark) or DAZN (registered trademark). It may be delivery by SNS.
  • the server 20 recognizes the human figure as a 3D model (person 3D model) from the depth information obtained by the sensor 12.
  • the advertiser bids the server 20 (SSP in RTB: supply side platform) in real time for the advertisement space of this time with his own PC 21a, PC 21b, PC 21c (DSP in RTB: demand side platform) (3)
  • the server 20 determines an advertisement to be displayed according to the bid amount.
  • the server 20 pastes the advertisement to be displayed (the advertisement determined in (3)) as a texture on the person 3D model.
  • the person 3D model is superimposed on the actual video from the camera 11 and distributed. At this time, by making the person 3D model itself transparent, it is not displayed on the monitor 16 of the viewer.
  • the uniform of the athlete is a uniform with “A company” written on the chest position, and an advertisement of “A company” goes to the audience actually watching the game at the stadium. It will be.
  • the advertisement determined by the bid in the RTB is displayed at the chest position of the uniform of the athlete.
  • the uniform of the athlete may be made plain and distributed to the monitor 16 in a state where no advertisement is displayed.
  • FIG. 2 The block diagram showing the configuration of the second embodiment is the same as that of FIG. 2, so that the description thereof will be omitted here with reference to FIG.
  • FIG. 5 is a flowchart showing the flow of processing of the advertising system of the second embodiment.
  • photographing is performed by the camera 11 and the sensor 12 (step S500).
  • the PC 13 recognizes a person in the image using the calibration image from the switcher 15 and the depth information from the sensor 12 (step S501).
  • the recognition of the moving body has been described above, whether or not the recognized moving body is a person is, for example, information stored in advance as a feature of the person (for example, the shape of the moving body, movement manner) and the current moving body. Information may be collated, and in the case of coincidence or approximation, it may be determined that the moving body is a person.
  • the PC 13 determines whether or not the person in the video has moved in a predetermined manner (step S502).
  • the determination of the movement can be performed based on, for example, skeleton information.
  • An example of skeleton information is shown in FIG.
  • the skeleton information 50 shown in FIG. 6 includes “head”, “neck”, “shoulder center”, “right shoulder”, “right elbow”, “right wrist”, “right hand”, and “right thumb” of the parts of the human body.
  • step S 502 If the movement of the person in the image is not a predetermined movement (for example, a predetermined pose, piece sign, guts pose, etc.) in step S 502 in FIG. 5 (step S 502: No), the process proceeds to step S 505 and the camera 11 captures an image. The obtained video is output as it is to the monitor 16, and the monitor 16 reproduces the video taken by the camera 11 as it is. Then, if it is a stop (Step S506: Yes), processing will be ended, and if it continues (Step S506: No), it will return to Step S500 and will repeat processing.
  • a predetermined movement for example, a predetermined pose, piece sign, guts pose, etc.
  • step S502 if the motion of the person in the video is a predetermined motion (step S502: Yes), the process proceeds to step S503.
  • step S503 an advertisement is placed at a predetermined position (may be superimposed on a person or may be another position in the video). This information is sent from the PC 13 to the switcher 15 as an effect and alpha, and the switcher 15 combines the video and the advertisement (step S504) to create an image with effects, and outputs the video with effects to the monitor 16.
  • the monitor 16 to which the effect-added video is input reproduces the effect-added video, that is, the image combined with the advertisement (step S505).
  • Step S506 Yes
  • processing will be ended, and if it continues (Step S506: No), it will return to Step S500 and will repeat processing.
  • FIG. 7 is a diagram illustrating an example of the execution environment of the advertisement system of the second embodiment.
  • the idol sings at the event site and the situation is simultaneously screened on the monitor 16, which is a large monitor, and when the idol moves to raise the right hand (specific choreography
  • the PC 30 includes the PC 13, the SYNC 14 and the switcher 15 shown in FIG. 2.
  • the sponsor 31 makes a contribution, and the advertisement “Candy of Company B” decided by the sponsor 31 is displayed on the monitor 16.
  • the PC 30 recognizes the human figure as a 3D model (human 3D model) from the depth information obtained by the sensor 12.
  • the PC 30 estimates the skeleton position (for example, skeleton information 50) of the person from the depth information obtained by the sensor 12.
  • the PC 30 uses the inferred skeleton position to determine from the movement of the skeleton whether or not a specific choreography (pose) has been performed.
  • a specific choreography an action in which the idle raises the right hand is a specific choreography.
  • an advertisement predetermined by the sponsor 31 for example, an advertisement stored in advance in a storage device (not shown) of the PC 30 is superimposed and displayed on the monitor 16.
  • An object of the present invention is to provide a system or apparatus with a storage medium storing a program code (computer program) for realizing the functions of the embodiments described above, and a computer of the system or apparatus supplied is stored in the storage medium. It is also achieved by reading and executing the code.
  • the program code itself read from the storage medium implements the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention.
  • the computer functions as each processing unit by executing the program, but part or all of the processing may be configured by a dedicated electronic circuit (hardware). I do not care.
  • the present invention is not limited to the specific embodiments described, but various modifications and variations are possible within the scope of the present invention as set forth in the claims.
  • Advertisement display means 10 advertising system 11 camera 12 sensor 13 PC (PC) 14 SYNC (synchronizer) 15 Switcher 16 Monitor 20 Server 21a, 21b, 21c PC (PC) 30 PC (PC) 31 Sponsor 100 Advertising system 101 Movie shooting means 102 Moving object detection means 103 Advertisement display area determination means 104 Advertisement display means 105 Depth detection means 106 Skeleton detection means 107 Advertisement determination means

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Finance (AREA)
  • Computer Hardware Design (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • Game Theory and Decision Science (AREA)
  • General Business, Economics & Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Databases & Information Systems (AREA)
  • Economics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Analysis (AREA)

Abstract

The purpose of the present invention is to provide an advertisement system that is capable of performing more effective advertising. This advertisement system is for displaying an advertisement in a moving image being reproduced during the reproduction of the moving image, and is characterized by being provided with: a moving body detection means for detecting a moving body in the moving image and detecting motion of the detected moving body; and an advertisement display means for displaying an advertisement on the basis of the motion of the moving body detected by the moving body detection means. This configuration facilitates the paying of attention to the advertisement by persons who are the object of the advertisement, and can realize more effective advertising.

Description

広告システムAdvertising system
　本発明は、動画再生中に広告を表示する広告システムに関する。 The present invention relates to an advertisement system that displays advertisements during video playback.
　広告においては、その目的を達成するため、新聞、テレビ、インターネットなどの様々な媒体を用いて情報伝達を行う。この情報伝達の形態としては、文字、音声、静止画、動画などが用いられる。テレビを媒体とした広告にあっては、ある番組放送と次の番組放送との間に広告を行うコマーシャル放送が知られている。また、インターネットを媒体とした広告にあっては、広告対象者がアクセスしたページの広告枠に広告を表示する方法が知られている。 In advertising, in order to achieve the purpose, information is communicated using various media such as newspaper, television, and the Internet. As a form of this information transmission, characters, sounds, still images, moving images, etc. are used. In the case of advertisements using television as a medium, commercial broadcasting is known in which an advertisement is performed between a certain program broadcast and the next program broadcast. In addition, in the case of advertisements via the Internet, there is known a method of displaying an advertisement in an advertisement space of a page accessed by an advertisement target person.
　このような広告においては広告効果の向上が求められることから、特開２００２－７３３２１号公報では、広告対象者を撮影し、その撮影画像から広告対象者の特徴（性別や年齢）を判定し、その特徴に対応した広告を表示する発明を開示している。この発明によれば、広告対象者に応じて表示する広告を異ならせることで、広告効果を向上することができる。 In such an advertisement, the improvement of the advertisement effect is required, so in Japanese Patent Application Laid-Open No. 2002-73321, an advertisement target person is photographed, and a characteristic (sex or age) of the advertisement target person is determined from the photographed image. The invention which displays the advertisement corresponding to the feature is disclosed. According to this invention, the advertising effect can be improved by making the advertisement to be displayed different according to the advertisement target person.
特開２００２－７３３２１号公報JP 2002-73321 A
　しかしながら、特開２００２－７３３２１号公報に記載の発明では、広告対象者に応じた広告を行うことができるものの、広告対象者による広告の視認については何ら考慮されておらず、広告対象者によって広告が視認されないことにより広告効果が十分に得られない虞があるという問題があった。 However, in the invention described in Japanese Patent Application Laid-Open No. 2002-73321, although the advertisement according to the advertisement target person can be advertised, the visual recognition of the advertisement by the advertisement target person is not considered at all, and the advertisement target person advertises There is a problem that there is a possibility that the advertisement effect can not be obtained sufficiently by not being visually recognized.
　本発明は以上のような課題を解決するためになされたものであり、より効果的な広告を行うことができる広告システムを提供することを目的とする。 The present invention has been made to solve the problems as described above, and it is an object of the present invention to provide an advertisement system capable of more effective advertisement.
　上記課題を解決するために、本発明は、動画再生中に該再生中の動画内に広告を表示する広告システムであって、動画内の動体を検出するとともに、検出した動体の動きを検出する動体検出手段と、前記動体検出手段によって検出した動体の動きに基づいて広告を表示する広告表示手段と、を備えたことを特徴とする。 In order to solve the above problems, the present invention is an advertisement system that displays an advertisement in a moving image being played back during moving image playback, and detects a moving object in the moving image and detects the detected movement of the moving object. The apparatus is characterized by comprising: a moving body detection means; and an advertisement display means for displaying an advertisement based on the movement of the moving body detected by the moving body detection means.
　また本発明の一実施形態は、前記動体検出手段によって検出した動体における所定箇所を広告表示領域として決定する広告表示領域決定手段をさらに備え、前記広告表示手段は、動画再生中に、該再生中の動画内の動体の動きに伴って移動する前記広告表示領域に広告を表示する、ことを特徴とする。 In one embodiment of the present invention, the apparatus further comprises: an advertisement display area determining unit configured to determine a predetermined portion of the moving object detected by the moving object detecting unit as an advertisement display area; Displaying an advertisement on the advertisement display area moving with movement of a moving body in the moving image.
　また本発明の一実施形態は、前記広告表示手段は、動画再生中に、該再生中の動画内の動体の動きが所定の動きであったときに広告を表示する、ことを特徴とする。 In one embodiment of the present invention, the advertisement display means displays an advertisement when the motion of the moving object in the moving image being played during the moving image playback is a predetermined motion.
　本発明によれば、広告対象者が動画視聴中に注目する動体の動きに基づいて広告を表示するので、広告の視認率を高め、より効果的な広告を行うことができる広告システムを提供することができる。 According to the present invention, an advertisement is displayed based on the movement of a moving object focused while watching a moving image, so an advertisement system capable of enhancing the visibility of the advertisement and performing more effective advertisement is provided. be able to.
　また本発明の一実施形態によれば、広告対象者の視線が向きやすい動体の所定箇所に広告を表示するので、広告の視認率を高め、より効果的な広告を行うことができる広告システムを提供することができる。 Further, according to one embodiment of the present invention, an advertisement is displayed at a predetermined location of a moving object to which the line of sight of an advertisement target person is likely to be directed. Therefore, an advertisement system capable of enhancing advertisement visibility and performing more effective advertisement. Can be provided.
　また本発明の一実施形態によれば、動体の動きが所定の動きであったときに広告を表示するので、広告対象者の視線が広告に向きやすく、広告の視認率を高め、より効果的な広告を行うことができる広告システムを提供することができる。 Further, according to one embodiment of the present invention, since the advertisement is displayed when the movement of the moving body is a predetermined movement, the line of sight of the advertisement target person is likely to face the advertisement, the visibility of the advertisement is enhanced, and more effective. Can provide an advertisement system capable of performing various advertisements.
本発明に係る広告システムの一実施形態の構成を示すブロック図である。It is a block diagram showing composition of one embodiment of an advertising system concerning the present invention. 本発明に係る広告システムの実施例１の構成を示すブロック図である。It is a block diagram showing composition of Example 1 of an advertising system concerning the present invention. 実施例１の広告システムの処理の流れを示すフローチャートである。It is a flowchart which shows the flow of a process of the advertising system of Example 1. FIG. 実施例１の広告システムの実行環境の一例を示す図である。FIG. 2 is a diagram showing an example of an execution environment of the advertisement system of the first embodiment. 実施例２の広告システムの処理の流れを示すフローチャートである。It is a flowchart which shows the flow of a process of the advertising system of Example 2. FIG. 骨格情報の一例を示す図である。It is a figure which shows an example of frame | skeleton information. 実施例２の広告システムの実行環境の一例を示す図である。FIG. 7 is a diagram illustrating an example of an execution environment of an advertisement system according to a second embodiment.
　以下、本発明に係る広告システムについて、図面を参照しながら詳細に説明する。なお、以下に示す実施形態は本発明に係るシステムの好適な具体例であり、一般的なハードウェア、ソフトウェア構成に即した種々の限定を付している場合もあるが、本発明の技術範囲は、特に本発明を限定する記載がない限り、これらの態様に限定されるものではない。また、以下に示す実施形態における構成要素は、適宜、既存の構成要素等との置き換えが可能であり、かつ、他の既存の構成要素との組み合わせを含む様々なバリエーションが可能である。したがって、以下に示す実施形態の記載をもって、特許請求の範囲に記載された発明の内容を限定するものではない。 Hereinafter, an advertisement system according to the present invention will be described in detail with reference to the drawings. The embodiment described below is a preferred example of a system according to the present invention, and may have various limitations in line with general hardware and software configurations, but the technical scope of the present invention Is not limited to these embodiments unless specifically described to limit the present invention. In addition, the components in the embodiments described below can be appropriately replaced with existing components and the like, and various variations are possible including combinations with other existing components. Therefore, the description of the embodiments shown below does not limit the contents of the invention described in the claims.
　図１は、本発明に係る広告システムの一実施形態の構成を示すブロック図である。本実施形態の広告システム１００は、動画を撮影する動画撮影手段１０１と、動画撮影手段１０１によって撮影した動画内の動体を検出する動体検出手段１０２と、動画内において広告を表示する領域を広告表示領域として決定する広告表示領域決定手段１０３と、広告表示領域決定手段１０３によって決定した広告表示領域に広告を表示する広告表示手段１０４と、を有して構成される。各構成は、ハードウェアで構成してもよいし、ソフトウェアで構成してもよい。 FIG. 1 is a block diagram showing a configuration of an embodiment of an advertisement system according to the present invention. The advertisement system 100 according to the present embodiment includes a moving image capturing unit 101 for capturing a moving image, a moving object detecting unit 102 for detecting a moving object in the moving image captured by the moving image capturing unit 101, and an area for displaying an advertisement in the moving image. An advertisement display area determination unit 103 determined as an area, and an advertisement display unit 104 displaying an advertisement in the advertisement display area determined by the advertisement display area determination unit 103 are configured. Each configuration may be configured by hardware or software.
　動画撮影手段１０１は、動画を撮影するカメラ（例えば図２のカメラ１１）とその撮影物までの距離を測定可能なセンサ（例えば図２のセンサ１２）とを有する。このカメラとセンサとは位置関係を固定されている。動画撮影手段１０１は、カメラとセンサとを兼ねた構成として、視差を利用して動画撮影手段１０１から動画内の各点までの距離を求めることができるステレオカメラでもよいし、例えばＫＩＮＥＣＴ（登録商標）のようなＲＧＢ－Ｄカメラであってもよい。 The moving picture photographing means 101 has a camera (for example, the camera 11 in FIG. 2) for photographing a moving picture and a sensor (for example, the sensor 12 in FIG. 2) capable of measuring the distance to the photographed object. The camera and the sensor have a fixed positional relationship. The moving image capturing means 101 may be a stereo camera that can obtain the distance from the moving image capturing means 101 to each point in the moving image using parallax as a configuration that combines a camera and a sensor, for example, KINECT (registered trademark) It may be an RGB-D camera such as.
　動体検出手段１０２は、例えば動画撮影手段１０１のカメラやセンサからの情報に基づき動画内の複数の点のそれぞれから動画撮影手段１０１までの距離、すなわち動画内の複数の点のそれぞれの深度である深度情報（デプス情報）を検出する深度検出手段１０５と、例えば深度検出手段１０５による深度情報に基づき動画内の動体の骨格を示す骨格情報（ボーン情報）を検出する骨格検出手段１０６と、を有する。深度情報の検出や骨格情報の検出は既知のいかなる方法を用いてもよい。 The moving object detection means 102 is, for example, the distance from each of a plurality of points in the moving image to the moving image shooting means 101 based on the information from the camera or sensor of the moving image shooting means 101, that is, the depth of each of the plurality of points in the moving image. It has a depth detection unit 105 that detects depth information (depth information), and a skeleton detection unit 106 that detects skeleton information (bone information) indicating the skeleton of a moving object in a moving image based on the depth information by the depth detection unit 105, for example. . The detection of depth information and the detection of skeletal information may use any known method.
　動体検出手段１０２では、例えば、動画内の複数の点のうち深度検出手段１０５による深度情報が近傍の深度である一団があるとき、動画内の複数の点の深度情報の変化が、時間経過に伴い、その一団が一体で移動する様子を示している場合、その一団を一つの動体とみなすことで動体を検出する。また、動体検出手段１０２では、動画内の色彩や明度のエッジにより動体の輪郭を検出するようにしてもよい。動体の検出は既知のいかなる方法を用いてもよい。 In the moving object detection means 102, for example, when there is a group of depth information by the depth detection means 105 being the depths in the vicinity among a plurality of points in the moving image, changes in the depth information of the plurality of points in the moving image Along with this, when the group indicates that they move together, the moving body is detected by regarding the group as one moving body. In addition, the moving object detection means 102 may detect the contour of the moving object based on the edge of color or lightness in the moving image. Motion detection may be performed using any known method.
　動体検出手段１０２では、例えば、深度検出手段１０５による深度情報の時間経過に伴う変化を追跡することにより、動体の動きを検出する。また、動体検出手段１０２では、例えば、骨格検出手段１０６による骨格情報の時間経過に伴う変化を追跡することにより、動体の動きを検出することもできる。動体の動きの検出は既知のいかなる方法を用いてもよい。 The moving body detection unit 102 detects the movement of the moving body by, for example, tracking changes in the depth information by the depth detection unit 105 over time. The moving object detection means 102 can also detect the movement of the moving object, for example, by tracking the change over time of the skeleton information by the skeleton detection means 106. Any known method of motion detection may be used.
　動体検出手段１０２で検出する動体は、車両などの無生物であってもよいし、人や動物などの生物であってもよい。骨格検出手段１０６による骨格情報は、動体の種類に応じてあらかじめ定めたポイント（実際の骨に限られるものではない）を検出し、これらの検出ポイントの集合から成るものとすることができる。 The moving body detected by the moving body detection means 102 may be an inanimate object such as a vehicle, or may be an organism such as a person or an animal. The skeleton information by the skeleton detection means 106 may be a set of predetermined detection points (not limited to actual bones) detected according to the type of moving body.
　動体検出手段１０２は、動画撮影手段１０１によって撮影した動画内の動体を検出する構成に限られず、不図示の記憶装置に記憶してある動画内の動体を検出する構成としてもよい。この場合、広告表示手段１０４は、記憶装置に記憶してある動画を再生する際に広告決定手段１０７によって決定した広告を表示する。この動画は、動画内の動体を検出する際に必要な情報（例えば動画の撮影装置から動画内の各点までの距離）とともに記憶装置に記憶しておく。 The moving body detection unit 102 is not limited to a configuration for detecting a moving body in a moving image captured by the moving image capturing unit 101, and may be configured to detect a moving body in a moving image stored in a storage device (not shown). In this case, the advertisement display means 104 displays the advertisement determined by the advertisement determination means 107 when reproducing the moving image stored in the storage device. This moving image is stored in the storage device together with information necessary for detecting a moving body in the moving image (for example, the distance from the moving image capturing device to each point in the moving image).
　広告表示領域決定手段１０３は、動画内において広告を表示する領域である広告表示領域を決定する。広告表示領域は、動画を再生する画面の右上の隅などと固定で決めておいてもよいし、動体検出手段１０２で検出した動体の所定箇所（人物の胸の部分、人物の頭の部分、競走馬などの動物の腹の部分、レーシングカーの車体中央部分など）に決定してもよいし、動画内においてあらかじめ定めたマーク位置（例えばクロマキー）に決定してもよい。マーク位置は動体に設けてもよく、動体としての人物がクロマキーの色の箇所がある服を着用し、人物の動きに伴ってマーク位置が動くようにしてもよい。 The advertisement display area determination means 103 determines an advertisement display area which is an area for displaying an advertisement in a moving image. The advertisement display area may be fixed to the upper right corner of the screen for reproducing the moving image, or the like, or a predetermined part of the moving body detected by the moving body detection means 102 (a part of a person's chest, a part of a person's head, The position may be determined on the belly of an animal such as a racehorse, the central portion of the body of a racing car, or the like, or may be determined at a predetermined mark position (for example, chroma key) in a moving image. The mark position may be provided on a moving body, and the person as the moving body may wear clothes having a color key portion of the chroma key so that the mark position moves in accordance with the movement of the person.
　広告表示手段１０４は、広告対象者に向けて動画を再生可能な装置（例えばディスプレイ、モニタ）を有する。また、広告表示手段１０４は、表示する広告を決定する広告決定手段１０７を有する。 The advertisement display means 104 has a device (for example, a display, a monitor) capable of reproducing a moving image toward the advertisement target person. Further, the advertisement display means 104 has an advertisement determination means 107 for determining an advertisement to be displayed.
　広告決定手段１０７は、広告主との契約であらかじめ定めた広告を、表示する広告として決定してもよいし、例えばリアルタイムビッデイング（ＲＴＢ）により、広告表示のタイミング（インプレッション）ごとに、複数の広告主が入札し、表示する広告として決定してもよい。広告は、文字でもよいし、静止画でもよいし、動画でもよい。 The advertisement determination means 107 may determine an advertisement defined in advance as a contract with the advertiser as the advertisement to be displayed, or, for example, by real time bidding (RTB), a plurality of advertisement display timings (impressions) may be displayed. An advertiser may bid and decide as an advertisement to be displayed. The advertisement may be characters, still images, or moving images.
　広告表示手段１０４は、動画撮影手段１０１によって撮影した動画を表示する際に、広告決定手段１０７で決定した広告を表示する。広告表示手段１０４が広告を表示するタイミングは、常に表示するものであってもよいし、所定のタイミングでのみ表示するものであってもよい。広告表示手段１０４は、動体検出手段１０２で検出した動体の動きが所定の動きであったときに、広告決定手段１０７で決定した広告を表示するようにしてもよい。 The advertisement display means 104 displays the advertisement determined by the advertisement determination means 107 when displaying the moving image photographed by the moving image photographing means 101. The timing at which the advertisement display means 104 displays the advertisement may be always displayed or may be displayed only at a predetermined timing. The advertisement display means 104 may display the advertisement determined by the advertisement determination means 107 when the movement of the moving body detected by the moving body detection means 102 is a predetermined movement.
　本実施形態の発明によれば、広告対象者の視線が一般的に動いているものに向きやすいことを利用し、広告表示手段１０４が、動体検出手段１０２によって検出した動体の動きに基づいて広告を表示することで、広告の視認率を高め、より効果的な広告を行うことができる広告システムを提供することができる。 According to the invention of the present embodiment, the advertisement display means 104 uses the fact that the line of sight of the advertisement target person is generally directed toward moving, and the advertisement display means 104 makes an advertisement based on the movement of the moving object detected by the moving object detection means 102. Can be provided to increase the visibility of advertisements and provide an advertisement system capable of more effective advertisement.
　また本実施形態の発明によれば、広告表示領域決定手段１０３が、動体検出手段１０２によって検出した動体における所定箇所を広告表示領域として決定し、広告対象者の視線が向きやすい動体の所定箇所に広告を表示するので、広告の視認率を高め、より効果的な広告を行うことができる広告システムを提供することができる。 Further, according to the invention of the present embodiment, the advertisement display area determination means 103 determines a predetermined place in the moving body detected by the moving body detection means 102 as the advertisement display area, and places the line of sight of the advertisement target person at the predetermined place Since the advertisement is displayed, it is possible to provide an advertisement system capable of enhancing the visibility of the advertisement and performing more effective advertisement.
　また本実施形態の発明によれば、広告表示領域決定手段１０３が、動体検出手段１０２によって検出した動体におけるマーク位置を広告表示領域として決定するので、広告の視認率を高め、より効果的な広告を行うことができる広告システムを提供することができる。 Further, according to the invention of the present embodiment, the advertisement display area determination means 103 determines the mark position in the moving object detected by the moving object detection means 102 as the advertisement display area, thereby enhancing the visibility of the advertisement and more effective advertisement. Can provide an advertising system that can
　また本実施形態の発明によれば、広告表示手段１０４が、動体検出手段１０２によって検出した動体の動きが所定の動きであったときに広告を表示するので、広告対象者の視線が広告に向きやすく、広告の視認率を高め、より効果的な広告を行うことができる広告システムを提供することができる。 Further, according to the invention of this embodiment, the advertisement display means 104 displays the advertisement when the movement of the moving object detected by the moving object detection means 102 is a predetermined movement, so the line of sight of the advertisement target person faces the advertisement. It is possible to provide an advertising system which can easily improve the visibility of advertisements and perform more effective advertising.
　また本実施形態の発明によれば、動体検出手段１０２は、動画撮影手段１０１によって撮影した動画内の動体を検出するので、即時性を高め、広告対象者の動画への興味を強めることができる。 Further, according to the invention of the present embodiment, the moving object detection means 102 detects the moving object in the moving image photographed by the moving image photographing means 101, so immediacy can be enhanced and the interest of the advertisement target person in the moving image can be intensified. .
　また本実施形態の発明によれば、動体検出手段１０２は、深度検出手段１０５によって検出した深度情報に基づいて動体の検出および動体の動きの検出を行うので、動体の検出および動体の動きの検出をより正確に行うことができる。 Further, according to the invention of this embodiment, the moving body detection means 102 detects the moving body and the movement of the moving body based on the depth information detected by the depth detecting means 105, so detection of the moving body and detection of the movement of the moving body Can be done more accurately.
　また本実施形態の発明によれば、動体検出手段１０２は、骨格検出手段１０６によって検出した骨格情報に基づいて動体の動きの検出を行うので、動体の動きの検出をより正確に行うことができる。 Further, according to the invention of the present embodiment, the moving body detection means 102 detects the movement of the moving body based on the skeleton information detected by the skeleton detection means 106, so that the movement of the moving body can be detected more accurately. .
　また本実施形態の発明によれば、広告決定手段１０７が、表示する広告をリアルタイムビッデイングによって決定するので、広告主側の要求と広告媒体側の要求とのバランスを取り、適正な広告を行う広告システムを提供することができる。 Further, according to the invention of this embodiment, the advertisement determination means 107 determines the advertisement to be displayed by real-time bidding, so that the request of the advertiser and the request of the advertisement medium are balanced to perform appropriate advertisement. An advertisement system can be provided.
　次に本発明に係る広告システムの実施例１について説明する。図２は、本発明に係る広告システムの実施例１の構成を示すブロック図である。本実施例の広告システム１０は、動画である映像を撮影するカメラ１１と、カメラ１１で撮影した映像内の各点の深度情報を取得するセンサ１２と、センサ１２から得た深度情報に基づき広告表示位置に配置した広告を出力するＰＣ（パソコン）１３と、装置同士の同期をとるＳＹＮＣ（シンクロナイザ）１４と、カメラ１１で撮影した映像にＰＣからの広告を合成して出力するスイッチャー１５と、スイッチャー１５からの広告が合成された映像を再生するモニタ１６と、を有して構成される。 Next, a first embodiment of the advertisement system according to the present invention will be described. FIG. 2 is a block diagram showing the configuration of the advertisement system according to the first embodiment of the present invention. The advertisement system 10 of the present embodiment advertises based on a camera 11 for capturing video which is a moving image, a sensor 12 for acquiring depth information of each point in the video captured by the camera 11, and depth information obtained from the sensor 12 A PC (personal computer) 13 for outputting an advertisement arranged at the display position, a SYNC (synchronizer) 14 for synchronizing the devices, and a switcher 15 for combining the advertisement from the PC with the image taken by the camera 11 and outputting it. And a monitor 16 for reproducing the video in which the advertisement from the switcher 15 is synthesized.
　カメラ１１は、図１の動画撮影手段１０１に相当する。センサ１２は、図１の動画撮影手段１０１、動体検出手段１０２および深度検出手段１０５に相当する。ＰＣ１３は、図１の広告表示領域決定手段１０３、広告表示手段および広告決定手段１０７に相当する。ＳＹＮＣ１４は、図１の広告表示手段１０４に相当する。スイッチャー１５は、図１の広告表示手段１０４に相当する。モニタ１６は、図１の広告表示手段１０４に相当する。センサ１２は、図１の動画撮影手段１０１、動体検出手段１０２、深度検出手段１０５および骨格検出手段１０６に相当するものであって、センサ１２からＰＣ１３に骨格情報が送信されるものであってもよい。 The camera 11 corresponds to the moving image shooting means 101 of FIG. The sensor 12 corresponds to the moving image capturing means 101, the moving object detecting means 102, and the depth detecting means 105 of FIG. The PC 13 corresponds to the advertisement display area determination unit 103, the advertisement display unit, and the advertisement determination unit 107 in FIG. The SYNC 14 corresponds to the advertisement display means 104 of FIG. The switcher 15 corresponds to the advertisement display means 104 of FIG. The monitor 16 corresponds to the advertisement display means 104 of FIG. The sensor 12 corresponds to the moving image photographing means 101, the moving object detection means 102, the depth detection means 105, and the skeleton detection means 106 of FIG. 1, and the skeleton information is transmitted from the sensor 12 to the PC 13. Good.
　カメラ１１で撮影した映像はスイッチャー１５に入力される。この映像はＨＤ－ＳＤＩによって伝送される。スイッチャー１５は、カメラ１１から入力された映像を、キャリブレーション用映像として、ＰＣ１３に出力する。このキャリブレーション用映像はＨＤ－ＳＤＩによって伝送される。センサ１２で取得した深度情報はＰＣ１３に入力される。センサ１２とＰＣ１３とはＵＳＢによって接続される。センサ１２は、例えば赤外線（他の光でもよい）を所定のパターンで動画撮影範囲内に照射し、そのパターンの幾何学的な歪み具合から対象物の３次元構造を復元し、深度情報を得るものであってもよい。また、センサ１２は、光の到達時間を基に距離を計測するＴＯＦ方式で深度情報を得るものであってもよい。 An image captured by the camera 11 is input to the switcher 15. This video is transmitted by HD-SDI. The switcher 15 outputs the video input from the camera 11 to the PC 13 as a calibration video. The calibration video is transmitted by HD-SDI. The depth information acquired by the sensor 12 is input to the PC 13. The sensor 12 and the PC 13 are connected by USB. The sensor 12 emits, for example, infrared light (or other light) with a predetermined pattern into the moving image shooting range, restores the three-dimensional structure of the object from the geometric distortion of the pattern, and obtains depth information It may be one. Further, the sensor 12 may obtain depth information by the TOF method in which the distance is measured based on the arrival time of light.
　ＰＣ１３では、スイッチャー１５から入力されたキャリブレーション用映像と、センサ１２から入力された深度情報に基づき、広告表示領域を決定する。また、ＰＣ１３では、不図示の記憶装置を備え、この記憶装置に複数種類の広告を記憶しておき、この複数種類の広告の中から今回表示する広告を決定する。ＰＣ１３からスイッチャー１５へは、ＨＤ－ＳＤＩによって、エフェクト（例えば広告）およびアルファ（例えばマスク情報）が送信される。このエフェクトおよびアルファによって、表示する広告および広告表示領域の情報が、ＰＣ１３からスイッチャー１５へ伝送される。 The PC 13 determines an advertisement display area based on the calibration image input from the switcher 15 and the depth information input from the sensor 12. In addition, the PC 13 includes a storage device (not shown), stores a plurality of types of advertisements in the storage device, and determines an advertisement to be displayed this time from among the plurality of types of advertisements. Effects (for example, advertisement) and alpha (for example, mask information) are transmitted from the PC 13 to the switcher 15 by HD-SDI. Information of the advertisement to be displayed and the advertisement display area is transmitted from the PC 13 to the switcher 15 by this effect and alpha.
　ＳＹＮＣ１４は、ＰＣ１３とスイッチャー１５との同期をとる。スイッチャー１５では、カメラ１１から入力された映像に対し、ＰＣ１３からのエフェクトおよびアルファにより、広告を合成し、エフェクト付き映像（広告が合成された映像）とし、これをモニタ１６に出力する。 The SYNC 14 synchronizes the PC 13 with the switcher 15. The switcher 15 synthesizes an advertisement with the video inputted from the camera 11 with the effect and alpha from the PC 13 to make a video with effect (a video on which the advertisement is synthesized) and outputs this to the monitor 16.
　図３は、実施例１の広告システムの処理の流れを示すフローチャートである。 FIG. 3 is a flowchart showing the flow of processing of the advertising system of the first embodiment.
　まず、カメラ１１およびセンサ１２による撮影を行う（ステップＳ３００）。続いて、ＰＣ１３では、スイッチャー１５からのキャリブレーション用映像およびセンサ１２からの深度情報を用いて、映像内の人物を認識する（ステップＳ３０１）。動体の認識については上述したが、認識した動体が人物であるか否かについては、例えば人物の特徴としてあらかじめ記憶してある情報（例えば、動体の形状、動き方）と、今回の動体についての情報とを照合し、一致あるいは近似である場合にその動体は人物であると判定すればよい。 First, photographing is performed by the camera 11 and the sensor 12 (step S300). Subsequently, the PC 13 recognizes a person in the image using the calibration image from the switcher 15 and the depth information from the sensor 12 (step S301). Although the recognition of the moving body has been described above, whether or not the recognized moving body is a person is, for example, information stored in advance as a feature of the person (for example, the shape of the moving body, movement manner) and the current moving body. Information may be collated, and in the case of coincidence or approximation, it may be determined that the moving body is a person.
　続いて、ＰＣ１３では、ステップＳ３０１で認識した人物の位置（例えば胸の位置）に広告を配置する（ステップＳ３０２）。この情報は、エフェクトおよびアルファとして、ＰＣ１３からスイッチャー１５に送られ、スイッチャー１５では、映像と広告とを合成（ステップＳ３０３）してエフェクト付き映像とし、このエフェクト付き映像をモニタ１６に出力する。エフェクト付き映像が入力されたモニタ１６では、そのエフェクト付き映像すなわち広告が合成された映像を再生する（ステップＳ３０４）。その後、停止であれば（ステップＳ３０５：Ｙｅｓ）、処理を終了し、継続するのであれば（ステップＳ３０５：Ｎｏ）、ステップＳ３００に戻って処理を繰り返す。 Subsequently, the PC 13 places an advertisement at the position (for example, the position of the chest) of the person recognized in step S301 (step S302). This information is sent from the PC 13 to the switcher 15 as an effect and alpha, and the switcher 15 combines the video and the advertisement (step S303) to create an image with effects, and outputs the video with effects to the monitor 16. The monitor 16 to which the effect-added video is input reproduces the effect-added video, that is, the image combined with the advertisement (step S304). After that, if it is a stop (step S305: Yes), the process ends, and if it continues (step S305: No), the process returns to step S300 and repeats the process.
　図４は、実施例１の広告システムの実行環境の一例を示す図である。この例では、スポーツ番組においてスポーツ選手のユニフォームの胸に広告を表示する場合を示している。図４において、サーバー２０は、図２に示したＰＣ１３、ＳＹＮＣ１４およびスイッチャー１５を備える。また、サーバー２０内のＰＣ１３は、例えばインターネットのようなネットワークによって、広告主のＰＣ２１ａ、ＰＣ２１ｂ、ＰＣ２１ｃと接続される。また、サーバー２０は、エフェクト付き映像を、複数の視聴者（広告対象者）のモニタ１６に配信する。このエフェクト付き映像の配信は、地上波によるテレビ放送でもよいし、衛星放送でもよいし、ケーブルテレビ放送でもよいし、ＹｏｕＴｕｂｅ（登録商標）やＤＡＺＮ（登録商標）のようなインターネットによる配信でもよいし、ＳＮＳによる配信であってもよい。 FIG. 4 is a diagram illustrating an example of an execution environment of the advertisement system of the first embodiment. In this example, the case of displaying an advertisement on the chest of the athlete's uniform in a sports program is shown. In FIG. 4, the server 20 includes the PC 13, the SYNC 14 and the switcher 15 shown in FIG. 2. Also, the PC 13 in the server 20 is connected to the advertiser's PC 21a, PC 21b, and PC 21c by a network such as the Internet, for example. Further, the server 20 distributes the effect-added video to the monitors 16 of a plurality of viewers (advertising target persons). The distribution of the effect-added video may be terrestrial television broadcasting, satellite broadcasting, cable television broadcasting, or Internet distribution such as YouTube (registered trademark) or DAZN (registered trademark). It may be delivery by SNS.
　図４に示すように、
（１）サーバー２０は、センサ１２によって得た深度情報から人物の体型を３Ｄモデル（人物３Ｄモデル）として認識する。
（２）広告主は、自身のＰＣ２１ａ、ＰＣ２１ｂ、ＰＣ２１ｃ（ＲＴＢにおけるＤＳＰ：デマンドサイドプラットフォーム）によって、今回の広告枠について、サーバー２０（ＲＴＢにおけるＳＳＰ：サプライサイドプラットフォーム）に対してリアルタイムに入札を行う
（３）サーバー２０では、入札額に応じて表示する広告を決定する。
（４）サーバー２０では、人物３Ｄモデル上に、表示すべき広告（（３）で決定した広告）をテクスチャとして貼り付ける。
（５）生放送サイト等に、カメラ１１による実際の映像に人物３Ｄモデルを重ねて配信する。このとき、人物３Ｄモデル自体は透明にしておくことで、視聴者のモニタ１６には表示されない。 As shown in Figure 4,
(1) The server 20 recognizes the human figure as a 3D model (person 3D model) from the depth information obtained by the sensor 12.
(2) The advertiser bids the server 20 (SSP in RTB: supply side platform) in real time for the advertisement space of this time with his own PC 21a, PC 21b, PC 21c (DSP in RTB: demand side platform) (3) The server 20 determines an advertisement to be displayed according to the bid amount.
(4) The server 20 pastes the advertisement to be displayed (the advertisement determined in (3)) as a texture on the person 3D model.
(5) On the live broadcast site etc., the person 3D model is superimposed on the actual video from the camera 11 and distributed. At this time, by making the person 3D model itself transparent, it is not displayed on the monitor 16 of the viewer.
　なお、図４では、スポーツ選手のユニフォームが、胸の位置に「Ａ社」と書かれたユニフォームであり、スタジアムで実際に観戦している観客に対しては、「Ａ社」の広告が行われていることになる。一方、配信されモニタ１６で再生された映像では、スポーツ選手のユニフォームの胸の位置には、ＲＴＢにおける入札で決定された広告が表示される。 In FIG. 4, the uniform of the athlete is a uniform with “A company” written on the chest position, and an advertisement of “A company” goes to the audience actually watching the game at the stadium. It will be. On the other hand, in the video delivered and reproduced on the monitor 16, the advertisement determined by the bid in the RTB is displayed at the chest position of the uniform of the athlete.
　また、本実施例によれば、メディアによって表示する広告を切り替えることができる。例えば、ＮＨＫによって配信する場合には、スポーツ選手のユニフォームを無地にして何ら広告が表示されない状態でモニタ１６に対して配信するようにしてもよい。 Further, according to the present embodiment, it is possible to switch the advertisement to be displayed by the media. For example, in the case of distributing by NHK, the uniform of the athlete may be made plain and distributed to the monitor 16 in a state where no advertisement is displayed.
　次に本発明に係る広告システムの実施例２について説明する。実施例２の構成を示すブロック図は、図２と同様であるので、ここでは、図２を参照してその説明は省略する。 Next, a second embodiment of the advertisement system according to the present invention will be described. The block diagram showing the configuration of the second embodiment is the same as that of FIG. 2, so that the description thereof will be omitted here with reference to FIG.
　図５は、実施例２の広告システムの処理の流れを示すフローチャートである。 FIG. 5 is a flowchart showing the flow of processing of the advertising system of the second embodiment.
　まず、カメラ１１およびセンサ１２による撮影を行う（ステップＳ５００）。続いて、ＰＣ１３では、スイッチャー１５からのキャリブレーション用映像およびセンサ１２からの深度情報を用いて、映像内の人物を認識する（ステップＳ５０１）。動体の認識については上述したが、認識した動体が人物であるか否かについては、例えば人物の特徴としてあらかじめ記憶してある情報（例えば、動体の形状、動き方）と、今回の動体についての情報とを照合し、一致あるいは近似である場合にその動体は人物であると判定すればよい。 First, photographing is performed by the camera 11 and the sensor 12 (step S500). Subsequently, the PC 13 recognizes a person in the image using the calibration image from the switcher 15 and the depth information from the sensor 12 (step S501). Although the recognition of the moving body has been described above, whether or not the recognized moving body is a person is, for example, information stored in advance as a feature of the person (for example, the shape of the moving body, movement manner) and the current moving body. Information may be collated, and in the case of coincidence or approximation, it may be determined that the moving body is a person.
　続いて、ＰＣ１３では、映像内の人物が所定の動きをしたか否かを判定する（ステップＳ５０２）。この動きの判定は、例えば骨格情報に基づいて行うことができる。図６に骨格情報の一例を示す。図６に示す骨格情報５０は、人体の各部のうち「頭」、「首」、「肩中央」、「右肩」、「右肘」、「右手首」、「右手」、「右手親指」、「右手先」、「左肩」、「左肘」、「左手首」、「左手」、「左手親指」、「左手先」、「背骨」、「腰中央」、「右腰」、「右膝」、「右かかと」、「右足」、「左腰」、「左膝」、「左かかと」、「左足」の２５か所の位置を示す。この２５か所の人体の各部の位置関係により、映像内の人物の動きを検出することができる。 Subsequently, the PC 13 determines whether or not the person in the video has moved in a predetermined manner (step S502). The determination of the movement can be performed based on, for example, skeleton information. An example of skeleton information is shown in FIG. The skeleton information 50 shown in FIG. 6 includes “head”, “neck”, “shoulder center”, “right shoulder”, “right elbow”, “right wrist”, “right hand”, and “right thumb” of the parts of the human body. , "Right hand tip", "left shoulder", "left elbow", "left wrist", "left hand", "left thumb", "left hand tip", "spine", "mid waist", "right hip", "right Indicate the position of 25 places of knees, right heel, right foot, left hip, left knee, left heel, and left foot. The movement of the person in the image can be detected by the positional relationship between the parts of the 25 human bodies.
　図５のステップＳ５０２において、映像内の人物の動きが所定の動き（例えばあらかじめ定めたポーズ、ピースサインやガッツポーズなど）でなければ（ステップＳ５０２：Ｎｏ）、ステップＳ５０５に進み、カメラ１１で撮影した映像をそのままでモニタ１６に出力し、モニタ１６ではカメラ１１で撮影した映像をそのまま再生する。その後、停止であれば（ステップＳ５０６：Ｙｅｓ）、処理を終了し、継続するのであれば（ステップＳ５０６：Ｎｏ）、ステップＳ５００に戻って処理を繰り返す。 If the movement of the person in the image is not a predetermined movement (for example, a predetermined pose, piece sign, guts pose, etc.) in step S 502 in FIG. 5 (step S 502: No), the process proceeds to step S 505 and the camera 11 captures an image. The obtained video is output as it is to the monitor 16, and the monitor 16 reproduces the video taken by the camera 11 as it is. Then, if it is a stop (Step S506: Yes), processing will be ended, and if it continues (Step S506: No), it will return to Step S500 and will repeat processing.
　ステップＳ５０２において、映像内の人物の動きが所定の動きである場合（ステップＳ５０２：Ｙｅｓ）には、ステップＳ５０３に進む。ステップＳ５０３では、あらかじめ定めた位置（人物に重ねてもよいし、映像内の他の位置でもよい。）に広告を配置する。この情報は、エフェクトおよびアルファとして、ＰＣ１３からスイッチャー１５に送られ、スイッチャー１５では、映像と広告とを合成（ステップＳ５０４）してエフェクト付き映像とし、このエフェクト付き映像をモニタ１６に出力する。エフェクト付き映像が入力されたモニタ１６では、そのエフェクト付き映像すなわち広告が合成された映像を再生する（ステップＳ５０５）。その後、停止であれば（ステップＳ５０６：Ｙｅｓ）、処理を終了し、継続するのであれば（ステップＳ５０６：Ｎｏ）、ステップＳ５００に戻って処理を繰り返す。 In step S502, if the motion of the person in the video is a predetermined motion (step S502: Yes), the process proceeds to step S503. In step S503, an advertisement is placed at a predetermined position (may be superimposed on a person or may be another position in the video). This information is sent from the PC 13 to the switcher 15 as an effect and alpha, and the switcher 15 combines the video and the advertisement (step S504) to create an image with effects, and outputs the video with effects to the monitor 16. The monitor 16 to which the effect-added video is input reproduces the effect-added video, that is, the image combined with the advertisement (step S505). Then, if it is a stop (Step S506: Yes), processing will be ended, and if it continues (Step S506: No), it will return to Step S500 and will repeat processing.
　図７は、実施例２の広告システムの実行環境の一例を示す図である。この例では、アイドルのライブイベントにおいて、イベント会場でアイドルが歌唱するとともに、その様子を大型のモニタであるモニタ１６で同時上映しており、アイドルが右手を上げる動作をしたとき（特定の振り付けを実行したとき）にモニタ１６に広告を表示する場合を示している。図７において、ＰＣ３０は、図２に示したＰＣ１３、ＳＹＮＣ１４およびスイッチャー１５を備える。また、このライブイベントにおいては、スポンサー３１が出資をし、このスポンサー３１が決めた広告「Ｂ社のキャンディ」がモニタ１６に表示される。 FIG. 7 is a diagram illustrating an example of the execution environment of the advertisement system of the second embodiment. In this example, at the live event of the idol, the idol sings at the event site and the situation is simultaneously screened on the monitor 16, which is a large monitor, and when the idol moves to raise the right hand (specific choreography The case where an advertisement is displayed on the monitor 16 when it is executed is shown. In FIG. 7, the PC 30 includes the PC 13, the SYNC 14 and the switcher 15 shown in FIG. 2. Also, in this live event, the sponsor 31 makes a contribution, and the advertisement “Candy of Company B” decided by the sponsor 31 is displayed on the monitor 16.
　図７に示すように、
（１）ＰＣ３０は、センサ１２によって得た深度情報から人物の体型を３Ｄモデル（人物３Ｄモデル）として認識する。
（２）ＰＣ３０は、センサ１２によって得た深度情報から人物の骨格位置（例えば骨格情報５０）を推測する。
（３）ＰＣ３０は、推測した骨格位置を用いて、骨格の動きから特定の振り付け（ポーズ）が行われたかを判定する。図７では、アイドルが右手を上げる動作を、特定の振り付けとしている。
（４）特定の振り付けが認識されたならば、スポンサー３１によってあらかじめ定められた広告（例えばＰＣ３０の不図示の記憶装置にあらかじめ記憶してある広告）を重ねてモニタ１６に表示する。 As shown in FIG.
(1) The PC 30 recognizes the human figure as a 3D model (human 3D model) from the depth information obtained by the sensor 12.
(2) The PC 30 estimates the skeleton position (for example, skeleton information 50) of the person from the depth information obtained by the sensor 12.
(3) The PC 30 uses the inferred skeleton position to determine from the movement of the skeleton whether or not a specific choreography (pose) has been performed. In FIG. 7, an action in which the idle raises the right hand is a specific choreography.
(4) If a specific choreography is recognized, an advertisement predetermined by the sponsor 31 (for example, an advertisement stored in advance in a storage device (not shown) of the PC 30) is superimposed and displayed on the monitor 16.
　以上、本発明の好ましい実施形態について説明したが、本発明は、これらの実施形態に限定されるものではない。本発明の目的は、上述の実施例の機能を実現するプログラムコード（コンピュータプログラム）を格納した記憶媒体をシステムあるいは装置に供給し、供給されたシステムあるいは装置のコンピュータが記憶媒体に格納されたプログラムコードを読み出し実行することによっても達成される。この場合、記憶媒体から読み出されたプログラムコード自体が上述した実施例の機能を実現することになり、そのプログラムコードを記憶した記憶媒体は本発明を構成することになる。また、上述した実施形態では、コンピュータがプログラムを実行することにより、各処理部として機能するものとしたが、処理の一部または全部を専用の電子回路（ハードウェア）で構成するようにしても構わない。本発明は、説明された特定の実施例に限定されるものではなく、特許請求の範囲に記載された本発明の趣旨の範囲内において、種々の変形・変更が可能である。 Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments. An object of the present invention is to provide a system or apparatus with a storage medium storing a program code (computer program) for realizing the functions of the embodiments described above, and a computer of the system or apparatus supplied is stored in the storage medium. It is also achieved by reading and executing the code. In this case, the program code itself read from the storage medium implements the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. In the above-described embodiment, the computer functions as each processing unit by executing the program, but part or all of the processing may be configured by a dedicated electronic circuit (hardware). I do not care. The present invention is not limited to the specific embodiments described, but various modifications and variations are possible within the scope of the present invention as set forth in the claims.
　本出願は、２０１７年１０月２０日に出願された日本特許出願である特願２０１７－２０３３０３号に基づく優先権を主張し、当該日本特許出願に記載されたすべての記載内容を援用する。 This application claims priority based on Japanese Patent Application No. 2017-203303 filed on Oct. 20, 2017, and incorporates the entire contents described in the Japanese Patent Application.
１０　広告システム
１１　カメラ
１２　センサ
１３　ＰＣ（パソコン）
１４　ＳＹＮＣ（シンクロナイザ）
１５　スイッチャー
１６　モニタ
２０　サーバー
２１ａ、２１ｂ、２１ｃ　ＰＣ（パソコン）
３０　ＰＣ（パソコン）
３１　スポンサー
１００　広告システム
１０１　動画撮影手段
１０２　動体検出手段
１０３　広告表示領域決定手段
１０４　広告表示手段
１０５　深度検出手段
１０６　骨格検出手段
１０７　広告決定手段
  10 advertising system 11 camera 12 sensor 13 PC (PC)
14 SYNC (synchronizer)
15 Switcher 16 Monitor 20 Server 21a, 21b, 21c PC (PC)
30 PC (PC)
31 Sponsor 100 Advertising system 101 Movie shooting means 102 Moving object detection means 103 Advertisement display area determination means 104 Advertisement display means 105 Depth detection means 106 Skeleton detection means 107 Advertisement determination means

Claims (8)

  1. 　動画再生中に該再生中の動画内に広告を表示する広告システムであって、
    　動画内の動体を検出するとともに、検出した動体の動きを検出する動体検出手段と、
    　前記動体検出手段によって検出した動体の動きに基づいて広告を表示する広告表示手段と、
    を備えたことを特徴とする広告システム。     An advertisement system for displaying an advertisement in a video being played back during video playback,
    Moving object detection means for detecting a moving object in a moving image and detecting the detected movement of the moving object;
    Advertisement display means for displaying an advertisement based on the movement of the moving body detected by the moving body detection means;
    An advertising system characterized by comprising.
  2. 　前記動体検出手段によって検出した動体における所定箇所を広告表示領域として決定する広告表示領域決定手段をさらに備え、
    　前記広告表示手段は、動画再生中に、該再生中の動画内の動体の動きに伴って移動する前記広告表示領域に広告を表示する、
    ことを特徴とする請求項１に記載の広告システム。     The apparatus further comprises advertisement display area determination means for determining a predetermined part of the moving body detected by the moving body detection means as an advertisement display area.
    The advertisement display means displays an advertisement in the advertisement display area which moves along with the movement of a moving body in the moving image being reproduced during the reproduction of the moving image.
    The advertising system according to claim 1, characterized in that.
  3. 　前記広告表示領域決定手段は、前記動体検出手段によって検出した動体におけるマーク位置を前記広告表示領域として決定する、
    ことを特徴とする請求項２に記載の広告システム。     The advertisement display area determining means determines, as the advertisement display area, a mark position on the moving object detected by the moving object detecting means.
    The advertising system according to claim 2, characterized in that:
  4. 　前記広告表示手段は、動画再生中に、該再生中の動画内の動体の動きが所定の動きであったときに広告を表示する、
    ことを特徴とする請求項１～３のいずれか１項に記載の広告システム。     The advertisement display means displays an advertisement when the motion of the moving body in the moving image being reproduced is a predetermined movement during the reproduction of the moving image.
    The advertising system according to any one of claims 1 to 3, characterized in that:
  5. 　動画を撮影する動画撮影手段をさらに備え、
    　前記動体検出手段は、前記動画撮影手段によって撮影した動画内の動体を検出する、
    ことを特徴とする請求項１～４のいずれか１項に記載の広告システム。     It is further equipped with moving picture shooting means to shoot moving pictures,
    The moving object detection unit detects a moving object in a moving image captured by the moving image capturing unit.
    The advertising system according to any one of claims 1 to 4, characterized in that:
  6. 　前記動体検出手段は、動画内の複数個所のそれぞれの深度を示す深度情報を検出する深度検出手段を有し、
    　前記動体検出手段は、前記深度検出手段によって検出した深度情報に基づいて動体の検出および動体の動きの検出を行う、
    ことを特徴とする請求項１～５のいずれか１項に記載の広告システム。     The moving object detection means includes depth detection means for detecting depth information indicating depths of a plurality of places in a moving image,
    The moving object detecting means detects a moving object and detects a motion of the moving object based on the depth information detected by the depth detecting means.
    The advertising system according to any one of claims 1 to 5, characterized in that:
  7. 　前記動体検出手段は、動画内の動体の骨格を示す骨格情報を検出する骨格検出手段を有し、
    　前記動体検出手段は、前記骨格検出手段によって検出した骨格情報に基づいて動体の動きの検出を行う、
    ことを特徴とする請求項１～６のいずれか１項に記載の広告システム。     The moving body detection means has a skeleton detection means for detecting skeleton information indicating the skeleton of the moving body in the moving image,
    The moving body detection means detects movement of the moving body based on the skeleton information detected by the skeleton detection means.
    The advertising system according to any one of claims 1 to 6, characterized in that:
  8. 　前記広告表示手段は、表示する広告を、リアルタイムビッデイングによって決定する広告決定手段を有する、
    ことを特徴とする請求項１～７のいずれか１項に記載の広告システム。
          The advertisement display means has an advertisement determination means for determining an advertisement to be displayed by real-time bidding.
    The advertising system according to any one of claims 1 to 7, characterized in that:
PCT/JP2018/037366 2017-10-20 2018-10-05 Advertisement system WO2019078038A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017203303A JP2021016015A (en) 2017-10-20 2017-10-20 Advertisement system
JP2017-203303 2017-10-20

Publications (1)

Publication Number Publication Date
WO2019078038A1 true WO2019078038A1 (en) 2019-04-25

Family

ID=66174469

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/037366 WO2019078038A1 (en) 2017-10-20 2018-10-05 Advertisement system

Country Status (2)

Country Link
JP (1) JP2021016015A (en)
WO (1) WO2019078038A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6942898B1 (en) * 2021-02-12 2021-09-29 株式会社オプティム Programs, methods, information processing equipment, systems

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006293999A (en) * 2005-03-15 2006-10-26 Kyushu Institute Of Technology Apparatus and method for displaying image
JP2009109887A (en) * 2007-10-31 2009-05-21 Akiji Nagasawa Synthetic program, recording medium and synthesizer
JP2012000165A (en) * 2010-06-14 2012-01-05 Sega Corp Video game apparatus
JP2014071494A (en) * 2012-09-27 2014-04-21 Toppan Printing Co Ltd Information management server, information upload system, information upload method, and information upload program
WO2014069247A1 (en) * 2012-11-02 2014-05-08 ソニー株式会社 Image processing device, image processing method, and program
JP2015135583A (en) * 2014-01-16 2015-07-27 ヤフー株式会社 Determination device, determination method, determination program, distribution device, distribution method, distribution program, and bidding device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006293999A (en) * 2005-03-15 2006-10-26 Kyushu Institute Of Technology Apparatus and method for displaying image
JP2009109887A (en) * 2007-10-31 2009-05-21 Akiji Nagasawa Synthetic program, recording medium and synthesizer
JP2012000165A (en) * 2010-06-14 2012-01-05 Sega Corp Video game apparatus
JP2014071494A (en) * 2012-09-27 2014-04-21 Toppan Printing Co Ltd Information management server, information upload system, information upload method, and information upload program
WO2014069247A1 (en) * 2012-11-02 2014-05-08 ソニー株式会社 Image processing device, image processing method, and program
JP2015135583A (en) * 2014-01-16 2015-07-27 ヤフー株式会社 Determination device, determination method, determination program, distribution device, distribution method, distribution program, and bidding device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6942898B1 (en) * 2021-02-12 2021-09-29 株式会社オプティム Programs, methods, information processing equipment, systems
WO2022172259A1 (en) * 2021-02-12 2022-08-18 株式会社オプティム Program, method, information processing device, and system
JP2022123345A (en) * 2021-02-12 2022-08-24 株式会社オプティム Program, method, information processing device and system

Also Published As

Publication number Publication date
JP2021016015A (en) 2021-02-12

Similar Documents

Publication Publication Date Title
JP6715441B2 (en) Augmented reality display system, terminal device and augmented reality display method
JP7041253B2 (en) Presentation of virtual reality in real world space
US10271040B1 (en) Dynamic angle viewing system
US9196093B2 (en) Information presentation device, digital camera, head mount display, projector, information presentation method and non-transitory computer readable medium
US20110008017A1 (en) Real time video inclusion system
KR20150030993A (en) Apparatus and method for providing contents experience service
US10896322B2 (en) Information processing device, information processing system, facial image output method, and program
JP2018182428A (en) Video distribution device, video distribution system, and video distribution method
US11995768B2 (en) VR live broadcasting distribution system, distribution server, control method for distribution server control method, program for distribution server, and data structure of VR picture data
KR20200132445A (en) System for providing ar commercial service using event promotion based on ar and realtime broadcasting technology
CN107241610A (en) A kind of virtual content insertion system and method based on augmented reality
TW201916666A (en) Mobile display device, image supply device, display system, and program
JP2023053039A (en) Information processing apparatus, information processing method and program
JP2008167127A (en) Video distributing method and video distributing device
WO2019078038A1 (en) Advertisement system
JP2011017883A (en) Target specifying system, target specifying method, advertisement output system, and advertisement output method
JP6775669B2 (en) Information processing device
JP6609078B1 (en) Content distribution system, content distribution method, and content distribution program
JP6559375B1 (en) Content distribution system, content distribution method, and content distribution program
JP5916365B2 (en) Video transmission system, video transmission method, and computer program
JP6942898B1 (en) Programs, methods, information processing equipment, systems
TWI622298B (en) Advertisement image generation system and advertisement image generating method thereof
US20230415040A1 (en) Image generation apparatus, image generation method, and program
WO2018173206A1 (en) Information processing device
JP7182915B2 (en) Image generation device, image generation method, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18867581

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18867581

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP