JP2020013552A - Terminal device, browsing system, display method, and program - Google Patents

Abstract

To provide a browsing system that can improve the effect of distribution of an image used for advertisement.SOLUTION: A terminal device displaying an (advertisement) image transmitted from an image distribution device comprises: receiving means that receives data of 2DCG and data of 3DCG transmitted by the image distribution device; and display control means that displays a predetermined area image (A11) indicating a predetermined area of the 2DCG as a back image and displays the 3DCG (B11) as a front image on the back image.SELECTED DRAWING: Figure 24

Description

  The present disclosure relates to a terminal device, a browsing system, a display method, and a program.

  2. Description of the Related Art A distribution type display advertisement in which an advertiser displays an advertisement in an advertisement space provided on a web page is known. Advertisers can display advertisements for products and services in advertisement spaces provided by various websites. A viewer interested in the product or service displayed in the advertisement frame clicks (or taps) on the advertisement frame, so that the advertiser can call the viewer to the company's Web site.

  Advertisers want to increase the frequency at which viewers click on advertisements, but the number of advertisements posted on one Web page is on the rise, and advertisers are devising display methods that draw the viewer's attention. (For example, see Patent Document 1). Patent Literature 1 discloses a technique for increasing the effect (click rate) of an advertisement by distributing a moving image advertisement. Since a person tends to be deprived of a line of sight by a moving object, it is possible to increase the degree of attention of the advertisement and improve the effect of the advertisement.

  However, in the case of a moving image, only the image changes in chronological order, and the moving image cannot be displayed in a manner expected to interest the viewer. Therefore, the click rate cannot always be improved.

  The present invention has been made in view of the above circumstances, and has as its object to provide a browsing system capable of further improving the effect of distributing an image used for an advertisement or the like.

  The present invention is a terminal device for displaying an image transmitted from an image distribution device, a receiving unit for receiving data of the image transmitted by the image distribution device and data of 3DCG, and a predetermined region of the image. A display control means for displaying the specified area image as a back image and displaying the 3DCG as a front image on the back image. It is.

  A browsing system capable of further improving the effect of distributing an image used for an advertisement or the like can be provided.

It is an example of a figure explaining a whole celestial sphere image as an example of a wide-angle image. It is an example of a figure explaining the outline of a browsing system. It is an example of a schematic block diagram of a browsing system. 1 is an example of a block diagram illustrating a schematic hardware configuration of a terminal device, an advertiser Web server, a partner site Web server, a DSP, an SSP, and an image distribution device. It is an example of the use image figure of a spherical camera. FIG. 4 is a diagram for explaining an outline of processing from creation of an omnidirectional image from an image captured by an omnidirectional camera. FIG. 4 is a diagram for explaining an outline of processing from creation of an omnidirectional image from an image captured by an omnidirectional camera. It is an example of a figure explaining a look of a visitor. It is an example of the functional block diagram which shows the function of a terminal device, an advertiser Web server, a partner site Web server, an image distribution apparatus, SSP, and DSP in block form. It is an example of a flowchart figure which shows the procedure which an attention area | region determination part determines an attention area | region. It is an example of a figure explaining the partial image of the omnidirectional image. FIG. 4 is an example of a diagram schematically illustrating information used by a Web page. FIG. 5 is an example of a sequence diagram illustrating a procedure in which the browsing system distributes a spherical image serving as an advertisement. FIG. 11 is an example of a sequence diagram illustrating a procedure in which the image distribution device updates the number of clicks for each display pattern. It is a figure which shows typically the display of the attention area based on a display pattern. It is an example of the figure which illustrates enlargement or reduction typically. FIG. 3 is an example of a diagram schematically illustrating an example of a movement amount and a movement speed with respect to time. It is an example of a figure explaining the moving speed from coordinate 1 to coordinate 2. It is an example of the flowchart figure which shows the procedure in which an advertising display part displays a whole celestial sphere image based on a display pattern. It is an example of a figure explaining switching of a display pattern. It is an example of the flowchart figure which shows the procedure which a terminal device switches a display pattern. FIG. 11 is an example of a flowchart illustrating a procedure in which an advertisement distribution unit of the image distribution device suppresses distribution of a spherical image in the same display pattern. FIG. 9 is a diagram illustrating a change in coordinates in the case of a moving image in which the imaging position hardly moves. It is a screen example which displayed 3DCG of a ring as a front image on the background image of the jewelry store. It is a screen example which displayed 3DCG of a ring as a front image on the background image of the jewelry store. It is a screen example which displayed 3DCG of a ring as a front image on the background image of the jewelry store. It is the figure which showed 3DCG of the ring from a different viewpoint.

  Hereinafter, a browsing system and an image distribution method performed by the browsing system will be described with reference to the drawings as an example of an embodiment for implementing the present invention.

<Outline of Electronic Device System of Present Embodiment>
FIG. 1 is an example of a diagram illustrating an omnidirectional image 6 as an example of a wide-angle image. FIG. 1A shows an omnidirectional image 6 represented by a three-dimensional solid sphere CS, and FIG. 1B shows an image represented by an equirectangular projection (hereinafter referred to as an “equidistant cylindrical projection image”). ") Is shown. The spherical image 6 generated by the spherical camera has a three-dimensional structure in which an equirectangular projected image as shown in FIG. The virtual camera IC corresponds to the viewpoint of the viewer, and the viewpoint is at the center of the spherical image 6 in FIG. The viewer rotates three axes around the X, Y, and Z axes passing through the virtual camera IC, and sets an arbitrary area of the omnidirectional image 6 as the predetermined area image Q on the display of the terminal device 30. Can be displayed.

FIG. 2 is a diagram illustrating an outline of the browsing system 100 according to the present embodiment. In the present embodiment, a browsing system 100 that uses the omnidirectional image 6 for an advertisement distributed by a third party will be described. Third-party distribution is a mechanism in which an advertiser distributes an advertisement across multiple media in order to manage the entire campaign. The third-party distribution server performs control such as distribution frequency of the advertisement and measurement of the effect of the advertisement. In FIG. 2, the image distribution device 10 corresponds to a third-party distribution server.
(S1) When the terminal device 30 opens the Web page having the advertising space 7 with the browser 8, the DSP 20 (Demand-Side Platform) that wants to display an advertisement on the terminal device 30 is notified to the terminal device 30. The terminal device 30 requests the DSP 20 for an advertisement.
(S2) The DSP 20 requests an advertisement from the image distribution device 10.
(S3) The image distribution device 10 stores the advertisement request, generates access information a2 for the terminal device 30 to access the device itself, and transmits the access information a2 to the DSP 20.
(S4) The DSP 20 transmits the received access information a2 to the terminal device 30.
(S5) The terminal device 30 requests advertisement data (omnidirectional image 6, 3DCG (Three-Dimensional Computer Graphics)) from the image distribution device 10 based on the access information a2. The image distribution device 10 of the present embodiment indicates a plurality of attention areas A of the celestial sphere image 6 (each attention area is represented by An (n: natural number), and any attention area is simply indicated by “P”) (coordinates). ) Data and data indicating the angle of view are held. In addition, the image distribution device 10 sets the data and the size (vertical x) of a plurality of 3D CG viewpoint directions B (each viewpoint direction is represented by Bn (n: natural number), and an arbitrary region of interest is simply indicated by "B"). Data indicating the number of horizontal pixels). Note that data indicating the enlargement ratio and the reduction ratio instead of the size may be used.
(S6) The image distribution device 10 transmits the advertisement data requested by the access information a2 to the terminal device 30.
(S7) The terminal device 30 receives the advertisement data, and the browser 8 operating on the terminal device 30 displays the plurality of attention areas A in the omnidirectional image 6 as the predetermined area image Q according to the display order (area display order information). I do. For example, the omnidirectional image 6 in FIG. 2 holds three regions of interest A and the angles of view of each region of interest A, and the region of interest A1 (angle of view 1) → region of interest A2 even if the viewer does not operate. The omnidirectional image 6 that rotates in the order of (view angle 2) → attention area A3 (view angle 3) is generated as advertisement data. Further, the browser 8 operating on the terminal device 30 displays 3DCG (here, “B1”) according to the display order (viewpoint display order information) in a plurality of viewpoint directions. In this case, the predetermined area image is the back image, and the front image as 3DCG is superimposed and displayed on the back image.

  Here, the predetermined area T is specified by the attention area A and the angle of view in the omnidirectional image 6. If the angle of view is the initial setting, the attention area A = the predetermined area T. When the angle of view is set to be large, attention area A> predetermined area T, and attention area A is displayed enlarged on the display. On the other hand, if the angle of view is set small, the attention area A <the predetermined area T, and the attention area A is displayed on the display in a reduced size. That is, when the angle of view is set to be small, the attention area A and images around the attention area A are displayed on the display.

  According to the browsing system 100 of the present embodiment, the terminal device 30 can automatically display the region of interest corresponding to the characteristic portion of the celestial sphere image 6 and the direction of the viewpoint of 3DCG independently as a moving image. Will be more interesting. In addition, since the image is displayed as if zoomed in (enlarged) or zoomed out (reduced) by changing the angle of view, it is possible to make the viewer more noticeable. The browsing system 100 according to the present embodiment displays an advertisement that is difficult to list as a whole celestial sphere image by highlighting a part that the advertiser wants to see, thereby reducing the effect of the advertisement (click Rate) can be improved.

  The omnidirectional image is an example of a captured image obtained by being captured by the omnidirectional camera. As long as it is a captured image, it may be a normal plane image instead of a spherical image. In addition, the effect of the advertisement is to at least draw attention, but a further click (or tap) by the viewer may be referred to as an effect.

The display order of the display areas is indicated by the area display order information, and the order in which the later-described advertisement display unit 40 of the terminal device 30 changes the area of interest and the angle of view of the omnidirectional image and displays the images in the advertisement frame 7 It is. Part of the whole celestial sphere image may be arbitrarily wide or narrow, and may be in the order in which the centers of a plurality of viewpoints indicating the display area are displayed. The display order of the viewpoint directions is indicated by the viewpoint display order information, and is the order in which the later-described advertisement display unit 40 of the terminal device 30 changes the viewpoint direction of the 3DCG and displays the 3DCG in the advertisement frame 7.
The advertisement display unit 40 is an example of a display control unit.

<System configuration example>
FIG. 3 is an example of a schematic configuration diagram of the browsing system 100. The browsing system 100 includes a terminal device 30, an image distribution device 10, a DSP 20, an SSP (Supply Side Platform) 50, a partner site Web server 60, and an advertiser Web server 70 that can communicate via the network N. .

  The network N is configured by a LAN constructed in a facility where the terminal device 30 is installed, a provider network of a provider connecting the LAN to the Internet, a line provided by a line carrier, and the like. When the network N has a plurality of LANs, the network N is called a WAN or the Internet. The network N may be configured by either wired or wireless, or a combination of wired and wireless. When the terminal device 30 is directly connected to a public line network, it can be connected to a provider network without going through a LAN.

  The terminal device 30 is an information processing device that operates as a client terminal in the present embodiment. In the terminal device 30, the browser 8 or application software having a function equivalent to the browser 8 is operating. The terminal device 30 receives a Web page requested by the terminal device 30 from the partner site Web server 60 and displays the Web page (LCD: Liquid Crystal Display described later). To be displayed.

  The terminal device 30 is, for example, a PC (Personal Computer), a tablet device, a smartphone, a PDA (Personal Digital Assistant), a game machine, a navigation terminal, a wearable PC, or the like, as long as it can display a Web page. For example, when the printer has a function of displaying a Web page or a display, the printer may be used as the terminal device 30. In addition, the digital signage may display a Web page. Digital signage is a system that transmits information using an electronic display device such as a display at a place where people can pass or exist, such as outdoors, stores, public spaces, and transportation, a display device or information to be displayed. Say. In the present embodiment, it is assumed that the Web page includes the Web application. A Web application refers to software or a mechanism used by a program in a programming language (for example, JavaScript (registered trademark)) operating on a Web browser and a program on a Web server side operating in cooperation with each other and used on the Web browser. .

  The terminal device 30 may be connected to the network N via a wired LAN or a wireless LAN access point, or may be connected to the network N by switching line type communication such as 3G, 4G or LTE (Long Term Evolution). Is also good.

  The partner site Web server 60 is a server (a general information processing device) that provides information and functions to a client computer (the terminal device 30 of the present embodiment) used by a viewer through a network. An advertisement space 7 is provided on a Web page provided by the advertiser Web server 70. The partner site Web server 60 requests the SSP 50 to display an advertisement in the advertisement space 7.

  The advertiser Web server 70 is also a server (general information processing device) that provides information and functions to a client computer (the terminal device 30 of the present embodiment) used by a viewer through a network. When the viewer clicks (or taps) the advertisement space 7, the terminal device 30 accesses the advertiser Web server 70. The advertiser Web server 70 is operated by an advertiser, requests the DSP 20 to purchase an advertisement space 7 for displaying an advertisement of its product or service, and requests the image distribution device 10 to generate an advertisement and display the advertisement. ing.

  The advertiser Web server 70 and partner site Web server 60 communicate with the terminal device 30 using, for example, HTTP or a communication protocol of HTTPs. The advertiser Web server 70 and the partner site Web server 60 transmit screen information to the terminal device 30 in response to a request from the terminal device 30. The screen information is a program described in HTML, a script language, and CSS (cascading style sheet). The structure of the Web page is mainly specified by HTML, the operation of the Web page is specified by the script language, and the Web is specified by CSS. The style of the page is specified. In the present embodiment, it is a script language that reflects the operation of the viewer on the Web page on the omnidirectional image 6. As a script language, specifically, a program language called JavaScript (registered trademark) or ECMAScript is known.

  Both the advertiser Web server 70 and the partner site Web server 60 record cookies on the terminal device 30. The advertiser Web server 70 records both its own cookie and the DSP 20 cookie, and the partner site Web server 60 records both its own cookie and the SSP 50 cookie.

  The SSP 50 is a mechanism for maximizing profit by selling the advertising space 7 by the partner site Web server 60 that posts the advertising space 7. Although illustrated as one device in the figure, it is a network of one or more information processing devices. The partner site Web server 60 requests the SSP 50 to sell the advertising space 7. Specifically, an advertisement tag issued by the SSP 50 is described in the advertisement space 7, and when the terminal device 30 displays a Web page of the partner site Web server 60, the advertisement tag requests the SSP 50 to distribute an advertisement (ad request). . The SSP 50 receives a bid for the advertising space 7 from the DSP 20 and transmits access information a1 for accessing the DSP 20 that has won the bid to the terminal device 30.

  The DSP 20 is a mechanism for efficiently and effectively delivering advertisements for advertisers, such as buying advertisement spaces 7 and delivering advertisements. Although illustrated as one device in the figure, it is a network of one or more information processing devices. That is, the DSP 20 obtains a cookie (referred to as an SSP cookie for discrimination) or the like from the SSP 50, and determines the attribute of the viewer based on the association information between the DSP cookie managed by itself and the SSP cookie. Then, it bids on the SSP 50 at a price determined based on the distribution setting of the advertisement from the advertiser requesting based on the attributes of the viewer, the budget, and the like.

  The DSP 20 that has won the bid is requested for an advertisement from the terminal device 30 based on the access information a1. The DSP 20 notifies the image distribution device 10 of the advertisement request, and acquires the access information a2 for the terminal device 30 to request the advertisement data from the image distribution device 10 to the image distribution device 10. The advertisement data includes a display program for displaying the spherical image 6 and an operation history program for acquiring an operation history.

  The DSP 20 transmits the access information a2 to the terminal device 30. The DSP 20 charges the advertiser according to the contract. Charging is performed between the image distribution apparatus 10 and the advertiser according to the contract. However, whether or not a fee is charged only for displaying an advertisement depends on the contract.

  The image distribution device 10 is one or more information processing devices that provide advertisement data including an advertisement material (omnidirectional image 6) that is optimal for the attribute of the viewer to the advertisement space 7 purchased by the DSP 20. The image distribution device 10 holds input materials such as banners and texts and advertisement images. The advertising data may be a simple banner (an image made of characters, pictures, or pictures), or may include a script language in addition to the image. In the present embodiment, a plurality of predetermined regions of the omnidirectional image 6 are changed and displayed in the display order, the viewpoint direction of the 3DCD is changed and displayed in the display order, and an operation of the viewer on the omnidirectional image 6 is performed. A display program for reflecting the display mode of the omnidirectional image 6 and an operation history program for recording an operation history for the omnidirectional image 6 are included. Both are described in a script language.

  When the terminal device 30 requests the advertisement data from the image distribution device 10 based on the access information a2, the image distribution device 10 transmits the advertisement data to the terminal device 30. The advertisement data includes the omnidirectional image 6 and 3DCG, and an advertisement display unit 40 described later changes, enlarges or reduces the attention area (predetermined area) of the omnidirectional image 6 by a display program. To display. In addition, the advertisement display unit 40 changes the viewpoint direction of the 3DCG and displays it by the display program. In addition, the operation history program transmits the operation history of the omnidirectional image 6 and the 3DCG to the image distribution device 10 together with the cookie (referred to as an image cookie for distinction) and the image ID of the image distribution device 10. The operation history is, for example, information indicating which attention area and angle of view of the omnidirectional image 6 is displayed, or which viewpoint direction and size (the number of vertical pixels × horizontal pixels) 3DCG is displayed. Since this operation history is used for determining the region of interest and the direction of the viewpoint, the operation history may not be transmitted if the operation history is not used for determining the region of interest or the direction of the viewpoint.

  Further, the operation history program transmits to the image distribution device 10 that the click has been made, together with a pattern ID of a display pattern described later. The image distribution device 10 determines display patterns of a plurality of (attention regions) predetermined regions with respect to one celestial sphere image 6, and monitors the click rates of the respective display patterns so that only display patterns having a high click rate are displayed. Be able to deliver. Similarly, the image distribution device 10 determines display patterns in a plurality of viewpoint directions for one 3DCG, and monitors the click rate of each display pattern, thereby distributing only display patterns with a high click rate. .

<Example of hardware configuration>
FIG. 4 is a block diagram illustrating a schematic hardware configuration of the terminal device 30. Terminal device 30 can be generally implemented as a personal computer, workstation, or appliance server. The terminal device 30 includes a CPU 201 and a memory 202 that enables high-speed access to data used by the CPU 201. The CPU 201 and the memory 202 are connected to other devices or drivers, such as a graphics driver 204 and a network device (NIC) 205, of the terminal device 30 via a system bus 203.

  The graphics driver 204 is connected to an LCD (display device) 206 via a bus, and monitors processing results by the CPU 201. A touch panel may be integrally provided on the LCD 206. In this case, the viewer can operate the terminal device 30 using a finger as the operation means.

  Further, the network driver 205 connects the terminal device 30 to the network N at the transport layer level and the physical layer level, and establishes a session with the advertiser Web server 70 and the like.

  An I / O bus bridge 207 is further connected to the system bus 203. On the downstream side of the I / O bus bridge 207, a storage device such as an HDD 209 is connected via an I / O bus 208 such as PCI by IDE, ATA, ATAPI, serial ATA, SCSI, USB, or the like. . An SSD (Solid State Drive) may be provided instead of the HDD 209 or together with the HDD 209.

  The HDD 209 stores a program 209p for controlling the entire terminal device 30. The program 209p includes screen information transmitted by the advertiser Web server 70, the partner site Web server 60, and the DSP 20, in addition to the browser 8. The terminal device 30 executes the browser 8, the display program included in the screen information, and the operation history program. The program 209p includes an advertisement tag, access information a1, and the like.

  In addition, an input device 210 such as a keyboard and a mouse (referred to as a pointing device) is connected to the I / O bus 208 via a bus such as a USB, and receives input and instructions from an operator such as a viewer. .

  The hardware configuration of the advertiser Web server 70, the partner site Web server 60, the SSP 50, the DSP 20, and the image distribution device 10 is not different from that in FIG. It is assumed that there is no problem. The advertiser Web server 70, partner site Web server 60, DSP 20, and image distribution device 10 preferably support cloud computing. Cloud computing refers to a usage mode in which resources on a network are used without being conscious of specific hardware resources. In this case, the hardware configuration shown in FIG. 4 does not need to be housed in one housing or provided as a unit, and the advertiser Web server 70, partner site Web server 60, DSP 20, And hardware elements that the image distribution apparatus 10 preferably has. In addition, in order to support cloud computing, the physical configurations of the advertiser Web server 70, partner site Web server 60, DSP 20, and image distribution device 10 of the present embodiment need not be fixed, and may be reduced in load or the like. It may be configured by dynamically connecting / disconnecting hardware resources accordingly.

<About spherical image 6>
The spherical image 6 will be described with reference to FIGS. FIG. 5 is an illustration of the use of the spherical camera 9. As shown in FIG. 5, the spherical camera 9 is used by a user to hold a hand and image a subject around the user. The omnidirectional camera 9 has a structure in which the back surfaces of two image sensors are opposed to each other, and obtains two hemispheric images by imaging an object around the user.

  Next, with reference to FIGS. 6 and 7, an outline of a process performed until an omnidirectional image 6 is created from an image captured by the omnidirectional camera 9 will be described. 6A is a hemispherical image (front side) captured by the spherical camera 9, FIG. 6B is a hemispherical image (rear side) captured by the spherical camera 9, and FIG. FIG. 2 is a diagram showing an image represented by an equirectangular projection (hereinafter, referred to as an “equidistant cylindrical image”). FIG. 7A is a conceptual diagram showing a state in which a sphere is covered with an equirectangular cylinder image, and FIG. 7B is a diagram showing an omnidirectional image 6.

  As shown in FIG. 6A, the image obtained by the spherical camera 9 is a hemispherical image (front side) curved by a fisheye lens. As shown in FIG. 6B, the image obtained by the omnidirectional camera 9 is a hemispherical image (rear side) curved by a fisheye lens. Then, the hemispherical image (front side) and the 180 degree-reversed hemispherical image (rear side) are synthesized by the omnidirectional camera 9, and as shown in FIG. Created.

  Then, by using OpenGL ES (Open Graphics Library for Embedded Systems), the equirectangular cylinder image is pasted so as to cover the spherical surface as shown in FIG. The spherical image 6 is created as shown in FIG. As described above, the omnidirectional image 6 is represented as an image in which the equirectangular cylinder image faces the center of the sphere. OpenGL ES is a graphics library used to visualize 2D (2-Dimensions) and 3D (3-Dimensions) data. The spherical image 6 may be a still image or a moving image.

  The advertisement data distributed by the image distribution device 10 includes the omnidirectional image 6. Since the spherical image 6 is an image attached to cover the spherical surface, the spherical image 6 is curved, and when viewed by a human, has a strange feeling. Therefore, the terminal device 30 displays the predetermined area T of a part of the celestial sphere image 6 as a flat image with less curvature so as not to give a strange feeling to humans. The predetermined area T is indicated by coordinates (X, Y, Z) in a three-dimensional virtual space. On the other hand, since the LCD 206 is a two-dimensional plane, the terminal device 30 cannot display the image in the predetermined area T. Therefore, the terminal device 30 obtains the predetermined area T by perspective projection transformation for projecting a three-dimensional object onto a two-dimensional plane using a 3D computer graphic technique. As described above, as shown in FIG. 1, the predetermined area T of the omnidirectional image 6 is displayed on the LCD 206 as a display area.

  FIG. 8 is an example of a diagram illustrating the line of sight of the viewer. Since the omnidirectional image 6 has three-dimensional coordinates, the line-of-sight direction is specified by information specifying three-dimensional coordinates or coordinates of a sphere such as latitude and longitude. In the present embodiment, the center CP of the predetermined area T is set as the line-of-sight direction.

  The viewer can change the line-of-sight direction by operation, but assuming that the virtual camera IC does not move in parallel, the virtual camera IC is a rigid body that rolls (rotates around the Z axis) and yaw (rotates around the Y axis). Three rotations are possible: rotation) and pitch (rotation about the X axis). The gaze direction changes regardless of any of these three rotations. For example, when the viewer rotates the omnidirectional image 6 in the horizontal direction, the yaw angle changes, and when the viewer rotates the omnidirectional image 6 in the vertical direction, the pitch angle changes. The roll angle changes. In the present embodiment, the operation of the viewer on the Web page is reflected in the line-of-sight direction (roll angle, yaw angle, pitch angle) and the like. It is assumed that the reflection is described in advance in the display program.

<Function>
FIG. 9 is an example of a functional block diagram showing the functions of the terminal device 30, the advertiser Web server 70, the partner site Web server 60, the image distribution device 10, the SSP 50, and the DSP 20 in a block form.

<< Advertiser Web Server 70, Partner Site Web Server 60 >>
The advertiser Web server 70 and the partner site Web server 60 have a Web page providing unit 71. These functions of the advertiser Web server 70 and the partner site Web server 60 are functions or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

  The Web page providing unit 71 interprets the HTTP request from the terminal device 30, constructs a Web page, and transmits the Web page to the terminal device 30 as an HTTP response. If necessary for the processing, a request is made to the application server for the processing, and the processing result is arranged on a Web page and transmitted. The Web page of the advertiser Web server 70 contains the cookie of the advertiser and the DSP cookie. This is because the advertiser Web server 70 has requested the DSP 20 to distribute an advertisement. This enables retargeting advertisements and the like. The Web page of the partner site Web server 60 includes the cookie of the partner site and the SSP cookie. This is because the partner site Web server 60 has requested the SSP 50 to sell the advertising space 7. The Web page providing unit 71 is realized by the CPU 201 illustrated in FIG. 4 executing the program 209p or the like.

<< SSP50 >>
The SSP 50 includes an advertisement request acquisition unit 52, an advertisement request unit 51, an access information transmission unit 53, and a successful bid unit 54. Each of these functions of the SSP 50 is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

  The advertisement request acquisition unit 52 acquires the advertisement request requested together with the SSP cookie by the terminal device 30 executing the advertisement tag associated with the advertisement space 7. The advertisement request acquisition unit 52 sends an advertisement request including the SSP cookie to the advertisement request unit 51. The advertisement request acquisition unit 52 is realized by the CPU 201 shown in FIG. 4 executing the program 209p or the like.

  The advertisement request unit 51 transmits an advertisement request to the DSP 20. The advertisement request includes an SSP cookie, a domain of the partner site Web server 60, an advertisement space ID, an advertisement space size, an advertisement format, a browser type, an OS type, and the like. The advertisement request unit 51 is realized by the CPU 201 shown in FIG. 4 executing the program 209p or the like.

  The successful bid unit 54 receives a bid from the DSP 20 and basically performs an auction for selling the advertising space 7 to the DSP 20 with the highest bid amount (the bid is not received depending on the product or service of the advertiser). The successful bid section 54 generates a successful bid ID and notifies the DSP 20. The successful bid section 54 is realized by the CPU 201 shown in FIG. 4 executing the program 209p or the like.

  The access information transmitting unit 53 generates access information a1 for requesting an advertisement to the winning DSP 20 and transmits the generated access information a1 to the terminal device 30 together with the successful bid ID. The access information a1 includes the URL (IP address) of the DSP 20. The access information transmitting unit 53 is realized by the CPU 201 shown in FIG. 4 executing the program 209p or the like.

<< DSP20 >>
The DSP 20 includes a request reception unit 21, a bid determination unit 22, a bid unit 23, an advertisement request reception unit 24, and an image request unit 25. Each of these functions of the DSP 20 is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

  In the storage unit 29, a cookie information DB 291 and a distribution setting DB 292 are constructed. The storage unit 29 is realized by the HDD 209 or the memory 202 shown in FIG.

  Table 1 schematically shows information stored in the cookie information DB 291. The cookie information DB 291 associates the DSP cookie with the SSP cookie, and registers a visited domain visited by the viewer. The association between the DSP cookie and the SSP cookie is possible by a technique called a cookie sink. The visit domain is obtained by the visitor visiting the Web site to which the DSP 20 has attached a tag (behavior monitoring tag). Therefore, the DSP 20 can specify the DSP cookie from the SSP cookie, and can determine what Web site this viewer is interested in.

  Table 2 schematically shows information stored in the distribution setting DB 292. In the distribution setting DB 292, an advertiser ID, an attribute to be advertised (attribute of a preferred target person), and a non-advertisement target attribute (attribute of an undesired target person) are registered. The advertiser ID is identification information for specifying or identifying an advertiser that provides a wide-angle image. Therefore, the DSP 20 or the image distribution device 10 determines whether to transmit the wide-angle image with reference to the attribute of the preferable subject or the attribute of the undesirable subject set for the provider of the wide-angle image. Can be.

  Note that ID is an abbreviation of Identification and means an identifier or identification information. The ID refers to a name, a code, a character string, a numerical value, or a combination of at least one of these used for uniquely distinguishing a specific target from a plurality of targets. The same applies to the following IDs. The advertisement target attribute is an attribute of a viewer to whom the advertiser wants to deliver an advertisement, and the non-advertisement attribute is an attribute of a viewer to which the advertiser does not want to deliver an advertisement. The DSP 20 compares the attribute of the viewer determined from the cookie information DB 291 or the like with the information of the distribution setting DB 292, quantifies the attribute of the viewer, and determines the bid price. Note that various information such as the time zone, the day of the week, the area of the viewer, and the like may be considered in determining the bid price.

(Functions of DSP20)
The request receiving unit 21 receives an advertisement request from the SSP 50. Basic information such as the advertising space ID of the terminal device 30 can be obtained from the request information. The request receiving unit 21 is realized by the CPU 201 shown in FIG. 4 executing the program 209p or the like.

  The bid determination unit 22 determines the bid amount by evaluating the advertisement request received by the request reception unit 21 with reference to the cookie information DB 291 and the distribution setting DB 292 (the bid may not be made). As described above, the DSP cookie is specified from the SSP cookie, and the bid amount is determined based on how much the attribute information stored in association with the DSP cookie matches the request of the advertiser stored in the distribution setting DB 292. I do. The bid judging unit 22 is realized by the CPU 201 shown in FIG. 4 executing the program 209p or the like.

  The bidding unit 23 bids on the SSP 50 at the determined bidding price. The bidding unit 23 is realized by the CPU 201 shown in FIG. 4 executing the program 209p or the like. If a successful bid is obtained, a successful bid ID is acquired and associated with the advertisement request.

  The advertisement request receiving unit 24 acquires an advertisement request (successful bid ID, DSP cookie) from the terminal device 30 based on the access information a1. The advertisement request receiving unit 24 specifies the advertisement request based on the successful bid ID. The DSP cookie may not be provided, and is used when the SSP cookie and the DSP cookie are not associated with each other. The advertisement request receiving unit 24 is realized by the CPU 201 shown in FIG. 4 executing the program 209p or the like.

  The image request unit 25 requests the image distribution device 10 for the access information a2 together with the DSP cookie, the advertiser ID, and the request content. The advertiser is specified by the advertiser ID. The advertisement space 7 is specified by the advertisement space ID of the request content. Further, the attribute of the viewer may be transmitted to the image distribution device 10. Thereby, the image distribution device 10 can distribute the omnidirectional image 6 suitable for the viewer. The image requesting unit 25 is realized by the CPU 201 shown in FIG. 4 executing the program 209p or the like.

<< Terminal device 30 >>
The terminal device 30 includes a Web page acquisition unit 31, a Web page analysis unit 32, a Web page display unit 33, an operation reception unit 34, and a script execution unit 35. Each of these functions of the terminal device 30 is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

  The operation receiving unit 34 is an example of a receiving unit, and receives various operations on the terminal device 30. Specifically, the operation for the browser executed by the terminal device 30 is received. When the Web page has a program described in the script language (the above-described script), an operation on the Web page triggered by the operation of the script is accepted. In the present embodiment, it is not strictly distinguished whether the operation target is the terminal device 30, the browser, or the Web page, and the operation on the terminal device 30, the operation on the browser, or the operation on the Web page has the same meaning. . The operation receiving unit 34 is realized by the CPU 201 illustrated in FIG. 4 executing the program 209p and controlling the input device 210 and the touch panel.

  The Web page acquisition unit 31 communicates with the advertiser Web server 70 and the partner site Web server 60 by operation of a viewer or by operation of a script, and acquires Web pages from the advertiser Web server 70 and the partner site Web server 60. . The Web page acquisition unit 31 is realized by the CPU 201 shown in FIG. 4 executing the program 209p and controlling the network driver 205.

  The Web page analysis unit 32 reads the HTML included in the screen information in order from the top, and analyzes the structure of the text and image data included in the HTML. In addition, it detects the association with the HTML text or image data described in the CSS and associates the style of the text or image data included in the HTML. Further, the Web page analysis unit 32 detects a script tag from HTML and extracts a script described in a script language. The Web page analysis unit 32 sends HTML and CSS to the Web page display unit 33 and sends a script to the script execution unit 35. The Web page analysis unit 32 is realized by the CPU 201 shown in FIG. 4 executing the program 209p or the like.

The Web page display unit 33 displays the Web pages on the LCD 206 in the order in which the analysis has been completed from the top of the HTML. Also, the web page is updated according to the operation on the web page. The Web page display unit 33 is realized by the CPU 201 shown in FIG. 4 executing the program 209p or the like.
The script execution unit 35 executes the script extracted by the web page analysis unit 32. The specific contents of the script vary depending on the Web page. In the present embodiment, as the script, the advertisement tag associated with the advertisement space 7, the access information a1 obtained from the SSP 50, the access information a2 obtained from the DSP 20, and the advertisement data distributed from the image distribution device 10 are detected. The script execution unit 35 is realized by the CPU 201 shown in FIG. 4 executing the program 209p or the like. Each function or means of the script execution unit 35 is realized by the CPU 201 executing a script.

  The advertisement frame detection unit 36 is a function realized by the terminal device 30 executing an advertisement tag associated with the advertisement frame 7 included in the screen information acquired by the web page acquisition unit 31. The advertisement space detection unit 36 transmits an advertisement request to the SSP 50 together with the SSP cookie based on the URL associated with the advertisement space 7.

  The access information acquisition unit 37 acquires the access information a1 from the SSP 50. The access information a1 is described in a script. The advertisement requesting unit 38 accesses the DSP 20 based on the URL included in the access information a1, and requests an advertisement together with the successful bid ID and the DSP cookie. The advertisement request unit 38 acquires the access information a2 and the advertisement opportunity ID in response to the request. The access information a2 is also described in a script.

  The advertisement acquisition unit 39 requests advertisement data from the image distribution device 10 by specifying an advertisement opportunity ID based on the URL of the image distribution device 10 included in the access information a2. Since the image distribution device 10 generates advertisement data, the advertisement acquisition unit 39 acquires advertisement data. The advertisement data of the present embodiment includes a spherical image 6, a display pattern, a display program, and an operation history program. The operation history program causes the image distribution device 10 to transmit the operation history. The display program rotates the omnidirectional image 6 according to the display pattern, and reflects the operation on the omnidirectional image 6 in the display mode of the omnidirectional image 6. The operation history program and the display program are also described in a script language, and are executed by the script execution unit 35.

  The advertisement display unit 40 is an example of a display control unit, and displays advertisement data acquired from the image distribution device 10. The advertisement display unit 40 is mainly realized by a display program, displays the celestial sphere image 6 (that is, an advertisement) in the advertisement frame 7, and automatically rotates so as to follow the attention area. Further, the display mode of the omnidirectional image 6 is changed according to the operation on the omnidirectional image 6.

  By acquiring the advertisement data from the image distribution device 10, the terminal device 30 can acquire the image cookie of the image distribution device 10 and store it in the storage unit 49. By transmitting the image cookie to the image distribution device 10 by the advertisement acquisition unit 39, the image distribution device 10 can associate the DSP cookie with the image cookie.

  The operation history recording unit 41 is mainly realized by an operation history program, and records operation information on the omnidirectional image 6 as an operation history. The details of the operation history will be described in the image distribution device 10. The operation history transmission unit 42 is mainly implemented by an operation history program, and distributes an operation history of the omnidirectional image 6 displayed in the advertisement frame 7 together with an image cookie and an image ID (identifying the omnidirectional image 6). Transmit to the device 10. When the button is clicked, the fact is transmitted to the image distribution apparatus 10 together with the display pattern.

<< Image distribution device 10 >>
The image distribution device 10 includes an image information response unit 11, an advertisement distribution unit 12, an operation history analysis unit, an attention target determination unit 13, and an operation history acquisition unit 14. Each of these functions of the image distribution apparatus 10 is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

  In addition, the image distribution device 10 includes the storage unit 19 realized by the HDD 209 or the memory 202 illustrated in FIG. In the storage unit 19, a distribution history DB 191, an operation history DB 192, a cookie correspondence DB 193, an advertisement image DB 194, and a pattern DB 195 are constructed.

  Table 3 schematically shows information stored in the operation history DB 192. The operation history DB 192 stores a history of what operation each viewer performed on the omnidirectional image 6. The operation history DB 192 records items such as an image ID, a browsing time, an image cookie, and browsing angles of view 1 to 3. The image ID is information for specifying the spherical image 6. The image cookie is information for determining the identity of the viewer operating the terminal device 30 or the terminal device 30 (an example of device identification information). The viewing angles of view 1 to 3 are the angles of view when the viewer views the omnidirectional image 6. Each of the viewing angle of view 1 to 3 stores the viewing time, the presence or absence of enlargement, the angle of view after enlargement when enlarged, and the presence or absence of reduction. In this manner, the angle of view that is considered to be of interest to the viewer is recorded for each image. The viewing angle of view 1 to 3 is an angle of view in which the viewer stays still without rotating the celestial sphere image 6 for a predetermined time (for example, 1 second). The operation history recording unit 41 of the terminal device 30 records the top three view angles during the stationary time. Only one or four or more may be used. Similarly, the operation history recording unit 41 records whether or not the viewer is enlarged or reduced at each of the viewing angles of view 1 to 3. The image distribution device 10 may set such an operation history as the attention area A. Furthermore, if an image cookie is associated with an image ID, a retargeting advertisement becomes possible. The angle of view at the time of clicking may be recorded as the operation history.

  Table 4 schematically shows information stored in the operation history DB 192. The operation history DB 192 records a history of what operation each viewer performed on the 3DCG. In the operation history DB 192, items of an image ID, a browsing time, an image cookie, and browsing viewpoint directions 1 to 3 are recorded. The image ID is information for specifying the 3DCG. The image cookie is information for determining the identity of the viewer operating the terminal device 30 or the terminal device 30 (an example of device identification information). The viewing viewpoint directions 1 to 3 are three-dimensional viewpoint directions when the viewer views 3DCG. In each of the viewing viewpoint directions 1 to 3, the viewing time, the presence or absence of enlargement (reduction), the size after enlargement (the number of vertical and horizontal pixels), the presence or absence of reduction, and the size after reduction if the enlargement is performed The size (the number of vertical and horizontal pixels) is stored. In this way, the viewpoint directions considered to be interesting to the viewer are recorded for each image. The viewing viewpoint directions 1 to 3 are viewing directions in which the viewer stays still without changing the viewing direction of the 3DCG for a predetermined time (for example, 1 second) or more. The operation history recording unit 41 of the terminal device 30 records the top three viewpoint directions during the stationary time. Only one or four or more may be used. Similarly, the operation history recording unit 41 records whether or not the viewer is enlarged or reduced in each of the viewing viewpoint directions 1 to 3. The image distribution device 10 may set such an operation history as the attention area A. Furthermore, if an image cookie is associated with an image ID, a retargeting advertisement becomes possible. The viewpoint direction at the time of clicking may be recorded as the operation history.

  Table 5 schematically shows information stored in the advertisement image DB 194. Information about the omnidirectional image 6 to be advertised is registered in the advertisement image DB 194. In the advertisement image DB 194, an advertiser ID, an image ID, a priority, and a target attribute are registered in association with each other. Since the advertiser is determined by the DSP 20, the image to be distributed is determined based on at least one of the coincidence or the priority between the attribute of the viewer and the target attribute in Table 5 among the images to be distributed by the advertiser. In the case of a retargeting advertisement, an image associated with an image cookie is distributed in the operation history DB 192.

  Table 6 schematically shows information stored in the cookie correspondence DB 193. DSP cookies and image cookies are associated with each other in the cookie correspondence DB 193. The DSP cookie is notified from the DSP 20, and the image cookie is notified from the terminal device 30. By associating the two, the image distribution apparatus 10 can determine the viewer only with the DSP cookie.

  Table 7 schematically shows information registered in the pattern DB 195. The combination of the display order and the angle of view of the attention area A of the omnidirectional image 6 is registered in the pattern DB 195. The combination of the order and the angle of view is called a display pattern. In Table 7, four coordinates 1 to 4 are the attention area A. The number of the attention areas A is not limited to four in one celestial sphere image 6, and may be three or less or five or more. Further, various types may be used depending on the spherical image 6. The display pattern has a display order of coordinates 1 to 4. Therefore, when there are four attention areas A, the display order is 4 factorial (= 24). Further, when the angle of view of each attention area A is changed to, for example, three stages, there is a combination of the angle of view of the power of 3/4. Therefore, there are 81 combinations for one display order regarding the angle of view. Finally, there is a 24 × 81 display pattern for one celestial sphere image. The number of clicks is the number of clicks by the viewer for each display pattern. Click is an example of “predetermined operation”. That is, the image distribution device 10 displays the omnidirectional image 6 on the plurality of terminal devices 30 in the same display pattern in the same display pattern, and records that the terminal device 30 is clicked. By doing so, it is possible to gradually avoid distribution with a display pattern having a low click rate. It is preferable that the number of clicks be recorded for each attribute (gender, age, family structure, etc.) of the viewer. Thereby, it is possible to display in a display pattern in which the number of clicks is large for the attribute of the viewer.

  In the pattern DB 195, a combination of the display order and the viewpoint direction of 3DCG is also registered. However, in Table 7, “angle of view” is merely replaced with “viewpoint direction”, and therefore description thereof is omitted here.

  Table 8 schematically shows information registered in the distribution history DB 191. The image ID and display pattern of the spherical image 6 (or 3DCG) distributed in association with the image cookie are registered in the distribution history DB 191. When an image cookie is registered in the terminal device 30 when the image distribution device 10 transmits the advertisement data, the image distribution device 10 can acquire the image cookie from the terminal device 30. The image distribution device 10 can avoid distributing the same omnidirectional image 6 (or 3DCG) to the same viewer or avoid distributing the same omnidirectional image 6 (or 3DCG) in the same display pattern. it can. Conversely, retargeting distribution can also be performed.

(About the history management server function)
The image information responding unit 11 assigns an advertising opportunity ID to the DSP cookie, the advertiser ID, and the request content (mainly the advertising space ID) acquired from the DSP 20, and returns the information together with the access information a2 to the DSP 20. An advertisement distribution opportunity can be specified for each advertisement space 7 of the terminal device 30 by the advertisement opportunity ID. The image information response unit 11 is realized by the CPU 201 shown in FIG. 4 executing the program 209p or the like.

  When the advertisement data is requested from the terminal device 30 together with the advertisement opportunity ID, the advertisement distribution unit 12 determines the omnidirectional image 6 (or 3DCG) to be distributed and the display pattern. First, the omnidirectional image 6 (or 3DCG) associated with the advertiser ID acquired from the DSP 20 is determined from the advertisement image DB 194. Preferably, the attributes of the viewer are considered. The attribute of the viewer may be notified from the DSP 20 or may be stored by the image distribution device 10 in association with the image cookie. Next, the advertisement distribution unit 12 determines a display pattern of the omnidirectional image 6 (or 3DCG) with reference to the pattern DB 195. For example, a pattern with the largest number of clicks is determined, or a pattern with a number of clicks greater than or equal to a threshold is arbitrarily determined. It is preferable that the attribute of the viewer is also considered when determining the pattern. The advertisement distribution unit 12 is realized by the CPU 201 illustrated in FIG. 4 executing the program 209p and controlling the network driver 205.

  The operation history acquisition unit 14 acquires the operation history together with the image cookie and the image ID from the terminal device 30 and sets the operation history in the operation history DB 192. Note that there are two types of operations, an operation history for determining the region of interest and the angle of view (or the direction and size of the viewpoint of interest (the number of vertical and horizontal pixels)) and an operation history for updating the number of clicks (clicking). Has history. The operation history acquisition unit 14 is realized by the CPU 201 shown in FIG. 4 executing the program 209p and controlling the network driver 205.

  The image distribution device 10 may include the operation history recording unit 41 of the terminal device 30. Since the operation history recording unit 41 requires time-series operation contents, it may be difficult for the image distribution device 10 to acquire the information depending on the communication band. On the other hand, since the operation history recording unit 41 of the terminal device 30 only needs to transmit the final operation history to the image distribution device 10, the communication load can be reduced.

  The attention target determination unit 13 determines the attention area A of the omnidirectional image 6. Various methods for determining the attention area A are conceivable, and details will be described later. The attention target determination unit 13 registers a display pattern using the determined attention area A in the pattern DB 195. The attention target determination unit 13 is realized by the CPU 201 illustrated in FIG. 4 executing the program 209p or the like. In addition, the attention target determination unit 13 determines the attention viewpoint direction of the 3DCG. Various methods of determining the direction of the viewpoint of interest can be considered, and details will be described later. The attention target determination unit 13 registers a display pattern using the determined attention viewpoint direction in the pattern DB 195.

<Determination of attention area A>
<< Method of determining attention area A from feature amount >>
FIG. 10 is an example of a flowchart illustrating a procedure in which the attention target determination unit 13 determines the attention area A. In step S11, the attention target determination unit 13 defines a regular polyhedron having a center common to the unit sphere, and performs perspective projection transformation using the normal direction of each surface as the line of sight to obtain a partial image. FIG. 11A illustrates an example in which a regular octahedron is defined as the projection plane of the omnidirectional image, and FIG. 11B illustrates an example in which a dodecahedron is defined as the projection plane of the omnidirectional image.

  In step S12, the attention target determination unit 13 extracts a predetermined feature amount from each partial image obtained in step S1. Since the input image is divided by the above-described method and the feature amount is calculated from the partial image having little distortion, it is possible to robustly process a wide-angle image exceeding 180 degrees. Color, edge, saliency, object position / label, and the like can be used as the feature amount.

  In the subsequent step S13, the attention target determination unit 13 calculates the importance for each position (for each pixel) of the input image from the feature amount extracted from each partial image using a predetermined regression model. Although details are omitted, the importance and the feature amount for each position are represented by a function by regression. The importance g, which is an output (teacher data), is determined in advance by using an appropriate method using the training data, and the relationship between the feature amount and the importance g is determined.

  In the following step S14, the attention target determination unit 13 determines the likelihood of the attention area A based on the distribution of the importance calculated in step S13 under the design idea that the attention area A of the user exists in the direction of higher importance. Calculate the distribution. For example, after defining a region R passing through the viewpoint on the unit image plane, an added value obtained by adding the importance of each position in the region R can be calculated as the attention region likelihood of the viewpoint.

  In the following step S15, the attention target determination unit 13 calculates the attention area A based on the attention area likelihood distribution. In the present embodiment, for example, a position corresponding to the imaging direction corresponding to the maximum likelihood value of the attention area likelihood is calculated as the attention area A.

  In this way, several attention areas A can be calculated. The attention target determination unit 13 specifies a predetermined number of attention areas A or attention areas A having a threshold value or more, out of the N upper attention areas A. Then, a pattern in which the display order of the attention area A and the angle of view are combined is registered in the pattern DB 195. Note that the calculation of the target viewpoint direction and the size (the number of pixels in the vertical and horizontal directions) is performed in the same manner, and the description thereof will be omitted.

<< Determine a person as attention area A >>
A person can be considered as a subject to which a person pays attention. As a method of detecting a person, face recognition is known. For face recognition, a known method of detecting a FOG feature amount or a Haar-like feature amount and performing pattern matching can be used. The attention target determination unit 13 detects the center of the face as the attention area A. When the number of faces is large, the number of faces may be reduced to a predetermined number by regarding faces having short distances as one.

<< Determine smile as attention area A >>
A person's smile can be considered as a subject to which a person pays attention. As a smiling face detection method, in addition to the face recognition described above, a known method of performing pattern matching using a previously held smiling face pattern can be used. When the number of faces is large, only the smile may be set as the attention area A. In addition, a face such as sadness, anger, or confusion may be determined as the attention area A in addition to the smile.

<< Determine the child as attention area A >>
When there is a child among adults, a person may pay attention to the child. Alternatively, when an adult exists among a large number of children, a person may pay attention to the adult. The position of the face can be used as a method for detecting a child or an adult. If the position of the face specified by the above face recognition is lower than the position of the other face, it is estimated that the child is a child, and if the position of the face specified by the face recognition is higher than the position of the other face, it is an adult. It is estimated to be.

<< Determine any subject as attention area A >>
It is considered that the attention area A that the advertiser wants the viewer to view is known by the advertiser. Therefore, the attention target determination unit 13 can detect the subject designated by the advertiser and set the subject as the attention area A. For example, an advertiser's product or service, such as a car, furniture, or food, is detected by pattern recognition and is set as the attention area A.

<< Use operation history >>
When there is a child among adults, a person may pay attention to the child. Alternatively, when an adult exists among a large number of children, a person may pay attention to the adult. The position of the face can be used as a method for detecting a child or an adult. If the position of the face specified by the above face recognition is lower than the position of the other face, it is estimated that the child is a child, and if the position of the face specified by the face recognition is higher than the position of the other face, it is an adult. It is estimated to be. When clicked, the angle of view at the time of clicking may be set as the attention area A.

<Information used by Web page>
FIG. 12 is an example of a diagram schematically illustrating information used by a Web page. FIG. 12A shows a Web page provided by the partner site Web server 60. The Web page provided by the partner site Web server 60 has one or more advertisement spaces 7. The terminal device 30 holds an SSP cookie and a DSP cookie in advance. The advertising space 7 is associated with the URL of the SSP 50, the advertising space ID, and the like. The browser (advertisement space detection unit 36) of the terminal device 30 transmits the SSP cookie and the request content to the SSP 50. Also, the access information a1 including the URL of the DSP 20 that has won the advertisement space 7 and the successful bid ID are transmitted from the SSP 50 to the terminal device 30.

  FIG. 12B illustrates the operation of the access information a1. The access information a1 transmits the successful bid ID and the DSP cookie to the DSP 20 based on the URL of the DSP 20. The DSP 20 specifies the advertisement request with the successful bid ID, and acquires the access information a2 including the URL of the image distribution device 10 and the advertisement opportunity ID from the image distribution device 10. The terminal device 30 acquires the access information a2 and the advertising opportunity ID from the DSP 20.

  FIG. 12C illustrates the operation of the access information a2. The access information a2 transmits the advertisement opportunity ID to the image distribution device 10 based on the URL of the image distribution device 10. The image distribution device 10 generates advertisement data based on an advertisement request specified by the advertisement opportunity ID and transmits the advertisement data to the terminal device 30 together with the image cookie, the advertisement space ID, and the display pattern. In this way, the omnidirectional image 6 is displayed in the advertisement frame 7 of the Web page.

<Operation procedure>
FIG. 13 is an example of a sequence diagram illustrating a procedure in which the browsing system 100 distributes the spherical image 6 displayed as an advertisement.

  S31: First, the viewer operates the terminal device 30 so as to connect to the partner site Web server 60. The operation receiving unit 34 of the terminal device 30 receives an operation, and the Web page obtaining unit 31 obtains a Web page.

  S32: The Web page analysis unit 32 of the terminal device 30 analyzes the Web page and extracts HTML, CSS, and script, and the Web page display unit 33 displays the Web page based on HTML and CSS.

  S33: The advertisement space detection unit 36 of the terminal device 30 transmits an advertisement request to the SSP 50 by executing an advertisement tag (script) associated with the advertisement space 7. The advertisement request includes, for example, an SSP cookie, a domain of the partner site Web server 60, an advertisement space ID, an advertisement space size, an advertisement format, a browser type, an OS type, and the like.

  S34: The advertisement request acquisition unit 52 of the SSP 50 acquires the advertisement request, and the advertisement request unit 51 receives the advertisement request. The advertisement request unit 51 detects the SSP cookie, notifies the DSP 20 of the advertisement request, and sells the advertisement space 7.

  S35: The request receiving unit 21 of the DSP 20 sends an advertisement request to the bid judging unit 22. The bid determination unit 22 of the DSP 20 specifies the DSP cookie from the SSP cookie with reference to the cookie information DB 291.

  S36: The bid judging unit 22 judges an attribute from the DSP cookie. The visit domain of the cookie information DB 291 may be referred to, or the attribute information of the viewer specified by the DSP cookie may be referred to as appropriate.

  S37: The bid judging unit 22 refers to the distribution setting DB 292 and transmits the wide-angle image to the viewer based on the attribute of the preferable target person or the attribute of the unfavorable target person set for the provider of the wide-angle image. Is determined. Here, it is assumed that distribution is determined for at least one advertiser.

  S38: The bid determination unit 22 determines a bid price according to the advertiser's budget, the degree of matching of attributes, and the like.

  S39: The bidding unit 23 of the DSP 20 bids for the SSP 50. The successful bid section 54 of the SSP 50 determines, as a successful bidder, the DSP 20 that has offered the highest bid in principle for bids from a plurality of DSPs 20.

  S40: Here, it is assumed that the illustrated DSP 20 has won a bid. The SSP 50 notifies the DSP 20 of the successful bid ID.

  S41: The access information transmitting unit 53 of the SSP 50 transmits the access information a1 together with the successful bid ID to the terminal device 30.

  S42: The advertisement requesting unit 38 of the terminal device 30 executes the access information a1 to transmit an advertisement request together with the successful bid ID to the DSP 20.

  S43: The advertisement request receiving unit 24 of the DSP 20 specifies the advertisement request based on the successful bid ID. The image requesting unit 25 requests an image from the image distribution device 10 together with the advertiser ID, the DSP cookie, and the advertisement request.

  S44: Upon receiving the image request, the image information response unit 11 of the image distribution device 10 generates an advertisement opportunity ID for specifying the advertisement request.

  S455: The image information responding unit 11 transmits the access information a2 associated with the advertisement opportunity ID to the DSP 20.

  S466: The image requesting unit 25 of the DSP 20 receives the access information a2, and the advertisement request receiving unit 24 transmits it to the terminal device 30.

  S47: The advertisement acquisition unit 39 of the terminal device 30 transmits an advertisement request (advertisement opportunity ID) based on the URL of the image distribution device 10 included in the access information a2. When the terminal device 30 holds an image cookie, the terminal device 30 can transmit the image cookie.

  S48: The advertisement distribution unit 12 of the image distribution device 10 specifies the image request based on the advertisement opportunity ID.

  S49: The advertisement distribution unit 12 determines the attribute from the DSP cookie or determines the attribute from the image cookie.

  S50: The advertisement distribution unit 12 specifies the omnidirectional image 6 based on the advertiser ID and the attribute. That is, with reference to the advertisement image DB 194, the omnidirectional image 6 to be transmitted is determined based on the attribute or priority of the distribution target person set for the omnidirectional image 6. The display pattern is one in which the number of clicks is higher than the threshold, but is selected randomly while the number of distributions of the spherical image 6 is small.

  S51: The advertisement distribution unit 12 transmits, to the terminal device 30, advertisement data including the omnidirectional image 6, the display pattern, the image ID, the image cookie, and the advertisement space ID. The omnidirectional image 6 is associated with the URL of the advertiser Web server 70.

  S52: The advertisement acquisition unit 39 of the terminal device 30 acquires the advertisement data, and the advertisement display unit 40 displays the spherical image 6 in the advertisement frame 7. When the viewer clicks on the advertisement space 7, the operation receiving unit 34 receives the advertisement frame 7, and the Web page obtaining unit 31 starts communication with the advertiser Web server 70. In the case of 3DCG, the same processing (S31 to S52) as that of the omnidirectional image 6 is performed, and thus the description thereof is omitted.

<Update of the number of clicks for each display pattern>
FIG. 14 is an example of a sequence diagram illustrating a procedure in which the image distribution device 10 updates the number of clicks for each display pattern.

  S61: It is considered that the viewer views the omnidirectional image 6 of the advertising frame 7 rotating according to the display pattern, and clicks (or taps) the advertising frame 7 if he / she is interested. The operation receiving unit 34 of the terminal device 30 receives the click.

  S62: The operation history recording unit 41 records an operation of clicking, and transmits to the image distribution device 10 that the operation history transmission unit 42 has been clicked. The transmission of the click may be performed immediately after the click or when the communication addition is small. This notification includes an image ID, a pattern ID, and an image cookie. The presence of image cookies makes it possible to record the number of clicks for each attribute.

  S63: The operation history acquisition unit 14 of the image distribution device 10 acquires the effect of the click, and increases (updates) the image ID of the pattern DB 195 and the number of clicks associated with the pattern ID by one. Alternatively, the attribute is determined based on the image cookie, and the number of clicks is increased for each attribute.

  Through such processing, the number of clicks is accumulated for each display pattern, and the number of clicks on a display pattern that is easily clicked increases. In other words, a display pattern that is difficult to click becomes clear. In the case of 3DCG, the same processing (S61 to S63) as that of the omnidirectional image 6 is performed, and thus the description thereof is omitted.

<Display based on display pattern>
FIG. 15 is a diagram schematically showing the display of the attention area A based on the display pattern. FIG. 15A shows an example of the display pattern, and FIG. 15B shows an example of the attention area A and the angle of view in the omnidirectional image 6.

  The display pattern shown in FIG. 15A is included in the advertisement data, and the advertisement display unit 40 displays the attention area A1 with a medium angle of view, the attention area A2 with a small angle of view, and the attention area A3 with a large angle of view. Then, the attention area A4 is sequentially displayed at the middle angle of view. After the attention area A4, the display returns to the attention area A1.

  More specifically, as shown in FIG. 15B, attention areas (predetermined areas) A1 to A4 of the omnidirectional image 6 are continuously moved and displayed. The attention areas (predetermined areas) A1 to A4 are displayed in the advertising space 7. The advertisement display unit 40 continuously follows the attention areas (predetermined areas) A1 to A4 while always displaying the omnidirectional image 6.

  Since the size of the advertising frame 7 does not change, it looks like it is enlarged when the viewer moves from the attention area A1 to the attention area A2, and it looks like it is reduced when it moves from the attention area A2 to the attention area A3. However, the movement from the attention area A3 to the attention area A4 appears to be enlarged, and the movement from the attention area A4 to the attention area A1 does not appear to be enlarged or reduced.

  As described above, the terminal device 30 always displays the omnidirectional image 6 by automatically tracing the plurality of attention areas A in order, so that the characteristic portion of the omnidirectional image 6 can be displayed without any operation by the viewer. Can be viewed by viewers.

  FIG. 16 is an example of a diagram schematically illustrating enlargement or reduction. FIG. 16A shows a display method in which enlargement is performed in parallel with movement of the attention area, and FIG. 16B shows a display method in which enlargement is performed after movement of the attention area. Since the angle of view is reduced by moving from the display range 1 to the display range 2, FIG. 16 means enlargement, but the same applies to reduction.

  The display method of FIG. 16A will be described. The advertisement display unit 40 specifies four vertices S1 to S4 in the case of a middle angle of view in the attention area A1. The coordinates of the four vertices Q1 to Q4 in the case of a small angle of view in the attention area A2 can be calculated. Therefore, the curve on the sphere (on the spherical surface of the celestial sphere) connecting S1 and Q1, S2 and Q2, S3 and Q3, and S4 and Q4 is divided (interpolated) into several parts, and the coordinates of each division point are calculated. The terminal device 30 displays the spherical image 6 at the angle of view. By doing so, the omnidirectional image 6 can be reduced while smoothly moving from the display range 1 to the display range 2 and the attention area A can be displayed at a fixed angle of view.

  The display method of FIG. 16B will be described. The advertisement display unit 40 specifies four vertices S1 to S4 in the case of a middle angle of view in the attention area A1. The coordinates of the four vertices S17 'to S4' in the case of a small angle of view in the attention area A2 can be calculated. The advertisement display unit 40 divides (interpolates) a curve on a sphere connecting S1 and S1 ′, S2 and S2 ′, S3 and S3 ′, and S4 and S4 ′, and calculates coordinates of each division point. The terminal device 30 displays an image at an angle of view (constant).

  Next, the advertisement display unit 40 divides the curve on the sphere connecting S1 ′ and Q1, S2 ′ and Q2, S3 ′ and Q3, and S4 ′ and Q4 into several parts, and calculates the coordinates of each division point. The terminal device 30 displays an image at the angle of view. By doing so, it is possible to smoothly move from the display range 1 of the omnidirectional image 6 to the display range 2 and then enlarge the display range 2 to display it at a fixed angle of view.

  Which display method is to be used may be the one with the higher appealing power of the advertisement, and is set in the image distribution device 10 in advance. Alternatively, the number of clicks may be counted by using the two display methods as one type of display pattern, and the higher click number may be adopted.

<Remaining time and moving speed>
FIG. 17 is an example of a diagram schematically illustrating an example of a movement amount and a movement speed with respect to time. FIG. 17A shows the moving amount, and FIG. 17B shows the moving speed. As shown in FIGS. 17A and 17B, the movement of the display range is stopped in the attention areas (predetermined areas) A1, A2, A3, and A4, and the attention area A2 shifts from the attention area A1 to the attention area A3. When moving from the attention area A3 to the attention area A4, the movement is performed at a constant speed. Since the display range is stopped for a predetermined time in the attention areas P1, P2, P3, and P4, the viewer can check the attention area A. Information on the moving speed is stored in the pattern DB 195 and transmitted to the terminal device 30.

  The rest time is several seconds (for example, 1 or 2 seconds). Further, the rest time may be zero. However, it is preferable to move slowly, even if it does not stop completely in the regions of interest (predetermined regions) A1, A2, A3, and A4 so that the viewer can confirm.

  FIG. 18 is an example of a diagram illustrating a moving speed from the attention area A1 to the attention area A2. The same applies to other movements between the attention areas A. FIG. 18A shows a moving method in which the terminal device 30 moves the display range from the attention area A1 to the attention area A2 at a constant speed. That is, it is the same as FIG. The display range can be moved at the highest speed.

  FIG. 18B shows a moving method in which the moving speed gradually increases from the attention area A1 at the movement start point, becomes constant thereafter, and gradually decreases before the next attention area A2. There is an advantage that a viewer can easily see because abrupt movement is avoided.

  FIG. 18C shows a moving method in which the moving speed gradually increases from the attention area A1 at the movement start point to the stop in the attention area A2. Abrupt movement at the start of movement can be avoided.

  FIG. 18D shows a moving method in which the moving speed gradually decreases from the attention area A1 at the movement start point to the stop in the attention area A2. Since the moving speed gradually decreases before the attention area A2, the viewer can view the next attention area A for a long time.

  It is assumed that the moving method in which the display range is moved is set in the image distribution device 10 in advance on the assumption that a moving method with a high advertising appeal is adopted. Alternatively, the number of clicks may be counted by using these movement methods as one of the display patterns, and the one with the higher number of clicks may be adopted.

<Display based on display pattern>
FIG. 19 is an example of a flowchart illustrating a procedure in which the advertisement display unit 40 displays the omnidirectional image 6 based on the display pattern. The procedure in FIG. 19 starts when the terminal device 30 receives the advertisement data.

  First, the advertisement display unit 40 sets "1" to i (S71). i indicates the display order of the attention area and the angle of view of the display pattern.

  Next, the advertisement display unit 40 displays the omnidirectional image 6 in the i-th region of interest and the angle of view of the display pattern (S72).

  Next, it is determined whether a predetermined time has elapsed since the start of the display (S73). The certain time may be zero.

  If the determination in step S73 is Yes, the advertisement display unit 40 determines whether the display pattern has ended (S74).

  When the display pattern ends, the advertisement display unit 40 sets i to “1”, and displays the omnidirectional image 6 in the display area and the angle of view in the first display order (S76).

  If the display pattern has not ended, the advertisement display unit 40 increases i by one (S75).

  Next, the advertisement display unit 40 starts moving to the i-th attention area of the display pattern (S77).

  Then, the advertisement display unit 40 changes the angle of view after moving to the ith region of interest of the display pattern, or changes the angle of view while moving (S78).

  The process returns to step S72, and displays the attention area and the angle of view of the display pattern based on the display order.

<Repeat of display pattern>
The celestial sphere image 6 displayed in the advertisement frame 7 by the terminal device 30 rotates while automatically following the attention area A as described above. However, in some cases, the click rate can be improved by displaying in a different display pattern when not clicked, rather than repeatedly displaying in a display pattern that is not clicked. Therefore, the terminal device 30 changes the display pattern of the same omnidirectional image 6 as described below.

FIG. 20A shows a first display pattern, FIG. 20B shows a second display pattern, and FIG. 20C shows a third display pattern. The image distribution device 10 transmits a plurality of display patterns to the terminal device 30. The advertisement display section 40 repeats one display pattern only twice, for example, and displays it in another display pattern when repeated twice.
A. First, the first display pattern is repeated twice.
B. After the last attention area A4 of the first display pattern, the display area moves to the first attention area A1 of the second display pattern.
C. The second display pattern is repeated twice.
D. After the last attention area A3 of the second display pattern, the display moves to the first attention area A3 of the third display pattern. Since there is no need to move from the attention area A3 to the attention area A3, the third display pattern starts without moving.

  If the end of the display pattern is the same as the first area of interest A of the next display pattern, it is determined that the display of the first area of interest A of the next display pattern has been completed and the second area of interest A of the next display pattern has been completed. The display may be started from.

  As described above, when the display pattern is displayed in the same display pattern a predetermined number of times or more, the click rate can be improved by switching the display pattern. Note that the predetermined number of times is an example, and the predetermined number serving as a switching reference is arbitrarily determined. For example, the terminal device 30 may determine according to the display time of one display pattern.

  The operation history recording unit 41 of the terminal device 30 transmits to the image distribution device 10 the pattern ID of the display pattern adopted when the button is clicked.

  FIG. 21 is an example of a flowchart illustrating a procedure in which the terminal device 30 switches the display pattern.

  Upon receiving the advertisement data, the advertisement display unit 40 of the terminal device 30 displays the omnidirectional image 6 and starts moving the display of the attention area A (S91).

  Next, the operation history recording unit 41 determines whether the operation reception unit 34 has received the click (S92). If the determination in step S92 is Yes, the operation history recording unit 41 transmits a click notification (image ID, pattern ID, image cookie) to the image distribution device 10 (S93).

  If the determination in step S92 is No, the advertisement display unit 40 determines whether the same display pattern has been repeated twice (S94).

  If the determination in step S94 is No, steps S92 to S93 are repeatedly executed.

  If the determination in step S94 is Yes, the advertisement display unit 40 switches the display pattern (S95). The process proceeds to step S91, and rotation of the omnidirectional image 6 is started in the next display pattern.

<Switching display patterns when distributing the same image to the same viewer>
A viewer whose image cookie is registered in the distribution history DB 191 has viewed the omnidirectional image 6 in some display pattern. When the viewer browses the Web page of the partner site Web server 60 or the Web page of another Web server, the image distribution device 10 may distribute the omnidirectional image 6. In this case, the click rate can be improved by the image distribution device 10 changing the display pattern. When the terminal device 30 repeatedly displays the display pattern while switching the display pattern as described with reference to FIGS. 20 and 21, at least the first display pattern is switched.

  FIG. 22 is an example of a flowchart illustrating a procedure in which the advertisement distribution unit 12 of the image distribution device 10 suppresses the distribution of the omnidirectional image with the same display pattern.

  First, the advertisement distribution unit 12 acquires a request for advertisement data together with the image cookie (S111). In the case of the terminal device 30 that has received distribution of the spherical image 6 in the past, since the image cookie is stored, the image distribution device 10 can determine the viewer.

  The advertisement distribution unit 12 determines whether there is a distribution history of the omnidirectional image 6 to be distributed with reference to the distribution history DB 191 (S112). That is, it is determined whether there is a distribution history of distributing the omnidirectional image 6 determined according to the attribute or the like to the same viewer.

  If the determination in step S112 is No, the advertisement distribution unit 12 distributes in the display pattern with a high number of clicks as described above (S113).

  If the determination in step S112 is Yes, the advertisement distribution unit 12 distributes in a display pattern different from the display pattern recorded in the distribution history DB 191 (S114). For example, distribution is performed with a display pattern having the highest number of clicks among display patterns different from the display patterns recorded in the distribution history DB 191.

  In the case of the retargeting advertisement, the omnidirectional image recorded in the distribution history DB 191 is distributed. In this case as well, the image distribution apparatus 10 uses a display pattern different from the display pattern recorded in the distribution history DB 191. , The same spherical image 6 can be distributed in different display patterns. In the case of a retargeting advertisement, the advertisement can be intentionally delivered in the same display pattern.

<Video distribution>
In many cases, the omnidirectional image 6 of the moving image is distributed. A moving image is an image having frames with different imaging times. In the case of a moving image, there are cases where the imaging position hardly moves and cases where the imaging position moves. When the imaging position does not move, the position of the attention area A does not move, so that it is the same as the case of the still image.

  FIG. 23 is a diagram illustrating a change in coordinates in the case of a moving image in which the imaging position hardly moves. FIG. 23A shows a display range 301 that is stationary in the attention area A1. Since the image is a moving image, the frame is switched when the time elapses, but the attention area A1 does not move. That is, the display range 301 displayed by the terminal device 30 at times t1 to t3 does not move.

  FIG. 23B shows a display range 301 that moves from the attention area A1 to the attention area A2. The display range 301 moves from the attention area A1 to the attention area A2 in parallel with the switching of the frame, but since the attention area A does not move, the display range 301 may be moved similarly to the still image.

  FIG. 23C shows a display range 301 that is stationary in the attention area A2. Since the image is a moving image, the frame is switched when the time elapses, but the attention area A2 does not move. That is, the display range 301 displayed by the terminal device 30 from time t7 to t9 does not move.

  On the other hand, in the case of a moving image in which the imaging position moves with time, the attention target determination unit 13 detects the attention area A and performs a process of tracking the same attention area A between frames, and labels the attention area A in each frame. I do. During the stationary time, the coordinates and the angle of view are adjusted in each frame so that the same attention area A is displayed. When the coordinates move, interpolation may be performed as in the case of a still image. Since the image is a moving image, the attention area A may disappear during the reproduction. In this case, it moves to the next attention area A before disappearing. Therefore, the attention target determination unit 13 tracks the attention area A and manages the presence or absence of the attention area A with respect to the time zone, so that a display pattern for sequentially displaying the attention area A can be generated.

<Summary>
As described above, the browsing system 100 according to the present embodiment distributes high-quality partial images or moving images with respect to the area specified by the attention area A, thereby suppressing an increase in the amount of advertisement data and Can be prevented from lowering. Alternatively, the effect of the advertisement can be improved. For example, when the compression ratio of the partial image 5 is improved or the resolution is increased, a clear image can be obtained up to a certain extent even if the user enlarges a distant place, for example, Tokyo Tower. This makes it easier for the user to click on the advertisement. In addition, when the partial image 5 of the moving image is distributed, even if the image quality is deteriorated, the user is more interested in the movement, so that the advertisement can be easily clicked.

<Other application examples>
As described above, the best mode for carrying out the present invention has been described using the embodiment. However, the present invention is not limited to such embodiment at all, and various modifications may be made without departing from the gist of the present invention. And substitutions can be added.

  For example, in the present embodiment, an example in which the omnidirectional image is displayed in the advertisement frame 7 has been described, but the omnidirectional image may not be displayed as an advertisement. For example, the omnidirectional image displayed on the Web page provided directly by the advertiser Web server 70 may be rotated so as to follow the attention area A.

  Further, the application of the terminal device 30 that displays the omnidirectional image is not limited to the browser 8, and the application can be rotated so as to follow the attention area A when any application software displays the omnidirectional image.

  Further, in the present embodiment, an example in which the omnidirectional image is used for the advertisement has been described, but the omnidirectional image need not be used for the advertisement.

  As described with reference to FIG. 13, in the present embodiment, the terminal device 30 accesses the DSP 20 and then accesses the image distribution device 10 to acquire the advertisement data. However, the DSP 20 may directly acquire the advertisement data from the image distribution device 10 and transmit the advertisement data to the terminal device 30. Since the terminal device 30 can acquire the advertisement data only by accessing the DSP 20, the time until the advertisement is displayed can be reduced.

  When the celestial sphere image 6 displayed in the display pattern is clicked, the display area and the viewing angle at the time of the click may be used as the operation history for determining the attention area A.

  Further, the DSP 20 and the image distribution device 10 may be integrally configured, and the DSP 20 may distribute the advertisement data (omnidirectional image) to the terminal device 30.

  The advertisement distribution unit 12 may evaluate the display pattern based on the click rate instead of the number of clicks. Alternatively, evaluation may be performed using an index that can be evaluated, such as the number of times a “like button” is pressed.

  Further, the advertisement distribution method in which the SSP 50, the DSP 20, and the image distribution device 10 described in the present embodiment cooperate is merely an example, and there is no intention to limit the process until the terminal device 30 displays the advertisement. For example, as a simple process, the partner site Web server 60 may store advertisement data from an advertiser and distribute the advertisement data to the terminal device 30. In this case, the SSP 50, the DSP 20, and the image distribution device 10 may be omitted.

  Further, in the present embodiment, the omnidirectional image that can be imaged at 360 degrees around the omnidirectional camera is described as being arranged on the Web page, but the image data of the Web page may be a wide-angle image. The wide-angle image according to the present embodiment refers to an image having a portion that cannot be displayed in an advertisement frame. For example, a panoramic image having an angle of view of about 180 degrees only in the horizontal direction may be used.

  In addition, the omnidirectional image is not limited to the case where the two images are created by a method in which two images are stuck together. . That is, the method of creating the spherical image is not limited.

  Further, in the present embodiment, for convenience of explanation, a display range in which a part of the omnidirectional image 6 is cut out is described. However, by setting an angle of view covering the entire omnidirectional image, the terminal device 30 is displayed. Can display the entire spherical image (stereosphere). The angle of view of part or all of the attention area A of the display pattern may include the entire celestial sphere image 6.

  Further, the configuration example of FIG. 9 and the like shown in the above embodiment is divided according to main functions in order to facilitate understanding of the processing of the browsing system 100. However, the present invention is not limited by the way of dividing each processing unit or the name. The browsing system 100 can be divided into more processing units according to the processing content. Further, it is also possible to divide the processing unit so that one processing unit includes more processing.

  The pattern DB 195 is an example of a display order storage unit, the advertisement distribution unit 12 is an example of a wide-angle image transmission unit, the advertisement acquisition unit 39 is an example of a wide-angle image acquisition unit, and the advertisement display unit 40 is an example of a wide-angle image display unit. For example, the operation history transmission unit 42 is an example of an operation history transmission unit, and the operation history acquisition unit 14 is an example of an operation history acquisition unit. The attention area Ai (i: 1 to 4) is an example of a first display area, and the attention area Ai + 1 is an example of a second display area. The terminal device 30 is an example of an information processing device or a second information processing device.

  Referring to FIGS. 24 to 27, a celestial sphere image (captured image) represents the inside of a jewelry store, a predetermined area image that is a predetermined area of the celestial sphere image is displayed in display frame 7 as a back image, and 3DCG of the ring is A case where the image is superimposed and displayed on the rear image as the front image will be described.

  FIGS. 24 to 26 are screen examples in which a 3DCG of a ring is displayed as a front image on a background image of a jewelry store. FIG. 27 is a diagram showing 3DCG of a ring having a different viewpoint.

  FIG. 24 shows a predetermined area image indicating the attention area (predetermined area) A11 in the celestial sphere image representing the inside of the jewelry store, and a 3DCG (here, “B11”) of the ring superimposed on the predetermined area image. Is displayed. FIG. 25 shows a state in which the 3D CG (here, “B13”) whose viewpoint direction has been changed is superimposed, while the predetermined area image remains as it is in FIG. In FIG. 26, a predetermined area image in which the attention direction of the 3D CG is changed from the attention area A11 to the attention area A12 is displayed with the viewpoint direction of FIG. 24 unchanged.

  In such a case, the predetermined area image is represented as continuously moving from the predetermined area A11 and gradually approaching the predetermined area A12. In addition, the 3DCG continuously rotates (moves) from the viewpoint direction B11 and gradually approaches the viewpoint direction B12 as shown in FIG. It is represented as approaching B13.

  In the above embodiment, the photographed image has been described, but the present invention is not limited to this. For example, it may be an image such as 2DCG (Two-Dimensional Computer Graphics).

7 Advertisement frame 10 Image distribution device 13 Attention target determination unit (an example of determination means)
20 DSP
30 terminal device 34 operation accepting unit (an example of accepting means)
39 Advertisement acquisition unit (an example of receiving means)
40 advertisement display unit (an example of display control means)
50 SSP
60 partner site web server 70 advertiser web server 100 browsing system

JP 2008-192115 A

Claims (15)

A terminal device that displays an image transmitted from the image distribution device,
Receiving means for receiving image data and 3DCG data transmitted by the image distribution device;
Display control means for displaying a predetermined area image indicating a predetermined area of the image as a back image, and displaying the 3DCG as a front image on the back image;
A terminal device comprising: The receiving means receives viewpoint display order information transmitted by the image distribution device and indicating a display order of a plurality of viewpoint directions in the 3DCG,
2. The terminal device according to claim 1, wherein the display control unit changes the viewpoint direction of the 3DCG and displays the 3DCG based on the display order indicated by the viewpoint display order information. 3.   The display control means may be configured to continuously change and display the 3D-CD display form from the first viewpoint direction to the second viewpoint direction based on the display order indicated by the viewpoint display order information. The terminal device according to claim 2, wherein:   The terminal device according to claim 2, wherein the viewpoint display order information indicates an order in which the number of times of display in the past in a plurality of viewpoint directions in the 3DCG is large. The terminal device according to claim 2, wherein:
A receiving unit that receives a change in the viewpoint direction of the 3DCG;
The terminal device, wherein the display control means displays the 3DCG according to a viewpoint direction in which a change has been accepted by the accepting means, without following a display order indicated by the viewpoint display order information. The receiving means receives area display order information transmitted by the image distribution device and indicating a display order of a plurality of predetermined area images in the image,
The display control unit displays each of the plurality of predetermined region images based on a display order indicated by the region display order information. The method according to claim 1, wherein the display control unit displays each of the plurality of predetermined region images. Terminal device.   The display control means displays the predetermined area image by continuously changing from a first predetermined area to a second predetermined area in the image based on a display order indicated by the area display order information. The terminal device according to claim 6, wherein:   8. The terminal device according to claim 6, wherein the area display order information indicates an order in which the number of times of display in the past in a plurality of predetermined areas in the image is large. 9. The terminal device according to claim 6, wherein:
Having reception means for receiving a change in the predetermined area,
The terminal device, wherein the display control means displays a predetermined area image indicating a predetermined area whose change has been received by the receiving means, without following a display order indicated by the area display order information.   The terminal device according to claim 1, wherein the image data transmitted by the image distribution device is data of a captured image obtained by being captured. A terminal device according to any one of claims 1 to 10,
The image distribution device;
Browsing system having A display method executed by a terminal device that displays an image transmitted from the image distribution device,
A receiving step of receiving image data and 3DCG data transmitted by the image distribution device;
A display control step of displaying a predetermined area image indicating a predetermined area of the image as a back image, and displaying the 3DCG on the back image as a front image;
A display method characterized by performing:   A program for causing a computer to execute the method according to claim 12. A terminal device that displays an image transmitted from the image distribution device,
Receiving means for transmitting 2DCG data and 3DCG data transmitted by the image distribution device;
Display control means for displaying a predetermined area image indicating a predetermined area of the 2DCG as a back image, and displaying the 3DCG as a front image on the back image;
A terminal device comprising:   The terminal device according to claim 1, wherein the image transmitted from the image distribution device is an advertisement image.