JP2019022207A - Browsing system, image distribution apparatus, image distribution method, and program - Google Patents

Abstract

To provide a browsing system capable of delivering images expected to be interested by a browser.SOLUTION: An image browsing system 100 having an image distribution apparatus 10 that distributes a wide-angle image and an information processing apparatus 30 that displays the wide-angle image, and the image distribution apparatus includes display method storage means 195 in which a display method of a plurality of display positions of the wide-angle image are registered, and wide-angle image transmitting means 12 for transmitting the display method and the wide-angle image to the information processing apparatus, and the information processing apparatus includes wide angle image acquiring means 39 for acquiring the display method and the wide-angle image and wide-angle image display means 40 for displaying the wide-angle image at the display position on the display device by the display method acquired by the wide-angle image acquiring means.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a browsing system, an image distribution device, an image distribution method, and a program.

  A distribution-type display advertisement in which an advertiser displays an advertisement in an advertisement space provided on a Web page is known. Advertisers can display advertisements for products and services in advertising spaces provided by various websites. Since a viewer who is interested in the product or service displayed in the advertisement frame clicks (or taps) the advertisement frame, the advertiser can call the viewer into his / her website.

  Advertisers want to improve the frequency with which viewers click on advertisements, but the number of advertisements posted on one Web page is increasing, and advertisers devise display methods that attract the attention of viewers (For example, refer to Patent Document 1). Patent Document 1 discloses a technique for improving the effect (click rate) of an advertisement by distributing a video advertisement. Since people tend to lose their line of sight to moving objects, it is possible to increase the degree of attention of advertisements and improve the effectiveness of advertisements.

  However, there is a problem in that a moving image cannot be displayed in a manner in which the viewer is expected to be interested because the moving image only changes in time series. Therefore, the click rate cannot always be improved.

  In view of the above-described problems, an object of the present invention is to provide a browsing system capable of distributing an image expected to be of interest to a viewer.

The present invention is a browsing system having an image distribution device that distributes a wide-angle image and an information processing device that displays the wide-angle image, and the image distribution device has a display method of a plurality of display positions of the wide-angle image. A registered display method storage means; and a wide-angle image transmission means for transmitting the display method and the wide-angle image to the information processing apparatus;
The information processing apparatus includes the display method and a wide-angle image acquisition unit that acquires the wide-angle image;
Wide-angle image display means for displaying the wide-angle image at the display position on a display device by the display method acquired by the wide-angle image acquisition means.

  It is possible to provide a browsing system capable of distributing an image expected to be of interest to the viewer.

It is an example of the figure explaining an omnidirectional image as an example of a wide-angle image. It is an example of the figure explaining the outline of a browsing system. It is an example of the schematic block diagram of a browsing system. It is an example of a block diagram showing a schematic hardware configuration of a terminal device, an advertiser Web server, a partner site Web server, a DSP, an SSP, and an image distribution device. It is an example of the use image figure of a spherical camera. It is a figure explaining the outline | summary of the process until an omnidirectional image is produced from the image imaged with the omnidirectional camera. It is a figure explaining the outline | summary of the process until an omnidirectional image is produced from the image imaged with the omnidirectional camera. It is an example of the figure explaining a viewer's eyes | visual_axis. It is an example of the functional block diagram which shows the function of a terminal device, an advertiser web server, a partner site web server, an image delivery apparatus, SSP, and DSP in a block form. It is an example of the flowchart figure which shows the procedure in which an attention point determination part determines an attention point. It is an example of the figure explaining the partial image of an omnidirectional image. It is an example of the figure which illustrates typically the information which a web page uses. It is an example of the sequence diagram explaining the procedure which the browsing system delivers the omnidirectional image used as an advertisement. It is an example of the sequence diagram which shows the procedure in which an image delivery apparatus updates the click frequency for every display pattern. It is a figure which shows typically the display of the attention point based on a display pattern. It is an example of the figure which illustrates expansion or reduction typically. It is an example of the figure which illustrates an example of the movement amount with respect to time, and a movement speed typically. It is an example of the figure explaining the moving speed from the coordinate 1 to the coordinate 2. FIG. It is an example of the flowchart figure which shows the procedure in which an advertisement display part displays an omnidirectional image based on a display pattern. It is an example of the figure explaining switching of a display pattern. It is an example of the flowchart figure which shows the procedure in which a terminal device switches a display pattern. It is an example of the flowchart figure which shows the procedure in which the advertisement delivery part of an image delivery apparatus suppresses the delivery of the omnidirectional image by the same display pattern. It is a figure explaining the change of the coordinate in the case of the moving image from which an imaging position hardly moves. (Example 2) which is an example of the functional block diagram which shows the function of a terminal device, an advertiser web server, a partner site web server, an image delivery apparatus, SSP, and DSP in the block form. It is an example of a diagram for explaining a method of generating a high-quality partial image by making the compression rate of the partial image smaller than that of the omnidirectional image. It is an example of the figure explaining the method of producing | generating the high quality partial image 5 by making the resolution of a partial image larger than the omnidirectional image. It is an example of the figure explaining the method to produce | generate the partial image of a moving image. It is an example of the sequence diagram which shows the procedure in which an image delivery apparatus delivers the advertisement data from which the compression rate of a spherical image and a partial image differ. It is an example of the sequence diagram which shows the procedure in which an image delivery apparatus delivers the advertisement data from which the resolution of a omnidirectional image and a partial image differ. It is an example of the sequence diagram which shows the procedure in which an image delivery apparatus delivers the advertisement data containing the partial image and omnidirectional image of a moving image.

  Hereinafter, as an example of an embodiment for carrying out the present invention, a browsing system and an image distribution method performed by the browsing system will be described with reference to the drawings.

<Outline of Electronic Device System of Present Embodiment>
FIG. 1 is an example of a diagram illustrating an omnidirectional image 6 as an example of a wide-angle image. FIG. 1A shows an omnidirectional image 6 represented by a three-dimensional solid sphere CS, and FIG. 1B shows an omnidirectional image 6 represented by an equirectangular projection. The omnidirectional image 6 generated by the omnidirectional camera has a three-dimensional structure in which an image as shown in FIG. The virtual camera IC corresponds to the viewer's viewpoint, and the viewpoint is at the center of the omnidirectional image 6 in FIG. The viewer can display an arbitrary predetermined region T of the omnidirectional image 6 by rotating three axes around the X axis, the Y axis, and the Z axis passing through the virtual camera IC. The predetermined area T can be enlarged or reduced, and the displayed predetermined area T in the omnidirectional image 6 is called an angle of view.

FIG. 2 is a diagram illustrating an overview of the browsing system 100 of the present embodiment. This embodiment demonstrates the browsing system 100 which uses the omnidirectional image 6 for the advertisement delivered by a third party delivery. Third-party distribution is a mechanism for distributing advertisements across a plurality of media in order to manage the entire campaign on the advertiser side. The third-party distribution server controls the advertisement distribution frequency and measures the advertisement effect. In FIG. 2, the image distribution apparatus 10 corresponds to a third party distribution server.
(1) When the terminal device 30 opens a Web page having the advertising space 7 with the browser 8, a DSP 20 (Demand-Side Platform) that wants to display an advertisement on the terminal device 30 is notified to the terminal device 30. The terminal device 30 requests an advertisement from the DSP 20.
(2) The DSP 20 requests an advertisement from the image distribution apparatus 10.
(3) The image distribution device 10 stores the advertisement request, generates access information 2 for the terminal device 30 to access the own device, and transmits the access information 2 to the DSP 20.
(4) The DSP 20 transmits the received access information 2 to the terminal device 30.
(5) The terminal device 30 requests advertisement data (omnidirectional image 6) from the image distribution device 10 based on the access information 2. The image distribution apparatus 10 according to the present embodiment includes a plurality of attention points P of the omnidirectional image 6 (each attention point is represented by Pn (n: natural number), and arbitrary attention points are simply indicated by “P”) and images. The advertisement data that holds the corners and in which the attention point P is displayed in order at each angle of view is generated.
(6) The image distribution device 10 transmits the advertisement data requested by the access information 2 to the terminal device 30.
(7) The terminal device 30 receives the advertisement data, and the browser 8 operating on the terminal device 30 rotates the omnidirectional image 6 to display a plurality of attention points P in order at designated angles of view. For example, the omnidirectional image 6 in FIG. 2 holds three attention points P and the angle of view of each attention point P, and the attention point P-1 (view angle 1) → notice even if the viewer does not operate. An omnidirectional image 6 that rotates in the order of point P-2 (view angle 2) → target point P-3 (view angle 3) is generated as advertisement data.

  According to the browsing system 100 of the present embodiment, the terminal device 30 can automatically display the attention point corresponding to the characteristic part of the omnidirectional image 6 like a moving image, so that it is easy to attract the viewer's interest. Further, since the angle of view changes, the image is displayed as zoomed-in (enlarged) or zoomed-out (reduced), so that the viewer can be more easily noticed. With respect to an advertisement that is difficult to list as a whole such as an omnidirectional image, the browsing system 100 according to the present embodiment displays an advertisement effect (click) by displaying the part that the advertiser wants to show emphasized. Rate) can be improved.

<Terminology>
The attention point P refers to a part of the omnidirectional image 6 where a characteristic image (part) is captured. The term “point” is not limited to one pixel but may mean a part. More specifically, the attention point P is a portion where the viewer is assumed to be interested. The attention point P may be determined by, for example, pure image processing, may be detected as a portion where a predetermined subject is captured, or may be statistically determined from a portion actually displayed by the viewer Good.

  The effect of the advertisement is at least attention, but further clicking (or tapping) by the viewer may be referred to as an effect.

  The display position display method is information that determines how to display a part of the omnidirectional image. For example, the display order or the angle of view may be reflected and reflected. The display order of the display positions is the order in which a part of the omnidirectional image is displayed. A part of the omnidirectional image may be arbitrarily wide and may be arranged in the order in which the centers of a plurality of viewpoints indicating display positions are displayed.

<System configuration example>
FIG. 3 is an example of a schematic configuration diagram of the browsing system 100. The browsing system 100 includes a terminal device 30, an image distribution device 10, a DSP 20, a SSP (Supply Side Platform) 50, a partner site Web server 60, and an advertiser Web server 70 that can communicate via a network N. .

  The network N is constructed by a LAN constructed in a facility where the terminal device 30 is installed, a provider network of a provider that connects the LAN to the Internet, a line provided by a circuit provider, and the like. When the network N has a plurality of LANs, the network N is called a WAN or the Internet. The network N may be constructed by either wired or wireless, and wired and wireless may be combined. Further, when the terminal device 30 is directly connected to the public network, it can be connected to the provider network without going through the LAN.

  The terminal device 30 is an information processing device that operates as a client terminal in the present embodiment. In the terminal device 30, the browser 8 or application software having an equivalent function is operating, and the Web page requested by the terminal device 30 is received from the partner site Web server 60 and displayed (LCD: Liquid Crystal Display described later). To display.

  The terminal device 30 is, for example, a PC (Personal Computer), a tablet device, a smartphone, a PDA (Personal Digital Assistant), a game machine, a navigation terminal, a wearable PC, or the like, as long as it can display a Web page. For example, the printer may be used as the terminal device 30 when the printer has a function for displaying a Web page or a display. Digital signage may display a web page. Digital signage is a system, display device, or information that is displayed using electronic display devices such as a display in places where people can pass or exist, such as outdoors, stores, public spaces, and transportation facilities. Say. In the present embodiment, it is assumed that the web application is included in the web page. The web application refers to software used on the web browser or a mechanism thereof, which operates when a program in a programming language (for example, JavaScript (registered trademark)) that operates on the web browser and a program on the web server side cooperate. .

  The terminal device 30 may be connected to the network N via a wired LAN or wireless LAN access point, or connected to the network N by switched line type communication such as 3G, 4G or LTE (Long Term Evolution). Also good.

  The partner site Web server 60 is a server (general information processing device) that provides information and functions to a client computer (a terminal device 30 of the present embodiment) used by a viewer through a network. An advertisement frame 7 is provided on a web page provided by the advertiser web server 70. The partner site Web server 60 requests the SSP 50 to display an advertisement on the advertisement space 7.

  The advertiser Web server 70 is also a server (general information processing apparatus) that provides information and functions through a network to a client computer (terminal apparatus 30 of the present embodiment) used by a viewer. When the viewer clicks (or taps) the advertising space 7, the terminal device 30 accesses the advertiser Web server 70. The advertiser web server 70 is operated by the advertiser, and requests the DSP 20 to purchase the advertising space 7 for displaying the advertisement of its product or service, and requests the image distribution apparatus 10 to generate the advertisement and display the advertisement. ing.

  The advertiser web server 70 and partner site web server 60 communicate with the terminal device 30 using, for example, a communication protocol of HTTP or HTTPs. In response to the request from the terminal device 30, the advertiser Web server 70 and the partner site Web server 60 transmit screen information to the terminal device 30. The screen information is a program described in HTML, script language, and CSS (cascading style sheet). The structure of the Web page is specified mainly by HTML, the operation of the Web page is specified by the script language, and the Web is specified by CSS. The page style is specified. In the present embodiment, it is a script language that reflects the operation of the browser on the Web page in the omnidirectional image 6. Specifically, a program language called JavaScript (registered trademark) or ECMAScript is known as the script language.

  Both the advertiser web server 70 and the partner site web server 60 record cookies on the terminal device 30. Advertiser Web server 70 records both its own cookies and DSP 20 cookies, and partner site Web server 60 records both its own cookies and SSP 50 cookies.

  The SSP 50 is a mechanism for maximizing profits by selling the advertising space 7 by the partner site Web server 60 on which the advertising space 7 is posted. Although shown as one device in the figure, it is a network of one or more information processing devices. The partner site Web server 60 requests the SSP 50 to sell the advertising space 7. Specifically, an advertisement tag issued by the SSP 50 is described in the advertisement space 7, and when the terminal device 30 displays a web page of the partner site web server 60, the advertisement tag requests the SSP 50 to distribute an advertisement (advertisement request). . The SSP 50 receives a bid for the advertising space 7 from the DSP 20, and transmits access information 1 for accessing the DSP 20 that has won the bid to the terminal device 30.

  The DSP 20 is a mechanism for performing efficient and effective advertisement distribution for advertisers, such as purchase of advertisement space 7 and advertisement distribution. Although shown as one device in the figure, it is a network of one or more information processing devices. That is, the DSP 20 acquires a cookie (referred to as an SSP cookie for distinction) from the SSP 50, and determines the attributes of the viewer based on the correspondence information between the DSP cookie and the SSP cookie managed by the DSP 20. Then, a bid is placed on the SSP 50 at a price determined based on the advertisement distribution setting from the advertiser requested based on the viewer's attributes, budget, and the like.

  The DSP 20 that has made a successful bid is requested for an advertisement from the terminal device 30 by the access information 1. The DSP 20 notifies the image distribution apparatus 10 of the advertisement request, and acquires access information 2 for the terminal apparatus 30 to request the advertisement data from the image distribution apparatus 10 to the image distribution apparatus 10. The advertisement data includes a display program for displaying the omnidirectional image 6 and an operation history program for acquiring an operation history.

  The DSP 20 transmits the access information 2 to the terminal device 30. The DSP 20 charges the advertiser according to the contract. Billing according to the contract is performed between the image distribution apparatus 10 and the advertiser. However, whether or not the user is charged only when the advertisement is displayed differs depending on the contract.

  The image distribution apparatus 10 is one or more information processing apparatuses that provide advertisement data including an advertisement material (global image 6) that is optimal for the viewer's attribute to the advertisement space 7 purchased by the DSP 20. The image distribution apparatus 10 holds input materials such as banners and texts and advertisement images. The advertisement data may be just a banner (an image made up of characters, photos or pictures), or may include a script language in addition to the image. In the present embodiment, a display program for rotating the omnidirectional image 6 in the display order or reflecting the operation of the viewer on the omnidirectional image 6 in the display mode of the omnidirectional image 6, and the omnidirectional image 6 includes an operation history program for recording an operation history for 6. Both are described in a script language.

  When the terminal device 30 requests the advertisement data from the image distribution device 10 based on the access information 2, the image distribution device 10 transmits the advertisement data to the terminal device 30. The omnidirectional image 6 is included in the advertisement data, and the display program automatically rotates the omnidirectional image so as to follow the point of interest of the omnidirectional image 6, and enlarges or reduces it. . In addition, the operation history program transmits an operation history for the omnidirectional image 6 to the image distribution apparatus 10 together with a cookie (referred to as an image cookie for distinction) of the image distribution apparatus 10 and an image ID. The operation history is, for example, information on which viewing angle of view is displayed. Since this operation history is used for determining the attention point, the operation history is transmitted when the operation history is not used for determining the attention point. It does not have to be.

  In addition, the operation history program transmits to the image distribution apparatus 10 that the click is performed together with a pattern ID of a display pattern to be described later. The image distribution apparatus 10 defines a plurality of display patterns for one omnidirectional image 6, and only the display patterns with a high click rate can be distributed by monitoring the click rate of each display pattern.

<Hardware configuration example>
FIG. 4 is a block diagram illustrating a schematic hardware configuration of the terminal device 30. The terminal device 30 can be generally implemented as a personal computer, a workstation, or an appliance server. The terminal device 30 includes a CPU 201 and a memory 202 that enables high-speed access of data used by the CPU 201. The CPU 201 and the memory 202 are connected to other devices or drivers of the terminal device 30, for example, a graphics driver 204 and a network device (NIC) 205 via the system bus 203.

  The graphics driver 204 is connected to an LCD (display device) 206 via a bus and monitors a processing result by the CPU 201. A touch panel may be integrally disposed on the LCD 206. In this case, the viewer can operate the terminal device 30 using a finger as an operation means.

  The network driver 205 connects the terminal device 30 to the network N at the transport layer level and the physical layer level to establish a session with the advertiser Web server 70 and the like.

  An I / O bus bridge 207 is further connected to the system bus 203. On the downstream side of the I / O bus bridge 207, a storage device such as an HDD 209 is connected by an IDE, ATA, ATAPI, serial ATA, SCSI, USB, etc. via an I / O bus 208 such as PCI. . Instead of the HDD 209 or together with the HDD 209, an SSD (Solid State Drive) may be included.

  The HDD 209 stores a program 209p for controlling the entire terminal device 30. The program 209p includes screen information transmitted by the advertiser Web server 70, the partner site Web server 60, and the DSP 20 in addition to the browser 8. The terminal device 30 executes the display program and the operation history program included in the browser 8 and the screen information. The program 209p includes an advertisement tag, access information 1, 2 and the like.

  Further, an input device 210 such as a keyboard and a mouse (referred to as a pointing device) is connected to the I / O bus 208 via a bus such as a USB, and accepts inputs and commands by an operator such as a viewer. .

  The hardware configuration diagram of the advertiser Web server 70, the partner site Web server 60, the SSP 50, the DSP 20, and the image distribution apparatus 10 is the same as or different from that in FIG. It shall not be a problem. Advertiser Web server 70, partner site Web server 60, DSP 20, and image distribution device 10 are preferably compatible with cloud computing. Cloud computing refers to a usage pattern in which resources on a network are used without being aware of specific hardware resources. In this case, the hardware configuration shown in FIG. 4 does not have to be housed in a single housing or provided as a single device, and is not limited to the advertiser web server 70, partner site web server 60, DSP 20, And hardware elements that the image distribution apparatus 10 preferably includes. In addition, in order to support cloud computing, the physical configurations of the advertiser Web server 70, partner site Web server 60, DSP 20, and image distribution apparatus 10 of this embodiment may not be fixed, and load may be increased. Accordingly, it may be configured by dynamically connecting / disconnecting hardware resources.

<About spherical image 6>
The omnidirectional image 6 will be described with reference to FIGS. FIG. 5 is a usage image diagram of the omnidirectional camera 9. As shown in FIG. 5, the omnidirectional camera 9 is used for the user to take an image of a subject around the user with his / her hand. The omnidirectional camera 9 has a structure in which the back surfaces of two imaging elements are opposed to each other, and obtains two hemispherical images by imaging a subject around the user.

  Next, an outline of processing until an omnidirectional image 6 is created from an image captured by the omnidirectional camera 9 will be described with reference to FIGS. 6 and 7. 6A shows a hemispheric image (front side) captured by the omnidirectional camera 9, FIG. 6B shows a hemispheric image captured by the omnidirectional camera 9 (rear side), and FIG. 6C. FIG. 4 is a diagram showing an image represented by equirectangular projection (hereinafter, referred to as “equal equirectangular image”). FIG. 7A is a conceptual diagram showing a state in which a sphere is covered with an equirectangular image, and FIG. 7B is a diagram showing an omnidirectional image 6.

  As shown in FIG. 6A, the image obtained by the omnidirectional camera 9 is a hemispherical image (front side) curved by the fisheye lens. Also, as shown in FIG. 6B, the image obtained by the omnidirectional camera 9 is a hemispherical image (rear side) curved by the fisheye lens. Then, the hemispherical image (front side) and the hemispherical image inverted by 180 degrees (rear side) are synthesized by the omnidirectional camera 9, and as shown in FIG. Created.

  Then, by using OpenGL ES (Open Graphics Library for Embedded Systems), as shown in FIG. 7A, the equirectangular image is pasted so as to cover the spherical surface, and FIG. The omnidirectional image 6 as shown in FIG. Thus, the omnidirectional image 6 is represented as an image in which the equirectangular image is directed toward the center of the sphere. Note that OpenGL ES is a graphics library used to visualize 2D (2-Dimensions) and 3D (3-Dimensions) data. The omnidirectional image 6 may be a still image or a moving image.

  The omnidirectional image 6 is included in the advertisement data distributed by the image distribution apparatus 10. Since the omnidirectional image 6 is an image pasted so as to cover the spherical surface, it is curved and has a sense of incongruity when viewed by humans. Therefore, the terminal device 30 displays a predetermined region T of the omnidirectional image 6 as a flat image with a small curvature so as not to give a sense of incongruity to humans. The predetermined area T is indicated by coordinates (X, Y, Z) in a three-dimensional virtual space. On the other hand, since the LCD 206 is a two-dimensional plane, the terminal device 30 cannot be displayed in the predetermined area T. Therefore, the terminal device 30 obtains the predetermined region T by perspective projection conversion in which a three-dimensional object is projected onto a two-dimensional plane using a 3D computer graphic technique. As described above, as shown in FIG. 1, the predetermined area T of the omnidirectional image 6 is displayed on the LCD 206 as a display area.

  FIG. 8 is an example of a diagram illustrating a viewer's line of sight. Since the omnidirectional image 6 has three-dimensional coordinates, the line-of-sight direction is specified by information for specifying the three-dimensional coordinates or the coordinates of the sphere such as latitude and longitude. In the present embodiment, the center cp of the predetermined region T is the line-of-sight direction.

  The viewer can change the line-of-sight direction by operation, but assuming that the virtual camera IC does not move in parallel, the virtual camera IC is a rigid body that rolls (rotates around the Z axis) and yaw (centers around the Y axis). Rotation) and pitch (rotation around the X axis) are possible. The line-of-sight direction changes regardless of which of these three rotations occurs. For example, when the viewer rotates the omnidirectional image 6 in the horizontal direction, the yaw angle changes. When the viewer rotates it in the vertical direction, the pitch angle changes, and when the omnidirectional image 6 is rotated about the center of the LCD 206. The roll angle changes. In the present embodiment, a browser operation on the web page is reflected in the viewing direction (roll angle, yaw angle, pitch angle) and the like. It is assumed that how it is reflected is described in advance in the display program.

<About functions>
FIG. 9 is an example of a functional block diagram illustrating the functions of the terminal device 30, the advertiser Web server 70, the partner site Web server 60, the image distribution device 10, the SSP 50, and the DSP 20 in a block form.

<< Advertiser Web Server 70, Partner Site Web Server 60 >>
The advertiser web server 70 and the partner site web server 60 have a web page providing unit 71. These functions of the advertiser Web server 70 and the partner site Web server 60 are functions or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

  The web page providing unit 71 performs, for example, general HTTP communication, constructs a web page in response to a web page request from the terminal device 30, and transmits the web page to the terminal device 30. If necessary for the processing, the application server is requested to perform the processing, and the processing result is arranged on the Web page and transmitted. The web page of the advertiser web server 70 includes an advertiser cookie and a DSP cookie. This is because the advertiser Web server 70 requests the DSP 20 to distribute advertisements. Thereby, a retargeting advertisement or the like becomes possible. The web page of the partner site web server 60 includes a partner site cookie and an SSP cookie. This is because the partner site Web server 60 requests the SSP 50 to sell the advertising space 7. The Web page providing unit 71 is realized by the CPU 201 illustrated in FIG. 4 executing the program 209p.

<< SSP50 >>
The SSP 50 includes an advertisement request acquisition unit 52, an advertisement request unit 51, an access information transmission unit 53, and a successful bid unit 54. Each of these functions of the SSP 50 is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

  The advertisement request acquisition unit 52 acquires the advertisement request requested together with the SSP cookie by executing the advertisement tag associated with the advertisement space 7 by the terminal device 30. The advertisement request acquisition unit 52 sends an advertisement request including the SSP cookie to the advertisement request unit 51. The advertisement request acquisition unit 52 is realized by the CPU 201 illustrated in FIG. 4 executing the program 209p.

  The advertisement request unit 51 transmits an advertisement request to the DSP 20. The advertisement request includes the SSP cookie, the domain of the partner site Web server 60, the advertisement space ID, the advertisement space size, the advertisement format, the browser type, the OS type, and the like. The advertisement request unit 51 is realized by the CPU 201 shown in FIG. 4 executing the program 209p.

  The successful bid unit 54 accepts bids from the DSP 20, and basically conducts an auction for selling the advertising space 7 to the DSP 20 with the highest bid amount (some advertisers' products and services do not accept bids). The successful bid section 54 generates a successful bid ID and notifies the DSP 20 of it. The successful bid section 54 is realized by the CPU 201 shown in FIG. 4 executing the program 209p.

  The access information transmission unit 53 generates access information 1 for requesting an advertisement to the DSP 20 that has made a successful bid, and transmits it to the terminal device 30 together with the successful bid ID. The access information 1 includes the URL (IP address) of the DSP 20. The access information transmission unit 53 is realized by the CPU 201 shown in FIG. 4 executing the program 209p.

<< DSP20 >>
The DSP 20 includes a request reception unit 21, a bid determination unit 22, a bid unit 23, an advertisement request reception unit 24, and an image request unit 25. Each of these functions of the DSP 20 is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

  In the storage unit 29, a cookie information DB 291 and a distribution setting DB 292 are constructed. The storage unit 29 is realized by the HDD 209 or the memory 202 shown in FIG.

Table 1 schematically shows information stored in the cookie information DB 291. The cookie information DB 291 associates the DSP cookie and the SSP cookie, and the visit domain visited by the viewer is registered. The association between the DSP cookie and the SSP cookie is possible by a technique called a cookie sink. The visit domain is obtained by a visitor visiting a Web site to which the DSP 20 has attached a tag (behavior monitoring tag). Therefore, the DSP 20 can specify the DSP cookie from the SSP cookie, and can determine what Web site the viewer is interested in.

Table 2 schematically shows information stored in the distribution setting DB 292. In the distribution setting DB 292, an advertiser ID, an advertisement target attribute (preferred target person attribute), and a non-advertisement target attribute (unfavorable target person attribute) are registered. The advertiser ID is identification information for specifying or identifying an advertiser who is a provider that provides a wide-angle image. Therefore, the DSP 20 or the image distribution device 10 determines whether or not to transmit the wide-angle image with reference to the attribute of the preferable target person or the attribute of the unfavorable target person set for the provider of the wide-angle image. Can do.

  Note that ID is an abbreviation of Identification and means an identifier or identification information. ID refers to a name, a code, a character string, a numerical value, or a combination of one or more of these used to uniquely distinguish a specific target from a plurality of targets. The same applies to the following IDs. The advertisement target attribute is an attribute of a viewer that the advertiser wants to distribute the advertisement, and the non-advertisement target attribute is an attribute of a viewer that the advertiser does not want to distribute the advertisement. The DSP 20 compares the browser attribute determined from the cookie information DB 291 and the like with the information in the distribution setting DB 292, digitizes the browser attribute, and determines the bid amount. In addition, various information, such as a time slot | zone, a day of the week, a visitor's area, etc., may be considered in the determination of a bid price.

(Function of DSP 20)
The request reception unit 21 receives an advertisement request from the SSP 50. Basic information such as the advertising space ID of the terminal device 30 is obtained from the request information. The request receiving unit 21 is realized by the CPU 201 shown in FIG. 4 executing the program 209p.

  The bid determination unit 22 determines the bid amount by evaluating the advertisement request received by the request reception unit 21 with reference to the cookie information DB 291 and the distribution setting DB 292 (there may not be a bid). As described above, the DSP cookie is identified from the SSP cookie, and the bid amount is determined by how much the attribute information stored in association with the DSP cookie matches the advertiser request stored in the distribution setting DB 292. To do. The bid determination unit 22 is realized by the CPU 201 shown in FIG. 4 executing the program 209p.

  The bidding unit 23 bids on the SSP 50 with the determined bid amount. The bidding unit 23 is realized by the CPU 201 shown in FIG. 4 executing the program 209p. If successful bid is obtained, a successful bid ID is acquired and associated with the advertisement request.

  The advertisement request receiving unit 24 acquires an advertisement request (successful bid ID, DSP cookie) from the terminal device 30 based on the access information 1. The advertisement request receiving unit 24 specifies an advertisement request by the successful bid ID. The DSP cookie may not be used, and is used when the SSP cookie and the DSP cookie are not associated with each other. The advertisement request receiving unit 24 is realized by the CPU 201 illustrated in FIG. 4 executing the program 209p.

  The image request unit 25 requests the image distribution apparatus 10 for the access information 2 together with the DSP cookie, the advertiser ID, and the request content. The advertiser is specified by the advertiser ID. The advertising space 7 is specified by the advertising space ID of the request content. Further, the viewer's attribute may be transmitted to the image distribution apparatus 10. Thereby, the image delivery apparatus 10 can deliver the omnidirectional image 6 suitable for the viewer. The image request unit 25 is realized by the CPU 201 shown in FIG. 4 executing the program 209p.

<< Terminal device 30 >>
The terminal device 30 includes a web page acquisition unit 31, a web page analysis unit 32, a web page display unit 33, an operation reception unit 34, and a script execution unit 35. Each of these functions of the terminal device 30 is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

  The operation receiving unit 34 receives various operations on the terminal device 30. Specifically, an operation for a browser executed by the terminal device 30 is accepted. When the Web page has a program (the above script) described in the script language, an operation on the Web page triggered by the script is accepted. In this embodiment, it is not strictly distinguished whether the operation target is the terminal device 30, the browser, or the web page, and the operation on the terminal device 30, the operation on the browser, or the operation on the web page has the same meaning. . The operation reception unit 34 is realized by the CPU 201 illustrated in FIG. 4 executing the program 209p to control the input device 210 and the touch panel.

  The web page acquisition unit 31 communicates with the advertiser web server 70 and the partner site web server 60 by a browser operation or a script operation, and obtains a web page from the advertiser web server 70 and the partner site web server 60. . The Web page acquisition unit 31 is realized by the CPU 201 illustrated in FIG. 4 executing the program 209p and controlling the network driver 205, and the like.

  The Web page analysis unit 32 reads the HTML included in the screen information in order from the top, and analyzes the structure of text and image data included in the HTML. In addition, a link between HTML text and image data described in CSS is detected, and the style of text and image data included in HTML is associated. Further, the Web page analysis unit 32 detects a script tag from HTML and extracts a script described in a script language. The web page analysis unit 32 sends HTML and CSS to the web page display unit 33 and sends the script to the script execution unit 35. The Web page analysis unit 32 is realized by the CPU 201 illustrated in FIG. 4 executing the program 209p.

  The web page display unit 33 displays web pages on the LCD 206 in the order in which the analysis is completed from the top of the HTML. In addition, the web page is updated according to an operation on the web page. The Web page display unit 33 is realized by the CPU 201 shown in FIG. 4 executing the program 209p.

  The script execution unit 35 executes the script extracted by the web page analysis unit 32. The specific content of the script varies depending on the Web page. In the present embodiment, as a script, an advertisement tag associated with the advertising space 7, access information 1 acquired from the SSP 50, access information 2 acquired from the DSP 20, and advertisement data distributed from the image distribution device 10 are detected. The script execution unit 35 is realized by the CPU 201 illustrated in FIG. 4 executing the program 209p. Each function or means of the script execution unit 35 is realized by the CPU 201 executing the script.

  The advertising space detection unit 36 is a function realized by the terminal device 30 executing an advertising tag associated with the advertising space 7 included in the screen information acquired by the Web page acquisition unit 31. The advertisement space detection unit 36 transmits an advertisement request to the SSP 50 together with the SSP cookie based on the URL associated with the advertisement space 7.

  The access information acquisition unit 37 acquires access information 1 from the SSP 50. Access information 1 is described in a script. The advertisement request unit 38 accesses the DSP 20 based on the URL included in the access information 1 and requests an advertisement together with the successful bid ID and the DSP cookie. In response to this request, the advertisement request unit 38 acquires the access information 2 and the advertisement opportunity ID. Access information 2 is also described by a script.

  Based on the URL of the image distribution device 10 included in the access information 2, the advertisement acquisition unit 39 specifies an advertisement opportunity ID and requests the image distribution device 10 for advertisement data. Since the image distribution apparatus 10 generates advertisement data, the advertisement acquisition unit 39 acquires advertisement data. The advertisement data of the present embodiment includes an omnidirectional image 6, a display pattern, a display program, and an operation history program. The operation history program causes the image distribution apparatus 10 to transmit the operation history. The display program rotates the omnidirectional image 6 with the display pattern, and reflects the operation on the omnidirectional image 6 in the display mode of the omnidirectional image 6. The operation history program and the display program are also described in a script language, and are executed by the script execution unit 35.

  The advertisement display unit 40 displays the advertisement data acquired from the image distribution device 10. The advertisement display unit 40 is mainly realized by a display program, and displays the omnidirectional image 6 (that is, advertisement) in the advertisement frame 7 and automatically rotates it so as to follow the point of interest. Further, the display mode of the omnidirectional image 6 is changed according to the operation on the omnidirectional image 6.

  By acquiring the advertisement data from the image distribution device 10, the terminal device 30 can acquire the image cookie of the image distribution device 10 and store it in the storage unit 49. When the advertisement acquisition unit 39 transmits the image cookie to the image distribution device 10, the image distribution device 10 can associate the DSP cookie with the image cookie.

  The operation history recording unit 41 is mainly realized by an operation history program, and records operation information for the omnidirectional image 6 as an operation history. Details of the operation history will be described in the image distribution apparatus 10. The operation history transmission unit 42 is realized mainly by an operation history program, and distributes an operation history for the omnidirectional image 6 displayed in the advertising space 7 together with an image cookie and an image ID (identifies the omnidirectional image 6). Transmit to device 10. If the button is clicked, a message to that effect is transmitted to the image delivery apparatus 10 together with the display pattern.

<< Image distribution device 10 >>
The image distribution apparatus 10 includes an image information response unit 11, an advertisement distribution unit 12, an operation history analysis unit, an attention point determination unit 13, and an operation history acquisition unit 14. These functions of the image distribution apparatus 10 are functions or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

  Further, the image distribution apparatus 10 includes the storage unit 19 realized by the HDD 209 or the memory 202 illustrated in FIG. In the storage unit 19, a distribution history DB 191, an operation history DB 192, a cookie correspondence DB 193, an advertisement image DB 194, and a pattern DB 195 are constructed.

Table 3 schematically shows information stored in the operation history DB 192. The operation history DB 192 records a history of what operations each viewer has performed on the omnidirectional image 6. In the operation history DB 192, items of image ID, browsing time, image cookie, and viewing angle of view 1 to 3 are recorded. The image ID is information for specifying the omnidirectional image 6. The image cookie becomes information for determining the identity of the viewer operating the terminal device 30 or the terminal device 30 (an example of device identification information). The viewing angle of view 1 to 3 is an angle of view when the viewer browses the omnidirectional image 6. Each viewing angle of view 1 to 3 stores the viewing time, the presence / absence of enlargement, the angle of view after enlargement when enlarged, and the presence / absence of reduction. In this way, the angle of view that the viewer is considered interested in is recorded for each image. The viewing angle of view 1 to 3 is an angle of view in which the time during which the viewer is stationary without rotating the omnidirectional image 6 is a predetermined time (for example, 1 second) or more. The operation history recording unit 41 of the terminal device 30 records the upper three angles of view when the stationary time is reached. There may be only one or four or more. Similarly, the operation history recording unit 41 records whether or not the viewer is enlarged or reduced at each viewing angle of view 1 to 3. The image distribution apparatus 10 may use such an operation history as the attention point P. Further, if an image cookie is associated with an image ID, a retargeting advertisement is possible. The click angle of view may be recorded as the operation history.

Table 4 schematically shows information stored in the advertisement image DB 194. In the advertisement image DB 194, information related to the omnidirectional image 6 to be advertised is registered. In the advertisement image DB 194, an advertiser ID, an image ID, a priority, and a target attribute are registered in association with each other. Since the advertiser is determined by the DSP 20, among the images that the advertiser wants to distribute, an image to be distributed is determined based on at least one of the degree of matching or the priority between the attributes of the viewer and the target attributes in Table 4. In the case of a retargeting advertisement, an image associated with an image cookie in the operation history DB 192 is distributed.

Table 5 schematically shows information stored in the cookie correspondence DB 193. In the cookie correspondence DB 193, a DSP cookie and an image cookie are associated. The DSP cookie is notified from the DSP 20, and the image cookie is notified from the terminal device 30. By associating both, the image distribution apparatus 10 can discriminate the viewer by using only the DSP cookie.

Table 6 schematically shows information registered in the pattern DB 195. In the pattern DB 195, the order of displaying the attention point P of the omnidirectional image 6 and the combination of the angle of view are registered. A combination of order and angle of view is called a display pattern. In Table 6, the four coordinates 1 to 4 are the attention point P. The number of attention points P is not limited to four in one omnidirectional image 6 and may be three or less or five or more. Further, the omnidirectional image 6 may vary. The display pattern has a display order of coordinates 1 to 4. Therefore, when there are four attention points P, the display order is 4 factorials (= 24). Further, when the angle of view of each attention point P is changed in, for example, three stages, there are combinations of 3 to the 4th angle of view. Therefore, there are 81 combinations of one display order with respect to the angle of view. Finally, there is a 24 × 81 display pattern for one omnidirectional image. The number of clicks is the number of clicks by the viewer for each display pattern. The click is an example of “predetermined operation”. That is, the image distribution apparatus 10 displays the same omnidirectional image 6 on the plurality of terminal devices 30 with the same display pattern, and records that the terminal device 30 has been clicked. By doing so, it is possible to gradually avoid distribution using a display pattern with a low click rate. Note that the number of clicks is preferably recorded for each attribute (gender, age, family structure, etc.) of the viewer. Thereby, it can display with a display pattern with many clicks with respect to a viewer's attribute.

Table 7 schematically shows information registered in the distribution history DB 191. In the distribution history DB 191, the image ID and display pattern of the omnidirectional image 6 distributed in association with the image cookie are registered. When an image cookie is registered in the terminal device 30 when the image distribution device 10 transmits advertisement data, the image distribution device 10 can acquire the image cookie from the terminal device 30. The image distribution apparatus 10 can avoid distributing the same omnidirectional image 6 to the same viewer, or can distribute the same omnidirectional image 6 in the same display pattern. Conversely, retargeting delivery is also possible.

(About history management server functions)
The image information response unit 11 assigns an advertising opportunity ID to the DSP cookie, the advertiser ID, and the request content (mainly the advertising space ID) acquired from the DSP 20, and returns it to the DSP 20 together with the access information 2. An advertisement distribution opportunity can be specified for each advertisement space 7 of the terminal device 30 by the advertisement opportunity ID. The image information response unit 11 is realized by the CPU 201 illustrated in FIG. 4 executing the program 209p.

  The advertisement distribution unit 12 determines the omnidirectional image 6 to be distributed and the display pattern when the advertisement data is requested together with the advertisement opportunity ID from the terminal device 30. First, the omnidirectional image 6 associated with the advertiser ID acquired from the DSP 20 is determined from the advertisement image DB 194. Preferably the attributes of the viewer are taken into account. The viewer's attribute may be notified from the DSP 20 or may be accumulated by the image distribution apparatus 10 in association with the image cookie. Next, the advertisement distribution unit 12 determines the display pattern of the omnidirectional image 6 with reference to the pattern DB 195. For example, the pattern with the largest number of clicks is determined, or is arbitrarily determined from the patterns with the number of clicks equal to or greater than a threshold. It is preferable that the attributes of the viewer are taken into consideration when determining the pattern. The advertisement distribution unit 12 is realized by the CPU 201 illustrated in FIG. 4 executing the program 209p to control the network driver 205, and the like.

  The operation history acquisition unit 14 acquires the operation history together with the image cookie and the image ID from the terminal device 30 and sets the operation history in the operation history DB 192. There are two types of operation history: an operation history for determining a point of interest and an operation history for updating the number of clicks (clicked). The operation history acquisition unit 14 is realized by the CPU 201 illustrated in FIG. 4 executing the program 209p to control the network driver 205, and the like.

  The image distribution device 10 may have the operation history recording unit 41 of the terminal device 30. Since the operation history recording unit 41 requires time-series operation content, it may be difficult for the image distribution apparatus 10 to acquire depending on a communication band or the like. On the other hand, since the operation history recording unit 41 of the terminal device 30 only needs to transmit only the final operation history to the image distribution device 10, the communication load can be reduced.

  The attention point determination unit 13 determines the attention point P of the omnidirectional image 6. Various methods for determining the attention point P can be considered, and details will be described later. The attention point determination unit 13 registers a display pattern using the determined attention point P in the pattern DB 195. The attention point determination unit 13 is realized by the CPU 201 illustrated in FIG. 4 executing the program 209p.

<Determination of attention point P>
<< Method of determining the point of interest P from the feature quantity >>
FIG. 10 is an example of a flowchart illustrating a procedure in which the attention point determination unit 13 determines the attention point P. In step S <b> 1, the attention point determination unit 13 defines a regular polyhedron having a center common to the unit sphere, and performs perspective projection conversion with the normal direction of each surface as the viewing direction to obtain a partial image. FIG. 11A shows an example in which a regular octahedron is defined as the projection plane of the omnidirectional image, and FIG. 11B shows an example in which a regular dodecahedron is defined as the projection plane of the omnidirectional image.

  In step S2, the attention point determination unit 13 extracts a predetermined feature amount from each partial image obtained in step S1. Since the input image is divided by the above method and the feature amount is calculated from the partial image with less distortion, a wide-angle image exceeding 180 degrees can be processed robustly. As the feature quantity, color, edge, saliency, object position / label, and the like can be used.

  In subsequent step S3, the point-of-interest determination unit 13 calculates the importance for each position (pixel) of the input image from the feature amount extracted from each partial image using a predetermined regression model. Although details are omitted, the importance and the feature amount for each position are expressed by a function by regression. It should be noted that importance g as output (teacher data) is determined in advance using training data by an appropriate method, and the relationship between the feature quantity and importance g is obtained.

  In the following step S4, the likelihood of the attention point P based on the importance distribution calculated in step S3 under the design concept that the attention point determination unit 13 has the user attention point P in the direction of higher importance. Calculate the distribution. For example, after defining a region R that passes the viewpoint on the unit image plane, an added value obtained by adding the importance of each position in the region R can be calculated as the attention point likelihood of the viewpoint.

  In subsequent step S5, the target point determination unit 13 calculates the target point P based on the target point likelihood distribution. In the present embodiment, for example, a position corresponding to the imaging direction corresponding to the maximum likelihood value of the attention point likelihood is calculated as the attention point P.

  In this way, several attention points P can be calculated. The attention point determination unit 13 identifies a predetermined number of attention points P or attention points P that are equal to or greater than a threshold value among the N upper attention points P. Then, a pattern combining the display order of the attention point P and the angle of view is registered in the pattern DB 195.

<< Determining the person as the point of interest P >>
A person can be considered as a subject to be noticed by a person. Face recognition is known as a person detection method. For face recognition, a known method of detecting a FOG feature value or Haar-like feature value and performing pattern matching can be used. The attention point determination unit 13 detects the center of the face as the attention point P. When the number of faces is large, the number of faces may be reduced to a fixed number by considering the faces that are close to each other as one.

<< Determine smile as attention point P >>
A person's smile can be considered as a subject that people pay attention to. As a method for detecting a smile, in addition to the above face recognition, a known method for pattern matching using a smile pattern held in advance can be used. When the number of faces is large, only the smile may be set as the attention point P. In addition to a smile, faces such as sadness, anger, and confusion may be determined as the attention point P.

<< A child is determined as a point of interest P >>
When a child exists in an adult, a person may pay attention to the child. Or, conversely, when there are adults among many children, a person may pay attention to the adults. The position of the face can be used as a method for detecting children or adults. If the face position specified by the above face recognition is lower than other face positions, it is estimated that the child is a child, and if the face position specified by face recognition is higher than the other face positions, it is an adult. It is estimated to be.

<< Determine an arbitrary subject as the point of interest P >>
It is considered that the advertiser knows the attention point P that the advertiser wants the viewer to browse. Therefore, the attention point determination unit 13 can detect the subject designated by the advertiser and set it as the attention point P. For example, an advertiser's product or service, such as an automobile, furniture, or food, is detected by pattern recognition and set as the attention point P.

<< Use operation history >>
When a child exists in an adult, a person may pay attention to the child. Or, conversely, when there are adults among many children, a person may pay attention to the adults. The position of the face can be used as a method for detecting children or adults. If the face position specified by the above face recognition is lower than other face positions, it is estimated that the child is a child, and if the face position specified by face recognition is higher than the other face positions, it is an adult. It is estimated to be. When clicked, the angle of view at the time of clicking may be set as the attention point P.

<Information used by Web page>
FIG. 12 is an example of a diagram schematically illustrating information used by a Web page. FIG. 12A shows a web page provided by the partner site web server 60. The web page provided by the partner site web server 60 has one or more advertising spaces 7. The terminal device 30 holds an SSP cookie and a DSP cookie in advance. The advertisement frame 7 is associated with the URL of the SSP 50 and the advertisement frame ID. The browser (advertisement space detection unit 36) of the terminal device 30 transmits the SSP cookie and the request content to the SSP 50. Further, the access information 1 including the URL of the DSP 20 that has made a successful bid for the advertising space 7 and the successful bid ID are transmitted from the SSP 50 to the terminal device 30.

  FIG. 12B is a diagram for explaining the operation of the access information 1. The access information 1 transmits a successful bid ID and a DSP cookie to the DSP 20 based on the URL of the DSP 20. The DSP 20 specifies the advertisement request with the successful bid ID, and acquires the access information 2 including the URL of the image distribution device 10 and the advertisement opportunity ID from the image distribution device 10. The terminal device 30 acquires the access information 2 and the advertisement opportunity ID from the DSP 20.

  FIG. 12C illustrates the operation of the access information 2. The access information 2 transmits an advertisement opportunity ID to the image distribution device 10 based on the URL of the image distribution device 10. The image distribution apparatus 10 generates advertisement data based on an advertisement request specified by the advertisement opportunity ID, and transmits the advertisement data to the terminal apparatus 30 together with the image cookie, the advertisement frame ID, and the display pattern. In this way, the omnidirectional image 6 is displayed in the advertising space 7 of the Web page.

<Operation procedure>
FIG. 13 is an example of a sequence diagram illustrating a procedure for distributing the omnidirectional image 6 displayed as an advertisement by the browsing system 100.

  S1: First, the viewer operates the terminal device 30 so as to connect to the partner site Web server 60. The operation reception unit 34 of the terminal device 30 receives the operation, and the web page acquisition unit 31 acquires the web page.

  S2: The web page analysis unit 32 of the terminal device 30 analyzes the web page and extracts HTML, CSS, and script, and the web page display unit 33 displays the web page based on the HTML and CSS.

  S3: The advertising space detection unit 36 of the terminal device 30 transmits an advertising request to the SSP 50 by executing the advertising tag (script) associated with the advertising space 7. The advertisement request includes, for example, the SSP cookie, the domain of the partner site Web server 60, the advertisement space ID, the advertisement space size, the advertisement format, the browser type, the OS type, and the like.

  S4: The advertisement request acquisition unit 52 of the SSP 50 acquires an advertisement request, and the advertisement request unit 51 receives the advertisement request. The advertisement request unit 51 detects the SSP cookie, notifies the DSP 20 of the advertisement request, and sells the advertisement space 7.

  S5: The request reception unit 21 of the DSP 20 sends an advertisement request to the bid determination unit 22. The bid determination unit 22 of the DSP 20 refers to the cookie information DB 291 to identify the DSP cookie from the SSP cookie.

  S6: The bid determination unit 22 determines the attribute from the DSP cookie. The visit domain of the cookie information DB 291 may be referred to, or the attribute information of the viewer specified by the DSP cookie may be referred to as appropriate.

  S7: The bid determination unit 22 refers to the distribution setting DB 292 and transmits the wide-angle image to the viewer based on the attributes of the preferable target person or the unfavorable target person set for the provider of the wide-angle image. Determine whether or not. Here, it is assumed that it is determined to distribute at least one advertiser.

  S8: The bid determination unit 22 determines the bid amount according to the advertiser's budget, the degree of matching of attributes, and the like.

  S9: The bidding unit 23 of the DSP 20 bids on the SSP 50. The successful bid section 54 of the SSP 50 determines the DSP 20 that applied for the highest bid amount as a successful bidder in principle for bids from a plurality of DSPs 20.

  S10: Here, it is assumed that the illustrated DSP 20 makes a successful bid. The SSP 50 notifies the DSP 20 of the successful bid ID.

  S11: The access information transmission unit 53 of the SSP 50 transmits the access information 1 together with the successful bid ID to the terminal device 30.

  S12: The advertisement request unit 38 of the terminal device 30 executes the access information 1 to transmit an advertisement request to the DSP 20 together with the successful bid ID.

  S13: The advertisement request receiving unit 24 of the DSP 20 specifies the advertisement request by the successful bid ID. The image request unit 25 requests an image from the image distribution apparatus 10 together with the advertiser ID, the DSP cookie, and the advertisement request.

  S14: When receiving the image request, the image information response unit 11 of the image distribution device 10 generates an advertisement opportunity ID for specifying the advertisement request.

  S15: The image information response unit 11 transmits the access information 2 associated with the advertisement opportunity ID to the DSP 20.

  S16: The image request unit 25 of the DSP 20 receives the access information 2, and the advertisement request receiving unit 24 transmits it to the terminal device 30.

  S17: The advertisement acquisition unit 39 of the terminal device 30 transmits an advertisement request (advertisement opportunity ID) based on the URL of the image distribution device 10 included in the access information 2. When the terminal device 30 holds an image cookie, the image cookie can be transmitted.

  S18: The advertisement distribution unit 12 of the image distribution apparatus 10 identifies the image request by the advertisement opportunity ID.

  S19: The advertisement distribution unit 12 determines an attribute from the DSP cookie or determines an attribute from the image cookie.

  S20: The advertisement distribution unit 12 specifies the omnidirectional image 6 based on the advertiser ID and the attribute. That is, the omnidirectional image 6 to be transmitted is determined based on the attribute or priority of the distribution target set for the omnidirectional image 6 with reference to the advertisement image DB 194. The display pattern has a click count higher than the threshold value, but is selected at random while the number of distributions of the omnidirectional image 6 is small.

  S21: The advertisement distribution unit 12 transmits the advertisement data including the omnidirectional image 6, the display pattern, the image ID, the image cookie, and the advertisement frame ID to the terminal device 30. The omnidirectional image 6 is associated with the URL of the advertiser Web server 70.

  S22: The advertisement acquisition unit 39 of the terminal device 30 acquires the advertisement data, and the advertisement display unit 40 displays the omnidirectional image 6 in the advertisement frame 7. When the viewer clicks on the advertising space 7, the operation reception unit 34 receives the Web page acquisition unit 31 and starts communication with the advertiser Web server 70.

<Updating the number of clicks for each display pattern>
FIG. 14 is an example of a sequence diagram illustrating a procedure in which the image distribution apparatus 10 updates the number of clicks for each display pattern.

  S1: It is considered that the viewer browses the omnidirectional image 6 of the advertising frame 7 that rotates according to the display pattern, and clicks (or taps) the advertising frame 7 if interested. The operation reception unit 34 of the terminal device 30 receives a click.

  S2: The operation history recording unit 41 records an operation of clicking, and transmits to the image distribution apparatus 10 that the operation history transmission unit 42 has been clicked. The transmission of the click may be performed immediately after the click or when the communication addition is small. This notification includes an image ID, a pattern ID, and an image cookie. The presence of image cookies makes it possible to record the number of clicks for each attribute.

  S3: The operation history acquisition unit 14 of the image distribution apparatus 10 acquires that the click has been made, and increases (updates) the number of clicks associated with the image ID and the pattern ID in the pattern DB 195 by one. Alternatively, the attribute is determined based on the image cookie, and the number of clicks is increased for each attribute.

  By such processing, the number of clicks is accumulated for each display pattern, and the number of clicks of a display pattern that is easily clicked increases. In other words, a display pattern that is difficult to click becomes clear.

<Display based on display pattern>
FIG. 15 is a diagram schematically showing the display of the attention point P based on the display pattern. FIG. 15A shows an example of the display pattern, and FIG. 15B shows an example of the attention point P and the angle of view in the omnidirectional image 6.

  The display pattern shown in FIG. 15A is included in the advertisement data, and the advertisement display unit 40 displays the attention point P-1 with a medium-size angle of view, the attention point P-2 with a small angle of view, and the attention point P-1. -3 is displayed with a large angle of view, and the attention point P-4 is displayed with a medium angle of view in order. After the attention point P-4, the display returns to the attention point P-1.

  Specifically, as shown in FIG. 15B, the display ranges 1 to 4 of the omnidirectional image 6 continuously move. The display ranges 1 to 4 are portions of the omnidirectional image 6 determined by the attention points P-1 to P-4 and the angle of view. This display range is displayed in the advertising space 7. The advertisement display unit 40 continuously follows the display ranges 1 to 4 in order while always displaying the omnidirectional image 6.

  Since the size of the advertisement frame 7 does not change, when viewed from the viewer, it looks like it is enlarged when moving from the display range 1 to the display range 2, and when it moves from the display range 2 to the display range 3, it looks like it is reduced. The movement from the display range 3 to the display range 4 appears to be enlarged, and the movement from the display range 4 to the display range 1 does not appear to be enlarged or reduced.

  In this way, since the terminal device 30 always displays the omnidirectional image 6 by automatically following the plurality of attention points P in order, the characteristic part of the omnidirectional image 6 can be displayed without any operation by the viewer. The viewer can browse.

  FIG. 16 is an example of a diagram schematically illustrating enlargement or reduction. FIG. 16A shows a display method for enlarging in parallel with the movement of the display range, and FIG. 16B shows a display method for enlarging after the movement of the display range. Since the angle of view is reduced by moving from the display range 1 to the display range 2, FIG. 16 means enlargement, but the same applies to reduction.

  A display method of FIG. 16A will be described. The advertisement display unit 40 specifies four vertices S1 to S4 in the case of a medium angle of view at the point of interest P-1. The coordinates of the four vertices Q1 to Q4 in the case of the attention point P-2 and a small angle of view can be calculated. Therefore, the coordinates of each division point are obtained by dividing (interpolating) the curve on the sphere (on the spherical surface of the omnidirectional sphere) connecting S1 and Q1, S2 and Q2, S3 and Q3, and S4 and Q4. The terminal device 30 displays the omnidirectional image 6 at the angle of view. By doing so, the celestial sphere image 6 can be reduced while smoothly moving from the display range 1 to the display range 2, and the attention point P can be displayed at a fixed angle of view.

  A display method of FIG. 16B will be described. The advertisement display unit 40 specifies four vertices S1 to S4 in the case of a medium angle of view at the point of interest P-1. The coordinates of the four vertices S1 ′ to S4 ′ in the case of the attention point P-2 and a small angle of view can be calculated. The advertisement display unit 40 divides (interpolates) the curve on the sphere connecting S1 and S1 ′, S2 and S2 ′, S3 and S3 ′, and S4 and S4 ′ into the coordinates of each division point. The terminal device 30 displays an image at an angle of view (constant).

  Next, the advertisement display unit 40 divides the curve on the sphere connecting S1 ′ and Q1, S2 ′ and Q2, S3 ′ and Q3, and S4 ′ and Q4 into The terminal device 30 displays an image at the angle of view. By doing so, the omnidirectional image 6 can be smoothly moved from the display range 1 to the display range 2, and then the display range 2 can be enlarged and displayed at a fixed angle of view.

  Which display method is used may be the one with higher advertisement appeal and is set in the image distribution apparatus 10 in advance. Alternatively, the number of clicks may be counted using two display methods as one type of display pattern, and the one with the higher number of clicks may be employed.

<About stationary time and moving speed>
FIG. 17 is an example of a diagram that schematically illustrates an example of a movement amount and a movement speed with respect to time. FIG. 17A shows the movement amount, and FIG. 17B shows the movement speed. As shown in FIGS. 17A and 17B, the movement of the display range stops at the points of interest P-1, P-2, P-3, and P-4, and from the point of interest P-1 to the point of interest P-2. When moving from the point of interest P-2 to the point of interest P-3 and from the point of interest P-3 to the point of interest P-4, it moves at a constant speed. Since the display range is stationary for a predetermined time at the attention points P-1, P-2, P-3, and P-4, the viewer can confirm the attention point P. Information regarding the moving speed is stored in the pattern DB 195 and transmitted to the terminal device 30.

  The rest time is several seconds (for example, 1, 2 seconds). Also, the rest time may be zero. However, it is preferable to move slowly even if it does not stop completely at P-1, P-2, P-3, and P-4 so that the viewer can confirm.

  FIG. 18 is an example of a diagram for explaining the moving speed from the point of interest P-1 to the point of interest P-2. The same applies to other movements between the attention points P. FIG. 18A shows a moving method in which the terminal device 30 moves the display range from the attention point P-1 to the attention point P-2 at a constant speed. That is, it is the same as FIG. The display range can be moved at the highest speed.

  FIG. 18B shows a moving method in which the moving speed gradually increases from the attention point P-1 as the movement start point, becomes constant thereafter, and gradually decreases before the next attention point P-2. Show. Since rapid movement is avoided, there is a merit that the viewer can easily see.

  FIG. 18C shows a moving method in which the moving speed gradually increases from the point of interest P-1 as the movement start point to the stop at the point of interest P-2. Abrupt movement can be avoided at the start of movement.

  FIG. 18D shows a moving method in which the moving speed gradually decreases from the point of interest P-1 as the movement start point to the stop at the point of interest P-2. Since the moving speed gradually decreases before the point of interest P-2, the viewer can browse the next point of interest P for a long time.

  The moving method with which the display range moves is assumed to be set in the image distribution apparatus 10 in advance, assuming that a moving method with high advertising appeal is adopted. Alternatively, the number of clicks may be counted using these movement methods as one of the display patterns, and the one with the higher number of clicks may be employed.

<Display based on display pattern>
FIG. 19 is an example of a flowchart illustrating a procedure in which the advertisement display unit 40 displays the omnidirectional image 6 based on the display pattern. The procedure of FIG. 19 starts when the terminal device 30 receives advertisement data.

  First, the advertisement display unit 40 sets “1” to i (S10). i indicates the display order of the attention point and the angle of view of the display pattern.

  Next, the advertisement display unit 40 displays the omnidirectional image 6 with the i-th attention point and the angle of view of the display pattern (S20).

  Next, it is determined whether or not a certain time has elapsed since the display was started (S30). The fixed time may be zero.

  When the determination in step S30 is Yes, the advertisement display unit 40 determines whether or not the display pattern has ended (S40).

  When the display pattern ends, the advertisement display unit 40 sets “1” to i, and displays the omnidirectional image 6 with the first attention point and the angle of view in the display order (S60).

  If the display pattern has not ended, the advertisement display unit 40 increases i by one (S50).

  Next, the advertisement display unit 40 starts moving to the i-th attention point of the display pattern (S70).

  Then, the advertisement display unit 40 changes the angle of view after moving to the i-th attention point of the display pattern, or changes the angle of view while moving (S80).

  The process returns to step S20 to display the attention point and the angle of view of the display pattern based on the display order.

<Repeating display pattern>
The omnidirectional image 6 displayed on the advertisement frame 7 by the terminal device 30 rotates while automatically following the attention point P as described above. However, there are cases where the click rate can be improved by displaying with a different display pattern when not clicked, rather than repeatedly displaying with a display pattern that is not clicked. Therefore, the terminal device 30 changes the display pattern of the same omnidirectional image 6 as follows.

20A shows the first display pattern, FIG. 20B shows the second display pattern, and FIG. 20C shows the third display pattern. The image distribution device 10 transmits a plurality of display patterns to the terminal device 30. The advertisement display unit 40, for example, repeats one display pattern only twice and displays it in another display pattern when it is repeated twice.
A. First, the first display pattern is repeated twice.
B. Next to the last point of interest P-4 of the first display pattern, it moves to the first point of interest P-1 of the second display pattern.
C. Repeat the second display pattern twice.
D. After the last point of interest P-3 of the second display pattern, it moves to the first point of interest P-3 of the third display pattern. Since there is no need to move from the point of interest P-3 to the point of interest P-3, the third display pattern starts without moving.

  When the last display pattern and the first display point P of the next display pattern are the same, the display of the first display point P of the next display pattern is finished, and the second display point P of the next display pattern is finished. Display may be started from.

  Thus, if it displays by the same display pattern more than predetermined times, a click rate can be improved by switching a display pattern. The predetermined number of times is an example, and the predetermined number of times as a reference for switching is arbitrarily determined. For example, the terminal device 30 may determine according to the display time of one display pattern.

  Note that the operation history recording unit 41 of the terminal device 30 transmits the pattern ID of the display pattern employed when clicked to the image distribution device 10.

  FIG. 21 is an example of a flowchart illustrating a procedure in which the terminal device 30 switches the display pattern.

  When receiving the advertisement data, the advertisement display unit 40 of the terminal device 30 displays the omnidirectional image 6 and starts rotating (S10).

  Next, the operation history recording unit 41 determines whether or not the operation receiving unit 34 has received a click (S20). When the determination in step S20 is Yes, the operation history recording unit 41 transmits a click notification (image ID, pattern ID, image cookie) to the image distribution device 10 (S30).

  When the determination in step S20 is No, the advertisement display unit 40 determines whether or not the same display pattern has been repeated twice (S40).

  If the determination in step S40 is No, steps S20 to S30 are repeatedly executed.

  When the determination in step S40 is Yes, the advertisement display unit 40 switches the display pattern (S50). The process proceeds to step S10, and rotation of the omnidirectional image 6 is started with the next display pattern.

<Switching display pattern when delivering the same image to the same viewer>
A viewer whose image cookie is registered in the distribution history DB 191 has viewed the omnidirectional image 6 in some display pattern. When the viewer browses a web page of the partner site web server 60 or a web page of another web server, the image delivery apparatus 10 may deliver the omnidirectional image 6. In this case, the image delivery apparatus 10 can improve the click rate by changing the display pattern. 20 and 21, when the terminal device 30 repeatedly displays the display pattern while switching, at least the first display pattern is switched.

  FIG. 22 is an example of a flowchart illustrating a procedure in which the advertisement distribution unit 12 of the image distribution apparatus 10 suppresses the distribution of omnidirectional images with the same display pattern.

  First, the advertisement distribution unit 12 acquires a request for advertisement data together with an image cookie (S10). In the past, in the case of the terminal device 30 that has received the distribution of the omnidirectional image 6, since the image cookie is stored, the image distribution device 10 can determine the viewer.

  The advertisement distribution unit 12 determines whether or not there is a distribution history of the omnidirectional image 6 to be distributed with reference to the distribution history DB 191 (S20). That is, it is determined whether there is a distribution history in which the omnidirectional image 6 determined according to the attribute or the like is distributed to the same viewer.

  When the determination in step S20 is No, the advertisement distribution unit 12 distributes in a display pattern with a high number of clicks as described above (S30).

  When the determination in step S20 is Yes, the advertisement distribution unit 12 distributes with a display pattern different from the display pattern recorded in the distribution history DB 191 (S40). For example, a display pattern having the highest number of clicks among the display patterns different from the display patterns recorded in the distribution history DB 191 is distributed.

  In the case of a retargeting advertisement, the omnidirectional image recorded in the distribution history DB 191 is distributed. In this case as well, the display pattern different from the display pattern recorded by the image distribution apparatus 10 in the distribution history DB 191 is used. The same omnidirectional image 6 can be distributed in different display patterns. In the case of a retargeting advertisement, it can be intentionally distributed in the same display pattern.

<Video distribution>
In many cases, the omnidirectional image 6 of the moving image is distributed. A moving image is an image having frames with different imaging times. In the case of moving images, there are cases where the imaging position hardly moves or moves. When the imaging position does not move, the position of the point of interest P does not move, so that it is the same as in the case of a still image.

  FIG. 23 is a diagram for explaining a change in coordinates in the case of a moving image in which the imaging position hardly moves. FIG. 23A shows the display range 301 that is stationary at the point of interest P-1. Since it is a moving image, the frame is switched when the time elapses, but the point of interest P-1 does not move. That is, the display range 301 displayed by the terminal device 30 at time t1 to t3 does not move.

  FIG. 23B shows a display range 301 that moves from the point of interest P-1 to the point of interest P-2. In parallel with the frame switching, the display range 301 moves from the point of interest P-1 to the point of interest P-2. However, since the point of interest P does not move, the display range 301 may be moved as in the case of a still image.

  FIG. 23C shows the display range 301 that is stationary at the point of interest P-2. Since it is a moving image, the frames are switched when the time elapses, but the point of interest P-2 does not move. That is, the display range 301 displayed by the terminal device 30 from time t7 to t9 does not move.

  On the other hand, in the case of a moving image whose imaging position moves with time, the attention point determination unit 13 detects the attention point P and performs processing for tracking the same attention point P between frames, and labels the attention point P in each frame. To do. The coordinates and angle of view are adjusted in each frame so that the same point of interest P is displayed during the stationary time. When the coordinates move, interpolation may be performed in the same manner as for a still image. Since it is a moving picture, the point of interest P may disappear during playback. In this case, it moves to the next attention point P before disappearing. Therefore, the attention point determination unit 13 tracks the attention point P and manages the presence / absence of the attention point P with respect to the time zone, thereby generating a display pattern for displaying the attention points P in order.

<Summary>
As described above, according to the browsing system 100 of the present embodiment, the terminal device 30 can automatically display the attention point corresponding to the characteristic part of the omnidirectional image 6 like a moving image, so that the viewer is interested. It becomes easy to pull. Further, since the angle of view changes, the image is displayed as zoomed-in (enlarged) or zoomed-out (reduced), so that the viewer can be more easily noticed. For an advertisement that is difficult to list as a whole, such as an omnidirectional image, the browsing system 100 of the present embodiment makes it easy for the viewer to browse a portion that the advertiser wants to show. In addition, since the display patterns are gradually selected according to the number of clicks, the advertisement can be distributed in a display pattern that is easily clicked with time. Therefore, the effect (click rate) of the advertisement can be improved.

  According to the first embodiment, the effect of advertisement can be improved by the omnidirectional image 6, but since the omnidirectional image 6 has a larger number of pixels because of the wide angle, it is compressed or has a lower resolution than the planar image. It is often delivered after. For example, when the volume of advertisement data (for example, file size) distributed by the image distribution apparatus 10 is limited, it is necessary to satisfy the limit, and when the distribution takes time due to the large capacity, the user This is because there is a possibility of not seeing the advertisement.

  For this reason, the image quality of the omnidirectional image 6 is lower than that of a general flat image, and there is a possibility that the advertising effect is reduced. For example, even if a characteristic subject is reflected in a background moving far away, when the user enlarges, a situation may occur in which the image becomes blurred and does not result in a click on the advertisement.

Therefore, in this embodiment, a high-quality partial image is prepared for the area specified by the attention point P, and the image distribution apparatus 10 transmits the low-quality omnidirectional image 6 to the terminal device 30. The partial image is a partial image of the omnidirectional image. Since the high-quality partial image is a part of the omnidirectional image 6, an increase in the capacity of the advertisement data can be suppressed. There are the following two methods for preparing a high-quality partial image.
(i) The compression rate of the partial image in the region specified by the attention point P and the angle of view associated with the attention point P is made smaller than that of the omnidirectional image 6.
(ii) The resolution of the partial image of the region specified by the attention point P and the angle of view associated with the attention point P is made larger than that of the omnidirectional image 6.

  Some high-quality partial images are less likely to blur even when the user enlarges them, so that they are more likely to lead to clicks on the advertisement, and the reduction in the effectiveness of the advertisement can be suppressed.

Furthermore, in terms of advertising effectiveness, the following third method may be adopted in addition to the method of improving the image quality of some images.
(iii) Distribute a partial image of the region specified by the angle of view associated with the point of interest P and the point of interest P as a moving image.

  Since humans are easily deprived of their eyes by moving objects, even if the image quality deteriorates, if the attention point P is a moving image, the advertising effect is unlikely to decrease. In addition, in the case of a moving image, it is known that the user is less likely to notice a decrease in image quality.

<About functions>
FIG. 24 is an example of a functional block diagram illustrating the functions of the terminal device 30, the advertiser Web server 70, the partner site Web server 60, the image distribution device 10, the SSP 50, and the DSP 20 in a block form in the present embodiment. In the present embodiment, the components denoted by the same reference numerals in FIG. 9 perform the same function, and therefore, only the main components of the present embodiment may be mainly described.

  The image distribution apparatus 10 of this embodiment newly has an image processing unit 15. The image processing unit 15 acquires the attention point P registered in the pattern DB 195 and its angle of view, and generates a partial image from the omnidirectional image 6. Note that the partial image generated by the image processing unit 15 still has the coordinates (position) in the omnidirectional image 6.

  When preparing a partial image as a moving image, the original omnidirectional image 6 also needs to be a moving image. The image processing unit 15 acquires a predetermined one frame from the omnidirectional image 6 as a still image, and acquires a partial image specified by the attention point P and its angle of view as a moving image.

  Further, the script execution unit 35 of the terminal device 30 has an image adjustment unit 43. When the partial image is transmitted together with the omnidirectional image 6, the image adjustment unit 43 pastes the partial image to the omnidirectional image 6 based on the coordinates of the partial image.

<Generation of high-quality partial images>
<< Reduce the compression ratio >>
First, a method of generating a high-quality partial image 5 by making the compression rate of the partial image 5 smaller than the omnidirectional image 6 will be described with reference to FIG. It should be noted that the omnidirectional image 6 distributed from the image distribution apparatus 10 described in the first embodiment is an image that has already been compressed or reduced in resolution. For this reason, the image quality of the omnidirectional image 6 is deteriorated and the above-described problem occurs. In other words, there is a high-quality omnidirectional image 6a before compression or resolution reduction, and in this embodiment, a high-quality partial image 5 is generated using this high-quality omnidirectional image 6a. To do.
(1) In FIG. 25, the omnidirectional image 6a before compression is shown. The region of the partial image 5 is identified by diagonal vertices (X1, Y2) (X2, Y1) from the point of interest P of the omnidirectional image 6a registered in the pattern DB 195 and the angle of view (either large, medium, or small). ing.
(2) The image processing unit 15 generates the partial image 5 from the omnidirectional image 6a before compression. For example, the range of the partial image 5 may be copied (duplicated). Or you may cut out (trimming). As a result, a high-quality partial image 5 was generated. Either copying or cropping may be employed, but the size of the omnidirectional image 6 can be reduced because the pixels are eliminated by the cropping (such as uniform white pixels). The partial image 5 has coordinates in the omnidirectional image 6a.
(3) Next, the image processing unit 15 generates the compressed omnidirectional image 6 by compressing the omnidirectional image 6a before compression for distribution as an advertisement. In the description of FIG. 25, it is assumed that the resolution (number of pixels) is not changed by this compression, but the resolution may be changed. Note that image compression means reducing the file size without changing the resolution (number of pixels) of the image. For example, when a bitmap format image is converted into an image such as a JPEG format, compression is performed and the file size can be reduced. In JPEG, the compression rate is variable, and the higher the compression rate, the smaller the file size. However, in compression, processing is performed in which similar data is regarded as the same data, and the higher the compression rate, the lower the image quality.
(4) The image distribution device 10 distributes the compressed omnidirectional image 6 and the partial image 5 (including coordinates) to the terminal device 30.

  The image adjustment unit 43 of the terminal device 30 that has received the distribution pastes the partial image 5 on the compressed omnidirectional image 6. First, the omnidirectional image 6 is image data in which pixel values are associated with pairs of latitude and longitude. Since the partial image 5 holds the coordinates in the omnidirectional image 6, the partial image 5 may be pasted on the omnidirectional image 6 according to the coordinates.

  When pasting, the pixel of the compressed omnidirectional image 6 is replaced with the pixel value of the partial image 5 (the image of the point of interest P of the compressed omnidirectional image 6 is not displayed) or superposed. (An image of the attention point P of the compressed omnidirectional image 6 is also displayed). In any method, as long as the partial image 5 exists, only the partial image 5 is visible to the user.

  In addition, in this embodiment, since the omnidirectional image 6 is affixed to a solid sphere so as to wrap the solid sphere, the advertisement display unit 40 of the terminal device 30 causes the omnidirectional image to be displayed on two solid spheres when superimposed. 6 and the partial image 5 may be pasted and displayed so that the solid sphere of the partial image is in front of the user.

  Since the high-quality partial image 5 is pasted on the omnidirectional image 6 compressed in this way, even when the user enlarges the partial image 5, the user can easily view the details, and the advertising effect Can be suppressed. Even if the resolution of the omnidirectional image 6 is further reduced, the partial image 5 has coordinates in the omnidirectional image 6 and can be pasted in the same manner as described with reference to FIG. it can.

<< Increase the resolution >>
Next, a method for generating the high-quality partial image 5 by making the resolution of the partial image 5 larger than that of the omnidirectional image 6 will be described with reference to FIG. In FIG. 26, the omnidirectional image 6 distributed from the image distribution apparatus 10 is an image whose capacity is reduced by compressing or reducing the resolution.
(1) FIG. 26 shows the omnidirectional image 6a before the resolution is reduced. The region of the partial image 5 is specified by the diagonal vertex (X1, Y2) (X2, Y1) from the attention point P and the angle of view of the omnidirectional image 6a.
(2) The image processing unit 15 generates the partial image 5 from the omnidirectional image 6a before the resolution is reduced as in FIG. Even if the resolution is reduced, the partial image 5 has coordinates in the omnidirectional image 6a.
(3) Next, the image processing unit 15 generates the omnidirectional image 6 by reducing the resolution of the omnidirectional image 6a for distribution as an advertisement. In the description of FIG. 26, it is assumed that the image is not compressed even if the resolution is reduced.

The resolution of the present embodiment refers to the number of pixels constituting the omnidirectional image 6. The larger the number of pixels, the more information that represents one omnidirectional image 6 and the more detailed omnidirectional image 6 can be displayed. For example, it is assumed that the resolution of the omnidirectional image 6a before the change in resolution is 1000 × 2000, and the resolution of the omnidirectional image 6 after the change is 500 × 1000. In this case, the resolution was reduced to 1/2 each of the vertical and horizontal directions. However, each pixel value of the omnidirectional image 6 is not changed to a point associated with latitude and longitude (the coordinates are not changed even if the resolution is changed).
(4) The image distribution device 10 distributes the omnidirectional image 6 and the partial image 5 with reduced resolution to the terminal device 30.

  The image adjustment unit 43 of the terminal device 30 receiving the distribution pastes the partial image 5 on the omnidirectional image 6 with reduced resolution. Since the resolution of the partial image 5 is twice that of the partial image 5 of the omnidirectional image 6 whose resolution has been reduced, the pixels of the partial image 5 do not fit in the omnidirectional image 6 as they are. For this reason, when the resolution of a partial image is changed, the advertisement display unit 40 of the terminal device 30 pastes the omnidirectional image 6 and the partial image 5 on two solid spheres as described in FIG. In addition, it is preferable to display (superimpose) the solid sphere of the partial image so as to come to the user. In the region with a large number of pixels, the omnidirectional panoramic image has a large number of pixels, so that the resolution of the point of interest P can be increased. As a result, an omnidirectional image 6 having a larger number of pixels is obtained in a region where the partial image 5 is present.

  Since the partial image 5 having a high resolution is pasted on the omnidirectional image 6 having a reduced resolution in this way, even when the user enlarges the partial image 5, the user can easily view details, and the advertisement The decrease in the effect can be suppressed. Even if the omnidirectional image 6 is further compressed, the partial image 5 has coordinates in the omnidirectional image 6 and can be pasted in the same manner.

<< Use video >>
Next, a method for generating a partial image 5 of a moving image will be described with reference to FIG. In the description of FIG. 27, it is assumed that the omnidirectional image 6 distributed from the image distribution apparatus 10 is an image whose capacity is reduced by compression. However, the resolution may be reduced, or compression and resolution reduction may be performed. Both may be done.
(1) FIG. 27 shows an example of the omnidirectional image 6a before compression. When the partial image 5 of the moving image is created, it is assumed that the omnidirectional image 6a is also a moving image. Note that the attention point P and the angle of view of the omnidirectional image 6a are the same for each moving image, and the partial image 5 is specified by the diagonal vertex (X1, Y2) (X2, Y1).
(2) The image processing unit 15 generates a partial image 5 of a moving image from each omnidirectional image 6a before compression. That is, the partial image 5 of the moving image is obtained by taking in only the partial image 5 from each frame of the omnidirectional image 6a of the moving image.
(3) The image processing unit 15 determines one frame (still image) of the omnidirectional image 6a included in the moving image. For example, it may be the first frame, the middle, or the last frame. Alternatively, it may be a frame with the best image quality viewed from the balance of luminance.
(4) The image processing unit 15 compresses the moving image partial image 5 to generate the compressed moving image partial image 5. In this compression, the resolution (number of pixels) may or may not change. By doing so, the capacity of the advertisement data can be reduced. The partial image 5 of the moving image may be distributed without being compressed.
(5) The image processing unit 15 generates the compressed omnidirectional image 6 by compressing the omnidirectional image 6a determined in (3) for distribution as an advertisement. In this compression, the resolution (number of pixels) may or may not change.
(6) The image distribution device 10 distributes the compressed omnidirectional image 6 and the partial image 5 of the moving image to the terminal device 30.

  The image adjusting unit 43 of the terminal device 30 that has received the distribution pastes the partial image 5 of the moving image on the compressed omnidirectional image 6. The partial image 5 may be pasted in accordance with the original coordinates on one still image by either the method of compression or the resolution being changed. During reproduction, the pasting of part of the image 5 is repeated with time. Since the partial image 5 of the moving image is generated from the original omnidirectional image 6 in this way, it is possible to suppress a decrease in the advertising effect even if the image quality is deteriorated.

  What is common to the above methods (i) to (iii) is that the high-quality partial image 5 is generated from the original omnidirectional image 6a. It is easy to paste. Assuming that a planar image captured by a digital camera for planar imaging is pasted on the omnidirectional image 6, positioning and the like are not easy. In the present embodiment, the partial image 5 may be pasted at the original location of the omnidirectional image 6 from which the partial image 5 was acquired.

<Operation procedure>
Hereinafter, the delivery procedure of the partial image 5 described in the above (i) to (iii) will be described with reference to FIGS.

  FIG. 28 is an example of a sequence diagram illustrating a procedure in which the image distribution device 10 distributes advertising data in which the compression ratios of the omnidirectional image 6 and the partial image 5 are different. The process in FIG. 28 is assumed to start when advertisement data is distributed (when a Web page is displayed on the terminal device 30) as an example. However, the processing in the image distribution apparatus 10 is possible after the timing when the attention point P is determined.

  S101: The image distribution apparatus 10 specifies the omnidirectional image 6a distributed as advertisement data as described with reference to FIG.

  S102: The image processing unit 15 generates a partial image 5 from the omnidirectional image 6a before compression.

  S103: The image processing unit 15 compresses the omnidirectional image 6a.

  S104: The advertisement distribution unit 12 of the image distribution device 10 distributes the advertisement data including the compressed omnidirectional image 6a and the partial image 5 to the terminal device 30.

  S105: The advertisement acquisition unit 39 of the terminal device 30 receives the advertisement data, and the image adjustment unit 43 adds the partial image 5 to the omnidirectional image 6 based on the coordinates of the omnidirectional image 6 of the partial image 5. paste. Thereby, since one equirectangular cylindrical image is obtained, the advertisement display unit 40 can generate an omnidirectional panoramic image as described with reference to FIG.

  S106: The advertisement display unit 40 displays the omnidirectional image 6 in the advertisement frame. For example, the attention point P1 is displayed on the advertising space. Since the attention point P1 has a compression rate lower than that of the omnidirectional image 6 as described above, the attention point P1 with high image quality can be displayed.

  FIG. 29 is an example of a sequence diagram illustrating a procedure in which the image distribution apparatus 10 distributes advertisement data in which the resolution of the omnidirectional image 6 and the partial image 5 is different. In the description of FIG. 29, differences from FIG. 28 are mainly described.

  S201: The image distribution apparatus 10 specifies the omnidirectional image 6a distributed by the advertisement data as described with reference to FIG.

  S202: The image processing unit 15 generates a partial image 5 from the omnidirectional image 6a before resolution reduction.

  S203: The image processing unit 15 reduces the resolution of the omnidirectional image 6a.

  S204 to S206: The same as S104 to S106 in FIG. Since the attention point P1 has a higher resolution than the omnidirectional image 6 as described above, the attention point P1 with high image quality can be displayed.

  FIG. 30 is an example of a sequence diagram illustrating a procedure in which the image distribution device 10 distributes the advertisement data including the partial image 5 and the omnidirectional image 6 of the moving image. In the description of FIG. 30, differences from FIG. 28 are mainly described.

  S301: The image distribution apparatus 10 specifies the omnidirectional image 6a distributed as advertisement data as described with reference to FIG.

  S302: The image processing unit 15 generates a partial image 5 from each frame of the omnidirectional image 6a before compression.

  S303: The image processing unit 15 compresses each partial image 5 of the moving image.

  S304: The image processing unit 15 specifies a frame (still image) to be distributed from the omnidirectional image 6.

  S305: The image processing unit 15 compresses the omnidirectional image 6 (frame).

  S306 to S308: Same as S104 to S106 in FIG. Since the attention point P1 is displayed as a moving image as described above, the effect of the advertisement can be enhanced.

<Combination of compression, resolution, and video>
The compression rate of the partial image 5 described in the present embodiment is made smaller than that of the omnidirectional image 6, the resolution of the partial image 5 is made larger than that of the omnidirectional image 6, and the partial image 5 Can be combined with any two or more of these three methods. That is,
The compression rate of the partial image 5 is made smaller than that of the omnidirectional image 6 and the resolution of the partial image 5 is made larger than that of the omnidirectional image 6.
The compression rate of the partial image 5 is made smaller than that of the omnidirectional image 6 and the partial image 5 of the moving image is distributed.
The resolution of the partial image 5 is made larger than that of the omnidirectional image 6 and the partial image 5 of the moving image is distributed.
The compression rate of the partial image 5 is made smaller than that of the omnidirectional image 6, the resolution of the partial image 5 is made larger than that of the omnidirectional image 6, and the partial image 5 of the moving image is distributed.

  As a result, the image quality of the partial image 5 is further improved, and the video image is more likely to be noticed.

<Summary>
As described above, the browsing system 100 according to the present embodiment distributes a high-quality partial image or video with respect to the region specified by the attention point P, thereby suppressing an increase in the capacity of the advertisement data. The decrease in the effect can be suppressed. Or the effect of an advertisement can be improved. For example, when the compression rate of the partial image 5 is improved or the resolution is increased, a clear image can be obtained up to a certain extent even if the user enlarges a distant place such as Tokyo Tower. For this reason, it becomes easy to click an advertisement. Further, when the partial image 5 of the moving image is distributed, even if the image quality is deteriorated, it attracts interest by the movement, so that it becomes easy to click the advertisement.

<Other application examples>
The best mode for carrying out the present invention has been described above with reference to the embodiments. However, the present invention is not limited to these embodiments, and various modifications can be made without departing from the scope of the present invention. And substitutions can be added.

  For example, in the present embodiment, an example in which an omnidirectional image is displayed in the advertisement frame 7 has been described, but the omnidirectional image may not be displayed as an advertisement. For example, the omnidirectional image displayed on the web page provided by the advertiser web server 70 may be rotated so as to follow the attention point P.

  The application of the terminal device 30 that displays the omnidirectional image is not limited to the browser 8, and any application software can be rotated so as to follow the point of interest P when displaying the omnidirectional image.

  Further, in this embodiment, the example in which the omnidirectional image is used for the advertisement has been described, but the omnidirectional image need not be used for the advertisement.

  As described with reference to FIG. 13, in this embodiment, the terminal device 30 accesses the DSP 20 and then accesses the image distribution device 10 to acquire advertisement data. However, the DSP 20 may acquire advertisement data directly from the image distribution device 10 and transmit it to the terminal device 30. Since the terminal device 30 can acquire the advertisement data only by accessing the DSP 20, the time until the advertisement is displayed can be shortened.

  Further, when the omnidirectional image 6 displayed in the display pattern is clicked, the display position at the time of clicking and the viewing angle of view may be used as the operation history for determining the attention point P.

  Further, the DSP 20 and the image distribution device 10 may be configured integrally, and the DSP 20 may distribute the advertisement data (omnidirectional image) to the terminal device 30.

  Further, the advertisement distribution unit 12 may evaluate the display pattern not by the number of clicks but by the click rate. Alternatively, evaluation may be performed using an index that can be evaluated, such as the number of times the “like button” is pressed.

  In addition, the advertisement distribution method in which the SSP 50, the DSP 20, and the image distribution apparatus 10 described in the present embodiment cooperate with each other is merely an example, and there is no intention to limit the process until the terminal apparatus 30 displays the advertisement. For example, as a simple process, the partner site Web server 60 may store advertisement data from an advertiser and distribute it to the terminal device 30. In this case, the SSP 50, the DSP 20, and the image distribution device 10 are not necessary.

  Further, in the present embodiment, it has been described that the omnidirectional image capable of capturing 360 degrees around the omnidirectional camera is arranged on the web page, but the image data of the web page may be a wide-angle image. The wide-angle image of the present embodiment refers to an image having a portion that cannot be displayed in the advertisement frame. For example, a panoramic image having an angle of view of about 180 degrees only in the horizontal direction may be used.

  In addition, the omnidirectional image is not limited to the case where the two images are created by a method in which the two images are pasted together. . That is, the method for creating the omnidirectional image is not limited.

  Further, in the present embodiment, for the sake of convenience of explanation, a display range in which a part of the omnidirectional image 6 is cut out is described, but the terminal device 30 is set by setting an angle of view that covers the entire omnidirectional image. Can display the entire spherical image (solid sphere). The angle of view of the attention point P in part or all of the display pattern may include the entire omnidirectional image 6.

  In addition, the configuration example such as FIG. 9 shown in the above embodiment is divided according to main functions in order to facilitate understanding of the processing of the browsing system 100. However, the present invention is not limited by the way of dividing or the name of each processing unit. The browsing system 100 can also be divided into more processing units according to the processing content. Moreover, it can also divide | segment so that one process unit may contain many processes.

  The pattern DB 195 is an example of a display method storage unit, the advertisement distribution unit 12 is an example of a wide-angle image transmission unit, the advertisement acquisition unit 39 is an example of a wide-angle image acquisition unit, and the advertisement display unit 40 is a wide-angle image display unit. For example, the operation reception unit 34 is an example of an operation reception unit, the operation history transmission unit 42 is an example of an operation history transmission unit, and the operation history acquisition unit 14 is an example of an operation history acquisition unit. The point of interest Pi (i: 1 to 4) is an example of the first display position, and the point of interest Pi + 1 is an example of the second display position. The terminal device 30 is an example of an information processing device or a second information processing device. The image processing unit 15 is an example of an image generation unit, and the image adjustment unit 43 is an example of an image setting unit.

7 Advertising space 10 Image distribution device 20 DSP
30 terminal device 40 advertisement display unit 50 SSP
60 Partner Site Web Server 70 Advertiser Web Server 100 Browsing System

JP 2008-192115 A

Claims (20)

A browsing system having an image delivery device for delivering a wide-angle image and an information processing device for displaying the wide-angle image,
The image distribution device includes:
Display method storage means in which a display method of a plurality of display positions of the wide-angle image is registered;
A wide-angle image transmission means for transmitting the display method and the wide-angle image to the information processing apparatus;
The information processing apparatus includes:
Wide angle image acquisition means for acquiring the display method and the wide angle image;
Wide-angle image display means for displaying the wide-angle image at the display position on a display device by the display method acquired by the wide-angle image acquisition means;
A browsing system.   The browsing system according to claim 1, wherein the display method is a display order of the plurality of display positions. In the display method storage means, an angle of view is set for each display position,
The wide-angle image acquisition unit acquires an angle of view for each display position together with the display order,
The browsing system according to claim 2, wherein the wide-angle image display unit displays a display range of the wide-angle image determined by the display position and the angle of view on a display device.   The browsing system according to claim 2 or 3, wherein the wide-angle image display means continuously changes the display range from the first display position to the second display position according to the display order. The wide-angle image display means starts from the angle of view set at the first display position in parallel with changing the display range continuously from the first display position to the second display position according to the display order. Change the angle of view continuously to the angle of view set to the second display position, or
The display range of the wide-angle image is changed from the angle of view set to the first display position to the angle of view set to the second display position after the display range is changed to the second display position. The browsing system described. The information processing apparatus includes:
Operation accepting means for accepting an operation on the wide-angle image displayed on the display device;
Operation history transmission means for transmitting the operation information received by the operation reception means to the image distribution device,
The operation history transmission means transmits the viewing angle of view of the wide-angle image browsed by the display device to the image distribution device,
The viewing system according to claim 1, wherein the wide-angle image transmission unit determines the display position based on the viewing angle of view. The information processing apparatus includes:
Operation accepting means for accepting an operation on the wide-angle image displayed on the display device;
Operation history transmission means for transmitting the operation information received by the operation reception means to the image distribution device,
The image distribution device includes:
An operation history acquisition unit that acquires the operation information and records the number of operations on the wide-angle image in association with the display method;
The browsing according to any one of claims 1 to 6, wherein the wide-angle image transmission unit transmits the information to the information processing apparatus in association with the display method in which the number of operations equal to or greater than a threshold is associated with the wide-angle image. system. The operation information includes a predetermined operation on the wide-angle image displayed on the display device,
The operation history transmission unit transmits the predetermined operation received by the operation reception unit, identification information of the wide-angle image, and identification information of the display method to the image distribution device,
The operation history acquisition unit of the image distribution apparatus acquires the predetermined operation, identification information of the wide-angle image, and identification information of the display method, and associates the identification information with the identification information of the wide-angle image and the display method, Record the number of predetermined operations,
The browsing system according to claim 7, wherein the wide-angle image transmission unit transmits the display method and the wide-angle image associated with the predetermined number of operations equal to or greater than a threshold value to the information processing apparatus. The wide-angle image transmission means transmits a plurality of the display methods to the information processing apparatus for one wide-angle image,
When the wide-angle image transmitting unit displays the wide-angle image including the display position on the display device a predetermined number of times or more by the same display method, the wide-angle image at the display position is displayed on the display device by another display method. The browsing system according to claim 7. The information processing device transmits device identification information for identifying the information processing device to the image distribution device,
The image distribution device has a distribution history in which identification information of the display method distributed together with the wide-angle image is recorded in association with the device identification information.
When the wide-angle image transmission unit requests the wide-angle image from the information processing apparatus that holds the apparatus identification information, the wide-angle image transmission unit uses the display method different from the display method recorded in the distribution history. The browsing system according to claim 7, wherein the browsing system is transmitted to. The information processing device transmits device identification information for identifying the information processing device to the image distribution device,
The wide-angle image transmitting means determines an attribute of a viewer of the wide-angle image based on device identification information for identifying the information processing device;
11. The method according to claim 1, wherein whether or not to transmit the wide-angle image is determined with reference to a preferable target person attribute or an unfavorable target person attribute set for the provider of the wide-angle image. The browsing system described in. The information processing device transmits device identification information for identifying the information processing device to the image distribution device,
The wide-angle image transmitting means determines an attribute of a viewer of the wide-angle image based on device identification information for identifying the information processing device;
The wide-angle image to be transmitted is determined based on the degree of coincidence or priority with the viewer's attribute by referring to the attribute or priority of the distribution target set for the wide-angle image. The browsing system according to item 1. The image distribution device includes:
Image generation means for generating a partial image including the display position in the wide-angle image by acquiring from the wide-angle image;
The wide-angle image transmission means transmits the partial image and the wide-angle image to the information processing apparatus,
The wide-angle image acquisition unit of the information processing apparatus acquires the partial image and the wide-angle image,
The browsing system according to claim 1, wherein the information processing apparatus includes an image setting unit that pastes the partial image at an original location of the wide-angle image from which the partial image is acquired. The image generating means includes
The browsing system according to claim 13, wherein the partial image is generated from the wide-angle image before the image quality of the wide-angle image is degraded. The image generation means generates the partial image having coordinates in the wide-angle image from the wide-angle image before the image quality of the wide-angle image is reduced;
The wide-angle image transmission means transmits the partial image and the compressed wide-angle image to the information processing apparatus,
The wide-angle image acquisition unit of the information processing apparatus acquires the partial image and the compressed wide-angle image,
The browsing system according to claim 14, wherein the image setting unit pastes the partial image at an original location of the compressed wide-angle image using the coordinates in the wide-angle image included in the partial image. The image generation means generates the partial image having coordinates in the wide-angle image from the wide-angle image before the image quality of the wide-angle image is reduced;
The wide-angle image transmission means transmits the partial image and the wide-angle image with reduced resolution to the information processing apparatus,
The wide-angle image acquisition unit of the information processing apparatus acquires the wide-angle image with the resolution reduced in the partial image,
16. The image setting unit according to claim 14 or 15, wherein the image setting unit pastes the partial image at an original location of the wide-angle image with reduced resolution using the coordinates in the wide-angle image included in the partial image. Browsing system. The image generation means generates a partial image of a moving image having coordinates in the wide-angle image from the wide-angle image of the moving image before the image quality of the wide-angle image is reduced,
Generating the wide-angle image of at least one still image from the wide-angle image of the video;
The wide-angle image transmission means transmits the wide-angle image of the still image with reduced image quality and a partial image of the moving image to the information processing apparatus,
The wide-angle image acquisition means of the information processing apparatus acquires the wide-angle image of a still image with reduced image quality and a partial image of the moving image,
The image setting means pastes the partial image of the moving image to the original location of the wide-angle image of the still image with reduced image quality, using the coordinates in the wide-angle image of the partial image of the moving image. With
The browsing system according to any one of claims 14 to 16, wherein the wide-angle image display means displays a partial image of the moving image when displaying the display position. A display method of a plurality of display positions of a wide-angle image, and a wide-angle image acquisition means for acquiring the wide-angle image;
A wide-angle image display unit that displays the wide-angle image at the display position on a display device by the display method acquired by the wide-angle image acquisition unit; And
Refer to display method storage means in which display methods of a plurality of display positions of the wide-angle image are registered,
Wide-angle image transmission means for transmitting the wide-angle image and the display method so that the wide-angle image is displayed on the second information processing apparatus by the display method;
An image distribution apparatus. An image distribution method performed by a browsing system having an image distribution device that distributes a wide-angle image and an information processing device that displays the wide-angle image,
The image distribution device includes:
A display method storage unit in which a display method of a plurality of display positions of the wide-angle image is registered, and a wide-angle image transmission unit transmits the display method and the wide-angle image to the information processing apparatus,
The information processing apparatus includes:
Wide-angle image acquisition means acquires the display method and the wide-angle image;
Wide-angle image display means, the display method of displaying the wide-angle image of the display position on the display device by the display method acquired by the wide-angle image acquisition means;
An image delivery method. A display method of a plurality of display positions of a wide-angle image, and a wide-angle image acquisition means for acquiring the wide-angle image;
An image distribution device that distributes a wide-angle image to a second information processing device, and a wide-angle image display unit that displays the wide-angle image at the display position on a display device by the display method acquired by the wide-angle image acquisition unit;
A wide-angle image transmission unit that refers to a display method storage unit in which a display method of a plurality of display positions of the wide-angle image is registered, and that transmits the display method and the wide-angle image to the second information processing apparatus;
Function as operation history acquisition means for acquiring operation information for the wide-angle image from the second information processing apparatus and recording the number of operations in association with the display method;
The wide-angle image transmission unit is a program for transmitting the wide-angle image to the second information processing apparatus by the display method in which the number of operations equal to or greater than a threshold is associated.