JP2013037577A - Information display surface image display system, related method, device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system for analyzing how long each of articles, advertisements, or zones existing in one space (one page) of newspaper and magazine or the like displayed with an actual space image on a display device by using electronic content have been actually displayed.SOLUTION: Disclosed is a system including an electronic content distribution server, information display surface image display device, and information display surface image display record information processor. The information display surface image display device includes various means of: displaying an information display surface image by using electronic content received from the electronic content distribution server; determining whether or not each zone is included in a predetermined display range within the information display surface; determining a time period over which each zone is included; generating information display surface image display record information containing information relating to the time period of the inclusion; and transmitting the information display surface image display record information to an information display surface image display record information processor.

Description

  The present invention displays a newspaper, a book, a magazine, a flyer advertisement, etc. on a display device such as a mobile terminal as a real paper image, and a system for processing display record information when displayed, and a related method, device, Regarding the program.

  Publications such as newspapers, books, and magazines have traditionally been published exclusively on paper, and which articles on which pages, in particular, which articles were often read by readers, etc. In order for the issuer to know this information, it was necessary to rely on the active provision of information from readers, such as responses to questionnaires. In addition, the evaluation of the advertising effect by a flyer advertisement issued using paper as a medium has been performed based on, for example, a change in the number of products sold on the advertisement before and after the advertisement is posted.

  On the other hand, in recent years, newspaper companies and publishers are also performing acts of publishing newspaper articles, magazine articles, etc. on their Web sites. In this case, without receiving active information provision from the reader, it is possible to obtain browsing records such as newspaper articles by the reader by analyzing the access log of the Web site. Also, on such websites, advertisements may be posted in the form of banner advertisements together with articles, but if the number of clicks on the banner advertisements is counted, readers' interest in the products posted on the advertisements may be increased. Can be evaluated. In this regard, an advertisement management method has been proposed in which the number of clicks on a banner advertisement is totaled and recorded in association with a reward amount for advertisement placement (Patent Document 1).

JP 2011-86080 A

  When a newspaper article, a magazine article, or the like is published on a website, the design of the website or the arrangement of articles is often different from the design or the arrangement of articles or articles published on paper as a medium. . Such websites typically form a hierarchical structure with a menu page listing the headings of each article and each page displaying individual articles accessible by clicking on each heading. In each page, there is usually one article displayed on one page. Therefore, in the Web site having such a configuration, for example, by comparing the number of page views for each page, it is possible to grasp for each individual article which of the published articles is often read by the reader.

  On the other hand, along with the popularization of mobile devices such as smartphones, which have excellent drawing processing capabilities, electronic content that displays articles, etc. on the terminal screen with a real paper image equivalent to publications published using paper as a medium has recently been developed. There are also services provided. In such electronic contents, the number of articles displayed on one page is not always one (particularly, when a newspaper page is displayed as an actual page image, many articles are usually displayed in the same page image. The reader browses the article after displaying the target article on the screen by operations such as scrolling the screen. Therefore, it is impossible to know how much each article in the page has been read only by analyzing the number of page views for each page or the display time. Furthermore, in such electronic content, advertisements are also displayed as real paper images rather than banner advertisements, that is, another page on which detailed information such as products is displayed by detecting a click operation by the reader is displayed. The function as a banner ad is not necessarily implemented. Therefore, the advertisement effect may not be evaluated depending on the method of counting the number of clicks.

  In view of the above circumstances, the present invention is a case where a plurality of articles and advertisements are displayed on the same page as an actual paper image, and each individual article, advertisement, or each of the articles and advertisements constituting the area of the advertisement is displayed. It is an object of the present invention to provide an information display surface image display system and a related method, apparatus, and program capable of analyzing how long an area is actually displayed.

  In order to solve the above problems, the present invention is an electronic content distribution server that stores and distributes electronic content including image data representing an information display surface image, and is connected to the electronic content distribution server via a network and receives the electronic content. Connected to the information display screen image display device and the information display screen image display device to receive the display record information of the information display screen image on the information display screen image display device. And an information display surface image display system including the information display surface image display recording information processing apparatus to be displayed. In the system of the present invention, an electronic content distribution server stores electronic content including two or more image data having different resolutions corresponding to one information display surface image, and an information display surface image display device. An information display surface image display device that receives the electronic content from the electronic content distribution server, and information display surface image display conditions. The information display surface image is displayed by selecting and outputting image data having a resolution that conforms to the display conditions corresponding to the information display surface image to be displayed and the information display surface image display condition input means for receiving the input. Information display screen image that is displayed over the display target range including all or part of it. The area is in a predetermined display range defined in the display target range for each area in the information display surface of the information display surface image displayed using the image display means and the image data of the selected resolution. Affiliation area determination means for determining whether to belong, and for each area, an affiliation time determination means for determining the time that the area belonged to a predetermined display range, and the affiliation time determined for each area Generating information display surface image display record information including information, information display surface image display record information generating means, and transmitting information display surface image display record information to the information display surface image display record information processing apparatus, An information display surface image display record information transmitting means, and the information display surface image display record information processing device includes an information display surface image table from the information display surface image display device. Information display surface image display record information receiving means for receiving record information, and display corresponding to the belonging time determined for each area in the information display surface of the information display surface image included in the information display surface image display record information Is displayed in association with each area, and information display surface image display record information display means is provided.

  The information display surface image display record information display means displays each area using a visual effect corresponding to the total value of the belonging time determined by the belonging time determining means for the image data of all resolutions for each area. Thus, the system of the present invention can be configured.

  The information display surface image display record information display means weights the belonging time determined by the belonging time determination means for the image data of each resolution for each area, and adds a visual effect corresponding to the total value. The system of the present invention can be configured to use to display each area.

  Whether the affiliation area determination means is a necessary condition for determining that the affiliation belongs to a predetermined display range, that the resolution of the image data used for displaying the information display surface image is a predetermined threshold or more, Alternatively, the system of the present invention can be configured so that a resolution exceeding a predetermined threshold is a necessary condition for determining that an area belongs to a predetermined display range.

  The affiliation area determination means uses a condition for determining that the area belongs to the predetermined display range that the ratio of the area included in the predetermined display range to the determination target area is equal to or greater than a predetermined threshold. Alternatively, the system of the present invention can be configured so that the ratio exceeds the predetermined threshold value as a condition for determining that the area belongs to the predetermined display range.

  The display corresponding to the affiliation time determined for each area is a display corresponding to the affiliation time representative value determined using the set of affiliation times determined for each area included in the article area including the area. As such, the system of the present invention can be configured.

  The system of the present invention can be configured so that the predetermined display range matches the display target range.

  The system of the present invention can be configured such that the predetermined display range is defined by a predetermined closed region including the center of the display target range.

  The information display surface image display device further comprises area designation event input means for receiving a predetermined event input designating an area within the display surface of the displayed information display surface image, and information display surface image display record information display means Displays a display corresponding to the score determined using the affiliation time determined for each area and the record information of the event input input by specifying each area in association with each area. The system of the present invention can be configured.

  The present invention further includes an electronic content distribution server that stores and distributes electronic content including image data representing an information display surface image, and is connected to the electronic content distribution server via a network to receive the electronic content and display the information display surface. An information display screen image display device for displaying an image and an information display screen connected to the information display screen image display device via a network for receiving and displaying information recorded on the information display screen image display device An information display surface image display record information processing method executed in an information display surface image display system including a surface image display record information processing apparatus is provided. According to the method of the present invention, an electronic content distribution server stores electronic content stored in electronic content storage means as electronic content including two or more image data having different resolutions corresponding to one information display surface image. A step of distributing to the information display surface image display device by the distribution means; and the information display surface image display device receives the electronic content from the electronic content distribution server by the electronic content receiving means, and the information display surface image display condition input means By receiving the input of the display condition of the information display surface image, by selecting and outputting the image data of the resolution that matches the display condition corresponding to the information display surface image to be displayed by the information display surface image display means, Information display surface image, including all or part of it Specified within the display target range for each area in the information display surface of the information display surface image displayed by the belonging area determination means using the image data of the selected resolution. It is determined whether or not the area belongs to the predetermined display range, and the time that the area belonged to the predetermined display range is determined for each area by the belonging time determination means, and the information display surface image display record The information generation means generates information display surface image display record information including information on the affiliation time determined for each area, and the information display surface image display record information transmission means generates information display surface image display record information. Each stage transmitted to the display surface image display recording information processing apparatus and the information display surface image display recording information processing apparatus Information display surface image display record information is received from the information display surface image display device by the receiving means, and information display surface image information included in the information display surface image display record information by the information display surface image display record information display means. Each stage is provided with a display corresponding to each area and a display corresponding to the affiliation time determined for each area in the display surface.

  The present invention further includes an electronic content receiving unit that receives electronic content including image data representing an information display surface image from an electronic content distribution server, and an information display surface image display that receives input of display conditions for the information display surface image. The condition input means and the image data included in the electronic content are selected from the two or more image data corresponding to the information display surface image to be displayed and having different resolutions, and selecting the image data having a resolution suitable for the display condition. The information display surface image display means for displaying the information display surface image over the display target range including all or a part thereof by outputting the selected image data, and the image data of the selected resolution In the information display surface of the information display surface image that is displayed using, each area within the display target range An affiliation area determination means for determining whether or not an area belongs to a predetermined display range, and an affiliation time determination means for determining the time that the area belonged to the predetermined display range for each area; Information display surface image display record information generating means for generating information display surface image display record information including information on the belonging time determined for each area, and information display surface image display record information display information display surface image display information An information display surface image display device comprising an information display surface image display record information transmission means for transmitting to a recording information processing device is provided.

The present invention further relates to an information display surface, wherein the computer receives electronic content including image data representing an information display surface image from an electronic content distribution server, and receives input of display conditions for the information display surface image. Image display condition input means, image data included in electronic content, and corresponding to the information display surface image to be displayed, and image data having a resolution suitable for the display condition is selected from two or more image data having different resolutions Then, by outputting the selected image data, the information display surface image is displayed over the display target range including all or part of the information display surface image, and the image data of the selected resolution is displayed. Display target for each area in the information display surface of the information display surface image displayed using Determining whether or not an area belongs to a predetermined display range specified in the enclosure, an affiliation area determination means, and for each area, determining the time that the area belonged to the predetermined display range Means for generating information display surface image display record information including information about the belonging time determined for each area, information display surface image display record information generating means, and information display surface image display record information as information display surface Provided is a program for functioning as an information display surface image display recording information transmitting means for transmitting to an image display recording information processing apparatus.

  The present invention processes the recorded information representing the display record for each area in the display surface of the information display surface image including a plurality of articles, advertisements, etc. as an actual paper image of newspapers, magazines, etc. However, it is possible to meticulously analyze the display conditions that differ for each area. As a result, the browsing status of newspapers, magazines, etc. provided as electronic contents can be known at the article level or at a more detailed level. Further, by analyzing the browsing status of the advertisement portion in the display surface, it is possible to evaluate the advertisement effect even when the number of clicks cannot be counted.

1 is a system configuration diagram illustrating an overall configuration of an information display surface image display system 1 according to an embodiment of the present invention. 3 is a configuration diagram illustrating a specific configuration of an electronic content generation device 2. FIG. 3 is a configuration diagram showing a specific configuration of an electronic content server 5. FIG. It is a block diagram showing the structure of the electronic content database 6 which memorize | stores the electronic content 31. FIG. 3 is a configuration diagram showing a specific configuration of a Web server 7. FIG. 4 is a configuration diagram showing a specific configuration of an information display surface image display device 9. FIG. 2 is a configuration diagram showing a specific configuration of an information display surface image display recording information processing apparatus 10. FIG. It is a figure showing the screen image when using a personal computer as the information display surface image display device 9, and displaying an information display surface image as a real paper surface image of a magazine by a Web browser. FIG. 9 is a diagram illustrating a screen image when the information display surface image is displayed as a spread image in the configuration illustrated in FIG. 8. It is a figure showing a conceptual image when an information display image is divided | segmented into the area. It is a conceptual image figure showing the predetermined display range prescribed | regulated within the display object range of an information display surface image. It is a figure showing the information item contained in information display surface image display recording information in a table format. It is a flowchart figure showing the flow of the production | generation of the heat map image in Example 1, and a display process. 2 is a diagram illustrating a heat map image generated and displayed by the information display surface image display recording information processing apparatus 10 in Embodiment 1. FIG. It is a flowchart figure showing the flow of the production | generation of a heat map image in Example 2, and a display process. FIG. 10 is a diagram illustrating an article region that is specified when an operator inputs a boundary line in the second embodiment. It is a figure showing the format obtained by extending the table format shown in FIG. 12 as a format of information display surface image display recording information. FIG. 11 is a diagram illustrating an article level heat map image generated and displayed by the information display surface image display recording information processing apparatus 10 in the second embodiment. It is a figure showing the click event received by the area designation | designated event input means in Example 3. It is a figure showing the extended table format of the information display surface image display recording information used in Example 4. FIG. It is a figure which shows an example of the menu screen for inputting the display conditions of the heat map image used in Example 4. FIG. It is a figure showing the display screen of the heat map image produced | generated according to the display conditions input into the menu screen 90 shown in FIG.

  DESCRIPTION OF EMBODIMENTS Hereinafter, an embodiment for implementing an information display surface image display system 1 and the like according to the present invention will be described in detail based on the drawings. However, the apparatus, server, database configuration, and table format for storing various data constituting the information display surface image display system according to the present invention are limited to the specific configurations shown in each drawing. However, it can be appropriately changed within the scope of the present invention. In the following embodiment, first, XML data is downloaded from a Web server to a display device, and then electronic content is downloaded from the electronic content server to the display device based on an address or the like described in the XML data ( The attribute information may be acquired directly from the XML data.) The electronic content is distributed in the form of, for example, but not limited to such distribution using XML data, the electronic content is distributed by any method. Is possible.

Overall Configuration of Information Display Surface Image Display System 1 FIG. 1 is a system configuration diagram showing the overall configuration of an information display surface image display system 1 according to an embodiment of the present invention. The information display surface image display system 1 includes an electronic content distribution server 3 that stores and distributes electronic content generated by the electronic content generation device 2, and an information display surface image display that receives the electronic content and displays an information display surface image. An apparatus 9 and an information display surface image display record information processing apparatus 10 for receiving and displaying information display surface image display record information in the information display surface image display device 9 are configured by a wired or wireless communication network. Via an appropriate communication protocol. In one example, the electronic content distribution server 3 is connected to the electronic content generation device 2 and the information display surface image display device 9 by external networks 8-1 and 8-2 constructed by the Internet, a mobile phone communication network, and the like, On the other hand, the information display surface image display recording information processing apparatus 10 is connected by an arbitrary internal network (not shown) constructed by an in-house LAN (Local Area Network) or the like.

  In FIG. 1, one information display surface image display device 9 and one information display surface image display recording information processing device 10 are drawn. However, these devices included in the information display surface image display system 1 are illustrated. The number is arbitrary. Similarly, a plurality of electronic content distribution servers 3 can be used simultaneously. For example, a plurality of electronic content distributors may distribute electronic content from separate electronic content distribution servers managed by each.

  The electronic content is typically generated by the electronic content generation apparatus 2 taking in image information and attribute information from real page image data such as newspapers and magazines, and performing image compression processing on the image information. The generated electronic content is transmitted to the electronic content distribution server 3 using FTP (File Transfer Protocol) client software. The electronic content distribution server 3 receives electronic content by the FTP server 4 via the network 8-1 and stores it in the electronic content database 6. However, in the information display surface image display system of the present invention, any electronic content different from the configuration generated in this way (the electronic content is provided by an arbitrary provider and stored in advance in the electronic content distribution server 3). It may be stored in the electronic content database 6). In view of this, the electronic content generation device 2 and the FTP server 4 are not essential elements for the system of the present invention.

  Hereinafter, specific configurations of various apparatuses, servers, and databases used in the present embodiment will be described.

Electronic content generation device 2
The electronic content generation device 2 receives the actual paper surface image data via an arbitrary network, an FTP server or the like (not shown), or by an operator's input operation, and captures image information and attribute information for each page. This is an apparatus for generating electronic contents by performing image compression processing or the like on image information. The electronic content generation process will be described in detail later.

  FIG. 2 shows a specific configuration of the electronic content generation apparatus 2. The electronic content generation device 2 includes a central control unit 11, a temporary storage device 12, an arbitrary display device 13 that can display images and text, an input device 14, a network I / F (interface) unit 15, and a storage device 16. It can be configured by installing an electronic content generation program 17 described later on an arbitrary general-purpose computer provided.

  The central control unit 11 takes the form of a processor (CPU: Central Processing Unit) that performs information processing by executing a program loaded from the storage device 16 onto the temporary storage device 12, and cooperates with the program to be executed. It constitutes various means. The temporary storage device 12 provides a memory space on which programs and data to be processed by the central control unit 11 are read, a work area required when the read program is executed by the central control unit 11, and the like. Specifically, it takes the form of a volatile memory (RAM: Random Access Memory, etc.). The display device 13 is an arbitrary display device that can display an image, text, or the like such as a liquid crystal display. The input device 14 is an arbitrary command from the operator to the electronic content generation device 3 such as a keyboard or a mouse. It is a device for inputting etc. The network I / F unit 15 is a group of devices including a network card and the like for communicating with the electronic content distribution server 3 through the FTP server 4, and the storage device 16 is an HDD (Hard Disk Drive). And a device that stores and manages programs, data, and the like, such as SSD (Solid State Drive).

  The storage device 16 is a basic program (operating system and driver software for various devices) for realizing basic functions of the electronic content generation device 2 such as input / output, display, and communication via I / F as program elements. And FTP client software for transmitting the generated electronic content to the electronic content distribution server 3 (not shown), and the electronic content generation program 17 are stored.

  The electronic content generation program 17 captures image information and attribute information from the actual paper surface image data received via the network as described above, performs image compression processing on the image information, and sets the resolution of one paper surface. A program for generating two or more different image data, generating electronic content by giving attribute information, and generating XML data in which the position specifier, display position, etc. of the image data and attribute information are described is there.

  The electronic content generation program 17 includes an image / attribute capturing module 18, an image data generation module 19 including an image compression submodule 20, an attribute information addition module 21, and an XML data generation module 22 as program modules. These program modules are loaded onto the temporary storage device 12 and executed by the central control unit 11 to constitute various means included in the electronic content generation device 3. The image / attribute capture module 18 is an image The attribute capturing means (not shown; hereinafter, reference numeral 18 is used), the image data generating module 19 is the image data generating means (not shown, hereinafter, using reference numeral 19), and the image compression sub. Module 20 is an image compression means (not shown; hereinafter, reference number 20 is used), and attribute information giving module 21 is an attribute information giving means (not shown, hereinafter, using reference number 21) is XML data. The generation module 22 constitutes XML data generation means (not shown; hereinafter, reference numeral 22 is used).

  The image / attribute take-in means 18 expands the actual paper image data received via the network or the like on the temporary storage device 12, stores it in the storage device 16 if necessary, and further stores image information, It is a means for capturing attribute information.

  The image data generation unit 19 is a unit that performs image compression processing by the image compression unit 20 on the captured image information, and generates two or more image data having different resolutions on one sheet of paper.

  The attribute information adding unit 21 is a unit that adds attribute information to the image data generated by the image data generating unit 19. When image data is generated by compressing actual newspaper page image data, the attribute information includes the date of issue of the newspaper, the page name, the page page corresponding to the image data, and the display of the image data on the entire page. The position, the relative coordinate data of the display range, the hierarchy number indicating the size of the resolution, and the like. Here, “addition” of attribute information refers to attribute information (attribute information may be imported together with actual image data via a network or the like) together with the image data generated by the image data generation means 19. Alternatively, the operator may input an individual image by using the input device 14. The image data and attribute information are stored in the temporary storage device 12 or stored in the storage device 16. (The generated electronic content is transmitted to the electronic content distribution server 3 and stored in the electronic content database 6. FIG. 4 and the description to be described later) See).

  The XML data generation means 22 includes image data stored in the electronic content database 6 as electronic content, a position specifier (URL: Uniform Resource Locator) that specifies attribute information, relative coordinates that determine the display position of the image data, This is a means for automatically generating XML (extensible Markup Language) data in which a layer number relating to the resolution of image data is described. The XML data can be automatically generated by a CGI (Common Gateway Interface) program using a Perl script or the like, and the XML data generating means 22 is typically configured by such an XML automatic generation module. When attribute information is given as text information such as a page name or page, the attribute information can be described as a tag in the XML data itself. In this case, only the image data may be stored in the electronic content database 6.

  Specific processing by these means will be described in detail separately.

  The storage device 16 further stores actual paper image data 23 as a data element. In this embodiment, the real paper surface image data 23 is real paper surface image data such as newspapers and magazines received via a network or the like, and is appropriately loaded on the temporary storage device 12 and compressed by the image compression means 20. (However, the storage device 16 may not be used as the storage position of the actual paper surface image data 23, and the received actual paper image data may be held on the temporary storage device 12 for compression processing.)

Electronic content distribution server 3
The electronic content distribution server 3 includes an FTP server 4, an electronic content server 5, an electronic content database 6, and a Web server 7. In this embodiment, the electronic content database 6 is configured by storing electronic content in the storage device 29 of the electronic content server 5, but the electronic content database 6 is stored in a storage device separate from the electronic content server 5. 6 may be provided. Further, the functions of the FTP server 4, the electronic content server 5, and the Web server 7 may be mounted on the same general-purpose computer or the like, or these functions may be distributed to any number of general-purpose computers. This also applies to other devices (and the above-described electronic content generation device 2) constituting the information display surface image display system 1 of the present invention.

FTP server 4
The FTP server 4 is a server device for transferring electronic content from the electronic content generation device 3 to the electronic content server 5. Since the FTP server 4 can be easily constructed by installing commercially available or free-distributed FTP server software on a general-purpose computer or the like, detailed description thereof is omitted here.

Electronic content server 5
The electronic content server 5 stores the electronic content received from the electronic content generation device 2 in the electronic content database 6 and reads the electronic content from the electronic content database 6 in response to a request from the information display surface image display device 9. It is a server apparatus for. As shown in FIG. 3, the electronic content server 5 includes a central control unit 24, a temporary storage device 25, a display device 26, an input device 27, a network I / F unit 28, and a storage device 29. Since these hardware configurations can be realized using a general-purpose computer in the same manner as the electronic content generation apparatus 2, the description thereof is omitted here.

  The storage device 29 of the electronic content server 5 stores the basic program (not shown) and the electronic content database management program 30 as program elements, and further stores the electronic content database 6 as data elements. Yes.

  The electronic content database management program 30 stores the electronic content received as described above in the electronic content database 6, reads the electronic content from the electronic content database 6 in response to requests, and adds, searches, This is a program for performing overall management of the electronic content database 6 such as update processing. The electronic content database 6 stores electronic content including image data generated by the electronic content generation device 3 and attribute information.

  As described above, if the position of the image data and attribute information included in the electronic content is directly specified by a URL or the like and described as a tag in the XML data, the image data and the attribute information are acquired using the URL or the like, respectively. Because it is possible, the electronic content need not form a specific data structure (eg, a table structure in a relational database). However, it is not a URL that individually designates the position of each image data and attribute information. Instead, a unique identifier of electronic content is described in XML data as a tag, and the image data and attribute information associated with the identifier are subjected to an SQL query. It is also possible to read out the electronic content to be distributed from the electronic content database 6 in such a manner that it is extracted by, for example. Even in this case, a database management system (DBMS: Data Base Management System) product that is commercially available or distributed free of charge is introduced into a general-purpose computer or the like, and data input / output and Web to be performed with the electronic content generation apparatus 2 are performed. The data structure of the electronic content database management program 30 and the electronic content database 6 can be constructed by appropriately programming the processing of the communication session established with the server 7. The central control unit 24 executes the electronic content database management program 30 and causes the electronic content database 6 to store the electronic content, thereby configuring electronic content storage means.

Electronic content database 6
In the electronic content database 6, two or more image data 32 having different resolutions corresponding to the same information display surface image and attribute information 33 associated with the image data 32 are associated with each other as necessary. Is stored as electronic content 31. The association between the image data 32 and the attribute information 33, that is, the specific data structure of the electronic content database 6 is arbitrary (if each position is designated by a URL or the like by a tag in the XML data, the association itself is not necessary. is there.). In one example, a unique actual sheet image ID is given to each of the actual sheet image data 23 (in an example described later, the information display surface image is an information item value of an electronic content ID, a page number, and a hierarchy number. At this time, the actual page image ID is uniquely determined as a set of the three information item values.) The image data 32 and the attribute information 33 are also searched by this actual page image ID. Data structures are defined so that they are possible. When the electronic content database 6 is constructed, if an index (index) structure for an arbitrary data item such as the actual paper surface image ID is created, the electronic content database 6 can be accessed at high speed using the index information. Become.

Web server 7
The Web server 7 receives a request for electronic content from the information display surface image display device 9 via the network 8-2, and in response to the request, a position specifier for image data and attribute information included in the electronic content. Request for image data and attribute information transmitted from the information display screen image display device 9 after the processing of the XML data is transmitted to the information display screen image display device 9 with the above described XML data describing the display position and the like. In response to the request, the image data and the attribute information are read from the electronic content database 6 (typically, the electronic content server 5 receiving the command from the Web server 7 loads the electronic content database management program 30). The image data and attribute information are read out and transmitted to the Web server 7). A server apparatus for transmitting and as the content 31 to the information display screen image display device 9. As shown in FIG. 5, the Web server 7 includes a central control unit 34, a temporary storage device 35, a display device 36, an input device 37, a network I / F unit 38, and a storage device 39. Since these hardware configurations can be realized using a general-purpose computer in the same manner as the electronic content generation apparatus 3 and the like, the description thereof is omitted here.

  The storage device 39 of the Web server 7 stores the basic program (not shown) and the electronic content distribution program 40 as program elements, and the XML generated by the XML data generation unit 22 as data elements. Data 41 is stored.

  The electronic content distribution program 40 is a program for distributing the XML data 41 and the electronic content 31 in response to a request from the information display screen image display device 9 as described above. The electronic content distribution program 40 is a temporary storage device. The electronic content distribution means (not shown; hereinafter, reference numeral 40 is used) is configured by being loaded on 35 and executed by the central control unit 34. As an example, the XML data 41 and the electronic content 31 are distributed using HTTP (Hyper Text Transfer Protocol) or HTTPS (HTTP over Secure Socket Layer). The electronic content distribution program 40 introduces commercially available or free-distributed Web server software to a general-purpose computer or the like, and processes requests from the information display surface image display device 9 or, if necessary, to the electronic content database 6. It is possible to implement by appropriately programming the inquiry processing by SQL.

Information display surface image display device 9
The information display screen image display device 9 is a device for receiving the XML data 41 and the electronic content 31 and displaying an information display screen image using the image data 32 and the attribute information 33 included in the electronic content 31. Further, the information display surface image display device 9 of the present invention records and records each area in the information display surface of the information display surface image, generates display record information, and stores the information in the information display surface image display record information processing apparatus 10. Send. As shown in FIG. 6, the information display surface image display device 9 includes a central control unit 42, a temporary storage device 43, a display device 44, an input device 45, a network I / F unit 46, and a storage device 47. Since these hardware configurations can be realized using a general-purpose computer or the like (typically, a personal computer or a smartphone having the same configuration) as in the electronic content generation apparatus 3 or the like, it will be described here. Is omitted.

  The storage device 47 of the information display surface image display device 9 stores the basic program (not shown) and the electronic content processing program 48 as program elements. User information 56 is stored as a data element, and information display surface image display record information 57 is stored as the information display surface image is displayed by executing the electronic content processing program 48 (these data). The element may be held on the temporary storage device 43).

  The electronic content processing program 48 receives the XML data 41 and the electronic content 31, displays an information display surface image, generates a display record of the display, and displays the information display surface image display record information processing apparatus 10 as display record information. It is a program for sending to.

  The electronic content processing program 48 includes, as its program modules, an electronic content receiving module 49, an information display screen image display condition input module 50, an information display screen image display module 51, an affiliation area determination module 52, an affiliation time determination module 53, an information display. A surface image display record information generation module 54 and an information display surface image display record information transmission module 55 are included. These program modules are loaded on the temporary storage device 43 and executed by the central control unit 42. By operating the display device 44, the input device 45, and the network I / F unit 46 as necessary, an information display screen image is displayed. The various means with which the apparatus 9 is provided are comprised. The electronic content receiving module 49 is an electronic content receiving means (not shown; hereinafter, reference numeral 49 is used), and the information display screen image display condition input module 50 is an information display screen image display condition input means (not shown; The information display surface image display module 51 uses information display surface image display means (not shown; hereinafter, reference number 51 is used), and the affiliation area determination module 52 uses affiliation area determination means. (Not shown; hereinafter, reference number 52 is used), belonging time determination module 53 is a member time determining means (not shown; hereinafter, reference number 53 is used), information display surface image display record information generation. The module 54 converts the information display surface image display record information generating means (not shown; hereinafter, reference numeral 54 is used) into the information display surface image. Di display recording information sending module 55 is the information display screen image display recording information transmitting means (not shown. Hereinafter, using the reference number 55.), And constituting respectively.

  The electronic content receiving means 49 transmits a request for electronic content to the Web server 7 to receive the XML data 41, and uses the position specifier described as a tag in the XML data 41 to store image data and attribute information. The electronic content 31 is received from the electronic content database 6 via the Web server 7. The transmission / reception is performed by communication via the network 8-2 by the network I / F unit 46, and extraction of a position specifier from the XML data 41 is performed by the central control unit 42.

  The information display surface image display condition input means 50 is a means for receiving an input of information display surface image display conditions performed by the operator using the input device 45. An example of display on a display screen of a personal computer shown in FIG. 8 will be described. An operator is displayed on a display screen (display device 44) by operating an input device 45 such as a keyboard and a mouse. A display condition such as a sheet surface (page) to be displayed, a display position, and an enlargement ratio is input for the information display surface image to be displayed. The display condition is stored in the temporary storage device 43 and used for displaying the information display surface image by the information display surface image display means 51. These operations may be performed by an arbitrary input device 45 such as a touch screen that forms a touch panel on the display screen, without using a keyboard, a mouse, or the like.

  The information display surface image display means 51 is a means for displaying an information display surface image on the display device 44 using the image data 32 and the attribute information 33 included in the received electronic content 31. The information display surface image display process will be described in detail later. The information display surface image display module 51 orders the image data 32 according to conditions such as a paper surface (page) designated by the accompanying attribute information 33, and then displays the display input using the input device 45. As an independent program module (as part of the electronic content processing program 48) for display on the display device 44 in accordance with display conditions such as position and magnification rate, it is installed in the information display screen image display device 9 in advance. Alternatively, Adobe Flash's “Flash Player” (registered trademark) or the like is installed in the information display surface image display device 9 as an extended function (add-on) to the Web browser, and information is displayed via the extended function. Individual display processing to be performed by the plane image display means 51 (and an input device if necessary) As the processing of various input events from 5) is executed, the server side, but also be implemented by programming the process of the client side, respectively.

  The affiliation area determination means 52 is a predetermined display range defined within the display target range of the information display surface image for each area within the information display surface of the information display surface image displayed using the image data 32. It is a means to judge whether each area belongs to. In the present embodiment, the information display surface on which the information display surface image is displayed is divided into a plurality of areas, and then, the predetermined display typically defined in the display screen of the display device 44 such as a liquid crystal display or the like. Display range (Normally, it is considered that the operator pays attention to the vicinity of the center of the screen. For this display range, it is effective to define an appropriate closed region in the center of the screen, but a different display range is specified. It is also possible to determine whether each area belongs to. As the operator performs a scrolling operation of the screen using the input device 45, the area belonging to the predetermined display range can change from moment to moment. Specifically, it is determined whether or not each area belongs within the predetermined display range at each time that is visited at every predetermined time interval by the program.

  The belonging time determining means 53 is a means for determining the time during which each section belonged to the predetermined display range. In the information display surface, the affiliation time for each area is stored in the temporary storage device 43 in a table format including the area ID and the affiliation time of each area. The assigned time can be determined for each zone by a method such as adding a fixed value (a time value equal to the judgment time interval) to the assigned time for the zone determined to be “done”.

  The information display surface image display record information generating means 54 is means for generating information display surface image display record information including information related to the belonging time determined for each of the areas. As an example, the information display surface image display record information includes an information item (user ID in the example of FIG. 12 described later) for specifying a user of electronic content, and an information item (FIG. 12) for specifying an information display surface image. In the example, the recording information is given in a format including an electronic content ID, a page number, and a hierarchy number) and an information item related to the belonging time for each area (in the example of FIG. 12, the area ID and the belonging time). It's okay. The generated information display surface image display record information is stored in the storage device 47 (see the information display surface image display record information 57 in FIG. 6) or held on the temporary storage device 43, which will be described later. The information display surface image display record information transmission means 55 transmits the information display surface image display record information processing apparatus 10 to the information display surface image display record information processing apparatus 10.

  The information display surface image display record information transmission means 55 displays the information display surface image display record information 57 (which may be held on the temporary storage device 43. The same applies hereinafter) as an information display surface image display. It is means for transmitting to the recording information processing apparatus 10. In one example, the affiliation time determination means 53 determines the affiliation time for each area by counting the affiliation time for each area over 24 hours, and the information display surface image display record information generation means 54 Is used to generate record information including each information item described above. In this case, the information display surface image display recording information transmitting means 55 sends the generated recording information from the network I / F unit 46 to the information display surface image display recording information processing apparatus 10 once a day at a predetermined time. The transmission process is performed in the background by a method such as transmitting to the other party.

Information display surface image display recording information processing apparatus 10
The information display surface image display recording information processing apparatus 10 receives the information display surface image display recording information 57 and displays the display corresponding to the belonging time determined for each area in the information display surface of the information display surface image. It is a device for displaying in association with each area. As shown in FIG. 7, the information display surface image display record information processing apparatus 10 includes a central control unit 58, a temporary storage device 59, a display device 60, an input device 61, a network I / F unit 62, and a storage device 63. . Since these hardware configurations can be realized using a general-purpose computer or the like in the same manner as the electronic content generation apparatus 3 and the like, description thereof is omitted here.

  The storage device 63 of the information display surface image display recording information processing apparatus 10 stores the above-described basic program (not shown) and the information display surface display recording information processing program 64 as program elements.

  The information display surface image display recording / recording information processing program 64 is a program for receiving the information display surface image display recording information 57 and performing display processing of the display corresponding to the affiliation time. A surface image display record information receiving module 65, an information display surface image display record information display condition input module 66, and an information display surface image display record information display module 67 are included. These program modules are loaded on the temporary storage device 59 and executed by the central control unit 58. By operating the display device 60, the input device 61, and the network I / F unit 62 as necessary, an information display screen image is displayed. The various means with which the recording information processing apparatus 10 is provided are comprised. The information display surface image display record information receiving module 65 is an information display surface image display record information receiving means (not shown; hereinafter, reference numeral 65 is used), and the information display surface image display record information display condition input module 66 is information. Display surface image display record information display condition input means (not shown; hereinafter, reference numeral 66 is used), information display surface image display record information display module 67 is information display surface image display record information display means (not shown). Hereinafter, reference numeral 67 is used).

  The information display surface image display record information receiving means 65 is means for receiving the information display surface image display record information 57 by communication via the network 8-2 using the network I / F unit 62. For example, the reception process is performed by downloading the information display screen image display record information 57 uploaded from the information display screen image display device 9 to the Web server 7 to the information display screen image display record information processing device 10. Is possible. The received information display surface image display record information 57 is typically held on the temporary storage device 59 or the storage device 63 for use in display processing described later by the information display surface image display record information display means 67. Are stored as data elements (not shown).

  The information display surface image display record information display condition input means 66 is a means for accepting input of display conditions for information display surface image display record information performed by the operator using the input device 61. As in the case of the information display surface image display device 9, an example of displaying recorded information on the display screen of a personal computer will be described. By operating the input device 61 including a keyboard and a mouse, the operator can display the display screen ( Display conditions for displaying information display surface image display record information displayed on the display device 60) (typically, information for specifying a target information display surface image. In addition, only display record information relating to a specific user) If the target is the target, information specifying the target user is input. The display conditions are stored in the temporary storage device 59 and used for display processing by the information display surface image display record information display unit 67. Note that these operations may be performed by an arbitrary input device 61 such as a touch screen that forms a touch panel on the display screen, without using a keyboard, a mouse, or the like. In addition, it is not essential for the present invention to select information display surface image display record information to be used for display according to display conditions input by the operator. That is, the information display surface image display record information display condition input means 66 is not an essential component.

  The information display surface image display record information display means 67 displays the display corresponding to the belonging time determined for each area in the information display surface of the information display surface image included in the received information display surface image display record information 57. It is means for displaying in association with each area. As an example, when recording information given as information including each information item described above is received, the information display surface is divided into areas, and each area is determined by the size of the belonging time value determined for the area. The above display corresponding to the belonging time can be performed as an image (heat map image) colored with a color associated with.

  Next, generation processing of electronic content and corresponding XML data performed using the electronic content generation device 2, and distribution of electronic content, display of an information display surface image, and information display by the information display surface image display system 1 Operations such as display of plane image display record information will be described.

Generation of electronic content and XML data As described above, in this embodiment, electronic content takes image information and attribute information from actual paper surface image data such as newspapers and magazines, and performs image compression processing on the image information. Is generated by

  First, the electronic content generation apparatus 2 receives actual page image data for each page (page) from the editing computer of the newspaper company or publisher via the network or the like by the network I / F unit 15. The image format of the actual paper surface image data may be BMP (Bit Map), PDF (Portable Document Format), JBIG (Joint Bi-level Image Experts Group), JPEG (Joint Photographic Experts), or any other format such as JPEG (Joint Photographic Experts).

  Next, the image / attribute take-in means 18 decrypts the received actual paper image data as necessary, develops it on the temporary storage device 12, and then extracts the image information and attribute information from the image data. Capture every page (page). The actual paper image data is given as image data in an arbitrary format as described above, and the image includes attribute information such as an issue date, a paper name, a paper page, and the like. Capture is performed by executing an OCR (Optical Character Reader) processing program included as part of the image / attribute capture module 18. If an image of a pre-defined format such as a newspaper is processed, each attribute information can be captured by performing OCR processing on a specified position, or the operator can input the input device 14. The text information may be read from the area designated via.

  Further, the image data generation means 19 generates image data in a compressed format from the actual paper surface image data by the image compression means 20. In this case, two or more image data having different resolutions are generated from one actual sheet image data. That is, two or more image data with different resolutions are generated as image data representing the same sheet (page). Specifically, an image compression subroutine (image compression submodule 20) included in the image data generation module 19 is also included in the image data generation module 19, and a control program module (not shown) that controls the operation of the compression subroutine. By executing under the control, a plurality of image data having different resolutions are automatically generated.

  The specific algorithm of image compression is arbitrary, but as an example, the image to be compressed is divided into pixel blocks such as 8 × 8, and then discrete cosine transform (DCT: Discrete Cosine Transform) is applied to each block. It is possible to generate JPEG compressed encoded image data by entropy encoding with Huffman code after reducing the amount of information by quantization.

  The plurality of generated image data forms a hierarchical structure. In one example, the first layer image data is image data configured as one image file representing one entire page (page), and the second layer image data is divided into four parts. The image data is configured as four image files representing each area obtained in this manner, and the image data in the third hierarchy is the 16 data representing each area obtained by dividing the entire page (page) into 16 parts. Image data configured as an image file. The number of hierarchies is arbitrary, and the entire page (page) may be further finely divided to increase the hierarchies. If the number of pixels in the image files of different layers is made the same, the resolution for the actual paper image increases as going from the first layer to the second and third layers.

  Further, as already described, the attribute information giving means 21 (for each paper or page) two or more image data having different resolutions generated from one real paper image, and the attribute captured by the OCR processing or the like. And electronic content as data including information. The electronic content 31 is transmitted to the electronic content distribution server 3 via the network I / F unit 15 and stored in the electronic content database 6.

  In addition, the XML data generation unit 22 is a position specifier that specifies the plurality of image data and attribute information (if the image data is configured as a plurality of image files, the position of the image data is typically an image In addition, the relative coordinates that determine the display position of the image data, the hierarchical number related to the resolution of the image data, etc. are directly described as tags. The following XML data is automatically generated.

The XML data file contains
<Element name = “element value”>
Or
<Element name>
<Attribute name 1 = “attribute value 1”>
<Attribute name 2 = “attribute value 2”>
</ Element name>
It is possible to describe a plurality of tags including arbitrary element names and attribute names in a format such as, and specify attributes such as position specifiers, relative coordinates, and hierarchy numbers for each image data (element). Thus, XML data is automatically created according to the elements, attribute names, hierarchical structure, etc. corresponding to the program design of the electronic content processing program 48. Under the control of the control program module included in the electronic content generation program 17, the XML data is transmitted to the Web server 7 via the network I / F unit 15 and stored in the storage device 39.

  As described above, the electronic content and XML data generated using the electronic content generation device 2 are stored in the electronic content database 6 and the storage device 39 of the Web server 7, respectively. Next, operations such as distribution of electronic contents, display of information display surface image, display of information display surface image display record information, and the like by the information display surface image display system 1 will be described.

The electronic content distribution Web server 7 receives the electronic content request transmitted from the information display surface image display device 9 by the electronic content receiving means 49 via the network 8-2. The content distribution means 40 transmits XML data 41 to the display device 9.

  Next, the electronic content receiving means 49 of the information display surface image display device 9 processes the received XML data to extract the image data to be acquired, the position specifier of the attribute information, etc. A request for data and attribute information is transmitted to the Web server 7.

  In response to the request, the electronic content distribution means 40 of the Web server 7 accesses the electronic content database 6 in the storage device 29 of the electronic content server 5 using the position specifier included in the request, and the electronic content database The target image data and attribute information are read out via the management means 30. The read electronic content is transmitted to the information display surface image display device 9 via the network 8-2. As described above, when the attribute information is described as a tag in the XML data itself, it is not necessary to send a request for the attribute information to the Web server 7, and the attribute information is the XML data itself. Can be obtained from

The information display surface image display means 51 of the information display surface image display device 9 decodes the image data that has been compression-encoded in a format such as JPEG as described above, and displays it on the display screen of the display device 44. After being expanded on the temporary storage device 43 so that it can be displayed, an information display screen image is constructed from the expanded image data, and an image corresponding to the operation is displayed on the display screen.

  In this embodiment, the information display surface image is configured by arranging each image according to the relative display position in the information display surface acquired as attribute information from the XML data. In the first layer, an information display surface image representing one page (page) is composed of one image file. In the second layer, four image files are used to represent the four images represented by each image file. The information display surface image is configured by arranging the images according to the relative display positions of the images, and in the third layer, the 16 images represented by the 16 image files are used for the relative display positions. The information display surface image is configured by arranging according to the above. More specifically, for example, in order to create the information display screen image of the fourth page in the third hierarchy, 16 images with the page number as attribute information “4” and the hierarchy number “3”. Files are distributed from the electronic content distribution server 3 in response to a request by the electronic content receiving means 49 (using 16 position specifiers described as tags in the XML data). ) A desired information display screen image can be configured by reading out from the temporary storage device 43 and arranging the images represented by the image files in accordance with the relative display positions given as attribute information to the respective image files. it can.

  As the first, second, and third layers increase, the number of pixels of the information display surface image as a whole increases, so that the entire image cannot be displayed depending on the screen resolution of the display device 44 of the information display surface image display device 9. There is. At this time, only a part of the information display surface image is displayed on the screen.

  FIG. 8 shows a screen image when a personal computer is used as the information display surface image display device 9 and the information display surface image is displayed as a real paper surface image of a magazine by a Web browser.

  The display area of the Web browser is divided into an information display unit 68, an image display unit 69, and an interface unit 70. The information display unit 68 displays the title 71 of the electronic content acquired as attribute information, the image display unit 69 displays all or part of the information display surface image, and the interface unit 70 displays the operator's display. Various buttons for inputting conditions are displayed. In the interface unit 70, the page number display unit 81 displays the number of pages acquired as attribute information. The operator depresses buttons 74 to 79 for inputting display conditions (refers to clicking the mouse button on the target button and clicking it), and the desired number of pages is displayed in the page number display section 81. The information display screen image display condition is input to the information display screen image display condition input means 50 by pressing the button 80 and the like.

  The button 74 is a button for selecting a display magnification. The operator presses this button and selects a desired magnification from the displayed pull-down menu 73, whereby the information display screen image can be enlarged or reduced and displayed at the desired magnification. In one example, when the display magnification is selected as “100%”, the information display surface image display means 51 selects and displays the information display surface image of the first layer, and the display magnification is selected as “200%”. When the display magnification is selected, the information display screen image of the second hierarchy is selected and displayed. When the display magnification is selected as “400%”, the information display screen image of the third hierarchy is selected and displayed. When “automatic adjustment” is selected in the pull-down menu 73, the information display surface image display unit 51 selects an appropriate magnification so that the entire information display surface image is displayed on the image display unit 69. An information display surface image adjusted to an appropriate size is displayed by interpolation and thinning processing. The magnification can also be selected by pressing buttons 75 (enlarge) and 76 (reduced).

  Buttons 77 and 78 are used for page turning. When the operator presses the button 77, the information display screen image of the previous page can be displayed, and when the button 78 is pressed, the information display screen image of the next page can be displayed. In the example of FIG. 8, the information display surface image of the second page is displayed. If the operator presses the button 78 in this state, the information display surface image of the third page is displayed by the information display surface image display means 51. Is newly generated and displayed on the image display unit 69. The button 79 is a button for selecting the presence / absence of spread display. If the operator presses the button 79 in the state as shown in FIG. 8, the information display screen image display means 51 newly starts the information display screen image from the image with the number of pages as attribute information “3”. Then, the image of the second page and the image of the third page are paralleled to generate a spread image and displayed on the image display unit 69 (FIG. 9). If the button 79 is pressed while the spread display is displayed, the image of the single page shown in FIG. 8 is displayed again. Further, the operator can directly display the information display surface image of the target page by pressing the button 80 after directly inputting the number of pages desired to be displayed in the page number display section 81. Further, the operator moves the mouse cursor to an arbitrary position in the information display surface image 72 displayed in the image display unit 69 and drags it in an arbitrary direction, thereby causing the information display surface image in the image display unit 69 to be dragged. 72 can be moved. The drag operation by the operator is accepted as a display condition input event by the information display surface image display condition input means 50, and the information display surface image display means 51 changes the display position of the information display surface image 72. When the display magnification is large and the entire information display surface image 72 cannot be displayed, the target article, image, or the like can be displayed by selecting the display position in this way.

  The various display conditions described above and the interface for inputting display conditions are merely examples. When a mobile terminal or the like not equipped with a mouse is adopted as the information display surface image display device 9, the display device 9 is provided as hardware, not a button displayed as an image in the display area as described above. In some cases, it is appropriate to input display conditions through buttons, and when the information display surface image display device 9 has a touch screen, no buttons are displayed on the screen, and detection is performed by the touch screen. The above display condition change command may be assigned to various input events (tap, flick, pinch-in, pinch-out, etc.).

Generation of Information Display Surface Image Display Record Information Next, a process for generating information display surface image display record information, which is typically performed in the background while displaying the information display surface image as described above, will be described. .

(Area)
In this embodiment, the information display surface is divided into an arbitrary number of areas, and display time is measured for each area to generate record information. FIG. 10 shows an example of division into areas. The display surface of the information display surface image 72 is divided into 280 rectangular areas including the area 82 by a group of straight lines that divide the display surface into 14 parts in the horizontal direction and 20 parts in the vertical direction. In one example, as execution parameters of the electronic content processing program 48, parameters indicating the number of divisions in each direction such as “14” and “20” are set in advance (for example, these parameters are information display surface image display record information). It may be changed at any time by sending a parameter change command from the processing device 10.) Based on these parameters, which of the 280 areas each pixel constituting the information display screen image belongs to By determining the affiliation area determination means 52, the information display surface can be conceptually divided into 280 areas.

(Display target range and predetermined display range)
In this embodiment, a predetermined display range is defined within the display target range of the information display surface image provided as the image display unit 69 in the display area of the Web browser, and each of the above-mentioned areas belongs to the predetermined display range. Determine whether or not. The predetermined display range can be defined as, for example, a closed region including the center portion in the display target range. The predetermined display range 83 shown in FIG. 11 is an example. Parameters for defining such a closed area (if defined as a rectangular area shown in FIG. 11, coordinates of the four vertices in the display area, etc.) are preset as execution parameters of the electronic content processing program 48. In one example, the parameter can be changed at any time by transmitting a parameter change command from the information display surface image display recording information processing apparatus 10. However, how to define the predetermined display range is arbitrary. As an example, the predetermined display range may be the display target range (image display unit 69) itself, and in that case, it is not necessary to define the predetermined display range separately from the display target range. .

(Judgment of affiliation area)
The determination as to whether or not each area belongs to the predetermined display range can be performed at regular intervals such as 1 second by the belonging area determination means 52 (control of such operation timing and other The operation control of each module included in the electronic content processing program 48 is performed by a control program module (not shown) included in the electronic content processing program 48. Specifically, for each of the 280 areas shown in FIG.
(1) The coordinates in the image display unit 69 are determined in the display area of the Web browser for each pixel in the area.
(2) By comparing the coordinates and the predetermined display range 83 shown in FIG. 11, it is determined whether or not each pixel is included in the predetermined display range.
(3) On the condition that the ratio of the pixels determined to be included in the predetermined display range among all the pixels included in the area is equal to or higher than a predetermined threshold (for example, 70%), or the threshold Is determined to belong to the predetermined display range, and otherwise, it is determined to not belong.
The above determination can be made by the following procedure. However, the determination as to whether or not the user belongs may be performed by another procedure. For example, determining whether or not the area belongs to the predetermined display range based on whether or not the pixel having the coordinates closest to the geometric center point of each area is included in the predetermined display range. Then, the amount of calculation by the central control unit 42 can be reduced. Besides, as shown in FIG. 10, if each area is given as a rectangular area, the coordinates of the four vertices in the rectangle and the predetermined value By comparing with the display range, the ratio of pixels included in the predetermined display range can be calculated.

(Decision of affiliation time)
Further, the belonging time determining means 53 determines the time during which each of the areas belonged to the predetermined display range. In one example, “time” in which a certain area belongs to a predetermined display range means that the area belongs to “predetermined display range” according to the determination by the belonging area determination means 52 performed at regular intervals as described above. Is determined as a value obtained by multiplying the number of times determined to "" by the predetermined time. Alternatively, the number of times determined as “belonging to the predetermined display range” itself can be used as the belonging time (in the case of fixing the time interval for determining whether to belong or not, such as Is particularly efficient.)

  In the present embodiment, the determination as to whether or not each area belongs to a predetermined display range and the determination of the belonging time are performed for each individual hierarchy. That is, the number of times that a certain area is determined to belong to a predetermined display range in the state where the information display surface image of the first hierarchy is displayed, and the certain area where the information display surface image of the second hierarchy is displayed. The number of times that is determined to belong to the predetermined display range is different from the number of times that the area is determined to belong to the predetermined display range in the state where the information display screen image of the third hierarchy is displayed. Is counted as The time when the area was displayed as the information display screen image of the third hierarchy with high resolution is higher than the time when the area was displayed as the information display screen image of the first hierarchy with low resolution. In such a configuration, it is possible to obtain more detailed information as display record information of the information display surface image. In particular, when the information display surface image includes characters that cannot be distinguished unless they are displayed at a high resolution, each area has a predetermined display indicating that the display resolution is equal to or higher than a predetermined threshold. It is effective to make it a necessary condition for determining that it belongs to the range. As an example, even if 70% or more of the pixels in the area are included in the predetermined display range, if the information display surface image being displayed is an image in the first layer, the area is predetermined. It is possible to configure so as to determine that it does not belong to the display range. However, it is not essential to determine the affiliation area and determine the affiliation time for each hierarchy, for example, the total of affiliation time in each hierarchy, without distinguishing which hierarchy information display image was displayed. You may determine the affiliation time of each area as time.

(Generation of information display surface image display record information)
The information display surface image display record information generating means 54 generates information display surface image display record information as information including information related to the belonging time determined for each zone as described above. In one example, the information display surface image display record information is in the format shown in the table of FIG. 12, and includes a user ID, an electronic content ID, a page number, a hierarchy number, a section ID, a belonging time, and other arbitrary information items. Configured to include.

  In each information item, the user ID is an identifier (number, character, symbol, etc., or a combination of these) that uniquely identifies a user as a user of electronic content. In one example, the user ID is given as part of the user information 56. Typically, the user information 56 is stored in a user registration server (not shown) disposed inside or outside the electronic content distribution server 3 when the electronic content processing program 48 is installed in the information display surface image display device 9. As a result of performing user registration (transmission of personal information of a person who uses the electronic content processing program 48 such as address, age, sex, occupation, etc.), it is generated by the user registration server and sent to the information display screen image display device 9 After being transmitted, it is stored in the storage device 47.

  Among the information items, the electronic content ID is an identifier for uniquely identifying a newspaper, a magazine, or the like provided as electronic content. In one example, the electronic content ID is given as attribute information included in the electronic content distributed by the electronic content distribution means 40, and the position specifier described in the XML data distributed from the Web server 7 is used. It can be acquired from the electronic content database 6 or directly from a tag described in the XML data.

  In each information item, the page number is a number given as attribute information to the image data constituting the information display screen image as described above. The page number can be acquired from the electronic content database 6 as attribute information included in the electronic content as with the electronic content ID, or directly from a tag described in the XML data.

  In each information item, the hierarchy number is a number indicating which hierarchy the information display screen image belongs to as described above. In one example, the hierarchy number is given as attribute information included in the electronic content distributed by the electronic content distribution means 40, and electronically using a position specifier described in the XML data distributed from the Web server 7. It can be acquired from the content database 6 or directly from a tag described in the XML data.

  In each information item, the area ID is an identifier for uniquely identifying an area obtained by dividing the information display surface as described above. In the above-described example, when the affiliation area determination unit 52 conceptually divides the information display surface based on the execution parameter or the like, a number for identifying each area (in the example shown in FIG. 10, 1 to 280). Integer).

  In each information item, the affiliation time is a time value determined by the affiliation time determination means 53 as described above, and the area belongs to a predetermined display range. Typically, after the information display surface image display recording information is initialized to zero at the timing when the information display surface image display recording information processing apparatus 10 is transmitted, the area is determined in the determination by the belonging area determination means 52. Each time it is determined that “belongs to a predetermined display range”, the belonging time value is determined by a procedure of adding a value equal to the time interval of the determination.

  In such a configuration of the information display surface image display record information, the user ID, the electronic content ID, the page number, and the hierarchical number are all equal records, and 280 records in which the area ID is one of 1 to 280. Can exist. The information display surface image display record information is generated by setting the belonging time of each record to the belonging time value determined by the above-described procedure.

Is the information display surface image display record information generated by the transmission information display surface image display record information generation means 54 stored in the temporary storage device 43 of the information display surface image display device 9? Alternatively, the information display surface image is recorded via the network 8-2 at a timing when the system time of the information display surface image display device 9 becomes a predetermined time once a day, for example, after being stored in the storage device 47. It is transmitted to the information processing apparatus 10. In this case, the affiliation time in the information item corresponds to the time during which each area belongs to the predetermined display range during the day. However, the timing of the transmission is arbitrary. For example, in the offline state in which the connection between the information display surface image display device 9 and the network 8-2 is not established, the affiliation time corresponding to each day is stored as an individual information display surface image display record information record. 47, and the record can be transmitted at the timing when the connection between the information display surface image display device 9 and the network 8-2 is established.

  When performing the above-described transmission processing of the information display surface image display recording information at a predetermined time, the image data constituting the corresponding information display surface image is also transmitted to the information display surface image display recording information processing apparatus 10. May be. More specifically, image data having the electronic content ID and page number of the information display surface image display record information to be transmitted as attribute information and having a hierarchical number of 1 (in the present embodiment, configured as one image file) May be transmitted to the information display surface image display recording information processing apparatus 10 together with the information display surface image display recording information. With such a configuration, the information display surface image itself that was the display target can be used as the background image in the recorded information display processing described later by the information display surface image display recording information processing apparatus 10. Here, it is preferable that an electronic content ID and a page number are added to the image data as metadata. Thereby, it is possible to uniquely specify the information display surface image constituted by the image data. In order to reduce communication traffic, it is preferable to select an image to be transmitted having a layer number of 1 as described above (in addition, it is effective to reduce the file size by thinning-out processing). Image data with a hierarchy number other than this may be transmitted (in this embodiment, for example, when image data with a hierarchy number “2” is transmitted, subsequent information display by the information display surface image display recording information processing apparatus 10) It is necessary to transmit four image files for plane image composition processing, and it is preferable to add relative coordinates to each image file as metadata. Further, when the information display surface image is not displayed as a background image, such image data transmission is not necessary. Hereinafter, the display processing by the information display surface image display recording information processing apparatus 10 will be described on the assumption that the image data having the layer number 1 is transmitted together with the information display surface image display recording information.

The display information display surface image display recording information processing apparatus 10 receives the information display surface image display recording information and the image data having the layer number of 1 by the information display surface image display recording information receiving means 65. It is received and held on the temporary storage device 59 or stored in the storage device 63. The information display surface image display record information display means 67 uses the record information and the image data to associate the display corresponding to the affiliation time determined for each area with the display area of the display device 60 in association with each area. Etc.

  Hereinafter, the information display surface image display record information is an image formed by dividing the information display surface into each area and coloring each area with a color corresponding to the size of the belonging time value determined for the area. It shall be displayed as (heat map image). In one example, such a heat map image can be generated by steps S1301 to S1304 shown in the flowchart of FIG.

(Step S1301)
First, the information display surface image display record information display condition input means 66 is information for specifying a target information display surface image (in this embodiment, an electronic content ID and a page number. However, as will be described later, a specific hierarchy is used. When a heat map image corresponding to only a number is generated and displayed, a hierarchical number is also included.) And information for specifying a target user (in this embodiment, a user ID) is input by an operator. Accept. The input is performed via a menu screen (not shown) displayed on the display screen of the display device 60 by executing the information display surface image display recording information processing program 64.

(Step S1302)
Next, the information display surface image display record information display means 67 is composed of the electronic content ID equal to that input in step S1301, the image data with the page number added as metadata, and the hierarchical number of 1 above. The information display surface of the information display surface image is conceptually divided into areas similar to the areas shown in FIG. In one example, as the execution parameter of the information display surface image display recording information processing program 64, a parameter indicating the number of divisions in each direction such as “14” and “20” is set in advance as with the execution parameter of the electronic content processing program 48. (These parameters may be changed at any time, for example, by an operator's input via the input device 61 of the information display surface image display recording information processing apparatus 10), and based on these parameters. The information display surface can be conceptually divided into 280 areas by determining which of the 280 areas each pixel of the image data constituting the information display surface image belongs to.

(Step S1303)
Next, the information display surface image display record information display means 65 determines a color to be used for coloring each area. As the coloring color model, it is possible to use an RGB color model in which the brightness of each color of red, blue, and green is determined as a numerical value from 0 to 255, and the color is defined by a set of the determined three numerical values. it can. In this case, among the information items of the received information display surface image display record information, the user ID, the electronic content ID, and the page number are equal to each information item input in step S1301 and the area ID. By determining the brightness value of “R” according to the information item value of the belonging time included in the information display surface display record information record in which the information item is equal to the area ID value of the area to be colored (“G”, The brightness value of “B” may be a predetermined value regardless of the affiliation time.) The length of the affiliation time in each area can be expressed by color (in this embodiment, one piece of information A color determination is made for each of the 280 areas to generate a heat map image corresponding to the display surface image). However, it is not essential to use the above color model for the display corresponding to the affiliation time, and any display can be used as long as the display content can be adjusted according to the affiliation time value, such as shades of black. May be.

  In the configuration of the present embodiment, among the information items of the information display surface image display record information, the user ID, the electronic content ID, the page number, and the section ID are all equal records, and the item number of the hierarchical number is 1 to 3. There can be three records taking each. Therefore, when determining the lightness value of “R”, there is an arbitraryness as to how the belonging time values of the three records are combined.

In one example, the item value of the hierarchical number is i and (i = 1 to 3) belonging time value of the information display screen image display recorded information record is as T _i, the affiliation time score _{T = c 1 T 1 + c} 2 T ₂ + c ₃ T ₃ (where c ₁ <c ₂ <c ₃ ) (1)
Then, the brightness value R of the above “R” is set to R = (T / T _max ) × 255 (2)
Can be determined. Here, c _{1 to} c ₃ are coefficients for weighting T _i , and T _max is the maximum value of T obtained when the above equation (1) is calculated for each area ID. In the case of T _max = 0, the brightness value R = 0 without using the equation (2).

By setting c ₁ <c ₂ <c ₃ in the above equation (1), the hierarchical number is higher than the belonging time of each section in the display record information of the information display surface image having a low hierarchical number (low resolution). The belonging time of each section in the display record information of the information display surface image (with high resolution) greatly contributes to the brightness value R (when the belonging time length is the same). In general, it is appropriate to evaluate that the area displayed at a high resolution by an image enlargement operation by the operator of the information display surface image display device 9 is an area viewed with high interest by the operator, By determining the brightness value of “R” using the above equations (1) and (2), it is possible to generate a heat map image that also reflects the degree of interest of the operator.

Note that a specific method for determining the brightness value of “R” from the belonging time corresponding to each layer number is arbitrary, and c ₁ <c ₂ <c ₃ or the above (1), (2) It is not essential to determine the lightness value according to As an example, if c ₁ = c ₂ = c ₃ , the affiliation time of each zone given as the total value of the affiliation time over all hierarchies without weighting according to the hierarchy number is the lightness of “R” It is possible to contribute to the value, or by setting c ₁ = 0, it is possible to ignore the time during which the area is displayed as the information display screen image of the first layer with low resolution. .

(Step S1304)
Next, the information display surface image display record information display means 67 determines each area determined by the conceptual division in the information display surface image composed of the image data having the hierarchical number of 1 (1). , (2) generates a heat map image as an image colored with a color determined according to the RGB color model from the lightness value of “R” determined by the equation and the predetermined lightness values regarding “G” and “B” And displayed on the display screen of the display device 60 or the like.

  An example of the heat map image generated and displayed in this way is shown in FIG. In the illustrated heat map image, each area in the region 84 is an area colored by a color having a higher brightness value of “R” than the other areas (for convenience of drawing, the area is colored). No), it can be read that the operator of the information display surface image display device 9 was paying attention to the area 84.

When determining the lightness value of “R”, it is not essential to combine the belonging time values T _{1 to} T ₃ corresponding to each hierarchical number as shown in the above equation (1). For example, instead of the above (1), T = c _i T _i (i is any one of 1 to 3)
It is possible to generate a heat map image corresponding to only a specific hierarchy number (in this case, 3 corresponding to each hierarchy number for one information display screen image). Two heatmap images are generated.)

In the present embodiment, the user ID as the display condition is specified in step S1301 and the heat map is generated and displayed. However, the heat map is generated and displayed without specifying the user ID. It is also possible to do. Specifically, when determining the color to be used for coloring each area in step S1303, the information item values of the electronic content ID, the page number, the hierarchy number, and the area ID are equal, and the information item values of the user ID are different. summing the affiliation time values of a plurality of information display screen image display recorded information record (or perform any other statistical processing) in terms of the like, with the belonging time value after being the total such as T _i, The brightness value of “R” can be determined by the above equations (1) and (2). The heat map displayed in this way represents the preference of the article as a whole user and the tendency of the browsing operation with respect to a specific information display surface image.

Variations in Embodiments Hereinafter, some examples of variations that can be adopted as embodiments of the present invention will be described.

  In Example 1 described above, as shown in FIG. 14, the information display surface was divided into 280 rectangular areas, and each area was colored with a color corresponding to the belonging time, thereby displaying a heat map image. On the other hand, after defining the “article region” as a set of areas, determine the “representative time representative value” for each article region, and color each article region with a color corresponding to the representative value. It is possible to display a heat map image. Hereinafter, the heat map image display processing at the article level will be described with reference to the flowchart shown in FIG.

(Step S1501)
First, the information display surface image display record information display condition input means 66 accepts input by the operator of the target information display surface image and information for identifying the user, as in step S1301 of FIG.

(Step S1502)
Next, the information display surface image display record information display means 67 determines to which area each pixel of the image data having the hierarchical number 1 belongs, as in step S1302 of FIG. The information display surface is conceptually divided into 280 areas.

(Step S1503)
Furthermore, the information display surface image display record information display means 67 specifies an article area including each area by giving an article area ID to each area. Thus, the article region is defined as a set of areas. In one example, the information display surface image display record information display means 67 is an image obtained by dividing the information display surface of the information display surface image into each area (an image in which each area is not colored in the heat map of FIG. 14). Is displayed on the display screen of the display device 60, and the information display surface image display record information display condition input means 66 is an article region via the input device 61 by the operator of the information display surface image display record information processing device 10. Accepts input of specified conditions. The operator inputs the article region defining condition by inputting the boundary line of the article region via the input device 61 such as a mouse.

  FIG. 16 shows an example of the boundary line of the article area input by the operator. In order to conceptually divide the information display surface into article areas 85 to 88, the operator inputs article area defining conditions by dragging the mouse to draw a desired boundary line.

  Based on the input boundary line, the information display surface image display record information display means 67 uses 1 as the article area ID for the section included in the article area 85 and as the article area ID for the section included in the article area 86. 2 is assigned to the area included in the article area 87 as 3 as the article area ID, 4 is assigned to the area included in the article area 88 as 4 as the article area ID, and the article areas 85 to 88 as a set of the areas are provided. Define. More specifically, an article area ID as an information item is added to each record of the information display surface image display record information received in the table format of FIG. 12, and the format of the display record information is a table shown in FIG. After being expanded to a format, it is held on the temporary storage device 59.

(Step S1504)
Next, the information display surface image display record information display means 67 determines a color to be used for coloring each article area. As the coloring color model, the RGB color model can be used as in the first embodiment. However, the brightness value of “R” that defines the color for coloring each area is not determined only by the affiliation time value of the display information record record having the area ID of the area, but the same article area as the area. It is possible to determine using the “representation time representative value” determined from the set of the belonging time values of the records corresponding to the respective areas included in.

As the belonging time representative value, for example, an average value of belonging time values included in the set of belonging time values can be used. In this case, the assigned time average values given for each of the three hierarchies are T ₁ , T ₂ , T _3, and these are substituted into the above (1) and (2) to color each article region. The brightness value of “R” can be determined. It should be noted that the above-described arbitraryness of coefficients used for weighting is similarly established in this embodiment. Also, it is not essential to set the representative time representative value to an average value. For example, the affiliation time representative value can be determined by an arbitrary method, such as adopting the affiliation time value of the section closest to the geometric center of the article region as a representative value.

(Step S1505)
Next, the information display surface image display record information display means 67 determines each area determined by the conceptual division in the information display surface image composed of the image data having the hierarchical number of 1 (1). , (2) generates a heat map image as an image colored with a color determined according to the RGB color model from the lightness value of “R” determined by the equation and the predetermined lightness values regarding “G” and “B” And displayed on the display screen of the display device 60 or the like. As described above, since the same “R” brightness value is determined for the areas included in the same article region, one article region is uniformly colored with the same color.

  An example of the heat map image generated and displayed in this way is shown in FIG. In the illustrated heat map image, each area in the article region 87 is an area colored with a color having a higher brightness value of “R” than the other areas (for convenience of drawing, the area is colored. It can be read that the operator of the information display surface image display device 9 is paying attention to the article area 87.

  In the first embodiment described above, the information display surface image display record information generated according to the table format shown in FIG. 12 by the information display surface image display record information generation means 54 included in the information display surface image display device 9 is used. Based on the value recorded as the information item of the affiliation time, the color to be used for coloring each area was determined. However, in the determination of the color (or the determination of the display content such as black shades when display is performed by a color other than the color), each area is given as the time belonging to the predetermined display range. It is also possible to reflect elements other than the affiliation time.

  For example, the electronic content processing program 48 stored in the storage device 47 of the information display surface image display device 9 can further include an area designation event input module (not shown) as its program module. The area designation event input module is loaded on the temporary storage device 43 and executed by the central control unit 42 to constitute an area designation event input means for receiving a predetermined event input designating an area.

  In such a configuration, the operator of the information display surface image display device 9 moves the mouse cursor to an arbitrary position 89 in the image 72 while the information display surface image 72 is displayed as shown in FIG. By clicking, it is possible to input a click event to the area designation event input means (in a mode in which the information display surface image 72 is displayed on the touch screen, such as inputting a tap event, depending on a specific configuration. The mode of the predetermined event input is different.)

  The area designation event input means detects the occurrence of the click event and specifies the occurrence position 89 as coordinates in the image display unit 69 to accept the input of the click event. In response to the input of the click event, the affiliation time determination means 53 adds a predetermined bonus value such as 10 seconds to the affiliation time value of the area including the click event occurrence position 89 (click event of the click event). The addition process may be performed only on records having a hierarchy number equal to the hierarchy number of the information display surface image displayed at the time of occurrence, or the addition process may be performed on records having all hierarchy numbers. ).

The configuration other than the configuration related to the area designation event input may be the same as the configuration of the first embodiment. In this case, the affiliation time value of each zone recorded in the table format shown in FIG.
(I) stipulated in the first embodiment, which is determined based on the number of times that the area is determined to belong to a predetermined display range in the above-described determination by the belonging area determination means 52 performed at regular intervals such as 1 second. As you can see,
(Ii) a bonus value generated by inputting the click by designating the area;
The “score” is determined as the sum of

  Therefore, the generation mode of the information display surface image display record information is changed so that the “score” is used as the information item value of the belonging time in the table of FIG. 12, and the subsequent processing is performed in the same manner as in the first embodiment. In other words, the displayed heat map image reflects not only the display time of each area but also the presence / absence of a click event, the number of times, and the like. The image data constituting the information display surface image is used as image data for product advertisement, and by clicking the image, link information is embedded in the image data so that another Web site displaying detailed information of the product is displayed. In such a case, by taking such a configuration, it becomes possible to evaluate the degree of interest in the product by the operator more finely.

The determination of the “score” may be performed in the information display surface image display recording information processing apparatus 10. In one example, the information item value of the belonging time in the table of FIG. 12 is determined in the same manner as in the first embodiment, and an information item of “event input bonus” is newly added to the table format shown in FIG. Thus, the table format of the information display surface image display record information is expanded, and the bonus value is recorded as the information item of the “event input bonus”. In this case, when generating the heat map image with the information display screen image display recording information display means 67, as belonging time value T _i in the formula (1), the information item value of the information item value and event input bonus belongs time If the sum is used, it is possible to generate a heat map image that also reflects the presence / absence of the occurrence of a click event, the number of times, and the like.

  Further, if the configuration related to the input of the area designation event is introduced to the configuration of the second embodiment, it is possible to reflect the occurrence of the input event in the article level heat map image. For example, in the aspect in which the information item of “event input bonus” is added to the table format shown in FIG. 12 and the bonus value is recorded as described above, when determining the color used for coloring each article area, (1) and (2) can be used after adding the bonus value given to each zone included in the above to the belonging time representative value.

  In addition, as information items of the information display surface image display record information, personal information (address, age, sex, occupation, etc.) of the user of the electronic content, the time zone when the display processing of the information display surface image was performed, and at that time The information display surface image display device 9 can be configured to record information related to the geographical position of the information display surface image display device 9. By displaying these information in association with the heat map image (or any other display corresponding to the affiliation time determined for each area), it is possible to display articles related to the user's age group, gender, etc. It is possible to grasp the tendency of the browsing operation related to the preference, the time zone, and the geographical position. Hereinafter, an example of such an embodiment will be described.

  In the present embodiment, each of the operations of generating electronic content and XML data by the electronic content generating device 2, distributing electronic content by the electronic content distribution server 3, and displaying the information display surface image by the information display surface image display device 9 is performed. It is assumed to be performed in a manner similar to that described in Example 1. However, the user information 56 stored in the storage device 47 of the information display surface image display device 9 includes personal information such as address, age, gender, occupation used in the user registration in addition to the above-described user ID. Shall be included.

Generation of Information Display Surface Image Display Record Information Hereinafter, the information display surface image display record information generation process performed in the present embodiment will be described.

  Within the display target range (image display unit 69 in FIG. 8), conceptual division of the information display surface into 280 areas by the belonging area determination means 52 (as described above, the number of areas is arbitrary). Stipulation of a predetermined display range (predetermined display range 83 in FIG. 11), each operation of the determination of the affiliation area, and determination of affiliation time to the predetermined display range in each area by the affiliation time determination means 53 The operation can be executed in the same manner as in the first embodiment. However, the affiliation time for each area by the affiliation time determination means 53 is not counted over 24 hours but over a predetermined time interval (for example, 1 hour) defined by the operation parameters of the electronic content processing program 48. Shall.

  Further, the information display surface image display record information generated by the information display surface image display record information generating means 54 is an extension of the table format of FIG. 12, and is in a format as shown in the table of FIG. , User personal information (address, age, gender, occupation, etc.), electronic content ID, page number, hierarchy number, area ID, affiliation time, display status information (recording start time, recording end time, geographical location, etc.), and It is configured to include other optional information items.

  Among the information items described above, the user personal information corresponds to personal information such as address, age, sex, and occupation included in the user information 56 as described above. Each personal information included in the user information 56 stored in the storage device 47 of the information display surface image display device 9 is included as an information item of the user personal information by representing it with a code number or the like as necessary. Each information item is determined.

  In addition, in the information items, the display status information includes a recording start time indicating the time when the measurement of the display time is started for each area in the information display surface of the information display surface image, and a recording end indicating the time when the measurement ends. Information items such as the time and the geographical position of the information display surface image display device 9 when the measurement is performed are included.

  The information display surface image display record information generating means 54 generates an information display surface image display record information record by determining these information items in addition to the information items included in the table format of FIG. If the information display surface image display device 9 is a stationary personal computer, the geographical position is typically determined by using an address included in the user information 56, and GPS (Global Positioning). In the case of a mobile terminal equipped with a (System) receiver, it can be determined using the GPS function.

  Here, in particular, when the information display surface image display device 9 is a portable terminal, the geographical position of the terminal greatly changes between the recording start time and the recording end time when the user moves. is there. Therefore, there arises a problem as to when the determination of the geographical position included in the display status information among the information items of the information display surface image display record information should be performed.

This problem,
(I) First, the geographical position is determined as the geographical position of the information display surface image display device 9 at the recording start time.
(Ii) For example, the geographical position of the information display surface image display device 9 is periodically monitored by the GPS function, and the area (prefecture including the geographical position, etc.) specified from the acquired latitude and longitude is changed. At this timing, a new copy of the information display surface image display record information record is generated (a copy of each record that existed before the area change is generated).
(Iii) Of the information items of the newly generated information display surface image display record information record, the item of geographical position is updated with the geographical position after the area change.
(Iv) In the information item of the newly generated information display surface image display record information record, the belonging time item is once initialized to zero.
It can be solved by such a method.

  Here, among the information items of the newly generated record, the affiliation time is newly counted from zero as the time that each area belongs to a predetermined display range after the area change. Further, information items other than the geographical position and the belonging time are the same in both records corresponding to before and after the area change. That is, during a predetermined time interval (for example, 1 hour as described above) in which the display time of the information display surface image should be measured, the information display surface image display device 9 is changed from, for example, Kanagawa Prefecture to Tokyo, Saitama Prefecture. When moving to, a total of three sets of information display surface image display record information records are generated as record sets corresponding to each prefecture and capital.

Transmission of Information Display Surface Image Display Recording Information The generated information display surface image display recording information is transmitted to the information display surface image display recording information processing apparatus 10 by the information display surface image display recording information transmitting means 55. The transmission can be performed in the same manner as in the first embodiment. Also in this embodiment, the electronic content ID and page number of the transmitted information display surface image display record information are used as attribute information, and the image data having the hierarchy number 1 is information together with the information display surface image display record information. It is assumed that the display surface image display recording information processing apparatus 10 transmits the information. If the display time is measured for a relatively short time such as 1 hour, records generated at any time are stored in the storage device 47 and collected at a predetermined timing such as once a day. Are preferably transmitted.

In the display example 1 using the information display surface image display record information, when the information item of the user ID is input as the display condition of the heat map image, the heat map image displayed as shown in FIG. One user's preference for articles and the tendency of browsing operations were expressed. On the other hand, when the information item of the user ID is not input, the displayed heat map image is the above-mentioned preference as the entire user with respect to the same information display surface image defined by the same electronic content ID and page number, It showed a trend.

  On the other hand, in the present embodiment, the user's age group, gender, information display surface image display time zone, geographical area using various display conditions input via a menu screen described later, A heat map image reflecting other preferences and tendencies related to the position or the like, or other display is generated and displayed. The specific process will be described below.

  First, the information display surface image display recording information processing apparatus 10 receives the information display surface image display recording information and the image data having the hierarchical number 1 by the information display surface image display recording information receiving means 65, and temporarily stores the image data. Or stored in the storage device 63. The information display surface image display record information display means 67 uses the record information and the image data to associate the display corresponding to the affiliation time determined for each area with the display area of the display device 60 in association with each area. Etc.

  If an example of displaying as a heat map image is described, the image generation and display operations can be performed in steps S1301 to S1304 shown in the flowchart of FIG. However, as the table format of the information display surface image display record information is expanded as shown in FIG. 20, in step S1301, the operator of the information display surface image display record information processing apparatus 10 determines the display conditions of the heat map image. Can be specified in more detail. Accordingly, the color determination operation performed in step S1303 is also different from that in the first embodiment.

(Step S1301)
FIG. 21 shows an example of a menu screen for inputting heat map image display conditions. The menu screen 90 includes an electronic content name input field 91, a page number input field 92, a recording time input field 93, a measurement area input field 94, an age group input field 95, a sex input field 96, a heat map display button 97, and an end button 98. The operator of the information display surface image display recording information processing apparatus 10 can input each display condition in the input fields 91-96. Note that the electronic content name input field 91, the page number input field 92, the measurement area input field 94, and the gender input field 96 are configured as pull-down menus, and an operator can arbitrarily select from input contents prepared in advance. It is preferable to select one. As an example, when the pull-down menu of the electronic content name input field 91 is clicked, a list of electronic content names prepared in advance is displayed as a list, and the operator selects a desired electronic content name from the list. Thus, an electronic content ID as a display condition can be designated. When the pull-down menu in the page number input field 92 is clicked, a list of page numbers that can be selected according to the total number of pages of the electronic content currently designated by the input to the electronic content name input field 91 is displayed. The list is displayed, and the operator can specify a desired page number from the list (in the storage device 63 of the information display surface image display recording processing device 10, the electronic content ID, the electronic content name, the total number of pages, etc.) It is assumed that information of existing electronic contents is stored as a database (not shown) in a table format including the information items of information display surface image display record information display condition input means 66. Use the information to determine the contents of the list to be displayed in the pull-down menu.) In addition, a list of areas to be presented as candidates for measurement areas and a list of genders are also stored in advance in the storage device 63 (in the table format of FIG. 20, the information item value of the geographical position is typical) Is defined by a code number corresponding to each of the above areas, etc. The storage device 63 is a table including information items of the code number and the measurement area name to be displayed in the pull-down menu of the measurement area input field 94. It is assumed that the information of the measurement area is stored as a database (not shown) in the format, and the operator determines the name of the measurement area from the pull-down menu, so that the geographical position as the heat map image display condition is determined. The code number is specified, and the gender is also specified via the code number, etc.).

  By pressing the display button 97 after inputting the display conditions, a heat map image is generated and displayed through the processing of steps S1302 to S1304 according to the input conditions (when the end button 98 is pressed) For example, the display of the menu screen 90 is terminated, and the execution of the information display surface image display recording information processing program 64 is also terminated.)

(Step S1302)
As in the first embodiment, the information display surface image display record information display means 67 is the image data with the hierarchical number of 1 added with the electronic content ID and page number equal to those specified in step S1301 as metadata. Are conceptually divided into areas similar to the areas shown in FIG.

(Step S1303)
Next, the information display surface image display record information display means 67 determines a color to be used for coloring each area. The color determination for each area is
(I) According to the display conditions input in step S1301, a record of information display surface image display record information to be used for generating a heat map image is extracted.
(Ii) In the information items of the extracted records, the affiliation time values are summed (or any other statistical process is performed), and the affiliation time values after the summation are used, the embodiment Similarly to 1, the brightness value of “R” is determined by the above formulas (1) and (2).
It can be done in the procedure.

Specifically, when the display condition is input as shown in the menu screen 90, the information display surface image display record information display means 67 is transmitted from the information display surface image display device 9 and held on the temporary storage device 59. Or among the information display surface image display record information records stored in the storage device 63,
The electronic content ID is equal to the electronic content ID corresponding to the electronic content name input in the electronic content name input field 91 (the correspondence relationship is a database of electronic content information stored in the storage device 63 as described above) ).)
-The page number is equal to the page number entered in the page number entry field 92.
Both the recording start time and the recording end time belong to the recording time range input in the recording time input field 93.
-The geographical position is equal to the code number or the like corresponding to the measurement area input in the measurement area input field 94 (the correspondence relationship is defined by the measurement area information database stored in the storage device 63 as described above). Has been).
-Age is within the age range entered in the age group entry field 95.
The gender is equal to the code number corresponding to the gender entered in the gender input field 96.
Records that satisfy the condition are extracted.

Then, among the extracted records, the records having the area ID corresponding to the area to be processed whose color is to be determined are classified for each hierarchy number, and the records having the respective hierarchy numbers are included in the information item. The above-mentioned belonging time value T _i is determined for each of i = 1 to 3 by summing up the belonging time values. Hereinafter, by calculating the above-described equations (1) and (2) using the T _i determined in this way, the lightness value of “R” for the area is determined. For each area (for 280 areas in this example), the color value to be used for coloring can be determined by determining the "R" lightness value in a similar procedure.

(Step S1304)
As in the first embodiment, the information display surface image display record information display means 67 generates a heat map image by coloring each area with the color determined as described above, and displays it on the display screen of the display device 60 or the like. To do.

  An example of the display screen of the heat map image generated in this way is shown in FIG. In the display screen 99 of the display device 60, the heat map image 100 and various display conditions 102 to 107 designated by the input to the menu screen 90 are displayed.

  In the illustrated heat map image 100, each area in the area 101 is an area colored with a color having a higher brightness value of “R” than the other areas (for convenience of drawing, the area is colored. Not.) According to the heat map image 100, between 25 and 16 o'clock on August 1, 2011, the second page of the electronic content “XXX” in the 23 wards of Tokyo was viewed 25-25. It can be seen that the 34-year-old man was particularly focused on the area 101.

  Of the input fields in the menu screen 90, when the display button 97 is pressed without inputting display conditions into the age group input field 95 and the sex input field 96, The record extraction process is performed without imposing conditions on information items such as age and gender. In this case, the displayed heat map image 100 displays the second page of the electronic content “XXX” in the Tokyo 23 wards between 15:00 and 16:00 on August 1, 2011. It represents the tendency of browsing operations of all users (regardless of age and gender). Similarly, by inputting only arbitrary display conditions that can be input on the menu screen 90, the user's age, sex, time zone when the display process of the information display surface image is performed, geographical position, etc. Among them, it is possible to grasp the preference and tendency related only to the arbitrarily selected condition.

  Further, the menu screen 90 may be configured to accept input of display conditions regarding other arbitrary information items such as the user's address, occupation, etc. In addition, the menu screen 90 accepts input of page numbers. First, it is possible to change the present embodiment to an arbitrary mode such as by providing a page feed button in the display screen 99 of FIG. It is. In addition, the present invention can be implemented by selectively combining the specific modes described in the first to fourth embodiments.

  The present invention is not limited to the above-described embodiment, and the specific configuration can be arbitrarily changed without departing from the technical scope of the present invention.

  INDUSTRIAL APPLICABILITY The present invention can be used in an arbitrary information processing system or the like that processes display record information of an information display surface image that displays a newspaper, a magazine, or the like as a real paper image.

DESCRIPTION OF SYMBOLS 1 Information display surface image display system 2 Electronic content production | generation apparatus 3 Electronic content delivery server 4 FTP server 5 Electronic content server 6 Electronic content database 7 Web server 8-1, Network 9 Information display surface image display apparatus 10 Information display surface image display Recording information processing device 11 Central control unit 12 Temporary storage device 13 Display device 14 Input device 15 Network I / F unit 16 Storage device 17 Electronic content generation program 18 Image / attribute acquisition module 19 Image data generation module 20 Image compression sub-module 21 Attribute information addition module 22 XML data generation module 23 Actual paper surface image data 24 Central control unit 25 Temporary storage device 26 Display device 27 Input device 28 Network I / F unit 29 Storage device 30 Electronic content data Database management program 31 Electronic content 32 Image data 33 Attribute information 34 Central control unit 35 Temporary storage device 36 Display device 37 Input device 38 Network I / F unit 39 Storage device 40 Electronic content distribution program 41 XML data 42 Central control unit 43 Temporary storage Device 44 Display device 45 Input device 46 Network I / F unit 47 Storage device 48 Electronic content processing program 49 Electronic content reception module 50 Information display screen image display condition input module 51 Information display screen image display module 52 Affiliated area determination module 53 Affiliation time Determination module 54 Information display surface image display record information generation module 55 Information display surface image display record information transmission module 56 User information 57 Information display surface image display record information 58 Central control 59 Temporary storage device 60 Display device 61 Input device 62 Network I / F unit 63 Storage device 64 Information display surface display recording information processing program 65 Information display surface image display recording information receiving module 66 Information display surface image display recording information display condition input module 67 Information display surface image display record information display module 68 Information display portion 69 Image display portion 70 Interface portion 71 Title of electronic content 72 Information display surface image 73 Pull-down menu 74 to 80 Button 81 Page number display portion 82 Area 83 Predetermined display range 84 Area 85-88 Article area 89 Mouse cursor position 90 Menu screen 91 Electronic content name input field 92 Page number input field 93 Recording time input field 94 Measurement area input field 95 Age group input field 96 Gender input field 97 Heatma Up display button 98 Exit button 99 display screen 100 heat map image 101 area 102 display conditions (electronic content name)
103 Display conditions (page number)
104 Display conditions (recording time)
105 Display conditions (measurement area)
106 Display conditions (age group)
107 Display conditions (gender)

Claims (12)

An electronic content distribution server that stores and distributes electronic content including image data representing an information display surface image, and is connected to the electronic content distribution server via a network to receive the electronic content and display the information display surface image An information display surface image display device and an information display surface connected to the information display surface image display device via a network for receiving and displaying display record information of the information display surface image in the information display surface image display device An information display surface image display system including an image display recording information processing apparatus,
The electronic content distribution server includes:
Electronic content storage means for storing the electronic content including two or more pieces of image data having different resolutions corresponding to one information display surface image;
Electronic content distribution means for distributing the electronic content to the information display surface image display device,
The information display surface image display device includes:
Electronic content receiving means for receiving the electronic content from the electronic content distribution server;
Information display surface image display condition input means for receiving input of display conditions of the information display surface image;
Corresponding to the information display surface image to be displayed, by selecting and outputting image data having a resolution suitable for the display condition, the information display surface image is displayed over a display target range including all or part thereof. An information display surface image display means for displaying;
For each area in the information display surface of the information display surface image displayed using the image data of the selected resolution, the area belongs to a predetermined display range defined in the display target range. Affiliation area determination means for determining whether or not to
For each area, an belonging time determining means for determining the time that the area belonged to the predetermined display range;
Information display surface image display record information generating means for generating information display surface image display record information, including information on the belonging time determined for each of the areas;
An information display surface image display record information transmitting means for transmitting the information display surface image display record information to the information display surface image display record information processing device;
The information display surface image display recording information processing apparatus is
An information display surface image display record information receiving means for receiving the information display surface image display record information from the information display surface image display device;
An information display surface for displaying a display corresponding to the affiliation time determined for each area in the information display surface of the information display surface image included in the information display surface image display record information in association with each area. An image display record information display means. A system comprising: The information display surface image display record information display means uses the visual effect corresponding to the total value of the belonging times determined by the belonging time determining means for the image data of all resolutions for each area. The system according to claim 1, wherein each area is displayed. The information display surface image display record information display means corresponds to a total value obtained by weighting the assigned times determined by the assigned time determining means for the image data of each resolution for each of the areas. The system according to claim 1, wherein each of the areas is displayed using a visual effect. The belonging area determination means is a necessary condition for determining that the area belongs to the predetermined display range, that the resolution of the image data used for displaying the information display surface image is equal to or higher than a predetermined threshold. The system according to claim 1, wherein a requirement for determining that the area belongs to the predetermined display range is that the resolution exceeds a predetermined threshold. The belonging area determining means determines that the ratio of the area included in the predetermined display range in the determination target area is equal to or greater than a predetermined threshold and that the area belongs to the predetermined display range. The system according to claim 1, wherein a condition for determining that the area belongs to the predetermined display range is that the ratio exceeds a predetermined threshold. . The display corresponding to the affiliation time determined for each area corresponds to the affiliation time representative value determined using the set of affiliation times determined for each area included in the article region including the area. The system according to claim 1, wherein the system is a display.   The system according to claim 1, wherein the predetermined display range matches the display target range.   The system according to claim 1, wherein the predetermined display range is defined by a predetermined closed region including a central portion of the display target range. The information display surface image display device includes:
In the display surface of the displayed information display surface image, further comprising an area designation event input means for receiving a predetermined event input designating an area,
The information display surface image display record information display means corresponds to a score determined using the belonging time determined for each area and the record information of the event input input by designating each area The system according to claim 1, wherein a display to be displayed is displayed in association with each of the areas. An electronic content distribution server that stores and distributes electronic content including image data representing an information display surface image, and is connected to the electronic content distribution server via a network to receive the electronic content and display the information display surface image An information display surface image display device and an information display surface connected to the information display surface image display device via a network for receiving and displaying display record information of the information display surface image in the information display surface image display device An information display surface image display recording information processing method executed in an information display surface image display system, including an image display recording information processing apparatus,
The electronic content distribution server is
The electronic content stored by the electronic content storage means as electronic content including two or more image data having different resolutions corresponding to one information display surface image is stored in the information display surface image display device by the electronic content distribution means. The stage to deliver to,
The information display surface image display device,
The electronic content receiving means receives the electronic content from the electronic content distribution server,
The information display surface image display condition input means accepts input of display conditions for the information display surface image,
By selecting and outputting image data having a resolution suitable for the display condition corresponding to the information display surface image to be displayed by the information display surface image display means, the information display surface image is included in whole or in part. Display over the displayed display range,
In the information display surface of the information display surface image displayed using the image data of the selected resolution by the belonging area determination means, a predetermined display defined within the display target range for each area Determine whether the area belongs to a range,
By the affiliation time determination means, for each of the areas, determine the time that the area belonged to the predetermined display range,
Information display surface image display record information generating means generates information display surface image display record information, including information on the belonging time determined for each area,
The information display surface image display record information transmitting means transmits the information display surface image display record information to the information display surface image display record information processing apparatus.
Each stage,
The information display surface image display recording information processing apparatus is
The information display surface image display record information receiving means receives the information display surface image display record information from the information display surface image display device,
By the information display surface image display record information display means, the display corresponding to the affiliation time determined for each area in the information display surface of the information display surface image, which is included in the information display surface image display record information, Display in association with the area,
A method characterized by comprising: Electronic content receiving means for receiving electronic content including image data representing an information display surface image from an electronic content distribution server;
Information display surface image display condition input means for receiving input of display conditions of the information display surface image;
Image data included in the electronic content, corresponding to the information display surface image to be displayed, and selecting image data having a resolution suitable for the display condition from two or more image data having different resolutions; Information display surface image display means for displaying the information display surface image over a display target range including the whole or a part thereof by outputting the image data thus obtained;
For each area in the information display surface of the information display surface image displayed using the image data of the selected resolution, the area belongs to a predetermined display range defined in the display target range. Affiliation area determination means for determining whether or not to
For each area, an belonging time determining means for determining the time that the area belonged to the predetermined display range;
Information display surface image display record information generating means for generating information display surface image display record information, including information on the belonging time determined for each of the areas;
An information display surface image display recording device, comprising: an information display surface image display recording information transmission unit configured to transmit the information display surface image display recording information to the information display surface image display recording information processing device. Computer
Electronic content receiving means for receiving electronic content including image data representing an information display surface image from an electronic content distribution server;
An information display surface image display condition input means for receiving input of display conditions of the information display surface image;
Image data included in the electronic content, corresponding to the information display surface image to be displayed, and selecting image data having a resolution suitable for the display condition from two or more image data having different resolutions; Information display surface image display means for displaying the information display surface image over a display target range including the whole or a part thereof by outputting the image data thus obtained,
For each area in the information display surface of the information display surface image displayed using the image data of the selected resolution, the area belongs to a predetermined display range defined in the display target range. Affiliation area determination means for determining whether to
For each area, an affiliation time determination means for determining the time that the area belonged to the predetermined display range;
An information display surface image display record information generating means for generating information display surface image display record information including information on the belonging time determined for each of the areas; and
A program for functioning as an information display surface image display record information transmitting means for transmitting the information display surface image display record information to an information display surface image display record information processing apparatus.