WO2012118135A1 - Book information providing system, digital book terminal, digital book information server, book information providing method and program for same - Google Patents

Book information providing system, digital book terminal, digital book information server, book information providing method and program for same Download PDF

Info

Publication number
WO2012118135A1
WO2012118135A1 PCT/JP2012/055157 JP2012055157W WO2012118135A1 WO 2012118135 A1 WO2012118135 A1 WO 2012118135A1 JP 2012055157 W JP2012055157 W JP 2012055157W WO 2012118135 A1 WO2012118135 A1 WO 2012118135A1
Authority
WO
WIPO (PCT)
Prior art keywords
book
electronic book
electronic
additional information
data
Prior art date
Application number
PCT/JP2012/055157
Other languages
French (fr)
Japanese (ja)
Inventor
尚司 谷内田
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Publication of WO2012118135A1 publication Critical patent/WO2012118135A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/38—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2213/00—Indexing scheme relating to interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F2213/0038—System on Chip

Definitions

  • the present invention relates to a book information providing system, an electronic book terminal, an electronic book information server, a book information providing method, and a program thereof, and more particularly, to a book information providing system that provides additional information using character data corresponding to image data.
  • Patent Document 1 describes an electronic book system in which only minimal data can be downloaded to a portable terminal and browsed.
  • Patent Document 2 describes a content search and presentation system that can acquire keywords as related information from the cover of a book and provide a wide range of search results to the user.
  • Patent Document 3 describes a book distribution system that can search for books such as bookstores by specifying keywords and search targets.
  • Patent Document 4 describes an image processing apparatus system capable of calculating a feature amount from an image of a human face and performing face recognition with high accuracy.
  • Patent Document 5 describes a search system in which an electronic document can be searched using a feature quantity such as a SIFT (Scale-Invariant Feature Transform) feature of an image to be searched.
  • SIFT Scale-Invariant Feature Transform
  • Patent Document 6 describes a meal log creation device that calculates the nutritional value of a meal from meal photo data.
  • Patent Document 7 describes an automatic authoring apparatus that creates hyperlinks between pages of an image-based electronic book.
  • the data format of the electronic book varies from company to company, and there is no unified standard.
  • the electronic book content provider needs to provide additional information using character data corresponding to each format.
  • an electronic book obtained by digitizing a book by an individual user naturally has a completely different file format and resolution for each user.
  • the digitized user must input character data as additional information. This is time-consuming, and particularly when character data of additional information is input to many pages of many books, the effort is enormous.
  • Patent Document 7 converts image data of an electronic book into character data by OCR. This is used for the purpose of creating a hyperlink between pages, and confirmation and correction after creation of character data. It does not reduce the troubles.
  • Patent Documents 1 to 6 are not originally intended to create and provide additional information of an electronic book, nor are they usable for that purpose.
  • An object of the present invention is to provide a book information providing system, an electronic book terminal, an electronic book that can reliably and effectively provide additional information based on character data for each data format and an electronic book digitized by a user.
  • a book information server a book information providing method, and a program thereof.
  • a book information providing system is a book information providing system in which a single or a plurality of electronic book terminals and a single or a plurality of electronic book information servers are connected to each other.
  • a terminal calculates a feature amount from image data obtained by digitizing a book, a feature amount transmission unit that transmits the calculated feature amount to an electronic book information server, and an electronic device corresponding to the transmitted feature amount
  • An electronic book storage unit that receives book additional information from the electronic book information server and stores it in correspondence with image data in a nonvolatile storage means provided in advance, and the electronic book information server includes a feature amount and a book identifier.
  • External storage means for storing book feature amount data and book additional information data for associating book identifiers with electronic book additional information
  • an electronic book terminal A book feature quantity search unit for searching for a book identifier corresponding to the received feature quantity from the book feature quantity data, and a book addition for searching the electronic book additional information corresponding to the book identifier from the book additional information data and returning it to the electronic book terminal
  • an information search unit wherein the feature amount calculation unit of the electronic book terminal calculates a feature amount from an image having two or more continuous pages in the image data.
  • an electronic book terminal is an electronic book terminal that is connected to an electronic book information server to constitute a book information providing system, and is characterized by image data obtained by digitizing a book.
  • a feature amount calculating unit for calculating the feature amount, a feature amount transmitting unit for transmitting the calculated feature amount to the electronic book information server, and receiving electronic book additional information corresponding to the transmitted feature amount from the electronic book information server.
  • an electronic book storage unit that stores the image data in correspondence with image data in a nonvolatile storage unit provided in advance, and the feature amount calculation unit calculates a feature amount from an image that is continuous for two or more pages in the image data. It is characterized by.
  • an electronic book information server is an electronic book information server that is connected to an electronic book terminal to constitute a book information providing system, and associates feature quantities with book identifiers.
  • the book feature amount data and the external storage means for storing the book additional information data for associating the book identifier with the electronic book additional information, and the book identifier corresponding to the feature amount received from the electronic book terminal are searched from the book feature amount data.
  • a book feature quantity search unit, and a book additional information search unit that searches for electronic book additional information corresponding to the book identifier from the book additional information data and sends it back to the electronic book terminal.
  • a book information providing method is a book information providing system in which a single or a plurality of electronic book terminals and a single or a plurality of electronic book information servers are connected to each other.
  • the feature amount calculation unit of the electronic book terminal calculates the feature amount from the image that is continuous for two or more pages in the digitized image data, and the feature amount transmission unit of the electronic book terminal sends the calculated feature amount to the electronic book information server.
  • the book feature quantity search unit of the electronic book information server searches the book identifier corresponding to the feature quantity transmitted and received from the electronic book terminal from the book feature quantity data stored in advance, and adds the electronic book corresponding to the book identifier.
  • the book additional information search unit of the electronic book information server searches the book additional information data in which information is stored in advance, and the searched book additional information data is stored in the electronic book information server.
  • the register additional information search unit returns to the electronic book terminal, and the received book additional information data is associated with the image data and stored in the nonvolatile storage means provided in advance in the electronic book storage unit of the electronic book terminal. To do.
  • a book information providing program is a book information providing system in which one or more electronic book terminals and one or more electronic book information servers are connected to each other.
  • the information data is associated with the image data, and a procedure for storing the information data in a nonvolatile storage unit provided in advance is executed.
  • another book information providing program is a book information providing system in which one or more electronic book terminals and one or more electronic book information servers are connected to each other.
  • a procedure for searching for book identifiers corresponding to the feature quantities received from the electronic book terminal from the book feature quantity data stored in advance, and electronic book additional information corresponding to the book identifiers are stored in advance.
  • a procedure for searching from the book additional information data that has been searched and a procedure for returning the searched book additional information data to the electronic book terminal is a book information providing system in which one or more electronic book terminals and one or more electronic book information servers are connected to each other.
  • the present invention is configured to distribute the electronic book additional information corresponding to the feature amount calculated from the image data obtained by digitizing the book using two or more continuous pages. Even if the data formats are different, common additional information can be provided. As a result, a book information providing system having excellent characteristics that electronic data can be reliably and effectively provided for each data format and electronic books digitized by individual users.
  • a book terminal, an electronic book information server, a book information providing method, and a program thereof can be provided.
  • FIG. 5A is an explanatory diagram showing the stored contents of the book feature data shown in FIG.
  • FIG. 5B is an explanatory diagram showing the storage contents of the book additional information data shown in FIG.
  • FIG. 9A is an explanatory diagram showing the stored contents of the book feature data shown in FIG.
  • FIG. 9B is an explanatory diagram showing the storage contents of the book additional information data shown in FIG.
  • FIG. 9A is an explanatory diagram showing the stored contents of the book feature data shown in FIG.
  • FIG. 9B is an explanatory diagram showing the storage contents of the book additional information data shown in FIG.
  • FIG. 9A is an explanatory diagram showing the stored contents of the book feature data shown in FIG.
  • FIG. 9B is an explanatory diagram showing the storage contents of the book additional information data shown in FIG.
  • the book information providing system 1 is a book information providing system in which one or more electronic book terminals 10 and one or more electronic book information servers 30 are connected to each other.
  • the electronic book terminal 10 includes a feature amount calculation unit 101 that calculates a feature amount from image data obtained by digitizing a book, a feature amount transmission unit 102 that transmits the calculated feature amount to an electronic book information server, and the transmitted feature.
  • An electronic book storage unit 103 that receives electronic book additional information corresponding to the amount from the electronic book information server and stores the electronic book additional information in association with image data in a nonvolatile storage unit provided in advance.
  • the electronic book information server 30 includes an external storage unit 34 that stores in advance book feature amount data 211 that associates feature amounts with book identifiers, and book additional information data 212 that associates book identifiers with electronic book additional information, and electronic books.
  • a book feature value search unit 201 for searching for a book identifier corresponding to the feature value received from the terminal from the book feature value data, and an electronic book additional information corresponding to the book identifier is searched from the book additional information data and returned to the electronic book terminal.
  • a book additional information search unit 202 for searching for a book identifier corresponding to the feature value received from the terminal from the book feature value data, and an electronic book additional information corresponding to the book identifier is searched from the book additional information data and returned to the electronic book terminal.
  • the feature quantity calculation unit 101 of the electronic book terminal uses any one or more of the image format of the image data, the arrangement of the center of gravity of the connected component of the image data, and the feature vector based on the local descriptor of the image data as the feature quantity.
  • Calculate as The feature vector based on the local descriptor mentioned here includes SURF feature, SIFT feature, GLOH feature, and the like.
  • the book information providing system 1 can reliably and effectively provide additional information based on character data for each data format and an electronic book digitized by the individual user. Hereinafter, this will be described in more detail.
  • FIG. 1 is an explanatory diagram showing a configuration of a book information providing system 1 according to the first embodiment of the present invention.
  • the book information providing system 1 is configured by connecting an electronic book terminal 10 to which an image input device 20 is connected and an electronic book information server 30 to each other via a network 40.
  • the electronic book terminal 10 may be a personal computer or a portable terminal specialized for browsing electronic books such as iPad.
  • FIG. 1 shows one electronic book terminal 10 and one electronic book information server 30, but the number of electronic book terminals 10 and electronic book information servers 30 is not particularly limited. However, it may be multiple.
  • FIG. 2 is an explanatory diagram showing the configuration of the electronic book terminal 10 shown in FIG. 1 in more detail.
  • the electronic book terminal 10 has a configuration as a general computer. That is, the electronic book terminal 10 temporarily stores main processing control means (CPU: Central Processing Unit) 11 that is a main body that executes various processes described as a computer program, and data being processed by the main processing control means 11.
  • Main processing control means CPU: Central Processing Unit
  • RAM Random Access Memory
  • the internal bus 14 of the electronic book terminal 10 further has an image interface 15 connected to the image input device 20 to receive input of the image data 21a, a nonvolatile storage means 16 for storing processed data, and a large amount of data. And an input / output means 18 for accepting user operations and presenting the results of the operations to the user as a screen.
  • the image input device 20 may be an image scanner or an electronic camera.
  • the connection method of the communication means 13 and the image interface 15 is not particularly limited, and may be wired connection or wireless connection.
  • the image data input by the image input device 20 is stored in the nonvolatile storage means 16 when the processing is completed.
  • the external storage means 17 is a movable nonvolatile storage device such as a hard disk drive or a flash memory or an SD card. However, if the capacity of the nonvolatile storage means 16 is not insufficient, the external storage means 17 is not necessarily used. There is no need to prepare.
  • the main calculation control means 11 of the electronic book terminal 10 is configured such that each of the feature amount calculation unit 101, the feature amount transmission unit 102, the electronic book storage unit 103, and the electronic book display unit 104 is operated by an electronic book creation program. It operates as a functional part. The operation contents of each of these functional units will be described later.
  • FIG. 3 is an explanatory diagram showing the configuration of the electronic book information server 30 shown in FIG. 1 in more detail.
  • the electronic book information server 30 also has a configuration as a general computer. That is, the electronic book information server 30 includes a main operation control unit 31 that is a main body that executes various processes described as a computer program, and a temporary storage unit 32 that temporarily stores data being processed by the main operation control unit 31.
  • the communication unit 33 is connected to the network 40 and performs data communication with other computers, and the external storage unit 34 that stores a large amount of data is connected to the internal bus 35.
  • the main calculation control means 31 of the electronic book information server 30 operates as a functional unit of the book feature amount search unit 201 and the book additional information search unit 202 by the operation of the electronic book information providing program.
  • the external storage means 34 stores book feature amount data 211 and book additional information data 212 in advance. The operation contents of each functional unit and the storage contents of each data will be described later.
  • FIG. 4 is an explanatory diagram showing a data configuration of the electronic book 21 stored in the nonvolatile storage means 16 or the external storage means 17 of the electronic book terminal 10 shown in FIG.
  • the electronic book 21 includes image data 21a and electronic book additional information 21b.
  • the image data 21a may be input via the image input device 20, or may be downloaded from another computer via the network 40.
  • the electronic book additional information 21b is information data acquired from the electronic book information server 30 corresponding to the image data 21a. For example, the title, author name, publication date, publisher name, search keyword, and the like of the book. Each character string data is included.
  • the feature amount calculation unit 101 calculates a feature amount from data of two or more consecutive pages in the image data 21a input from the image input device 20.
  • the feature amount transmitting unit 102 transmits the feature amount calculated from the data of the image that is continuous for two or more pages to the electronic book information server 30.
  • the feature amount here is, for example, the total number of pages of the image, the page number, the number of colors, the resolution (dpi), the rough classification based on the image format, the feature vector based on the local descriptor, or the connection of binarized image data.
  • a known feature amount such as the center of gravity calculated by extracting the components is included.
  • a known vector such as a SURF (Speeded Up Up Robust Features) feature, a SIFT (Scale-Invariant Feature Transform) feature, a GLOH (Gradiant Location And Orientation Histogram) feature or the like is used as the feature vector based on the local descriptor. be able to.
  • FIG. 5A is an explanatory diagram showing the stored contents of the book feature data 211 shown in FIG.
  • the book feature amount data 211 is data stored by associating a representative image feature amount 211a of various books with a book ID 211b that uniquely indicates the corresponding book.
  • the book ID 211b may be any number that can uniquely identify the book, such as ISBN (International Standard Book Number) or JAN (Japan Article Number) code.
  • FIG. 5B is an explanatory diagram showing the storage contents of the book additional information data 212 shown in FIG.
  • the book additional information data 212 is data stored by associating the same book ID 211b as the book feature data 211 and the corresponding book additional information 212a.
  • the book additional information 212a includes character string data such as the title, author name, publication date, publisher name, search keyword, and the like of the book.
  • the book feature quantity search unit 201 searches the feature quantity 211a of the book feature quantity data 211 for a match with the feature quantity received from the electronic book terminal 10, and this The book ID 211b corresponding to is output.
  • the book additional information search unit 202 returns the book additional information 212 a corresponding to the book ID 211 b output from the book feature amount search unit 201 to the electronic book terminal 10.
  • the electronic book storage unit 103 stores the book additional information 212a returned from the electronic book information server 30 in a nonvolatile manner as electronic book additional information 21b related to the image data 21a. Save to means 16.
  • the electronic book 21 is a combination of the image data 21 a and the electronic book additional information 21 b corresponding thereto.
  • the electronic book display unit 104 displays the electronic book 21 on the input / output unit 18 in accordance with a user operation through the input / output unit 18. In addition, when the user inputs an instruction to perform a search, the electronic book display unit 104 searches the contents of the electronic book additional information 21b in accordance with this and displays the result on the input / output means 18 on the screen.
  • FIG. 6 is a sequence diagram showing operations of the electronic book terminal 10 and the electronic book information server 30 in the book information providing system 1 shown in FIG.
  • the image data 21a from the image input device 20 is input to the feature amount calculation unit 101 via the image interface 15 (step S301).
  • the feature amount calculation unit 101 calculates a feature amount from data of images that are continuous for two or more pages (step S302).
  • the feature-value transmission part 102 transmits the calculated feature-value to the electronic book information server 30 (step S303).
  • the book feature quantity search unit 201 searches the feature quantity 211 a of the book feature quantity data 211 for a match with the feature quantity received from the electronic book terminal 10, The book ID 211b corresponding to this is output (step S304). Further, the book additional information search unit 202 searches for the book additional information 212a corresponding to the book ID 211b output from the book feature amount search unit 201, and returns this to the electronic book terminal 10 (step S305).
  • the electronic book storage unit 103 stores the book additional information 212a returned from the electronic book information server 30 in the nonvolatile storage unit 16 as the electronic book additional information 21b related to the image data 21a. (Step S306).
  • the electronic book 21 in which the image data 21 a and the electronic book additional information 21 b corresponding to the image data 21 a are combined is stored in the nonvolatile storage unit 16 of the electronic book terminal 10.
  • the electronic book display unit 104 searches the electronic book additional information 21b and displays the image data 21a with respect to the electronic book 21 stored in the nonvolatile storage unit 16 (step S307).
  • the book information providing method is a book information providing system 1 in which a single or a plurality of electronic book terminals 10 and a single or a plurality of electronic book information servers 30 are connected to each other.
  • a feature value calculation unit of the electronic book terminal calculates a feature value from an image of two or more pages in the image data (FIG. 6, steps S301 to S302), and the calculated feature value is a feature value transmission unit of the electronic book terminal. Is sent to the electronic book information server (FIG.
  • step S303 and the book identifier corresponding to the feature quantity received from the electronic book terminal is searched for the book feature quantity of the electronic book information server from the book feature quantity data stored in advance.
  • the book is retrieved by the department (FIG. 6, step S304), and the electronic book additional information corresponding to the book identifier is pre-stored from the book additional information data stored in the electronic book information server.
  • the additional information search unit searches, and the added book information search unit of the electronic book information server returns the searched book additional information data to the electronic book terminal (step S305 in FIG. 6), and the received book additional information data is image data.
  • the electronic book storage unit of the electronic book terminal is stored in the nonvolatile storage means provided in advance (step S306 in FIG. 6).
  • each said operation step this may be programmed so that execution is possible with a computer, and you may make it perform these with the electronic book terminal 10 and the electronic book information server 30 which are the computer which directly performs each said step.
  • the program may be recorded on a non-temporary recording medium, such as a DVD, a CD, or a flash memory. In this case, the program is read from the recording medium by a computer and executed.
  • an image continuous for two or more pages is usually the most characteristic image in the book. Therefore, by calculating the feature amount using “images that are continuous for two or more pages” and using the feature amount for the search, the book feature amount search unit 201 searches for the wrong book ID 211b, thereby adding the book additional information. It is possible to reduce the possibility that the search unit 202 returns the wrong book additional information 212a.
  • the data capacity can be reduced to 1/100 or less compared to the case of transmitting the image data 21a itself,
  • the common book additional information 212a can be obtained regardless of the format of the image format.
  • the publisher of the book is common to the image data 21a from any electronic book distribution service or to the image data 21a that is digitized by the user (the file format and resolution vary for each user).
  • the book additional information 212a can be provided. This is advantageous not only in reducing the user's trouble of inputting additional information but also in providing a wide range of appropriate additional information for publishers.
  • the book additional information search unit 501 of the electronic book information server 430 includes: It is determined whether the book identifier indicates the entire book or only a part of the book. If the book identifier indicates only a part of the book, the book additional information data corresponding to only a part of the book is stored in the electronic book terminal. It has a function to reply to.
  • the book information providing system 401 can be configured so that even if the image data 21a is an electronic version of the entire book or an electronic version of only some chapters of the book. The same effect as that of the embodiment can be obtained. Hereinafter, this will be described in more detail.
  • FIG. 7 is an explanatory diagram showing a configuration of a book information providing system 401 according to the second embodiment of the present invention.
  • the book information providing system 401 includes an electronic book terminal 10 that is the same as that of the first embodiment to which the image input device 20 is connected, and an electronic book information server 430 that is different from the first embodiment. Are connected to each other via the same network 40.
  • FIG. 8 is an explanatory diagram showing the configuration of the electronic book information server 430 shown in FIG. 7 in more detail.
  • the electronic book information server 430 is exactly the same in hardware as the electronic book information server 30 according to the first embodiment. Therefore, the same element is referred to by the same name and reference number.
  • the electronic book information server 430 includes a book feature quantity search unit 201 and a book additional information search unit 202 that are operated by the main calculation control unit 31, respectively.
  • the book feature quantity search unit 501 and the book additional information search unit 502 are replaced.
  • the book feature quantity data 211 and the book additional information data 212 stored in advance in the external storage unit 34 are also replaced with different book feature quantity data 511 and book additional information data 512, respectively.
  • the capturing of the image data 21a performed by the electronic book terminal 10 may be a single file for all pages of one book or a single file for each chapter.
  • the feature amount calculation unit 101 calculates a feature amount for each chapter.
  • FIG. 9A is an explanatory diagram showing the stored contents of the book feature data 511 shown in FIG.
  • the book feature quantity data 511 is stored in association with a chapter number 511a indicating the chapter of the book.
  • the book feature amount data 511 there is one that stores a feature amount for each chapter of one book as the image feature amount 211 a. In that case, the book and chapter are uniquely indicated by the book ID 211b and the chapter number 511a.
  • FIG. 9B is an explanatory diagram showing the storage contents of the book additional information data 512 shown in FIG.
  • the book additional information data 512 in addition to the book ID 211b and the book additional information 212a shown in FIGS. 5A and 5B, a chapter number 511a and page number information 512a are stored in association with each other.
  • the page number information 512a indicates the number of pages of the entire book and the number of pages of the chapter.
  • the page number information 512a is the start page that is the page number where the chapter starts in the entire book. A number or the like can be included as appropriate.
  • the feature amount extracted from the image data 21a includes information on the total page number and page number. Therefore, by comparing this with the page number information 512a, it can be determined whether the image data 21a includes all pages of the book or only a specific chapter.
  • FIG. 10 is a sequence diagram showing operations of the electronic book terminal 10 and the electronic book information server 430 in the book information providing system 401 shown in FIG.
  • the sequence diagram shown in FIG. 10 includes many operations that are the same as those of the first embodiment shown in FIG. 6, and therefore the same operations are denoted by the same reference numerals as those in FIG.
  • the book feature quantity search unit 501 searches the feature quantity 211a of the book feature quantity data 211 for a match with the feature quantity received from the electronic book terminal 10, but is the same as step S304 in FIG. Subsequently, it is determined whether the search result is for the entire book or only for a specific chapter (step S601).
  • step S601 If the search result is for the entire book (Yes in step S601), the book additional information 212a of the entire book is returned to the electronic book terminal 10 as in FIG. 6 (step S305). If the search result is only for a specific chapter (No in step S601), the book additional information 212a and the page number information 512a of only that chapter are returned to the electronic book terminal 10 (step S602).
  • the electronic book storage unit 103 stores the received information as data of the electronic book 21 corresponding to the image data 21a (step S306).
  • the electronic book storage unit 103 also stores this as data of the electronic book 21 corresponding to the image data 21a.
  • the image data 21a is for the entire book or only for a specific chapter, and the book additional information 212a (and The page number information 512a) is returned.
  • the book information providing system 401 is the same as that of the first embodiment even if the image data 21a is an electronic version of the entire book, or an electronic version of only a part of the chapter of the book. Similarly, appropriate additional information can be provided to each user.
  • the portable terminal for browsing electronic books has a smaller storage capacity than a desktop terminal. For this reason, only the chapter which a user wants to read may be digitized and transferred to a portable terminal.
  • the second embodiment is also useful in such a case.
  • a book information providing system in which one or more electronic book terminals and one or more electronic book information servers are connected to each other,
  • the electronic book terminal is A feature amount calculation unit that calculates a feature amount from image data obtained by digitizing a book;
  • a feature amount transmitting unit that transmits the calculated feature amount to the electronic book information server;
  • An electronic book storage unit that receives electronic book additional information corresponding to the transmitted feature quantity from the electronic book information server and stores the electronic book additional information in correspondence with the image data in a nonvolatile storage unit provided in advance.
  • the electronic book information server is External storage means for storing in advance book feature amount data associating the feature amount with a book identifier and book additional information data associating the book identifier with electronic book additional information;
  • a book feature value search unit that searches the book feature value data for a book identifier corresponding to the feature value received from the electronic book terminal;
  • a book additional information search unit for searching the electronic book additional information corresponding to the book identifier from the book additional information data and returning it to the electronic book terminal;
  • the book information providing system wherein the feature amount calculation unit of the electronic book terminal calculates the feature amount from an image having two or more continuous pages in the image data.
  • the feature quantity calculation unit of the electronic book terminal is any one of an image format of the image data, an arrangement of barycentric points of connected components of the image data, and a feature vector based on a local descriptor of the image data.
  • the said additional information search part of the said electronic book information server discriminate
  • the feature amount calculation unit calculates the feature amount from an image having two or more continuous pages in the image data.
  • An electronic book information server which is mutually connected with an electronic book terminal, and comprises a book information provision system, External storage means for storing in advance book feature amount data associating the feature amount with a book identifier and book additional information data associating the book identifier with electronic book additional information;
  • a book feature value search unit that searches the book feature value data for a book identifier corresponding to the feature value received from the electronic book terminal;
  • An electronic book information server comprising: a book additional information retrieval unit that retrieves the electronic book additional information corresponding to the book identifier from the book additional information data and sends it back to the electronic book terminal.
  • the feature value calculation unit of the electronic book terminal calculates a feature value from an image that is continuous for two or more pages in image data obtained by digitizing a book
  • the feature amount transmission unit of the electronic book terminal transmits the calculated feature amount to the electronic book information server
  • the book feature value search unit of the electronic book information server searches for the book identifier corresponding to the feature value received from the electronic book terminal from the book feature value data stored in advance.
  • the book additional information search part of the electronic book information server searches the electronic book additional information corresponding to the book identifier from book additional information data stored in advance
  • the book additional information search unit of the electronic book information server returns the searched book additional information data to the electronic book terminal
  • a book information providing method wherein the received book additional information data is associated with the image data and stored in a non-volatile storage means provided in advance in an electronic book storage unit of the electronic book terminal.

Abstract

[Problem] To provide a book information provision system, and the like, which enable reliable and effective provision of additional information in the form of text data to digital books of different data formats. [Solution] A digital book terminal (10) equipped with: a characteristic quantity calculation unit (101) that calculates a characteristic quantity from a continuous image of two or more pages within image data of a digitalized book; a characteristic quantity transmission unit (102) that transmits the calculated characteristic quantity to a digital book information server; and a digital book storage unit (103) that receives additional digital book information from the digital book information server. The digital book information server (30) is equipped with: an external storage means (34) that pre-stores book characteristic quantity data (211) and additional book information data (212); a book characteristic quantity search unit (201) that searches for the book identifier corresponding to the received characteristic quantity from the book characteristic quantity data; and an additional book information search unit (202) that searches for the additional digital book information corresponding to the book identifier from the additional book information data, and sends a response to the digital book terminal.

Description

書籍情報提供システム、電子書籍端末、電子書籍情報サーバ、書籍情報提供方法およびそのプログラムBook information providing system, electronic book terminal, electronic book information server, book information providing method and program thereof
　本発明は、書籍情報提供システム、電子書籍端末、電子書籍情報サーバ、書籍情報提供方法およびそのプログラムに関し、特に画像データに対応して文字データによる付加情報を提供する書籍情報提供システム等に関する。 The present invention relates to a book information providing system, an electronic book terminal, an electronic book information server, a book information providing method, and a program thereof, and more particularly, to a book information providing system that provides additional information using character data corresponding to image data.
　パーソナルコンピュータや携帯電話端末などの個人向け可搬式電子機器が普及するに伴い、これらの電子機器の表示画面上で閲覧することのできる電子書籍（電子ブック）に対する需要が出てきている。また、米国アップル・インコーポレーティッド社のｉＰａｄ（登録商標）、米国アマゾン・ドットコム社のキンドル（登録商標）、シャープ（株）のガラパゴス（登録商標）などのような電子書籍閲覧用の端末も各社から発売されている。 With the spread of personal portable electronic devices such as personal computers and mobile phone terminals, there is a growing demand for electronic books (electronic books) that can be viewed on the display screen of these electronic devices. There are also terminals for reading e-books such as iPad (registered trademark) of Apple Inc. in the US, Kindle (registered trademark) of Amazon.com in the US, Galapagos (registered trademark) of Sharp Corporation. Released by each company.
　これに伴い、各端末に対応する電子書籍コンテンツをインターネットを介して配信するサービスが出現し、また紙の上に印刷された書籍をスキャナなどによってユーザ個人で電子化して電子書籍として閲覧可能にする（俗に「自炊」と呼ばれる）行為も多く行われるようになっている。 Along with this, a service for distributing electronic book contents corresponding to each terminal via the Internet has appeared, and books printed on paper are digitized by a user by a scanner or the like so that they can be browsed as electronic books. Many acts (commonly called “self-catering”) are also being carried out.
　しかしながら、紙の書籍を電子化する際、紙面は画像データとして取り込まれ、ページごとに番号が振られるが、当該書籍の題名、著者名などのような付加情報については画像データとは別個に文字データとして付加していく必要がある。電子書籍の特徴として、その内容を検索可能であることが挙げられるが、この検索による利便性を得るためには、そのための文字データである付加情報がどうしても必要である。 However, when a paper book is digitized, the paper surface is captured as image data and numbered for each page. However, additional information such as the title and author name of the book is written separately from the image data. It is necessary to add it as data. A feature of electronic books is that their contents can be searched, but in order to obtain the convenience of this search, additional information that is character data for that purpose is absolutely necessary.
　これに関連する技術として、次の各々の特許文献がある。その中でも特許文献１には、最小限のデータのみを携帯用端末にダウンロードして閲覧可能であるという電子ブックシステムについて記載されている。特許文献２には、書籍の表紙から関連情報としてキーワードを取得して広範囲な検索結果をユーザに提供できるというコンテンツ検索提示システムについて記載されている。特許文献３には、キーワードと検索対象とを指定して書店などの書籍を検索できるという書籍配布方式システムについて記載されている。 There are following patent documents as related technologies. Among them, Patent Document 1 describes an electronic book system in which only minimal data can be downloaded to a portable terminal and browsed. Patent Document 2 describes a content search and presentation system that can acquire keywords as related information from the cover of a book and provide a wide range of search results to the user. Patent Document 3 describes a book distribution system that can search for books such as bookstores by specifying keywords and search targets.
　特許文献４には、人間の顔の画像から特徴量を算出して高精度に顔認識を行うことが可能であるという画像処理装置システムについて記載されている。特許文献５には、検索対象の画像のＳＩＦＴ（Scale-Invariant Feature Transform）特徴などの特徴量を利用して電子ドキュメントを検索可能であるという検索システムについて記載されている。 Patent Document 4 describes an image processing apparatus system capable of calculating a feature amount from an image of a human face and performing face recognition with high accuracy. Patent Document 5 describes a search system in which an electronic document can be searched using a feature quantity such as a SIFT (Scale-Invariant Feature Transform) feature of an image to be searched.
　特許文献６には、食事の写真データからその食事の栄養価を計算するという食事ログ作成装置について記載されている。特許文献７には、画像ベースの電子書籍のページ間のハイパーリンクを作成するという自動オーサリング装置について記載されている。 Patent Document 6 describes a meal log creation device that calculates the nutritional value of a meal from meal photo data. Patent Document 7 describes an automatic authoring apparatus that creates hyperlinks between pages of an image-based electronic book.
特開２００３－１５０５９７号公報JP 2003-150597 A 特開２００３－１５０６１８号公報JP 2003-150618 A 特開２００３－２３３６１５号公報JP 2003-233615 A 特開２００８－２３３９５９号公報JP 2008-233959 A 特開２０１０－０４００３２号公報JP 2010-04-0032 A 特開２０１０－２８６９６０号公報JP 2010-286960 A 特許第３６０８９６５号公報Japanese Patent No. 3608965
　各社から発売されている電子書籍閲覧用の端末では、電子書籍のデータ形式は各社ごとに異なり、統一規格が無いのが実情である。そのような各々のデータ形式に対して、電子書籍コンテンツ提供者は、各形式に対応した文字データによる付加情報を提供する必要がある。 In the terminal for browsing electronic books released by each company, the data format of the electronic book varies from company to company, and there is no unified standard. For each such data format, the electronic book content provider needs to provide additional information using character data corresponding to each format.
　また、ユーザ個人で書籍を電子化した電子書籍は、当然ながらファイル形式や解像度などが各々のユーザごとに全く異なるものとなる。この場合には、電子化を行ったユーザが付加情報として文字データを入力せねばならないこととなる。これは手間のかかることであり、特に多くの書籍の多くのページに対して付加情報の文字データ入力を行う場合には、その手間は膨大なものとなる。 Also, an electronic book obtained by digitizing a book by an individual user naturally has a completely different file format and resolution for each user. In this case, the digitized user must input character data as additional information. This is time-consuming, and particularly when character data of additional information is input to many pages of many books, the effort is enormous.
　ＯＣＲ（Optical Character Recognition、光学文字認識）を利用して画像データを文字データに変換する技術もあるが、これだと誤認識の発生によって誤った文字データが作成される可能性があり、該文字データの作成後に人間が目視による確認と手入力による修正を行う必要がある。従って、これでは文字データを入力する手間を軽減することにはならない。 There is also a technology that converts image data into character data using OCR (Optical Character Recognition), but this may cause erroneous character data to be created due to the occurrence of erroneous recognition. It is necessary for humans to perform visual confirmation and manual correction after data creation. Therefore, this does not reduce the trouble of inputting character data.
　この問題を解決し、画像データに文字データによる付加情報を容易に提供しうる技術は、前述の特許文献１～７には記載されていない。特許文献７の技術は、電子書籍の画像データをＯＣＲによって文字データに変換しているが、これはページ間のハイパーリンクを作成する目的に利用されており、文字データの作成後の確認および修正の手間を軽減するものではない。その他の特許文献１～６は、そもそも電子書籍の付加情報の作成および提供を目的としたものではなく、またその目的に利用できるものでもない。 The technology that can solve this problem and can easily provide additional information based on character data to image data is not described in the above-mentioned Patent Documents 1 to 7. The technology of Patent Document 7 converts image data of an electronic book into character data by OCR. This is used for the purpose of creating a hyperlink between pages, and confirmation and correction after creation of character data. It does not reduce the troubles. Other Patent Documents 1 to 6 are not originally intended to create and provide additional information of an electronic book, nor are they usable for that purpose.
　本発明の目的は、各々のデータ形式およびユーザ個人で電子化した電子書籍に対して、文字データによる付加情報を確実かつ有効に提供することを可能とする書籍情報提供システム、電子書籍端末、電子書籍情報サーバ、書籍情報提供方法およびそのプログラムを提供することにある。 An object of the present invention is to provide a book information providing system, an electronic book terminal, an electronic book that can reliably and effectively provide additional information based on character data for each data format and an electronic book digitized by a user. To provide a book information server, a book information providing method, and a program thereof.
　上記目的を達成するため、本発明に係る書籍情報提供システムは、単数もしくは複数の電子書籍端末と単数もしくは複数の電子書籍情報サーバとが相互に接続された書籍情報提供システムであって、電子書籍端末が、書籍を電子化した画像データから特徴量を算出する特徴量算出部と、算出された特徴量を電子書籍情報サーバに送信する特徴量送信部と、送信された特徴量に対応する電子書籍付加情報を電子書籍情報サーバから受信してこれを画像データと対応させて予め備えられた不揮発性記憶手段に記憶する電子書籍保存部とを備え、電子書籍情報サーバが、特徴量と書籍識別子とを対応づける書籍特徴量データおよび書籍識別子と電子書籍付加情報とを対応づける書籍付加情報データを予め記憶した外部記憶手段と、電子書籍端末から受信した特徴量に対応する書籍識別子を書籍特徴量データから検索する書籍特徴量検索部と、書籍識別子に対応する電子書籍付加情報を書籍付加情報データから検索して電子書籍端末に返信する書籍付加情報検索部とを備えると共に、電子書籍端末の特徴量算出部が画像データの中で２ページ以上連続した画像から特徴量を算出することを特徴とする。 To achieve the above object, a book information providing system according to the present invention is a book information providing system in which a single or a plurality of electronic book terminals and a single or a plurality of electronic book information servers are connected to each other. A terminal calculates a feature amount from image data obtained by digitizing a book, a feature amount transmission unit that transmits the calculated feature amount to an electronic book information server, and an electronic device corresponding to the transmitted feature amount An electronic book storage unit that receives book additional information from the electronic book information server and stores it in correspondence with image data in a nonvolatile storage means provided in advance, and the electronic book information server includes a feature amount and a book identifier. External storage means for storing book feature amount data and book additional information data for associating book identifiers with electronic book additional information, and an electronic book terminal A book feature quantity search unit for searching for a book identifier corresponding to the received feature quantity from the book feature quantity data, and a book addition for searching the electronic book additional information corresponding to the book identifier from the book additional information data and returning it to the electronic book terminal And an information search unit, wherein the feature amount calculation unit of the electronic book terminal calculates a feature amount from an image having two or more continuous pages in the image data.
　上記目的を達成するため、本発明に係る電子書籍端末は、電子書籍情報サーバと相互に接続されて書籍情報提供システムを構成する電子書籍端末であって、書籍を電子化した画像データから特徴量を算出する特徴量算出部と、算出された特徴量を電子書籍情報サーバに送信する特徴量送信部と、送信された特徴量に対応する電子書籍付加情報を電子書籍情報サーバから受信してこれを画像データと対応させて予め備えられた不揮発性記憶手段に記憶する電子書籍保存部とを備えると共に、特徴量算出部が画像データの中で２ページ以上連続した画像から特徴量を算出することを特徴とする。 In order to achieve the above object, an electronic book terminal according to the present invention is an electronic book terminal that is connected to an electronic book information server to constitute a book information providing system, and is characterized by image data obtained by digitizing a book. A feature amount calculating unit for calculating the feature amount, a feature amount transmitting unit for transmitting the calculated feature amount to the electronic book information server, and receiving electronic book additional information corresponding to the transmitted feature amount from the electronic book information server. And an electronic book storage unit that stores the image data in correspondence with image data in a nonvolatile storage unit provided in advance, and the feature amount calculation unit calculates a feature amount from an image that is continuous for two or more pages in the image data. It is characterized by.
　上記目的を達成するため、本発明に係る電子書籍情報サーバは、電子書籍端末と相互に接続されて書籍情報提供システムを構成する電子書籍情報サーバであって、特徴量と書籍識別子とを対応づける書籍特徴量データおよび書籍識別子と電子書籍付加情報とを対応づける書籍付加情報データを予め記憶した外部記憶手段と、電子書籍端末から受信した特徴量に対応する書籍識別子を書籍特徴量データから検索する書籍特徴量検索部と、書籍識別子に対応する電子書籍付加情報を書籍付加情報データから検索して電子書籍端末に返信する書籍付加情報検索部とを備えることを特徴とする。 In order to achieve the above object, an electronic book information server according to the present invention is an electronic book information server that is connected to an electronic book terminal to constitute a book information providing system, and associates feature quantities with book identifiers. The book feature amount data and the external storage means for storing the book additional information data for associating the book identifier with the electronic book additional information, and the book identifier corresponding to the feature amount received from the electronic book terminal are searched from the book feature amount data. A book feature quantity search unit, and a book additional information search unit that searches for electronic book additional information corresponding to the book identifier from the book additional information data and sends it back to the electronic book terminal.
　上記目的を達成するため、本発明に係る書籍情報提供方法は、単数もしくは複数の電子書籍端末と単数もしくは複数の電子書籍情報サーバとが相互に接続された書籍情報提供システムにあって、書籍を電子化した画像データの中で２ページ以上連続した画像から特徴量を電子書籍端末の特徴量算出部が算出し、算出された特徴量を電子書籍端末の特徴量送信部が電子書籍情報サーバに送信し、電子書籍端末から受信した特徴量に対応する書籍識別子を予め記憶された書籍特徴量データの中から電子書籍情報サーバの書籍特徴量検索部が検索し、書籍識別子に対応する電子書籍付加情報を予め記憶された書籍付加情報データの中から電子書籍情報サーバの書籍付加情報検索部が検索し、検索された書籍付加情報データを電子書籍情報サーバの書籍付加情報検索部が電子書籍端末に返信し、受信した書籍付加情報データを画像データと対応させて電子書籍端末の電子書籍保存部が予め備えられた不揮発性記憶手段に記憶することを特徴とする。 To achieve the above object, a book information providing method according to the present invention is a book information providing system in which a single or a plurality of electronic book terminals and a single or a plurality of electronic book information servers are connected to each other. The feature amount calculation unit of the electronic book terminal calculates the feature amount from the image that is continuous for two or more pages in the digitized image data, and the feature amount transmission unit of the electronic book terminal sends the calculated feature amount to the electronic book information server. The book feature quantity search unit of the electronic book information server searches the book identifier corresponding to the feature quantity transmitted and received from the electronic book terminal from the book feature quantity data stored in advance, and adds the electronic book corresponding to the book identifier. The book additional information search unit of the electronic book information server searches the book additional information data in which information is stored in advance, and the searched book additional information data is stored in the electronic book information server. The register additional information search unit returns to the electronic book terminal, and the received book additional information data is associated with the image data and stored in the nonvolatile storage means provided in advance in the electronic book storage unit of the electronic book terminal. To do.
　上記目的を達成するため、本発明に係る書籍情報提供プログラムは、単数もしくは複数の電子書籍端末と単数もしくは複数の電子書籍情報サーバとが相互に接続された書籍情報提供システムにあって、電子書籍端末が備えるコンピュータに、書籍を電子化した画像データの中で２ページ以上連続した画像から特徴量を算出する手順、算出された特徴量を電子書籍情報サーバに送信する手順、および受信した書籍付加情報データを画像データと対応させて予め備えられた不揮発性記憶手段に記憶する手順を実行させることを特徴とする。 To achieve the above object, a book information providing program according to the present invention is a book information providing system in which one or more electronic book terminals and one or more electronic book information servers are connected to each other. A procedure for calculating a feature amount from an image in which two or more pages are continuous in image data obtained by digitizing a book to a computer included in a terminal, a procedure for transmitting the calculated feature amount to an electronic book information server, and a received book addition The information data is associated with the image data, and a procedure for storing the information data in a nonvolatile storage unit provided in advance is executed.
　上記目的を達成するため、本発明に係る他の書籍情報提供プログラムは、単数もしくは複数の電子書籍端末と単数もしくは複数の電子書籍情報サーバとが相互に接続された書籍情報提供システムにあって、電子書籍情報サーバが備えるコンピュータに、電子書籍端末から受信した特徴量に対応する書籍識別子を予め記憶された書籍特徴量データの中から検索する手順、書籍識別子に対応する電子書籍付加情報を予め記憶された書籍付加情報データの中から検索する手順、検索された書籍付加情報データを電子書籍端末に返信する手順を実行させることを特徴とする。 To achieve the above object, another book information providing program according to the present invention is a book information providing system in which one or more electronic book terminals and one or more electronic book information servers are connected to each other. In the computer provided with the electronic book information server, a procedure for searching for book identifiers corresponding to the feature quantities received from the electronic book terminal from the book feature quantity data stored in advance, and electronic book additional information corresponding to the book identifiers are stored in advance. And a procedure for searching from the book additional information data that has been searched and a procedure for returning the searched book additional information data to the electronic book terminal.
　本発明は、上述したように、書籍を電子化した画像データの中で２ページ以上連続した画像から算出した特徴量を利用してこれに対応する電子書籍付加情報を配信するように構成したので、データ形式が異なっていても共通した付加情報を提供することができる。これによって、各々のデータ形式およびユーザ個人で電子化した電子書籍に対して、文字データによる付加情報を確実かつ有効に提供することを可能であるという、優れた特徴を持つ書籍情報提供システム、電子書籍端末、電子書籍情報サーバ、書籍情報提供方法およびそのプログラムを提供することができる。 As described above, the present invention is configured to distribute the electronic book additional information corresponding to the feature amount calculated from the image data obtained by digitizing the book using two or more continuous pages. Even if the data formats are different, common additional information can be provided. As a result, a book information providing system having excellent characteristics that electronic data can be reliably and effectively provided for each data format and electronic books digitized by individual users. A book terminal, an electronic book information server, a book information providing method, and a program thereof can be provided.
本発明の第１の実施形態に係る書籍情報提供システムの構成を示す説明図である。It is explanatory drawing which shows the structure of the book information provision system which concerns on the 1st Embodiment of this invention. 図１で示した電子書籍端末の構成をより詳しく示す説明図である。It is explanatory drawing which shows in more detail the structure of the electronic book terminal shown in FIG. 図１で示した電子書籍情報サーバの構成をより詳しく示す説明図である。It is explanatory drawing which shows in more detail the structure of the electronic book information server shown in FIG. 図２に示した電子書籍端末の不揮発性記憶手段もしくは外部記憶手段に記憶される電子書籍のデータ構成について示す説明図である。It is explanatory drawing shown about the data structure of the electronic book memorize | stored in the non-volatile memory | storage means or external memory | storage means of the electronic book terminal shown in FIG. 図５Aは図３に示した書籍特徴量データの記憶内容について示す説明図である。図５Ｂは図３に示した書籍付加情報データの記憶内容について示す説明図である。FIG. 5A is an explanatory diagram showing the stored contents of the book feature data shown in FIG. FIG. 5B is an explanatory diagram showing the storage contents of the book additional information data shown in FIG. 図１に示した書籍情報提供システムで、電子書籍端末および電子書籍情報サーバの各々の動作を示すシーケンス図である。It is a sequence diagram which shows each operation | movement of an electronic book terminal and an electronic book information server in the book information provision system shown in FIG. 本発明の第２の実施形態に係る書籍情報提供システムの構成を示す説明図である。It is explanatory drawing which shows the structure of the book information provision system which concerns on the 2nd Embodiment of this invention. 図７に示した電子書籍情報サーバの構成をより詳しく示す説明図である。It is explanatory drawing which shows in more detail the structure of the electronic book information server shown in FIG. 図９Aは図８に示した書籍特徴量データの記憶内容について示す説明図である。図９Ｂは図８に示した書籍付加情報データの記憶内容について示す説明図である。FIG. 9A is an explanatory diagram showing the stored contents of the book feature data shown in FIG. FIG. 9B is an explanatory diagram showing the storage contents of the book additional information data shown in FIG. 図７に示した書籍情報提供システムで、電子書籍端末および電子書籍情報サーバの各々の動作を示すシーケンス図である。It is a sequence diagram which shows each operation | movement of an electronic book terminal and an electronic book information server with the book information provision system shown in FIG.
（第１の実施形態）
　以下、本発明の第１の実施形態の構成について添付図１～３に基づいて説明する。
　最初に、本実施形態の基本的な内容について説明し、その後でより具体的な内容について説明する。
　本実施形態に係る書籍情報提供システム１は、単数もしくは複数の電子書籍端末１０と単数もしくは複数の電子書籍情報サーバ３０とが相互に接続された書籍情報提供システムである。電子書籍端末１０は、書籍を電子化した画像データから特徴量を算出する特徴量算出部１０１と、算出された特徴量を電子書籍情報サーバに送信する特徴量送信部１０２と、送信された特徴量に対応する電子書籍付加情報を電子書籍情報サーバから受信してこれを画像データと対応させて予め備えられた不揮発性記憶手段に記憶する電子書籍保存部１０３とを備える。電子書籍情報サーバ３０は、特徴量と書籍識別子とを対応づける書籍特徴量データ２１１および書籍識別子と電子書籍付加情報とを対応づける書籍付加情報データ２１２を予め記憶した外部記憶手段３４と、電子書籍端末から受信した特徴量に対応する書籍識別子を書籍特徴量データから検索する書籍特徴量検索部２０１と、書籍識別子に対応する電子書籍付加情報を書籍付加情報データから検索して電子書籍端末に返信する書籍付加情報検索部２０２とを備える。そして電子書籍端末の特徴量算出部は、画像データの中で２ページ以上連続した画像から特徴量を算出する。 (First embodiment)
The configuration of the first embodiment of the present invention will be described below with reference to FIGS.
First, the basic content of the present embodiment will be described, and then more specific content will be described.
The book information providing system 1 according to the present embodiment is a book information providing system in which one or more electronic book terminals 10 and one or more electronic book information servers 30 are connected to each other. The electronic book terminal 10 includes a feature amount calculation unit 101 that calculates a feature amount from image data obtained by digitizing a book, a feature amount transmission unit 102 that transmits the calculated feature amount to an electronic book information server, and the transmitted feature. An electronic book storage unit 103 that receives electronic book additional information corresponding to the amount from the electronic book information server and stores the electronic book additional information in association with image data in a nonvolatile storage unit provided in advance. The electronic book information server 30 includes an external storage unit 34 that stores in advance book feature amount data 211 that associates feature amounts with book identifiers, and book additional information data 212 that associates book identifiers with electronic book additional information, and electronic books. A book feature value search unit 201 for searching for a book identifier corresponding to the feature value received from the terminal from the book feature value data, and an electronic book additional information corresponding to the book identifier is searched from the book additional information data and returned to the electronic book terminal. And a book additional information search unit 202. And the feature-value calculation part of an electronic book terminal calculates a feature-value from the image which continued 2 pages or more in image data.
　ここで、電子書籍端末の特徴量算出部１０１は、画像データの画像フォーマット、画像データの連結成分の重心点の配置、画像データの局所記述子による特徴ベクトルのうちいずれか１つ以上を特徴量として算出する。ここで言う局所記述子による特徴ベクトルとは、ＳＵＲＦ特徴、ＳＩＦＴ特徴、ＧＬＯＨ特徴などを含む。 Here, the feature quantity calculation unit 101 of the electronic book terminal uses any one or more of the image format of the image data, the arrangement of the center of gravity of the connected component of the image data, and the feature vector based on the local descriptor of the image data as the feature quantity. Calculate as The feature vector based on the local descriptor mentioned here includes SURF feature, SIFT feature, GLOH feature, and the like.
　以上の構成を備えることにより、書籍情報提供システム１は、各々のデータ形式およびユーザ個人で電子化した電子書籍に対して、文字データによる付加情報を確実かつ有効に提供することが可能となる。
　以下、これをより詳細に説明する。 By providing the above configuration, the book information providing system 1 can reliably and effectively provide additional information based on character data for each data format and an electronic book digitized by the individual user.
Hereinafter, this will be described in more detail.
　図１は、本発明の第１の実施形態に係る書籍情報提供システム１の構成を示す説明図である。書籍情報提供システム１は、画像入力装置２０が接続された電子書籍端末１０と、電子書籍情報サーバ３０とが、ネットワーク４０を介して相互に接続されて構成される。電子書籍端末１０は、パーソナルコンピュータであってもよく、またｉＰａｄなどのような電子書籍閲覧に特化した可搬式端末であってもよい。また、図１には各１台ずつの電子書籍端末１０と電子書籍情報サーバ３０を示しているが、電子書籍端末１０と電子書籍情報サーバ３０の各々の台数には特に制限は無く、それぞれ単数でも複数でもよい。 FIG. 1 is an explanatory diagram showing a configuration of a book information providing system 1 according to the first embodiment of the present invention. The book information providing system 1 is configured by connecting an electronic book terminal 10 to which an image input device 20 is connected and an electronic book information server 30 to each other via a network 40. The electronic book terminal 10 may be a personal computer or a portable terminal specialized for browsing electronic books such as iPad. FIG. 1 shows one electronic book terminal 10 and one electronic book information server 30, but the number of electronic book terminals 10 and electronic book information servers 30 is not particularly limited. However, it may be multiple.
　図２は、図１で示した電子書籍端末１０の構成をより詳しく示す説明図である。電子書籍端末１０は、一般的なコンピュータとしての構成を備えている。即ち、電子書籍端末１０は、コンピュータプログラムとして記述された各種処理を実行する主体である主演算制御手段（ＣＰＵ: Central Processing Unit）１１と、主演算制御手段１１によって処理中のデータを一時的に記憶する一時記憶手段（ＲＡＭ: Random Access Memory）１２と、ネットワーク４０に接続して他のコンピュータとの間でデータ通信を行う通信手段１３とが内部バス１４に接続されて構成される。 FIG. 2 is an explanatory diagram showing the configuration of the electronic book terminal 10 shown in FIG. 1 in more detail. The electronic book terminal 10 has a configuration as a general computer. That is, the electronic book terminal 10 temporarily stores main processing control means (CPU: Central Processing Unit) 11 that is a main body that executes various processes described as a computer program, and data being processed by the main processing control means 11. Temporary storage means (RAM: “Random Access Memory”) 12 for storing data and communication means 13 for connecting to the network 40 and performing data communication with other computers are connected to the internal bus 14.
　電子書籍端末１０の内部バス１４には、さらに、画像入力装置２０と接続して画像データ２１ａの入力を受け付ける画像インタフェース１５と、処理済みのデータを保存する不揮発性記憶手段１６と、多量のデータを記憶する外部記憶手段１７と、ユーザの操作を受け付け、その操作の結果を画面としてユーザに提示する入出力手段１８も接続されている。 The internal bus 14 of the electronic book terminal 10 further has an image interface 15 connected to the image input device 20 to receive input of the image data 21a, a nonvolatile storage means 16 for storing processed data, and a large amount of data. And an input / output means 18 for accepting user operations and presenting the results of the operations to the user as a screen.
　画像入力装置２０は、画像スキャナでもよいし、電子カメラでもよい。また、通信手段１３および画像インタフェース１５の接続方式は特に問わず、有線接続でも無線接続でもよい。 The image input device 20 may be an image scanner or an electronic camera. The connection method of the communication means 13 and the image interface 15 is not particularly limited, and may be wired connection or wireless connection.
　画像入力装置２０によって入力された画像データは、処理が終了したら不揮発性記憶手段１６に保存される。外部記憶手段１７はハードディスクドライブ、もしくはフラッシュメモリやＳＤカードなどのような移動可能な不揮発性記憶装置であるが、不揮発性記憶手段１６の容量が不足していない場合には必ずしも外部記憶手段１７を備える必要はない。 The image data input by the image input device 20 is stored in the nonvolatile storage means 16 when the processing is completed. The external storage means 17 is a movable nonvolatile storage device such as a hard disk drive or a flash memory or an SD card. However, if the capacity of the nonvolatile storage means 16 is not insufficient, the external storage means 17 is not necessarily used. There is no need to prepare.
　電子書籍端末１０の主演算制御手段１１は、電子書籍作成プログラムが動作することにより、特徴量算出部１０１と、特徴量送信部１０２と、電子書籍保存部１０３と、電子書籍表示部１０４の各々の機能部として動作する。これらの機能部の各々の動作内容については後述する。 The main calculation control means 11 of the electronic book terminal 10 is configured such that each of the feature amount calculation unit 101, the feature amount transmission unit 102, the electronic book storage unit 103, and the electronic book display unit 104 is operated by an electronic book creation program. It operates as a functional part. The operation contents of each of these functional units will be described later.
　図３は、図１で示した電子書籍情報サーバ３０の構成をより詳しく示す説明図である。電子書籍情報サーバ３０もまた、一般的なコンピュータとしての構成を備えている。即ち、電子書籍情報サーバ３０は、コンピュータプログラムとして記述された各種処理を実行する主体である主演算制御手段３１と、主演算制御手段３１によって処理中のデータを一時的に記憶する一時記憶手段３２と、ネットワーク４０に接続して他のコンピュータとの間でデータ通信を行う通信手段３３と、多量のデータを記憶する外部記憶手段３４とが内部バス３５に接続されて構成される。 FIG. 3 is an explanatory diagram showing the configuration of the electronic book information server 30 shown in FIG. 1 in more detail. The electronic book information server 30 also has a configuration as a general computer. That is, the electronic book information server 30 includes a main operation control unit 31 that is a main body that executes various processes described as a computer program, and a temporary storage unit 32 that temporarily stores data being processed by the main operation control unit 31. The communication unit 33 is connected to the network 40 and performs data communication with other computers, and the external storage unit 34 that stores a large amount of data is connected to the internal bus 35.
　電子書籍情報サーバ３０の主演算制御手段３１は、電子書籍情報提供プログラムが動作することにより、書籍特徴量検索部２０１と、書籍付加情報検索部２０２の各々の機能部として動作する。また、外部記憶手段３４には、書籍特徴量データ２１１と、書籍付加情報データ２１２とがあらかじめ記憶されている。これらの各機能部の動作内容、および各データの記憶内容についても後述する。 The main calculation control means 31 of the electronic book information server 30 operates as a functional unit of the book feature amount search unit 201 and the book additional information search unit 202 by the operation of the electronic book information providing program. The external storage means 34 stores book feature amount data 211 and book additional information data 212 in advance. The operation contents of each functional unit and the storage contents of each data will be described later.
　図４は、図２に示した電子書籍端末１０の不揮発性記憶手段１６もしくは外部記憶手段１７に記憶される電子書籍２１のデータ構成について示す説明図である。電子書籍２１は、画像データ２１ａと電子書籍付加情報２１ｂとで構成される。画像データ２１ａは、画像入力装置２０を介して入力されるものでもよいし、ネットワーク４０を介して他のコンピュータからダウンロードしたものでもよい。 FIG. 4 is an explanatory diagram showing a data configuration of the electronic book 21 stored in the nonvolatile storage means 16 or the external storage means 17 of the electronic book terminal 10 shown in FIG. The electronic book 21 includes image data 21a and electronic book additional information 21b. The image data 21a may be input via the image input device 20, or may be downloaded from another computer via the network 40.
　電子書籍付加情報２１ｂは、画像データ２１ａに対応して電子書籍情報サーバ３０から取得される情報データであり、たとえばその書籍の題名、著者名、出版年月日、出版社名、検索用キーワードなどといった各々の文字列データを含む。 The electronic book additional information 21b is information data acquired from the electronic book information server 30 corresponding to the image data 21a. For example, the title, author name, publication date, publisher name, search keyword, and the like of the book. Each character string data is included.
　電子書籍端末１０側（図２）で、特徴量算出部１０１は、画像入力装置２０から入力された画像データ２１ａの中の２ページ以上連続した画像のデータから、特徴量を算出する。特徴量送信部１０２は、２ページ以上連続した画像のデータから算出した特徴量を、電子書籍情報サーバ３０に送信する。 On the electronic book terminal 10 side (FIG. 2), the feature amount calculation unit 101 calculates a feature amount from data of two or more consecutive pages in the image data 21a input from the image input device 20. The feature amount transmitting unit 102 transmits the feature amount calculated from the data of the image that is continuous for two or more pages to the electronic book information server 30.
　ここでいう特徴量とは、たとえばその画像の全ページ数、ページ番号、色数、解像度（ｄｐｉ）、画像フォーマットなどによる粗分類、局所記述子による特徴ベクトル、あるいは二値化した画像データの連結成分を抽出して算出した重心などのような公知の特徴量が含まれる。局所記述子による特徴ベクトルとして、具体的にはたとえばＳＵＲＦ（Speeded Up Robust Features）特徴、ＳＩＦＴ（Scale-Invariant Feature Transform）特徴、ＧＬＯＨ（Gradiant Location and Orientation Histogram）特徴などのような公知技術を利用することができる。 The feature amount here is, for example, the total number of pages of the image, the page number, the number of colors, the resolution (dpi), the rough classification based on the image format, the feature vector based on the local descriptor, or the connection of binarized image data. A known feature amount such as the center of gravity calculated by extracting the components is included. For example, a known vector such as a SURF (Speeded Up Up Robust Features) feature, a SIFT (Scale-Invariant Feature Transform) feature, a GLOH (Gradiant Location And Orientation Histogram) feature or the like is used as the feature vector based on the local descriptor. be able to.
　図５Ａは、図３に示した書籍特徴量データ２１１の記憶内容について示す説明図である。書籍特徴量データ２１１は、様々な書籍における代表的な画像の特徴量２１１ａと、これに対応する書籍を一意に示す書籍ＩＤ２１１ｂとを対応づけて記憶されているデータである。書籍ＩＤ２１１ｂは、たとえばＩＳＢＮ（International Standard Book Number、国際図書標準番号）、ＪＡＮ（Japan Article Number）コードなどのように、書籍を一意に特定することのできる番号であれば何でもよい。 FIG. 5A is an explanatory diagram showing the stored contents of the book feature data 211 shown in FIG. The book feature amount data 211 is data stored by associating a representative image feature amount 211a of various books with a book ID 211b that uniquely indicates the corresponding book. The book ID 211b may be any number that can uniquely identify the book, such as ISBN (International Standard Book Number) or JAN (Japan Article Number) code.
　図５Ｂは、図３に示した書籍付加情報データ２１２の記憶内容について示す説明図である。書籍付加情報データ２１２は、書籍特徴量データ２１１と同一の書籍ＩＤ２１１ｂと、それに対応する書籍付加情報２１２ａとを対応づけて記憶されているデータである。書籍付加情報２１２ａは、たとえばその書籍の題名、著者名、出版年月日、出版社名、検索用キーワードなどといった各々の文字列データを含む。 FIG. 5B is an explanatory diagram showing the storage contents of the book additional information data 212 shown in FIG. The book additional information data 212 is data stored by associating the same book ID 211b as the book feature data 211 and the corresponding book additional information 212a. The book additional information 212a includes character string data such as the title, author name, publication date, publisher name, search keyword, and the like of the book.
　電子書籍情報サーバ３０（図３）で、書籍特徴量検索部２０１は、電子書籍端末１０から受信した特徴量と一致するものを、書籍特徴量データ２１１の特徴量２１１ａの中から検索し、これに対応する書籍ＩＤ２１１ｂを出力する。書籍付加情報検索部２０２は、書籍特徴量検索部２０１から出力された書籍ＩＤ２１１ｂに対応する書籍付加情報２１２ａを電子書籍端末１０に返信する。 In the electronic book information server 30 (FIG. 3), the book feature quantity search unit 201 searches the feature quantity 211a of the book feature quantity data 211 for a match with the feature quantity received from the electronic book terminal 10, and this The book ID 211b corresponding to is output. The book additional information search unit 202 returns the book additional information 212 a corresponding to the book ID 211 b output from the book feature amount search unit 201 to the electronic book terminal 10.
　再び電子書籍端末１０側（図２）で、電子書籍保存部１０３は、電子書籍情報サーバ３０から返信されてきた書籍付加情報２１２ａを、画像データ２１ａと関連する電子書籍付加情報２１ｂとして不揮発性記憶手段１６に保存する。図４に示した通り、画像データ２１ａと、これに対応する電子書籍付加情報２１ｂとを合わせたものが、電子書籍２１となる。 Again on the electronic book terminal 10 side (FIG. 2), the electronic book storage unit 103 stores the book additional information 212a returned from the electronic book information server 30 in a nonvolatile manner as electronic book additional information 21b related to the image data 21a. Save to means 16. As shown in FIG. 4, the electronic book 21 is a combination of the image data 21 a and the electronic book additional information 21 b corresponding thereto.
　電子書籍表示部１０４は、入出力手段１８を介したユーザの操作に応じて、電子書籍２１を入出力手段１８に画面表示する。電子書籍表示部１０４はまた、ユーザが検索を行うよう指示入力した場合には、これに応じて電子書籍付加情報２１ｂの内容を検索して、その結果を入出力手段１８に画面表示する。 The electronic book display unit 104 displays the electronic book 21 on the input / output unit 18 in accordance with a user operation through the input / output unit 18. In addition, when the user inputs an instruction to perform a search, the electronic book display unit 104 searches the contents of the electronic book additional information 21b in accordance with this and displays the result on the input / output means 18 on the screen.
　図６は、図１に示した書籍情報提供システム１で、電子書籍端末１０および電子書籍情報サーバ３０の各々の動作を示すシーケンス図である。まず、電子書籍端末１０側で、画像入力装置２０からの画像データ２１ａが、画像インタフェース１５を介して特徴量算出部１０１に入力される（ステップＳ３０１）。特徴量算出部１０１はこれを受けて、２ページ以上連続した画像のデータから、特徴量を算出する（ステップＳ３０２）。そして、算出された特徴量を、特徴量送信部１０２が電子書籍情報サーバ３０に送信する（ステップＳ３０３）。 FIG. 6 is a sequence diagram showing operations of the electronic book terminal 10 and the electronic book information server 30 in the book information providing system 1 shown in FIG. First, on the electronic book terminal 10 side, the image data 21a from the image input device 20 is input to the feature amount calculation unit 101 via the image interface 15 (step S301). In response to this, the feature amount calculation unit 101 calculates a feature amount from data of images that are continuous for two or more pages (step S302). And the feature-value transmission part 102 transmits the calculated feature-value to the electronic book information server 30 (step S303).
　これを受けた電子書籍情報サーバ３０側で、書籍特徴量検索部２０１が、電子書籍端末１０から受信した特徴量と一致するものを、書籍特徴量データ２１１の特徴量２１１ａの中から検索し、これに対応する書籍ＩＤ２１１ｂを出力する（ステップＳ３０４）。さらに、書籍付加情報検索部２０２は、書籍特徴量検索部２０１から出力された書籍ＩＤ２１１ｂに対応する書籍付加情報２１２ａを検索して、これを電子書籍端末１０に返信する（ステップＳ３０５）。 On receiving the electronic book information server 30, the book feature quantity search unit 201 searches the feature quantity 211 a of the book feature quantity data 211 for a match with the feature quantity received from the electronic book terminal 10, The book ID 211b corresponding to this is output (step S304). Further, the book additional information search unit 202 searches for the book additional information 212a corresponding to the book ID 211b output from the book feature amount search unit 201, and returns this to the electronic book terminal 10 (step S305).
　再び電子書籍端末１０側で、電子書籍保存部１０３が、電子書籍情報サーバ３０から返信されてきた書籍付加情報２１２ａを、画像データ２１ａと関連する電子書籍付加情報２１ｂとして不揮発性記憶手段１６に保存する（ステップＳ３０６）。これで、画像データ２１ａと、これに対応する電子書籍付加情報２１ｂとを合わせた電子書籍２１が、電子書籍端末１０の不揮発性記憶手段１６に保存されたことになる。 On the electronic book terminal 10 side again, the electronic book storage unit 103 stores the book additional information 212a returned from the electronic book information server 30 in the nonvolatile storage unit 16 as the electronic book additional information 21b related to the image data 21a. (Step S306). Thus, the electronic book 21 in which the image data 21 a and the electronic book additional information 21 b corresponding to the image data 21 a are combined is stored in the nonvolatile storage unit 16 of the electronic book terminal 10.
　そして、電子書籍表示部１０４が、不揮発性記憶手段１６に保存されている電子書籍２１に対して、電子書籍付加情報２１ｂの検索と画像データ２１ａの表示の動作を行う（ステップＳ３０７）。 Then, the electronic book display unit 104 searches the electronic book additional information 21b and displays the image data 21a with respect to the electronic book 21 stored in the nonvolatile storage unit 16 (step S307).
（第１の実施形態の全体的な動作）
　次に、上記の実施形態の全体的な動作について説明する。本実施形態に係る書籍情報提供方法は、単数もしくは複数の電子書籍端末１０と単数もしくは複数の電子書籍情報サーバ３０とが相互に接続された書籍情報提供システム１にあって、書籍を電子化した画像データの中で２ページ以上連続した画像から特徴量を電子書籍端末の特徴量算出部が算出し（図６・ステップＳ３０１～３０２）、算出された特徴量を電子書籍端末の特徴量送信部が電子書籍情報サーバに送信し（図６・ステップＳ３０３）、電子書籍端末から受信した特徴量に対応する書籍識別子を予め記憶された書籍特徴量データの中から電子書籍情報サーバの書籍特徴量検索部が検索し（図６・ステップＳ３０４）、書籍識別子に対応する電子書籍付加情報を予め記憶された書籍付加情報データの中から電子書籍情報サーバの書籍付加情報検索部が検索し、検索された書籍付加情報データを電子書籍情報サーバの書籍付加情報検索部が電子書籍端末に返信し（図６・ステップＳ３０５）、受信した書籍付加情報データを画像データと対応させて電子書籍端末の電子書籍保存部が予め備えられた不揮発性記憶手段に記憶する（図６・ステップＳ３０６）。 (Overall operation of the first embodiment)
Next, the overall operation of the above embodiment will be described. The book information providing method according to the present embodiment is a book information providing system 1 in which a single or a plurality of electronic book terminals 10 and a single or a plurality of electronic book information servers 30 are connected to each other. A feature value calculation unit of the electronic book terminal calculates a feature value from an image of two or more pages in the image data (FIG. 6, steps S301 to S302), and the calculated feature value is a feature value transmission unit of the electronic book terminal. Is sent to the electronic book information server (FIG. 6, step S303), and the book identifier corresponding to the feature quantity received from the electronic book terminal is searched for the book feature quantity of the electronic book information server from the book feature quantity data stored in advance. The book is retrieved by the department (FIG. 6, step S304), and the electronic book additional information corresponding to the book identifier is pre-stored from the book additional information data stored in the electronic book information server. The additional information search unit searches, and the added book information search unit of the electronic book information server returns the searched book additional information data to the electronic book terminal (step S305 in FIG. 6), and the received book additional information data is image data. The electronic book storage unit of the electronic book terminal is stored in the nonvolatile storage means provided in advance (step S306 in FIG. 6).
　ここで、上記各動作ステップについては、これをコンピュータで実行可能にプログラム化し、これらを前記各ステップを直接実行するコンピュータである電子書籍端末１０および電子書籍情報サーバ３０に実行させるようにしてもよい。本プログラムは、非一時的な記録媒体、例えば、ＤＶＤ、ＣＤ、フラッシュメモリ等に記録されてもよい。その場合、本プログラムは、記録媒体からコンピュータによって読み出され、実行される。
　この動作により、本実施形態は以下のような効果を奏する。 Here, about each said operation step, this may be programmed so that execution is possible with a computer, and you may make it perform these with the electronic book terminal 10 and the electronic book information server 30 which are the computer which directly performs each said step. . The program may be recorded on a non-temporary recording medium, such as a DVD, a CD, or a flash memory. In this case, the program is read from the recording medium by a computer and executed.
By this operation, this embodiment has the following effects.
　電子書籍において「２ページ以上連続した画像」は、たいていの場合、その書籍において最も特徴的な画像である。従って、「２ページ以上連続した画像」を利用してその特徴量を算出して検索に利用することにより、書籍特徴量検索部２０１が間違った書籍ＩＤ２１１ｂを検索することに起因して書籍付加情報検索部２０２が間違った書籍付加情報２１２ａを返信してしまう可能性を低くすることができる。 In an electronic book, “an image continuous for two or more pages” is usually the most characteristic image in the book. Therefore, by calculating the feature amount using “images that are continuous for two or more pages” and using the feature amount for the search, the book feature amount search unit 201 searches for the wrong book ID 211b, thereby adding the book additional information. It is possible to reduce the possibility that the search unit 202 returns the wrong book additional information 212a.
　また、画像データ２１ａの特徴量２１１ａを電子書籍端末１０から電子書籍情報サーバ３０に送信することにより、画像データ２１ａそのものを送信する場合と比べてデータ容量を１／１００以下にすることができ、かつ画像フォーマットの形式を問わずに共通した書籍付加情報２１２ａを得ることができる。 Further, by transmitting the feature quantity 211a of the image data 21a from the electronic book terminal 10 to the electronic book information server 30, the data capacity can be reduced to 1/100 or less compared to the case of transmitting the image data 21a itself, In addition, the common book additional information 212a can be obtained regardless of the format of the image format.
　さらに、どの電子書籍配信サービスによる画像データ２１ａでも、あるいはユーザが各自で電子化した（ファイル形式や解像度などがユーザごとにまちまちの）画像データ２１ａに対しても、その書籍の出版者が共通した書籍付加情報２１２ａを提供することができる。これはユーザが付加情報を入力する手間を軽減するだけでなく、出版者にとっても適切な付加情報を広く提供できるという点でメリットがある。 Furthermore, the publisher of the book is common to the image data 21a from any electronic book distribution service or to the image data 21a that is digitized by the user (the file format and resolution vary for each user). The book additional information 212a can be provided. This is advantageous not only in reducing the user's trouble of inputting additional information but also in providing a wide range of appropriate additional information for publishers.
（第２の実施形態）
　本発明の第２の実施形態に係る書籍情報提供システム４０１は、第１の実施形態として説明した書籍情報提供システム１の構成に加えて、電子書籍情報サーバ４３０の書籍付加情報検索部５０１が、書籍識別子が書籍の全体を示すものか一部のみを示すものかを判別し、書籍の一部のみを示すものである場合には書籍の一部のみに対応する書籍付加情報データを電子書籍端末に返信する機能を有するものとした。 (Second Embodiment)
In the book information providing system 401 according to the second embodiment of the present invention, in addition to the configuration of the book information providing system 1 described as the first embodiment, the book additional information search unit 501 of the electronic book information server 430 includes: It is determined whether the book identifier indicates the entire book or only a part of the book. If the book identifier indicates only a part of the book, the book additional information data corresponding to only a part of the book is stored in the electronic book terminal. It has a function to reply to.
　この構成を備えることにより、書籍情報提供システム４０１は、画像データ２１ａが書籍全体を電子化したものであっても、また書籍の一部の章のみを電子化したものであっても、第１の実施形態と同一の効果を得ることができる。
　以下、これをより詳細に説明する。 By providing this configuration, the book information providing system 401 can be configured so that even if the image data 21a is an electronic version of the entire book or an electronic version of only some chapters of the book. The same effect as that of the embodiment can be obtained.
Hereinafter, this will be described in more detail.
　図７は、本発明の第２の実施形態に係る書籍情報提供システム４０１の構成を示す説明図である。書籍情報提供システム４０１は、画像入力装置２０が接続された第１の実施形態と同一の電子書籍端末１０と、第１の実施形態とは異なる電子書籍情報サーバ４３０とが、第１の実施形態と同一のネットワーク４０を介して相互に接続されて構成される。 FIG. 7 is an explanatory diagram showing a configuration of a book information providing system 401 according to the second embodiment of the present invention. The book information providing system 401 includes an electronic book terminal 10 that is the same as that of the first embodiment to which the image input device 20 is connected, and an electronic book information server 430 that is different from the first embodiment. Are connected to each other via the same network 40.
　図８は、図７に示した電子書籍情報サーバ４３０の構成をより詳しく示す説明図である。電子書籍情報サーバ４３０は、第１の実施形態に係る電子書籍情報サーバ３０とハードウェアとしては全く同一である。そのため、同一の要素については同一の名称および参照番号でいう。 FIG. 8 is an explanatory diagram showing the configuration of the electronic book information server 430 shown in FIG. 7 in more detail. The electronic book information server 430 is exactly the same in hardware as the electronic book information server 30 according to the first embodiment. Therefore, the same element is referred to by the same name and reference number.
　電子書籍情報サーバ４３０は、第１の実施形態に係る電子書籍情報サーバ３０と比較して、主演算制御手段３１で動作する書籍特徴量検索部２０１および書籍付加情報検索部２０２が、各々別の書籍特徴量検索部５０１および書籍付加情報検索部５０２に置換されている。また、外部記憶手段３４にあらかじめ記憶されている書籍特徴量データ２１１および書籍付加情報データ２１２も、各々別の書籍特徴量データ５１１および書籍付加情報データ５１２に置換されている。 Compared with the electronic book information server 30 according to the first embodiment, the electronic book information server 430 includes a book feature quantity search unit 201 and a book additional information search unit 202 that are operated by the main calculation control unit 31, respectively. The book feature quantity search unit 501 and the book additional information search unit 502 are replaced. Further, the book feature quantity data 211 and the book additional information data 212 stored in advance in the external storage unit 34 are also replaced with different book feature quantity data 511 and book additional information data 512, respectively.
　ここで、電子書籍端末１０で行われる画像データ２１ａの取り込みは、１冊の書籍の全ページを１つのファイルにまとめる場合もあれば、章ごとに１ファイルとする場合もある。後者の場合、特徴量算出部１０１は各章ごとに特徴量を算出する。 Here, the capturing of the image data 21a performed by the electronic book terminal 10 may be a single file for all pages of one book or a single file for each chapter. In the latter case, the feature amount calculation unit 101 calculates a feature amount for each chapter.
　図９Ａは、図８に示した書籍特徴量データ５１１の記憶内容について示す説明図である。書籍特徴量データ５１１は、図５Ａで示した画像の特徴量２１１ａと書籍ＩＤ２１１ｂとに加えて、その書籍の第何章であるかを示す章番号５１１ａが対応づけられて記憶されている。書籍特徴量データ５１１では、画像の特徴量２１１ａとして、１つの書籍の各章ごとの特徴量を記憶しているものがある。その場合、書籍ＩＤ２１１ｂと章番号５１１ａとで、その書籍と章を一意に示す。 FIG. 9A is an explanatory diagram showing the stored contents of the book feature data 511 shown in FIG. In addition to the image feature quantity 211a and the book ID 211b shown in FIG. 5A, the book feature quantity data 511 is stored in association with a chapter number 511a indicating the chapter of the book. In the book feature amount data 511, there is one that stores a feature amount for each chapter of one book as the image feature amount 211 a. In that case, the book and chapter are uniquely indicated by the book ID 211b and the chapter number 511a.
　図９Ｂは、図８に示した書籍付加情報データ５１２の記憶内容について示す説明図である。書籍付加情報データ５１２では、図５Ａ～Ｂで示した書籍ＩＤ２１１ｂと書籍付加情報２１２ａに加えて、章番号５１１ａと、ページ数情報５１２ａとが対応づけられて記憶されている。ページ数情報５１２ａは、図９Ｂに示した例では書籍全体のページ数とその章のページ数とを示しているが、この他にも書籍全体の中でその章が始まるページ番号である開始ページ番号などを適宜含むことができる。 FIG. 9B is an explanatory diagram showing the storage contents of the book additional information data 512 shown in FIG. In the book additional information data 512, in addition to the book ID 211b and the book additional information 212a shown in FIGS. 5A and 5B, a chapter number 511a and page number information 512a are stored in association with each other. In the example shown in FIG. 9B, the page number information 512a indicates the number of pages of the entire book and the number of pages of the chapter. In addition, the page number information 512a is the start page that is the page number where the chapter starts in the entire book. A number or the like can be included as appropriate.
　画像データ２１ａから抽出された特徴量には、総ページ数とページ番号の情報が含まれる。従って、これをページ数情報５１２ａと比較することにより、その画像データ２１ａがその書籍の全ページを含むものか、それとも特定の章だけであるかを判定することができる。 The feature amount extracted from the image data 21a includes information on the total page number and page number. Therefore, by comparing this with the page number information 512a, it can be determined whether the image data 21a includes all pages of the book or only a specific chapter.
　図１０は、図７に示した書籍情報提供システム４０１で、電子書籍端末１０および電子書籍情報サーバ４３０の各々の動作を示すシーケンス図である。図１０に示したシーケンス図は、図６に示した第１の実施形態の動作と同一の動作を多く含むので、同一の動作については図６と同一の参照番号でいう。 FIG. 10 is a sequence diagram showing operations of the electronic book terminal 10 and the electronic book information server 430 in the book information providing system 401 shown in FIG. The sequence diagram shown in FIG. 10 includes many operations that are the same as those of the first embodiment shown in FIG. 6, and therefore the same operations are denoted by the same reference numerals as those in FIG.
　書籍特徴量検索部５０１は、電子書籍端末１０から受信した特徴量と一致するものを、書籍特徴量データ２１１の特徴量２１１ａの中から検索する所は図６のステップＳ３０４と同一であるが、これに引き続いて、その検索結果が書籍全体のものか、それとも特定の章だけのものかを判定する（ステップＳ６０１）。 The book feature quantity search unit 501 searches the feature quantity 211a of the book feature quantity data 211 for a match with the feature quantity received from the electronic book terminal 10, but is the same as step S304 in FIG. Subsequently, it is determined whether the search result is for the entire book or only for a specific chapter (step S601).
　検索結果が書籍全体のものであれば（ステップＳ６０１がイエス）、図６と同じく、書籍全体の書籍付加情報２１２ａを電子書籍端末１０に返信する（ステップＳ３０５）。検索結果が特定の章だけのものであれば（ステップＳ６０１がノー）、その章のみの書籍付加情報２１２ａとページ数情報５１２ａとを電子書籍端末１０に返信する（ステップＳ６０２）。 If the search result is for the entire book (Yes in step S601), the book additional information 212a of the entire book is returned to the electronic book terminal 10 as in FIG. 6 (step S305). If the search result is only for a specific chapter (No in step S601), the book additional information 212a and the page number information 512a of only that chapter are returned to the electronic book terminal 10 (step S602).
　ステップＳ３０５もしくはＳ６０２で返信を受けた電子書籍端末１０では、電子書籍保存部１０３が、受信した情報を画像データ２１ａに対応する電子書籍２１のデータとして記憶する（ステップＳ３０６）。ページ数情報５１２ａを受信した場合には、電子書籍保存部１０３はこれも画像データ２１ａに対応する電子書籍２１のデータとして記憶する。 In the electronic book terminal 10 that receives the reply in step S305 or S602, the electronic book storage unit 103 stores the received information as data of the electronic book 21 corresponding to the image data 21a (step S306). When the page number information 512a is received, the electronic book storage unit 103 also stores this as data of the electronic book 21 corresponding to the image data 21a.
　以上で説明した通り、本発明の第２の実施形態では、画像データ２１ａが書籍全体のものか、それとも特定の章だけのものかを判定して、その各々に対応する書籍付加情報２１２ａ（およびページ数情報５１２ａ）を返信する構成とした。 As described above, in the second embodiment of the present invention, it is determined whether the image data 21a is for the entire book or only for a specific chapter, and the book additional information 212a (and The page number information 512a) is returned.
　これによって、書籍情報提供システム４０１は、画像データ２１ａが書籍全体を電子化したものであっても、また書籍の一部の章のみを電子化したものであっても、第１の実施形態と同様に、各々のユーザに対して適切な付加情報を提供することが可能となる。多くの場合、電子書籍閲覧用の可搬式端末の記憶容量は、デスクトップ用の端末と比べて少ない。このため、ユーザが読みたいと思う章だけを電子化して可搬式端末に転送することもありうる。第２の実施形態では、そのような場合にも有用である。 As a result, the book information providing system 401 is the same as that of the first embodiment even if the image data 21a is an electronic version of the entire book, or an electronic version of only a part of the chapter of the book. Similarly, appropriate additional information can be provided to each user. In many cases, the portable terminal for browsing electronic books has a smaller storage capacity than a desktop terminal. For this reason, only the chapter which a user wants to read may be digitized and transferred to a portable terminal. The second embodiment is also useful in such a case.
　これまで本発明について図面に示した特定の実施形態をもって説明してきたが、本発明は図面に示した実施形態に限定されるものではなく、本発明の効果を奏する限り、これまで知られたいかなる構成であっても採用することができる。 The present invention has been described with reference to the specific embodiments shown in the drawings. However, the present invention is not limited to the embodiments shown in the drawings, and any known hitherto provided that the effects of the present invention are achieved. Even if it is a structure, it is employable.
　上述した実施形態について、その新規な技術内容の要点をまとめると、以下のようになる。なお、上記実施形態の一部または全部は、新規な技術として以下のようにまとめられるが、本発明は必ずしもこれに限定されるものではない。 The summary of the new technical contents of the above-described embodiment is summarized as follows. In addition, although part or all of the said embodiment is summarized as follows as a novel technique, this invention is not necessarily limited to this.
（付記１）　単数もしくは複数の電子書籍端末と単数もしくは複数の電子書籍情報サーバとが相互に接続された書籍情報提供システムであって、
　前記電子書籍端末が、
　書籍を電子化した画像データから特徴量を算出する特徴量算出部と、
　算出された前記特徴量を前記電子書籍情報サーバに送信する特徴量送信部と、
　送信された前記特徴量に対応する電子書籍付加情報を前記電子書籍情報サーバから受信してこれを前記画像データと対応させて予め備えられた不揮発性記憶手段に記憶する電子書籍保存部とを備え、
　前記電子書籍情報サーバが、
　前記特徴量と書籍識別子とを対応づける書籍特徴量データおよび前記書籍識別子と電子書籍付加情報とを対応づける書籍付加情報データを予め記憶した外部記憶手段と、
　前記電子書籍端末から受信した前記特徴量に対応する書籍識別子を前記書籍特徴量データから検索する書籍特徴量検索部と、
　前記書籍識別子に対応する前記電子書籍付加情報を前記書籍付加情報データから検索して前記電子書籍端末に返信する書籍付加情報検索部とを備えると共に、
　前記電子書籍端末の前記特徴量算出部が前記画像データの中で２ページ以上連続した画像から前記特徴量を算出することを特徴とする書籍情報提供システム。 (Appendix 1) A book information providing system in which one or more electronic book terminals and one or more electronic book information servers are connected to each other,
The electronic book terminal is
A feature amount calculation unit that calculates a feature amount from image data obtained by digitizing a book;
A feature amount transmitting unit that transmits the calculated feature amount to the electronic book information server;
An electronic book storage unit that receives electronic book additional information corresponding to the transmitted feature quantity from the electronic book information server and stores the electronic book additional information in correspondence with the image data in a nonvolatile storage unit provided in advance. ,
The electronic book information server is
External storage means for storing in advance book feature amount data associating the feature amount with a book identifier and book additional information data associating the book identifier with electronic book additional information;
A book feature value search unit that searches the book feature value data for a book identifier corresponding to the feature value received from the electronic book terminal;
A book additional information search unit for searching the electronic book additional information corresponding to the book identifier from the book additional information data and returning it to the electronic book terminal;
The book information providing system, wherein the feature amount calculation unit of the electronic book terminal calculates the feature amount from an image having two or more continuous pages in the image data.
（付記２）　前記電子書籍端末の前記特徴量算出部が、前記画像データの画像フォーマット、前記画像データの連結成分の重心点の配置、前記画像データの局所記述子による特徴ベクトルのうちいずれか１つ以上を前記特徴量として算出することを特徴とする、付記１に記載の書籍情報提供システム。 (Supplementary Note 2) The feature quantity calculation unit of the electronic book terminal is any one of an image format of the image data, an arrangement of barycentric points of connected components of the image data, and a feature vector based on a local descriptor of the image data. The book information providing system according to appendix 1, wherein at least two are calculated as the feature amount.
（付記３）　前記電子書籍情報サーバの前記書籍付加情報検索部が、前記書籍識別子が前記書籍の全体を示すものか一部のみを示すものかを判別し、前記書籍の一部のみを示すものである場合には前記書籍の一部のみに対応する前記書籍付加情報データを前記電子書籍端末に返信する機能を有することを特徴とする、付記１に記載の書籍情報提供システム。 (Additional remark 3) The said additional information search part of the said electronic book information server discriminate | determines whether the said book identifier shows the whole or only part of the said book, and shows only a part of the said book The book information providing system according to appendix 1, wherein the book additional information data corresponding to only a part of the book is returned to the electronic book terminal.
（付記４）　電子書籍情報サーバと相互に接続されて書籍情報提供システムを構成する電子書籍端末であって、
　書籍を電子化した画像データから特徴量を算出する特徴量算出部と、
　算出された前記特徴量を前記電子書籍情報サーバに送信する特徴量送信部と、
　送信された前記特徴量に対応する電子書籍付加情報を前記電子書籍情報サーバから受信してこれを前記画像データと対応させて予め備えられた不揮発性記憶手段に記憶する電子書籍保存部とを備えると共に、
　前記特徴量算出部が前記画像データの中で２ページ以上連続した画像から前記特徴量を算出することを特徴とする電子書籍端末。 (Additional remark 4) It is an electronic book terminal which comprises a book information provision system connected mutually with an electronic book information server,
A feature amount calculation unit that calculates a feature amount from image data obtained by digitizing a book;
A feature amount transmitting unit that transmits the calculated feature amount to the electronic book information server;
An electronic book storage unit that receives electronic book additional information corresponding to the transmitted feature quantity from the electronic book information server and stores the electronic book additional information in association with the image data in a nonvolatile storage unit provided in advance. With
The electronic book terminal, wherein the feature amount calculation unit calculates the feature amount from an image having two or more continuous pages in the image data.
（付記５）　電子書籍端末と相互に接続されて書籍情報提供システムを構成する電子書籍情報サーバであって、
　前記特徴量と書籍識別子とを対応づける書籍特徴量データおよび前記書籍識別子と電子書籍付加情報とを対応づける書籍付加情報データを予め記憶した外部記憶手段と、
　前記電子書籍端末から受信した前記特徴量に対応する書籍識別子を前記書籍特徴量データから検索する書籍特徴量検索部と、
　前記書籍識別子に対応する前記電子書籍付加情報を前記書籍付加情報データから検索して前記電子書籍端末に返信する書籍付加情報検索部とを備えることを特徴とする電子書籍情報サーバ。 (Additional remark 5) It is an electronic book information server which is mutually connected with an electronic book terminal, and comprises a book information provision system,
External storage means for storing in advance book feature amount data associating the feature amount with a book identifier and book additional information data associating the book identifier with electronic book additional information;
A book feature value search unit that searches the book feature value data for a book identifier corresponding to the feature value received from the electronic book terminal;
An electronic book information server, comprising: a book additional information retrieval unit that retrieves the electronic book additional information corresponding to the book identifier from the book additional information data and sends it back to the electronic book terminal.
（付記６）　単数もしくは複数の電子書籍端末と単数もしくは複数の電子書籍情報サーバとが相互に接続された書籍情報提供システムにあって、
　書籍を電子化した画像データの中で２ページ以上連続した画像から特徴量を前記電子書籍端末の特徴量算出部が算出し、
　算出された前記特徴量を前記電子書籍端末の特徴量送信部が前記電子書籍情報サーバに送信し、
　前記電子書籍端末から受信した前記特徴量に対応する書籍識別子を予め記憶された書籍特徴量データの中から前記電子書籍情報サーバの書籍特徴量検索部が検索し、
　前記書籍識別子に対応する前記電子書籍付加情報を予め記憶された書籍付加情報データの中から前記電子書籍情報サーバの書籍付加情報検索部が検索し、
　検索された書籍付加情報データを前記電子書籍情報サーバの前記書籍付加情報検索部が前記電子書籍端末に返信し、
　受信した書籍付加情報データを前記画像データと対応させて前記電子書籍端末の電子書籍保存部が予め備えられた不揮発性記憶手段に記憶する
ことを特徴とする書籍情報提供方法。 (Appendix 6) In a book information providing system in which one or more electronic book terminals and one or more electronic book information servers are connected to each other,
The feature value calculation unit of the electronic book terminal calculates a feature value from an image that is continuous for two or more pages in image data obtained by digitizing a book,
The feature amount transmission unit of the electronic book terminal transmits the calculated feature amount to the electronic book information server,
The book feature value search unit of the electronic book information server searches for the book identifier corresponding to the feature value received from the electronic book terminal from the book feature value data stored in advance.
The book additional information search part of the electronic book information server searches the electronic book additional information corresponding to the book identifier from book additional information data stored in advance,
The book additional information search unit of the electronic book information server returns the searched book additional information data to the electronic book terminal,
A book information providing method, wherein the received book additional information data is associated with the image data and stored in a non-volatile storage means provided in advance in an electronic book storage unit of the electronic book terminal.
（付記７）　単数もしくは複数の電子書籍端末と単数もしくは複数の電子書籍情報サーバとが相互に接続された書籍情報提供システムにあって、
　前記電子書籍端末が備えるコンピュータに、
　書籍を電子化した画像データの中で２ページ以上連続した画像から特徴量を算出する手順、
　算出された前記特徴量を前記電子書籍情報サーバに送信する手順、
　および受信した書籍付加情報データを前記画像データと対応させて予め備えられた不揮発性記憶手段に記憶する手順
を実行させることを特徴とする書籍情報提供プログラム。 (Appendix 7) In a book information providing system in which one or more electronic book terminals and one or more electronic book information servers are connected to each other,
In the computer provided in the electronic book terminal,
A procedure for calculating a feature amount from an image of two or more continuous pages in digitized image data of a book,
A procedure for transmitting the calculated feature quantity to the electronic book information server;
And a book information providing program for executing a procedure for storing the received book additional information data in a nonvolatile storage means provided in advance in association with the image data.
（付記８）　単数もしくは複数の電子書籍端末と単数もしくは複数の電子書籍情報サーバとが相互に接続された書籍情報提供システムにあって、
　前記電子書籍情報サーバが備えるコンピュータに、
　前記電子書籍端末から受信した前記特徴量に対応する書籍識別子を予め記憶された書籍特徴量データの中から検索する手順、
　前記書籍識別子に対応する前記電子書籍付加情報を予め記憶された書籍付加情報データの中から検索する手順、
　検索された書籍付加情報データを前記電子書籍端末に返信する手順
を実行させることを特徴とする書籍情報提供プログラム。 (Appendix 8) In a book information providing system in which one or more electronic book terminals and one or more electronic book information servers are connected to each other,
In the computer provided in the electronic book information server,
A procedure for retrieving a book identifier corresponding to the feature received from the electronic book terminal from book feature data stored in advance;
A procedure for searching the electronic book additional information corresponding to the book identifier from pre-stored book additional information data;
A book information providing program for executing a procedure of returning the retrieved book additional information data to the electronic book terminal.
　この出願は２０１１年３月２日に出願された日本出願特願２０１１－０４５００７を基礎とする優先権を主張し、その開示の全てをここに取り込む。 This application claims priority based on Japanese Patent Application No. 2011-045007 filed on March 2, 2011, the entire disclosure of which is incorporated herein.
　電子書籍端末、および電子書籍配信システムに適用できる。 Applicable to electronic book terminals and electronic book distribution systems.
　　１、４０１　書籍情報提供システム
　　１０　電子書籍端末
　　１１、３１　主演算制御手段
　　１２、３２　一時記憶手段
　　１３、３３　通信手段
　　１４、３５　内部バス
　　１５　画像インタフェース
　　１６　不揮発性記憶手段
　　１７、３４　外部記憶手段
　　１８　入出力手段
　　２０　画像入力装置
　　２１　電子書籍
　　２１ａ　画像データ
　　２１ｂ　電子書籍付加情報
　　３０、４３０　電子書籍情報サーバ
　　４０　ネットワーク
　　１０１　特徴量算出部
　　１０２　特徴量送信部
　　１０３　電子書籍保存部
　　１０４　電子書籍表示部
　　２０１、５０１　書籍特徴量検索部
　　２０２、５０２　書籍付加情報検索部
　　２１１、５１１　書籍特徴量データ
　　２１１ａ　特徴量
　　２１１ｂ　書籍ＩＤ
　　２１２、５１２　書籍付加情報データ
　　２１２ａ　書籍付加情報
　　５１１ａ　章番号
　　５１２ａ　ページ数情報 DESCRIPTION OF SYMBOLS 1,401 Book information provision system 10 Electronic book terminal 11, 31 Main operation control means 12, 32 Temporary storage means 13, 33 Communication means 14, 35 Internal bus 15 Image interface 16 Non-volatile storage means 17, 34 External storage means 18 Input Output means 20 Image input device 21 Electronic book 21a Image data 21b Electronic book additional information 30, 430 Electronic book information server 40 Network 101 Feature amount calculation unit 102 Feature amount transmission unit 103 Electronic book storage unit 104 Electronic book display unit 201, 501 Books Feature amount search unit 202, 502 Book additional information search unit 211, 511 Book feature amount data 211a Feature amount 211b Book ID
212, 512 Book additional information data 212a Book additional information 511a Chapter number 512a Page number information

Claims (8)

  1. 　単数もしくは複数の電子書籍端末と単数もしくは複数の電子書籍情報サーバとが相互に接続された書籍情報提供システムであって、
    　前記電子書籍端末が、
    　書籍を電子化した画像データから特徴量を算出する特徴量算出部と、
    　算出された前記特徴量を前記電子書籍情報サーバに送信する特徴量送信部と、
    　送信された前記特徴量に対応する電子書籍付加情報を前記電子書籍情報サーバから受信してこれを前記画像データと対応させて予め備えられた不揮発性記憶手段に記憶する電子書籍保存部とを備え、
    　前記電子書籍情報サーバが、
    　前記特徴量と書籍識別子とを対応づける書籍特徴量データおよび前記書籍識別子と電子書籍付加情報とを対応づける書籍付加情報データを予め記憶した外部記憶手段と、
    　前記電子書籍端末から受信した前記特徴量に対応する書籍識別子を前記書籍特徴量データから検索する書籍特徴量検索部と、
    　前記書籍識別子に対応する前記電子書籍付加情報を前記書籍付加情報データから検索して前記電子書籍端末に返信する書籍付加情報検索部とを備えると共に、
    　前記電子書籍端末の前記特徴量算出部が前記画像データの中で２ページ以上連続した画像から前記特徴量を算出することを特徴とする書籍情報提供システム。     A book information providing system in which one or more electronic book terminals and one or more electronic book information servers are connected to each other,
    The electronic book terminal is
    A feature amount calculation unit that calculates a feature amount from image data obtained by digitizing a book;
    A feature amount transmitting unit that transmits the calculated feature amount to the electronic book information server;
    An electronic book storage unit that receives electronic book additional information corresponding to the transmitted feature quantity from the electronic book information server and stores the electronic book additional information in correspondence with the image data in a nonvolatile storage unit provided in advance. ,
    The electronic book information server is
    External storage means for storing in advance book feature amount data associating the feature amount with a book identifier and book additional information data associating the book identifier with electronic book additional information;
    A book feature value search unit that searches the book feature value data for a book identifier corresponding to the feature value received from the electronic book terminal;
    A book additional information search unit for searching the electronic book additional information corresponding to the book identifier from the book additional information data and returning it to the electronic book terminal;
    The book information providing system, wherein the feature amount calculation unit of the electronic book terminal calculates the feature amount from an image having two or more continuous pages in the image data.
  2. 　前記電子書籍端末の前記特徴量算出部が、前記画像データの画像フォーマット、前記画像データの連結成分の重心点の配置、前記画像データの局所記述子による特徴ベクトルのうちいずれか１つ以上を前記特徴量として算出することを特徴とする、請求項１に記載の書籍情報提供システム。 The feature quantity calculation unit of the electronic book terminal receives at least one of an image format of the image data, an arrangement of barycentric points of connected components of the image data, and a feature vector based on a local descriptor of the image data. The book information providing system according to claim 1, wherein the book information providing system is calculated as a feature amount.
  3. 　前記電子書籍情報サーバの前記書籍付加情報検索部が、前記書籍識別子が前記書籍の全体を示すものか一部のみを示すものかを判別し、前記書籍の一部のみを示すものである場合には前記書籍の一部のみに対応する前記書籍付加情報データを前記電子書籍端末に返信する機能を有することを特徴とする、請求項１に記載の書籍情報提供システム。 When the book additional information search unit of the electronic book information server determines whether the book identifier indicates the entire book or only a part of the book, and indicates only a part of the book The book information providing system according to claim 1, further comprising a function of returning the book additional information data corresponding to only a part of the book to the electronic book terminal.
  4. 　電子書籍情報サーバと相互に接続されて書籍情報提供システムを構成する電子書籍端末であって、
    　書籍を電子化した画像データから特徴量を算出する特徴量算出部と、
    　算出された前記特徴量を前記電子書籍情報サーバに送信する特徴量送信部と、
    　送信された前記特徴量に対応する電子書籍付加情報を前記電子書籍情報サーバから受信してこれを前記画像データと対応させて予め備えられた不揮発性記憶手段に記憶する電子書籍保存部とを備えると共に、
    　前記特徴量算出部が前記画像データの中で２ページ以上連続した画像から前記特徴量を算出することを特徴とする電子書籍端末。     An electronic book terminal that is interconnected with an electronic book information server and constitutes a book information providing system,
    A feature amount calculation unit that calculates a feature amount from image data obtained by digitizing a book;
    A feature amount transmitting unit that transmits the calculated feature amount to the electronic book information server;
    An electronic book storage unit that receives electronic book additional information corresponding to the transmitted feature quantity from the electronic book information server and stores the electronic book additional information in association with the image data in a nonvolatile storage unit provided in advance. With
    The electronic book terminal, wherein the feature amount calculation unit calculates the feature amount from an image having two or more continuous pages in the image data.
  5. 　電子書籍端末と相互に接続されて書籍情報提供システムを構成する電子書籍情報サーバであって、
    　前記特徴量と書籍識別子とを対応づける書籍特徴量データおよび前記書籍識別子と電子書籍付加情報とを対応づける書籍付加情報データを予め記憶した外部記憶手段と、
    　前記電子書籍端末から受信した前記特徴量に対応する書籍識別子を前記書籍特徴量データから検索する書籍特徴量検索部と、
    　前記書籍識別子に対応する前記電子書籍付加情報を前記書籍付加情報データから検索して前記電子書籍端末に返信する書籍付加情報検索部とを備えることを特徴とする電子書籍情報サーバ。     An electronic book information server that is connected to an electronic book terminal to constitute a book information providing system,
    External storage means for storing in advance book feature amount data associating the feature amount with a book identifier and book additional information data associating the book identifier with electronic book additional information;
    A book feature value search unit that searches the book feature value data for a book identifier corresponding to the feature value received from the electronic book terminal;
    An electronic book information server, comprising: a book additional information retrieval unit that retrieves the electronic book additional information corresponding to the book identifier from the book additional information data and sends it back to the electronic book terminal.
  6. 　単数もしくは複数の電子書籍端末と単数もしくは複数の電子書籍情報サーバとが相互に接続された書籍情報提供システムにあって、
    　書籍を電子化した画像データの中で２ページ以上連続した画像から特徴量を前記電子書籍端末の特徴量算出部が算出し、
    　算出された前記特徴量を前記電子書籍端末の特徴量送信部が前記電子書籍情報サーバに送信し、
    　前記電子書籍端末から受信した前記特徴量に対応する書籍識別子を予め記憶された書籍特徴量データの中から前記電子書籍情報サーバの書籍特徴量検索部が検索し、
    　前記書籍識別子に対応する前記電子書籍付加情報を予め記憶された書籍付加情報データの中から前記電子書籍情報サーバの書籍付加情報検索部が検索し、
    　検索された書籍付加情報データを前記電子書籍情報サーバの前記書籍付加情報検索部が前記電子書籍端末に返信し、
    　受信した書籍付加情報データを前記画像データと対応させて前記電子書籍端末の電子書籍保存部が予め備えられた不揮発性記憶手段に記憶する
    ことを特徴とする書籍情報提供方法。     In a book information providing system in which one or more electronic book terminals and one or more electronic book information servers are connected to each other,
    The feature value calculation unit of the electronic book terminal calculates a feature value from an image that is continuous for two or more pages in image data obtained by digitizing a book,
    The feature amount transmission unit of the electronic book terminal transmits the calculated feature amount to the electronic book information server,
    The book feature value search unit of the electronic book information server searches for the book identifier corresponding to the feature value received from the electronic book terminal from the book feature value data stored in advance.
    The book additional information search part of the electronic book information server searches the electronic book additional information corresponding to the book identifier from book additional information data stored in advance,
    The book additional information search unit of the electronic book information server returns the searched book additional information data to the electronic book terminal,
    A book information providing method, wherein the received book additional information data is associated with the image data and stored in a non-volatile storage means provided in advance in an electronic book storage unit of the electronic book terminal.
  7. 　単数もしくは複数の電子書籍端末と単数もしくは複数の電子書籍情報サーバとが相互に接続された書籍情報提供システムにあって、
    　前記電子書籍端末が備えるコンピュータに、
    　書籍を電子化した画像データの中で２ページ以上連続した画像から特徴量を算出する手順、
    　算出された前記特徴量を前記電子書籍情報サーバに送信する手順、
    　および受信した書籍付加情報データを前記画像データと対応させて予め備えられた不揮発性記憶手段に記憶する手順
    を実行させることを特徴とする書籍情報提供プログラム。     In a book information providing system in which one or more electronic book terminals and one or more electronic book information servers are connected to each other,
    In the computer provided in the electronic book terminal,
    A procedure for calculating a feature amount from an image of two or more continuous pages in digitized image data of a book,
    A procedure for transmitting the calculated feature quantity to the electronic book information server;
    And a book information providing program for executing a procedure for storing the received book additional information data in a nonvolatile storage means provided in advance in association with the image data.
  8. 　単数もしくは複数の電子書籍端末と単数もしくは複数の電子書籍情報サーバとが相互に接続された書籍情報提供システムにあって、
    　前記電子書籍情報サーバが備えるコンピュータに、
    　前記電子書籍端末から受信した前記特徴量に対応する書籍識別子を予め記憶された書籍特徴量データの中から検索する手順、
    　前記書籍識別子に対応する前記電子書籍付加情報を予め記憶された書籍付加情報データの中から検索する手順、
    　検索された書籍付加情報データを前記電子書籍端末に返信する手順
    を実行させることを特徴とする書籍情報提供プログラム。     In a book information providing system in which one or more electronic book terminals and one or more electronic book information servers are connected to each other,
    In the computer provided in the electronic book information server,
    A procedure for retrieving a book identifier corresponding to the feature received from the electronic book terminal from book feature data stored in advance;
    A procedure for searching the electronic book additional information corresponding to the book identifier from pre-stored book additional information data;
    A book information providing program for executing a procedure of returning the retrieved book additional information data to the electronic book terminal.
PCT/JP2012/055157 2011-03-02 2012-03-01 Book information providing system, digital book terminal, digital book information server, book information providing method and program for same WO2012118135A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2011-045007 2011-03-02
JP2011045007 2011-03-02

Publications (1)

Publication Number Publication Date
WO2012118135A1 true WO2012118135A1 (en) 2012-09-07

Family

ID=46758062

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/055157 WO2012118135A1 (en) 2011-03-02 2012-03-01 Book information providing system, digital book terminal, digital book information server, book information providing method and program for same

Country Status (1)

Country Link
WO (1) WO2012118135A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230196000A1 (en) * 2021-12-21 2023-06-22 Woongjin Thinkbig Co., Ltd. System and method for providing personalized book

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11232439A (en) * 1998-02-16 1999-08-27 Toshinari Hayashi Document picture structure analysis method
JP2002149659A (en) * 2000-11-08 2002-05-24 Fuji Xerox Co Ltd Method and system for book retrieval service, book retrieval system, book retrieval requesting device, book retrieval intermediating device and book retrieval device
JP2007065793A (en) * 2005-08-29 2007-03-15 Seiko Epson Corp Display controller and display control method
JP2008191936A (en) * 2007-02-05 2008-08-21 Fujifilm Corp Method for supporting construction of content registration/search system, and apparatus for supporting construction of content registration/search system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11232439A (en) * 1998-02-16 1999-08-27 Toshinari Hayashi Document picture structure analysis method
JP2002149659A (en) * 2000-11-08 2002-05-24 Fuji Xerox Co Ltd Method and system for book retrieval service, book retrieval system, book retrieval requesting device, book retrieval intermediating device and book retrieval device
JP2007065793A (en) * 2005-08-29 2007-03-15 Seiko Epson Corp Display controller and display control method
JP2008191936A (en) * 2007-02-05 2008-08-21 Fujifilm Corp Method for supporting construction of content registration/search system, and apparatus for supporting construction of content registration/search system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
MAO KOIZUMI: "Hyoshi Gazo Database ni yoru Tag Nyuryoku Hojo Kino o Motsu Shoseki File Kanri System", SYMPOSIUM ON MULTIMEDIA, DISTRIBUTED, COOPERATIVE AND MOBILE SYSTEMS (DICOM02009) RONBUNSHU, IPSJ SYMPOSIUM SERIES, vol. 2009, no. L, 1 July 2009 (2009-07-01), pages 61 - 65 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230196000A1 (en) * 2021-12-21 2023-06-22 Woongjin Thinkbig Co., Ltd. System and method for providing personalized book
US11822876B2 (en) * 2021-12-21 2023-11-21 Woongjin Thinkbig Co., Ltd. System and method for providing personalized book

Similar Documents

Publication Publication Date Title
JP5353148B2 (en) Image information retrieving apparatus, image information retrieving method and computer program therefor
US7991778B2 (en) Triggering actions with captured input in a mixed media environment
US7920759B2 (en) Triggering applications for distributed action execution and use of mixed media recognition as a control input
US7587412B2 (en) Mixed media reality brokerage network and methods of use
US7769772B2 (en) Mixed media reality brokerage network with layout-independent recognition
US7672543B2 (en) Triggering applications based on a captured text in a mixed media environment
US7669148B2 (en) System and methods for portable device for mixed media system
US8156427B2 (en) User interface for mixed media reality
US7551780B2 (en) System and method for using individualized mixed document
US8195659B2 (en) Integration and use of mixed media documents
US9171202B2 (en) Data organization and access for mixed media document system
JP2010073114A6 (en) Image information retrieving apparatus, image information retrieving method and computer program therefor
US20070047008A1 (en) System and methods for use of voice mail and email in a mixed media environment
US20090092287A1 (en) Mixed Media Reality Recognition With Image Tracking
US20110106798A1 (en) Search Result Enhancement Through Image Duplicate Detection
JP2013541793A (en) Multi-mode search query input method
CN108959586A (en) Text vocabulary is identified in response to visual query
US20120195499A1 (en) Color description analysis device, color description analysis method, and color description analysis program
EP2482210A2 (en) System and methods for creation and use of a mixed media environment
JP2014010722A (en) Retrieval device, retrieval method and program
EP1917635A1 (en) Embedding hot spots in electronic documents
EP1917637A1 (en) Data organization and access for mixed media document system
US20160179821A1 (en) Searching Inside Items
WO2012118135A1 (en) Book information providing system, digital book terminal, digital book information server, book information providing method and program for same
US11699174B2 (en) Media processing techniques for enhancing content

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12752422

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12752422

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP