KR102542170B1 - Digital reference book provision system by authentication of purchase of real reference books - Google Patents

Abstract

The present invention relates to a digital reference book providing system, and more specifically, to a digital reference book providing system using the authentication of the purchase of a real reference book, wherein a digitized reference book can be provided based on a real reference book thereof using the authentication of the purchase of the real reference book. The digital reference book providing system using the authentication of the purchase of a real reference book according to the present invention is a digital reference book providing system using the authentication of the purchase of a real reference book, comprising a digital reference book providing server for extracting, storing and managing the elements of a digitized reference book, and providing the same to a student terminal. The digital reference book providing server includes: a database part for storing the digital reference book and the elements; a purchase authentication part for authenticating the purchase of a real reference book using an image received from the student terminal; a digital reference book payment part for providing payment for the digital reference book to the student terminal for which the purchase of the real reference book has been authenticated; and a digital reference book providing part for providing the digital reference book to the student terminal having paid for the digital reference book.

Description

Digital reference book provision system through purchase authentication of physical reference book {DIGITAL REFERENCE BOOK PROVISION SYSTEM BY AUTHENTICATION OF PURCHASE OF REAL REFERENCE BOOKS}

The present invention relates to a system for providing digital reference books, and more particularly, to a system for providing digital reference books through purchase authentication of physical reference books capable of providing digitized reference books based on the actual reference books through purchase authentication of physical reference books. .

Publishers are publishing reference books necessary for learning various subjects such as Korean, English, social studies, science, and English for various subjects such as elementary school students, middle school students, high school students, college students, and civil service exam preparation students. These reference books are published as books and sold to consumers belonging to the aforementioned target audience.

On the other hand, reference books in digital form not only eliminate the inefficiency of book transportation, but also provide personalized learning by collecting and analyzing the learning history of users, thereby building an effective learning environment. is emerging

In addition, a method of lending a digital reference book having the same content as the physical reference book to users such as students who have purchased the physical reference book through a smartphone, tablet, and/or PC is emerging.

Republic of Korea Patent Registration No. 10-1985612 (Announced on June 03, 2019)

An object of the present invention to solve the above problems is to provide a digital reference book providing system through purchase authentication of a physical reference book capable of authenticating the purchase of a physical reference book.

Another object of the present invention to solve the above problems is to provide a digital reference book providing system through purchase authentication of a physical reference book capable of providing a digital reference book including contents of a physical reference book to a purchaser or holder of the physical reference book.

Another object of the present invention to solve the above problems is to provide a digital reference book providing system through purchase authentication of a physical reference book capable of extracting and managing each element from a digital reference book in which the physical reference book is digitized and providing it to the user. .

In order to achieve the above object, a digital reference book providing system through purchase authentication of a physical reference book according to an embodiment of the present invention extracts, stores and manages elements of a digitized reference book, and provides them to a student terminal. A system for providing digital reference books through purchase authentication of physical reference books, including a digital reference book providing server, wherein the digital reference book providing server includes a database unit in which the digital reference book and the elements are stored, and an image received from the student terminal. Including a purchase authentication unit that authenticates purchase, a digital reference book payment unit that provides payment for digital reference books to student terminals where the purchase of physical reference books is authenticated, and a digital reference book provision unit that provides the digital reference books to student terminals that have paid for digital reference books In addition, it is characterized in that it is possible to certify the purchase of physical reference books and provide digital reference books using physical reference books.

The purchase authentication unit includes an authentication code transmission unit that transmits an authentication code to the student terminal, an authentication page unit that transmits authentication page information of the physical reference book to the student terminal, and the authentication code written in the authentication page to the student terminal. and an entry location unit that transmits entry location information, wherein the student terminal generates the image by photographing the authentication page of the physical reference book in which the authentication code is written at the entry location, and transmits the generated image to the purchase authentication. The purchase authentication unit includes the authentication code written in the generated image received from the student terminal, the location information in which the authentication code is written, and the authentication page of the physical reference book, and the authentication code transmission unit transmits the authentication code to the student terminal. It is characterized in that the purchase of the physical reference book is authenticated by comparing the authentication code transmitted to the terminal, the writing location information transmitted to the student terminal by the writing location unit, and the authentication page of the digital reference book stored in the database unit.

The digital reference book providing server further includes whether to lend a digital reference book by generating a user code and transmitting it to the student terminal, wherein the student terminal generates a rental image by photographing the user code and the authentication page on which the date is written. , The generated rental image is transmitted to the digital reference book rental unit, and the digital reference book rental unit provides lending authority for the digital reference book to the student terminal that has transmitted the rental image.

The authentication page unit transmits cover information of the physical reference book, randomly determined random page information, and authentication page information to the student terminal, and the student terminal transmits the cover information of the physical reference book corresponding to the cover information, the random page information. A random page of the physical reference book corresponding to the page information and the authentication page corresponding to the authentication page information in which the user code and date are written are photographed to generate extended images, respectively, and the generated extended images are transmitted to the authentication page unit. And, the authentication page unit is characterized in extending the lending authority of the digital reference book of the student terminal based on the received extended image.

The system for providing digital reference books includes a plurality of student terminals, and when the authentication page information is transmitted to the plurality of student terminals, the authentication page unit determines the same page as the authentication page if it is the same reference book, and the authentication page information is transmitted to the plurality of student terminals. It is characterized in that the physical reference book and the digital reference book correspond 1:1 by transmitting to each of the two student terminals.

According to the system for providing digital reference books through purchase authentication of physical reference books according to the present invention, there is an effect of enabling purchase authentication of physical reference books.

According to the system for providing a digital reference book through purchase authentication of a physical reference book according to the present invention, there is an effect of providing a digital reference book including contents of a physical reference book to a purchaser or holder of a physical reference book.

According to the system for providing a digital reference book through purchase authentication of a physical reference book according to the present invention, it is possible to extract and manage each element from a digital reference book in which a physical reference book is digitized and provide it to the user.

1 is a diagram showing each component of a system for providing digital reference books through purchase authentication of physical reference books according to the present invention.
2 is a diagram showing an authentication page of a physical reference book that is photographed when authenticating the purchase of a physical reference book according to the present invention.
3 is a view showing a user code and date written on an authentication page according to the present invention.
4 is a diagram showing the front cover, random page, and authentication page of an actual reference book, respectively, which are photographed when the rental authority is extended according to the present invention.
5 to 7 are diagrams showing authentication pages included in extended images according to the present invention.
8 is a diagram showing page analysis through a similarity comparison module between pages using computer vision according to the present invention.
9 is a diagram showing that all authentication pages in the same physical reference book are set identically.
10 is a diagram showing each configuration of a digital reference book conversion server according to the present invention.

Hereinafter, some embodiments of the present invention will be described in detail through exemplary drawings. In adding reference numerals to components of each drawing, it should be noted that the same components have the same numerals as much as possible, even if they are displayed on different drawings.

And, in describing the embodiments of the present invention, if it is determined that a detailed description of a related known configuration or function hinders understanding of the embodiments of the present invention, the detailed description will be omitted.

Also, terms such as first, second, A, B, (a), and (b) may be used to describe components of an embodiment of the present invention. These terms are only used to distinguish the component from other components, and the nature, order, or order of the corresponding component is not limited by the term.

In this specification, the singular form also includes the plural form unless otherwise specified in the phrase. The terms "comprising" and/or "comprising" used in the specification do not exclude the presence or addition of one or more other components other than the recited components.

In this specification, it is described as a student and a student terminal 10, respectively, to further clarify the meaning of a general user and a user terminal. Therefore, it is preferable to understand the student and student terminal 10 as a general user who purchases or possesses an actual reference book and a student terminal 10 possessed by a general user and connected to the digital reference book providing server 100 to receive a digital reference book. do.

In addition, in this specification, a physical reference book actually means a physical book that a student can carry and can be contrasted with a digital reference book.

The digital reference book providing server 100 according to the present invention is a digital reference book and/or digital reference book conversion server 200 extracting the contents of a real reference book from a PDF file or the like and storing and managing elements of a digitized reference book. (Elements) can be provided to the student terminal 10, the digital reference created by recombination.

The digital reference book providing server 100 according to the present invention enables access to the digital reference book only to the purchaser of the physical reference book and/or the owner of the physical reference book, and provides authentication of purchase of the physical reference book and/or certification of possession of the physical reference book to a specific page of the physical reference book. proceed in conjunction with The student terminal 10 can read the digital reference provided from the digital reference providing server 100 after authentication and/or payment, which will be described later.

In addition, in this specification, reference numerals written in English alphabets are used separately from uppercase and lowercase letters.

Hereinafter, the present invention will be described in more detail with reference to the accompanying drawings.

1 is a diagram showing each component of a digital reference book providing system 1000 through purchase authentication of physical reference books according to the present invention.

Referring to FIG. 1, a digital reference book providing system 1000 through purchase authentication of an actual reference book according to the present invention includes a student terminal 10, a digital reference book providing server 100, and an external server 20.

The digital reference book providing server 100 according to the present invention includes a database unit 110, a purchase authentication unit 120, a digital reference book payment unit 130, a digital reference book providing unit 140, and digital reference book rental status 150. include

On the other hand, the digital reference book providing system 1000 according to the present invention receives a digital reference book that has been digitized in PDF, Word, hwp, etc. based on an actual reference book from an external server 20 such as a publisher, and elements from each digital reference book. It may further include a digital reference book conversion server 200 that extracts and manages. The digital reference book conversion server 200 transmits the extracted elements and the received digital reference to the database unit 110 of the digital reference book providing server 100. The digital reference book providing server 100 may provide the digital reference book transmitted to the database unit 110 by the digital reference book conversion server 200 or the digital reference book generated by recombining the extracted elements to the student terminal 10 . Meanwhile, the external server 20 of a publisher or the like may include a publisher terminal (not shown).

Each component of the digital reference book providing server 100 and/or the digital reference book conversion server 200 according to the present invention may be driven by a known library. For example, the digital reference book providing server 100 and/or the digital reference book conversion server 200, particularly the digital reference book conversion server 200, converts PDFs into images for each page and extracts text using the pdf library fitz and image transformation. Libraries such as opencv (Open Source Computer Vision), a computer vision library that is used in and borderline extraction, object detection pytorch and tensorflow used as object detection model training and prediction and tools, and MathPix used as MathML and LaTex grammar OCR APIs are on Python. It may be driven, but is not limited thereto. In addition, in the digital reference providing server 100 and/or the digital reference conversion server 200 according to the present invention, libraries such as numpy, sklearn, re, and glob can be run on Python, and using the Font-forge library It is possible to detect text on the PDF, match it with a suitable font, and extract it in a renderable form, and the font format may be calculated in the form of TTF, TTF2, OTF, woff, etc., but is not limited thereto. Meanwhile, the detailed configuration of the digital reference book conversion server 200 will be described later with reference to FIG. 10 .

The purchase authentication unit 120 according to the present invention authenticates the holder of the student terminal 10 , that is, the student's purchase and/or possession of an actual reference book through the image received from the student terminal 10 . The student terminal 10 includes a camera module (not shown) capable of shooting and a camera control application (not shown) that controls the camera module. The student terminal 10 creates an image by photographing a specific page of the actual reference book, and transmits the generated image to the purchase authentication unit 120 . The purchase authentication unit 120 may authenticate purchase and ownership of the physical reference book of the holder of the student terminal 10 based on the received image. The purchase and ownership authentication of the actual reference book by the purchase authentication unit 120 will be described later.

When the purchase and/or ownership of the actual reference book of the holder of the student terminal 10 is authenticated by the purchase authentication unit 120, the digital reference book payment unit 130 transfers the purchase and/or possession of the actual reference book to the student terminal 10 that has been authenticated. Payment of digital reference books can be provided. The payment provision process of the digital reference book payment unit 130 follows a well-known one, and for example, it may be connected to an external payment server (not shown) to provide payment for digital reference books.

The digital reference book providing unit 140 according to the present invention provides the digital reference book stored in the database unit 110 to the student terminal 10 for which payment for the digital reference book has been completed. Therefore, the digital reference book providing unit 140 can provide a digital reference book to the student terminal 10 for which purchase authentication has been completed through an actual reference book.

Meanwhile, the purchase authentication unit 120 may select and receive images received from the student terminal 10 only images captured in real time through the camera module described above. That is, when an image pre-stored in the storage space of the student terminal 10 is received, the purchase authentication unit 120 blocks reception of the pre-stored image. Alternatively, even if a pre-stored image is received, post-processing for purchase authentication is not performed. This is because the authentication code to be entered in the authentication page, which will be described later, is tampered with or modified, so that the extension of purchase authentication and reading is bypassed, or a plurality of student terminals based on a single physical reference book (10) , that is, to prevent duplicate provision of digital reference books to a plurality of users.

Meanwhile, the digital reference book providing server 100 according to the present invention may provide a separate camera control application to the student terminal 10 for purchase authentication and/or request for extension of reading of the actual reference book. A separate camera control application provided by the digital reference book providing server 100 may control the camera module provided in the student terminal 10 . As described above, the student terminal 10 uses only a separate camera control application provided by the digital reference book providing server 100 to create an image by photographing a real reference book, and transmits the generated image through the separate camera control application. It can be transmitted to the digital reference book providing server 100. The digital reference book providing server 100 receives or post-processes only the image transmitted through the separate camera control application to prevent problems caused by the secondary distribution of physical reference books as described above, purchase authentication and/or Bypass usage due to extension of reading can be blocked.

2 is a diagram showing an authentication page of a physical reference book that is photographed when authenticating the purchase of a physical reference book according to the present invention. Referring to FIG. 2 , the purchase and possession authentication of the actual reference book of the purchase authentication unit 120 according to the present invention will be described as follows. Meanwhile, although two authentication pages are illustrated on the left and right sides as an example in FIG. 2 , authentication pages corresponding to each actual reference book have only one authentication page.

Referring to FIG. 1 together, the purchase authentication unit 120 according to the present invention includes an authentication code transmission unit 121, an authentication page unit 123, and a writing position unit 125.

The authentication code transmitter 121 according to the present invention transmits the authentication code generated by a known random number generating algorithm to the student terminal 10 . The student terminal 10 displays the received authentication code on the display device, and the holder of the student terminal 10 can check the authentication code displayed on the display device.

On the other hand, the authentication code transmitted by the authentication code transmission unit 121 to the student terminal 10 can simplify the login procedure through Single Sign On. The authentication code may be a Unique ID value generated by a separate authentication procedure through personal information confirmation of the student terminal 10 . Only one authentication code, which is a unique ID value, can be assigned to one physical reference book. And one authentication code can authorize access from one tablet and one smartphone. When accessing from a new device with the same authentication code, the use of digital references may be restricted on devices that are not designated.

An authentication page according to the authentication page information generated by the authentication page unit 123 and the writing location unit 125 according to the present invention is as shown in FIG. 2 .

The authentication page unit 123 according to the present invention transmits authentication page information of an actual reference book to the student terminal 10 . At this time, the authentication page information includes information on a specific page of the actual reference book. In particular, when selecting a specific page, the authentication page unit 123 may select a specific page having a background color in the page. Meanwhile, in this specification, a specific page selected by the authentication page unit 123 is referred to as an authentication page.

The writing location unit 125 according to the present invention includes information on the writing location where the authentication code in the authentication page is to be written in authentication page information transmitted by the authentication page unit 123 and transmits the information to the student terminal 10 . At this time, the writing position information may be selected to include an area (a) in which the background color exists in the specific page selected by the authentication page unit 123. Preferably, at this time, the writing position information may be selected such that an area (a) in which the background color changes among the areas (a) in which the background color exists in the specific page selected by the authentication page unit 123 is included.

The authentication page unit 123 and the writing position unit 125 have a background color in a specific page for the holder of the student terminal 10, and preferably at the writing position (a), which is an area where the background color is changed. Information requesting to write the aforementioned authentication code may be included in authentication page information and transmitted to the student terminal 10 .

The holder of the student terminal 10 checks the authentication code displayed on the display device of the student terminal 10, writes the authentication code in the writing position of the page (h) corresponding to the authentication page information in the physical reference book, and then An image may be generated by taking a picture through a camera control application and a camera module, and the generated image may be transmitted to the purchase authentication unit 120 through the camera control application. That is, the student terminal 10 directly photographs the authentication page h of the physical reference book in which the authentication code is written at the writing position a, generates an image, and transmits the generated image to the purchase authentication unit 120.

At this time, each component of the purchase authentication unit 120 may require the holder of the student terminal 10 to write the authentication code in the writing position using a blue or red ballpoint pen that cannot be modified. This is to prevent fertilization using correction fluid, etc., and to block access rights when signs of damage are found.

When the purchase authentication unit 120 receives the image from the student terminal 10, the authentication code written in the image is compared with the authentication code transmitted to the student terminal 10 by the authentication code transmission unit 121, and the actual reference book to verify the purchase of At this time, the purchase authentication unit 120 may extract the authentication code written in the image received from the student terminal 10 through a library capable of recognizing known handwriting. On the other hand, the library capable of recognizing handwriting is not limited to the one used in extracting the authentication code of the purchase authentication unit 120, but also used when extracting a user code and date written in an authentication page to be described later.

The purchase authentication unit 120 compares the writing position (a) where the authentication code in the image received from the student terminal 10 is written and the writing position transmitted to the student terminal 10 by the writing position unit 125, and causes a certain error. It is checked whether an authentication code within the range is written, and at this time, the purchase authentication unit 120 can compare the written positions (a) based on the background color or background color change in the page.

The purchase authentication unit 120 compares the authentication page h included in the image received from the student terminal 10 with the authentication page of the digital reference book stored in the database unit 110, and the authentication page unit 123 transmits It is judged whether the page of the physical reference book that matches the certified page was photographed. At this time, it is determined whether the page (h) in the photographed image and the corresponding page in the digital reference book stored in the database unit 110 are identical to each other by a similarity comparison module between pages using computer vision, which will be described later. However, it is not limited thereto and may be based on a similarity comparison module between pages using a known computer vision.

The digital reference book payment unit 130, based on the image received from the student terminal 10, when the authentication code, the authentication page (h) and the entry position (a) are confirmed by the purchase authentication unit 120, the above As described above, payment for the digital reference book is provided to the student terminal 10, and when the payment is completed, the digital reference book providing unit 140 provides the digital reference book to the student terminal 10.

On the other hand, provision of the digital reference book to the student terminal 10 may be provided in a so-called digital reference rental method in which a reading period is determined.

That is, the digital reference book providing unit 140 may provide a digital reference book provided to the student terminal 10 for a certain period of time, and after a certain period of time, the digital reference book may be provided only to the student terminal 10 with an extended reading period. there is.

The digital reference book lending unit 150 creates a user code (e, FIG. 3) based on the authentication code, authentication page (h), and writing position (a) confirmed by the purchase authentication unit 120, and the student terminal Send to (10). The user code (e) transmitted to the student terminal 10 is displayed on the display device of the student terminal 10 so that the owner of the student terminal 10 can check the user code (e). On the other hand, the user code (e) generated by the digital reference book lending unit 150 may be a hashed user id generated through a known hash algorithm.

3 is a view showing a user code and date written on an authentication page according to the present invention.

Referring to FIG. 3, the holder of the student terminal 10 enters the confirmed user code (e) and the date (a) corresponding to the rental start date in the manner of year, month and/or day as described above on the authentication page (h). ), the authentication page (h) is photographed to generate a rental image, and the generated rental image can be transmitted to the digital reference book rental unit 150 through the camera control application of the student terminal 10. . That is, the student terminal 10 creates a rental image by photographing the authentication page (h) on which the user code (e) and the date (a) are written, and transmits the generated rental image to the digital reference book rental unit 150. .

After analyzing the received rental image, the digital reference book lending unit 150 may provide the lending authority of the digital reference book corresponding to the actual reference book to the student terminal 10 that has transmitted the rental image. Digital reference book rental (150) is based on the user code (e) included in the authentication page (h) included in the rental image, and the date (a) is entered as the first day Provides the right to borrow digital reference books for a certain period of time A digital reference book is provided to the received student terminal 10 .

Meanwhile, the authentication page of FIG. 3 is a simplified illustration of the authentication page of FIG. 2 .

4 is a diagram showing the front cover, random page, and authentication page of an actual reference book, respectively, which are photographed when the rental authority is extended according to the present invention.

On the other hand, as the reading period of the digital reference book ends, the student terminal 10 that needs to extend the borrowing right can apply for an extension of the borrowing right to the digital reference book lending unit 150 . Referring to FIG. 4, the student terminal 10, which has applied for the extension of the lending authority with the digital reference book lending 150, is randomly determined from the authentication page unit 123, the cover information of the real reference book, the real reference book The authentication page information transmitted to the digital reference book lending unit 150 by entering the random page information and user code is received. On the other hand, in the digital reference book providing system 1000 according to the present invention, authentication pages (h) are all set to be the same for each physical reference book, complying with the so-called 1:1 principle of a physical reference book and a digital reference book. This 1:1 principle will be described later with reference to FIG. 9 .

As shown in FIG. 4, the student terminal 10 has a cover (f) of the actual reference book corresponding to the cover information, and a random page in the actual reference book corresponding to the random page information randomly determined by the authentication page unit 123 ( g) and the authentication page (h) as described above are photographed through a camera control application, respectively, and an extended image including a cover (f), a random page (g), and an authentication page (h) is generated. The student terminal 10 transmits the generated extension image to the authentication page unit 123 through the camera control application.

The authentication page unit 123 extends the lending authority of the digital reference book of the student terminal 10 by analyzing the received extended image as described above. At this time, the extension of the rental authority is extended with the written date (b, FIG. 5) as the first day.

As the authentication page unit 123 analyzes the extended image including the front cover f and the random page g, problems caused by the secondary distribution of physical reference books as described above are prevented. On the other hand, the authentication page unit 123 can grasp the title of the actual reference book through the image of the cover (f), and can confirm the completeness of the corresponding actual reference book through the image of the random page (g). In the authentication page (h), the holder of the student terminal 10, that is, the user, can be identified by checking the user code (e) and the first date of rental extension (b, FIG. Further use may be restricted to the owner.

5 to 7 are diagrams showing authentication pages included in extended images according to the present invention.

As described above with reference to FIG. 3 , the rental image generated by the student terminal 10 is created by photographing an authentication page (h) in which the user code (e) and the corresponding date (a) are written. Also, as described above, the same physical reference book has the same authentication page (h). Therefore, even when an extension image is created to extend the rental right, the same page is used as the authentication page (h).

The authentication page (h) of the extension image for extending the rental right of the digital reference book uses the authentication page (h) in which the date (a) and the user code (e) have been written for the first time in FIG. 3 . As shown in FIG. 5, the student terminal 10 captures an authentication page (h) on which a new date (b) is written below the initially written date (a), and includes it in the extended image, and includes the extended image. is transmitted to the authentication page unit 123. The authentication page unit 123 extends the lending authority of the digital reference book of the student terminal 10 based on the received extension image. When the rental right is extended again thereafter, as shown in FIG. 6, a new date (c) is written below to extend the rental right, and when the rental right is extended again thereafter, as shown in FIG. Likewise, you can extend the rental right by writing a new date (d) below it.

8 is a diagram showing page analysis through a similarity comparison module between pages using computer vision according to the present invention.

On the other hand, each component of the digital reference book providing server 100 according to the present invention is based on the images received from the student terminal 10, that is, images generated by photographing actual reference books through a camera control application, rental images, and extended images. The included pages are compared with corresponding pages of the digital reference book stored in the database unit 110 and analyzed. Each component of the digital reference book providing server 100 may perform comparison between pages through a similarity comparison module between pages using computer vision.

An example of a similarity comparison module between pages using computer vision of the digital reference book providing server 100 will be described with reference to FIG. 8 below. On the other hand, in this specification, an example of a similarity comparison module between pages using computer vision of the digital reference book providing server 100 is described through a random page (g) requested by the authentication page unit 123 when extending the rental right. Page analysis through a similarity comparison module between pages using computer vision can operate in the same way not only on the random page (g) but also on other pages (f and h).

When generating an extended image, the student terminal 10 according to the present invention photographs a random page g randomly determined by the authentication page unit 123 . The student terminal 10 includes the random page g in the extended image and transmits it to the authentication page unit 123. The authentication page unit 123 uses a similarity comparison module between pages using computer vision when analyzing random pages in the received extended image.

Referring to FIG. 8, the similarity comparison module between pages using computer vision according to the present invention first searches for digital references stored in a database. At this time, the digital reference book to be searched can be searched for a digital reference book corresponding to the physical reference book based on the title of the cover (f) of the physical reference book photographed by the student terminal 10 . Thereafter, the similarity comparison module searches for a page in the digital reference book corresponding to the random page (g) photographed. Then, the similarity comparison module extracts feature points from the searched page. The extracted feature points are compared with the feature points of the random page (g) in the extended image. The similarity comparison module verifies the completeness of the actual reference book and extends the rental authority if it is determined that the feature points are identical within the error range after comparing the feature points.

9 is a diagram showing that all authentication pages in the same physical reference book are set identically.

Referring to FIG. 9 , the digital reference book providing system 1000 according to the present invention sets all certified pages (h) to be the same for each physical reference book, complying with the so-called 1:1 principle of physical reference book and digital reference book. 9 shows two actual reference books written as book 1 and book 2. The authentication page (h) of book 1 is set to the same page as the authentication page (h) regardless of the user. In addition, the authentication page (h) of book 2 is also set to the same page as the authentication page (h) regardless of the user. The authentication pages (h) of book 1 and book 2 may be different or the same. As such, since the authentication pages (h) of the same reference book are the same, problems caused by secondary circulation of one physical reference book can be prevented when purchase and possession certification is performed based on the actual reference book.

In summary, the digital reference book providing system 1000 according to the present invention includes a plurality of student terminals 10, and when the authentication page unit 123 transmits authentication page information to the plurality of student terminals 10, the same In the case of a reference book, the same page is determined as the authentication page (h) and transmitted to a plurality of student terminals 10 respectively. Therefore, physical reference books and digital reference books should correspond 1:1.

10 is a diagram showing each configuration of the digital reference book conversion server 200 according to the present invention.

As described above, the digital reference conversion server 200 receives digital references converted into PDF, Word, hwp, etc. based on actual references from external servers 20 such as publishers, and extracts and manages elements from each digital reference. do.

Referring back to FIG. 1 , a digital reference book providing system 1000 through purchase authentication of a physical reference book according to the present invention includes a digital reference book conversion server 200 . The digital reference book conversion server 200 separates, extracts, stores, and manages each element of content included in a digital reference file created in a portable document format (PDF), hwp, doc, etc. (hereinafter referred to as 'PDF') format . The digital reference book conversion server 200 may extract, store, and manage each element from the PDF file of the digitized reference book, group the elements, and provide the elements to the student terminal 10 .

Referring to FIG. 10 , the digital reference book conversion server 200 according to the present invention includes a file creation unit 210, a region detection unit 220, and an element extraction unit 230.

The file generator 210 extracts a plurality of pages from the digitized PDF file of the reference book and creates a page file. That is, the file generator 210 creates a page file by dividing a plurality of pages of the PDF file into single pages.

The PDF file from which the file creation unit 210 extracts pages may be a PDF file that has been created and stored in the database unit 250 that the digital reference book conversion server 200 separately includes. A PDF file from which the file generator 210 extracts pages may receive a PDF file generated by scanning a reference book by the student terminal 10 such as a smartphone, a scanner, or a multifunction device. Alternatively, the PDF file from which the file generator 210 extracts pages may be received from another external server 20 connected through a communication network. A PDF file created by scanning a reference book includes a plurality of pages. The file generator 210 extracts a plurality of pages into a single page and creates a page file.

Meanwhile, the PDF file from which the file creation unit 210 extracts pages may be a structured PDF or a scanned PDF file depending on how it is created. Structured PDF is a PDF file created electronically using computer software, and Scanned PDF is a PDF file created in the form of an image using a specific book in the real world. The big difference between Structured PDF and Scanned PDF is that in Structured PDF, referring to Figure 1 below, each element such as text, image or table included in each page can be identified and extracted according to selection. The blue highlighted part in Figure 1 shows the selected element. Unlike Structured PDF, in Scanned PDF, referring to Figure 2 below, it is impossible to select and extract each element. Therefore, when the prepared PDF file is Scanned PDF, the file creation unit 210 constructs the Structure through the OCR process. restore At this time, the OCR process may be performed by the optical character recognition unit 240 to be described later. Alternatively, if the prepared PDF file is a scanned PDF, the file creation unit 210 extracts the question area, the answer area, and the commentary area by the area detection unit 220 to be described later without going through the OCR process, and the extracted area Images may be stored and managed in the database unit 250 as well as the above-described database unit 110 .

<Figure 1: Structured PDF>

<Figure 2: Scanned PDF>

The digitized reference book according to the present invention includes a workbook and a commentary book.

First, when the reference book is a workbook, the area detection unit 220 according to the present invention, in the page file generated by the file creation unit 210, includes the entire image of the page file, text included in the page file, HTML, CSS, and Fonts. , Background vector image, etc. are extracted. After that, the area detection unit 220 converts each page file into an HTML page. When Structured PDF is converted to HTML page, each element can be detected (clickable) after conversion, and for Scanned PDF, the entire page is extracted as a single image while each element is undetectable. Therefore, as described above, the scanned PDF needs to be converted into a form in which characters/numbers in the image can be detected through OCR processing. Meanwhile, after the region detection unit 220 converts each page file into an HTML page, an id value is assigned to an identified element within each page. At this time, the selectable element includes each element such as text, image, or table, and may include, for example, a problem area, a question area and an answer area within the problem area, and a number option within the answer area.

However, the class id value given to the selectable element is generated based on the location information within each page in the process of converting PDF to HTML page, and the id value has no meaning. Therefore, in order to group these id values into semantic units, such as pages, problems, views, or multiple-choice questions, the following machine learning process is performed on the image of the page file. In this case, grouping may mean, for example, grouping problems, examples, and multiple-choice questions attached to one passage.

The area detection unit 220 first detects a problem area in each page file, assigns an ID, and separates the problem area into a question area and an answer area requiring interaction and detects it. An id (Sub-id) is also assigned to the detected question area and answer area. In addition, the area requiring interaction within the problem area may differ for each subject in the reference book. For example, in the case of Korean or English, there is a bundled text, and this bundled text provides both the text and the problem at the same time for the convenience of learners. It is desirable to be able to view it on one screen.

The area detection unit 220 according to the present invention detects a problem area (Fig. 4, A) in the page file extracted by the file creation unit 210. The area detection unit 220 may extract object information in a JSON (JavaScript Object Notation) format using the fitz library. The fitz library can extract text from a page as shown in Figure 3 below.

<Figure 3>

The area detection unit 220 detects text from the page through the fitz library. The area detection unit 220 may detect each problem area as shown in Figure 4 below, with the boundary between the text space or the vertical length longer than the other text space or vertical length.

When detecting problem areas in each page file, the area detection unit 220 may generate a bounding box surrounding each problem area using machine learning. The region detection unit 220 may add a unified background color to the problem region within the bounding box generated by machine learning. The region detection unit 220 determines whether other problem regions exist by expanding adjacent pixels in the remaining region except for the bounding box through opencv.

Only the information within the bounding box generated by the region detection unit 220 is allocated to the work region, and the processing speed according to the present invention can be faster than processing the entire page. Meanwhile, the area detection unit 220 detects and stores information about the position and size of the created bounding box.

On the other hand, when the region detector 220 detects a problem region in each page file, the x coordinate (x1) of the leftmost point and the x coordinate (x1) of the rightmost point of the bounding box are higher than the x coordinate (x half) of the midpoint in the horizontal direction of the page. When the value of x2) is larger, it can be determined that the layout of the page is two columns. The midpoint coordinates in the horizontal direction of the page may be coordinate values corresponding to the center point of the entire page or the center of a line segment connecting the left and right sides of the page.

<Figure 4>

The area detection unit 220 separates the detected problem area into a question area and an answer area (B, FIG. 5) as shown in FIG. 5 below. When dividing the problem area into a question area and an answer area, the area detector 220 first selects and extracts the answer area, and selects the remaining problem areas excluding the selected answer area as the question area.

Problem areas can be arranged horizontally or vertically. If the problem areas are arranged vertically, the selection of answer areas is as follows.

When detecting a problem area in a page file, the area detection unit 220 may detect a row including a circle number. When a series of consecutive circular numbers is detected at the leftmost side of a row by the area detection unit 220 and a series of consecutive circular numbers are detected in a downward direction in a column of the circular numbers, the area detection unit 220 has a problem. Select an area containing a sentence containing a circle number detected in the area as an answer area.

In addition, when the problem areas are horizontally aligned, the area detection unit 220 may detect rows included so that the circle number continuously increases when detecting the problem areas in the page file. When a series of consecutive circle numbers is detected along a row by the region detector 220 and the next circle number is detected in the next row, the region detector 220 detects a sentence containing the circle number detected in the problem region. Select the area with the as the answer area.

<Figure 5>

As shown in Figure 6 below, the element extraction unit 230 extracts elements (C to F, Figure 6) from the question area and answer area separated by the area detection unit 220, and extracts the extracted elements into the database unit 250. save to At this time, the elements include a problem index (C), text (D), image (E), text box (not shown), and table (not shown). When extracting the problem index C, the element extractor 230 selects and extracts the index located on the leftmost side of the question area. The element extraction unit 230 may select and extract the image E from the problem area. The problem index extracted by the element extraction unit 230 can be used for scoring automation by being connected to an answer area of a commentary book, which will be described later.

Except for the problem index (C) and the image (E) extracted from the question area by the element extraction unit 230, the rest may be text (D). At this time, each text may be selected and extracted based on a region having a different bounding box according to each position of the text. Meanwhile, the element extraction unit 230 may select and extract a series of options (F) from text in the selected question area. A series of options (F) are 'a. you. c.', '(a) (b) (c)', 'a. me. all.' Alternatively, when '(a) (b) (c)' is detected in series, the sentences or the area can be selected and extracted as a series of options (F).

The element extraction unit 230 stores the selected and extracted elements in the database unit 250. Each element selected and extracted by the element extraction unit 230 has a bounding box, and the area within the bounding box is stored in the database unit 250 in the form of an image.

In addition, the element extraction unit 230 determines a sentence including a circle number as an option in an area selected as an answer area because the above-described area detection unit 220 has a sentence including a circle number in the problem area. The element extraction unit 230 extracts the aforementioned elements from the answer area including the options, and stores the extracted elements in the database unit 250.

<Figure 6>

On the other hand, depending on the subject type of the reference book, there may be a difference in the format of the problem. For example, if the subject of the reference book is mathematics, formulas may exist in the problem area. Elements extracted by the element extractor 230 may further include formulas, and when the element extractor 230 extracts formula elements within the problem area, MathML for formulas using MatchOCR (eg, Mathpix). Alternatively, you can extract formulas in LaTex format. On the other hand, it is not limited to extracting formula elements from the problem area only when the subject of the reference book is mathematics, and formula elements can be extracted anytime when formulas in the problem area are detected.

Also, if the subject of the reference book is Korean or English, a bundled passage can be included as shown in Figure 7 below. Bundled fingerprints refer to fingerprints in which a plurality of questions are included in one fingerprint.

The area detection unit 220 may detect a bundled fingerprint number (G, FIG. 7) at the top of the problem area. When a bundled fingerprint number is detected, the area detection unit 220 performs a document merging operation to include a problem area corresponding to the bundled fingerprint number (refer to the description area to be described later), and the area including the bundled fingerprint number. Create a bounding box in At this time, the area detection unit 220 may create a bounding box to include problem areas according to bundled fingerprint numbers. For example, as shown in Figure 5, when '35 to 37' is the bundled fingerprint number, the area detection unit 220 generates a bounding box to include the problem areas with problem indexes 35 to 37 (C) together with the bundled fingerprint. do. In addition, when the element extraction unit 230 extracts elements from the question area and the answer area and stores them in the database unit 250, it also extracts elements from the aforementioned bundled fingerprints and stores them in the database unit 250. At this time, the question area and Elements extracted from the answer area and elements extracted from the bundled fingerprints may be stored in the database unit 250 so as to be connected to each other.

The detection of bundled fingerprints is not limited only to cases where the subject of the reference book is Korean or English, and whenever the area detection unit 220 detects a number array in the form of 'numbers to numbers' such as the aforementioned bundled fingerprint number, bundled fingerprint elements can be extracted and stored.

On the other hand, there are cases in which bundled fingerprints in a specific area are not assigned a bundle number as shown in <Figure 7> below. In this case, after each problem area is detected, the remaining area is defined as a fingerprint area and the remaining area is determined through the inspection procedure for each page. The mapping process can be carried out by fingerprinting the relevant problem areas and post-correction.

<Figure 7>

The element extraction unit 230 extracts the extracted elements, that is, the problem index (C), text (D), image (E), text box (not shown), table (not shown), a series of options (F), and page information. They are grouped into one problem and stored in the database unit 250. The grouped elements may be provided to the student terminal 10 by a problem providing unit 260 to be described later. When there is a bundled fingerprint, it is preferable that problems corresponding to one bundled fingerprint are simultaneously provided on one screen. Therefore, the element extraction unit 230 determines whether there is a bundled fingerprint in the page file, how many questions the questions correspond to the bundled fingerprint, that is, which problem index it has, and if the bundled fingerprint is turned over, the page information at that time. are extracted and stored in the database unit 250. When grouping the extracted elements, the element extraction unit 230 may assign a specific class id value to the corresponding elements.

The problem providing unit 260 provides the elements grouped by the element extracting unit 230 to the screen of the student terminal 10 . At this time, the provided elements may be provided as an html layer in a state of being arranged at positions suitable for each position value.

Meanwhile, the problem providing unit 260 may provide a multi-layer structure to the student terminal 10 . That is, a writing layer for writing may be further provided on the html layer in which grouped problems are provided to the student terminal 10 . The student terminal 10 may proceed with writing and problem solving in the writing layer provided on the html layer. The problem providing unit 260 may recognize an answer check through a library capable of recognizing handwriting written in the handwriting layer. At this time, if the answer is checked in the handwriting method in the handwriting layer at the same position as the position value where any circle number included in the answer area of the html layer is located, the problem providing unit 260 is the problem index of the answer area to be described later It is possible to automate the scoring of the problem by comparing the answer check of the student terminal 10 and the correct answer based on the correct answer.

If the digitized reference book according to the present invention is a commentary book including answers and explanations of problems according to the workbook, the area detection unit 220 extracts the entire image file from the page file. The area detection unit 220 extracts a commentary area from the extracted image file. At this time, the extraction of the commentary area can be performed by the same process as the detection of the problem area described above.

On the other hand, when the area detection unit 220 extracts the commentary area, in the n-column configuration first in the entire image file extracted from each page file, referring to Figure 8 below, the dividing line (midline, H, figure 8) can be detected. In addition, the region detection unit 220 may also detect an outer line (I, Fig. 8), which is the innermost dividing line constituting the content within each page. The region detection unit 220 may cut images containing internal contents based on the center line and the outer line, and merge them into one image by cutting them based on the center line. An example of merging into one image is shown in Figure 9. Such a merged image may be one in which images corresponding to all pages of the commentary area are merged into a single image.

<Figure 8>

<Figure 9>

In the element extraction unit 230, the area detection unit 220 divides the image in which the commentary book PDFs are merged into one into each chapter area.

When the element extractor 230 divides the merged image into chapter areas, referring to FIG. 10, a first delimiter for dividing the chapters is selected, and referring to FIG. 11, feature points of the selected first delimiter are extracted and , Referring to Figure 12, each chapter can be distinguished by detecting a second delimiter based on the extracted first delimiter.

<Figure 10>

<Figure 11>

<Figure 12>

The element extraction unit 230 separates the merged commentary book images by chapter and section through the above-described feature points, and extracts page information and problem indexes by chapter. The element extraction unit 230 extracts correct answers and explanations for each problem index and stores them in the database unit 250. The element extraction unit 230 connects the problem index in the above-described problem area and the problem index in the description area to each other. Therefore, as described above, the problem providing unit 260 compares the location information of the answer check of the student terminal 10 with the location information of the answer area of the question to automatically score the question.

The digital reference book providing system 1000 through purchase authentication of physical reference books according to the present invention concludes a copyright license agreement with reference book publishers and/or their distributors for distributing specific reference books, receives books for distribution, , PDF files of specific reference books can be received from external servers 20 provided by reference book publishers and/or their distributors.

The digital reference book conversion server 200 according to the present invention builds a website and/or application-based sales channel and an application that can operate the digitally converted reference book, and sends the built application to the student terminal 10 It may further include an application providing unit (not shown) provided as . The application built by the application providing unit is installed in the student terminal 10 .

The student terminal 10 generates an ID in the sales channel established by the application providing unit and purchases reference books such as books. The student terminal 10 can use the digitally converted reference book by authenticating the ID on the application.

The student terminal 10 acquires the right to read and use the digitally converted reference book having the same contents as the purchased reference book when the purchase confirmation process is completed after receipt of the purchased reference book.

On the other hand, the application built by the application providing unit according to the present invention may have the following safety devices implemented.

First, a procedure for verifying whether the purchaser of the reference book and the owner of the student terminal 10 who logged in are the same may be implemented in the application through login and channel authentication procedures.

In addition, in the application, there is a procedure for requesting an expression of intent to confirm an irrevocable purchase from the student terminal 10 that purchased the reference book and providing access to the digital reference book to the student terminal 10 only when there is an expression of intent to confirm purchase. can be implemented This is to prevent users who have not purchased reference books from using digital reference books, which are an additional function of purchasing reference books.

On the other hand, when the application provides a digital reference to the student terminal 10, it may be provided as fragmented pages in a CDN/security-enhanced protocol, not in the form of a PDF file.

The student terminal 10 according to the present invention is a terminal such as a desktop PC, notebook PC, tablet PC, smartphone, scanner, multifunction device, etc. having an input means such as a keyboard, mouse, touch pad, or touch screen, and a display screen. , but not limited thereto, of an application program capable of accessing the digital reference book providing server 100 and the digital reference book conversion server 200 through a communication network, inputting search information and selection information, and displaying search result information. Any configuration capable of processing digital information that can be installed may be included. The student terminal 10 according to the present invention is a component that transmits and receives information by accessing the digital reference book providing server 100 and the digital reference book conversion server 200 through a communication network, for example, a smartphone or a tablet PC. (tablet personal computer), mobile phone, video phone, desktop personal computer (laptop personal computer), netbook computer, personal digital assistant (PDA), portable multimedia player (PMP) , It may include at least one of a wearable device (eg, smart glasses, a head-mounted-device (HMD), etc.), a kiosk, or a smart watch) .

The student terminal 10 according to the present invention, the digital reference book providing server 100 and the digital reference book conversion server 200 may communicate through a communication unit and a communication network, respectively. A communication network refers to a connection structure capable of exchanging information between nodes such as terminals and servers. Examples of such a communication network include a 3rd Generation Partnership Project (3GPP) network, a Long Term Evolution (LTE) network, and 5G Network, WIMAX (World Interoperability for Microwave Access) network, Internet (Internet), LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), wifi network, A Bluetooth network, a satellite broadcasting network, an analog broadcasting network, a Digital Multimedia Broadcasting (DMB) network, etc. are included, but are not limited thereto. The communication unit provided by the student terminal 10, the digital reference book providing server 100, and the digital reference book conversion server 200, respectively, includes electronic components provided for the communication network to perform wired and wireless data communication through the above-described communication network. can do.

The database unit 110 and the database unit 250 according to the present invention may include a database management system (DBMS). A DBMS is a set of software tools that allow multiple users to access data in the database unit 110 and database unit 250. DBMS includes IMS, CODASYL DB, DB2, ORACLE, INFORMIX, SYBASE, INGRES, MS-SQL, Objectivity, O2, Versanat, Ontos, Gemstone, Unisql, Object Store, Starburst, Postgres, Tibero, MySQL or MS-access can do. DBMS can access specific data according to the input of a specific command.

In this specification, each component included in the digital reference book providing server 100, that is, the database unit 110, the purchase authentication unit 120, the authentication code transmission unit 121, the authentication page unit 123, and the entry location unit 125 , Digital reference book payment unit 130, digital reference book providing unit 140, digital reference book lending unit 150, and each component included in digital reference book conversion server 200, that is, file generation unit 210, area detection unit 220 ), the element extraction unit 230, the optical character recognition unit 240, and the problem providing unit 260 may be processors that execute successive processes stored in memory. Or, it can operate as software modules driven and controlled by a processor. Further, a processor may be a hardware device.

In this specification, a "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Further, one unit may be realized using two or more hardware, and two or more units may be realized by one hardware.

The protection scope of the present invention is not limited to the description and expression of the embodiments explicitly described above. In addition, it is added once again that the scope of protection of the present invention cannot be limited due to obvious changes or substitutions in the technical field to which the present invention belongs.

10: student terminal 20: external server
100: digital reference book providing server 110: database unit
120: purchase authentication unit 121: authentication code transmission unit
123: authentication page part 125: writing position part
130: digital reference payment unit 140: digital reference book provision unit
150: Digital reference book rental 200: Digital reference book conversion server
210: file generation unit 220: area detection unit
230: element extraction unit 240: optical character recognition unit
250: database unit 260: problem provision unit
1000: Digital reference book provision system through purchase authentication of actual reference book

Claims (5)

In a digital reference book providing system through purchase authentication of physical reference books, including a digital reference book providing server that extracts, stores and manages elements of digitized reference books, and provides them to student terminals,
The digital reference book providing server,
a database unit in which the digital reference book and the elements are stored;
a purchase authentication unit authenticating the purchase of an actual reference book through the image received from the student terminal;
A digital reference book payment unit that provides payment for digital reference books to student terminals for which purchase of physical reference books has been authenticated; and
a digital reference book providing unit that provides the digital reference book to a student terminal that has paid for the digital reference book;
Including, it is possible to certify the purchase of a physical reference book and provide a digital reference book using a physical reference book,
The purchase certification unit,
an authentication code transmitter for transmitting an authentication code to the student terminal;
an authentication page unit for transmitting authentication page information of the physical reference book to the student terminal; and
a writing location unit that transmits writing location information in which the authentication code is to be written in the authentication page to the student terminal;
including,
The digital reference book providing server,
Further comprising a digital reference book lending option that provides the student terminal with the lending authority of the digital reference book corresponding to the real reference book based on the user code,
The authentication page unit,
Transmitting cover information of the physical reference book, randomly determined random page information, and authentication page information to the student terminal;
The student terminal,
The cover of the physical reference book corresponding to the cover information, the random page of the physical reference book corresponding to the random page information, and the authentication page corresponding to the authentication page information in which the user code and date are written are photographed to generate extended images, respectively , transmits the generated extended image to the authentication page unit,
Wherein the authentication page unit extends the lending authority of the digital reference book of the student terminal based on the received extension image. The method of claim 1,
The student terminal generates the image by photographing the authentication page of the physical reference book in which the authentication code is written in the entry position, and transmits the generated image to the purchase authentication unit;
The purchase certification unit,
The authentication code written in the generated image received from the student terminal, the location information in which the authentication code is written, and the authentication page of the physical reference book, the authentication code transmitted by the authentication code transmitter to the student terminal, the entry A digital reference book providing system through authentication of purchase of a physical reference book, characterized in that the purchase of the physical reference book is authenticated by comparing the entry location information transmitted to the student terminal by the location unit with the authentication page of the digital reference book stored in the database unit. . The method of claim 2,
The digital reference book rental
Generating the user code and transmitting it to the student terminal;
The student terminal generates a rental image by photographing the authentication page on which the user code and the date are written, and transmits the generated rental image to the digital reference book rental facility;
The digital reference book providing system through authentication of purchase of an actual reference book, characterized in that the digital reference book rental service provides the student terminal that has transmitted the rental image with the lending authority of the digital reference book. delete The method of claim 1,
The digital reference book providing system,
Including a plurality of student terminals,
The authentication page unit,
When the authentication page information is transmitted to the plurality of student terminals, if it is the same reference book, the same page is determined as the authentication page and transmitted to the plurality of student terminals, so that the physical reference book and the digital reference book correspond 1: 1 Characterized in that, a digital reference book providing system through purchase authentication of physical reference books.

Images