WO2024090615A1 - System for providing digital reference book through purchase authentication of physical reference book - Google Patents

System for providing digital reference book through purchase authentication of physical reference book Download PDF

Info

Publication number
WO2024090615A1
WO2024090615A1 PCT/KR2022/016597 KR2022016597W WO2024090615A1 WO 2024090615 A1 WO2024090615 A1 WO 2024090615A1 KR 2022016597 W KR2022016597 W KR 2022016597W WO 2024090615 A1 WO2024090615 A1 WO 2024090615A1
Authority
WO
WIPO (PCT)
Prior art keywords
reference book
authentication
unit
digital reference
page
Prior art date
Application number
PCT/KR2022/016597
Other languages
French (fr)
Korean (ko)
Inventor
최현욱
Original Assignee
주식회사 테스트뱅크
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 테스트뱅크 filed Critical 주식회사 테스트뱅크
Priority to PCT/KR2022/016597 priority Critical patent/WO2024090615A1/en
Publication of WO2024090615A1 publication Critical patent/WO2024090615A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/08—Payment architectures
    • G06Q20/14—Payment architectures specially adapted for billing systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education

Definitions

  • the present invention relates to a system for providing digital reference books, and more specifically, to a system for providing digital reference books through purchase authentication of physical reference books, which can provide digitized reference books based on the physical reference books through purchase authentication of physical reference books. .
  • Publishers publish reference books necessary for learning various subjects such as Korean, English, social studies, science, and English for a variety of audiences, including elementary school students, middle school students, high school students, college students, and those preparing for civil service exams. Such reference books are published as books and sold to consumers belonging to the above-mentioned target groups.
  • reference books in digital form not only eliminate inefficiencies in transporting books, but can also create an effective learning environment by collecting and analyzing users' learning history and providing personalized learning, increasing the need for technology that allows reference books to be used on digital devices. It is emerging.
  • a method is emerging that allows users, such as students who have purchased a physical reference book, to rent and read a digital reference book with the same content as the physical reference book through a smartphone, tablet, and/or PC.
  • the purpose of the present invention to solve the above-mentioned problems is to provide a system for providing digital reference books through purchase authentication of physical reference books, which enables purchase authentication of physical reference books.
  • Another purpose of the present invention to solve the above-mentioned problems is to provide a digital reference book provision system through purchase authentication of a physical reference book that can provide a digital reference book including the contents of the physical reference book to the purchaser or holder of the physical reference book.
  • Another purpose of the present invention to solve the above-mentioned problems is to provide a digital reference book provision system through purchase authentication of physical reference books that can extract and manage each element from a digitized digital reference book and provide it to the user. .
  • the system for providing digital reference books through purchase authentication of physical reference books extracts, stores and manages elements of digitized reference books, and provides them to student terminals.
  • It is a digital reference book providing system through purchase authentication of physical reference books including a digital reference book providing server, wherein the digital reference book providing server includes a database unit storing the digital reference book and the elements, and an image received from the student terminal to provide physical reference books.
  • It includes a purchase authentication department that authenticates the purchase, a digital reference book payment department that provides payment for digital reference books to student terminals for which the purchase of physical reference books has been certified, and a digital reference book provision department that provides the digital reference books to student terminals that have paid for digital reference books.
  • It is characterized by the ability to authenticate the purchase of a physical reference book and provide a digital reference book using a physical reference book.
  • the purchase authentication unit includes an authentication code transmitting unit that transmits an authentication code to the student terminal, an authentication page unit that transmits authentication page information of the physical reference book to the student terminal, and an authentication code that is entered into the authentication page by the student terminal. It includes an entry location unit that transmits entry location information, and the student terminal generates the image by photographing the authentication page of the physical reference book in which the authentication code is written at the entry location, and uses the generated image to authenticate the purchase.
  • the purchase authentication unit transmits the authentication code written in the generated image received from the student terminal, the location information where the authentication code is written, and the authentication page of the physical reference book, and the authentication code transmitter sends the authentication code to the student. Characterized in that the purchase of the physical reference book is authenticated by comparing the authentication code sent to the terminal, the entry location information sent by the entry location unit to the student terminal, and the authentication page of the digital reference book stored in the database unit.
  • the digital reference book providing server further includes a digital reference book rental unit that generates a user code and transmits it to the student terminal, and the student terminal generates a rental image by photographing the authentication page on which the user code and date are written. , the generated rental image is transmitted to the digital reference book rental unit, and the digital reference book rental unit provides rental rights for the digital reference book to the student terminal that transmitted the rental image.
  • the authentication page unit transmits cover information of the physical reference book, randomly determined random page information, and the authentication page information to the student terminal, and the student terminal transmits the cover information of the physical reference book corresponding to the cover information, the random page information, and the authentication page information.
  • An extension image is generated by photographing a random page of the actual reference book corresponding to the page information and the authentication page corresponding to the authentication page information with the user code and date written thereon, and sending the generated extension image to the authentication page unit.
  • the authentication page unit is characterized in that it extends the rental authority of the digital reference book of the student terminal based on the received extension image.
  • the digital reference book providing system includes a plurality of student terminals, and the authentication page unit, when transmitting the authentication page information to the plurality of student terminals, determines the same page as the authentication page if it is the same reference book and determines the authentication page for the plurality of student terminals. It is characterized in that it is transmitted to each student terminal so that the physical reference book and the digital reference book correspond 1:1.
  • the system for providing digital reference books through purchase authentication of physical reference books has the effect of enabling purchase authentication of physical reference books.
  • a system for providing digital reference books through purchase authentication of physical reference books it is possible to extract and manage each element from a digital reference book in which the physical reference book has been digitized and provide it to the user.
  • Figure 1 is a diagram illustrating each configuration of a system for providing digital reference books through purchase authentication of physical reference books according to the present invention.
  • Figure 2 is a diagram showing the authentication page of the physical reference book taken when authenticating the purchase of the physical reference book according to the present invention.
  • Figure 3 is a diagram showing the user code and date written on the authentication page according to the present invention.
  • Figure 4 is a diagram showing the cover, random page, and authentication page of a physical reference book taken when extending rental authority according to the present invention, respectively.
  • FIGS 5 to 7 are diagrams showing an authentication page included in an extended image according to the present invention.
  • Figure 8 is a diagram showing page analysis through a similarity comparison module between pages using computer vision according to the present invention.
  • Figure 9 is a diagram showing that all authentication pages within the same physical reference book are set the same.
  • Figure 10 is a diagram showing each configuration of the digital reference book conversion server according to the present invention. 11 to 22 show specific examples to explain the present invention.
  • first, second, A, B, (a), and (b) may be used. These terms are only used to distinguish the component from other components, and the nature, sequence, or order of the component is not limited by the term.
  • the student and the student terminal 10 are a general user who has purchased or possesses a physical reference book and a student terminal 10 that is provided with a digital reference book by accessing the digital reference book providing server 100. do.
  • a physical reference book refers to a physical book that a student can actually possess and can be contrasted with a digital reference book.
  • the digital reference book providing server 100 is a digital reference book and/or digital reference book conversion server 200 that extracts, stores, and manages the contents of a physical reference book from a PDF file, etc.
  • a digital reference book created by recombining (elements) can be provided to the student terminal (10).
  • the digital reference book providing server 100 enables access to digital reference books only to purchasers of physical reference books and/or holders of physical reference books, and provides authentication of purchase of the physical reference book and/or certification of possession of the physical reference book on a specific page of the physical reference book. It is carried out in conjunction with.
  • the student terminal 10 can view the digital reference book provided from the digital reference book providing server 100 after authentication and/or payment, which will be described later.
  • Figure 1 is a diagram illustrating each configuration of a system 1000 for providing digital reference books through purchase authentication of physical reference books according to the present invention.
  • the system 1000 for providing digital reference books through purchase authentication of physical reference books includes a student terminal 10, a digital reference book providing server 100, and an external server 20.
  • the digital reference book providing server 100 includes a database unit 110, a purchase authentication unit 120, a digital reference book payment unit 130, a digital reference book provision unit 140, and a digital reference book rental unit 150. Includes.
  • the digital reference book providing system 1000 receives digital reference books digitized into PDF, Word, HWP, etc. based on physical reference books from an external server 20, such as a publisher, and extracts elements from each digital reference book. It may further include a digital reference book conversion server 200 that extracts and manages the book.
  • the digital reference book conversion server 200 transmits the extracted elements and the received digital reference book to the database unit 110 of the digital reference book providing server 100.
  • the digital reference book providing server 100 may provide a digital reference book transmitted to the database unit 110 by the digital reference book conversion server 200 or a digital reference book created by recombining extracted elements to the student terminal 10.
  • the external server 20, such as a publisher may include a publisher terminal (not shown).
  • Each component of the digital reference book providing server 100 and/or the digital reference book conversion server 200 according to the present invention may be driven by a known library.
  • the digital reference book providing server 100 and/or the digital reference book conversion server 200, especially the digital reference book conversion server 200 includes PDF library fitz, which is used to convert PDF images and extract text for each page, and image transformation.
  • PDF library fitz which is used to convert PDF images and extract text for each page, and image transformation.
  • Libraries such as opencv (Open Source Computer Vision), a computer vision library used in boundary line extraction, object detection pytorch and tensorflow, used as object detection model learning, prediction, and tools, and MathPix, used as MathML and LaTex grammar OCR API, are available on Python. It may be driven, but is not limited to this.
  • the digital reference book providing server 100 and/or the digital reference book conversion server 200 can run libraries such as numpy, sklearn, re, and glob on Python, and use the Font-forge library. Text can be detected on a PDF and matched with a suitable font to extract it in a form that can be rendered. Font format can be calculated in the form of TTF, TTF2, OTF, woff, etc., but is not limited to this. Meanwhile, the detailed configuration of the digital reference book conversion server 200 will be described later with reference to FIG. 10.
  • the purchase authentication unit 120 authenticates the purchase and/or possession of a physical reference book by the holder of the student terminal 10, that is, the student, through the image received from the student terminal 10.
  • the student terminal 10 includes a camera module (not shown) capable of taking pictures, and a camera control application (not shown) that controls the camera module.
  • the student terminal 10 creates an image by photographing a specific page of the physical reference book, and transmits the generated image to the purchase authentication unit 120.
  • the purchase authentication unit 120 can authenticate the purchase and possession of the physical reference book by the owner of the student terminal 10 based on the received image. The purchase and ownership authentication of the physical reference book in the purchase authentication department 120 will be described later.
  • the digital reference book payment unit 130 is used to verify the purchase and/or possession of the physical reference book by the student terminal 10.
  • Payment for digital reference books can be provided.
  • the payment provision process of the digital reference book payment unit 130 follows a known process, and, for example, can be connected to an external payment server (not shown) to provide payment for digital reference books.
  • the digital reference book providing unit 140 provides the digital reference book stored in the database unit 110 to the student terminal 10 for which payment for the digital reference book has been completed. Therefore, the digital reference book provision unit 140 can provide a digital reference book to the student terminal 10 for which purchase authentication has been completed through a physical reference book.
  • the purchase authentication unit 120 can select and receive only images captured in real time through the above-described camera module as images received from the student terminal 10. That is, when an image pre-stored in the storage space of the student terminal 10 is received, the purchase authentication unit 120 blocks reception of the pre-stored image. Or, even if a pre-stored image is received, post-processing for purchase authentication is not performed. This is because the authentication code to be entered in the authentication page, which will be described later, is tampered with or modified, and purchase authentication and extension of viewing are used bypassing, or secondary distribution such as used transactions of physical reference books results in multiple student terminals (10) based on a single physical reference book. , That is, to prevent digital reference books from being repeatedly provided to multiple users.
  • the digital reference book providing server 100 can provide a separate camera control application to the student terminal 10 for purchasing authentication and/or requesting extension of viewing of a physical reference book.
  • a separate camera control application provided by the digital reference book provision server 100 can control the camera module provided in the student terminal 10.
  • the student terminal 10 uses only a separate camera control application provided by the digital reference book providing server 100 to create an image by photographing a physical reference book as described above, and to generate an image through the separate camera control application. It can be transmitted to the digital reference book provision server 100.
  • the digital reference book providing server 100 receives or post-processes only images transmitted through the separate camera control application to prevent problems arising from secondary distribution of physical reference books as described above, or to provide purchase authentication and/or Circumvention use due to extended viewing can be blocked.
  • Figure 2 is a diagram showing the authentication page of the physical reference book taken when authenticating the purchase of the physical reference book according to the present invention.
  • the purchase and possession authentication of a physical reference book by the purchase authentication unit 120 according to the present invention will be described as follows. Meanwhile, in FIG. 2, two authentication pages are shown on the left and right side as an example, but each physical reference book has only one authentication page.
  • the purchase authentication unit 120 includes an authentication code transmission unit 121, an authentication page unit 123, and an entry location unit 125.
  • the authentication code transmitter 121 transmits an authentication code generated by a known random number generation algorithm to the student terminal 10.
  • the student terminal 10 displays the received authentication code on the display device, and the owner of the student terminal 10 can check the authentication code displayed on the display device.
  • the authentication code transmitted by the authentication code transmitter 121 to the student terminal 10 can simplify the login process through Single Sign On.
  • the authentication code may be a Unique ID value generated through a separate authentication procedure through confirmation of personal information of the student terminal 10. Only one authentication code, which is this Unique ID value, can be assigned to one physical reference book. And one authentication code can grant access from one tablet and one smartphone. When accessing from a new device with the same authentication code, use of the digital reference book may be restricted on undesignated devices.
  • the authentication page according to the authentication page information generated by the authentication page unit 123 and the writing position unit 125 according to the present invention is as shown in FIG. 2.
  • the authentication page unit 123 transmits authentication page information of the physical reference book to the student terminal 10.
  • the authentication page information includes information about a specific page of the physical reference book.
  • the authentication page unit 123 can select a specific page with a background color within the page. Meanwhile, in this specification, the specific page selected by the authentication page unit 123 is referred to as an authentication page.
  • the writing location unit 125 includes information on the writing location where the authentication code in the authentication page will be written in the authentication page information transmitted by the authentication page unit 123 and transmits it to the student terminal 10.
  • the writing location information may be selected to include an area (a) where the background color exists within the specific page selected by the authentication page unit 123.
  • the writing location information at this time may be selected to include an area (a) in which the background color changes among the areas (a) where the background color exists in the specific page selected by the authentication page unit 123.
  • the authentication page unit 123 and the entry position unit 125 are provided to the holder of the student terminal 10 at the entry position (a), which is an area where a background color exists in a specific page and where the background color changes.
  • Information requesting that the above-described authentication code be entered can be included in the authentication page information and transmitted to the student terminal 10.
  • the holder of the student terminal 10 checks the authentication code displayed on the display device of the student terminal 10, and enters the authentication code in the entry position of the page (h) corresponding to the authentication page information in the physical reference book.
  • An image can be created by shooting through a camera control application and a camera module, and the generated image can be transmitted to the purchase authentication unit 120 through a camera control application. That is, the student terminal 10 creates an image by directly photographing the authentication page (h) of the physical reference book on which the authentication code is written at the entry position (a), and transmits the generated image to the purchase authentication unit 120.
  • each component of the purchase authentication unit 120 may require the holder of the student terminal 10 to write the authentication code in the entry position using a non-editable blue or red ballpoint pen. This is to prevent corrections using correction fluid, etc. and to block access when signs of damage are discovered.
  • the purchase authentication unit 120 compares the authentication code written in the image with the authentication code sent by the authentication code transmitter 121 to the student terminal 10, and creates an actual reference book. Perform purchase authentication. At this time, the purchase authentication unit 120 can extract the authentication code written in the image received from the student terminal 10 through a library that can recognize known handwriting. Meanwhile, the library that can recognize handwriting is not limited to being used to extract the authentication code of the purchase authentication unit 120, but is also used to extract the user code and date written on the authentication page, which will be described later.
  • the purchase authentication unit 120 compares the writing position (a) where the authentication code is written in the image received from the student terminal 10 with the writing position sent by the writing position unit 125 to the student terminal 10 to produce a certain error. It is checked whether the authentication code within the range has been entered, and at this time, the purchase authentication unit 120 can compare the entry positions (a) based on the background color or background color change within the page.
  • the purchase authentication unit 120 compares the authentication page (h) included in the image received from the student terminal 10 with the authentication page of the digital reference book stored in the database unit 110 to obtain the authentication page transmitted by the authentication page unit 123. It is determined whether the page of the actual reference book that matches the authentication page was photographed. At this time, determining whether the page (h) in the captured image and the corresponding page in the digital reference book stored in the database unit 110 are the same is based on a similarity comparison module between pages using Computer Vision, which will be described later. However, it is not limited to this and may be based on a similarity comparison module between pages using known computer vision.
  • the digital reference payment unit 130 when the authentication code, authentication page (h), entry location (a), etc. are confirmed by the purchase authentication unit 120 based on the image received from the student terminal 10, As described above, payment for the digital reference book is provided to the student terminal 10, and when payment is completed, the digital reference book providing unit 140 provides the digital reference book to the student terminal 10.
  • digital reference books can be provided to the student terminal 10 in the form of so-called rental of digital reference books with a fixed reading period.
  • the digital reference book provision unit 140 can provide digital reference books provided to the student terminal 10 for a certain period of time, and after a certain period of time, the digital reference book can only be provided to the student terminal 10 with an extended viewing period. there is.
  • the digital reference book rental unit 150 generates a user code (e, Figure 3) based on the authentication code confirmed by the purchase authentication unit 120, the authentication page (h), and the entry location (a), etc., and sends it to the student terminal. Send to (10).
  • the user code (e) transmitted to the student terminal 10 is displayed on the display device of the student terminal 10, so that the holder of the student terminal 10 can check the user code (e).
  • the user code (e) generated by the digital reference book rental unit 150 may be a Hashed User id generated through a known Hash Algorithm.
  • Figure 3 is a diagram showing the user code and date written on the authentication page according to the present invention.
  • the holder of the student terminal 10 enters the confirmed user code (e) and the date (a) corresponding to the rental start date in the form of year, month, and/or day on the authentication page (h) as described above. ), then take a photo of the corresponding authentication page (h) to create a rental image, and then transmit the created rental image to the digital reference book rental unit 150 through the camera control application of the student terminal 10. . That is, the student terminal 10 creates a rental image by photographing the authentication page (h) with the user code (e) and date (a) written on it, and transmits the generated rental image to the digital reference book rental unit 150. .
  • the digital reference book rental unit 150 may provide rental rights for a digital reference book corresponding to the physical reference book to the student terminal 10 that transmitted the rental image.
  • the digital reference book rental department 150 provides the right to rent digital reference books for a certain period of time based on the user code (e) included in the authentication page (h) included in the rental image and with the entered date (a) as the first day.
  • a digital reference book is provided to the received student terminal (10).
  • FIG. 3 is a simplified illustration of the authentication page in FIG. 2.
  • Figure 4 is a diagram showing the cover, random page, and authentication page of a physical reference book taken when extending rental authority according to the present invention, respectively.
  • the student terminal 10 that needs an extension of the rental authority can apply for an extension of the rental authority to the digital reference book rental unit 150.
  • the student terminal 10 which has applied for an extension of rental authority to the digital reference book rental unit 150, receives the cover information of the physical reference book from the authentication page unit 123 and the randomly determined information in the physical reference book. Enter the random page information and user code to receive the authentication page information sent to the digital reference book rental unit 150.
  • the authentication pages (h) for each physical reference book are all set to be the same, thereby complying with the so-called 1:1 principle between physical reference books and digital reference books. This 1:1 principle will be described later with reference to FIG. 9.
  • the student terminal 10 displays the cover (f) of the physical reference book corresponding to the cover information, and a random page (f) in the physical reference book corresponding to the random page information randomly determined by the authentication page unit 123.
  • g) and the authentication page (h) as described above are each photographed through a camera control application to generate an extended image including a cover (f), a random page (g), and an authentication page (h).
  • the student terminal 10 transmits the generated extension image to the authentication page unit 123 through the camera control application.
  • the authentication page unit 123 analyzes the received extension image as described above and extends the rental authority of the digital reference book of the student terminal 10. At this time, the extension of rental authority is extended using the entered date (b, Figure 5) as the first day.
  • the authentication page unit 123 analyzes the extended image including the cover (f) and the random page (g), problems caused by secondary distribution of the physical reference book as described above are prevented. Meanwhile, the authentication page unit 123 can identify the title of the physical reference book through the image of the cover (f) and confirm the completeness of the physical reference book through the image of the random page (g). On the authentication page (h), the user code (e) and the first date of rental extension (b, Figure 5) can be confirmed to identify the holder of the student terminal (10), that is, the user, preventing the loss of the physical reference book due to secondary distribution, etc. Further use may be restricted to the owner.
  • FIGS 5 to 7 are diagrams showing an authentication page included in an extended image according to the present invention.
  • the rental image generated by the student terminal 10 is created by photographing the authentication page (h) on which the user code (e) and the corresponding date (a) are written. Also, as described above, the same physical reference book has the same authentication page (h). Therefore, even when creating an extension image to extend rental rights, the same page is used as the authentication page (h).
  • the authentication page (h) of the extension image for extending the rental authority of the digital reference book uses the authentication page (h) on which the date (a) and the user code (e) were first written in FIG. 3.
  • the student terminal 10 photographs the authentication page (h) with the new date (b) written below the initially entered date (a) and includes it in the extended image, and the extended image is transmitted to the authentication page unit 123.
  • the authentication page unit 123 extends the rental authority of the digital reference book of the student terminal 10 based on the received extension image.
  • the rental authority is extended by writing a new date (c) below it as shown in Figure 6.
  • the rental authority again after that as shown in Figure 7.
  • Figure 8 is a diagram showing page analysis through a similarity comparison module between pages using computer vision according to the present invention.
  • each component of the digital reference book providing server 100 includes images received from the student terminal 10, that is, images generated by shooting a physical reference book through a camera control application, rental images, and extended images.
  • the included pages are analyzed by comparing them with each corresponding page of the digital reference book stored in the database unit 110.
  • Each configuration of the digital reference book providing server 100 can perform comparison between pages through a similarity comparison module between pages using Computer Vision.
  • the student terminal 10 photographs a random page (g) randomly determined by the authentication page unit 123 when generating an extended image.
  • the student terminal 10 includes a random page (g) in the extended image and transmits it to the authentication page unit 123.
  • the authentication page unit 123 uses a similarity comparison module between pages using computer vision when analyzing random pages in the received extended image.
  • the similarity comparison module between pages using Computer Vision first searches digital reference books stored in the database.
  • the digital reference book being searched may be a digital reference book corresponding to the physical reference book based on the title of the cover (f) of the physical reference book photographed by the student terminal 10.
  • the similarity comparison module searches for pages in the digital reference book that correspond to the photographed random page (g).
  • the similarity comparison module extracts feature points from the searched page. The extracted feature points are compared with the feature points of the random page (g) in the extended image.
  • the similarity comparison module checks the completeness of the physical reference book and extends rental authority if it is determined that the feature points are identical within the error range after comparing them.
  • Figure 9 is a diagram showing that all authentication pages within the same physical reference book are set the same.
  • the digital reference book providing system 1000 sets all authentication pages (h) to be the same for each physical reference book, thereby complying with the so-called 1:1 principle between physical reference books and digital reference books.
  • Figure 9 shows two physical reference books labeled book 1 and book 2.
  • the authentication page (h) of book 1 is set to the same page as the authentication page (h) regardless of the user.
  • the authentication pages (h) of book 2 are all set to the same page as the authentication page (h) regardless of the user.
  • the authentication pages (h) of book 1 and book 2 may be different from each other or may be the same. In this way, since the authentication pages (h) of the same reference book are the same, problems that arise due to secondary distribution of one physical reference book can be prevented when purchasing and authenticating possession based on the physical reference book.
  • the digital reference book providing system 1000 includes a plurality of student terminals 10, and the authentication page unit 123 is identical when transmitting authentication page information to a plurality of student terminals 10.
  • the same page is determined as the authentication page (h) and transmitted to a plurality of student terminals (10). Therefore, ensure that there is a 1:1 correspondence between the physical reference book and the digital reference book.
  • Figure 10 is a diagram showing each configuration of the digital reference book conversion server 200 according to the present invention.
  • the digital reference book conversion server 200 receives digital reference books digitized into PDF, Word, HWP, etc. based on physical reference books from an external server 20, such as a publisher, and extracts and manages elements from each digital reference book. do.
  • the system 1000 for providing digital reference books through purchase authentication of physical reference books includes a digital reference book conversion server 200.
  • the digital reference book conversion server 200 separately extracts, stores, and manages each element of content included in a digital reference book file created in a portable document format (PDF), hwp, doc, etc. (hereinafter referred to as 'PDF').
  • PDF portable document format
  • 'PDF' portable document format
  • the digital reference book conversion server 200 can extract, store and manage elements from the PDF file of the digitized reference book, group the elements, and provide them to the student terminal 10.
  • the digital reference book conversion server 200 includes a file creation unit 210, an area detection unit 220, and an element extraction unit 230.
  • the file creation unit 210 extracts a plurality of pages from the PDF file of the digitized reference book and generates a page file. That is, the file creation unit 210 creates a page file in which the plurality of pages contained in the PDF file are separated into single pages.
  • the PDF file from which the file creation unit 210 extracts pages may be a PDF file that has already been created and stored in the database unit 250 separately included in the digital reference book conversion server 200.
  • the PDF file from which the file creation unit 210 extracts pages may be received as a PDF file generated by scanning a reference book by the student terminal 10, such as a smartphone, scanner, or multi-function printer.
  • the PDF file from which the file creation unit 210 extracts pages may be received from another external server 20 connected through a communication network.
  • a PDF file created by scanning a reference book includes multiple pages.
  • the file creation unit 210 generates a page file by extracting a plurality of pages into a single page.
  • the PDF file from which the file creation unit 210 extracts pages may be a Structured PDF or Scanned PDF file depending on how it was created.
  • Structured PDF is a PDF file created electronically using computer software
  • Scanned PDF is a PDF file created in image form using a specific physical book using a scanner, etc.
  • the major difference between Structured PDF and Scanned PDF is that Structured PDF, referring to Figure 11, allows identification of each element, such as text, image, or table included in each page, and extraction based on selection. The blue highlighted portion in Figure 11 indicates that the element is selected.
  • Scanned PDF does not allow selection and extraction of each element, as shown in Figure 12.
  • the file creation unit 210 restores the structure through the OCR process. do.
  • the OCR process may be performed by the optical character recognition unit 240, which will be described later.
  • the file creation unit 210 extracts the question area, answer area, and commentary area by the area detection unit 220, which will be described later, without going through the OCR process, and extracts the extracted area. Images may be stored and managed in the database unit 250 as well as the database unit 110 described above.
  • the digitized reference book according to the present invention includes a workbook and a commentary book.
  • the area detection unit 220 selects the entire image of the page file, text included in the page file, HTML, CSS, and Font from the page file generated by the file creation unit 210. , Background vector image, etc. are extracted. Afterwards, the area detection unit 220 converts each page file into an HTML page.
  • Structured PDF is converted to an HTML page, each element can be detected (clickable) after conversion, and for Scanned PDF, the entire page is extracted as one image while each element cannot be detected. Therefore, as mentioned above, Scanned PDF needs to be converted to a form that allows detection of characters/numbers in the image through OCR processing.
  • selectable elements include each element such as text, image, or table, and may include, for example, a problem area, a question area and answer area within the problem area, and raw number options within the answer area.
  • the class id value assigned to the selectable element is created based on location information within each page during the PDF conversion process to HTML page, so the id value has no meaning. Therefore, in order to group these id values into meaningful units, such as pages, problems, views, or multiple choice questions, the image of the page file is subjected to the machine learning process as follows. At this time, grouping may mean, for example, grouping problems, examples, and multiple-choice questions belonging to one passage.
  • the area detection unit 220 first detects a problem area in each page file, assigns an ID, and detects the problem area by separating it into a question area and an answer area that require interaction. An id (Sub-id) is also assigned to the detected question area and answer area.
  • areas that require interaction within the problem area may differ depending on the subject of the reference book. For example, in the case of Korean or English, bundled passages exist, and these bundled passages combine the passages and problems at the same time for the convenience of the learner. It is desirable to be able to view it on one screen.
  • the area detection unit 220 detects problem areas ( Figure 4, A) in the page file extracted by the file creation unit 210.
  • the area detection unit 220 can extract object information in JSON (JavaScript Object Notation) format using the fitz library.
  • the fitz library can extract text from a page as shown in Figure 13.
  • the area detection unit 220 detects text on the page through the fitz library.
  • the area detection unit 220 can detect each problem area as shown in FIG. 14 using the letter spacing between texts or a portion longer than the letter spacing or vertical length between texts having different vertical lengths as a boundary.
  • the area detection unit 220 may use machine learning to create a bounding box surrounding each problem area.
  • the area detection unit 220 can add a unified background color to the problem area within the bounding box generated through machine learning.
  • the area detection unit 220 determines whether other problem areas exist in the remaining areas excluding the bounding box by inflating adjacent pixels through opencv.
  • the area detection unit 220 detects and stores information about the location and size of the created bounding box.
  • the area detection unit 220 uses the leftmost point x coordinate (x1) and the rightmost point x coordinate ( When the value of x2) is larger, it can be determined that the page layout is two-column.
  • the midpoint coordinates in the horizontal direction of the page may be coordinate values corresponding to the center point of the entire page or the center of the line segment connecting the left and right sides of the page.
  • the area detection unit 220 separates the detected problem area into a question area and an answer area (B, Figure 15) as shown in Figure 15.
  • the area detection unit 220 first selects and extracts the answer area, and selects the remaining problem areas excluding the selected answer area as the question area.
  • problems may be arranged horizontally or vertically. If the problem areas are aligned vertically, the answer area selection is as follows.
  • the area detection unit 220 can detect a row containing a raw number.
  • the area detection unit 220 detects a problem. The area containing the sentence containing the raw number detected in the area is selected as the answer area.
  • the area detection unit 220 can detect rows in which the raw number increases continuously when detecting the problem area in the page file. When a series of consecutive raw numbers are detected along a row by the area detection unit 220, and the next raw number is detected in the next row, the area detection unit 220 detects a sentence containing the raw numbers detected in the problem area. Select the area with this as the answer area.
  • the element extraction unit 230 extracts elements (C to F, FIG. 16) from the question area and the answer area separated by the area detection unit 220 and stores the extracted elements in the database unit 250. Save.
  • the elements include problem index (C), text (D), image (E), text box (not shown), and table (not shown).
  • the element extraction unit 230 selects and extracts the index located on the leftmost side of the question area.
  • the element extraction unit 230 can select and extract the image (E) from the problem area.
  • the problem index extracted by the element extraction unit 230 is connected to the answer area of the commentary book, which will be described later, and can be used to automate scoring.
  • the rest may be text (D).
  • each text can be selected and extracted based on an area with a different bounding box depending on each position of the text.
  • the element extraction unit 230 can select and extract a series of options (F) from the text in the selected question area.
  • a series of options (F) include ‘a.’ in each sentence. you. ‘C.’, ‘( ⁇ ) ( ⁇ ) ( ⁇ )’, ‘A. me. all.' Or, if '(a) (b) (c)' is detected in a series, those sentences or the area can be selected and extracted as a series of options (F).
  • the element extraction unit 230 stores each selected and extracted element in the database unit 250.
  • Each element selected and extracted by the element extraction unit 230 has a bounding box, and the area within the bounding box is stored in the database unit 250 in the form of an image.
  • the element extraction unit 230 determines the sentence containing the raw number as an option in the area selected by the above-described area detection unit 220 as the answer area because there is a sentence containing the raw number in the problem area.
  • the element extraction unit 230 extracts the above-described elements from the answer area containing the options and stores the extracted elements in the database unit 250.
  • the element extraction unit 230 may further include formulas, and when extracting formula elements within the problem area, the element extraction unit 230 uses MatchOCR (e.g., Mathpix) to match the MathML formula to the formula. Alternatively, you can extract the formula in LaTex format. Meanwhile, extraction of formula elements from the problem domain is not limited to only when the subject of the reference book is mathematics, and formula elements can be extracted whenever a formula within the problem domain is detected.
  • MatchOCR e.g., Mathpix
  • a bundled fingerprint refers to a fingerprint that contains multiple questions in one fingerprint.
  • the area detection unit 220 can detect the bundled fingerprint number (G, Figure 17) at the top of the problem area. When a bundled fingerprint number is detected, the area detection unit 220 performs a document merge operation so that the problem area corresponding to the bundled fingerprint number can be included (refer to the explanation area to be described later), and the area containing the bundled fingerprint number is Create a bounding box in . At this time, the area detection unit 220 may create a bounding box to include the problem area according to the bundled fingerprint number.
  • the area detection unit 220 creates a bounding box to include problem areas with problem indexes (C) numbered 35 to 37 along with the bundled fingerprint. do.
  • the element extraction unit 230 extracts elements from the question area and the answer area and stores them in the database unit 250, it also extracts elements from the above-mentioned bundled fingerprint and stores them in the database unit 250.
  • the elements extracted from the answer area and the elements extracted from the bundled fingerprint can be stored in the database unit 250 so that they are connected to each other.
  • Detection of a bundled fingerprint is not limited to when the subject of the reference book is Korean or English, and whenever the area detection unit 220 detects a numeric array in the form of 'number ⁇ number' such as the above-mentioned bundled fingerprint number, the bundled fingerprint element is always detected. can be extracted and stored.
  • the element extraction unit 230 extracts the extracted elements, namely problem index (C), text (D), image (E), text box (not shown), table (not shown), a series of options (F), and page information. These are grouped into one problem and stored in the database unit 250. Grouped elements may be provided to the student terminal 10 by the problem providing unit 260, which will be described later. When there are bundled fingerprints, it is desirable for problems corresponding to one bundled fingerprint to be provided on one screen at the same time. Therefore, the element extraction unit 230 determines whether a bundled fingerprint exists in the page file, how many questions there are in the questions to which the bundled fingerprint corresponds, that is, which question index it has, and, if the bundled fingerprint goes beyond the page, the page information at that time. These are extracted and stored in the database unit 250. When grouping extracted elements, the element extraction unit 230 may assign a specific class id value to the corresponding elements.
  • the problem providing unit 260 provides elements grouped by the element extracting unit 230 to the screen of the student terminal 10. At this time, the provided elements can be provided as an html layer while being arranged in positions appropriate for each position value.
  • the problem providing unit 260 can provide a multi-layer structure to the student terminal 10.
  • a writing layer for writing may be further provided on the HTML layer where grouped problems are provided to the student terminal 10.
  • the student terminal 10 can proceed with writing and problem solving on the writing layer provided on the HTML layer.
  • the problem providing unit 260 can recognize the answer check through a library that can recognize handwriting written in the handwriting layer. At this time, if the answer is checked by handwriting on the handwriting layer at the same position as the position value of a certain raw number included in the answer area of the html layer, the problem providing unit 260 creates a question index of the answer area, which will be described later. Based on the and correct answers, the grading of questions can be automated by comparing the answer check on the student terminal 10 with the correct answer.
  • the area detection unit 220 extracts the entire image file from the page file.
  • the area detection unit 220 extracts the commentary area from the extracted image file. At this time, extraction of the commentary area may be performed through the same process as the detection of the problem area described above.
  • the area detection unit 220 when extracting the commentary area, the area detection unit 220 first selects an n-column configuration from the entire image file extracted from each page file. Referring to FIG. 18, the midline (H, FIG. 18) is a dividing line. ) can be detected. Additionally, the area detection unit 220 can also detect the outer line (outline I, Figure 18), which is the innermost dividing line that constitutes the content within each page. The area detection unit 220 may cut an image containing internal content based on the center line and the outer line and merge them into one image by cutting the image based on the center line. An example of merging into one image is shown in Figure 19. Such a merged image may be one in which images corresponding to all pages of the commentary area are merged into a single image.
  • the area detection unit 220 divides the image in which the commentary book PDFs are merged into one chapter area.
  • the element extraction unit 230 selects a first separator that separates chapters, referring to FIG. 20, and extracts feature points of the selected first separator, referring to FIG. 21. , Referring to FIG. 22, each chapter can be distinguished by detecting the second separator based on the extracted first separator.
  • the element extraction unit 230 separates the merged commentary book image by chapter and section through the above-described feature points, and extracts information on each page and problem index for each chapter.
  • the element extraction unit 230 extracts the correct answer and explanation for each problem index and stores them in the database unit 250.
  • the element extraction unit 230 connects the problem index in the above-described problem area and the problem index in the explanation area. Accordingly, the problem providing unit 260 can automatically score the problem by comparing the position information of the answer check of the student terminal 10 with the position information of the answer area of the problem, as described above.
  • the digital reference book provision system 1000 through purchase authentication of physical reference books according to the present invention enters into a copyright license agreement with reference book publishers and/or their distributors to distribute specific reference books, and receives books for distribution.
  • the PDF file of the specific reference book can be received from the external server 20 provided by the reference book publisher and/or their distributor.
  • the digital reference book conversion server 200 builds a website and/or application-based sales channel and an application that can operate digitally converted reference books, and connects the built application to the student terminal (10). It may further include an application providing unit (not shown) provided by . The application built by the application provider is installed on the student terminal (10).
  • the student terminal 10 purchases reference books such as books by generating an ID from a sales channel established by the application provider.
  • the student terminal 10 can authenticate the ID on the application and use the digitally converted reference book.
  • the student terminal 10 obtains the right to view and use a digitally converted reference book with the same content as the purchased reference book upon receiving the purchased reference book and completing the purchase confirmation process.
  • the application built by the application provider according to the present invention may have the following safety devices implemented.
  • a procedure can be implemented in the application to check whether the purchaser of the reference book and the holder of the logged-in student terminal 10 are the same through login and channel authentication procedures.
  • the application includes a procedure that requests an irrevocable expression of intent to purchase from the student terminal (10) that purchased the reference book and provides access to the digital reference book to the student terminal (10) only when there is an expression of intent to confirm the purchase. It can be implemented. This is to prevent users who have not purchased a reference book from using the digital reference book, which is an additional function of purchasing a reference book.
  • the application when the application provides a digital reference book to the student terminal 10, it can provide it as fragmented pages using a CDN/security-enhanced protocol rather than in the form of a PDF file.
  • the student terminal 10 is a terminal such as a desktop PC, laptop PC, tablet PC, smartphone, scanner, multifunction device, etc., equipped with input means such as a keyboard, mouse, touchpad, and touch screen, and a display screen. , but is not limited to this, and is capable of accessing the digital reference book providing server 100 and the digital reference book conversion server 200 through a communication network, inputting search information and selection information, and displaying search result information. Any configuration that can process digital information that can be installed can be included.
  • the student terminal 10 according to the present invention is a component that transmits and receives information by connecting to the digital reference book providing server 100 and the digital reference book conversion server 200 through a communication network, for example, a smartphone or tablet PC.
  • a wearable device e.g., smart glasses, head-mounted-device (HMD), etc.
  • an unmanned terminal e.g., a smart watch.
  • the student terminal 10, the digital reference book providing server 100, and the digital reference book conversion server 200 can communicate through the communication unit and communication network provided by each.
  • a communication network refers to a connection structure that allows information exchange between nodes such as terminals and servers. Examples of such communication networks include the 3rd Generation Partnership Project (3GPP) network, Long Term Evolution (LTE) network, and 5G. Network, WIMAX (World Interoperability for Microwave Access) network, Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), wifi network, It includes, but is not limited to, a Bluetooth network, satellite broadcasting network, analog broadcasting network, and DMB (Digital Multimedia Broadcasting) network.
  • the communication unit provided by the student terminal 10, the digital reference book providing server 100, and the digital reference book conversion server 200 includes electronic components provided for a communication network to perform wired and wireless data communication through the above-mentioned communication network. can do.
  • the database unit 110 and the database unit 250 may include a database management system (hereinafter referred to as DBMS).
  • DBMS is a set of software tools that allow multiple users to access data in the database unit 110 and database unit 250.
  • DBMS includes IMS, CODASYL DB, DB2, ORACLE, INFORMIX, SYBASE, INGRES, MS-SQL, Objectivity, O2, Versanat, Ontos, Gemstone, Unisql, Object Store, Starburst, Postgres, Tibero, MySQL or MS-access. can do.
  • DBMS allows access to specific data depending on the input of a specific command.
  • each component included in the digital reference book providing server 100 namely, database unit 110, purchase authentication unit 120, authentication code transmission unit 121, authentication page unit 123, and entry location unit 125.
  • each component included in the digital reference book payment unit 130, the digital reference book provision unit 140 and the digital reference book rental unit 150 and the digital reference book conversion server 200 that is, the file creation unit 210 and the area detection unit 220.
  • the element extraction unit 230, the optical character recognition unit 240, and the problem providing unit 260 may be processors that execute sequential execution processes stored in memory. Alternatively, they may operate as software modules driven and controlled by a processor.
  • a processor may be a hardware device.
  • 'part' includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Additionally, one unit may be realized using two or more pieces of hardware, and two or more units may be realized using one piece of hardware.

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Tourism & Hospitality (AREA)
  • Finance (AREA)
  • Economics (AREA)
  • Theoretical Computer Science (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Marketing (AREA)
  • Human Resources & Organizations (AREA)
  • Primary Health Care (AREA)
  • General Health & Medical Sciences (AREA)
  • Development Economics (AREA)
  • Health & Medical Sciences (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The present invention relates to a system for providing a digital reference book and, specifically, to a system for providing a digital reference book through purchase authentication of a physical reference book, the system being capable of providing a digitized reference book on the basis of a physical reference book through purchase authentication of the physical reference book. The system for providing a digital reference book through purchase authentication of a physical reference book according to the present invention is a system for providing a digital reference book through purchase authentication of a physical reference book, the system comprising a digital reference book providing server which extracts, stores, and manages elements of a digitized reference book, and provides the elements to a student terminal, wherein the digital reference book providing server comprises: a database unit in which the digital reference book and the elements are stored; a purchase authentication unit which authenticates the purchase of a physical reference book through an image received from the student terminal; a digital reference book payment unit which provides payment for the digital reference book to the student terminal for which the purchase of the physical reference book has been authenticated; and a digital reference book providing unit which provides the digital reference book to the student terminal for which payment for the digital reference book has been made.

Description

실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템Digital reference book provision system through purchase authentication of physical reference books
본 발명은 디지털 참고서 제공 시스템에 관한 것으로, 더욱 상세하게는 실물 참고서의 구매 인증을 통해 그 실물 참고서를 기반으로 디지털화 된 참고서를 제공할 수 있는 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템에 관한 것이다.The present invention relates to a system for providing digital reference books, and more specifically, to a system for providing digital reference books through purchase authentication of physical reference books, which can provide digitized reference books based on the physical reference books through purchase authentication of physical reference books. .
출판사들은 초등학생, 중학생, 고등학생, 대학생, 공무원 시험 준비생 등 다양한 대상을 위해, 국어, 영어, 사회, 과학, 영어 등 다양한 과목의 학습에 필요한 참고서를 출판하고 있다. 이와 같은 참고서들은 서적으로 출판되어 전술한 대상에 속한 소비자들에게 판매된다. Publishers publish reference books necessary for learning various subjects such as Korean, English, social studies, science, and English for a variety of audiences, including elementary school students, middle school students, high school students, college students, and those preparing for civil service exams. Such reference books are published as books and sold to consumers belonging to the above-mentioned target groups.
한편, 디지털 형태의 참고서는 서책 운반의 비효율을 제거할 뿐만 아니라 이용자의 학습 내역을 수집하고 분석하여 개인화 학습을 제공하여 효과적인 학습 환경을 구축할 수 있어 참고서를 디지털 디바이스에서 이용할 수 있는 기술의 필요성이 대두되고 있다.Meanwhile, reference books in digital form not only eliminate inefficiencies in transporting books, but can also create an effective learning environment by collecting and analyzing users' learning history and providing personalized learning, increasing the need for technology that allows reference books to be used on digital devices. It is emerging.
또한 실물 참고서를 구매한 학생 등 사용자에게 그 실물 참고서와 동일한 컨텐츠를 가진 디지털 참고서를 스마트폰, 태블릿 및/또는 PC를 통해 대여하여 열람할 수 있는 방안이 대두되고 있다.In addition, a method is emerging that allows users, such as students who have purchased a physical reference book, to rent and read a digital reference book with the same content as the physical reference book through a smartphone, tablet, and/or PC.
상술한 문제점을 해결하기 위한 본 발명의 목적은 실물 참고서의 구매 인증이 가능한 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템을 제공하는 것이다.The purpose of the present invention to solve the above-mentioned problems is to provide a system for providing digital reference books through purchase authentication of physical reference books, which enables purchase authentication of physical reference books.
상술한 문제점을 해결하기 위한 본 발명의 또 다른 목적은 실물 참고서의 구매자 또는 소지자에게 실물 참고서의 컨텐츠를 포함하는 디지털 참고서의 제공이 가능한 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템을 제공하는 것이다.Another purpose of the present invention to solve the above-mentioned problems is to provide a digital reference book provision system through purchase authentication of a physical reference book that can provide a digital reference book including the contents of the physical reference book to the purchaser or holder of the physical reference book.
상술한 문제점을 해결하기 위한 본 발명의 또 다른 목적은 실물 참고서가 디지털화 된 디지털 참고서에서 각 요소를 추출하고 관리하여 사용자에게 제공하는 것이 가능한 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템을 제공하는 것이다.Another purpose of the present invention to solve the above-mentioned problems is to provide a digital reference book provision system through purchase authentication of physical reference books that can extract and manage each element from a digitized digital reference book and provide it to the user. .
상술한 목적을 달성하기 위하여, 본 발명의 일 실시예에 따른 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템은, 디지털화 된 참고서의 요소(element)들을 추출하여 저장 및 관리하고, 학생단말기로 제공하는 디지털 참고서 제공 서버를 포함하는 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템이며, 상기 디지털 참고서 제공 서버는, 상기 디지털 참고서 및 상기 요소가 저장된 데이터베이스부, 상기 학생단말기로부터 수신한 이미지를 통해 실물 참고서의 구매를 인증하는 구매인증부, 실물 참고서의 구매가 인증된 학생단말기로 디지털 참고서의 결제를 제공하는 디지털참고서결제부 및 디지털 참고서를 결제한 학생단말기로 상기 디지털 참고서를 제공하는 디지털참고서제공부를 포함하여, 실물 참고서를 이용하여 실물 참고서의 구매 인증 및 디지털 참고서의 제공이 가능한 것을 특징으로 한다.In order to achieve the above-mentioned purpose, the system for providing digital reference books through purchase authentication of physical reference books according to an embodiment of the present invention extracts, stores and manages elements of digitized reference books, and provides them to student terminals. It is a digital reference book providing system through purchase authentication of physical reference books including a digital reference book providing server, wherein the digital reference book providing server includes a database unit storing the digital reference book and the elements, and an image received from the student terminal to provide physical reference books. It includes a purchase authentication department that authenticates the purchase, a digital reference book payment department that provides payment for digital reference books to student terminals for which the purchase of physical reference books has been certified, and a digital reference book provision department that provides the digital reference books to student terminals that have paid for digital reference books. , It is characterized by the ability to authenticate the purchase of a physical reference book and provide a digital reference book using a physical reference book.
상기 구매인증부는, 상기 학생단말기로 인증 코드를 송신하는 인증코드송신부, 상기 학생단말기로 상기 실물 참고서의 인증 페이지 정보를 송신하는 인증페이지부 및 상기 학생단말기로 상기 인증 페이지 내 상기 인증 코드가 기입될 기입 위치 정보를 송신하는 기입위치부를 포함하고, 상기 학생단말기는, 상기 인증 코드가 상기 기입 위치에 기입된 상기 실물 참고서의 상기 인증 페이지를 촬영하여 상기 이미지를 생성하고, 생성한 이미지를 상기 구매인증부로 송신하며, 상기 구매인증부는, 상기 학생단말기로부터 수신한 상기 생성한 이미지 내 기입된 상기 인증 코드, 상기 인증 코드가 기입된 위치 정보 및 상기 실물 참고서의 인증 페이지와, 상기 인증코드송신부가 상기 학생단말기로 송신한 인증 코드, 상기 기입위치부가 상기 학생단말기로 송신한 기입 위치 정보 및 상기 데이터베이스부에 저장된 상기 디지털 참고서의 인증 페이지와 비교하여 상기 실물 참고서의 구매를 인증하는 것을 특징으로 한다.The purchase authentication unit includes an authentication code transmitting unit that transmits an authentication code to the student terminal, an authentication page unit that transmits authentication page information of the physical reference book to the student terminal, and an authentication code that is entered into the authentication page by the student terminal. It includes an entry location unit that transmits entry location information, and the student terminal generates the image by photographing the authentication page of the physical reference book in which the authentication code is written at the entry location, and uses the generated image to authenticate the purchase. The purchase authentication unit transmits the authentication code written in the generated image received from the student terminal, the location information where the authentication code is written, and the authentication page of the physical reference book, and the authentication code transmitter sends the authentication code to the student. Characterized in that the purchase of the physical reference book is authenticated by comparing the authentication code sent to the terminal, the entry location information sent by the entry location unit to the student terminal, and the authentication page of the digital reference book stored in the database unit.
상기 디지털 참고서 제공 서버는, 이용자 코드를 생성하여 상기 학생단말기로 송신하는 디지털참고서대여부를 더 포함하고, 상기 학생단말기는, 상기 이용자 코드와 날짜가 기입된 상기 인증 페이지를 촬영하여 대여이미지를 생성하며, 생성한 상기 대여이미지를 상기 디지털참고서대여부로 송신하고, 상기 디지털참고서대여부는, 상기 대여이미지를 송신한 상기 학생단말기로 상기 디지털참고서의 대여 권한을 제공하는 것을 특징으로 한다.The digital reference book providing server further includes a digital reference book rental unit that generates a user code and transmits it to the student terminal, and the student terminal generates a rental image by photographing the authentication page on which the user code and date are written. , the generated rental image is transmitted to the digital reference book rental unit, and the digital reference book rental unit provides rental rights for the digital reference book to the student terminal that transmitted the rental image.
상기 인증페이지부는, 상기 학생단말기로 상기 실물 참고서의 표지 정보, 랜덤으로 결정되는 랜덤 페이지 정보 및 상기 인증 페이지 정보를 송신하고, 상기 학생단말기는, 상기 표지 정보에 해당하는 실물 참고서의 표지, 상기 랜덤 페이지 정보에 해당하는 실물 참고서의 랜덤페이지 및 상기 이용자 코드와 날짜가 기입된 상기 인증 페이지 정보에 해당하는 상기 인증페이지를 촬영하여 각각 연장이미지를 생성하고, 생성한 상기 연장이미지를 상기 인증페이지부로 송신하고, 상기 인증페이지부는, 수신한 상기 연장이미지를 기초로 상기 학생단말기의 디지털참고서의 대여 권한을 연장하는 것을 특징으로 한다.The authentication page unit transmits cover information of the physical reference book, randomly determined random page information, and the authentication page information to the student terminal, and the student terminal transmits the cover information of the physical reference book corresponding to the cover information, the random page information, and the authentication page information. An extension image is generated by photographing a random page of the actual reference book corresponding to the page information and the authentication page corresponding to the authentication page information with the user code and date written thereon, and sending the generated extension image to the authentication page unit. And, the authentication page unit is characterized in that it extends the rental authority of the digital reference book of the student terminal based on the received extension image.
상기 디지털 참고서 제공 시스템은, 복수 개의 학생단말기를 포함하고, 상기 인증페이지부는, 상기 복수 개의 학생단말기로 상기 인증페이지 정보를 송신할 때, 동일한 참고서인 경우 동일한 페이지를 상기 인증페이지로 결정하여 상기 복수 개의 학생단말기로 각각 송신하여, 실물 참고서와 디지털 참고서가 1:1 대응되도록 하는 것을 특징으로 한다.The digital reference book providing system includes a plurality of student terminals, and the authentication page unit, when transmitting the authentication page information to the plurality of student terminals, determines the same page as the authentication page if it is the same reference book and determines the authentication page for the plurality of student terminals. It is characterized in that it is transmitted to each student terminal so that the physical reference book and the digital reference book correspond 1:1.
본 발명인 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템에 따르면, 실물 참고서의 구매 인증이 가능한 효과가 있다.According to the present invention, the system for providing digital reference books through purchase authentication of physical reference books has the effect of enabling purchase authentication of physical reference books.
본 발명인 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템에 따르면, 실물 참고서의 구매자 또는 소지자에게 실물 참고서의 컨텐츠를 포함하는 디지털 참고서의 제공이 가능한 효과가 있다.According to the present inventor's system for providing digital reference books through purchase authentication of physical reference books, it is possible to provide digital reference books containing the contents of the physical reference book to the purchaser or holder of the physical reference book.
본 발명인 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템에 따르면, 실물 참고서가 디지털화 된 디지털 참고서에서 각 요소를 추출하고 관리하여 사용자에게 제공하는 것이 가능한 효과가 있다.According to the present invention, a system for providing digital reference books through purchase authentication of physical reference books, it is possible to extract and manage each element from a digital reference book in which the physical reference book has been digitized and provide it to the user.
도 1은 본 발명에 따른 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템의 각 구성이 도시된 도면이다.Figure 1 is a diagram illustrating each configuration of a system for providing digital reference books through purchase authentication of physical reference books according to the present invention.
도 2는 본 발명에 따른 실물 참고서의 구매 인증 시 촬영되는 실물 참고서의 인증 페이지를 보여주는 도면이다.Figure 2 is a diagram showing the authentication page of the physical reference book taken when authenticating the purchase of the physical reference book according to the present invention.
도 3은 본 발명에 따른 인증 페이지에 이용자 코드와 날짜가 기재된 모습을 보여주는 도면이다.Figure 3 is a diagram showing the user code and date written on the authentication page according to the present invention.
도 4는 본 발명에 따른 대여 권한의 연장 시 촬영되는 실물 참고서의 표지, 랜덤 페이지 및 인증 페이지를 각각 보여주는 도면이다.Figure 4 is a diagram showing the cover, random page, and authentication page of a physical reference book taken when extending rental authority according to the present invention, respectively.
도 5 내지 도 7은 본 발명에 따른 연장이미지 내 포함되는 인증 페이지를 보여주는 도면이다.Figures 5 to 7 are diagrams showing an authentication page included in an extended image according to the present invention.
도 8은 본 발명에 따른 Computer Vision을 이용한 페이지 간 유사성 비교 모듈을 통한 페이지 분석을 보여주는 도면이다.Figure 8 is a diagram showing page analysis through a similarity comparison module between pages using computer vision according to the present invention.
도 9는 동일한 실물 참고서 내 인증 페이지는 모두 동일하게 설정된 것을 보여주는 도면이다.Figure 9 is a diagram showing that all authentication pages within the same physical reference book are set the same.
[규칙 제91조에 의한 정정 30.12.2022]
도 10은 본 발명에 따른 디지털 참고서 변환 서버의 각 구성을 보여주는 도면이다. 도 11 내지 22는 본 발명을 설명하기 위한 구체적인 예시를 나타낸다.[Correction 30.12.2022 pursuant to Rule 91]
Figure 10 is a diagram showing each configuration of the digital reference book conversion server according to the present invention. 11 to 22 show specific examples to explain the present invention.
이하, 본 발명의 일부 실시예들을 예시적인 도면을 통해 상세하게 설명한다. 각 도면의 구성 요소들에 참조 부호를 부가함에 있어서, 동일한 구성 요소들에 대해서는 비록 다른 도면상에 표시되더라도 가능한 한 동일한 부호를 가지도록 하고 있음에 유의해야 한다.Hereinafter, some embodiments of the present invention will be described in detail through illustrative drawings. When adding reference signs to components in each drawing, it should be noted that the same components are given the same reference numerals as much as possible even if they are shown in different drawings.
그리고 본 발명의 실시예를 설명함에 있어, 관련된 공지 구성 또는 기능에 대한 구체적인 설명이 본 발명의 실시예에 대한 이해를 방해한다고 판단되는 경우에는 그 상세한 설명은 생략한다.Also, in describing embodiments of the present invention, if detailed descriptions of related known configurations or functions are judged to impede understanding of the embodiments of the present invention, the detailed descriptions will be omitted.
또한, 본 발명의 실시예의 구성 요소를 설명하는 데 있어서, 제1, 제2, A, B, (a), (b) 등의 용어를 사용할 수 있다. 이러한 용어는 그 구성 요소를 다른 구성 요소와 구별하기 위한 것일 뿐, 그 용어에 의해 해당 구성 요소의 본질이나 차례 또는 순서 등이 한정되지 않는다.Additionally, when describing the components of an embodiment of the present invention, terms such as first, second, A, B, (a), and (b) may be used. These terms are only used to distinguish the component from other components, and the nature, sequence, or order of the component is not limited by the term.
본 명세서에서 단수형은 문구에서 특별히 언급하지 않는 한 복수형도 포함한다. 명세서에서 사용되는 “포함한다” 및/또는 “포함하는” 은 언급된 구성요소 외에 하나 이상의 다른 구성요소의 존재 또는 추가를 배제하지 않는다.In this specification, singular forms also include plural forms unless specifically stated in the phrase. As used in the specification, “comprises” and/or “including” does not exclude the presence or addition of one or more other components in addition to the mentioned components.
본 명세서에서 일반 사용자 및 사용자단말기의 의미를 더욱 명확히 하도록 각각 학생 및 학생단말기(10)로 기재하였다. 따라서 학생 및 학생단말기(10)는 각각 실물 참고서를 구매 또는 소지한 일반 사용자 및 일반 사용자가 소지하고 디지털 참고서 제공 서버(100)에 접속하여 디지털 참고서를 제공받는 학생단말기(10)로 이해하는 것이 바람직하다. In this specification, to make the meaning of general user and user terminal more clear, they are described as student and student terminal 10, respectively. Therefore, it is preferable to understand that the student and the student terminal 10 are a general user who has purchased or possesses a physical reference book and a student terminal 10 that is provided with a digital reference book by accessing the digital reference book providing server 100. do.
또한 본 명세서에서 실물 참고서는, 실제로 학생이 소지가능 한 물질적인 서책을 의미하며 디지털 참고서와 대비될 수 있다.Additionally, in this specification, a physical reference book refers to a physical book that a student can actually possess and can be contrasted with a digital reference book.
본 발명에 따른 디지털 참고서 제공 서버(100)는, 디지털 참고서 및/또는 디지털 참고서 변환 서버(200)에 의해 실물 참고서의 컨텐츠를 동일하게 포함하는 PDF 파일 등에서 추출하여 저장 및 관리되는 디지털화 된 참고서의 요소(element)들이 재조합되어 생성된 디지털 참고서를 학생단말기(10)로 제공할 수 있다. The digital reference book providing server 100 according to the present invention is a digital reference book and/or digital reference book conversion server 200 that extracts, stores, and manages the contents of a physical reference book from a PDF file, etc. A digital reference book created by recombining (elements) can be provided to the student terminal (10).
본 발명에 따른 디지털 참고서 제공 서버(100)는 실물 참고서 구매자 및/또는 실물 참고서 소지자에 한하여 디지털 참고서의 접근을 가능하게 하며 실물 참고서의 구매 인증 및/또는 실물 참고서의 소지 인증을 실물 참고서의 특정 페이지와 연동하여 진행한다. 학생단말기(10)는 후술하게 될 인증 및/또는 결제 후 디지털 참고서 제공 서버(100)로부터 제공받은 디지털 참고서를 열람할 수 있다.The digital reference book providing server 100 according to the present invention enables access to digital reference books only to purchasers of physical reference books and/or holders of physical reference books, and provides authentication of purchase of the physical reference book and/or certification of possession of the physical reference book on a specific page of the physical reference book. It is carried out in conjunction with. The student terminal 10 can view the digital reference book provided from the digital reference book providing server 100 after authentication and/or payment, which will be described later.
또한 본 명세서에서 영어 알파벳으로 병기된 도면부호는 대문자와 소문자를 구분하여 사용하였다.In addition, in this specification, reference numerals written in the English alphabet are used separately from uppercase and lowercase letters.
이하, 첨부된 도면을 참조하여 본 발명을 보다 상세하게 설명하고자 한다.Hereinafter, the present invention will be described in more detail with reference to the attached drawings.
도 1은 본 발명에 따른 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템(1000)의 각 구성이 도시된 도면이다.Figure 1 is a diagram illustrating each configuration of a system 1000 for providing digital reference books through purchase authentication of physical reference books according to the present invention.
본 발명에 따른 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템(1000)은, 도 1을 참조하면, 학생단말기(10), 디지털 참고서 제공 서버(100) 및 외부서버(20)를 포함한다. Referring to FIG. 1, the system 1000 for providing digital reference books through purchase authentication of physical reference books according to the present invention includes a student terminal 10, a digital reference book providing server 100, and an external server 20.
본 발명에 따른 디지털 참고서 제공 서버(100)는, 데이터베이스부(110), 구매인증부(120), 디지털참고서결제부(130), 디지털참고서제공부(140) 및 디지털참고서대여부(150)를 포함한다. The digital reference book providing server 100 according to the present invention includes a database unit 110, a purchase authentication unit 120, a digital reference book payment unit 130, a digital reference book provision unit 140, and a digital reference book rental unit 150. Includes.
한편, 본 발명에 따른 디지털 참고서 제공 시스템(1000)은, 출판사 등의 외부서버(20)로부터 실물 참고서를 기반으로 PDF, Word, hwp 등으로 디지털화 된 디지털 참고서를 수신하고, 각 디지털 참고서에서 요소들을 추출하여 관리하는 디지털 참고서 변환 서버(200)를 더 포함할 수 있다. 디지털 참고서 변환 서버(200)는, 추출한 요소들과 수신한 디지털 참고서를 디지털 참고서 제공 서버(100)의 데이터베이스부(110)로 송신한다. 디지털 참고서 제공 서버(100)는, 디지털 참고서 변환 서버(200)에 의해 데이터베이스부(110)에 송신된 디지털 참고서 또는 추출한 요소를 재조합하여 생성된 디지털 참고서를 학생단말기(10)로 제공할 수 있다. 한편, 출판사 등의 외부서버(20)는 출판사단말기(미도시)를 포함할 수 있다.Meanwhile, the digital reference book providing system 1000 according to the present invention receives digital reference books digitized into PDF, Word, HWP, etc. based on physical reference books from an external server 20, such as a publisher, and extracts elements from each digital reference book. It may further include a digital reference book conversion server 200 that extracts and manages the book. The digital reference book conversion server 200 transmits the extracted elements and the received digital reference book to the database unit 110 of the digital reference book providing server 100. The digital reference book providing server 100 may provide a digital reference book transmitted to the database unit 110 by the digital reference book conversion server 200 or a digital reference book created by recombining extracted elements to the student terminal 10. Meanwhile, the external server 20, such as a publisher, may include a publisher terminal (not shown).
본 발명에 따른 디지털 참고서 제공 서버(100) 및/또는 디지털 참고서 변환 서버(200)의 각 구성은, 공지된 라이브러리에 의해 구동될 수 있다. 예를 들어 디지털 참고서 제공 서버(100) 및/또는 디지털 참고서 변환 서버(200), 특히 디지털 참고서 변환 서버(200)는, PDF를 각 페이지별로 이미지 변환 및 텍스트 추출 시 사용되는 pdf 라이브러리 fitz, 이미지 변형과 경계선 추출에서 사용되며 컴퓨터 비전 라이브러리인 opencv(Open Source Computer Vision), object detection 모델 학습과 예측 및 도구로써 사용되는 객체감지 pytorch 및 tensorflow와 MathML 및 LaTex 문법 OCR API로 사용되는 MathPix 등 라이브러리가 파이썬 상에서 구동될 수 있으나, 이에 한정되지 않는다. 또한 그 외 본 발명에 따른 디지털 참고서 제공 서버(100) 및/또는 디지털 참고서 변환 서버(200)는, numpy, sklearn, re, glob 등 라이브러리가 파이썬 상에서 구동될 수 있고, Font-forge 라이브러리를 사용하여 PDF 상에서 텍스트를 검출하고 이를 적합한 폰트와 매칭하여 rendering 가능한 형태로 추출할 수 있으며, Font fomat은 TTF, TTF2, OTF, woff 등의 형태로 산출될 수 있으나, 이에 한정되지 않는다. 한편, 디지털 참고서 변환 서버(200)의 상세한 구성은, 도 10을 참조하여 후술하도록 한다.Each component of the digital reference book providing server 100 and/or the digital reference book conversion server 200 according to the present invention may be driven by a known library. For example, the digital reference book providing server 100 and/or the digital reference book conversion server 200, especially the digital reference book conversion server 200, includes PDF library fitz, which is used to convert PDF images and extract text for each page, and image transformation. Libraries such as opencv (Open Source Computer Vision), a computer vision library used in boundary line extraction, object detection pytorch and tensorflow, used as object detection model learning, prediction, and tools, and MathPix, used as MathML and LaTex grammar OCR API, are available on Python. It may be driven, but is not limited to this. In addition, the digital reference book providing server 100 and/or the digital reference book conversion server 200 according to the present invention can run libraries such as numpy, sklearn, re, and glob on Python, and use the Font-forge library. Text can be detected on a PDF and matched with a suitable font to extract it in a form that can be rendered. Font format can be calculated in the form of TTF, TTF2, OTF, woff, etc., but is not limited to this. Meanwhile, the detailed configuration of the digital reference book conversion server 200 will be described later with reference to FIG. 10.
본 발명에 따른 구매인증부(120)는, 학생단말기(10)로부터 수신한 이미지를 통해 학생단말기(10)의 소지자, 즉 학생의 실물 참고서 구매 및/또는 소지를 인증한다. 학생단말기(10)는 촬영이 가능한 카메라 모듈(미도시)과, 그 카메라 모듈을 제어하는 카메라 제어 어플리케이션(미도시)을 포함한다. 학생단말기(10)는 실물 참고서의 특정 페이지를 촬영하여 이미지를 생성하고, 생성한 이미지를 구매인증부(120)로 송신한다. 구매인증부(120)는 수신한 이미지를 기초로 학생단말기(10) 소지자의 그 실물 참고서 구매 및 소유를 인증할 수 있다. 구매인증부(120)의 실물 참고서에 대한 구매 및 소유 인증은 후술하도록 한다.The purchase authentication unit 120 according to the present invention authenticates the purchase and/or possession of a physical reference book by the holder of the student terminal 10, that is, the student, through the image received from the student terminal 10. The student terminal 10 includes a camera module (not shown) capable of taking pictures, and a camera control application (not shown) that controls the camera module. The student terminal 10 creates an image by photographing a specific page of the physical reference book, and transmits the generated image to the purchase authentication unit 120. The purchase authentication unit 120 can authenticate the purchase and possession of the physical reference book by the owner of the student terminal 10 based on the received image. The purchase and ownership authentication of the physical reference book in the purchase authentication department 120 will be described later.
구매인증부(120)에 의해 학생단말기(10) 소지자의 실물 참고서 구매 및/또는 소유가 인증되면 디지털참고서결제부(130)는 실물 참고서의 구매 및/또는 소유가 인증된 학생단말기(10)로 디지털 참고서의 결제를 제공할 수 있다. 디지털참고서결제부(130)의 결제 제공 과정은 공지된 것을 따르며, 예를 들어, 외부 결제 서버(미도시) 등과 연결되어 디지털 참고서의 결제를 제공할 수 있다.When the purchase and/or possession of the physical reference book by the student terminal 10 holder is certified by the purchase authentication unit 120, the digital reference book payment unit 130 is used to verify the purchase and/or possession of the physical reference book by the student terminal 10. Payment for digital reference books can be provided. The payment provision process of the digital reference book payment unit 130 follows a known process, and, for example, can be connected to an external payment server (not shown) to provide payment for digital reference books.
본 발명에 따른 디지털참고서제공부(140)는, 디지털 참고서의 결제가 완료된 학생단말기(10)로 데이터베이스부(110)에 저장된 디지털 참고서를 제공한다. 따라서 디지털참고서제공부(140)는 실물 참고서를 통해 구매 인증이 완료된 학생단말기(10)로 디지털 참고서의 제공이 가능하다.The digital reference book providing unit 140 according to the present invention provides the digital reference book stored in the database unit 110 to the student terminal 10 for which payment for the digital reference book has been completed. Therefore, the digital reference book provision unit 140 can provide a digital reference book to the student terminal 10 for which purchase authentication has been completed through a physical reference book.
한편, 구매인증부(120)는, 학생단말기(10)로부터 수신하는 이미지를 전술한 카메라 모듈을 통해 실시간 촬영된 이미지만을 선택하여 수신할 수 있다. 즉 구매인증부(120)는 학생단말기(10) 내 저장공간에 기 저장된 이미지가 수신될 경우 그 기 저장된 이미지의 수신을 차단한다. 또는 기 저장된 이미지가 수신되더라도 구매인증을 위한 후처리를 진행하지 않는다. 이는 후술하게 될 인증 페이지 내 기입될 인증 코드가 변조되거나 수정되어 구매 인증 및 열람의 연장이 우회 사용되거나 실물 참고서의 중고 거래 등 2차 유통에 따라 단일의 실물 참고서에 기초한 복수 개의 학생단말기(10), 즉 복수 명의 사용자에게 디지털 참고서가 중복 제공되는 것을 방지하기 위함이다. Meanwhile, the purchase authentication unit 120 can select and receive only images captured in real time through the above-described camera module as images received from the student terminal 10. That is, when an image pre-stored in the storage space of the student terminal 10 is received, the purchase authentication unit 120 blocks reception of the pre-stored image. Or, even if a pre-stored image is received, post-processing for purchase authentication is not performed. This is because the authentication code to be entered in the authentication page, which will be described later, is tampered with or modified, and purchase authentication and extension of viewing are used bypassing, or secondary distribution such as used transactions of physical reference books results in multiple student terminals (10) based on a single physical reference book. , That is, to prevent digital reference books from being repeatedly provided to multiple users.
한편, 본 발명에 따른 디지털 참고서 제공 서버(100)는, 실물 참고서의 구매 인증 및/또는 열람의 연장 신청을 위한 별도의 카메라 제어 어플리케이션을 학생단말기(10)로 제공할 수 있다. 디지털 참고서 제공 서버(100)가 제공하는 별도의 카메라 제어 어플리케이션은 학생단말기(10) 내 구비된 카메라 모듈을 제어할 수 있다. 학생단말기(10)는 디지털 참고서 제공 서버(100)가 제공하는 별도의 카메라 제어 어플리케이션만을 이용하여 전술한 바와 같이 실물 참고서를 촬영하여 이미지를 생성하고, 생성한 이미지를 그 별도의 카메라 제어 어플리케이션을 통해 디지털 참고서 제공 서버(100)로 송신할 수 있다. 디지털 참고서 제공 서버(100)는, 그 별도의 카메라 제어 어플리케이션을 통해 송신된 이미지만을 수신하거나 후처리하여 전술한 바와 같은 실물 참고서의 2차 유통에 따라 발생하는 문제를 방지하거나, 구매 인증 및/또는 열람의 연장에 따른 우회 사용법을 차단할 수 있다.Meanwhile, the digital reference book providing server 100 according to the present invention can provide a separate camera control application to the student terminal 10 for purchasing authentication and/or requesting extension of viewing of a physical reference book. A separate camera control application provided by the digital reference book provision server 100 can control the camera module provided in the student terminal 10. The student terminal 10 uses only a separate camera control application provided by the digital reference book providing server 100 to create an image by photographing a physical reference book as described above, and to generate an image through the separate camera control application. It can be transmitted to the digital reference book provision server 100. The digital reference book providing server 100 receives or post-processes only images transmitted through the separate camera control application to prevent problems arising from secondary distribution of physical reference books as described above, or to provide purchase authentication and/or Circumvention use due to extended viewing can be blocked.
도 2는 본 발명에 따른 실물 참고서의 구매 인증 시 촬영되는 실물 참고서의 인증 페이지를 보여주는 도면이다. 도 2를 참조하여, 본 발명에 따른 구매인증부(120)의 실물 참고서 구매 및 소지 인증에 대해 설명하면 다음과 같다. 한편, 도 2에는 두 개의 인증 페이지를 예시로서 좌측과 우측에 함께 도시되었으나, 각 실물 참고서에 해당하는 인증 페이지는 단 하나의 인증 페이지를 갖는다. Figure 2 is a diagram showing the authentication page of the physical reference book taken when authenticating the purchase of the physical reference book according to the present invention. Referring to FIG. 2, the purchase and possession authentication of a physical reference book by the purchase authentication unit 120 according to the present invention will be described as follows. Meanwhile, in FIG. 2, two authentication pages are shown on the left and right side as an example, but each physical reference book has only one authentication page.
본 발명에 따른 구매인증부(120)는, 도 1을 함께 참조하면, 인증코드송신부(121), 인증페이지부(123) 및 기입위치부(125)를 포함한다.Referring to FIG. 1 together, the purchase authentication unit 120 according to the present invention includes an authentication code transmission unit 121, an authentication page unit 123, and an entry location unit 125.
본 발명에 따른 인증코드송신부(121)는, 학생단말기(10)로 공지된 난수 발생 알고리즘에 의해 생성된 인증 코드를 송신한다. 학생단말기(10)는, 수신한 인증 코드를 디스플레이 장치에 표출하며, 학생단말기(10)의 소지자는 디스플레이 장치에 표출된 인증 코드를 확인할 수 있다.The authentication code transmitter 121 according to the present invention transmits an authentication code generated by a known random number generation algorithm to the student terminal 10. The student terminal 10 displays the received authentication code on the display device, and the owner of the student terminal 10 can check the authentication code displayed on the display device.
한편, 인증코드송신부(121)가 학생단말기(10)로 송신하는 인증 코드는 Single Sign on을 통해 로그인 절차를 간소화 할 수 있다. 인증 코드는 학생단말기(10)의 개인정보 확인을 통한 별도의 인증절차에 의해 생성되는 Unique ID 값일 수 있다. 이러한 Unique ID 값인 인증 코드는 1권의 실물 참고서에 대해 1개만 부여될 수 있다. 그리고 1개의 인증 코드는 1개의 태블릿과 1개의 스마트폰에서 접근할 수 있는 권한을 부여할 수 있다. 동일한 인증 코드로 새로운 디바이스에서 접근 시 지정되지 않은 디바이스에서는 디지털 참고서의 이용이 제한될 수 있다.Meanwhile, the authentication code transmitted by the authentication code transmitter 121 to the student terminal 10 can simplify the login process through Single Sign On. The authentication code may be a Unique ID value generated through a separate authentication procedure through confirmation of personal information of the student terminal 10. Only one authentication code, which is this Unique ID value, can be assigned to one physical reference book. And one authentication code can grant access from one tablet and one smartphone. When accessing from a new device with the same authentication code, use of the digital reference book may be restricted on undesignated devices.
본 발명에 따른 인증페이지부(123) 및 기입위치부(125)에 의해 생성된 인증 페이지 정보에 따른 인증 페이지는 도 2에 도시된 바와 같다.The authentication page according to the authentication page information generated by the authentication page unit 123 and the writing position unit 125 according to the present invention is as shown in FIG. 2.
본 발명에 따른 인증페이지부(123)는, 학생단말기(10)로 실물 참고서의 인증 페이지 정보를 송신한다. 이때 인증 페이지 정보는, 실물 참고서의 어느 특정 페이지에 대한 정보를 포함한다. 특히 인증페이지부(123)는 특정 페이지를 선택할 때, 페이지 내 백그라운드 컬러(Background Color)가 존재하는 특정 페이지를 선택할 수 있다. 한편, 본 명세서에서는 인증페이지부(123)가 선택한 특정 페이지를 인증 페이지라 한다.The authentication page unit 123 according to the present invention transmits authentication page information of the physical reference book to the student terminal 10. At this time, the authentication page information includes information about a specific page of the physical reference book. In particular, when selecting a specific page, the authentication page unit 123 can select a specific page with a background color within the page. Meanwhile, in this specification, the specific page selected by the authentication page unit 123 is referred to as an authentication page.
본 발명에 따른 기입위치부(125)는, 인증 페이지 내 인증 코드가 기입될 기입 위치 정보를 인증페이지부(123)가 송신하는 인증 페이지 정보 내 포함시켜 학생단말기(10)로 송신한다. 이때 기입 위치 정보는, 인증페이지부(123)가 선택한 특정 페이지 내 백그라운드 컬러가 존재하는 영역(a)을 포함하도록 선택될 수 있다. 바람직하게는 이때 기입 위치 정보는, 인증페이지부(123)가 선택한 특정 페이지 내 백그라운드 컬러가 존재하는 영역(a) 중 백그라운드 컬러가 변화하는 영역(a)이 포함되도록 선택될 수도 있다.The writing location unit 125 according to the present invention includes information on the writing location where the authentication code in the authentication page will be written in the authentication page information transmitted by the authentication page unit 123 and transmits it to the student terminal 10. At this time, the writing location information may be selected to include an area (a) where the background color exists within the specific page selected by the authentication page unit 123. Preferably, the writing location information at this time may be selected to include an area (a) in which the background color changes among the areas (a) where the background color exists in the specific page selected by the authentication page unit 123.
인증페이지부(123) 및 기입위치부(125)는, 학생단말기(10)의 소지자에게 특정 페이지 내 백 그라운드 컬러가 존재하고, 바람직하게는 그 백그라운드 컬러가 변화되는 영역인 기입 위치(a)에 전술한 인증 코드를 기재하도록 요구하는 정보를 인증 페이지 정보에 포함시켜 학생단말기(10)로 송신할 수 있다.The authentication page unit 123 and the entry position unit 125 are provided to the holder of the student terminal 10 at the entry position (a), which is an area where a background color exists in a specific page and where the background color changes. Information requesting that the above-described authentication code be entered can be included in the authentication page information and transmitted to the student terminal 10.
학생단말기(10)의 소지자는, 학생단말기(10)의 디스플레이 장치에 표출된 인증 코드를 확인하고, 그 인증 코드를 실물 참고서 내 인증 페이지 정보에 해당하는 페이지(h)의 기입 위치에 기재한 후 카메라 제어 어플리케이션 및 카메라 모듈을 통해 촬영하여 이미지를 생성하고, 생성한 이미지를 카메라 제어 어플리케이션을 통해 구매인증부(120)로 송신할 수 있다. 즉 학생단말기(10)는 인증 코드가 기입 위치(a)에 기입된 실물 참고서의 인증 페이지(h)를 직접 촬영하여 이미지를 생성하고, 생성한 이미지를 구매인증부(120)로 송신한다.The holder of the student terminal 10 checks the authentication code displayed on the display device of the student terminal 10, and enters the authentication code in the entry position of the page (h) corresponding to the authentication page information in the physical reference book. An image can be created by shooting through a camera control application and a camera module, and the generated image can be transmitted to the purchase authentication unit 120 through a camera control application. That is, the student terminal 10 creates an image by directly photographing the authentication page (h) of the physical reference book on which the authentication code is written at the entry position (a), and transmits the generated image to the purchase authentication unit 120.
이때 구매인증부(120)의 각 구성은, 학생단말기(10)의 소지자가 기입 위치에 인증 코드를 기입할 때, 수정이 불가능한 청색, 적색등의 볼펜을 이용하여 기재하도록 요구할 수 있다. 이는 수정액 등을 이용한 수정을 방어하며 훼손 징후 발견 시 접근권한을 차단하기 위함이다.At this time, each component of the purchase authentication unit 120 may require the holder of the student terminal 10 to write the authentication code in the entry position using a non-editable blue or red ballpoint pen. This is to prevent corrections using correction fluid, etc. and to block access when signs of damage are discovered.
구매인증부(120)는, 학생단말기(10)로부터 이미지를 수신한 경우 이미지 내 기입된 인증 코드를, 인증코드송신부(121)가 학생단말기(10)로 송신한 인증 코드와 비교하여, 실물 참고서의 구매 인증을 수행한다. 이때 구매인증부(120)는, 공지된 손글씨를 인식할 수 있는 라이브러리를 통해 학생단말기(10)로부터 수신한 이미지 내 기입된 인증 코드를 추출할 수 있다. 한편, 손글씨를 인식할 수 있는 라이브러리는 구매인증부(120)의 인증 코드 추출에서 이용되는 것에 한하지 않고, 후술하게 될 인증 페이지에 기입되는 이용자 코드 및 날짜를 추출할 때에도 이용된다.When receiving an image from the student terminal 10, the purchase authentication unit 120 compares the authentication code written in the image with the authentication code sent by the authentication code transmitter 121 to the student terminal 10, and creates an actual reference book. Perform purchase authentication. At this time, the purchase authentication unit 120 can extract the authentication code written in the image received from the student terminal 10 through a library that can recognize known handwriting. Meanwhile, the library that can recognize handwriting is not limited to being used to extract the authentication code of the purchase authentication unit 120, but is also used to extract the user code and date written on the authentication page, which will be described later.
구매인증부(120)는 학생단말기(10)로부터 수신한 이미지 내 인증 코드가 기입된 기입 위치(a)와 기입위치부(125)가 학생단말기(10)로 송신한 기입 위치를 비교하여 일정 오차범위 내 인증 코드가 기입된 것인지 확인하며, 이때 구매인증부(120)는 페이지 내 백그라운드 컬러 또는 백그라운드 컬러 변화에 기초하여 기입 위치(a) 간 비교할 수 있다.The purchase authentication unit 120 compares the writing position (a) where the authentication code is written in the image received from the student terminal 10 with the writing position sent by the writing position unit 125 to the student terminal 10 to produce a certain error. It is checked whether the authentication code within the range has been entered, and at this time, the purchase authentication unit 120 can compare the entry positions (a) based on the background color or background color change within the page.
구매인증부(120)는 학생단말기(10)로부터 수신한 이미지에 포함된 인증 페이지(h)와 데이터베이스부(110)에 저장된 디지털 참고서의 인증 페이지를 서로 비교하여 인증페이지부(123)가 송신한 인증 페이지에 부합되는 실물 참고서의 페이지가 촬영된 것인지 판단한다. 이때 촬영된 이미지 내 페이지(h)와 데이터베이스부(110)에 저장된 디지털 참고서 내 해당하는 페이지가 서로 동일한 지 판단하는 것은 후술하게 될 Computer Vision을 이용한 페이지간 유사성 비교 모듈에 의한다. 다만 이에 한정되는 것은 아니고 공지된 Computer Vision을 이용한 페이지간 유사성 비교 모듈에 의한 것일 수도 있다.The purchase authentication unit 120 compares the authentication page (h) included in the image received from the student terminal 10 with the authentication page of the digital reference book stored in the database unit 110 to obtain the authentication page transmitted by the authentication page unit 123. It is determined whether the page of the actual reference book that matches the authentication page was photographed. At this time, determining whether the page (h) in the captured image and the corresponding page in the digital reference book stored in the database unit 110 are the same is based on a similarity comparison module between pages using Computer Vision, which will be described later. However, it is not limited to this and may be based on a similarity comparison module between pages using known computer vision.
디지털참고서결제부(130)는, 학생단말기(10)로부터 수신한 이미지를 기초로 구매인증부(120)에 의해 인증 코드, 인증 페이지(h) 및 기입 위치(a) 등이 확인된 경우, 전술한 바와 같이 학생단말기(10)로 디지털 참고서의 결제를 제공하고, 결제가 완료된 경우 디지털참고서제공부(140)는 학생단말기(10)로 디지털 참고서를 제공한다. The digital reference payment unit 130, when the authentication code, authentication page (h), entry location (a), etc. are confirmed by the purchase authentication unit 120 based on the image received from the student terminal 10, As described above, payment for the digital reference book is provided to the student terminal 10, and when payment is completed, the digital reference book providing unit 140 provides the digital reference book to the student terminal 10.
한편, 학생단말기(10)로의 디지털 참고서 제공은 열람 기간이 정해진, 이른 바 디지털 참고서의 대여 방식으로 제공될 수 있다.Meanwhile, digital reference books can be provided to the student terminal 10 in the form of so-called rental of digital reference books with a fixed reading period.
즉, 디지털참고서제공부(140)는 학생단말기(10)로 제공하는 디지털 참고서를 일정기간동안 제공할 수 있으며, 일정 기간 후에는 열람 기간이 연장된 학생단말기(10)로만 디지털 참고서를 제공할 수 있다. In other words, the digital reference book provision unit 140 can provide digital reference books provided to the student terminal 10 for a certain period of time, and after a certain period of time, the digital reference book can only be provided to the student terminal 10 with an extended viewing period. there is.
디지털참고서대여부(150)는, 구매인증부(120)에 의해 확인된 인증 코드, 인증 페이지(h) 및 기입 위치(a) 등을 기초로 이용자 코드(e, 도 3)를 생성하여 학생단말기(10)로 송신한다. 학생단말기(10)로 송신된 이용자 코드(e)는 학생단말기(10)의 디스플레이 장치에 표출되어 학생단말기(10)의 소지자는 이용자 코드(e)를 확인할 수 있다. 한편, 디지털참고서대여부(150)가 생성하는 이용자 코드(e)는 공지된 Hash Algorithm을 통해 생성된 Hashed User id일 수 있다. The digital reference book rental unit 150 generates a user code (e, Figure 3) based on the authentication code confirmed by the purchase authentication unit 120, the authentication page (h), and the entry location (a), etc., and sends it to the student terminal. Send to (10). The user code (e) transmitted to the student terminal 10 is displayed on the display device of the student terminal 10, so that the holder of the student terminal 10 can check the user code (e). Meanwhile, the user code (e) generated by the digital reference book rental unit 150 may be a Hashed User id generated through a known Hash Algorithm.
도 3은 본 발명에 따른 인증 페이지에 이용자 코드와 날짜가 기재된 모습을 보여주는 도면이다.Figure 3 is a diagram showing the user code and date written on the authentication page according to the present invention.
학생단말기(10)의 소지자는, 도 3을 참조하면, 확인한 이용자 코드(e)와 대여 시작일에 해당하는 날짜(a)를 연, 월 및/또는 일의 방식으로 전술한 바와 같이 인증 페이지(h)에 기입한 후, 해당 인증 페이지(h)를 촬영하여 대여이미지를 생성한 후, 생성한 대여이미지를 학생단말기(10)의 카메라 제어 어플리케이션을 통해 디지털참고서대여부(150)로 송신할 수 있다. 즉, 학생단말기(10)는 이용자 코드(e)와 날짜(a)가 기입된 인증 페이지(h)를 촬영하여 대여이미지를 생성하며, 생성한 대여이미지를 디지털참고서대여부(150)로 송신한다.Referring to FIG. 3, the holder of the student terminal 10 enters the confirmed user code (e) and the date (a) corresponding to the rental start date in the form of year, month, and/or day on the authentication page (h) as described above. ), then take a photo of the corresponding authentication page (h) to create a rental image, and then transmit the created rental image to the digital reference book rental unit 150 through the camera control application of the student terminal 10. . That is, the student terminal 10 creates a rental image by photographing the authentication page (h) with the user code (e) and date (a) written on it, and transmits the generated rental image to the digital reference book rental unit 150. .
[규칙 제91조에 의한 정정 30.12.2022]
디지털참고서대여부(150)는 수신한 대여이미지를 분석한 후, 대여이미지를 송신한 학생단말기(10)로 그 실물 참고서에 대응되는 디지털참고서의 대여 권한을 제공할 수 있다. 디지털참고서대여부(150)는 대여이미지에 포함된 인증 페이지(h)에 포함된 이용자 코드(e)를 기초로 하고 기입된 날짜(a)를 초일로 하여 일정 기간 동안 디지털참고서의 대여 권한을 제공받은 학생단말기(10)로 디지털 참고서를 제공한다.[Correction 30.12.2022 pursuant to Rule 91]
After analyzing the received rental image, the digital reference book rental unit 150 may provide rental rights for a digital reference book corresponding to the physical reference book to the student terminal 10 that transmitted the rental image. The digital reference book rental department 150 provides the right to rent digital reference books for a certain period of time based on the user code (e) included in the authentication page (h) included in the rental image and with the entered date (a) as the first day. A digital reference book is provided to the received student terminal (10).
한편 도 3의 인증 페이지는, 도 2의 인증 페이지를 간략히 도시한 것이다.Meanwhile, the authentication page in FIG. 3 is a simplified illustration of the authentication page in FIG. 2.
도 4는 본 발명에 따른 대여 권한의 연장 시 촬영되는 실물 참고서의 표지, 랜덤 페이지 및 인증 페이지를 각각 보여주는 도면이다.Figure 4 is a diagram showing the cover, random page, and authentication page of a physical reference book taken when extending rental authority according to the present invention, respectively.
한편, 디지털 참고서의 열람 기간이 종료됨에 따라 대여 권한의 연장이 필요한 학생단말기(10)는, 디지털참고서대여부(150)로 대여 권한의 연장을 신청할 수 있다. 디지털참고서대여부(150)로 대여 권한의 연장을 신청한 학생단말기(10)는, 도 4를 참조하면, 인증페이지부(123)로부터 그 실물 참고서의 표지 정보, 그 실물 참고서 내 랜덤으로 결정되는 랜덤 페이지 정보 및 이용자 코드를 기입하여 디지털참고서대여부(150)로 송신했던 그 인증 페이지 정보를 수신한다. 한편, 본 발명에 따른 디지털 참고서 제공 시스템(1000)은, 실물 참고서마다 인증 페이지(h)는 모두 동일하도록 설정되어, 이른바 실물 참고서와 디지털 참고서의 1:1 원칙을 준수한다. 이와 같은 1:1 원칙은 도 9를 참조하여 후술하도록 한다.Meanwhile, as the viewing period of the digital reference book expires, the student terminal 10 that needs an extension of the rental authority can apply for an extension of the rental authority to the digital reference book rental unit 150. Referring to FIG. 4, the student terminal 10, which has applied for an extension of rental authority to the digital reference book rental unit 150, receives the cover information of the physical reference book from the authentication page unit 123 and the randomly determined information in the physical reference book. Enter the random page information and user code to receive the authentication page information sent to the digital reference book rental unit 150. Meanwhile, in the digital reference book providing system 1000 according to the present invention, the authentication pages (h) for each physical reference book are all set to be the same, thereby complying with the so-called 1:1 principle between physical reference books and digital reference books. This 1:1 principle will be described later with reference to FIG. 9.
도 4에 도시된 바와 같이, 학생단말기(10)는 표지 정보에 해당하는 그 실물 참고서의 표지(f), 인증페이지부(123)가 랜덤으로 결정한 랜덤 페이지 정보에 해당하는 실물 참고서 내 랜덤 페이지(g) 및 전술한 바와 같은 인증 페이지(h)를 각각 카메라 제어 어플리케이션을 통해 촬영하여 표지(f), 랜덤 페이지(g) 및 인증 페이지(h)를 포함하는 연장이미지를 생성한다. 학생단말기(10)는 생성한 연장이미지를 카메라 제어 어플리케이션을 통해 인증페이지부(123)로 송신한다.As shown in FIG. 4, the student terminal 10 displays the cover (f) of the physical reference book corresponding to the cover information, and a random page (f) in the physical reference book corresponding to the random page information randomly determined by the authentication page unit 123. g) and the authentication page (h) as described above are each photographed through a camera control application to generate an extended image including a cover (f), a random page (g), and an authentication page (h). The student terminal 10 transmits the generated extension image to the authentication page unit 123 through the camera control application.
인증페이지부(123)는 수신한 연장이미지를 기초로 전술한 바와 같이 분석하여 학생단말기(10)의 디지털참고서의 대여 권한을 연장한다. 이때 대여 권한의 연장은 기입된 날짜(b, 도 5)를 초일로 하여 연장된다. The authentication page unit 123 analyzes the received extension image as described above and extends the rental authority of the digital reference book of the student terminal 10. At this time, the extension of rental authority is extended using the entered date (b, Figure 5) as the first day.
인증페이지부(123)가 표지(f) 및 랜덤 페이지(g)를 포함하는 연장이미지를 분석함에 따라 전술한 바와 같은 실물 참고서의 2차 유통에 따른 문제점 발생을 방지한다. 한편, 인증페이지부(123)는 표지(f)의 이미지를 통해 실물 참고서의 타이틀을 파악할 수 있고, 랜덤 페이지(g)의 이미지를 통해 해당 실물 참고서의 완전성을 확인할 수 있다. 인증 페이지(h)에서는 이용자 코드(e)와 대여 연장의 초일(b, 도 5)을 확인함에 따라 학생단말기(10)의 소지자 즉, 이용자를 특정할 수 있어 2차 유통 등에 의해 실물 참고서의 미소유자에게 더 이상의 이용을 제한할 수 있다.As the authentication page unit 123 analyzes the extended image including the cover (f) and the random page (g), problems caused by secondary distribution of the physical reference book as described above are prevented. Meanwhile, the authentication page unit 123 can identify the title of the physical reference book through the image of the cover (f) and confirm the completeness of the physical reference book through the image of the random page (g). On the authentication page (h), the user code (e) and the first date of rental extension (b, Figure 5) can be confirmed to identify the holder of the student terminal (10), that is, the user, preventing the loss of the physical reference book due to secondary distribution, etc. Further use may be restricted to the owner.
도 5 내지 도 7은 본 발명에 따른 연장이미지 내 포함되는 인증 페이지를 보여주는 도면이다.Figures 5 to 7 are diagrams showing an authentication page included in an extended image according to the present invention.
도 3을 참조하여 전술한 바와 같이, 학생단말기(10)가 생성하는 대여이미지는 이용자 코드(e)와 해당 날짜(a)가 기입된 인증 페이지(h)를 촬영하여 생성된다. 또한 전술한 바와 같이 동일한 실물 참고서는 동일한 인증 페이지(h)를 갖는다. 따라서 대여 권한을 연장하기 위해 연장이미지를 생성할 때에도 동일한 페이지를 인증 페이지(h)로 갖는다. As described above with reference to FIG. 3, the rental image generated by the student terminal 10 is created by photographing the authentication page (h) on which the user code (e) and the corresponding date (a) are written. Also, as described above, the same physical reference book has the same authentication page (h). Therefore, even when creating an extension image to extend rental rights, the same page is used as the authentication page (h).
디지털 참고서의 대여 권한을 연장하기 위한 연장이미지의 인증 페이지(h)는 도 3에서 최초로 날짜(a)의 기입과 함께 이용자 코드(e)가 기입되었던 그 인증 페이지(h)를 이용한다. 이는 도 5에 도시된 바와 같이, 학생단말기(10)는 최초 기입된 날짜(a)의 아래에 새로운 날짜(b)가 기입된 인증 페이지(h)를 촬영하여 연장이미지 내 포함시키고, 그 연장이미지를 인증페이지부(123)로 송신한다. 인증페이지부(123)는 수신한 연장이미지를 기초로 학생단말기(10)의 디지털참고서의 대여 권한을 연장한다. 이후 또 다시 대여 권한을 연장할 때에는, 도 6에 도시된 바와 같이 그 아래에 새로운 날짜(c)를 기입하여 대여 권한을 연장하고, 그 이후 또 다시 대여 권한을 연장할 때에도 도 7에 도시된 바와 같이 그 아래에 새로운 날짜(d)를 더 기입하여 대여 권한을 연장할 수 있다.The authentication page (h) of the extension image for extending the rental authority of the digital reference book uses the authentication page (h) on which the date (a) and the user code (e) were first written in FIG. 3. As shown in Figure 5, the student terminal 10 photographs the authentication page (h) with the new date (b) written below the initially entered date (a) and includes it in the extended image, and the extended image is transmitted to the authentication page unit 123. The authentication page unit 123 extends the rental authority of the digital reference book of the student terminal 10 based on the received extension image. When extending the rental authority again, the rental authority is extended by writing a new date (c) below it as shown in Figure 6. When extending the rental authority again after that, as shown in Figure 7. Likewise, you can extend your rental authority by adding a new date (d) below it.
도 8은 본 발명에 따른 Computer Vision을 이용한 페이지 간 유사성 비교 모듈을 통한 페이지 분석을 보여주는 도면이다.Figure 8 is a diagram showing page analysis through a similarity comparison module between pages using computer vision according to the present invention.
한편, 본 발명에 따른 디지털 참고서 제공 서버(100)의 각 구성은, 학생단말기(10)로부터 수신한 이미지들, 즉 카메라 제어 어플리케이션을 통해 실물 참고서가 촬영되어 생성된 이미지, 대여이미지 및 연장이미지에 포함된 페이지를, 데이터베이스부(110)에 저장된 디지털 참고서의 각 해당하는 페이지와 비교하여 분석한다. 디지털 참고서 제공 서버(100)의 각 구성은 Computer Vision을 이용한 페이지 간 유사성 비교 모듈을 통해 페이지 간 비교를 수행할 수 있다. Meanwhile, each component of the digital reference book providing server 100 according to the present invention includes images received from the student terminal 10, that is, images generated by shooting a physical reference book through a camera control application, rental images, and extended images. The included pages are analyzed by comparing them with each corresponding page of the digital reference book stored in the database unit 110. Each configuration of the digital reference book providing server 100 can perform comparison between pages through a similarity comparison module between pages using Computer Vision.
디지털 참고서 제공 서버(100)의 Computer Vision을 이용한 페이지 간 유사성 비교 모듈의 예시는 이하 도 8을 참조하여 설명하도록 한다. 한편, 본 명세서에서 디지털 참고서 제공 서버(100)의 Computer Vision을 이용한 페이지 간 유사성 비교 모듈의 예시를 인증페이지부(123)가 대여 권한의 연장 시 요구하는 랜덤 페이지(g)를 통해 설명하며, 이러한 Computer Vision을 이용한 페이지 간 유사성 비교 모듈을 통한 페이지 분석은 랜덤 페이지(g)뿐만 아니라 다른 페이지(f, h)에서도 동일하게 동작할 수 있다.An example of the similarity comparison module between pages using computer vision of the digital reference book providing server 100 will be described with reference to FIG. 8 below. Meanwhile, in this specification, an example of the similarity comparison module between pages using computer vision of the digital reference book providing server 100 is explained through the random page (g) requested by the authentication page unit 123 when extending rental authority, and this Page analysis through the similarity comparison module between pages using Computer Vision can operate equally not only on random pages (g) but also on other pages (f, h).
본 발명에 따른 학생단말기(10)는 연장이미지를 생성할 때 인증페이지부(123)가 랜덤으로 결정한 랜덤 페이지(g)를 촬영한다. 학생단말기(10)는 랜덤 페이지(g)를 연장이미지 내 포함하여 인증페이지부(123)로 송신한다. 인증페이지부(123)는 수신한 연장이미지 내 랜덤 페이지를 분석할 때 Computer Vision을 이용한 페이지 간 유사성 비교 모듈을 이용한다.The student terminal 10 according to the present invention photographs a random page (g) randomly determined by the authentication page unit 123 when generating an extended image. The student terminal 10 includes a random page (g) in the extended image and transmits it to the authentication page unit 123. The authentication page unit 123 uses a similarity comparison module between pages using computer vision when analyzing random pages in the received extended image.
본 발명에 따른 Computer Vision을 이용한 페이지 간 유사성 비교 모듈은, 도 8을 참조하면, 먼저 데이터베이스 내 저장된 디지털 참고서를 검색한다. 이때 검색되는 디지털 참고서는 학생단말기(10)에 의해 촬영된 실물 참고서의 표지(f)의 타이틀을 기초로 실물 참고서와 대응되는 디지털 참고서가 검색될 수 있다. 이후 유사성 비교 모듈은 촬영된 랜덤 페이지(g)에 대응되는 디지털 참고서 내 페이지를 검색한다. 이후 유사성 비교 모듈은 검색한 페이지 내에서 특징점들을 추출한다. 추출된 특징점들은 연장이미지 내 랜덤페이지(g)의 특징점들과 비교된다. 유사성 비교 모듈은 특징점들의 비교 후 오차범위 내 동일하다고 판단되는 경우 해당 실물 참고서의 완전성을 확인하고 대여 권한을 연장한다.Referring to FIG. 8, the similarity comparison module between pages using Computer Vision according to the present invention first searches digital reference books stored in the database. At this time, the digital reference book being searched may be a digital reference book corresponding to the physical reference book based on the title of the cover (f) of the physical reference book photographed by the student terminal 10. Afterwards, the similarity comparison module searches for pages in the digital reference book that correspond to the photographed random page (g). Afterwards, the similarity comparison module extracts feature points from the searched page. The extracted feature points are compared with the feature points of the random page (g) in the extended image. The similarity comparison module checks the completeness of the physical reference book and extends rental authority if it is determined that the feature points are identical within the error range after comparing them.
도 9는 동일한 실물 참고서 내 인증 페이지는 모두 동일하게 설정된 것을 보여주는 도면이다.Figure 9 is a diagram showing that all authentication pages within the same physical reference book are set the same.
본 발명에 따른 디지털 참고서 제공 시스템(1000)은, 도 9를 참조하면, 실물 참고서마다 인증 페이지(h)를 모두 동일하도록 설정하여, 이른바 실물 참고서와 디지털 참고서의 1:1 원칙을 준수한다. 도 9에는 book 1 및 book 2로 기재된 두 개의 실물 참고서가 도시되어 있다. book 1들의 인증 페이지(h)는 이용자와 관계없이 모두 동일한 페이지를 인증 페이지(h)로 설정된다. 또한 book 2들의 인증 페이지(h)도 이용자와 관계없이 모두 동일한 페이지를 인증 페이지(h)로 설정된다. book 1과 book 2의 인증 페이지(h)는 서로 다를 수도 있고, 서로 같을 수도 있다. 이처럼 동일한 참고서의 인증 페이지(h)가 서로 같아, 실물 참고서를 기초로 구매 및 소지 인증을 할 때 한 권의 실물 참고서의 2차 유통에 따라 발생하는 문제점을 방지할 수 있다.Referring to FIG. 9, the digital reference book providing system 1000 according to the present invention sets all authentication pages (h) to be the same for each physical reference book, thereby complying with the so-called 1:1 principle between physical reference books and digital reference books. Figure 9 shows two physical reference books labeled book 1 and book 2. The authentication page (h) of book 1 is set to the same page as the authentication page (h) regardless of the user. Additionally, the authentication pages (h) of book 2 are all set to the same page as the authentication page (h) regardless of the user. The authentication pages (h) of book 1 and book 2 may be different from each other or may be the same. In this way, since the authentication pages (h) of the same reference book are the same, problems that arise due to secondary distribution of one physical reference book can be prevented when purchasing and authenticating possession based on the physical reference book.
정리하면 본 발명에 따른 디지털 참고서 제공 시스템(1000)은 복수 개의 학생단말기(10)를 포함하고, 인증페이지부(123)는, 복수 개의 학생단말기(10)로 인증페이지 정보를 송신할 때, 동일한 참고서인 경우 동일한 페이지를 인증페이지(h)로 결정하여 복수 개의 학생단말기(10)로 각각 송신한다. 따라서 실물 참고서와 디지털 참고서가 1:1 대응되도록 한다.In summary, the digital reference book providing system 1000 according to the present invention includes a plurality of student terminals 10, and the authentication page unit 123 is identical when transmitting authentication page information to a plurality of student terminals 10. In the case of a reference book, the same page is determined as the authentication page (h) and transmitted to a plurality of student terminals (10). Therefore, ensure that there is a 1:1 correspondence between the physical reference book and the digital reference book.
도 10은 본 발명에 따른 디지털 참고서 변환 서버(200)의 각 구성을 보여주는 도면이다.Figure 10 is a diagram showing each configuration of the digital reference book conversion server 200 according to the present invention.
전술한 바와 같이 디지털 참고서 변환 서버(200)는 출판사 등의 외부서버(20)로부터 실물 참고서를 기반으로 PDF, Word, hwp 등으로 디지털화 된 디지털 참고서를 수신하고, 각 디지털 참고서에서 요소들을 추출하여 관리한다.As described above, the digital reference book conversion server 200 receives digital reference books digitized into PDF, Word, HWP, etc. based on physical reference books from an external server 20, such as a publisher, and extracts and manages elements from each digital reference book. do.
본 발명에 따른 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템(1000)은, 다시 도 1을 참조하면, 디지털 참고서 변환 서버(200)를 포함한다. 디지털 참고서 변환 서버(200)는 PDF(portable document format), hwp, doc 등(이하, ‘PDF’라 함) 형식으로 생성된 디지털 참고서 파일에 포함된 콘텐츠의 각 요소를 분리 추출하여 저장 및 관리한다. 디지털 참고서 변환 서버(200)는 디지털화 된 참고서의 PDF 파일에서 요소(element)들을 각각 추출하여 저장 및 관리하고, 그 요소들을 그룹화하여 학생단말기(10)로 제공할 수 있다. Referring again to FIG. 1, the system 1000 for providing digital reference books through purchase authentication of physical reference books according to the present invention includes a digital reference book conversion server 200. The digital reference book conversion server 200 separately extracts, stores, and manages each element of content included in a digital reference book file created in a portable document format (PDF), hwp, doc, etc. (hereinafter referred to as 'PDF'). . The digital reference book conversion server 200 can extract, store and manage elements from the PDF file of the digitized reference book, group the elements, and provide them to the student terminal 10.
본 발명에 따른 디지털 참고서 변환 서버(200)는, 도 10을 참조하면, 파일생성부(210), 영역검출부(220) 및 요소추출부(230)를 포함한다.Referring to FIG. 10, the digital reference book conversion server 200 according to the present invention includes a file creation unit 210, an area detection unit 220, and an element extraction unit 230.
파일생성부(210)는 디지털화 된 참고서의 PDF 파일에서 복수개의 페이지를 추출하여 페이지 파일을 생성한다. 즉 파일생성부(210)는 PDF 파일이 가지고 있는 복수개의 페이지를 각각 단일의 페이지로 분리한 페이지 파일을 생성한다. The file creation unit 210 extracts a plurality of pages from the PDF file of the digitized reference book and generates a page file. That is, the file creation unit 210 creates a page file in which the plurality of pages contained in the PDF file are separated into single pages.
파일생성부(210)가 페이지를 추출하는 PDF 파일은 기 생성되어 디지털 참고서 변환 서버(200)가 별도로 포함하는 데이터베이스부(250)에 저장된 PDF 파일일 수 있다. 파일생성부(210)가 페이지를 추출하는 PDF 파일은 스마트폰, 스캐너, 복합기 등 학생단말기(10)에 의해 참고서가 스캔되어 생성된 PDF 파일이 수신될 수 있다. 또는 파일생성부(210)가 페이지를 추출하는 PDF 파일은 통신망을 통해 연결된 다른 외부서버(20)로부터 수신될 수 있다. 참고서가 스캔되어 생성된 PDF 파일은 복수개의 페이지를 포함한다. 파일생성부(210)는 복수개의 페이지를 각각 단일의 페이지로 추출하여 페이지 파일을 생성한다. The PDF file from which the file creation unit 210 extracts pages may be a PDF file that has already been created and stored in the database unit 250 separately included in the digital reference book conversion server 200. The PDF file from which the file creation unit 210 extracts pages may be received as a PDF file generated by scanning a reference book by the student terminal 10, such as a smartphone, scanner, or multi-function printer. Alternatively, the PDF file from which the file creation unit 210 extracts pages may be received from another external server 20 connected through a communication network. A PDF file created by scanning a reference book includes multiple pages. The file creation unit 210 generates a page file by extracting a plurality of pages into a single page.
[규칙 제91조에 의한 정정 30.12.2022]
한편, 파일생성부(210)가 페이지를 추출하는 PDF 파일은 그 생성된 방법에 따라 Structured PDF 또는 Scanned PDF 파일일 수 있다. Structured PDF는 컴퓨터 소프트웨어를 이용하여 전자적으로 생성된 PDF 파일이고, Scanned PDF은 실물의 특정 서책을 스캐너 등을 이용하여 이미지 형태로 생성된 PDF 파일이다. Structured PDF과 Scanned PDF의 큰 차이점으로 Structured PDF는, 도 11을 참조하면, 각 페이지가 포함하는 텍스트, 이미지 또는 표 등 각 요소에 대해서 선택(identify) 및 선택에 따른 추출이 가능하다는 점이다. 도 11의 파란색 하이라이트 부분은 요소가 선택된 모습을 나타낸다. Scanned PDF는 Structured PDF와 달리, 도 12를 참조하면, 각 요소에 대한 선택 및 추출이 불가능하며, 따라서 파일생성부(210)는, 준비된 PDF 파일이 Scanned PDF 일 경우, OCR process를 통해서 Structure를 복원한다. 이때 OCR process는 후술하게 될 광학문자인식부(240)에 의해 진행될 수 있다. 또는 파일생성부(210)는 준비된 PDF 파일이 Scanned PDF 일 경우, OCR process를 통하지 않고, 후술하게 될 영역검출부(220)에 의해 질문영역, 답변영역 및 해설영역 등이 추출되고, 추출된 영역의 이미지가 전술한 데이터베이스부(110)뿐만 아니라 데이터베이스부(250)에 저장되어 관리될 수도 있다.[Correction 30.12.2022 pursuant to Rule 91]
Meanwhile, the PDF file from which the file creation unit 210 extracts pages may be a Structured PDF or Scanned PDF file depending on how it was created. Structured PDF is a PDF file created electronically using computer software, and Scanned PDF is a PDF file created in image form using a specific physical book using a scanner, etc. The major difference between Structured PDF and Scanned PDF is that Structured PDF, referring to Figure 11, allows identification of each element, such as text, image, or table included in each page, and extraction based on selection. The blue highlighted portion in Figure 11 indicates that the element is selected. Unlike Structured PDF, Scanned PDF does not allow selection and extraction of each element, as shown in Figure 12. Therefore, when the prepared PDF file is Scanned PDF, the file creation unit 210 restores the structure through the OCR process. do. At this time, the OCR process may be performed by the optical character recognition unit 240, which will be described later. Alternatively, if the prepared PDF file is a Scanned PDF, the file creation unit 210 extracts the question area, answer area, and commentary area by the area detection unit 220, which will be described later, without going through the OCR process, and extracts the extracted area. Images may be stored and managed in the database unit 250 as well as the database unit 110 described above.
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022]
<도 11 : Structured PDF>[Correction 30.12.2022 pursuant to Rule 91]
<Figure 11: Structured PDF>
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022]
<도 12 : Scanned PDF>[Correction 30.12.2022 pursuant to Rule 91]
<Figure 12: Scanned PDF>
본 발명에 따른 디지털화 된 참고서는 문제집 및 해설집을 포함한다. The digitized reference book according to the present invention includes a workbook and a commentary book.
먼저, 참고서가 문제집일 경우, 본 발명에 따른 영역검출부(220)는, 파일생성부(210)가 생성한 페이지 파일에서, 페이지 파일의 전체 이미지, 페이지 파일 내 포함된 텍스트, HTML, CSS, Font, Background vector image 등 요소를 추출한다. 이후, 영역검출부(220)는 페이지 파일 각각을 HTML page로 변환한다. Structured PDF가 HTML page로 변환된 경우, 각 요소들은 변환 후 검출(Clickable) 가능하며, Scanned PDF에 대해서는 각 요소들의 검출이 불가능한 상태에서 전체 페이지가 한 개의 이미지로 추출된다. 따라서 전술한 바와 같이 Scanned PDF는 OCR processing을 통해서 이미지 내 character/number의 검출이 가능한 형태로 변환될 필요가 있다. 한편, 영역검출부(220)가 페이지 파일 각각을 HTML page로 변환한 후, 각 페이지 내에서 선택 가능한 요소(identified element)에 대해 id 값을 부여한다. 이때, 선택 가능한 요소란, 텍스트, 이미지 또는 표 등 각 요소를 포함하며, 예를 들어, 문제영역, 문제영역 내 질문영역 및 답변영역, 답변영역 내 원숫자 선택지 등을 포함할 수 있다.First, when the reference book is a workbook, the area detection unit 220 according to the present invention selects the entire image of the page file, text included in the page file, HTML, CSS, and Font from the page file generated by the file creation unit 210. , Background vector image, etc. are extracted. Afterwards, the area detection unit 220 converts each page file into an HTML page. When Structured PDF is converted to an HTML page, each element can be detected (clickable) after conversion, and for Scanned PDF, the entire page is extracted as one image while each element cannot be detected. Therefore, as mentioned above, Scanned PDF needs to be converted to a form that allows detection of characters/numbers in the image through OCR processing. Meanwhile, the area detection unit 220 converts each page file into an HTML page and then assigns an id value to a selectable element (identified element) within each page. At this time, selectable elements include each element such as text, image, or table, and may include, for example, a problem area, a question area and answer area within the problem area, and raw number options within the answer area.
단, 선택 가능한 요소에 부여된 class id 값은 PDF 가 HTML 페이지로의 변환과정에서 각 페이지 내 위치정보를 기반으로 생성된 것으로 그 id 값에 의미는 없다. 따라서 이러한 id 값을 의미단위, 즉 페이지, 문제, 보기 또는 객관식 문항 등의 단위로 그룹화하기 위해 페이지 파일의 이미지를 아래와 같은 머신러닝 과정을 진행한다. 이때 그룹화는, 예를 들어, 하나의 지문에 딸린 문제, 보기, 객관식 문항 등을 그룹화하는 것을 의미할 수 있다.However, the class id value assigned to the selectable element is created based on location information within each page during the PDF conversion process to HTML page, so the id value has no meaning. Therefore, in order to group these id values into meaningful units, such as pages, problems, views, or multiple choice questions, the image of the page file is subjected to the machine learning process as follows. At this time, grouping may mean, for example, grouping problems, examples, and multiple-choice questions belonging to one passage.
영역검출부(220)는 먼저, 각 페이지 파일에서 문제영역을 검출하여 ID를 부여하고, 그 문제영역 내 상호작용(interaction)이 필요한 질문영역 및 답변영역으로 분리하여 검출한다. 검출된 질문영역 및 답변영역에도 id(Sub-id)가 부여된다. 또한 문제영역 내 상호작용이 필요한 영역은, 참고서의 과목마다 차이가 있을 수 있으며, 예를 들어, 국어 또는 영어의 경우 묶음지문이 존재하고, 이러한 묶음지문은 학습자의 편의를 위해서는 지문과 문제를 동시에 한 화면에서 볼 수 있도록 하는 것이 바람직하다. The area detection unit 220 first detects a problem area in each page file, assigns an ID, and detects the problem area by separating it into a question area and an answer area that require interaction. An id (Sub-id) is also assigned to the detected question area and answer area. In addition, areas that require interaction within the problem area may differ depending on the subject of the reference book. For example, in the case of Korean or English, bundled passages exist, and these bundled passages combine the passages and problems at the same time for the convenience of the learner. It is desirable to be able to view it on one screen.
[규칙 제91조에 의한 정정 30.12.2022]
본 발명에 따른 영역검출부(220)는, 파일생성부(210)가 추출한 페이지 파일에서 문제영역(그림 4, A)을 검출한다. 영역검출부(220)는 fitz 라이브러리를 사용하여 JSON(JavaScript Object Notation) format의 Object 정보를 추출할 수 있다. fitz 라이브러리는 도 13과 같이 페이지에서 텍스트를 추출할 수 있다.[Correction 30.12.2022 pursuant to Rule 91]
The area detection unit 220 according to the present invention detects problem areas (Figure 4, A) in the page file extracted by the file creation unit 210. The area detection unit 220 can extract object information in JSON (JavaScript Object Notation) format using the fitz library. The fitz library can extract text from a page as shown in Figure 13.
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022]
영역검출부(220)는 fitz 라이브러리를 통해 페이지에서 텍스트를 검출한다. 영역검출부(220)는 텍스트간 자간 또는 상하방향 길이가 다른 텍스트 간 자간 또는 상하방향 길이보다 더 긴 부분을 경계로 하여 도 14와 같이 각각의 문제영역을 검출할 수 있다.[Correction 30.12.2022 pursuant to Rule 91]
The area detection unit 220 detects text on the page through the fitz library. The area detection unit 220 can detect each problem area as shown in FIG. 14 using the letter spacing between texts or a portion longer than the letter spacing or vertical length between texts having different vertical lengths as a boundary.
영역검출부(220)는 각 페이지 파일에서 문제영역을 검출할 때, 머신러닝을 이용하여 각 문제영역을 둘러싼 바운딩박스(bounding box)를 생성할 수 있다. 영역검출부(220)는 머신러닝으로 생성한 바운딩박스 내 문제영역에 통일된 배경색을 추가할 수 있다. 영역검출부(220)는 바운딩박스를 제외한 나머지 영역에 대해 opencv를 통해 인접한 픽셀끼리 팽창화를 통해 다른 문제영역이 존재하는 지 판단한다.When detecting problem areas in each page file, the area detection unit 220 may use machine learning to create a bounding box surrounding each problem area. The area detection unit 220 can add a unified background color to the problem area within the bounding box generated through machine learning. The area detection unit 220 determines whether other problem areas exist in the remaining areas excluding the bounding box by inflating adjacent pixels through opencv.
영역검출부(220)가 생성한 바운딩박스 내의 정보만이 작업영역으로 할당되어 전체 페이지를 처리하는 것 보다 본 발명에 따른 처리속도가 더욱 빨라질 수 있다. 한편, 영역검출부(220)는 생성한 바운딩박스의 위치 및 사이즈에 대한 정보를 검출하여 저장한다.Only the information within the bounding box generated by the area detection unit 220 is assigned to the work area, so that the processing speed according to the present invention can be faster than processing the entire page. Meanwhile, the area detection unit 220 detects and stores information about the location and size of the created bounding box.
한편, 영역검출부(220)는, 각 페이지 파일에서 문제영역을 검출할 때, 페이지 가로방향 중간점 x 좌표(x half)보다, 바운딩박스의 최좌측점 x 좌표(x1) 및 최우측점 x 좌표(x2)의 값이 더 클 때 페이지의 레이아웃이 2열인 것으로 판단할 수 있다. 페이지 가로방향의 중간점 좌표란 전체 페이지의 중심점 또는 페이지의 좌측과 우측을 잇는 선분의 중심에 해당하는 좌표 값일 수 있다. Meanwhile, when detecting a problem area in each page file, the area detection unit 220 uses the leftmost point x coordinate (x1) and the rightmost point x coordinate ( When the value of x2) is larger, it can be determined that the page layout is two-column. The midpoint coordinates in the horizontal direction of the page may be coordinate values corresponding to the center point of the entire page or the center of the line segment connecting the left and right sides of the page.
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022]
영역검출부(220)는 검출한 문제영역을, 도 15와 같이 질문영역 및 답변영역(B, 도 15)으로 분리한다. 영역검출부(220)는 문제영역을 질문영역 및 답변영역으로 분리할 때 먼저 답변영역을 먼저 선택하여 추출하고, 선택한 답변영역을 제외한 나머지 문제영역을 질문영역으로 선택한다.[Correction 30.12.2022 pursuant to Rule 91]
The area detection unit 220 separates the detected problem area into a question area and an answer area (B, Figure 15) as shown in Figure 15. When dividing the problem area into a question area and an answer area, the area detection unit 220 first selects and extracts the answer area, and selects the remaining problem areas excluding the selected answer area as the question area.
문제영역은 문제가 가로로 정렬될 수도 있고, 세로로 정렬될 수도 있다. 문제영역이 세로로 정렬될 경우 답변영역의 선택은 아래와 같다.In the problem area, problems may be arranged horizontally or vertically. If the problem areas are aligned vertically, the answer area selection is as follows.
영역검출부(220)는 페이지 파일에서 문제영역을 검출할 때, 원숫자가 포함된 행을 검출할 수 있다. 영역검출부(220)에 의해 일련의 연속된 원숫자가 행의 최좌측에서 검출되고, 그 원숫자의 열의 아랫방향으로 일련의 증가되도록 연속된 원숫자가 검출된 경우, 영역검출부(220)는 문제영역에서 검출된 원숫자가 포함된 문장이 있는 영역을 답변영역으로 선택한다.When detecting a problem area in the page file, the area detection unit 220 can detect a row containing a raw number. When a series of consecutive raw numbers are detected from the leftmost side of a row by the area detection unit 220, and a series of increasing continuous raw numbers are detected downward in the column of the raw numbers, the area detection unit 220 detects a problem. The area containing the sentence containing the raw number detected in the area is selected as the answer area.
또한 문제영역이 가로로 정렬될 경우, 영역검출부(220)는 페이지 파일에서 문제영역을 검출할 때, 원숫자가 연속적으로 증가하도록 포함된 행을 검출할 수 있다. 영역검출부(220)에 의해 일련의 연속된 원숫자가 행을 따라 검출되고, 다음 행에 그 다음의 원숫자가 검출된 경우, 영역검출부(220)는 문제영역에서 검출된 원숫자가 포함된 문장이 있는 영역을 답변영역으로 선택한다.Additionally, when the problem area is aligned horizontally, the area detection unit 220 can detect rows in which the raw number increases continuously when detecting the problem area in the page file. When a series of consecutive raw numbers are detected along a row by the area detection unit 220, and the next raw number is detected in the next row, the area detection unit 220 detects a sentence containing the raw numbers detected in the problem area. Select the area with this as the answer area.
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022]
요소추출부(230)는, 도 16과 같이, 영역검출부(220)에 의해 분리된 질문영역 및 답변영역에서 요소(C 내지 F, 도 16)를 추출하고 추출된 요소를 데이터베이스부(250)에 저장한다. 이때 요소는 문제인덱스(C), 텍스트(D), 이미지(E), 글박스(미도시) 및 표(미도시)를 포함한다. 요소추출부(230)는 문제인덱스(C)를 추출할 때 질문영역의 최좌측에 위치하는 인덱스를 선택하여 추출한다. 요소추출부(230)는 문제영역에서 이미지(E)를 선택하여 추출할 수 있다. 요소추출부(230)가 추출한 문제인덱스는, 후술하게 될, 해설집의 답변영역과 서로 연결되어 채점 자동화에 이용될 수 있다.[Correction 30.12.2022 pursuant to Rule 91]
As shown in FIG. 16, the element extraction unit 230 extracts elements (C to F, FIG. 16) from the question area and the answer area separated by the area detection unit 220 and stores the extracted elements in the database unit 250. Save. At this time, the elements include problem index (C), text (D), image (E), text box (not shown), and table (not shown). When extracting the problem index (C), the element extraction unit 230 selects and extracts the index located on the leftmost side of the question area. The element extraction unit 230 can select and extract the image (E) from the problem area. The problem index extracted by the element extraction unit 230 is connected to the answer area of the commentary book, which will be described later, and can be used to automate scoring.
요소추출부(230)가 질문영역에서 추출한 문제인덱스(C) 및 이미지(E)를 제외한 나머지는 텍스트(D)일 수 있다. 이때의 텍스트의 각 위치에 따라 서로 다른 바운딩박스를 가진 영역을 기초로 각 텍스트는 선택 및 추출될 수 있다. 한편, 요소추출부(230)는, 선택한 질문영역에서의 텍스트 중 일련의 선택지(F)를 선택 및 추출할 수 있다. 일련의 선택지(F)는, 각 문장에 각각 'ㄱ. ㄴ. ㄷ.', '(ㄱ) (ㄴ) (ㄷ)', '가. 나. 다.' 또는 '(가) (나) (다)'가 일련으로 검출된 경우, 그 문장들 또는 그 영역을 일련의 선택지(F)로 선택 및 추출할 수 있다.Except for the problem index (C) and image (E) extracted from the question area by the element extraction unit 230, the rest may be text (D). At this time, each text can be selected and extracted based on an area with a different bounding box depending on each position of the text. Meanwhile, the element extraction unit 230 can select and extract a series of options (F) from the text in the selected question area. A series of options (F) include ‘a.’ in each sentence. you. ‘C.’, ‘(ㄱ) (ㄴ) (ㄷ)’, ‘A. me. all.' Or, if '(a) (b) (c)' is detected in a series, those sentences or the area can be selected and extracted as a series of options (F).
요소추출부(230)는, 선택 및 추출한 각 요소들을 데이터베이스부(250)에 저장한다. 요소추출부(230)가 선택 및 추출한 각 요소들은 각각 바운딩박스를 가지고, 그 바운딩박스 내의 영역을 이미지의 형태로 데이터베이스부(250)에 저장한다.The element extraction unit 230 stores each selected and extracted element in the database unit 250. Each element selected and extracted by the element extraction unit 230 has a bounding box, and the area within the bounding box is stored in the database unit 250 in the form of an image.
또한 요소추출부(230)는, 전술한 영역검출부(220)가 문제영역에서 원숫자가 포함된 문장이 있어 답변영역으로 선택한 영역에서, 원숫자가 포함된 문장을 선택지로 판단한다. 요소추출부(230)는 선택지가 포함된 답변영역에서 전술한 요소들을 추출하고, 추출된 요소를 데이터베이스부(250)에 저장한다.Additionally, the element extraction unit 230 determines the sentence containing the raw number as an option in the area selected by the above-described area detection unit 220 as the answer area because there is a sentence containing the raw number in the problem area. The element extraction unit 230 extracts the above-described elements from the answer area containing the options and stores the extracted elements in the database unit 250.
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
한편, 참고서의 과목 종류에 따라 문제의 형식에 차이가 있는 경우가 있다. 예를 들어 참고서의 과목이 수학인 경우, 문제영역 내에 수식이 존재할 수 있다. 요소추출부(230)가 추출하는 요소에는 수식이 더 포함될 수 있으며, 요소추출부(230)는 문제영역 내 수식 요소를 추출할 때, MatchOCR(예를 들어, Mathpix)를 사용하여 수식에 대하여 MathML 혹은 LaTex 형태로 수식을 추출할 수 있다. 한편, 참고서의 과목이 수학인 경우에만 문제영역에서 수식 요소가 추출되는 것에 한정되는 것은 아니고, 문제영역 내 수식이 검출될 때에는 언제나 수식 요소가 추출될 수 있다.Meanwhile, there may be differences in the format of the questions depending on the type of subject in the reference book. For example, if the subject of the reference book is mathematics, there may be a formula in the problem area. The elements extracted by the element extraction unit 230 may further include formulas, and when extracting formula elements within the problem area, the element extraction unit 230 uses MatchOCR (e.g., Mathpix) to match the MathML formula to the formula. Alternatively, you can extract the formula in LaTex format. Meanwhile, extraction of formula elements from the problem domain is not limited to only when the subject of the reference book is mathematics, and formula elements can be extracted whenever a formula within the problem domain is detected.
[규칙 제91조에 의한 정정 30.12.2022]
또한 참고서의 과목이 국어 또는 영어인 경우에는, 도 17과 같이 묶음지문이 포함될 수 있다. 묶음지문이란, 하나의 지문에 복수개의 문제가 포함된 지문을 의미한다.[Correction 30.12.2022 pursuant to Rule 91]
Additionally, if the subject of the reference book is Korean or English, a bundled text may be included as shown in FIG. 17. A bundled fingerprint refers to a fingerprint that contains multiple questions in one fingerprint.
[규칙 제91조에 의한 정정 30.12.2022]
영역검출부(220)는, 문제영역 최상단에서 묶음지문 번호(G, 도 17)를 검출할 수 있다. 영역검출부(220)는, 묶음지문 번호가 검출되면, 묶음지문 번호가 해당하는 문제 영역을 포함시킬 수 있도록 Document 병합 작업을 실시하고(후술하게 될 해설영역 참조), 그 묶음지문 번호를 포함하는 영역에 바운딩박스를 생성한다. 이때 영역검출부(220)는 묶음지문 번호에 따른 문제영역을 함께 포함하도록 바운딩박스를 생성할 수 있다. 예를 들어 도 17과 같이 '35~37' 이 묶음지문 번호인 경우, 영역검출부(220)는, 묶음지문과 함께 35 내지 37번 문제인덱스(C)를 가진 문제영역이 포함되도록 바운딩박스를 생성한다. 그리고 요소추출부(230)는, 질문영역 및 답변영역에서 요소를 추출하여 데이터베이스부(250)에 저장할 때 전술한 묶음지문에서도 요소를 함께 추출하여 데이터베이스부(250)에 저장하며, 이때 질문영역 및 답변영역에서 추출한 요소와 묶음지문에서 추출한 요소가 서로 연결되도록 데이터베이스부(250)에 저장할 수 있다.[Correction 30.12.2022 pursuant to Rule 91]
The area detection unit 220 can detect the bundled fingerprint number (G, Figure 17) at the top of the problem area. When a bundled fingerprint number is detected, the area detection unit 220 performs a document merge operation so that the problem area corresponding to the bundled fingerprint number can be included (refer to the explanation area to be described later), and the area containing the bundled fingerprint number is Create a bounding box in . At this time, the area detection unit 220 may create a bounding box to include the problem area according to the bundled fingerprint number. For example, if '35 to 37' is a bundled fingerprint number as shown in Figure 17, the area detection unit 220 creates a bounding box to include problem areas with problem indexes (C) numbered 35 to 37 along with the bundled fingerprint. do. And, when the element extraction unit 230 extracts elements from the question area and the answer area and stores them in the database unit 250, it also extracts elements from the above-mentioned bundled fingerprint and stores them in the database unit 250. The elements extracted from the answer area and the elements extracted from the bundled fingerprint can be stored in the database unit 250 so that they are connected to each other.
묶음지문의 검출은 참고서의 과목이 국어 또는 영어인 경우에만 한정되는 것은 아니고, 영역검출부(220)가 전술한 묶음지문 번호와 같은 '숫자~숫자' 형식의 숫자배열이 검출될 때에는 언제나 묶음지문 요소가 추출되고 저장될 수 있다.Detection of a bundled fingerprint is not limited to when the subject of the reference book is Korean or English, and whenever the area detection unit 220 detects a numeric array in the form of 'number ~ number' such as the above-mentioned bundled fingerprint number, the bundled fingerprint element is always detected. can be extracted and stored.
[규칙 제91조에 의한 정정 30.12.2022]
한편, 특정영역의 묶음 지문은 도 17처럼 묶음 번호가 부여되지 않는 경우가 존재하며, 이 경우 각 문제영역을 검출한 후 남은 영역을 지문영역으로 규정하고 각 페이지별 검수절차를 통해서 남은 지문을 관계있는 문제영역과 후 보정으로 맵핑 프로세스 진행할 수 있다.[Correction 30.12.2022 pursuant to Rule 91]
On the other hand, there are cases where bundled fingerprints in a specific area are not assigned a bundle number as shown in Figure 17. In this case, after detecting each problem area, the remaining area is defined as the fingerprint area and the remaining fingerprints are related through the inspection procedure for each page. The mapping process can be carried out with problem areas and post-correction.
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
요소추출부(230)는, 추출한 요소들 즉 문제인덱스(C), 텍스트(D), 이미지(E), 글박스(미도시), 표(미도시), 일련의 선택지(F), 페이지 정보 들을 하나의 문제로 그룹화하여 데이터베이스부(250)에 저장한다. 그룹화된 요소들은, 후술하게 될 문제제공부(260)에 의해 학생단말기(10)로 제공될 수 있다. 묶음지문이 있는 경우, 하나의 묶음지문과 대응되는 문제들이 동시에 한 화면에 제공되는 것이 바람직하다. 따라서 요소추출부(230)는, 페이지 파일에 묶음지문이 존재하는지, 묶음 지문이 대응되는 문항들이 몇 번 문제들인지, 즉 어느 문제인덱스를 가지고 있는지, 묶음 지문이 페이지가 넘어간다면, 그때의 페이지 정보들을 추출하여 데이터베이스부(250)에 저장한다. 요소추출부(230)는, 추출한 요소들을 그룹화할 때 해당 요소들에 특정 class id 값을 부여할 수 있다.The element extraction unit 230 extracts the extracted elements, namely problem index (C), text (D), image (E), text box (not shown), table (not shown), a series of options (F), and page information. These are grouped into one problem and stored in the database unit 250. Grouped elements may be provided to the student terminal 10 by the problem providing unit 260, which will be described later. When there are bundled fingerprints, it is desirable for problems corresponding to one bundled fingerprint to be provided on one screen at the same time. Therefore, the element extraction unit 230 determines whether a bundled fingerprint exists in the page file, how many questions there are in the questions to which the bundled fingerprint corresponds, that is, which question index it has, and, if the bundled fingerprint goes beyond the page, the page information at that time. These are extracted and stored in the database unit 250. When grouping extracted elements, the element extraction unit 230 may assign a specific class id value to the corresponding elements.
문제제공부(260)는, 요소추출부(230)가 그룹화한 요소들을 학생단말기(10)의 화면에 제공한다. 이때, 제공되는 요소들은 각각 위치값에 맞는 위치에 배열된 상태에서 html layer 로 제공될 수 있다.The problem providing unit 260 provides elements grouped by the element extracting unit 230 to the screen of the student terminal 10. At this time, the provided elements can be provided as an html layer while being arranged in positions appropriate for each position value.
한편, 문제제공부(260)는 Multi-layer structure를 학생단말기(10)로 제공할 수 있다. 즉, 그룹화된 문제들이 학생단말기(10)로 제공되는 html layer 상에 필기를 위한 필기 layer 가 더 제공될 수 있다. 학생단말기(10)는 html layer 상에 제공된 필기 layer 에 필기와 문제풀기를 진행할 수 있다. 문제제공부(260)는 필기 layer에 기재된 손글씨를 인식할 수 있는 라이브러리를 통해 답 체크를 인식할 수 있다. 이때의 답 체크는 html layer의 답변영역에 포함된 어느 원숫자가 위치한 위치값과 동일한 위치의 필기 layer 에 손글씨의 방식으로 체크된 경우, 문제제공부(260)는 후술하게 될 답변영역의 문제인덱스와 정답을 기반으로 학생단말기(10)의 답 체크와 정답을 비교하여 문제의 채점을 자동화할 수 있다. Meanwhile, the problem providing unit 260 can provide a multi-layer structure to the student terminal 10. In other words, a writing layer for writing may be further provided on the HTML layer where grouped problems are provided to the student terminal 10. The student terminal 10 can proceed with writing and problem solving on the writing layer provided on the HTML layer. The problem providing unit 260 can recognize the answer check through a library that can recognize handwriting written in the handwriting layer. At this time, if the answer is checked by handwriting on the handwriting layer at the same position as the position value of a certain raw number included in the answer area of the html layer, the problem providing unit 260 creates a question index of the answer area, which will be described later. Based on the and correct answers, the grading of questions can be automated by comparing the answer check on the student terminal 10 with the correct answer.
본 발명에 따른 디지털화 된 참고서가 문제집에 따른 문제의 정답과 해설이 포함된 해설집인 경우, 영역검출부(220)는, 페이지 파일에서 전체 이미지 파일을 추출한다. 영역검출부(220)는 추출한 이미지 파일에서 해설영역을 추출한다. 이때 해설영역의 추출은, 전술한 문제영역의 검출과 동일한 process 에 의해 진행될 수 있다. If the digitized reference book according to the present invention is a commentary book containing answers and explanations to problems according to the problem book, the area detection unit 220 extracts the entire image file from the page file. The area detection unit 220 extracts the commentary area from the extracted image file. At this time, extraction of the commentary area may be performed through the same process as the detection of the problem area described above.
[규칙 제91조에 의한 정정 30.12.2022]
한편, 영역검출부(220)는 해설영역을 추출할 때, 각 페이지 파일에서 추출된 전체 이미지 파일에서 먼저 n 열 방식의 구성에서, 도 18을 참조하면, 구분선인 중앙라인(midline, H, 도 18)을 검출할 수 있다. 또한 영역검출부(220)는 각 페이지 내에서 컨텐츠를 구성하는 최내측 구분선인 바깥라인(outline, I, 도 18)도 검출할 수 있다. 영역검출부(220)는, 중앙라인과 바깥라인을 기준으로 내부 컨텐츠가 담긴 이미지를, 중앙라인을 기준으로 잘라 하나의 이미지로 병합할 수 있다. 하나의 이미지로 병합된 예시는 도 19와 같다. 이와 같은 병합된 이미지는 해설영역의 모든 페이지에 대응하는 이미지가 단일의 이미지로 병합된 것일 수 있다.[Correction 30.12.2022 pursuant to Rule 91]
Meanwhile, when extracting the commentary area, the area detection unit 220 first selects an n-column configuration from the entire image file extracted from each page file. Referring to FIG. 18, the midline (H, FIG. 18) is a dividing line. ) can be detected. Additionally, the area detection unit 220 can also detect the outer line (outline I, Figure 18), which is the innermost dividing line that constitutes the content within each page. The area detection unit 220 may cut an image containing internal content based on the center line and the outer line and merge them into one image by cutting the image based on the center line. An example of merging into one image is shown in Figure 19. Such a merged image may be one in which images corresponding to all pages of the commentary area are merged into a single image.
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
요소추출부(230)는, 영역검출부(220)가 해설집 PDF가 하나로 병합된 이미지를 각 챕터 영역으로 구분한다. In the element extraction unit 230, the area detection unit 220 divides the image in which the commentary book PDFs are merged into one chapter area.
[규칙 제91조에 의한 정정 30.12.2022]
요소추출부(230)는 병합된 이미지를 각 챕터 영역으로 구분할 때, 도 20을 참조하면, 챕터를 구분하는 제1 구분자를 선택하고, 도 21을 참조하면, 선택한 제1 구분자의 특징점을 추출하고, 도 22를 참조하면, 추출한 제1 구분자를 기준으로 제2 구분자를 검출하여 각 챕터를 구분할 수 있다.[Correction 30.12.2022 pursuant to Rule 91]
When dividing the merged image into each chapter area, the element extraction unit 230 selects a first separator that separates chapters, referring to FIG. 20, and extracts feature points of the selected first separator, referring to FIG. 21. , Referring to FIG. 22, each chapter can be distinguished by detecting the second separator based on the extracted first separator.
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
[규칙 제91조에 의한 정정 30.12.2022][Correction 30.12.2022 pursuant to Rule 91]
요소추출부(230)는, 전술한 특징점을 통해 병합된 해설집 이미지를 챕터별, 섹션별 분리하고, 각 페이지 정보와 챕터별 문제인덱스를 추출한다. 요소추출부(230)는 문제인덱스별 정답과 해설을 추출하여 데이터베이스부(250)에 저장한다. 요소추출부(230)는, 전술한 문제영역에서의 문제인덱스와 해설영역에서의 문제인덱스를 서로 연결한다. 따라서 문제제공부(260)는, 전술한 바와 같이 학생단말기(10)의 답 체크의 위치정보와 문제의 답변영역의 위치정보를 비교하여 문제의 자동채점이 가능하다.The element extraction unit 230 separates the merged commentary book image by chapter and section through the above-described feature points, and extracts information on each page and problem index for each chapter. The element extraction unit 230 extracts the correct answer and explanation for each problem index and stores them in the database unit 250. The element extraction unit 230 connects the problem index in the above-described problem area and the problem index in the explanation area. Accordingly, the problem providing unit 260 can automatically score the problem by comparing the position information of the answer check of the student terminal 10 with the position information of the answer area of the problem, as described above.
본 발명에 따른 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템(1000)은, 참고서 출판사 및/또는 그들의 총판과 특정 참고서를 유통할 수 있는 저작권 이용허락 약정을 체결하고, 유통을 위한 서책을 납품받거나, 참고서 출판사 및/또는 그들의 총판이 구비한 외부서버(20)로부터 그 특정 참고서의 PDF 파일을 수신할 수 있다. The digital reference book provision system 1000 through purchase authentication of physical reference books according to the present invention enters into a copyright license agreement with reference book publishers and/or their distributors to distribute specific reference books, and receives books for distribution. , the PDF file of the specific reference book can be received from the external server 20 provided by the reference book publisher and/or their distributor.
본 발명에 따른 디지털 참고서 변환 서버(200)는, 웹사이트 및/또는 어플리케이션 기반의 판매채널과 디지털 변환된 참고서가 작동할 수 있는 어플리케이션(Application)을 구축하고, 구축한 어플리케이션을 학생단말기(10)로 제공하는 어플리케이션제공부(미도시)를 더 포함할 수 있다. 어플리케이션제공부가 구축한 어플리케이션은 학생단말기(10)에 설치된다.The digital reference book conversion server 200 according to the present invention builds a website and/or application-based sales channel and an application that can operate digitally converted reference books, and connects the built application to the student terminal (10). It may further include an application providing unit (not shown) provided by . The application built by the application provider is installed on the student terminal (10).
학생단말기(10)는, 어플리케이션제공부가 구축한 판매 채널에서 ID를 생성하여 서책 등 참고서를 구매한다. 학생단말기(10)는 어플리케이션 상에서 ID를 인증하여 디지털 변환된 참고서를 이용할 수 있다. The student terminal 10 purchases reference books such as books by generating an ID from a sales channel established by the application provider. The student terminal 10 can authenticate the ID on the application and use the digitally converted reference book.
학생단말기(10)는, 구매한 참고서에 대해서 수령 후 구매확정 절차 완료 시, 구매한 참고서와 동일한 내용의 디지털 변환된 참고서를 열람 및 사용할 수 있는 권한을 획득한다.The student terminal 10 obtains the right to view and use a digitally converted reference book with the same content as the purchased reference book upon receiving the purchased reference book and completing the purchase confirmation process.
한편, 본 발명에 따른 어플리케이션제공부가 구축한 어플리케이션은, 다음과 같은 안전장치가 구현되어 있을 수 있다.Meanwhile, the application built by the application provider according to the present invention may have the following safety devices implemented.
먼저 어플리케이션에는, 로그인 및 채널 인증절차를 통해서 참고서의 구매자와 로그인 한 학생단말기(10)의 소지자가 동일한 지 확인하는 절차가 구현될 수 있다. First, a procedure can be implemented in the application to check whether the purchaser of the reference book and the holder of the logged-in student terminal 10 are the same through login and channel authentication procedures.
또한 어플리케이션에는, 참고서를 구매한 학생단말기(10)로 취소 불가한 구매확정의 의사표시를 요구하고 구매확정의 의사표시가 있을 시에만 학생단말기(10)로 디지털 참고서의 접근 권한을 제공하는 절차가 구현될 수 있다. 이는 참고서를 구매하지 않은 이용자에게는 참고서 구매의 부가적인 기능인 디지털 참고서의 이용을 방지하기 위한 것이다.In addition, the application includes a procedure that requests an irrevocable expression of intent to purchase from the student terminal (10) that purchased the reference book and provides access to the digital reference book to the student terminal (10) only when there is an expression of intent to confirm the purchase. It can be implemented. This is to prevent users who have not purchased a reference book from using the digital reference book, which is an additional function of purchasing a reference book.
한편, 어플리케이션은 학생단말기(10)로 디지털 참고서를 제공할 때, PDF 파일 형태가 아닌 CDN/보안기능을 강화한 프로토콜에서 파편화된 페이지로 제공할 수 있다.Meanwhile, when the application provides a digital reference book to the student terminal 10, it can provide it as fragmented pages using a CDN/security-enhanced protocol rather than in the form of a PDF file.
본 발명에 따른 학생단말기(10)는, 키보드, 마우스, 터치패드, 터치 스크린 등의 입력수단과, 디스플레이 화면을 구비한 데스크탑 PC, 노트북 PC, 태블릿 PC, 스마트폰, 스캐너, 복합기 등의 단말기로서, 이에 한정되는 것은 아니고, 통신망을 통해 디지털 참고서 제공 서버(100)와 디지털 참고서 변환 서버(200)에 접속할 수 있으며, 검색 정보 및 선택 정보의 입력과, 검색된 결과 정보를 디스플레이할 수 있는 애플리케이션 프로그램의 설치가 가능한 디지털 정보의 처리가 가능한 구성이면 모두 포함될 수 있다. 본 발명에 따른 학생단말기(10)는 디지털 참고서 제공 서버(100) 및 디지털 참고서 변환 서버(200)에 통신망을 통해 접속하여 정보를 송수신하는 구성요소로서, 예를 들면 스마트폰(smartphone), 태블릿 PC(tablet personalcomputer), 이동 전화기(mobile phone), 영상 전화기, 데스크탑 PC(desktoppersonal computer), 랩탑 PC(laptop personal computer), 넷북 컴퓨터(netbook computer), PDA(personal digital assistant), PMP(portable multimedia player), 웨어러블 장치(wearable device)(예: 스마트 안경, 머리 착용형 장치(head-mounted-device(HMD) 등), 무인단말기(kiosk) 또는 스마트 와치(smart watch)) 중 적어도 하나를 포함할 수 있다.The student terminal 10 according to the present invention is a terminal such as a desktop PC, laptop PC, tablet PC, smartphone, scanner, multifunction device, etc., equipped with input means such as a keyboard, mouse, touchpad, and touch screen, and a display screen. , but is not limited to this, and is capable of accessing the digital reference book providing server 100 and the digital reference book conversion server 200 through a communication network, inputting search information and selection information, and displaying search result information. Any configuration that can process digital information that can be installed can be included. The student terminal 10 according to the present invention is a component that transmits and receives information by connecting to the digital reference book providing server 100 and the digital reference book conversion server 200 through a communication network, for example, a smartphone or tablet PC. (tablet personal computer), mobile phone, video phone, desktop PC (desktop personal computer), laptop PC (laptop personal computer), netbook computer, PDA (personal digital assistant), PMP (portable multimedia player) , It may include at least one of a wearable device (e.g., smart glasses, head-mounted-device (HMD), etc.), an unmanned terminal (kiosk), or a smart watch. .
본 발명에 따른 학생단말기(10), 디지털 참고서 제공 서버(100) 및 디지털 참고서 변환 서버(200)는 각각이 구비한 통신부 및 통신망을 통해 통신할 수 있다. 통신망은 단말들 및 서버들과 같은 각각의 노드 상호간에 정보 교환이 가능한 연결구조를 의미하는 것으로, 이러한 통신망의 일 예에는, 3GPP(3rd Generation Partnership Project) 네트워크, LTE(Long Term Evolution) 네트워크, 5G 네트워크, WIMAX(World Interoperability for Microwave Access) 네트워크, 인터넷(Internet), LAN(Local Area Network), Wireless LAN(Wireless Local Area Network), WAN(Wide Area Network), PAN(Personal Area Network), wifi 네트워크, 블루투스(Bluetooth) 네트워크, 위성 방송 네트워크, 아날로그 방송 네트워크, DMB(Digital Multimedia Broadcasting) 네트워크 등이 포함되나 이에 한정되지는 않는다. 학생단말기(10), 디지털 참고서 제공 서버(100) 및 디지털 참고서 변환 서버(200)가 각각 구비한 통신부는, 전술한 통신망을 통한 유무선 데이터 통신을 수행할 수 있도록 통신망을 위해 구비된 전자 부품을 포함할 수 있다. The student terminal 10, the digital reference book providing server 100, and the digital reference book conversion server 200 according to the present invention can communicate through the communication unit and communication network provided by each. A communication network refers to a connection structure that allows information exchange between nodes such as terminals and servers. Examples of such communication networks include the 3rd Generation Partnership Project (3GPP) network, Long Term Evolution (LTE) network, and 5G. Network, WIMAX (World Interoperability for Microwave Access) network, Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), wifi network, It includes, but is not limited to, a Bluetooth network, satellite broadcasting network, analog broadcasting network, and DMB (Digital Multimedia Broadcasting) network. The communication unit provided by the student terminal 10, the digital reference book providing server 100, and the digital reference book conversion server 200 includes electronic components provided for a communication network to perform wired and wireless data communication through the above-mentioned communication network. can do.
본 발명에 따른 데이터베이스부(110)와 데이터베이스부(250)는 데이터베이스 관리 시스템(이하, DBMS)을 포함할 수 있다. DBMS는 다수의 사용자들이 데이터베이스부(110)와 데이터베이스부(250) 내의 데이터에 접근할 수 있도록 해주는 소프트웨어 도구의 집합이다. DBMS는 IMS, CODASYL DB, DB2, ORACLE, INFORMIX, SYBASE, INGRES, MS-SQL, Objectivity, O2, Versanat, Ontos, Gemstone, Unisql, Object Store, Starburst, Postgres, Tibero, MySQL 또는 MS-access등을 포함할 수 있다. DBMS는 특정 명령어의 입력에 따라 해당하는 특정 데이터에 접근하는 것이 가능하다. The database unit 110 and the database unit 250 according to the present invention may include a database management system (hereinafter referred to as DBMS). DBMS is a set of software tools that allow multiple users to access data in the database unit 110 and database unit 250. DBMS includes IMS, CODASYL DB, DB2, ORACLE, INFORMIX, SYBASE, INGRES, MS-SQL, Objectivity, O2, Versanat, Ontos, Gemstone, Unisql, Object Store, Starburst, Postgres, Tibero, MySQL or MS-access. can do. DBMS allows access to specific data depending on the input of a specific command.
본 명세서에서 디지털 참고서 제공 서버(100)가 포함하는 각 구성 즉, 데이터베이스부(110), 구매인증부(120), 인증코드송신부(121), 인증페이지부(123), 기입위치부(125), 디지털참고서결제부(130), 디지털참고서제공부(140) 및 디지털참고서대여부(150)와 디지털 참고서 변환 서버(200)가 포함하는 각 구성 즉, 파일생성부(210), 영역검출부(220), 요소추출부(230), 광학문자인식부(240) 및 문제제공부(260)는 메모리에 저장된 연속된 수행과정들을 실행하는 프로세서들일 수 있다. 또는, 프로세서에 의해 구동되고 제어되는 소프트웨어 모듈들로서 동작할 수 있다. 나아가, 프로세서는 하드웨어 장치일 수 있다.In this specification, each component included in the digital reference book providing server 100, namely, database unit 110, purchase authentication unit 120, authentication code transmission unit 121, authentication page unit 123, and entry location unit 125. , each component included in the digital reference book payment unit 130, the digital reference book provision unit 140 and the digital reference book rental unit 150 and the digital reference book conversion server 200, that is, the file creation unit 210 and the area detection unit 220. ), the element extraction unit 230, the optical character recognition unit 240, and the problem providing unit 260 may be processors that execute sequential execution processes stored in memory. Alternatively, they may operate as software modules driven and controlled by a processor. Furthermore, a processor may be a hardware device.
본 명세서에 있어서 '부(部)'란, 하드웨어에 의해 실현되는 유닛(unit), 소프트웨어에 의해 실현되는 유닛, 양방을 이용하여 실현되는 유닛을 포함한다. 또한, 1개의 유닛이 2개 이상의 하드웨어를 이용하여 실현되어도 되고, 2개 이상의 유닛이 1개의 하드웨어에 의해 실현되어도 된다.In this specification, 'part' includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Additionally, one unit may be realized using two or more pieces of hardware, and two or more units may be realized using one piece of hardware.
본 발명의 보호범위가 이상에서 명시적으로 설명한 실시예의 기재와 표현에 제한되는 것은 아니다. 또한, 본 발명이 속하는 기술분야에서 자명한 변경이나 치환으로 말미암아 본 발명이 보호범위가 제한될 수도 없음을 다시 한 번 첨언한다.The scope of protection of the present invention is not limited to the description and expression of the embodiments explicitly described above. In addition, it is to be added once again that the scope of protection of the present invention may not be limited due to changes or substitutions that are obvious in the technical field to which the present invention pertains.

Claims (5)

  1. 디지털화 된 참고서의 요소(element)들을 추출하여 저장 및 관리하고, 학생단말기로 제공하는 디지털 참고서 제공 서버를 포함하는 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템에 있어서,In the system for providing digital reference books through purchase authentication of physical reference books, which includes a digital reference book provision server that extracts, stores and manages elements of digitized reference books and provides them to student terminals,
    상기 디지털 참고서 제공 서버는,The digital reference book providing server,
    상기 디지털 참고서 및 상기 요소가 저장된 데이터베이스부;a database unit storing the digital reference book and the elements;
    상기 학생단말기로부터 수신한 이미지를 통해 실물 참고서의 구매를 인증하는 구매인증부;a purchase authentication unit that authenticates the purchase of a physical reference book through an image received from the student terminal;
    실물 참고서의 구매가 인증된 학생단말기로 디지털 참고서의 결제를 제공하는 디지털참고서결제부; 및A digital reference book payment unit that provides payment for digital reference books through a student terminal that has been certified to purchase physical reference books; and
    디지털 참고서를 결제한 학생단말기로 상기 디지털 참고서를 제공하는 디지털참고서제공부;A digital reference book providing unit that provides the digital reference book to the student terminal for which the digital reference book has been paid;
    를 포함하여, 실물 참고서를 이용하여 실물 참고서의 구매 인증 및 디지털 참고서의 제공이 가능한 것을 특징으로 하는, 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템.Including, a system for providing digital reference books through purchase authentication of physical reference books, characterized in that it is possible to authenticate the purchase of physical reference books and provide digital reference books using physical reference books.
  2. 청구항 1에 있어서,In claim 1,
    상기 구매인증부는, The purchase certification department,
    상기 학생단말기로 인증 코드를 송신하는 인증코드송신부;Authentication code transmission unit that transmits an authentication code to the student terminal;
    상기 학생단말기로 상기 실물 참고서의 인증 페이지 정보를 송신하는 인증페이지부; 및an authentication page unit that transmits authentication page information of the physical reference book to the student terminal; and
    상기 학생단말기로 상기 인증 페이지 내 상기 인증 코드가 기입될 기입 위치 정보를 송신하는 기입위치부;an entry location unit that transmits entry location information where the authentication code is to be entered in the authentication page to the student terminal;
    를 포함하고,Including,
    상기 학생단말기는, 상기 인증 코드가 상기 기입 위치에 기입된 상기 실물 참고서의 상기 인증 페이지를 촬영하여 상기 이미지를 생성하고, 생성한 이미지를 상기 구매인증부로 송신하며,The student terminal generates the image by photographing the authentication page of the physical reference book where the authentication code is written at the entry position, and transmits the generated image to the purchase authentication unit,
    상기 구매인증부는, The purchase certification department,
    상기 학생단말기로부터 수신한 상기 생성한 이미지 내 기입된 상기 인증 코드, 상기 인증 코드가 기입된 위치 정보 및 상기 실물 참고서의 인증 페이지와, 상기 인증코드송신부가 상기 학생단말기로 송신한 인증 코드, 상기 기입위치부가 상기 학생단말기로 송신한 기입 위치 정보 및 상기 데이터베이스부에 저장된 상기 디지털 참고서의 인증 페이지와 비교하여 상기 실물 참고서의 구매를 인증하는 것을 특징으로 하는, 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템.The authentication code written in the generated image received from the student terminal, the location information where the authentication code is written, and the authentication page of the physical reference book, the authentication code sent by the authentication code transmitter to the student terminal, and the information written above. A digital reference book providing system through purchase authentication of a physical reference book, characterized in that the location unit authenticates the purchase of the physical reference book by comparing the entry location information transmitted to the student terminal and the authentication page of the digital reference book stored in the database unit. .
  3. 청구항 2에 있어서,In claim 2,
    상기 디지털 참고서 제공 서버는, The digital reference book providing server,
    이용자 코드를 생성하여 상기 학생단말기로 송신하는 디지털참고서대여부를 더 포함하고,It further includes a digital reference book rental unit that generates a user code and transmits it to the student terminal,
    상기 학생단말기는, 상기 이용자 코드와 날짜가 기입된 상기 인증 페이지를 촬영하여 대여이미지를 생성하며, 생성한 상기 대여이미지를 상기 디지털참고서대여부로 송신하고,The student terminal generates a rental image by photographing the authentication page on which the user code and date are written, and transmits the generated rental image to the digital reference book rental unit,
    상기 디지털참고서대여부는, 상기 대여이미지를 송신한 상기 학생단말기로 상기 디지털참고서의 대여 권한을 제공하는 것을 특징으로 하는, 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템.A system for providing digital reference books through purchase authentication of physical reference books, characterized in that the digital reference book rental unit provides rental authority for the digital reference book to the student terminal that transmitted the rental image.
  4. 청구항 3에 있어서,In claim 3,
    상기 인증페이지부는,The authentication page part is,
    상기 학생단말기로 상기 실물 참고서의 표지 정보, 랜덤으로 결정되는 랜덤 페이지 정보 및 상기 인증 페이지 정보를 송신하고,Transmitting cover information, randomly determined page information, and authentication page information of the physical reference book to the student terminal,
    상기 학생단말기는, The student terminal is,
    상기 표지 정보에 해당하는 실물 참고서의 표지, 상기 랜덤 페이지 정보에 해당하는 실물 참고서의 랜덤페이지 및 상기 이용자 코드와 날짜가 기입된 상기 인증 페이지 정보에 해당하는 상기 인증페이지를 촬영하여 각각 연장이미지를 생성하고, 생성한 상기 연장이미지를 상기 인증페이지부로 송신하고,An extended image is generated by photographing the cover of the physical reference book corresponding to the cover information, the random page of the physical reference book corresponding to the random page information, and the authentication page corresponding to the authentication page information with the user code and date written on it, respectively. and transmitting the generated extension image to the authentication page unit,
    상기 인증페이지부는, 수신한 상기 연장이미지를 기초로 상기 학생단말기의 디지털참고서의 대여 권한을 연장하는 것을 특징으로 하는, 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템.A system for providing digital reference books through purchase authentication of physical reference books, characterized in that the authentication page unit extends the rental authority of the digital reference book of the student terminal based on the received extension image.
  5. 청구항 4에 있어서,In claim 4,
    상기 디지털 참고서 제공 시스템은,The digital reference book provision system is,
    복수 개의 학생단말기를 포함하고,Contains a plurality of student terminals,
    상기 인증페이지부는,The authentication page part is,
    상기 복수 개의 학생단말기로 상기 인증페이지 정보를 송신할 때, 동일한 참고서인 경우 동일한 페이지를 상기 인증페이지로 결정하여 상기 복수 개의 학생단말기로 각각 송신하여, 실물 참고서와 디지털 참고서가 1:1 대응되도록 하는 것을 특징으로 하는, 실물 참고서의 구매 인증을 통한 디지털 참고서 제공 시스템.When transmitting the authentication page information to the plurality of student terminals, if it is the same reference book, the same page is determined as the authentication page and transmitted to the plurality of student terminals respectively, so that the physical reference book and the digital reference book correspond 1:1. A system for providing digital reference books through purchase authentication of physical reference books.
PCT/KR2022/016597 2022-10-27 2022-10-27 System for providing digital reference book through purchase authentication of physical reference book WO2024090615A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/KR2022/016597 WO2024090615A1 (en) 2022-10-27 2022-10-27 System for providing digital reference book through purchase authentication of physical reference book

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2022/016597 WO2024090615A1 (en) 2022-10-27 2022-10-27 System for providing digital reference book through purchase authentication of physical reference book

Publications (1)

Publication Number Publication Date
WO2024090615A1 true WO2024090615A1 (en) 2024-05-02

Family

ID=90831098

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2022/016597 WO2024090615A1 (en) 2022-10-27 2022-10-27 System for providing digital reference book through purchase authentication of physical reference book

Country Status (1)

Country Link
WO (1) WO2024090615A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004513421A (en) * 2000-10-25 2004-04-30 ライトニング　ソース，インク． Content processing for electronic distribution using digital rights management system
KR100456425B1 (en) * 2004-01-27 2004-11-10 주식회사 지식발전소 System and method for service books information about buying books
KR20120017986A (en) * 2010-08-20 2012-02-29 주식회사에어플러그 Method and apparatus for deliverying information using images taken from real things as an information agent
KR20130011749A (en) * 2011-07-22 2013-01-30 전창영 Book purchasing system and method
KR20150119980A (en) * 2014-04-15 2015-10-27 주식회사 디지북 Method and device for providing service for e-book
KR102542170B1 (en) * 2022-10-27 2023-06-13 주식회사 테스트뱅크 Digital reference book provision system by authentication of purchase of real reference books

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004513421A (en) * 2000-10-25 2004-04-30 ライトニング　ソース，インク． Content processing for electronic distribution using digital rights management system
KR100456425B1 (en) * 2004-01-27 2004-11-10 주식회사 지식발전소 System and method for service books information about buying books
KR20120017986A (en) * 2010-08-20 2012-02-29 주식회사에어플러그 Method and apparatus for deliverying information using images taken from real things as an information agent
KR20130011749A (en) * 2011-07-22 2013-01-30 전창영 Book purchasing system and method
KR20150119980A (en) * 2014-04-15 2015-10-27 주식회사 디지북 Method and device for providing service for e-book
KR102542170B1 (en) * 2022-10-27 2023-06-13 주식회사 테스트뱅크 Digital reference book provision system by authentication of purchase of real reference books

Similar Documents

Publication Publication Date Title
CN110442744B (en) Method and device for extracting target information in image, electronic equipment and readable medium
WO2023075434A1 (en) Machine learning-based digital reference book provision system using bounding boxes
US9898452B2 (en) Annotation data generation and overlay for enhancing readability on electronic book image stream service
US20140298164A1 (en) Electronic book production apparatus, electronic book system, electronic book production method, and non-transitory computer-readable medium
WO2019164119A1 (en) Electronic device and control method therefor
WO2024090615A1 (en) System for providing digital reference book through purchase authentication of physical reference book
KR102542170B1 (en) Digital reference book provision system by authentication of purchase of real reference books
JP2015143899A (en) Information processing apparatus, information hiding method, and information hiding program
WO2016190650A1 (en) System for providing captcha and advertisement using combination of characters
WO2014025175A1 (en) Method for recommending electronic books using learning plan
WO2022102965A1 (en) Method for analyzing document
WO2012165847A2 (en) Device for processing user annotations, and system and method for electronic book service therefor
WO2022182104A1 (en) Table creation method and system, and method and system for correcting image including table
KR101477642B1 (en) Flat board printer
US11907524B2 (en) Digital ink processing system, method, and program
WO2022244997A1 (en) Method and apparatus for processing data
WO2021133133A1 (en) Electronic drawing security management method using colors
KR101824601B1 (en) System and method for providing web contents based on replacement of font
WO2023149618A1 (en) System and method for providing digital reference book according to copyright ownership
WO2023149617A1 (en) System for providing digital reference book based on page edition and delimiter detection, and method thereof
US20200296258A1 (en) Image forming apparatus for forming image represented by image data on recording paper sheet
KR20180090044A (en) System and method for providing web contents based on replacement of font
WO2016200194A1 (en) Method and device for providing issue content
WO2018139777A1 (en) Numerical information management device using data structure
WO2020130708A1 (en) Method and apparatus for augmented reality