KR20190033381A - Mass webpage document transforming method, and system thereof - Google Patents

Abstract

The present invention relates to a system and a method for converting large-volume web page documents which can access large-volume documents that are variously posted on an Internet web page, and convert the large-volume documents into files such as PDF, html, xml, SVG and images with a user′s simple manipulation. A web page document conversion system according to the present invention is a web page document conversion system for loading a web page document from a web server which holds a plurality of web page documents, converting the web page document into other types of documents, and storing the same. The conversion system may comprise a conversion apparatus for generating conversion metadata based on document information including a web address, an ID, a document title and a document type of the web page document, accessing the web server based on the generated conversion metadata, and converting the plurality of web page documents into other types of documents. According to the present invention, it is possible to periodically store and hold a large-volume web document, transfer and store the document into a new system in accordance with a system replacement, and submit the same to an institution or organization as a file report.

Description

[0001] The present invention relates to a large-scale web page document conversion system and a method thereof,

The present invention relates to a large-capacity web page document conversion system and a method thereof, and more particularly to a large-capacity web page document conversion system which accesses a large-capacity web page document which is variously posted on an Internet web page, html, xml, SVG, image, etc., you can store and store large-capacity web documents periodically, and you can transfer them to a new system according to the system change and save them to a file report To a large-capacity web page document conversion system and a method thereof.

Generally, most of the web page documents such as balance sheets and accounting reports posted on web pages are converted to PDF files when they are submitted to the agency or when they are about to be archived.

Also, if you want to transfer documents posted on a Web page to another system, you will also convert them to image or PDF files.

At this time, when the documents posted on the web page are a small amount within 10 pages, the user (worker) performs a task of converting the documents of each page into PDF files one by one.

However, when a Web page document is large in a size of several thousand pages or tens of thousands of pages, there is a problem that a user (an operator) takes a great deal of time and money to convert the document of each page into a PDF file one by one.

Korean Patent Publication No. 2002-0023545 (published on March 29, 2002)

It is an object of the present invention to solve the above-mentioned problems, and it is an object of the present invention to solve the above problems by accessing a large amount of documents posted on an Internet web page, A large-capacity web page document conversion system that allows large-capacity web documents to be periodically stored and archived, can be transferred to a new system according to system replacement, and can be submitted as a file report to an organization or an organization And a method thereof.

According to an aspect of the present invention, there is provided a web page document conversion system for converting a web page document from a web server having a plurality of web page documents into another document, Wherein the conversion metadata generation unit generates conversion metadata based on document information including a web address, an ID, a document title, and a document type of the web page document, accesses the web server based on the generated conversion metadata, And converting the web page documents into other types of documents.

Here, the conversion device may include: a connection unit for connecting to the web page document; A conversion object extraction unit that extracts a conversion object from the web page document; A control unit for generating conversion metadata based on information on the web page document; A converted document generation unit for generating a converted document by converting the plurality of web page documents into other documents based on the generated conversion metadata; A database storing information on the web page document, the generated conversion metadata, and the generated conversion document; And a converted document processing unit for transmitting the converted document to a document storage device or storing the converted document in the database.

The apparatus may further include a user interface unit for receiving data from a user to generate the conversion metadata and displaying the input data on a screen.

In addition, the control unit may fetch information about the web page document from the database, and may generate the conversion metadata according to data input from the user through the user interface unit.

In addition, the conversion metadata may include at least one of a connection address, a document ID, a type of a document access, a size of a screen to be accessed, a storage location of the converted documents, Conversion document file name, conversion document dissemination, and attachment file dissemination.

In addition, when generating the conversion metadata, the control unit may generate, for the converted document file name, a name of each conversion document file classified in accordance with the document type and the document title of each web page document in the plurality of web page documents have.

In addition, the converted document file name may include a document type and a document ID of the web page document.

The conversion device may further include a thread for collecting the entire HTML content from the access address of the plurality of web page documents when converting the plurality of web page documents into other types of documents, A thread for extracting an address related to an attached file, a thread for generating a converted document, a thread for downloading an attached file, a converted document, an attached file, and metadata to another system , And convert the plurality of web page documents into other types of documents and store them or transmit them to the document storage device.

The conversion device accesses the predetermined number or more of web page documents by using an online access API (Application Programming Interface), downloads attachments attached to the web page document using a download API, A document conversion time and a result of the document are recorded in a log and the conversion metadata is converted into a JavaScript and a Cascading Style Sheet (CSS) You can provide the ability to add watermarks and electronic signatures to your documents.

According to another aspect of the present invention, there is provided a web page document conversion system including: a web server having a predetermined number of web page documents; And a conversion program for generating conversion metadata based on the information on the predetermined number or more of the web page documents and converting the predetermined number or more of the web page documents into other types of documents based on the generated conversion metadata have.

The apparatus may further include a document storage device for storing and storing other types of documents converted through the conversion program.

The conversion program may be installed in the web server or installed in the document storage device.

The conversion program may further include a thread for collecting the entire HTML contents from the access address of the predetermined number or more of the web page documents when converting the predetermined number or more of the web page documents into other types of documents, A thread for extracting the HTML content of the target area, a thread for extracting an address related to the attachment according to the presence or absence of the attachment, a thread for generating the converted document, a thread for downloading the attachment, To the other system, and converts the web pages of the predetermined number or more into other types of documents, and stores the converted web pages or transmits them to the document storage device.

The conversion program accesses the predetermined number or more of web page documents using an online access API (Application Programming Interface), downloads attached files attached to the web page document using a download API, A document conversion time and a result of a page document are recorded in a log and the conversion metadata is converted into a JavaScript and a Cascading Style Sheet (CSS) A watermark and an electronic signature may be added to the document.

According to another aspect of the present invention, there is provided a web page document conversion method for converting a plurality of web page documents into other types of documents, the method comprising the steps of: (a) Generating conversion metadata based on document information including a web address, an ID, a document title, and a document type of the web page document; (b) connecting to the plurality of web page documents based on the generated conversion metadata; (c) extracting a conversion object for each of the plurality of web page documents for each web page document; (d) a transformed document generating unit converts the extracted transformed object into another type of document based on the transformed metadata to generate a transformed document; And (e) the converted document processing unit may store the generated converted documents in a database or transmit them to a document storage device.

In addition, in the step (a), the control unit fetches the document information from the database storing the document information, generates the conversion metadata according to the data input from the user through the user interface unit and the document information .

In addition, the conversion metadata may include at least one of a connection address, a document ID, a document access type, a screen size to be accessed, a storage location of the converted other types of documents, Conversion document filenames, translated document margins, converted document escapes, and attachment escapes.

In addition, in the step (a), when generating the conversion metadata, the control unit may convert each of the plurality of web page documents classified by the document type and the document title of each web page document into the converted document file name The converted document file name can be generated.

In addition, the converted document file name may include a document type and a document ID of the web page document.

In the step (c), a thread for collecting all the HTML content from the access address of the plurality of web page documents, a thread for extracting the HTML content of the corresponding conversion target area, A thread for extracting an address of an attached file, a thread for generating a converted document, a thread for downloading an attached file, and a thread for transferring a converted document, an attached file, and metadata to another system, The web page document can be converted into another type of document and stored or transmitted to the document storage device.

Other aspects, advantages and features of the present invention will become more apparent on the basis of the following description in the entire specification, including the following sections: Brief Description of the Drawings, Detailed Description, and Claims.

According to the present invention, it is possible to access large-sized documents displayed in categories on the Internet web page, and easily convert them into PDF, html, xml, SVG, image and the like by a simple operation of the user.

Therefore, it is possible to store and store a large amount of web documents periodically as a file, easily transfer the web page document to a new system even when the system is replaced, and submit the web page document to another organization or organization as a file report .

In addition, by accessing a web page in which various types of documents are posted, metadata for document conversion is extracted, and partial document conversion of the corresponding region is performed in consideration of a text area and an attachment file to be converted based on the extracted metadata It is possible to store personal PCs and transfer them to other systems quickly.

In addition, a web page of a legacy system and a new web page document can be quickly retrieved from a variety of devices.

In addition, it is possible to apply the document conversion function according to the present invention to an existing legacy system that stores a large amount of web page documents.

In addition, large-scale documents can be easily placed by conversion, and real-time document conversion and periodic document conversion can be optionally provided.

In addition, a web page document generated due to system replacement can be applied to a system that is necessary for document transfer and storage as a new system.

In addition, it can provide diversification of archiving and inquiry of existing documents when introduced into a legacy system.

In addition, since the system provides a real-time conversion service after the replacement of the system, it is possible to provide convenience such as document archiving and document archiving that may occur in the future.

In addition, web pages can be periodically stored and used for archiving purposes, for report submission, and for printing. For example, html documents such as accounting slips and receipts are inconvenient to be provided in various forms when accessing various devices at the time of inquiry. However, when using the conversion system according to the present invention, And the like.

In addition, there is an advantage that a password can be set and stored in the form of a document when archiving important email (E-mail), storing attachments, and storing important site information.

FIG. 1A is a block diagram schematically showing a configuration of a web page document conversion system according to an embodiment of the present invention.
1B is a block diagram schematically illustrating an internal configuration of a conversion apparatus in a web page document conversion system according to an embodiment of the present invention.
1C is a diagram illustrating an example of a web page document according to an embodiment of the present invention.
2 is a diagram illustrating an example in which a conversion apparatus according to an embodiment of the present invention is applied to a client apparatus,
3 is a diagram showing an example in which the conversion apparatus according to the embodiment of the present invention is applied to a device for a cloud.
4 is a block diagram illustrating a web page document conversion system according to another embodiment of the present invention.
5 is a block diagram illustrating a web page document conversion system according to another embodiment of the present invention.
6A and 6B are flowcharts illustrating a method of converting a web page document of a conversion apparatus according to an embodiment of the present invention.
7 is a diagram illustrating an example of setting an environment for web page document conversion according to an embodiment of the present invention.
8 is a diagram illustrating transform metadata for transforming a web page document according to an embodiment of the present invention.
9 is a diagram illustrating converted document information for generating conversion metadata according to an embodiment of the present invention.
10 is a diagram illustrating an example of converting a web page document according to an embodiment of the present invention using a parallel processing process.
FIG. 11 is a diagram illustrating an example in which other types of converted documents are stored locally or transferred to another system for storage according to an embodiment of the present invention.
12 is a diagram illustrating an example in which a web page document is converted into another type of document and stored and stored in the same screen in various devices according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art to which the present invention pertains. The present invention may be embodied in many different forms and is not limited to the embodiments described herein.

In order to clearly illustrate the present invention, parts not related to the description are omitted, and the same or similar components are denoted by the same reference numerals throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as " comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.

If any part is referred to as being " on " another part, it may be directly on the other part or may be accompanied by another part therebetween. In contrast, when a section is referred to as being " directly above " another section, no other section is involved.

The terms first, second and third, etc. are used to describe various portions, components, regions, layers and / or sections, but are not limited thereto. These terms are only used to distinguish any moiety, element, region, layer or section from another moiety, moiety, region, layer or section. Thus, a first portion, component, region, layer or section described below may be referred to as a second portion, component, region, layer or section without departing from the scope of the present invention.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the invention. The singular forms as used herein include plural forms as long as the phrases do not expressly express the opposite meaning thereto. Means that a particular feature, region, integer, step, operation, element and / or component is specified and that the presence or absence of other features, regions, integers, steps, operations, elements, and / It does not exclude addition.

Terms indicating relative space such as " below ", " above ", and the like may be used to more easily describe the relationship to other portions of a portion shown in the figures. These terms are intended to include other meanings or acts of the apparatus in use, as well as intended meanings in the drawings. For example, when inverting a device in the figures, certain portions that are described as being " below " other portions are described as being " above " other portions. Thus, an exemplary term " below " includes both up and down directions. The device can be rotated by 90 degrees or rotated at different angles, and terms indicating relative space are interpreted accordingly.

Unless otherwise defined, all terms including technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Commonly used predefined terms are further interpreted as having a meaning consistent with the relevant technical literature and the present disclosure, and are not to be construed as ideal or very formal meanings unless defined otherwise.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein.

FIG. 1A is a block diagram schematically showing a configuration of a web page document conversion system according to an embodiment of the present invention.

Referring to FIG. 1A, a web page document conversion system 100 according to an embodiment of the present invention may include a web server 110, a conversion apparatus 120, and a document storage apparatus 130.

The web server 110 is a device that holds a web page in the form of a document, for example, 1,000 or more or 10,000 or more. Here, the web page can be implemented in HTML or XML format, or in other document formats.

The web server 110 may be implemented, for example, as a legacy system as shown in FIG. 1A. Here, a legacy system can mean a mainframe or a batch processing application as an opposite concept to an open system using software that complies with open standards in the computer field. It can also refer to the popular client server software and systems that were used in the 1990s, as Internet technology evolved into the 2000s. That is, the legacy system may refer to a computer system that has been used before.

The conversion apparatus 120 generates conversion metadata based on the information about the web page, accesses the web server 110 based on the generated conversion metadata, and transmits a predetermined number or more of the web page documents to another type of document . ≪ / RTI >

Here, the information on the web page document may include a web address, an ID, a document title, a document type, a creator, a creation date, and the like of the web page document.

In addition, the transformation metadata may include a connection address, a document ID, a type of a document access, and an access browser size (W & H) for a plurality of web page documents. The document ID is an identifier of the document at the connection address. The document access type indicates whether the document at the connection address has access to a certain type of frame (iframe, etc.) or an XML view. The access browser size refers to the screen size (W: Width / H: Height) which accesses the web page document at the connection address and displays the web page document.

In addition, the conversion metadata may include a storage location for the converted other types of documents, a file name for another type of document, a converted document margin, a success or failure of document conversion, and a message in case of a document conversion error. Here, since the size of the converted document margins differs for each web page document, the converted document margins are different from each other, for example, at a predetermined interval with respect to the width and the length, that is, A frame having a space of 1 Cm in each of L: Left and R: right and a space of 1.5 Cm in the top (T: Top) and a bottom (B: Bottom) So that the converted other document is located in the frame.

In addition, when the converted other document is a PDF, the storage location (PDF DIR) of the PDF file indicates the directory where the converted PDF file is stored, and PDF FILE indicates the file name of the converted PDF document .

The conversion metadata may include an HTML document position change, an option, whether or not the converted document is transferred, and whether the attached file is transferred. Here, when the web page document is converted into the PDF file, the HTML document is not converted as it is in the original document. For example, the HTML document is moved to the left side or moved to the right side and converted to the PDF file. The option means, for example, to select HTML Scaling and Fitting for the output paper (A4 etc.). FW denotes the Fit Width, FFW denotes the Force Fit Width, FH denotes the Fit Height, PM denotes the Postcard Mode, and RPP denotes the Resize PDF Page.

The conversion device 120 may include a database (SQL DB) storing various types of web page documents and information about the web pages in a predetermined number or more.

The document storage device 130 refers to the new system as an object to which the converted documents are to be transferred, and the converted other types of documents can be received from the conversion device 120 and stored in a storage device such as a database (DB) .

1B is a block diagram schematically illustrating an internal configuration of a conversion apparatus in a web page document conversion system according to an embodiment of the present invention.

1B, a conversion apparatus 120 according to an embodiment of the present invention includes a connection unit 202, a conversion object extraction unit 204, a control unit 206, a conversion document generation unit 208, a conversion document processing unit 210, a user interface (UI) unit 212, and a database (DB)

The connection unit 202 may mean a communication unit or the like for connecting to a web page document. That is, the connection unit 202 may refer to a web page on which a web page document is posted, or an access device or communication means for accessing a URL address of the web server 110.

The conversion object extraction unit 204 can extract the conversion object from the web page document. That is, as shown in Fig. 1C, the conversion object extracting unit 204 extracts the conversion target object from a pure document excluding a logo, a main menu, a submenu, and the like in a web page document composed of a web address, a main menu, Can be extracted as the object of conversion. 1C is a diagram illustrating an example of a web page document according to an embodiment of the present invention. At this time, when extracting the conversion object from the web page document shown in Fig. 1C, the conversion object extraction unit 204 extracts the conversion object from the document encoded in XML or HTML with respect to the web page document by using the < iframe name = docubody >, </ Iframe>, <tr>, and <td> can be extracted as the conversion target.

The control unit 206 can generate the conversion metadata based on the information on the web page document. That is, the control unit 206 fetches the information about the web page document from the database, and generates the conversion metadata as shown in FIG. 8 according to the data input from the user through the UI unit 212.

Here, the information on the web page document may include a web address, an ID, a document title, a document type, a creator, a creation date, and the like of the web page document. At this time, the document ID may refer to an id included in the web address as shown in FIG. 1C.

8, the conversion metadata includes a connection address, a document ID, a document access type, a screen size to be accessed, a storage location for converted documents, Conversion document margins, conversion document file names, conversion document migration status, and attachment file migration status. At this time, the control unit 206 generates a conversion document file name for each conversion document file name in a plurality of web page documents, each conversion document file name being classified according to a document type, a document title, and a document ID (ID) of each web page document . Therefore, the converted document file name may include the document type and the document ID of the Web page document.

The converted document generation unit 208 may generate a converted document by converting a plurality of web page documents into different types of documents, for example, a PDF document based on the generated conversion metadata. Here, other types of documents may be an MS-Word (doc) file, an image (jpg, tif, gif, etc.) file as well as a PDF (Portable Document Format) file.

The converted document processing unit 210 transmits the generated converted document to the document storage device 130 or stores it in the database 214 and stores it.

The UI unit 212 receives data from a user to generate conversion metadata and displays the input result on a screen.

The DB 214 is a device that stores information on a web page document, the generated conversion metadata, and the generated conversion document.

The conversion apparatus 120 may be a server system as shown in FIG. 1 and may be a device for a client as shown in FIG. 2, It can be a device for Cloud as shown. FIG. 2 is a diagram illustrating an example in which a conversion apparatus according to an embodiment of the present invention is applied to a client apparatus, and FIG. 3 is a diagram illustrating an example in which a conversion apparatus according to an embodiment of the present invention is applied to a device for a cloud.

2, when the conversion apparatus is applied to a client apparatus, the client apparatus may include a conversion apparatus 210 for a personal computer (PC) and a conversion apparatus 220 for personal storage.

At this time, the conversion program according to the embodiment of the present invention may be installed in the PC conversion device 210 and the personal storage conversion device 220. Here, the conversion program generates conversion metadata based on information on a predetermined number or more of web page documents, and converts the web page document of a predetermined number or more into different types of documents based on the generated conversion metadata .

In addition, the conversion program may be installed in the PC conversion device 210 and the personal storage conversion device 220, respectively, in accordance with the installation operation of the user in a state of being recorded on a recording medium such as a CD or a DVD.

Therefore, the PC conversion apparatus 210 connects to the web server 110 according to the execution of the conversion program, fetches a predetermined number or more of web page documents, converts the web page documents based on the conversion metadata, To the document storage apparatus 130 corresponding to the system, and transfer it.

On the other hand, the personal storage conversion device 220 accesses the web server 110 according to the execution of the conversion program, fetches a predetermined number or more of web page documents, converts the web page documents into a file format such as PDF based on the conversion metadata, The converted final document and the attached file are stored in the internal storage and archived.

The conversion apparatus according to the present invention can be implemented as a system 310 for a cloud, as shown in FIG.

A cloud service is a service that stores data on the Internet and allows users to access anytime and anywhere through the Internet without having to install the necessary data or programs on their computers. Cloud services can easily share and deliver data stored on the Internet with simple operations and clicks. In addition to simply storing the data on a server on the Internet, you can perform the desired operation by using the functions of the application program provided on the web without installing the program separately. have.

The system for the cloud 310 is provided with a conversion program as described above in the cloud server so that the user can connect to the cloud server using the personal computer and execute the conversion program.

Accordingly, the user's personal computer accesses the system for the cloud 310 and executes a conversion program to convert the web page documents posted on the web server 110, thereby converting the web page documents stored in the storage space allocated to the user of the cloud system 310 Or may be stored in the document storage device 130 corresponding to the new web server.

That is, the cloud system 310 connects to the web server 110 to obtain a predetermined number or more of web page documents, converts the web page documents based on the conversion metadata, and stores the converted final documents and attached files in a document storage device (130).

Here, the document storage device 130 is a device for storing and storing the converted other types of documents, and may be implemented as one of a server device, a client (PC) device, and a cloud device.

The other types of documents converted through the conversion program may be one of Portable Document Format (PDF), Extensible Markup Language (XML), Microsoft Word (DOC), Image, and SVG.

4 is a block diagram illustrating a web page document conversion system according to another embodiment of the present invention.

Referring to FIG. 4, the web page document conversion system 400 according to another embodiment of the present invention includes a Web page document conversion apparatus 400 that has a predetermined number or more of web page documents, converts the web page documents into a different type of document And a document storage device 130 for receiving and storing other types of documents converted from the web server 410 through a conversion program.

Here, the conversion program is installed in the web server 410, and generates conversion metadata based on information on a predetermined number or more of the web page documents, and converts a predetermined number or more of the web page documents into another format Into a document.

That is, in the web page document conversion system 400 according to another embodiment of the present invention, a conversion program is installed in the web server 410 having web page documents, and the web server 410 converts the conversion program To perform the function of a conversion device that converts a certain number of web page documents into another type of document.

At this time, the web server 410 may include a database (SQL DB) 420 storing various types of web page documents and information about the web page documents in a predetermined number or more.

The document storage device 130 is a device for storing and storing other types of converted documents, and may be one of a device for a server, a device for a client PC, and a device for a cloud.

Accordingly, when the conversion program is executed by the user or the administrator, the web server 410 generates conversion metadata based on the information about each web page stored in the DB 420, and based on the generated conversion metadata, The web page documents are fetched from the server 420 and converted into other types of documents such as a PDF file and transmitted to the document storage device 130.

For example, the web server 410 may include a microprocessor for controlling web page documents to be displayed, and a program storage unit for storing a conversion program and a memory for temporarily storing data processed by the microprocessor.

The apparatus may further include an input unit for receiving an execution command of the conversion program from the user, and an output unit for outputting the execution result of the conversion program on a screen or voice.

The microprocessor executes the conversion program stored in the program storage unit when the execution command of the conversion program is input.

The conversion program generates the conversion metadata shown in FIG. 8 based on the information about each web page stored in the DB 420, and temporarily stores the conversion metadata in the memory. The conversion program fetches a predetermined number or more of web page documents corresponding to the conversion target from the DB 420 on a sequential basis or on a predetermined unit basis based on the generated conversion metadata and stores the same in a memory. The conversion program divides the web page documents temporarily stored in the memory into parallel documents using a plurality of threads as shown in Fig. 10 and converts them into other types of documents such as PDF files. In addition, the conversion program transfers other types of documents converted into PDF or the like to the document storage device 130.

5 is a block diagram illustrating a web page document conversion system according to another embodiment of the present invention.

Referring to FIG. 5, the web page document conversion system 500 according to another embodiment of the present invention includes a web server 110 that holds a predetermined number or more of web page documents, And a new web server 510 for fetching, converting and storing web page documents from the web server 110 based thereon.

Here, the conversion program generates conversion metadata based on information on a predetermined number or more of web page documents, and executes a function of converting a predetermined number or more of web page documents into other types of documents based on the generated conversion metadata .

The new web server 510 is a device for transferring and storing Web page documents from the web server 110, and the conversion program is installed.

Accordingly, the new web server 510 executes the conversion program to generate conversion metadata based on the information about each web page document, and acquires from the web server 110 a predetermined number or more of webs To perform the function of a conversion device that takes page documents and converts them into PDF files.

At this time, the new web server 510 may have a database (DB) therein and store the converted other types of documents in a database (DB).

1 to 5, the conversion devices 110, 210, 220, 310, 410, and 510 may include a server device, a client device, a cloud device, a web server, a new web server, .

When the conversion program is executed, the conversion apparatuses 110, 210, 220, 310, 410, and 510 set an environment for converting a predetermined number or more of web page documents through a user interface, You can connect to the server.

In addition, the conversion apparatuses 110, 210, 220, 310, 410, and 510 may generate conversion metadata by designating a conversion document type and a format according to a database (DB) approach or a web page access robot method.

Here, the database (DB) access method accesses a table (Tab) and a web page view (View) of a database (DB) storing information on a certain number or more of web page documents in the web server, .

In addition, the web page access robot method accesses HTML, XML, and DOM of a predetermined number or more of web page documents, parses the corresponding web page document, accesses a web page view, User interface) to select the document selection area. Here, DOM is a document object model that allows all elements of the web, including graphics, text, headlines, and styles, to be tweaked by JavaScript or scripting language, It is a core technology that constitutes DHTML together with language.

When a certain number or more of web page documents are converted into different types of documents in real time, the conversion devices 110, 210, 220, 310, 410, and 510 may convert all HTML A thread for collecting contents, a thread for extracting HTML contents of the corresponding area, a thread for extracting an attachment-related address according to the presence or absence of an attachment file, a thread for generating a converted document, , A thread for downloading attachments, and a thread for transferring converted documents, attachments, and metadata to other systems to parallelize a certain number of web page documents in real time to another type of document Can be converted.

The conversion apparatuses 110, 210, 220, 310, 410, and 510 may access a web server using an online access API (application programming interface), access a predetermined number or more of web pages, You can download attachments attached to the page.

In addition, the conversion devices 110, 210, 220, 310, 410, and 510 log document conversion time and results for a predetermined number or more of web page documents, log conversion metadata, And a CSS (Cascading Style Sheet), and can provide a function of adding a watermark and an electronic signature to the converted document.

The conversion apparatuses 110, 210, 220, 310, 410, and 510 may classify the converted other documents together with the attached file, and classify them in a local or transmit them to another apparatus.

6A and 6B are flowcharts illustrating a method of converting a web page document of a conversion apparatus according to an embodiment of the present invention.

Referring to FIGS. 6A and 6B to 12, the conversion apparatus 120 according to the embodiment of the present invention generates conversion metadata based on information on a predetermined number or more of web pages (S610).

That is, the control unit 206 fetches the document information from the database 214 in which the document information including the web address, the ID, the document title, and the document type of the web page document is stored, The transformed metadata as shown in FIG. 8 may be generated according to the data and the document information received from the user through the user interface (S610).

At this time, when the conversion program is executed, the conversion apparatus 120 receives data from the user or the manager through the UI unit 212 to set an environment for web page conversion, and connects the web server 110 to the web server 110 using the login information do. Web page access is both public and private. Private pages can be accessed through login information.

Here, as shown in FIG. 7, the conversion apparatus 120 sets an environment for web page conversion through login, connection to the server, metadata extraction and definition, conversion document type, and type designation. 7 is a diagram illustrating an example of setting an environment for web page document conversion according to an embodiment of the present invention. As shown in FIG. 7, the transformed document type and type specification may include accessing a table and accessing a view in an SQL DB approach.

In addition, the conversion document type and type designation is a web page access robot method, a method of executing Html and XML, a DOM access and a parser, a web page view access / a DOM access user interface (UI) And an automatic object classification method of specifying a document selection area.

That is, the conversion apparatus 120 can generate conversion metadata by specifying a conversion document type and a format according to a database (DB) approach or a web page access robot method.

At this time, the database (DB) access method accesses a table (Tab) and a view of a database (DB) storing information on a certain number or more of web pages in the web server 110, .

In addition, the web page access robot method accesses HTML, XML, and DOM for a predetermined number of web pages or more, accesses a web page view, a DOM, accesses a DOM through a user interface, It automatically classifies objects by specifying a selection area. That is, it is referred to as a web page access robot system in the sense of accessing and parsing a certain number of web pages, such as an automatic robot, or automatically classifying the web pages according to a designated selection through the UI.

On the other hand, the conversion apparatus 120 receives data for web page document conversion from the user or manager through the UI unit 212, and converts the conversion metadata as shown in FIG. 8 based on the input data and the document information . 8 is a diagram illustrating transform metadata for transforming a web page document according to an embodiment of the present invention.

At this time, as shown in FIG. 8, the conversion metadata includes a connection address (url), a document ID (ID), a document access type (Type), a browser size designation, A file name, a designated document margin, a success or failure of document conversion, a message in case of a document conversion error, an HTML document position change, an option, an attachment file transfer status, &Lt; / RTI &gt;

In this case, the control unit 206 determines the document type (TYPE), the year name, the form name, the URL address, and the document ID in the conversion metadata based on the URL address of the web page document obtained from the database 214, (ID), document title, document type, author, creation date, and so on.

In addition, the control unit 206 can generate a document access type from the conversion metadata according to a separator such as <iframe> and <xml view>, which are input from the user through the UI unit 212. That is, in the HTML document for the web page document shown in FIG. 1C, a key for the conversion area such as a part having an <iframe>, </ iframe>, or the like corresponding to the conversion target or a part having a separator such as <xml view> Value as a document access type.

In the conversion metadata of FIG. 8, PDF DIR is generated based on data input from the user through the UI unit 212, defines the location where documents are converted and stored, and FTP It can be the access URL address accessed by access or POST method.

In the conversion metadata of FIG. 8, PDF FILE defines the file name of the converted document, and may be changed depending on extensions such as PFD and html. That is, the control unit 206 can automatically generate a converted document file name, which is classified according to the document type and the document title of each web page document, in a plurality of web page documents with respect to the converted document file name.

In the conversion metadata of FIG. 8, success indicates whether or not the document conversion is successful when the web page document is converted into the PDF document, and the note indicates an error message when the document conversion error occurs.

8, Browser (W & H) designates the size of an access browser as a screen size for accessing a web page document, and margin (L & R & T & B) designates a margin of the converted document. In other words, since a plurality of web page documents are different in size according to document types, margins are set in the left and right sides, the top side, and the bottom side, respectively, So that the converted document is output in the set frame.

8, Html (L & T & W & H) is set to change the position of the HTML document to be changed to the left side (L), the upper side (T), the width (Width) Option (FW & FFW & FH & PM & RPP) sets the size option of the converted document. For example, the option is to set the selection of HTML Scaling and Fitting for the output paper (A4 etc.). FW denotes the Fit Width, FFW denotes the Force Fit Width, FH denotes the Fit Height, PM denotes the Postcard Mode, and RPP denotes the Resize PDF Page.

Further, in the conversion metadata of FIG. 8, the attached escape character indicates whether or not the file attached to the web page document is escaped, and the escape status indicates the escape status of the converted document.

In addition, the conversion apparatus 120 can extract the conversion metadata or define the conversion metadata based on the conversion document information as shown in FIG. 9 is a diagram illustrating converted document information for generating conversion metadata according to an embodiment of the present invention. 9, the converted document information includes at least one of a document ID, a document number, a draft date, a draft time, a draftsman name, a document classification, a document classification code, a title, a number of approval lines, .

Then, the conversion apparatus 120 accesses the web server 110 based on the generated conversion metadata (S620).

That is, the connection unit 202 accesses a plurality of web page documents existing in the web server 110 based on the conversion metadata. At this time, as shown in FIG. 1C, the connection unit 202 can access a URL address holding a web page document or access a URL address (an address including a document ID) corresponding to a web page document.

The connection unit 202 can access the web server 110 using an online access API (application programming interface) or access a predetermined number or more of web page documents posted on the web server 110. Web page access can also be accessed via url, html, xml, xslt, and so on.

Next, the conversion object extraction unit 204 in the conversion apparatus 120 extracts conversion objects for each web page document with respect to a plurality of web page documents (S630). That is, in the HTML document for the web page document shown in Fig. 1C, the conversion target extraction unit 204 extracts a portion having a delimiter such as <iframe>, </ iframe>, <tr>, <td> can do.

Subsequently, in the conversion apparatus 120, the converted document generation unit 208 converts the extracted conversion target into another type of document based on the conversion metadata to generate a converted document (S640).

In other words, the converted document generation unit 208 converts the converted metadata into, for example, PDF format for each Web page document based on the converted metadata to generate a converted document.

At this time, the conversion apparatus 120 can process the document conversion by dividing it into a plurality of functions by using a parallel processing process as shown in FIG. 10 is a diagram illustrating an example of converting a web page document according to an embodiment of the present invention using a parallel processing process. As shown in FIG. 10, for example, a thread 1 for collecting entire HTML contents from an access address for a predetermined number or more of web page documents, and a thread 1 for extracting HTML contents of the corresponding conversion object region from the entire HTML contents A thread 3 for extracting an attachment-related address according to the presence or absence of an attached file, a thread 4 for generating a converted document, a thread 5 for downloading an attached file, It is possible to convert a certain number of web page documents into other types of documents in real time by parallel processing using a thread 6 that transfers documents, attachments and metadata to other systems.

In addition, when a file is attached to a predetermined number or more of web pages, the conversion device 120 can download a file attached to the web page using the download API. In addition, the conversion device 120 may convert images, fonts, and the like of the web page document.

In addition, the conversion device 120 can record a document conversion time and a result of a predetermined number or more of web pages in a log, and can convert the conversion metadata into a JavaScript or a style sheet Standard (CSS: Cascading Style Sheet) or the like.

Then, the conversion apparatus 120 can provide a function of adding a watermark and an electronic signature to the converted document of another type.

In step S650, the converted document processing unit 210 in the conversion apparatus 120 stores the generated converted documents in the database 214 or transmits the converted documents to the document storage apparatus 130 (S650).

In other words, the conversion apparatus 120 classifies the converted other document such as PDF, together with the attached file as shown in FIG. 11, and classifies the converted document in the local, It can be transferred to another device (another system). FIG. 11 is a diagram illustrating an example in which other types of converted documents are stored locally or transferred to another system for storage according to an embodiment of the present invention. In FIG. 11, the conversion apparatus can classify converted documents and attached files through a PC-class conversion system and store the converted documents locally or transmit them to a web server of a new system using FTP.

At this time, the conversion apparatus 120 can transfer the converted other types of documents to another system together with the attached file, metadata, and the like using the transfer process as shown in FIG.

Therefore, when web page documents are converted in an existing web server system and stored and stored in a conversion system, users can access the conversion system using a computer terminal as shown in FIG. 12, The same screen can be provided (system utilization 1). 12 is a diagram illustrating an example in which a web page document is converted into another type of document and stored and stored in the same screen in various devices according to an embodiment of the present invention.

Also, when converting a web page document in the conversion system and transferring it to a new web server system and storing it, users can access a new web server system using a computer terminal as shown in Fig. 12, The same screen can be provided in real time (system utilization 2).

By storing the conversion metadata according to the embodiment of the present invention in the database 214, it is possible to check the conversion completion status of each web page document through the conversion metadata, You can check the documentation. Therefore, a document in which an error occurs in conversion can be separately converted and stored.

As described above, according to the present invention, it is possible to access large-volume documents that are variously posted on an Internet web page, and convert large-capacity documents into files such as PDF, html, xml, SVG, A large-capacity web page document conversion system and method capable of storing and storing large-capacity web documents periodically, storing them in a new system according to system replacement, and allowing them to be submitted to a file report to an organization or organization Can be realized.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention as defined by the following claims and their equivalents. Only. It is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents. .

100, 300, 400, 500: Web page document conversion system
110: Web server
120: conversion device
130: Document storage device
202: Connection
204: conversion target extraction unit
206:
208: Transform document generation unit
210: Transformed document processor
212: UI section
214: DB
220: Converter for PC
230: Personal storage converter
310: System for the cloud
410: Web server
510: New web server

Claims (20)

A web page document conversion system for converting a web page document from a web server having a plurality of web page documents into another type of document,
The conversion metadata generating unit generates conversion metadata based on document information including a web address, an ID, a document title, and a document type of the web page document, accesses the web server based on the generated conversion metadata, A conversion device for converting the page document into other types of documents;
And the web page document conversion system.
The method according to claim 1,
The conversion device includes:
A connection unit for connecting to the web page document;
A conversion object extraction unit that extracts a conversion object from the web page document;
A control unit for generating conversion metadata based on information on the web page document;
A converted document generation unit for generating a converted document by converting the plurality of web page documents into other documents based on the generated conversion metadata; And
A database storing information on the web page document, the generated conversion metadata, and the generated conversion document; And
A converted document processing unit for transmitting the generated converted document to a document storage device or storing the converted document in the database;
And the web page document conversion system.
3. The method of claim 2,
A user interface unit for receiving data from a user to generate the conversion metadata and displaying the input data on a screen;
The web page document conversion system.
The method of claim 3,
Wherein the control unit fetches information on the web page document from the database and generates the conversion metadata according to the data received from the user through the user interface unit and the document information.
5. The method according to any one of claims 1 to 4,
The conversion metadata may include at least one of a connection address, a document ID, a type of a document access, a screen size to be accessed, a storage location of the converted documents, a converted document margin, A web page document conversion system including a file name, a conversion document transfer status, and an attachment transfer status.
6. The method of claim 5,
Wherein the control unit generates a conversion document file name for each of the plurality of web page documents, the conversion document file name being generated based on a document type and a document title of each web page document, Document conversion system.
6. The method of claim 5,
Wherein the converted document file name includes a document type and a document ID of the web page document.
The method according to claim 1,
The conversion device includes:
A thread for collecting the entire HTML content from the access address of the plurality of web page documents when converting the plurality of web page documents into another type of document, a thread for extracting the HTML content of the corresponding area, Depending on the presence or absence of the file, a thread for extracting the address related to the attachment file, a thread for generating the converted document, a thread for downloading the attachment file, and a thread for transferring the converted document, And converting the plurality of web page documents into another type of document and transmitting the same to a storage or document storage device.
The method according to claim 1,
The conversion device includes:
Accessing the predetermined number or more of web page documents by using an online access API (application programming interface), downloading attached files attached to the web page document by using a download API,
A document conversion time and a result of the plurality of web page documents are recorded in a log,
Converts the transformation metadata into JavaScript (Cascading Style Sheet) and JavaScript (CSS)
And providing a function of adding a watermark and an electronic signature to the converted other type of document.
A web server having a predetermined number or more of web page documents; And
A conversion program for generating conversion metadata based on the information on the predetermined number or more of web page documents and converting the predetermined number or more of web page documents into other types of documents based on the generated conversion metadata;
And a web page document conversion system.
11. The method of claim 10,
A document storage device for storing and storing other types of documents converted through the conversion program;
The web page document conversion system.
12. The method of claim 11,
Wherein the conversion program is installed in the web server or installed in the document storage device.
12. The method of claim 11,
Wherein the conversion program comprises:
A thread for collecting the entire HTML content from the access address of the predetermined number or more of the web page documents when converting the predetermined number or more of the web page documents into other types of documents, A thread that extracts an attachment-related address, a thread that generates a conversion document, a thread that downloads an attachment, a thread that transfers a conversion document, an attachment, and metadata to another system And converting the predetermined number or more of web pages into other types of documents and storing the converted web pages or transmitting them to the document storage device.
11. The method of claim 10,
Wherein the conversion program comprises:
Accessing the predetermined number or more of web page documents by using an online access API (application programming interface), downloading attached files attached to the web page document by using a download API,
And records a document conversion time and a result of the predetermined number or more of web page documents in a log,
Converts the transformation metadata into JavaScript (Cascading Style Sheet) and JavaScript (CSS)
And providing a function of adding a watermark and an electronic signature to the converted other type of document.
A web page document conversion method of a conversion apparatus for converting a plurality of web page documents into other types of documents,
(a) generating a conversion metadata based on document information including a web address, an ID, a document title, and a document type of the web page document;
(b) connecting to the plurality of web page documents based on the generated conversion metadata;
(c) extracting a conversion object for each of the plurality of web page documents for each web page document;
(d) a transformed document generating unit converts the extracted transformed object into another type of document based on the transformed metadata to generate a transformed document; And
(e) the converted document processing unit stores the generated converted documents in a database or transmits them to a document storage device;
And converting the web page into a web page.
16. The method of claim 15,
In the step (a), the control unit may acquire the document information from the database in which the document information is stored, generate the conversion metadata according to the data received from the user through the user interface unit and the conversion information, How to convert a page document.
16. The method of claim 15,
The conversion metadata may include at least one of a connection address, a document ID, a document access type, a screen size to be accessed, a storage location for the converted other types of documents, A method of converting a web page document, the file name including a translation document margins, a conversion document migration status, and an attachment file migration status.
18. The method of claim 17,
In the step (a), when generating the conversion metadata, the control unit may convert the conversion document file name into a conversion document, which is classified according to a document type and a document title of each web page document in the plurality of web page documents, A web page document conversion method for generating a file name.
18. The method of claim 17,
Wherein the converted document file name includes a document type and a document ID of the web page document.
16. The method of claim 15,
The step (c) includes: a thread for collecting the entire HTML content from the access address of the plurality of web page documents; a thread for extracting the HTML content of the corresponding conversion target area; A thread for extracting a related address, a thread for generating a converted document, a thread for downloading an attached file, and a thread for transferring a converted document, an attached file, and metadata to another system, Converting the document into another type of document and storing the document or transmitting the document to the document storage device.

Images