KR20110024874A - System for scrap of web contents and method thereof - Google Patents

Abstract

PURPOSE: A system for scraping web contents and a method thereof are provided to save the scrap work time by converting the contents posted on the web into an electronic file, storing the converted file, then displaying the stored file to a website space. CONSTITUTION: A central control server(30) receives a scrap request signal of a certain webpage from a client terminal(10) connected through a network. The central control server converts the webpage into an electronic file and stored the converted file. A scrap DB(40) stores the electronic file converted in the central control server, and includes ID information for classifying plural clients. The electronic file is linked with the ideas for identifying the clients.

Description

Web content scrap system and its method {SYSTEM FOR SCRAP OF WEB CONTENTS AND METHOD THEREOF}

The present invention relates to a system and method for scraping content implemented on a web or the like into an electronic file. More specifically, the web content scrap is generated and stored and stored as individual PDF data based on an article or article unit. A system and method thereof are provided.

Through the universal dissemination of the Internet, the development of the Internet communication technology, and the rapid development of the communication infrastructure supporting it, the cyber space on the Internet through the Internet is expanding into another living area of modern people.

The Internet is mainly used to search for the desired information from the infinite information and to use the search results. In recent years, the use of such search and the change of the modern people's life patterns are used online according to their own or fellowship members. Various activities that create so-called private spaces that build spaces are commonplace.

In addition, these cyber spaces have characteristics that are based on the basic inclination of human beings to express themselves, so they are composed of high-level information at the professional level as well as various activities to inform themselves to those who visit their space. It is being developed as a space that can be protected by intellectual property rights, and has been established as a new creative activity space of cultural code.

On the other hand, the Internet space providing near infinite information has been proposed various ways for the user to conveniently search the desired information and scrap the search information, and to utilize the search results conveniently. In most cases, other storage spaces are set, and information or content desired by a user (user) is directly stored in the set space and operated in a form that can be viewed and viewed again later.

In addition, the conventional method of the conventional scrap is that when scraping articles, pictures or various contents desired by the user, since most of the web document is generated based on HTML, a method of copying or linking the address of the corresponding web document or providing it to the user The method of storing the content to be stored as a picture file or the like or to image through a screen print or the like is used.

In addition, in the case of various mass media including a media that provides offline media online, the media delivery has only been switched to online, and in order to effectively scrape an article desired by the user, the user directly selects the corresponding article. In addition to image files, there are no user-oriented scrap tools.

In addition, if a user wants to produce a 22nd edited work such as a scrapped product, a newspaper article scrap, or a fellowship activity result in a single printed book or e-book format, the work-dependent method used in terms of individual activities can be used. It is simply used, and there is no efficient way of scraping various web documents and publishing them as a result.

In addition, in the case of a service that allows the user to selectively search only the desired information online for offline mass media information, or a service that provides the resulting data (for example, an article search service or a mailing service) Most of the materials are simply scanned and imaged, or the entire contents are generated as a single file, which causes a problem in that the user can not select and search for articles separately.

In addition, for articles protected by copyright, if a user wants to create a new secondary or edited work using it, there is a lack of a method for verifying information on the copyright. In addition, there is a problem that must be performed, as well as users with insufficient recognition of intellectual property rights such as copyright can be said to be likely to cause a complicated problem in the future.

SUMMARY OF THE INVENTION The present invention has been made to overcome the above problems in the above background, and an object of the present invention is to provide a web content scrap system and a method for realizing scrap editing, legal rights, and various uses of the result.

A web content scrap method of the present invention for achieving the above object, the first step of driving a scrap application for scraps in a web browser of the client, receiving a scrap request signal from the application, the URL of the web page And a third step of checking a scrap range of the web page, a third step of receiving an HTML file of a web page corresponding to the scrap range identified in the second step, and receiving in the third step. And converting the received HTML file into an electronic file and storing the same.

In addition, in the web content scraping method of the present invention, the fourth step may include extracting design information of content from a received HTML file, and converting a scrap target web page to an electronic file based on the design information. It characterized in that it further comprises.

In addition, in the web content scrap method of the present invention, the scrap application is characterized in that implemented as a web widget (Widget) in the web browser of the client.

In addition, in the web content scrap method of the present invention, the electronic file is characterized in that the PDF supporting XML.

On the other hand, as a web content scrap system of the present invention, a central control server for receiving a scrap request signal of a specific web page from a client terminal connected through a network, converts the web page into an electronic file and stores it, and the central control It characterized in that it comprises a scrap DB is stored in the electronic file to be converted in the server.

In addition, as a web content scrap system of the present invention, the scrap DB further comprises ID (ID) information for distinguishing a plurality of clients, the electronic file is characterized in that stored in association with the ID for identifying the client do.

In addition, the web content scraping system of the present invention, the electronic file is characterized in that the PDF supporting XML.

As described above, the present invention converts the contents posted on the web into electronic files, stores them in a database, and posts them in a separate website space as necessary or saves time for a normal scrap work. At the same time, there is an advantage that you can easily view the stored electronic files.

In addition, by supporting PDF which is used very widely as an electronic file, more specifically an electronic document file, there is an effect that can create a variety of business using the universality and the same.

As the inventive concept allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

For example, without departing from the scope of the present invention, the second component may be referred to as the first component, and similarly, the first component may also be referred to as the second component.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Now, a web content scrap method and system according to an embodiment of the present invention will be described in detail with reference to the drawings, and the same or corresponding elements are denoted by the same reference numerals regardless of the reference numerals, and redundant description thereof will be omitted. Sometimes.

1 is a block diagram illustrating a web content scrap system according to an embodiment of the present invention, Figure 2 is a detailed view for explaining the operation of the central control server shown in Figure 1, Figure 3 is an embodiment of the present invention This is a flowchart for explaining a web content scraping method according to an example.

The web content scrap system according to the present embodiment is a web browser of a plurality of client terminals 10 connected through a network 20 as shown in FIG. 1, for example, Microsoft's Internet Explorer, Apple's Safari, and Google's. Chrome, Firefox, and so on, users can access websites and access their content. Such a website may be a typical blog, community, shopping mall 50 and the like, but is not limited thereto. Receiving a scrap request signal from the client terminal 10 as described above, the central control server 30 for converting the web page into an electronic file, and the scrap DB 40 in which the converted electronic file 40 is stored Include.

The central control server 30 includes an information extracting unit 31, a file converting unit 32, and a rendering unit 33 as shown in FIG. 2, which will be described in detail with reference to the flowchart of FIG. It demonstrates with reference.

The central control server 30 monitors whether a scrap request signal is received from the plurality of client terminals 10 through the network 20 (S11). In this case, a separate application for scrap must be driven in the client terminal 10, which is preferably provided in the form of a web widget. The web widget may be implemented in the form of Flash, JAVA Script Active X, JAVA Applet, but is not limited thereto.

Through the scrap application provided in the form of the web widget, the user requests a scrap request signal to the central control server 30 on a web browser, and the central control server 30 receives the request signal and receives the URL of the web page. It will be confirmed (S12). Thereafter, the webpage is accessed through the confirmed URL (S13), and the scope of the scrap object is checked (S14). If the web page is a blog, only the contents of the post except for a menu placed on the side of the web page will be identified as the scrap object. Since only the contents of the post can be extracted from the HTML of the web page, the information extraction unit 31 of the central control server 30 is responsible for this. In addition, when the web page is a community, it is also possible to check only the contents of the post as a scrap object, except for a menu placed on the side. Such extraction may be accomplished using extraction tags in HTML.

The information extraction unit 31 of the central control server 30 extracts the HTML of the checked scrap range as described above, and checks the design and layout information of the web page of the extracted HTML (S16). Through the checked design and layout information, the rendering unit 33 performs re-rendering with respect to the range where the scrap is to be processed (S17). This is to solve the problem of incompatibility when converting a normal web page into an electronic file, and the broken phenomenon due to the inconsistent design and layout. The temporary HTML that reimplements the web page through re-rendering is generated. will be. Thereafter, the rendered web page, that is, the HTML file conversion unit 32 is converted into PDF (S18), and the central control server 30 records and stores the converted PDF file in the scrap DB (40). The PDF is a file format developed by Adobe of the United States as a file format supporting ordinary XML, or a general electronic file format recently selected as an ISO standard.

The PDF file is stored in the scrap DB 40, and the central control server 30 stores the PDF file so as to be linked with ID information, which is user identification information, to be stored separately for each user.

The scrap file stored as described above has an advantage of easily opening the scraped PDF file when the user logs in through ID / password input by accessing the central control server 30, that is, the service website. .

In addition, in the form of a web widget can be linked to a separate website bulletin board or blog link, if the other user clicks the link by linking the URL on the web of the specific scraped PDF file stored in the scrap DB (40) You can also make the PDF file visible to other users who clicked it.

One embodiment of the present invention described above should not be construed as limiting the technical spirit of the present invention. The protection scope of the present invention is limited only by the matters described in the claims, and those skilled in the art can change and change the technical idea of the present invention in various forms. Therefore, such improvements and modifications will fall within the protection scope of the present invention as long as it will be apparent to those skilled in the art.

1 is a block diagram illustrating a web content scrap system according to an embodiment of the present invention.

2 is a detailed view for explaining the operation of the central control server shown in FIG.

3 is a flowchart illustrating a web content scraping method according to an embodiment of the present invention.

Claims (7)

A first step of running a scrap application for scrap in a web browser of a client, A second step of receiving a scrap request signal from the application, checking a URL of a corresponding web page, and confirming a scrap range of the web page; A third step of receiving an HTML file of a web page corresponding to the scrap range identified in the second step; And a fourth step of converting the HTML file received in the third step into an electronic file and storing the same. The method of claim 1, The fourth step, And extracting design information of the content from the received HTML file, rendering the scrap target web page based on the design information, and converting the content into an electronic file. The method of claim 1, The scrap application is a web content scrap method, characterized in that implemented as a web widget (Widget) in the web browser of the client. The method of claim 1, And the electronic file is a PDF that supports XML. As a web content scrap system, A central control server for receiving a scrap request signal of a specific web page from a client terminal connected through a network, converting the web page into an electronic file, and storing the converted web page; Web scrap content system including a scrap DB is stored in the electronic file converted by the central control server. The method of claim 5, The scrap DB, Further comprising ID information for identifying a plurality of clients, And the electronic file is stored in association with an ID for identifying the client. The method of claim 6, The electronic file is a web content scrap system, characterized in that the PDF supporting XML.

Images