KR102031732B1 - Apparatus and methods of supporting fast web scrolling - Google Patents

Abstract

According to a web scrolling system for solving the problems of the present invention, a web document providing apparatus for storing a Web (Web) document in a web description language, and providing the web document to the user terminal device in accordance with the connection of the user terminal device And receiving the web document by accessing the web document providing device, parsing the received web document, and converting the web document into dome tree data having a tree-shaped structure. Subsequently, nodes except the display output node corresponding to the data to be output to the display means, having the same structure as the converted dome tree data, generate render tree data including empty nodes. And a user terminal device including a processor configured to provide the render tree data to a web application process. .
According to the present invention, the user terminal device can provide a data structure and a processing method for quickly scrolling a web document and allowing the web document to be scrolled quickly.

Description

User terminal device and scrolling method that supports fast web scrolling of web documents {APPARATUS AND METHODS OF SUPPORTING FAST WEB SCROLLING}

The present invention is a technology for displaying a Web document (Web Document) composed of a web description language, including HTML (HyperText Markup Language) on the user terminal device, and particularly improves the responsiveness of the user terminal device when displaying a large web document It is about technology to let.

At present, various user terminal devices access the Internet and download a number of web documents from a web document providing device and display them on the user terminal device.

Web documents are generally expressed in a web document description language such as Java Script or XML including HTML, and web applications executed in the user terminal device interpret the web document description language and display it on the display means of the user terminal device. Display.

Due to the development of the Internet and the development of wired / wireless communication technology, web documents are more diverse and contain more information than ever before, and have been expanded from text-based contents to web documents including multimedia contents such as pictures and videos. have.

Therefore, the web application running on the user terminal device requires a higher computational process than before, and the system needs to be configured to stably process a web document composed of a large amount of content and not to degrade user response.

In addition, recently, an internet service providing a social network service is increasing. Many social network services do not have a fixed end of a web document, but after loading a certain amount of the web document, when the user scrolls the web document to the end of the corresponding capacity, the subsequent capacity is loaded again. In the form of services.

1 is a result of displaying a specific social network service on a mobile user terminal device, and when scrolling past a certain capacity 110 of a web document, the subsequent capacity is reloaded and repeated.

In this case, there is a problem that the user terminal device continues to load the web document beyond the display screen shown to the user, so that a large load is placed on the memory capacity and data processing. This is a bigger problem for devices.

Accordingly, there is a need for a method capable of efficiently processing web documents in a user terminal device without degrading user responsiveness.

Domestic Publication No. 2010-0023822 (2010.03.04) Title of the Invention: Turbo-scroll mode for fast data item selection

It is an object of the present invention to provide a user terminal device and a method for rapidly scrolling a web document.

Another object of the present invention is to provide a user terminal device and method for supporting a data structure and a processing method for making a web document quickly scrollable.

Another object of the present invention is to provide a user terminal apparatus and method capable of changing a data structure and processing method for scrolling according to the complexity of a web document.

According to a web scrolling system for solving the problems of the present invention, a web document providing apparatus for storing a Web (Web) document in a web description language, and providing the web document to the user terminal device in accordance with the connection of the user terminal device And receiving the web document by accessing the web document providing device, parsing the received web document, and converting the web document into dome tree data having a tree-shaped structure. Subsequently, nodes except the display output node corresponding to the data to be output to the display means, having the same structure as the converted dome tree data, generate render tree data including empty nodes. And a user terminal device including a processor configured to provide the render tree data to a web application process. .

According to a user terminal device for solving the problems of the present invention, the display unit for displaying the output result of the Web Application Process (Web Application Process), the video output memory unit for storing the output results displayed on the display unit, the processor unit Tree by executing the process including the web application process and the memory unit for storing the data including the intermediate operation result of the processing, and parses the provided Web Document (Web Document) in the Web description language (Tree) After converting to dome tree data having a structure of), nodes except display output nodes corresponding to data to be output to the display means having the same structure as the converted dome tree data are empty nodes. generate render tree data consisting of void nodes, and Further storing a tree data to said video memory includes an output processor, the processor unit provided in the web application process (Web Application Process).

The video output memory unit may be configured as a video buffer memory.

The processor unit may store the dome tree data in a memory having a lower speed than the video output memory unit.

The processor unit may insert a scroll mark node at a data structure position corresponding to a display output node of the render tree data in the dome tree data.

The scroll mark node may be different nodes of a start scroll mark node and an end scroll mark node.

When the processor unit receives a request to change the data to be output to the display unit from the web application process, the display output node of the render tree data changes nodes that are no longer output to the display unit to empty nodes, and the dome tree data. After copying the data to be output to the display means to the render tree data, the render tree data may be provided to the web application process.

According to a user terminal device for solving the problems of the present invention, the display unit for displaying the output result of the Web Application Process (Web Application Process), the video output memory unit for storing the output results displayed on the display unit, the processor unit Tree by executing the process including the web application process and the memory unit for storing the data including the intermediate operation result of the processing, and parses the provided Web Document (Web Document) in the Web description language (Tree) After converting to Dom Tree data having a structure of), if the ratio of Texts in the provided Web document is exceeded and a preset value is exceeded, it has the same structure as the converted Dome Tree data. The display output node corresponding to the data to be output to the display means is provided. One node generates render tree data consisting of void nodes, stores render tree data in the video output memory unit, and provides the render tree data to a web application process. And a processor for providing the dome tree data to the web application process when the ratio of characters does not exceed a preset value.

According to a method of scrolling a web document of a user terminal device for solving the problems of the present invention, (a) the processor executes processes including a web application process (Web Application Process) and the web document configured in a web description language ( Web document), (b) the processor parses the web document and converts the web document into DOM tree data having a tree structure, and (c) the processor Generating render tree data including empty nodes, except for a display output node corresponding to data to be output to a display means, having the same structure as the dome tree data; and (d The processor loading the render tree data into a video buffer memory and providing the render tree data to the web application process. .

According to the present invention, the user terminal device can quickly scroll a web document.

In addition, according to the present invention, it is possible to provide a data structure and a processing method for enabling scrolling of a web document quickly.

According to the present invention, the data structure and processing method for scrolling can be changed according to the complexity of the web document.

1 is an embodiment of a service over the web of a conventional social network service.
2 is an embodiment of a web scrolling system according to the present invention.
3 is an embodiment of a user terminal device according to the present invention.
4 is an embodiment of a web document scrolling method of the user terminal device according to the present invention.
FIG. 5 illustrates an embodiment in which a web document is converted into DOM tree data.
FIG. 6 is an embodiment in which a web document according to the present invention is converted into render tree data.
FIG. 7 illustrates an embodiment in which a web document according to the present invention is converted into render tree data.
FIG. 8 illustrates an embodiment of a data configuration in which a scroll mark node is inserted into dome tree data according to the present invention.
FIG. 9 illustrates an embodiment of a data configuration in which a scroll mark node is inserted into dome tree data according to the present invention.

Details of the object and technical configuration of the present invention and the resulting effects will be more clearly understood by the following detailed description based on the accompanying drawings. With reference to the accompanying drawings will be described in detail an embodiment according to the present invention.

As those skilled in the art can implement various applications of the present invention through the embodiments of the present disclosure, any embodiments described in the detailed description of the present invention are illustrative for better understanding of the present invention. It is not intended that the scope be limited to the embodiments.

Each functional unit or functional unit represented herein is merely an example of an implementation of the present invention. Thus, other implementations or means may be used in other implementations of the invention without departing from the spirit and scope of the invention. In addition, each functional unit or each functional means may be implemented solely in the configuration of hardware or software, or may be implemented in a combination of various hardware and software configurations that perform the same function.

In the present specification, a user terminal device typically means an apparatus including at least one processor unit, a memory unit, and a display unit. The user terminal device includes a mobile phone, a tablet computer, a personal computer, and the like.

In the present specification, the web description language includes a language for writing a web document such as HyperText Markup Language (HTML), HyperText Markup Language (HTML) 5, JavaScript, and Cascading Style Sheets (CSS).

An embodiment of a web scroll system according to the present invention will be described with reference to FIG. 2.

The web scroll system according to the present invention includes a web document providing apparatus device and user terminal devices 220, 230, and 240.

Web document providing apparatus The device is connected to a wired or wireless network and provides a web document to a user terminal device connected through the wired or wireless network. The web document is written in a web description language including HTML, and may be stored in a database connected to a web document providing device.

The user terminal devices 220, 230, and 240 access the web document providing apparatus, receive a web document, parse the received web document, and convert the received web document into DOM tree data as shown in FIG. 5. do.

Dom Tree is a formal standard for the W3C as a format for representing structured documents using an object-oriented model.

 The web document converted to the dome tree data has the same structure as the converted dome tree data, and nodes except the display output node corresponding to the data to be output to the display means are empty nodes. Generates the configured render tree data.

The render tree data is loaded into a video output memory and provided to a web application process.

The data to be output to the display means that only the data to be output to the display means is separated from the web document converted to the DOM tree data, and the web document converted to the dome tree data is displayed on the display means. When the amount of data exceeds one page, it means the data of one page to be output to the current display means.

Therefore, when the web document is scrolled, the data to be outputted to the display means continuously changes as scrolls, and accordingly, render tree data also changes.

The web application process generally refers to a process of an application capable of parsing a web document and outputting it to a display means among application program processes executed in a processor, and a web browser is also included in the web application.

An embodiment of a user terminal device according to the present invention will be described with reference to FIG. 3.

The user terminal device according to the present invention includes a display unit 310, a video output memory unit 330, a memory unit 320, and a processor unit 340.

The display unit 310 is an output means for displaying the operation state and the operation result of the user terminal device or providing information to the user. The display unit 310 displays information input by the user or information provided to the user, including various menus. That is, the display 310 may provide a Graphic User Interface (GUI) of an application executed in the processor 340 of the user terminal device.

The display unit 310 may be formed in the form of a panel such as an LCD, or may be implemented to enable input in the form of a touch LCD.

The video output memory unit 330 is a memory for recording and reading information to be output to the display unit 310. The video output memory unit 330 may be configured independently from system memory, and the system memory is shared. In the case of the memory, the video output area may be allocated in the system memory.

The video output memory unit 330 is preferably a video buffer memory separate from the system memory and may be configured as a memory having a faster input / output speed than the system memory.

The memory unit 320 or the video output memory unit 330 may be a volatile memory device, a nonvolatile memory, or a nonvolatile electromagnetic storage device.

The processor unit 340 may be a general-purpose central processing unit (CPU), but may also be a programmable device device (CPLD, FPGA) or an application-specific semiconductor processing unit (ASIC) implemented for a specific purpose.

The processor unit 340, which executes the web application process, parses a web document including HTML and converts the web document into dome tree data having a tree structure as shown in FIG.

The processor unit 340 has the same structure as the converted dome tree data using the converted dome tree data and excludes a display output node corresponding to data to be output to the display unit 310. The nodes generate render tree data consisting of void nodes.

The processor unit 340 loads the render tree data into the video output memory unit 330 to provide the web application process to the web application process, and the web application process or a separate graphics processor provides the render tree. Tree data is rendered and output to the display unit 310.

If the result converted into the DOM tree data is shown in FIG. 5, the render tree data has the same structure as the DOM tree data as shown in FIG. 6.

However, since data to be output to the display means among the dome tree data is limited, if only a part 510 of the data node is output to the display means among the dome tree data shown in FIG. 5, the render tree ( In the Render Tree data, the nodes 520 except for the data node 510 outputted to the display means are generated as a void node as shown in FIG. 6.

In this case, the processor unit 340 may store the DOM tree data in a memory having a lower speed than the video output memory unit 330.

Therefore, even when the user terminal device has a small capacity video output memory unit 330, nodes except for a node corresponding to an area output from the display unit 310 in a large web document are configured as void nodes. Render tree data is processed in the video output memory unit 330, and the remaining DOM tree data is stored in system memory, thereby enabling quick display of a web document.

That is, when rendering dome tree data in a region (viewport, viewport) output to the display 310, the output time is proportional to the complexity (number of nodes) of the dome tree data. In the case of a mobile terminal, the computing power of the processor unit is much lower than that of a general computer, and a web page that is converted into a dome tree data having a large amount of data consumes a lot of time for scrolling. Therefore, the user environment is also deteriorated due to the scroll delay of the web page.

On the other hand, as described above, in the case of outputting to the viewport using the rendering data having the structure and the node according to the present invention, the application process makes the viewport output speed faster by configuring the nodes except the data nodes output to the viewport as void nodes. Improved mobile terminal with low computing power can also provide a smooth user experience to users and prevent scroll delay because it does not output all the data as valid nodes even when the web user scrolls the web browser. It works.

In addition, void nodes of the render tree data are assigned to each node by a header marker indicating that they are empty nodes, thereby preventing searching for all nodes or outputting them to the display means. Can be distinguished from other nodes.

Referring to FIG. 7, render tree data may change according to scrolling of a web browser of a user.

 For example, the node except for the data node 510 in which only a part 510 of the data node is output to the display means among the dome tree data as illustrated in FIG. 5, and the render tree data is output to the display means. After the fields 520 are configured as empty nodes and generated as shown in FIG. 6, when the data output to the display means is changed to some other node 520 according to the scrolling of the web browser of the user, the render tree (Render) Nodes 510 except for the data node 520 outputted to the display means are also configured as empty nodes, and the nodes 620 which were empty nodes are displayed in the dome tree data. The nodes 520 to be outputted are copied and reconfigured as shown in FIG. 7.

In another example, referring to FIG. 8, the processor unit 340 generates the render tree data from the dome tree data to the display output node of the render tree data. Scroll Mark Nodes 811 and 812 may be inserted at corresponding data structure positions to store the DOM tree data.

The scroll mark node may be in the same form as a node of dome tree data converted from a web document, may be a node having a different data structure, and it is sufficient to have an indication that the scroll document node is a scroll mark node.

The scroll mark node is inserted at a node position (a data structure position corresponding to the display output node) that has a pointer of the display output node of the render tree data among the DOM tree data, and is a render tree. Tree) The scroll mark node may be a node composed of a start scroll mark node and an end scroll mark node so as to know the start and end of the position where the display output node of the data was located.

Therefore, even after generating the render tree data, the scroll mark node may be used to easily access a node of the dome tree data corresponding to the display output node of the render tree data.

7, 8, and 9, when the processor unit 340 receives a change request of the data to be output to the display unit 310 from the web application process, the processor unit 340 may select one of the display output nodes of the render tree data. Nodes leaving the viewport may be deleted, nodes newly output to the viewport among the dome tree data may be copied into render tree data, loaded into the display output memory, and provided to the web application process. .

Render tree data generated from the dome tree data converted from the web document is shown in FIG. 6 and corresponds to the display output node of the render tree data in the dome tree data. After the scroll mark nodes 811 and 812 are inserted at the data structure location, the processor unit 340 receives a request for data change to be output to the display unit 310 including the scroll event through a web application process of the user terminal device. ) May determine to which side of the web document the scroll event is directed and scrolled to, and search for the scroll mark nodes 811 and 812 in the dome tree data. .

Thereafter, the processor unit 340 may copy a node required from the DOM tree data to the render tree data by using the scroll mark nodes 811 and 812 and load it into the render memory. Can be.

In this case, the processor unit 340 may move and insert the scroll mark nodes 921 and 922 again at the position of the display output node in the DOM tree data.

Therefore, even when the content area of the web application is larger than the size of the display 310 or the size of the user interface window of the web application, scrolling is performed. Data may be easily loaded into the video output memory unit 330 for display.

Another embodiment of the user terminal device according to the present invention will be described.

The user terminal device according to the present invention includes a display unit 310, a video output memory unit 330, a memory unit, and a processor unit 340.

The display unit 310 is an output means for displaying an operation state and an operation result of the user terminal device or providing information to the user. The display unit 310 may be a graphical user interface of an application executed in the processor unit 340 of the user terminal device. GUI, Graphic User Interface).

The video output memory unit 330 is a memory for recording and reading information to be output to the display unit 310. The video output memory unit 330 may be configured independently from system memory, and the system memory is shared. In the case of the memory, the video output area may be allocated in the system memory.

The video output memory unit 330 is preferably a video buffer memory separate from the system memory and may be configured as a memory having a faster input / output speed than the system memory.

The processor unit 340 may be a general-purpose central processing unit (CPU), but may also be a programmable device device (CPLD, FPGA) or an application-specific semiconductor processing unit (ASIC) implemented for a specific purpose.

The processor unit 340, which executes the web application process, parses a web document including HTML and converts the web document into data having a tree-like structure as shown in FIG.

The processor unit 340 measures the complexity of the web document converted into DOM tree data.

When a user terminal device displays a display by processing an event based on a graphic processing unit (GPU) based on a graphic processing unit (GPU) in the user terminal device, the scroll using the GPU is newly displayed in the display area of the display unit 310 or the like. To render the contents that should be displayed in the area of the graphical user interface window, we perform an operation called Texture Upload, which draws pictures into the video buffer memory. Since the Texture Upload has a very high time delay operation, the method of separating the display output tree data for the scrolling of all web documents and storing the video output memory in the video output memory is performed by scrolling when a large image or a large number of images are stored in the content. The breakage of may occur.

Therefore, after converting a web document into DOM tree data having a tree-shaped structure, the web document is rendered from the DOM tree data only when the ratio of characters in the provided web document exceeds a preset value. Render tree data is generated and loaded into the video output memory unit 330 and provided to the web application process.

Referring to FIG. 4, a web document scrolling method of the user terminal device will be described.

The processor executes processes including a web application process and is provided with a web document including a hypertext markup language (HTML) (S410).

The process parses the web document (S420) and converts the web document into DOM tree data having a tree-shaped structure (S430). Thereafter, the renderers having the same structure as the dome tree data from the converted dome tree data and excluding the display output nodes corresponding to the data to be output to the display means are configured as void nodes. Tree tree data is generated, the render tree data is loaded into a video buffer memory, provided to the web application process (S450), and output to the display means (S460).

The processor may check a ratio of texts in the provided web document, convert the dome tree data into render tree data and load it into the video buffer memory only when the ratio exceeds a preset value (S440). ).

The processor may further store the dome tree data in a memory having a lower speed than the video buffer memory, and a scroll mark node at a data structure position corresponding to a display output node of the render tree data in the dome tree data. ) May be inserted to store the display non-output data.

The display output node refers to nodes corresponding to data to be output to the display 310 among the nodes of the dome tree data or the render tree data.

The scroll mark node may be different nodes of a start scroll mark node and an end scroll mark node.

When the processor unit 340 receives a request for data change to be output to the display unit 310 including a scroll event through a web application process, the processor unit 340 may determine which of the web documents output the scroll event to the viewport. The scroll mark nodes 811 and 812 may be searched for from the dome tree data.

Thereafter, the processor unit 340 copies necessary nodes from the DOM tree data to the render tree data using the scroll mark nodes 811 and 812 and loads them into the output memory. It may be provided to the web application process (S480, S450).

In this case, the processor unit 340 may move and insert the scroll mark nodes 921 and 922 again at the position of the display output node in the DOM tree data.

Therefore, even when the content area of the web application is larger than the size of the display 310 or the size of the user interface window of the web application, scrolling is performed. Data may be easily loaded into the video output memory unit 330 for display.

Certain terms used in the embodiments described in order to facilitate understanding of the present invention do not limit the present invention. The present invention may include all components that are natural to those skilled in the art and all components having equivalent values.

220, 230, 240: user terminal device
610, 720, 810, 920: display output node
811, 812, 921, 922: scroll mark node

Claims (19)

delete A display unit which displays an output result of a web application process;
A video output memory unit for storing output results displayed on the display unit;
A memory unit which stores data including intermediate calculation results according to the process of the processor unit; And
It executes processes including the web application process, parses the provided web document composed of web description language and converts it into dom tree data having a tree structure. After that, nodes other than the display output node of the dome tree data are configured as empty nodes to generate render tree data, and the render tree data is stored in the video output memory unit. It includes a processor processor for providing to the web application process (Web Application Process),
The display output node
The user terminal device corresponds to data to be output to the display means, and corresponds to some data nodes of the dome tree data.
delete delete delete delete The method of claim 2,
The processor unit,
When a request for change of data to be output to the display unit is received from the web application process,
In the display output node of the render tree data, nodes that are no longer output to the display unit are replaced with empty nodes,
And copying the data to be output to the display means from the dome tree data to the render tree data, and providing the render tree data to the web application process.
A display unit which displays an output result of a web application process;
A video output memory unit for storing output results displayed on the display unit;
A memory unit which stores data including intermediate calculation results according to the process of the processor unit; And
It executes processes including the web application process, parses the provided web document composed of web description language and converts it into dom tree data having a tree structure. After that, when the ratio of the texts in the provided web document exceeds the preset value, the render tree is configured by forming empty nodes in the dome tree data except for the display output node. (Render Tree) data is generated, the render tree data is stored in the video output memory unit and provided to a web application process, and the ratio of characters in the web document does not exceed a preset value. A processor unit for providing dome tree data to the web application process,
The display output node
The user terminal device corresponds to data to be output to the display means, and corresponds to some data nodes of the dome tree data.
delete delete delete delete The method of claim 8,
The processor unit,
If the proportion of characters in the web document exceeds a preset value,
When a request for change of data to be output to the display unit is received from the web application process,
In the display output node of the render tree data, nodes that are no longer output to the display unit are replaced with empty nodes,
And copying the data to be output to the display means from the dome tree data to the render tree data, and providing the render tree data to the web application process.
delete delete delete delete delete delete