KR20120003122A - Apparatus and method for processing image based on pre loading, and apparatus and method for processing image based on asynchronous loading - Google Patents

Abstract

PURPOSE: A device for processing a preloading based image and a method thereof, and an asynchronous loading based image processing device and a method thereof are provided to pre-load another image on a background in rendering a specific image. CONSTITUTION: A loading unit(311) loads data about a display target image. If data for the image is completely loaded, a rendering unit(312) renders the image based on the loaded data. The loading unit loads data for another image which is not completely loaded while the rendering unit renders the image.

Description

Preloading-based image processing apparatus and method, and asynchronous loading-based image processing apparatus and method

A pre loading image processing apparatus and method and an asynchronous loading based image processing apparatus and method are disclosed. In particular, embodiments of the present invention relate to a multithreaded image loading technique that preloads another image into the background when a particular image is being rendered in the terminal.

Recently, as interest in user interfaces (UIs) such as mobile terminals has increased, researches on graphic user interfaces (GUIs) capable of providing an intuitive and colorful UI have been actively conducted.

As user demand for GUI increases, recently released mobile terminals are equipped with a GUI composed of various contents such as text, images, and vectors.

As a result, resource demands that mobile terminals and the like must use to implement such GUIs are gradually increasing.

In general, a mobile terminal or the like often uses a file in a predefined bitmap format to reduce the loading speed of many images used in the GUI.

However, in this case, when the file to be loaded is an external file or a file downloaded from the network, it is often necessary to use a compressed image file in consideration of the file size. It can make a difference.

As such, as the implementation of various image-based multimedia contents is required in a mobile terminal, a study on a technique for reducing the loading speed of images is required.

Embodiments of the present invention provide a multithread-based image loading technique that preloads another image into the background when a specific image is being rendered in the terminal, thereby rapidly drawing the image on the terminal. I want to lay the foundation for it.

According to an embodiment of the present invention, a pre loading-based image processing apparatus includes a loading unit for loading data for an image to be displayed and a data loading for the image when loading of the image is completed. And a rendering unit configured to render the image based on the loading unit, wherein the loading unit loads data for another image which is not loaded while the rendering unit renders the image.

In this case, according to an embodiment of the present invention, the loading unit may perform data loading on the other image in the background.

In addition, according to an embodiment of the present invention, the renderer manages a scene tree by using a predetermined resource, receives the loaded data from the loading unit, and updates the scene tree. can do.

According to an embodiment of the present invention, the rendering unit requests a loading unit to load data for the other image based on the scene tree, and the loading unit requests data for the other image according to the request of the rendering unit. Loading may be delivered to the renderer.

In accordance with another aspect of the present invention, an asynchronous loading-based image processing apparatus includes a layer divider for dividing data for an image to be displayed into a predetermined layer, and sequentially loading data divided into the selected layer. and a rendering unit that renders the image sequentially based on the loading completion order of the data divided into the selected layer, and the loading unit is based on the data of the priority layer. While performing the rendering, the data of the lower priority layer is not loaded.

In this case, according to an embodiment of the present invention, the loading unit may perform loading of the data of the subordinate layer in the background.

In addition, according to an embodiment of the present invention, the hierarchical separator may classify the hierarchical layer of data for the image from low resolution to high resolution based on the resolution of the image.

In addition, according to an embodiment of the present invention, the rendering unit may render the image in the order of low resolution to high resolution based on the loading completion order of the data divided based on the height of the resolution.

According to another embodiment of the present invention, there is provided a preloading-based image processing method of loading data for an image to be displayed, and when data loading for the image is completed, based on the loaded data. Rendering the image, loading data for another image that has not been loaded while the image is being rendered, and loading data for the other image when the image is finished loading Rendering the other image as a basis.

In this case, according to an embodiment of the present invention, the loading of the data for the other image may be performed in the background of the data loading for the other image.

According to an embodiment of the present invention, the preloading-based image processing method may include managing a scene tree by using a predetermined resource and receiving data about the loaded image. The method may further include updating the scene tree.

At this time, according to an embodiment of the present invention, the preloading-based image processing method further comprises the step of requesting loading of data for the other image based on the scene tree, and loading data for the other image The step of loading may load data for the other image in response to the request.

According to another aspect of the present invention, there is provided an asynchronous loading-based image processing method, comprising: dividing data for an image to be displayed into a predetermined layer, and storing data of a priority layer among the data classified into the selected layer. Loading, when the data of the priority layer is finished loading, rendering an image corresponding to the data of the priority layer based on the data of the priority layer, and corresponding to the data of the priority layer While the image is being rendered, loading the data of the subordinate layer that has not been loaded and rendering the image corresponding to the data of the subordinate layer based on the data of the subordinate layer when the data of the subordinate layer is loaded. Steps.

In this case, according to an embodiment of the present invention, the loading of the data of the subordinate layer may be performed in the background of the data of the subordinate layer.

In addition, according to an embodiment of the present disclosure, the dividing into the selected hierarchical layer may classify the hierarchical layer of data for the image from low resolution to high resolution based on the resolution of the image.

Embodiments of the present invention provide a multithread-based image loading technique that preloads another image into the background when a specific image is being rendered in the terminal, thereby rapidly drawing the image on the terminal. You can establish a framework to make it possible.

In addition, embodiments of the present invention by loading the next image of the particular image in the background when the specific image is being rendered, so that when the rendering of the specific image is completed, the rendering of the next image immediately without a separate loading time A preloading based image processing apparatus and method which can be performed can be provided.

In addition, embodiments of the present invention divide the image to be drawn on the screen of the terminal into a predetermined layer and when the image of a specific layer is being rendered, by preloading the image of another layer in the background, thereby improving the drawing speed of the image An asynchronous loading-based image processing apparatus and method can be provided.

1 is a diagram illustrating a process of drawing an image on a screen according to an asynchronous loading-based image processing technique according to an embodiment of the present invention.
2 is a diagram illustrating an operation structure of a multithreaded image processing technique according to embodiments of the present invention.
3 is a diagram illustrating a structure of a preloading based image processing apparatus according to an embodiment of the present invention.
4 is a diagram illustrating a structure of an asynchronous loading-based image processing apparatus according to an embodiment of the present invention.
5 is a flowchart illustrating a preloading based image processing method according to an embodiment of the present invention.
6 is a flowchart illustrating an asynchronous loading-based image processing method according to an embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings will be described embodiments of the present invention; However, the present invention is not limited or limited by the embodiments. Also, like reference numerals in the drawings denote like elements.

In general, a technique for distributing a file loading time is widely used as a technique used to reduce an image loading speed of a terminal.

The above technique is a method of loading a file whenever it is needed, and loads the file whenever a designated image is drawn on the screen.

However, since images of the screen are included in the screen drawing at once, it is difficult to expect a distributed loading effect from the above technique.

Although there is an explicit loading technique as another distributed loading technique, the explicit loading technique is not used much because of the high development cost for specifying unnecessary loading functions.

In this regard, embodiments of the present invention provide a multithread-based image loading technique that preloads another image into the background when a particular image is being rendered on the terminal, We want to lay the groundwork for an image to be drawn quickly.

Embodiments of the present invention provide a preloading-based image processing technique for preloading the next image when the specific image is being rendered, and classify the image into a predetermined layer and then render the image of the specific layer. At the same time, it can be classified into an asynchronous loading-based image processing technique that gradually loads image data of another layer.

Therefore, hereinafter, embodiments of the present invention will be described by dividing the preloading based image processing technique into the asynchronous loading based image processing technique.

The preloading-based image processing technique preloads the next image of the specific image in the background when the specific image is being rendered, and when the rendering of the specific image is completed, immediately renders the next image without additional loading time. It is a technique that can be done.

In other words, the preloading-based image processing technique is a technique of performing a loading task to be branched in the background using multithreading.

Since the preloading-based image processing technique requires preloading before the image loading time, the image usage should be predicted in advance, and the total amount of preloaded images should not be larger than the physical memory size.

The asynchronous loading-based image processing technique divides an image to be drawn on a screen of a terminal into a predetermined layer and when the image of a specific layer is being rendered, preloads the image of another layer in the background, thereby improving the drawing speed of the image. It can be a technique.

In other words, the asynchronous loading-based image processing technique is a technique that reflects a loading state on a drawing screen in real time when an image to be used for drawing is not loaded.

Therefore, unlike the general image loading technique, the asynchronous loading-based image processing technique can render an image without waiting for loading time, thereby improving the drawing speed of the image.

According to an embodiment of the present invention, in order to implement an asynchronous loading-based image processing technique, an image may be divided into several layers of resolutions according to a format, and then images may be loaded for each resolution.

At this time, by generating an image file including the image pyramid content or using a method of quickly scanning a low frequency image, it is possible to implement the loading of the image for each resolution.

Normally, the loading time for each resolution of the image will be required proportionally, so loading in the order of lower resolution to higher resolution can produce different image results while the loading of the image is performed. The result is that the loading of the image is faster.

The loading of the image which is divided by resolution gradually can be processed by using the interlace method in the image format, and the loading process can be completed quickly by using the progressive jpeg method which is highly compressed and suitable for network transmission. Can be.

1 is a diagram illustrating a process of drawing an image on a screen according to an asynchronous loading-based image processing technique according to an embodiment of the present invention.

FIG. 1 illustrates a process of drawing an image by dividing the image into four layers in the order of low resolution to high resolution, and sequentially performing rendering for each layer.

That is, referring to FIG. 1, the image corresponding to the layer 3 is loaded at the same time as the rendering of the image corresponding to the layer 3, and the rendering of the image corresponding to the layer 3 is performed. Upon completion, the image corresponding to the layer 2 (level 2) which is preloaded is immediately rendered, and the image corresponding to the layer 1 (level 1) is simultaneously executed while the image corresponding to the layer 2 (level 2) is rendered. It can be seen that the drawing of the entire image is completed by using the method of loading the image.

The asynchronous loading-based image processing technique may be appropriately used when many images need to be loaded, such as a large list, depending on an application, and the images need to be quickly replaced by a scrolling operation.

If the image list is scrolling quickly, only the image corresponding to the lowest resolution layer is rendered. On the contrary, when the image list is slowly scrolled or frozen, all images of all layers are loaded to increase the efficiency of image drawing. have.

In the above, the pre-loading based image processing technique and the asynchronous loading based image processing technique which are the multi-threaded image processing techniques according to the embodiments of the present invention have been described.

Hereinafter, an overall operation structure of a multithreaded image processing scheme according to embodiments of the present invention will be described with reference to FIG. 2.

2 is a diagram illustrating an operation structure of a multithreaded image processing technique according to embodiments of the present invention.

2, the main thread 210 includes an image cache 211, a request queue 212, and a surface marker 213, and the loading thread 220 includes an image loader 221. do.

The main thread 210 manages a scene tree using resources prepared in advance, and performs various CPU operations and renderings.

In particular, the main thread 210 requests the loading thread 220 to load the image through the request queue 212 for resource management, obtains the loaded image from the loading thread 220 and updates the scene tree. Perform rendering.

The loading thread 220 repeatedly executes only the resource loading operation separately from the main thread 210, so that the loading thread 220 operates in the background so that the main thread 210 can use the resource smoothly.

In addition, the loading thread 220 adjusts the size of the request buffer 230 so that a task is not crowded to a specific thread, and returns control to allow the main thread 210 to do more work when there is no work content.

The operation of the main thread 210 and the loading thread 220 will be described in more detail. First, the main thread 210 displays a request queue (each frame) in the preloading list of the scene tree. 212).

In this case, the images added to the request queue 212 should include a loading priority, but are not related to the order in which they are added to the request queue 212.

The size of the request buffer 230 is set by a predetermined size irrespective of the size of the request queue 212 for use as a synchronization variable for integrity between the main thread 210 and the loading thread 220.

In particular, the size of the request buffer 230 may be determined in consideration of the processing period of the loading thread 220 during the update period of the main thread 210.

The request buffer 230 is a variable used by the main thread 210 and the loading thread 220 to perform mutex synchronization with the loading thread 220.

The main thread 210 fills the request buffer 230 in the request queue 212 once per frame, and after the priority sorting of the request queue 212, the request buffer 230 by the size of the request buffer 230. And empty the request queue 212.

The loading thread 220 performs mutex synchronization of the request buffer 230 at every work cycle to determine the loading image.

At this time, the loading image is completed by the image loader 221.

The loading thread 220 adds the loading image to the preliminary buffer 240 to the same size as the request buffer 230 in order to make the loaded loading image into a hardware processable texture.

In this case, every loading image of the preliminary buffer 240 adds a surface id generated by the surface marker 213 to the image cache 211 at each update period of the main thread 210.

Embodiments of the present invention provide a synchronization function of the main thread 210 and a service function of the loading thread 220 to ensure the integrity of the request buffer 230 and the preliminary buffer 240, which are shared variables of a loader using multi-threads. It can only be interfaced through, and callback functions can be used for shared variable mutex synchronization and thread loader extensions.

The operation structure of the multithreaded image processing technique according to the embodiments of the present invention has been described above with reference to FIG. 2.

Hereinafter, a preloading based image processing apparatus and asynchronous loading based image processing apparatus and method according to embodiments of the present invention will be described in detail with reference to FIGS. 3 to 6.

3 is a diagram illustrating a structure of a preloading based image processing apparatus according to an embodiment of the present invention.

Referring to FIG. 3, the preloading based image processing apparatus 310 includes a loading unit 311 and a rendering unit 312.

The loading unit 311 loads data on an image to be displayed.

The rendering unit 312 renders the image based on the data on which the loading is completed, when data loading of the image is completed.

In this case, while the rendering unit 312 renders the image, the loading unit 311 loads data for another image in which loading is not completed.

According to an embodiment of the present invention, the loading unit 311 may perform data loading on the other image in the background.

In addition, according to an embodiment of the present invention, the rendering unit 312 may manage the scene tree by using the selected resource, and receive the data from the loading unit 311 to update the scene tree. have.

In this case, the rendering unit 312 may request the loading unit 311 to load data for the other image based on the scene tree.

In this case, the loading unit 311 may load data for the other image and transmit the data for the other image to the rendering unit 312 according to a request of the rendering unit 312.

4 is a diagram illustrating a structure of an asynchronous loading-based image processing apparatus according to an embodiment of the present invention.

Referring to FIG. 4, the asynchronous loading-based image processing apparatus 410 includes a layer separator 411, a loading unit 412, and a rendering unit 413.

The hierarchical separator 411 divides data about an image to be displayed into a selected hierarchical layer.

The loading unit 412 sequentially loads data divided into the selected layer.

The rendering unit 413 renders the images sequentially based on the loading completion order of the data divided into the selected layer.

In this case, the loading unit 412 loads the data of the lower priority layer while the rendering unit 413 performs the rendering based on the data of the priority layer.

According to an embodiment of the present invention, the loading unit 412 may perform the loading of the data of the subordinate layer in the background.

In addition, according to an embodiment of the present invention, the hierarchical separator 411 may classify the hierarchical layer of data for the image in order of low resolution to high resolution based on the resolution of the image.

In this case, the rendering unit 413 may render the image in the order of low resolution to high resolution based on the loading completion order of the data divided based on the height of the resolution.

5 is a flowchart illustrating a preloading based image processing method according to an embodiment of the present invention.

In operation S510, data about an image to be displayed is loaded.

In step S520, when the data loading for the image is completed, the image is rendered based on the loaded data.

In step S530, while the image is rendered, data for another image that is not loaded is loaded.

According to an embodiment of the present invention, in step S530, data loading of the other image may be performed in the background.

In step S540, when the data loading for the other image is completed, the other image is rendered based on the data for the other image.

The preloading-based image processing method according to an embodiment of the present invention may further include managing a scene tree by using a resource selected before operation S510.

In this case, the preloading-based image processing method may further include updating data of the scene tree by receiving data on the loaded image after step S510.

In addition, the preloading-based image processing method may further include requesting data loading of the other image based on the scene tree after step S510.

In this case, step S530 may load data for the other image in response to the request.

6 is a flowchart illustrating an asynchronous loading-based image processing method according to an embodiment of the present invention.

In operation S610, data about an image to be displayed is classified into a selected layer.

In this case, according to an embodiment of the present invention, in step S610, the hierarchical layer of data for the image may be classified in order of low resolution to high resolution based on the resolution of the image.

In operation S620, data of a priority layer is loaded among data divided into the selected layer.

In operation S630, when data of the priority layer is loaded, an image corresponding to the data of the priority layer is rendered based on the data of the priority layer.

In operation S640, while the image corresponding to the data of the priority layer is rendered, the data of the lower priority layer is not loaded.

At this time, according to an embodiment of the present invention, in step S640, the loading of the data of the subordinate layer may be performed in the background.

In step S650, when the data of the subordinate layer is finished loading, the image corresponding to the data of the subordinate layer is rendered based on the data of the subordinate layer.

Embodiments according to the present invention can be implemented in the form of program instructions that can be executed by various computer means can be recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

As described above, the present invention has been described by specific embodiments such as specific components and the like. For those skilled in the art to which the present invention pertains, various modifications and variations are possible.

Therefore, the spirit of the present invention should not be limited to the described embodiments, and all of the equivalents or equivalents of the claims as well as the claims to be described later will belong to the scope of the present invention. .

210: main thread
211: Image Cache 212: Request Queue 213: Surface Markers
220: loading thread
221 image loader
230: request buffer 240: spare buffer
310: preloading based image processing device
311: loading unit 312: rendering unit
410: asynchronous loading based image processing apparatus
411: layer division unit 412: loading unit 413: rendering unit

Claims (16)

A loading unit loading data of an image to be displayed; And
When the data loading for the image is completed, the rendering unit for rendering the image on the basis of the loading data is completed (rendering)
Including,
The loading unit is a pre-loading image processing apparatus for loading data for another image that is not finished loading while the rendering unit renders the image. The method of claim 1,
The loading unit
A preloading based image processing apparatus for performing data loading on the other image in the background. The method of claim 1,
The renderer
A preloading-based image processing apparatus for managing a scene tree by using a predetermined resource, and updating the scene tree by receiving the loaded data from the loading unit. The method of claim 3,
The renderer
Request a loading unit to load data for the other image based on the scene tree,
The loading unit loads data for the other image according to a request of the rendering unit and transfers the data to the rendering unit. A hierarchical dividing unit dividing data about an image to be displayed into a predetermined layer;
A loading unit which sequentially loads data divided into the selected layer; And
A rendering unit that renders the image sequentially based on the loading completion order of the data divided into the selected layer.
Including,
The loading unit is an asynchronous loading-based image processing apparatus for loading the data of the lower priority layer, the loading is not completed while the rendering unit performs the rendering based on the data of the priority layer. The method of claim 5,
The loading unit
The asynchronous loading-based image processing device for loading the data of the subordinate layer in the background. The method of claim 5,
The layer division unit
An asynchronous loading-based image processing apparatus for dividing a layer of data for the image from low resolution to high resolution based on the resolution of the image. The method of claim 7, wherein
The renderer
And rendering the image in the order of low resolution to high resolution based on the loading completion order of the data divided based on the height of the resolution. Loading data for an image to be displayed;
Rendering the image based on the data on which the loading is completed, when data loading for the image is completed;
While the image is being rendered, loading data for another image that has not been loaded; And
Rendering the other image based on data for the other image when data loading for the other image is completed
Preloading based image processing method comprising a. 10. The method of claim 9,
Loading data for the other image
The preloading-based image processing method of performing data loading on the other image in the background. 10. The method of claim 9,
Managing a scene tree by utilizing a predetermined resource; And
Updating the scene tree by receiving data on the loaded image
A preloading based image processing method further comprising. The method of claim 11,
Requesting loading of data for the other image based on the scene tree
Further comprising:
The loading of data for the other image may include loading data for the other image in response to the request. Dividing data for an image to be displayed into a predetermined layer;
Loading data of a priority layer among data divided into the selected layer;
When the data of the priority layer is loaded, rendering an image corresponding to the data of the priority layer based on the data of the priority layer;
Loading data of a lower priority layer while the image corresponding to the data of the priority layer is being rendered; And
When the data of the lower priority layer is finished loading, rendering an image corresponding to the data of the lower priority layer based on the data of the lower priority layer.
Asynchronous loading-based image processing method comprising a. The method of claim 13,
Loading the data of the subordinate layer is
Asynchronous loading-based image processing method for performing the loading of the data of the subordinate layer in the background. The method of claim 13,
The step of dividing into the selected layer is
Asynchronous loading-based image processing method for classifying the data of the image layer based on the resolution of the image in order from low resolution to high resolution. A computer-readable recording medium having recorded thereon a program for performing the method of any one of claims 9 to 15.

Images