KR20170026735A - Method and system for image processing - Google Patents

Method and system for image processing Download PDF

Info

Publication number
KR20170026735A
KR20170026735A KR1020150120829A KR20150120829A KR20170026735A KR 20170026735 A KR20170026735 A KR 20170026735A KR 1020150120829 A KR1020150120829 A KR 1020150120829A KR 20150120829 A KR20150120829 A KR 20150120829A KR 20170026735 A KR20170026735 A KR 20170026735A
Authority
KR
South Korea
Prior art keywords
thumbnail
image
processing system
image processing
displayed
Prior art date
Application number
KR1020150120829A
Other languages
Korean (ko)
Inventor
위영철
양성진
Original Assignee
주식회사 큐램
주식회사 핀그램
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 큐램, 주식회사 핀그램 filed Critical 주식회사 큐램
Priority to KR1020150120829A priority Critical patent/KR20170026735A/en
Publication of KR20170026735A publication Critical patent/KR20170026735A/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
    • H04N1/32149—Methods relating to embedding, encoding, decoding, detection or retrieval operations
    • H04N1/32267—Methods relating to embedding, encoding, decoding, detection or retrieval operations combined with processing of the image
    • H04N1/32277—Compression
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N2201/3201—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3225—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document
    • H04N2201/325—Modified version of the image, e.g. part of the image, image reduced in size or resolution, thumbnail or screennail

Abstract

The present invention provides an image processing method and a system therefor. The image processing method comprises the following steps of: allowing an image processing system installed in a data processing system to generate a first thumbnail corresponding to an original image based on the original image in response to an image display request; performing decoding for displaying the first thumbnail generated by the image processing system; and allowing the image processing system to display the decoded first thumbnail on the data processing system. The step of performing decoding for displaying the first thumbnail includes a step of allowing the image processing system to generate region information corresponding to the first thumbnail, wherein the region information indicates a location of each of a plurality of regions constituting the first thumbnail.

Description

[0001] The present invention relates to a method and system for image processing,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing method and system thereof, and more particularly, to an image processing method and system capable of performing efficient region decoding and / or efficient thumbnail utilization.

High quality images are widely used in data processing systems (e.g., mobile phones, tablets, PCs, web servers, etc.) due to the high image quality of the image photographing means.

Due to the high image quality of images, thumbnail and region decoding are actively utilized.

A thumbnail is an image generated by reducing an original image to a small size image, and is often used for displaying the thumbnail instead of displaying the original image itself.

In the past, mainly, an image list or the like is mainly used for intuitively grasping an image of an original image. In recent years, however, a thumbnail previously created for a time required for decoding and displaying a high- And a method for providing a real-time property to a user environment by scaling and displaying a certain ratio. In addition, in order to utilize various kinds of thumbnails, thumbnails of various sizes such as a small thumbnail, a medium thumbnail, and a large thumbnail are utilized according to circumstances.

On the other hand, region decoding is widely used due to the need to decode only a part of the image. To be able to decode such a region, it is necessary to divide the image into a certain region (region) and to selectively decode only a specific region or regions based on the divided region, from the original image. For this purpose, region information (or region map) may be required, and region decoding using such region information is widely used for various image or video decoding.

In particular, such region decoding is widely used when a user wants to zoom in a specific area of an image desired by the user. That is, when the user selects a specific region of the desired image and requests zooming, the image solution can selectively or preferentially decode the specific region in the original image, thereby zooming the specific region to another region It is necessary to provide the region information in order to distinguish it from the region information.

Also, such region decoding is often occurring even when a thumbnail is displayed. For example, if the original image stored in the user's data processing system is of high quality or large size, the image solution may display a suitable thumbnail (e.g., a large thumbnail) corresponding to the original image. When the zoom request is input in a state that the thumbnail is displayed, a certain area of the original image requested to be zoomed is decoded to display the zoomed image. At this time, the region information of the original image is needed to determine a certain area of the original image requested to be zoomed.

1 is a diagram for explaining a conventional region decoding.

First, as shown in FIG. 1A, in response to a display request for a predetermined image, a conventional image solution may decode and display the image itself, and may display a thumbnail image corresponding to the image (S10 ). Then, the user can select a specific area for the original or thumbnail image of the displayed image, and then input a zoom request (S11). Then, the image solution can perform zone decoding by performing region decoding to preferentially or selectively decode the specific region (S13). For this, the region information of the original image is required as described above. Accordingly, when the zoom request is input, the image solution generates region information through an inverse encoding process (e.g., Hoffman decoding) with respect to the original of the image (S12) and performs zooming (S13).

The region information is divided into a plurality of regions (for example, 11, 12, 13, 14, etc.) having a predetermined size, as shown in FIG. 1B, (For example, 12-1, 13-1, 14-1, etc.). For example, the region information may be the position of the leftmost pixels of each region as shown in FIG. 1B, but various embodiments may be possible.

Conventionally, after a source image or a thumbnail image is displayed, if a process requiring region decoding is requested, the image solution can generate region information of the original image and perform region decoding after the region information is generated. Therefore, in the conventional image solutions, for example, zooming is performed after a slight interval (time for generating the region information) occurs when the user makes a zoom request, and the usability of the user is deteriorated. That is, conventionally, when a request to perform region decoding (e.g., a zoom request) is inputted after the original image or the thumbnail image is displayed, the process of generating the region information for region decoding is performed only at that time.

In addition, when a thumbnail image is to be generated and displayed in real time or when zooming (zooming) from a thumbnail image is to be performed, conventionally, regions of the original image corresponding to the thumbnail image are sequentially decoded and uploaded to the graphic engine , The region to be included in the zoom image is sequentially uploaded to the graphic engine from a predetermined region (for example, the upper left region) to display the zoom image after zooming is performed. Accordingly, in the case of a high-quality image, a state in which the regions are sequentially blurred (for example, a state in which another thumbnail image is being displayed or an image before zooming is displayed) A state in which the region is decoded and displayed or a region of the zoom image is displayed) is visually confirmed.

1020090056107 "Mobile terminal and its digital image processing method" 1020090115344 "Mobile terminal and image processing method thereof"

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to provide a method and apparatus for displaying a source image or a thumbnail image by generating region information of an original image in order to display the source image or decoding a source image in order to generate a thumbnail image, And a region decoding can be performed in a state in which a source image is displayed in a state where a source image is displayed or a region in which a thumbnail image is displayed, and a system therefor.

Also, when a thumbnail image is uploaded to the graphic engine, image processing that can upload multiple or all regions to the graphic engine at once without uploading it sequentially to the graphic engine by region (region or tile) included in the thumbnail image And a system therefor.

It is another object of the present invention to provide an image processing method and system that can sequentially display an area to be included in a zoom image in a zooming process from an area recognized by a user in priority.

Further, it is an object of the present invention to provide an image processing method and system that can increase usability when a small thumbnail is displayed as an original ratio (original image ratio).

According to another aspect of the present invention, there is provided an image processing method, comprising the steps of: decoding an original image when an image processing system installed in a data processing system determines to display an original image or a first thumbnail in response to an image display request; And displaying the decoded original image or a first thumbnail corresponding to the original image on the data processing system after the image processing system decodes the original image, The decoding of the original image may include decoding region information corresponding to the original image while the image processing system decodes the original image, wherein the region information includes information indicating the position of each of the plurality of regions constituting the original image Generating a < RTI ID = 0.0 > .

The image processing method may further include the step of the image processing system generating and storing a second thumbnail corresponding to the original image in advance, wherein the first thumbnail is a large thumbnail or a medium thumbnail, Wherein the second thumbnail is a small thumbnail, and the image processing system selectively displays the second thumbnail or the first thumbnail, and when the second thumbnail is displayed, When the first thumbnail is displayed, the first thumbnail is generated by decoding the original image, and then the first thumbnail is displayed.

Wherein the image processing method further comprises the step of sequentially decoding a plurality of tiles to be included in the first thumbnail and storing the decoded textures in a storage device provided in the data processing system, Wherein the step of decoding the original image and then generating the decoded original image or a first thumbnail corresponding to the original image and displaying the generated first thumbnail on the data processing system, And loading the textures into the graphics engine at one time.

Wherein the image processing method further comprises the step of displaying a second thumbnail corresponding to the original image and stored in advance and displaying the first thumbnail after displaying the second thumbnail, And loading the texture of the plurality of tiles stored in the apparatus into the graphic engine at a time.

The image processing method comprising the steps of: receiving a zoom request for a specific area of the first thumbnail displayed by the image processing system; zooming based on the region information generated in response to the received zoom request .

The step of performing zooming based on the region information previously generated in response to the received zoom request may include the steps of preferentially decoding and displaying a reference area from a zoom image to be displayed after zooming in response to the zoom request, And decoded and displayed sequentially from nearest to nearest reference area.

And the reference region is a region corresponding to a center of the specific region.

Wherein the image processing method further comprises generating and storing the second thumbnail at an original ratio corresponding to the original image, and when the image processing system displays the second thumbnail at a grid view ratio The second thumbnail may be cropped by the grid view ratio and displayed, and the second thumbnail may be displayed when the second thumbnail is displayed in an original ratio.

According to an aspect of the present invention, there is provided an image processing method for an image processing system, the method comprising: displaying a second thumbnail corresponding to an original image; displaying the second thumbnail, Sequentially decoding a plurality of tiles to be included in the first thumbnail and storing the decoded tiles in a storage device provided in the data processing system to display the texture of the plurality of tiles stored in the storage device at once, And loading the engine.

According to another aspect of the present invention, there is provided an image processing method for an image processing system, the method comprising: receiving a zoom request for a specific region of an image displayed in a data processing system; Preferentially decoding and displaying a predetermined reference area located at a central portion of the zoom image, and decoding and displaying another area of the zoom image sequentially in order from the reference area in a close order.

According to an aspect of the present invention, there is provided an image processing method for an image processing system, the image processing system comprising: generating a thumbnail corresponding to an original image in advance at an original ratio and storing the thumbnail in a data processing system; The second thumbnail is cropped by the grid view ratio and displayed, and when the display is performed in the aspect ratio, the thumbnail is displayed.

The image processing method may be implemented by a computer program installed in the data processing system.

According to an aspect of the present invention, there is provided an image processing system including a thumbnail generating module for generating a first thumbnail corresponding to an original image based on an original image in response to an image display request, And a control module for displaying the decoded first thumbnail on a data processing system in which the image processing system is installed, wherein the decoding module generates the first thumbnail corresponding to the original image And the region information is information indicating a position of each of a plurality of regions constituting the original image.

Wherein the thumbnail generation module stores a second thumbnail corresponding to the original image, wherein the first thumbnail is a large thumbnail and the second thumbnail is a small thumbnail or medium, Wherein the control module displays the second thumbnail stored in advance when displaying the second thumbnail and displays the second thumbnail when the first thumbnail is displayed, And display the first thumbnail.

The decoding module sequentially decodes a plurality of tiles to be included in the generated first thumbnail and stores decoded textures in a storage device provided in the data processing system, and the control module stores the textures stored in the storage device And loading the graphics engine at one time.

Wherein the image processing system further comprises an interface module for receiving a zoom request for a specific area of the displayed first thumbnail, wherein the control module controls zooming based on the previously generated region information in response to the received zoom request, Can be performed.

An image processing system for solving the above-mentioned technical problems is provided with an interface module for receiving a zoom request for a specific area of an image displayed on a data manipulation device, and an interface module for receiving, from the zoom image to be displayed after zooming in response to the received zoom request, And a control module for decoding and displaying a predetermined reference area located at the center of the image and then decoding and displaying the other area of the zoom image sequentially from the reference area in order of closeness.

According to an aspect of the present invention, there is provided an image processing system comprising: a thumbnail generating module for generating thumbnails corresponding to original images in advance at an original ratio and storing the thumbnails in a data processing system; And a control module for cropping and displaying the second thumbnail at the grid view ratio, and displaying the thumbnail when displaying in the aspect ratio.

According to the technical idea of the present invention, when a thumbnail image is generated in real time from an original image and displayed, or when an original image itself is displayed, a region of the original image is decoded before a request of a user, Information can be generated so that immediate region decoding can be performed.

Also, when a thumbnail image is uploaded to a graphics engine, multiple or all regions can be uploaded to the graphics engine at one time, without uploading to the graphics engine sequentially by region (region or tile) included in the thumbnail image, It is possible to prevent a visual effect such as an image being sequentially cleared so that usability can be enhanced and the overall display time can be accelerated.

In addition, zooming can be performed so that the user does not feel discomfort visible to the user by sequentially displaying the area to be included in the zoom image at the time of zooming from the area that is preferentially recognized by the user.

In addition, by generating a small thumbnail at an original ratio, there is an effect that efficient display can be performed when a small thumbnail is to be displayed in both an original ratio and a grid ratio.

BRIEF DESCRIPTION OF THE DRAWINGS A brief description of each drawing is provided to more fully understand the drawings recited in the description of the invention.
1 is a diagram for explaining a conventional region decoding.
2 is a diagram showing a schematic configuration of an image processing system according to the technical idea of the present invention.
3 is a schematic view for explaining an image processing method according to the technical idea of the present invention.
4 is a view for explaining an environment in which a thumbnail image is displayed according to an embodiment of the present invention.
5 is a diagram illustrating a method of uploading an image to a graphic engine according to an image processing method according to an embodiment of the present invention.
6 is a view for explaining a method for performing zooming according to an image processing method according to an embodiment of the present invention.
7 is a diagram for explaining wstn (wide_small_thumbnail) according to an embodiment of the present invention.

In order to fully understand the present invention, operational advantages of the present invention, and objects achieved by the practice of the present invention, reference should be made to the accompanying drawings and the accompanying drawings which illustrate preferred embodiments of the present invention.

Also, in this specification, when any one element 'transmits' data to another element, the element may transmit the data directly to the other element, or may be transmitted through at least one other element And may transmit the data to the other component.

Conversely, when one element 'directly transmits' data to another element, it means that the data is transmitted to the other element without passing through another element in the element.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, the present invention will be described in detail with reference to the preferred embodiments of the present invention with reference to the accompanying drawings. Like reference symbols in the drawings denote like elements.

2 is a diagram showing a schematic configuration of an image processing system according to the technical idea of the present invention.

Referring to FIG. 2, the image processing system 100 according to the technical idea of the present invention includes a control module 110, a thumbnail generation module 120, and a decoding module 130. The image processing system 100 may further include an interface module 140.

In this specification, the term 'module' may mean a functional and structural combination of hardware for carrying out the technical idea of the present invention and software for driving the hardware. For example, the 'module' may mean a logical unit of a predetermined code and a hardware resource for the predetermined code to be executed, and may be a code physically connected to the module, or a kind of hardware Or may be easily deduced to the average expert in the field of the present invention.

According to an embodiment, the image processing system 100 may not be any one physical device but may be distributed over a plurality of physical devices. If necessary, when each of the configurations included in the image processing system 100 is implemented as independent physical devices, these physical devices may be organically combined through a wired / wireless network so that the image Decoding system 100 as described above.

The control module 110 may control the functions of other configurations of the image processing system 100 (e.g., the thumbnail generation module 120, the decoding module 130, and / or the interface module 140, etc.) and / Can be controlled.

The image processing system 100 may be installed in a predetermined data processing system to implement operations and / or functions according to the technical idea of the present invention. To this end, the image processing system 100 may include a software (computer program, image solution) for implementing the operations and / or functions of the image processing system 100 and a system in which the hardware of the data processing system is implemented organically combined . ≪ / RTI >

The data processing system may be implemented in various hardware, for example, a mobile phone, a tablet, a computer, a server, and the like, in which data processing capability capable of implementing the technical idea of the present invention exists. According to an example, the data processing system may mean a device in which a plurality of physical devices are implemented by being organically combined through a wired / wireless network.

The image processing system 100 may generate a thumbnail corresponding to the original image stored in the data processing system. The image processing system 100 may generate a predetermined thumbnail in advance before the thumbnail needs to be displayed. In addition, the image processing system 100 may generate and display a thumbnail from the original image in real time when a thumbnail needs to be displayed. The image processing system 100 may be a system using at least two types of thumbnails. Any one kind of thumbnail may be a thumbnail that is generated in advance when the image processing system 100 acquires the original image. The thumbnail to be generated in advance may be a small thumbnail or a medium thumbnail. Another kind of thumbnail may be a thumbnail that the image processing system 100 generates from the original image, in real time, if the display of the thumbnail is needed. Such a case may be a thumbnail having a large capacity (size) and consuming a large amount of resources in advance, and may be a large thumbnail or a medium thumbnail. In the case of a medium thumbnail, it may be created and stored in advance according to an implementation example, or may be created and used in real time, such as a large thumbnail. The generation of such a thumbnail may be performed by the thumbnail generation module 120 included in the image processing system 100. [ Since various prior arts are known as to how the thumbnail generating module 120 generates thumbnails, a detailed description will be omitted.

In any case, in this specification, a thumbnail generated from the original image in real time for image display may be a first thumbnail, and a thumbnail previously generated and stored by the image processing system 100 may be a second thumbnail. Of course, depending on the implementation, the first thumbnail may also be generated and stored by the image processing system 100 in advance. The first thumbnail may be a display size of the data processing system, and the second thumbnail may be an image having a capacity and / or size smaller than the first thumbnail.

In this specification, the term " displaying a thumbnail " may be defined to include not only displaying a thumbnail as it is, but also including scaling and displaying a thumbnail as necessary.

As is well known, the image processing system 100 adaptively selects a small thumbnail, a medium thumbnail, or a large thumbnail corresponding to a specific original image according to the time interval of the input request of the user or the type of the input request . For example, if a fast response (display) is required, the previously stored second thumbnail may be displayed as it is or scaled at a predetermined rate, and if not, a first thumbnail may be generated and displayed. In some cases, the original image itself may be decoded and displayed. Depending on the implementation, the second thumbnail may be preferentially displayed and then the first thumbnail may be displayed again to increase the immediacy of the response.

For example, as shown in FIG. 4, the image processing system 100 may display a predetermined image in a data processing system, wherein the displayed image is a small thumbnail (e.g., stn_img1), a medium thumbnail (mtn_img1), or a large thumbnail (ltn_img1). Or the original image itself. If the user wishes to sequentially view a plurality of images (e.g., img1, img2, img3, etc.) while sweeping at a high speed, (E.g., stn_img1, stn_img2, stn_img3, etc.) of each of a plurality of images (e.g., img1, img2, img3, etc.) Lt; / RTI > At this time, the image processing system 100 can selectively display a thumbnail corresponding to the original image, instead of displaying the original image of each of the sequentially selected images. For example, a second thumbnail (e.g., a small thumbnail or a medium thumbnail) may be displayed as it is or scaled prior to displaying at a high speed or in response to a request (e.g., swipe) (E.g., a large thumbnail) of the specific image corresponding to the specific image (for example, when the sweeping is stopped). The control module 110 included in the image processing system 100 thus adaptively determines whether to display the original image itself, the thumbnail, what thumbnail to display, how to display the selected thumbnail, Other configurations included in the image processing system 100 may be controlled to perform appropriate image processing (e.g., scaling, zooming, region decoding).

And, after the first thumbnail is displayed (or after the original image is displayed), the user typically performs a request (e.g., zoom request) for region decoding (e.g., zooming). In this case, conventionally, as described in Fig. 1, conventionally, after the first thumbnail is displayed (or after the original image is displayed), the region information of the original image has to be generated in order to process the request. However, in order to generate the region information, the decoding process of the original image, in particular, the decoding process of the encoded original image (e.g., reverse Hoffman decoding), must be performed. After the region information is generated through the inverse encoding process, the request can be performed.

In order to solve such a problem, the decoding module 130 included in the image processing system 100 performs the decoding of the original image in order to display the first thumbnail or the original image, Information can be generated. That is, instead of generating the region information in response to a predetermined request (for example, a zoom request) after the display of the original image or the first thumbnail as in the prior art, it is possible to display the original image or to generate the first thumbnail In the process of decoding the original image, the region information may be generated.

In this case, conventionally, the display is performed after the inverse processing for the display of the first thumbnail or the original image, and when the request is inputted, the reverse image of the original image is again processed to generate the region information again. According to the technical idea of the present invention, since the region information is generated in advance through the inverse encoding process for the display of the first thumbnail or the original image, it is possible to avoid the repetitive inverse encoding process. Thus, even though the time for displaying the original image or the first thumbnail may be slightly increased, there is an effect that immediate region decoding can be performed.

According to an embodiment, the first thumbnail is generated in advance, and the image processing system 100 can determine to display the first thumbnail. In this case, since the first thumbnail is generated in advance, it is not necessary to generate the region information at the time of decoding the original image, which is performed in the process of generating the first thumbnail, When stopping while pinging, or when stopping while moving a displayed first thumbnail, etc.), that is, before the request in which region decoding is performed is inputted, the region information may be generated.

For example, the image processing system 100 may sweep a plurality of images in succession and then stop sweeping in a particular image. The image processing system 100 may display the first thumbnail generated and stored in advance. In this case, the image processing system 100 can generate the region information of the original image corresponding to the first thumbnail even before a request (for example, a zoom request) for performing region decoding is input through the first thumbnail have. That is, there is a small possibility that a request (for example, a zoom request) in which zone decoding is performed is input during the sweeping operation. However, in the case where the sweeping operation is stopped, Can be relatively high. Therefore, when the sweeping operation is stopped, the image processing system 100 can generate the region information of the original image corresponding to the first thumbnail in advance.

For example, the image processing system 100 may display a first generated thumbnail, and then perform an operation of moving an image according to a user's input. While moving the image like this, it is unlikely that a request to perform region decoding (e.g., a zoom request) is input. Then, when the operation of moving the image stops, the image processing system 100 may generate the region information of the original image corresponding to the image being displayed in advance.

In addition, in a state where the second thumbnail is displayed, a request to perform region decoding is generally not input. Therefore, the control module 110 included in the image processing system 100 may display a first thumbnail The decoding module 130 may control the decoding module 130 to generate the region information corresponding to the original image in the decoding process for displaying the first thumbnail. If the second thumbnail is to be displayed, And directly decode and display the stored second thumbnail. This process will be described with reference to FIG.

3 is a schematic view for explaining an image processing method according to the technical idea of the present invention.

Referring to FIGS. 2 and 3, the image processing system 100 may receive a user request through the data processing system (S100). The user request may be as described above, such as a request to display a particular image, a request to select another image, and so on. This user request may be received by the interface module 140 included in the image processing system 100.

The control module 110 included in the image processing system 100 may then determine in response to the user request whether to display the original image or thumbnail corresponding to the image to be displayed and / or to display some thumbnail (S110). If it is determined that a second thumbnail should be displayed (e.g., a fast response is required), the control module 110 may display a second thumbnail (S160). To this end, the control module 110 may decode a second thumbnail stored in advance in the data processing system and upload the decoded texture to a graphics engine (e.g., an OpenGL engine 200). Then, the graphic engine can display an image corresponding to the uploaded texture on a display device provided in the data processing system.

If the control module 110 determines to display the first thumbnail (e.g., the first thumbnail, which is an image that is clearer because the user has no additional action in the state where the second thumbnail is displayed) If the control module 110 determines to display the image (S110), the control module 110 may generate the first thumbnail (e.g., a large thumbnail) based on the original image through the thumbnail generation module 120. [ In order to generate the first thumbnail, the decoding module 130 must decode the original image. In this process, the control module 110 controls the decoding module 130 to generate the region information corresponding to the original image (S120). After the first thumbnail is generated, the control module 110 generates the first thumbnail (e.g., a large thumbnail) by uploading the decoded texture of the first thumbnail (e.g., a large thumbnail) (S130).

Of course, even when the control module 110 determines to display an original image, the control module 110 must decode the original image and generate the region information while decoding the original image.

As a result, the control module 110 may decode the original image before the request (e.g., a zoom request) that requires generation of the region information is input from the user, whether the original image is displayed or the first thumbnail is displayed, You can create region information for an image.

Then, after the original image or the first thumbnail (e.g., a large thumbnail) is displayed, if the zoom request is received from the user (S140), the region information can be immediately used, (S150). Of course, in the case where a request to perform region decoding is not input, the previously generated region information may not be used. However, since the region information is generated in the decoding process for displaying the original image or the first thumbnail (e.g., a large thumbnail) anyway, when region decoding is performed with only a little additional process, it is possible to perform region decoding ) Can be performed.

Meanwhile, in the process of displaying the first thumbnail (S130), the control module 110 sequentially displays the tiles included in the first thumbnail. The tile may be the same as the region according to an embodiment, and a plurality of regions may form a single tile. In any case, conventionally, the tiles are sequentially decoded and uploaded to the graphic engine 200, so that tiles sequentially included in the first thumbnail are displayed in a clear manner. However, in such a case, there is redundancy due to the uploading of the repetitive graphic engine 200, and the user can visually confirm that the image is blurry and clear for each tile, so that the user feels that the decoding speed is slow There is a problem that it is given or the usability is deteriorated.

The technical idea for solving such a problem will be described with reference to Fig.

5 is a diagram illustrating a method of uploading an image to a graphic engine according to an image processing method according to an embodiment of the present invention.

FIG. 5A schematically shows a process of displaying a first thumbnail, and FIG. 5B is a diagram for explaining a change of an image displayed on the data processing system 1000 according to 5a.

As shown in FIG. 5B, the data processing system may be a state in which the second thumbnail 20 is displayed as it is or scaled, and a blurred image may be displayed.

The conventional image processing system may then decode the first region (e.g., 21) of the first thumbnail to display the first thumbnail (S20). Although FIG. 5 shows an example in which a unit tile uploaded to the graphic engine 200 by a conventional image processing system is the same as the above-described region, it is needless to say that a plurality of regions may be one tile.

The conventional image processing system can upload the texture of the first region (e.g., 21) obtained as the decoded result to the graphics engine (S21). Then, the 12th region (e.g., 21) where the second thumbnail was displayed may be displayed based on the first thumbnail so that the cleared image (e.g., an image with high resolution) can be displayed.

The conventional image processing system may repeatedly perform operations to decode and upload the following regions (for example, 22, 23, 24) sequentially to the graphic engine until no other region exists (S22, 23, 24). Each of the regions (e.g., 22, 23, 24, etc.) of the image 20 being displayed in the data processing system 1000 may then be replaced with an image that is sequentially cleared. That is, the image corresponding to each of the regions (for example, 21, 22, 23, and 24) is sequentially obtained from the image obtained from the second thumbnail, the image obtained from the first thumbnail including more information than the second thumbnail Can be replaced. In this case, the user can recognize that the image displayed on the data processing system 1000 sequentially changes in a clear manner.

Therefore, the image processing system 100 according to the technical idea of the present invention does not upload sequentially to the graphic engine 200 for each tile as shown in FIG. 5C, but to a plurality of tiles (e.g., a first thumbnail The entire tiles included) can be uploaded to the graphic engine 200 at one time, thereby reducing the process of repeatedly uploading to the graphic engine 200 while solving this problem.

Referring to FIG. 5C, the control module 110 may control the decoding module 130 to decode the first tile (e.g., region 21) of the first thumbnail (S200). The resulting texture may be stored in a predetermined storage device (e.g., a memory device included in the data processing system 1000) (S210). In addition, it is possible to repeatedly perform tile-based decoding and texture storage repeatedly until there are no remaining tiles (S220, S230). If a texture is created and stored for all the tiles, the control module 110 may upload the tiles to the graphic engine 200 at a time (S240). Then, for example, multiple (or all) tiles (e.g., 21, 22, 23, 24) can be replaced with a clear image at a time in a situation where a second thumbnail is being displayed have. In this case, the time for clearing any one tile (e.g., 21) may be longer, but the time for all tiles to be cleared may be shortened and the user may not suffer the inconvenience of sequentially clearing the image .

On the other hand, after the first thumbnail is displayed, the user can input a predetermined request requiring region decoding (e.g., zooming). In this case, as described above, the image processing system 100 does not generate the region information after the request is input, but uses the region information generated in the decoding process of the original image for displaying the first thumbnail, The zooming can be performed as described above.

Meanwhile, in order to perform zooming, it is necessary to decode and display a zoomed image (i.e., an image in which zooming is performed) from the original image. At this time, it is necessary to decode and display each area included in the zoomed image from the original image. In this case, conventionally, each tile to be included in the enlarged image, that is, the zoom image, is sequentially decoded and displayed from a predetermined area or tile (e.g., from the uppermost left side) of the zoom image. And the predetermined area is a predetermined area irrespective of the characteristic of the zoom. Therefore, in this case as well, in order to clear the zoom image as a whole (i.e., each tile to be included in the zoom image is decoded and displayed from the original image), as described in FIG. 5, It was canceled. However, according to the technical idea of the present invention, when performing zooming, the decoding and display order of the tiles included in the zoom image is controlled, thereby providing a technical idea for increasing the speed at which the user perceives the decoding visually. This technical idea will be described with reference to FIG.

6 is a view for explaining a method for performing zooming according to an image processing method according to an embodiment of the present invention.

Referring to FIG. 6, in a state where the first thumbnail 30 is displayed as shown in FIG. 6A, the user can input a zoom request for a predetermined area (for example, 31). It goes without saying that the zoom request may further include information such as a zoom ratio.

A zoom image corresponding to the area (e.g., 31) may then be displayed in the data processing system 1000, as shown in FIG. 6B. The conventional image processing system then specifies a zoom image (e.g., 32) to be displayed after zooming on the basis of the zoom request, and specifies each tile to be included in the specified zoom image, for example, And sequentially decoded and displayed. In this case, conventionally, the zoom image 32 is cleared in the order of, for example, tiles j, k, l, m, i, b, c, n, h, a, d, o, g, f, (I.e., decoding and displaying the corresponding tile from the original image). In this case, as shown in FIG. 5, the user can recognize that the tiles are sequentially cleared in a visible manner. In such a case, there is a problem of inconvenience or deterioration of usability due to a decrease in bodily sensation speed of decoding.

However, according to the technical idea of the present invention, the control module 110 can decode a predetermined tile (area) at the center of the zoom image 32 and select it as a tile to be displayed. For example, the control module 110 may select one of the tiles a, b, c, or d as the reference area in FIG. 6B.

And perform decoding and display in the order of the reference area to the nearest area (tile). For example, when the reference area is selected as a tile a, the control module 110 first decodes and displays a, and b, c, d, e, f, g, h, i, j, m, n, o, and p in this order. Of course, the order may be changed for tiles located at the same distance from the reference area. In any case, the control module 110 can control so that the respective areas are cleared from the center of the zoom image 32, and the areas of the outer areas are sequentially cleared. For example, the predetermined area in the center of the zoom image 32 may be set as a reference area, and then each area may be sequentially decoded and displayed in the form of a whirl around the reference area, but the present invention is not limited thereto.

When each area is sequentially cleared from the center of the zoom image 32 to the outside of the zoom image 32, the user may prefer to pay attention to the center of the zoom area, It is possible to perceive that the decoding speed of the decoding is higher than that of the conventional method, even if the decoding time of the entire zoom image is the same or similar, so that the usability can be increased. Of course, the above-described control of decoding and display order of the zoom image at the time of zooming need not be limited to the case where the image already displayed is the first thumbnail, and even if any image is displayed, It will be readily apparent to one of ordinary skill in the art to which the present invention may be applied.

According to the technical idea of the present invention, on the other hand, technical ideas for enhancing the usability of small thumbnails are additionally provided. Small thumbnails have typically been created at a predetermined rate, or grid rate, for a grid view. The grid ratio has been a ratio of squares (1: 1) or a ratio similar to a square (e.g., 3: 4, etc.) has been used according to embodiments.

That is, the small thumbnail has been generated at a predetermined grid ratio irrespective of the ratio of the original image, that is, the original ratio. However, in such a case, if the small thumbnail is more appropriately displayed at the original ratio, there may arise a problem that an area in which the image does not exist occurs. This problem and the technical idea of the present invention for this purpose will be described with reference to FIG.

7 is a diagram for explaining wstn (wide_small_thumbnail) according to an embodiment of the present invention.

First, an original image (e.g., img1) as shown in Fig. 7A may exist. In this case, the conventional image processing system may generate a small thumbnail (for example, stn_img1) corresponding to the grid ratio used by the image processing system in advance as shown in FIG. 7B, A small thumbnail of the grid ratio (e.g., stn_img1) was used to represent a list of images as shown in 7c. At this time, conventionally, the original image is cropped at a grid ratio, and then the image is reduced to generate a small thumbnail (e.g., stn_img1), thereby generating a thumbnail as shown in FIG. 7B.

However, in this case, when it is necessary to display the small thumbnail (e.g., stn_img1) at the original ratio, if the small thumbnail (e.g., stn_img1) is scaled and displayed as shown in FIG. 7D, An area (for example, 40) is generated. Alternatively, the small thumbnail (e.g., stn_img1) may be scaled to a screen size based on any one direction (e.g., horizontal and vertical directions) according to an embodiment. In this case as well, Since the cropped part is not displayed on the small thumbnail (stn_img1), it is the same as displaying the image different from the original image.

In order to solve such a problem, the thumbnail generation module 120 included in the image processing system 100 according to the technical idea of the present invention generates a thumbnail image having a ratio of an original image, that is, (E.g., wide small thumbail, wstn_img1).

In the case of generating a small thumbnail (e.g., wstn_img1) having the original ratio as described above, when the control module 110 displays a small thumbnail (e.g., wstn_img1) corresponding to the original image at the original ratio, As shown, the small thumbnail (e.g., wstn_img1) can be simply scaled and displayed. At this time, for example, scaling may be performed in accordance with the size of the screen based on any one direction (for example, the horizontal direction). In this case, even when enlarged display is performed using a small thumbnail The original image can be displayed without being damaged.

If the small thumbnail (e.g., wstn_img1) needs to be displayed at a grid ratio (e.g., in the case of FIG. 7F), the control module 110 stores the small thumbnail (e.g., wstn_img1) So that it can be cropped and displayed. For example, a small thumbnail having a grid ratio (for example, cropping wide small thumbnail) may be generated by simply cropping both predetermined lengths of the small thumbnail (e.g., wstn_img1).

As a result, according to the technical idea of the present invention, when a small thumbnail is generated, a small thumbnail (for example, wstn_img1) corresponding to the original ratio is generated so that even if the small thumbnail is scaled and displayed, (E.g., wstn_img1) on the basis of the small thumbnail (e.g., wstn_img1) when necessary by simply cropping the small thumbnail (e.g., wstn_img1) There is an effect that can be done.

In the case of using a small thumbnail (e.g., wstn_img1) according to the technical idea of the present invention, when a small thumbnail is displayed at a grid ratio, in many cases, a real-time property or an immediate response is rarely required When enlarging a small thumbnail or displaying it at an original ratio, a quick and immediate response is generally required in many cases, so that it can be more effective for display using a small thumbnail.

Meanwhile, the image processing method according to the embodiment of the present invention can be implemented in the form of a program-readable program command and stored in a computer-readable recording medium, and the control program and the target program according to the embodiment of the present invention And can be stored in a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Program instructions to be recorded on a recording medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of software.

Examples of the computer-readable recording medium include magnetic media such as a hard disk, a floppy disk and a magnetic tape, optical media such as CD-ROM and DVD, a floptical disk, And hardware devices that are specially configured to store and execute program instructions such as magneto-optical media and ROM, RAM, flash memory, and the like. The above-mentioned medium may also be a transmission medium such as a light or metal wire, wave guide, etc., including a carrier wave for transmitting a signal designating a program command, a data structure and the like. The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner.

Examples of program instructions include machine language code such as those produced by a compiler, as well as devices for processing information electronically using an interpreter or the like, for example, a high-level language code that can be executed by a computer.

The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

It is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents. .

Claims (18)

Decoding the original image if the image processing system installed in the data processing system determines to display the original image or the first thumbnail in response to the image display request;
Displaying the decoded original image or the first thumbnail corresponding to the original image on the data processing system after the image processing system decodes the original image, and displaying the generated first thumbnail on the data processing system,
Wherein the step of decoding the original image comprises:
Wherein the image processing system decodes the original image and generates region information corresponding to the original image, wherein the region information is information indicating a position of each of a plurality of regions constituting the original image Including an image processing method.
The image processing method according to claim 1,
Wherein the image processing system further comprises generating and storing a second thumbnail corresponding to the original image in advance,
Wherein the first thumbnail is a large thumbnail or a medium thumbnail,
Wherein the second thumbnail is a small thumbnail,
The image processing system comprising:
Selectively displaying the second thumbnail or the first thumbnail,
Displaying the second thumbnail generated and stored in advance when displaying the second thumbnail,
And when the first thumbnail is displayed, decoding the original image to generate the first thumbnail, and then displaying the first thumbnail.
The image processing method according to claim 1,
Wherein the image processing system sequentially decodes a plurality of tiles to be included in the first thumbnail and stores the decoded textures in a storage device provided in the data processing system,
Wherein the image processing system decodes the original image and then displays the decoded original image or the first thumbnail corresponding to the original image on the data processing system after the first thumbnail is generated,
Loading the textures stored in the storage device into the graphics engine at one time.
The image processing method according to claim 3,
And displaying a second thumbnail corresponding to the original image and stored in advance,
Wherein the image processing system loads the textures of the plurality of tiles stored in the storage device into the graphics engine at a time when displaying the first thumbnail after displaying the second thumbnail .
The image processing method according to claim 1,
Receiving a zoom request for a particular region of the first thumbnail displayed by the image processing system;
And performing zooming based on the region information previously generated in response to the received zoom request.
6. The method of claim 5, wherein performing zooming based on the region information generated in response to the received zoom request comprises:
Preferentially decode and display a reference area of a zoom image to be displayed after zooming in response to the zoom request; And
Sequentially decoded and displayed from the reference area in a near-end order.
7. The apparatus of claim 6,
Wherein the predetermined region is a region corresponding to a center of the specific region.
The image processing method according to claim 2,
And generating and storing the second thumbnail at an original ratio corresponding to the original image,
The image processing system comprising:
When the second thumbnail is displayed at a grid view ratio, the second thumbnail is cropped by the grid view ratio and displayed. When the second thumbnail is displayed at an original ratio, the second thumbnail is displayed .
The image processing system displaying a second thumbnail corresponding to the original image;
The image processing system sequentially decodes a plurality of tiles to be included in the first thumbnail to display a first thumbnail corresponding to the original image after displaying the second thumbnail, ; And
Loading the texture of the plurality of tiles stored in the storage device into the graphics engine at one time.
The image processing system receiving a zoom request for a particular area of the image displayed in the data processing system;
Preferentially decoding and displaying a predetermined reference area located at the center of the zoom image among zoom images to be displayed after zooming in response to the received zoom request; And
And decoding and displaying another area of the zoom image sequentially from the reference area in order of closest order.
Storing the thumbnail corresponding to the original image in advance in an original ratio and storing the thumbnail in the data processing system;
When the image processing system displays the thumbnail at a grid view ratio, crops and displays the second thumbnail at the grid view ratio, and displays the thumbnail when displaying the image at the aspect ratio / RTI >
A computer program installed in a data processing system and recorded on a medium for performing the method of any one of claims 1 to 11.
An image processing system comprising:
A thumbnail generation module for generating a first thumbnail corresponding to the original image based on the original image in response to the image display request;
A decoding module for decoding the generated first thumbnail; And
And a control module for displaying the decoded first thumbnail on a data processing system in which the image processing system is installed,
The decoding module includes:
Generating region information corresponding to the original image while generating the first thumbnail, wherein the region information is information indicating a position of each of a plurality of regions constituting the original image, Processing system.
14. The apparatus of claim 13, wherein the thumbnail generation module comprises:
And a second thumbnail corresponding to the original image is stored.
Wherein the first thumbnail is a large thumbnail,
Wherein the second thumbnail is a small thumbnail or a medium thumbnail,
The control module includes:
Displays the second thumbnail stored in advance when the second thumbnail is displayed, and displays the first thumbnail generated after the original image is decoded when displaying the first thumbnail.
14. The apparatus of claim 13, wherein the decoding module comprises:
Sequentially decoding a plurality of tiles to be included in the generated first thumbnail, storing the decoded textures in a storage device provided in the data processing system,
The control module includes:
Loading the textures stored in the storage device into the graphics engine at one time.
14. The image processing system according to claim 13,
Further comprising an interface module for receiving a zoom request for a particular area of the displayed first thumbnail,
The control module includes:
And zooming based on the region information generated in advance in response to the received zoom request.
An image processing system comprising:
An interface module for receiving a zoom request for a specific area of the image displayed on the data manipulating device; And
A predetermined reference area located at the center of the zoom image is preferentially decoded and displayed from a zoom image to be displayed after zooming in response to the received zoom request and then displayed in order from the reference area to another area of the zoom image sequentially And a control module for decoding and displaying the image.
An image processing system comprising:
A thumbnail generation module for generating in advance a thumbnail corresponding to the original image at an original ratio and storing the generated thumbnail in the data processing system;
A control module for cropping and displaying the second thumbnail at the grid view ratio when the thumbnail is displayed at a grid view ratio and displaying the thumbnail when displaying the thumbnail at a screen ratio; Image processing system.
KR1020150120829A 2015-08-27 2015-08-27 Method and system for image processing KR20170026735A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150120829A KR20170026735A (en) 2015-08-27 2015-08-27 Method and system for image processing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150120829A KR20170026735A (en) 2015-08-27 2015-08-27 Method and system for image processing

Publications (1)

Publication Number Publication Date
KR20170026735A true KR20170026735A (en) 2017-03-09

Family

ID=58402707

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150120829A KR20170026735A (en) 2015-08-27 2015-08-27 Method and system for image processing

Country Status (1)

Country Link
KR (1) KR20170026735A (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090056107A (en) 2007-11-29 2009-06-03 임재용 Apparatus for exchanging money of small currency
KR20090115344A (en) 2008-05-02 2009-11-05 강민수 User Chosen Camera Based Image Providing System and Method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090056107A (en) 2007-11-29 2009-06-03 임재용 Apparatus for exchanging money of small currency
KR20090115344A (en) 2008-05-02 2009-11-05 강민수 User Chosen Camera Based Image Providing System and Method

Similar Documents

Publication Publication Date Title
US11303881B2 (en) Method and client for playing back panoramic video
JP4926601B2 (en) Video distribution system, client terminal and control method thereof
KR100405060B1 (en) Enlarged Digital Image Providing Method and Apparatus Using Data Communication Networks
CN110377264B (en) Layer synthesis method, device, electronic equipment and storage medium
US11240403B2 (en) Compensation for delay in PTZ camera system
KR20130093007A (en) Adaptive image rendering and use of imposter
US9621866B2 (en) Image processing apparatus, image processing method, and program
US20120254780A1 (en) Predictive tiling
US9516267B2 (en) Remote magnification and optimization of shared content in online meeting
JP5462882B2 (en) System and method for distributing the processing load of realistic image formation
JP6178705B2 (en) Video distribution system, video distribution apparatus, and video distribution program
KR101751807B1 (en) Method and system for image processing
EP2572510A1 (en) Sharing an image
WO2013183223A1 (en) Information processor, information processing method, program, and image display device
JP6367759B2 (en) Display image zoom terminal, display image zoom method, and display image zoom program
CN110602410B (en) Image processing method and device, aerial camera and storage medium
KR101399951B1 (en) Multi-view video steaming system and providing method thereof
KR20170026735A (en) Method and system for image processing
US8972877B2 (en) Information processing device for displaying control panel image and information image on a display
CN105163194A (en) Real-time video coding method and electronic equipment
JP2007124354A (en) Server, control method thereof, and video delivery system
JP2017192123A (en) Image recorder and control method of the same
CN115134633B (en) Remote video method and related device
JP5141886B2 (en) Image processing apparatus, image processing method, program, and recording medium
JP2004194187A (en) Image transmission device, image receiver, and image-transmitting/receiving system