KR100683349B1 - Method and apparatus of image display based on section of interest - Google Patents

Abstract

The present invention relates to a method for selecting a region of interest based on a designated region of interest in a still image and a device thereof. The present invention divides a still image into several regions of interest and performs a selection view conveniently by quickly moving between the regions of interest. The present invention relates to a region-based selection view selection method and an apparatus thereof.

In the selection view method based on the region of interest designation, a selection view file is described by describing a region of interest designation information for the selection view for the original still image, the region of interest in the still image, and the selection view according to a display command of the user. And sequentially displaying the corresponding ROIs based on the information described in the file, wherein the information describing the ROIs includes information on the priority of the ROIs in the still image and based on the priorities. And displaying the corresponding ROI sequentially.

Still image search, region of interest, mobile terminal

Description

Selective view method and device based on region of interest designation in still image {METHOD AND APPARATUS OF IMAGE DISPLAY BASED ON SECTION OF INTEREST}

1 is a diagram showing an example of a section structure and reading order of a cartoon image to which the present invention is applied.

2A illustrates a file structure for viewing a region of interest selection of the present invention.

2B is a diagram showing an example of the file structure for the ROI selection view of the present invention.

3 is a block diagram illustrating an embodiment of a region of interest designation based selection view of the present invention;

<Explanation of symbols for the main parts of the drawings>

21: total number of areas of interest

22: location, ranking, magnification of the region of interest technical information

23: Original still image data

31: memory 32: video codec

33: processor 34: display unit

35: user interface

The present invention relates to a method for selecting a region of interest based on a designated region of interest in a still image and a device thereof. The present invention divides a still image into several regions of interest and performs a selection view conveniently by quickly moving between the regions of interest. The present invention relates to a region-based selection view selection method and an apparatus thereof.

As well as mobile terminals represented by mobile phones as well as PCs, mobile-based terminal devices such as smart phones, PDAs, portable multimedia players (PMPs), etc., have emerged one after another. These terminals have a foundation for storing various information such as still images, moving images, various music files, and document files, including memory and codec, and playing and displaying them as needed or outputting them to speakers. Accordingly, the user demands higher performance and quality in acquiring, storing, managing, and reproducing the resources in utilizing various multimedia resources, and also seeks to maximize device operation and interface convenience.

Still among the multimedia resources, still images may have one or more areas of particular interest to the user. For example, in the case of cartoon video, it is divided into several sections, and each section includes pictures and letters. In other words, the cartoon image is composed of several regions of interest. When the still image including a lot of the region of interest is displayed on the display window of limited size, the still image is adjusted to fit the display window. Then, as the original still image is reduced, the size of the region of interest (section in the case of the cartoon image) in the still image is reduced accordingly, so that not only the image but also the size of the text becomes smaller, so that it is difficult for the user to interpret it.

That is, in the case of a cartoon image composed of several sections, if the cartoon image is reduced in order to be displayed on a display window of limited size, the sections are also reduced accordingly, and thus the size of the image included in the section is reduced to recognize the image. Difficulties follow, and furthermore, the characters in the section are also smaller, making it difficult to decipher the characters.

In order to solve this inconvenience, the screen is enlarged. Since the enlarged screen displays only a partial region of the original still image, the user moves while looking at each region of interest in order through the operation of the device. This movement generally uses direction keys, and the user must bear the inconvenience of having to manipulate the direction keys several times to move to the next region of interest. In addition, when the configuration of the ROI is complicated, it becomes more difficult to move to the next ROI.

An object of the present invention is to provide a method and apparatus for designating a region of interest in a still image and sequentially selecting and viewing a region of interest of the still image based on the region of interest.

Another object of the present invention is to provide a method and an apparatus for selecting a region of interest based on region of interest specified in a still image, by which a region of interest is designated in a still image, so that the key can be conveniently used for moving / navigating between regions of interest and adjusting the screen size. There is this.                         

In addition, the present invention constitutes a selection view file consisting of the original still image, the total number of regions of interest, the position of the region of interest, priority, and the minimum screen magnification value, and stops based on the region of interest description information of the selection view file. The search movement in the image is performed between the ROIs, and according to the priority value, the movements of the ROIs are sequentially performed, and when the still image and the ROI need to be resized, the image is reduced to the minimum screen magnification value. It is an object of the present invention to provide a method and apparatus for designing a selection view based on a region of interest within a still image, so that the image and text cannot be decoded and recognized.

In accordance with the present invention, a region of interest designation based selection view in a still image according to the present invention comprises a composition of a selection view file by describing a region of interest designation for a selection view with respect to an original still image and a region of interest in the still image. And sequentially displaying the corresponding ROI based on the information described in the selection view file according to the display command of the user, wherein the information describing the ROI is related to the priority of the ROI in the still image. Includes information and sequentially displays the corresponding ROI based on the priority.

In addition, the information describing the ROI in the present invention may include a location and priority of the ROI in the corresponding still image.

In addition, the information describing the ROI in the present invention may include a location, priority, and number of ROIs in the corresponding still image.

In addition, the present invention is characterized in that the magnification for the minimum screen size is described together in the selection view file.

In the present invention, the magnification for the minimum screen size is described in the selection view file, and the minimum screen magnification value is assigned to each ROI.

In addition, in the present invention, the magnification for the minimum screen size is described together in the selection view file, and the size of the image adjusted when displaying the image of the ROI is limited so as not to be reduced below the minimum screen magnification value.

In addition, in the present invention, the magnification for the minimum screen size is described together in the selection view file, and it is determined whether the entire ROI is displayed above this minimum screen magnification value, and if not, displaying each ROI separately. It features.

In addition, the present invention provides a skip function when sequentially displaying the ROIs according to the priority values of the ROIs described in the selection view file (ie, 1, 3, 5, ... or 1). According to the user's selection, such as, 2,4,6, ... etc., it is possible to search by skipping without sequentially searching all regions of interest in the still image.

In addition, in the present invention, the original still image provider configures the extraction of the region of interest and information (number, position, rank) describing the region of interest and provides the terminal to the original still image provider.

In addition, the present invention is characterized in that the extraction of the region of interest and information (number, position, rank) describing the region of interest are automatically generated by the terminal automatically extracted for each original still image.

In addition, in the present invention, the above-described automatic extraction extracts a region of interest based on an image pattern divided into sections (for example, a rectangle pattern for section division of a cartoon image), and extracts information (number, position, and ranking) describing the region of interest. It is characterized by generating.

In addition, in the present invention, the above-described manual extraction is defined by the user as a region of interest by dividing a specific region in the original still image while viewing the whole original still image, and describing the necessary information (number, position, rank) for the viewing order. The preprocessing editing is performed, and subsequent display of the corresponding ROI is performed based on the ROI technical information generated by the user when the corresponding still image is viewed again.

In addition, the region of interest designation based selection viewing device in the still image of the present invention for achieving the above object, the original still image data and information including a position and display ranking of the at least one region of interest in the original still image Means for storing a selection view file, means for inputting a search between regions of interest when the original still image is displayed, and means for sequentially displaying the original still image for each region of interest according to the search request (control / Display information, wherein the information describing the display rank comprises information on the priority of at least one region of interest in the still image, and sequentially displays the corresponding region of interest based on the priority. It is characterized by.

In addition, the terminal device equipped with the selection view in the present invention is characterized in that the mobile terminal.

An embodiment of a method for selecting a region of interest designation based on the still image according to the present invention and an embodiment thereof will be described in detail with reference to the accompanying drawings.

If a mobile terminal has a small display window, such as a mobile terminal, the actual image may be displayed by reducing its size or displaying a portion of the actual size image. In addition, a specific position in the entire image may be of interest.

Take the cartoon image of FIG. 1 as an example. The cartoon image shown in FIG. 1 consists of several sections 11-17. Each section 11 to 17 is viewed from the user's point of view and each section becomes one area of interest. As described above, in the case of a still image composed of several ROIs, when it is difficult to display all ROIs 11 to 17 on one screen at a time, the ROIs should be divided into parts and displayed according to the priority of the ROIs. . In addition, the size of the resize is limited so that the image does not become smaller than a certain level so that the user is not inconvenienced in reading the image and text.

In the cartoon image (original still image) shown in FIG. 1, when based on the time flow of story development, each region of interest-sections 11 to 17 must be displayed in order in the order expressed in the drawing. There is no inconvenience in understanding the development and decoding the images and characters in each section.

In order to provide the above functions, a selection view file having a structure as shown in FIG. FIG. 2A shows the basic structure of the selection view file, and FIG. 2B shows an example of the selection view file in the case of having seven regions of interest (see FIG. 1).

As shown in Fig. 2A, the selection view file according to the present invention includes the total number of regions of interest 21 in the original still image, the position and priority of each region of interest and the minimum screen magnification 22, and the still image data ( 23)

Referring to FIG. 2B, the selection view file in the case of the seven ROI-sections 11 to 17 as shown in FIG. 1 may include '7' of the total ROIs, and for each of the ROIs 11 through 17. The position information (x, y), the priority at the time of display and the minimum screen magnification of the region of interest are described. The location information of the ROI may be set based on the x and y coordinate values of the ROI on the x-y coordinate plane.

 By using the information value described in the selection view file, the following functions are provided.

First, in case of displaying on the terminal, after determining whether the entire ROI is displayed at the minimum screen magnification, if not possible, each ROI is displayed separately, and the ROI having the lowest priority is displayed at the minimum screen magnification. . When moving to the next region of interest, it moves according to the low priority value. By using the ROI value, the user can easily move at once instead of the inconvenience of moving to the next position by operating the position movement key. In particular, if a video contains contents such as time flow or logical development, such as a cartoon, the priority of the region of interest has an important meaning, so that the viewer can easily grasp the contents.

Meanwhile, in the present invention, a skip function may be provided when sequentially displaying the ROIs according to the priority values of the ROIs described in the selection view file. That is, although the ROIs may be sequentially displayed according to the priority value, in some cases, the display order is 1, 3, 5, in order to roughly search for the ROI in the still image. ... or 1, 2, 4, 6, ..., etc., according to the user's selection, instead of sequentially searching all the ROI in the still image to search by skipping. Expanding this, assuming that at least two finite number of ROIs are included in one still image, only one ROI representing each still image is selected and displayed for multiple still images. It is possible to navigate by.

Also, in the present invention, the extraction of the ROI and information (number, location, ranking) describing the ROI are configured by a person providing the original still image (for example, a service provider providing a cartoon image), and the ROI. Providing a still image including technical information to a user-terminal, or generating the extraction of the ROI and information describing the ROI (number, position, rank) automatically or manually for each original still image from the terminal. And save this information along with the still image.

The above-mentioned automatic extraction extracts a region of interest using a known pattern-based object region detection technique based on an image pattern divided into sections, such as a cartoon image (see FIG. 1), and describes the information ( Number, location, rank).

In addition, the aforementioned manual extraction artificially partitions a specific area in the original still image using the device control panel of the terminal while the user views the entire still image, designates the partitioned area as the region of interest, and provides the necessary information (number and position). By doing so, a sort of preprocessing of the viewing order is done. In this case, when the user views the processed still image later, the display of the corresponding ROI is sequentially performed based on the ROI technical information generated according to the subjective and main viewpoint of the user.

3 is a block diagram of an embodiment of the ROI-based selection viewing device in the still image according to the present invention. As shown in FIG. 3, the selection viewing apparatus includes a memory unit 31, a video codec 32, a processor 33, a display unit 34, and a user interface unit 35.

The selection view file described above is stored in the memory unit 31. The selection view file includes the total number of regions of interest, the position and priority of the regions of interest, the minimum screen magnification values, and the corresponding still image data. If the original still image data is a compression-encoded format, the video codec 32 corresponding to the standard is provided to drive and reproduce the video codec 32 when displaying the still image.

The processor 33 displays the corresponding still image of the memory unit 31 on the display unit 34 for each region of interest in response to a user's selection viewing command input through the user interface unit 35. When displaying the original still image for each region of interest, the region of interest is sequentially displayed based on the priority of the region of interest described above.

Here, the selection viewing device may be mounted in the mobile terminal. Since the mobile terminal represented by the mobile phone is equipped with a memory, a processor, a display unit, a user interface unit, a video codec, etc., the still image data based on the selection view file according to the present invention is reconstructed and stored in the memory, and the selection view file is stored. By using a magnification of more than the minimum screen magnification, the corresponding region of interest is displayed on the display window of the limited size mobile terminal.

In this way, even in a mobile terminal having a limited size display window, a still image such as a cartoon image can be displayed based on a search movement between regions of interest, and the size becomes smaller than necessary, making it difficult to decode images and characters. Can be solved at the same time. In addition, since the user can move to the next region of interest by one key operation to display and view the corresponding image, convenience in the still image search is guaranteed.

The present invention can be very useful when there is more than one region of interest or when a limitation of resize is required when displaying an image on a terminal.

For example, it is useful for cartoon video. In cartoon video, several sections make up a single image, each section has a temporal flow, and each section has a letter, and when it is smaller than a certain size, it becomes impossible to decode the text itself. In this case, the location, priority, and minimum screen magnification of the region of interest may allow the user to easily move to the region without manipulating the direction keys. In addition, when the above value is used when moving to the next region of interest, complicated directional key manipulation is not necessary and the user can be convenient.

Claims (15)

Constructing a selection view file by describing ROI specification information for selection view for the original still image and the ROI in the still image; And sequentially displaying the corresponding ROI based on the information described in the selection view file according to a display command of the user. Including; The information describing the ROI includes information on the priority of the ROI in the still image, and sequentially displays the ROI based on the priority. Select view method. The method of claim 1, wherein the information describing the ROI further includes a location of the ROI in the corresponding still image. The method of claim 1, wherein the information describing the ROI further includes a location of the ROI in the corresponding still image and a number of ROIs. The method of claim 1, wherein the magnification for the minimum screen size is described together in the selection view file. The method of claim 1, wherein the magnification for the minimum screen size is described in the selection view file, and the minimum screen magnification value is assigned to each ROI. . The method of claim 1, wherein a magnification for the minimum screen size is described together in the selection view file, and the size of the image adjusted when displaying the image of the ROI is limited so as not to be reduced below the minimum screen magnification value. Selection view based on region of interest designation in still image. The method according to claim 1, wherein the magnification for the minimum screen size is described together in the selection view file, and it is determined whether the entire ROI is displayed above the minimum screen magnification value, and if not, the respective ROIs are displayed separately. Selective viewing method based on the region of interest within the still image, characterized in that. [Claim 2] The selection view of claim 1, wherein a skip function is provided when the ROIs are sequentially displayed according to the priority values of the ROIs described in the selection view file. Way. [Claim 2] The selection view of claim 1, wherein the original still image provider constructs and extracts the region of interest and information (number, position, rank) describing the region of interest and provides the terminal to the terminal. Way. The interest in the still image of claim 1, wherein the terminal extracts the region of interest and information (number, position, and rank) describing the region of interest is automatically and manually extracted from the terminal for each original still image. Zoning-based selection view method. 12. The ROI designation of claim 10, wherein the automatic extraction extracts the ROI based on an image pattern divided into sections, and generates information (number, position, rank) describing the ROI. Based selection view method. 11. The method of claim 10, wherein the manual extraction is performed by the user partitioning a specific area in the original still image while designating it as the region of interest, and describing necessary information (number, position, and ranking) in order of viewing. And pre-processing editing for the region of interest in the still image, characterized in that the subsequent display of the region of interest is sequentially performed based on the region of interest description information generated by the user when the image is viewed again. Means for storing a selection view file comprising original still image data and information describing a position and display rank of at least one region of interest within the original still image, and inputting a search between regions of interest when displaying the original still image; Means (UI), and means (control / display) for sequentially displaying the original still image for each region of interest according to the search request, The information describing the display rank may include information on the priority of at least one ROI in the corresponding still image, and the ROI may be sequentially displayed based on the priority. Selective viewing device based on region of interest in still image. The apparatus of claim 13, wherein the terminal apparatus on which the selection view is mounted is a mobile terminal. 15. The ROI of claim 13, wherein the information designating the ROI is described together with the location, priority, number of ROIs, and magnification for the minimum screen size of the ROI in the still image. Assignment-based selection viewing device.

Images