KR100775177B1 - Local Zooming Method and Apparatus for Mobile Broadcasting Receive Device - Google Patents

Abstract

The present invention relates to a method for real time partial enlargement display on a partial area of a received video in a mobile broadcast receiving terminal. According to the present invention, an enlarged window is set for a partial area of interest of a user with respect to a received image of a mobile broadcast receiving terminal, and enlarged image data corresponding to a set enlarged window is synthesized to an original image, And enlarges and displays a part of the enlarged image together with the image.

Mobile broadcasting, terminal, video, enlargement

Description

TECHNICAL FIELD [0001] The present invention relates to a method and an apparatus for expanding a video portion of a mobile broadcast receiving terminal,

1 is a block diagram of a mobile broadcast receiving terminal according to the present invention.

2 is a flowchart of a method of enlarging a video portion of a mobile broadcast receiving terminal according to the present invention.

3 is a diagram showing an example of a user setting screen for partial enlargement in the present invention

4 is a view illustrating an example in which a partial enlarged image is displayed in synchronization with an original image in the present invention

5 is a diagram showing an example of a display screen according to a position change of a partial enlargement window in the present invention

FIG. 6 is a flowchart of a process of setting and enlarging a partial enlargement window in the present invention

The present invention relates to a method and an apparatus for enlarging a part of a region selected by a user in an image displayed on a mobile broadcast receiving terminal and displaying the same in synchronization with an original image.

A broadcasting system capable of receiving broadcast signals between mobile stations has been commercialized. For example, a mobile broadcasting service called Digital Multimedia Broadcasting (DMB) has been implemented. The broadcasting system provides a service capable of receiving broadcast signals even on the basis of satellite or terrestrial waves.

The mobile terminal receives the broadcast signal between the mobile terminal and the mobile terminal. Portability of a terminal can be considered to mean that the terminal is small and lightweight. Since the mobile broadcast receiving terminal is small, the size of the display device mounted on the terminal is also limited. Since a mobile broadcast receiving screen must be realized by using such a small-sized display device, even if a display device having a high resolution is used, the visibility is limited, and when a character or the like is displayed on a broadcast screen, its readability is limited.

It is an object of the present invention to provide a method of partially displaying an area of a screen displayed on a mobile broadcast receiving terminal and synthesizing an enlarged partial image into an original image to display an original image and a partially enlarged image synchronously in real time And to provide such a device.

It is another object of the present invention to partially enlarge a part of a user's interest in a screen displayed on a mobile broadcast receiving terminal and to freely adjust the position and size of a partial enlarged area according to a user's selection, And displaying the original image and the partially enlarged image synchronously with each other in real time.

It is still another object of the present invention to provide a method and apparatus for partially enlarging a region of interest on a screen displayed on a mobile broadcast receiving terminal and performing signal processing for improving an image quality on an enlarged partial image, The present invention also provides a method and apparatus for synchronizing an original image and a partially enlarged image of a sharp image together in real time.

According to another aspect of the present invention, there is provided a method of expanding a video portion of a mobile broadcast receiving terminal, comprising: extracting and enlarging a portion of a received video signal; Synthesizing the enlarged partial image at a corresponding position of the original image and outputting the synthesized partial image; And a control unit.

According to another aspect of the present invention, there is provided a method of expanding a video portion of a mobile broadcast receiving terminal, comprising: confirming a reference position of a partially enlarged image; Extracting position information of a region to be partially enlarged in an image frame according to a size of a partial enlargement window based on the identified position; Extracting an image corresponding to a region to be partially enlarged according to the extracted position information; Enlarging an image of the extracted region; Resizing the partially enlarged image to fit the window size; Inserting the resized partial enlarged image at a corresponding position in an image frame according to the extracted position information; And a control unit.

According to another aspect of the present invention, there is provided a mobile broadcast receiving terminal including: a broadcast receiver for receiving a broadcast signal; A decoder for decoding the received broadcast signal; A partial enlargement setting unit for setting an image area to be partially enlarged from the decoded video signal; An image output unit for enlarging a partial image region set by a user out of the decoded image signals, and synthesizing and outputting an enlarged partial image to an original image; And a control unit.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

FIG. 1 shows a configuration of a mobile broadcast receiving terminal to which the present invention is applied. 1, a mobile broadcast receiving terminal according to the present invention includes a receiver 10 for receiving a broadcast signal, a decoder 20 for decoding the received broadcast signal, A partial image extracting unit 30 for extracting an image region, a partial image enlarging unit 40 for enlarging the extracted partial image region, a synthesizing unit 50 for synthesizing and outputting the enlarged partial image to an original image, A display unit 60 for displaying the synthesized image, and a user interface unit 70 for inputting a user command for the partial enlargement.

The broadcast signal receiving unit 10 selects and outputs a broadcast signal of a channel selected by the user. The broadcast signal output from the broadcast signal receiving unit 10 is decoded by the decoder 20. The video signal decoded by the decoder 20 is extracted by a partial image extracting unit 30 from a video signal corresponding to a specific region set by the user. The image to be partially enlarged is set through the user interface unit 70. In the broadcast receiving terminal, the user interface unit 70 may use a key input unit. The position of the area to be partially enlarged (window) is determined through the specific key operation of the key input unit, and the size and the enlargement ratio are also set. The partial image extracting unit 30 extracts a video signal of the corresponding region according to the position and size setting information of the partial enlargement region.

For example, in a digital image signal processed in a frame unit, a video signal corresponding to a partial region set by a user is cut out in a frame image based on a memory. At this time, position information cut out by the partial image is obtained. The partial image enlargement unit 40 enlarges the image signal corresponding to the extracted partial image region. At this time, the enlargement ratio is set by the user using the user interface unit 70. The enlarged image is input to the composition unit 50.

The synthesizer 50 synthesizes the enlarged partial image with the original image, and outputs the image signal including the partially synchronized image, that is, the partially enlarged image, and the display unit 60 displays the image. A method of composing a partially enlarged image on an original image can be performed by inserting the enlarged partial image into the cut-out area and having the position information of the area to be partially enlarged in the image frame. In this way, only the specific part of the original image is displayed in real time.

If a part of the original image is cut out and the part is enlarged, the size of the enlarged image increases by a factor of magnification. The reference position for enlargement is based on, for example, the center position of the partial enlargement area (window), where the enlarged image is resized according to the window size. As a resizing processing method, for example, a method of taking only an enlarged image included in a window area without using pixels enlarged outside the window size can be used. When the reference position of resizing is changed, it is possible to implement an image that is enlarged in a specific direction based on a specific point. This resizing process is applied to the embodiments to be described later as well.

When the partial enlarged image is displayed as described above, the position of the partial enlargement area can be moved through the user interface unit 70. For example, when the user requests to move the position of the partial enlargement area using the direction key of the key input unit, the partial image extraction unit 30 extracts the window (partial enlargement area) in the direction required by the user An image corresponding to the moved position is extracted, and the extracted image is enlarged and displayed on the original image. The movement interval of the window using the direction key may be moved by a unit of the default interval or may be set by the user as an initial value. For example, you can use the way the window moves in units of 10 pixels each time you press the direction key once. The size of the window can be selected as an example to keep the original size as it is when the window is moved.

As described above, since the enlarged image is displayed in real time synchronized with the original image, the visibility and readability of a specific area of interest can be maximized.

2 shows a method of enlarging a video portion of a mobile broadcast receiving terminal according to the present invention. When the partial enlargement function is selected, a partial image region corresponding to the enlargement magnification, size, and position set by the user is extracted and enlarged, and a partial image enlarged on the original image is synthesized and displayed.

First, let's look at an initial setting step (S100). The initial setting step S100 is a process of setting the magnification and magnification in advance using a menu screen. 3 shows an example of an initial setting screen. The terminal 110 exemplifies a mobile phone equipped with a broadcast receiving function. The mobile terminal 100 includes a key input unit 111 for selecting a menu and selecting a moving direction. The display unit 120 includes a magnification setting item 121 and a size setting item 122 for initial setting, Respectively.

The user can view the initial setting screen (menu) to be displayed and set the magnification of the desired magnification and the magnification of the partial magnified image (window). The window size is exemplified by the case of inputting in pixel units, and the case of setting the sizes of the horizontal and vertical directions is exemplified.

In FIG. 2, for example, the magnification is set to 2, the horizontal size is 40, and the vertical size is 10, and when the magnification and size are set as described above, And enlarges the image by two times by 80 times by 20 times by 20 times, and then inserts the enlarged partial image at that position.

Next, the selection step S10 of the partial enlargement function is selected by the user performing the partial key enlargement function during the viewing of the mobile broadcast by performing the key input promised by the key input unit 111. [ If the partial enlargement function is selected, the partial enlargement is executed in the next step (S20).

Let's look at how to zoom in on a specific part of the displayed image. When the partial enlargement function is selected, the center of the screen is used as the reference position. Here, it is described based on the X-Y coordinate system. The center of the screen is set as a reference position, and a partial image area corresponding to the size set by the user is cut out. As an example of a method of cutting out a partial image area, a method of cutting an image area at a position corresponding to a size set by a user using a frame memory can be used. The image signal of the cut-out partial area is enlarged. The enlarged partial image is inserted again at the original cut position to form an image synthesized with the original image. That is, the original image and the partially enlarged image are synchronized in real time. The synthesized image is output to the display unit (S30). Since the image displayed on the display unit is enlarged in some areas and is displayed together with the original image, it is possible to recognize an original image enlarged only at a specific portion while viewing the original image in full screen.

In this way, when the partial enlarged image is displayed together with the original image, the area to be enlarged, that is, the window position can be moved to the new interest area of the user. That is, when the movement of the enlarged area is selected using the direction keys (up, down, left, right button) of the key input unit 111, the window position is moved accordingly and the partial image of the moved new position is moved Expand, synthesize, and display them in the same manner as described above (S40). The interval for moving the position of the partial image area (window) to be partially enlarged refers to a preset interval.

In addition, for the adaptive movement to the window type, the movement interval in the direction in which the horizontal / vertical ratio of the screen is large is set to be wider than the other direction. For example, as shown in FIG. 3, when the window size is 40 x 10, the moving distance in the horizontal direction is wider than the moving distance in the vertical direction.

In addition, in order to move the window more conveniently and quickly, when moving the partial image region (window) to be enlarged, the moving interval unit is relatively short or relatively long. For example, if the direction key of the key input unit 111 is long-pressed, the user can perform a fast movement by skipping over two or more movement interval units at a time.

The partial enlarged image is processed in synchronism with the original image in real time for all subsequent image frames until the user selects the end of the partial enlargement function (S60).

4 illustrates an example in which a partial enlarged image is displayed in synchronization with an original image in the present invention. An image corresponding to the partial enlargement area 132 of the broadcasting screen 130 represented in the display unit 130 of FIG. 4 is moved from the right side to the left side of the lower side of the screen and the displayed small characters are much easier to see It shows that it is giving help. In other words, it shows the case where the readability of a character is increased.

5 shows an example of a display screen 140 according to the position change of the partial enlargement window in the present invention. This function can be used to move up, down, left, and right partial enlargement areas (windows) 141, 142, and 143 using four buttons of the key input unit 111. The button may be used with any button of the portable terminal, and the button may be moved at regular intervals whenever the button is pressed. By setting the movement interval in consideration of the precision, the movement interval in the direction in which the horizontal and vertical ratios of the screen are large is widened, thereby avoiding overlapping of the partial regions already enlarged due to the movement interval which is too short. In addition, by providing a long key function for solving the inconvenience of pressing the button continuously, it is possible to move at a high speed.

6 shows an embodiment of the setting and enlargement processing of a partial enlargement window in the present invention.

First, the magnification, the size of the image, and the x and y coordinates of the frame image are checked (S110). As described with reference to FIG. 2, the step of confirming the size of the magnification and the partial enlargement area (window) set in the initial environment setting step is to confirm the position information in the broadcast image frame, that is, the specific x and y coordinates . Here, the x and y coordinates are located at the center of the screen as an initial value when the partial enlargement function is started, and change every time there is a key input when there is a key operation for moving the window position.

Assuming that the size and position information of the partial enlargement area (window) is determined in pixels and moves, if the display device supports 640x480 resolution, the first reference position Pref (x, y) corresponds to the center of the screen Therefore, it can be called Pref (320,240). The next step S120 is a step of extracting an area of a broadcast frame with a width and a vertical size centered on the x, y coordinates. In this embodiment, the window area can be extracted as a rectangle based on the x, y coordinate system. That is, the window region can be partitioned into vertex coordinates P_up_left_end (x, y) and P_btm_right_end (x, y) of a square in a diagonal direction facing each other. Here, P_up_left_end (x, y) is the coordinates of the upper left vertex of the rectangular window, and P_btm_right_end (x, y) is the coordinates of the lower right vertex of the rectangular window. Each coordinate is determined according to the width and height of the window as follows.

P_up_left_end (x) = Pref (x) - Width / 2

P_up_left_end (y) = Pref (y) - Length / 2

P_btm_right_end (x) = Pref (x) + transverse length / 2

P_btm_right_end (y) = Pref (y) + vertical length / 2

For example, if Pref (x, y) = Pref (320,240) and the window size is width x length = 40x10, the position information of the window area is as follows.

P_up_left_end (x) = Pref (320) - 40/2 = P_up_left_end (300)

P_up_left_end (y) = Pref (240) - 10/2 = P_up_left_end (235)

P_btm_right_end (x) = Pref (320) + 40/2 = P_btm_right_end 340

P_btm_right_end (y) = Pref (240) + 10/2 = P_btm_right_end (245)

That is, the window area corresponds to a rectangular area extracted so that P (300, 235) and P (340, 245) become diagonal vertex coordinates.

If the image signal of the area is enlarged as much as the magnification after extracting the area to be enlarged, the image quality deteriorates. Therefore, before enlargement (or after enlargement) to prevent the deterioration of image quality as much as possible, The processing is performed by a preprocessing (or post-processing) process.

First, a sharpening technique is performed to emphasize the contour in the extracted image (S130). This is to reduce blurring due to enlargement. Next, a saturation emphasis process for improving saturation is performed (S140). Contrast stretching processing for expanding contrast is performed (S150). By performing the image quality improvement processing on the partially enlarged image, the enlarged portion is clearly emphasized to the user. The order of adjusting the sharpness (sharpness), saturation, and contrast for the image quality improvement process is irrelevant.

After performing the above-mentioned processes, the extracted image is enlarged by a magnification (S160). In this case, the cubic algorithm is used to minimize the deterioration of the image quality due to the enlargement, thereby suppressing the image discontinuity at the corner between the adjacent blocks in the block-based digital image processing.

Finally, the center point of the enlarged partial image is matched with the center point Pref (x, y) of the extracted region, and then inserted into the original broadcast frame to produce a final partially enlarged broadcast frame (S170).

When the position of the partial enlargement area (window) is moved at regular intervals by using the direction key, it is adjusted by adjusting the pref (x, y) which is the reference value of the window at the set interval. As the value of Pref (x, y) is adjusted, the partial enlargement area will be set at the new position in the same manner as described above. The image in the partial enlargement area is enlarged in addition to the image quality improvement process, The position of the partially enlarged image is moved under the real-time image. When the window size is 40x10, the moving interval of the partial enlargement area (window) is shifted by at least 40 pixels when moving left and right, and by at least 10 pixels when moving up and down, .

The shape of the partial enlargement area (window) can be set in various forms such as a circle, an ellipse, etc. in addition to a rectangle. In accordance with each shape, the image of the corresponding area is cut out in the frame image, Position, the partially enlarged image and the original image are synchronized and displayed simultaneously in real time.

The present invention expands the information of a small area desired by a user in a mobile broadcast receiving terminal, thereby providing viewers with ease of information acquisition, and provides an effect that a large screen is viewed on a specific part despite being a small display device. In addition, it is possible to easily view a desired area even on the move, thereby relieving the visual fatigue of the user.

In addition, if the user wishes to grasp the content of a certain area of the broadcast, the user can emphasize the content more clearly than when enlarging the area, thereby improving visibility and readability.

In addition, according to the present invention, it is possible to designate the size and magnification of the magnified area, and the magnified area can be freely moved by using the up, down, left, and right buttons and the image quality deterioration And to emphasize the enlarged information so as to easily grasp the information of the enlarged portion.

Claims (20)

delete delete delete Extracting a corresponding region according to a size and a position of a partial enlargement window in a video signal and enlarging the video signal of the extracted region to a predetermined scale; Performing signal processing for image quality adjustment on the enlarged image; Inserting the enlarged image of the image quality adjusted into a partial enlargement window of a size and position set with respect to the original image, and synthesizing the enlarged image with the original image; Determining whether the output of the partial enlargement window is shifted; As a result of the determination, when the position of the partial enlargement window is moved, the position of the partial enlargement window is adjusted in units of the set interval of movement, and the degree of the movement of the partial enlargement window at a time is a multiple of the predetermined interval. Lt; / RTI > Enlargement of the image of the region corresponding to the partial enlargement window of the moved position, enlargement of the enlargement of the image at the set magnification, synthesized output of the image of the image quality and the original image are sequentially performed. A method for enlarging a video portion of a receiving terminal. delete 5. The method of claim 4, wherein the position of the partial enlargement window is larger in a direction of a larger size than a width of the screen. 5. The method of claim 4, wherein the degree of movement of the partial enlargement window is shortened or lengthened at a time in proportion to a pressing time of the direction key. delete 5. The method of claim 4, wherein the size of the partial enlargement window is set in units of pixels. delete delete delete The method of claim 4, wherein the image quality adjustment is at least one of signal processing, sharpness adjustment, contrast adjustment, and saturation adjustment. delete delete delete delete delete delete delete

Images