KR20040089900A - Method for processing mosaic of picture in wireless terminal - Google Patents

Abstract

PURPOSE: A method for processing an image screen to mosaic in a mobile terminal is provided to allow a user to display a selected photo image of a mobile terminal as a mosaic-processed photo image. CONSTITUTION: When a display mode for displaying image data is selected(311), a user selects a photo(312). When a function key for an mosaic effect is selected(313), a controller determines a size of a mask block and initializes variables x and y according to movement of the mask block in the region of the photo image(314). The controller checks the position of the mask block(315) and then calculates the sum of pixel data of the mask block(317). An average value of the calculated pixel data is calculated(318) and stored(319). The controller determines whether the mask block is positioned at the last of the Y coordinate of the photo image(320). If the mask block is positioned at the last of the Y coordinate, the controller determines whether the mask block is positioned at the last of the X coordinate(322). If the mask block is positioned at the last of the X coordinate, the corresponding region is determined as a mosaic region, processed to mosaic, and displayed at the center of the photo region(326,327).

Description

How to handle mosaic of video screen in mobile device {METHOD FOR PROCESSING MOSAIC OF PICTURE IN WIRELESS TERMINAL}

The present invention relates to a method for processing a video screen, and more particularly, to a method for mosaicing a video screen.

Currently, portable mobile communication terminals are converting to a structure capable of transmitting high speed data in addition to voice communication functions. Data that can be processed by the mobile terminal performing the data communication may be packet data and image data.

Currently, the mobile terminal has a function of transmitting and receiving image data. Therefore, the video screen received from the base station is stored or the acquired video screen is transmitted to the base station. In addition, the portable terminal may include a camera for photographing an image screen and a display unit for displaying an image signal photographed by the camera. The camera may use a CCD or a CMOS sensor, and the display unit may use an LCD. In addition, with the miniaturization of the camera device, the device for capturing the image is becoming more and more miniaturized. The portable terminal may capture a video screen and display the moving picture and the still picture, and transmit the captured video screen to the base station.

As described above, as the needs of operators and consumers are increased with respect to video mails, the above-mentioned services are implemented, and the trend is to be greatly increased in the future. In addition, the functions of editing a video screen by a user's operation in the portable terminal are also increasing. For example, technologies for adjusting (zoom in, zoom out) or synthesizing a plurality of photographic images stored in a portable terminal are implemented.

Accordingly, an object of the present invention is to provide a method for mosaicing a photographic image in a mobile terminal.

Another object of the present invention is to provide a method for mosaicing a predetermined region of a selected photo image after selecting the photo image being stored in the portable terminal.

A method of mosaicing and displaying a photographic image of a mobile terminal for achieving the above object includes: setting a region of all image data, setting a mask block for obtaining an average value of pixel data in a specific region, and Moving the mask block to an area of the entire image data, storing an average value in a located block; and if the mask block is located last, inputting an average value corresponding to an area set for mosaic processing to display a mosaic. Characterized in that made.

1 is a diagram illustrating a configuration of a portable terminal for implementing a mosaic function of an image screen according to an embodiment of the present invention.

FIG. 2 is a diagram illustrating a configuration of an image processing unit in FIG. 1. FIG.

3 is a diagram illustrating a mosaic process of an image screen according to an exemplary embodiment of the present invention.

4A to 4E are views for explaining FIG. 3.

5 is a diagram illustrating a process of setting an area where a mosaic is displayed according to an exemplary embodiment of the present invention.

6A-6E illustrate an original video screen and a mosaic screened video screen according to an embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, detailed descriptions of preferred embodiments of the present invention will be described with reference to the accompanying drawings. It should be noted that the same components in the figures represent the same numerals wherever possible.

In the following description, specific details such as the size of the photographic image for implementing the mosaic, the size of the mask block, the average value according to the position of the mask block, the shape of the setting area for the mosaic processing, etc. are shown to provide a more comprehensive understanding of the present invention. have. It will be apparent to one of ordinary skill in the art that the present invention may be readily practiced without these specific details and also by their modifications.

1 is a diagram illustrating a configuration of a mobile terminal according to an exemplary embodiment of the present invention, which may be a configuration of a mobile phone.

Referring to FIG. 1, the RF unit 23 performs a wireless communication function of the portable telephone. The RF unit 23 includes an RF transmitter for upconverting and amplifying a frequency of a transmitted signal, and an RF receiver for low noise amplifying and downconverting a received signal. The data processor 20 includes a transmitter for encoding and modulating the transmitted signal, a receiver for demodulating and decoding the received signal, and the like. That is, the data processor 20 may be configured of a modem and a codec CODDEC. The codec includes a data codec for processing data and an audio codec for processing an audio signal such as voice. The audio processor 25 plays a function of reproducing a received audio signal output from the audio codec of the data processor 20 or transmitting a transmission audio signal generated from a microphone to the audio codec of the data processor 20.

The key input unit 27 includes keys for inputting numeric and character information and function keys for setting various functions. In addition, the key input unit 27 may include function keys for implementing a mosaic effect according to an embodiment of the present invention. The memory 30 may include a program memory, a data memory, and image memories for storing photographic images according to an exemplary embodiment of the present invention. The program memory may store programs for controlling a general operation of the portable telephone and programs for processing an image signal applied to the display unit 60 according to an exemplary embodiment of the present invention. In addition, the data memory temporarily stores data generated during the execution of the programs. The image memory is a memory for storing photo image data or for storing mosaic image data.

The controller 10 performs a function of controlling the overall operation of the portable terminal. In addition, the controller 10 may include the data processor 20. In addition, the controller 10 controls operations of implementing a mosaic function in the photo image according to a mode command set from the key input unit 27 according to an embodiment of the present invention.

The camera module 40 includes a camera sensor for capturing image data, converting the photographed optical signal into an electrical signal, and a signal processor for converting the analog image signal photographed from the camera sensor into digital data. Herein, it is assumed that the camera sensor is a CCD sensor, and the signal processor may be implemented by a digital signal processor (DSP). In addition, the camera sensor and the signal processor may be integrally implemented or may be separately implemented.

The image processor 50 performs a function of generating screen data for displaying an image signal output from the camera unit 40. The image processor 50 processes the image signal output from the camera unit 40 in units of frames, and outputs the frame image data according to the characteristics and size of the display unit 60. In addition, the image processing unit 50 includes an image codec and performs a function of compressing the frame image data displayed on the display unit 60 in a set manner or restoring the compressed frame image data to the original frame image data.

The display unit 60 displays a frame image signal output from the image processor 50 on a screen, and displays user data output from the controller 10. In addition, the display unit 60 displays a video signal reproduced under the control of the controller 10. The display unit 60 may use an LCD. In this case, the display unit 60 may include an LCD controller, a memory capable of storing image data, and an LCD display device. In this case, when the LCD is implemented using a touch screen method, the LCD may operate as an input unit.

The communication interface 70 is connected to an external communication device to perform a function of communicating a picture image with a portable terminal. The external communication device may be a scanner, a computer, a digital camera, or the like. The communication interface 70 may perform a function of communicating with the external communication devices under the control of the controller 10 to output a stored picture image or to receive a picture image.

Referring to FIG. 1, the mobile phone according to an embodiment of the present invention may perform an operation of displaying or transmitting a person or a surrounding environment on a video screen. First, the camera unit 40 may be mounted on a portable telephone or connected to a predetermined position outside. That is, the camera unit 40 may be an external camera or an internal camera. The camera unit 40 may use a charge coupled device (CCD) sensor. The image captured by the camera unit 40 is converted into an electrical signal by an internal CCD sensor, and then the signal processor converts the image signal into digital image data. The converted digital image signal and the synchronization signal are output to the image processor 50. The synchronization signal may be a horizontal synchronization signal (Hsync) and a vertical synchronization signal (Vsync).

2 is a diagram illustrating an example of a configuration of the image processor 50 according to an embodiment of the present invention.

Referring to FIG. 2, the camera interface 211 interfaces the image data and the synchronization signals HREF and VREF from the camera unit 40. The HREF is a horizontal validity period flag, which is used as a line synchronization signal. The HREF may be a horizontal synchronization signal for reading image data stored in a line memory in the camera unit 40 on a line basis. The VREF is used as a frame synchronization signal as a vertical validity period flag. The VERF is used as a signal that can be transmitted by the signal processor 60 which processes the image data photographed by the camera unit 40. The VREF is generated in units of one frame and may be a vertical synchronization signal.

The LCD interface 217 may access the image data of the controller 10 and the display screen generator by switching the selector 219.

The scaler 213 performs a function of scaling the magnitude of the image signal photographed by the camera unit 40 to the magnitude of the image signal that can be displayed on the display unit 60. That is, the number of pixels of the one-frame video signal photographed by the camera unit 40 is different from the number of pixels of the one-frame video signal that can be displayed on the display unit 60. The scaler 213 reduces (decimates) the number of pixels of one frame photographed by the camera unit 40 to the number of pixels of one frame that can be displayed on the display unit 60 or sets an appropriate number of pixels of the photographed one frame. To display on the display unit.

The image codec 231 compresses the captured image signal or restores the compressed image signal to the original image signal. In an embodiment of the present invention, the image codec 231 is assumed to be a JPEG codec. The image codec 80 performs JPEG compression on the image data output from the camera unit 40 and outputs the encoded data to the control unit 10 or restores the compressed coded data input from the control unit 10 to the scaler 213. Perform.

The small screen processing unit 221 reconstructs the image data output from the image processing unit to the set small screen. The small screen processing unit 221 cuts the left and right ends and the top and bottom ends of the video screen displayed on the display unit 60 to a predetermined size, and then decimates the pixels of the cut video screen to generate a small screen.

The control interface 221 performs an interface function between the image processor 50 and the controller 10, and also performs an interface function between the display unit 60 and the controller 10. That is, the control interface 221 performs an interface function between the controller 10 and the image processor 50. The control interface 221 is a common interface for accessing the image processor 50 and the display unit 60 through the image processor 50.

The selector 219 selects data output from the image processor 50 or data output from the controller 10 according to the control signal output from the controller 10 and outputs the data to the display unit 60. Here, the first control signal refers to a signal for activating a bus between the image processor 50 and the display 60, and the second control signal is a signal to activate a path between the controller 10 and the display 60. In addition, the controller 10 may perform the bidirectional communication between the display unit 60 through the selector 219.

Accordingly, the portable terminal having the configuration as shown in FIGS. 1 and 2 may receive a video screen obtained from the camera 40, the RF unit 23, the communication interface unit 70, and the like and store the picture image in the memory 30 as a picture image. They may be stored as a small screen through the small screen processor 241 of the image processor 50. Therefore, a picture image and a corresponding small screen image may be stored in the image memory area of the memory 30.

In the above state, the user may check and edit the photo image stored in the memory 30. At this time, the controller 10 accesses the small screen images stored in the memory 30 and displays them on the display unit 60 in the screen display mode, and the user checks the small screen images displayed on the display unit 60 and selects a desired image to edit the mosaic. Can be performed.

In general, mosaic processing in a photographic image means setting a specific region of the photographic image and making the photographic image of the set region not clear. That is, the mosaic effect fills the average value of the corresponding pixel in the internal or external region set as shown in FIG. 6 to make the photographic image unclear.

FIG. 3 is a flowchart illustrating a process of displaying a mosaic process on a selected photographic image according to an exemplary embodiment of the present invention, and FIG. 4 is a diagram for describing a process of obtaining an average value using a mask block in an area of the photographic image of FIG. 3. Drawing.

Referring to FIG. 3, when a display mode capable of displaying image data is selected in step 311, the user proceeds to step 312 in which a user selects a desired picture. If a function key for a mosaic effect is selected after selecting a photo in step 312, the controller 10 detects it in step 313 and proceeds to step 314. In step 314, a size of a mask block for determining an average value of pixel data in a specific region of the photo image is determined, and X and Y parameters are initialized according to the movement of the mask block in the photo image region. In an embodiment of the present invention, it is assumed that the size of the mask block is 3x3.

First, in step 315, the controller 10 determines the position of the mask block located in the area of the photo image, and then proceeds to step 317 in which the sum of the pixel data in the mask block is calculated. Thereafter, in step 318, the average value of the calculated pixel data is calculated, and the process proceeds to step 319 in which the average value is stored as a value of the center pixel in the mask block. 4B shows a mask block 330 positioned in the photographic image when the X and Y variables are 0. FIG. In this case, the controller 10 obtains a sum by adding nine pixel data in a 3x3 mask block 330, and then divides the sum by the size of the mask block to obtain an average value. The average value thus obtained becomes the value of the center pixel 1 in the mask block and is stored in the memory 30.

After storing the average value in step 319, it is determined whether the mask block is located at the end of the Y coordinate of the photographic image. If it is not located at the end, it is detected in step 320 and the value of the Y variable is increased by '1'. Proceed to step 321. Then repeat steps 315-320 again. 4C illustrates that the mask block 330 moves after the process of FIG. 4B to obtain an average value of pixel data of a next specific region.

If the mask block is positioned at the end of the Y coordinate of the photographic image while repeating steps 315 to 320, the controller 10 detects it at step 320 and the mask block is the last of the X coordinate of the photographic image. Determine if it is located at If the mask block is not located at the end of the X coordinate of the photographic image, the control unit 10 detects it in step 322 and proceeds to step 323 in which the X variable is increased by '1' and the Y variable is initialized. Thereafter, steps 315 to 322 are repeated again. If the mask block is positioned at the end of the X coordinate of the photographic image during steps 315 to 322, the control unit 10 detects this in step 322 and proceeds to step 326.

However, when the average value is obtained using the mask block in the photo image area, an area in which the mask block cannot be used is generated and pixels that do not have an average value occur. 4B illustrates a process of using the mask block when the X and Y variables are '0', and FIG. 4C illustrates a process of using the mask block by increasing the Y variable by '1'. As described above, when the X variable is '0', the Y variable is increased and when the mask block is used, the pixels of the first X coordinate lines A of the photo area do not have an average value. In addition, as shown in FIG. 4D, a 3 × 3 mask block cannot be applied to the last Y coordinate of the photo region, so that pixels of the last Y coordinate lines B ′ cannot obtain an average value. 4E illustrates a process of using a mask block by increasing an X variable by '1'. As shown in FIG. 4E, the pixels of the first Y coordinate lines B 'do not obtain an average value. As a result, the pixels of the first X coordinate lines (A), the last X coordinate lines (A '), the first Y coordinate lines (B), and the last Y coordinate lines (B') in the photograph area do not have an average value. . Therefore, in the embodiment of the present invention, the pixels having no average value are stored with the average value of the surrounding pixels as the corresponding value, and the process is performed in steps 324 to 319.

In an embodiment of the present invention, it is assumed that a circle-shaped area is displayed as a mosaic inside the center of the photo area. Therefore, after performing steps 315 to 322, the controller 10 fills the average value of the corresponding pixels in the inner region of the circle determined as the defaults in steps 326 to 327. Then, as shown in FIG. 6B, the mosaic-processed photographic image is displayed only inside the circle region. The shape, size, position, etc. of the region for the mosaic processing may be changed, which will be described in detail with reference to FIG. 5.

According to an exemplary embodiment of the present invention, a method of performing a mosaic process by storing an average value of pixels of the entire selected photographic image and then filling the average value of the corresponding pixel in the set area is described. The average value of the pixels may be obtained and filled.

FIG. 5 is a process of setting a region in which a mosaic is displayed according to an embodiment of the present invention.

Referring to FIG. 5, when a function key for a mosaic effect is selected after selecting a picture, the controller 10 detects it in step 411 and proceeds to step 412. In operation 412, after performing the process of FIG. 3, a photographic image in which a partial region is displayed as a mosaic is displayed. In the embodiment of the present invention, as shown in FIG. 6B, it is assumed that a photographic image in which a mosaic inside the original area is processed is displayed. If the user selects the corresponding key to change the area where the mosaic is displayed, the controller 10 detects this in step 413. The corresponding key for changing the area where the mosaic is displayed may be used by setting a side key or a direction key located on the side of the portable terminal. If the user selects the outside of the circle through the area change key, the controller 10 detects it in step 414 and proceeds to step 417 to set an external area to display the mosaic. At this time, the size of the circle, the internal or external region setting, etc. can be known by the controller 10 through a program stored in the memory. Therefore, the controller 10 proceeds to step 418 in which the mosaic is displayed on the outer region of the set circle through Equation 1 below.

F = ((k-y coordinate) * (k-y coordinate)) + ((l-x coordinate) * (l-x coordinate))-(Mosaic circle size)

Where k = x coordinate + horizontal size of mask block

l = y coordinate + height of mask block

As shown in FIG. 6D and step 418, the mosaic may be displayed on the outer region of the circle by filling the average value only in a value (pixel) whose 'F' value is greater than '0' through Equation (1).

In addition, when the user selects the inside of the circle through the area change key, the controller 10 detects it in step 414 and proceeds to step 415 in which an internal area for displaying a mosaic is set. Then, the controller 10 may display a mosaic in the inner region of the circle as shown in FIG. 6B by filling the average value only in a value (pixel) whose 'F' value is smaller than '0' through Equation (1). Proceed to step 416.

In step 412, when the user selects a corresponding key to change the shape in which the mosaic is displayed, the controller 10 detects this in step 419. The corresponding key for changing the shape in which the mosaic is displayed may be used by setting a side key or a direction key on the side of the portable terminal. In the exemplary embodiment of the present invention, the mosaic display shape is assumed to be a circle shape or a rectangle, but various shapes may be used according to the user's taste.

If the user selects a rectangle by manipulating a shape change key, the control unit 10 detects it in step 420 and proceeds to step 423 in which an area of a rectangle to display a mosaic is set. In this case, the controller 10 may determine the area setting according to the circle or the rectangle through a program stored in a memory. Therefore, the controller 10 proceeds to step 424 in which the mosaic is displayed inside the rectangle as shown in FIG. 6C by filling the average value only in the value (pixel) corresponding to Equation 2 through Equation 2 below.

Where k = x coordinate + horizontal size of mask block

l = y coordinate + height of mask block

In this case, when the user selects a key for changing the mosaic display area in order to display the mosaic on the outside of the rectangle, the controller 10 detects it in steps 413 and 414 and proceeds to step 417. If the external area of the rectangle to display the mosaic is set in step 417, the control unit 10 fills the average value only with a value (pixel) corresponding to Equation 3 through Equation 3, as shown in FIG. The flow proceeds to step 418 in which the mosaic is displayed outside the rectangle.

Where k = x coordinate + horizontal size of mask block

l = y coordinate + height of mask block

In addition, when the user selects a key for changing the size of the area where the mosaic is displayed in step 421, the controller 10 detects this in step 425. If the size of the mosaic display area can be changed using a direction key, the key set in the mosaic mode may be used. In the embodiment of the present invention, it is assumed that the direction key. If the user enlarges the area by changing the size of the area where the mosaic is displayed through the direction key, the control unit 10 detects it in step 426 and proceeds to step 427 to expand the display area. At this time, if the mosaic is displayed inside the circle or rectangle area, the mosaic will be displayed on the inner area of the circle or rectangle, which is expanded through steps 415 to 416. Alternatively, if the mosaic is displayed outside the area of the circle or rectangle, the mosaic is displayed on the outside area of the circle or rectangle, which is enlarged through steps 417 to 418.

If the user reduces the area by changing the size of the area where the mosaic is displayed through the direction key, the control unit 10 detects it in step 426 and proceeds to step 429 to reduce the display area. At this time, if the mosaic is displayed inside the circle or rectangle area, the mosaic is displayed on the reduced area of the circle or rectangle in steps 415 to 416. Alternatively, if the mosaic is displayed outside the area of the circle or the rectangle, the mosaic is displayed on the outside area of the circle or the rectangle reduced in steps 417 to 418.

In addition, when the user selects a key for moving the area where the mosaic is displayed in step 421, the controller 10 detects this in step 431. The area shift key on which the mosaic is displayed may use a key set for movement in the mosaic mode if the size change of the mosaic display area can be used as a direction key. Whenever the user moves the area in which the mosaic is displayed by operating the key for moving the area in step 432, the controller 10 receives the information about the location and fills the average value in the moved area to display the mosaic.

In this case, the user may proceed to step 433 of changing the shape of the area where the mosaic is displayed at the moved position. In step 433, steps 420 through 424 are performed. In operation 434, the user may change the size of the area where the mosaic is displayed. In this case, steps 426 to 429 may be performed. In addition, the user may set an internal or external area in which the mosaic is displayed in step 435, in which steps 414 to 418 are performed. The mosaic changed and set as described above is displayed on the display unit 60 in step 436.

As described above, the selected photographic image may be displayed as a mosaic-processed photographic image in the mobile terminal storing the photographic image. As a result, the photographic image may be re-edited into various image screens. In addition, the mosaic image can be displayed as described above and can be stored in an external device through a communication interface or transmitted to a base station and transmitted to other subscribers, thereby improving the display function of the terminal.

Claims (5)

In the method of displaying a mosaic image of the mobile terminal, Setting the area of the entire image data; Setting a mask block for obtaining an average value of pixel data in a specific region; Moving the mask block in the area of the entire image data and storing an average value in the located block; And when the mask block is positioned last, displaying a mosaic by inputting an average value corresponding to an area set for mosaic processing. The method of claim 1, Wherein the area set for the mosaic processing is a circle or a square. The method of claim 1, Wherein the mosaic is displayed inside or outside the area set for the mosaic processing. The method of claim 1, The method of claim 1, wherein the size of the area set for the mosaic processing is adjusted. The method of claim 1, Wherein the position of the area set for the mosaic processing is moved.