KR101389775B1 - Apparatus and method for displaying image at liquid crystal display in wireless communication terminal - Google Patents

Abstract

The present invention relates to an apparatus and method for setting an image on a screen in a wireless communication terminal, and an apparatus for setting an image on a screen in a wireless communication terminal, wherein the face region is detected by detecting feature points of a face image from an input image. A region setting unit configured to set a trimming region in the image so that the detected face region matches the liquid crystal display (LCD) screen size ratio of the terminal, and the trimmed image is displayed according to a corresponding application. Including a control unit to solve the problems caused by the difference in size ratio between the image and the LCD when configuring the background screen, the slide show, and the caller ID display in the wireless communication terminal.

Face Detection, Trimming, Wallpaper, Caller ID, Slide Show.

Description

Apparatus and method for setting image on screen in wireless communication terminal {APPARATUS AND METHOD FOR DISPLAYING IMAGE AT LIQUID CRYSTAL DISPLAY IN WIRELESS COMMUNICATION TERMINAL}

The present invention is to set the image on the screen by trimming the image centered on a person or a specific point designation when configuring the wallpaper, slide show, and caller ID (Caller ID) in the wireless communication terminal Device and method.

As the technology of the information communication and electronics industry has developed rapidly, the functions of wireless terminals have become very advanced and diverse. As a result, the LCD screen of the wireless terminal has become large and clear enough to realize digital images at the photographic level, and the storage of a large number of digital images, which requires a large amount of storage space, is also required due to the development of memory chip technology. It became possible enough in terminal. Meanwhile, wireless terminals equipped with digital cameras have recently been introduced and are rapidly spreading. Mobile phones equipped with such digital cameras have both a photographing function and a transmission function thereof. With little or no place constraints, people can take a photo anytime, anywhere and send it to their mobile phone simply and easily.

As described above, with the spread of the camera phone, it supports more various services that can provide various beneficial and interesting information from the image taken with the camera phone. For example, the user photographed image may be set as a wallpaper, used for a slide show, a caller ID setting, or the like.

Images taken from the camera have a ratio of length longer than portrait, but the size of LCD (Liquid Crystal Display) of wireless communication terminal has a ratio of length longer than width. Therefore, when setting a portrait picture as a wallpaper or configuring a slide show on a wireless terminal, a picture having a longer width is set on the LCD screen having a higher length. Rotate or zoom out while maintaining overall angle of view. In addition, a method of cropping unnecessary portions based on the center region of the image may be used. Alternatively, in the case of an image registered in the caller ID, the resizing (ignoring the difference in the ratio between the horizontal and vertical ratio of the user interface (hereinafter referred to as "UI") and the actual photo) Resizing method is used.

1 illustrates an example of outputting an image having a length longer than a length to a display screen having a length longer than a width.

Referring to FIG. 1, in the case of a camera sensor, an image is generally output at a ratio longer than a width in length. However, since the terminal UI displays the portrait at a longer ratio than the width, the following method is used to set the screen background, the slide show, or the caller ID display using the image having the longer ratio.

When setting the screen background, there is a problem that a blank space is generated at the top and bottom of the LCD by adjusting the vertical LCD in a state in which the entire view angle of the image is maintained on the original screen (see Fig. 1 (a)). When the image is vertically aligned with the vertical length of the LCD, the left and right portions of the image are cropped. If the object to be set as the background is not located at the center, the object to be set may exist outside the cropping area (see FIG. 1 (b)).

When the slide show is generated, a long horizontal image is formed on the LCD having a vertical length so that a blank space is generated at the top and bottom of the LCD (see FIG. 1 (a)). When placing a slide show photo in a landscape view (Landscape view) in a vertical mood, there is a problem that the image is displayed in a rotated form on the mobile phone fitted to the vertical UI (see Fig. 1 (c)).

When setting the caller ID display, there is a difference between the aspect ratio of the picture and the ratio of the image registered as the caller ID display, resulting in a distortion of the expressed caller ID display ratio (see FIG. 1 (d)). .

As described above, an apparatus and method for solving a problem caused by a difference in size ratio between an image and an LCD when configuring a background screen, a slide show, and a caller ID display in a wireless communication terminal are proposed.

According to a first aspect of the present invention for achieving the above object, an apparatus for setting an image on a screen in a wireless communication terminal, the area setting unit for detecting a facial region by detecting feature points of the face image from the input image And a region generation unit configured to set a trimming region in the image so that the detected face region matches a liquid crystal display (LCD) screen size ratio of the terminal, and a controller which displays the trimmed image according to a corresponding application. Characterized in that.

According to a second aspect of the present invention for achieving the above object, in the apparatus for setting the image on the screen in the wireless communication terminal, setting the ratio of the trimming region in accordance with the aspect ratio of the image to be used for a specific application And a region setting unit, a region generator for maintaining a ratio of an image to be used in the specific application and generating a trimming region, and a controller for displaying the trimmed image according to the specific application.

According to a third aspect of the present invention for achieving the above object, a method for setting an image on a screen in a wireless communication terminal, the method comprising: detecting a facial region by detecting the feature points of the face image from the input image; And setting a trimming region on the image so that the detected face region matches a liquid crystal display (LCD) screen size ratio of the terminal, and displaying the trimmed image according to a corresponding application. do.

According to a fourth aspect of the present invention for achieving the above object, in a method for setting an image on a screen in a wireless communication terminal, the ratio of the trimming region is set according to the aspect ratio of the image to be used for a specific application And a process of generating a trimming area while maintaining a ratio of an image to be used in the specific application, and displaying the trimmed image according to the specific application.

As described above, when the background screen, the slide show, and the caller ID display are configured in the wireless communication terminal, problems caused by the difference in the size ratio between the image and the LCD can be solved. In addition, the photographed image and other portrait images may be automatically trimmed or trimmed by specifying a specific point using a user interface (UI) of the wireless communication terminal without using a computer or other image tools, and may be applied to various applications. It can provide differentiated functions.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The following terms are defined in consideration of the functions of the present invention, and may be changed according to the intentions or customs of the user, the operator, and the like. Therefore, the definition should be based on the contents throughout this specification.

Hereinafter, the present invention trims the picture centering on a person or by designating a specific point when configuring a wallpaper, a slide show, and a caller ID in a wireless communication terminal. The apparatus and method to set will be described.

2 illustrates a terminal device for setting an image on a screen according to an exemplary embodiment of the present invention. In the following description, the terminal includes a cellular phone, a personal communication system (PCS), a personal data assistant (PDA), and an international mobile telecommunication-2000 (IMT-2000) terminal. The following description will be described with the general configuration of the above examples.

Referring to FIG. 2, a control unit (MPU: Micro-Processer Unit) 200 controls the overall operation of the wireless communication terminal. For example, processing and control for voice call and data communication are performed, and in addition to the normal function, the controller 200 compares whether the image size is larger than the LCD screen or determines whether the input image is a portrait photograph. The result is notified to the area setting unit 204. In addition, by controlling an application for processing and outputting a video image, the video image trimmed by the video generating unit 206 is used for setting a background screen, a slice show, or a caller ID display.

The memory unit 202 stores the microcode of the program and various reference data for processing and control of the control unit 200. In addition, the working memory of the controller 200 stores temporary data generated during various programs. In addition to the usual functions, the video image trimmed by the area generator 206 is stored. The stored image may be used for setting a background screen, a photo slide show of a standby screen state, and setting a caller ID display image.

Key pad 224 is a numeric key buttons of 0-9, menu button (menu), cancel button (clear), confirmation button, call button (TALK), end button (END), Internet access button, A plurality of function keys such as navigation key (or direction key) buttons (▲ / ▼ / ◀ / ▶) are provided, and key input data corresponding to a key pressed by the user is provided to the controller 200. The display unit 210 displays status information generated during operation of the terminal, a limited number of characters, a large amount of video and still images, and the like. The display unit 210 may use a color liquid crystal display (LCD) and output a stored message.

The codec (Coder-Decoder) 212 connected to the control unit 200 and the speaker 216 and the microphone 214 connected to the codec 212 are voice input / output blocks used for phone calls and voice recording. . The codec 212 converts the PCM data provided from the controller 200 into an analog voice signal, transmits the same through the speaker 216, and converts the voice signal received through the microphone 214 into PCM data. It provides to the control unit 200.

In addition, the RF module 220 reduces the frequency of the radio frequency signal received through the antenna 218 to the baseband processor 222, and provides the baseband signal from the baseband processor 222. The frequency is raised and transmitted through the antenna 218. The baseband processor 222 processes a baseband signal transmitted and received between the RF unit 220 and the controller 200. For example, it performs channel coding and spreading of data to be transmitted in case of transmission, and despreads and channel-decodes a received signal in case of a receiver .

The area setting unit 204 receives an image from the control unit 200 and automatically detects a face area in the input image. That is, the position information of the mouth is searched to find the position of the eye and the direction of the face that may be characteristic of the human face in the input image. According to the implementation, the coordinate information of the eyes and mouth of the person in the image may be input through the user interface UI, or the characteristic part may be set using a navigation key. Here, as a method of detecting feature points from a face image, various articles related to image processing (for example, RA Messner and HHSzu, "An image processing architecture for real time generation of scale and rotation invariant patterns" Computer Vision, Graphics and Image Processing, 31, pp. 50-66, 1985; K. Hotta T. Kurita, and T. Mishima, "Scale invariant face detection method using higher-order local autocorrelation features extracted from log-polar image" Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition, Nara, Japan, pp 70-75, Apr. 1998; TS Lee "Image Representation Using 2D Gabor Wavelets", IEEE Trans PAMI, Vol. 18, No. 10, Oct 1996; L Wiskott, J. Marc, Fellous NK "Face Recognition by Elastic Bunch Graph Matching", IEEE Trans. PAMI, Vol. 19, No. 7, pp. 775-779, July 1997; or WYJeong and KMLee "Rotation and Scale Invariant Face Detection Using Gabor Wavelet Filter and Log-polar Mapping "Comput er vision and image processing 13th KOREA.Jan. 2001.) by using the methods disclosed in this document as they are or as appropriately modified, first extracting facial regions from the transmitted image, and then extracting feature points for the pupils, Feature points for eyebrows, noses and lips can be extracted.

In particular, for extracting feature points of each facial component such as eyes, eyebrows, nose, mouth, etc., several conventional papers (eg, Nilanjan Rayand Scott T. Acton "Adaptive Image Processing via Snake Filters" Virginia Image and Video Analysis) (VIVA), Department of Electrical and Computer Engineering, University of Virginia, Charlottesville, VA 22904 .; L. Vincent, "Morphological area openings and closings for grey-scale images," In Shape in picture: Mathematical description of shape in gray level images, Y.-LO, A. Toet, D. Foster, HJAM Heijmans, and P. Meer, editors, pp. 197-208, NATO, 1993 .; F. Cheng and AN Venetsanopoulos, "An adaptive morphological filter for image processing, "IEEE Transactions on Image Processing, vol. 1, pp.533-539, 1992 .; or P. Salembier and J. Serra," "Flat zones filtering, connected operators and filters by reconstruction," IEEE Transactions on Image Processing , vol. 8, pp. 1153-1160, 1995. It may be used in Hi strain.

Also, when there is no person in the input image, the area setting unit 204 sets the trimming area ratio according to the aspect ratio of the image used in the application through the user interface, and the ratio of the image to be used in the set application application. Create a trimming area while maintaining

The area generator 206 estimates the overall size of the face using the detected eye and mouth positions, automatically trims the face area of the portrait by using this information, and then outputs the result to the memory unit 202. Store in In addition, the trimming area is generated while maintaining the ratio of the image to be used in the application application set by the area setting unit 204.

The trimming region correction unit 208 performs a process of expanding or narrowing the size of the region and editing the best region by moving the region with respect to the set trimming region, and then returns the result to the region generator 206. Notify me.

Here, the region setting unit 204, the region generating unit 206, and the trimming region correction unit 208 have been described separately from the control unit 200 for convenience of explanation. 204, the region generator 206 and the trimming region correction unit 208 may be implemented as a part or the entire function of the controller 200. That is, the controller 200 may perform the functions of the area setting unit 204, the area generation unit 206, and the trimming area correction unit 208.

3 is a flowchart for setting an image on a screen in a wireless communication terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 3, the terminal receives an image in step 300. Here, the input image may be an image photographed by a camera attached to the terminal, an image photographed by a general camera, and an image photographed by other persons.

Thereafter, the terminal compares whether the image size is larger than the LCD screen in step 302. When the input image size is larger than the LCD screen, the terminal proceeds to step 306 and automatically detects a face region in the input image. That is, the position information of the mouth is searched to find the position of the eye and the direction of the face that may be characteristic of the human face in the input image. 5A illustrates an example of detecting a mouth and an eye from an input image. In some implementations, coordinate information of an eye and a mouth of a person in an image may be input through a user interface (UI), or a characteristic point may be set using a navigation key.

If the image size is not larger than the LCD screen in step 302, the mode proceeds to 304. For example, the image captured in the corresponding mode is immediately used for the corresponding application (for example, a wallpaper, a slide show, and a program for setting the caller ID display) without trimming.

Thereafter, the terminal predicts the overall size of the face using the positions of the eyes and the mouth detected in step 308 and automatically trims the face region of the portrait by using this information (see FIG. 5 (b)). Figure 5 (b) is when the position of the eyes and mouth of the person in the input image is obtained by using the information to predict the area corresponding to the face automatically set the size to fit the ratio of the LCD size photographed area The above example shows to the user.

Thereafter, when the terminal desires to modify the trimming region set in step 310, the terminal edits the best region by moving the region and the process of widening or narrowing the size of the trimming region automatically obtained in step 312. Perform a procedure (see FIG. 5 (c) below). On the other hand, when it is not desired to modify the trimming region in step 310, the trimming region obtained automatically is used (see FIG. 5 (b)).

5 (c) shows an example in which the trimming region can be edited when the user needs to edit the region for the trimming region automatically obtained in FIG. 5 (b). As a criterion for editing the trimming area, the size may be set large or small while maintaining the size ratio of the LCD in the trimming area automatically obtained in FIG. 5 (b). In addition to the size setting, the user may move the position of the area in parallel. The editable range must be equal to or larger than that of the LCD while maintaining the ratio of the LCD size, and the trimming area must be within the range of the picture area.

In step 314, the terminal stores the automatic trimming area or the trimming area edited to a size and position desired by the user.

Then, the terminal is applied to a variety of applications using the image stored in step 316. For example, the stored image is used for setting a background screen, a photo slide show in a standby screen state, and setting a caller ID display image.

5 (d) shows an example of using the trimmed person area in a background application. This application can be used for applications such as photo slides in the usual screen state. Another application example may be used in an example of registering a picture such as displaying a caller ID by registering a picture when registering a phone number. In case of the picture set as caller ID display, the size is not set according to the size of LCD, but its size varies according to the defined UI. In this case, the area of FIG. 5 (b) is not set to the LCD size ratio to suit the size ratio of the calling party number display, but is automatically set to match the calling party number size ratio, and the user modifies the trimming area in a subsequent step. In this case, the trimming area can be modified and stored to fit the size ratio, and then applied to the caller ID display application.

Thereafter, the algorithm of the present invention terminates.

As described above, the face region may be trimmed using the positions of the eyes and the mouth obtained through the automatic face region detection method in the person image, and may be applied to various applications.

4 is a flowchart for setting an image on a screen in a wireless communication terminal according to another embodiment of the present invention.

Referring to FIG. 4, the terminal receives an image in step 400. Here, the input image may be an image photographed by a camera attached to the terminal, an image photographed by a general camera, and an image photographed by other persons.

In step 402, the terminal determines whether the input image is a portrait, and if there is no person in the input image, the terminal proceeds to step 404 and the ratio of the trimming area to the aspect ratio of the image used in the application through the UI. Set. The terminal generates a trimming area while maintaining the ratio of the image to be used in the application application set in step 406.

In other words, if it is not a portrait, when the ratio of the image to be used for a specific application is input, the trimming area is displayed while maintaining the input ratio (see Fig. 6 (a). It can be used as a method of trimming by inputting a ratio without selecting a feature point of a face.

Further, depending on the implementation, the coordinate information of the eye and mouth of the person in the image may be input through the user interface, or the characteristic part may be set using the navigation key (see FIG. 6 (b)).

If there is a person in the input image, the terminal detects a face region in the input image in step 408. Here, the position information of the mouth is searched to find the position of the eye and the direction of the face that may be characteristic of the human face in the input image. The terminal predicts the overall size of the face using the positions of the eyes and the mouth detected in step 410, and automatically trims the face area of the portrait picture using this information. The face region detecting step 408 and the trimming the face region 410 are the same as the operations 306 and 308 of FIG. 3.

Thereafter, when the terminal desires to modify the trimming region in step 412, the terminal can edit the best region by moving the region and the process of widening or narrowing the region size with respect to the trimming region obtained automatically in step 414. Perform a procedure (see FIG. 6 (c) below). On the other hand, when it is not desired to modify the trimming region in step 412, the trimming region obtained automatically is used (see FIG. 6 (b)).

6 (c) shows an example in which the trimming area can be edited when the user needs to edit the trimming area automatically obtained in FIG. 6 (b). As a criterion for editing the trimming area, the size may be set large or small while maintaining the size ratio of the LCD in the trimming area automatically obtained in FIG. 6 (b). In addition to the size setting, the user may move the position of the area in parallel. The editable range must be equal to or larger than that of the LCD, while maintaining the aspect ratio of the cell phone LCD, and the trimming area must be within the range of the picture area.

In step 416, the terminal stores the auto trimming area or the trimming area edited to a size and position desired by the user.

Thereafter, the terminal applies the various applications using the stored image in step 418. For example, the stored image is used for setting a background screen, a photo slide show in a standby screen state, and setting a caller ID display image.

6 (d) shows an example of using the background screen application for the trimmed region. This application can be used for applications such as photo slides in the usual screen state. Another application example may be used in an example of registering a picture such as displaying a caller ID by registering a picture when registering a phone number. In case of the picture set as caller ID display, the size is not set according to the size of LCD, but its size varies according to the defined UI. In this case, the area of FIG. 6 (b) is not set to the LCD size ratio to fit the size ratio of the calling party number display, but is automatically set to match the size of the calling party number display size. In this case, the trimming area can be modified and stored to fit the size ratio, and then applied to the caller ID display application.

Thereafter, the algorithm of the present invention terminates.

As described above, in the case of a portrait image, a user may input a position of an eye and a mouth to trim a face region and apply it to various applications. In addition, when the image is not a person, an area to be trimmed may be generated in the image by setting the aspect ratio of the image to be used in a specific application.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments, but is capable of various modifications within the scope of the invention. Therefore, the scope of the present invention should not be limited by the illustrated embodiments, but should be determined by the scope of the appended claims and equivalents thereof.

1 illustrates an example in which an image having a length longer than a length is output to a display screen having a length longer than a width;

2 is a terminal device for setting an image on a screen according to an embodiment of the present invention;

3 is a flowchart for setting an image on a screen in a wireless communication terminal according to an embodiment of the present invention;

4 is a flowchart for setting an image on a screen in a wireless communication terminal according to another embodiment of the present invention;

5 is an exemplary diagram of trimming an image around a person and setting a screen in a wireless communication terminal according to the present invention;

6 is an exemplary diagram of trimming an image with a specific point designation and setting it on a screen when setting a background screen in a wireless communication terminal according to the present invention.

Claims (25)

An apparatus for setting an image on a screen in a wireless communication terminal, A region setting unit which detects feature regions of the face image from the input image and detects a face region; An area generation unit configured to set a trimming area in the image so that the detected face area corresponds to a display screen size ratio of the wireless communication terminal; A trimming region correction unit for adjusting the size of the trimming region; And a controller configured to display an image corresponding to the adjusted trimming area using a corresponding application. delete The method according to claim 1, The criterion for adjusting the size of the trimming area is characterized in that the size of the trimming area is automatically adjusted while maintaining the display screen size ratio of the terminal. The method according to claim 1, The application is one of a program for setting a wallpaper, a photo slide show of a standby screen, and a caller ID display. The method according to claim 1, The area setting unit detects a face area by receiving a coordinate value obtained through a specific point or a user interface of the image designated as a navigation. The method according to claim 1, The control unit compares the image size with the display screen size. An apparatus for setting an image on a screen in a wireless communication terminal, An area setting unit that sets a ratio of the trimming area to an aspect ratio of an image to be used for a specific application; An area generator configured to generate a trimming area while maintaining a ratio of an image to be used in the specific application; A trimming region correction unit for adjusting the size of the trimming region; And a controller configured to display an image corresponding to the adjusted trimming area using the specific application. delete 8. The method of claim 7, The criterion for adjusting the size of the trimming area is characterized in that the size of the trimming area is automatically adjusted while maintaining the display screen size ratio of the terminal. 8. The method of claim 7, The specific application is one of a program for setting a wallpaper, a photo slide show of a standby screen, and a caller ID display. 8. The method of claim 7, And the area setting unit receives a coordinate value obtained through a specific point or a user interface of the image designated as a navigation and sets a specific trimming area. 8. The method of claim 7, The controller checks whether the image is a portrait. 13. The method of claim 12, And when the image is determined to be a portrait, detecting a face by detecting feature points of an existing face, and setting a trimming area based on the detected face area. In the method for setting the image on the screen in the wireless communication terminal, Detecting a face region by detecting feature points of the face image from the input image; Setting a trimming area in the image such that the detected face area is in accordance with a ratio of a screen size of a display of the wireless communication terminal; Adjusting the size of the trimming region; And displaying an image corresponding to the adjusted trimming area using a corresponding application. delete 15. The method of claim 14, The criterion for editing the trimming area is characterized in that the size of the trimming area is automatically adjusted while maintaining the display screen size ratio of the terminal. 15. The method of claim 14, The corresponding application is one of a program for setting a wallpaper, a photo slide show of a standby screen, and a caller ID display. 15. The method of claim 14, When detecting the face area, the method characterized in that for detecting the face area by receiving a coordinate value obtained through a specific point or a user interface of the image designated as the navigation. 15. The method of claim 14, And comparing the image size with the display screen size. In the method for setting the image on the screen in the wireless communication terminal, Setting the ratio of the trimming area to the aspect ratio of the image to be used for a specific application; Generating a trimming area while maintaining a ratio of an image to be used in the specific application; Adjusting the size of the trimming region; And displaying the image corresponding to the adjusted trimming area according to the specific application. delete 21. The method of claim 20, Wherein said particular application is one of a program for setting a wallpaper, a photo slide show of a standby screen, and a caller ID display. 21. The method of claim 20, When the trimming area is set, a specific trimming area is set by receiving a coordinate value obtained through a specific point or a user interface of the image designated as a navigation. 21. The method of claim 20, And checking whether the image is a portrait. 25. The method of claim 24, And when the image is determined to be a portrait, detecting a face by detecting feature points of an existing face, and setting a trimming area based on the detected face area.

Images