KR101987748B1 - Emoticon Service System And Emoticon Service providing Method thereof - Google Patents

Abstract

The present invention relates to an emoticon service system and a method of providing an emoticon service, the terminal comprising: a terminal for collecting images, receiving the collected images and transmitting the collected images to the emoticons service apparatus, receiving the images from the terminal, The method comprising the steps of: detecting facial feature points, modifying feature points with respect to a facial image similar to the detected facial feature points, or providing at least one image effect to the modified images, and generating the generated caricature samples; And an emoticon service device for providing the service.

Description

Technical Field [0001] The present invention relates to an emoticon service system and an emoticon service providing method thereof,

The present invention relates to an emoticon service, and more particularly, to an emoticon service system that supports creation of a user-customized emoticon having high user preference and being distinguished from other emoticons by providing emoticons based on a user's face, ≪ / RTI >

Portable communication terminals provided for convenience of carrying and use have been inferior in performance and function to general personal computers due to limitations in size and weight. However, in recent years, various users It is possible to accommodate more functions while developing in the form of a smartphone equipped with functions.

Since the smartphone is equipped with an open operating system (OS), the user can freely install or delete the application. In accordance with the activation of the application store in which an arbitrary user can freely create and sell the application, Function is now available.

A typical user function applied to a high-performance communication terminal such as a smart phone is a communication function that allows a plurality of users to freely communicate using voice / text / video. Examples of such communication functions include an instant messenger, a social network service (SNS), and the like.

This communication function provides an emoticon expressing various facial expressions, shapes, emotions and feelings in order to enhance the user's enjoyment and satisfaction with the use of the emoticon. By using the emoticons in addition to the characters, the user intuitively Lt; / RTI >

However, the existing emoticons are collectively generated by the service provider and are provided to a plurality of users. Since all the users use the same emoticons, it is difficult to differentiate among the users.

Patent Document 1: KR 10-2006-0104980 A, October 09, 2006 (Name: Emoticon and avatar interworking method and system)

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide an apparatus and method for generating a user-customized emoticon having a high user preference and being distinguished from other emoticons by generating and providing emoticons And a method of providing the emoticon service of the emoticon service system.

According to the embodiment of the present invention, as means for solving the above-mentioned problems, there is provided an image processing apparatus for collecting an image including a user's face, delivering the collected image to the emoticon service apparatus, A terminal for receiving the emoticons; And an emoticon service device for extracting facial features from the image received from the terminal, generating a caricature sample reflecting the extracted facial features, and generating and providing a plurality of emoticons representing various emotions by modifying the generated caricature samples. The emoticon service system comprising:

An emoticon service apparatus according to an embodiment of the present invention includes: a device communication unit for forming a communication channel with a terminal and transmitting / receiving data; A facial feature is extracted from the received image of the user through a device communication unit, a caricature sample is generated by reflecting the extracted facial feature, and the generated caricature sample is modified to express various emotions And provides the generated emoticons to the terminal.

The emoticon service apparatus according to an exemplary embodiment of the present invention further includes a device storage unit including a face database storing a plurality of face images. The device control unit extracts facial feature points from the user's image received by the device control unit, A face image similar to the face image may be searched from the face database, and the caricature sample may be generated by changing the minutiae of the searched face image or applying at least one image effect to the minutiae changed face image.

In the emoticon service apparatus according to the embodiment of the present invention, the device control unit may enlarge or reduce at least a part of the facial feature points, adjust the facial feature points at a predetermined predetermined ratio, Processing for simplifying the feature points of the face image, processing for replacing at least a part of the feature points of the face image with a certain type of image, specific color processing for at least a part of the feature points of the face image, And at least one of the processes for solidifying at least a part of the plurality of pixels.

In addition, the device control unit of the emoticon service apparatus according to the embodiment of the present invention may include a caricature creation method according to basic outline processing, a caricature creation method using a printing format, a caricature creation method using a cartoon format, a caricature creation method using a 3D graphic format, ≪ / RTI > can be used to generate the caricature sample.

The device control unit of the emoticon service apparatus according to the embodiment of the present invention can generate a plurality of caricature samples and generate emoticons based on specific caricature samples selected by the terminal from among a plurality of caricature samples.

In addition, the terminal for supporting the emoticon service according to the embodiment of the present invention may include a facial feature extraction unit for extracting a face feature from an image including a face, generating a caricature sample reflecting the extracted feature, and expressing various emotions based on the caricature sample A control unit for generating a plurality of emoticons; A display unit displaying at least one of an image including a face, a caricature sample, and a plurality of emoticons; An input unit for generating an input signal for generating an emoticon; And a storage unit for storing at least one of an image including a face, a caricature sample, and a plurality of emoticons.

The terminal according to an exemplary embodiment of the present invention may further include a camera for capturing an image including a face.

In the terminal according to the embodiment of the present invention, the storage unit further stores a face database storing a plurality of face images, the control unit extracts facial feature points from the image including the face, and extracts facial images similar to the extracted facial feature points And to control the generation of the caricature sample by changing the minutiae point of the searched face image or applying at least one image effect to the minutiae-changed image.

The control unit of the terminal according to the exemplary embodiment of the present invention can control to generate at least one of a caricature generated based on the basic outline processing, a caricature applying a printing format, a caricature applying a cartoon format, and a caricature sample using a 3D graphic format.

In the terminal according to the embodiment of the present invention, the control unit may include at least one face caricature generated by changing the feature points of the face image or applying at least one image effect to the face image in which the feature points are changed. One - dimensional caricature applying body to facial caricature; And a three - dimensional caricature constructed by fabricating stereoscopic motion of a one - dimensional caricature; To generate at least one of them.

According to another aspect of the present invention, there is provided an emoticon service providing method comprising: acquiring an image including a face; Generating a caricature sample that reflects facial features of the image; Generating a plurality of emoticons representing various emotions by modifying the caricature sample; And providing a plurality of emoticons to the user.

In the emoticon service providing method according to the embodiment of the present invention, the step of generating the caricature sample may include extracting facial feature points of the image; Searching for a face image similar to a face feature point extracted from a face database storing a plurality of face images; And generating a caricature sample by changing a feature point of the searched face image or applying at least one image effect to a face image in which the feature point is changed.

In the method of providing an emoticon service according to an embodiment of the present invention, the step of acquiring an image may include a step of photographing an image including a face using a camera of a terminal, and a step of selecting one of images including a previously stored face Or the like.

In addition, the present invention can further provide a computer-readable recording medium on which a program for executing the emoticonic service providing method described above is recorded.

As described above, according to the emoticon service system and the emoticon service providing method according to the present invention, it is possible to generate emoticons of a user-like emoticon expressing various emotions based on the user's face, Can be provided.

In addition, the emoticon used for expressing the user's own emotions or facial expressions is implemented based on the user's own face, so that the user's emotions or expressions can be expressed more realistically, and the user's preference can be further increased, Service activation can be induced.

1 is a block diagram for explaining a configuration of an emoticon service system according to the present invention.
2 is a block diagram schematically illustrating a terminal configuration for supporting an emoticon generation service according to an embodiment of the present invention.
3 is a block diagram illustrating a configuration of a control unit of a terminal according to an embodiment of the present invention.
4 is a block diagram illustrating a configuration of an emoticon service apparatus for supporting an emoticon generation service according to an embodiment of the present invention.
5 is a flowchart illustrating an emoticon service providing method according to an embodiment of the present invention.
FIG. 6 is a flowchart illustrating a process of generating a caricature sample similar to a user's face in a method of providing an emoticon service according to an embodiment of the present invention.
7 is a signal flow diagram illustrating an emoticon service providing method according to another embodiment of the present invention.
8 is a diagram illustrating an example of an emoticon generation service according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

In the following description of the embodiments of the present invention, descriptions of techniques which are well known in the technical field of the present invention and are not directly related to the present invention will be omitted. In addition, detailed description of components having substantially the same configuration and function will be omitted.

For the same reason, some of the elements in the accompanying drawings are exaggerated, omitted or schematically shown, and the size of each element does not entirely reflect the actual size. Accordingly, the invention is not limited by the relative size or spacing depicted in the accompanying drawings.

 The present invention is for generating a plurality of emoticons representing various facial expressions and emotions using a caricature generated corresponding to a user's facial image and providing the emoticons to the user. Here, the caricature may be a character having a characteristic composition including a part of the user's facial features among arbitrarily created characters, or providing a certain image effect, thereby esthetically highlighting the feature points.

Hereinafter, a system in which the system of the present invention generates a caricature based on a user's facial image, and generates and provides emoticons from the generated caricatures will be described as a main example. However, the present invention is not limited thereto, and it is possible to generate and provide emoticons from characters of a user created by various methods based on a user's facial image.

In addition, the emoticon service according to the present invention can be performed through a standalone operation of the terminal or an interlock operation between the terminal and the server, and the following embodiments will be described taking all these points into consideration.

1 is a diagram schematically showing a configuration of an emoticon service system according to an embodiment of the present invention.

1, an emoticon service system 10 according to an embodiment of the present invention includes a terminal 100 that transmits and receives data directly or indirectly through a communication network 300, and an emoticon service apparatus 200 .

The communication network 300 is a medium for transmitting data by connecting the plurality of terminal devices 200 to the message service device 100. The communication network 300 may be a wired communication method such as the Internet or a wireless communication method including Wi- Method and a mobile communication method of various generations such as 2G, 3G, 4G, and the like.

The emoticon service system 10 collects an image including a user's face in order for the terminal 100 to generate an emoticon through the emoticon service apparatus 200 and transmits the collected image to the emoticon service apparatus 200 . Then, the emoticon service apparatus 200 included in the emoticon service system 10 generates a caricature corresponding to the corresponding image, generates an emoticon expressing various emotions based on the generated caricature, and transmits the generated emoticons to the terminal 100 . Accordingly, the emoticon service system 10 according to the present invention can provide the emoticon service to the user 100 through the emoticon service apparatus 200 even if the terminal 100 does not have a separate emoticon generation program, a face DB, a color DB, A unique emoticon can be generated and provided.

To this end, the terminal 100 may operate a camera to capture a face of a user to acquire an image to be used for generating an emoticon, or may search for and select a previously stored specific photograph, thereby collecting images for generating an emoticon. The collected images may be transmitted to the emoticon service apparatus 200 according to a user request. For this purpose, the terminal 100 may form a communication channel for image transmission to the emoticon service apparatus 200, and the communication unit for supporting the communication channel formation may include various forms such as a mobile communication module, a wireless communication module, Can be implemented.

Meanwhile, the terminal 100 may receive a plurality of emoticons representing various facial expressions and emotions generated based on the face of the user from the emoticon service apparatus 200 through the communication channel of the communication unit. The receiving terminal 100 stores the plurality of emoticons and can generate a message by applying the stored emoticons while using various communication services such as an instant messenger, a social network service, and a blog. For this, the terminal 100 may receive one or more caricature samples corresponding to an image including the face of the user before receiving the plurality of emoticons. Then, the terminal 100 outputs a caricature sample screen composed of caricature samples, so that the user can select at least one caricature corresponding to his / her preference. The terminal 100 may transmit the caricature selection information to the emoticon service apparatus 200. The emoticon service apparatus 200 may modify the facial expression, action, and gesture of the selected caricature, By adding various expressions, a large number of emoticons representing various emotions can be generated.

The emoticon service apparatus 200 is a device for supporting the emoticon generation service of the terminal 100. The emoticon service apparatus 200 may be implemented as a separate server apparatus, and may be directly or indirectly connected to the terminal 100 through wired or wireless communication. The emoticon service apparatus 200 receives an image including a face from the terminal 100, generates a plurality of emoticons representing various emotions based on the received image, and provides the generated emoticons to the terminal 100. At this time, the emoticon service apparatus 200 generates caricature samples based on the received image and provides the generated caricature samples to the terminal 100, and then the emoticons service apparatus 200 can generate the emoticons based on the caricatures selected by the terminal 100. The generated plurality of emoticons are mapped to a specific user (for example, a user of the terminal 100) and stored. When the specific user function (e.g., instant messenger) of the terminal 100 is operated, can do. For example, when an instant messenger function is operated and a message is to be transmitted, one or more of the emoticons may be attached to create a message and then transmitted to the other party. According to this, the emotion of the user can be recognized more easily through the expression or gesture of the emoticon which is similar to the other party's actual counterpart. Here, the emoticon service apparatus 200 may be designed to perform only a function of providing emoticons, or may operate an arbitrary user function (e.g., an instant messenger) using the generated emoticons. The emoticon service apparatus 200 may include a configuration as shown in FIG. 4, which will be described later in more detail.

2 is a block diagram schematically illustrating a configuration of a terminal supporting an emoticon generation service according to an embodiment of the present invention.

2, a terminal 100 according to an exemplary embodiment of the present invention includes a communication unit 110, an input unit 120, an audio processing unit 130, a display unit 140, a camera 150, a storage unit 160, And may include a control unit 170.

The terminal 100 according to the present invention having the above-described configuration can photograph a face of a user using the camera 150 or extract facial feature points from a previously stored user's photograph, and then create a customized emoticon . In particular, when generating the emoticon of the user, the terminal 100 may generate a caricature by extracting minutiae from the user's facial image, and generate a plurality of emoticons by modifying the generated caricature. When a caricature is generated based on the extracted feature points of a face, a wapping process and at least one predefined image effect are performed to generate a caricature which is more likely to be preferred by the user, And the user can select a desired caricature. In addition, the terminal 100 according to the present invention can be used not only as a caricature for a face but also as a three-dimensional caricature based on a one-dimensional caricature and a one-dimensional caricature combined with a body part at the time of generating a caricature as a base of the emoticons. And provide them. According to this, an emoticon based on a face, an emoticon capable of changing a gesture or an action, and a three-dimensional emoticon can be produced.

To this end, the terminal 100 may include a camera 150 for capturing an image including a user's face. The camera 150 may photograph an object image including a face of the user according to user control and provide the captured image to the controller 170. [ In this process, the subject image photographed by the camera 150 is preferably photographed in such a form as to extract feature points of the face. Accordingly, the control unit 170 can induce the subject image capturing so that the feature point extraction of the face required for generating the emoticon can be performed. For example, the control unit 170 may perform the feature point extraction of the face in the preview image of the subject image in real time or at regular intervals, and guide the user through the guide sound or lamp blinking so that the appropriate face feature point is extracted.

When the preview image of the subject image is searched to the extent that the facial feature point required for emoticon generation can be extracted, the camera 150 can automatically photograph the subject image under the control of the controller 170. The process of photographing a face photograph may be performed by a self camera photographing by itself in addition to a situation where a photograph is taken by another person. Therefore, the camera 150 of the present invention and the control unit 170 controlling the camera 150 can induce the image photographed by the camera 150 to be appropriately photographed so as to be used for generating the emoticons, It helps to eliminate the inconvenience. Meanwhile, when a face photograph used for emoticon generation is received from the outside through the communication unit 110 or stored in the storage unit 160 before being collected through the camera 150, the camera 150 May be omitted in the configuration of the terminal 100. [

The communication unit 110 supports a communication function of the terminal 100. The communication unit 110 may form a communication channel with another terminal or a specific service device to receive the facial image from the outside, and may receive the facial image through the communication channel. The facial photographs received by the communication unit 110 may be stored in the storage unit 160 under the control of the controller 170 or used in real time for emoticon generation. At this time, the communication unit 110 for facial image collection may be configured as a corresponding communication module to support at least one of wired and wireless methods.

Also, the communication unit 110 can support various communication services using the generated emoticons. For example, the communication unit 110 may send and receive a message for an instant messenger, and the message may include one or more of the generated emoticons. For this purpose, the communication unit 110 forms a communication channel with the instant messenger service supporting device, and can transmit a message including the emoticon through the formed communication channel.

The communication unit 110 may be configured as a communication module for supporting a wired communication method as well as a wireless communication. Accordingly, the network system may also include communication network devices for supporting the communication method. When the mobile communication or wireless communication function is supported, the communication unit 110 supports a variety of communication methods such as 2G, 3G, 4G, and Wi-Fi, such as WCDMA and OFDMA, as well as communication modules supporting communication methods such as CDMA and GSM. And a communication module for transmitting and receiving data.

The input unit 120 may be formed of a key button or the like as an input means for inputting a command, a character / number, etc. of a user. When the terminal 100 is manufactured as a full touch screen, a side key or a separate hot key And may include a key map displayed on the touch screen of the terminal 100. [ The input unit 120 may include a plurality of input keys and function keys for receiving numeric or character information and setting various functions.

In particular, the input unit 120 may include an input signal for activating a program for creating an emoticon, an input signal for image collection including a face, and a caricature sample, which is a basis of the emoticon, among specific caricature samples generated based on the collected image An input signal for selecting a caricature, an input signal for controlling various service operations in which the generated emoticons are used, and the like can be generated according to a user's operation. Here, the input signal for the image collection including the face includes input signals necessary for capturing an image including a face through the camera 150, and input signals necessary for selecting an image including a user's face among a plurality of previously stored images Input signals, and input signals necessary for receiving an image including a face from the outside through the communication unit 110. [

The audio processing unit 130 may include a speaker SPK for outputting various audio data generated during the operation of the terminal 100 and a microphone MIC for audio data collection. In particular, the audio processor 130 of the present invention supports the output of various audio data generated in the process of supporting the emoticon generation service under the control of the controller 170. For example, as described above, the camera 150 may be operated to output a guidance sound for guiding an image including a face capable of extracting a feature point of an appropriate face to be photographed when a face photograph is to be used for generating an emoticon.

For example, the audio processing unit 130 may request a zoom in / out such that an image is captured to a size enough to extract a feature point of a face, a guide sound for requesting movement of a subject, or a guide sound for guiding a subject to have proper focusing And so on. In addition, the audio processor 130 may provide a guidance sound for each process performed until the process of generating emoticons based on the image including the provided face. The guidance sound output of the above-described audio processing unit 130 may be omitted according to the user's control, or may not be provided according to the designer's intention.

The display unit 140 displays various menus of the terminal 100 as well as information input by the user or information provided to the user. That is, the display unit 140 may provide various screens such as an idle screen, a menu screen, a message creation screen, a call screen, a terminal end screen, and a terminal boot screen according to the use of the terminal 100. The display unit 140 may be formed in the form of a flat panel display panel such as a liquid crystal display (OLED) or an organic light emitting diode (OLED). The display unit 140 may be manufactured in a structure including a display panel and a touch panel according to a manufacturing method.

In particular, the display unit 140 of the present invention can provide various screen interfaces for supporting emoticon generation. For example, the display unit 140 may include a screen interface for capturing an image including a face to be used for generating an emoticon, a screen interface for providing various caricature samples generated based on the captured or stored image, A screen interface for providing a plurality of emoticons generated using the selected caricature sample from the caricature samples can be provided. Also, the display unit 140 can output a specific communication service supporting screen operated on the basis of the generated emoticons. An example of a screen interface provided through the display unit 140 will be described in detail with reference to the following drawings.

The storage unit 160 stores application programs necessary for the functional operation according to the embodiment of the present invention, a screen image to be output to the display unit 140, and the like. The storage unit 160 may store a key map or a menu map for operating the touch screen when the display unit 140 is configured as a touch screen. Here, the key map and the menu map may be various types. That is, the key map may be a keyboard map, a 3 * 4 key map, a QWERTY key map, or the like, and may be a control key map for controlling the operation of the currently activated application program. In addition, the menu map may be a menu map for currently operating application program control. For example, the menu map may include a menu for selecting functions for emoticon generation according to the present invention. The storage unit 160 may also include an operating system (OS) for operating the terminal 100 and operating the respective components described above, various user functions, for example, a user function for supporting the call function of the terminal 100 , An MP3 user function for playing back other sound sources, an image output function for playing back pictures and the like, and an application program for supporting a video playback function, respectively.

In particular, the storage unit 160 of the present invention may store an emoticon generation program 161 for supporting emoticon generation, a face DB 163 for storing a face image used in the emoticon generation process, a color DB 165, have. Here, the emoticon generation program 161 may further include a program for generating a caricature that can be a basis of the emoticon using the user's face, and further includes a 3D rendering program for implementing the caricature in 3D can do. The storage unit 160 may store various application programs for supporting communication services based on the created emoticons, for example, an instant messenger service management program, a game program, a message management program, a memo management program, etc. Lt; / RTI >

The emoticon generation program 161 includes various routines for supporting the emoticon generation service according to the present invention. For example, the emoticon generation program 161 generates a plurality of emoticons representing various emotions using the feature points of the face image of the user. To this end, a routine for extracting feature points of the face from the user's image, extraction And a routine for searching the face DB 163 for a face image having information most similar to the extracted feature points. In addition, the emoticon generation program 161 includes a routine for applying a warping to the face image retrieved from the face DB 163, a routine for correcting the applied face image at a predefined constant ratio, A routine for generating a caricature sample, and a routine for generating a plurality of emoticons representing various emotions by modifying a selected specific caricature sample of the generated caricature samples.

The face DB 163 is a database for storing face images of a plurality of characters composed of various minutiae which are the basis for caricature creation. The face DB 163 can be compared with the minutiae extracted from the collected images. More specifically, the face DB 163 may include various face images composed of various feature points such as eyebrows, eyes, nose, and mouth.

The color DB 165 is a structure for providing color deformation corresponding to the skin color of the face required for generating a caricature that reflects the characteristics of the user who is the basis of the emoticons. The color DB 165 may include various colors as items so as to provide a color similar to a skin color of a user corresponding to a face photograph. In particular, the color DB 165 can provide the colors necessary for generating the caricature.

Meanwhile, the storage unit 160 may store a warping program for generating a caricature having a high user's preference. The warping program is a program for distorting a specific part of an image such as a facial feature point, and can distort a predefined predetermined part among various facial feature points in a certain form, thereby supporting a caricature creation of a form that a user can prefer more. For example, the warping program may enlarge the size of the eye among the minutiae points to a predefined predetermined size or distort the jaw to have a certain degree of curvature. That is, the warping program applied to the present invention may distort the image so that the feature points may be in a predefined shape, such as an inferior or an invisible form. Herein, the inferior or inferior distortion is determined based on various experiments and statistics, and various feature points constituting the face, such as eye, pupil, mouth shape, placement of a tail, jaw shape, cheek bone and ball shape, The deformed image can be distorted in a more favorable form. Or the feature points of the above-described facial features can be transformed into a specific shape of a crushable form. In addition, among the feature points of the face, the wrinkles formed on the mouth, the eyes, and the forehead are extracted and intentionally removed to provide a younger image, so that it is possible to support the caricature creation in a form that the user can prefer more. The user can create an emoticon of a preferred form.

The control unit 170 performs signal flow control to support the emoticon generation service of the present invention, and display control of data processing and caricature samples. For this, the controller 170 may include a configuration as shown in FIG.

3 is a detailed block diagram of the controller 170 of the terminal 100 according to the embodiment of the present invention.

3, the control unit 170 of the present invention includes an image collecting unit 171, a facial feature extracting unit 172, a facial feature enlarging unit 173, a facial caricature generating unit 174, a trunk generating unit 175 Dimensional caricature generating unit 176, a three-dimensional motion producing unit 177, a three-dimensional caricature generating unit 178, and an emoticon generating unit 179. The three-

The image collection unit 171 controls various signal processing and data collection for collecting images. For example, when an input signal for activating the emoticon generation service of the present invention is generated, the image collection unit 171 controls the camera 150 to be automatically activated, and displays the image of the user photographed through the camera 150 To the feature extraction unit 172. The image collecting unit 171 can support the photographing of the image including the face capable of extracting the feature point through the camera 150.

More specifically, the image collecting unit 171 checks the preview image together with the activation of the camera 150, and checks whether there is a face having predetermined predetermined feature points. At this time, if the face is not detected in the preview image, the image collecting unit 171 can control the output of the guide sound so that the face enters the photographing angle. The image collecting unit 171 adjusts the automatic zooming or zooming of the camera 150 so that the user's face enters the photographing angle, but the feature point can not be extracted through image recognition, It is possible to guide a specific operation related to the camera 150 or to guide the movement of the subject. Alternatively, when an input signal for activating the emoticon generation service is generated, the image acquisition unit 171 may support outputting a screen capable of searching for images including the face among the images stored in the storage unit 160. When a specific image is selected, the image collecting unit 171 may transmit the selected image to the facial feature extracting unit 172 for the emoticon generation service.

The facial feature extraction unit 172 extracts facial feature points from the image when the facial feature extraction unit 172 receives an image including a face from the image collection unit 171. [ To this end, the facial feature extracting unit 172 may detect points that can be featured from the image through a method such as image filtering, and perform a determination on feature points of the points using the feature point extraction algorithm. When the feature point extraction is completed, the facial feature extraction unit 172 may display the feature points on the image to display which portions are extracted as feature points. In this case, if the feature point display function is designed not to provide a separate display function for the feature point display, the feature point display function of the face feature extraction unit 172 may be omitted. In addition, the face feature extraction unit 172 can search for a character image composed of a combination of face items most similar to the feature points extracted from the face DB 163. The face feature extraction unit 172 may transmit the character image retrieved from the face DB 152 to the facial feature enlargement unit 173.

The facial feature enlarging unit 173 enlarges or reduces a predetermined region including each of the minutiae points and minutiae points of the character image received from the facial feature extracting unit 172 at a predetermined ratio. The facial feature enlarging unit 173 may enlarge or reduce the facial feature points based on the weighting program stored in the storage unit 160 at a predetermined ratio of the predefined appeal. The face feature enlarging unit 173 can also support enlarging or reducing the size of the face itself at a constant ratio.

The facial characteristic enlarger 173 enlarges or reduces facial feature points by a program stored in the storage 160 or a predefined ratio or the like to provide a corrected facial image, Supports generation of multiple caricature samples based on images. At this time, the face caricature generating unit 174 can generate a plurality of caricature samples having high likelihood by applying various image effects to the corrected face image. For example, when generating a caricature, the face caricature generating unit 174 intentionally removes the wrinkles formed on the mouth, eyes, forehead or the like and processes the face so as to be seen as a younger image, , It is possible to generate a more favorable caricature by reducing the face by a predetermined ratio (for example, 10%) while emphasizing the feature of the eyes. This will be described in more detail with reference to the following drawings.

The trunk generating unit 175 generates a trunk from the caricature configuration of the user. For this purpose, the trunk generating unit 175 may check whether the trunk portion is provided in the original image, and if the trunk portion is included in the image, the trunk portion may be extracted and used as the trunk portion of the caricature. At this time, the trunk generating unit 175 may process the trunk portion to match the generated caricature sample. That is, the trunk generating unit 175 may process the trunk portion according to a predetermined form so as to match the color or face ratio of the caricature samples.

Meanwhile, if there is no body part in the original image, the body creating part 175 may select a body of a pre-stored body as a body to be applied to the caricature. Particularly, the trunk generating unit 175 can check the face ratio of the caricature, control the body to select the trunk corresponding to the face ratio, and confirm the face color of the caricature to create a trunk having a color corresponding thereto. Accordingly, the trunk generating unit 175 may generate at least one trunk for each of the plurality of caricature samples and provide the at least one trunk to the one-dimensional caricature generating unit 176.

The one-dimensional caricature generating unit 176 combines the caricature samples generated by the face caricature generating unit 174 and the torso provided by the torso generating unit 175 to generate a one-dimensional caricature. In this case, the one-dimensional caricature generating unit 176 may generate a one-dimensional caricature by connecting the body matching the face color or face ratio of the caricature samples.

When the one-dimensional caricature is generated, the stereoscopic motion producing unit 177 generates a stereoscopic motion by rotating the one-dimensional caricature. Particularly, the stereoscopic motion producing unit 177 can be manufactured so that the stereoscopic motion can be performed through processing such as rotation or volume application of each part of the one-dimensional caricature.

The three-dimensional caricature generating unit 178 generates a three-dimensional caricature based on the three-dimensional motion of the one-dimensional caricature generated by the three-dimensional motion producing unit 177. The three-dimensional caricature generator 178 may apply a predetermined image effect to stereoscopic motion to generate a three-dimensional caricature.

The emoticon generation unit 179 receives the caricatures generated from at least one of the facial caricature generation unit 174, the one-dimensional caricature generation unit 176 and the three-dimensional caricature generation unit 178, and based on the generated caricatures It creates a number of emoticons that express various emotions by changing one or more of facial expressions, gestures, and movements or applying special effects. The plurality of emoticons generated by the emoticon generation unit 179 are stored in the storage unit 160 and then provided to the user during the use of an arbitrary communication service to generate a message to which a user applies one or more emoticons .

The configuration of the controller 170 described above is similar to the embodiment in which the emoticon generation is performed in a standalone operation without interlocking with other apparatuses. In the case where the emoticon is generated through interlocking with the emoticon service apparatus 200, Some of which may be omitted.

FIG. 4 is a detailed block diagram illustrating the configuration of an emoticon service apparatus 200 according to another embodiment of the present invention.

Referring to FIG. 4, the emoticon service apparatus 200 of the present invention may include a configuration of a device communication unit 210, a device storage unit 220, and a device control unit 230.

The device communication unit 210 forms a communication channel with the terminal 100 requesting connection to the emoticon generation service device 200 and supports transmission and reception of various signals required to support the emoticon generation service through the communication channel. For example, the device communication unit 210 may transmit a message requesting the terminal 100 requesting the emoticon generation service to transmit an image to be used for creating an emoticon. The device communication unit 210 may receive the image corresponding to the message, and may provide the received image to the device control unit 230. On the other hand, when the caricature samples that are the basis of the emoticons are generated, the device communication unit 210 may provide the terminal 100 with data on the caricature samples. In addition, the device communication unit 210 may receive the caricature information selected by the terminal 100 and provide the received caricature information to the device control unit 230. In addition, the device communication unit 210 may transmit to the terminal 100 a plurality of emoticons representing various emotions generated by modifying the selected caricature sample or applying special effects. The device communication unit 210 may be a communication module supporting at least one communication method capable of transmitting and receiving data required to support the emoticon service of the terminal 100. Accordingly, But is not limited to a specific communication method or a specific communication module.

The device storage unit 220 may include a face DB 221, a color DB 223, a caricature DB 225, and an emoticon DB 227 for supporting the emoticon generation service. The device storage unit 220 includes a face DB 221 and a color DB 223 and an emoticon generation program for generating an emoticon using the received image and a caricature creation program for creating a caricature as a basis of the emoticons Or more. Here, the emoticon generation program may be embedded in the device control unit 230 of the emoticon service apparatus 200 to support the emoticon generation service.

The face DB 221 stores various character images having various feature points. The face DB 221 can be used to search for a face image most similar to the extracted feature points of the face when the feature points of the face are extracted from the image transmitted by the terminal 100. [ The face image retrieved from the face DB 221 may be provided to the device control unit 230 to generate caricature samples that are the basis for emoticon generation.

The color DB 223 includes various color information related to the face color of the received image. The color DB 223 provides color information necessary for generating the caricatures in the process of generating the caricature samples that are the basis of the emoticons through the received image. That is, the color DB 223 provides color information applied at the time of correcting the facial images. At this time, the color DB 223 may preferentially provide color information similar to the face color in the received image according to the request of the device controller 230.

The caricature DB 225 is a configuration in which the emoticon service apparatus 200 stores caricature samples including characteristics of a user created based on a user's image. In particular, the caricature DB 225 may map and store at least one caricature selected through the terminal 100 with a specific user. The stored caricature samples can then be used to generate emoticons.

The emoticon DB 227 stores a plurality of emoticons expressing various emotions generated by changing a selected caricature sample among a plurality of caricature samples corresponding to a user stored in the caricature DB 225 or giving special effects. The plurality of emoticons may be mapped to and stored in a specific user, and may be provided to a specific user, and may be used in operation of a communication service of a specific user.

The device control unit 230 controls various signal flows required to support emoticon generation according to the connection procedure of the terminal 100 and the request of the terminal 100. [ The device controller 230 can perform pre-registered authentication information confirmation for connection to the terminal 100. When the authentication information confirmation is completed, when the emoticon generation service request is generated from the terminal 100, the device controller 230 generates the corresponding emoticon Support. More specifically, the device control unit 230 generates a message requesting the terminal 100 to transmit an image to be used for creating an emoticon, and controls the device 100 to transmit the message to the terminal 100 through the device communication unit 210 have. Upon receiving the image from the terminal 100, the device controller 230 can extract the feature points of the face from the received image. In order to extract feature points, the device controller 230 may perform image filtering and data area search, and may collect information about feature points through specific data distribution regions, distribution of specific data, and the like .

When the feature points are extracted, the device control unit 230 searches the face DB 221 for a character image most similar to the corresponding feature points, and uses the searched character image to generate a caricature sample. Here, the images included in the face DB 221 may be a formal basic character image that can be used to construct a basic skeleton of a specific type of caricature. The device control unit 230 can change the feature point and apply the various image effects more quickly and accurately by using the standardized face image, and can reduce the calculation load in the actual caricature creation.

Here, the device controller 230 may generate a caricature based on the standardized facial image, and may apply features of the extracted feature points to support a specific caricature of the specific terminal 100 alone. For example, the device control unit 230 applies the relation information between the minutiae points extracted from the image to the ratio adjustment applied in the image correction process, so that even if the caricature is generated based on the standardized face image, Can be performed.

The device control unit 230 applies a warping function to predetermined regions of the detected face image or predetermined regions based on the detected feature points, adjusts the ratio of the images to generate a corrected image, It is possible to generate various caricature samples by giving image effects. When giving an image effect, the device control unit 230 may use a color related to the color extracted from the face photograph using the color DB 223. In addition, when the caricature samples are generated through the above-described process, the device controller 230 changes a selected caricature sample from the generated caricature samples, or gives a special effect to generate a plurality of emoticons representing various emotions. The plurality of emoticons thus generated may be provided to the terminal 100.

On the other hand, the device control unit 230 may provide a predetermined billing related to emoticon generation according to the service policy. At this time, the device controller 230 can provide basic emoticons free of charge according to a service policy, and when a request for generating additional emoticons required by specific terminals 100 occurs, a predetermined charge can be given according to the occurrence of the corresponding event . Alternatively, the device control unit 230 may provide a charge according to a policy that a fixed charge is given per the number of emoticons.

Next, the operation of the emoticon generation service based on the above-described configuration will be described.

5 is a flowchart illustrating a method for supporting an emoticon generation service based on the terminal 100 according to an embodiment of the present invention.

5, when an input signal is generated from the input unit 120 or the display unit 140 of the input function, the corresponding input signal is used to generate an emoticon in step S101. Whether or not the input signal is an input signal. For this purpose, the terminal 100 may provide an icon, a widget, or a menu item for creating an emoticon. The user can then support activating the emoticon generation function by selecting the corresponding icon, widget or menu item.

If the input signal is not an input signal for generating an emoticon in step S101, the controller 170 of the terminal 100 may branch to step S103 and control the performance of the function according to the input signal. For example, the control unit 170 may enable various user functions such as a file search function, a file playback function, a file transfer function, a call function, a broadcast reception function, a game function, have.

On the other hand, if the input signal generated in step S101 is an input signal for emoticon generation, the controller 170 branches to step S105 and collects the user's image for emoticon generation. This step is substantially the same as the step of photographing the subject image including the face region of the user by operating the camera 150 or the step of displaying the image having the face region capable of extracting the feature point among the images stored in the storage unit 160, As shown in FIG.

Next, in step S107, the controller 170 generates a plurality of caricature samples reflecting the characteristics of the user based on the collected user's images. The process of generating the plurality of caricature samples may be performed using various techniques, for example, as shown in FIG.

That is, referring to FIG. 6, in step S201, the controller 170 performs minutia point analysis of the image collected in step S105.

The control unit 170 can search for the face image of the character most similar to the analyzed feature point by referring to the face DB 163 stored in the storage unit 160 as in step S203.

The control unit 170 supports the execution of the warping on the face image most similar to the extracted feature points in step S205. At this stage, the controller 170 may perform distortion on the feature points of the face according to a predefined rule. For example, the controller 170 may perform a distortion process such as adjusting the size of the minutiae, adjusting the ratio of the minutiae, or replacing the minutiae with other images. Also, the controller 170 may perform image correction by applying a predefined ratio in step S207. This step may be a step that applies a common element that feels on average and esthetically beautiful to the facial image. For example, correction may be performed, such as making the eyes more louder, making the shape of the face more rounder, softening the mouthpiece processing, and the like. In order to satisfy the user's preference, if the wrinkles of the mouth, eyes, forehead or the like are intentionally removed or the width of the face is wider than the average, A correction can be made to reduce the ratio (e.g., by about 10%). Here, the image correction may include a process of deforming the color with respect to the face or body and the face, a process of simplifying the feature points, a process of replacing at least a part of the feature points with a certain type of image, And a process of solidifying at least a part of the minutiae points by applying an image effect including at least one of them.

Next, in step S209, the control unit 170 generates one or more caricature samples based on the warped and image-corrected image. At this time, the controller 170 may generate a caricature sample according to various predefined caricature generation methods. For example, the control unit 170 generates a caricature in which the outline of the collected image is mechanically applied, a caricature in which a printing format is applied, a caricature in which a cartoon format is applied, a caricature in which a 3D graphic format is applied, and outputs it to the display unit 140 . In addition, in step S209, the controller 170 may include at least one face caricature generated by changing facial feature points of the image or applying at least one image effect to the changed facial feature points, and at least one face caricature Dimensional caricature, and a three-dimensional caricature constructed by constructing stereoscopic motion of the one-dimensional caricature.

Referring again to FIG. 5, the controller 170 generates a plurality of caricature samples using various techniques including the above-described method, and then, based on the specific caricature selected by the user from the one or more caricature samples in step S109 And generates a plurality of emoticons representing various emotions. At this time, the emoticon generation may be performed using only the face region of the selected specific caricature, or may be performed using the entire image. Further, a plurality of emoticons representing various emotions, situations, facial expressions, and the like are generated by changing facial expressions, gestures, and movements of the selected specific caricatures or applying special effects (e.g., sweat blindness, windbreak, can do.

The control unit 170 stores a plurality of emoticons reflecting the characteristics of the user generated according to the above-described manner and then applies the same to a message service such as a specific communication service, for example, an instant messenger, Use one or more of the emoticons to help you express your feelings.

Meanwhile, in another embodiment of the present invention, the method of providing an emoticon service may be performed not only in stand-alone operation of the terminal 100, but also through interlocking of the emoticon service apparatus 200 and the terminal 100 .

7 is a signal flow diagram illustrating an emoticon service providing method according to another embodiment of the present invention.

Referring to FIG. 7, in the method of operating the emoticon service system according to another embodiment of the present invention, the terminal 100 collects images in step S301. This step may be a step of photographing an image including a face using the camera 150 mounted on the terminal 100 or selecting an image including a face stored in the storage unit 160. Herein, the terminal 100 basically refers to collecting images corresponding to the face of the user of the terminal 100, but arbitrary images may be collected instead of the user's face image according to the user's selection. For example, the user may request to use the emoticon generation service for the photograph including the specific face stored in the storage unit 160. [

When the image is collected or the image is selected, the terminal 100 delivers the image collected in step S303 to the emoticon service apparatus 200. [ For this purpose, the terminal 100 supports the communication unit 110 to form a communication channel with the emoticon service apparatus 200. When the terminal 100 is a mobile communication terminal, the communication unit 110 may form a communication channel in which a communication channel of at least a partial section is formed by a mobile communication channel with the emoticon service apparatus 200. Here, when the emoticon service apparatus 200 is operated as a membership system, the terminal 100 can transmit and receive a pre-registered ID and password, and perform the authentication process.

Meanwhile, in step S305, the emoticon service apparatus 200 generates a caricature sample reflecting characteristics of the received image. For this, the emoticon service apparatus 200 may selectively perform steps S201 to S209 in FIG. 6 to generate a caricature sample having a high degree of preference while reflecting characteristics of the user. That is, the emoticon service apparatus 200 extracts feature points of the face from the received image, searches the face DB 221 for a face image most similar to the extracted feature points, performs warping on the retrieved face image, Or at least one predefined image effect may be applied to generate at least one caricature sample. In this process, the emoticon service apparatus 200 can generate only a facial caricature, generate a body corresponding to a facial caricature, and combine with a facial caricature to generate a one-dimensional caricature. In addition, the emoticon service apparatus 200 can support three-dimensional caricature generation through stereoscopic motion generation for a one-dimensional caricature. As a result, the caricature samples generated by the emoticon service apparatus 200 may include at least one face caricature, at least one one-dimensional caricature including the torso, and at least one three-dimensional caricature made in 3D.

In the above description, the warping may be a process of enlarging or reducing at least a part of the feature points of the face, or adjusting a predetermined fixed ratio. The enlargement or reduction of the above-mentioned minutiae and the adjustment of a certain ratio are carried out in the direction of changing the face or the like to a form having favorable feelings, and it is possible to change the minutiae or the minutiae which are commonly defined according to various experiments and statistics Processing method.

The image effect may include a process of deforming a color with respect to a face or a body and a face, a process of simplifying the feature points, a process of replacing at least a part of the feature points with a certain type of image, And a process of solidifying at least a part of the minutiae points, or a process of generating a specific type of caricature sample through at least one of various processing methods.

In addition, the caricature samples can be generated in various different caricature generation methods. For example, a caricature generation method based on basic outline processing, a caricature generation method using a print format, a caricature generation method using a cartoon type, And the applied caricature generation method.

When the caricature samples are generated, the emoticon service apparatus 200 delivers the caricature sample to the terminal 100 in step S307. The terminal 100 may receive at least one caricature sample and display it on the display unit 140 so that the user can select at least one caricature of a preferred form.

Accordingly, the terminal 100 transmits a specific caricature selection signal to the emoticon service apparatus 200 in step S309 according to the user's selection.

If the specific caricature selection information of the user is transmitted through step S309, the emoticon service apparatus 200 displays various emotions based on the specific caricature selected in step S311 by changing facial expressions, gestures or movements, applying special effects, To generate a plurality of emoticons.

Then, the emoticon service apparatus 200 transmits the plurality of emoticons generated in step S313 to the terminal 100. [

In step S315, the terminal 100 may apply a plurality of emoticons provided from the emoticon service apparatus 200, provide a plurality of emoticons during operation of an arbitrary communication service, and support the emoticon to be used for emotional expression of the user .

8 is a diagram illustrating an emoticon generation process according to an embodiment of the present invention.

Referring to FIG. 8, when the emoticon generation function is activated, the terminal 100 can collect images to be used for emoticon generation as in the 801 screen. For this, the terminal 100 activates the camera 150 and may output the image collection screen 141 according to the image capturing using the camera to the display unit 140. Alternatively, the terminal 100 may output the image collection screen 141, which has been stored in the storage unit 160, to the display unit 140.

The emoticon service apparatus 200 receiving the user's image from the terminal 100 or the terminal 100 generates the input image signal indicating that the user image , It is possible to generate a caricature reflecting the characteristics of the user and to provide it as a caricature sample as in the 803 screen. In the illustrated example, only one caricature sample is shown, but otherwise, more than one caricature sample may be provided, and one of the provided caricature samples may be selected by the user. In this case, the caricature samples can be classified into a caricature which mechanically applies the outline of the face photograph, a caricature which adjusts the image of the face according to the print format, a caricature which adjusts the face photograph according to the cartoon type, Caricatures. The caricature provided as described above is applied to the feature image change and at least one image effect on the face image most similar to the face feature of the user.

The terminal 100 or the emoticon service apparatus 200 may generate and provide a plurality of emoticons representing various strengths based on a specific caricature sample as shown in the 805 screen. The emoticons provided in the illustrated example represent different emotions, but the characteristics of the user are reflected, thereby providing user satisfaction or amusement.

As described above, according to the embodiment of the present invention, it is possible to easily generate a specific emoticon having a good feeling through only a simple image acquisition and input operation from the viewpoint of the user for emoticon generation. In this process, the present invention can provide a plurality of caricature samples through support of a waving function and an image effect, thereby widening the range of user selection and supporting the user to generate emoticons based on a more preferred caricature.

Meanwhile, the terminal 100 may further include various additional modules according to the provided mode. That is, the terminal 100 is a communication terminal, a short-range communication module for short-range communication, an interface for data transmission / reception by a wired communication method or a wireless communication method of the terminal 100, An Internet communication module, and a digital broadcasting module that performs digital broadcasting reception and reproduction functions. These components can not be enumerated because of a wide variety of variations depending on the convergence trend of the digital device, but it is also possible that components having the same level as the above-mentioned components are further included in the device have. Also, it is needless to say that the terminal 100 of the present invention may be excluded from the specific configurations in the above configuration or may be replaced with other configurations in accordance with the provision mode thereof. Which will be readily apparent to those skilled in the art.

In addition, the terminal 100 according to the embodiment of the present invention may include all types of devices capable of using emoticons. For example, the terminal 100 may include all mobile communication terminals operating based on communication protocols corresponding to various communication systems, a portable multimedia player (PMP), a digital All information communication devices such as a broadcasting player, a PDA (Personal Digital Assistant), a music player (for example, an MP3 player), a portable game terminal, a smart phone, a notebook and a handheld PC, Device.

In addition, the emoticon service providing method according to the embodiment of the present invention can be realized in the form of software readable by various computer means and recorded in a computer-readable recording medium. Here, the recording medium may include program commands, data files, data structures, and the like, alone or in combination. Program instructions to be recorded on a recording medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. For example, the recording medium may be an optical recording medium such as a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, a compact disk read only memory (CD-ROM), a digital video disk (DVD) Includes a hardware device that is specially configured to store and execute program instructions such as a magneto-optical medium such as a floppy disk and a ROM, a random access memory (RAM), a flash memory, do. Examples of program instructions may include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. Such a hardware device may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. , And are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention may be practiced without departing from the scope of the invention disclosed herein.

The emoticon service system and the emoticon service providing method according to the present invention can be provided in cooperation with a communication service such as an instant messenger. The emoticon service system can generate an emoticon expressing various emotions based on a user's face, You can provide your own unique emoticons.

In addition, the emoticon used for expressing the user's own emotions or facial expressions is implemented based on the user's own face, so that the user's emotions or expressions can be expressed more realistically, and the user's preference can be further increased, Service activation can be induced.

100: terminal 110: communication unit 120: input unit
130: audio processing unit 140: display unit 150: camera
160: Storage unit 170: Control unit
200: emoticon service device 210: device communication unit 220: device storage unit
230:

Claims (16)

A terminal for collecting an image including a user's face, delivering the collected image to the emoticon service apparatus, and receiving one or more emoticons generated based on the image from the emoticon service apparatus; And
An emoticons service apparatus for generating a plurality of emoticons representing various emotions by extracting facial features from an image received from the terminal, generating caricature samples reflecting the extracted facial features, and modifying the generated caricature samples, ; ≪ / RTI >
Wherein the emoticon service apparatus comprises:
Extracting feature points of the face from the received image, searching for a regularized basic character image having the highest degree of similarity with the extracted feature points, waving feature points on the searched character image, adjusting the relationship between feature points at a certain ratio Or a facial caricature is generated by applying a predetermined image effect, a body is combined with the generated facial caricature to generate a one-dimensional caricature, and a stereoscopic motion is applied to the generated one-dimensional caricature, And generates a plurality of emoticons in which at least one of a facial expression, a gesture, and a movement is changed based on the selected caricature sample among the plurality of caricature samples by the terminal. A device communication unit which forms a communication channel with the terminal and transmits and receives data; And
A facial feature is extracted from the received image of the user, a caricature sample is generated by reflecting the extracted facial feature, and the generated caricature sample is transformed into various emotions And generating a plurality of emoticons representing the plurality of emoticons, and providing the plurality of emoticons to the terminal,
The apparatus control unit includes:
Extracting feature points of the face from the received image, searching for a regularized basic character image having the highest degree of similarity with the extracted feature points, waving feature points on the searched character image, adjusting the relationship between feature points at a certain ratio Or a facial caricature is generated by applying a predetermined image effect, a body is combined with the generated facial caricature to generate a one-dimensional caricature, and a stereoscopic motion is applied to the generated one-dimensional caricature, And generates a plurality of emoticons in which at least one of a facial expression, a gesture, and a movement is changed based on a caricature sample selected by the terminal from among a plurality of caricature samples. delete delete ◈ Claim 5 is abandoned due to the registration fee. 3. The apparatus of claim 2, wherein the device control unit
A process of simplifying the feature points of the face image, a process of replacing at least some of the feature points of the face image with a certain type of image, a process of replacing at least one of the feature points of the face image A specific color process for the part, and a process for solidifying at least a part of the feature points of the facial image. ◈ Claim 6 is abandoned due to the registration fee. 3. The apparatus according to claim 2, wherein the device control unit is configured to use at least one of a caricature creation method based on basic outline processing, a caricature creation method using a print format, a caricature creation method using a cartoon format, and a caricature creation method using a 3D graphic format And controls to generate the caricature sample. delete delete delete delete delete delete delete delete delete delete

Images