JP2009163465A - Portrait illustration data providing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain a portrait illustration data providing system for efficiently generating portrait illustration data as the raw materials of HTML mail for a cellular phone while taking in the tastes of a user. <P>SOLUTION: Face region image data is extracted from a face picture image data received from a user, and one side half face image is generated, and an eye peripheral image and an eyebrow peripheral image are extracted on the basis of the one side face image, and a sample which is the most similar to the respective sites of the generated one side half face image and the extracted one side eye region image and one side eyebrow region image are extracted from outline/eye/eyebrow sample data, and corresponding illustration data is extracted from the outline/eye/eyebrow illustration data on the basis of the extracted sample data, and the extracted outline/eye/eyebrow illustration data is synthesized with the illustration data selected from the type-categorized hairstyle/hair color illustration data on the basis of the extracted outline/eye/eyebrow illustration data and the selection data of the hairstyle type and the hair color type received from the user, so that the portrait illustration data can be completed. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a caricature illustration data providing system that generates caricature illustration data from a face photograph image and provides it to a user.

  Numerous patent applications have been filed for a system for receiving a facial photograph image taken with a mobile phone with a camera and automatically generating a portrait illustration from the facial photograph image. For example, Patent Document 1 described below ~ 4.

  Patent Document 1 does not disclose a new method for generating a caricature illustration from a facial photographic image, but discloses a management means for enabling viewing of the caricature illustration and a method for displaying it in combination with an advertisement image. is doing.

  Patent Document 2 discloses a system for generating a portrait of a caricature used for e-mail of a mobile phone and creating various characters based on the caricature. In Patent Document 2, as a method of generating a caricature illustration, each part constituting the face is cut out from the face part cut out from the photograph, and a feature image is extracted from each part to create a caricature image. For a specific method, an existing technique is used (paragraph number 0032). The feature of the technique disclosed in Patent Document 2 is considered to be characterized in that the created portrait image is further subjected to various deformation processes according to user preferences and the like.

  Patent Document 3 discloses a portable terminal device and a portrait data providing system that change the facial expression of a portrait automatically displayed according to the content of an e-mail. In Patent Document 3, face detection processing is performed from the transmitted face image, the basic portrait data and facial expression parameters are returned to the user terminal, the basic portrait data is read and displayed on the display screen, and the displayed portrait is electronically displayed. It is thought that there is a feature in changing the facial expression of the caricature by changing the facial expression parameter according to the emotion symbol included in the email.

  In Patent Document 4, matching is performed between a photographed face and face parts stored in a database in advance, and data such as size, position, color, and inclination is added to the part and encoded, along with the encoded data. Although a portrait is automatically output on a screen or the like, a specific method for performing the matching process is not disclosed in detail.

  On the other hand, recently, services that provide functions that can add various decorations to email, such as freely changing the background color and text color and size of emails exchanged with mobile phones, and embedding images and videos, have become popular. is doing. Such services include, for example, “Deco-mail” (registered trademark of NTT DoCoMo, Inc.), “Decoration Mail” (name used by KDDI Corporation), “Arrange Mail” (Registration of Vodafone Corporation) Trademark). The entity of the decoration mail is a kind of HTML mail, and if it has a function of displaying HTML content in the mobile phone, it can be displayed without any problem on the side that receives the decoration mail. It is necessary to have a function for creating a proper HTML content. At present, many mobile phone models support such functions.

In recent years, with the spread of HTML mail for mobile phones, the market for materials for decoration (e.g., pictograms, character images, templates, GIF movies, etc.) has also expanded. Caricature illustrations generated from face photos are attractive content as HTML mail material for mobile phones because users can create their own original characters. Therefore, it is considered that there is a great need for a service for providing a portrait illustration for HTML mail for mobile phones that is easy for users to use. In particular, if the user can provide caricature illustration data free of charge by devising the business model, the attractiveness of the service will increase. Moreover, there is a possibility that various services can be added based on the generated portrait illustration data.
JP 2004-005391 A JP 2005-228185 A JP 2007-122561 A JP 2007-164408 A

  The present invention is intended to provide a caricature illustration data providing system that can efficiently generate caricature illustration data as a material for HTML mail for mobile phones while incorporating user preferences.

  Another object of the present invention is to provide a caricature illustration data providing system that provides caricature illustration data for HTML mail for mobile phones in combination with an advertisement template.

  It is another object of the present invention to provide a caricature illustration data providing system capable of processing the generated caricature illustration data according to the user's preference.

  A caricature illustration data providing system according to the present invention is a caricature illustration data providing system that receives face picture image data transmitted from a user and generates caricature illustration data. A server capable of data communication with the user's mobile phone and a data storage unit are provided.

The data storage unit includes a face image data storage unit that extracts and temporarily stores a face photograph image received from a user, and a face that temporarily stores face area image data extracted from the stored face image data. Area extraction data storage means, outline / eye / eyebrow sample data storage means for storing a large number of contour and eye / brow photographic image samples including the nose and mouth on one half of the face, and outline / eye / brow sample data storage Contour / eye / brow illustration data storage means for storing illustration / image data of contour / eye / brow stored in association with the sample of the photographic image stored in the means, and the hairstyle and hair color selected by the user And a hair type / hair color illustration data storage unit for storing illustration image data to be combined.
The server also includes face image data storage means for storing the face photo image data received from the user in the face image data storage means, and extracts face area image data from the stored face image data to store the face area extraction data. A face area extraction means for storing in the means, and a one-side half-face image generation / one-side for generating a one-sided half face image from the stored face-area image data and extracting an eye peripheral image and an eyebrow peripheral image based on the one side face image Eye region image / one-sided eyebrow region image extracting means, and the contour / eye / eyebrow sample data storage of the sample most similar to each part of the generated one-sided half-face image and the extracted one-sided eye region image / one-sided eyebrow region image A matching sample data extracting means for extracting from the means, and a contour / eye / brow illustration data storage means based on the extracted matching sample data; Matching illustration data extracting means for extracting corresponding illustration data, extracted contour / eye / brow illustration data, and hairstyle / hair color illustrations by type based on the selected hairstyle type and hair color type data received from the user And caricature illustration synthesis processing means for composing the illustration data selected from the data storage means to complete the caricature illustration data.

  Further, in the above-described caricature illustration data providing system, the data storage unit further stores template data in which the face part created corresponding to the advertising company is blank and stored in association with the category as a caricature illustration template Means, and billing data storage means for storing advertisement billing data every time the caricature illustration data combined with the template is downloaded to the user, the server further based on the category selection information received from the user, Template data extraction means for extracting template data by random selection from the template data storage means, template synthesis processing means for synthesizing the extracted template data and caricature illustration data, and template synthesis processing means. Download determining means for determining whether or not the user has downloaded the caricature illustration data, and charging data writing means for writing the advertisement charging data into the charging data storage means when the download determining means determines that the user has downloaded the data. It can be configured as follows.

  Note that the processing executed by each of the above-described units included in the server is executed in cooperation with the computer hardware and the computer program under the control of the computer program.

  According to the present invention, caricature illustration data as an HTML mail material for a mobile phone is efficiently generated based on the face photograph image transmitted from the user while incorporating the user's preferences, and provided to the user. I can do it.

  Furthermore, in order to realize a business model that provides original caricature illustration data to users free of charge, it is possible to provide caricature illustration data as HTML mail material that is a random combination of caricature illustration data and templates containing corporate advertisements. It is to make.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram showing an outline of a caricature illustration data providing system according to an embodiment of the present invention.

The caricature illustration data providing system performs user authentication processing in response to access by the user's mobile phone 4 via the network 5, and receives facial photograph image data 402 attached to an email and transmits the caricature illustration data. Data for performing creation processing and downloading the completed portrait illustration data 404 to the mobile phone 4 and storing or providing the server 2 with data necessary for authentication processing of the server 2 and portrait illustration data creation processing, etc. And a storage unit 3. The server 2 has functions as a Web server, a mail server, and a database server, and is represented by one block in FIG. 1, but may be configured by a plurality of hardware. Similarly, the data storage 3 is also expressed by one block, but is composed of a plurality of databases or data files and tables.
<First Embodiment>
Next, the configuration of the server 2 and the data storage unit 3 in the first embodiment will be described in more detail with reference to FIG.

  The data storage unit 3 temporarily stores a user database 301 storing attributes including age, gender, occupation, region, etc. of a user registered as a member, and extracts a face photo image attached to a mail from the user and transmitted. A face image data file 302 to be saved, a face area extraction data file 303 to temporarily save a face area extracted from the saved face image data, and a large number of photographic image images of the contour, eyes, and eyebrows of the right half of the face Contour / eye / brow sample data file 304 to be stored, contour / eye / brow sample data file 304 and contour / eye / brow illustration image data stored in association with the sample of the photographic image stored / Eye / eyebrow illustration data file 305, illustration image data for synthesizing the hairstyle and hair color selected by the user It has a type-specific hairstyle / hair color illustration data file 306 for the product.

  The server 2 is capable of data communication with the mobile phone 4 and develops an authentication processing means 201 for performing authentication processing including presence / absence of user registration and registration processing for unregistered members, and e-mail sent from the user. Face image data storage means 202 for extracting face image data and saving it in the face image data file 302; face area extraction means 203 for extracting a face area from the saved face image data and saving it in the face area extraction data file 303; A right half face image generation / right eye area image / right eyebrow area image extraction unit 204 that generates a right half face image from face area extraction data and extracts an eye peripheral image and an eyebrow peripheral image based on the right face image is generated. The sample most similar to each part of the right half face image / right eye region image and right eyebrow region image is extracted from the contour / eye / brow sample data file 304. Matching sample data extraction means 205, matching illustration data extraction means 206 for extracting corresponding illustration data from the contour / eye / brow illustration data file 305 based on the extracted matching sample data, each extracted illustration data and user Has a portrait illustration synthesis processing means 207 for synthesizing illustration data selected from the type-specific hairstyle / hair color illustration data file 306 based on the hairstyle type data 403 and the hair color type data 403 to complete the portrait illustration. ing.

  Note that the authentication processing means 201, face image data storage means 202, face area extraction means 203, right half face image generation / eye area image / brow area image extraction means 204, matching sample data extraction means 205, which the server 2 has. The processing executed by each of the matching illustration data extraction means 206 and the portrait illustration composition processing means 207 is executed by the cooperation of the computer hardware including the CPU of the server 2 and the computer program.

  Next, with reference to FIG. 2 and FIG. 3, an outline of the flow of the operation on the server 2 side until the user's operation for obtaining the portrait illustration data and the completion of the portrait illustration data will be described.

  The user takes a face image with the camera of the mobile phone in advance (U41), and accesses the website of the caricature illustration data providing service provided by the server 2 with the mobile phone (U42).

  Upon receiving access from the user, the server 2 displays a screen for confirming whether the user is a registered user, and starts authentication processing (F21). If the server 2 obtains an ID, password, attribute, or the like input by the user, and accesses and searches the user database 301 for storing registered user data, the server 2 determines that the user has been registered ( F22), the authentication process is completed (F24), and the process proceeds to the next process. If the user has not been registered (F22), data for displaying a registration screen prompting the user to register is transmitted (F23). Then, the attribute data input on the registration screen is received from the user (U43), user registration is performed, and the authentication process is completed (F24).

  When the authentication process is completed, the server 2 transmits a screen displaying the face image transmission address to the user (F25). In response to this, when the user sends a mail with a face image photograph attached to the server 2 (U44), the server 2 automatically returns a mail containing the URL of the portrait generation site to the user (F26). On the other hand, the server 2 expands the received mail, extracts the attached face photo image, and temporarily stores it in the face image data file 302 (F27).

  Next, the server 2 detects only the face area from the stored face photo image (F28), and displays a screen surrounding the detected face area with a frame on the mobile phone of the user who has accessed the URL of the portrait generation site. In addition to displaying, a selection screen for selecting whether or not the face area surrounded by the frame is correct, and a screen for selecting a hairstyle / hair color type when the user makes a selection are displayed (F29). . Then, when the user selects whether or not the user can select (F30), a screen for retrying is displayed (F31), and the user selects the face area and selects the hairstyle / hair. When the color is selected (F30), the process proceeds to the next step F32. The face area detection method will be described in more detail later.

  In step F32, the server 2 generates a right half face image from the selected face area image, and further extracts a right eye area image and a right eyebrow area image. Further, each of these parts is analyzed, and the most similar sample data is extracted from the contour / eye / brow sample data file 304 (F33). Then, each illustration data stored in association with each extracted sample data file is extracted from the contour / eyebrow / eye illustration data file 305 (F34). The matching process described above will be described in more detail later.

  Finally, the server 2 synthesizes each selected illustration data and the illustration data extracted from the hairstyle / hair color illustration data file 306 by type based on the hairstyle / hair color data selected in advance by the user (F35). Then, the completed portrait illustration is displayed and a screen asking whether the selection is possible is displayed on the user's mobile phone screen (F36). This illustration composition processing will be described in more detail later.

  The server 2 obtains whether or not the caricature illustration can be selected from the user (U46), and if it is not selected (F37), displays a retry screen (F38). On the other hand, when the user selects a portrait illustration (F37), a download screen for the portrait illustration data is displayed to prompt the user to download (F39).

  Next, details of the face area search / extraction process (F28) will be described with reference to FIG. 4, FIG. 2, and FIG. As shown in FIG. 4, the face photographic image transmitted from the user includes hair, neck, shoulders, background, and the like around the face. Therefore, in order to synthesize a caricature illustration, it is first necessary to correctly detect only the face area. Therefore, the server 2 performs pattern recognition based on the average face from the face image transmitted from the user and stored in the face image data file 302, detects only the face area, and sets the detection location as a frame (see the frame in FIG. 4). It is displayed in the box and asked for confirmation. Here, pattern recognition using an average face will be described. The “average face” refers to an average face for N numbers generated by adding pixel density values of a plurality of different human face images in units of image pixels and dividing by N numbers. “Pattern recognition” is based on calculating the location closest to the average face density value for an unknown image (that is, a face photo image transmitted from the user) based on an average face created in advance. , It is determined as a face area (this is also referred to as template matching).

  Next, details of the matching processing (F32, F33, F34) will be described with reference to FIGS. 5, 6, 2, and 3. FIG. First, the position of the nose and the position of both eyes are detected from the face area image extracted in step F28 using the color density difference, and the nose position is set as the center of the Y coordinate and the center position of both eyes is set as the X coordinate. Thus, the right half image of the face with the nose as the center position is generated (see FIGS. 5A and 5B). Further, using the generated right half face image, the eyebrow position is detected using the density difference from the right eye position. Then, a right eye region image centered on the right eye position and a right eyebrow region image centered on the right eyebrow position are extracted (see FIG. 5C and FIG. 5D, and so far processing of F32). .

  For each part of the right half face image, right eye region image, and right eyebrow region image extracted in step F32, the sample data (photographic image data) stored in the contour / eye / brow sample data file 304 in advance is stored. The principal component analysis using the density difference is performed to obtain the most similar sample data (see FIGS. 6A and 6B).

  The contour sample data is photographic image data including the contour of the right half of the face, the nose and the mouth, and may be considered as photographic image data corresponding to the lower half of the right half face image. Accordingly, in order to obtain the most similar sample data from the contour sample data, the similarity between the contour, the nose, and the mouth is comprehensively determined, and the sample data is extracted.

  Next, illustration data (see FIG. 6C) of each part stored in association with the obtained sample data is extracted from the contour / eye / eyebrow illustration data file 305 (F34). The contour illustration data is also illustration data of the right half of the face whose nose and mouth are included in the contour.

  Next, the details of the portrait illustration synthesis process (F35) will be described. First, the right half contour illustration data extracted in step F34 is combined with a plain canvas. In this synthesis, an intersection of a line extending horizontally from the corner of the eye toward the outside (ie, toward the right contour of the face) and the contour of the face is taken as an endpoint, and is extracted in step F28 based on this endpoint. Adjust the size of the face area image and the illustration size to the same size. Similarly, the eye illustration data and eyebrow illustration data extracted in step F34 are adjusted to be equal to the size of the face area image.

  Next, the image of the eye illustration data and the image of the eyebrow illustration data are combined on the contour illustration data image with the X-coordinate and Y-coordinate points by the following method. That is, the Y coordinate of the eye illustration data is determined as the center position of the contour illustration data. Then, the X coordinate of the eye illustration data is synthesized so that the zero point of the Y coordinate becomes the black eye portion of the eye illustration data. The Y coordinate of the eyebrow illustration data is determined to be a position obtained by subtracting the right eyebrow Y coordinate from the right black eye Y coordinate measured in advance by the user's face area image. The X coordinate of the eyebrow illustration data is determined to be the same position as the right black eye coordinate position.

  Finally, the hairstyle / hair color illustration data selected from the type-specific hairstyle / hair color illustration data file is synthesized according to the user's selection.

  Although the description of the first embodiment has been completed, the features of the portrait illustration creation process in the present invention will be described here.

  Since the portrait illustration according to the present invention is provided as a material for HTML mail for mobile phones, it is not required to create a high-quality portrait that is exactly faithful to the person's face image photograph, and the portrait character The purpose is to provide a caricature illustration that captures the characteristics of the person who is loved as. In addition, since it is expected that there are many young generations who want to obtain caricature illustrations, it is thought that users cannot be attracted unless caricature illustrations can be easily obtained at low cost (or free of charge). Therefore, a system that performs processing that places a heavy load on hardware to create a portrait or a system that requires a considerable cost for creating a program is not realistic.

For this purpose, in the process of creating a caricature illustration according to the present invention, first, the similarity of a human face is affected by small differences in eyebrows and eyes, and other parts such as the mouth and nose are roughly classified. Therefore, the outline, eyes, and eyebrows are used as elements constituting the caricature illustration based on the idea that the difference will not stand out as long as it is present. In addition, a plurality of right half contour / eye / brow photographic images and illustration image data stored in association with the photographic images are stored in advance. , I'm trying to synthesize caricature illustration data efficiently.
In the first embodiment, the caricature illustration data is synthesized from the image data of the right half face area, but the present invention generates a caricature using the face image of one half of the face. Therefore, it is possible to synthesize caricature illustration data from the image data of the left half face area.
<Second Embodiment>
Next, a second embodiment according to the present invention will be described with reference to FIGS. In the second embodiment, a template incorporating a corporate advertisement and a caricature illustration are combined and downloaded as HTML mail material, and the user is provided with a caricature illustration free of charge.

  FIG. 7 shows the flow of the operation on the server 2 side until the user-side operation and the portrait illustration data combined with the template are downloaded in the second embodiment, and FIG. 8 shows the second embodiment. It is the figure which showed the concept of the mechanism of the advertisement charge in the form of.

  In the second embodiment, the flow until completion of the caricature illustration is the same as that in the first embodiment. Therefore, the flow shown in FIG. 7 corresponds to step F35 in the first embodiment. Starting from step S35.

  In the second embodiment, a template database 307 and an accounting data file 308 are further included as databases or files included in the data storage unit 3 shown in FIG. Further, the server 2 shown in FIG. 2 synthesizes template data extraction means for extracting template data by random selection from the template database based on the category selection information received from the user, and the extracted template data and the portrait illustration data. Template composition processing means, download determination means for judging whether or not the user downloaded the caricature illustration data synthesized by the template composition processing means, and advertisement billing data when the download judgment means judges that the data has been downloaded. Charge data writing means for writing into the charge data storage means is further included.

  The template is illustration data with a blank face portion created in advance according to the image of the advertising company, and two examples are shown in a2 of FIG. This template is combined with the completed caricature illustration data a3 and downloaded to the user's mobile phone as an image a4. In the template database 307, such templates are stored in association with categories.

  Here, the category is for the user to select when downloading the template. In the example of the selection screen shown as a1 in FIG. 8, meal, date invitation, shopping, sleepy, good morning, rest. Are you free? , And the like are listed, and one of these keywords is selected. In this example of the selection screen, the user will select a keyword assuming a scene where he / she wants to send e-mail. Note that various methods can be employed for selecting a category, such as selecting from a plurality of displayed icons and illustrations, regardless of keywords. One feature of the second embodiment is that the user can only select a category but cannot directly select a template. This is because the server 2 randomly selects a template to be combined with the caricature illustration from a plurality of templates belonging to this category based on the selected category.

  Since the downloaded template also serves as a corporate advertisement, log data such as the management code of the template and the date and time of downloading are written in the accounting data file 308 when the user downloads the template. Then, from the data stored in the billing data file 308, the advertising revenue of the operator of the caricature illustration providing site is calculated.

  Next, referring to FIG. 7, a description will be given of the operation on the server 2 side until the user-side operation and the portrait illustration data combined with the template are downloaded in the second embodiment.

  When the server 2 synthesizes the caricature illustration based on the selected illustration data of the right contour / right eye / right eyebrow and the hairstyle / hair color data selected in advance by the user according to the flow described in FIG. 3 (S35), the process is completed. When the selected caricature illustration is displayed and the user is prompted to select or not, a screen for selecting a category is displayed (S36).

  When the user transmits the selection availability and the category selection accordingly (U47), if no portrait illustration is selected (S37), the server 2 displays a retrial guidance (S38). When the user selects a portrait illustration and a category (S37), a template composition process is started (S39).

  The server 2 accesses the template database 307, acquires template data belonging to the category according to the category selected by the user, and selects one template using a random function on the program (S40). When selecting a template, the attribute data of the user may be acquired from the user database 31 and the template may be selected in combination with the category. If it does so, it becomes possible to combine an optimal template from a user attribute, and it can expect a targeted advertising effect.

  When the template is selected, the server 2 combines the portrait illustration with the blank face portion of the template (S41), and displays the combined portrait illustration to display a screen for allowing the user to select whether to download or not (S41). S42). When the user transmits the download permission (U48), the server 2 displays a retry information (S44) when the download is not selected (S43), and when the download is selected (S43). ), A download screen is displayed (S45). Then, after downloading by the user, log data for billing the advertisement is recorded in the billing data file 308 (S46). In step S42, when the caricature illustration combined with the template is displayed to the user, the advertisement is displayed at least once to the user. Therefore, the user may be charged once at this time.

  In step S43, when the user does not select the download, it is assumed that the user does not like the selected template even though he likes the caricature illustration, so return to the step after selecting the category. A routine capable of retrying is provided (S47).

  Also, as shown in FIG. 9, the template is composed of 4 to 10 frames (b1), and a portrait illustration a5 is synthesized to all of them, and the synthesized frame (b2) is automatically converted into a GIF animation as a moving image. It may be generated and downloadable. This is the end of the description of the operation of the second embodiment. Here, the characteristics of the second embodiment will be described.

  The second embodiment is characterized in that a portrait illustration is synthesized with a template that is a corporate advertising medium. Sites that provide caricature illustration data allow users to earn advertising revenue from companies by downloading caricature illustrations combined with templates, thereby providing free caricature illustrations to users Can be realized.

For users, by combining their original caricature illustrations with corporate characters that are already well known in society, users can obtain new attractive characters that they want to add to emails sent to friends and others. Also, since templates are selected randomly only by category selection, you can enjoy the exciting fun of what templates are combined, and some advertisements are scarce, so repeated illustrations can be repeated many times May be generated.
For advertising companies, the downloaded caricature illustration data is used in emails to users' friends, etc., so that it becomes an advertisement for friends, etc. Effective advertising is also possible.

  Furthermore, in the case of a template using a moving image, it is considered that the visual impression is stronger and the advertising appeal effect is higher than a template using a still image. The user can feel as if he / she appeared in the commercial of the company by combining his caricature illustration and the advertisement video of the company, as if he / she was the novelty I can feel my senses. As a result, it is possible that the company itself feels familiar, becomes a fan of the company, and leads to the purchase of the company's products. In addition, it can be expected that the advertisement video with the caricature illustration downloaded by the company will be frequently used by e-mail so that many friends, acquaintances and family members know about it. Also, once a user likes a video template that combines caricature illustrations, the user may be tempted to appear in other video templates and download video templates one after another. This kind of user behavior makes video templates more attractive to advertising publishers as a medium for increasing the effectiveness of advertising, and also provides opportunities for revenue for operators of caricature illustration data providers. Will increase.

The portrait illustration creation processing in the portrait illustration data providing system described in the first embodiment of the present invention can be used not only in the second embodiment but also in various businesses and services that handle facial images. Some usage examples are described below.
(1) Create animal face characters such as dogs and cats from their own caricature illustrations.
It can also be used for avatars, and original goods using the characters can be created.
(2) Used for makeup simulator.
Make a virtual makeup of cosmetics using the caricature illustration image you obtain. It can be used to promote new products and attract stores.
(3) Used for hairstyle simulator.
You can change your hairstyle virtually using the caricature illustration image you get. It can be used for sales promotion of beauty salons and store invitations.
(4) Used for glasses simulator.
You can virtually wear glasses and sunglasses using the caricature illustration image you get. It can also be used for sales promotions of manufacturers.
(5) Create an original figure.
Print the caricature illustration image you get on the blank face of your favorite 3D model and complete your original figure.

It is a block diagram which shows the outline | summary of a structure of the caricature illustration data provision system by embodiment of this invention. It is a block diagram which shows the structure of the 1st Embodiment of this invention. It is a flowchart which shows the flow of operation | movement of the 1st Embodiment of this invention. It is a figure which shows the example of the face area image detection in the 1st Embodiment of this invention. It is a figure which shows the example of a right half image, eye periphery image, and eyebrow periphery image detection in the 1st Embodiment of this invention. It is a figure which shows the example which extracts right-eye sample data and also right-eye illustration data from the right-eye area | region image in the 1st Embodiment of this invention. It is a flowchart which shows the flow of operation | movement in the 2nd Embodiment of this invention. It is the figure which showed the concept of the mechanism of the advertisement billing in the 2nd implementation of this invention. It is the figure which showed the example of a synthesis | combination with the portrait illustration and the template by a moving image.

Explanation of symbols

2 server 3 data storage unit 4 mobile phone 5 network 201 authentication processing means 202 face image data storage means 203 face area extraction means 204 right half face image generation / eye area image / brow area image extraction means 205 matching sample data extraction means 206 matching Illustration data extraction means 207 Caricature illustration composition processing means 301 User database 302 Face image data file 303 Face area extraction data file 304 Contour / eye / brow sample data file 305 Contour / eye / brow illustration data file 306 Hairstyle / hair color illustration by type Data file 307 Template database 308 Billing data file

Claims (8)

A caricature illustration data providing system that includes a server capable of data communication with a user's mobile phone and a data storage unit, receives facial photo image data transmitted from the user and generates caricature illustration data,
The data storage unit
Face image data storage means for extracting and temporarily storing a face photo image received from a user;
Face area extraction data storage means for temporarily storing face area image data extracted from the stored face image data;
Contour / eye / eyebrow sample data storage means for accumulating a large number of samples including a nose and mouth on one half of the face and photographic images of eyes and eyebrows;
Contour / eye / eyebrow illustration data storage means for storing contour / eye / brow illustration data stored in association with the photographic image samples stored in the contour / eye / brow sample data storage means;
A hairstyle classified by type / hair color illustration data storage means for storing illustration image data for synthesizing the hairstyle selected by the user and the hair color;
The server
Face image data storage means for storing face photo image data received from a user in the face image data storage means;
Face area extraction means for extracting face area image data from the stored face image data and storing it in the face area extraction data storage means;
One-sided half-face image generation / one-sided eye region image / one-sided eyebrow region image extracting means for generating one-sided half-face image from the stored face-region image data and extracting the eye-peripheral image and eyebrow-peripheral image based on the one-sided face image When,
Matching sample data extracting means for extracting a sample most similar to each part of the generated one-side half face image and the extracted one-eye area image / one-side eyebrow area image from the contour / eye / eyebrow sample data storage means;
Matching illustration data extraction means for extracting corresponding illustration data from the contour / eye / brow illustration data storage means based on the extracted matching sample data;
The extracted contour / eye / eyebrow illustration data is combined with the illustration data selected from the hairstyle / hair color illustration data storage means by type based on the hairstyle type and hair color type selection data received from the user. A caricature illustration data providing system comprising caricature illustration compositing processing means for completing the illustration data. The data storage unit
Template data storage means for storing illustration data with a blank face part corresponding to an advertising advertising company as a caricature illustration template in association with a category,
Billing data storage means for storing advertisement billing data each time the caricature illustration data combined with the template is downloaded to the user;
The server
Template data extraction means for extracting template data by random selection from the template data storage means based on the category selection information received from the user;
A template composition processing means for synthesizing the extracted template data and the caricature illustration data;
Download determination means for determining whether or not the user downloaded the caricature illustration data synthesized by the template synthesis processing means;
Billing data writing means for writing advertisement billing data into the billing data storage means when the download judging means judges that downloading has been performed;
The caricature illustration data providing system according to claim 1, further comprising: Face image data storage means for extracting and temporarily storing a face photo image received from a user; and face area extraction data storage means for temporarily storing face area image data extracted from the stored face image data; The contour / eye / eyebrow sample data storage means for storing a large number of contour image samples including the nose and mouth on one half of the face and eye and eyebrow photographic image data, and the contour / eye / brow sample data storage means are stored. Contour / eye / brow illustration data storage means for storing illustration / eye / brow illustration data stored in association with a photographic image sample, and an illustration image for combining the hairstyle and hair color selected by the user Providing caricature illustration data with a hairstyle / hair color illustration data storage means for storing data and a server capable of data communication with the user's mobile phone In the stem,
Storing the face photo image data received from the user in the face image data storage means;
Extracting face area image data from the stored face image data and storing it in the face area extraction data storage means;
Generating a half-face image from the saved face area image data and extracting a peripheral eye image and an eyebrow peripheral image based on the single-side face image;
Extracting from the contour / eye / eyebrow sample data storage means a sample most similar to each part of the generated half-face image and the extracted one-eye region image / one-side eyebrow region image;
Extracting corresponding illustration data from the contour / eye / brow illustration data storage means based on the extracted matching sample data;
The extracted contour / eye / brow illustration data is combined with the illustration data selected from the hairstyle / hair color illustration data storage means by type based on the hairstyle type and hair color type selection data received from the user. And a step of completing the illustration data. The caricature illustration data providing system further includes template data storage means for storing illustration data with a blank face portion created corresponding to the advertising advertising company as a caricature illustration template in association with a category, and a caricature synthesized with the template. Charging data storage means for storing advertisement charging data each time illustration data is downloaded to the user,
Extracting template data by random selection from template data storage means based on category selection information received from the user;
Combining the extracted template data and the caricature illustration data;
Determining whether the user has downloaded the caricature illustration data synthesized by the template synthesis processing means;
4. The portrait illustration data generation method according to claim 3, further comprising the step of writing advertisement billing data into billing data storage means when it is determined that the user has downloaded. Face image data storage means for extracting and temporarily storing a face photo image received from a user; and face area extraction data storage means for temporarily storing face area image data extracted from the stored face image data; The contour / eye / eyebrow sample data storage means for storing a large number of contour image samples including the nose and mouth on one half of the face and eye and eyebrow photographic image data, and the contour / eye / brow sample data storage means are stored. Contour / eye / brow illustration data storage means for storing illustration / eye / brow illustration data stored in association with a photographic image sample, and an illustration image for combining the hairstyle and hair color selected by the user Providing caricature illustration data with a hairstyle / hair color illustration data storage means for storing data and a server capable of data communication with the user's mobile phone In the stem,
Storing the face photo image data received from the user in the face image data storage means;
Extracting face area image data from the stored face image data and storing it in the face area extraction data storage means;
Generating a half-face image from the saved face area image data and extracting a peripheral eye image and an eyebrow peripheral image based on the single-side face image;
Extracting from the contour / eye / eyebrow sample data storage means a sample most similar to each part of the generated half-face image and the extracted one-eye region image / one-side eyebrow region image;
Extracting corresponding illustration data from the contour / eye / brow illustration data storage means based on the extracted matching sample data;
The extracted contour / eye / brow illustration data is combined with the illustration data selected from the hairstyle / hair color illustration data storage means by type based on the hairstyle type and hair color type selection data received from the user. A program for causing a computer to execute steps for completing illustration data. The caricature illustration data providing system further includes template data storage means for storing the illustration data with a blank face portion created corresponding to the advertising advertising company in association with the category as a caricature illustration template, and the caricature synthesized with the template Charging data storage means for storing advertisement charging data each time illustration data is downloaded to the user,
Extracting template data by random selection from template data storage means based on category selection information received from the user;
Combining the extracted template data and the caricature illustration data;
Determining whether the user has downloaded the caricature illustration data synthesized by the template synthesis processing means;
The program according to claim 5, further causing the computer to execute the step of writing the advertisement billing data in the billing data storage means when it is determined that the user has downloaded. Face image data storage means for extracting and temporarily storing a face photo image received from a user; and face area extraction data storage means for temporarily storing face area image data extracted from the stored face image data; The contour / eye / eyebrow sample data storage means for storing a large number of contour image samples including the nose and mouth on one half of the face and eye and eyebrow photographic image data, and the contour / eye / brow sample data storage means are stored. Contour / eye / brow illustration data storage means for storing illustration / eye / brow illustration data stored in association with a photographic image sample, and an illustration image for combining the hairstyle and hair color selected by the user Providing caricature illustration data with a hairstyle / hair color illustration data storage means for storing data and a server capable of data communication with the user's mobile phone In the stem,
Storing the face photo image data received from the user in the face image data storage means;
Extracting face area image data from the stored face image data and storing it in the face area extraction data storage means;
Generating a half-face image from the saved face area image data and extracting a peripheral eye image and an eyebrow peripheral image based on the single-side face image;
Extracting from the contour / eye / eyebrow sample data storage means a sample most similar to each part of the generated half-face image and the extracted one-eye region image / one-side eyebrow region image;
Extracting corresponding illustration data from the contour / eye / brow illustration data storage means based on the extracted matching sample data;
The extracted contour / eye / brow illustration data is combined with the illustration data selected from the hairstyle / hair color illustration data storage means by type based on the hairstyle type and hair color type selection data received from the user. A computer-readable recording medium on which a program for causing a computer to execute illustration data is recorded. The caricature illustration data providing system further includes template data storage means for storing the illustration data with a blank face portion created corresponding to the advertising advertising company in association with the category as a caricature illustration template, and the caricature synthesized with the template Charging data storage means for storing advertisement charging data each time illustration data is downloaded to the user,
Extracting template data by random selection from template data storage means based on category selection information received from the user;
Combining the extracted template data and the caricature illustration data;
Determining whether the user has downloaded the caricature illustration data synthesized by the template synthesis processing means;
8. A computer-readable recording medium storing the program according to claim 7 for causing the computer to further execute a step of writing advertisement charging data in the charging data storage means when it is determined that the user has downloaded.