JP2007133599A - Image processing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To present an accurate simulation image by combining an image on the basis of the information of a base image and the information of a decorative image to be superposed to the base image. <P>SOLUTION: The image processing apparatus is provided with: an image input means 7 for inputting an image of an object; an analysis means 8b for analyzing the positional information of portions of the object, irregularity information and color information on the basis of the image information from the image input means 7; a selection means 8c for selecting a specific portion of the object from the inputted image information; an information storage means 8e for storing information concerned with a decoration for decorating the selected portion; an image composition means 8d for combining an image for the selected portion on the basis of the base color information of the object which is analyzed by the analysis means 8b and color information selected from the information concerned with the decoration which is stored in the information storage means 8e; and an image display means 2 for displaying the image combined by the image composition means 8d. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image processing apparatus that synthesizes images.

Conventionally, there has been proposed an image display device that displays an image synthesized by adding another image to a held image (see Patent Document 1). According to the invention described in this patent document, the size and position of a face area and a facial part are detected for an input image, and a predetermined figure is detected according to the detected position of the facial part. The position and size are relatively changed, and the image is displayed and processed with the input image. As a result, the displayed content can be shown as if the person to be recognized is disguised instantly.
JP 2000-322588 A

  However, in the above proposal, since the predetermined graphic is displayed on the input image together, the input image located under the overlapped portion is hidden by the predetermined graphic superimposed from above. It has been. In other words, when the other image is superimposed on one image, the other image superimposed from above can be seen, but one image underlying that image is hidden behind the other image. Can not.

  For example, if you do not need to see an image of the body underneath these costumes, such as some costumes such as hats and coats, the images of these costumes above the body image It is possible to grasp the state of wearing a costume by putting on as it is. On the other hand, the color of materials (transparent costumes and lipsticks) that are layered with the color of the underlying material (for example, costumes and lips), such as costumes and cosmetics made of transparent materials (see-through materials). In the above proposal, only the color of the material superimposed on the above proposal can be seen, and the color represented by the synthesized image is different from the actual color when wearing a costume or lipstick. turn into. This restricts the case where an accurate simulation image can be obtained by combining a plurality of images.

  In addition, for example, when purchasing lipstick, it is generally not possible to confirm the color of the lipstick by actually applying it to the lips for hygiene and other reasons. In many cases, for example, the color of the back of the hand and the color of the lips are confirmed by trial coating on the back of the hand, but the color of the back of the hand and the color of the lips are often different. There are many cases where the impression differs greatly. Similarly, even when purchasing a costume made of transparent material, for example, the color of the costume varies greatly depending on the color of the inner worn on the day of trying on, and it is troublesome to change the inner each time it is tried on.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to display an image based on information on a base image and information on an image of a decorative item superimposed on the base image. An object of the present invention is to provide an image processing apparatus capable of presenting an appropriate simulation image by combining.

  The feature according to the embodiment of the present invention is that image input means for inputting an image of a subject, analysis means for analyzing position information, unevenness information, and color information of a part of the subject based on image information from the image input means, A selection means for selecting a specific part of the subject from the input image information, an information storage means for storing information relating to an ornament that decorates the selected part, and an analysis means for analyzing the selected part Means for synthesizing an image on the basis of the color information of the subject to be the basic tone and the color information selected from the information on the ornament stored in the information storage means, and the image synthesized by the image synthesizing means And image display means for displaying.

  According to the present invention, an image capable of presenting an accurate simulation image by synthesizing an image based on information on a base image and information on an image of a decorative item superimposed on the base image. A processing device can be provided.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(First embodiment)
As shown in FIG. 1, the image processing apparatus 1 according to the first embodiment of the present invention displays an image display unit 2 that displays a synthesized image and the like, and various information according to instructions displayed on the image display unit 2. An information input means 3 for inputting, a showcase 4 for displaying a sample of ornaments, a discharge port 5 through which a printed product is discharged when a synthesized image is printed, and each component device in the image processing apparatus 1 And a control device 8 for controlling.

  FIG. 2 shows an example of how the image processing apparatus 1 is used. For example, the image processing apparatus 1 is arranged beside a general cosmetic showcase A, and a chair B is placed in front of the discharge port 5 in the image processing apparatus 1. A user of the image processing apparatus 1 sits on the chair B so as to face the image display means 2 and becomes a subject.

  3 is a cross-sectional view of the image processing apparatus 1 taken along line AA in FIG. The image display means 2 includes a first half mirror 2a, a second half mirror 2b, and a liquid crystal monitor 2c. When the liquid crystal monitor 2c is not driven, since the power of the backlight of the liquid crystal monitor 2c is not turned on, the user can see his / her appearance in the first half mirror 2a. On the other hand, when the backlight of the liquid crystal monitor 2c is ON, the image displayed on the liquid crystal monitor 2c can be seen through the half mirror 2b and the half mirror 2a. Note that, by the control by the control device 8 to be described later, it is possible to enlarge an image or the like displayed on the liquid crystal monitor 2c, or to correct distortion due to a difference in viewing angle and display it for easy viewing.

  The information input unit 3 inputs various instructions and information to the image processing apparatus 1. In FIG. 1 to FIG. 3, a so-called mouse is drawn. However, for example, a keyboard, various pointing devices, or a touch panel may be used.

  In the showcase 4, samples of ornaments are displayed. Examples of the decorative products displayed here include cosmetics such as lipsticks, foundations, and eye shadows, but may also display precious metals such as earrings and earrings. In the embodiment of the present invention, “decorative items” refer to all items worn on the body, such as cosmetics, precious metals, clothing items and the like.

  The discharge port 5 is a portion from which the composite image printed by the printing unit 6 is discharged. The printing means 6 is naturally capable of color printing in addition to monochrome printing.

  The image input means 7 is, for example, a video camera or a camera, and captures an image of a user that has been transmitted through the first half mirror 2a and reflected by the second half mirror 2b. Note that the image input means 7 not only captures the user first, but also continuously captures until the user finishes using the image processing apparatus 1.

  As shown in FIGS. 3 and 4, the control device 8 is connected to, for example, an image display unit 2, an information input unit 3, a printing unit 6, and an image input unit 7 that constitute the image processing apparatus 1 through a communication cable. .

  The control unit 8 a receives information input by the user using the information input unit 3 and controls each component device of the image processing apparatus 1 and each processing unit in the control device 8. The control means 8a also controls the image input means 7 to photograph the user as a subject, acquires the photographed video information, and transmits it to the analysis means 8b and the selection means 8c.

  The analysis unit 8b performs 3D modeling analysis on the transmitted video information. Since the image input unit 7 continuously captures the video information, the video information can be analyzed in real time. In the analysis means 8b, position information, unevenness information, and color information of the part of the user who is the subject are analyzed. For example, when the user sits on the chair B and the user's object to be photographed is a face, the position of each of the eyes, nose, lips, ears, etc. in the face, the uneven state, the color state Analyzing information such as. Specifically, the brightness and color in the captured face image are digitized into, for example, the three primary colors of red (R), green (G), and blue (B) for each of the divided elements, and the information is used as the basis. Analyzing the facial part by mapping in three dimensions.

  The selection unit 8c selects and specifies a specific part such as lips, ears, or the entire face from the video of the user (subject) taken by the image input unit 7. In addition, information on decorative items such as cosmetics and precious metals necessary for image synthesis is selected from information on decorative items stored in advance in the information storage unit 8e. In addition, in selecting this specific part or decoration, the user can select using the information input means 3 and, of course, it can be used to select lips and lipsticks in the lipstick sales corner, for example. Depending on the situation, a specific part or an ornament may be selected.

  The information on the specific part analyzed and selected and specified by the analyzing unit 8b and the selecting unit 8c and the information on the ornament are transmitted to the image combining unit 8d. The image synthesizing unit 8d synthesizes an image based on the information from these subjects and the information on the ornaments stored in the information storage unit 8e.

  The synthesized image is transmitted to and displayed on the image display means 2 and is stored in the information storage means 8f and printed by the printing means 6 controlled by the print control means 8g.

  Next, the flow of actual image processing will be described with reference to the flowchart shown in FIG. Here, it is assumed that the shooting range is the entire head including the user's face.

  First, when the user of the image processing apparatus 1 sits on the chair B shown in FIG. 2 and faces the image display means 2, a message that the image of the user's face (substance image) is taken into the image display means 2. Is displayed and shooting starts (ST1). The image input means 7 continues to photograph the user who is the subject until the use of the image processing apparatus 1 is finished. The captured image is taken into the image processing apparatus 1 via the control means 8a in the control apparatus 8 (ST2) and analyzed by the analysis means 8b (ST3). Here, the outline of the entire imaged head is first identified, and each part constituting the face is identified from the position information, unevenness information, and color information of the part as the 3D modeling analysis proceeds (ST4). The information of the image once analyzed and specified is stored in the information storage means 8f and displayed on the image display means 2 (ST5).

  The user looks at the displayed image of his / her head, and selects a region where he / she wants to see an image synthesized with the image of the ornament such as lips, eyes or ears. In this case, the user is selected through the information input means 3, and the part selected in the display part is specified by the selection means 8c (ST6). Next, the selection means 8c calls the information on the ornament according to the selected part from the information storage means 8e and displays it on the image display means 2. For example, when a lip is selected, a lipstick sample is displayed. The user selects and inputs an ornament to be used from among the ornaments displayed on the image display means 2. It should be noted that the user may display the ornamental sample on the image display means 2 and select from the ornamental sample displayed on the showcase 4. The ornament selected by the user is selected and specified by the selection means 8c (ST8). When the ornament is selected and specified, information on the selected part stored in the information storage unit 8f is associated (ST9), and an image is synthesized by the image synthesis unit 8d (ST10).

  Here, the composition of the image will be described by taking as an example a case where the part of the subject that is specifically selected and specified is the lip, the selected ornament is the lipstick, and the lipstick is applied on the lip. The information on the decorative product stored in the information storage unit 8e is, for example, information on the color of the cosmetic product. This color information is also stored in advance by digitizing brightness and color for each ornament, for example, into three primary colors of red (R), green (G), and blue (B).

  In general, when a person with little reddish lip color paints a thin pink lipstick on the lips, the color after painting is almost the same as the color of the lipstick. On the other hand, when a person with strong red or purple lip color paints the same lipstick on the lips, the color after painting is expressed as a darker color than the original color of the lipstick. This is because when the lipstick is applied to the lips, the color of the lipstick mixes with the color of the lips to produce a new color. The color of the lipstick is never expressed on the painted lips. Therefore, in the present embodiment, the lip color information and the lipstick color information, which are digitized by calculation, are faithfully reproduced in order to faithfully reproduce the color of the lipstick after the lipstick is applied to the lips. Based on this, find the color after applying lipstick to the lips. The calculation result is transmitted to the image display means 2 and displayed on the image display means 2 (ST11). In the embodiment of the present invention, the composition of the image is performed by calculating each color information. For example, the information storage means 8e stores the color information of the subject and the color information of the ornament in a matrix form. You may obtain | require the image synthesize | combined by other methods, such as the method of storing and calculating | requiring the image synthesized using each color information.

  The synthesized image is displayed on the image display means 2, and the user can confirm the painted state on the screen without actually painting the lipstick on the lips. The displayed image can be printed by the printing means 6 (ST12). If the images are to be combined again thereafter, the process returns to the step of selecting and specifying a part from the above-described specified images (ST6) or the photographing of the real image (ST1).

  As described above, based on the information on the base image (color information on the selected part (lip)) and the information on the image of the decorative item (lip color information on the lipstick) superimposed on the base image, Image processing device that can present the same color as the actual lipstick on the lips as a simple and accurate simulation image by obtaining the color after applying the lipstick and synthesizing the image based on that information Can be provided.

(Second Embodiment)
Next, a second embodiment of the present invention will be described. Note that, in the second embodiment, the same components as those described in the first embodiment are denoted by the same reference numerals, and the description of the same components is omitted because it is duplicated.

  As shown in the flowchart of FIG. 6, the second embodiment is characterized in that in addition to the information on the decorative product, the information on the environment in which the decorative product is used is taken into account when combining the images.

  As shown in FIG. 6, the selection means 8c calls the information of the ornament according to the part selected by the user from the information storage means 8e and displays it on the image display means 2, and the ornament selected by the user is selected. The means 8c is selected and specified (ST8). Thereafter, the usage environment of the selected ornament is further displayed on the image display means 2 (ST8a), and the usage environment is selected by the user. Information on the selected use environment is specified by the selection means 8c (ST8b).

  Even if a lipstick of the same color is attached, the appearance of the color varies greatly depending on the environment in which the lipstick is used, such as outdoors on a sunny day, indoors with electric lights, or indoors with reduced lighting. For example, when light is shining from the left side of the face, the left side of the lips is illuminated with light and the color becomes whitish, and the right side of the lips is shaded and looks dark. In such a state, when a light pink lipstick is applied to the lips, the left side of the lips has a hue close to that of the lipstick, and the right side of the lips has a darker hue than the color of the lipstick. In addition, when a dark red lipstick is applied to the lips, the left side of the lips becomes lighter than the color of the lipstick, and on the contrary, the right side of the lips has a color close to the color of the lipstick. The information storage means 8e stores in advance environmental information in which the amount of light in the outdoors, indoors, weather, etc., and the direction of the light are quantified, considering use in various environments. At the same time, these environmental information is taken into account.

  After applying the lipstick on the lips based on the information on the base image, the information on the image of the decorative item superimposed on the base image, and the information on the condition of the light according to each use environment An image processing apparatus capable of simply and accurately presenting the same color as the environment in which lipstick is actually applied to the lips by synthesizing an image based on the information is obtained. be able to.

(Third embodiment)
Next, a third embodiment of the present invention will be described.

  The third embodiment is characterized in that the image synthesized in accordance with the movement of the user who uses the image processing apparatus 1 also moves following the movement in real time.

  The image input unit 7 continuously captures the user while the user is using the image processing apparatus 1 after first capturing the user's image. Therefore, the motion of the image to be synthesized can be synchronized with the actual motion of the user by performing high-speed arithmetic processing on the information of the constantly photographed image.

  By doing so, it becomes possible to faithfully reproduce changes in shadows and colors caused by the user moving in front of the image processing apparatus 1, and based on these pieces of information, information on ornaments and environmental information can be obtained. By combining the images with consideration, it is possible to provide an image processing apparatus capable of presenting the same state as when an ornament is actually used as a simple and accurate simulation image.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In each of the above-described embodiments, an example at a cosmetics department has been described. In addition, for example, Purikura (registered trademark), for example, a costume made of a transparent material or a plurality of small holes are vacant or transparent When wearing precious metals such as hair ornaments and necklaces with various parts, it can be implemented by incorporating them into a show window of a store that presents a simulation image, a washbasin at home, and the like. Further, the information storage means 8f has a function of storing the synthesized image. However, when this image is held, it is managed as customer information, and the same user uses the image processing apparatus 1 next time. It is also possible to present it as past history information. Further, a user who uses the image processing apparatus 1 stores his / her information, for example, information on the color of his / her face that has been tanned in the summer and information on decorations owned by the user in a storage medium such as a CD-R. These pieces of information may be taken into the image processing apparatus 1 so that information about the user can be corrected or added.

  Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiments. For example, some components may be deleted from all the components shown in the embodiment. Further, for example, the image processing apparatus 1 according to the embodiment of the present invention is provided with an Internet terminal, and the information on the ornaments is appropriately updated so that the latest ornament information is always provided. These constituent elements may be combined as appropriate.

1 is a configuration diagram illustrating an image processing apparatus according to a first embodiment of the present invention. It is a block diagram which shows the usage condition of the image processing apparatus which concerns on the 1st Embodiment of this invention. 1 is a cross-sectional view showing an internal configuration of an image processing apparatus according to a first embodiment of the present invention. It is a block diagram which shows the internal structure of the image processing apparatus which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the flow of the image processing which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the flow of the image processing which concerns on the 2nd Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image processing apparatus 2 Image display means 3 Information input means 6 Printing means 7 Image input means 8 Control apparatus

Claims (6)

An image input means for inputting an image of a subject;
Analysis means for analyzing position information of the part of the subject, unevenness information, and color information based on image information from the image input means;
Selection means for selecting a specific part of the subject from the input image information;
Information storage means for storing information relating to an ornament that decorates the selected part;
An image of the selected portion based on the color information of the subject to be analyzed and the color information selected from the information on the ornament stored in the information storage unit is analyzed by the analysis unit. Means for synthesizing
Image display means for displaying the image synthesized by the image synthesis means;
An image processing apparatus comprising:   The image processing apparatus according to claim 1, wherein the information related to the decorative product stored in the information storage unit is information related to cosmetics.   3. The image processing apparatus according to claim 1, wherein the information related to the ornament stored in the information storage unit is information related to the accessory. 4.   The image processing according to any one of claims 1 to 3, wherein the information stored in the information storage means includes environmental information in which the amount of light inside and outside is digitized. apparatus.   The color information of the image of the subject displayed on the image display means includes color information in the information relating to the ornament stored in the information storage means, color information in the information stored in the information storage means, or both of the environmental information. 5. The image processing apparatus according to claim 1, wherein the image processing apparatus is determined by combining information by calculation.   The image processing apparatus according to claim 1, wherein the composite image displayed by the image display unit has a function of moving following the movement of the subject.

Images