JP2004171560A - Composited image providing system, composited image generation program, information processor and data carrier - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a user to see, when he/she sees a colored commodity such as rouge at a store or on a magazine, a composited image of its trial state in real time at the site by use of a cellular phone. <P>SOLUTION: In this system for providing a composited image to be displayed on the cellular phone, an image such as a face image having a preset color change section such as lip section is preliminarily stored in the cellular phone, and an RFID or two-dimensional code storing color information corresponding to the colored commodity such as rouge is provided on the store or magazine. The user fetches the color information from the RFID or two-dimensional code to the cellular phone. The cellular phone color-converts the color change section on the basis of the fetched color information, and generates and displays the composited image such as the face image with the lip colored with the color corresponding to the rouge. <P>COPYRIGHT: (C)2004,JPO

Description

  The present invention provides a composite image in which an image such as a face image registered by a user is subjected to image composition processing corresponding to a colored product such as lipstick to generate a composite image, and the composite image is provided to a user on a mobile terminal. The present invention relates to a system, a composite image generation program for providing a composite image, an information processing device, and a data carrier.

  As a technical document related to providing a composite image by performing image composition processing corresponding to a colored product such as lipstick on an image such as a face image registered by a user and providing the composite image to the user on a mobile terminal Patent Documents 1 and 2 and Patent Documents 3 to 5 include technical documents related to performing image synthesis processing corresponding to a colored product on a face image of a user to generate a synthesized image and displaying the synthesized image on a display unit. There are Patent Documents 6 to 9 as reference technical documents.

  In Patent Literature 1, a server receives a user's face image from a user terminal such as a mobile phone, analyzes the user's face image, and classifies the image into any of a plurality of impression patterns classified based on a feature amount. Model face images in which makeup is performed on each of the determined impression patterns of the user and the preferred makeup patterns or models corresponding to the plurality of impression patterns including the user impression patterns, respectively. To the terminal, prompting the user to select a makeup pattern on the screen of the terminal, generate a composite image in which virtual makeup is performed on the condition of the makeup pattern selected by the user, and transmit the composite image to the terminal. If a response to approve is received, information on products and methods for achieving the same makeup is sent, and a response to Describes that the correction and transmission of the synthesized image according to the user's request are repeated a predetermined number of times, and further, a part of the information on the product etc. is displayed so as to be displayed on the portable terminal as code information such as a barcode. It describes that a service is provided based on information obtained from code information at a store such as a cosmetics store, and that a product realizing makeup of a composite image can be ordered on a web page.

  In Patent Document 2, a server receives a face image of a user from a terminal of the user such as a mobile phone and selects a plurality of images in accordance with the face image of the user, an inquiry sheet, a product purchase history, or a system use history. The makeup pattern is determined, and a makeup image selected virtually by the user or the server from the plurality of makeup patterns is generated on the terminal by generating a synthetic image in which the face image is virtually made up by a known image processing technique. If you receive a response to approve the composite image and send information about products and methods that realize the same makeup, and if you receive a response to It describes that the correction and transmission of the combined image along the predetermined times are repeated a predetermined number of times.

  Patent Literatures 3 and 4 disclose a makeup section such as a face image of a user captured by an imaging section on a display section, and a shape pattern such as a lip shape in a range in which the color of the makeup section is changed and a color that can be designated. A pattern is registered in advance, and in accordance with the specification of the shape pattern, the position adjustment, and the specification of the color pattern using a light pen, a mouse, or the like, a composite image of the makeup part with the makeup applied is generated, and the composite image is displayed on the display unit. In addition, it describes that the range in which the color is changed is indicated by a mouse, a light pen, or the like as a conventional technique.

  Patent Literature 5 discloses an imaging unit that captures a face of a user, a display unit that displays a face image of the user captured by the imaging unit, and a virtual image of the user's face displayed on the display unit. Means for applying makeup, and a memory in which a plurality of makeup data images representing changes in the face due to makeup are stored, wherein the means for virtually applying makeup selects any one of the makeup data images stored in the memory In addition, a system is described in which the makeup data image is transformed from the face image of the model to which the makeup data has been applied, and the makeup data image is transformed before the makeup of the model. It describes that the image is a face image removed, and that a measured value is used as the transmittance of a makeup data image used in image synthesis.

  In Patent Document 6, an edge image of a face area is generated from a face image, an edge histogram is generated by Y-axis projection, a Y coordinate of each part of the face is searched, and a feature point of a required part is extracted. Tentatively sets a lip candidate region at the Y coordinate position including the mouth, obtains skin color information and its average value from a predetermined range between the lower end of the nose and the upper end of the mouth, and between both ends of the mouth, and the like. It describes that a deviation of the color of the pixel of the lip candidate region from the average value is obtained, and if the deviation exceeds a threshold value, it is determined to be a lip region and extracted.

  Further, in Patent Document 7, an edge is detected by performing a filtering process on luminance information of a face image using a Sobel filter or the like, and a portion outside the outermost edge is separated as a background. A color histogram is converted into a YIQ color system to generate a cumulative histogram of density values on the Q axis, and the cumulative histogram is subjected to threshold processing with a predetermined threshold to determine a lip candidate area. A lip region is extracted by generating a cumulative histogram of values and performing threshold processing on the cumulative histogram with a predetermined threshold, or after determining a lip candidate region with an appropriate configuration, the lip candidate region and its surroundings may be included. A second lip candidate area, and a color component histogram of the lip candidate area and a color component histogram of the second lip candidate area are generated. A threshold value is obtained by multiplying the peak value of the difference histogram by a predetermined coefficient to obtain a threshold value. It describes that a region is extracted as a lip region.

  Patent Literature 8 discloses a database for storing images of displayed objects such as clothes shown in a fashion magazine, a database for storing information related to a user, and a web server to build an experience website. On the computer side of the user or the experience website, add an image image of clothes etc. to a human body model in which the face image of the user is combined with the model image created based on the body size of the user, and superimpose the combined image A system for providing a virtual experience execution unit for generating, accessing the experience website on the user's computer, inputting the number of a display object described in a fashion magazine or the like, acquiring an image image, and generating and displaying a composite image It is further described that a composite image can be generated with furniture, accessories of people and cars, tire wheels, and the like. There.

  Further, in Patent Literature 9, access destination information and a product ID are stored in an RFID provided in association with a product, and the mobile phone fetches the RFID access destination information and the product ID with an RFID reader, and reads the access destination information. The product information server is automatically accessed according to the extraction, and the product ID received from the RFID is transmitted to the product information server. The product information server searches the product information database based on the product ID, and is associated with the product. A system is described in which information is read and returned to a mobile phone, and the returned product information is displayed on the mobile phone.

JP 2002-132916 A JP-A-2002-092132 JP-A-63-80692 JP-A-64-4189 JP 2000-194835 A JP 2000-11145 A JP 2000-348173 A JP-A-2002-24640 JP 2003-198451 A

  Consumers often find their favorite lipstick or the like at a store, or find a description of their favorite lipstick or the like in a magazine, and want to try the colored product such as the lipstick on the spot. That is, there is a strong demand from consumers to check the trial state of colored products in ubiquitous locations. Furthermore, since the interest of the consumer changes over time, it is necessary to promptly confirm the trial state of the colored product in almost real time to make the consumer confirm the trial state of the product and increase the impression of the product. is there.

  The present invention has been made in view of the above problems, and enables a user of a portable terminal to check a trial state of a colored product in a ubiquitous place, and quickly changes the trial state in almost real time. It is an object of the present invention to provide a composite image providing system that allows a user to confirm, a composite image generating program, an information processing device, and a data carrier related to the composite image providing system.

  First, a composite image providing system according to the present invention is a system for providing a composite image displayed on a mobile terminal, wherein the information processing apparatus recognizes a color conversion area set in a target image. The mobile terminal stores a composite image generation program for realizing a function of generating a composite image by performing color conversion based on information, receives a composite image generation program transmission request from the mobile terminal, and responds to the mobile terminal in response to the composite image generation program transmission request. Extract the composite image generation program stored in the terminal, send it to the mobile terminal, receive the target image for setting the color conversion area from the mobile terminal, extract the predetermined color conversion area from the target image, and set it as the target image Then, the target image in which the color conversion area stored in the mobile terminal is set is transmitted to the mobile terminal, and the data carrier provided in association with the colored product is changed to the color of the colored product. Characterized by storing a response to and color information recognized by the mobile terminal to the composite image generation program cooperation with possible capture on a mobile device.

  Further, in the composite image providing system according to the present invention, the composite image generation program recognizes the color conversion area of the area identification information set in the target image based on the recognition of the area identification information set corresponding to the color information. Then, based on the recognition of the color information corresponding to the area identification information, the mobile terminal realizes a function of performing color conversion on the recognized color conversion area to generate a composite image, and the information processing apparatus performs processing on the target image. A plurality of types of color conversion regions, extract each color conversion region and each region identification information in a target image, transmit each color conversion region and a target image in which the identification information is set to a mobile terminal, and Or storing the area identification information and the color information set corresponding to the area identification information, or the combined image generation program recognizes the area identification information set corresponding to the color information. Based on the recognition of the color information corresponding to the area identification information set in the target image based on the recognition of the color information corresponding to the area identification information, And the information processing apparatus receives the color conversion area designation information from the mobile terminal, specifies the color conversion area to be extracted from the target image based on the designation information, and The specified color conversion region is extracted, the color conversion region and the region identification information are set in the target image, the color conversion region and the target image in which the identification information is set are transmitted to the portable terminal, and the data carrier is used for the region identification. It stores information and color information set in correspondence with the area identification information. Further, it is preferable that the information processing apparatus be configured to execute a charging process corresponding to the setting of the color conversion area for a user of the portable terminal.

  The composite image generation program of the present invention is a program for generating a composite image displayed on a mobile terminal, and recognizes and stores color information taken from a data carrier provided in association with a colored product. The portable terminal realizes a function of recognizing the color conversion region of the target image in which the color conversion region is set and performing color conversion of the color conversion region based on the color information to generate a composite image. Based on recognition of area identification information set corresponding to color information taken from a data carrier provided in association with a colored product, color conversion of the area identification information set in the stored target image is performed. The portable terminal has a function of recognizing an area and performing a color conversion of the recognized color conversion area to generate a composite image based on the recognition of the color information set corresponding to the area identification information. Characterized in that to.

  Further, the information processing apparatus of the present invention is provided in association with a colored product, and enables the portable terminal to capture color information corresponding to the color of the colored product and recognized by the mobile terminal in cooperation with the composite image generation program. In cooperation with the data carrier to be stored, it cooperates with a composite image generation program for realizing a function of generating a composite image by performing color conversion based on color information that recognizes a color conversion region set in a target image in a portable terminal. An information processing apparatus for generating a composite image on a mobile terminal, the target image for setting a color conversion area is received from the mobile terminal, a predetermined color conversion area is extracted from the target image, and the target image is set. A target image in which a color conversion area stored in the mobile terminal is set is transmitted to the mobile terminal.

  Further, the data carrier of the present invention receives a target image for setting a color conversion area from a mobile terminal, extracts a predetermined color conversion area from the target image, sets the target color as a target image, and stores a color conversion stored in the mobile terminal. The mobile terminal has a function of generating a composite image by performing color conversion based on color information that recognizes a color conversion area set in the target image in cooperation with an information processing device that transmits a target image in which an area is set to the mobile terminal. A data carrier for generating a composite image on a portable terminal that cooperates with the composite image generation program to be realized, provided in association with a colored product, corresponding to the color of the colored product, and cooperating with the composite image generation program The color information recognized by the mobile terminal is stored so as to be fetchable by the mobile terminal.

  Further, the data carrier of the present invention recognizes color information taken from a data carrier provided in association with a colored product and recognizes a color conversion area of a target image in which a stored color conversion area is set. A data carrier for generating a composite image on a portable terminal having a function of generating a composite image by performing color conversion on a color conversion area based on color information, provided in association with a colored product; Color information recognized by a mobile terminal that cooperates with a composite image generation program, and is stored in a manner that can be captured by the mobile terminal; and further, area identification information of a color conversion area that performs color conversion with the color information. Is preferably stored corresponding to the color information.

  Secondly, the composite image providing system of the present invention is a system for providing a composite image displayed on a mobile terminal, wherein the information processing apparatus extracts a predetermined color conversion area from the target image and And stores a composite image generation program that allows the portable terminal to realize a function of generating a composite image by performing color conversion based on color information that recognizes a color conversion region set in the target image and transmitting the composite image generation program Receiving the request from the mobile terminal, extracting the composite image generation program stored in the mobile terminal in response to the request for transmitting the composite image generation program, transmitting the extracted composite image generation program to the mobile terminal, and providing the data carrier associated with the colored product with the colored product. The color information corresponding to the color and recognized by the portable terminal cooperating with the composite image generating program is stored so as to be fetched by the portable terminal.

  Further, the composite image generation program of the present invention is a program for generating a composite image displayed on a mobile terminal, and extracts a predetermined color conversion area from a target image, sets the extracted color conversion area on the target image, and associates the color conversion area with a colored product. In addition to recognizing the color information taken from the data carrier provided, the color conversion area of the target image in which the stored color conversion area is set is recognized, and the color conversion area is color-converted based on the color information. The mobile terminal realizes a function of generating a composite image by extracting a plurality of types of color conversion areas from a target image, and setting area identification information for identifying the type of the color conversion area, and performing each color conversion. It is characterized in that an area is set in a target image.

  Further, the information processing apparatus of the present invention is provided in association with a colored product, and enables the portable terminal to capture color information corresponding to the color of the colored product and recognized by the mobile terminal in cooperation with the composite image generation program. An information processing apparatus for generating a composite image on a mobile terminal in cooperation with a data carrier to be stored, the information processing apparatus extracting a predetermined color conversion area from a target image, setting the extracted color conversion area as a target image, and setting the target image. The mobile terminal stores a composite image generation program that realizes a function of generating a composite image by performing color conversion based on color information that recognizes a color conversion area that is being recognized, receives a composite image generation program transmission request from the mobile terminal, and performs synthesis. In response to the image generation program transmission request, a composite image generation program stored in the mobile terminal is extracted and transmitted to the mobile terminal.

  Third, a composite image providing system according to the present invention is a system for providing a composite image displayed on a mobile terminal, wherein the information processing apparatus recognizes color identification information recognized from a plurality of types of color information set. A composite image generation program that realizes a function of recognizing color information corresponding to a color conversion area set in the target image and performing a color conversion based on the recognized color information to generate a composite image in the portable terminal. Receiving the transmission request of the composite image generation program from the mobile terminal, extracting the composite image generation program stored in the mobile terminal in response to the transmission request of the composite image generation program, transmitting the extracted composite image generation program to the mobile terminal, and storing the color stored in the mobile terminal. A plurality of types of color information respectively corresponding to the identification information are transmitted to the portable terminal, and the data carrier provided in association with the colored product corresponds to the color information corresponding to the color of the colored product. One color identification information recognized by the mobile terminal to the composite image generation program cooperate with and storing, capturing capable mobile device. The transmission of a plurality of types of color information by the information processing apparatus may be based on the reception of a transmission request from the mobile terminal, or may be configured to transmit the color information periodically or when required.

  Further, the composite image generation program of the present invention is a program for generating a composite image displayed on a mobile terminal, and recognizes and sets color identification information taken from a data carrier provided in association with a colored product. Has a function of recognizing color information corresponding to color identification information from a plurality of types of color information, and performing a color conversion based on the recognized color information in a color conversion area set in the target image to generate a composite image. A terminal that realizes the area identification information of the color information corresponding to the color identification information from the area identification information set corresponding to the color information, and performs color conversion corresponding to the area identification information. It is characterized by recognizing an area.

  Further, the information processing apparatus of the present invention carries color identification information which is provided in association with a colored product, corresponds to color information corresponding to the color of the colored product, and is recognized by a mobile terminal cooperating with a synthetic image generation program. An information processing apparatus for generating a composite image on a portable terminal in cooperation with a data carrier stored in a terminal so as to be capable of being captured, the color corresponding to color identification information recognized from a plurality of types of set color information. A composite image generation program for recognizing information and realizing a function of generating a composite image by performing color conversion based on the recognized color information of the color conversion region set in the target image in the portable terminal is stored. A program transmission request is received from the mobile terminal, and the composite image generation program stored in the mobile terminal is extracted and transmitted to the mobile terminal in response to the composite image generation program transmission request, and stored in the mobile terminal. And transmitting a plurality of kinds of color information respectively corresponding to the color identification information in the mobile terminal.

  Further, the data carrier of the present invention recognizes color identification information taken from a data carrier provided in association with a colored product, and selects a color corresponding to the recognized color identification information from a plurality of types of set color information. A data carrier for recognizing information and generating a composite image in a portable terminal having a function of generating a composite image by performing color conversion based on color information that has recognized a color conversion region set in a target image, It is provided that color identification information corresponding to color information corresponding to the color of the colored product, which is provided in association with the colored product, and which is recognized by the mobile terminal cooperating with the synthetic image generation program, is stored in the mobile terminal so that the color identification information can be captured. Features.

  Fourth, a composite image providing system according to the present invention is a system for providing a composite image displayed on a mobile terminal, wherein the information processing apparatus recognizes a color conversion area set in the target image. The mobile terminal stores a composite image generation program for realizing a function of generating a composite image by performing color conversion based on information, receives a composite image generation program transmission request from the mobile terminal, and responds to the mobile terminal in response to the composite image generation program transmission request. Extract the composite image generation program stored in the terminal, send it to the mobile terminal, store multiple types of color information corresponding to each color identification information, and transfer the color identification information taken into the mobile terminal from the data carrier It receives and extracts the color information corresponding to the color identification information and transmits it to the mobile terminal, and the data carrier provided in association with the colored product matches the color of the colored product. Characterized by storing the color identification information recognized by the mobile terminal for cooperating with corresponding and composite image generating program to the color information taking capable in mobile terminals.

  Further, the composite image generation program of the present invention is a program for generating a composite image to be displayed on a mobile terminal, and obtains color identification information stored in a data carrier provided in association with a colored product from the mobile terminal. Color information received from the information processing device based on the color conversion region and the transmission to the information processing device, the color conversion region of the target image in which the stored color conversion region is set is recognized, and the color conversion region is colored. The feature that the mobile terminal realizes the function of performing color conversion based on information and generating a composite image, and furthermore, the information processing apparatus supports multiple types of color information based on transmission of color identification information to the information processing apparatus Recognize the area identification information stored and received from the information processing apparatus, and recognize the color conversion area of the area identification information set in the stored target image based on the recognition of the area identification information. Characterized in that it.

  Further, the information processing apparatus of the present invention is provided in association with a colored product, stores color identification information corresponding to the color information corresponding to the color of the colored product, and recognized by the information processing device so that the portable terminal can capture the color identification information. In cooperation with a data carrier, a mobile terminal cooperates with a composite image generation program that realizes a function of generating a composite image by performing color conversion based on color information that recognizes a color conversion region set in a target image. An information processing device for generating a composite image at the terminal, storing a plurality of types of color information corresponding to each color identification information, receiving from the mobile terminal the color identification information taken into the mobile terminal from the data carrier, It is characterized by extracting the color information corresponding to the color identification information and transmitting it to the portable terminal, further storing the area identification information corresponding to each color identification information, and corresponding to the color identification information received from the portable terminal. Extracting area identification information that and transmits to the portable terminal.

  Further, the data carrier of the present invention stores a plurality of types of color information corresponding to each color identification information, receives the color identification information taken into the mobile terminal from the data carrier from the mobile terminal, and stores the color corresponding to the color identification information. In cooperation with an information processing device that extracts information and sends it to the mobile terminal, a function to generate a composite image by performing color conversion based on the color information that recognizes the color conversion area set in the target image is realized in the mobile terminal A data carrier for generating a composite image at a portable terminal cooperating with the composite image generation program to be provided, which is provided in association with a colored product, corresponds to color information corresponding to the color of the colored product, and Color identification information recognized by a portable terminal cooperating with the portable terminal is stored so as to be fetched by the portable terminal.

  Fifth, a composite image providing system of the present invention is a system for providing a composite image displayed on a mobile terminal, wherein the information processing apparatus receives a target image for setting a color conversion area from the mobile terminal. A predetermined color conversion area is extracted from the target image and set as the target image, the target image in which the color conversion area is set is stored, a plurality of types of color information corresponding to each color identification information are stored, Color identification information received by the terminal is received from the mobile terminal, color information corresponding to the color identification information is recognized, and color conversion is performed based on the recognized color information in the color conversion area set in the target image and synthesized. Generates an image, transmits the generated composite image to the mobile terminal, and stores the color identification information of the color information corresponding to the color of the colored product so that the color identification information corresponding to the color of the colored product can be captured by the mobile terminal. Do And wherein the door.

  Also, the information processing apparatus of the present invention is provided in association with a colored product, and in cooperation with a data carrier that stores color identification information of color information corresponding to the color of the colored product so as to be able to be captured by the mobile terminal. An information processing apparatus for providing a composite image displayed by a color carrier, stores a target image in which a color conversion area is set, and stores a plurality of types of color information corresponding to each piece of color identification information. Color identification information received by the terminal is received from the mobile terminal, the color information corresponding to the color identification information is recognized, and the color conversion area set in the target image is subjected to color conversion based on the recognized color information and combined. An image is generated, and the generated composite image is transmitted to the mobile terminal. The target image in which the color conversion area is set, the target image in which the color conversion area is set is received from the mobile terminal, a predetermined color conversion area is extracted from the target image and set as the target image, and the color conversion area is set. The configuration for storing the target image is preferable because the target image can be set on a mobile terminal from a ubiquitous location, which is preferable.However, from a color conversion area processing device connected to a storefront or a storefront terminal via a communication network. A configuration in which a target image in which a color conversion area is set is received and stored in association with a user ID or the like, or the information processing apparatus extracts and sets a color conversion area for a target image received from a terminal such as a store. It is also possible to adopt a configuration in which the data is stored after being applied. Further, area identification information corresponding to each color identification information is stored, area identification information corresponding to the received color identification information is recognized, a color conversion area corresponding to the area identification information is recognized, and the color conversion area is color-coded. A configuration in which color conversion is performed based on information may be adopted.

  Further, the data carrier of the present invention receives a target image for setting a color conversion area from a mobile terminal, extracts a predetermined color conversion area from the target image, sets the target color as a target image, and sets a target image in which the color conversion area is set. , Storing a plurality of types of color information corresponding to each color identification information, receiving the color identification information taken into the mobile terminal from the data carrier from the mobile terminal, and recognizing the color information corresponding to the color identification information. The color conversion area set in the target image is color-converted based on the recognized color information to generate a composite image, and the generated composite image is displayed on the mobile terminal in cooperation with an information processing device that transmits the generated composite image to the mobile terminal. A data carrier for providing a synthesized image to be provided, wherein the data carrier is provided in association with a colored product, and stores color identification information of color information corresponding to the color of the colored product so as to be captured by a mobile terminal. I do.

  Sixth, a composite image providing system of the present invention is a system for providing a composite image displayed on a mobile terminal, wherein the information processing apparatus receives a target image for setting a color conversion area from the mobile terminal. Extracting a predetermined color conversion area from the target image, setting the target image as the target image, storing the target image in which the color conversion area is set, receiving the color information taken into the mobile terminal from the data carrier from the mobile terminal, The color conversion area set in the image is color-converted based on the color information to generate a composite image, the generated composite image is transmitted to the mobile terminal, and the data carrier provided in association with the colored product is It is characterized in that color information corresponding to a color is stored so as to be fetched by a portable terminal.

  The information processing apparatus of the present invention is provided in association with a colored product, and is displayed on the mobile terminal in cooperation with a data carrier that stores color information corresponding to the color of the colored product so that the color information can be captured by the mobile terminal. An information processing device for providing a composite image, wherein a target image in which a color conversion area is set is stored, color information received from a data carrier into a mobile terminal is received from the mobile terminal, and the target image is set in the target image. The color conversion area is color-converted based on the color information to generate a composite image, and the generated composite image is transmitted to the mobile terminal. Similarly to the above, the target image for which the color conversion area is set is obtained by receiving the target image for which the color conversion area is set from the mobile terminal, extracting a predetermined color conversion area from the target image and setting the target image, It is preferable to store the target image in which the region is set, but it is also possible to receive the target image in which the color conversion region is set from the color conversion region processing device and store it. Further, a configuration may be adopted in which the area identification information taken into the mobile terminal from the data carrier is received from the mobile terminal, a color conversion area corresponding to the area identification information is recognized, and the color conversion area is color-converted based on the color information. .

  Further, the data carrier of the present invention receives a target image for setting a color conversion region from a mobile terminal, extracts a predetermined color conversion region from the target image, sets the target color image as a target image, and sets the target image in which the color conversion region is set. The color information captured by the mobile terminal from the data carrier is received from the mobile terminal, and the color conversion area set in the target image is color-converted based on the color information to generate a composite image. A data carrier for providing a composite image displayed on the mobile terminal in cooperation with an information processing device that transmits an image to the mobile terminal. The data carrier is provided in association with a colored product and has a color corresponding to the color of the colored product. It is characterized in that the information is stored so as to be fetched by the portable terminal, and that the area identification information of the color conversion area to be color-converted with the color information is stored corresponding to the color information.

  Seventhly, as a further modification of the present invention, the color to be converted is recognized by recognizing access destination information of a site that provides information related to the colored product, which is taken in from a data carrier provided in association with the colored product. A composite image generation program for realizing the function of setting the access destination information in the conversion area so that the input destination information can be designated or input, or the information processing apparatus is set and stored in the mobile terminal so as to correspond to each of a plurality of types of color information. A function of recognizing the access destination information corresponding to the color identification information from the access destination information of the site that provides the related information of the colored product, and setting the access destination information in the color conversion area for color conversion so that it can be designated and input. A composite image generation program realized by a portable terminal, or a color quotient stored in an information processing device corresponding to color identification information, extracted and transmitted based on the color identification information, A composite image generation program that allows a portable terminal to realize a function of setting access destination information in a color conversion area for color conversion based on recognition of access destination information of a site that provides related information, or The processing device stores the access destination information stored in correspondence with the color identification information, recognizes the access destination information of the site that provides the related information of the colored product, or receives the access destination information received from the mobile terminal by being taken into the mobile terminal from the data carrier. It is possible to provide a composite image providing system or the like that recognizes and sets access destination information in the color conversion area for color conversion so that it can be designated and input to generate a composite image. In addition, a configuration in which a smaller number of data carriers associated with the colored products are provided than the plurality of colored products displayed at the store, or the information processing device or the mobile terminal automatically generates the composite image based on the generation of the composite image Or in a state where the composite image can be transmitted to another person based on a storage request to be input or received, and stored in a storage location corresponding to an album or the like that can be browsed through a communication connection of the information processing apparatus, an image folder of a mobile terminal, or the like. It is also suitable as a configuration or the like. Further, as the color information corresponding to one colored product, color information corresponding to the color of the colored product and color information corresponding to the color of another colored product related to the colored product may be set. Furthermore, the data carrier, the portable terminal, or the information processing device may be configured to store the transmittance of the color information used in the weighting synthesis of the color conversion in correspondence with the color information. May be set to be selectable.

  Note that the information processing apparatus of the present invention is an information processing server, or a plurality of information processing servers that perform different processing, or a network computer in which the information processing server and other devices are connected via a network, or The information processing device may be a computer other than the server. In addition, transmission and reception between the information processing device and the portable terminal can be performed via an appropriate communication network or communication method, and is not limited to the case where the communication is performed via a communication network capable of long-distance communication. A mobile terminal is provided with a communication control unit for short-range optical communication such as infrared communication and a communication control unit for short-range wireless communication such as Bluetooth (registered trademark). It is also possible to adopt a configuration in which connection is made directly by communication and necessary data is transmitted and received. In addition, the mobile terminal includes a mobile phone and a mobile information terminal. The configuration for setting and storing the various programs used in the present invention in the portable terminal is not limited to downloading from the information processing device, but is appropriate. Further, the data carrier includes a wireless IC chip such as an RFID and code information such as a two-dimensional code or a code information recording medium. Further, the colored products of the present invention include products that color objects including humans, and products that have the same or uniform shape and are themselves colored. Further, in the present invention, a configuration in which the configuration of each invention is added to another configuration within the applicable range, a configuration in which each configuration is changed to another configuration within the applicable range, The present invention includes those in which the configuration of each invention is deleted to the extent that a partial operation and effect can be obtained.

  By using the composite image providing system and the like of the present invention, colored products displayed in stores, colored products described in magazines, catalogs, posters, etc., colored products displayed on electronic paper, etc., can be transferred to a mobile terminal. When the user sees, the user captures color information and color identification information from the data carrier present in association with the colored product on the spot with the mobile terminal, and the target image in which the color conversion area is set in advance By receiving the display of the composite image obtained by performing the color conversion for the color conversion area, the trial state of the colored product can be confirmed on the spot. In other words, the trial state of the colored product can be confirmed at ubiquitous times and places. Furthermore, since the composite image can be viewed with a simple operation of the mobile terminal based on the preset target image, for example, the user asks a clerk or the like to provide the composite image or takes a face image at the store. There is no need for troublesome work, and the composite image can be easily and easily checked. In addition, when it is difficult to actually use colored products such as lipstick in a crowded store, or when you want to check the trial state of colored products for an object such as a person or a car that does not exist, check the trial state. Can be.

  Furthermore, by setting the target image and the color conversion region for color conversion of the target image in advance, when the user receives the display of the composite image, there is no need to perform advanced arithmetic processing such as extraction and setting of the color conversion region. A composite image is obtained by a process of recognizing the color conversion area and performing color conversion based on the color information. Therefore, it is possible to save labor in image processing, and to provide a user with a composite image of a trial state of a colored product in a much shorter time than in actual coloring. In particular, when the user receives the display of the composite image, the user wants to check the trial state of the colored product if the configuration is such that the stored image of the data carrier can be received by the portable terminal only by receiving the stored information. It is possible to drastically shorten the time from the occurrence of the desire to the provision of the trial state, and to confirm the trial state in real time before the interest of the user shifts from the colored product.

  By providing the ubiquitous and quick composite image, the convenience and recreation of the colored product for the user can be enhanced, the degree of impression can be improved, and a high sales promotion effect can be obtained. In particular, when a plurality of types of color conversion areas are set in the target image and each color conversion area is configured to be color convertible with the color of the product corresponding to each color conversion area, the user may select a desired plurality of types of colored products. It is possible to check the trial state by combining at any time, further enhance the convenience, entertainment, and impression of the user's colored products, and obtain a higher sales promotion effect, such as promoting purchases by combining multiple colored products. Can be. Further, by storing the color information and the region identification information or the color identification information having a small data amount in the data carrier, it is possible to avoid the problem of insufficient storage capacity. Furthermore, since an image captured by a mobile terminal by imaging or communication can be set as a target image and a color conversion area can be set, a desired image can be easily set as a target image with a color conversion area set. Furthermore, for example, when a user shares a sample of a coloring cosmetic such as a lipstick with another person and actually colors the product, the trial is performed in a case where the trial use of the colored product has a problem of the user's psychological resistance or hygiene, and is synthesized. It is possible to eliminate the need for trials using actual coloring in trials using images, and it is possible to eliminate psychological resistance and hygiene problems of users.

  In addition, the configuration for charging the setting of the color conversion area for the target image can secure a price corresponding to the color conversion area setting processing that requires a large amount of arithmetic processing or labor. By adjusting the amount of money, the number of times of the color conversion area setting process can be adjusted to the number of times suitable for the arithmetic processing capability or labor of the information processing apparatus. In addition, the configuration in which the mobile terminal captures the information stored in the data carrier, and the mobile terminal generates and displays a composite image from the information, significantly shortens the time required to receive the display of the composite image, and further increases the use time. There is an advantage that the user can receive the display of the composite image without paying the communication fee of the mobile terminal. On the other hand, in a configuration in which a mobile terminal transmits information captured from a data carrier to an information processing device and the information processing device transmits color information or the like or a composite image to the mobile terminal, extraction, transmission, or synthesis of the color information or the like is performed. Charges can be made in response to data processing and transmission such as image generation and transmission, and profits can be secured by covering the operating costs for providing composite images with the charge.

  Further, by setting the access destination information of the site that provides information related to the colored product in the color conversion area for color conversion, it is possible to immediately provide the related information of the colored product as needed, The convenience of the user can be improved, and the user can specify and access the color-converted color conversion area such as the lips of the user's own image. it can. In particular, by setting access destination information in a plurality of types of color conversion areas, it is possible to immediately provide related information corresponding to each of a plurality of colored commodities, thereby further improving entertainment. In addition, the number of data carriers associated with the colored product is smaller than the number of the colored products displayed at the store, such as providing a data carrier on a sample, shelf, or display case of the colored product displayed at the store. With the configuration provided, it is not necessary to provide a data carrier for the purpose of the composite image of the color conversion in all of the colored products in the shop, and the composite image can be provided with a lower cost and labor with a small number of data carriers. Separately from the use of the data carrier directly provided on the colored product, a data carrier for providing a composite image can be provided at a store. In addition, the composite image generated by the color conversion is stored in the portable terminal or the information processing device so that the composite image can be transmitted to another person, and the other person can view the composite image. It is expected that synthetic images will be used in a peer-to-peer environment, and it will be possible to obtain publicity effects such as word-of-mouth for the provision of colored products and synthetic images. Can be planned.

  The present invention will be described based on an embodiment of a composite image providing system for providing a composite image displayed on a mobile phone. It should be noted that partial configurations and the like of each embodiment and each example described later are appropriately used and added as configurations of other embodiments and examples as long as applicable, and partial configurations of each embodiment and each example are added. The configuration is appropriately changed to a partial configuration or the like relating to another embodiment or example within an applicable range, or the configuration or the like relating to each embodiment or each example is partially limited to the extent that a partial operation and effect can be obtained. The present invention includes those in which the general configuration and the like are deleted. Furthermore, the present invention also includes a case where a partial configuration in each embodiment or each example is appropriately used for a configuration of another part in the same embodiment or the same example.

  First, a composite image providing system according to the first embodiment will be described. As shown in FIG. 1, the synthetic image providing system according to the first embodiment includes an information processing server 10 as an information processing apparatus, a mobile phone 20 as a mobile terminal, and an RFID 30 as a data carrier. Is connected as needed via a wireless base station (not shown), a mobile phone network 2, a gateway server (not shown), and the Internet network 3, and the mobile phone 20 and the RFID 30 are connected via short-range wireless communication. Connected as needed.

  The information processing server 10 includes a communication control unit 11 that performs communication control, a memory such as a storage area for a CPU and a control program and a data processing area, and a control unit 12 that executes a predetermined process according to the control program, and transmits to the mobile phone 20. A site data storage unit 13 for storing site data used by a site processing unit 121, which will be described later, such as a site screen to be extracted, transmitting / receiving a target image for which a color conversion region is set, and receiving / storing a target image for which a color conversion region is set. A composite image generation program storage unit 14 that stores a composite image generation program that causes a portable terminal to realize a function of generating a composite image by performing color conversion on a color conversion area set in a target image based on color information; Corresponding to the user's password, name, address, e-mail address, credit card number, and other payment information User information database 15 for storing that data, and a billing information database 16 for storing billing information for the user corresponding to the user ID. The control unit 12 functions as a site processing unit 121 that performs normal site processing such as transmission of a site screen and processing of received data on a predetermined site screen, and extracts a composite image generation program and distributes it to the mobile phone 20. A distribution processing unit 122, a color conversion area processing unit 123 that sets a color conversion area for the target image received from the mobile phone 20 and transmits the target image, and a charging processing unit 124 that executes a charging process to the user for the setting of the color conversion area. Function as

  The mobile phone 20 includes a communication control unit 21 that performs communication control, a CPU and a memory such as a storage area for a control program and a data processing area, and a control unit 22 that performs a predetermined process according to the control program. Operation input such as a storage unit 23 for storing various set data such as a set target image and its color conversion area, and a target image captured by the imaging unit 26, a display unit 24 such as a liquid crystal display, and a button for receiving a user's operation input. Unit 25, an imaging unit 26 such as a CCD camera or a CMOS camera that captures a target image, an RFID reader 27 that transmits radio waves to the RFID 30 and receives response radio waves from the RFID 30 to read information on the response radio waves, and additionally includes a speaker. It has necessary parts required to function as a mobile phone such as a mobile phone and a microphone.

  The RFID 30 stores a control unit that executes a predetermined process according to a control program not shown in the figure, color information such as RGB values, and area identification information that is identification information indicating the type of a color conversion area to be color-converted using the color information. The mobile phone 20 includes a storage unit, a power supply unit, and an antenna. Radio waves transmitted from the RFID reader 27 of the mobile phone 20 are received by the antenna, power is generated from the received radio waves by the power supply unit and supplied to the control unit. In response to the radio wave information request, the color information and the area identification information stored in the storage unit are read, and the read color information and the area identification information are transmitted to the RFID reader 27 of the mobile phone 20 via the antenna. The RFID 30 is provided in association with the colored product 31, and the configuration of the association is appropriate as long as the location of the colored product 31 and the location of the RFID 30 shaking the relationship with the colored product 31 is clear to the user. As a specific example in which the RFID 30 is provided in association with the colored product 31, for example, a sample of the colored product 31, which is provided inside the colored product 31 and attached to the packaging of the colored product 31 or the colored product 31. Or a price tag, provided at a predetermined location in the display case of the colored product 31, provided at a predetermined location on the shelf where the colored product 31 is provided, provided at a position close to the colored product 31, at a location away from the colored product 31 In such a configuration, it is provided in a place that can be recognized as the installation location of the RFID 30 with respect to the colored product 31, provided on a paper surface such as a magazine, poster, catalog, or the like on which the colored product 31 is displayed, or provided on electronic paper that displays the colored product 31. Is possible. Further, the color information can be an appropriate color system value such as an RGB value, an HSV value, a YIQ value, or the like. A part of the color system value such as only the luminance value is set as the color information. The control unit 22 or the combined image processing unit 126 cooperating with the combined image generation program described later may perform color conversion of the color information as necessary when performing color conversion of the color conversion area based on the color information. Color conversion may be performed by performing a colorimetric conversion process such as converting the system from an HSV value to an RGB value.

  When providing the composite image displayed on the display unit 24 of the mobile phone 20 in the composite image providing system of the first embodiment, for example, the composite image is provided in the following process (see FIG. 2). First, the user inputs access destination information such as the URL of the information processing server 10 to the mobile phone 20 and inputs a connection request. Based on the transmission of the connection request of the mobile phone 20, the information processing server 10 and the mobile phone 20 To establish a communication connection. The site processing unit 121 of the information processing server 10 transmits an initial screen using the site data stored in the site data storage unit 13, and the control unit 22 of the mobile phone 20 displays the received initial screen on the display unit 24. I do. On the initial screen, items corresponding to a request for presenting a user registration site and a request for presenting a download site for a composite image generation program are displayed so that they can be designated and input.

  If the user is not registered in the composite image providing service, a new member registration is performed. For example, in the process of new member registration, the user designates and inputs a user registration site presentation request item using the operation input unit 25, and the control unit 22 of the mobile phone 20 transmits a user registration request site presentation request according to the input. Is transmitted to the information processing server 10, while the site processing unit 121 of the information processing server 10 receives the user registration request site presentation request, and receives the user's password, name, address, e-mail address, and credit. A user registration screen is displayed to the mobile phone 20 in which input fields for necessary items such as card number and settlement information and items corresponding to a user registration request that can be specified and input are displayed. The control unit 22 of the mobile phone 20 displays the received user registration screen on the display unit 24, and further responds to the input of the necessary items for registration on the user registration screen and the specification of the user registration request. Then, the registration necessary items and the user registration request input on the user registration screen are transmitted to the information processing server 10, while the site processing unit 121 of the information processing server 10 receives the user registration request and the registration required items. , A user ID for the user of the mobile phone 20 is generated, a member registration end screen displaying a message indicating that the user ID and the member registration have been completed is transmitted to the mobile phone 20 and the user ID is And, each necessary registration item is stored in each storage location of the user information DB 15. On the other hand, the control unit 22 of the mobile phone 20 displays the received member registration end screen on the display unit 24 and, if necessary, stores the user ID in a predetermined storage location of the storage unit 23 based on the user ID setting registration input. , The new member registration process is completed.

  Further, when the user downloads the composite image generation program to the mobile phone 20, the user designates and inputs the download site presentation request item of the composite image generation program on the initial screen with the operation input unit 25, and The control unit 22 of the telephone 20 transmits the download site presentation request to the information processing server 10 in response to the input, while the site processing unit 121 of the information processing server 10 responds to the reception of the download site presentation request. Then, an authentication screen in which input fields for a user ID and a password and items corresponding to an authentication request that can be specified and input are displayed is transmitted to the mobile phone 20. The control unit 22 of the mobile phone 20 displays the received authentication screen on the display unit 24. Further, in response to the input of the user ID and the password on the authentication screen and the designation input of the item of the authentication request, the authentication screen is displayed. The input user ID, password, and authentication request are transmitted to the information processing server 10, while the site processing unit 121 of the information processing server 10 transmits the user ID, the password, and the user ID in response to the reception of the authentication request, the user ID, and the password. A program in which a password corresponding to the received user ID is extracted from the information DB 15 and collated with the received password. If the passwords match, a program for displaying a download request item of the composite image generation program can be designated. The distribution screen is transmitted to the mobile phone 20. If the passwords do not match, a screen displaying a message indicating that the authentication has failed is transmitted to the mobile phone 20. The control unit 22 of the mobile phone 20 displays the received program distribution screen on the display unit 24, and transmits a download request to the information processing server 10 in response to the designation input of the download request of the program distribution screen. The distribution processing unit 122 of the processing server 10 extracts the composite image generation program from the composite image generation program storage unit 14 and transmits the extracted composite image generation program to the mobile phone 20 in response to receiving the download request. In response to the reception of the composite image generation program, the control unit 22 of the mobile phone 20 stores the composite image generation program in a predetermined storage location of the memory of the control unit 22, and becomes operable according to the composite image generation program (S101). ).

  When the user obtains the target image in which the color conversion area has been set, first, the user performs designation input of a composite image generation program on the program selection screen of the mobile phone 20, and The control unit 22 starts the composite image generation program. The control unit 22 cooperating with the composite image generation program is configured to specify each image of the normal image captured and stored in the mobile phone 20 such as the image captured by the imaging unit 26 in order to specify the image for setting the color conversion area. Items corresponding to the display request of the normal image list screen for displaying a list of identification information so that they can be designated and input are stored in the mobile phone 20 in order to receive the provision of a composite image by the target image in which the color conversion area is set. The display unit 24 displays an initial screen in which items corresponding to the display request of the area-set target image list screen are displayed in a list so that each identification information of the target image for which the color conversion area is set can be designated and input. The normal image list screen is displayed on the display unit 24 in response to the specification input of the display request of the normal image list screen, and in response to the specification input of the identification information of the required image in the normal image list screen. Items corresponding to the specific request that identifies and displays on the display unit 24 a confirmation screen displaying the desired image with a desired image is displayed as a target image to set a color conversion area. Further, the control unit 22 specifies the image for which the color conversion area is to be set as the target image according to the input of the specification request according to the composite image generation program, and also allows the user ID and password to be input and specified. An authentication screen in which items corresponding to the request for setting the color conversion area for the target image are displayed on the display unit 24. The user ID and password are input on the authentication screen, and the color conversion to the target image is also performed as the authentication request. In response to the designation input of the area setting request, a connection request is transmitted based on the access destination information of the information processing server 10 set in the composite image generation program to establish a connection with the information processing server 10 and is input on the authentication screen. The user ID and password, the color conversion area setting request for the target image, and the specified target image are transmitted to the information processing server 10 (S102). The target image is, for example, a face image in which the face of the user in a front view is mostly displayed. The authentication data to be authenticated is not limited to the above, but may be fingerprint data or the like.

  The information processing server 10 receives the user ID, the password, the color conversion area setting request, and the target image from the mobile phone 20 (S103), and the site processing unit 121 transmits the color conversion area setting request, which also serves as an authentication request, and the user. In response to the reception of the ID and the password, the password corresponding to the received user ID is extracted from the user information DB 15 and compared with the received password. If the passwords do not match, the authentication is not successful. A screen displaying a message to the effect is transmitted to the mobile phone 20. If the passwords match in the comparison, the color conversion area processing unit 123 extracts a predetermined color conversion area from the received target image (S104), and assigns a color conversion area to each of the extracted color conversion areas. Area identification information indicating the type is added, and each color conversion area and the area identification information of each color conversion area are set in association with the target image (S105), and the target image in which each color conversion area corresponding to each area identification information is set And a color conversion area setting completion screen are transmitted to the mobile phone 20 (S106). Further, the charging processing unit 124 executes a charging processing for the user for setting the color conversion area and the area identification information to the target image, A predetermined amount to be set and stored is charged to the user of the user ID, and the charging amount or the amount obtained by adding the charging amount to the already charged amount is associated with the user ID, and the charging information D is set. 16 to be stored (S107). On the other hand, the control unit 22 of the mobile phone 20 receives, from the information processing server 10, the target image in which each color conversion area and the area identification information of each color conversion area are set and the color conversion area setting completion screen (S108). The identification information is added to each color conversion area and the target image in which the area identification information of each color conversion area is set, stored in a predetermined storage location of the storage unit 23 (S109), and the received color conversion area setting completion screen is displayed on the display unit 24. And the setting process of the color conversion area is completed. The extraction of the color conversion area and the setting of the color conversion area and the area identification information indicating the type of the color conversion area for the target image can be executed by an appropriate technique such as an example described later. The color conversion area to be set is, for example, a plurality of types of color conversion areas based on a combination of a lip area or a lipstick coloring area, a foundation coloring area, a blusher coloring area, and an eye shadow coloring area.

  Thereafter, when the user receives the provision of the composite image by the target image in which the color conversion region is set, first, the composite image generation program is started in the same manner as described above, and the display request of the normal image list screen and the region setting completion are performed. On the initial screen in which each item corresponding to the display request of the target image list screen is displayed, the user specifies and inputs a display request of the area-set target image list screen. The control unit 22 of the mobile phone 20 displays an area-set target image list screen on the display unit 24 according to the designation input according to the composite image generation program, and displays the desired target image on the area-set target image list screen. In response to the designation input of the identification information, the color conversion regions corresponding to the designated identification information and the target image in which the region identification information of each color conversion region is set are extracted from the storage unit 13 (S110), and the extracted target image is extracted. Is displayed, and the display unit 24 displays a capture screen in which items corresponding to the capture request of the color information and the area identification information from the RFID 30 are displayed so that they can be designated and input.

  Further, the control unit 22 cooperating with the composite image generation program, in response to the designation input of the request for taking in the color information and the area identification information, from the RFID 30 which is associated with the colored product 31 and is close to the RFID reader 27, The RFID reader 27 receives the color information and the area identification information of the color conversion area to be color-converted using the color information, recognizes the color conversion area by using an identifier (S111), and sets each color conversion set in the extracted and displayed target image. A color conversion area corresponding to the area identification information received from the area is recognized (S112), and the recognized color conversion area of the target image is color-converted based on the received color information to generate a composite image of the target image ( (S113), the composite image is displayed on the display unit 24 (S114). The color conversion based on the color information for the color conversion area of the target image can be performed by an appropriate technique such as an example described later, and the color conversion for the color conversion area is, for example, lip area or lipstick coloring. Color conversion based on the color information corresponding to the lipstick color for the area, or color conversion based on the color information corresponding to the foundation color for the foundation colored area, or color conversion based on the color information corresponding to the blushed color for the rouge colored area, or eye The color conversion or the like based on the color information corresponding to the eye shadow color for the shadow coloring area.

  Then, the display of the composite image is displayed in place of the extracted and displayed target image on a capture screen in which items corresponding to the capture request of the color information and the area identification information from the RFID 30 are displayed so as to be able to be designated and input. When a capture request for another RFID 30 is separately input after that, the control unit 22 according to the composite image generation program executes color information and area identification information from the separate RFID 30 by the same processing as described above. The color conversion area that is the same as or different from the color-converted color conversion area corresponding to the area identification information is color-converted based on the color information separately received from the RFID 30 to generate and display a composite image.

  In this case, if the same color conversion region as the previously generated composite image is to be color-converted with a later-generated composite image, the image is replaced with a color-converted region image that has been color-converted based on the subsequent color information and displayed. In the case where a color conversion area of a different type from the previously generated composite image is subjected to color conversion using a composite image generated later, the image of the color conversion area obtained by color conversion using the previously generated composite image is left. In this state, an image of a color conversion area, which is color-converted based on the subsequent color information, is generated and displayed. For example, when displaying a synthesized face image in which the lip region is color-converted based on the color information corresponding to the lipstick color, when the color information corresponding to the lipstick color for the lip region is newly recognized, the newly recognized color information is newly recognized. A configuration in which a composite face image in which the lip region is color-converted with the color information is generated and displayed, and a composite face image in which the lip region is color-converted based on the color information corresponding to the lipstick color is displayed. When the color information corresponding to the foundation color for the coloring area is recognized, the lip area is color-converted based on the color information corresponding to the lipstick color. And the like for generating and displaying the synthesized face image. Further, in response to the designation input of the save button, the input of identification information, or the like, or automatically based on the generation or display end, the control unit 22 of the mobile phone 20 stores the composite image generated by the color conversion with the identification information attached thereto. It may be stored in a predetermined storage location such as an image folder of the unit 23 and stored so as to be transmitted to another person.

  When performing color conversion on a color conversion area of a different type before and after, when performing color conversion on a color conversion area of a later type, the color conversion on the color conversion area of the previous type is performed on the original image. For example, when displaying a synthesized face image in which the lip area is color-converted based on the color information corresponding to the lipstick color, when the color information corresponding to the foundation color for the foundation colored area is recognized. In the configuration, the color conversion of the lip region based on the color information corresponding to the lipstick color is returned to the state of the original image, and a composite face image in which the foundation colored region is color-converted with the color information corresponding to the foundation color is generated and displayed. And so on.

  In the first embodiment, a case has been described as an example where the color conversion regions of the face image as the target image are four regions of a lip region, a foundation coloring region, a blusher coloring region, and an eye shadow coloring region. May be a plurality of types other than the four types or a single type. When the target image has one type of color conversion area, the color conversion area and the area identification information capable of identifying the color conversion area from other areas or the area identification information capable of identifying the color conversion area from other areas Is set as the target image, the color information is stored in the RFID 30 or a color information set storage unit described later without storing the region identification information, and the control unit 22 cooperating with the composite image generation program or a control unit described later. The composite image processing unit 126 may be configured to perform color conversion on a set color conversion area based on recognition of color information.

  Further, the target image and the color conversion area are not particularly limited as long as the color conversion can be performed using the color information corresponding to the colored product 31. For example, the target image is a face image including the hair, the color conversion area is the hair area, the colored product 31 Is a hair manicure, or the target image is an image of a finger or a hand showing a nail area, the color conversion area is a nail area, the coloring product 31 is a manicure, or the target image is an image of a car or model. A structure in which the color conversion area is a body area of a car or a model, and the colored product 31 is colored spray or paint, or a target image is an image in which the outer or inner wall of a building is shown, and a color converted area is an outer wall area, an inner wall area, or a colored product 31 A paint or a wall material or wallpaper of a predetermined color, a target image is an image showing furniture, a color conversion area is a furniture display area, a colored product 31 is a paint or colored spray, or a target image is a window cover. The image / color conversion area where the image is displayed is a window glass area / the colored product 31 is a window glass of a predetermined color, or the target image is an image / color conversion area where an eye area such as a face image is displayed from the iris area or iris. It is possible to adopt a configuration or the like in which the substantially black eye region / colored product 31 up to a predetermined distance is used as a color contact lens.

  Next, a composite image providing system according to a second embodiment will be described. In the composite image providing system according to the second embodiment, the color conversion area is set in the target image received by the information processing server 10 and transmitted to the mobile phone 20 according to the first embodiment. Instead of receiving the target image set in the storage unit 23 and storing it in the storage unit 23, the information processing server 10 executes a composite image generation program that causes the mobile phone 20 to realize a function of setting and storing a color conversion area in the target image. Transmits to the mobile phone 20, the mobile phone 20 stores the received composite image generation program, extracts a color conversion area from the target image according to the composite image generation program, and stores the target image in which the color conversion area is set in the storage unit 23. In the configuration. Note that the same configuration as that described in other embodiments and the like such as the first embodiment can be appropriately used for the configuration that is not particularly described in the second embodiment.

  As shown in FIG. 3, in the composite image providing system according to the second embodiment, the information processing server 10 and the mobile phone 20 are timely connected via the mobile phone network 2 and the Internet network 3, as in the first embodiment, The mobile phone 20 and the RFID 30 are appropriately connected via short-range wireless communication. The information processing server 10 includes a communication control unit 11, a control unit 12, a site data storage unit 13, and a composite image generation program storage unit 14 as in the first embodiment, but is stored in the composite image generation program storage unit 14. The composite image generation program extracts a predetermined color conversion region from the target image, sets the target color in the target image, stores the target image in which the color conversion region is set, and extracts the target image in which the color conversion region is set, The portable terminal realizes a function of generating a composite image by performing color conversion on a color conversion area set in a target image based on color information. Further, it does not have the user information database 15 and the billing information database 16, and the control unit 12 functions as a site processing unit 121 and a distribution processing unit 122. As in the first embodiment, the mobile phone 20 includes a communication control unit 21, a control unit 22, a storage unit 23, a display unit 24, an operation input unit 25, an imaging unit 26, and an RFID reader 27. The composite image generation program is stored in a memory of the information processing server 10 by download from the information processing server 10, and the control unit 22 executes a predetermined process according to the composite image generation program. The RFID 30 has the same configuration as that of the first embodiment, and stores color information such as RGB values and area identification information indicating the type of a color conversion area to be color-converted by the color information in its storage unit.

  When the composite image providing system of the second embodiment provides the composite image displayed on the display unit 24 of the mobile phone 20, it is provided, for example, in the following process (see FIG. 4). First, a communication connection is established between the information processing server 10 and the mobile phone 20, the information processing server 10 transmits an initial screen using the site data, and the mobile phone 20 displays the received initial screen on the display unit 24. On the initial screen, items corresponding to the presentation request of the download site of the composite image generation program are displayed so that they can be designated and input. The mobile phone 20 transmits the download site presentation request to the information processing server 10 in response to the designation input of the presentation request item, while the site processing unit 121 of the information processing server 10 receives the download site presentation request. In response to the request, a program distribution screen on which the item of the download request of the composite image generation program is displayed so as to be specified is transmitted to the mobile phone 20. The mobile phone 20 displays the received program distribution screen, and transmits a download request to the information processing server 10 in response to the designation input of the download request. On the other hand, the information processing server 10 The composite image generation program is extracted from the composite image generation program storage unit 14 and transmitted to the mobile phone 20. In response to the reception of the composite image generation program, the control unit 22 of the mobile phone 20 stores the composite image generation program in a predetermined storage location of the memory of the control unit 22 and becomes operable according to the composite image generation program (S201). ).

  When the user obtains the target image in which the color conversion area has been set, the user inputs and designates the composite image generation program on the program selection screen of the mobile phone 20, and the control unit 22 of the mobile phone 20 specifies the composite image. Start the generated program. The control unit 22 which cooperates with the composite image generation program, for specifying an image for setting the color conversion area, stores each of normal images captured and stored in the mobile phone 20 such as an image captured by the imaging unit 26. The identification information is stored in the mobile phone 20 in order to receive the provision of an item corresponding to the display request of the normal image list screen and the provision of the composite image by the target image in which the color conversion area is set. An initial screen is displayed on the display unit 24 in which items corresponding to the display request of the area-set target image list screen are displayed so that each identification information of the target image for which the color conversion area is set can be designated and input. Then, the normal image list screen is displayed on the display unit 24 in response to the specification input of the display request of the normal image list screen, and in accordance with the specification input of the identification information of the required image in the normal image list screen, Items corresponding to the specific request that identifies and displays on the display unit 24 a confirmation screen displaying the desired image with a main image is displayed as a target image to set a color conversion area.

  Further, the control unit 22 of the mobile phone 20 specifies an image for setting the color conversion area as a target image in accordance with the input of the specification request according to the composite image generation program, and performs a predetermined color conversion from the specified target image. A region is extracted (S202), region identification information indicating the type of the color conversion region is added to each of the extracted color conversion regions, and the color conversion regions and the region identification information of each color conversion region are set in association with the target image. (S203), the identification information is added to each color conversion area and the target image in which the area identification information of each color conversion area is set and stored in a predetermined storage location of the storage unit 23 (S204), and the setting processing of the color conversion area is completed. . Processing similar to the processing of the color conversion area processing unit 123 in the first embodiment can be used as appropriate for the processing of the control unit 22 such as extraction, setting, and storage of the color conversion area. Thereafter, similarly to the processing of S110 to S114 of the first embodiment, the mobile phone 20 extracts a target image in which each color conversion area corresponding to each area identification information is set (S205), and colors it with the RFID reader 27. The color information and the area identification information of the color conversion area using the color information are received and recognized from the RFID 30 associated with the product 31 (S206), and correspond to the area identification information received from each color conversion area of the target image. The color conversion area having the area identification information is recognized (S207), the recognized color conversion area is color-converted based on the received color information to generate a composite image (S208), and the generated composite image is displayed on the display unit 24. (S209). The composite image is displayed on the same screen as the capture screen of the first embodiment, and the same processing as that of the first embodiment can be performed from the capture screen.

  Next, a composite image providing system according to a third embodiment will be described. The composite image providing system according to the third embodiment stores the color information and the region identification information of the color conversion region in which the color conversion is performed by the color information in the first embodiment. Instead of receiving the area identification information, recognizing a color conversion area corresponding to the received area identification information of the target image, and performing color conversion on the color conversion area based on the received color information to generate a composite image, The processing server 10 stores, as a color information set, a plurality of types of color information respectively corresponding to the respective color identification information, and each area identification information of a color conversion area for performing color conversion with each color information, and distributes the color information set to the mobile phone 20. The RFID 30 stores the color identification information, the mobile phone 20 receives the color identification information from the RFID 30, and stores the color information corresponding to the received color identification information. And extract the area identification information, recognize the color conversion area corresponding to the extracted area identification information of the target image, and convert the color conversion area based on the extracted color information to generate a composite image. It is. Note that the same configuration as that described in the other embodiments such as the first embodiment can be appropriately used for the configuration not particularly described in the third embodiment.

  As shown in FIG. 5, in the composite image providing system of the third embodiment, as in the first embodiment, the information processing server 10 and the mobile phone 20 are timely connected via the mobile phone network 2 and the Internet network 3, The mobile phone 20 and the RFID 30 are appropriately connected via short-range wireless communication. The information processing server 10 includes a communication control unit 11, a control unit 12, a site data storage unit 13, a composite image generation program storage unit 14, a user information DB 15, and a billing information DB 16, as in the first embodiment. Reference numeral 12 functions as a site processing unit 121, a distribution processing unit 122, a color conversion area processing unit 123, and a billing processing unit 124, and further includes a plurality of types of color information and each area identification of a color conversion area corresponding to each color information. The information includes a color information set storage unit 17 that stores a color information set which is data in which each color information and its area identification information are set corresponding to each color identification information, and the distribution processing unit 122 extracts the color information set. The processing for distributing to the mobile phone 20 is executed, and the stored composite image generation program stores the color information corresponding to the color identification information recognized from the color information set. Recognizes the fine area identification information, is used for realizing the corresponding target image a function of converting based color the color conversion region in the color information to the area identification information to the portable terminal. As in the first embodiment, the mobile phone 20 includes a communication control unit 21, a control unit 22, a storage unit 23, a display unit 24, an operation input unit 25, an imaging unit 26, and an RFID reader 27. The color information set received from the information processing server 10 is stored in the predetermined storage location 23, and the control unit 22 executes a predetermined process according to the stored composite image generation program. The RFID 30 has the same basic configuration as that of the first embodiment, but stores color identification information in its storage unit, and the control unit extracts the color identification information and transmits it to the mobile phone 20.

  When providing the composite image displayed on the display unit 24 of the mobile phone 20 in the composite image providing system of the third embodiment, for example, the composite image is provided in the following process (see FIG. 6). First, the same processing as the member registration and the processing of S101 to S109 of the first embodiment is performed. That is, new member registration is performed as necessary from the initial screen transmitted from the information processing server 10 to the mobile phone 20, and a composite image generation program is received from the information processing server 10 to the mobile phone 20 and stored in a predetermined storage location. The image is stored (S301), and the mobile phone 20 transmits a target image for which a color conversion area is to be set to the information processing server 10 (S302). Upon reception (S303), the color conversion area processing unit 123 extracts a predetermined color conversion area from the received target image (S304), and adds area identification information indicating the type of the color conversion area to each of the extracted color conversion areas. Then, each color conversion area and the area identification information of each color conversion area are set in association with the target image (S305), and each color conversion area corresponding to each area identification information is set. The target image is transmitted to the mobile phone 20 (S306), and the charging processing unit 124 executes a charging process for the user for setting the color conversion area and the area identification information to the target image (S307). The mobile phone 20 receives, from the information processing server 10, the color conversion areas and the target image in which the area identification information of each color conversion area is set (S308), and sets the received color conversion areas and the area identification information of each color conversion area. The identification information is attached to the target image and stored in a predetermined storage location of the storage unit 23 (S309).

  Then, when the user receives the distribution of the color information set, the user first specifies and inputs a composite image generation program on the program selection screen of the mobile phone 20, and the control unit 22 of the mobile phone 20 performs the synthesis. Start the image generation program. In the third embodiment, the control unit 22 cooperating with the composite image generation program performs a color information set distribution process in addition to the items corresponding to the normal image list screen display request and the area set target image list screen display request. An initial screen on which an item corresponding to the request is displayed is displayed on the display unit 24, and in response to the designation input of the color information set distribution processing request, a color information set distribution field that also serves as an input field for a user ID and a password and an authentication request. An authentication screen on which an item corresponding to the request is displayed is displayed on the display unit 24. The user inputs the user ID and the password on the authentication screen, and specifies the color information set distribution request which also serves as the authentication request. A connection request is transmitted based on the access destination information of the information processing server 10 set in the generation program to establish a connection with the information processing server 10, and a user input on the authentication screen is performed. To send a user ID and password and color information set distribution request to the information processing server 10.

  The information processing server 10 receives the user ID, the password, and the color information set distribution request from the mobile phone 20, and the site processing unit 121 responds to the color information set distribution request also serving as the authentication request and the user ID and the password. Then, the same authentication processing as in the case of distributing the composite image generation program is executed. When the authentication is performed based on the agreement of the password, the distribution processing unit 122 extracts the color information set stored in the color information set storage unit 17 and transmits the color information set to the mobile phone 20 based on the color information set distribution request. . In response to receiving the color information set from the information processing server 10, the control unit 22 of the mobile phone 20 stores the received color information set in a predetermined storage location of the storage unit 23, and the color information set follows a composite image generation program. The state becomes usable by the control unit 22 (S310).

  Thereafter, when the user receives the provision of the composite image by the target image in which the color conversion area is set, the user starts the composite image generation program in the same manner as described above, and requests the normal image list screen display request and the area-set target image list. On the initial screen where items corresponding to the screen display request and the color information set distribution processing request are displayed, the user designates and inputs a display request for the area-set target image list screen. The control unit 22 of the mobile phone 20 displays an area-set target image list screen on the display unit 24 according to the designation input according to the composite image generation program, and displays the desired target image on the area-set target image list screen. In response to the designation input of the identification information, the color conversion regions corresponding to the designated identification information and the target image in which the region identification information of each color conversion region is set are extracted from the storage unit 13 (S311), and the extracted target image is extracted. Is displayed on the display unit 24, and an item corresponding to the request for importing the color identification information from the RFID 30 is displayed so as to be able to be designated and input.

  Further, the control unit 22 cooperating with the composite image generation program, in response to the designation input of the request for capturing the color identification information, changes the RFID reader 27 associated with the colored product 31 and close to the RFID reader 27 to the RFID reader 27. Receives the color identification information and recognizes it by an identifier (S312), and recognizes color information corresponding to the received color identification information and area identification information of a color conversion area to be color-converted with the color information from the color information set (S313). ), A color conversion region corresponding to the recognized region identification information is recognized from each color conversion region set in the extracted and displayed target image (S314), and the recognized color conversion region of the target image is recognized. Color synthesis is performed based on the color information to generate a composite image of the target image (S315), and the composite image is displayed on the display unit 24 (S316). The display of the composite image is configured to be displayed in place of the extracted and displayed target image on a capture screen in which an item corresponding to the capture request of the color identification information from the RFID 30 is displayed so as to be able to be designated and input. If there is a separate input of a capture request for the RFID 30 such as another, the control unit 22 according to the composite image generation program performs the color identification information The color identification information corresponding to the region identification information is recognized from the color information set, and the same or different color conversion region as the color-converted color conversion region corresponding to the region identification information is separately received from the RFID 30 by the color identification information. The color information is converted based on the color information recognized based on the image, and a composite image is generated and displayed.

  Next, a composite image providing system according to a fourth embodiment will be described. In the composite image providing system according to the fourth embodiment, the information processing server 10 distributes and stores a color information set to the mobile phone 20 according to the third embodiment, and the mobile phone 20 performs processing based on the stored color information set. Instead of recognizing the color information and the area identification information corresponding to the color identification information received from the RFID 30, the mobile phone 20 transmits the color identification information received from the RFID 30 to the information processing server 10, and the information processing server 10 stores the color identification information. The color information and the region identification information corresponding to the color identification information received from the mobile phone 20 are recognized based on the color information set to be transmitted, and the color information and the region identification information are transmitted to the mobile phone 20. Recognizing the color information and the area identification information received from the information processing server 10, and assigning the color conversion area of the target image corresponding to the area identification information to the color information. And Hazuki color conversion is obtained by the arrangement for generating the composite image. It should be noted that the same configuration as that described in the other embodiments such as the first and third embodiments can be appropriately used for the configuration not particularly described in the fourth embodiment.

  As shown in FIG. 7, in the composite image providing system of the fourth embodiment, the information processing server 10 and the mobile phone 20 are timely connected via the mobile phone network 2 and the Internet network 3 as in the third embodiment, The mobile phone 20 and the RFID 30 are appropriately connected via short-range wireless communication. As in the third embodiment, the information processing server 10 includes a communication control unit 11, a control unit 12, a site data storage unit 13, a composite image generation program storage unit 14, a user information DB 15, a billing information DB 16, and a color information set storage. The control unit 12 functions as a site processing unit 121, a distribution processing unit 122, a color conversion area processing unit 123, and a billing processing unit 124, and the control unit 12 controls the color identification information received from the mobile phone 20. Functions as a color information distribution processing unit 125 that recognizes color information and area identification information corresponding to the color information set stored in the color information set storage unit 17 and transmits the recognized color information and area identification information to the mobile phone 20; The stored composite image generation program recognizes the received color information and the area identification information, and sets the color conversion area of the target image corresponding to the area identification information to the color information. It is used for realizing the function of based color conversion on the mobile terminal. The mobile phone 20 includes a communication control unit 21, a control unit 22, a storage unit 23, a display unit 24, an operation input unit 25, an imaging unit 26, and an RFID reader 27 as in the third embodiment. The color information set is not stored in the storage unit 23, and the control unit 22 performs a predetermined process according to the stored composite image generation program. The RFID 30 is the same as that of the third embodiment, and transmits stored color identification information to the mobile phone 20.

  When providing the composite image displayed on the display unit 24 of the mobile phone 20 in the composite image providing system of the fourth embodiment, for example, the composite image is provided in the following process (see FIG. 8). First, the same processing as the member registration and the processing of S101 to S109 or S301 to S309 of the first and third embodiments is performed (S401 to S409). Then, when the user receives the provision of the composite image by the target image in which the color conversion area is set, first, the user performs designation input of the composite image generation program on the program selection screen of the mobile phone 20, and The control unit 22 of the mobile phone 20 starts the composite image generation program. The control unit 22 cooperating with the composite image generation program displays on the display unit 24 an initial screen on which items corresponding to the display request of the normal image list screen and the display request of the area set target image list screen are displayed, In response to the designation input of the display request of the area-set target image list screen, the area-set target image list screen is displayed on the display unit 24, and the identification information of the desired target image in the area-set target image list screen is specified. In response to the input, each color conversion area corresponding to the specified identification information and a target image in which the area identification information of each color conversion area is set are extracted from the storage unit 13 (S410), and the extracted target image is displayed. At the same time, the display unit 24 displays a capture enabled screen on which items corresponding to the capture request of the color identification information from the RFID 30 are displayed so as to be able to be designated and input.

  Further, the control unit 22 cooperating with the composite image generation program, in response to the designation input of the request for capturing the color identification information, changes the RFID reader 27 associated with the colored product 31 and close to the RFID reader 27 to the RFID reader 27. Receives the color identification information and recognizes it (S411), and in response to the reception of the color identification information, transmits a connection request based on the access destination information of the information processing server 10 set by the composite image generation program to process the information. A connection is established with the server 10, and a color information distribution request and the color identification information are transmitted to the information processing server 10 (S412). The information processing server 10 receives the color information distribution request and the color identification information from the mobile phone 20 (S413), and the color information distribution processing unit 125 receives the color information distribution request and the color identification information in response to the color information distribution request and the color identification information. The color information corresponding to the color identification information and the area identification information of the color conversion area to be color-converted with the color information are extracted from the color information set of the color information set storage unit 17 (S414), and the extracted color information and area identification information are extracted. The message is transmitted to the mobile phone 20 (S415). On the other hand, the mobile phone 20 receives and recognizes the color information corresponding to the color identification information and the area identification information transmitted from the information processing server 10 (S416), and the control unit 22 according to the composite image generation program executes the extraction. A color conversion region corresponding to the received region identification information is recognized from each color conversion region set in the displayed target image (S417), and the recognized color conversion region of the target image is determined based on the received color information. The composite image of the target image is generated by color conversion (S418), and the composite image is displayed on the display unit 24 (S419).

  The display of the composite image is configured to be displayed in place of the extracted target image on a capture screen in which an item corresponding to the capture request of the color identification information from the RFID 30 is displayed so as to be able to be designated and input. When there is an input of a capture request to the other RFID 30 or the like, the control unit 22 according to the composite image generation program receives color identification information from the separate RFID 30 or transmits from the mobile phone 20 by the same processing as described above. Based on the reception of the color information and the area identification information corresponding to the color identification information, the color conversion area that is the same as or different from the color-converted color conversion area corresponding to the received area identification information is recognized. The color conversion area is color-converted based on the generated color to generate and display a composite image.

  Next, a composite image providing system according to a fifth embodiment will be described. The composite image providing system according to the fifth embodiment is different from the first to fourth embodiments in which the mobile phone 20 performs a process of generating a composite image by performing color conversion on a color conversion region of a target image based on color information. The processing server 10 extracts the target image, the color information, and the region identification information corresponding to the color information based on the user ID and the color identification information received from the mobile phone 20, and performs color conversion of the target image corresponding to the region identification information. In this configuration, a region is color-converted based on color information to generate a composite image, and the composite image is transmitted to the mobile phone 20. Note that the same configuration as that described in other embodiments such as the first and fourth embodiments can be appropriately used for the configuration not particularly described in the fifth embodiment.

  As shown in FIG. 9, the composite image generation program according to the fifth embodiment is configured such that the information processing server 10 and the mobile phone 20 are connected via the mobile phone network 2 and the Internet network 3 as in the first to fourth embodiments. The mobile phone 20 and the RFID 30 are appropriately connected via short-range wireless communication. The information processing server 10 includes a communication control unit 11, a control unit 12, a site data storage unit 13, a user information DB 15, a billing information DB 16, and a color information set storage unit 17, as in the fourth embodiment. Reference numeral 12 functions as a site processing unit 121, a distribution processing unit 122, a color conversion area processing unit 123, and a billing processing unit 124. The target image in which the color conversion area and its area identification information are set corresponds to the user ID. The control unit 12 includes a target image DB 18 to be stored, a support program storage unit 19 to store a support program for supporting provision of a composite image, and a control unit 12 that stores color information and an area corresponding to the color identification information received from the mobile phone 20. The identification information is recognized from the color information set in the color information set storage unit 17, and the target image corresponding to the user ID received from the mobile phone 20 is stored in the target image DB. 8, a color conversion area of the target image corresponding to the recognized area identification information is recognized, a color conversion is performed on the color conversion area based on the recognized color information to generate a composite image, and the composite image is generated. The color conversion area processing unit 123 has a function as a composite image processing unit 126 that transmits the image to the mobile phone 20. The color conversion area processing unit 123 sets the target image in which the color conversion area and the area identification information are set in correspondence with the user ID. Stored in the DB 18, the distribution processing unit 122 extracts a support program for supporting provision of a composite image and distributes the support program to the mobile phone 20. The mobile phone 20 has the same basic configuration as the fourth embodiment and the like, and includes a communication control unit 21, a control unit 22, a storage unit 23, a display unit 24, an operation input unit 25, an imaging unit 26, and an RFID reader 27. Although provided, the control unit 22 stores a support program and executes a predetermined process according to the support program. The RFID 30 transmits color identification information to be stored to the mobile phone 20 in the same manner as the fourth embodiment.

  When providing the composite image displayed on the display unit 24 of the mobile phone 20 in the composite image providing system of the fifth embodiment, for example, the composite image is provided in the following process (see FIG. 10). First, the user inputs the access destination information of the information processing server 10 and the connection request to the mobile phone 20, and based on the transmission of the connection request of the mobile phone 20, establishes a communication connection between the information processing server 10 and the mobile phone 20. To establish. The site processing unit 121 of the information processing server 10 transmits an initial screen using the site data stored in the site data storage unit 13, and the control unit 22 of the mobile phone 20 displays the received initial screen on the display unit 24. I do. On the initial screen, items corresponding to a request for presenting a user registration site and a request for presenting a download site for a support program are displayed so that they can be designated and input. The process of member registration by the user registration site is the same as in the first embodiment.

  When the user downloads the support program for supporting the provision of the composite image to the mobile phone 20, the user specifies and inputs the support program download site presentation request item on the initial screen using the operation input unit 25. Then, the control unit 22 of the mobile phone 20 transmits the download site presentation request to the information processing server 10 in response to the input, while the site processing unit 121 of the information processing server 10 transmits the download site presentation request In response to the reception, an authentication screen in which input fields for the user ID and password and items corresponding to an authentication request that can be specified and input are displayed is transmitted to the mobile phone 20. Further, an authentication process is performed in the same manner as in the case of downloading the composite image generation program of the first embodiment or the like, and if the passwords match, a program distribution screen is displayed in which the download request item of the support program can be designated. Send to mobile phone 20. The control unit 22 of the mobile phone 20 displays the received program distribution screen on the display unit 24, and transmits a download request to the information processing server 10 in response to the designation input of the download request of the program distribution screen, The distribution processing unit 122 of the processing server 10 extracts the support program from the support program storage unit 19 and transmits the support program to the mobile phone 20 in response to receiving the download request. In response to the reception of the support program, the control unit 22 of the mobile phone 20 stores the support program in a predetermined storage location of the memory of the control unit 22, and becomes operable according to the support program (S501).

  Then, when the user stores the target image in which the color conversion area has been set in the information processing server 10, the user performs designation input of the support program on the program selection screen of the mobile phone 20, and The control program is started by the control unit 22. The control unit 22 cooperating with the support program identifies each identification information of a normal image captured and stored in the mobile phone 20 such as an image captured by the imaging unit 26 in order to specify an image for setting a color conversion area. Are stored in the information processing server 10 in order to receive the provision of an item corresponding to the display request of the normal image list screen and the provision of the composite image by the target image in which the color conversion area has been set. The display unit 24 displays an initial screen on which items corresponding to the display processing request of the area-set target image list screen are displayed in a list so that each identification information of the target image for which the color conversion area has been set can be designated and input. indicate. Further, the same processing as that of the composite image generation program of the first embodiment is performed, and the user ID, the password, the color conversion area setting request for the target image, and the specified target image are transmitted to the information processing server 10. (S502).

  The information processing server 10 receives the user ID, the password, the color conversion area setting request, and the target image from the mobile phone 20 (S503), performs the same authentication processing as in the first embodiment, and determines that the password is If they match, the color conversion area processing unit 123 extracts a predetermined color conversion area from the received target image (S504), and adds area identification information indicating the type of the color conversion area to each of the extracted color conversion areas. In addition, each color conversion area and area identification information of each color conversion area are set in association with the target image (S505), and identification information is added to the target image in which each color conversion area corresponding to each area identification information is set, It is stored in a predetermined storage location of the target image DB in association with the user ID (S506). A charging process for the user is executed, a predetermined amount to be set and stored is charged to the user of the user ID, and the charging amount or the amount obtained by adding the charging amount to the already charged amount is used as the user ID. Is stored in the billing information DB 16 (S507). Further, the color conversion area processing unit 123 displays a color conversion area setting completion screen on which the identification information attached to the target image is displayed and a message indicating that the setting and storage of the color conversion area for the target image is completed is displayed. The image is transmitted to the mobile phone 20, and the mobile phone 20 displays the received color conversion area setting completion screen on the display unit 24, thereby completing the color conversion area setting processing.

  Thereafter, when the user receives the provision of the composite image by the target image in which the color conversion area is set, the support program is started in the same manner as described above, and the display request of the normal image list screen and the area-set target image list screen are performed. On the initial screen in which the items corresponding to the display processing request are displayed, the user specifies and inputs a display processing request for the area-set target image list screen. In accordance with the support program, the control unit 22 of the mobile phone 20 displays, in response to the input, an item corresponding to a user ID and a password input field or an item corresponding to a display request of an area-set target image list screen that can be designated and input. The screen is displayed on the display unit 24, and is set by the support program in accordance with the input of the user ID and the password on the authentication screen and the designation input of the display request for the area-set target image list screen also serving as the authentication request. A connection request is transmitted based on the access destination information of the information processing server 10 to establish a connection with the information processing server 10, and the user ID and password input on the authentication screen and the display request for the area-set target image list screen are transmitted to the information. Send it to the processing server 10.

  The information processing server 10 receives the user ID, the password, and the display request for the area-set target image list screen from the mobile phone 20, and the site processing unit 121 displays the area-set target image list screen that also serves as an authentication request. In response to the request and the reception of the user ID and the password, the authentication processing is executed in the same manner as described above. If the passwords match, one or more of the user IDs set in the target image DB 18 corresponding to the user ID are set. Each identification information of the target image in which the color conversion area and the area identification information are set is extracted, and each identification information of the target image set corresponding to the user ID is extracted using the site data of the site data storage unit 13. An area-set target image list screen to be displayed in a list so as to allow designation input is generated, and the area-set target image list screen is transmitted to the mobile phone 20. On the other hand, the mobile phone 20 receives the area-set image list screen, and the control unit 22 according to the support program displays the area-set image list screen on the display unit 24, and displays the area-set target image list screen. The designated identification information and the request for displaying the target image are transmitted to the information processing server 10 in accordance with the designation input of the identification information of the desired target image. On the other hand, the information processing server 10 receives the display request of the target image and the specified identification information from the mobile phone 20, and the site processing unit 121 responds to the reception by requesting each color conversion area corresponding to the received identification information. Then, a target image in which the region identification information of each color conversion region is set is extracted from the target image DB, and the extracted target image is transmitted to the mobile phone 20 (S508). According to the support program, the control unit 22 of the mobile phone 20 recognizes the received target image in which the color conversion region and the region identification information are set, displays the target image, and responds to the request for capturing the color identification information from the RFID 30. A capture screen in which the corresponding item is displayed so that it can be designated and input is generated, and the capture screen is displayed on the display unit 24.

  Further, the control unit 22 cooperating with the support program, in response to the designation input of the request for capturing the color identification information, transmits the color by the RFID reader 27 from the RFID 30 which is associated with the colored product 31 and is close to the RFID reader 27. The identification information is received and recognized by the identifier (S509), and in response to the reception of the color identification information, a connection request is transmitted based on the access destination information of the information processing server 10 set in the support program, and the information processing server 10 is received. Then, the connection is established, and the request for generating a composite image and the color identification information are transmitted to the information processing server 10 (S510). The information processing server 10 receives the composite image generation request and the color identification information from the mobile phone 20 (S511), and the composite image processing unit 126 responds to the composite image generation request and the color identification information by receiving the received color. The color information corresponding to the identification information and the area identification information of the color conversion area to be color-converted with the color information are extracted from the color information set of the color information set storage unit 17 (S512), and set as the target image being extracted and displayed. A color conversion area corresponding to the extracted area identification information is recognized from each of the obtained color conversion areas (S513), and the recognized color conversion area of the target image is color-converted based on the extracted color information to synthesize the target image. An image is generated (S514), and the composite image is transmitted to the mobile phone 20 (S515).

  The mobile phone 20 receives the composite image transmitted from the information processing server 10 (S516), and the control unit 22 recognizes the received composite image according to the support program, displays the composite image, and identifies the color from the RFID 30. A capture screen is displayed in which items corresponding to the information capture request are displayed so that they can be designated and input, and the capture screen is displayed on the display unit 24 (S517). Thereafter, when there is a separate input of a capture request for another RFID 30 from the capture available screen on which the composite image is displayed, the same processing as described above, that is, when the mobile phone 20 receives another capture request from another RFID 30. Receiving the color identification information, transmitting the color identification information to the mobile phone 20, generating a captureable screen on which the received composite image is displayed, and color information and area identification information corresponding to the color identification information of the information processing server 10. By generating and transmitting a composite image of the target image based on the above, a composite image obtained by performing color conversion on a color conversion area that is the same as or different from the color-converted area of the already displayed composite image is performed. Note that the combined image generation processing of the combined image processing unit 126 can use the same processing as the combined image generation processing performed by the control unit 22 according to the combined image generation program of the first to fourth embodiments. Also, in response to the designation input of the save button, the input of the identification information, or the like, or automatically based on the reception, the identification information is added to the composite image received by the control unit 22 of the mobile phone 20 and the image folder of the storage unit 23, etc. The control unit 22 of the mobile phone 20 transmits the storage request and the identification information to the information processing server 10 according to a configuration in which the storage request is stored in a predetermined storage location and transmitted so as to be transmitted to another person, or a storage request or a transmission input of identification information. Based on the storage request and the identification information received by the predetermined unit of the control unit 12 of the information processing server 10 or automatically based on the generation and transmission of the synthesized image, the transmitted synthesized image is automatically stored in the predetermined storage location. , And may be stored so as to be displayed on an album site that can be viewed by another person through a communication connection.

  Next, a composite image providing system according to a sixth embodiment will be described. The composite image providing system according to the sixth embodiment transmits the color identification information received by the mobile phone 20 from the RFID 30 to the information processing server 10 according to the fifth embodiment, from the color information set stored in the information processing server 10. Instead of extracting color information and area identification information corresponding to the received color identification information, recognizing a color conversion area of the target image corresponding to the area identification information, and performing color conversion using the color information, the mobile phone 20 uses the RFID 30. The information processing server 10 recognizes the color conversion area of the target image corresponding to the area identification information received from the mobile phone 20, and receives the color information and the area identification information received from the mobile phone 20 from the mobile phone 20. The color conversion area is color-converted with the obtained color information. Note that the same configuration as that described in another embodiment such as the fifth embodiment can be appropriately used for the configuration not particularly described in the sixth embodiment.

  As shown in FIG. 11, the composite image generation program according to the sixth embodiment connects the information processing server 10 and the mobile phone 20 via the mobile phone network 2 and the Internet network 3 in a timely manner as in the fifth embodiment. The mobile phone 20 and the RFID 30 are appropriately connected via short-range wireless communication. The information processing server 10 includes a communication control unit 11, a control unit 12, a site data storage unit 13, a user information DB 15, a billing information DB 16, a target image DB 18, and a support program storage unit 19, similarly to the fifth embodiment. The control unit 12 functions as a site processing unit 121, a distribution processing unit 122, a color conversion area processing unit 123, a billing processing unit 124, and a composite image processing unit 126, but does not have the color information set storage unit 17, The composite image processing unit 126 recognizes a target image corresponding to the user ID received from the mobile phone 20 from the target image DB 18, and recognizes a color conversion area of the target image corresponding to the area identification information received from the mobile phone 20. The color conversion area performs color conversion based on the color information received from the mobile phone 20 to generate a composite image, and transmits the composite image to the mobile phone 20. The mobile phone 20 includes a communication control unit 21, a control unit 22, a storage unit 23, a display unit 24, an operation input unit 25, an imaging unit 26, and an RFID reader 27 as in the fifth embodiment. According to the support program, the color information and the area identification information taken from the RFID 30 are recognized and transmitted to the information processing server 10. The RFID 30 stores the color information and the area identification information in its storage unit, and transmits the color information and the area identification information to the mobile phone 20, and is the same as the first embodiment.

  When the composite image providing system according to the sixth embodiment provides the composite image displayed on the display unit 24 of the mobile phone 20, it is provided, for example, in the following process (see FIG. 12). First, as in the fifth embodiment, a communication connection is established between the information processing server 10 and the mobile phone 20, and the information processing server 10 displays a user registration site presentation request and a support program download site presentation request. An initial screen is transmitted, a member registration is performed on the user registration site as needed, and a support program is downloaded to the mobile phone 20 on the download site (S601). Further, the initial screen of the support program is displayed on the mobile phone 20, and in the same process as that of the composite image generation program of the first and fifth embodiments, the user ID, the password, and the color conversion area setting request for the target image are requested. Then, the specified target image is transmitted to the information processing server 10 (S602). Further, similarly to the fifth embodiment, the information processing server 10 receives the user ID, the password, the color conversion area setting request, and the target image (S603), and the color conversion area processing unit 123 transmits the received target image. A predetermined color conversion area is extracted from the image data (S604), area identification information indicating the type of the color conversion area is added to each of the extracted color conversion areas, and the area identification information of each color conversion area and each color conversion area is added to the target image. The corresponding image is set (S605), identification information is added to the target image in which each color conversion area corresponding to each area identification information is set, and stored in a predetermined storage location of the target image DB in correspondence with the user ID (S606). In addition, the billing processing unit 124 performs a billing process to the user for setting the color conversion area and the area identification information to the target image (S607).

  Thereafter, when the user receives the provision of the composite image based on the target image in which the color conversion area is set, the user starts the support program as in the fifth embodiment, and transmits the user ID from the mobile phone 20 to the information processing server 10. And a request for displaying the password and the area-set target image list screen, the information processing server 10 executes an authentication process and transmits the area-set target image list screen to the mobile phone 20, and the mobile phone 20 transmits the desired target image. The information processing server 10 transmits the identification information and the display request of the target image to the information processing server 10, and further extracts the target image of the identification information and transmits the extracted image to the mobile phone 20 (S608). A target screen is displayed, and a capture screen is displayed in which items corresponding to the capture request of the color information and the area identification information from the RFID 30 are displayed so as to be able to be designated and input, Capture possible screen is displayed on the display unit 24.

  Further, the control unit 22 cooperating with the support program, from the RFID 30 which is associated with the colored product 31 and is close to the RFID reader 27, At 27, the color information and the area identification information are received and recognized by the identifier (S609), and the connection is made based on the access destination information of the information processing server 10 set by the support program in response to the reception of the color information and the area identification information. A request is transmitted to establish a connection with the information processing server 10, and a request for generating a composite image and the color information and the area identification information are transmitted to the information processing server 10 (S610). The information processing server 10 receives the composite image generation request, the color information, and the area identification information from the mobile phone 20 (S611), and the composite image processing unit 126 responds to the reception by adding the composite image processing unit 126 to the extracted and displayed target image. A color conversion area corresponding to the received area identification information is recognized from each of the set color conversion areas (S612), and the recognized color conversion area of the target image is color-converted based on the received color information. A composite image is generated (S613), and the composite image is transmitted to the mobile phone 20 (S614).

  The mobile phone 20 receives the composite image transmitted from the information processing server 10 (S615), and the control unit 22 recognizes the received composite image according to the support program, the composite image is displayed, and the color information from the RFID 30 is displayed. Then, a capture-capable screen in which items corresponding to the capture request of the area identification information are displayed so as to be designated and input is generated, and the capture-capable screen is displayed on the display unit 24 (S616). After that, when a capture request for another RFID 30 is input separately from the capture screen on which the composite image is displayed, the same processing as described above, that is, the mobile phone 20 receives another capture request from another RFID 30 is performed. Reception of color information and area identification information, transmission of color information and area identification information to the mobile phone 20, generation of a captureable screen on which a composite image to be received is displayed, and color information and area identification information of the information processing server 10 By generating and transmitting a composite image of the target image based on the above, a composite image obtained by performing color conversion on a color conversion region that is the same as or different from the color-converted region of the already displayed composite image that has been color-converted is provided. Note that the combined image generation processing of the combined image processing unit 126 can use the same processing as the combined image generation processing performed by the control unit 22 according to the combined image generation program of the first to fourth embodiments.

  With the combined image providing system of the first to sixth embodiments, the user of the mobile phone 20 can use the colored product 31 displayed in the store, the colored product 31 described in a magazine, a catalog, a poster, or the like. When a colored product 31 or the like displayed on a display such as an electronic paper is found, an RFID 30 provided for the colored product 31 or an RFID 30 provided on a sample of the colored product 31 or a shelf, The color information and the region identification information or the color identification information from the RFID 30 associated with the colored product 31 such as a lipstick, such as the RFID 30 provided on a magazine, catalog, poster, or electronic paper in which the colored product 31 is indicated, are displayed on the mobile phone 20. The color conversion area such as the lip area of the target image such as the face image set in advance corresponds to the colored product 31 such as lipstick. It is possible to check the composite image obtained by color conversion based on the color information, and to check the trial state on the spot when the coloring product 31 itself or its description is found, in other words, to try the coloring product 31 such as lipstick. Status can be confirmed at ubiquitous times and places. Furthermore, since the composite image can be viewed only by a simple operation of the mobile phone 20 based on the preset target image, for example, the user asks a clerk or the like to provide the composite image or takes a face image at the store. Thus, it is possible to easily and easily check the composite image without any troublesome work. Further, when it is difficult to actually use the colored product 31 such as lipstick such as a crowded store or when it is desired to check the trial state of the colored product 31 for an object such as a person or a car that does not exist on the spot, the confirmation of the trial state is performed. Can be possible.

  Further, by setting a target image in advance and setting a color conversion region for color conversion of the target image in advance, image processing that requires advanced arithmetic processing such as extraction and setting of the color conversion region when confirming a composite image is performed. Since there is no need to perform this process, it is sufficient to perform a process of recognizing a preset color conversion area and performing color conversion based on color information, so that the trial state of the colored product 31 such as lipstick is synthesized in a much shorter time than actual coloring. Images can be quickly provided to the user in almost real time, and labor-saving image processing can be performed. In particular, when viewing the composite image, the communication between the information processing server 10 and the mobile phone 20 is not performed, and the color information and the area identification information or the color identification information are transmitted from the RFID 30 associated with the colored product 31 to the mobile phone. The composite image providing system according to the first to third embodiments, in which the composite image can be viewed simply by capturing the composite image in the short-range communication 20, is used when the user desires to view the composite image in the color of the colored product 31. The time required to provide an image can be drastically reduced, and a composite image can be provided in real time before the user's interest in the colored product 31 such as lipstick changes.

  Then, by providing the ubiquitous and quick composite image, the user's convenience and amusement with respect to the colored product 31 such as lipstick can be enhanced, the impression degree can be improved, and a high sales promotion effect can be obtained. In particular, for example, a user's face image is set as a target image, and a plurality of types of color conversion regions such as a lip region or a lipstick coloring region, a foundation coloring region, a blush coloring region, and an eye shadow coloring region are set, and lipstick, foundation, blush, and eye are set. Based on color information corresponding to each coloring cosmetic such as shadow, it is possible to provide a composite image in which color conversion is performed for multiple types of color conversion areas, and to color multiple types of color conversion areas set in one target image. By making it possible to provide a composite image color-converted with the color information corresponding to the product 31, the user can check the trial state in which a plurality of types of colored products 31 are combined at any time. , The level of convenience, entertainment, and impression can be further improved, and a higher sales promotion effect can be obtained, such as promotion of purchase by combining a plurality of colored products 31.

  Furthermore, for example, when a user shares a sample of a cosmetic for coloring such as lipstick with another person and actually colors the sample, the trial of the colored product 31 has a problem in terms of the user's psychological resistance and hygiene. In addition, it is possible to eliminate the need for a trial based on actual coloring in the trial using a composite image, and it is possible to eliminate the problem of the user's psychological resistance and hygiene. Further, since the RFID 30 stores color information and area identification information or color identification information having a small data amount, the storage capacity of the RFID 30 does not become inconvenient, and the RFID 30 has a small data amount. Other information can be stored as necessary together with the small color information and the area identification information or the color identification information, and sufficient hardware resources of the RFID 30 for storing the other information can be secured. Further, it is possible to set a color conversion area using an image such as a face image of oneself or another person captured by the mobile phone 20 by imaging or communication as a target image, and thus easily set a color conversion area for a desired image. Target image.

  Further, in the embodiment in which charging is performed in accordance with the setting of the color conversion area for the target image, it is possible to secure a price corresponding to the color conversion area setting processing that requires a large amount of arithmetic processing in the information processing server 1, and By adjusting the set amount to be charged, the number of times of the color conversion area setting processing can be adjusted to the number of times suitable for the arithmetic processing capability of the information processing server 10. Further, in the embodiment in which the communication at the time of providing the composite image can be performed only by local communication between the mobile phone 20 and the RFID 30, the user of the mobile phone 20 does not pay the communication fee when receiving the display of the composite image. In an embodiment in which an image can be displayed and communication is performed between the information processing server 10 and the mobile phone 20 when providing a composite image, data transmission such as transmission of color information and area identification information or transmission of a composite image is performed. It is possible to charge for the transmission to recover the value. Also, if one RFID 30 is provided corresponding to a plurality of colored products 31 such as providing RFID 30 at one place or two to three places corresponding to a sample of the colored product 31 such as lipstick, There is no need to provide the RFID 30 in all of the components, and a composite image providing system can be realized at a low cost with a small number of RFIDs 30. Further, there is an advantage that the RFID 30 directly provided on the colored product 31 can be used for another purpose. . When the image generated by the color conversion is stored in the information processing server 10 or the mobile phone 20 so that the image can be viewed by another person or transmitted to another person, the user can add the composite image It is also expected to be used in a peer-to-peer environment, and it is possible to improve the amusement through advertising of colored products 31 and image communication.

  Next, in the composite image providing systems of the first to sixth embodiments, the above-described extraction of the color conversion region from the target image, setting of the color conversion region and region identification information indicating the type of the color conversion region for the target image, A configuration example of color conversion and the like based on color information for a color conversion region of a target image will be described. That is, extraction of a color conversion region from a target image executed by the color conversion region processing unit 123 of the information processing server 10 or the control unit 22 according to the composite image generation program of the mobile phone 20, the color conversion region and the type of the color conversion region And the like for the target image with the region identification information indicating the color information for the color conversion region of the target image executed by the control unit 22 according to the composite image generation program of the mobile phone 20 or the composite image processing unit 126 of the information processing server 10 Can be executed by an appropriate technique such as an existing technique, for example, the following technique can be used.

  When the color conversion area and the area identification information are set for the target image, for example, an area number different for each of the various color conversion areas is assigned to the edge of each of the various color conversion areas extracted from the target image of the bitmap image. By setting the target image as the identification information, the color conversion area and the area identification information are set in the target image, and the target image is transmitted or stored in the storage unit 23 or the target image DB 18. The same processing is performed even when the color conversion regions overlap, such as a coloring region, a foundation coloring region, and an eye shadow coloring region. The setting configuration can be processed even when one or one type of color conversion area is set, and the color conversion area can be specially set to the edge of the color conversion area extracted from the target image of the bitmap image. The configuration is such that the region number of the region is set as the region identification information in the target image. Alternatively, the color conversion area may be set by adding SVG data specifying the color conversion area to the data of the target image. Alternatively, a pixel to be color-converted based on the color information at a predetermined ratio may be extracted from the color conversion area, identification information may be set for the pixel, and only the pixel corresponding to the identification information may be color-converted.

  When a composite image is generated by performing color conversion on the color conversion area of the target image based on the color information, for example, the colors of the pixels of the original image in the color conversion area of the target image for each of the various color conversion areas The transmittance of the information and the transmittance of the color information corresponding to the colored product 31 are set in the composite image generation program or the control program of the composite image processing unit 126, and the color information of the original image and the color information corresponding to the colored product 31 are set. Are added at the ratio of each transmittance to calculate color information such as RGB values, and color conversion of the corresponding color conversion region is performed using the color information. Further, when the color conversion region overlaps, the color conversion region corresponds to the overlapping portion. The transmittance of the color information possessed by the pixels of the image and the respective transmittances corresponding to the plurality of types of colored products 31 are set, and the color information of the original image and the color information corresponding to the plurality of types of the colored products 31 are set to the respective transmittances. RGB value etc. Calculates color information, the color conversion of the overlapping portion of the corresponding color conversion region by the color information, a configuration such as by weighted combination, the transmission rate is configured such that acquires statistics on coloration. Alternatively, color information corresponding to the colored product 31 is set as a color lighter than the actual product 31 color, and the color information is added to the color information of the pixels of the original image to calculate color information such as RGB values. Then, the corresponding color conversion area is color-converted by the color information. Alternatively, the color conversion is performed by replacing the color information of the pixels of the original image in the color conversion area with the color information corresponding to the colored product 31. Alternatively, the average of the color information of each pixel of the original image in the color conversion area is calculated, and the color information corresponding to the colored product 31 is added or weighted to the average to calculate the color information. Is used to perform color conversion. Alternatively, when the color conversion area is color-converted based on the color information, a configuration may be adopted in which the color conversion based on the color information in the color conversion area such as a blusher or eye shadow coloring area is lightly or gradually lightened, For example, toward a position at a predetermined distance from the contour of the color conversion area, the transmittance of the color information to be used in the weighting synthesis is gradually reduced, and the color becomes lighter as approaching the contour, or a predetermined distance from the contour. For the area up to the position of, the weighting synthesis for coloring the color information with a high transmittance different from that of the other areas may be performed.

  When extracting a color conversion area from a target image, edge detection, classification based on color information, identification of a predetermined part based on positional relationship information, extraction of an area based on setting of an extraction candidate area, position of the predetermined part, and edge of the area The color conversion area is extracted by appropriately using the extraction of the color conversion area based on. For example, when the target image is a face image whose face is mostly a front-view face, and a lip region, a foundation coloring region, a blusher coloring region, and an eye shadow coloring region are extracted as color conversion regions, based on edge detection and classification based on skin color information. The face area is extracted, and further, a partial area other than the skin color in the face area is detected, and each predetermined part such as a nostril, eyebrows, eyes, and lips is specified based on the positional relationship information. To extract the nostril region, eyebrow region, eye region, and lip region based on edge detection and classification based on color information, extract regions other than the regions of the predetermined portions as foundation colored regions, and further extract the eye region and eyebrow region. A predetermined area set based on a predetermined position with respect to is extracted as an eye shadow coloring area, and is set based on a predetermined position with respect to an edge of a face area and an eye area, a nostril area, and a lip area. It may be configured such that extracts a predetermined region as a blush colored region.

  Further, when a predetermined color conversion area is extracted from a face image as a target image, the following technique can be appropriately used. For example, when extracting a lip region as a color conversion region from a face image, an edge image of the face region is generated from the face image, and a histogram of the edge is generated by Y-axis projection, as described in Patent Document 6, and each part of the face is generated. , A feature point of a required part is extracted, and a lip candidate area is provisionally set at the Y coordinate position including the mouth, and a predetermined area such as between the lower end of the nose and the upper end of the mouth and between both ends of the mouth is determined. It is configured to acquire skin color information and its average value from the range, acquire the deviation of the color of the pixel of the lip candidate region with respect to the average value of the skin color information, and extract and extract the lip region when the deviation exceeds the threshold value. be able to. Alternatively, when extracting a lip region from a face image, an edge is detected by performing filter processing on luminance information of the face image using a Sobel filter or the like, as in Patent Document 7, and a portion outside the outermost edge is detected. Separate the background as a background, convert the face image with the separated background into a YIQ color system, generate a cumulative histogram of density values on the Q axis, and perform threshold processing on the cumulative histogram with a predetermined threshold to determine a lip candidate region. Furthermore, a configuration may be adopted in which a cumulative histogram of density values on the Q axis is generated for the lip candidate region, and the cumulative histogram is subjected to threshold processing with a predetermined threshold to extract the lip region. Alternatively, when extracting a lip region from a face image, after determining a lip candidate region with an appropriate configuration as in Patent Literature 7, a second lip candidate region is defined to include the lip candidate region and its periphery. Determine, generate a color component histogram of the lip candidate region and a color component histogram of the second lip candidate region, generate a difference histogram between the two, and obtain a threshold value by multiplying a peak value of the difference histogram by a predetermined coefficient. Then, a region of a color component on the peak side of the lip color component from the threshold value among the color components of the color component histogram of the lip candidate region may be extracted as a lip region.

  Alternatively, when extracting a foundation colored region from a face image, the background, the region below the lower jaw, and the ear region are separated from the face image by edge detection or the like, and a region having skin color information is extracted from the face image as a face region. Extracting a nostril position having a black information in the face region and an appropriate position such as a nostril region located at a predetermined position based on a face arrangement condition and a center of gravity of the nostril region, and using the nostril position and the nostril position as reference Nose regions, eye regions, lip regions, by setting partial extraction candidate regions at predicted positions of eyes, mouth, ears, eyebrows, etc., and performing threshold processing and edge detection based on density differences for each extraction candidate region An eyebrow region or the like may be accurately specified and extracted, and a region of each predetermined part may be extracted and extracted from the face region. A face region including an ear region is extracted based on edge detection or skin color information, and a nostril region having black information in the face region and located at a predetermined position based on a face arrangement condition, and a nostril position such as a center of gravity thereof. Is extracted, and an ear region is extracted by setting a partial ear candidate region at a predicted position of the ear with reference to the nostril position, and performing edge detection or the like on the ear candidate region to exclude the ear region. A configuration for extracting a face region may be adopted. Alternatively, when extracting a blusher-colored area from a face image, a face area is extracted in the same manner as in the above-described configuration, and a plurality of reference points are obtained based on the position of the contour line / eye area / nostril area of the face area, The shape line of the predetermined shape pattern to be set and stored is arranged at a predetermined position based on the nostril position or the like, and the shape line is deformed by adjusting a plurality of reference points of the shape line to the positions of the acquired reference points, A configuration may be adopted in which a region surrounded by the adjusted shape line or a region surrounded by the adjusted shape line and the outline of the face region is extracted as a rouge coloring region. Alternatively, when extracting the eye shadow coloring region from the face image, the eye region is extracted in the same manner as in the above-described configuration, and the region up to a predetermined distance from the eye region is extracted as the eye shadow coloring region. Accordingly, a configuration may be adopted in which the upper contour line of the eye shadow coloring region is specified based on the position specified based on the positions of the upper contour line of the eye region and the lower contour line of the eyebrow region.

  When extracting a hair region from a face image including hair and performing color conversion based on color information corresponding to hair manicure using the hair region as a color conversion region, when extracting a hair region (hair manicure coloring region) For example, the background is separated from the face area including the hair by edge detection, and the hair area is extracted from the face area based on the threshold value processing of the density value based on the hair color information such as black information and the estimated hair position information on the upper part of the image. Or a region having black information or the like and having a predetermined area or more may be extracted as a hair region. When a nail area is extracted from an image of a finger, a hand, or the like in which a nail area is shown, and the nail area is used as a color conversion area and color conversion is performed based on color information corresponding to the nail polish, the nail area (manicure coloring area) is used. When extracting, for example, the background is separated from the finger region or the hand region by edge detection, and a nail candidate region is set based on the nail position information of the tip of the finger estimated from the finger region or the hand region, and the edge detection is performed. For example, a configuration in which a nail region is extracted from a nail candidate region can be adopted.

  Further, the extraction of the color conversion area from the target image may be executed by chroma key processing. For example, using a product such as a free sample or a sale product that is colored in a predetermined color such as red, blue, or green, applying a predetermined color to a region to be extracted as a color conversion region in the colored product, for example, a lip region or a nail region, The target image having the coloring region is captured by the imaging unit 26 into the mobile phone 20 by imaging or the like, and the control unit 22 cooperating with the color conversion region processing unit 123 or the composite image generation program of the information processing server 10 converts the coloring region into The coloring area may be extracted as a color conversion area from the target image having the same color by a chroma key process. Further, when the target image includes a plurality of coloring areas of the same color, for example, a lip area, a blusher coloring area, and an eye shadow coloring The type of the color conversion area may be specified based on the positional relation information corresponding to the type of the color conversion area such as the positional relation information of the area. From colored target image in color may be extracted color conversion region of type corresponding to the color that is the colored chroma key processing. The color to be colored in the chroma key processing can be set as needed, for example, a configuration in which a color that is colored in the foundation area or a predetermined color having a large color difference from the background is colored in the lip area, blush area, and eye shadow area. And

  Further, the mobile phone 20 captures the target image having no coloring in the extraction target area, transmits the uncolored image from the mobile phone 20 to the information processing server 10, and a predetermined unit of the control unit 12 of the information processing server 10 performs control. According to the program, or the control unit 22 of the mobile phone 20 that has imported the uncolored target image, according to a control program such as a composite image generation program, the color of pixels in a predetermined range of the uncolored target image and a predetermined plurality of locations. Obtain the user's skin color information, lip color information, nail color information, and other ground color information by calculating the average value of the information, obtaining the color information of the pixel at the representative point, and using the skin color information as necessary The color of the pixel in the color conversion area is calculated by adding the background color information and the color information corresponding to the colored product 31 by adding or weighting the ground color information and the color information corresponding to the colored product 31. It may be configured to conversion. Alternatively, there is an uncolored area in an image indicating an area to be extracted which is colored and which is the same kind of area as the above-described area and has no color, such as an image in which a colored nail area and an uncolored nail area are shown. And obtains and stores the user's ground color information in the same manner as described above, and adds or weights the ground color information and the color information corresponding to the colored product 31 to calculate the color of the pixel in the color conversion area. A configuration for performing color conversion may be adopted.

  Also, for example, a configuration in which a color conversion area is extracted and set by remote operation of a color conversion area processing device via a network for a target image stored in the information processing server 10, or is temporarily sent from the information processing server 10 to the color conversion area processing device. Patent Document 1 discloses a configuration in which data of a target image is transmitted and stored, and the information processing server 10 receives and stores the target image subjected to the color conversion region processing by the color conversion region processing device from the color conversion region processing device. It is also possible to adopt a configuration in which a color conversion area is extracted according to a manual input such as 3 or 4. As a specific example, control in which the information processing server 10 stores the target image received from the mobile phone 20 in a predetermined storage location in association with the user ID and the identification information of the target image, and stores the color conversion area processing program in the memory thereof In response to a request for displaying a target image of required identification information from a color conversion processing device including a unit, a storage unit, a display unit, an operation input unit, and a communication control unit, the information processing server 10 transmits the target image to the color conversion area processing device via a communication network. In accordance with the color conversion area processing program, the control unit of the color conversion area processing device appropriately specifies the area range of the operator, adjusts the position of the shape pattern, traces the outline, determines the area and its type, etc. The color conversion area is extracted by executing a predetermined process corresponding to the input of the information processing apparatus, the color conversion area and the area identification information are set in the target image, and a separate predetermined According to the configuration of storing the image in the storage location or the information processing server 10 storing the image in a separate storage location, the target image in which the color conversion area and the area identification information are set is automatically transmitted to the mobile phone 20 by e-mail or the like. A configuration or the like is possible. Alternatively, the control unit 22 of the mobile phone 20 cooperating with a synthetic image generation program or the like that enables selection and designation of a minute area similarly extracts a color conversion area from a target image in response to manual input, and It is also possible to adopt a configuration in which the identification information is set and stored in the target image.

  Next, modified examples of the composite image providing system such as the first to sixth embodiments will be described.

  In the above embodiment, the case where the RFID 30 which is a wireless IC chip is used as the data carrier has been described. However, instead of the RFID 30, code information such as a two-dimensional code or a code information recording body is used, and the same processing as the above embodiment is performed. For example, a configuration may be adopted in which a code information analysis program is stored in a memory of the control unit 22 of the mobile phone 20, and color information and area identification are stored in the printed code information or the code information displayed on a display such as electronic paper. Information or color identification information is stored, the code information is captured by the image capturing unit 26 and captured into the mobile phone 20, and the control unit 22 of the mobile phone 20 analyzes the captured code information according to the analysis program to obtain color information and area information. A configuration for extracting identification information or color identification information may be employed. Alternatively, the control unit 22 of the mobile phone 20 transmits the fetched code information to the information processing server 10 in accordance with a predetermined program, and the code information analysis processing unit provided in the information processing server 10 analyzes the received code information to obtain color information. In addition, a configuration for extracting the area identification information or the color identification information can be adopted. Alternatively, instead of the configuration in which the image capturing section 26 captures the code information into the mobile phone 20, a code reader or a scanner may be provided in the mobile phone 20, and the code information may be read and captured by the code reader.

  Further, information separately stored in addition to the color information and the area identification information or the color identification information is fetched from a data carrier such as an RFID 30 and processed by the mobile phone 20 or the information processing server 10 or a similar separately stored information. A configuration in which information is fetched from the information processing server 10 and processed by the mobile phone 20, or a configuration in which similar separately stored information is extracted and processed by the information processing server, or a configuration in which the mobile phone 20 or the information processing server 10 performs color conversion A configuration in which additional processing is performed on the region in addition to the color conversion may be employed. For example, the name information of the colored product 31 is stored in the RFID 30 in association with the color information or the color identification information in the RFID 30 or the information processing server 10, and the name information is received and displayed by the mobile phone 20 or is associated with the color information or the composite image. Or stored in a predetermined storage location of the storage unit 23 and displayed as necessary, or the information processing server 10 stores the name information corresponding to the composite image and the like, and transmits the name information to the mobile phone 20 as necessary. It may be a configuration to be presented. By the name information, it is possible to increase the user's awareness of the colored product 31 and to improve the purchase motivation and the advertising effect by word of mouth and the like.

  Alternatively, for example, the RFID 30 stores the access destination information such as the URL of the site that provides the related information of the colored product 31 together with the color information and the region identification information corresponding to the colored product 31, and the mobile phone 20 receives the information, Further, the control unit 22 cooperates with a predetermined program to recognize a color conversion area of the target image corresponding to the area identification information, recognizes the color conversion area as a link definition area in which the access destination information is embedded, and uses XML or the like. And generates an embedding command in a predetermined description language to embed the access destination information in the link definition area so that the access destination information can be designated and input. Further, the color information / area identification information / access destination for the same color conversion area is newly added separately. When the information is received, the configuration may be such that the access destination information of the color conversion area is replaced and embedded by the same processing as described above. Alternatively, a configuration in which the mobile phone 20 receives the color information, the area identification information, and the access destination information transmitted by the information processing server 10 and the mobile phone 20 performs the same processing as described above, or a composite image processing unit of the information processing server 10 126 may be configured to perform the embedding process in the same manner as described above based on the color information, area identification information, and access destination information to be received or extracted. With the above configuration, the user can access a site that provides information related to the colored product 31 by designating and inputting the color conversion area that has undergone color conversion, thereby improving the entertainment and convenience of the user. Further, related information corresponding to various colored products 31 can be immediately provided as needed.

  In addition to uploading and downloading, other communication methods such as e-mail can be used as appropriate for transmission and reception between the information processing server 10 and the mobile phone 20. In the form of an e-mail, a configuration in which the information processing server 10 transmits to the mobile phone 20 by an e-mail generated by an e-mail address for extracting a target image in which the color conversion area is set, or a configuration in which the information processing server 10 It is possible to transmit the color information and the area identification information or the color identification information by e-mail to the information processing server 10. Create a dedicated email format and record or enter the required information in that format. It may be configured such that transmission. Also in the case of the above configuration, the information processing server 10 and the mobile phone 20 recognize necessary data from the e-mail and perform predetermined processing in the same manner as described above.

  In addition, the target image is not limited to a still image, and may be a moving image. Even when the target image is a moving image, for example, extraction, setting, and It is possible to perform color conversion and the like. In addition, for example, a configuration may be employed in which a contour initially set by using the principle of energy minimization is converged on the color conversion region and the color conversion region is extracted. In addition, the target image is transmitted to the information processing server 10 from the mobile phone 20 which is a video phone, for example, by a video phone, and the information processing server 10 acquires a target image of a moving image for a predetermined time from the target image, and A configuration in which a color conversion area is extracted from a target image and set, or a target image of a moving image is captured by the imaging unit 26 of the mobile phone 20, and the moving image is uploaded to the information processing server 10 or transmitted by e-mail. A configuration in which the same processing as described above is performed on a target image of a moving image received by the information processing server 10, or a target image of a moving image is captured by the imaging unit 26 of the mobile phone 20, and the control unit 22 operates in accordance with a predetermined program. The color conversion area may be extracted from the target image of the moving image and set.

  Further, when the target image in which the color conversion area and the area identification information are set is stored in the storage unit 23 of the mobile phone 20, the target image captured at a store or the like is loaded into the color conversion area processing device such as the information processing server 10. The color conversion area processing device performs the above-described color conversion area extraction / setting processing, transmits the target image in which the color conversion area and the area identification information are set to the mobile terminal 20 by an e-mail separately acquired, and transmits the target image to the mobile terminal 20. For example. When a target image in which a color conversion area and area identification information are set is stored in the target image DB 18 of the information processing server 10, the target image captured at a store or the like is loaded into the information processing server 10, and the information processing server 10 May be configured to perform a process of extracting and setting a color conversion area and store it.

  In addition, the configuration for collecting the operating cost of the composite image providing system may employ an appropriate charging process such as a fixed system, a pay-as-you-go system, or a combination of the two, in addition to the charging process performed by the charging processor 124 of the above embodiment. Is possible. For example, there is provided a billing processing device which is connected to the information processing server 10 via a communication network and shares the user information in the user information DB 15 with the information processing server 10. Based on the recognition of the predetermined day, the set billing amount corresponding to a certain period such as the month set in the storage unit is extracted, and the user ID of each user is extracted and set according to each user ID. A billing process for billing the billing amount may be executed, and each user ID and the billing amount corresponding to each user ID may be stored in the billing information DB 16 and billed on a fixed basis.

  Alternatively, in a predetermined storage location of the storage unit of the charging processing device, a step-by-step charging amount divided by the number of times of setting the color conversion area is set, and the charging processing device periodically executes the charging process as in the previous period. In addition, the user information DB 15 of the information processing server 10 stores the maximum number of color conversion area settings that can be regularly used by a user in a contract by associating the user ID with the user ID, and performs color conversion from a predetermined date of the user. The predetermined number of regions is stored, the predetermined unit of the control unit 12 of the information processing server 10 recognizes the color conversion region setting process for the user ID, and sets the number of times of setting the color conversion region for the user ID from a predetermined date. The set number of times in the user information DB 15 is updated by adding the number of processes such as 1, and before the color conversion area setting process by the color conversion area processing unit 123 is performed, the set number of color conversion areas is set to the upper limit number of times. To Whether to confirm obtain, can be configured to perform a color conversion area setting process if not exceeded.

  Alternatively, in a configuration in which the information processing server 10 transmits the color information, the area identification information, and the composite image to the mobile phone 20 when the user views the display of the composite image on the mobile phone 20, the setting of the color conversion area may be performed. Alternatively, in addition to the setting of the color conversion area or the setting of the color conversion area, the charging processing unit 124 may execute the charging processing of the set charging amount in response to the extraction of the color information and the generation of the composite image. Alternatively, identification information of a product provider such as a manufacturer or a seller of the colored product 31 and a periodic set charging amount based on a contract with each product provider are stored in a predetermined storage location of a storage unit of the charging processing device, According to the control program, the control unit of the billing device extracts the identification information of the merchandise provider and the settable amount based on the recognition of the predetermined date on a regular basis, and sets the set charging amount in accordance with the identification information of each merchandise provider. A configuration may be adopted in which charging processing for charging is performed, and the identification information of each product provider and the charging amount corresponding to each identification information are stored in the charging information DB. Alternatively, the information processing server 10 or the billing processing device may acquire the unique identification information using the unique identification information of the mobile phone 20 acquired by communication, and perform a billing process on the unique identification information. Note that each embodiment and the present invention can be configured by using unique identification information of a mobile terminal such as the mobile phone 20 instead of the user ID.

  When the mobile phone 20 is configured to receive the color information and the area identification information or the color information and generate a composite image, the control unit 22 of the mobile phone 20 stores the received color information and the like in accordance with a predetermined program. The color conversion of the color conversion area of the target image is executed by using the stored color information and the like in accordance with the target image and the color information designated in which the color conversion area is set. A configuration for generating and displaying a synthesized image may be adopted. Further, a selection screen for displaying selectable color information and the like to be stored and color information to be received is displayed on the display unit 24, and based on the selected and input color information and the like. The color conversion of the color conversion area of the target image may be performed.

  If the color conversion area processing unit 123 of the information processing server 10 or the control unit 22 according to a predetermined program of the mobile phone 20 can set a plurality of types of color conversion areas from the target image, the specified color conversion area is The target image may be set. For example, the control unit 22 of the mobile phone 20 displays a selection screen on the display unit 24 according to a predetermined program, in which a color conversion area to be set can be selected from a plurality of types of color conversion areas. Based on the designated input of the color conversion area, the specified color conversion area is extracted and set, or a request for setting the specified color conversion area is transmitted to the information processing server 10. The configuration may be such that the area processing unit 123 executes the extraction and setting of the designated color conversion area received.

  In addition, color information and area identification information stored in the RFID 30 provided in association with the colored article 31 or color information and area identification information corresponding to the color identification information stored in the information processing server 10 or the mobile phone 20 are included in the colored article 31. The corresponding color information and the area identification information are represented by the color information of the colored product 31 itself, the directly corresponding color information and the area identification information, and the color information indicating the color of the colored product that is a related product of the colored product 31 and the corresponding color information. It is also possible to adopt a configuration in which a composite image is generated by the mobile phone 20 or the information processing server 10 as the area identification information. For example, when the colored product 31 is a predetermined lipstick, the RFID 30 corresponding to the lipstick stores color information indicating the color of the lipstick and region identification information of a lip region to be color-converted, and is used in combination with the lipstick. It is recommended that the color information indicating the color of the foundation and the area identification information of the foundation coloring area be stored to store a plurality of types of color information and area identification information. The area and the foundation colored area may be color-converted with each color information to generate a composite image, or the like, and a composite image of a plurality of types of colored products may be provided, and these products may be collectively recommended.

  Alternatively, for example, when the colored product 31 is a predetermined lipstick, the RFID 30 corresponding to the lipstick stores color information indicating the color of the lipstick and region identification information of a lip region to be color-converted, and associates the lipstick with the lipstick. The color information indicating the color of another lipstick having high sexuality and the region identification information of the lip region are stored, and the region identification information of the same type as the plurality of types of color information is stored. A lip region of the target image is converted and converted with the color information indicating the color of the lipstick to generate and display a composite image. It is configured to generate and display a composite image by performing color conversion with the color information indicating the color of the another lipstick, and to provide a plurality of colored products by sequentially displaying them, so that these products can be collectively recommended. You may.

  Further, in the case where the color conversion of the color conversion area of the target image is performed by weighting and combining the ground color information and the color information of the colored product 31 in the generation of the composite image of the mobile phone 20 and the information processing server 10, the color information is added to the RFID 30. The transmissivity of the color information at the time of the weighted composition is stored, for example, the transmissivity at the time of the composition is stored, or the transmittance at the time of the composition is stored in the information processing server 10 or the mobile phone 20. The color information is stored in correspondence with the color information, and the mobile phone 20 or the information processing server 10 obtains the transmittance together with the color information, and obtains the color of the color conversion area by weighting and synthesizing the ground information with the color information and the transmittance. Or the like, and a color transmittance may be set for each type of lipstick or the like to provide a good appearance. Further, a plurality of transmittances are set in accordance with the color information, and the control unit 22 of the mobile phone 20 and the synthesized image processing unit 126 of the information processing server 10 transmit or receive predetermined transmittances from the mobile phone 20. Based on the specification of the ratio, a configuration may be adopted in which a composite image is generated by weighting and combining with the specified transmittance and color-converted and displayed, so that a state in which the color is adjusted to a desired density can be confirmed.

  The present invention provides, for example, coloring products such as coloring cosmetics and paints such as lipsticks, and colored products such as wallpaper, colored glass, and color contact lenses colored with a predetermined color, in descriptions and displays of stores, magazines, and the like. When seen on a display or the like, it is possible to promptly provide the user with a composite image in which the color conversion area of the user or the target image of the predetermined object is colored with a color corresponding to the product.

FIG. 1 is a block diagram illustrating a composite image providing system according to a first embodiment. 5 is a flowchart illustrating a processing procedure of the composite image providing system according to the first embodiment. FIG. 9 is a block diagram illustrating a composite image providing system according to a second embodiment. 9 is a flowchart illustrating a processing procedure of the composite image providing system according to the second embodiment. FIG. 13 is a block diagram illustrating a composite image providing system according to a third embodiment. 9 is a flowchart illustrating a process performed by the composite image providing system according to the third embodiment. FIG. 14 is a block diagram showing a composite image providing system according to a fourth embodiment. 13 is a flowchart illustrating a processing procedure of the composite image providing system according to the fourth embodiment. FIG. 15 is a block diagram showing a composite image providing system according to a fifth embodiment. 15 is a flowchart illustrating a processing procedure of the composite image providing system according to the fifth embodiment. FIG. 16 is a block diagram showing a composite image providing system according to a sixth embodiment. 15 is a flowchart illustrating a processing procedure of the composite image providing system according to the sixth embodiment.

Explanation of reference numerals

1 Internet network 2 Mobile phone network 10 Information processing server 11 Communication control unit 12 Control unit 121 Site processing unit 122 Distribution processing unit 123 Color conversion area processing unit 124 Billing processing unit 125 Color information distribution processing unit 126 Synthetic image processing unit 13 Storage unit 14 Synthetic image generation program storage unit 15 User information database 16 Charging information database 17 Color information set storage unit 18 Target image database 19 Support program storage unit 20 Mobile phone 21 Communication control unit 22 Control unit 23 Storage unit 24 Display unit 25 Operation input Unit 26 imaging unit 27 RFID reader 30 RFID
31 Colored goods

Claims (45)

A system for providing a composite image displayed on a mobile terminal, wherein an information processing device performs color conversion based on color information that recognizes a color conversion region set in a target image to generate a composite image. A composite image generation program that causes the mobile terminal to realize the above, receives a composite image generation program transmission request from the mobile terminal, and extracts the composite image generation program stored in the mobile terminal in response to the composite image generation program transmission request. Transmits to the mobile terminal, receives the target image for setting the color conversion area from the mobile terminal, extracts a predetermined color conversion area from the target image, sets it as the target image, and sets the color conversion area stored in the mobile terminal And the data carrier provided in association with the colored product corresponds to the color of the colored product and cooperates with the composite image generation program. Composite image providing system, characterized by storing the color information recognized by the portable terminal can take in the mobile device. The composite image generation program recognizes a color conversion area of the area identification information set in the target image based on the recognition of the area identification information set corresponding to the color information, and corresponds to the area identification information. Based on the recognition of the color information that is present, the mobile terminal realizes the function of performing color conversion on the recognized color conversion region and generating a composite image, and the information processing apparatus extracts a plurality of types of color conversion regions from the target image. Setting each color conversion region and each region identification information in a target image, transmitting each target color image in which each color conversion region and its identification information are set to a portable terminal, and a data carrier including the region identification information and the region identification information. 2. The composite image providing system according to claim 1, wherein color information set correspondingly is stored. The composite image generation program recognizes a color conversion area of the area identification information set in the target image based on the recognition of the area identification information set corresponding to the color information, and corresponds to the area identification information. Based on the recognition of the color information that is present, the mobile terminal realizes the function of performing color conversion on the recognized color conversion area and generating a composite image, and the information processing apparatus receives the color conversion area designation information from the mobile terminal. Identifying a color conversion region to be extracted from the target image based on the designation information, extracting the specified color conversion region from the target image, setting the color conversion region and region identification information in the target image, and identifying the color conversion region and its identification. 3. The image processing apparatus according to claim 1, wherein the target image having the information set is transmitted to the mobile terminal, and the data carrier stores the area identification information and the color information set corresponding to the area identification information. Composite image providing system. 4. The composite image providing system according to claim 1, wherein the information processing device executes a charging process corresponding to the setting of the color conversion area for a user of the mobile terminal. A program for generating a composite image to be displayed on a mobile terminal, which recognizes color information taken from a data carrier provided in association with a colored product and sets a stored color conversion area. A composite image generation program for causing a portable terminal to realize a function of recognizing a color conversion region of an image and performing color conversion of the color conversion region based on color information to generate a composite image. Based on the recognition of the area identification information set corresponding to the color information taken from the data carrier provided in association with the colored product, the color conversion area of the area identification information set in the stored target image The portable terminal realizes a function of generating a composite image by performing color conversion of the recognized color conversion area based on recognition of color information set corresponding to the area identification information. Item 7. A composite image generation program according to Item 5. In cooperation with a data carrier that is provided in association with a colored product and stores color information corresponding to the color of the colored product and recognized by the mobile terminal cooperating with the composite image generation program so that the mobile terminal can capture the color information, A mobile terminal that cooperates with a synthetic image generation program that realizes a function of generating a composite image by performing color conversion based on color information that recognizes a color conversion region set in an image and generating a composite image with the mobile terminal An information processing apparatus, which receives a target image for setting a color conversion area from a mobile terminal, extracts a predetermined color conversion area from the target image, sets the target image, and sets a color conversion area stored in the mobile terminal. An information processing apparatus for transmitting a set target image to a mobile terminal. A target image for setting a color conversion area is received from a mobile terminal, a predetermined color conversion area is extracted from the target image, set as a target image, and the target image in which a color conversion area stored in the mobile terminal is set is set on the mobile terminal. In cooperation with an information processing device that transmits to a mobile terminal, the mobile terminal realizes a function of generating a composite image by performing color conversion based on color information that recognizes a color conversion region set in a target image, and a mobile terminal. A data carrier for generating a composite image on a mobile terminal that operates, color information provided in association with a colored product, corresponding to the color of the colored product, and recognized by the mobile terminal cooperating with the composite image generation program Characterized in that the data carrier is stored so as to be able to be imported by a portable terminal. In addition to recognizing the color information taken from the data carrier provided in association with the colored product, recognizing the color conversion area of the target image in which the stored color conversion area is set, and converting the color conversion area into color information A data carrier for generating a composite image on a portable terminal having a function of generating a composite image by performing color conversion based on the color of the colored product, provided in association with a colored product, and A data carrier storing color information recognized by a cooperating mobile terminal so as to be able to be captured by the mobile terminal. 10. The data carrier according to claim 9, wherein area identification information of a color conversion area to be color-converted by the color information is stored corresponding to the color information. A system for providing a composite image displayed on a mobile terminal, wherein an information processing apparatus extracts a predetermined color conversion region from a target image, sets the extracted color conversion region in the target image, and sets a color conversion set in the target image. Stores a composite image generation program that allows a mobile terminal to realize a function of generating a composite image by performing color conversion based on color information that recognizes an area, receives a composite image generation program transmission request from the mobile terminal, and transmits a composite image generation program. The composite image generation program stored in the mobile terminal is extracted and transmitted to the mobile terminal in response to a request, and the data carrier provided in association with the colored product corresponds to the color of the colored product and cooperates with the composite image generation program A composite image providing system for storing color information recognized by a mobile terminal to be captured by the mobile terminal. A program for generating a composite image to be displayed on a mobile terminal, wherein a predetermined color conversion area is extracted from a target image, set as a target image, and loaded from a data carrier provided in association with a colored product. A function for recognizing color information, recognizing a color conversion area of a target image in which a stored color conversion area is set, and performing a color conversion on the color conversion area based on the color information to generate a composite image is provided to the mobile terminal. A synthetic image generation program characterized by being realized. 13. The composite image generation according to claim 12, wherein a plurality of types of color conversion areas are extracted from the target image, area identification information for identifying the type of the color conversion area is set, and each color conversion area is set as the target image. program. In cooperation with a data carrier that is provided in association with a colored product and stores color information corresponding to the color of the colored product and recognized by the mobile terminal in cooperation with the composite image generation program so that the mobile terminal can capture the color information, An information processing apparatus for generating a composite image at a terminal, wherein a predetermined color conversion area is extracted from a target image, set as a target image, and color information that recognizes the color conversion area set in the target image The mobile terminal stores a composite image generation program that causes the mobile terminal to realize a function of generating a composite image by performing color conversion based on the image, receiving a composite image generation program transmission request from the mobile terminal, and responding to the composite image generation program transmission request. An information processing apparatus for extracting a composite image generation program stored in a portable terminal and transmitting the extracted composite image generation program to a portable terminal. A system for providing a composite image displayed on a mobile terminal, wherein an information processing device recognizes color information corresponding to color identification information recognized from a plurality of types of color information to be set, and generates a target image. Stores a composite image generation program that allows a mobile terminal to realize a function of generating a composite image by performing color conversion based on color information that recognizes a set color conversion region, and receives a composite image generation program transmission request from the mobile terminal. In response to a request for transmitting a composite image generation program, a composite image generation program stored in the mobile terminal is extracted and transmitted to the mobile terminal. A data carrier that is transmitted to the terminal and provided in association with the colored product corresponds to the color information corresponding to the color of the colored product and cooperates with the composite image generation program. Composite image providing system, characterized by containing the color identification information recognized by the end capture capable mobile device. A program for generating a composite image displayed on a mobile terminal, which recognizes color identification information taken from a data carrier provided in association with a colored product, and performs color identification from a plurality of types of set color information. A composite image, characterized in that a mobile terminal realizes a function of recognizing color information corresponding to information and performing a color conversion based on the recognized color information in a color conversion region set in a target image to generate a composite image. Generation program. The method according to claim 1, further comprising: recognizing area identification information of the color information corresponding to the color identification information from the area identification information set corresponding to the color information, and recognizing a color conversion area corresponding to the area identification information. A composite image generation program according to claim 16. A data carrier that is provided in association with a colored product and stores color identification information corresponding to color information corresponding to the color of the colored product and recognized by a mobile terminal cooperating with a composite image generating program so that the color identification information can be captured by the mobile terminal. An information processing apparatus for generating a composite image on a portable terminal in cooperation with the color information corresponding to the color identification information recognized from a plurality of types of color information to be set and setting the target image. Storing a composite image generation program that allows a mobile terminal to realize a function of generating a composite image by performing color conversion based on color information that recognizes a color conversion region that has been received, receiving a composite image generation program transmission request from the mobile terminal, In response to the request for transmitting the synthesized image generation program, the synthesized image generation program stored in the mobile terminal is extracted and transmitted to the mobile terminal, and each of the extracted programs corresponds to the color identification information stored in the mobile terminal. The information processing apparatus characterized by transmitting a plurality of types of color information to the portable terminal. Recognizes color identification information taken from a data carrier provided in association with a colored product, recognizes color information corresponding to the recognized color identification information from a plurality of types of set color information, and sets the target image A data carrier for generating a composite image on a portable terminal having a function of generating a composite image by performing color conversion based on color information that recognizes a color conversion area that is provided, provided in association with a colored product, A data carrier storing color identification information corresponding to color information corresponding to a color of a product and recognized by a mobile terminal cooperating with a composite image generation program so as to be fetchable by the mobile terminal. A system for providing a composite image displayed on a mobile terminal, wherein an information processing device performs color conversion based on color information that recognizes a color conversion region set in a target image to generate a composite image. A composite image generation program that causes the mobile terminal to implement the process, receives a composite image generation program transmission request from the mobile terminal, and extracts the composite image generation program stored in the mobile terminal in response to the composite image generation program transmission request. Transmits to the mobile terminal, stores multiple types of color information corresponding to each color identification information, receives the color identification information taken into the mobile terminal from the data carrier from the mobile terminal, and extracts the color information corresponding to the color identification information The data carrier transmitted to the mobile terminal and provided in association with the colored product has a color image corresponding to the color information of the colored product. Composite image providing system, characterized by containing the color identification information recognized by the mobile terminal for cooperating with the ram on mobile capture capable. A program for generating a composite image to be displayed on a mobile terminal, based on capturing color identification information stored in a data carrier provided in association with a colored product from the mobile terminal and transmitting the color identification information to an information processing device. Recognizes the color information received from the information processing device, recognizes the color conversion area of the target image in which the stored color conversion area is set, and generates a composite image by performing color conversion on the color conversion area based on the color information. A composite image generation program that causes a portable terminal to realize the function of performing Based on the transmission of the color identification information to the information processing device, the information processing device recognizes the region identification information stored in correspondence with the plurality of types of color information and received from the information processing device, and based on the recognition of the region identification information, 22. The composite image generation program according to claim 21, wherein a color conversion area of the area identification information set in the stored target image is recognized. The target image is provided in association with a colored product, and in cooperation with a data carrier that stores color identification information that is associated with color information corresponding to the color of the colored product and that is recognized by the information processing device in a portable terminal. Information for generating a composite image in a mobile terminal in cooperation with a composite image generation program that allows a mobile terminal to realize a function of generating a composite image by performing color conversion based on color information that recognizes a color conversion area set in the mobile terminal A processing device that stores a plurality of types of color information corresponding to each color identification information, receives the color identification information taken into the mobile terminal from the data carrier from the mobile terminal, and extracts the color information corresponding to the color identification information An information processing apparatus for transmitting to a mobile terminal. 24. The information processing apparatus according to claim 23, wherein the area identification information corresponding to each color identification information is stored, and the area identification information corresponding to the color identification information received from the mobile terminal is extracted and transmitted to the mobile terminal. Stores multiple types of color information corresponding to each color identification information, receives the color identification information taken into the mobile terminal from the data carrier from the mobile terminal, extracts the color information corresponding to the color identification information, and sends it to the mobile terminal In cooperation with an information processing apparatus that performs a color conversion area set in a target image and a synthesized image generation program that realizes a function of generating a synthesized image by performing color conversion based on color information recognized by a portable terminal. A data carrier for generating a composite image on a mobile terminal, which is provided in association with a colored product, corresponds to color information corresponding to the color of the colored product, and is recognized by a mobile terminal cooperating with a composite image generation program. A data carrier for storing color identification information that can be captured by a portable terminal. A system for providing a composite image displayed on a mobile terminal, wherein an information processing device receives a target image for setting a color conversion region from the mobile terminal, and extracts a predetermined color conversion region from the target image. Set the target image, store the target image in which the color conversion area is set, store multiple types of color information corresponding to each color identification information, and receive the color identification information taken into the mobile terminal from the data carrier from the mobile terminal Recognizing the color information corresponding to the color identification information, generating a composite image by performing color conversion based on the recognized color information of the color conversion region set in the target image, and transmitting the generated composite image to the mobile terminal. A combined image providing system for transmitting, wherein a data carrier provided in association with a colored product stores color identification information of color information corresponding to the color of the colored product so as to be able to be taken in by a portable terminal. To provide a composite image displayed on a mobile terminal in cooperation with a data carrier that is provided in association with a colored product and stores color identification information of color information corresponding to the color of the colored product so that the color information can be captured by the mobile terminal. The information processing device according to claim 1, further comprising: storing a target image in which a color conversion area is set, storing a plurality of types of color information corresponding to each color identification information, and storing the color identification information taken into the mobile terminal from the data carrier. Receives from the terminal, recognizes color information corresponding to the color identification information, generates a composite image by performing color conversion based on the recognized color information of the color conversion area set in the target image, and generates the composite image. An information processing device for transmitting to a portable terminal. Receiving a target image for setting the color conversion region from a mobile terminal, extracting a predetermined color conversion region from the target image, setting the target image, and storing the target image in which the color conversion region is set. The information processing apparatus according to claim 27. The area identification information corresponding to each color identification information is stored, the area identification information corresponding to the received color identification information is recognized, the color conversion area corresponding to the area identification information is recognized, and the color conversion area is converted to the color information. 29. The information processing apparatus according to claim 27, wherein color conversion is performed based on the information. A target image for setting a color conversion area is received from a mobile terminal, a predetermined color conversion area is extracted from the target image, set as a target image, and the target image in which the color conversion area is set is stored, corresponding to each color identification information. The mobile terminal receives color identification information taken into the mobile terminal from the data carrier from the mobile terminal, recognizes the color information corresponding to the color identification information, and stores the color information set in the target image. In order to provide a composite image displayed on a mobile terminal in cooperation with an information processing apparatus that generates a composite image by performing color conversion based on the color information that has recognized the conversion area and transmits the generated composite image to the mobile terminal. A data carrier, which is provided in association with a colored product and stores color identification information of color information corresponding to the color of the colored product so as to be fetchable by a portable terminal. A system for providing a composite image displayed on a mobile terminal, wherein an information processing device receives a target image for setting a color conversion region from the mobile terminal, and extracts a predetermined color conversion region from the target image. Set the target image, store the target image with the color conversion area set, receive the color information taken into the mobile terminal from the data carrier from the mobile terminal, and convert the color conversion area set in the target image to the color information. Generates a composite image by performing color conversion based on it, transmits the generated composite image to the mobile terminal, and allows the mobile terminal to capture color information corresponding to the color of the colored product with the data carrier provided in association with the colored product And a composite image providing system. An information processing apparatus for providing a composite image displayed on a mobile terminal in cooperation with a data carrier provided in association with a colored product and storing color information corresponding to the color of the colored product so that the color information can be captured by the mobile terminal Storing the target image in which the color conversion area is set, receiving the color information taken into the mobile terminal from the data carrier from the mobile terminal, and setting the color conversion area set in the target image based on the color information. An information processing apparatus, wherein the information processing apparatus generates a composite image by performing conversion, and transmits the generated composite image to a mobile terminal. Claims: A target image for setting a color conversion area is received from a mobile terminal, a predetermined color conversion area is extracted from the target image and set as a target image, and the target image in which the color conversion area is set is stored. Item 33. The information processing device according to item 32. Receiving the area identification information taken into the mobile terminal from the data carrier from the mobile terminal, recognizing a color conversion area corresponding to the area identification information, and performing color conversion on the color conversion area based on the color information. Item 34. The information processing device according to Item 32 or 33. A target image for setting a color conversion area is received from a mobile terminal, a predetermined color conversion area is extracted from the target image and set as a target image, the target image in which the color conversion area is set is stored, and Receiving the color information captured by the mobile terminal from the mobile terminal, generating a composite image by performing color conversion on the color conversion region set in the target image based on the color information, and transmitting the generated composite image to the mobile terminal A data carrier for providing a composite image displayed on a mobile terminal in cooperation with the device, provided in association with a colored product, and enabling the mobile terminal to capture color information corresponding to the color of the colored product. A data carrier characterized by storing. 36. The data carrier according to claim 35, wherein area identification information of a color conversion area to be color-converted by the color information is stored corresponding to the color information. Recognize the access destination information of the site that provides the related information of the coloring product, which is taken in from the data carrier provided in association with the coloring product, and set the access destination information in the color conversion area for performing the color conversion to be designated and inputtable. 18. The composite image generating program according to claim 5, wherein the portable terminal implements the function of performing the composite image generation. Recognize the access destination information corresponding to the color identification information from the access destination information of the site that provides the related information of the colored product set and stored in the mobile terminal, and designate and input the access destination information in the color conversion area for color conversion. The composite image generation program according to claim 16 or 17, wherein the function of enabling the setting is realized in the mobile terminal. A color conversion area for performing the color conversion based on recognition of access destination information of a site that provides related information of a colored product, which is stored in correspondence with the color identification information in the information processing device and extracted and transmitted based on the color identification information; 22. The composite image generation program according to claim 21, wherein the portable terminal realizes a function of setting the access destination information so that it can be designated and input. The information processing apparatus stores the access destination information corresponding to the color identification information, recognizes the access destination information of the site that provides the related information of the colored product, or is acquired from the data carrier to the mobile terminal and received from the mobile terminal. 32. The composite image providing system according to claim 26, wherein the composite image is generated by recognizing the image and setting the access destination information in the color conversion area for color conversion so that the access destination information can be designated and input. The data carrier associated with a colored product is provided in a smaller number than the plurality of colored products displayed at the store, wherein the number of data carriers is less than the number of the colored products displayed at the store. A composite image providing system according to any one of the first to third aspects. The said information processing apparatus or a portable terminal memorize | stores the synthetic | combination image in the state which can be transmitted to others, The one in any one of Claims 1-4, 11, 15, 20, 26, 31, 40, 41 characterized by the above-mentioned. The composite image providing system described in the above. The color information corresponding to one colored product, color information corresponding to the color of the colored product and color information corresponding to the color of another colored product related to the colored product are set. Item 43. The composite image providing system according to any one of Items 1 to 4, 11, 15, 20, 26, 31, 40, 41, and 42. The transmittance of color information used in the weighting synthesis of the color conversion is stored in correspondence with the color information. 43. The composite image providing system according to any one of 43. 45. The composite image providing system according to claim 44, wherein a plurality of transmittances set corresponding to one color information are set to be selectable.

Images