WO2004034300A1

WO2004034300A1 - Combined image providing system, combined image creation program, information processing device, and data carrier

Info

Publication number: WO2004034300A1
Application number: PCT/JP2003/014411
Authority: WO
Inventors: Shigeyuki Motoi
Original assignee: Shigeyuki Motoi
Priority date: 2002-11-21
Filing date: 2003-11-13
Publication date: 2004-04-22
Also published as: JP4140511B2; JP2004171560A; AU2003299516A1

Abstract

When a user happens to see a colored commodity such as a lipstick at a store or on a journal, a system enables the user to use a mobile telephone to view a combined image showing the trial in real time. An image such as a face image for which a color conversion region such as a lip region is set is stored in advance in a mobile telephone and an RFID or a 2-dimensional code containing color information corresponding to a colored commodity such as a lipstick is presented at a store or on a journal. The user acquires color information from the RFID or the 2-dimensional code into the mobile telephone. The mobile telephone subjects the color conversion region to color conversion according to the color information acquired. Thus, a combined image such as of a face with the lips colored by a color corresponding to the lipstick is created and displayed.

Description

2003/014411

Synthetic image providing system, synthetic image generation program, information processing device, and data carrier

The present invention relates to an image corresponding to a colored product such as lipstick on an image such as a face image registered by a user.

A composite image providing system that generates a composite image by performing image composition processing and provides the composite image to the user on a portable terminal, and a composite image generation program for providing the composite image

The present invention relates to a RAM, an information processing device, and a data carrier. Background art

A technical document related to generating a composite image by performing image composition processing corresponding to colored products such as lipstick on images such as face images registered by the user and providing the composite image to the user on a mobile terminal Patent Literatures 1 and 2, Patent Literatures 3 to 5 relate to the technical literature related to generating a composite image by performing image synthesis processing on a user's face image corresponding to a colored product and displaying it on a display unit. There are patent documents 6 to 9 as reference technical documents for

In Patent Document 1 (Japanese Unexamined Patent Application Publication No. 2000-02-1320), a server receives a face image of a user from a terminal of the user such as a mobile phone and transmits the face image of the user. Analyze and determine which of the multiple impression patterns are classified based on the feature amount, and correspond to each of the determined user impression patterns and the multiple impression patterns including the user impression patterns. A model face image in which a makeup pattern is applied to each preferred makeup pattern or model is sent to the terminal, and the user is prompted to select a makeup pattern on the terminal screen. Generates a composite image with typical makeup, sends it to the terminal, and sends information on products and methods that realize the same makeup when receiving a response to approve the composite image. If the user receives a response that the user does not approve the image, he or she will modify and transmit the composite image according to the user's request a specified number of times. Display part of information on products etc. as code information such as barcodes so that they can be displayed on mobile terminals, provide services based on the information obtained from the code information at stores such as cosmetics stores, and make up composite images It states that products that realize the above can be ordered on the homepage.

In Patent Document 2 (Japanese Unexamined Patent Application Publication No. 2000-0992 1332), the server 1 receives a face image of a user from a terminal of the user such as a mobile phone, and receives the face image of the user. A plurality of selectable make-up patterns are determined according to the user's or server's make-up pattern, and a known image processing is performed using the make-up pattern selected by the user or the server from among the plurality of make-up patterns. When a synthetic image is created by virtually applying makeup to the face image using technology and transmitted to the terminal, and when a response to approve the synthetic image is received, information on products and methods for realizing the same makeup is obtained. The document states that if a response is received that the user does not approve the transmitted image, the correction and transmission of the composite image according to the user's request are repeated a predetermined number of times.

Patent Literature 3 (Japanese Patent Application Laid-Open No. 63-080692) and Patent Literature 4 (Japanese Patent Application Laid-Open No. 64-11981) describe makeup of a user's face image and the like captured by an imaging unit. The makeup area is displayed on the display, and the shape pattern such as the shape of the lips in the range in which the color of the makeup area is changed and the color pattern that can be specified are registered in advance. A system is described in which a composite image of a makeup part where makeup has been applied is generated in accordance with the designation of a color pattern, and the composite image is displayed on a display unit. It indicates that the instruction was given with a mouse or light pen.

Patent Document 5 (Japanese Unexamined Patent Application Publication No. 2000-194948) discloses an imaging unit for imaging a user's face and a display unit for displaying a user's face image captured by the imaging unit. Means for virtually applying makeup to the user's face image displayed on the display unit; and a memory in which a plurality of makeup data images representing changes in the face due to makeup are stored. Means for selecting one of the makeup data images stored in the memory, transforming the makeup data image so as to match the face image of the user, and synthesizing the image with the face image of the user. The makeup data image is an image obtained by removing the face image before make-up of the model from the face image of the model to which makeup has been applied. It describes that the measured value is used for the transmittance of the makeup data image used in image synthesis.

Patent Document 6 (Japanese Unexamined Patent Application Publication No. 2000-1111) discloses a method of generating an edge image of a face region from a face image and generating a histogram of an edge by Y-axis projection. The Y coordinate of each part of the face is searched, the feature point of the required part is extracted, and the lip candidate area is provisionally set at the Y coordinate position including the mouth. The skin color information and its average value are obtained from a predetermined range such as the interval, and the deviation of the color of the pixel in the lip capture area from the average value of the skin color information is obtained.If the deviation exceeds the threshold, it is determined to be the lip area. It is described that extraction is carried out.

Also, in Patent Document 7 (Japanese Patent Application Laid-Open No. 2000-34048173), the brightness information of a face image is subjected to a filtering process using a Sobe 1 filter or the like to detect edges, and the outermost The part outside the edge is separated as the background, the face image from which the background is separated is color-converted to the YIQ color system, and a cumulative histogram of density values on the Q axis is generated. The lip region is determined by performing threshold processing, a cumulative histogram of density values on the Q axis is generated for the lip candidate region, and threshold processing is performed on the cumulative histogram with a predetermined threshold to generate a lip region. After extracting or determining a lip candidate area with an appropriate configuration, a second lip candidate area is determined so as to include the lip candidate area and its surroundings, and a color component histogram of the lip symptom capturing area is determined. Color component hiss in the second lip capture area A histogram is generated to generate a difference histogram between the two, a peak value of the difference histogram is multiplied by a predetermined coefficient, and a threshold is obtained. It describes extracting a color component region on the peak side of the lip color component as a lip region.

Patent Document 8 (Japanese Patent Application Laid-Open No. 2002-24640) discloses a database for storing images of displayed items such as clothes shown in fashion magazines and the like, and information relating to users. In addition to building an experience website on a database that stores the information and a web server, the user's computer or the experience website will add the user's face image to the model image created based on the user's body size. A virtual experience execution unit is provided to generate a superimposed composite image by adding an image of clothes and the like to the combined human body model, and access the experience website on the user's computer, The system describes the system that acquires the image image by inputting the number of the display object described in the magazine, etc., and generates and displays the composite image. It states that it can be generated.

Patent Document 9 (Japanese Unexamined Patent Application Publication No. 2003-1989) stores access destination information and a product ID in an RFID provided in association with a product. At the same time, the access destination information and product ID of RFID are taken in, the product information server is automatically accessed according to the extraction of the access destination information, and the product ID received from RFID is transmitted to the product information server. Describes a system that searches a product information database based on a product ID, reads information associated with a product, returns it to a mobile phone, and displays the returned product information on a mobile phone. . Disclosure of the invention

By the way, consumers often want to find their favorite lipstick or the like at a store, or find a description of their favorite lipstick or the like in a magazine, and try the colored product such as the lipstick on the spot. In other words, there is a strong demand from consumers to check the trial state of colored products in ubiquitous locations. Furthermore, since consumers' interests change quickly with time, consumers can check the trial state of colored products, and in order to increase the impression of the product, it is necessary to have them check the trial state almost immediately in real time. is necessary.

The present invention has been proposed in view of the above problems, and enables a user of a portable terminal to check a trial state of a colored product in a ubiquitous place, and to quickly check the trial state in almost real time. An object of the present invention is to provide a composite image providing system that enables a user to confirm, a composite image generating program, an information processing device, and a data carrier related to the composite image providing system.

First, a composite image providing system according to the present invention is a system for providing a composite image displayed on a mobile terminal, wherein the information processing apparatus recognizes a color conversion area set in the target image. The mobile terminal stores a composite image generation program for realizing a function of generating a composite image by performing color conversion based on information, receives a composite image generation program transmission request from the mobile terminal, and responds to the composite image generation program transmission request. Mobile end Extract the composite image generation program stored at the end and send it to the mobile terminal, receive the target image for setting the color conversion area from the mobile terminal, extract the predetermined color conversion area from the target image, and extract the target image The target image in which the color conversion area stored in the mobile terminal has been set is transmitted to the mobile terminal, and the data carrier provided in association with the colored product corresponds to the color of the colored product and generates a composite image. It is characterized in that the color information recognized by the mobile terminal cooperating with the program is stored so as to be fetched by the mobile terminal.

Further, in the composite image providing system according to the present invention, the composite image generation program recognizes a color conversion area of the area identification information set in the target image based on recognition of the area identification information set corresponding to the color information. In addition, based on the recognition of the color information corresponding to the area identification information, the mobile terminal realizes a function of performing color conversion of the recognized color conversion area and generating a composite image, and the information processing apparatus performs A plurality of types of color conversion regions are extracted from the image, each color conversion region and each region identification information are set in a target image, each color conversion region and a target image in which the identification information is set are transmitted to a mobile terminal, and data carrier is performed. Or storing the area identification information and the color information set corresponding to the area identification information, or wherein the composite image generation program stores the area information corresponding to the color information. Based on the recognition of the area identification information, the color conversion area of the area identification information set in the target image is recognized, and based on the recognition of the color information corresponding to the area identification information, the recognized color conversion area is recognized. The mobile terminal realizes the function of performing color conversion of the gamut to generate a composite surface image, and the information processing device receives the color conversion area designation information from the mobile terminal and extracts colors from the target image based on the designation information. The conversion area is specified, the specified color conversion area is extracted from the target image, the color conversion area and the area identification information are set in the target image, and the color conversion area and the target image in which the identification information is set are transmitted to the mobile terminal. The data carrier stores the area identification information and the color information set corresponding to the area identification information. Further, it is preferable that the information processing apparatus is configured to execute a charging process corresponding to the setting of the color conversion area for a user of the portable terminal.

The composite image generation program of the present invention is a program for generating a composite image to be displayed on a mobile terminal, and recognizes and stores color information taken from a data carrier provided in association with a colored product. The color conversion area of the target image in which the color conversion area is set is recognized, and the color conversion area is color-converted based on the color information. It is characterized by realizing a function of generating a composite image in a mobile terminal, and furthermore, it recognizes area identification information set corresponding to color information taken from a data carrier provided in association with a colored product. The color conversion area of the area identification information set in the stored target image is recognized based on the color information, and the recognized color conversion area is colored based on the recognition of the color information set corresponding to the area identification information. It is characterized by realizing the function of converting and generating a composite image in a mobile terminal.

Further, the information processing apparatus of the present invention is provided in association with a colored product, and enables the portable terminal to capture color information corresponding to the color of the colored product and recognized by the mobile terminal in cooperation with the composite image generation program. In cooperation with the data carrier to be stored, the mobile terminal realizes the function of generating a composite image by performing color conversion based on the color information that recognizes the color conversion region set in the target image, and a composite image generation program that realizes the function. An information processing device for generating a composite image on a mobile terminal that operates, receives a target image for setting a color conversion area from the mobile terminal, extracts a predetermined color conversion area from the target image, and converts the target image into a target image. It is characterized in that a target image in which a color conversion area stored in the mobile terminal is set is transmitted to the mobile terminal.

Further, the data carrier of the present invention receives a target image for setting a color conversion area from a mobile terminal, extracts a predetermined color conversion area from the target image, sets the target color as a target image, and stores the color conversion stored in the mobile terminal. Function to generate a composite plane image by performing color conversion based on color information that recognizes the color conversion area set in the target image in cooperation with an information processing device that transmits the target image in which the area has been set to the mobile terminal Is a data carrier for generating a composite image on a mobile terminal that cooperates with a composite image generation program for realizing a composite image on a mobile terminal. It is characterized in that the color information recognized by the mobile terminal cooperating with the program is stored so that it can be captured by the mobile terminal.

Further, the data carrier of the present invention recognizes the color information taken from the data carrier provided in association with the colored product, and recognizes the color conversion area of the target image in which the stored color conversion area is set. A data carrier for generating a composite image on a mobile terminal having a function of generating a composite image by performing color conversion on a color conversion area based on color information, provided in association with a colored product; Compatible with colors And storing the color information recognized by the mobile terminal cooperating with the composite image generation program so that the color information can be captured by the mobile terminal. It is preferable to store the color information.

Secondly, the composite image providing system of the present invention is a system for providing a composite image displayed on a mobile terminal, wherein the information processing device extracts a predetermined color conversion area from the target image to extract the target image. And stores a composite image generation program that allows a portable terminal to realize a function of generating a composite image by performing color conversion based on color information that recognizes a color conversion area set in a target image, and generates a composite image. The program transmission request is received from the mobile terminal, and the composite image generation program stored in the mobile terminal is extracted and transmitted to the mobile terminal in response to the composite image generation program transmission request, and the data carrier provided in association with the colored product is used. The color information corresponding to the color of the colored product and recognized by the mobile terminal cooperating with the synthetic image generation program is stored so as to be fetched by the mobile terminal. .

Further, the composite image generation program of the present invention is a program for generating a composite image displayed on a mobile terminal, and extracts a predetermined color conversion area from the target image, sets the color conversion area as the target image, and converts the color conversion product into a colored product. In addition to recognizing the color information captured from the data carrier provided in association with the color conversion area of the target image in which the stored color conversion area is set, the color conversion area is colored based on the color information. It is characterized by realizing the function of converting and generating a composite image in a mobile terminal.Moreover, it extracts a plurality of types of color conversion areas from a target image and sets area identification information for identifying the type of the color conversion area. In this case, each color conversion area is set in the target image.

Further, the information processing apparatus of the present invention is provided in association with a colored product, and enables the portable terminal to capture color information corresponding to the color of the colored product and recognized by the mobile terminal in cooperation with the composite image generation program. An information processing device for generating a composite image on a mobile terminal in cooperation with a data carrier to be stored. The information processing device extracts a predetermined color conversion area from the target image and sets it as the target image. The mobile terminal stores a composite image generation program that realizes the function of generating a composite image by performing color conversion based on the color information that has recognized the color conversion area that has been recognized, and sends a request for transmission of the composite image generation program from the mobile terminal. A composite that is received and stored in the mobile terminal in response to the composite image generation program transmission request An image generation program is extracted and transmitted to a mobile terminal.

Thirdly, the composite image providing system of the present invention is a system for providing a composite image displayed on a mobile terminal, wherein the information processing device recognizes color identification information recognized from a plurality of types of color information set. Stores a composite image generation program that enables a mobile terminal to recognize the color information corresponding to the target image and realize the function of generating a composite image by performing color conversion based on the recognized color information in the color conversion area set in the target image. The mobile terminal receives the request for transmitting the composite image generation program from the mobile terminal, extracts the composite image generation program stored in the mobile terminal in response to the transmission request for the composite image generation program, transmits the program to the mobile terminal, and stores the program in the mobile terminal. And transmits a plurality of types of color information respectively corresponding to the color identification information to the portable terminal, and the data carrier provided in association with the colored product has a color corresponding to the color of the colored product. Characterized by storing the color identification information recognized by the mobile terminal for cooperating with corresponding and composite image generation program broadcast capture capable mobile device. Transmission of a plurality of types of color information by the information processing device may be performed based on reception of a transmission request from the mobile terminal, or may be configured to transmit the color information periodically or when required. Further, the composite image generation program of the present invention is a program for generating a composite image displayed on a mobile terminal, and recognizes color identification information taken from a data carrier provided in association with a colored product, and performs setting. A function that recognizes color information corresponding to color identification information from multiple types of color information that has been set, and performs color conversion based on the recognized color information in the color conversion area set in the target image to generate a composite image In addition, the terminal is realized by recognizing the area identification information of the color information corresponding to the color identification information from the area identification information set corresponding to the color information, and corresponding to the area identification information. The color conversion area is recognized.

Further, the information processing apparatus of the present invention carries color identification information provided in association with a colored product, corresponding to color information corresponding to the color of the colored product, and recognized by a mobile terminal cooperating with a synthetic image generation program. An information processing device for generating a composite image on a mobile terminal in cooperation with a data carrier that can be stored at the terminal. The color corresponding to the color identification information recognized from multiple types of color information set A composite image generation program that allows a portable terminal to realize a function of recognizing information and generating a composite image by performing color conversion based on the recognized color information in the color conversion region set in the target image is stored. A request to transmit a generation program is received from the mobile terminal, and a composite image generation program stored in the mobile terminal is extracted and transmitted to the mobile terminal in response to the request to transmit the composite image generation program, and the color identification information stored in the mobile terminal is extracted. And transmitting a plurality of types of color information respectively corresponding to the mobile terminal to the mobile terminal.

Further, the data carrier of the present invention recognizes color identification information taken from a data carrier provided in association with a colored product, and sets a color corresponding to the recognized color identification information from a plurality of types of set color information. A data carrier for generating a composite image on a portable terminal having a function of recognizing information and performing color conversion based on the recognized color information in a color conversion area set in the target image to generate a composite image. , Which is provided in association with a colored product, stores color identification information corresponding to the color information corresponding to the color of the colored product and recognized by the mobile terminal cooperating with the composite image generating program so that the color identification information can be captured by the mobile terminal. It is characterized by the following.

Fourth, a composite image providing system according to the present invention is a system for providing a composite image displayed on a mobile terminal, wherein the information processing device recognizes a color conversion area set in the target image. The mobile terminal stores a composite image generation program for realizing a function of generating a composite image by performing color conversion based on information, receives a composite image generation program transmission request from the mobile terminal, and responds to the composite image generation program transmission request. The composite image generation program stored in the mobile terminal is extracted and transmitted to the mobile terminal.Multiple types of color information corresponding to each color identification information are stored, and the color identification information taken into the mobile terminal from the data carrier is stored in the mobile terminal. Color information corresponding to the color identification information is received from the terminal, extracted and transmitted to the mobile terminal, and the data carrier provided in association with the colored product is colored. The feature is to store color identification information corresponding to the color information corresponding to the color of the product and recognized by the portable terminal cooperating with the composite image generation program so that the portable terminal can capture the color identification information.

Further, the composite image generation program of the present invention is a program for generating a composite image to be displayed on a mobile terminal, and acquires color identification information stored in a data carrier provided in association with a colored product from the mobile terminal. And recognizes the color information received from the information processing device based on the transmission to the information processing device, recognizes the color conversion region of the target image in which the stored color conversion region is set, and sets the color conversion region to the color conversion region. Based on information It is characterized by realizing a function of generating a composite image by performing color conversion on a mobile terminal. Furthermore, based on transmission of color identification information to an information processing device, the information processing device can handle a plurality of types of color information. Recognizing the region identification information stored and received from the information processing device, and recognizing the color conversion region of the region identification information set in the stored target image based on the recognition of the region identification information. Features.

Further, the information processing device of the present invention is provided in association with a colored product, and enables a portable terminal to capture color identification information corresponding to the color information corresponding to the color of the colored product and recognized by the information processing device. In cooperation with a data carrier to be stored, a mobile terminal that cooperates with a composite image generation program that enables a mobile terminal to realize a function of generating a composite image by performing color conversion based on color information that recognizes a color conversion region set in a target image. An information processing device for generating a composite image on a terminal, storing a plurality of types of color information corresponding to each color identification information, receiving the color identification information taken into the mobile terminal from the data carrier from the mobile terminal, The method is characterized in that color information corresponding to the identification information is extracted and transmitted to the mobile terminal. Further, the area identification information corresponding to each color identification information is stored, and the color identification received from the mobile terminal is stored. The feature is that area identification information corresponding to different information is extracted and transmitted to the mobile terminal.

Further, the data carrier of the present invention stores a plurality of types of color information corresponding to each color identification information, receives the color identification information taken into the mobile terminal from the data carrier from the mobile terminal, and stores the color information corresponding to the color identification information. In cooperation with an information processing device that extracts information and sends it to the mobile terminal, a function to generate a composite image by performing color conversion based on the color information that recognizes the color conversion area set in the target image has been added to the mobile terminal. A data carrier for generating a composite image at a portable terminal that cooperates with a composite image generation program to be realized. The data carrier is provided in association with a colored product, and corresponds to color information corresponding to the color of the colored product. It is characterized in that the color identification information recognized by the mobile terminal cooperating with the image generation program is stored so as to be fetched by the mobile terminal.

Fifth, a composite image providing system of the present invention is a system for providing a composite image displayed on a mobile terminal, wherein the information processing apparatus receives a target image for setting a color conversion area from the mobile terminal. Then, a predetermined color conversion area is extracted from the target image and set as the target image, the target image in which the color conversion area is set is stored, and the color conversion information corresponding to each color identification information is stored. Stores several types of color information, receives color identification information taken into the mobile terminal from the data carrier from the mobile or terminal, recognizes the color information corresponding to the color identification information, and sets the color set in the target image. A synthesized image is generated by performing color conversion based on the color information recognizing the conversion area, and the generated synthesized image is transmitted to the mobile terminal, and the data carrier provided in association with the colored product corresponds to the color of the colored product. It is characterized in that the color identification information of the color information is stored so as to be fetched by a portable terminal.

Also, the information processing apparatus of the present invention is provided in association with a colored product, and cooperates with a data carrier that stores color identification information of color information corresponding to the color of the colored product in a manner that can be captured by a mobile terminal. An information processing device for providing a composite image to be displayed on a terminal. The information processing device stores a target image in which a color conversion area is set, and stores a plurality of types of color information corresponding to each color identification information. The color identification information received by the terminal is received from the mobile terminal, the color information corresponding to the color identification information is recognized, and color conversion is performed based on the recognized color information of the color conversion area set in the target image. And generating a composite image by using the method, and transmitting the generated composite image to the mobile terminal. The target image in which the color conversion area is set includes receiving the target image in which the color conversion area is set from the mobile terminal, extracting a predetermined color conversion area from the target image and setting the target image, and setting the color conversion area. A configuration that stores the target image is preferable because the target image can be set from a ubiquitous location on a mobile terminal, which is preferable.However, a color conversion area processing that is connected to a storefront or a store terminal and a communication network via a communication network is preferable. A configuration in which the target image with the color conversion area set is received from the device and stored in association with the user ID, etc., and the information processing device extracts and sets the color conversion area for the target image received from the terminal such as a store It may be configured to perform processing and store. Further, area identification information corresponding to each color identification information is stored, area identification information corresponding to the received color identification information is recognized, a color conversion area corresponding to the area identification information is recognized, and the color conversion area is recognized. A configuration in which color conversion is performed based on color information may be adopted.

Further, the data carrier of the present invention receives a target image for setting a color conversion region from a mobile terminal, extracts a predetermined color conversion region from the target image, sets the color conversion region as the target image, and sets the color conversion region. The target image is stored, a plurality of types of color information corresponding to each color identification information is stored, the color identification information taken into the mobile terminal from the data carrier is received from the mobile terminal, and the color information corresponding to the color identification information is recognized. The color set in the target image It provides a composite image to be displayed on a mobile terminal in cooperation with an information processing device that generates a composite image by performing color conversion based on the color information that recognizes the conversion area and transmits the generated composite image to the mobile terminal. A data carrier, which is provided in association with a colored product and stores color identification information of color information corresponding to the color of the colored product so as to be fetchable by a portable terminal.

Sixth, a composite image providing system of the present invention is a system for providing a composite image displayed on a mobile terminal, wherein the information processing apparatus receives a target image for setting a color conversion area from the mobile terminal. A predetermined color conversion area is extracted from the target image, set as the target image, the target image in which the color conversion area is set is stored, and the color information taken into the mobile terminal from the data carrier is received from the mobile terminal; The color conversion area set in the target image is color-converted based on the color information to generate a composite image, and the generated composite image is transmitted to the mobile terminal. It is characterized in that color information corresponding to the color of a color product is stored so as to be able to be taken in by a portable terminal. The information processing apparatus of the present invention is provided in association with a colored product, and displayed on a mobile terminal in cooperation with a data carrier that stores color information corresponding to the color of the colored product so that the color information can be captured by the mobile terminal. An information processing apparatus for providing a synthesized image to be stored, which stores a target image in which a color conversion area is set, receives color information taken into the mobile terminal from a data carrier from the mobile terminal, and sets the target image. The color conversion area is color-converted based on the color information to generate a composite image, and the generated composite image is transmitted to a portable terminal. Similarly to the above, the target image for which the color conversion area is to be set is obtained by receiving the target image for which the color conversion area is to be set from the mobile terminal, extracting a predetermined color conversion area from the target image, setting the target image, and performing color conversion. It is preferable to store the target image in which the region is set, but it is also possible to receive the target image in which the color conversion region is set from the color conversion region processing device and store it. Further, a configuration is also possible in which the area identification information taken into the mobile terminal from the data carrier is received from the mobile terminal, the color conversion area corresponding to the area identification information is recognized, and the color conversion area is color-converted based on the color information. Good.

Further, the data carrier of the present invention receives a target image for setting a color conversion area from a portable terminal, extracts a predetermined color conversion area from the target image, sets the target color image as a target image, and sets the target for which the color conversion area is set. Images are stored and imported from the data carrier to the mobile terminal. With the information processing device that receives the color information from the mobile terminal, generates a composite image by performing color conversion on the color conversion area set in the target image based on the color information, and transmits the generated composite image to the mobile terminal. A data carrier for providing a composite image displayed on the mobile terminal, provided in association with the colored product, and stores color information corresponding to the color of the colored product so that the color information can be captured by the mobile terminal. The feature is further characterized in that region identification information of a color conversion region to be color-converted by color information is stored corresponding to the color information. Seventh, as a further modification of the present invention, the color conversion is performed by recognizing access destination information of a site that provides information related to the colored product, which is taken in from a data carrier provided in association with the colored product. To the portable terminal by realizing a function to set the access destination information in the color conversion area to be designated so that the portable terminal can input the information, or from the information processing device to the portable terminal by corresponding to each of a plurality of types of color information. Recognize the access destination information corresponding to the color identification information from the access destination information of the site that provides the related information of the colored product stored in the setting, and specify the access destination information in the color conversion area for color conversion. Or a composite image generation program for realizing the function to be set in the portable terminal, or stored in the information processing device in correspondence with the color identification information, and extracted and transmitted based on the color identification information. Based on recognition of access destination information of a site that provides information related to a colored product, a mobile terminal realizes a function of setting access destination information so that the destination information can be designated and input in the color conversion area for color conversion. The information processing device recognizes the access destination information of the site that provides the related information of the colored product, which is stored in association with the color identification information, or is taken into the portable terminal from the data carrier and stored in the portable terminal. It is possible to provide a composite image providing system or the like that recognizes the access destination information received from the terminal and sets the access destination information in the color conversion area for color conversion so that the input destination information can be designated and input to generate a composite image. In addition, a configuration in which a smaller number of data carriers associated with the colored products are provided than the plurality of colored products displayed at the store, or the information processing device or the mobile terminal automatically generates the data based on the composite image is generated. In addition, based on a storage request to be input or received, a storage location corresponding to an album that can be browsed through a communication connection of the information processing device, an image folder of a portable terminal, or the like in a state in which a composite image can be transmitted to another person. It is also suitable as a configuration for storing data in a memory. Further, as color information corresponding to one colored product, color information corresponding to the color of the colored product and another colored product related to the colored product are provided. Color information corresponding to the color of the product may be set. Furthermore, the data carrier, the mobile terminal, or the information processing device may be configured to store the transmittance of the color information used in the weighting synthesis of the color conversion in correspondence with the color information. A plurality of set transmittances may be set so as to be selectable.

The information processing apparatus of the present invention may be an information processing server, or a plurality of information processing servers that perform different processing, or a network computer in which the information processing server and other devices are kneaded over a network. Or an information processing device that is a computer other than the server. In addition, transmission and reception between the information processing device and the portable terminal can be performed via an appropriate communication network or communication method, and is not limited to the case where the transmission and reception are performed via a communication network capable of long-distance communication. A communication control unit for short-range optical communication such as infrared communication and a communication control unit for short-range wireless communication such as Bluetooth (registered trademark) are installed in the mobile terminal and the mobile terminal. Alternatively, a configuration may be employed in which a direct connection is made by local communication to transmit and receive necessary data. In addition, the mobile terminal includes a mobile phone and a mobile information terminal. The configuration for setting and storing the various programs used in the present invention in the portable terminal is not limited to downloading from the information processing device, but is appropriate. Further, the data carrier includes a wireless IC chip such as an RFID and code information such as a two-dimensional code or a code information recording medium. Further, the colored product of the present invention includes a product for coloring an object including a person and a product in which the product itself is colored with the same or uniform shape. In addition, in the present invention, a configuration in which the configuration of each invention is added to another configuration within the applicable range, a configuration in which each configuration is changed to another configuration within the applicable range, and However, the present invention includes those in which the configuration of each invention is deleted to the extent that a partial operation and effect can be obtained.

As an effect of the present invention, by using the composite image providing system of the present invention, it is displayed on colored goods displayed in stores, colored goods described in magazines, catalogs, posters, etc., electronic paper, and the like. When a user of a mobile terminal sees a colored product or the like, the user reads in color information or color identification information on the mobile terminal from a data carrier that is associated with the colored product on the spot and uses the color information in advance. By receiving the display of the composite image obtained by color-converting the color conversion area of the target image in which the conversion area is set, the user can check the trial state of the colored product on the spot. In other words, colored products Can be checked at ubiquitous times and places. Furthermore, since the composite image can be viewed with a simple operation of the mobile terminal based on the preset target image, the user can ask a clerk to provide the composite image or take a face image at the store, for example. There is no need for troublesome work, and the user can easily and easily check the composite image. In addition, when it is difficult to actually use colored products such as lipsticks in crowded stores, or when you want to check the trial status of colored products for people or vehicles that do not exist on the spot, check the trial status. be able to.

Furthermore, by setting the target image and the color conversion area for color conversion of the target image in advance, when the user receives the display of the composite image, there is no need to perform advanced arithmetic processing such as extraction and setting of the color conversion area. A composite image is obtained by processing of recognizing the color conversion area and performing color conversion based on the color information. Therefore, it is possible to save labor in image processing and to provide a user with a synthesized image in a trial state of a colored product in a much shorter time than in actual coloring. In particular, when the user receives the composite image display, if the user can receive the composite image display simply by capturing the storage information of the data carrier into the mobile terminal, the user wants to check the trial state of the colored product. The time from the user's desire to the provision of the trial status can be drastically shortened, and the trial status can be confirmed in real time before the user's interest shifts from the colored product.

By providing a ubiquitous and quick composite image, it is possible to enhance the user's convenience and amusement with respect to the colored product, improve the impression degree, and obtain a high sales promotion effect. In particular, when a plurality of types of color conversion areas are set in the target image and each color conversion area is configured to be capable of color conversion with a product color corresponding to each color conversion area, a user may select a desired plurality of types of coloring. It is possible to check the trial state of a combination of products at any time, and to further enhance the convenience, recreational, and impression of the user's coloring products, and to promote higher sales, such as promoting purchases by combining multiple coloring products. The effect can be obtained. Further, by configuring the data carrier to store the color information and the area identification information or the color identification information having a small data amount, it is possible to avoid the problem of insufficient storage capacity. Furthermore, since an image taken into a portable terminal by imaging or communication can be set as a target image and a color conversion region can be set, a desired image can be easily set as a target image with a color conversion region set. In addition, users can use samples of coloring cosmetics such as lipstick In cases where the trial of colored products has a psychological resistance or hygiene problem of the user, such as when actually coloring by sharing with others, the trial using the actual coloring is not required by the trial using the composite image It can eliminate users' psychological resistance and hygiene problems.

In addition, the configuration for charging the setting of the color conversion area for the target image can secure a price corresponding to the color conversion area setting processing that requires a large amount of arithmetic processing or labor, and further charges. By adjusting the set amount of money, the number of color conversion area setting processes can be adjusted to a number suitable for the arithmetic processing capability or labor of the information processing apparatus. In addition, the configuration in which the mobile terminal captures the information stored in the data carrier and the mobile terminal generates and displays a composite image from the information can greatly reduce the time required to receive the display of the composite image. In addition, there is an advantage that users can receive composite images without having to pay the communication fee of the mobile terminal. On the other hand, in a configuration in which the mobile terminal transmits information captured from the data carrier to the information processing device and the information processing device transmits color information or the like or a composite image to the mobile terminal, extraction, transmission, or synthesis of the color information or the like is performed. It is possible to charge for data processing and transmission such as generation and transmission of images, and profits can be secured by covering the operating costs for providing composite images with the charging.

In addition, by setting the access destination information of the site that provides information related to the colored product in the color conversion area for color conversion, it is possible to immediately provide the relevant information of the colored product as needed. Therefore, it is possible to enhance the convenience of the user, and to access by designating the color conversion area such as the lips of the user's own image which has been color-converted. Can be enhanced. In particular, by setting access destination information in multiple types of color conversion areas, it is possible to immediately provide relevant information corresponding to each of multiple colored products, and further enhance entertainment. . In addition, provide a smaller number of data carriers associated with the colored products, such as a sample of colored products displayed at the store, shelves, and display cases with data carriers, etc. With this configuration, it is not necessary to provide a data carrier for the purpose of color conversion composite images in all of the in-store colored products, and a composite image can be provided with less cost and labor with a small number of data carriers. In addition, a data carrier for providing a composite image can be provided at a store, separated from the use of a data carrier provided directly on a colored product. In addition, the composite image generated by the color conversion is stored in the portable terminal or the information processing device so that the composite image can be transmitted to another person, and the other person can view the composite image. It is expected that the composite image will be used in a peer-to-peer environment, and it will be possible to obtain publicity effects such as word-of-mouth on the provision of colored products and composite images. Can be achieved. BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 is a block diagram showing a composite image providing system according to the first embodiment, FIG. 2 is a flowchart showing a process of the composite image providing system according to the first embodiment, and FIG. 3 is a composite image according to the second embodiment. FIG. 4 is a flowchart showing a process of the composite image providing system of the second embodiment, FIG. 5 is a block diagram showing a composite image providing system of the third embodiment, and FIG. 6 is a block diagram showing the composite image providing system of the third embodiment. FIG. 7 is a flowchart showing a process of the composite image providing system of the third embodiment. FIG. 7 is a block diagram showing a composite image providing system of the fourth embodiment. FIG. 8 is a process of the composite image providing system of the fourth embodiment. FIG. 9 is a block diagram showing the composite image providing system of the fifth embodiment, FIG. 10 is a flowchart showing the processing steps of the composite image providing system of the fifth embodiment, and FIG. Implementation form FIG. 12 is a block diagram showing a composite image providing system according to the second embodiment, and FIG. 12 is a flowchart showing a processing procedure of the composite image providing system according to the sixth embodiment. BEST MODE FOR CARRYING OUT THE INVENTION

The present invention will be described based on an embodiment of a composite image providing system for providing a composite image displayed on a mobile phone. It should be noted that partial configurations and the like of each embodiment and each example to be described later are appropriately used as configurations of other embodiments and examples as long as they can be applied. As far as the partial configuration is applicable, the configuration is appropriately changed to a partial configuration related to another embodiment or an example, or a limit to obtain a partial operation and effect for the configuration related to each embodiment or each example. The present invention also includes those in which a partial configuration or the like is deleted. Furthermore, in each embodiment and each The present invention also includes a case where a partial configuration in the embodiment is appropriately used for the configuration of another portion in the same embodiment or the same embodiment.

First, a composite image providing system according to the first embodiment will be described. As shown in FIG. 1, the synthetic image providing system of the first embodiment has an information processing server 10 as an information processing apparatus, a mobile phone 20 as a mobile terminal, and an RFID 30 as a data carrier. The information processing server 10 and the mobile phone 20 are timely connected via a wireless base station (not shown), a mobile phone network 2, a gateway server (not shown), and an internet network 3, and The telephone 20 and the RFID 30 are appropriately connected via short-range wireless communication.

The information processing server 10 includes a communication control unit 11 that performs communication control, a CPU and a memory such as a storage area for a control program and a data processing area, and a control unit 12 that executes a predetermined process according to the control program. A site data storage unit 13 that stores site data used by a site processing unit 12 1 described later, such as a site screen to be transmitted to the mobile phone 20 .Extraction, transmission, and color conversion of a target image for setting a color conversion area Stores a composite image generation program that enables a mobile terminal to receive and store the target image for which the area has been set, and to generate a composite image by performing color conversion on the color conversion area set for the target image based on color information. The user's password corresponding to the user ID 'name, address, e-mail address, credit card number, etc. User information database 1 5 for storing that data, and a billing information database 1 6 for storing accounting information for 禾 IJ for users in response to user I D. The control unit 12 functions as a site processing unit 12 1 that performs a normal site process such as transmitting a site screen and processing received data on a predetermined site screen, and generates a composite image. A distribution processing unit 1 2 2 that extracts a program and distributes it to the mobile phone 20. A color conversion area processing unit 1 2 3 that sets a color conversion area on the target image received from the mobile phone 20 and transmits it. It functions as a billing unit 124 that executes billing processing for the user for the setting.

The mobile phone 20 includes a communication control unit 21 that performs communication control, a CPU and a memory such as a storage area of a control program and a data processing area, and a control unit 22 that performs predetermined processing according to the control program, which will be described later. Target image for which color conversion area is set and its color A storage unit 23 for storing various storage data such as a conversion area and an image captured by the imaging unit 26; a display unit 24 such as a liquid crystal display; an operation input unit 25 such as a button for receiving a user's operation input; An imaging unit 26 such as a CCD camera or a CMOS camera that captures the target image, and an RFID reader 27 that transmits radio waves to RFID 30 and receives response waves from RFID 30 to read response radio wave information. In addition, it has necessary parts required to function as a mobile phone such as a smart phone and a micro phone.

The RFID 30 includes a control unit that executes predetermined processing according to a control program omitted in the figure, color information such as RGB values, and area identification information that is identification information indicating the type of a color conversion area to be color-converted using the color information. It has a storage unit for storing, a power supply unit, and an antenna.A radio wave transmitted from the RFID reader 27 of the mobile phone 20 is received by the antenna, power is generated from the received radio wave by the power supply unit, and supplied to the control unit. The control unit reads out the color information and the area identification information stored in the storage unit in response to the information request of the received radio wave, and sends the read color information and the area identification information to the RFID reader 27 of the mobile phone 20 via an antenna. Send. The RFID 30 is provided in association with the colored product 31, and the configuration of the association is appropriate as long as the location of the colored product 31 and the RFID 30 shaking the relationship with the colored product 31 is clear to the user. As a specific example of providing the RFID 30 in association with the colored product 3 1, for example, the RFID 30 is provided inside the colored product 3 1 by itself or attached to the packaging of the colored product 3 1 or the colored product 3 1. Provided, placed on a sample or price tag of colored product 311, provided at a predetermined location on the display case of colored product 311, installed at a predetermined location on the shelf where colored product 31 is provided, close to colored product 31 Magazines, posters, catalogs, etc. on which the colored product 31 is displayed, provided in a location that can be recognized as the location where the RFID 30 for the colored product 31 is installed, away from the colored product 31 It is possible to adopt a configuration provided on electronic paper for displaying the colored product 31 or the like provided on the paper surface. Further, the color information can be, for example, an appropriate color system value such as an RGB value, an HSV value, a YIQ value, and the like, and a part of the color system value such as only the luminance value is used as the color information. The control unit 22 or the composite image processing unit 126, which cooperates with the composite image generation program described later, may perform the color conversion of the color conversion area based on the color information as necessary. To convert the color system of color information from HSV value to RGB value Color conversion may be performed by performing color system conversion processing.

When providing the composite image displayed on the display unit 24 of the mobile phone 20 in the composite image providing system of the first embodiment, for example, the composite image is provided in the following process (see FIG. 2). First, the user inputs the access destination information such as the URL of the information processing server 10 and the connection request to the mobile phone 20 and, based on the transmission of the connection request of the mobile phone 20, the information processing server 10. And a mobile phone 20 to establish a communication connection. The site processing unit 112 of the information processing server 110 transmits the initial screen using the site data stored in the site data storage unit 13, and the control unit 22 of the mobile phone 20 receives the initial screen. The initial screen is displayed on the display unit 24. On the initial screen, items corresponding to the presentation request of the user registration site and the presentation request of the download site of the composite image generation program are displayed so as to be able to be designated and input.

If the user is not registered in the composite image providing service, a new member registration is performed. For example, in the process of new member registration, the user designates and inputs a user registration site presentation request item using the operation input unit 25, and the control unit 22 of the mobile phone 20 uses the item according to the input. Sends the user registration request site presentation request to the information processing server 10, while the site processing unit 121 of the information processing server 10 responds to the user registration request site presentation request , User's password 'name' address ・ e-mail address' credit card number Send the screen to mobile phone 20. The control unit 22 of the mobile phone 20 displays the received user registration screen on the display unit 24, and further inputs the necessary items for registration on the user registration screen and the items of the user registration request. In response to the specification input, the registration necessary items and the user registration request entered on the user registration screen are transmitted to the information processing server 10, while the site processing unit 12 1 of the information processing server 10 is In response to the user registration request and the reception of the necessary items, a user ID for the user of the mobile phone 20 is generated, and a message indicating that the user ID and the membership registration have been completed is displayed. The member registration end screen is transmitted to the mobile phone 20 and the user ID and each registration requirement are stored in each storage location of the user information DB 15. On the other hand, the control unit 22 of the mobile phone 2 displays the received member registration end screen on the display unit 24, and stores the user ID based on the user ID setting registration as needed. Place The new member registration process is completed by storing it in the fixed storage location.

Furthermore, when the user downloads the composite image generation program to the mobile phone 20, the user designates the item of the request for presentation of the download site of the composite image generation program on the initial screen using the operation input unit 25. The control unit 22 of the mobile phone 20 transmits the download site presentation request to the information processing server 10 in response to the input, and on the other hand, the site processing unit 1 of the information processing server 10 In response to the reception of the download site presentation request, 21 transmits to the mobile phone 20 an authentication screen in which an entry field of a user ID and a password and an item corresponding to an authentication request that can be specified and input are displayed. The control unit 22 of the mobile phone 20 displays the received authentication screen on the display unit 24, and further, according to the input of the user ID and the password on the authentication screen and the specification input of the item of the authentication request, The user ID, password and authentication request entered on the authentication screen are transmitted to the information processing server 10, while the site processing unit 122 of the information processing server 10 transmits the authentication request and the user ID to the information processing server 10. In response to receiving the password, a password corresponding to the received user ID is extracted from the user information DB 15 and compared with the received password. A program distribution screen in which the items of the download request are displayed so as to be specified can be transmitted to the mobile phone 20. If the passwords do not match, a screen displaying a message indicating that authentication was not successful is transmitted to the mobile phone 20. The control unit 22 of the mobile phone 20 displays the received program distribution screen on the display unit 24, and transmits the download request to the information processing server 110 in response to the designation input of the download request on the program distribution screen. On the other hand, the distribution processing unit 122 of the information processing server 10 extracts the composite image generation program from the composite image generation program storage unit 14 in response to receiving the download request, and Send to The control unit 22 of the mobile phone 20 stores the composite image generation program in a predetermined storage location of the memory of the control unit 22 in response to receiving the composite image generation program, and operates in accordance with the composite image generation program. (S101).

Then, when the user obtains the target image in which the color conversion area is set, first, the user performs a designation input of the composite image generation program on the program selection screen of the mobile phone 20, and the mobile phone 2 0 Start the composite image generation program with the control unit 22 You. The control unit 22 which cooperates with the composite image generation program is usually loaded and stored in the mobile phone 20 such as an image captured by the imaging unit 26 in order to specify an image for setting the color conversion area. In order to receive the items corresponding to the display request of the normal image list screen and the provision of the composite image by the target image with the color conversion area set Each of the identification information of the target image for which the color conversion area has been set stored in the mobile phone 20 is displayed as a list so that it can be designated and input. The initial screen to be displayed is displayed on the display unit 24, and the normal image list screen is displayed on the display unit 24 in response to the designation input of the display request for the normal image list screen, and the required image on the normal image list screen is identified. Depending on the specified input of information , Items corresponding to the specific request that identifies and displays on the display unit 2 4 a confirmation screen displayed the desired image with a desired image is displayed as a target image to set a color conversion area. Further, the control unit 22 specifies an image for which the color conversion area is to be set as a target image in accordance with the input of the specification request according to the composite image generation program, and inputs and specifies a user ID and a password in an input field. Display the authentication screen that displays the items corresponding to the color conversion area setting request to the possible target image on the display unit 24, and input the user ID and password on the authentication screen and also perform the authentication request. In response to the designated input of the color conversion area setting request to the information processing server, it sends a connection request based on the access destination information of the information processing server set in the composite image generation program to establish a connection with the information processing server 10 It establishes and transmits the user ID and password entered on the authentication screen, the color conversion area setting request to the target image, and the specified target image to the information processing server 10 (S102). The target image is, for example, a face image in which the face of the user in a front view is mostly displayed. The authentication data to be authenticated is not limited to the above, but may be fingerprint data or the like.

The information processing server 10 receives the user ID, password and color conversion area setting request and the target image from the mobile phone 20 (S103), and the site processing unit 121 also serves as an authentication request. In response to the color conversion area setting request and the reception of the user ID and the password, the password corresponding to the received user ID is extracted from the user information DB 15 and compared with the received password, and the password matches. If not, a screen displaying a message that authentication was not successful is transmitted to the mobile phone 20. Ma If the passwords match in the collation, the color conversion area processing unit 123 extracts a predetermined color conversion area from the received target image (S104), extracts the color conversion area, and extracts each color conversion area. To each of the color conversion areas and the area identification information of each color conversion area are set so as to correspond to the target image (S105). The mobile terminal 20 transmits the target image in which each color conversion area has been set and the color conversion area setting completion screen to the mobile phone 20 (S106). Further, the billing processing unit 124 executes the color conversion area and area identification information. The user is charged for the setting of the target image, and a predetermined amount to be set and stored is charged to the user of the user ID, and the charging amount or the charging amount is already charged. The amount added to the amount is stored in the charging information DB 16 in association with the user ID That (S 1 0 7). On the other hand, the control unit 22 of the mobile phone 20 receives from the information processing server 10 a target image in which each color conversion area and the area identification information of each color conversion area are set and a color conversion area setting completion screen (S1). 08), the identification information is added to the received color conversion area and the target image in which the area identification information of each color conversion area is set, and the image is stored in a predetermined storage location of the storage unit 23 (S109). The color conversion area setting completion screen is displayed on the display unit 24, and the color conversion area setting processing is completed. The extraction of the color conversion area and the setting of the color conversion area and the area identification information indicating the type of the color conversion area for the target image can be executed by an appropriate technique such as an example described later. The color conversion area to be set is, for example, a lip area or a lipstick coloring area, a foundation coloring area, a reddish coloring area, a plurality of types of color conversion areas by combining eye shadow coloring areas, and the like.

Thereafter, when the user receives the provision of a composite image using the target image in which the color conversion area has been set, first, the composite image generation program is started in the same manner as described above, and the display request of the normal image list screen and the brightness On the initial screen where the items corresponding to the display request for the area-set target image list screen are displayed, the user specifies and inputs the display request for the area-set target image list screen. The control unit 22 of the mobile phone 20 displays an area-set target image list screen on the display unit 24 in accordance with the designation input according to the composite image generation program, and displays the area-set target image list screen. According to the designation input of the identification information of the desired target image, a target image in which each color conversion area corresponding to the specified identification information and the area identification information of each color conversion area are set is extracted from the storage unit 13 (S11). 0), the extracted target image is The display unit 24 displays a capture enabled screen that is displayed and displays items corresponding to the capture request of the color information and the area identification information from the RFID 30 so that the items can be designated and input. Further, the control unit 22 cooperating with the synthetic image generation program is associated with the colored product 31 in proximity to the RFID reader 27 in response to the designation input of the request for taking in the color information and the area identification information. The RFID reader 27 receives the color information and the area identification information of the color conversion area to be color-converted using the color information from the RFID reader 27, recognizes it by the identifier (S111), and extracts and displays the information. A color conversion area corresponding to the area identification information received from each color conversion area set in the target image being recognized is recognized (S112), and the recognized color conversion area of the target image is added to the received color information. Based on the color conversion, a composite image of the target image is generated (S113), and the composite image is displayed on the display unit 24 (S114). The color conversion based on the color information for the color conversion area of the target image can be performed by an appropriate technique such as an example described later, and the color conversion for the color conversion area is, for example, a lip area or Color conversion based on the color information corresponding to the lipstick color for the lipstick coloring area, or color conversion based on the color information corresponding to the foundation color for the foundation coloring area, or based on the color information corresponding to the red color for the red coloring area Color conversion, or color conversion based on color information corresponding to the eye shadow color for the eye shadow colored area, or the like.

Then, the display of the composite image is performed in place of the target image extracted and displayed on the capture screen in which items corresponding to the capture request of the color information and the area identification information from the RFID 30 are displayed so as to be able to be designated and input. If a capture request to another RFID 30 is input afterwards, the control unit 22 according to the composite image generation program sends a request from another RFID 30 by the same processing as described above. Based on the received color information and the region identification information, the same or different color conversion region as the color-converted region corresponding to the region identification information is based on the color information separately received from the RFID 30. Generate and display a composite image by color conversion.

In this case, when the same color conversion region as the previously generated composite image is subjected to color conversion in a composite image generated later, the color conversion region is replaced with an image in the color conversion region converted based on the subsequent color information. When a color conversion area of a type different from that of the previously generated composite image is subjected to color conversion by a composite image generated later, the color conversion is performed by the previously generated composite image. With the image of the converted color conversion area remaining, an image of the color conversion area obtained by color conversion based on the subsequent color information is generated and displayed. For example, when displaying a synthesized face image in which the lip region is color-converted based on the color information corresponding to the lipstick color, if the color information corresponding to the lipstick color for the lip region is newly recognized, the new recognition is performed. A configuration is used to generate and display a composite face image in which the lip region is color-converted with the color information.When displaying the composite face image in which the lip region is color-converted based on the color information corresponding to the lipstick color, When the color information corresponding to the foundation color for the foundation coloring area is recognized, the lip area is color-converted based on the color information corresponding to the lipstick color, and the foundation coloring is performed using the color information corresponding to the foundation color. It is configured to generate and display a synthesized face image in which the area is color-converted. Furthermore, the control unit 22 of the mobile phone 20 adds identification information to the composite image generated by the color conversion in response to the designation input of the save button, the input of identification information, or the like, or automatically based on the generation or display end. Alternatively, the information may be stored in a predetermined storage location such as an image folder of the storage unit 23 and stored so as to be transmitted to another person.

When performing color conversion on a color conversion area of a different type before and after, when performing color conversion on a color conversion area of a later type, the color conversion on the color conversion area of the previous type is performed on the original image. For example, when displaying a synthesized face image in which the lip region is color-converted based on the color information corresponding to the lipstick color, when the color information corresponding to the foundation color for the foundation colored region is recognized. Then, the color conversion of the lip region based on the color information corresponding to the lipstick color is returned to the original image state, and a composite face image in which the color conversion of the foundation colored region is performed with the color information corresponding to the foundation color is generated and displayed. And so on.

In the first embodiment described above, the case where the color conversion area of the face image as the target image is a lip area, a foundation coloring area, a red coloring area, and an eye shadow coloring area is described as an example. The number of color conversion regions for the face image can be plural or one other than four. When the target image has one type of color conversion area, the color conversion area and the area identification information that can identify the color conversion area from other areas, or the area that can identify the color conversion area from other areas. A color conversion area having identification information is set as a target image, and color information is stored without storing the area identification information in RFID 30 or a color information set storage unit described later, and cooperates with a composite image generation program. Control unit 22 or A configuration may be adopted in which a later-described synthesized image processing unit 126 performs color conversion of a set color conversion area based on recognition of color information.

The target image and the color conversion area are not particularly limited as long as the color conversion can be performed using the color information corresponding to the colored product 31.For example, the target image is a face image including the hair.The color conversion area is the hair area. A configuration in which the product 31 is a hair manicure, or a target image is a finger or hand image in which a nail region is shown, and a color conversion region is a nail region.A configuration in which the colored product 31 is a nail polish or the target image is Image of car or model · Color conversion area is body area of car or model · Colored product 31 is composed of colored spray or paint, or target image is an image showing outer or inner wall of building · Color conversion area is outer wall Area or inner wall areaColored product 3 1 is made up of paint or wall material of a predetermined color ゃ wallpaper, or the target image is an image showing furniture, 'color conversion area is furniture display area', and colored product 3 1 is painted or colored. Spray configuration or target image with window glazing The color conversion area is a window glass area.The colored product 31 is a window glass of a predetermined color, or the target image is an image showing an eye area such as a face image.The color conversion area is a black eye area. Alternatively, it is possible to adopt a configuration in which the colored product 31 is a color contact lens in a substantially iris area from the iris to a predetermined distance.

Next, a composite image providing system according to a second embodiment will be described. The composite image providing system according to the second embodiment is configured to set a color conversion area in the target image received by the information processing server 10 and transmit the color conversion area to the mobile phone 20 according to the first embodiment. Instead of receiving the target image in which the color conversion area is set and storing it in the storage unit 23, the mobile phone 20 realizes the function of setting the color conversion area in the target image and storing it in the mobile phone 20. The information processing server 10 transmits the program to the mobile phone 20. The mobile phone 20 stores the received composite image generation program, extracts a color conversion area from the target image according to the composite image generation program, and performs color conversion. The configuration is such that the target image in which the region is set is stored in the storage unit 23. It is to be noted that, for a configuration that is not particularly described in the second embodiment, a configuration similar to the configuration described in another embodiment or the like such as the first embodiment can be appropriately used.

As shown in FIG. 3, the composite image providing system according to the second embodiment is configured such that, as in the first embodiment, the information processing server 10 and the mobile phone 20 are connected to the mobile phone network 2 and the Internet. The mobile phone 20 and the RFID 30 are appropriately connected via short-range wireless communication. The information processing server 10 includes a communication control unit 11, a control unit 12, a site data storage unit 13, and a composite image generation program storage unit 14, as in the first embodiment. The composite image generation program stored in the generation program storage unit 14 extracts a predetermined color conversion area from the target image, sets the target color in the target image, stores the target image in which the color conversion area is set, and performs color conversion. The mobile terminal realizes a function of extracting a target image in which an area is set, and performing a color conversion on the color conversion area set in the target image based on the color information to generate a composite image. Further, it does not have the user information database 15 and the billing information database 16, and the control unit 12 functions as a site processing unit 121 and a distribution processing unit 122. As in the first embodiment, the mobile phone 20 includes a communication control unit 21, a control unit 22, a storage unit 23, a display unit 24, an operation input unit 25, an imaging unit 26, and an RFID reader 27. In the memory of the control unit 22, the composite image generation program is stored by downloading from the information processing server 10, and the control unit 22 performs a predetermined process according to the composite image generation program. Execute The RFID 30 has the same configuration as that of the first embodiment, and stores color information such as RGB values and area identification information indicating a type of a color conversion area to be color-converted by the color information in its storage unit.

When providing the composite image displayed on the display unit 24 of the mobile phone 20 in the composite image providing system of the second embodiment, for example, the composite image is provided in the following process (see FIG. 4). First, a communication connection is established between the information processing server 10 and the mobile phone 20. The information processing server 10 transmits an initial screen using site data, and the mobile phone 20 displays the received initial screen on the display unit. Display on 2-4. On the initial screen, items corresponding to the presentation request of the download site of the composite image generation program are displayed so as to be able to be designated and input. The mobile phone 20 transmits the download site presentation request to the information processing server 10 in response to the designation input of the presentation request item, while the site processing unit 121 of the information processing server 10 In response to the reception of the download site presentation request, a program distribution screen in which the download request item of the composite image generation program is displayed so as to be specified can be transmitted to the mobile phone 20. The mobile phone 20 displays the received program distribution screen, and processes the download request according to the designated input of the download request. The information processing server 10 extracts the composite image generation program from the composite image generation program storage unit 14 in response to receiving the download request, and transmits the extracted composite image generation program to the mobile phone 20. I do. The control unit 22 of the mobile phone 20 stores the composite image generation program in a predetermined storage location of the memory of the control unit 22 in response to receiving the composite image generation program, and determines whether the mobile phone can operate according to the composite image generation program. (S201).

Then, when the user obtains the target image in which the color conversion area is set, the user inputs and designates the composite image generation program on the program selection screen of the mobile phone 20 and controls the control unit 22 of the mobile phone 20. To start the composite image generation program. The control unit 22, which cooperates with the composite image generation program, is used to specify an image for which a color conversion area is to be set, such as an image captured by the image capturing unit 26 and stored in the mobile phone 20. In order to receive the image corresponding to the display request of the normal image list screen, which displays each identification information of the image so that it can be specified and input, and the provision of the composite image by the target image in which the color conversion area is set, the mobile phone 2 Initially displays items corresponding to the display request of the area-set target image list screen, which lists each identification information of the target image for which the color conversion area is set stored in 0 so that it can be specified and input. The screen is displayed on the display unit 24, and the normal image list screen is displayed on the display unit 24 in response to the specification input of the display request of the normal image list screen, and the identification information of the required image on the normal image list screen is specified. Depending on the input Is displayed on the display unit 2 4 a confirmation screen items corresponding to the specific requirements of a particular displayed as a target picture image desired image to set a color conversion area the desired image while being displayed.

Further, the control unit 22 of the mobile phone 20 specifies an image for which the color conversion area is to be set as a target image in accordance with the input of the specification request according to the composite image generation program, and performs a predetermined process from the specified target image. A color conversion area is extracted (S202), and area identification information indicating the type of the color conversion area is added to each of the extracted color conversion areas, and the area identification information of each color conversion area and each color conversion area is targeted. The information is set in correspondence with the image (S203), the identification information is added to each color conversion area and the target image in which the area identification information of each color conversion area is set, and stored in a predetermined storage location of the storage unit 23 (S203). 204) The setting process of the color conversion area is completed. For processing such as extraction, setting, and storage of the color conversion area of the control unit 22 For the processing, the same processing as the processing of the color conversion area processing unit 123 in the first embodiment can be appropriately used. After that, similarly to the processing of S110 to S114 in the first embodiment, the mobile phone 20 extracts a target image in which each color conversion area corresponding to each area identification information is set (S11). 205) The RFID reader 27 receives and recognizes the color information and the area identification information of the color conversion area using the color information from the RFID 30 associated with the coloring product 31 (S5). 206), and recognizes a color conversion area having area identification information corresponding to the area identification information received from each color conversion area of the target image (S207), and converts the recognized color conversion area into the received color information. Based on the color conversion, a composite image is generated (S208), and the generated composite image is displayed on the display unit 24 (S209). The composite image is displayed on the same screen as the captureable screen of the first embodiment, and the same processing as that of the first embodiment can be performed from the captureable screen.

Next, a composite image providing system according to a third embodiment will be described. In the composite image providing system according to the third embodiment, the RFID 30 according to the first embodiment stores color information and area identification information of a color conversion area for performing color conversion based on the color information. Color information and area identification information are received from 0, the color conversion area corresponding to the received area identification information of the target image is recognized, and the color conversion area is color-converted based on the received color information to generate a composite image. Instead of the configuration, the information processing server 10 stores, as a color information set, a plurality of types of color information respectively corresponding to the respective color identification information and the respective area identification information of the color conversion area for performing color conversion using the respective color information. To the mobile phone 20 and store it in the mobile phone 20, the RFID 30 stores the color identification information, the mobile phone 20 receives the color identification information from the RFID 30, and receives the received color. Color information and area identification corresponding to identification information Information is extracted, the color conversion area corresponding to the extracted area identification information of the target image is recognized, and the color conversion area is color-converted based on the extracted color information to generate a composite image. . Note that the same configuration as that described in the other embodiments such as the first embodiment can be appropriately used for the configuration not particularly described in the third embodiment.

As shown in FIG. 5, in the composite image providing system according to the third embodiment, as in the first embodiment, the information processing server 10 and the mobile phone 20 are connected via the mobile phone network 2 and the internet network 3 in a timely manner. Connected, mobile phone 20 and RFID 30 are in short-range wireless communication Are appropriately connected via As in the first embodiment, the information processing server 10 includes a communication control unit 11, a control unit 12, a site data storage unit 13, a composite image generation program storage unit 14, a user information DB 15, Equipped with charging information DB 16, control unit 12 functions as site processing unit 121, distribution processing unit 122, color conversion area processing unit 123, and charging processing unit 124 In addition, for each type of color information and each area identification information of the color conversion area corresponding to each color information, the color information set which is the data that sets each color information and the area identification information corresponding to each color identification information. A color information set storage unit 17 for storing the color information set, and a distribution processing unit 122 for extracting the color information set and distributing the extracted color information set to the mobile phone 20. The composite image generation program generates color information and areas corresponding to the color identification information recognized from the color information set. The portable terminal realizes a function of recognizing the area identification information and performing color conversion on the color conversion area of the target image corresponding to the area identification information based on the color information. As in the first embodiment, the mobile phone 20 includes a communication control unit 21, a control unit 22, a storage unit 23, a display unit 24, an operation input unit 25, an imaging unit 26, and an RFID reader 27. The color information set received from the information processing server 10 is stored in a predetermined storage location of the storage unit 23, and the control unit 22 stores the color information set according to the stored composite image generation program. Execute the processing. The basic configuration of the RFID 30 is the same as that of the first embodiment, except that the storage unit stores color identification information, and the control unit extracts the color identification information and transmits it to the mobile phone 20. is there.

When providing the composite image displayed on the display unit 24 of the mobile phone 20 in the composite image providing system of the third embodiment, for example, the composite image is provided in the following process (see FIG. 6). First, the same processing as the member registration and the processing from S101 to S109 in the first embodiment is performed. That is, new member registration is performed as necessary from the initial screen transmitted from the information processing server 10 to the mobile phone 20, and the composite image generation program is received from the information processing server 10 to the mobile phone 20. Then, the image is stored in a predetermined storage location (S301), and the mobile phone 20 transmits a target image for setting the color conversion area to the information processing server 10 (S0302). The information processing server 10 receives the target image from the mobile phone 20 (S303), and the color conversion area processing unit 123 extracts a predetermined color conversion area from the received target image (S303). S 304), for each extracted color conversion area Area identification information indicating the type of the color conversion area is added, and each color conversion area and the area identification information of each color conversion area are set so as to correspond to the target image (S305), and corresponding to each area identification information The target image in which each color conversion area is set is transmitted to the mobile phone 20 (S306), and the charging processing unit 124 charges the user for the setting of the color conversion area and the area identification information to the target image. On the other hand, the mobile phone 20 receives from the information processing server 10 the color conversion areas and the target image in which the area identification information of each color conversion area is set (S 307). 8) The identification information is added to the received color conversion area and the target image in which the area identification information of each color conversion area is set and stored in a predetermined storage location of the storage unit 23 (S309).

Then, when the user receives the distribution of the color information set, first, the user performs designation input of the composite image generation program on the program selection screen of the mobile phone 20 and controls the mobile phone 20. The composite image generation program is started in the section 22. The control unit 22 cooperating with the composite image generation program includes, in addition to the items corresponding to the display request of the normal image-view screen and the display request of the area-set target image list screen, a color information set of the third embodiment. An initial screen in which items corresponding to the distribution processing request are displayed is displayed on the display unit 24, and according to the designation input of the color information set distribution processing request, the input fields of the user ID and the password and the authentication request are displayed. An authentication screen that displays items corresponding to the color information set distribution request that also serves as the color information set distribution request is displayed on the display unit 24. In response to the designated input, a connection request is sent based on the access destination information of the information processing server 10 set in the composite image generation program to establish a connection with the information processing server 10, and the connection is entered on the authentication screen. Re To send a user I D and Pasuwado and color information set distribution request to the information processing server 1 0.

The information processing server 10 receives the user ID, the password, and the color information set distribution request from the mobile phone 20, and the site processing unit 121 transmits the color information set distribution request also serving as an authentication request. According to the reception of the user ID and the password, the same authentication processing as in the case of distributing the composite image generation program is executed. Then, when authentication is performed by matching the password, the distribution processing unit 122 extracts the color information set stored in the color information set storage unit 17 based on the color information set distribution request. To mobile phone 20 Send. The control unit 22 of the mobile phone 20 stores the received color information set in a predetermined storage location of the storage unit 23 in response to receiving the color information set from the information processing server 10, and stores the color information. The set is ready for use by the control unit 22 according to the composite image generation program (S310).

Thereafter, when the user receives the provision of a composite image using the target image in which the color conversion area is set, the user starts the composite image generation program in the same manner as described above, and requests the display of the normal image list screen and the target image for which the area has been set. On the initial screen where items corresponding to the list screen display request and the color information set distribution processing request are displayed, the user specifies and inputs a display request for the area-set target image list screen. The control unit 22 of the mobile phone 20 displays an area-set target image list screen on the display unit 24 according to the designation input according to the composite image generation program, and displays the area-set target image list screen. According to the designated input of the identification information of the desired target image, the color conversion regions corresponding to the specified identification information and the target image in which the region identification information of each color conversion region is set are extracted from the storage unit 13 (S 3 1 1), the display unit 24 displays an extractable screen on which the extracted target image is displayed and an item corresponding to the request for importing the color identification information from the RFID 30 is displayed so that it can be designated and input. indicate. Further, the control unit 22 cooperating with the composite image generating program, in response to the designation input of the color identification information capture request, associates the RFID product 27 with the RFID reader 27 which is in close proximity to the RFID reader 27. The RFID reader 27 receives the color identification information and recognizes it by the identifier (S312), and receives the color information corresponding to the received color identification information and the area identification information of the color conversion area for performing color conversion using the color information. Is recognized from the color information set (S313), and from each color conversion area set in the target image being extracted and displayed, a color conversion area corresponding to the recognized area identification information is recognized (S313). 14 4), the color conversion area of the recognized target image is subjected to color conversion based on the recognized color information to generate a composite image of the target image (S 3 15), and the composite image is displayed on the display unit 24. Yes (S316). The composite image is displayed in such a manner that an item corresponding to the color identification information capture request from the RFID 30 is displayed on the capture enabled screen in which designation input is possible, instead of the target image extracted and displayed. If, after that, a capture request for another RFID 30 is separately input, the control unit 22 according to the composite image generation program transmits the color identification information from the separate RFID 30 by the same processing as described above. Color identification based on receiving The color information and the area identification information corresponding to the information are recognized from the color information set, and a color conversion area that is the same as or different from the color-converted color conversion area corresponding to the area identification information is separately stored in the RFID 30. The color conversion is performed based on the color information recognized based on the color identification information received from, and a composite image is generated and displayed.

Next, a composite image providing system according to a fourth embodiment will be described. In the composite image providing system according to the fourth embodiment, in the third embodiment, the information processing server 10 distributes and stores the color information set to the mobile phone 20, and the mobile phone 20 stores the color information set. Instead of recognizing the color information and area identification information corresponding to the color identification information received from RFID 30 based on the color information set, the mobile phone 20 processes the color identification information received from RFID 30 The information processing server 10 recognizes the color information and the area identification information corresponding to the color identification information received from the mobile phone 20 based on the stored color information set, and transmits the color information and the color information. The mobile phone 20 transmits the area identification information to the mobile phone 20. On the other hand, the mobile phone 20 recognizes the color information and the area identification information received from the information processing server 10, and outputs the target image corresponding to the area identification information. The color conversion area is colored based on the color information. It is configured to generate a composite image by conversion. Note that the same configuration as that described in the other embodiments such as the first and third embodiments can be appropriately used for the configuration not particularly described in the fourth embodiment.

As shown in FIG. 7, in the composite image providing system of the fourth embodiment, as in the third embodiment, the information processing server 10 and the mobile phone 20 are connected via the mobile phone network 2 and the Internet network 3 in a timely manner. The mobile phone 20 and the RFID 30 are connected appropriately via short-range wireless communication. As in the third embodiment, the information processing server 10 includes a communication control unit 11, a control unit 12, a site data storage unit 13, a composite image generation program storage unit 14, a user information DB 15, It has a charging information DB 16 and a color information set storage unit 17 .The control unit 12 has a site processing unit 121, a distribution processing unit 122, a color conversion area processing unit 123, and a charging process. The control unit 12 recognizes the color information and the area identification information corresponding to the color identification information received from the mobile phone 20 from the color information set of the color information set storage unit 17 And functions as a color information distribution processing unit 125 that transmits the recognized color information and region identification information to the mobile phone 20. The stored composite image generation program stores the received color information and region identification information. Recognition of the domain This is to allow a portable terminal to realize a function of performing color conversion of a color conversion area of a target image corresponding to different information based on color information. As in the third embodiment, the mobile phone 20 includes a communication control unit 21, a control unit 22, a storage unit 23, a display unit 24, an operation input unit 25, an imaging unit 26, and an RFID reader 27. Although it is provided, the color information set is not stored in the storage unit 23, and the control unit 22 executes predetermined processing according to the stored composite image generation program. The RFID 30 is the same as that of the third embodiment, and transmits the stored color identification information to the mobile phone 20.

When providing the composite image displayed on the display unit 24 of the mobile phone 20 in the composite image providing system of the fourth embodiment, for example, the composite image is provided in the following process (see FIG. 8). First, the same processing as the member registration and the processing of S101 to S109 or S301 to S309 in the first and third embodiments is performed (S401 to S400). 9). Then, when the user receives the provision of the composite image based on the target image in which the color conversion area is set, the user first specifies and inputs the composite image generation program on the program selection screen of the mobile phone 20. Then, the control unit 22 of the mobile phone 20 starts the composite image generation program. The control unit 22 cooperating with the composite image generation program displays the initial screen on the display unit 24 on which each item corresponding to the display request of the normal image list screen and the display request of the area set target image list screen is displayed. In accordance with the designated input of the display request of the area-set target image list screen, the area-set target image list screen is displayed on the display unit 24, and the desired target in the area-set target image list screen is displayed. In accordance with the designated input of the image identification information, the color conversion areas corresponding to the specified identification information and the target image in which the area identification information of each color conversion area is set are extracted from the storage unit 13 (S410). On the display unit 24, the extracted target image is displayed, and an item corresponding to the request for acquiring the color identification information from the RF ID 30 is displayed on the display unit 24 so that the item can be designated and input.

Further, the control unit 22 cooperating with the composite image generation program, in response to the designation input of the color identification information capture request, associates the RFID reader 27 associated with the colored product 31 with the RFID reader 27 which is in proximity to the RFID reader 27. The RFID reader-27 receives and recognizes the color identification information (S411), and in response to receiving the color identification information, accesses the information processing server 10 set in the composite image generation program. A connection request is transmitted based on the information to establish a connection with the information processing server 10, and a color information distribution request and the color identification information are transmitted. Is transmitted to the information processing server 10 (S4 12). The information processing server 10 receives the color information distribution request and the color identification information from the mobile phone 20 (S 413), and the color information distribution processing unit 125 receives the color information distribution request and the color identification. Upon receipt of the information, the color information corresponding to the received color identification information and the area identification information of the color conversion area to be color-converted with the color information are extracted from the color information set in the color information set storage unit 17. Then (S414), the extracted color information and region identification information are transmitted to the mobile phone 20 (S415). On the other hand, the mobile phone 20 receives and recognizes the color information and the area identification information corresponding to the color identification information transmitted from the information processing server 10 (S 4 16), and generates a composite image generation program. The control unit 22 recognizes a color conversion area corresponding to the received area identification information from each color conversion area set in the target image being extracted and displayed (S 4 17), and The color conversion area of the image is color-converted based on the received color information to generate a composite image of the target image (S 418), and the composite image is displayed on the display unit 24 (S 419) .

The display of the composite image is configured such that an item corresponding to the color identification information capture request from the RFID 30 is displayed in place of the extracted target surface image on a capture screen that is displayed so as to be able to be designated and input, After that, if another capture request to the RFID 30 is input, the control unit 22 according to the composite image generation program performs the same processing as above to separately perform the color identification information from the RFID 30. The same or different color as the color-converted color conversion area corresponding to the received area identification information based on the reception of the color information and the area identification information corresponding to the color identification information transmitted from the mobile phone 20. Recognizes the conversion area and performs color conversion on the color conversion area based on the received color information to generate and display a composite image.

Next, a composite image providing system according to a fifth embodiment will be described. The composite image providing system of the fifth embodiment is different from the first to fourth embodiments in which the mobile phone 20 performs a process of generating a composite image by performing color conversion on the color conversion region of the target image based on the color information. The information processing server 10 extracts the target image, the color information, and the area identification information corresponding to the color information based on the user ID and the color identification information received from the mobile phone 20, and the target image corresponding to the area identification information. The color conversion area is color-converted based on the color information to generate a composite image, and the composite image is transmitted to the mobile phone 20. The fifth embodiment For configurations not particularly described in the embodiments, configurations similar to those described in other embodiments and the like such as the first and fourth embodiments can be appropriately used.

As shown in FIG. 9, the composite image generation program according to the fifth embodiment is similar to the first to fourth embodiments, except that the information processing server 10 and the mobile phone 20 are connected to the mobile phone network 2 and the Internet. The mobile phone 20 and the RFID 30 are appropriately connected via the short-range wireless communication. As in the fourth embodiment, the information processing server 10 includes a communication control unit 11, a control unit 12, a site data storage unit 13, a user information DB 15, a billing information DB 16, and color information. A set storage unit 17 is provided, and the control unit 12 functions as a site processing unit 121, a distribution processing unit 122, a color conversion area processing unit 123, and a billing processing unit 124. The target image DB 18 that stores the conversion region and the target image in which the region identification information is set corresponding to the user ID, and the support program storage unit 19 that stores the support program for supporting the provision of the composite image The control unit 12 further recognizes the color information and the region identification information corresponding to the color identification information received from the mobile phone 20 from the color information set of the color information set storage unit 17, and The target image corresponding to the user ID received from 20 is recognized from the target image DB 18 and The color conversion area of the target image corresponding to the identified area identification information is recognized, the color conversion is performed on the color conversion area based on the recognized color information to generate a composite image, and the composite image is transmitted to the mobile phone 20. The color conversion area processing section 123 has the function of the composite image processing section 126 to transmit, and the color conversion area processing section 123 associates the target image in which the color conversion area and the area identification information are set with the user ID. Then, the distribution processing unit 122 extracts a support program for supporting provision of the composite image and distributes it to the mobile phone 20. The mobile phone 20 has the same basic configuration as the fourth embodiment and the like, and includes a communication control unit 21, a control unit 22, a storage unit 23, a display unit 24, an operation input unit 25, and an imaging unit. 26 and an RFID reader 27. The control unit 22 stores a support program and executes a predetermined process according to the support program. The RFID 30 is the same as that of the fourth embodiment and the like, and transmits the stored color identification information to the mobile phone 20. When providing the composite image displayed on the display unit 24 of the mobile phone 20 in the composite image providing system of the fifth embodiment, for example, the composite image is provided in the following process (see FIG. 10). First, the user inputs the access destination information of the information processing server 10 to the mobile phone 20 and inputs the information. And a connection request is input, and a communication connection is established between the information processing server 10 and the mobile phone 20 based on the transmission of the connection request from the mobile phone 20. The site processing unit 12 1 of the information processing server 10 transmits the initial screen using the site data stored in the site data storage unit 13, and the control unit 22 of the mobile phone 20 receives the initial screen. The initial screen is displayed on the display section 24. In the initial screen, items corresponding to a request for presenting a user registration site and a request for presenting a download site for a support program are displayed so as to be able to be designated and input. The process of member registration by the user registration site is the same as in the first embodiment.

Then, when the user downloads a support program for supporting provision of a composite image to the mobile phone 20, the user uses the operation input unit 25 to request a download site for a support program on the initial screen. The control unit 22 of the mobile phone 20 transmits the download site presentation request to the information processing server 10 in response to the input, and on the other hand, the control unit 22 of the information processing server 10 In response to receiving the download site presentation request, the site processing unit 121 displays the authentication screen in which the user ID and password input fields and items corresponding to the authentication request that can be specified and displayed are displayed on the mobile phone. Send to 20. Furthermore, authentication processing is performed in the same manner as in the case of downloading the composite image generation program of the first embodiment, etc., and when the passwords match, the program distribution in which the items of the download request of the support program can be specified is displayed. Send the screen to mobile phone 20. The control unit 22 of the mobile phone 20 displays the received program distribution screen on the display unit 24, and transmits the download request to the information processing server 10 in response to the designation input of the download request of the program distribution screen. On the other hand, the distribution processing unit 122 of the information processing server 10 extracts the support program from the support program storage unit 19 and transmits it to the mobile phone 20 in response to receiving the download request. In response to receiving the support program, the control unit 22 of the mobile phone 20 stores the support program in a predetermined storage location of the memory 'of the control unit 22 and becomes operable according to the support program (S5). 0 1).

Then, when the user stores the target image in which the color conversion area has been set in the information processing server 10, the user performs designation input of the support program on the program selection screen of the mobile phone 20, and The support program is started by the control unit 22 of the mobile phone 20. The control unit 22 cooperating with the support program determines the image for which the color conversion area is to be set by using the normal image captured and stored in the mobile phone 20 such as the image captured by the imaging unit 26. An information processing server 10 is provided for displaying the list corresponding to the display request of the normal image list screen, in which each identification information is displayed in a list so that it can be designated and input, and a combined image provided by the target image in which the color conversion area is set. The initial image in which the items corresponding to the display processing request on the area-set target image list screen are displayed so that each identification information of the target image for which the color conversion area has been set stored in the area can be specified and input. The surface is displayed on the display section 24. Further, the same processing as in the case of the composite image generation program of the first embodiment is performed, and the user ID, password, color conversion area setting request to the target image, and the specified target image are transmitted to the information processing server 10. Is transmitted to (S502).

The information processing server 10 receives the user ID, the password, the color conversion area setting request, and the target image from the mobile phone 20 (S503), and performs the same authentication processing as in the first embodiment. If the passwords match in the comparison, the color conversion area processing unit 123 extracts a predetermined color conversion area from the received target image (S504), and applies the extracted color conversion area to each of the extracted color conversion areas. Area identification information indicating the type of the color conversion area is added, and each color conversion area and the area identification information of each color conversion area are set so as to correspond to the target image (S550), and the area identification information corresponding to each area identification information is set. The identification information is attached to the target image in which each color conversion area is set, stored in a predetermined storage location of the target image DB in correspondence with the user ID (S506), and the charging processing unit 124 To the user for setting the conversion area and area identification information to the target image A payment process is performed, a predetermined amount to be set and stored is charged to the user of the user ID, and the charged amount or the amount obtained by adding the charged amount to the already charged amount is associated with the user ID. It is stored in the billing information DB 16 (S507). Further, the color conversion area processing section 123 displays the identification information attached to the target image and displays a message indicating that the setting and storage of the color conversion area for the target image are completed. The area setting completion screen is transmitted to the mobile phone 20, and the mobile phone 20 displays the received color conversion area setting completion screen on the display unit 24, and the color conversion area setting processing is completed.

After that, the user receives the provision of the composite image with the target image in which the color conversion area is set. 2003/014411

In the initial screen, the support program is started in the same way as above, and the items corresponding to the display request of the normal image list screen and the display processing request of the area set target image recognition screen are displayed. The user specifies and inputs a display processing request for the area-set target image list screen. In accordance with the support program, the control unit 22 of the mobile phone 20 responds to the input by inputting a user ID and a password in an input field or an area-set target image that can be designated and input. The displayed authentication screen is displayed on the display unit 24. Support is provided according to the input of the user ID and password on the authentication screen, and the designation input of the display request for the area-set target image list screen that also serves as the authentication request. A connection request is sent based on the access destination information of the information processing server 10 set in the program to establish a connection with the information processing server 10, and the user ID, password and area entered on the authentication screen are set. A display request for the set target image list screen is transmitted to the information processing server 10.

The information processing server 10 receives the user ID, the password, and the display request of the area-set target image list screen from the mobile phone 20, and the site processing unit 121 sets the area which also serves as the authentication request. The authentication process is executed in the same way as described above in response to the display request for the list of already processed images and the reception of the user ID and password. One or a plurality of color conversion areas set in advance and the identification information of the target image in which the area identification information is set are extracted, and the corresponding user ID is set using the site data in the site data storage unit 13 An area-set target image list screen for displaying a list of each set of target image identification information so that they can be designated and input is generated, and the area-set target image list screen is transmitted to the mobile phone 20. On the other hand, the mobile phone 20 receives the area-set image list screen, the control unit 22 according to the support program displays the area-set image list screen on the display unit 24, and the area-set target image list. In response to the designation input of the identification information of the desired target image on the screen, the display request of the specified identification information and the target image is transmitted to the information processing server 10. On the other hand, the information processing server 10 receives the display request of the target image and the specified identification information from the mobile phone 20, and the site processing unit 121 responds to the received identification information in response to the reception. The target image in which the corresponding color conversion regions and the region identification information of each color conversion region are set is extracted from the target image DB, and the extracted target image is transmitted to the mobile phone 20 (S508). The control unit 22 of the mobile phone 20 follows the support program, Recognizes the received color conversion area and the target image in which the area identification information is set, displays the target image, and displays the item corresponding to the color identification information capture request from RFID 30 so that it can be specified and input. A capture screen is generated, and the capture screen is displayed on the display unit 24.

Further, the control unit 22 cooperating with the support program, from the RFID 30 which is associated with the colored product 31 and is in close proximity to the RFID reader 27, The RFID reader 27 receives the color identification information and recognizes it by the identifier (S509). In response to the reception of the color identification information, the access destination information of the information processing server 10 set by the support program is received. A connection request is transmitted to the information processing server 10 to establish a connection with the information processing server 10, and a request to generate a composite image and the color identification information are transmitted to the information processing server 10 (S510). The information processing server 10 receives the composite image generation request and the color identification information from the mobile phone 20 (S511), and the composite image processing unit 126 receives the composite image generation request and the color identification information. Then, the color information corresponding to the received color identification information and the area identification information of the color conversion area to be color-converted with the color information are extracted from the color information set of the color information set storage unit 17 (S 512) Recognizing a color conversion area corresponding to the extracted area identification information from each color conversion area set in the target image being extracted and displayed (S513), and recognizing the color of the recognized target image. The conversion area is color-converted based on the extracted color information to generate a composite image of the target image (S 514), and transmits the composite image to the mobile phone 20 (S 515).

The mobile phone 20 receives the composite image transmitted from the information processing server 10 (S

5 1 6) According to the support program, the control unit 22 recognizes the received composite image, displays the composite image, and can specify and input items corresponding to the color identification information capture request from the RFID 30. Then, a capture-capable screen to be displayed on the screen is generated, and the capture-capable screen is displayed on the display unit 24 (S5 17). After that, if another capture request for the RFID 30 is input from the capture screen on which the composite image is displayed, the same processing as described above, that is, other than the mobile phone 20 is performed. Receiving color identification information from RFID 30 of Japan, transmitting color identification information to mobile phone 20 and generating a captureable screen that displays a composite image to be received, and color identification of information processing server 10 By generating and transmitting a composite image of the target image based on color information and area identification information corresponding to the information, A composite image in which the same or different color conversion region as the color-converted region of the obtained composite image is color-converted is provided. Note that the composite image generation processing of the composite image processing unit 126 may use the same processing as the composite image generation processing performed by the control unit 22 according to the composite image generation program of the first to fourth embodiments. It is possible. In addition, in response to the designation input of the save button, the input of identification information, or the like, or automatically based on the reception, the control unit 22 of the mobile phone 20 attaches the identification information to the received composite image and stores it in the storage unit 23. The control unit 22 of the mobile phone 20 stores the request for storage and the identification according to the configuration for storing the image in a predetermined storage location such as an image folder and the like so that the image can be transmitted to another person, and according to the storage request and the transmission input of the identification information. The other information is transmitted to the information processing server 10, and based on the storage request and the identification information received by the predetermined unit of the control unit 12 of the information processing server 10, or automatically based on the generation and transmission of the composite image. Alternatively, a configuration may be adopted in which the transmitted composite image is stored with identification information attached to a predetermined storage location, and is stored so as to be displayed on an album site that can be viewed by another person through a communication connection. '

Next, a composite image providing system according to a sixth embodiment will be described. In the composite image providing system according to the sixth embodiment, the mobile phone 20 transmits the color identification information received from the RFID 30 to the information processing server 10 according to the fifth embodiment, and the information processing server 10 stores the color identification information. Instead of extracting color information and area identification information corresponding to the received color identification information from the set of color information to be recognized, recognizing the color conversion area of the target image corresponding to the area identification information, and performing color conversion using the color information. The mobile phone 20 transmits the color information and the area identification information received from the RFID 30 to the information processing server 10, and the information processing server 10 transmits the target image corresponding to the area identification information received from the mobile phone 20. In this configuration, the color conversion area is recognized, and the color conversion area is color-converted with the color information received from the mobile phone 20. It should be noted that the same configuration as that described in the other embodiments and the like such as the fifth embodiment can be appropriately used for the configuration not particularly described in the sixth embodiment.

As shown in FIG. 11, the composite image generation program according to the sixth embodiment is similar to the fifth embodiment, except that the information processing server 10 and the mobile phone 20 are connected to the mobile phone network 2 and the internet network 3. The mobile phone 20 and the RFID 30 are appropriately connected via short-range wireless communication. As in the fifth embodiment, the information processing server 10 includes a communication control unit 11, a control unit 12, a site data storage unit 13, and a user information DB. 15; billing information DB 16; target image DB 18; support program storage unit 19; control unit 12 includes site processing unit 121, distribution processing unit 122, color conversion area processing unit 1 23, the billing unit 124, and the combined image processing unit 126, but without the color information set storage unit 17, and the combined image processing unit 126 Recognize the target image corresponding to the user ID received from the target image from the target image DB 18, recognize the color conversion area of the target image corresponding to the area identification information received from the mobile phone 20, and recognize the color conversion area , A color conversion is performed based on the color information received from the mobile phone 20 to generate a synthesized image, and the synthesized image is transmitted to the mobile phone 20. As in the fifth embodiment, the mobile phone 20 includes a communication control unit 21, a control unit 22, a storage unit 23, a display unit 24, an operation input unit 25, an imaging unit 26, and an RFID reader 27. The control unit 22 recognizes the color information and the area identification information taken from the RFID 30 according to the support program, and transmits them to the information processing server 10. The RFID 30 stores the color information and the area identification information in its storage unit and transmits the color information and the area identification information to the mobile phone 20 and is the same as that of the first embodiment.

When providing the composite image displayed on the display unit 24 of the mobile phone 20 in the composite image providing system of the sixth embodiment, for example, the composite image is provided in the following process (see FIG. 12). First, as in the fifth embodiment, a communication connection is established between the information processing server 10 and the mobile phone 20. The information processing server 10 provides a user registration site presentation request and a support program download site. The initial screen displaying the items of the presentation request is transmitted, and if necessary, membership registration is performed at the user registration site, and the support program is downloaded to the mobile phone 20 at the download site (S 6 0 1). Further, the initial screen of the support program is displayed on the mobile phone 20. In the same process as that of the composite image generation program of the first and fifth embodiments, the user ID, password, and color conversion area setting for the target image are set. The request and the specified target image are transmitted to the information processing server 10 (S602). Further, similarly to the fifth embodiment, the information processing server 10 receives the user ID, the password, the color conversion area setting request, and the target image (S603), and the color conversion area processing unit 12 3 A predetermined color conversion area is extracted from the received target image (S604), and area identification information indicating the type of the color conversion area is added to each of the extracted color conversion areas, to thereby obtain each color conversion area and each color. The area identification information of the conversion area (S605), the identification information is added to the target image in which each color conversion area corresponding to each area identification information is set, and the target image DB is set in correspondence with the user ID. It is stored in the storage location (S 606), and the billing processing section 124 performs billing processing for the user for setting the color conversion area and the area identification information to the target image (S 606). ).

Thereafter, when the user receives the provision of a composite image using the target image in which the color conversion area has been set, the support program is started in the same manner as in the fifth embodiment, and the mobile phone 20 transmits the information to the information processing server 10. The information processing server 10 transmits a user ID, a password, and a display request for the area-set target image list screen, executes authentication processing, and transmits the area-set target image 1K screen to the mobile phone 20. The mobile phone 20 transmits the identification information of the desired target image and the display request of the target image to the information processing server 10, and further, the information processing server 10 extracts the target image of the identification information and sends it to the mobile phone 20. Then, the mobile phone 20 displays the target image and displays the items corresponding to the color information and area identification information acquisition request from the RFID 30 so that they can be designated and input. Generate a screen that can be imported and import it Screen is displayed on the display unit 24.

Further, the control unit 22 cooperating with the support program, in response to the designation input of the request for taking in the color information and the area identification information, makes the RFID 3 From 0, the RFID reader 27 receives the color information and the area identification information and recognizes them by the identifier (S609), and in accordance with the reception of the color information and the area identification information, the information processing set in the support program. A connection request is transmitted based on the access destination information of the server 10 to establish a connection with the information processing server 10, and a composite image generation request and the color information and the area identification information are transmitted to the information processing server 10 ( S610). The information processing server 110 receives the composite image generation request, the color information, and the region identification information from the mobile phone 20 (S 611), and the composite image processing unit 126 A color conversion area corresponding to the received area identification information is recognized from each color conversion area set in the extracted and displayed target image (S612), and the recognized color conversion area of the target image is converted to the color conversion area. Color conversion is performed based on the received color information to generate a composite image of the target image (S613), and the composite image is transmitted to the mobile phone 20 (S614). The mobile phone 20 receives the composite image transmitted from the information processing server 10 (S615), and the control unit 22 recognizes the received composite image according to the support program, and the composite image is displayed. Generates an importable screen in which items corresponding to the request to acquire color information and area identification information from RFID 30 are displayed so that they can be specified and input, and displays the importable screen on display unit 24. Yes (S6 16). After that, if another capture request to the RFID 30 is separately input from the capture screen displaying the composite image, the same processing as described above, that is, other than the mobile phone 20 is performed. Receiving color information and area identification information from RFID 30, transmitting color information and area identification information to mobile phone 20, generating captureable screens that display composite images to be received, and information processing server 1 By generating and transmitting a composite image of the target image based on the color information of 0 and the region identification information, etc., a composite image obtained by color-converting a color-converted region that is the same as or different from the color-converted region of the already-displayed composite image Is provided. Note that the composite image generation processing of the composite image processing section 126 uses the same processing as the composite image generation processing performed by the control section 22 according to the composite image generation program of the first to fourth embodiments. Is possible. According to the composite image providing system of the first to sixth embodiments described above, the user of the mobile phone 20 can use the coloring product 31 displayed in the store or the coloring described in the magazine 'catalog' poster or the like. If a product 31 or a colored product 31 shown on a display such as electronic paper is found, the RFID 30 provided for the colored product 31 or a sample of the colored product 3 1 RFID associated with colored products 3 1 such as lipstick, such as RFID 30 provided on shelves or RFID '30' on catalogs 'posters' electronic papers showing colored products 3 1 Import color information and area identification information or color identification information from cell phone 20 from cell phone 20 and support lipstick and other colored products 31 for color conversion areas such as the lip area of target images such as face images that have been preset Color conversion based on the color information It is possible to check the image of the product, and when the product 31 itself or its description is found, the trial state can be checked on the spot.In other words, the trial state of the product 31 such as lipstick is ubiquitous. You can check at the right time and place. Furthermore, since a composite image can be viewed with a simple operation of the mobile phone 20 based on a preset target image, for example, a user can ask a clerk to provide the composite image or take a face image at a store. Troublesome work There is no need for any work, and you can easily and easily check the composite image. Further, when it is difficult to actually use colored products 31 such as lipsticks in a crowded store or when it is desired to check the trial status of colored products 31 for a person or a car that does not exist on the spot, the trial state is also used. Confirmation can be made possible.

Furthermore, by setting the target image in advance and setting the color conversion area for color conversion of the target image in advance, image processing that requires advanced arithmetic processing such as extraction and setting of the color conversion area when checking the composite image is performed. There is no need to perform it, and it is only necessary to recognize the color conversion area that has been set in advance and perform color conversion based on the color information. Can be provided to users quickly in almost real time, and labor-saving image processing becomes possible. In particular, when viewing the composite image, communication between the information processing server 10 and the mobile phone 20 is not performed, and the color information and area identification information are obtained from the RFID 30 associated with the colored product 31. Alternatively, the composite image providing system according to the first to third embodiments, in which the composite image can be viewed simply by taking the color identification information into the mobile phone 20 by short-range communication, is provided. The time from when a user wants to produce a composite image can be drastically reduced, and a composite image can be provided in real time before the user's interest in colored products 31 such as lipstick changes can do. Then, by providing a ubiquitous and quick composite image, the user's convenience and amusement with respect to the colored product 31 such as lipstick are enhanced, the impression degree is improved, and a high sales promotion effect can be obtained. In particular, for example, a face image of the user is set as the target image, and a plurality of types of color conversion areas such as a lip area or a lipstick coloring area, a foundation coloring area, a reddish coloring area, an eye shadow coloring area are set, and a lipstick, a foundation, a burst Multiple types of color conversion set for one target image, such as being able to provide a composite image in which multiple types of color conversion areas are color-converted based on color information corresponding to each color cosmetic such as red and eye shadow By making it possible to provide a composite image in which the area is color-converted with the color information corresponding to each colored product 31, the user can check the trial state combining multiple types of colored products 31 at any time. It will be possible to enhance the user's convenience / entertainment / impression of colored products 31 and obtain higher sales promotion effects such as promoting purchases by combining multiple colored products 31 it can. Furthermore, for example, when a user shares a sample of coloring cosmetics such as lipstick with another person to actually color it, the trial of colored products 31 has a psychological resistance or hygiene problem for the user. In this way, it is possible to eliminate the need for trials using actual coloring in trials using composite images, and it is possible to eliminate psychological resistance and hygiene problems of users. Further, since the RFID 30 stores color information and area identification information or color identification information having a small amount of data, it does not cause a disadvantage in the storage capacity of the RFID 30, 30 can store other information as needed, together with color information and area identification information or color identification information having a small data amount. The hard disk resource of RFID 30 for storing other information can be stored. Can be secured sufficiently. Furthermore, since it is possible to set a color conversion area with an image such as a face image of oneself or another person captured by the mobile phone 20 by imaging or communication as a target image, it is possible to easily set a color conversion area for a desired image. The set target image can be used.

Further, in the embodiment in which charging is performed in accordance with the setting of the color conversion area for the target image, it is possible to secure a price corresponding to the color conversion area setting processing that requires a large amount of arithmetic processing in the information processing server 1, and By adjusting the set amount to be charged, it is possible to adjust the number of color conversion area setting processes to a number suitable for the arithmetic processing capability of the information processing server 10. In the embodiment in which the communication at the time of providing the composite image can be performed only by local communication between the mobile phone 20 and the RFID 30, the user of the mobile phone 20 pays a communication fee when receiving the display of the composite image. In addition, in the embodiment in which the information processing server 10 and the mobile phone 20 communicate with each other at the time of providing the composite image, transmission or combination of the color information and the area identification information can be performed. It is possible to charge for data transmission, such as transmission of an image, and to collect payment. In addition, a configuration in which one RFID 30 is provided corresponding to a plurality of colored products 31 such as providing RFID 30 at one place or two or three places corresponding to a sample of colored products 31 such as lipstick. Then, it is not necessary to provide RFID 30 for all of the colored products 31, and a low-cost composite image providing system can be realized with a small number of RFID 30, and further, it is provided directly to the colored products 31. There are benefits to using RFID 30 for other purposes. If the image generated by the color conversion is stored in the information processing server 10 or the mobile phone 20 so that the image can be viewed by another person or transmitted to another person, the image may be secondarily processed. It is also expected that each user will use the composite image in a peer-to-peer environment, and it will be possible to improve the entertainment of colored products 31 through advertising and image communication.

Next, extraction of the color conversion region from the target image described above in the composite image providing system of the first to sixth embodiments, setting of the color conversion region and region identification information indicating the type of the color conversion region for the target image, A configuration example of color conversion based on color information for a color conversion region of a target image will be described. That is, the color conversion area processing unit 123 of the information processing server 10 or the control unit 22 according to the composite image generation program of the mobile phone 20 executes the extraction of the color conversion area from the target image, the color conversion area and its Settings for the target image with area identification information indicating the type of the color conversion area, the control unit 22 according to the composite image generation program of the mobile phone 20, or the composite image processing unit 1 2 6 of the information processing server 10 The color conversion based on the color information for the color conversion area of the target image executed by the image processing can be performed by an appropriate technology such as an existing technology. For example, the following technology can be used.

When setting the color conversion area and the area identification information for the target image, for example, an edge number of each color conversion area extracted from the target image of the bitmap surface image, an area number different for each type of color conversion area Is set in the target image as the region identification information, so that the color conversion region and the region identification information are set in the target image, and the target image is transmitted or stored in the storage unit 23 or the target image DB 18. The same processing is performed even when the color conversion areas overlap, such as in the foundation coloring area and the red coloring area, or in the foundation coloring area and the eye shadow coloring area. The above-mentioned setting configuration can perform the above-described processing even when one or one type of color conversion area is set, and color conversion can be performed specially on the edge of the color conversion area extracted from the target image of the bitmap image. The area number of the area is set as the area identification information in the target image. Alternatively, the color conversion area may be set by adding SVG data specifying the color conversion area to the data of the target image. Alternatively, a configuration may be adopted in which a pixel to be color-converted is extracted from the color conversion area based on the color information at a predetermined ratio, identification information is set to the pixel, and only the pixel corresponding to the identification information is color-converted.

When a composite image is generated by performing color conversion on the color conversion area of the target image based on the color information, for example, for each of the various color conversion areas, The transmittance of the color information of the pixels of the original image and the transmittance of the color information corresponding to the colored product 31 are set in the composite image generation program or the control program of the composite image processing unit 126, and the color of the original image is set. Information and the color information corresponding to the colored product 31 1 are added at the ratio of each transmittance to calculate color information such as RGB values, and the color conversion of the corresponding color conversion area is performed using the color information. In the area where the areas overlap, corresponding to the overlapping area, the transmittance of the color information of the pixels of the original image and the transmittance corresponding to the plurality of kinds of colored products 31 are set, and the color information of the original image and the plurality of kinds are set. The color information corresponding to the colored product 3 1 is added at the ratio of each transmittance to calculate color information such as RGB values, and the color information is used to perform color conversion on the overlapping part of the corresponding color conversion area. And the transmittance is obtained by statistics at the time of coloring. To. Alternatively, the color information corresponding to the colored product 31 is set with a color that is lighter than the actual product 31 and the color information is added to the color information of the pixels of the original image to obtain color information such as RGB values. Is calculated, and the corresponding color conversion area is color-converted by the color information. Alternatively, the color information corresponding to the colored product 31 is replaced with the color information of the pixels of the original image in the color conversion area to perform the color conversion. Alternatively, an average value of the color information of each pixel of the original image in the color conversion area is calculated, and the color information corresponding to the colored product 31 is added or weighted to the average value to calculate the color information. Color conversion is performed using information. Alternatively, when the color conversion area is color-converted based on the color information, the color conversion may be performed such that the color based on the color information in the color conversion area, such as the red-eye shadow coloring area, becomes lighter or gradually lighter. For example, for example, a configuration in which the transmittance of the color information to be used in the weighting synthesis is gradually reduced toward a position at a predetermined distance from the contour of the color conversion area, and the color becomes lighter as the contour approaches, For a region up to a position at a predetermined distance, a configuration or the like for performing weighting synthesis for coloring color information with a high transmittance different from that of other regions can be adopted.

When extracting the color conversion area from the target image, edge detection, classification by color information, identification of a predetermined part based on positional relationship information, extraction of an area based on the setting of an extraction candidate area, The color conversion area is extracted by appropriately using the color conversion area extraction based on the edge. For example, if the target image is a face image that is mostly a front-view face, and the lip region and the foundation coloring region are extracted as color conversion regions. Based A facial region is extracted, a partial region other than the skin color in the facial region is detected, and predetermined portions such as a nostril, eyebrows, eyes, and lips are specified based on positional relationship information. A catch detection area is set to extract a nostril area, an eyebrow area, an eye area, and a lip area based on edge detection and classification based on color information.Except for the area of each of the predetermined parts, the area is extracted as a foundation coloring area. The predetermined region set based on the predetermined position with respect to the region and the eyebrow region is extracted as an eye shadow coloring region, and the predetermined region set based on the predetermined position with respect to the edge and the eye region, the nostril region, and the lip region of the face region is colored red. It may be configured to extract as a region.

Further, when a predetermined color conversion area is extracted from a face image which is a target image, the following technology can be appropriately used. For example, when extracting a lip region as a color conversion region from a face image, as in Patent Document 6, an edge image of the face region is generated from the face image, and a histogram of the wedge is generated by Y-axis projection to obtain a face image. Search the Y coordinate of each part, extract the feature point of the required part, and temporarily set the lip capture area at the Y coordinate position including the mouth, between the lower end of the nose and the upper end of the mouth and between the both ends of the mouth Acquires skin color information and its average value from a predetermined range such as, acquires the deviation of the color of the pixel in the lip capture area from the average value of the skin color information, and if the deviation exceeds the threshold value, judges it as a lip area and extracts it Configuration. Alternatively, when extracting the lip region from the face image, as described in Patent Document 7, the edge information is detected by executing a filtering process on the luminance information of the face image using a Sobe 1 filter or the like, and the outermost edge is detected. Separate the face image with the outside part as the background, convert the face image with the separated background to the YIQ color system, generate a cumulative histogram of density values on the Q axis, and perform threshold processing on the cumulative histogram with a predetermined threshold. The lip region is determined by the following formula.A cumulative histogram of the density value on the Q axis is generated for the lip region, and the lip region is extracted by thresholding the cumulative histogram with a predetermined threshold value. Can be. Alternatively, when extracting a lip region from a face image, as described in Patent Document 7, a lip symptom capturing region is determined by an appropriate configuration, and then a second lip candidate region is included so as to include the lip candidate region and its periphery. Is determined. A threshold value from the color component histogram of the lip capture area, and One

A configuration may be employed in which the region of the color component 50 is extracted as a lip region.

Alternatively, when extracting the foundation colored area from the face image, the background, the area below the lower jaw and the ear area are separated from the face image by edge detection or the like, and the area having skin color information is extracted from the face image. A nostril region having black information in the face region and a nostril position located at a predetermined position based on the face arrangement condition and a nostril position at an appropriate position such as a center of gravity of the nostril region; The nostril region is set by setting a partial extraction trap area at the predicted position such as eyes, mouth, ears, eyebrows, etc. The eye region, the lip region, the eyebrow region, and the like can be accurately specified and extracted, and the region of each predetermined part can be extracted and extracted from the face region. A face region including an ear region is extracted based on edge detection and skin color information, and a nostril region having black information in the face region and located at a predetermined position based on a face arrangement condition and a center of gravity thereof. The position is extracted, a partial ear catching region is set at the predicted ear position based on the nostril position, and the ear region is extracted by performing edge detection or the like on the ear candidate region, and the ear region is extracted. A configuration in which a face region not included is extracted may be adopted. Alternatively, when extracting a red-colored area from a face image, the facial area is extracted in the same manner as in the above-described configuration, and a plurality of reference points are obtained based on the position of the contour line, the eye area, the nostril area, and the like of the face area. Then, the shape line of the predetermined shape pattern to be set and stored is arranged at a predetermined position using the nostril position as a reference, etc., and the plurality of reference points of the shape line are adjusted to the positions of the acquired reference points to deform the shape line. However, a configuration is possible in which a region surrounded by the adjusted shape line or a region surrounded by the adjusted shape line and the contour of the face region is extracted as a reddish-colored region. Alternatively, when extracting an eye shadow colored region from a face image, an eye region is extracted in the same manner as the above-described configuration, and a region up to a position at a predetermined distance from the eye region is extracted as a shadow colored region. If necessary, a configuration may be employed in which the upper contour line of the eye shadow coloring area is specified based on the position specified based on the positions of the upper contour line of the eye area and the lower contour line of the eyebrow area.

When extracting a hair region from a face image including the hair and performing color conversion based on the color information corresponding to the hair manicure using the head region as a color conversion region, the hair region (hair manicure coloring region) is extracted. For example, the background is separated from the face region including the hair by edge detection, and hair color information such as black information (the threshold value processing of the density value based on this) is separated from the face region. The configuration may be such that the hair region is extracted based on the hair position information on the upper part of the image which is estimated and estimated, or a region having black information or the like and having a predetermined area or more is extracted as the hair region. In addition, when a nail area is extracted from an image of a finger, a hand, or the like in which the nail area is indicated, and the nail area is used as a color conversion area and color conversion is performed based on color information corresponding to the nail polish, the nail area (manicure coloring area) is used. When extracting, for example, the background is separated from the finger region and the hand region by edge detection, and a nail candidate region is set based on the nail position information of the tip of the finger estimated from the finger region and the hand region. It is possible to adopt a configuration in which the nail area is extracted from the nail capture area by detection or the like.

Further, the extraction of the color conversion area from the target image may be executed by chroma key processing. For example, using a product such as a free sample or a sale product that is colored in a predetermined color such as red, blue, or green, applying a predetermined color to an area to be extracted as a color conversion area in the colored product, for example, a lip area or a nail area, The control unit cooperates with the color conversion area processing unit 123 of the information processing server 10 or the composite image generation program by capturing the target image having the colored area into the mobile phone 20 by imaging the imaging unit 26 or the like. 22 may be configured to extract the coloring region as a color conversion region from the target image having the coloring region by chroma key processing.If the target image has a plurality of coloring regions of the same color, for example, a lip region * The color conversion area type may be specified based on the positional relation information according to the type of the color conversion area, such as the positional relation information of the reddish color area and the shadow colored area, and a plurality of color conversion areas may be specified. By type From the target image that is colored in a different color, it may be extracted color conversion area of the type corresponding to the color that is the colored chroma key processing.. The color to be colored by the chroma key processing can be set as needed.For example, a color that is colored in the foundation area or a predetermined color that has a large color difference from the background can be used for the lip area, red area, and eyeshadow area. The area is colored.

Further, the mobile phone 20 captures the target image having no coloring in the extraction target area, transmits the uncolored image from the mobile phone 20 to the information processing server 10, and controls the control unit of the information processing server 10. The control unit 22 of the mobile phone 20 that has taken the uncolored target image according to the control program by the predetermined unit 2 or the control unit 22 of the mobile phone 20 that has taken the uncolored target image according to the control program such as the composite image generation program. It is useful to calculate the average value of the color information of the pixels at a plurality of predetermined locations, obtain the color information of the pixel at the representative point, and the like. Obtain ground color information such as user's skin color information, lip color information, and nail color information, store the skin color information in a predetermined storage location by associating it with the user ID as necessary, A configuration may be adopted in which the color information corresponding to the colored product 31 is added or weighted and added to calculate the color of the pixel in the color conversion area to perform color conversion. Alternatively, for an image indicating a region where the extraction target region has color and is the same kind of region as the above-mentioned region and is not colored, for example, an image showing a colored nail region and a non-colored nail region is colored. As described above, the user obtains and stores the user's ground color information from the non-existing area, and adds or weights and adds the ground color information and the color information corresponding to the colored product 31 to obtain the color of the pixel in the color conversion area. May be calculated to calculate the color.

In addition, for example, a configuration in which a color conversion area is extracted and set by remote operation of a color conversion area processing device via a network for a target image stored in the information processing server 10, or a color conversion area from the information processing server 10. The data of the target image is transmitted to and stored in the processing device, and the information processing server 10 receives and stores the target image subjected to the color conversion region processing by the color conversion region processing device from the color conversion region processing device. Depending on the configuration and the like, it is also possible to adopt a configuration for extracting a color conversion area according to manual input as in Patent Documents 3 and 4. As a specific example, the information processing server 10 stores the target image received from the mobile phone 20 in a predetermined storage location in association with the user ID and the identification information of the target image, and stores the color conversion area processing program in the memory. Control unit for storageStorage unitDisplay unitOperation input unitIn response to a request to display the target image of the required identification information from the color conversion processing device including the communication control unit, the information processing server 10 performs the color conversion area processing device. The target image is transmitted via the communication network and presented to the user, and the control unit of the color conversion area processing device specifies the area range of the operator according to the color conversion area processing program. A predetermined process corresponding to an appropriate input, such as determination of the type, is executed to extract a color conversion region, set the color conversion region and the region identification information in the target image, and execute a separate process of the information processing server 10. According to the configuration of storing in a fixed storage location or the information processing server 10 storing in a separate storage location, the target image in which the color conversion area and the area identification information are set is automatically e-mailed to the mobile phone 20. It is possible to adopt a configuration for transmitting data by using a method such as this. Alternatively, the control unit 22 of the mobile phone 20 cooperating with a synthetic image generation program or the like that enables selection and specification of a minute area can similarly perform color conversion from the target image in response to manual input. It is also possible to adopt a configuration in which a conversion area is extracted, and a color conversion area and area identification information are set and stored in a target image.

Next, modified examples of the composite image providing system according to the first to sixth embodiments will be described.

In the above embodiment, the case where the RFID 30 which is a wireless IC chip is used as the data carrier has been described. However, instead of the RFID 30, code information such as a two-dimensional code or a code information recording body is used. The same processing as in the embodiment may be performed. For example, a code information analysis program may be stored in the memory of the control unit 22 of the mobile phone 20, and the printed code information or electronic paper or the like may be displayed. The color information and the area identification information or the color identification information are stored in the code information displayed on the mobile phone 20. The code information is imaged by the imaging unit 26 and taken into the mobile phone 20, and the control unit 22 of the mobile phone 20 is stored. In accordance with an analysis program, a configuration may be adopted in which the acquired code information is analyzed to extract color information and area identification information or color identification information. Alternatively, the control unit 22 of the mobile phone 20 transmits the acquired code information to the information processing server 10 in accordance with a predetermined program, and the code information analysis processing unit provided in the information processing server 10 receives the code information. To extract color information and area identification information or color identification information. Alternatively, instead of the configuration in which the imaging unit 26 captures the image and captures the code information into the mobile phone 20, the mobile phone 20 may be provided with a code reader or a scanner, and the code reader may read and capture the code information. Is also good.

A configuration in which information separately stored in addition to the color information and the area identification information or the color identification information is fetched from a data carrier such as RFID 30 and processed by the mobile phone 20 or the information processing server 10, or a similar configuration. A configuration in which separately stored information is fetched from the information processing server 10 and processed by the mobile phone 20, or a configuration in which the information processing server extracts and processes similar separately stored information, or a mobile phone Alternatively, the information processing server 10 may perform an additional process on the color conversion area in addition to the color conversion. For example, the name information of the colored product 31 is stored in the RFID 30 in association with the color information or the color identification information in the RFID 30 or the information processing server 10, and the name information is received and displayed by the mobile phone 20 or Corresponds to color information and composite images Or the information is stored in a predetermined storage location of the storage unit 23 and displayed as necessary, or the information processing server 10 stores the name information corresponding to the composite image and the like, and the mobile phone as necessary. 20. According to the name information, it is possible to increase the user's awareness of the colored product 31 and to improve the purchase motivation.

Alternatively, for example, the RFID 30 stores access destination information such as a URL of a site that provides related information of the colored product 31 together with the color information and the region identification information corresponding to the colored product 31, and stores the information on the mobile phone 20. The control unit 22 recognizes a color conversion area of the target image corresponding to the area identification information and cooperates with a predetermined program to convert the color conversion area into the access destination information. The link definition area is recognized as an embedded link definition area, an embedding command is generated in a predetermined description language such as XML, and the access destination information is embedded in the link definition area so as to be able to be designated and input. When the color information for the conversion area, the area identification information, and the access destination information are received, the access destination information of the color conversion area may be replaced and embedded by the same processing as described above. Alternatively, the color information transmitted by the information processing server 10. The area identification information and the access destination information are received by the mobile phone 20, and the mobile phone 20 performs the same processing as described above. The composite image processing unit 126 of the tenth embodiment may be configured to perform the embedding process in the same manner as described above based on the color information to be received or extracted, the region identification information, and the access destination information. With the above-described configuration, the user can access a site that provides information related to the colored product 31 by designating and inputting the color-converted color conversion area, thereby increasing the entertainment and convenience of the user. In addition, related information corresponding to various colored products 31 can be provided immediately as needed.

In addition, for transmission and reception between the information processing server 10 and the mobile phone 20, other communication methods such as electronic mail can be used as appropriate in addition to upload / download. From the server to the information processing server 10 by e-mail, or the e-mail generated by the e-mail from the information processing server 10 to extract the target image in which the color conversion area has been set. And the color information and the area identification information or the color identification information from the mobile phone 20 to the information processing server 10. The control unit 22 that follows the composite image generation program and support program of the mobile phone 20 generates an e-mail format exclusively for transmission to the information processing server 10. Alternatively, a configuration may be employed in which necessary information is recorded or input in the format and transmitted. Also in the case of the above configuration, the information processing server 10 and the mobile phone 20 recognize necessary data from the e-mail and perform predetermined processing in the same manner as described above.

In addition, the target image is not limited to a still image, but may be a moving image. Even when the target image is a moving image, for example, the extraction, setting, and It is possible to perform color conversion and the like, and besides, for example, a configuration may be used in which an initially set outline is converged on the color conversion region using the energy minimization principle and the color conversion region is extracted. Also, the target image is transmitted to the information processing server 10 from the mobile phone 20 which is a video phone, for example, by a video phone, and the information processing server 10 acquires a target image of a moving image for a predetermined time from the target image, A configuration in which a color conversion area is extracted from the target image of the moving image and set, or a target image of the moving image is captured by the imaging unit 26 of the mobile phone 20 and the moving image is processed by the information processing server 10. A configuration in which the same processing as described above is performed on the target image of the moving image that is transmitted by e-mail and received by the information processing server 10 or the moving image is captured by the imaging unit 26 of the mobile phone 20 It is possible to adopt a configuration in which the target image is picked up, and the control unit 22 extracts and sets a color conversion area from the target image of the moving image according to a predetermined program.

Further, when the target image in which the color conversion area and the area identification information are set is stored in the storage unit 23 of the mobile phone 20, the image is captured by a color conversion area processing device such as the information processing server 10 at a store or the like. The target image is fetched, the color conversion area processing device performs the above-described color conversion area extraction and setting processing, and transfers the target image in which the color conversion area and the area identification information are set by an e-mail acquired separately to the mobile terminal 20. It is possible to adopt a configuration or the like that is transmitted and stored in the mobile phone 20. Also, when storing a target image in which the color conversion area and the area identification information are set in the target image DB 18 of the information processing server 10, the target image captured at a store or the like is loaded into the information processing server 10. Alternatively, the information processing server 10 may perform a process of extracting and setting a color conversion area and storing the processed data.

The configuration for collecting the operating cost of the composite image providing system is the same as that of the above embodiment. In addition to the billing process performed by the billing processing unit 124, an appropriate billing process configuration such as a fixed system, a metered system, or a combination of both can be adopted. For example, a billing processor is connected to the information processing server 10 via a communication network and shares the user information in the user information DB 15 with the information processing server 10 .The control unit of the billing processor follows the control program. Based on the recognition of a given day, such as the corresponding day of each month, the set billing amount corresponding to a certain period, such as the month set in the storage unit, is extracted, and the user ID of each user is extracted and used. Charge the set billing amount in accordance with the user ID, execute the billing process, store each user ID and the billing amount corresponding to each user ID in the billing information DB 16 and charge in a fixed manner. can do.

Alternatively, in a predetermined storage location of the storage unit of the charging processing device, a stepwise charging amount set according to the number of times of setting the color conversion area is set, and the charging processing device periodically executes the charging process as in the previous period. The user information DB 15 of the information processing server 10 is made to correspond to the user ID, stores the upper limit number of color conversion area settings that can be used regularly by the user under contract, and starts from the specified date of the user. The predetermined number of control units 12 of the information processing server 10 recognizes the color conversion region setting process for the user ID, and stores the number of times the color conversion region is set for the user ID. The number of times of processing such as 1 is added to the number of times of setting of the color conversion area to update the number of times set in the user information DB 15, and further, the color conversion area processing unit 123 executes the color conversion area setting processing. Before the number of times the color conversion area is set exceeds the upper limit For determining whether to confirm, can be configured to perform a color conversion area setting process if not exceeded.

Alternatively, when the user views the display of the composite image on the mobile phone 20, the information processing server 110 transmits the color information, the area identification information, and the composite image to the mobile phone 20. Instead of setting the conversion area or in addition to setting the color conversion area, the charging processing unit 124 may execute the charging processing of the set charging amount in response to extraction of color information and generation of a composite image. Alternatively, identification information of a product provider such as a manufacturer or a seller of the colored product 31 and a periodic set billing amount based on a contract with each product provider are stored in a predetermined storage location of a storage unit of the charging processing device. In accordance with the control program, the control unit of the billing device extracts the identification information of the product provider and the settable amount based on the recognition of the predetermined date on a regular basis, and sets it according to the identification information of each product provider. Billing process for billing the billing amount May be executed, and the identification information of each product provider and the billing amount corresponding to each identification information may be stored in the billing information DB. Alternatively, the information processing server 10 or the billing processing device acquires the unique identification information by using the unique identification information of the mobile phone 20 acquired by communication, and performs a billing process on the unique identification information. You can. Note that each embodiment and the present invention can be configured by using unique identification information of a mobile terminal such as the mobile phone 20 instead of the user ID.

When the mobile phone 20 is configured to receive the color information and the area identification information or the color information to generate a composite image, the control unit 22 of the mobile phone 20 may execute the received color information according to a predetermined program. Is stored in a predetermined storage location of the storage unit 23, and in response to a designated input of the target image and the color information in which the color conversion area is set, the color conversion area of the target image is stored using the stored color information and the like. A composite screen may be generated and displayed by executing the color conversion of the above. Further, a selection screen for displaying selectable color information to be stored and color information to be received is displayed on the display unit 24, The color conversion of the color conversion area of the target image may be performed based on the selected and input color information.

Also, if the color conversion area processing unit 123 of the information processing server 10 or the control unit 22 according to a predetermined program of the mobile phone 20 can set a plurality of types of color conversion areas from the target image, The selected color conversion area may be set as the target image. For example, the control unit 22 of the mobile phone 20 may select a color conversion area to be set from a plurality of types of color conversion areas according to a predetermined program. Is displayed on the display unit 24, and based on the designated input of the color conversion area, the specified color conversion area is extracted and executed, or a request for setting the specified color conversion area is sent to the information processing server 10. The information processing server 10 may be configured to transmit and, on the other hand, extract and set the designated color conversion area received by the color conversion area processing unit 123 of the information processing server 10.

Also, color information and area identification information stored in the RFID 30 provided in association with the colored product 31, or color information and area identification information corresponding to the color identification information stored in the information processing server 10 or the mobile phone 20. , The color information corresponding to the colored product 31 and its region identification information, the color information indicating the color of the colored product 31 itself, the directly corresponding color information and its region identification information, and the coloring that is a related product of the colored product 31 A composite image is generated by the mobile phone 20 or the information processing server 10 as color information indicating the color of the product and its area identification information. A configuration is also possible. For example, when the colored product 31 is a predetermined lipstick, the RFID 30 corresponding to the lipstick stores color information indicating the color of the lipstick and area identification information of a lip area to be subjected to color conversion, and stores the lipstick. The color information indicating the color of the foundation that is recommended to be used in combination with the area identification information of the foundation coloring area is stored, and a plurality of types of color information and area identification information are stored. The information is taken in, the lip region and the foundation coloring region of the target image are color-converted with each color information to generate a composite image, etc., and a composite image of multiple types of colored products is provided. May be recommended.

Or, for example, when the colored product 31 is a predetermined lipstick, R F corresponding to the lipstick

In 1D30, the color information indicating the color of the lipstick and the region identification information of the lip region to be color-converted are recorded, and the color information and the lip region of another lipstick color highly relevant to the lipstick are stored. The area identification information is stored, the same kind of area identification information as the plural kinds of color information is stored, and the mobile phone 20 takes in the information, and the lip area of the target image is represented by the color information indicating the color of the lipstick. Generates and displays a composite image by color conversion, and further performs color conversion of the lip region of the target image with the color information indicating the another lipstick color after displaying for a predetermined time or based on input of a color switching request or the like. It may be configured to generate and display a composite image by providing, for example, sequentially displaying colored products of a plurality of colors, so that these products can be collectively recommended.

In addition, when generating a composite image of the mobile phone 20 or the information processing server 10 and performing color conversion of the color conversion area of the target image by weighting and combining the ground color information and the color information of the colored product 31, Weighted synthesis such as storing the color information and the transmittance at the time of synthesis in the RFID 30 or storing the color information corresponding to the color identification information and the transmittance at the time of synthesis in the information processing server 10 or mobile phone 20 The transmissivity of the color information at the time is stored in correspondence with the color information, and the mobile phone 20 and the information processing server 10 obtain the transmissivity together with the color information, and the weight information is combined with the ground color information by the color information and the transmissivity. Or the like may be configured to acquire the color of the color conversion area and perform color conversion, and to set the transmittance of the darkness that gives a good appearance for each type of lipstick or the like. Further, a plurality of transmittances are set according to the color information, and the control unit of the mobile phone 20 is set.

22 and the composite image processing section 126 of the information processing server 10 perform weighting synthesis with the specified transmittance based on the specified transmittance input or received from the mobile phone 20. Generate and display a color-converted composite image to achieve the desired density The state in which the color is adjusted may be confirmed. Industrial applicability

The present invention relates to coloring of cosmetics such as lipstick, paint such as paint, or wallpaper colored with a predetermined color, colored glass, and colored contact lenses such as color contact lenses. When seen on a display or the like, it is possible to promptly provide a user with a composite image in which the color conversion area of the target image of the user or the predetermined object is colored with a color corresponding to the product.

Claims

1. A system for providing a composite image to be displayed on a mobile terminal, wherein an information processing device performs color conversion based on color information that recognizes a color conversion area set in a target image and generates a composite image. A composite image generation program that allows a mobile terminal to realize the function of generating a composite image is stored, a request to transmit a composite image generation program is received from the mobile terminal, and a composite image generation program is generated.

The composite image generation program stored in the mobile terminal is extracted and transmitted to the mobile terminal in response to the generated program transmission request, and the target image for setting the color conversion area is received from the mobile terminal.

Then, a predetermined color conversion area is extracted from the target image and set as the target image, and the target image in which the color conversion area stored in the mobile terminal is set is transmitted to the mobile terminal and provided in association with the colored product A composite image providing system, characterized in that a data carrier stores color information corresponding to the color of a surrounding color product and recognized by a mobile terminal cooperating with a composite image generation program so that the color information can be captured by the mobile terminal.

2. Based on the recognition of the region identification information set corresponding to the color information, the composite image generation program recognizes the color conversion region of the region identification information set in the target image, and corresponds to the region identification information. Based on the recognition of the color information being performed, the mobile terminal realizes the function of performing color conversion of the recognized color conversion area to generate a composite image, and the information processing apparatus performs a plurality of types of color conversion from the target image. The region is extracted, each color conversion region and each region identification information are set in the target image, each color conversion region and the target image in which the identification information is set are transmitted to the mobile terminal, and the data carrier is configured to output the region identification information and 2. The composite image providing system according to claim 1, wherein color information set in correspondence with the area identification information is stored.

3. Based on the recognition of the area identification information set corresponding to the color information, the composite image generation program recognizes the color conversion area of the area identification information set in the target image, and corresponds to the area identification information. Based on the recognition of the color information being performed, the portable terminal realizes the function of performing color conversion on the recognized color conversion area to generate a composite image, and the information processing device transmits the designated information of the color conversion area to the mobile terminal. A color conversion area received from the terminal and extracted from the target image based on the specified information is specified, the specified color conversion area is extracted from the target image, the color conversion area and the area identification information are set in the target image, Conversion domain and its knowledge 2. The method according to claim 1, wherein the target image to which the different information is set is transmitted to the portable terminal, and the data carrier stores the area identification information and the color information set corresponding to the area identification information. Or the composite image providing system according to paragraph 2.

4. The combination according to claim 1, 2, or 3, wherein the information processing device executes a charging process corresponding to the setting of the color conversion area for the user of the portable terminal. Image providing system.

5. A program for generating a composite image to be displayed on a mobile terminal, which recognizes color information captured from a data carrier provided in association with a colored product and sets a stored color conversion area. A composite image generation program for realizing a function of recognizing a color conversion region of a target image and performing color conversion of the color conversion region based on color information to generate a composite image in a portable terminal.

6. Data provided in association with the colored product. Based on the recognition of the area identification information set corresponding to the color information imported from the carrier, the data of the area identification information set in the stored target image is stored. Recognizing a color conversion area and, based on recognition of color information set corresponding to the area identification information, realizing a function of causing a portable terminal to perform color conversion of the recognized color conversion area and generate a composite image. A composite image generation program according to claim 5, characterized in that:

7. A data carrier that is provided in association with a colored product and stores color information that corresponds to the color of the colored product and that is recognized by a mobile terminal that cooperates with a composite image generation program so that the mobile terminal can capture the color information. Combines with a mobile terminal that cooperates with an image generation program that realizes a function to generate a composite image by performing color conversion based on color information that recognizes the color conversion area set in the target image in cooperation with An information processing apparatus for generating an image, which receives a target image for setting a color conversion area from a mobile terminal, extracts a predetermined color conversion area from the target image, sets the target color conversion area as a target image, and stores the target image in the mobile terminal. An information processing apparatus for transmitting a target image in which a color conversion area to be set is set to a mobile terminal.

8. The target image for which the color conversion area is to be set is received from the mobile terminal, a predetermined color conversion area is extracted from the target image and set as the target image, and the target image in which the color conversion area stored in the mobile terminal is set In cooperation with an information processing device that transmits a color image to a mobile terminal, a color conversion area set in the target image is subjected to color conversion based on the recognized color information to generate a composite image. A data carrier for generating a composite image on a mobile terminal that cooperates with a composite image generation program for realizing a function on a mobile terminal. The data carrier is provided in association with a colored product, and corresponds to the color of the colored product and has a composite image. A data carrier characterized in that color information recognized by a mobile terminal cooperating with a generation program is stored so as to be captured by the mobile terminal.

9. Recognize the color information captured from the data carrier provided in association with the colored product, recognize the color conversion area of the target image in which the stored color conversion area is set, and color-convert the color conversion area. A data carrier for generating a composite image on a portable terminal having a function of generating a composite image by performing color conversion based on information, provided in association with a colored product, and corresponding to the color of the colored product and having a composite image A data carrier characterized by storing color information recognized by a mobile terminal that cooperates with a generation program so that the color information can be captured by the mobile terminal.

10. The data carrier according to claim 9, wherein area identification information of a color conversion area to be color-converted by said color information is stored corresponding to said color information.

1 1. A system for providing a composite image displayed on a mobile terminal, wherein an information processing device extracts a predetermined color conversion area from a target image, sets the extracted color conversion region as a target image, and sets the target image as a target image. The mobile terminal stores a composite image generation program that realizes the function of recognizing the color conversion area and performing the color conversion based on the color information to generate the composite image, and receives the composite image generation program transmission request from the mobile terminal. A composite image generation program extracts a composite image generation program stored in a mobile terminal in response to a transmission request, transmits the program to the mobile terminal, and a data carrier provided in association with the colored product corresponds to the color of the colored product and is composed. A composite image providing system, wherein color information recognized by a mobile terminal cooperating with an image generation program is stored so as to be captured by the mobile terminal.

1 2. A program for generating a composite image to be displayed on a mobile terminal. The program extracts a predetermined color conversion area from a target image, sets the color conversion area in the target image, and sets a target image in a data carrier provided in association with a colored product. A function that recognizes the captured color information, recognizes the color conversion area of the target image in which the stored color conversion area is set, and performs color conversion on the color conversion area based on the color information to generate a composite image. A synthetic image generation program characterized by being realized on a mobile terminal.

13 3. A range of claims wherein a plurality of types of color conversion areas are extracted from the target image, area identification information for identifying the type of the color conversion area is set, and each color conversion area is set in the target image. 12. The composite image generation program according to paragraph 2.

14 4. In cooperation with a data carrier that is provided in association with a colored product and stores color information corresponding to the color of the colored product and recognized by the mobile terminal cooperating with the composite image generation program so that the color information can be captured by the mobile terminal. An information processing apparatus for generating a composite image on a mobile terminal, comprising extracting a predetermined color conversion area from a target image, setting the color conversion area in the target image, and setting a color conversion area set in the target image. Stores a composite image generation program that allows a mobile terminal to realize the function of generating a composite image by performing color conversion based on recognized color information, receives a composite image generation program transmission request from the mobile terminal, and transmits a composite image generation program transmission request. An information processing apparatus characterized in that a composite image generation program stored in a mobile terminal is extracted according to the information and transmitted to the mobile terminal.

15. A system for providing a composite image displayed on a mobile terminal, wherein an information processing device recognizes color information corresponding to color identification information recognized from a plurality of types of color information to be set, Stores a composite image generation program that enables a mobile terminal to perform a function of generating a composite image by performing color conversion based on color information that recognizes a color conversion area set in a target image, and transmits a request to transmit a composite image generation program. A composite image generation program received from the terminal and stored in the mobile terminal in response to the request to transmit the composite image generation program is extracted and transmitted to the mobile terminal, and each corresponds to the color identification information stored in the mobile terminal. A plurality of types of color information are transmitted to the portable terminal, and a data carrier provided in association with the colored product is adapted to correspond to the color information corresponding to the color of the colored product and generate a composite image generation program. Composite image providing system, characterized by containing the color identification information recognized by the mobile terminal to preparative cooperating take-capable mobile device.

16. A program for generating a composite image to be displayed on a mobile terminal, recognizing color identification information taken from a data carrier provided in association with a colored product, and from a plurality of types of set color information. The portable terminal realizes a function of recognizing color information corresponding to the color identification information and performing a color conversion based on the recognized color information in the color conversion area set in the target image to generate a composite image. Composite image generation program.

17. Recognizing the area identification information of the color information corresponding to the color identification information from the area identification information set corresponding to the color information, and recognizing the color conversion area corresponding to the area identification information. 17. The composite image generation program according to claim 16, wherein:

18. Color identification information that is provided in association with the colored product and that corresponds to the color information corresponding to the color of the colored product and that is recognized by the mobile terminal in cooperation with the composite image generation program is stored so that it can be captured by the mobile terminal. An information processing apparatus for generating a composite image on a mobile terminal in cooperation with a data carrier that performs color recognition by recognizing color information corresponding to color identification information recognized from a plurality of types of set color information. In addition, the portable terminal stores a composite image generation program that realizes a function of generating a composite image by performing color conversion based on color information that recognizes a color conversion region set in a target image, and transmits a request to transmit the composite image generation program. The color identification information received from the mobile terminal, stored in the mobile terminal in response to the request to transmit the synthesized image generation program, extracted and transmitted to the mobile terminal, and stored in the mobile terminal. An information processing apparatus characterized by transmitting a plurality of types of color information respectively corresponding to information to a portable terminal.

1 9. Recognize the color identification information taken from the data carrier provided in association with the colored product, and recognize the color information corresponding to the recognized color identification information from the set multiple types of color information. A data carrier for generating a composite image on a mobile terminal having a function of generating a composite image by performing color conversion based on color information that recognizes a color conversion region set in a target image, and is associated with a colored product. Color identification information corresponding to the color information corresponding to the color of the colored product and recognized by the mobile terminal cooperating with the composite image generation program is stored so as to be captured by the mobile terminal. Data carrier.

20. A system for providing a composite image displayed on a mobile terminal, wherein an information processing device performs color conversion based on color information that recognizes a color conversion region set in a target image and converts the composite image. A composite image generation program that stores a composite image generation program that allows a mobile terminal to perform the function of generating a composite image generation program is received from the mobile terminal, and a composite image generation program that is stored in the mobile terminal in response to the composite image generation program transmission request Is extracted and transmitted to the mobile terminal, storing a plurality of types of color information corresponding to each color identification information, receiving the color identification information taken into the mobile terminal from the data carrier from the mobile terminal, The color information corresponding to the color identification information is extracted and transmitted to the mobile terminal, and the data carrier provided in association with the colored product corresponds to the color information corresponding to the color of the colored product and cooperates with the composite image generation program. A composite image providing system wherein color identification information recognized by a mobile terminal is stored so as to be captured by the mobile terminal.

2 1. A program for generating a composite image to be displayed on a mobile terminal. The color identification information stored in a data carrier provided in association with a colored product from the mobile terminal is taken in, and the information is transmitted to an information processing device. In addition to recognizing the color information received from the information processing device based on the transmission, recognizing the color conversion area of the target image in which the stored color conversion area is set, and performing color conversion on the color conversion area based on the color information. A composite image generation program that causes a mobile terminal to realize a function of generating a composite image.

2 2. Based on the transmission of the color identification information to the information processing device, the information processing device recognizes the region identification information stored corresponding to the plurality of types of color information and received from the information processing device, and 23. The composite image generation program according to claim 21, wherein a color conversion area of the area identification information set in the stored target image is recognized based on the recognition.

23. Linked with a data carrier that is provided differently for colored products, stores color identification information that corresponds to the color information corresponding to the color of the colored products, and that is recognized by the information processing device so that it can be captured by a mobile terminal. Then, the mobile terminal cooperates with the synthetic image generation program that realizes the function of generating a synthetic image by performing color conversion based on the color information that recognizes the color conversion area set in the target image. An information processing device for generating color information, storing a plurality of types of color information corresponding to each color identification information, receiving the color identification information taken into the mobile terminal from the data carrier from the mobile terminal, and converting the color identification information into the color identification information. An information processing apparatus for extracting corresponding color information and transmitting the extracted color information to a mobile terminal.

24. The method according to claim 2, wherein the area identification information corresponding to each color identification information is stored, and the area identification information corresponding to the color identification information received from the mobile terminal is extracted and transmitted to the mobile terminal. Item 3. The information processing device according to item 3.

25. Store multiple types of color information corresponding to each color identification information, receive the color identification information taken into the mobile terminal from the data carrier from the mobile terminal, and extract the color information corresponding to the color identification information. Set as target image in cooperation with information processing device to send to mobile terminal A data carrier for generating a composite image on a mobile terminal in cooperation with a composite image generation program that realizes the function of generating a composite image by performing color conversion based on the color information that recognizes the color conversion area A: c, provided in association with a colored product, color identification information that corresponds to the color information corresponding to the color of the colored product and that is recognized by the mobile terminal that cooperates with the synthetic image generation program can be captured by the mobile terminal A data carrier characterized by being stored in

26. A system for providing a composite image displayed on a mobile terminal, wherein an information processing device receives a target image for setting a color conversion area from the mobile terminal, and performs a predetermined color conversion area from the target image. Is extracted and set as the target image, the target image with the color conversion area set is stored, multiple types of color information corresponding to each color identification information are stored, and the color identification captured by the mobile terminal from the data carrier is stored. Information is received from a mobile terminal, color information corresponding to the color identification information is recognized, and a color conversion is performed based on the recognized color conversion area set in the target image to generate a composite image. Transmitting the synthesized image to the mobile terminal, and storing, in the mobile terminal, color identification information of color information corresponding to the color of the colored product in a data carrier provided in association with the colored product. Yes Composite image Provide system.

27. In conjunction with the data carrier, which is provided in association with the colored product and stores the color identification information of the color information corresponding to the color of the colored product so that it can be captured by the mobile terminal, the composite image displayed on the mobile terminal can be displayed. An information processing device for providing a target image in which a color conversion area is set, storing a plurality of types of color information corresponding to each color identification information, and storing the color identification information taken into a portable terminal from a data carrier. Information is received from the mobile terminal, color information corresponding to the color identification information is recognized, and a color conversion area set in the target image is subjected to color conversion based on the recognized color information to generate a composite image. An information processing device for transmitting a composite image to a portable terminal.

28. Receiving a target image for setting the color conversion area from a mobile terminal, extracting a predetermined color conversion area from the target image, setting the target image, and storing the target image with the color conversion area set. 28. The information processing apparatus according to claim 27, wherein:

2 9. Store the area identification information corresponding to each color identification information, recognize the area identification information corresponding to the received color identification information, recognize the color conversion area corresponding to the area identification information, 29. The information processing apparatus according to claim 27, wherein said color conversion area is color-converted based on color information.

30. The target image for which the color conversion area is to be set is received from the mobile terminal, a predetermined color conversion area is extracted from the target image and set as the target image, and the target image for which the color conversion area is set is stored. Stores multiple types of color information corresponding to the identification information, receives the color identification information taken into the mobile terminal from the data carrier from the mobile terminal, recognizes the color information corresponding to the color identification information, and converts the color information into the target image. A composite image is generated on the mobile terminal in cooperation with an information processing device that generates a composite image by performing color conversion based on the recognized color information in the set color conversion area and transmits the generated composite image to the mobile terminal. A data carrier for providing an image, wherein the data carrier is provided in association with a colored product and stores color identification information of color information corresponding to the color of the colored product so that the color identification information can be captured by a portable terminal. A.

31. A system for providing a composite image to be displayed on a mobile terminal, wherein an information processing device receives a target image for setting a color conversion area from the mobile terminal, and performs a predetermined color conversion area from the target image. Is extracted and set as the target image, the target image in which the color conversion area is set is stored, the color information captured by the mobile terminal from the data carrier is received from the mobile terminal, and the color conversion area set in the target image is received. Color conversion based on the color information to generate a composite image, transmit the generated composite image to the mobile terminal, and use a data carrier provided in association with the colored product to convert the color information corresponding to the color of the colored product into the mobile terminal. A composite image providing system characterized in that it is stored so as to be able to be imported.

3 2. In conjunction with a data carrier that is provided in association with a colored product and stores color information corresponding to the color of the colored product so that it can be captured at the mobile terminal, it provides a composite image displayed on the mobile terminal. An information processing device that stores a target image in which a color conversion area is set, receives color information taken into the mobile terminal from the data carrier from the mobile terminal, and converts the color conversion area set in the target image into color information. An information processing apparatus characterized by generating a composite image by performing color conversion based on the color information and transmitting the generated composite image to a portable terminal.

3 3. Receive the target image for setting the color conversion area from the mobile terminal, extract a predetermined color conversion area from the target image, set it as the target image, and store the target image with the color conversion area set. ::

33. The information processing apparatus according to claim 32, wherein the information is stored.

34. A feature is that area identification information taken into the mobile terminal from the data carrier is received from the mobile terminal, a color conversion area corresponding to the area identification information is recognized, and the color conversion area is color-converted based on the color information. An information processing apparatus according to claim 32 or 33, wherein

3 5. Receive the target image for setting the color conversion area from the mobile terminal, extract a predetermined color conversion area from the target image and set it as the target image, store the target image with the color conversion area set, and store the data carrier. Receives the color information captured by the mobile terminal from the mobile terminal, generates a composite image by color-converting the color conversion area set in the target image based on the color information, and sends the generated composite image to the mobile terminal. A data carrier for providing a composite image to be displayed on a mobile terminal in cooperation with an information processing device for transmission. The data carrier is provided in association with a colored product, and stores color information corresponding to the color of the colored product on a mobile terminal. A data carrier characterized in that it is stored so that it can be imported.

36. The data carrier according to claim 35, wherein area identification information of a color conversion area to be color-converted by said color information is stored corresponding to said color information.

3 7. Recognize the access destination information of the site that provides the related information of the colored product, which is acquired from the data carrier provided in association with the colored product, and stores the access destination information in the color conversion area for performing the color conversion. Claims 5, 6, 12, 12, 13, 16 or 17 characterized by realizing the function of enabling the designated input on the mobile terminal Synthetic image generation program.

38. Recognize the access destination information corresponding to the color identification information from the access destination information of the site that provides the related information of the colored product, which is set and stored in the mobile terminal, and access the color conversion area for color conversion. 18. The composite image generation program according to claim 16, wherein a function of setting information so that it can be designated and input is realized on a portable terminal.

39. The color conversion based on the recognition of the access destination information of the site that provides the related information of the colored product, which is stored in the information processing device corresponding to the color identification information, extracted and transmitted based on the color identification information, and 21. The combination according to claim 21, wherein a function of setting the access destination information so that it can be designated and input in the color conversion area to be performed is realized in the portable terminal. Image generation program.

40. The information processing device recognizes the access destination information of the site that provides the related information of the colored goods stored in correspondence with the color identification information, or is taken into the portable terminal from the data carrier and received from the portable terminal. 27. The image processing apparatus according to claim 26, wherein the access destination information is recognized, and the access destination information is set in the color conversion area for color conversion so that the access destination information can be designated and input to generate a composite image. The composite image providing system according to the item.

41. Claims 1 to 4 and 11 wherein the number of data carriers associated with the colored goods is provided in a smaller number than the plurality of colored goods displayed at the store. Item 15. The composite image providing system according to any one of Items 15, 20, 26, 31, and 40.

42. The information processing apparatus or the portable terminal stores a composite image in a state where the composite image can be transmitted to another person. , Item 20, Item 26, Item 31, Item 40, Item 41.

4 3. As the color information corresponding to the colored product, the color information corresponding to the color of the colored product and the color information corresponding to the color of another colored product related to the colored product are set. Claims Claims 1 to 4, Clause 11, Clause 15, Clause 15, Clause 20, Clause 26, Clause 31, Clause 40, Clause 41, 42. The composite image providing system according to any one of 2.

44. The transmissivity of the color information used in the weighting synthesis of the color conversion is stored in correspondence with the color information. Item 5. The composite image providing system according to any one of Items 5, 20, 26, 31, 31, 40, 41, 42, and 43.

45. The composite image providing system according to claim 44, wherein a plurality of transmittances corresponding to one color information are set so as to be selectable.