JP2005099956A - Video information processor, video information processing system, video information outputting method and its program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide the video information of relevant commodity which an object does not actually wear by using video information when the object actually wears the commodity. <P>SOLUTION: This video information processor is provided with a digital camera 11 which acquires video information by photographing an object wearing predetermined commodity, a commodity information database (DB) 22 in which the information of the commodity which the object actually wears and relevant commodity is stored. The commodity information stored in the commodity information database (DB) 22 is read, and the video part of the commodity in the video information acquired by a digital camera 11 is replaced with the information of the relevant commodity, and converted video information is generated by a video information processing part 45. Then, the converted video information generated by the video information processing part 45 is printed on a recording medium by a printer 13. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a video information processing system that provides video information, and more particularly to a video information processing system that handles video information related to products worn by a subject such as a customer.

  In recent years, with the development of information technology such as computer devices and networks, the clothing industry such as apparel manufacturers, luxury boutiques, department stores, clothing stores, etc. has been required to innovate operations by incorporating such technologies. In particular, as electronic commerce through the network is activated, sales of clothing items through the network are also activated.

  Furthermore, in recent years, digital cameras have been improved in image quality, and high image quality has been obtained even when video information is output in a large format such as A4 size. In addition, for example, printers that employ an electrophotographic method have been rapidly improved in image quality, and high-quality photographic images close to silver-lead photographs can be output simply and quickly. With the development of such digital video technology, for example, in the clothing industry and the like, there is an increasing demand to utilize these digital video technologies for strengthening services and promoting sales to customers.

  In particular, in the clothing industry, as a prior art described in a gazette using network technology or digital video technology, for example, in a net sales system that sells fashion products via a network, the user's personal information, body size, and body image are included. There is a technique in which member information and product images are combined, a wear image is created and registered in a database, the registered wear image is displayed on a user terminal together with product information, and an order is received (see, for example, Patent Document 1) .). In addition, for example, information on clothing currently owned by the user or personal information of the user himself / herself is obtained via the network, and coordinate information on clothing is created using information on clothing owned by apparel manufacturers and dealers. A technique for creating a catalog tailored to the user is disclosed (for example, see Patent Document 2). In addition, for example, by photographing a clothing appearance in a fitting room and printing out the captured image together with code information on the clothing that was tried on, visual confirmation of the image of the clothing appearance and product identification at the time of purchase can be performed. There exists a technique for facilitating (see, for example, Patent Document 3).

JP 2002-373266 A (page 7-9, FIG. 1) JP 2002-169578 A (page 3-4, FIG. 1) JP 2001-157201 A (page 3-4, FIGS. 3 and 5)

  However, since the technique described in Patent Document 1 is merely a combination of a product image and a user's image in a simulation, there is a great sense of incongruity with actual wearing, and an accurate image is provided. I can't. Further, although it is determined whether or not the dimensions are appropriate based on the user's body size information, it is difficult to adapt all of the user's body sizes, and the actual image and the provided image are greatly different. Furthermore, the simulation takes a very long time. Moreover, in the said patent document 2, although the clothing information customized for every user can be provided, it is difficult to provide the goods matched with a user's face etc.

  Furthermore, although the said patent document 3 is very excellent at the point which can obtain merchandise information with a user's try-on image | video, the try-on image provided is limited only to the image itself which tried on the product to the last. Even if a product is tried on, for example, if the size is nicely adapted to the customer, it is difficult to try on all of the differently colored products. In particular, even if the manufacturer that provides the product has a product with different colors, it is often not available at the store where the customer tried on, and these products with different colors are physically tried on. Is difficult. For example, if it is possible to provide a video image similar to that of a product that has not been tried on by a customer, such as a different color, the customer's willingness to purchase can be increased.

The present invention has been made to solve the technical problems as described above, and the object of the present invention is to actually use the video information when the subject actually wears the product. Is to provide video information of related products that are not worn.
Another object of the present invention is to further increase the customer's willingness to purchase by providing converted video information obtained by adding a predetermined conversion to video information when the customer wears a product.

  For such a purpose, a video information processing apparatus to which the present invention is applied includes a photographing means for photographing a subject wearing a predetermined product and obtaining video information, a product worn by the subject, and the product. Product information storage means for storing product information of related products (for example, of the same type), read the product information stored in the product information storage means, in the video information obtained by the imaging means The converted video information is generated by the converted video information generating means by replacing the video portion of the product with the information of the related product. The converted video information generated by the converted video information generating means is printed on a recording medium by the printing means.

  Here, shooting condition acquisition means for acquiring shooting conditions when the subject is shot by the shooting means, video information storage means for storing synthesized video information to be synthesized, and predetermined synthesized video from the video information storage means Further comprising processing means for reading out information and performing predetermined processing on the video information photographed by the photographing means based on the state of the composite video information and the photographing conditions obtained by the photographing condition obtaining means, and generating converted video information The means may be characterized in that the converted video information is generated by synthesizing the read out synthesized video information with the video information subjected to the predetermined processing by the processing means. Furthermore, if the printing means is characterized in that the order code information for specifying the related product including the information in the converted video information is printed at the same time as the converted video information, the order processing of the related product can be performed smoothly. Are better.

  Further, the video information processing system to which the present invention is applied includes video information acquisition means capable of acquiring video information when a subject wears a product, and color information for acquiring color information of the product worn An acquisition means, an area recognition means for recognizing a product area in the video information acquired by the video information acquisition means, using the color information acquired by the color information acquisition means, and a worn product The related product color information acquisition means for acquiring the color information of the related products having different colors, and the converted video information by replacing the color information of the region in the video information with the color information of the related products acquired by the related product color information acquisition means Generating means for generating code information generating means for generating code information for specifying related products included in the converted video information generated by the generating means, and a change generated by the generating means. And a printing means for printing, including the code information generated by the video information and the code information generation unit. Here, the area recognizing means can recognize a color information area within a certain range from the color information acquired by the color information acquiring means as a product area. Further, the color information acquisition unit and the related product color information acquisition unit may be characterized by acquiring color information from a product information database in which product information is stored.

  From another point of view, the video information processing system provided with the present invention is a video information acquisition means capable of acquiring video information including a subject wearing a product, photographed under a predetermined lighting condition, A background image removing unit that removes a background image excluding a subject in information, an illumination information acquiring unit that acquires illumination information at the time of photographing under the illumination conditions, and a video information database that stores various types of video information. The background image is obtained from the combined background image acquisition unit that acquires the combined background image, the illumination information acquired by the illumination information acquisition unit, and the illumination condition assumed in the combined background image acquired by the combined background image acquisition unit. Filter processing means for performing a filtering process on the video information after the background image is removed by the removing means, and the filtering process by the filtering process means Including an image information, and generating means for generating a converted image information to synthesized a background image obtained by synthesizing the background image acquisition unit.

  Here, the color information acquisition means for acquiring the color information of the worn product and the color information acquired by the color information acquisition means, the product from the video information acquired by the video information acquisition means A region recognizing means for recognizing the region, and related product color information acquiring means for acquiring color information of related products having a color different from that of the worn product, wherein the generating means If the conversion information is generated by replacing the color information with the color information of the related product acquired by the related product color information acquisition means, for example, synthesis of the background image and conversion to the color information of the related product Are preferable in that they can be applied simultaneously. Further, the code information generating means for generating code information for specifying the product and / or related products, the converted video information generated by the generating means, and the code information generated by the code information generating means are printed. Printing means.

  In these systems, the functions are distributed via a network, in addition to cases where the casing is formed as a single device, for example, when most of the functions are integrated into a computer device, or the like. It does not matter.

  On the other hand, when grasping the present invention from the category of the method, the video information output method to which the present invention is applied includes the step of acquiring video information when the subject wears the product, and the product information storage means from the product information storage means. Obtaining color information; using the obtained color information; recognizing a product region in the video information; obtaining color information of a related product having a color different from the product from the product information storage unit; A step of generating the converted video information by replacing the color information of the product area in the video information with the color information of the related product, and a step of printing out the generated converted video information.

  Here, the step of recognizing the region can be characterized in that a region of color information within a certain range from the acquired color information is recognized as a product region. Further, the step of printing out is characterized by printing out including code information for specifying the related product. Further, the printing output step is characterized in that the converted video information is printed out together with the video information, and is printed out including code information for specifying a product included in the video information.

  Furthermore, a step of acquiring photographing conditions when the video information of the subject is photographed, a step of reading predetermined composite video information from the video information storage means storing the composite video information to be synthesized, and the read composition A step of performing a predetermined process on the acquired video information based on the state of the video information and the acquired shooting condition, and synthesizing the read composite video information with the video information subjected to the predetermined process If it is configured to include the step of generating the converted video information, it is possible to further enhance the try-on image of the product.

  On the other hand, the present invention can be made to function as a program that realizes a predetermined function in a computer device used in a server, a client, a store, or the like that constitutes a system via a network. That is, a program to which the present invention is applied is acquired by a computer with a function of acquiring video information when a subject wears a product, and a function of acquiring color information of the product from the product information storage unit. The function of recognizing the product area in the video information using the color information, the function of acquiring the color information of the related product having a different color from the product from the product information storage means, and the area in the video information For generating converted video information by replacing color information of related products with color information of related products, a function for acquiring shooting conditions when video information of a subject is shot, and a video in which synthesized video information to be synthesized is stored Based on the function of reading the predetermined composite video information from the information storage means, the state of the read composite video information and the acquired shooting conditions, the acquired video information is added to the predetermined information such as filter processing, for example. A function of performing processing, this predetermined processing video information subjected to realize the function of generating a synthesized to convert the video information combined image information read out.

  When these programs are provided to the computer, for example, in a state where the programs are installed in a computer device, the programs to be executed by the computer are provided on a storage medium stored in a computer-readable manner. The form to do is conceivable. As this storage medium, for example, a DVD or a CD-ROM medium or the like is applicable, and the program is read by a DVD or CD-ROM reader or the like, the program is stored in an HDD or a flash ROM, and executed by the CPU. . These programs may be provided from a program transmission device via a network, for example.

  According to the present invention, it is possible to provide video information of related products that are not actually worn by using video information when the subject actually wears the product.

Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.
[Embodiment 1]
FIG. 1 is a diagram showing an overall configuration of a video information processing system to which the present embodiment is applied. FIG. 1 shows an example configured as a video information processing apparatus placed in, for example, a clothing store. The video information processing system (video information processing apparatus) shown in FIG. 1 is a photographing unit that is arranged in a fitting room, for example, and photographs a customer who has tried on a product (a subject wearing the product) and acquires a digital video. As a digital camera 11, a scanner 12 for reading code information included in a customer-specific fitting catalog provided to a customer, and a printing means for printing out a customer-specific fitting catalog provided to a customer on a recording medium such as paper, for example, laser The printer 13 is a printer. Further, as various storage means, for example, various databases for storing data using an auxiliary storage device such as an external HDD (hard disk drive) or an external MO (Magneto Optical Disk) are provided. The database includes a customer information database (customer information DB) 21 in which various information about customers is stored, a product information database (product information DB) 22 in which information on various products to be sold is stored, and a try-on catalog. A video information database (video information DB) 23 in which various video information used for the video is stored. Further, an order database (DB) 24 in which various information used for placing an order based on the order instruction is stored. Furthermore, a PC (personal computer) 30 is provided as a computer device for processing such as creation of a fitting catalogue and recognition of code information. In the present embodiment, the product information database 22 includes various types of information for forming images of related products such as different color products. The subject may be a human or a pet such as a dog or cat. The same can be applied to an image of a pet wearing a product.

  The customer information database 21 includes customer address, name, age, occupation, gender, various sizes (height, weight, bust, waist, hip size, etc.), customer preferences (preferences) for each customer. (Color, pattern, design, shape), hobbies, etc., for example, various data such as payment methods are stored as table information, for example. These customer information is authenticated when the system logs in. When the registration is connected to a network as shown in Embodiment 2 (described later), the registration is performed via the network. When placed in a store or the like as shown in FIG. 1, for example, store input is performed via the PC 30 or the like. This registered data is selected according to its use.

The merchandise information database 22 stores, for example, provision information related to the supplied apparel from an apparel manufacturer that manufactures and provides the apparel. The stored data (product information) includes various types of information of products that are associated with the product code and have different sizes, colors, materials, prices, and the like. Further, before the product code is generated, product information is stored based on predetermined identification information managed by a supply source such as each apparel manufacturer. The product information database 22 stores the product information of the related products in a state where the relevance of the related products can be recognized and can be identified by, for example, related information bits. The product information includes, for example, product color information and pattern information represented by Lab (CIE L ^* a ^* b ^* ). For example, when a specific product is designated, the PC 30 can specify a related product with reference to, for example, related information bits provided in the product information database 22. The product information database 22 is configured to be able to provide, for example, color information or pattern information of the related product after the related information is specified.

  In the video information database 23, for example, various image images to be pasted on a catalog when a customer-specific catalog is issued are stored. For example, various kinds of information such as a photograph pasted on a cover, a product image of a general catalog to be attached, a background image, and an illustration decorating the catalog are included. Examples of the background image include a reception hall, a lounge bar, and a living room if they are indoors, and the sea, mountains, and towns if they are outdoors, and these video information is stored in the video information database 23. This background image is stored in the video information database 23 in such a state that the brightness of the background image can be recognized by the PC 30, for example.

  The order database 24 stores customer IDs, product codes, product colors, patterns, sizes, and the like in association with the order numbers. In the catalog issuing store, for example, the order database 24 is accessed using the PC 30, and a conversion table for managing product codes, colors, sizes, etc. from the personal ID, the fitting catalog number, and the product number described in each sheet is managed. . In this order database 24, the relationship between the order code and the product is clarified. By using the information stored in the order database 24, for example, a related product related to the tried-on product is uniquely specified. It becomes possible to do.

The PC 30 is configured to be able to execute a fitting catalog creation process 31 and a code information recognition process 32.
The try-on catalog creation processing 31 executes processing for generating a customer-specific catalog output to the printer 13. Further, as a function thereof, a try-on information processing unit 41 that processes try-on information acquired from the digital camera 11 or the like, for example, a product information processing unit 42 that acquires and processes product information of a try-on product from the product information database 22, And a customer information processing unit 43 that acquires information about the customer photographed by the digital camera 11 from the customer information database 21. Also obtained from the digital camera 11 and the code information generating unit 44 that generates code information formed in the customer-specific catalog from the processing results of the try-on information processing unit 41, the product information processing unit 42, the customer information processing unit 43, and the like. A layout processing unit 46 that performs layout processing on the catalog for the code information generated by the video information processing unit 45 and the code information generation unit 44 that processes the video information and the video information processed by the video information processing unit 45. I have.

  In the code information recognition process 32, a recognition process based on, for example, data read from the scanner 12 is executed on the code information included in the customer-specific fitting catalog. Further, as functions thereof, an order code recognition unit 33 that recognizes an order code, a product code recognition unit 34 that recognizes a product code, and a customer code recognition unit 35 that recognizes a customer code are provided. Further, an order processing unit 36 that performs order processing, a product information management unit 37 that manages product information, and a customer information management unit 38 that manages customer information are provided. The customer information recognized by the customer code recognition unit 35 is managed by the customer information management unit 38. For example, when there is a new purchase request, the information is stored in the customer information database 21. The customer information management unit 38 has a function of storing, in the customer information database 21, information related to a try-on result by a customer and an actual order. In addition, when the product code recognition unit 34 recognizes, for example, product information desired to be purchased, the product information management unit 37 identifies the product, and various information on the product is stored in the product information database 22. . Further, the purchased product information may be provided by the product information management unit 37 to a product supplier or the like via a network or the like.

Next, the customer-specific fitting catalog generated by the fitting catalog creation process 31 will be described.
2 (a), 2 (b), 3 and 4 are diagrams showing examples of try-on catalogs generated in the present embodiment. FIG. 2A shows a cover 301, which is a top sheet of a customer-specific fitting catalog. FIG. 2B shows an example of a basic page (sheet) 302, in which a try-on image 320 is printed as it is as a video that the customer tried on. FIG. 3 shows an example in which a conversion try-on image 321 to a related product consisting of a color difference, a pattern difference, or the like of a tried-on product is printed as the option page 303. FIG. 4 shows an example of a converted try-on image 322 obtained by changing the scene (background image in the example shown in the figure) as an option page 304 and changing the image. In the fitting catalogue, a booklet is formed by a plurality of sheets as shown in FIGS. 2A and 2B and FIGS. As a general rule, this try-on catalog has the same catalog number and customer code (described later). Product information and the like may be different for each page in the booklet.

  In addition to the bibliographic item 310, a customer code 311 is described on the cover 301 shown in FIG. The customer code 311 can include a try-on catalog number and the like in addition to the customer's personal ID. A basic page 302 shown in FIG. 2B describes a bibliographic item 310, a customer code 311, a product code 312, and an order code 313 along with a try-on image 320 taken by the digital camera 11. The product code 312 includes a product number that can be recognized by the customer as main information. The order code 313 includes the order number of a product that can be recognized by the customer as main information, and can also include information (date and time, store name) at the time of fitting. Moreover, even if it is the same goods, when a color, a pattern, etc. differ, it is used also in order to specify those contents. Furthermore, depending on the case, it is also possible to include the personal ID of the store clerk who handled the customer service for the customer who tried on. As described above, each page such as the basic page 302 shown in FIG. 2B is attached with the try-on image 320 and the product order number included in the order code 313, and functions as a one-page product sheet. .

  The example of the option page 303 shown in FIG. 3 shows an example in which image processing such as product color conversion is performed from the video shown in FIG. 2B where the customer actually tried on the product. What is converted is the color and pattern of the related products (related products for the tried-on products) stored in the product information database 22, and in the case of complicated patterns, there are parts that are difficult to process, but only the colors If it is a difference or a simple pattern such as a line or one point, image conversion can be performed relatively easily. In FIG. 3, four types of conversion try-on images 321 are shown. Each conversion try-on image 321 corresponds to a product stored in the product information database 22, and the type or the like of the color or pattern of the related product is determined by the order database 24 specified by the order code 313. Determined uniquely. In addition, bibliographic items 310 such as product descriptions are added to each conversion fitting image 321 so that the customer can easily recognize the contents.

  The example of the option page 304 shown in FIG. 4 shows an example in which a converted try-on image 322 is formed by performing background processing from a video in which a customer actually tried on a product. In the example of the conversion try-on image 322 shown in FIG. 4, image processing such as product color conversion is also performed. Here, for example, indoor images such as a lounge bar, mountains and lakes, and outdoor scenes such as streets are selected. Bibliographic items 310 such as product descriptions are added to each converted fitting image 322 so that the customer can easily recognize the contents, and the converted try-on image 322 is visualized by the order database 24 specified by the order code 313. A product can be uniquely determined. Thus, by synthesizing the background image assuming the customer's usage scene, the customer can easily grasp the usage image of the tried-on product. For example, for a customer who tried on a swimsuit, the video at the seaside or poolside is synthesized.

  In addition, an order code 313 is added to the sheets as shown in FIGS. 2B, 3 and 4 together with a try-on image, thereby completing a one-page order sheet. For example, in a store, by scanning these codes using a scanner 12 or a code reading device (code reader) such as a barcode reader (not shown), it is possible to uniquely select a product whose color or pattern is specified. . As shown in FIGS. 3 and 4, when a plurality of order codes 313 are provided on one page, the read code information is displayed on, for example, a display (described later) when read, and the store operator ( (Clerk) may be selected.

  Each code information of the customer code 311, the product code 312, and the order code 313 can be grasped as a simple function that only specifies the information stored in the database. For example, the customer code 311 specifies customer information stored in the customer information database 21, the product code 312 specifies product information stored in the product information database 22, and the order code 313 is stored in the order database 24. The order information may be specified. Of course, when there is a large amount of information included in each piece of code information, customer information, product information, and order information that can be completed with each piece of code information may be provided.

  As the code information, bar code information can be used as information that can be recognized by the apparatus. In addition to this bar code, a QR code (Quick Response) that is a two-dimensional code can also be used. As described above, any format can be used to express information. However, it is possible to improve security by using a code that cannot be seen at first glance. Also, numerical values can be output as information that can be recognized by the customer. Furthermore, a general catalog (not shown) can be attached when generating a customer-specific fitting catalog using the sheets shown in FIGS. 2 (a), 2 (b), 3 and 4 as a booklet. This general catalog is preferably composed of a product image of a general product, a product description, and a product code 312 in which the customer is not shown. The general catalog is generated by the video information processing unit 45 based on information read from the product information database 22 and the video information database 23, for example. Further, in FIGS. 2 (a), 2 (b) and FIGS. 3 and 4, bar code information having a large number of digits is used as code information. However, in order to facilitate the convenience of telephone orders and net orders by customers. It is desirable to use simple code information of about 3 to 4 digits.

Next, issuance of a customer-specific fitting catalog executed mainly in the fitting catalog creation process 31 of the PC 30 will be described.
FIG. 5 is a flowchart showing processing for issuing a try-on catalog. In the customer information processing unit 43 shown in FIG. 1, first, customer information is acquired from the customer information database 21 (step 101). For example, when a customer is specified by inputting a telephone number or name (in the order of Aiueo), reading an ID card, or the like, when customer information is stored in the customer information database 21, the customer information processing unit 43 performs the above-described specification. Customer information can be acquired. In addition, when the customer information database 21 does not have customer information for taking a try-on video, the customer information processing unit 43 displays on the display (described later) on the PC 30 that there is no customer information, and an operator (for example, a clerk) ) Prompts for customer information. When customer information is input, the customer information processing unit 43 registers this customer information in the customer information database 21.

Next, the image of the customer trying on the product is photographed by the digital camera 11, and the photographed fitting image is input into the PC 30 (step 102). The try-on information processing unit 41 inputs product information using a barcode or IC tag attached to a product tag or the like, and product color information including, for example, Lab (CIE L ^* a ^* b ^* ) is acquired. (Step 103). In addition, the try-on information processing unit 41 acquires illumination information when a try-on image is taken (step 104). Here, it is determined whether or not an option is specified (step 105). If no option is specified, as a normal process, first, the cover 301 shown in FIG. 2A is generated (step 106), and the layout processing unit 46 performs the catalog image layout process (step 107). ). For example, a try-on unique number is given by the merchandise information processing unit 42 (step 108), and an order code 313 is generated by the code information generation unit 44 (step 109). Thereafter, a try-on catalog is printed by the printer 13 (step 110), and the process ends.

  On the other hand, if there is an option designation in step 105, after the cover 301 shown in FIG. 2A is generated (step 111), for example, the illumination information acquired in step 104 and the step 103 Based on the product color information acquired in this way, the video information processing unit 45 executes product image conversion processing such as product color conversion (step 112). Further, the video information processing unit 45 performs background processing of the try-on image using the video information stored in the video information database 23, and stores the product, customer, and background of the product image converted in step 112. Synthesis is performed (step 113). Thereafter, the layout processing unit 46 performs a catalog image layout process (step 114). For example, a try-on unique number is given by the product information processing unit 42 (step 115), and an order code 313 is generated by the code information generation unit 44 (step 116). Then, a try-on catalog is printed by the printer 13 (step 117), and the process ends. The order code 313 generated by the code information generation unit 44 is registered in the order database 24 and used when processing orders from customers.

Next, the product image conversion process shown in step 112 will be described.
FIGS. 6A and 6B are diagrams for explaining processing at the time of product color conversion in the product image conversion processing. FIG. 6A shows a flow of product color conversion processing executed by the video information processing unit 45, and FIG. 6B shows an example of changing from red clothes to blue clothes, a ^* b ^*. This is indicated by the coordinate system (a, b). The horizontal axis is a (a ^* value), and the vertical axis is b (b ^* value). As shown in FIG. 6A, in the product color conversion process, product color information (L ^* a ^* b ^* ) is first input from the product information stored in the product information database 22 (step 121). Next, for example, L ^* a ^* b ^* conversion is performed on the fitting image data acquired in the RGB color system (step 122). Next, an area in which the ratio of a ^* b ^* is in a certain range is recognized as a product from the L ^* a ^* b ^* converted fitting image data (step 123). In the graph shown in FIG. 6B, for example, an area within a certain range indicated by a red broken line is recognized as a product.

Then, ^a * ^{b *} values of the product portion in the fitting image data, the ^a * ^{b *} values of the color difference product, assigned to maintain the ratio (step 124). That is, as shown in FIG. 6B, the a ^* b ^* value of the try-on product is referred to by referring to the color information of the product data of the try-on product and the product data of the different-color product stored in the product information database 22. (a1, b1) is converted into a ^* b ^* values (a2, b2) of different color products. For example, the ratio of the a ^* b ^* value (a1, b1) of the product data and the a ^* b ^* information (aS, bS) of the product at the time of fitting image shooting is obtained, and the a ^* b ^* value (a2 , b2). Here, the conversion is performed in proportion to the distance from each origin. Next, L ^* is distributed according to the ratio before and after the color change (step 125). This distribution of L ^* is the L ^* value of the product data stored in the product information database 22 (L1), to determine the specific items from L ^* information at the time of fitting the image capturing (LS), different color product L ^* Apply the ratio to the value (L2). As described above, the product color conversion process is executed.

Next, background processing and composition of a try-on image shown in step 113 will be described.
FIGS. 7A and 7B are diagrams for explaining background processing and composition processing of a try-on image. FIG. 7A shows the flow of background addition processing executed by the video information processing unit 45, and FIG. 7B shows two processing examples for synthesizing the fitting image and the background image. First, in the video information processing unit 45, as shown in FIG. 7B, the background is removed from the fitting image acquired from the digital camera 11 (step 131). Further, the fitting information processing unit 41 obtains the lighting conditions at the time of photographing based on, for example, photographing conditions performed by the digital camera 11, information acquired in advance by the fitting information processing unit 41, and the like. (Step 132). Illumination conditions to be grasped include, for example, a fluorescent lamp, an incandescent lamp, sunlight, and the like, and illuminance and the like are also grasped. It should be noted that it is preferable that the fitting room or the photographing background is set to a fixed environment in advance for the fitting image background processing. For example, if the background is fixed to a white or gray background, the background processing becomes easy.

  Here, in the video information processing unit 45, background information to be added is acquired from the video information database 23 (step 133). Note that this acquisition may be performed by, for example, converting the background information into thumbnails, displaying a list on a display or the like, and recognizing an arbitrary selection from the list. Further, for example, the video information processing unit 45 may be configured to select background information predetermined for each product. For example, it is also effective to predetermine the usage situation in which the product is imaged for each product, such as a mountain landscape for outdoor products, a seaside scene for swimwear, and a party venue for formal products.

Then, in the video information processing unit 45, color filter processing according to the brightness of the background image and the illumination condition assumed in the background image is applied to the fitting image (step 134). In FIG. 7B, two examples of background images are “lounge bar etc.” and “outdoors”. For example, in the case of a background such as “lounge bar”, a case where the lighting is dark and yellowish is considered. Therefore, a filter process corresponding to the yellowish illumination condition is applied to the fitting image. In addition, in the case of “outdoors”, for example, a filtering process that makes the image brighter is applied. The fitting image thus filtered and the background image are synthesized (step 135), and a converted fitting image 322 to be pasted on the fitting catalog is generated.
Note that, when the fitting image and the background image are combined, the product color conversion as shown in FIG. 6 can be performed at the same time. By performing both the processes shown in FIGS. 6 and 7, a conversion fitting image 322 as shown in FIG. 4 can be obtained.

Next, a process for recognizing code information from the fitting catalog, which is mainly executed in the code information recognition process 32 of the PC 30, will be described.
FIG. 8 is a flowchart showing a process for recognizing code information from the fitting catalog. The PC 30 reads the fitting catalog using the scanner 12, for example (step 201). Next, the product code recognition unit 34 recognizes the code (step 202). When the product code 312 is recognized (step 203), product information identified by the product code 312 is acquired from the product information database 22 (step 204).
When the order code 313 is recognized by the order code recognition unit 33 (step 205), order information identified by the order code 313 is acquired from the order database 24 (step 206). Based on the product information and the order information acquired in this way, the product is specified (step 207). More specifically, for example, when one of the order codes 313 provided corresponding to the conversion fitting images 321 and 322 as shown in FIGS. The recognizing unit 33 reads the order information from the ordering database 24 using the recognized order code 313, and uses the product information stored in the product information database 22 to have a specific color, pattern, size, or the like. Identify the product.
On the other hand, when the customer code 311 is recognized by the customer code recognition unit 35 (step 208), customer information identified by the customer code 311 is acquired from the customer information database 21 (step 209).

  As described above, when product order processing is performed, the product information management unit 37 stores the product information such as the sales record of the product and the specific product type (color, size, etc.) in the product information database 22. The product information is managed on the basis of the stored customer information (step 210). In addition, the customer information management unit 38 grasps the relationship between the products actually purchased after being tried on and the customers, and the reaction status with respect to the provision of the converted fitting images 321 and 322, and for example, a customer information database distinguished by a customer ID or the like. In FIG. 21, predetermined customer information is managed, such as storing a specific customer trend (step 211). This completes the code information recognition process. The customer information stored in the customer information database 21 includes, in addition to general customer attribute information and customer product preferences, for example, a time lag between the actual fitting date / time and the order date / time, the number of fittings, and the like. In addition to the relationship with the purchase record, the relationship between the shooting method and the purchase record, the relationship between the method for providing the fitting video and the purchase record, etc., the reaction to the converted fitting image 321 and 322 is also managed for each customer.

  As described above, in this embodiment, in addition to the try-on image 320 of the product, the conversion try-on images 321 and 322 for making it appear as if the related product is tried on are generated, and a try-on catalog for each customer is provided. It was configured as follows. “The customer tries on (wears)” means that the customer is very interested in the product that is tried on. In particular, when the customer agrees to leave the try-on result in a video, it is expected that the satisfaction with the try-on product is quite high. Therefore, it can be said that providing a try-on catalog including such a try-on image 320 is useful for sales promotion. In addition, conversion try-on images with different colors and simple pattern differences are added to the try-on catalog for such relatively high-satisfied products. In other words, the same type of product (related product) as the tried-on product is provided even if it is not actually tried on. As a result, the sales promotion effect can be further enhanced. In addition, when there is an order for the products of the conversion fitting images 321 and 322, the customer information management unit 38 can grasp the customer's preference for clothing products and the like, It will be effective for formulation.

[Embodiment 2]
The first embodiment has been described based on a video information processing system placed in a sales store or the like as shown in FIG. In the present embodiment, a video information processing system via a network such as the Internet will be described.
In addition, about the function similar to Embodiment 1, the same code | symbol is used and the detailed description is abbreviate | omitted here.

  FIG. 9 is a diagram showing the overall configuration of the video information processing system via the network 99. In the example shown in FIG. 9, the functions provided in the store or the like shown in FIG. 1 are the management server 60, the store device 70 that is a terminal arranged in a sales store or the like that has photographed a try-on video, and the terminal of the customer who tried on It is characterized in that it is partly distributed to the user devices 80 and connected via the network 99. The network 99 is connected to a product provider company server 90 such as an apparel manufacturer that provides products. The management server 60, the store device 70, the user device 80, and the product provider company server 90 can use a computer device such as a PC. The network 99 may be a public wide area network such as the Internet or a local network. In addition, the system of the present embodiment can be constructed in a closed form such as an intranet within a company.

  In the example illustrated in FIG. 9, the management server 60 includes, for example, a transmission / reception unit 61 that performs transmission / reception via the network 99 with the store device 70 and the product providing company server 90, a management unit 62 that manages product information, customer information, and the like. 1 includes a fitting catalog creation process 63 having the same function as the fitting catalog creation process 31 shown in FIG. Further, the management server 60 includes a customer information database 21, a product information database 22, a video information database 23, and an order database 24 as various databases similar to those shown in FIG. Note that these databases may not be directly connected to the management server 60, and may be provided in another database server via the network 99, for example. Each database may be distributed to a plurality of servers.

On the other hand, for example, the store apparatus 70 inputs / receives a try-on video (a try-on image 320) of a customer obtained from the digital camera 11 and the transmission / reception unit 71 that performs transmission / reception with the management server 60 and the user device 80 via the network 99. An information input unit 72, a customer information input unit 73 for inputting customer information, and a code recognition unit 74 for recognizing various codes read from the scanner 12 are provided. Further, for example, a scanner 12 for inputting code information and a printer 13 for outputting a fitting catalog are provided. In the example shown in FIG. 9, a part of the order processing unit 36 of the code information recognition processing 32 shown in FIG. 1 and the management functions of the product information management unit 37 and the customer information management unit 38 are transferred to the management server 60. Each code recognition function of the code recognition unit 33, the product code recognition unit 34, and the customer code recognition unit 35 is left in the code recognition unit 74.
For example, a scanner 81 for inputting code information, a printer 82 for outputting a fitting catalog, and the like can be connected to the user device 80.
The merchandise provider server 90 currently provides various information and code information of the merchandise being provided, information on new products such as size and color information of merchandise included in the code, and various service information.

  FIG. 10 is a flowchart showing the try-out catalog output process in the process of the video information processing system via the network 99 shown in FIG. In the store apparatus 70, first, a customer's try-on video (a try-on image 320) is photographed using the digital camera 11 (step 301) and is taken into the store apparatus 70. Further, the product information of the actually tried-on products and the customer information of the tried-on customers are input into the store apparatus 70 via a scanner, keyboard, code reader (not shown), etc. (step 302). Thereafter, the store apparatus 70 transmits the try-on image 320 and each input information to the management server 60 from the transmission / reception unit 71 via the network 99 (step 303). Further, at this time, it is possible to receive an option designation indicating that a conversion fitting image is desired from the customer.

In the management server 60, the fitting image 320 and each piece of information are received by the transmission / reception unit 61 (step 304). When an option is specified, information on the product to be converted (for example, color information such as L ^* a ^* b ^* ) is acquired. In addition to the case where the information is stored in advance in the product information database 22, the information may be acquired from the product provider company server 90 via the network 99 as needed, for example. The acquired product information is sequentially stored in the product information database 22.

  In the fitting catalog creation process 63, a fitting catalog is created using the received fitting image 320 and each information stored in various databases (step 305). In addition to the cover 301 and the basic page 302 shown in FIG. 2, this try-on catalog includes option pages 303 and 304 including converted try-on images 321 and 322 as shown in FIGS. It is generated including. Thereafter, information on the created fitting catalog is stored in various databases. That is, information such as the product code 312 and the order code 313 corresponding to the customer code 311 is stored in a database such as the customer information database 21, the product information database 22, and the order database 24 (step 306). For example, when an option is specified and related products are visualized, an order code 313 is assigned to each converted fitting image 321, 322, and order information corresponding to the order code 313 is stored in the order database 24. Is done. Thereafter, the created fitting catalog is transmitted by the transmission / reception unit 61 via the network 99 (step 307).

  When the fitting catalog is received by the store apparatus 70 (step 308), the store apparatus 70 prints out the fitting catalog using the printer 13 (step 309). The outputted try-on catalog is handed over to the customer as it is, or is handed over to the customer by mail or the like. The fitting catalog is generally transmitted to the store device 70. However, if the mail address of the user device 80 is recognized in advance and the customer who operates the user device 80 desires, It is sent directly to the device 80. That is, when the fitting catalog is received by the user device 80 (step 310), the fitting catalog is printed out by the printer 82 connected to the user device 80 (step 311). Through the processing as described above, the customer can acquire a fitting catalog including the converted fitting images 321 and 322.

  FIG. 11 is a flowchart showing code information recognition processing in the processing of the video information processing system via the network 99 shown in FIG. For example, when a customer visits a store and places an order for a try-on product, the store device 70 reads a try-on catalog using the scanner 12, for example. Alternatively, code information is read using, for example, a predetermined code reader (step 401). The code recognition unit 74 of the store apparatus 70 recognizes the customer code 311, the product code 312, and the order code 313 from the try-on catalog (step 402), and receives the recognized code information from the transmission / reception unit 71 via the network 99. 60 (step 403). The ordering operation can also be performed from the user device 80. For example, a customer who wants to place an order for a try-on product or a product of a different color for which the converted try-on image 321 is generated accesses the URL of the management server 60 using the browser of the user device 80, for example. Then, based on an instruction from the site of the management server 60, after logging in, authenticating, etc., for example, the number given to the order code 313 is input and the code information is transmitted (step 404). That is, by inputting an order number in a try-on catalog, which is information that can be recognized by the customer, it is possible to easily order, for example, products of different colors.

  The management server 60 receives these pieces of code information by the transmission / reception unit 61 (step 405), and acquires each information from the customer information database 21, the product information database 22 and the order database 24 (step 406). For example, the management unit 62 performs various processing for each customer based on the customer information acquired by relying on the customer code 311, manages the product purchase results, and stores the management result in the customer information database 21. (Step 407). Furthermore, for example, the order processing based on the order information is executed in the management unit 62. At this time, the management server 60 performs product information management, and stores the management result in the product information database 22 (step 408). Thereafter, the management server 60 transmits the processing result to the store device 70 and the user device 80 via the network 99 by the transmission / reception unit 61. In the store apparatus 70, the processing result is received by the transmission / reception unit 71 (step 409), and when an order is made directly from the user apparatus 80, the processing result is also transmitted to the user apparatus 80 (step). 410). Further, the product information ordered by the customer is also transmitted to the product provider company server 90 that provides the product, and this information provision is utilized for the next product development, production, etc. (step 411).

Next, the hardware configuration of the computer 30 configuring the PC 30 illustrated in FIG. 1, the management server 60, the store device 70, the user device 80, and the product provider company server 90 illustrated in FIG. 9 will be described.
FIG. 12 is a diagram showing an example of a hardware architecture applicable to these computer apparatuses. The computer apparatus shown in FIG. 12 includes a CPU (Central Processing Unit) 201 which is a calculation means, an M / B (motherboard) chip set 202 for connecting various devices such as the CPU 201 and a memory module, and the M / B chip. A main memory 203 connected to the CPU 201 via a set 202 and a CPU bus, an M / B chip set 202, and a video card 204 connected to the CPU 201 via an AGP (Accelerated Graphics Port) are provided. The video card 204 is connected to a display 220 such as an LCD as a display device.

  Further, various devices are connected to the M / B chipset 202 via a PCI (Peripheral Component Interconnect) bus, and from the PCI bus via a low-speed bus such as a bridge circuit 207 and an ISA (Industry Standard Architecture) bus. Various devices are connected to the M / B chipset 202. For example, a modem 221 is connected via a serial port 208 and a printer 222 is connected via a parallel port 209. A hard disk device (HDD) 223 and a scanner 224 are connected via a SCSI (Small Computer System Interface) controller 210. A network interface 211 is connected. A floppy disk drive 212 and a keyboard / mouse 213 are connected to the low-speed bus.

  Note that FIG. 12 merely illustrates the hardware architecture of the computer apparatus that implements the embodiments of FIGS. 1 and 9. If this embodiment is applicable, other various configurations may be employed. it can. For example, instead of providing the video card 204, only the video memory may be mounted and the CPU 201 may process the image data. Further, as an external storage device, a CD-R (Compact Disc Recordable) or DVD-RAM (Digital Versatile Disc Random Access Memory) drive may be provided via an interface such as ATA (AT Attachment) or SCSI controller 210. Is possible. Further, the digital camera 11 shown in FIGS. 1 and 9 is connected to a computer apparatus via a serial port 208 such as a USB (Universal Serial Bus). Further, the access from the store apparatus 70 to the management server 60 shown in FIG. 9 and the access from the user apparatus 80 to the management server 60 are realized by a browser executed by the CPU 201. Application programs and browsers that execute the processing functions shown in FIGS. 1 and 9 are read into the main memory 203 and executed by the CPU 201. In addition to the case where the hard disk device (HDD) 223 shown in FIG. 12 is used, various databases may use an external HDD via USB, or a storage device connected via an internal network, for example. is there.

  As described above in detail, in an environment where clothing items such as department stores, boutiques, wedding costume rentals, etc. are handled, even if one product cannot be easily determined because the product is expensive, the system configuration in the present embodiment If you use, you will never lose the opportunity to purchase products. That is, in this embodiment, by printing out the fitting image 320, it is not necessary to select a place for sharing the catalog information with another person. At this time, in the present embodiment, the conversion try-on images 321 and 322 are created for the related products such as the color difference of the tried-on products together with the try-on image 320, and these are also included in the try-on catalog. This can be expected to improve the sales performance of the product. In addition, by combining and outputting background information that reflects the situation in which the product is used, etc. to the fitting image 320, the image when the customer wears the product can be strengthened. Sales performance can be improved.

  As a utilization example of the present invention, a computer device used in a store or the like, a server that provides information via the Internet, or the like can be considered.

It is the figure which showed the whole structure of the video information processing system to which this Embodiment is applied. (a), (b) is the figure which showed an example of the try-on catalog produced | generated in this Embodiment. It is the figure which showed an example of the try-on catalog produced | generated in this Embodiment. It is the figure which showed an example of the try-on catalog produced | generated in this Embodiment. It is the flowchart which showed the issue processing of the try-on catalog. (a), (b) is a figure for demonstrating the process at the time of merchandise color conversion in merchandise image conversion processing. (a), (b) is a figure for demonstrating the background process and composition process of a try-on image. It is the flowchart which showed the process for code information recognition. It is the figure which showed the whole structure of the image | video information processing system via a network. 10 is a flowchart showing a fitting catalog output process in the processing of the video information processing system via the network shown in FIG. 9. It is the flowchart which showed the recognition process of code information in the process of the video information processing system via the network shown in FIG. It is the figure which showed an example of the hardware architecture applicable to a computer apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 ... Digital camera, 12 ... Scanner, 13 ... Printer, 21 ... Customer information database (customer information DB), 22 ... Product information database (product information DB), 23 ... Video information database (video information DB), 24 ... For ordering Database (DB), 30 ... PC (personal computer), 31 ... Try-on catalog creation processing, 32 ... Code information recognition processing, 60 ... Management server, 70 ... Store device, 80 ... User device, 90 ... Product provider company server

Claims (17)

Photographing means for photographing a subject wearing a predetermined product and obtaining video information;
Product information storage means for storing product information of the product worn by the subject and related products related to the product;
Conversion video information generation that reads the product information stored in the product information storage unit and replaces the video part of the product in the video information obtained by the photographing unit with the information of the related product to generate conversion video information Means,
And a printing unit that prints the converted video information generated by the converted video information generation unit on a recording medium. Shooting condition acquisition means for acquiring shooting conditions when a subject is shot by the shooting means;
Video information storage means for storing synthesized video information to be synthesized;
Predetermined composite video information is read from the video information storage means, and predetermined processing is performed on the video information photographed by the photographing means based on the state of the composite video information and the photographing conditions obtained by the photographing condition obtaining means. Processing means for applying,
2. The converted video information generation unit generates the converted video information by combining the read-out synthesized video information with the video information subjected to the predetermined processing by the processing unit. The video information processing apparatus described.   The video information processing apparatus according to claim 1, wherein the printing unit prints order code information for specifying the related product including information in the converted video information simultaneously with the converted video information. Video information acquisition means capable of acquiring video information when the subject wears a product;
Color information acquisition means for acquiring color information of the product worn;
Area recognition means for recognizing the area of the product in the video information acquired by the video information acquisition means using the color information acquired by the color information acquisition means;
Related product color information acquisition means for acquiring color information of a related product having a color different from that of the product worn;
A video information processing system comprising: generating means for generating converted video information by replacing color information of the region in the video information with color information of the related product acquired by the related product color information acquiring means.   5. The video information processing system according to claim 4, wherein the area recognizing unit recognizes an area of color information within a certain range from the color information acquired by the color information acquiring unit as the area of the product. . Code information generating means for generating code information for specifying the related product included in the converted video information generated by the generating means;
5. The video information processing system according to claim 4, further comprising: a printing unit that prints including the converted video information generated by the generation unit and the code information generated by the code information generation unit.   5. The video information processing system according to claim 4, wherein the color information acquisition unit and the related product color information acquisition unit acquire color information from a product information database in which product information is stored. Video information acquisition means capable of acquiring video information including a subject photographed under a predetermined lighting condition and wearing a product;
Background image removing means for removing a background image excluding the subject in the video information;
Illumination information acquisition means for acquiring illumination information when imaged under the illumination conditions;
A composite background image acquisition means for acquiring a composite background image to be combined from a video information database storing various types of video information;
The background image is removed by the background image removing unit from the illumination information acquired by the illumination information acquiring unit and the illumination condition assumed in the combined background image acquired by the combined background image acquiring unit. Filter processing means for performing filter processing on the later video information;
A video information processing system comprising: generating means for generating converted video information by combining the video information filtered by the filter processing means and the background image acquired by the combined background image acquisition means. Color information acquisition means for acquiring color information of the product worn;
Area recognition means for recognizing the area of the product from the video information acquired by the video information acquisition means using the color information acquired by the color information acquisition means;
The product further includes related product color information acquisition means for acquiring color information of a related product having a color different from that of the product worn.
9. The converted image information is generated by replacing the color information of the region in the video information with the color information of the related product acquired by the related product color information acquiring unit. The video information processing system described. Code information generating means for generating code information for specifying the product and / or the related product;
10. The video information processing system according to claim 8, further comprising a printing unit that prints including the converted video information generated by the generation unit and the code information generated by the code information generation unit. Obtaining video information when the subject wears a product;
Obtaining color information of the product from the product information storage means;
Recognizing a region of the product in the video information using the acquired color information;
Obtaining color information of related products having a different color from the product from the product information storage means;
Replacing the color information of the region in the video information with the color information of the related product to generate converted video information;
Printing out the generated converted video information. A video information output method comprising:   12. The video information output method according to claim 11, wherein the step of recognizing the region recognizes a region of color information within a certain range from the acquired color information as the region of the product.   12. The video information output method according to claim 11, wherein the printing and outputting includes printing and including code information for specifying the related product.   12. The print-out step includes printing out the converted video information together with the video information, and printing out the code information for specifying the product included in the video information. Video information output method. Acquiring shooting conditions when the video information of the subject is shot;
Reading predetermined synthesized video information from video information storage means for storing synthesized video information to be synthesized;
Applying predetermined processing to the acquired video information based on the read state of the composite video information and the acquired shooting condition;
12. The video information output method according to claim 11, further comprising the step of synthesizing the read-out synthesized video information with the video information subjected to the predetermined processing to generate converted video information. On the computer,
A function to acquire video information when the subject wears a product,
A function of obtaining color information of the product from the product information storage means;
A function of recognizing the product area in the video information using the acquired color information;
A function of acquiring color information of related products having a different color from the product from the product information storage unit;
A program for realizing a function of generating converted video information by replacing color information of the area in the video information with color information of the related product. In the computer,
A function for acquiring shooting conditions when video information of a subject is shot;
A function of reading predetermined synthesized video information from video information storage means for storing synthesized video information to be synthesized;
A function of performing predetermined processing on the acquired video information based on the read state of the composite video information and the acquired shooting condition;
The program according to claim 16, further realizing a function of synthesizing the read synthesized video information with the video information subjected to the predetermined processing to generate converted video information.

Images