JP2006304331A - Device, method for generating fitting image, terminal, method for using fitting image and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To perform a part of fitting synthesis service, performed in cooperation with a server at a shop front by dividing it from a server which composites the fitting image, using a portable terminal, such as PDA. <P>SOLUTION: A privacy protection mode regarding the body image of a user and the right of work utilization to clothes image data of the user are checked. Then, graphics processing, such as coordinate transformation and animation generation of the fitting image, is performed on either of the server which composites the fitting image or the portable terminal. The fitting image having been stored in the portable terminal on the protecting the privacy of the user and the right of work utilization of a clothes image and the composited fitting image is browsed, regardless of the location. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention generates a try-on image obtained by synthesizing an image of a user trying on clothes based on the user's body image data and clothes image data, and further converts the try-on image or generates an animation. BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic fitting technique for providing a fitting composition service, and in particular, a fitting image providing system and a fitting image provision method for providing a fitting composition service to a remote user terminal on a network, user's body image data and clothes Part of try-on synthesis service such as try-on image generation device and method for generating try-on image synthesis, coordinate conversion, and animation generation based on image data, display of try-on image, coordinate conversion of try-on image and animation generation A fitting image utilization terminal, a fitting image utilization method, and a computer program.

  More specifically, the present invention provides a try-on image providing system and a try-on image providing for using a synthesized try-on image in various places by cooperation between a user terminal such as a PDA (Personal Digital Assistant) and a server in the store. Method, fitting image generation apparatus and fitting image generation method, fitting image utilization terminal and fitting image utilization method, and computer program, in particular, privacy protection related to user's body image data necessary for composition of fitting images, and , A try-on image providing system, a try-on image providing method, a try-on image generating apparatus, and a try-on image generating method for using a synthesized try-on image in various places while protecting the copyright on clothes image data or the right to use content , Try-on image use terminal and try-on image use method And a computer program.

  In recent years, computing technologies such as information processing and information communication have improved dramatically, and computer systems have become widespread. In addition, there is a growing demand for network computing technology that interconnects computers. Under a network connection environment, it is possible to smoothly perform collaborative work such as sharing of computer resources and sharing, distribution, distribution, and exchange of information.

  There are various forms of networks that interconnect computers. For example, a locally laid LAN (Local Area Network) such as Ethernet (registered trademark), and “Internet” that has literally grown into a worldwide network as a result of repeated interconnections between networks. (TheInternet).

  "Internet" is literally a server (mainly a UNIX (registered trademark) workstation) installed at each university, research institution, etc., which has been voluntarily repeated, resulting in a huge network. Is a network of networks. Currently, innumerable servers are connected on the Internet, and each server opens various resource objects to innumerable clients. Servers on the Internet are usually interconnected on the basis of TCP / IP (Transmission Control Protocol / Internet Protocol).

  On the Internet, many services such as WWW (World Wide Web), News, TELNET (TELeipewriter Network), FTP (File Transfer Protocol), and Gopher are open to the public. Among them, WWW is a wide area information retrieval system that provides an information space with a hyperlink structure, and has become the biggest factor for the explosive growth and rapid spread of the Internet. On the WWW system, various media contents such as text, images, and audio can be viewed in high text format. Hypertext information handled on the WWW is described in a hypertext format description language called HTML (Hyper Text Markup Language). According to TCP / IP, various information resources including these HTML documents are specified by identifiers in the form of URL (Uniform Resource Locator) and can be transferred according to the HTTP (Hyper Text Transfer Protocol) protocol (well known). ). On the client side, HTML content can be downloaded using a WWW browser and displayed as a home page on the screen.

  Recently, with the speeding up of network lines such as telephone lines (such as ADSL (Asymmetric Digital Subscriber Line)) and cable television, moving image content distribution services have been expected. For example, when distributing sound and video images over the Internet, "streaming" technology has been developed and started to spread, not playing after the user has downloaded the file, but playing it while downloading it. . Currently, as a well-known content distribution system that implements streaming technology, for example, “Real System G2”, “Windows (registered trademark) Media Technologies”, and the like can be cited.

  The penetration rate of the Internet is already high, and it penetrates deeply into various research institutions such as universities, corporate offices, and general households. In recent years, the Internet has been used not only as a means for distributing information but also as a means for various businesses including merchandise sales. This is a so-called “net sales” or “online shopping” commercial transaction.

  For example, when online sales are applied to digital information such as computer software, music, video content, etc., the manufacturing cost of recording media such as CD (Compact Disc) and DVD (Digital Versatile Disc) and the consumer's hand Many physical means such as distribution channels and sales channels for delivering products (that is, media) can be reduced.

  Even when online sales are applied to regular merchandise sales instead of digital information, sellers post product information in the form of Web pages and receive responses from consumers (such as purchases) It is only necessary to wait, and physical means such as a store showcase can be omitted to reduce costs.

  When comparing traditional mail-order sales with online sales, the former requires time and effort to distribute catalogs to fixed customers and arbitrary consumers. On the other hand, in the latter case, product information can be instantaneously distributed all over the world simply by uploading data content corresponding to a catalog on one Web site. In other words, according to the online sales, there is immediacy of product information, and a product sales contract can be established smoothly and quickly. In addition, according to network distribution, since the initial cost required for product sales is low, it is possible to subdivide the transaction unit and establish a transaction that sequentially responds to various requests for each general consumer.

  In online sales, a merchandise seller generally provides a merchandise catalog on a Web page, and a live-action video about the merchandise can be posted on such a page. The purchaser can determine whether the product matches his / her demand by using such a video as a clue.

  In addition, when the video provided on the page is a planar two-dimensional image, it is difficult for the purchaser to grasp the substance / real image of the product. Those skilled in the art will appreciate that a three-dimensional computer graphics (CG) image may be used instead of a two-dimensional image to solve such a problem.

  Furthermore, for a user who is considering purchasing clothes, an image composition process is performed based on the user's body image data and clothes image data, and the user is trying on clothes. That is, “electronic try-on” can be provided online in real time. Electronic try-on is a very useful promotional tool for consumers trying to purchase from a remote location. Of course, even for consumers who have visited the store directly, they can physically try on, but electronic fitting can still be convenient because it saves the trouble of changing clothes by electronic fitting. According to electronic try-on, it is possible to enlarge / reduce the appearance of the consumer who is trying on by general geometric transformation processing, or even check the appearance seen from behind by rotating. It is.

  Such a try-on device that realizes virtual try-on is conventionally known. Some basic ideas about try-on devices have been proposed.

  For example, there has been proposed a preview apparatus that allows a user to generate and preview a series of poses wearing clothes on a computer without actually wearing clothes (see, for example, Patent Document 1). thing). According to this apparatus, a user inputs data related to a series of poses in a computer-readable format, and a user who wears clothes by mixing or superimposing a clothing image and a user image on the computer. A composite image consisting of can be displayed to the user.

  In addition, a system for generating custom clothing based on customer's personal tailored dimension data, clothing option information, and the like has also been proposed (see, for example, Patent Document 2). This system includes a center station that provides services to a plurality of remote devices via a communication line. On the remote device, an interactive graphic display terminal is provided to specify a combination of physical data such as customer dimensions, option selection data, and clothing pattern data. The center station is equipped with a cutting device, and the designed clothes can be completed based on the final combination.

  In recent years, it has become possible to synthesize fitting images using software that synthesizes fitting images on the Internet. For example, in “My Virtual Model” (trademark) developed by Public Technologies Multimedia (PTM), based in Montreal, Canada, a 3D computer graphic (CG) model is created by a user inputting body shape data, A try-on image can be created by synthesizing a CG image of clothes with this model. This PTM system has been available from the home page of "LAND'S END" since November 1998. With this system, you can not only display fitting images, but also recommend style design.

  In Japan, Toyobo has developed relatively high-level try-on image generation software “DressingSim” and has begun production and sales. For example, a method for synthesizing an image showing a try-on situation that can be reproduced virtually and realistically without actually trying on the try-on situation when trying on clothes on a try-on object has been proposed. (See, for example, Patent Document 3).

  All of the above-described conventional techniques make it possible to realize that the try-on system is in a practical stage in the online service.

  The inventor considers that it is preferable to have the following requirements for the electronic fitting service.

(1) Site orientation:
By acquiring the clothes ID on the spot from the clothes you like at the store, you can access the related clothes data.
(2) Immediate:
For example, by accessing a store network, clothing data can be acquired from a database. A 3D clothing image can be synthesized and a fitting image can be displayed instantaneously. (3) Realism:
Even on a small screen, it is possible to display a try-on image that allows a customer to grasp a try-on image to some extent.
(4) Privacy protection:
Protect personal data such as customer body images.
(5) Reproducibility of experience:
The customer can store the accessed clothing data for a certain period and confirm the try-on image again later.
(6) Amusement:
Various images such as try-on images can be transformed. For example, when a Y-shirt is selected, the customer's enjoyment is increased by providing a function of displaying a combination of ties and suits that match the Y-shirt and a function of designing a color and a pattern by the customer.
(7) Real-time performance:
It can support real-time relay of try-on images.
(8) Interactivity:
The display form of the fitting image can be controlled by the customer.
(9) Super reality:
It makes video and sound that cannot be experienced in reality appear as if they were real.

  However, the above-described try-on system assumes that all try-on image generation services are performed online on the server. For this reason, for example, using a portable terminal such as a PDA, a try-on image synthesized by cooperating with a storefront server is performed by dividing a part of the try-on synthesis service offline from the server of the try-on synthesis service. There was not enough ingenuity for. For example, a terminal device that is different from the device that stores the dressed image detachable recording medium or the storage device of a portable terminal (RAM (Random Access Memory), HD (Hard Disk), etc.) or the device that combines the fitting image. It does not assume a usage form such as performing coordinate processing on a try-on image synthesized on a server (including the portable terminal) or graphics processing such as animation generation. For this reason, in order for the user to receive the fitting image service, it is necessary to connect to a specific computer on which the server is installed and request processing relating to the fitting image.

  Further, in a conventional try-on image providing system, personal information such as individual body shape data and imaging data is input to a server and stored in a storage device of the server, thereby performing image processing in the server. For this reason, since the user needs to disclose personal information such as system data to at least the server, it may be inconvenient for the user from the viewpoint of privacy protection.

U.S. Pat. No. 4,149,246 U.S. Pat. No. 4,539,585 JP-A-11-203347

  An object of the present invention is to provide an excellent fitting image providing system and fitting image providing method, a user's body image data and clothes image, which can provide a fitting composition service to a remote user terminal on a network. The fitting image generation device and the fitting image generation method capable of synthesizing the fitting image based on the data, coordinate conversion, and animation generation, the fitting image generation, the fitting image display method, the coordinate conversion of the fitting image, and the animation generation. An object of the present invention is to provide an excellent try-on image use terminal, a try-on image use method, a storage medium, and a computer program that can take part of the service.

  A further object of the present invention is to provide an excellent try-on image providing system and a try-on image providing method capable of using a synthesized try-on image in various places by cooperation between a user terminal such as a PDA and a storefront server, It is an object to provide a try-on image generation apparatus, a try-on image generation method, a try-on image use terminal, a try-on image use method, and a computer program.

  A further object of the present invention is to protect the privacy related to the user's body image data necessary for the synthesis of the fitting image, and to protect the copyright relating to the clothing image data or the right to use the content, To provide an excellent fitting image providing system and fitting image providing method, a fitting image generation apparatus and a fitting image generation method, a fitting image utilization terminal and a fitting image utilization method, and a computer program that can be used in a place. is there.

  It is a further object of the present invention to provide personal data to a server by performing image composition processing on a personal portable terminal when the user does not want to disclose personal information such as body image data. Excellent fitting image providing system and fitting image providing method, fitting image generating apparatus and fitting image generating method, fitting image using terminal, and fitting image using method, which can be safely combined without fitting. And providing a computer program.

  A further object of the present invention relates to the case where the clothing data should be protected as a copyrighted work or the use of the data should be restricted for other reasons. By providing to specific users safely without infringing the copyright or other usage rights of clothing data owned by the clothing image provider, An easy fitting image providing system and fitting image providing method, a fitting image generation device and a fitting image generation method, a fitting image utilization terminal, and a fitting image utilization method, which make it easy to obtain services relating to fitting images regardless of time, and To provide a computer program.

The present invention has been made in consideration of the above problems, and a first aspect of the present invention provides a try-on image obtained by combining images based on a user's body image data and clothes image data on a computer network. A fitting image providing system,
A user terminal including at least an ID reading unit for acquiring an ID from a desired clothes, a wireless communication unit, and a display unit for a fitting image;
An access point for wirelessly connecting the user terminal to the computer network;
An image processing server connected to the computer network and synthesizing a fitting image based on the user's body image data and clothes image data;
It is a try-on image providing system characterized by comprising.

  However, “system” here refers to a logical collection of a plurality of devices (or functional modules that realize specific functions), and each device or functional module is in a single housing. It does not matter whether or not (hereinafter the same).

  According to the try-on image providing system according to the first aspect of the present invention, a try-on image synthesized by cooperating with a store server using a personal portable terminal such as a PDA can be attached to a removable recording medium or In a terminal device (including the mobile terminal) or a server that is stored in a storage device (RAM, HD, etc.) of a portable terminal and is different from the device that has synthesized the fitting image, coordinate conversion or animation generation is performed on the synthesized fitting image. As in the case of performing graphics processing, a part of the try-on synthesis service can be divided and performed off-line from the server of the try-on synthesis service.

  Here, in the privacy protection mode for protecting the user's body image data, the user terminal acquires the clothing image data corresponding to the ID read from the desired clothing via the computer network, and the user terminal The body image data and the clothing image data may be combined to generate a try-on image.

  Further, if the user terminal is out of the privacy protection mode, the user terminal transfers the body image data to the image processing server via the computer network, and tries to combine the body image data of the user and the clothing image data. An image generation process may be requested.

  Further, when the user does not have the right to use the clothing image data corresponding to the ID read from the desired clothes, the user terminal may execute a predetermined usage right acquisition process. .

  In addition, when the user has a usage right related to the clothing image data corresponding to the ID read from the desired clothing, the image processing server is a fitting image obtained by synthesizing the body image data of the user and the clothing image data. Data may be transferred to the user terminal.

  In addition, when the user does not have the right to use the clothing image data corresponding to the ID read from the desired clothing, the image processing server is a fitting image obtained by combining the body image data of the user and the clothing image data. Data may be transferred to the user terminal in a stream delivery or try-on image data in a non-reusable format to protect the right to use the image data of clothes from the possibility of unauthorized duplication / use.

According to a second aspect of the present invention, there is provided a user terminal including at least an ID reading unit for acquiring an ID from a desired clothing, a wireless communication unit, and a display unit for a fitting image, and the user terminal connected to the computer wirelessly. An access point for connecting to a network, and a computer network that is connected to the computer network and has an image processing server for synthesizing a fitting image based on the user's body image data and clothes image data A fitting image providing method for providing a fitting image obtained by combining images based on user's body image data and clothes image data,
Under the privacy protection mode for protecting the user's body image data, the user terminal acquires the clothes image data corresponding to the ID read from the desired clothes via the computer network, and the user's body image Synthesizing the data and clothing image data to generate a fitting image;
Outside the privacy protection mode, the user terminal transfers body image data to the image processing server via the computer network, and generates a fitting image that combines the body image data of the user and the clothing image data. Step to request,
It is a fitting image providing method characterized by comprising.

  In the fitting image providing method according to the second aspect of the present invention, when the user does not have the right to use the clothes image data corresponding to the ID read from the desired clothes, the user terminal There may be further provided a step of executing the usage right acquisition process.

In addition, when the user has a right to use the clothes image data corresponding to the ID read from the desired clothes, the image processing server combines the image data of the user's body image data and clothes image data. Transferring to the user terminal;
When the user does not have the right to use the clothing image data corresponding to the ID read from the desired clothing, the image processing server uses the fitting image data obtained by combining the body image data of the user and the clothing image data. Transferring to a user terminal in a non-reusable format for streaming or fitting image data;
May be further provided.

  According to the method for providing a try-on image according to the second aspect of the present invention, a try-on image synthesized by cooperating with a store server using a personal portable terminal such as a PDA can be attached to a removable recording medium or In a terminal device (including the mobile terminal) or a server that is stored in a storage device (RAM, HD, etc.) of a portable terminal and is different from the device that has synthesized the fitting image, coordinate conversion or animation generation is performed on the synthesized fitting image. As in the case of performing graphics processing, a part of the try-on synthesis service can be divided and performed off-line from the server of the try-on synthesis service.

According to a third aspect of the present invention, there is provided a try-on image generating apparatus or method for generating a try-on image obtained by combining images based on body image data of a user and image data of clothes.
Means or step for receiving a request for generating a fitting image to be synthesized based on body image data and clothing image data from a user;
Means or step for obtaining image data of the requested clothing;
Means or step for checking whether the user has the right to use the image data of clothes;
Means or step for generating a fitting image by synthesizing images based on the user's body image data and clothes image data;
Means or step for transmitting a try-on image to the user terminal in a manner corresponding to the presence or absence of the right to use the image data of the user's clothes;
A fitting image generating apparatus or method characterized by comprising:

  Here, the means or the step of transmitting the fitting image to the user terminal transfers the generated fitting image data to the user terminal as it is when the user has the right to use the image data of clothes. You may do it. As a result, on the user terminal, the try-on image can be used primary and secondary. If the user does not have the right to use the clothing image data, the generated fitting image data is streamed to the user terminal or transferred to the user terminal in a format that the fitting image data cannot be reused. Use may be restricted to protect copyrights and other rights related to clothing data.

Further, a fourth aspect of the present invention is a try-on image using terminal or method that uses a try-on image synthesized based on the user's body image data and clothes image data,
An ID reading means or step for acquiring an ID from a desired garment;
Wireless communication means or step for wirelessly connecting to a computer network;
Means or step for checking whether or not there is a right to use the image data of the user's clothes;
Receives fitting images and / or clothing image data synthesized based on the user's body image data and clothing image data in a manner that depends on whether or not the user has the right to use the clothing image data. Means or steps;
Display means or step of fitting image; and
It is a fitting image utilization terminal or method characterized by comprising.

  Here, the try-on image use terminal or method according to the fourth aspect of the present invention has a predetermined use right when the user does not have the right to use the clothes image data corresponding to the ID read from the desired clothes. A means or step for executing the usage right acquisition process may be further provided. As a result, the user can acquire the right to use the clothing image data smoothly and can freely use the fitting image.

  Further, the means or step for receiving the fitting image may have a user's right to use the clothes image data corresponding to the ID read from the desired clothes, from a predetermined image processing server. You may make it receive the try-on image data which image-synthesized body image data and clothes image data. As a result, on the user terminal, it can be freely used such as primary use and secondary use of a try-on image.

  Alternatively, the means or step for receiving the try-on image, if the user does not have the right to use the clothes image data corresponding to the ID read from the desired clothes, from the predetermined image processing server, The fitting image data obtained by synthesizing the body image data and the clothing image data may be received by the user terminal in a stream reception or in a format in which the fitting image data cannot be reused. As a result, the use of a fitting image on the user terminal can be restricted to protect copyrights and other rights related to clothes data.

  Moreover, the try-on image using terminal or method according to the fourth aspect of the present invention may further include a try-on image generating means or step for synthesizing the user's body image data and clothes image data. In the privacy protection mode for protecting the user's body image data, the clothing image data corresponding to the ID read from the desired clothes is acquired, and the body image data and the clothes image data of the user are combined. A try-on image may be generated so that personal data such as body image data is not leaked to an external computer. If it is outside the privacy protection mode, the body image data is transferred to a predetermined image processing server, and the fitting image generation process for synthesizing the body image data of the user and the clothing image data is performed using the image processing function. You may make it request to the external computer which strengthened.

In addition, a fifth aspect of the present invention is a computer program written to execute on a computer a process for generating a fitting image obtained by combining images based on a user's body image data and clothes image data. For the computer,
A procedure for receiving a request for generating a fitting image to be combined based on body image data and clothing image data from a user;
A procedure for obtaining image data of the requested clothing;
A procedure for checking whether the user has the right to use the image data of clothes;
A procedure for generating a fitting image by combining images based on the user's body image data and clothing image data,
A procedure for sending a try-on image to the user terminal in a manner depending on whether or not the user has the right to use the image data of the user's clothing;
Is a computer program characterized in that

According to a sixth aspect of the present invention, there is provided a computer program written to execute on a computer a process that uses a fitting image synthesized based on a user's body image data and clothes image data. For the computer,
An ID reading procedure for obtaining an ID from a desired garment;
A wireless communication procedure for wirelessly connecting to a computer network;
A procedure to check for usage rights for image data of the user's clothing;
A procedure for receiving a fitting image synthesized based on the user's body image data and clothing image data, or clothing image data in accordance with whether or not the user has the right to use the clothing image data. ,
The procedure for displaying the fitting image,
Is a computer program characterized in that

  The computer program according to each of the fifth and sixth aspects of the present invention defines a computer program written in a computer-readable format so as to realize predetermined processing on the computer. In other words, by installing the computer program according to the fourth aspect of the present invention in the computer, a cooperative action is exhibited on the computer, and the fitting image generating apparatus or method according to the third aspect of the present invention. And the effect similar to the try-on image utilization terminal or method which concerns on a 4th side surface can be acquired.

  According to the present invention, an excellent fitting image providing system and a fitting image providing method capable of providing a fitting composition service to a remote user terminal on a network, a user's body image data and clothes image An excellent fitting image generation device and fitting image generation method that can perform fitting image synthesis, coordinate conversion, and animation generation based on data, fitting image display, fitting image coordinate conversion, animation generation, etc. It is possible to provide an excellent try-on image use terminal, a try-on image use method, and a computer program that can take part of the service.

  Further, according to the present invention, an excellent try-on image providing system and a try-on image providing method capable of using a synthesized try-on image in various places by cooperation between a user terminal such as a PDA and a storefront server. A fitting image generation apparatus and a fitting image generation method, a fitting image utilization terminal, a fitting image utilization method, and a computer program can be provided.

  In addition, according to the present invention, privacy protection relating to the user's body image data necessary for the synthesis of the fitting image, and copyrights relating to clothing image data or rights relating to use of the content are protected, and various synthesized fitting images can be used. An excellent fitting image providing system and fitting image providing method, a fitting image generation apparatus and a fitting image generation method, a fitting image utilization terminal and a fitting image utilization method, and a computer program that can be used in various places it can.

  Further, according to the present invention, when the user does not want to disclose personal information such as body image data, the personal data is stored in the server by performing the image composition processing on the personal portable terminal. An excellent fitting image providing system and fitting image providing method, a fitting image generation apparatus and a fitting image generation method, a fitting image utilization terminal, and a fitting image utilization, which can safely perform fitting image synthesis without providing them. Methods and computer programs can be provided.

  In addition, according to the present invention, with respect to the case where the clothing data should be protected as a copyrighted work or other cases where the use of the data should be restricted, the usage right of the clothing data is set to the user under certain restrictions, By providing a specific user safely and without infringing on the copyright and other usage rights of clothing data owned by the clothing image provider, the user will be able to use the location and time within the limits. An easy fitting image providing system and fitting image providing method, a fitting image generation device and a fitting image generation method, a fitting image utilization terminal and a fitting image utilization method, and a computer A program can be provided.

  According to the present invention, a try-on image synthesized by cooperating with a storefront server using a personal portable terminal such as a PDA can be attached to a removable recording medium or a storage device (RAM, HD, etc.) of the portable terminal. Can be downloaded for storage. Therefore, in a terminal device (including the mobile terminal) or a server different from the device that synthesized the fitting image, a fitting process such as coordinate transformation or animation generation for the synthesized fitting image is performed. A part can be divided off-line from the server of the try-on synthesis service.

  Further, according to the electronic try-on service according to the present invention, when the user does not want to disclose personal information such as his / her body image data, the image composition processing can be performed on the personal portable terminal. That is, it is possible to safely try-on image composition without providing personal data to an external computer such as a server.

  Furthermore, according to the present invention, when the clothing data is copyright-protected, the right to use the copyrighted work is set for the user under certain restrictions, and is owned by the clothing image provider such as the clothing data. Can be safely provided to specific users without exposing the copyright to infringement. As a result, the user can easily enjoy services related to try-on images without choosing a place or time within the limits.

  Other objects, features, and advantages of the present invention will become apparent from more detailed description based on embodiments of the present invention described later and the accompanying drawings.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  In the present invention, by combining a user terminal such as a PDA and a server in a retail shop such as a boutique via a network such as the Internet, the synthesized fitting image can be viewed in various places. Electronic fitting service is provided. According to the electronic try-on service according to the present invention, it is synthesized while protecting the privacy related to the user's body image data necessary for synthesizing the try-on image and protecting the copyright related to the clothing image data or the right to use the content. Try-on images can be used in various places.

A. Network Configuration FIG. 1 schematically shows the configuration of a computer network 1 to which an electronic fitting service according to the present invention is applied.

  The computer network 1 includes a portable fitting device 10 possessed by a purchaser of clothes or a user of an electronic fitting service (hereinafter simply referred to as “user”), and a store such as a boutique that provides clothes and clothes image data ( A local network established in a retail shop, that is, a retail LAN 20, a data center LAN 30 having a remote data server 32 that manages various types of information used in electronic fitting services, and a table-type display 42 (or electronic fitting) A restaurant LAN (or a store LAN other than a restaurant) 40 installed in a restaurant equipped with an interactive graphic terminal of another form that can use the service, and a user of an electronic fitting service user In-home LAN 50 and these local Composed of such a wide area network 60 such as the Internet connecting Ttowaku each other. Each local network 20, 30, 40, 50 is connected to the Internet 60 via gateways 21, 31, 41, 51.

  A local database server 22, an image processing server 23, an access point 24, a display device 26, and the like are provided on a retail LAN 20 installed in a store (retail shop) such as a boutique that provides clothes and clothes image data. It is connected.

  The local database server 22 is a server for database management of local information in the retail shop such as customer information, information on clothes and other products handled, sales and other accounting information.

  The image processing server 23 synthesizes a try-on image when the customer tries on clothes based on the specified image data of clothes and the customer's body image data by computer graphics processing, and provides the electronic to the customer It is a server that executes a try-on service. The image processing server 23 generates a try-on image in a plurality of poses of the customer, geometric transformation such as rotation and enlargement / reduction of the try-on image, and generation of an animation in which the customer operates while trying on clothes. Or do it. The image processing server 23 can deliver the try-on images to a display device on which a customer such as the portable try-on device 10 browses the try-on images by using streaming technology in addition to transferring the files by HTTP or FTP.

  The display device 26 is used to check data stored on the local database server 22 and processing results by the image processing server 23 in the retail shop. The electronic try-on service is based on providing a try-on image on the portable try-on device 10 possessed by the user. However, when the user is in the retail shop, the display device 26 has a larger screen than the portable try-on device 10. You can enjoy electronic fitting images. At this time, the user does not need to change clothes.

  The access point 24 is equipped with a wireless LAN such as IEEE 802.11a / b, or a wireless communication means such as Bluetooth, in order to wirelessly connect the portable try-on device 10 possessed by a customer visiting a retail shop to the retail LAN 20. used. For example, the access point 24 constantly transmits a beacon to detect the portable fitting device 10. Then, by using a dynamic host configuration protocol (DHCP) or the like, an IP address that can be recognized is dynamically assigned to the detected portable try-on device 10 so that the portable try-on device 10 can be connected to the retail LAN 20. . When both the retail LAN 20 and the portable try-on device 10 are compatible with IPV6 (Internet Protocol Version 6), the portable try-on device 10 can be connected to the retail LAN 20 without having to dynamically assign an IP address.

  Also, identification information (ID) is assigned to each garment displayed in the boutique. The clothing ID is displayed using a format such as a one-dimensional barcode, a two-dimensional barcode, a cyber code, or an RF-ID (described later). The ID of each garment is managed on the local database server 22.

  Although only a single retail LAN 20 is depicted in FIG. 1, in reality, it is understood that retail shops are scattered all over the country, and a large number of retail LANs exist on the computer network 1. I want to be.

  In FIG. 1, the local database server 22 and the image processing server 23 are shown as different computers, but a single computer may be equipped with both server functions. Needless to say. The gateway 21 is preferably configured as a computer independent of the local database server 22 or the image processing server 23 in consideration of security. Of course, one computer may have two or more server functions.

  The clothing image data and clothing ID on each retail LAN 20 as well as the body image data and other user information of each user who uses the electronic fitting service are operated by a data center which is centrally managed on the computer network 1. Has been. In such a data center, a data center LAN 30 is laid, and a remote data server 32 that centrally manages information on clothes and information on users is arranged on the LAN 30. The remote data server 32 can be accessed from the image processing server 23/53, the portable fitting device 10 or the like via the Internet 60.

  The body image data of each user is privacy information, and the image data of clothes is accompanied by copyright or other rights related to the use of content. Therefore, the remote data server 32 appropriately manages user information and clothing information from the viewpoints of privacy protection and copyright / content usage rights.

  On a restaurant LAN 40 laid in a restaurant such as a cafe (or a store other than a restaurant), an interactive graphic terminal having a larger screen than the portable fitting device 10 such as a table-type display 42 is installed. Yes. The table type display 42 is configured using, for example, an organic EL element. A plurality of users can use the electronic try-on service via the table-type display 42 in a state where they are at the table.

  Although only a single restaurant LAN 20 is depicted in FIG. 1, in reality, restaurants and other stores are scattered throughout the country, and many restaurant LANs are located on the computer network 1. It should be understood that it exists.

  A local database server 52, an image processing server 53, an access point 24, and the like are connected to a home LAN 50 installed in the home of a user of an electronic fitting service.

  The local database server 52 stores body image data and other user information of each user existing in the home, clothing image data, image data of other products targeted for the electronic fitting service, and the like for each home. A server that manages the database. Since the clothing image data and other product image data are accompanied by copyrights or other content usage rights owned by the retail shop or the creator, the user is appropriate on the local database server 52 in the home. Only the clothing image data and product image data for which usage rights have been acquired are stored.

  The image processing server 53 synthesizes a try-on image when the user tries on the clothes based on the image data of the specified clothes and the body image data of the user in the home by computer graphics processing, to the customer. It is a server that executes the electronic fitting service provided. The image processing server 53 generates a try-on image in a plurality of poses of the user, geometric conversion such as rotation and enlargement / reduction of the try-on image, and generation of an animation in which the customer operates while trying on clothes. Or do it.

  The access point 54 is equipped with a wireless LAN such as IEEE 802.11a / b or a short-range wireless communication means such as Bluetooth, and for example, for wirelessly connecting the portable fitting device 10 possessed by a home user to the home LAN 50. Used for. For example, the access point 54 constantly transmits a beacon to detect the portable fitting device 10. Then, using DHCP or the like, a recognizable IP address is dynamically assigned to the detected portable try-on device 10 so that the portable try-on device 10 can be connected to the home LAN 50. When both the home LAN 50 and the portable try-on device 10 support IPV6, the portable try-on device 10 can be connected to the home LAN 50 without having to dynamically assign an IP address.

  Although only a single home LAN 50 is depicted in FIG. 1, there are actually numerous homes scattered throughout the country, and many home LANs exist on the computer network 1. Please understand.

  In FIG. 1, the local database server 52 and the image processing server 53 are shown as different computers. However, a single computer may be equipped with both server functions. Needless to say. The gateway 51 is preferably configured as a computer independent of the local database server 52 or the image processing server 53 in consideration of security. Of course, these computers have two or more server functions. You may have it.

  The portable fitting device 10 is configured, for example, in the form of a PDA or other small information processing terminal, and includes a calculation function for processing a fitting synthetic image and a display for displaying the fitting synthetic image.

  Also, the portable fitting device 10 is more preferably equipped with a wireless LAN such as IEEE 802.11a / b or a short-range wireless communication means such as Bluetooth. In such a case, the portable fitting device 10 is connected to the retail LAN 20 via the access point 24 installed on the retail LAN 20 or via the access point 54 installed on the home LAN 50. To the home LAN 50 and further to the Internet via the gateway 21 or 51 on each LAN 20 or 50. Alternatively, the portable fitting device 10 may have a mobile phone function such as PDC (Personal Digital Cellular), and may be connected to the Internet 60 via a mobile phone network and a public telephone network (both not shown).

B. Clothes ID
In this embodiment, identification information (ID) is assigned to each garment displayed in the boutique in order to manage the garment data used to synthesize the fitting image. The ID of each garment is displayed using a format such as a one-dimensional barcode, two-dimensional barcode, cybercode, or RF-ID (described above). The portable fitting device 10 is equipped with an ID reading function for reading identification information (ID) attached to clothes displayed in a store such as a boutique.

  Here, the one-dimensional barcode is configured by arranging barcodes such as JAN and ITF codes on a straight line (see FIG. 2).

  The two-dimensional barcode is a barcode display method having information in the horizontal and vertical directions, that is, in the two-dimensional direction. A two-dimensional barcode scanner as an ID reading means needs to recognize and read a two-dimensional barcode as a surface.

  Two-dimensional barcodes are roughly classified into a stack type and a matrix type (http://www.barcode.co.jp/barcode/2-toku-syu.html). The stack type is a barcode in which information is displayed vertically and horizontally by vertically stacking one-dimensional barcodes, and is a structure in which one-dimensional barcodes are reduced and stacked vertically in multiple stages (see FIG. 3). ). The symbol is expressed by a thin bar and a thick bar (or a thin space and a thick space) as in the one-dimensional barcode, and the reading method is substantially the same as that in the one-dimensional barcode. The matrix type is a bar code in which information is displayed in a vertical and horizontal mosaic pattern with black and white alternating cells (cells) (see FIG. 4). In order to identify the data columns, each column has a start symbol and a stop symbol, and is decoded as data when all columns are read regardless of which column is read.

  The cyber code is a kind of two-dimensional bar code. As shown in FIG. 5, a “guide bar display area” for indicating the location of the cyber code and a “code code” for displaying a two-dimensional code pattern. Pattern display area ”. The code pattern display area is composed of cells arranged in an n × m matrix (7 × 7 in the figure), and identification information can be given by expressing each cell in white or black. . However, the corner cells at the four corners of the code pattern display area are always black patterns as registration patterns, not as identification information. The cyber code recognition procedure includes a step of binarizing a captured image, a step of finding a guide bar candidate from the binary image, and a step of searching for a corner cell based on the position and direction of the guide bar And decoding the image bitmap pattern in response to detecting the guide bar and the corner cell. Further, by checking the error bit, it is possible to confirm that the correct cyber code is included in the captured image and to derive identification information and position information of the code. Further, based on the position of the corner cell, distortion caused by the tilt of the camera or object can be calculated and compensated. Details of the cyber code can be found in, for example, Japanese Laid-Open Patent Publication No. 2000-82108 (“2D code recognition processing method, 2D code recognition processing device, and medium”) already assigned to the present applicant. Is also disclosed.

  The RF-ID is used by a combination of an RF tag attached to the clothes side and an RF-ID reading unit that reads an ID from the RF tag. FIG. 6 is a functional block diagram for explaining the operation of reading the RF-ID from the RF tag. In the illustrated example, an electromagnetic transmission / reception system is adopted for wireless transmission / reception. More preferably, the RF tag carrying ID information is attached to the clothing side, and the reading unit for reading the RF-ID from the RF tag is provided on the portable fitting device 10 side.

  The RF-ID reading unit on the side of the portable fitting device 10 amplifies a radio wave of a specific frequency (135 kHz in the illustrated example) oscillated by an oscillator and outputs it to the outside via an RF transmitting / receiving antenna. On the other hand, as a result of holding the portable fitting device 10, the RF tag is close to the RF transmission / reception antenna and can receive radio waves. The coil antenna in the RF tag resonates with the received radio wave, thereby storing resonance energy. The modulator is driven by electric energy obtained by converting the accumulated resonance energy, modulates the received radio wave (for example, AM modulation), and generates a modulation frequency corresponding to the ID assigned to the clothes, Output via coil antenna. The RF transmitting / receiving antenna receives a radio wave having a modulation frequency from the RF tag, and the decoder decodes identification information (RF-ID) assigned to the modulation frequency.

  In realizing the present invention, the form of expressing the clothes ID is not particularly limited, and the clothes ID may be indicated by any one of a one-dimensional barcode, a two-dimensional barcode, a cyber code, and an RF-ID. Or you may employ | adopt systems other than the above.

  By the way, in the apparel industry, since 1993, to promote QR (quick response) as a measure to modernize the textile industry, we have performed source marking with a JAN code that is a one-dimensional barcode and one of the comprehensive standard barcodes. It was coming. Currently, it is in the transition to a system using a two-dimensional barcode such as QR code or PDF.

C. Electronic computer fitting service On the computer network 1 according to the present embodiment, by linking the portable fitting device 10 possessed by the user, the table-type display 42 in the restaurant, and the image processing server 23 in the retail shop, An electronic try-on service can be used from anywhere, and a try-on image synthesized as if a user tried on a specific garment can be viewed regardless of location.

  For example, an organic EL display is placed on the cafe table, so you can enjoy information that you couldn't try on at a boutique while relaxing at the cafe and talking to friends on a larger screen than a PDA. As such conversations bounce, it is possible to return to the boutique again to buy clothes that are “this is good”. Alternatively, online shopping can be enjoyed by connecting to the Internet 60 via a PDA or a table-type display 42. At this time, if the store number of the retail shop that provided the original clothing data is always reflected, the retail shop side will be incentivized to participate in the shopping format using the electronic fitting service. Can be given.

  The electronic fitting service provided on the computer network 1 according to the present embodiment has the following features.

(1) Site orientation:
By acquiring the clothes ID on the spot from the clothes you like at the store, you can access the related clothes data.
(2) Immediate:
For example, by accessing a store network, clothing data can be acquired from a database. A 3D clothing image can be synthesized and a fitting image can be displayed instantaneously. (3) Realism:
Even on a small screen, it is possible to display a try-on image that allows a customer to grasp a try-on image to some extent.
(4) Privacy protection:
Personal data such as a customer's body image is recorded and protected on removable media (to be described later) with a data access protection function such as a memory stick.
(5) Reproducibility of experience:
The customer can store the accessed clothing data for a certain period and confirm the try-on image again later.
(6) Amusement:
Various images such as try-on images can be transformed. For example, when a Y-shirt is selected, the customer's enjoyment is increased by providing a function of displaying a combination of ties and suits that match the Y-shirt and a function of designing a color and a pattern by the customer.
(7) Real-time performance:
It can support real-time relay of try-on images.
(8) Interactivity:
The display form of the fitting image can be controlled by the customer.
(9) Super reality:
It makes video and sound that cannot be experienced in reality appear as if they were real.

  Hereinafter, an overall flow of an electronic try-on service that combines and displays a try-on image of a user trying on clothes will be described.

  The user carries the portable fitting device 10 and visits a boutique where clothes are displayed. When the portable fitting device 10 reads the information of the ID 25 attached to the clothes displayed in the boutique, the portable fitting device 10 accesses the local database server 22 connected to the intra-retail LAN 20 and collates the ID 25. Corresponding clothing image data can be read out. The image data of clothes mentioned here is not limited to still images, but includes moving images such as animation. Furthermore, the image data may be either a two-dimensional image or a three-dimensional image data.

  If the corresponding clothing image data is not stored in the local database server 22 on the retail LAN 20, it passes through the gateway server 21 to the remote database server 32 connected to the data center LAN 30. By accessing, image data of clothes corresponding to the ID 25 may be downloaded to the local database server 22. Here, it is desirable to form a VPN (Virtual Private Network) between the gateway 21 and the gateway 31 in consideration of safety of transfer data such as copyright protection and rights protection for other content usage.

Next, the personal image data created based on the user's individual body shape data or the photographed whole body image data, and the clothing image data retrieved corresponding to the ID 25 are stored in the image processing server. 23. Then, the result of the image composition is displayed on a display on the portable fitting device 10 or a display device (monitor display such as a PC monitor, a TV receiver, or a mirror display) 26 installed in the boutique. Has been.
The personal body shape data or the captured whole body image data used for the synthesis of the fitting image is the portable fitting device 10, the local database server 22 on the retail LAN 20, the remote database server 32 on the data center LAN 30, or the home. It is stored in one of the local database servers 52 on the internal LAN 50.

  Personal body shape data and captured whole body image data are personal information, and if leaked without permission, the privacy of the user may be infringed. Therefore, from the viewpoint of privacy protection, it is desirable to store personal body shape data and captured whole body image data after encryption. In addition, when these body shape data and captured whole body image data are stored in the local database server 52 on the home LAN 50, a VPN is formed between the portable fitting device 10 and the gateway 51, and the local It is desirable that the data is once downloaded from the database server 52 to the portable fitting device 10 and then the downloaded personal data is transmitted again from the portable fitting device 10 to the image processing server 23.

  In still another embodiment, the following configuration is provided for the purpose of further strengthening the privacy protection of personal data. The portable fitting device 10 reads the information of the ID 25 attached to the clothes displayed in the boutique, and then accesses the local database server 22 connected on the retail LAN 20 to check the clothes corresponding to the ID 25. Read image data. The read clothes image data is transmitted to the portable fitting device 10. The personal data is stored in either the portable fitting device 10 or the home local database server 52 where privacy is ensured, and is not supplied to the outside.

  More preferably, the personal data is stored in a semiconductor memory or a solid recording medium that can be read by being mounted on the portable fitting device 10, thereby reducing the opportunity to access the personal data from the outside as much as possible. Furthermore, in order to increase the safety of privacy, it is desirable to restrict users, processes, tasks, applications, and the like that can access the personal data.

  The user of the portable try-on device 10 is allowed to hold the combined try-on image data and the corresponding clothing data stored in a storage area readable and writable by the portable try-on device 10 as necessary. .

  Here, the clothing data corresponds to a primary work in accordance with the Copyright Act, and 2 pieces of try-on image data in which the clothing data and the user's personal data (body type data and photographed whole body image data) are synthesized are 2 pieces. It corresponds to the next work. Therefore, it is desirable that the portable fitting device 10 includes means for managing the right to hold or use these works.

  An example of copyright management will be described in detail later, but the copyrighted work must be recorded only on a removable recording medium with a copyright protection mechanism. What is necessary is just to comprise so that a copyrighted work can be used according to use conditions. An example of the removable recording medium is a semiconductor memory such as an MG-R compatible memory stick manufactured by Sony Corporation. FIG. 7 shows the internal structure of an MG-R compatible memory stick. A memory stick is a cartridge-type device that uses a flash memory as a recording medium. When there is data to be written to the memory stick on the portable fitting device 10 main body side, the data is first transferred to the transmission controller of the memory slot via the system bus. Then, the transmission controller serially transfers the write data to the reception controller on the memory stick side. The receiving controller receives the write data and then writes it to a predetermined address in the flash memory.

  If data relating to a copyrighted work is stored and no conditions regarding the use of the data are set, a distribution method may be applied such that the copyrighted work does not remain on the portable try-on device 10 for enjoying a try-on image. For example, after personal data is transmitted from the portable fitting device 10 or the home local database server 52 to the image processing server 23, image synthesis with clothing data corresponding to ID25 is performed, and an MPEG (Moving Picture Experts Group) is performed. 2 or after data compression using an image compression method such as MPEG4 or MPEG7, this is stream-distributed to the portable fitting device 10 and viewed using an MPEG player on the portable fitting device 10. Is possible. According to the stream distribution, data is not left after being played back by the MPEG player, so there is no concern that the copyrighted work is used without permission.

  As another embodiment, when the user does not satisfy a specific condition regarding the use of a copyrighted work, software with a copyright protection function provided with means for preventing the read data from being reused is installed on the portable try-on device 10. You just have to install it. That is, by the operation of the software with the copyright protection function, the clothing data is transmitted from the local database server 22 or the like in the boutique to the portable try-on device 10 and the personal image data (body type data or photographed whole body image data). Can be combined with the portable fitting device 10 to allow the user to view the synthesized fitting image in a state where it cannot be reused.

  When clothing data or synthetic fitting image data is recorded on a removable recording medium with a copyright protection function such as an MG-R compatible memory stick, the recording medium reader and display 42 installed in the restaurant (for example, A composite fitting image can be viewed using a table-type display, wall display, electronic paper, or the like. Here, it is preferable that the recording medium reading device and the display 42 (at least including a CPU (Central Processing Unit), a graphic server, and a storage device) are integrally formed in the shape of a cafe table.

  Furthermore, if necessary, a user who operates the table-type display 42 can access a system in the boutique having the authority to manage the clothing data or a related information provider (not shown) on the Internet 60 via the restaurant LAN 40. ), It is possible to search related data or connect to an online sales system (not shown). It goes without saying that the user's own home LAN 50 can be accessed via the restaurant LAN 40 and the Internet 60.

D. Configuration of Portable Try-On Device FIG. 8 illustrates an example of the internal hardware configuration of the portable try-on device 10 applicable to the computer network 1 according to the present embodiment. The portable fitting device 10 shown in the figure is configured as a raster display system architecture with a built-in peripheral display processor.

  The CPU 81 that is the main controller of the system 10 executes various applications under the control of an operating system (OS). For example, an application for client processing in the electronic try-on service according to the present embodiment is executed by the CPU 81.

  As shown in the figure, the CPU 81 is interconnected with other devices (described later) by a system bus 89. Each device on the system bus 89 is given a unique memory address or I / O address, and the CPU 81 can access each device on the system bus 98 by these addresses.

  The system memory 82 is used for loading a program (application program, graphics package, and operating system) to be executed on the CPU 81 and holding work data for the execution. Here, the system memory 82 is configured by a ROM (Read Only Memory), a RAM, or a combination thereof.

  The display processor 83 is a dedicated processor that executes graphics functions such as scan conversion and raster processing independently of the CPU 81.

  The display processor memory 84 is used to hold program codes and work data for executing scan conversion and raster processing on the display processor 83.

  The frame buffer 85 is for image refreshing independent of the system memory 82 for temporarily storing, for each frame, displayable image data created by scan conversion and raster processing on the display processor 83. Memory.

  The video controller 86 controls display driving on the monitor display 87 and displays the image data temporarily held on the frame buffer 85 on the monitor display 87. The monitor display 87 includes, for example, a liquid crystal display (LCD), a cathode ray tube (CRT) display, an organic EL display, or the like.

  The peripheral device interface 88 is an interface device for connecting various peripheral devices on the system bus 89. Peripheral devices mentioned here include a keyboard 88A, a mouse 88B or other form of user input device, a wireless communication device 88C for exchanging wireless data with the access point 24/54, a hard disk An external storage device such as a drive 88D, a memory slot 88E in which a portable semiconductor memory device such as a memory stick is detachably mounted are included.

  FIG. 9 illustrates another example of the internal hardware configuration of the portable fitting device 10 that can be applied to the computer network 1 according to the present embodiment. The portable fitting device 10 shown in the figure is configured as a raster display system architecture.

  The CPU 91 which is the main controller of the system 10 executes various applications under the control of the OS. For example, an application for client processing in the electronic try-on service according to the present embodiment is executed by the CPU 91.

  As shown in the figure, the CPU 91 is interconnected with other devices (described later) by a system bus 98. Each device on the system bus 98 is given a unique memory address or I / O address, and the CPU 91 can access each device on the system bus 98 by these addresses.

  The system memory 92 is used for loading a program (application program, graphics package, and operating system) to be executed on the CPU 91 and holding work data for the execution. Here, the system memory 92 is configured by ROM, RAM, or a combination thereof.

  The display processor 94 is a dedicated processor that executes graphics functions such as scan conversion and raster processing independently of the CPU 91.

  The video controller 95 controls display driving on the monitor display 96 and displays the image data temporarily held on the frame buffer 93 on the monitor display 96. The monitor display 96 is composed of, for example, an LCD, a CRT display, an organic EL display, or the like.

  In the configuration example shown in FIG. 9, a frame buffer 93 for holding image data created by scan conversion and raster processing is adopted as a part of the system memory 92 by adopting the single address space method. Yes. Therefore, the CPU 91, the video controller 95, and the display processor 94 can all access the system memory 92.

  In the configuration example shown in FIG. 9, since the video controller 95 is a dual port, the frame buffer 93 can be accessed without restricting the system bus 98. Another possible way to avoid tying up the system bus 98 is to configure the CPU 91 to have, for example, an instruction or data cache memory. Further, the display processor 94 may be configured to incorporate a dedicated memory for algorithms and storage processing.

  The peripheral device interface 97 is an interface device for connecting various peripheral devices on the system bus 89. Peripheral devices mentioned here include a keyboard 97A, a mouse 97B or other form of user input device, a wireless communication device 97C for exchanging wireless data with the access point 24/54, a hard disk An external storage device such as a drive 97D and a memory slot 97E in which a portable semiconductor memory device such as a memory stick is detachably mounted are included.

  FIG. 10 illustrates still another example of the internal hardware configuration of the portable fitting device 10 that can be applied to the computer network 1 according to the present embodiment. The portable fitting device 10 shown in the figure is configured as a vector (random scan) display system architecture.

  The CPU 101 that is the main controller of the system 10 executes various applications under the control of the OS. For example, an application for client processing in the electronic try-on service according to the present embodiment is executed by the CPU 101.

  As illustrated, the CPU 101 is interconnected with other devices (described later) by a system bus 106. Each device on the system bus 106 is assigned a unique memory address or I / O address, and the CPU 101 can access each device on the system bus 106 using these addresses. .

  The system memory 102 is used for loading a program (application program, graphics package, and operating system) to be executed on the CPU 101 and holding work data for the execution. Here, the system memory 102 is configured by ROM, RAM, or a combination thereof.

  The display processor 103 is a dedicated processor that executes graphics functions such as scan conversion and raster processing independently of the CPU 101.

  In the example illustrated in FIG. 10, the display processor 103 is called a “display processing unit (DPU)” or a “graphics controller”. The display processor 103 includes an instruction set and an instruction address register, and performs typical processing such as instruction reading (decoding) and an execution cycle as in a normal computer. Since this type of display processor 103 does not have a pixmap, it is desirable to execute the program 30-60 times per second in order to be able to generate a flicker-free display output. A program executed by the display processor 103 is usually placed in a system memory 102 shared by the CPU 101 and the display processor 103. The display processor 103 may be configured to store a program by incorporating a dedicated memory.

  In general, the display processor is configured to perform pipeline processing by dividing it into a geometric subsystem block and a raster processing block in order to speed up rendering calculation.

  FIG. 11 shows peripheral devices connected to the peripheral device interface 88, 97, or 105 of the portable fitting device 10. Peripheral devices required at a minimum to properly implement the present invention are a wireless communication unit 110, an ID detection unit 111, and a removable storage medium connection unit 112. However, as already described with reference to FIGS. 8 to 10, the portable fitting device 10 may be equipped with, for example, a user input device or an external storage device as a peripheral device.

  The wireless communication unit 110 conforms to a wireless standard defined by the FCC (Federal Communication Commission) such as IEEE 802.11a / b, Bluetooth communication, or UWB (Ultra Wide Band). A hardware configuration conforming to the wireless communication system is provided.

  The ID detection unit 111 includes a one-dimensional barcode (see FIG. 2) or a two-dimensional barcode (see FIGS. 3 and 4), a cyber code (see FIG. 5), an RF-ID, and the like. A hardware configuration such as a barcode reader, an image recognition device, and an RF-ID reading device for reading a clothing ID expressed in the format is provided. Alternatively, hardware such as a barcode reader that changes a two-dimensional or three-dimensional barcode in time series in a moving image manner may be provided.

  The removable storage medium connection unit 112 is a flash memory (for example, a memory stick developed and manufactured by Sony Corporation (see FIG. 7), an SD memory card developed by SanDisk, Matsushita, and Toshiba). The detachable storage medium 113 is detachably mounted and has hardware capable of reading and writing to the memory.

  The detachable storage medium connection unit 112 includes a detachable storage medium 113 equipped with a copyright protection function (for example, an MG (Magic Gate) memory stick (see FIG. 7) manufactured by Sony Corporation) or an SD memory. Corresponding to a card etc., an encryption part and a decryption part may be included. For example, the SD memory card is compliant with SDMI (Secure Digital Music Initiative), which is a security level required by a music distribution system, and the copyright protection mechanism includes four companies (4C, IBM, Intel, Matsushita, and Toshiba). CPRM (Content Protection for Recordable Media) proposed by Entity LLC) is adopted. In this case, the removable storage medium connection unit 112 includes a CPRM encryption unit (not shown).

  The MG memory stick also has a copyright protection function conforming to the SDMI standard. When making the portable fitting device 10 compatible with the MG memory stick 113, the MG memory stick connection unit 112 includes a dedicated hardware circuit for performing authentication and encryption for copyright protection, The system memory 82, 92 or 102 has an individual “key” (device ID 1). This device ID may be stored in a dedicated memory in a dedicated hardware circuit in the MG memory stick connection unit 112. Also, the memory stick key (device ID 2) is stored in the memory inside the MG memory stick 113. When the CPU 81, 91, or 101 accesses the MG memory stick 113 (reads / writes data), the authentication hardware reads the device ID 1 from the system memory 82, 92, or 102, and further, the MG memory stick 113. By reading the device ID 2 from the mobile phone, it is authenticated that the portable fitting device 10 and the MG memory stick 113 are not illegally connected to each other. That is, in this case, the removable storage medium connection unit 112 includes a dedicated hardware circuit that performs authentication and encryption, and authentication is performed when the removable storage medium 113 is attached to the removable storage medium connection unit 112. It is comprised so that it may perform.

  It should be noted that programs such as device drivers and service software corresponding to each of the three hardware blocks specified in FIG. 11 are normally stored in the system memory 82, 92, or 102. It goes without saying that the CPU 81, 91, or 101 is configured to perform a service using each hardware block by using these programs.

  8 to 10 and FIG. 11 only describe hardware components essential to the present invention. That is, it goes without saying that in order to make the system operate completely, it is necessary to supplement various circuit components that can be conceived by those having ordinary knowledge of computer hardware.

  8 to 10 can be applied not only to the portable fitting device 10 but also to the image processing server 23 or 53 or the table type display 42. In the case of the image processing server 23 or 53, it is common to have a large capacity (several GB or more) hard disk drive (HDD) as one of the devices connected to the peripheral device interface. .

E. Processing on portable fitting device Next, FIG. 12 shows image composition processing of image data of a fitting object such as a boutique (thing that can be worn on the body such as clothes, glasses, wigs, accessories) and body image data. The operation | movement on the portable fitting device 10 which concerns on is shown in the format of the flowchart. The operation is actually realized in a form in which the CPU 81, 91, or 101 executes a predetermined service application. Hereinafter, with reference to the flowchart shown in FIG. 12, the operation on the portable try-on device 10 related to the image composition process of the clothing image data and the body image data will be described in detail.

  First, the portable try-on device 10 checks whether or not the ID of the clothing to be tried on has been read in step S10.

  In this embodiment, the portable fitting device 10 is equipped with ID reading means (see FIG. 11). For example, if the ID is a barcode, the ID reading means is a barcode reader, and if the ID is transmitted by an active medium such as RF-ID, the ID reading means is an RF-ID reader (see FIG. 6). The barcode is a one-dimensional barcode (see FIG. 2), a two-dimensional barcode (see FIG. 3 or FIG. 4), a cybercode (see FIG. 5), or a moving image. A one-dimensional or two-dimensional barcode may be changed in time series.

  Next, in step S11, the portable try-on device 10 stores the image data (two-dimensional data or three-dimensional data) related to the product indicated by the ID in the storage means of the user's personal terminal for secondary use. Is permitted, that is, if the image data is regarded as a copyrighted work, it is checked whether or not there is a right to use the copyrighted work.

  Such copyright use right check is performed on, for example, a semiconductor memory with a copyright protection mechanism, and the copyright information for writing and reading the copyrighted work data relating to the ID product is stored in the semiconductor memory. It can be done in a form that checks whether it is recorded.

  If it is determined in step S11 that the portable try-on device 10 has the copyrighted work use right, the process proceeds to step S12, and the image data corresponding to the ID or the image data is synthesized using the image data. The composite image data is downloaded to the portable fitting device 10 and stored in a storage means (for example, a flash memory) with a copyrighted material protection mechanism for use.

  In step S12, it is first checked whether or not the privacy protection mode is set.

  The “privacy protection mode” here refers to setting whether or not personal data can be read by another computer. That is, when the privacy protection mode is set, reading by other computers is prohibited, while when the privacy protection mode is not set, reading by other computers is permitted.

  If it is determined in step S12 that the privacy protection mode is set, the process proceeds to step S15, and a processing procedure for performing image composition processing for synthesizing a fitting image in the portable fitting device 10 is performed. On the other hand, if it is determined that the privacy protection mode is not set, the process proceeds to step S13, and a computer other than the portable fitting device 10 (for example, an expensive external device with enhanced image processing functions such as the image processing server 23). A processing procedure for performing an image composition process for composing a fitting image is performed.

  Here, a case where it is determined that the privacy protection mode is not set will be described first. In this case, the personal data is permitted to be read by an external computer that performs image composition processing, and the process proceeds to step S13. More specifically, after transferring personal body data or captured personal body video data to the image processing server 23, for example, the image processing server 23 generates the body based on the body data. The image data or the captured personal body video data and the clothing image data corresponding to the ID detected in step S10 are synthesized.

  Therefore, in step S <b> 13, the portable try-on device 10 requests the image processing server 23 to perform image composition processing. This processing will be described later as processing in the image processing server 23 with reference to FIG.

  Next, in step S14, a standby state is entered until a composite image downloaded from the image processing server 23 is received. When the composite image is received in step S14, the process proceeds to step S18, where the received composite try-on image is displayed on a monitor display (liquid crystal display, electronic paper, organic EL monitor, etc.) provided in the portable try-on device 10. A series of composite fitting ends the image display process. Here, the synthesized fitting image may be a two-dimensional image, a three-dimensional image, or an animation format.

  Focusing on step S12 again, the case where it is determined that the privacy protection mode is set and the process proceeds to step S15 will be described. In such a case, the personal data cannot be read by an external computer. Therefore, the portable try-on device 10 performs the image composition process for synthesizing the user's try-on image in the portable try-on device 10 instead of the image processing server 23 without outputting personal data such as body image data to the outside. To do.

  In order to perform the fitting image synthesis, it is necessary to download the clothing image data corresponding to the ID detected in step S10. For this purpose, in step S15, the portable try-on device 10 transmits the clothes ID detected from the desired clothes to the local database server 22, and sends the clothes image data corresponding to the ID to the portable try-on device 10. Request to send to. Alternatively, clothing image data stored in the local database server 52 on the home LAN 50 can be used.

  Next, in step S16, a standby state for receiving clothing image data is entered. When the clothing image data is received, the process proceeds to step S17, and a separately defined try-on image composition process is performed. The fitting image synthesis process will be described in detail later with reference to FIG. The clothing image data received on the home LAN 20 is also stored in the local database server 52 when the right to use it is obtained, so that it can be used again later when trying on electronic clothes again. It may be.

  Finally, when the try-on image composition processing is completed, the process proceeds to step S18 as before, and a try-on image synthesized as if the user tried on clothes is displayed. Here, the synthesized fitting image may be a two-dimensional image, a three-dimensional image, or an animation format.

  If it is determined in step S11 that there is no right to use the copyrighted work, the process proceeds from branch No of the determination block S11 to (1), and the processing procedure is performed according to the flowchart shown in FIG.

  First, in step S20, “copyright use right acquisition processing” is performed. In realizing the present invention, the form of the copyrighted work right acquisition process is not particularly limited. For example, a billing procedure for acquiring the right to use a copyrighted work is performed between the portable fitting device 10 possessed by the user and the boutique via a network using electronic commerce or the like.

  Subsequently, in step S21, it is determined whether or not the user, that is, the portable fitting device 10 has acquired the copyrighted work use right. If it is determined that the right to use the copyrighted work has been acquired, the process proceeds from branch Yes to (2) and returns to step S12 in the flowchart shown in FIG.

  On the other hand, if it is determined in step S21 that the right to use the copyrighted work has not been acquired, the process proceeds to step S22. In step S22 and subsequent steps, the image data corresponding to the clothes ID designated by the user cannot be downloaded in a form that can be secondarily used in the portable fitting device 10, so that the combined image data can be viewed by stream distribution. Processing that can be performed is performed.

  First, in step S22, the privacy protection mode is checked in the same manner as in step S12 shown in FIG.

  In the subsequent processing of step S23, the image processing server 23 is requested to perform image processing, as in the case of step S13 shown in FIG. At this time, by notifying the image processing server 23 that “there is no copyrighted work use right”, the image processing server 23 transmits the composite try-on image by stream distribution after the image composition is completed. Alternatively, the composite try-on image is transmitted by a transfer method that cannot be reused on the receiving side. This process will be described later with reference to FIG.

  Finally, in step S24, the portable fitting device 10 uses the software program corresponding to the stream distribution to display the received synthetic fitting image in real, and ends a series of synthetic fitting image display operations. Here, the synthesized fitting image may be a two-dimensional image, a three-dimensional image, or an animation format.

  Subsequently, a process for displaying a composite image when the portable fitting device 10 can use clothes image data written on a removable storage medium (semiconductor memory, optical disk, etc.) that can be attached to and read from the fitting device. The procedure will be described. In this case, it is assumed that personal data such as the user's body image data is also held in the storage means on the portable fitting device 10 side. Therefore, the portable try-on device 10 can synthesize all the try-on images independently without depending on a computer other than the portable try-on device 10 (for example, the image composition server 23).

  FIG. 14 shows a processing procedure for displaying a composite image using clothes image data embedded below in a readable / writable removable storage medium in the form of a flowchart. This processing procedure is realized, for example, in a format in which the CPU 81/91/101 of the portable fitting device 10 executes a predetermined service application. Hereinafter, description will be given with reference to the flowchart shown in the drawing.

  In step S30, the portable fitting device 10 checks whether or not the ID of the clothing to be tried on has been read. The portable fitting device 10 is equipped with ID reading means for fitting objects (described above). For example, if the ID is a barcode, the ID reading means is a barcode reader. Further, if the ID is transmitted by active media like RF-ID, it becomes an RF-ID reader (see FIG. 6). The barcode is a one-dimensional barcode (see FIG. 2), a two-dimensional barcode (see FIGS. 3 and 4), a two-dimensional barcode or 3 It may be one that changes the dimensional barcode.

  Next, in step S31, the portable try-on device 10 allows the image data (two-dimensional data or three-dimensional data) relating to the product indicated by the ID to be stored in the storage means of the personal terminal and used secondarily. If the image data is regarded as a copyrighted work, it is checked whether there is a right to use the copyrighted work.

  This copyrighted work right check is performed on a semiconductor memory with a copyright protection mechanism such as an MG-R compatible memory stick. In other words, it is performed in such a form that the copyrighted data relating to the ID product is written and read out in the semiconductor memory to check whether the right information is recorded. In this case, for example, if the ID is in the form as shown in FIGS. 2 to 4, the copyrighted work right check is performed in a stepwise manner according to a procedure (described later) shown in the flowchart of FIG. It is.

  If it is determined in step S31 that there is a right to use the copyrighted work, the process proceeds to step S32, and the image data corresponding to the ID is stored in the database in the removable recording medium attached to the portable fitting device 10. Perform a search.

  If it is determined in step S33 that the clothing image data corresponding to the detected ID has been searched, the process proceeds to step S34. On the other hand, if the clothing image data could not be retrieved, the entire processing routine ends here. Of course, the system may be configured by a software program so as to proceed to step S11 shown in FIG. 12 and continue the processing.

  Next, in step S34, try-on image synthesis processing is performed. This fitting image composition processing is processed according to the processing procedure shown in the form of a flowchart in FIG. 16, but this point will be described later.

  Finally, when the fitting image combining process is completed, the process proceeds to step S35, and the combined fitting image is displayed on the monitor / display of the portable fitting device 10. Here, the synthesized fitting image may be a two-dimensional image, a three-dimensional image, or an animation format.

F. Work use rights check processing Subsequently, a description of the check processing of work use rights. The ID read by the portable fitting device 10 is, for example, a one-dimensional barcode in JAN format (country code, product manufacturer code, product item code, check digit) as shown in FIG. .

  Here, the JAN code is expressed by a 13-digit numerical value and is defined as follows. That is,

(1) Two-digit country code: “49” and “45” for Japan.
(2) Product manufacturer code 5 digits: The number of the company that displays the JAN code (source marking). It is applied to the distribution code center through the Chamber of Commerce and Industry nationwide and numbered.
(3) Product item code 5 digits: A code set and managed by the manufacturer according to the price, capacity, size, packaging form, etc. of the product. In the case of apparel, it is set for each color and size. Up to 100,000 items can be set per manufacturer code.
(4) Check digit 1 digit: This is a code for preventing misreading, and its calculation formula is defined by the JIS standard.

  FIG. 15 shows a processing procedure for checking whether or not the portable try-on device 10 holds a copyrighted work use right relating to clothes data in the form of a flowchart. This processing procedure is realized, for example, in a form in which the CPU 81/91/101 of the portable fitting device 10 executes a predetermined service application. The copyrighted work right check process will be described below with reference to the flowchart shown in FIG.

  First, in step S41, the device ID of the portable fitting device 10 is read. The device ID is permanently stored in the system memory 82/92/102, for example.

  Next, in step S42, the user ID of the portable fitting device 10 is read. The user ID is recorded in the system memory 82/92/102, for example. Alternatively, when the user has a non-contact IC card, the user ID can be read out via an IC card reader (not shown).

  In step S43, the device ID and the user ID acquired in the preceding steps are combined and a personal authentication key is generated by a predetermined personal authentication key generation program.

  Furthermore, in step S44, the copyrighted work right information is read from the removable recording medium inserted in the removable storage medium connection unit 112.

  Next, in step S45, the personal authentication key generated in step S43, the clothing ID acquired from the desired clothing in step S10 or S30, and the copyrighted work usage right information read out in step S44 are written. To the rights check program.

  This copyright check program checks the copyright on the copyrighted work related to the image data corresponding to the clothing ID. More specifically, for example, when the clothing ID is expressed by the JAN code, the product maker code is read out from the clothing ID, and the manufacturer expressed by the manufacturer code is expressed by the personal authentication key. Whether the above-mentioned right to use the copyrighted work is permitted or not to the user, that is, the user to use the clothes image data corresponding to the clothes ID (primary use and / or secondary use of the work). Judge by referring to the information.

G. Try-on image composition processing (offline)
The process of synthesizing a try-on image of a user's desired clothes can be performed by the computer network 1 through cooperative work between the image processing server 23 in the boutique and the user's portable fitting device 10. In the privacy protection mode that does not allow the use of personal data such as body image data of an external computer on the portable try-on device 10 or the home image processing server 53, the image processing server 23 in the boutique is offline. In this state, a fitting image is synthesized.

  FIG. 16 shows, in the form of a flowchart, a processing procedure for synthesizing a try-on image on the portable try-on device 10 or the home image processing server 53 while being offline with the image processing server 23 in the boutique. ing. This processing procedure is realized, for example, in a form in which the CPU 81/91/101 executes a predetermined service application. Hereinafter, the fitting image synthesis process in the offline state will be described with reference to this flowchart.

  First, in step S70, body image data of a wearer of clothes, that is, an individual user is read from the removable storage medium inserted in the removable storage medium connection unit 112 of the portable fitting device 10.

  Next, in step S71, the clothing image data already read into the storage area of the portable fitting device 10 (either a hard disk, a memory stick, a RAM, or a removable storage medium) is attached to the body image data. Based on the body profile data (height, BWH, foot length, shoulder width, etc., size data necessary for fitting) and information such as the body orientation in the image, the size is changed and the orientation is adjusted.

  Finally, in step S72, the clothing image data is synthesized with the body image data to form a try-on image.

H. Try-on image composition processing (online)
It has already been described that the process of synthesizing a try-on image of a user's desired clothes can be performed in the computer network 1 by the cooperative operation of the image processing server 23 in the boutique and the user's portable fitting device 10. It was. For example, when personal data such as the user's body image data is placed outside the privacy protection mode, this kind of personal data can be passed to an external computer with enhanced image processing functions, so that online processing is possible. Is possible. Here, an online fitting image synthesis process by the image processing server 23 in the boutique will be described.

  FIG. 17 shows, in the form of a flowchart, the procedure of offline fitting image composition processing by the image processing server 23 in the boutique. Hereinafter, referring to this flowchart, a description will be given of a try-on image synthesis process performed in an offline state.

  First, in step S13 shown in FIG. 12 or step S23 shown in FIG. 13, the portable fitting device 10 requests the image processing server 23 in the boutique to perform image composition processing. At this time, personal body image data is transmitted in addition to the information on presence / absence of the copyrighted work use right.

  In step S80, the image processing server 23 has already read into the storage area (hard disk, memory disk, RAM, or removable storage medium (CD, DVD, tape, etc.)) on the image processing server 23. Body image data attached to the body image data provided from the portable fitting device 10 (height, BWH, leg length, shoulder width, etc., size data necessary for fitting) and Based on information such as the body orientation in the image, the size is changed and the orientation is adjusted. Of course, in step S80, body image data and body profile data may be acquired by requesting the portable fitting device 10 interactively.

  Next, in step S81, a try-on image representing a state in which the user tried on a desired garment is constructed by synthesizing the garment image data with the body image data.

  Thereafter, on the image processing server 23, the presence / absence of the copyrighted work use right is checked based on the information provided from the portable fitting device 10 in step S82. Similarly, the portable fitting device 10 checks whether or not there is a copyrighted work use right in step S83. Of course, the image processing server 23 may make an inquiry about whether or not there is a copyrighted work use right to the portable fitting device 10 in step S82.

  Here, if it is determined that the user, that is, the portable fitting device 10 has the copyrighted work use right, the process proceeds to step S84 and the fitting image data is transmitted. In step S85, the portable fitting device 10 downloads and receives the fitting image data.

  On the other hand, if the image processing server 23 determines in step S82 that the portable try-on device 10 does not have the right to use the copyrighted work related to the clothing image data, the image processing server 23 proceeds to step S86 and performs the software program for stream distribution. Is used to start stream delivery to the portable fitting device 10. The stream distribution processing includes encoding of a synthetic fitting image and transmission processing of the encoded data.

  On the other hand, if it is determined in step S83 that the portable try-on device 10 itself does not have the copyrighted work use right for the clothing image data, the process proceeds to step S87, where a software program for receiving the stream is installed. Starts up and waits to receive streamed data. Then, the stream distribution data received from the image processing server 23 is received and decoded.

  Stream distribution is a real reproduction technique of distribution contents in which a user does not reproduce a file after downloading it, but reproduces it while downloading. Currently, as a well-known content distribution system that implements streaming technology, for example, “Real System G2”, “Windows (registered trademark) Media Technologies”, and the like can be cited. According to stream distribution, since data does not remain after being played back by an MPEG player, there is no concern for copyright holders such as boutiques that a copyrighted work such as clothes data is used without permission.

  Although not described above, it goes without saying that, in step S84 and step S86, the image processing server 23 enters a transmission waiting state until the portable fitting device 10 is ready for reception in step S85 or S86.

I. Synthetic try-on image display processing When the user, i.e., the portable try-on device 10 side has a copyright on the work image data, the synthetic try-on image is downloaded from the image processing server 23 or on the off-line portable try-on device 10. You can synthesize fitting images. In this case, the synthesized fitting image data is stored in the system memory 82 (92 or 102) or the removable storage medium 113 of the portable fitting device 10 or the local database server 52 on the home LAN 50, and is replayed. Provided for use.

  The user of the portable try-on device 10 can browse the synthetic try-on image data using a browsing software program (also referred to as “browser”) at any time and place. Here, the fitting image data is preferably configured as a graphic object, and can be converted into various images by graphic processing.

  The viewing software program preferably comprises a graphics operation. The graphics operation mentioned here includes an image composition function with a live-action background, a function for changing the orientation and orientation of a graphic object, and a lighting effect for fitting image data to change the appearance. Functions, a function for enhancing a three-dimensional display effect by combining with a holographic display by a holographic effect, a function for producing an animation effect by connecting several motion poses, and the like.

  For details on graphics operations, see, for example, “Computer Graphics: Principles and Practice (Second Edition in C): James D. Foley, Andrews van Fenh, Steven H. Fehn. , Addison-Wesley, 1996).

  By using these graphics operation functions, the user of the portable fitting device 10 can change the synthesized fitting image based on the synthesized fitting image data. Various poses when you try on clothes, various angles, composition and status with various background images (for example, daytime, nighttime, indoor, outdoor, good weather, cloudy weather, etc.), clothing data texture (pattern) ) Or by creating an effect of creating a standing pose from a sitting pose by an animation effect, you can enjoy the image of yourself trying on clothes in a virtual space.

  As another embodiment, the synthetic fitting image can be browsed on the table type display 42 by using a browsing software program. For example, the table type display 42 is understood to be equipped with the removable storage medium connection unit 112 and / or the wireless communication unit 110 as one of the peripheral devices in the system configuration shown in FIGS. I want.

If this is the case, the removable storage medium 113 is removed from the portable fitting device 10 and reconnected to the removable storage medium connection 112 of the table-type display 42, so that the above-described explanation is given on the table-type display 42. Similarly to the above, it is possible to browse by changing the synthetic fitting image.

  In addition, when the table-type display 42 is equipped with the wireless communication unit 110 that can communicate with the same standard (for example, IEEE 802.11a / b or Bluetooth) as the wireless communication unit of the portable fitting device 10, After the fitting image data is transferred to the memory of the table-type display 42 by communication, the synthesized fitting image can be browsed using the browsing software program.

  Furthermore, as another embodiment, after the try-on image data is transferred from the portable fitting device 10 to the image processing server 53 connected to the home LAN 50 through the access point 54 of the home LAN 50, By using the function, the synthetic fitting image can be browsed by the browsing software program. Alternatively, if the computer connected to the home LAN 50 is configured so that the removable storage medium 113 connected to the portable fitting device 10 can be connected, the removable storage medium 113 is connected to the computer. Thus, after the fitting image data is transferred, the combined fitting image can be browsed by the browsing software program using the function of the image processing server 53 connected to the home LAN 50. The home computer referred to here may be the same as the image processing server 53 or may be another computer connected to the home LAN 50.

  In the embodiment of the present invention described above, the expression “image data” includes not only a still image but also a moving image such as an animation. Furthermore, the image data referred to here may be either two-dimensional image data or three-dimensional image data.

  The electronic fitting service according to the present invention can be realized in whole or in part by a software program. Also, all functions that can be realized by software programs can be realized by hardware such as semiconductors or peripheral circuits. In other words, when speeding up of processing is desired rather than flexibility of processing change, it is desirable to implement functions that can be realized by software programs as hardware.

  Regarding removable storage media, floppy (registered trademark) disk, super disk (large capacity floppy (registered trademark) disk, optical disk (CD-RW, DVD-RAM, etc.), magnetic recording medium (MO, etc.) ) Or a semiconductor memory (flash memory, MRAM (Magnetic RAM), FeRAM (Ferroelectricity RAM), etc.).

  8 to 10, the RAM is replaced with one of DRAM (Dynamic RAM), SDRAM (Synchronous DRAM), RDRAM (Rambus DRAM), IRAM (Intelligent RAM), MRAM, or FRAM. It is possible.

  The present invention has been described in detail above with reference to specific embodiments. However, it is obvious that those skilled in the art can make modifications and substitutions of the embodiment without departing from the gist of the present invention. That is, the present invention has been disclosed in the form of exemplification, and the contents described in the present specification should not be interpreted in a limited manner. In order to determine the gist of the present invention, the claims should be taken into consideration.

  As shown in FIGS. 8 to 10, the portable fitting device 10 described in this specification is used as an internal interface (input / output interface) between LSIs (Large Scale Integrations) on a printed wiring board or between substrates. A configuration example assuming a bus-type architecture such as a PCI (Peripheral Component Interconnect) bus was used. However, even if a “serial transmission” method, which is expected to be a standard for an input / output interface in the future, is adopted in the present invention, the essence of the present invention does not change at all. As a serial transmission method, Motorola Inc. is currently used. And Mercury Computer Systems, Inc. “RapidIO”, which is being standardized mainly, and AMD, Inc. “HyperTransport”, which is being standardized mainly by, and Third Generation I / O (3GIO) whose specifications are mainly created by Intel Corp., and the like.

FIG. 1 is a diagram schematically showing a configuration of a computer network 1 to which an electronic fitting service according to the present invention is applied. FIG. 2 is a diagram illustrating a configuration example of a one-dimensional barcode. FIG. 3 is a diagram showing a configuration example (stack system) of a two-dimensional barcode. FIG. 4 is a diagram showing a configuration example (matrix method) of a two-dimensional barcode. FIG. 5 is a diagram illustrating a configuration example of a cyber code. FIG. 6 is a functional block diagram for explaining the operation of reading the RF-ID from the RF tag. FIG. 7 shows the internal structure of the MG-R compatible memory stick. FIG. 8 is a diagram schematically illustrating an example of the internal hardware configuration of the portable fitting device 10. FIG. 9 is a diagram schematically illustrating another example of the internal hardware configuration of the portable fitting device 10. FIG. 10 is a diagram schematically showing still another example of the internal hardware configuration of the portable fitting device 10. FIG. 11 is a diagram showing peripheral devices connected to the peripheral device interface 88/97/105. FIG. 12 shows the operation on the portable fitting device 10 related to the image composition processing of image data and body image data of an object to be tried on such as a boutique (clothes, glasses, wigs, accessories, etc. that can be worn on the body). It is a flowchart. FIG. 13 is a flowchart showing a processing procedure when it is determined that there is no copyrighted work use right. FIG. 14 is a flowchart showing a processing procedure for displaying a composite image using clothes image data embedded in a removable storage medium that can be read and written by the portable fitting device 10. FIG. 15 is a flowchart showing a processing procedure for checking whether or not the portable fitting device 10 holds a copyrighted work use right related to clothes data. FIG. 16 is a flowchart showing a processing procedure for synthesizing a try-on image on the portable try-on device 10 or the home image processing server 53 while being offline with the image processing server 23 in the boutique. FIG. 17 is a flowchart showing a procedure of offline fitting image composition processing by the image processing server 23 in the boutique.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Computer network 10 ... Portable fitting device 20 ... Retail LAN
DESCRIPTION OF SYMBOLS 21 ... Gateway 22 ... Local database server 23 ... Image processing server 24 ... Access point 26 ... Display apparatus 30 ... Data center LAN
31 ... Gateway 32 ... Remote Data Center 40 ... Restaurant LAN
41 ... Gateway 42 ... Table type display 50 ... Home LAN
51 ... Gateway 54 ... Access point 60 ... Internet 81 ... CPU
82 ... System memory 83 ... Display processor 84 ... Display processor memory 85 ... Frame buffer 86 ... Video controller 87 ... Monitor display 88 ... Peripheral device interface 89 ... System bus 91 ... CPU
92 ... System memory 93 ... Frame buffer 94 ... Display processor 95 ... Video controller 96 ... Monitor display 97 ... Peripheral device interface 98 ... System bus 101 ... CPU, 102 ... System memory 103 ... Display processor 104 ... monitor display 105 ... peripheral device interface 106 ... system bus

Claims (14)

A try-on image generating device that generates a try-on image synthesized based on user body image data and clothes image data,
Means for receiving a request for generating a fitting image to be synthesized based on body image data and clothing image data from a user;
Means for obtaining image data of the requested clothing;
Means for checking whether the user has the right to use the image data of clothes;
Means for synthesizing images based on the user's body image data and clothes image data to generate a fitting image;
Means for sending a try-on image to the user terminal in a manner corresponding to the presence or absence of the right to use the image data of the user's clothing;
A fitting image generating apparatus comprising: The means for transmitting the fitting image to the user terminal transfers the generated fitting image data to the user terminal when the user has a right to use the clothing image data, and relates to the clothing image data. When the user does not have the right to use, the generated fitting image data is streamed to the user terminal or transferred in a format that cannot be reused.
The try-on image generating apparatus according to claim 7. A try-on image generation method for generating a try-on image by combining images based on body image data of a user and image data of clothes,
Receiving a request for generating a fitting image to be synthesized based on body image data and clothing image data from a user;
Obtaining image data of the requested clothing;
Checking whether the user has the right to use the image data of clothes;
Generating a try-on image by combining images based on the user's body image data and clothing image data;
Sending a try-on image to the user terminal in a manner corresponding to the presence or absence of the right to use the image data of the user's clothing;
A fitting image generation method comprising: In the step of transmitting the fitting image to the user terminal, if the user has a right to use the clothing image data, the generated fitting image data is transferred to the user terminal, and the clothing image data is transmitted. When the user does not have the right to use, the generated fitting image data is streamed to the user terminal or transferred in a format that cannot be reused.
The method for generating a try-on image according to claim 3. A try-on image using terminal that uses a try-on image synthesized based on the user's body image data and clothes image data,
ID reading means for acquiring an ID from a desired clothing;
Wireless communication means for wirelessly connecting to a computer network;
Means for checking the use right of the image data of the user's clothing;
Means for receiving a fitting image synthesized based on the body image data of the user and the image data of the clothes, or the image data of the clothes in a method according to the presence or absence of the right to use the image data of the user's clothes; ,
Means for displaying a fitting image;
A fitting image using terminal comprising: If the user does not have a usage right related to the clothing image data corresponding to the ID read from the desired clothing, the device further includes means for executing a predetermined usage right acquisition process.
The try-on image using terminal according to claim 5. The means for receiving the fitting image is:
When the user has the right to use the clothing image data corresponding to the ID read from the desired clothing, try-on image data obtained by synthesizing the user's body image data and clothing image data from a predetermined image processing server. Receive
When the user does not have the right to use the clothing image data corresponding to the ID read from the desired clothing, the try-on image data obtained by synthesizing the user's body image data and the clothing image data from a predetermined image processing server Receiving the stream in the user terminal in a format that cannot be stream received or try-on image data reusable,
The try-on image using terminal according to claim 5. A fitting image generating means for synthesizing the user's body image data and clothing image data;
Under the privacy protection mode for protecting the user's body image data, the clothing image data corresponding to the ID read from the desired clothing is acquired, and the body image data and the clothing image data of the user are combined and imaged. Produces
If it is outside the privacy protection mode, the body image data is transferred to a predetermined image processing server, and a request is made for a fitting image generation process for synthesizing the body image data of the user and the clothing image data.
The try-on image using terminal according to claim 5. A method of using a try-on image using a try-on image synthesized based on the user's body image data and clothing image data,
An ID reading step of acquiring an ID from a desired clothing;
A wireless communication step for wirelessly connecting to a computer network;
A step of checking whether there is a right to use the image data of the user's clothing;
Receiving a fitting image synthesized based on the body image data of the user and the image data of the clothes or the image data of the clothes in a manner depending on whether or not the user has the right to use the image data of the clothes; ,
A step of displaying a fitting image,
A method of using a try-on image, comprising: A step of executing a predetermined use right acquisition process when the user does not have a use right regarding the clothes image data corresponding to the ID read from the desired clothes;
The method for using a try-on image according to claim 9. In the step of receiving the fitting image,
When the user has the right to use the clothing image data corresponding to the ID read from the desired clothing, try-on image data obtained by synthesizing the user's body image data and clothing image data from a predetermined image processing server. Receive
When the user does not have the right to use the clothing image data corresponding to the ID read from the desired clothing, the try-on image data obtained by synthesizing the user's body image data and the clothing image data from a predetermined image processing server Receiving the stream in the user terminal in a format that cannot be stream received or try-on image data reusable,
The method for using a try-on image according to claim 9. A fitting image generating step of synthesizing the user's body image data and clothing image data;
Under the privacy protection mode for protecting the user's body image data, the clothing image data corresponding to the ID read from the desired clothing is acquired, and the body image data and the clothing image data of the user are combined and imaged. Produces
If it is outside the privacy protection mode, the body image data is transferred to a predetermined image processing server, and a request is made for a fitting image generation process for synthesizing the body image data of the user and the clothing image data.
The method for using a try-on image according to claim 9. A computer program written to execute on a computer a process for generating a fitting image obtained by combining images based on body image data of a user and image data of clothes.
A procedure for receiving a request for generating a fitting image to be combined based on body image data and clothing image data from a user;
A procedure for obtaining image data of the requested clothing;
A procedure for checking whether the user has the right to use the image data of clothes;
A procedure for generating a fitting image by combining images based on the user's body image data and clothing image data,
A procedure for sending a try-on image to the user terminal in a manner depending on whether or not the user has the right to use the image data of the user's clothing;
A computer program for executing A computer program written to execute on a computer a process that uses a fitting image synthesized based on the user's body image data and clothing image data.
An ID reading procedure for obtaining an ID from a desired garment;
A wireless communication procedure for wirelessly connecting to a computer network;
A procedure to check for usage rights for image data of the user's clothing;
A procedure for receiving a fitting image synthesized based on the user's body image data and clothing image data, or clothing image data in accordance with whether or not the user has the right to use the clothing image data. ,
The procedure for displaying the fitting image,
A computer program for executing