JP2016040649A - Product and the like providing system, product and the like providing method and product and the like providing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To facilitate a check of whether a product suits oneself in a virtual space in comparison of three-dimensional (3D) modeling information about a user body with product 3D information on the product.SOLUTION: A product and the like providing system is configured to provide products or services to users through user terminals used by the users, and a user terminal 1 comprises: an information acquisition unit 182 that acquires body information about a physical characteristic of the user; a user three-dimensional (3D) information creation unit 169b that creates object data having the physical characteristic reproduced as 3D modeling information displayable in a virtual space; a product and the like 3D information creation unit 861 that creates product and the like 3D information displayable in the virtual space on the basis of product and the like information acquired from a product and the like information distribution server 6 distributedly arranged on a communication network 5; a comparison unit 821 that compares the 3D modeling information with the product and the like 3D information; and a comparison result output unit 169c that outputs a comparison result in the user terminal 1.SELECTED DRAWING: Figure 2

Description

  The present invention provides a product providing system for providing a product such as clothes or a custom-made service to the user through a user terminal used by the user from a communication network constructed by connecting communication paths to each other, The present invention relates to a product providing method and a product providing program.

  2. Description of the Related Art Conventionally, when a consumer purchases a product such as clothes, it is common to determine a product to purchase from a plurality of products by trying on a product that is anxious at a store in advance. However, such a try-on in a real space requires time to go to a store and the trouble of changing clothes, so that there is a problem that it is not possible to actively promote try-on or purchase of a product.

  In order to solve such a problem, for example, there is a system that can synthesize a customer image and a clothing image to create a simulation image of a situation where the customer tried on clothing and monitor a virtual fitting situation. It has been proposed (Patent Document 1).

  The technique disclosed in Patent Document 1 is a technique for simulating the wearing of a product by displaying an image of clothes or the like superimposed on a model image reflecting a consumer's body size. By using the technique disclosed in Document 1, it is possible to determine the purchase of a product without having to try on at a store.

JP 2002-24640 A

  However, in the technique disclosed in Patent Document 1, the input body size is only the height, chest circumference, waist circumference, and waist circumference, and does not completely reflect the characteristics of the user's body. Moreover, the technique disclosed in Patent Document 1 simply displays a product image such as a two-dimensional clothes superimposed on a two-dimensional model image. Therefore, it is difficult for a user who uses the technology disclosed in Patent Document 1 to feel that he / she actually tried it on, and to determine whether or not the product or the like he / she really tried is suitable for himself / herself. There is a problem.

  Therefore, the present invention solves the above-described problems and provides a product providing system, a product providing method, and a product that can easily confirm whether or not the product is suitable for the user in the virtual space. The purpose is to provide such programs.

  In order to solve the above-described problems, the present invention provides a product etc. providing system for providing a product or service to a user through a user terminal used by the user from a communication network constructed by connecting communication paths to each other. In the user terminal, a user 3D that generates physical information related to the physical characteristics of the user and 3D modeling information that can display object data in which the physical characteristics are reproduced in the virtual space. Displayed in a virtual space based on an information generation unit, a product information distribution server that is distributed on a communication network, distributes product information on products or services, and product information acquired from the product information distribution server 3D information generating unit for generating 3D information for possible products, etc., 3D modeling information and 3D for products etc. A comparator for comparing the broadcast, the user terminal, and a comparison result output unit for outputting a comparison result.

Further, another invention is a method for providing a product or the like for providing a product or service to a user through a user terminal used by the user from a communication network constructed by connecting communication paths to each other,
(1) a physical information acquisition unit in which a physical information acquisition unit of the user terminal acquires physical information related to the physical characteristics of the user;
(2) a user 3D information generation unit that generates object data in which physical features are reproduced as 3D modeling information that can be displayed in a virtual space;
(3) a product etc. information acquisition step for acquiring product etc. information related to the product or service from the product etc. information distribution server distributed on the communication network;
(4) a product etc. 3D information generating step in which the product etc. 3D information generation unit generates 3D information such as a product that can be displayed in a virtual space based on the product etc. information acquired from the product etc. information distribution server;
(5) a comparison step in which the comparison unit compares the 3D modeling information with the 3D information such as the product;
(6) The comparison result output unit of the user terminal includes a comparison result output step for outputting the comparison result.

  Here, in the present invention, the product includes, for example, clothes, shoes, hats, accessories such as accessories, and articles such as leisure goods, and the services include custom-made services for these clothes and accessories. , Health check and diet coaching services, medical and welfare services.

  In the present invention, the physical characteristics include partial or total physical characteristics, and the “partial” physical characteristics include, for example, a hand, a face, a foot, and the like outside a part of the body. In addition to the typical shape, size, color, and dry state, internal conditions such as temperature, moisture, and fat content are also included. On the other hand, as `` overall '' physical features, height and body shape, size and shape of each part of the body on the same scale, external features such as the size and shape ratio of each part of the body, weight and body fat percentage, Internal characteristics such as health status are also included. Furthermore, in the present invention, “acquiring body information” means measuring a body part, body temperature, etc. using a measuring device, inputting by a user using an input means, and recording a still image or a moving image by photographing. Etc. are included.

  In the present invention, “output comparison result” means various signals and data such as printout, text information message, voice, video, etc., regarding the match / mismatch between the user 3D information and the product 3D information. Means to output.

  According to the present invention, 3D modeling information called so-called avatar or mannequin information that reflects the user's own physical characteristics in a virtual space, and 3D information such as products that reproduce objects related to products and services as 3D information The user terminal compares the information and outputs the comparison result. Therefore, according to the present invention, for example, when 3D information such as a product is 3D information about clothes, the product fits against mannequin information (3D modeling information) in which the physical characteristics of the user are reproduced. Or a comparison result such as whether the size is large or small is output, and as a result, it is possible to easily confirm whether or not the product is suitable for the user.

  In the above invention, the comparison unit includes a 3D information synthesis unit that synthesizes 3D information such as a product to be compared with 3D modeling information and generates comparison result 3D information that can be displayed in a virtual space. The result output unit preferably outputs the comparison result 3D information generated by the 3D information combining unit in the comparison result. Here, “composite” includes a process of putting 3D information of clothing on a virtual space in the user's avatar (3D modeling information) when the 3D information such as a product relates to clothing or accessories. Includes a modeling process in which clothing and accessories are placed on the surface of the user's avatar and their movements and deformations are synchronized.

  In this case, the comparison result 3D information obtained by combining the 3D information such as the product to be compared with the 3D modeling information is included in the comparison result and output, so that the user's body is dressed in the virtual space. The consistency and coordination image can be visually recognized, and it can be easily confirmed whether or not the product is suitable for the user.

  In the above invention, a comparison result evaluation unit that inputs an evaluation on the comparison result output by the comparison result output unit based on an operation by the user, and evaluation information on evaluation by the comparison result evaluation unit is collected from each user terminal. And an evaluation information storage unit that aggregates and analyzes the evaluation information collected by the evaluation information collection unit, accumulates the analysis result in association with product etc. information, and the comparison unit includes: The comparison is preferably performed by reflecting the analysis result stored in the evaluation information storage unit.

  Here, the “evaluation with respect to the comparison result” is an evaluation with respect to the purchased product or service, and is an evaluation with respect to the purchased product or service. Information is included, and the evaluation includes a positive evaluation such as a match with the comparison result in addition to a negative evaluation such as the size of some or all of the product differing from the comparison result. In addition, a general evaluation regarding a general product / service of a review or reason for return / exchange may be included.

  In this case, real information actually measured by the user can be acquired, and the comparison result can be reflected so as to eliminate the difference between the comparison in the virtual space and the comparison with the real space. As a result, the accuracy of comparison from the next time can be improved, and the credibility of information such as products can be improved.

  In the above invention, the partial or overall physical characteristics of the user included in the physical information are mutually complemented, and the estimated value regarding the predetermined part of the body and the correlation information with the partial or total physical characteristics are obtained. An analysis unit for calculation, a calculated estimated value and correlation information are accumulated, a data accumulation unit for aggregation, and a correction for generating correction data based on the estimated value and correlation information accumulated in the data accumulation unit It is preferable to further include a data generation unit and a data correction unit that corrects an estimated value related to a predetermined part of the user's body calculated by the analysis unit based on the correction data.

  Here, in the present invention, the “predetermined part of the body” is a part to be observed or measured, and includes any part of the body such as waist, bust, shoulder width, and neck circumference. In the present invention, “partially or partially complementing physical features” means that the estimated values are obtained by unifying the conditions (units, scales, etc.) of a plurality of acquired partial and overall information. This means that the shortage of information is compensated by using such as to ensure continuity between information. For example, when creating a whole body photo by joining partially taken body parts, the scale of the taken body part can be unified, or the partially taken body part can be applied to the whole body photo, For example, the scale can be adjusted.

  Further, in the present invention, “correlation information” means a mutual relationship between partial or overall physical characteristics, for example, an external relationship such as a correlation between arm thickness and waist size. In addition, the relationship between external and internal, such as the correlation between arm thickness and body weight or body fat percentage, is also included.

  According to the present invention as described above, based on the physical information related to the partial or overall physical characteristics of the user, the estimated value related to the predetermined part of the body and the correlation information with the acquired physical characteristics (physical information) Can be accumulated and aggregated. The aggregated information can be used as so-called big data. By analyzing the big data, the user can input partial or whole body information, and the estimated value related to a predetermined part of the body can be accurately obtained. It is expected to be able to calculate.

  In the above invention, the information acquisition unit is an imaging unit that images a part or all of the user's body, the analysis unit is an image analysis unit that calculates the body information by analyzing an image captured by the imaging unit, and a user operation And an actual measurement value input unit for inputting an actual measurement value of the user's physical characteristics, and the analysis unit calculates an estimated value and correlation information based on the actual measurement value input by the actual measurement value input unit. Is preferred.

  Here, the image to be photographed by the “photographing unit” may be a still image or a moving image. In this case, since the physical features can be input by a simple operation of taking a picture, the operation can be simplified.

  In addition, physical features that are input as measured values include partial, overall, external, and internal features. As described above, for example, the external features of a part of the body such as hands, faces, and feet. Other external characteristics such as temperature, moisture, fat content and body shape, size and shape of each part of the body on the same scale, and the size and shape ratio of each part of the body , Internal features such as weight and body fat percentage, health status.

  In this case, real information actually measured by the user can be acquired, and the credibility of the stored big data can be improved by correcting the correlation information so as to eliminate the difference between the estimated value and the actually measured value. It can be increased and reflected in calculation of the estimated value from the next time, and the accuracy can be increased.

Further, these product etc. providing system and product etc. providing method can be realized by executing the game program of the present invention described in a predetermined language on a computer. That is, this program is a product providing program for providing products or services to a user through a user terminal used by the user from a communication network constructed by connecting communication paths to each other.
(1) In the user terminal, a physical information acquisition step for acquiring physical information related to the physical characteristics of the user;
(2) a user 3D information generation step of generating object data in which physical features are reproduced as 3D modeling information that can be displayed in a virtual space;
(3) a product etc. information acquisition step for acquiring product etc. information related to the product or service from the product etc. information distribution server distributed on the communication network;
(4) a product etc. 3D information generating step for generating product etc. 3D information that can be displayed in a virtual space based on the product etc. information acquired from the product etc. information distribution server;
(5) a comparison step for comparing the 3D modeling information with the 3D information such as a product;
A process having a comparison result output step for outputting a comparison result is executed.

  According to such an invention, by using the product etc. providing program, a special processing device is not required, and the above-described product etc. providing system and product etc. providing method can be realized in various information processing devices. it can. That is, by installing this program on a general-purpose computer or IC chip and executing it on the CPU, an object control device having the above-described functions can be easily constructed. This program can be distributed through a communication line, for example, and can be transferred as a package application that operates on a stand-alone computer. Such an object control program can be recorded on a computer-readable recording medium, and the system and method described above can be implemented using a general-purpose computer or a dedicated computer. Can be easily stored, transported and installed.

  As described above, according to the present invention, it is possible to easily confirm whether or not the product is suitable for the user in the virtual space.

It is a conceptual diagram which shows the whole structure of the goods provision system which concerns on embodiment. It is a block diagram which shows the internal structure of the clothing matching server which concerns on embodiment. It is a block diagram which shows the internal structure of the user terminal which concerns on embodiment. It is a block diagram which shows the internal structure of the recommendation server which concerns on embodiment. It is a flowchart figure which shows the provision method of goods etc. which concern on embodiment. It is explanatory drawing which shows the display screen displayed by the 3D modeling information creation assistance function which concerns on embodiment. It is a block diagram which shows the internal structure of CPU which concerns on the 3D modeling information creation assistance function which concerns on embodiment. It is a block diagram which shows the internal structure of the information processing part and analysis part which concern on embodiment. It is a block diagram which shows the internal structure of the user 3D information management server which concerns on embodiment. It is a flowchart figure which shows the 3D modeling information creation assistance method which concerns on embodiment.

(Product provision system)
Embodiments of a product etc. providing system according to the present invention will be described below in detail with reference to the accompanying drawings. FIG. 1 is a conceptual diagram showing the overall configuration of a product etc. providing system according to this embodiment. In the present embodiment, a case will be described as an example in which a product is provided so that the user can try on clothes (clothing, shoes, hats, accessories, etc.) through a user terminal used by the user.

  As shown in FIG. 1, the product etc. providing system according to the present embodiment provides a user with a product or service (from a communication network 5 constructed by connecting communication paths to each other through a user terminal used by the user). Hereinafter referred to as a product etc.) on the communication network 5, the user terminal 1, the user 3D information management server 2, the clothing matching server 8, the product etc. information distribution server 6, and the recommendation server. 9 and.

  The communication network 5 is an IP network using the communication protocol TCP / IP, and various communication lines (public lines such as telephone lines, ISDN lines, ADSL lines, optical lines, private lines, wireless communication networks) are mutually connected. It is a distributed communication network constructed by connecting. The communication network 5 includes a LAN such as an intranet (in-house network) or a home network based on 10BASE-T, 100BASE-TX, or the like.

  The wireless base station 3 is a device that is connected to the communication network 5 through the relay device 4, establishes a wireless communication connection with the user terminal 1, and provides calls and data communication by the user terminal 1. The relay device 4 is a node device such as a modem, a terminal adapter, or a gateway device for connecting to the communication network 5, performs communication path selection and data (signal) mutual conversion, and communicates with the radio base station 3. Relay processing with the network 5 is performed.

  The user 3D information management server 2 is a server device that is arranged on the communication network 5 and performs user management and data collection management regarding 3D modeling information. Here, the 3D modeling information is object data in which the physical characteristics of the user are reproduced. Here, the physical characteristics include partial or total physical characteristics, and the “partial” physical characteristics include, for example, one of the body such as a hand, a face, and a foot. In addition to the external shape, size, color, and dry state of the part, internal states such as temperature, moisture, and fat content are also included. On the other hand, as `` overall '' physical features, height and body shape, size and shape of each part of the body on the same scale, external features such as the size and shape ratio of each part of the body, weight and body fat percentage, Internal characteristics such as health status are also included.

  The 3D modeling information includes these physical characteristics (for example, detailed information such as height, weight, chest circumference, waist circumference, waist circumference, shoulder width, upper body length, lower body length). . Furthermore, in addition to the morphological and quantitative characteristics of the entire body composed of skeleton, muscle, subcutaneous fat, etc., internal physical characteristics may be included. In addition, the user 3D information management server 2 includes a Web server, and a server that transmits information such as an HTML (Hyper Text Markup Language) file, an image file, and a music file in a document system such as WWW (World Wide Web). It is a computer or software having its function, stores information such as HTML documents and images, and transmits such information through an IP network such as the Internet in response to a request from client software such as a Web browser.

  The user terminals 1 and 1a are arithmetic processing units equipped with a CPU, which can be realized by a general-purpose computer such as a personal computer or a dedicated device with specialized functions, such as a mobile computer, a PDA (Personal Digital Assistance), It may be a mobile phone. In the present embodiment, the user terminal 1a is a general-purpose computer such as a personal computer using wired communication, and the user terminal 1 is a portable smartphone or mobile phone using wireless communication. In the user terminal 1, a relay point such as a base station and a mobile phone communicate with each other wirelessly and can receive a communication service such as a call or data communication while moving. Examples of the communication system of the cellular phone include an FDMA system, a TDMA system, a CDMA system, a W-CDMA system, third and fourth generation systems, a PHS (Personal Handyphone System) system, and the like. Further, the user terminal 1 is equipped with various functions such as an application software execution function or a position information acquisition function using GPS (Global Positioning System).

  The user terminals 1 and 1a also have a browser function for accessing the communication network 5 and transmitting / receiving data. This browser function is application software for browsing a Web page, downloads an HTML (HyperText Markup Language) file, an image file, a music file, and the like from the communication network 5, analyzes the layout, and displays / reproduces it. It is also possible for a user to transmit data to a Web server using a form, or to operate application software described in JavaScript (registered trademark), Flash, Java (registered trademark), or the like. In the following description, when the user terminal 1 and the user terminal 1a are not distinguished, they are simply referred to as the user terminal 1.

  The product etc. information distribution server 6 is a server device that is distributed on the communication network and is managed by a manufacturer and a store that sells products that distribute product information related to products or services. Here, the goods include, for example, clothing, shoes, hats, accessories such as accessories, and articles such as leisure goods. Services include custom-made services for these clothes and accessories, health checks and This includes dieting coaching services, medical and welfare services. In addition, the product etc. information distribution server 6 of this embodiment shall be a server which the maker who provides goods, such as clothing, manages with respect to a user. Such merchandise information distribution server 6 includes data relating to clothing merchandise (product identification information, price, size information, product image information (two-dimensional image), body information serving as a base when setting the size, etc.). Are transmitted to the clothing matching server 8.

  The clothing matching server 8 is a content server that provides a 3D virtual space that shares 3D virtual space information, and that allows the user to try on 3D modeling information in the 3D virtual space. (World Wide Web), etc., a server computer that builds a three-dimensional virtual space by distributing information such as an HTML (HyperText Markup Language) file, an image file, or a music file, or executing an application, or its function These pieces of information are transmitted through the Internet 5 in response to a request from client software such as a Web browser or a dedicated application. The clothing matching server 8 acquires information on products etc. from the product etc. information distribution server 6 and also acquires 3D modeling information data from the user terminal 1.

  The recommendation server 9 is a server device that analyzes history information (purchase history, try-on execution history, etc.) according to provision of products and the like by the clothing matching server 8 and distributes recommended products as advertisement information to members.

(Internal structure of each device)
Next, an internal structure of each device constituting the above-described product etc. providing system will be described. The “module” used in the description refers to a functional unit that is configured by hardware such as an apparatus or a device, software having the function, or a combination thereof, and achieves a predetermined operation. .

(1) Product etc. information distribution server 6 and clothing matching server 8
As shown in FIG. 2, the product etc. information distribution server 6 includes a communication interface 61, a control unit 62, and a product database 63.

  The product database 63 is a database that stores information about products. As information about products, for example, product information and product images are stored for each product category such as jacket, skirt, sweater, shoes, bags, and accessories. Yes. The product information includes a product category name, product name, product number, color, size, clothing material information, pattern information, clothing type, order number, price, and the like.

  The communication interface 61 is an interface that transmits and receives data to and from the user terminal 1 and other server devices via the communication network 5. Through this communication interface 61, for example, information related to products and the like is transmitted to the clothing matching server 8, and user evaluation, purchase history information, and the like are received from the clothing matching server 8 or the recommendation server 9.

  The control unit 62 includes a processor such as a CPU or DSP (Digital Signal Processor), a memory, hardware such as other electronic circuits, software such as a program having the function, or a combination thereof. It is a module, and various function modules are virtually constructed by appropriately reading and executing a program, and operation control of each unit is performed by each constructed function module.

  In the present embodiment, the control unit 62 performs product sales management, inventory management, and the like, and updates information related to products in the product database 63. In addition, the control unit 62 acquires usage history information and the like from the recommendation server 9.

  On the other hand, the clothing matching server 8 includes a communication interface 81, a virtual space generation unit 85, a user management unit 83, a try-on processing unit 82, an analysis result acquisition unit 84, and a display information generation unit 86. Yes. The communication interface 81 is an interface that transmits and receives data to and from the user terminal 1 and other server devices via the communication network 5. Through this communication interface 81, for example, information related to products and the like is received from the clothing matching server 8, and data of 3D modeling information, an operation signal at the time of trying on, and the like are received from the user terminal 1.

  The user management unit 83 is a module that manages personal information such as user IDs and passwords, communication conditions necessary for providing distribution services to users, and in this embodiment, a member database 833 and member registration A unit 832 and an authentication unit 831.

    The member database 833 is a database that stores information related to the user terminal 1. In this embodiment, the user ID (such as the IP address of the user terminal 1) that identifies the user terminal 1 includes information related to the user (e-mail address of the terminal, In addition to telephone numbers, basic personal information such as age and gender is recorded in association with each other. Further, 3D modeling information data stored in the 3D modeling information storage unit 823 is stored in association with this user ID.

  The authentication unit 831 is a computer that verifies the legitimacy of an accessor or software having a function thereof, acquires an identifier such as the user terminal 1 or the IP address of the user terminal 1 through the communication network 5, and collates the member database 833. This is a module for confirming whether or not the accessor has the right and whether or not the accessor is the principal.

  In addition, the user management unit 83 has a function of acquiring user evaluation information for a sold product. Here, the user evaluation information includes word-of-mouth information input in the comment field, input data of impressions, return / exchange information (including the reason for return) that has been returned or exchanged after purchase.

  The member registration unit 832 is a module that processes member registration of a user who uses this system, and accepts access from the user terminal 1 to perform member registration. Specifically, the member registration unit 832 first acquires the IP address, the MAC address, and the like of the user terminal 1 as identification information for specifying the user terminal 1 and records it in the member database 833. If the personal information is entered, information related to the user terminal 1 possessed by the user (e.g., personal information such as the user terminal 1 mail address, telephone number, user name, age, gender, etc.) is entered in the user ID. Record in association with the member database 833.

  The analysis result acquisition unit 84 is a module that acquires information on the analysis result analyzed by the recommendation server 9. Among the analysis results, the recommendation information is evaluated in the virtual space generation unit 85, and the evaluation information is evaluated in the analysis results. The information is input to the information storage unit 863.

  The virtual space generation unit 85 is a group of modules that creates a virtual space for arranging the image of the 3D modeling information and the product image in a virtual space. In this embodiment, the virtual space database 856, the basic virtual space, A generation unit 851 and a select shop generation unit 852 are provided.

  The virtual space database 856 is a database that stores virtual space data, and the virtual space data includes map data in which an arrangement of stores and the like is written, store designation data that designates a store arranged on the map data, and the like. . The virtual space database 856 stores store data set for each store for each store. This store data includes store name data indicating the name of the store, store image designating data for designating the appearance of the store, store type data (store, self-select shop, availability of entry, etc.), and entry allowed. In the case of a store, internal layout data is included. Further, in the store data, a product database 862 is associated with identification information for identifying each store.

  The basic virtual space generation unit 851 is a module that generates a normal virtual space before obtaining analysis data, and arranges virtual stores on map data based on each data in the virtual space database 856. This virtual store is linked to address data in the virtual space. Note that the internal layout of the store and the product arrangement can be set by an administrator or a person in charge of the product information distribution server 6.

  The select shop generation unit 852 is a module that generates a virtual store unique to each user based on the analysis data acquired by the analysis result acquisition unit 84. In this embodiment, the select shop generation unit 852 includes a virtual store generation unit 853 and an internal layout determination unit. 854 and a product extraction unit 855.

  The virtual store generation unit 853 is a module that generates a user-specific virtual store, assigns a virtual store to an empty address in the virtual space database 856, and creates a user-specific My Select shop on the map. The appearance of the virtual store can be selected by a user operation.

  The internal layout determining unit 854 is a module that determines the internal layout in the virtual store generated by the virtual store generating unit 853, and the color, pattern, product arrangement, etc. in the store can be selected by a user operation. ing. The product extraction unit 855 is a module that extracts products to be placed in the My Select shop. In this embodiment, the product extraction unit 855 recommends to the user based on the recommended information of the analysis result information acquired from the analysis result acquisition unit 84. Extract products from the product database.

  Here, the extracted products are the same as the best-selling products based on sales results, products according to the season, products according to product deterioration such as outlet products and sale products, products according to changes in the user's figure, and purchased products. Product with attribute is extracted. Then, the product extraction unit 855 stores information on the extracted products and the like in the virtual space database 856 in association with identification information for identifying the My Select shop. The virtual space generated by the basic virtual space generation unit 851 and the select shop generation unit 852 and the display information in the virtual store are transmitted to the display information generation unit 86.

  Further, in the clothing matching server 8, a product etc. 3D information generation unit 861, a product database 862, and the like as a module group for generating 3D information of the product etc. based on the product etc. information acquired from the product etc. information distribution server 6. , An evaluation information storage unit 863 is provided.

  The product etc. 3D information generation unit 861 is a module that generates product etc. 3D information that can be displayed in the virtual space based on the product etc. information acquired from the product etc. information distribution server 6. Specifically, the product etc. 3D information generation unit 861 calculates the three-dimensional shape and size of the product based on information such as the size and dimensions of the product and the acquired two-dimensional image, and the calculated shape. 3D information is generated based on the size, the size, and the material of the product. Note that the product 3D information may be generated by a user operation, or may be automatically generated based on information on the shape and size of the product or the like or image analysis.

  Similar to the product database 63, the product database 862 is generated by the product etc. 3D information generation unit 861 together with product information and product images (two-dimensional images) for each product category such as jacket, skirt, sweater, shoes, bags, and accessories. 3D information such as merchandise is stored. Further, in the product database 862, when a product or the like is attached to the object data, data for changing the shape in which the shape of the product changes according to the physical information of the object data is accumulated. It is possible to display a state in which the shape of the product has changed according to the business data. Note that 3D images of products and the like can be displayed from 360 degrees all around.

  The evaluation information accumulation unit 863 is a storage device that accumulates the analysis results analyzed based on the evaluation information collected by the evaluation information collection unit 911 of the recommendation server 9 in association with the product etc. information in the product database 862. The evaluation information storage unit 863 stores the analysis result in association with the identification information for identifying the product.

  The try-on processing unit 82 is a module group that virtually tries on 3D modeling information in a virtual space based on a user operation, and includes a 3D modeling information storage unit 823, a try-on product selection unit 822, and a comparison unit. 821.

The 3D modeling information storage unit 823 is a storage device that accumulates 3D modeling information generated by the user 3D information generation unit 169b of the user terminal 1. In the present embodiment, the 3D modeling information includes, for example, detailed body information such as height, weight, chest circumference, waist circumference, waist circumference, shoulder width, upper body length, lower body length, and the like. Based on the information, the display form of the avatar and mannequin information displayed on the screen is changed. The 3D modeling information may further include internal physical characteristics in addition to morphological and quantitative characteristics of the entire body composed of skeleton, muscle, subcutaneous fat, and the like.
The try-on product selection unit 822 is a module that accepts a user operation via the communication interface 81 and extracts corresponding product information from the product database 862 based on the selected product ID. Here, the extracted product information includes a product name, a price, size information, a 3D image of the product to be dressed with 3D modeling information, and the like.

  The comparison unit 821 is a module that compares the product etc. 3D information extracted from the try-on product selection unit 822 and the 3D modeling information (product etc. 3D information) extracted from the 3D modeling information storage unit 823. Specifically, the comparison unit 821 compares so-called avatar or mannequin information 3D modeling information that reflects the user's own physical characteristics with 3D information such as products that reproduces objects related to products and services as 3D information. Then, it is determined whether the product fits the mannequin information (3D modeling information) in which the physical characteristics of the user are reproduced, or whether the product is large or small. At this time, the comparison unit 821 performs comparison by reflecting the analysis result accumulated in the evaluation information accumulation unit 863. The comparison reflecting the analysis result is, for example, when the selected product or the like has an analysis result for the evaluation, and adjusts the shape and size values of the product or the like 3D information according to the analysis result.

  Further, the comparison unit 821 has a 3D information synthesis unit 821a that synthesizes 3D information such as a product to be compared with 3D modeling information and generates comparison result 3D information that can be displayed in the virtual space. . For example, when the 3D information such as a product is related to clothing or accessories, the 3D information synthesis unit 821a performs a process of attaching the clothing 3D information to the user's avatar (3D modeling information) in the virtual space. At this time, the 3D information compositing unit 821a performs a modeling process in which clothing and accessories are arranged on the surface of the user's avatar and their movements and deformations are synchronized. Then, the comparison result and the comparison result 3D information are output to the display information generation unit 86.

  The display information generation unit 86 is a module that generates display information to be displayed on the LCD 165. In the virtual space generated by the virtual space generation unit 85, a display in which products are tried on as 3D modeling information by the fitting processing unit 82 is displayed. The arrangement of the image is determined, display information is generated, and distributed to the user terminal 1.

  In the display information generation unit 86, a virtual camera that defines a field-of-view range is arranged in a three-dimensional space, and an object captured by the virtual camera is displayed as a two-dimensional plane. Specifically, the display information generation unit 86 first virtually configures a three-dimensional store space, and stores the 3D modeling information, products, and camera coordinate positions that exist on the three-dimensional coordinates in the store space. Is controlled to form a three-dimensional structure. Further, the display information generation unit 86 performs a calculation process on a two-dimensional image corresponding to the field of view of the photographing screen from the configured three-dimensional space data, and displays the three-dimensional space two-dimensionally on the photographing screen.

  In this embodiment, while generating the screen which image | photographed the virtual space where each store is arrange | positioned from the predetermined direction, 3D modeling information is displayed as an object in the said virtual space. Further, when the object enters the store, the internal layout in the store is displayed as a background, and the object is displayed in the center. Then, when the fitting process is executed by the comparison unit 821, the product is combined with the part corresponding to the selected product, and the object on which the product is tried on is displayed on the screen as shown in FIG. These data are distributed to the user terminal 1 via the communication interface 81, and the comparison result and the comparison result 3D information are output on the LCD 165 based on the browser unit 169a of the user terminal 1.

(2) User terminal 1
As shown in FIG. 3, the user terminal 1 includes an input interface 12, an output interface 13, a photographing unit 16, a ROM 153, a communication interface 11, and a CPU 169.

  The input interface 12 is a device for inputting user operations such as a mouse and a keyboard. The output interface 13 is a device that outputs video and sound, such as a display and a speaker. In particular, the output interface 13 includes an LCD 165 such as a liquid crystal display.

  The communication interface 11 is a communication interface capable of calling and data communication. The communication interface 11 transmits and receives packet data via a communication network, and acquires each store S product master information D1. The imaging unit 16 is an imaging device that is attached to the user terminal 1 and captures part or all of the user's body. The imaging unit 16 includes a lens and a fixed imaging element that is a CCD, and represents an incident subject image. Light is focused on the light receiving surface of the CCD, and image data is transmitted to the CPU 169 via a camera signal processing circuit, an A / D converter, and the like. The image data includes moving images and still images, and the moving image data is transferred to the CPU 169 in a streaming format in which a large number of continuous images are converted into frames.

  The RAM 152 is used as a working memory or the like for the CPU 169, and temporarily stores a calculation result by the CPU 169. A program for the CPU 169 is recorded in the ROM 153, and program execution instructions are sequentially output in response to a request from the CPU 169.

  The CPU 169 is a module for executing an application such as a general OS, browser software, and an image reproduction application in addition to the program according to the present invention. In this embodiment, a user 3D information generation unit 169b and a browser unit 169a are provided on the CPU 169. The user 3D information generation unit 169b includes an information acquisition unit that acquires physical information related to the physical characteristics of the user, and can display object data in which the physical characteristics acquired by the information acquisition unit are reproduced in a virtual space. This module is generated as modeling information. Note that specific processing by the user 3D information generation unit 169b will be described later.

  The browser unit 169a is a module that is constructed by executing browser software, and is a module for browsing web pages. The browser unit 169a downloads an HTML (HyperText Markup Language) file or an image file from the Internet, analyzes the layout, displays the Reproduce. In the present embodiment, the browser unit 169a obtains a comparison result between the created 3D modeling information and product 3D information generated based on the product information related to the product or service from the clothing matching server 8, and the LCD 165 And a comparison result output unit 169c for outputting to.

  Here, the comparison result output by the comparison result output unit 169c is, for example, whether the clothes are just the size of the user's body, can be worn with a relative margin, or cannot be actually worn. The size is displayed. Moreover, such a comparison result can also be compared for every body part, for example, and a comparison result can also be output. “Output comparison result” means outputting various signals and data such as printout, text information message, voice, video, etc., regarding the match / mismatch between the user 3D information and the product 3D information. included.

  Furthermore, the comparison result output unit 169c has a function of outputting the comparison result 3D information generated by the 3D information combining unit 821a in the comparison result. That is, the comparison result output unit 169c displays on the LCD 165 display information in a state where the product is attached to the object data. At this time, the comparison result output unit 169c changes the shape of the product tried on the object according to the comparison result. The comparison result output unit 169c can display the object from 360 degrees all around, and can also display a part of the object in an enlarged manner.

  Further, the browser unit 169a includes a comparison result evaluation unit 169d that inputs an evaluation on the comparison result output by the comparison result output unit 169c based on an operation by the user. The evaluation with respect to the comparison result is an evaluation with respect to the purchased product or service, and is an evaluation with respect to the purchased product or service, and particularly includes information on matching / mismatching between the user 3D information and the 3D information such as the product. For example, word of mouth or reason for return / exchange entered by the user who purchased the product, and the evaluation is negative such that the size of part or all of the product is different from the comparison result. In addition to the evaluation, it may be a positive evaluation such as being consistent with the comparison result.

  Here, when a negative evaluation is made or when a return / commodity is exchanged, for example, in the comparison result by the first comparison result output unit 169c, a result of the just size is displayed. When purchased and worn, there is a difference in size that differs from the comparison result in whole or in part. In this case, text information or the like indicating that the size of the arm portion is different due to a word of mouth or a reason for return / exchange is input. The comparison result evaluation unit 169d transmits the text information or the like of the word of mouth or the reason for the return to the recommendation server 9 as evaluation information.

(3) Recommendation server 9
As shown in FIG. 4, the recommendation server 9 includes a communication interface 95, a data acquisition unit 91, a data analysis unit 92, a data storage unit 93, and a data distribution unit 94.

  The communication interface 95 is an interface that transmits and receives data between the clothing matching server 8 and the user 3D information management server 2 through the communication network 5. The data acquisition unit 91 is a module that acquires various data to be analyzed from each server device. In this embodiment, the data acquisition unit 91 includes a usage history acquisition unit 913, a user information acquisition unit 912, and an evaluation information collection unit 911. Yes.

  The usage history acquisition unit 913 is a module that acquires usage history information processed in the fitting processing unit 82 of the clothing matching server 8. This usage history information includes information on products etc. that have been tried on and purchased, and information on products etc. for which virtual try-on processing has been executed even if not purchased. The user information acquisition unit 912 is a module that acquires user information of each user from the user 3D information management server 2. This user information includes age, sex, physical information and the like.

  The evaluation information collection unit 911 is a module that collects evaluation information related to evaluation by the comparison result evaluation unit 169 d of the user terminal 1 from each user terminal 1. Here, the user evaluation information is an evaluation for the purchased product or service, and in particular, includes information on the match / mismatch between the user 3D information and the 3D information such as the product. In addition to negative evaluations such as some or all of the sizes differing from the comparison results, positive evaluations such as matching with the comparison results are included, as well as reviews or returns / exchanges for goods and services A general assessment of the product or service of the reason may be included. For example, the user evaluation information may include word-of-mouth information input in the comment field, input data of impressions, return / exchange information (including return reason) returned or exchanged after purchase.

  The data storage unit 93 is a module that stores various data acquired by the data acquisition unit 91, and stores information related to products, user information, and evaluation information that are associated with each other based on an ID that identifies the product. Yes.

  The data analysis unit 92 is a module that counts and analyzes various data stored in the data storage unit 93. As the analysis here, various analyzes can be performed by combining various data. For example, product information that was tried on or purchased from the usage history information, physical information of users who tried on or purchased, purchase motivation and satisfaction regarding the product, and evaluation information such as word of mouth, reasons for return / exchange, etc. Can be analyzed. As a result, it is possible to analyze to which users each product is purchased, whether it is a highly satisfactory product, or a product that has been returned or exchanged. As a result, the accuracy of size matching and design matching of the product can be improved. Can be improved.

  In particular, it analyzes the reviews that are badly evaluated, or the reasons for return / exchange for returned / exchanged products, and among them, the comparison result by the comparison result output unit 169c and the case where the product etc. is actually worn in the real space If there is a difference, by collecting and analyzing the evaluation information, part or all of the size (dimensions) of the product can be corrected, and the comparison accuracy from the next time on can be improved.

  In addition, by analyzing user attributes (age, gender, etc.) and physical information associated with the product actually purchased, volume zones such as user preferences, fashion and size data (product and service are the most (Selling price range, size range, etc.) are acquired as analysis results. Thereby, the precision of the recommendation goods for each user can be improved.

  Further, the data analysis unit 92 has a function of analyzing a volume zone such as a size band that is most sold among certain products. Further, the data analysis unit 92 can analyze not only the volume zones for all users but also the age, sex, and zones where purchases are likely to be expected in the competition. .

  Further, the data analysis unit 92 analyzes user information of purchased products, and analyzes products or services of a genre different from the products to be tried on, such as music CDs and DVDs that match each user's preference. These analysis results are accumulated in the data accumulation unit 93 and transmitted to the data distribution unit 94.

  The data distribution unit 94 is a module that distributes the analysis result of the data analysis unit 92 to another server, and includes a recommendation distribution unit 94a and a body data distribution unit 94b. The recommendation distribution unit 94a is a module that distributes products matching the user's preference to the clothing matching server 8 as recommended information. Here, the recommended information for each user includes products with the same attributes as purchased products, products according to changes in the user's body shape, popular products based on sales performance, products according to the season, outlet products, sale products, etc. This is information such as a product corresponding to the product deterioration. Furthermore, the recommended distribution unit 94a can also distribute information on products that are listed on the auction site as recommended information, and information that prompts the user to list items in the auction (for recent similar products). (Successful bid amount etc.) may be included in the recommended information and distributed.

When the recommended information is distributed from the recommendation distribution unit 94a to the clothing matching server 8, the select shop generation unit 852 extracts a product based on the information and arranges the product in the virtual store. In addition, you may deliver directly the information regarding these goods etc. to the user terminal 1. FIG.

  The body data distribution unit 94b is a module that distributes the user's physical information to the administrator of the product etc. information distribution server 6. At this time, the body shape data distribution unit 94b distributes the predetermined information (user name, address, etc.) so that the personal information of the user having the physical information is not specified. The body data to be distributed can be distributed not only in volume zones such as size zones where products and services are most sold, but also by age, sex and zones that are likely to be purchased in competition. ing. This distribution may be paid or free of charge.

  Further, the data distribution unit 94 transmits an analysis result (such as size correction of a product etc.) analyzed based on the evaluation information collected by the evaluation information collection unit 911 to the clothing matching server 8. The internal configuration of the user 3D information management server 2 will be described when the 3D modeling creation support function is described.

(Product provision method)
By operating the product providing system having the above configuration, the product providing method of the present invention can be implemented. FIG. 5 is a sequence diagram illustrating a method according to the second embodiment.

  This product etc. providing method is a method of providing a product or service to a user through a user terminal used by the user from a communication network constructed by connecting communication paths to each other. Specifically, as shown in FIG. 5, the product etc. information distribution server 6 transmits information related to the company's products etc. to the clothing matching server 8 (S101). In the clothing matching server 8, the product etc. 3D information generation unit 861 acquires the product etc. information related to the product or service from the product etc. information distribution server 6 distributed on the communication network 5.

  Then, the product etc. 3D information generation unit 861 generates the product etc. 3D information that can be displayed in the virtual space based on the product etc. information acquired from the product etc. information distribution server 6. (S102). Information on the product etc. acquired from the product etc. information distribution server 6 and the generated product etc. 3D information are stored in the product database 862.

  In the user terminal 1, the user 3D information generation unit 169b of the CPU 169 executes a 3D modeling creation support process (S103). Specifically, the user 3D information generation unit 169b acquires physical information related to the physical characteristics of the user, and generates object data in which the physical characteristics are reproduced as 3D modeling information that can be displayed in the virtual space. Thereafter, the user terminal 1 accesses the clothing matching server 8 through the browser unit 169a (S104).

  The clothing matching server 8 receives access by the browser unit 169a, authenticates the ID and the like of the user terminal 1 accessed by the server-side authentication unit 831, and permits access when the right access right can be confirmed. (S105). On the other hand, if it cannot be recognized as a member, an error is displayed and access is denied.

  Thereafter, the user terminal 1 transmits the created 3D modeling information data to the clothing matching server 8 (S106). The clothing matching server 8 stores the acquired 3D modeling information data in the 3D modeling information storage unit 823 (S107).

  When an operation signal for execution of fitting is acquired from the user terminal 1, a fitting process using data of 3D modeling information is executed in the virtual space (S108). Specifically, in the comparison unit 821, the comparison unit 821 compares the 3D modeling information with the 3D information such as the product. At this time, the 3D information synthesis unit 821a synthesizes the 3D information such as the product to be compared with the 3D modeling information, and generates the comparison result 3D information that can be displayed in the virtual space.

  The comparison result and the comparison result 3D information are transmitted to the user terminal 1, and the comparison result output unit 169c of the user terminal 1 includes the comparison result 3D information generated by the 3D information synthesis unit 821a in the comparison result on the LCD 165. indicate.

  Thereafter, for example, a product is purchased and a purchase process is executed by a user operation (S109), or an evaluation process for the product is performed (S110). When there is a product purchase operation, communication processing is performed with a payment server on the communication network to execute payment processing. Thereafter, various data manipulated by the virtual try-on process, the purchase process, and the evaluation process are transmitted to the recommendation server 9 as usage history information (S111). The usage history information also includes evaluation information for the comparison result processed by the comparison result evaluation unit 169d of the user terminal 1.

  The data acquisition unit 91 of the recommendation server 9 acquires various data (S112). This acquisition of various data includes, for example, processing in which the evaluation information collection unit 911 collects evaluation information related to evaluation by the comparison result evaluation unit 169d of the user terminal 1 from each user terminal 1. Thereafter, various data acquired by the data acquisition unit 91 is stored in the data storage unit 93 and data analysis is performed by the data analysis unit 92 (S113).

  This data analysis includes, for example, processing for collecting and analyzing evaluation information collected by the evaluation information collection unit 911. Then, the recommendation delivery part 94a delivers recommendation data to the clothing matching server 8 among the analyzed analysis results (S114). In the clothing matching server 8, the analysis result acquisition unit 84 acquires the recommendation data, and the select shop generation unit 852 creates a My Select shop in which products that match the user's preference are collected (S115).

  On the other hand, the body data distribution unit 94b distributes body data among the analyzed results to the product information distribution server 6 (S116). The control unit 62 of the product etc. information distribution server 6 acquires this body shape data (S117), and performs the next product development based on the body shape data.

  In addition, the data distribution unit 94 transmits the analysis process analyzed based on the evaluation information to the clothing matching server 8 (S118). The clothing matching server 8 receives the analysis result, and stores the analysis result in the evaluation information storage unit 863 in association with the product etc. information (S119). Then, the comparison unit 821 reflects the analysis result accumulated in the evaluation information accumulation unit 863 and performs the comparison after the next time.

(3D modeling creation support function)
Next, the 3D modeling creation support function executed in the user terminal 1 and the user 3D information management server 2 will be described. FIG. 6 is an explanatory diagram showing a display screen displayed by the 3D modeling information creation support function according to the present embodiment.

  In the present embodiment, creation of 3D modeling information is executed in the portable user terminal 1 described above. Here, as shown in FIG. 6, the user terminal 1 has a rectangular main body 100, and the main body 100 is provided with a liquid crystal display (LCD) 165 as a display unit for displaying graphics. 3D modeling information 501 that is an object displayed three-dimensionally is displayed on the screen of the LCD 165. The 3D modeling information 501 is also referred to as so-called mannequin information, and is an object displayed in a three-dimensional shape reflecting the user's body type information, that is, external and internal physical characteristics. The 3D modeling information 501 can be stereoscopically displayed from 360 degrees all around by a virtual camera that captures the image in the three-dimensional space.

  Further, the user terminal 1 is provided with a touch panel 300 as an operation signal input device for operating the 3D modeling information 501. The touch panel 300 is an input device that inputs an operation signal by pressure by a touch operation using a user's fingertip, a pen, or the like. The touch panel 300 corresponds to an LCD 165 that is a display unit that displays a graphic and a coordinate position of the graphic displayed on the LCD 165. The touch sensor for receiving the operation signal is superimposed and the coordinate position corresponding to the display position of the 3D modeling information 501 displayed on the LCD 165 can be specified by the touch operation. The user terminal 1 is provided with operation buttons such as button switches and direction keys, and an operation signal can be input using the operation buttons.

(Internal structure of each device)
Next, the internal structure of each device constituting the 3D modeling information creation support described above will be described. FIG. 7 is a block diagram showing the internal structure of the CPU related to the 3D modeling information creation support function according to the present embodiment. 8A to 8H are block diagrams illustrating the internal configurations of the information processing unit and the analysis unit according to the present embodiment. FIG. 9 is a block diagram illustrating an internal configuration of the management server according to the embodiment.

(1) Internal Configuration in CPU 169 in User Terminal 1 First, the internal structure of a 3D modeling information support creation function module group virtually constructed on the CPU 169 will be described.

  First, when creating 3D modeling information, an external device is connected to the user terminal 1. The external device includes an external imaging device 18 and a body composition measuring device 19. The external imaging device 18 is an imaging device other than the imaging unit 16 attached to the user terminal 1. In addition to a normal imaging device, the external imaging device 18 is an infrared camera that captures image data that has passed through clothing or the like, and backscattered X-rays. Includes cameras. These external imaging devices 18 may be possessed by each user, for example, or may be installed in a store operated by a service provider that provides this service, for example.

  The body composition measuring device 19 includes various body composition information (weight, body fat percentage, BMI (body mass index), basal metabolic level, skeletal muscle level, bone level, visceral fat level, such as a weight scale and a body composition meter. , Water content, body age, etc.). The external imaging device 18 and the body composition measuring device 19 can be connected to the user terminal 1 by wireless communication or wired communication, and transmit the measured body composition information and image data.

  In the CPU 169, an information acquisition unit 182, an analysis unit 181, a 3D modeling generation unit 184, and a display information generation unit 185 are constructed as a 3D modeling information creation support function module group.

  The information acquisition unit 182 is a module that acquires physical information related to a user's physical characteristics. In this embodiment, the information acquisition unit 182 acquires physical information related to partial or overall physical characteristics of the user. In the information acquisition unit 182, “physical information” acquired is information related to physical characteristics measured using a measuring instrument such as a body part and body temperature, as well as information input by a user using an input unit, Shooting data such as still images and moving images acquired by shooting is included. The information acquisition unit 182 includes an imaging data acquisition unit 182a, an actual measurement value input unit 182b, and a pattern selection unit 182c.

  On the other hand, the analysis unit 181 mutually complements the partial or overall physical characteristics of the user included in the physical information, and calculates the estimated value about the predetermined part of the body and the partial or overall physical characteristics. This is a module for calculating correlation information. The analysis unit 181 includes an image analysis unit 181a. Here, the “predetermined part of the body” is a part to be observed or measured, and includes any part of the body such as waist, bust, shoulder width, or neck circumference. “Partial or overall physical features complement each other” means that the estimated values are obtained by unifying the conditions (units, scale, etc.) of the acquired partial and overall information. It is meant to make up for missing information and secure continuity between information. For example, when creating a whole body photo by joining partially taken body parts, the scale of the taken body part can be unified, or the partially taken body part can be applied to the whole body photo, For example, the scale can be adjusted.

  Furthermore, “correlation information” means a mutual relationship between partial or overall physical characteristics, for example, an external relationship such as a correlation between arm thickness and waist size, as well as arm It also includes the relationship between external and internal, such as the correlation between thickness and weight and body fat percentage. The estimated value about the predetermined part of the body calculated by the analysis unit 181 and the correlation information with the partial or overall physical feature are accumulated in the body shape data accumulation unit 153c and via the communication interface 11. To the user 3D information management server 2. The body shape data storage unit 153c is a storage device that stores the estimated value calculated by the analysis unit 181 and the correlation information.

  The 3D modeling generation unit 184 is a module that generates 3D modeling information based on the estimated value and the correlation information accumulated in the body shape data accumulation unit 153c. The display information generation unit 185 is a module that generates display information to be displayed on the LCD 165. The display information generation unit 185 displays each image during the process of calculating the estimated value and the correlation information, and the 3D modeling created by the 3D modeling generation unit 184. Information 501 is displayed on the screen. In the present embodiment, the display information generation unit 185 arranges a virtual camera that defines a visual field range in a three-dimensional space, and displays the 3D modeling information 501 captured by the virtual camera as a two-dimensional plane in a window. .

  Specifically, the display information generation unit 185 first virtually configures a three-dimensional space, and controls the 3D modeling information 501 existing on the three-dimensional coordinates in the three-dimensional space and the coordinate position of the camera to 3 Make up dimensions. Further, the display information generation unit 185 acquires the data of the configured three-dimensional space, performs a calculation process on a two-dimensional image corresponding to the field of view range of the photographing screen, and displays the three-dimensional space on the photographing screen two-dimensionally. To do. In this embodiment, the LCD 165 displays an image obtained by photographing the 3D modeling information from 360 degrees all around the 3D modeling information 501 and objectively visually recognizes the 3D modeling that reflects his body shape. Can be done.

(Specific processing contents of the information acquisition unit 182 and the analysis unit 181)
In the present embodiment, the information acquisition unit 182 and the analysis unit 181 are configured to select and execute each functional module described above according to each mode for creating 3D modeling information. Hereinafter, specific processing contents of each functional module in each mode will be described. FIGS. 8A to 8H are block diagrams illustrating the internal configurations of the analysis unit 181 and the information acquisition unit 182 in each mode.

(Mode 1)
First, mode 1 in which the user inputs his / her physical characteristics to calculate an estimated value and correlation information will be described. In mode 1, as shown in FIG. 8A, the information acquisition unit 182 includes an actual measurement value input unit 182b.

  The actual measurement value input unit 182b is a module that receives an input of an actual measurement value of the physical feature of the user based on a user operation. Here, the physical features that are input to the actual measurement value input unit 182b as actual measurement values include partial, overall, external, and internal features. In addition to the external shape, size, color, and dryness of body parts such as feet, temperature, moisture, fat content and body shape, body part size and shape on the same scale, body part size and shape Input of external characteristics such as a ratio, and internal characteristics such as weight, body fat percentage, and health status acquired from the body composition measuring device 19 is accepted.

  At this time, the actual measurement value input unit 182b controls the display information generation unit 185 to display on the LCD 165 an input field in which actual measurement values of physical features to be input are to be input. Then, the actual measurement value input unit 182b acquires the actual measurement value of the physical feature input by the user via the input interface 12. Thereafter, the analysis unit 181 calculates an estimated value and correlation information based on the actual measurement value input by the actual measurement value input unit 182b.

(Mode 2)
Next, mode 2 in which pattern data is selected and an estimated value and correlation information are calculated by inputting and correcting an actual measurement value will be described. In mode 2, as shown in FIG. 8B, the information acquisition unit 182 includes an actual measurement value input unit 182b and a pattern selection unit 182c. Here, a pattern storage unit 153a that accumulates a plurality of pattern data is used.

  The pattern storage unit 153a stores physical feature types as pattern data. Here, as the pattern data, the body information of a standard person and the image information of the mannequin (sample 3D modeling) displayed based on the body information are stored in association with each other. The standard body information of the person is classified according to each category such as age, height, gender, nationality, body type (slim type, normal type, obesity type), etc., and these categories are combined. Physical information and display information are accumulated.

  When mode 2 is executed, first, the pattern selection unit 182c controls the display information generation unit 185 to extract standard mannequin (sample 3D modeling) pattern data from the pattern storage unit 153a. A plurality of 3D modeling images are displayed on the screen. Then, the pattern selection unit 182c reads arbitrary pattern data from the pattern storage unit 153a based on a user operation. On the other hand, as described above, the actual measurement value input unit 182b receives the input of the actual measurement value of the physical feature of the user based on the user operation, and acquires physical information. Then, the estimated value and the correlation information are calculated in the analysis unit 181 by applying the body information acquired by the actual measurement value input unit 182b to the pattern data selected by the pattern selection unit 182c.

(Mode 3)
Next, mode 3 will be described in which pattern data is selected and body information is corrected and estimated values and correlation information are calculated based on an image of any part (hand, foot, head, etc.) of the user himself / herself. To do. In this mode 3, as shown in FIG. 8C, the information acquisition unit 182 includes a pattern selection unit 182c and a photographing data acquisition unit 182a, and the analysis unit 181 includes an image analysis unit 181a. . Here, the data stored in the image processing storage unit 153b is used.

  The image processing storage unit 153b is a storage device that accumulates various data and programs for image processing in the image analysis unit 181a. In this embodiment, the lens based on camera characteristics (lens distortion, focal length). Lens distortion correction parameters for correcting distortion, a program that calculates gradient strength for each pixel, a program that extracts edges from the gradient direction in the local direction of the edge, and identifies the contour in the image based on the edges Various data necessary for various image recognition processes such as programs, software necessary for 3D image creation, and the like are stored.

  When mode 3 is executed, first, the pattern selection unit 182c determines the pattern data selected from the operation signal as described above. On the other hand, the photographing data acquisition unit 182a controls the display information generation unit 185 to display an instruction to photograph a partial physical feature of the user. At this time, the photographing data acquisition unit 182a may instruct which partial physical feature (hand, foot, face, etc.) is to be photographed, or may be selected by the user. The captured image is input to the image analysis unit 181a.

  The image analysis unit 181a is a module that analyzes the image captured by the imaging unit 16 and calculates physical information related to a partial physical feature. The image analysis unit 181a specifies the shape of the body information from the captured image by using various data and programs for performing the image recognition processing stored in the image processing storage unit 153b. Further, the image analysis unit 181a specifies the dimension information of the body information. As a method for specifying the dimensional information of the body information, for example, the occupancy may be estimated based on the proportion of the partial body information displayed on the screen. Then, the estimated value and the correlation information are calculated by applying the body information analyzed by the image analyzing unit 181a to the pattern data selected by the pattern selecting unit 182c.

(Mode 4)
Next, mode 4 for selecting the pattern data and calculating the estimated value and the correlation information by correcting the physical information from the image obtained by photographing the comparison object whose partial physical characteristics and dimensions of the user are known. explain. That is, in the mode 4, as shown in FIG. 8D, the dimension information of the partial physical features photographed in the process of the mode 3 is specified based on the comparison object photographed at the same time. . Here, the “comparative object whose dimensions are known” is an article whose dimensions can be determined, for example, a general article that is close in size, such as a cigarette box, a lighter, or a credit card. Other models include smartphones, mobile phones, tablet PCs, and digital cameras. The known information storage unit 153e stores dimensional information (article shape and dimensional information on the article) regarding the comparison target whose dimensions are known.

  When mode 4 is executed, first, the pattern selection unit 182c determines the pattern data selected from the operation signal as described above. On the other hand, the imaging data acquisition unit 182a controls the display information generation unit 185 to instruct to shoot including the partial physical features of the user and the comparison object. At this time, the analysis unit 181 may select which comparison object is to be photographed or may be selected by the user. Further, the photographing data acquisition unit 182a can display guide display information in which the comparison target is arranged at a predetermined position on the screen. For example, a circular frame is displayed at the center of the screen, and a message “Place a coin on the palm and shoot so that the coin is located in the frame.” Is displayed. Note that, in the analysis unit 181, as in mode 3, partial physical characteristics are also instructed.

  The image analysis unit 181a acquires the image data photographed by the photographing unit 16, analyzes the image data by the image recognition function, and specifies the partial physical feature shape. The image analyzed by the image analysis unit 181a is transmitted to the known information acquisition unit 182d. The known information acquisition unit 182d extracts the comparison object captured in the image when the comparison object is captured in the image captured by the imaging unit 16, and obtains the dimension information of the extracted comparison object. It is a module to acquire, and based on the image acquired from the image analysis unit 181a, the known information storage unit 153e is referred to acquire the dimension information of the comparison target. Thereafter, the dimension information of the comparison target is transmitted to the analysis unit 181.

  The analysis unit 181 calculates an estimated value and correlation information based on the dimension information acquired by the known information acquisition unit 182d and the comparison result between the comparison object and the user's body in the image. Specifically, the analysis unit 181 obtains a ratio between the dimension information acquired by the known information acquisition unit 182d and the dimension information of the comparison target on the screen, and the part displayed in the image based on the ratio Dimensional information on typical physical features. Then, the estimated value and the correlation information are calculated by applying the body information analyzed by the image analyzing unit 181a to the pattern data selected by the pattern selecting unit 182c.

(Mode 5)
Next, mode 5 in which the estimated value and the correlation information are calculated by selecting the pattern data and correcting the physical information by photographing the user himself with a moving image will be described. In mode 5, as shown in FIG. 8E, the information acquisition unit 182 includes a pattern selection unit 182c and a captured data acquisition unit 182a, and the analysis unit 181 includes an image analysis unit 181a.

  In this case, first, the pattern selection unit 182c determines the pattern data selected from the operation signal as described above. In addition, the shooting data acquisition unit 182a controls the display information generation unit 185 to output an instruction to shoot the entire user with a moving image. At this time, the photographing unit 16 is fixed at a predetermined position, and an instruction is issued to rotate the user once in front of the photographing unit 16.

  Thereafter, the image analysis unit 181a acquires the moving image data captured by the imaging unit 16, analyzes the moving image data by the image recognition function, and calculates physical information related to the user's overall physical characteristics. Specifically, the shape of the user is three-dimensionally specified by one or a plurality of frame images taken from a predetermined angle (front, side, etc.) in the moving image data. At this time, the shape of the user is determined by, for example, recognizing a part such as a face, eyes, shoulders, or waist included in the image as a reference point.

  Further, the image analysis unit 181a specifies dimensional information of the overall physical information of the specified user. As this process, for example, it may be specified from the proportion of the body displayed on the screen, or the dimension information may be specified based on any one of the reference points. Then, the estimated value and the correlation information are calculated by applying the body information analyzed by the image analyzing unit 181a to the pattern data selected by the pattern selecting unit 182c.

(Mode 6)
Next, mode 6 in which an estimated value and correlation information are calculated only by shooting the user himself / herself with a moving image will be described. In mode 6, as shown in FIG. 8F, the information acquisition unit 182 has a shooting data acquisition unit 182a, and the analysis unit 181 has an image analysis unit 181a.

  First, the shooting data acquisition unit 182a controls the display information generation unit 185 to output an instruction to shoot the entire user with a moving image. At this time, the photographing unit 16 is fixed at a predetermined position, and an instruction is issued to rotate the user once in front of the photographing unit 16. Thereafter, the image analysis unit 181a acquires the moving image data shot by the shooting unit 16, analyzes the moving image data by the image recognition function, as in the above-described mode 5, and the body information regarding the overall physical characteristics of the user. Is calculated.

  Further, the image analysis unit 181a specifies dimensional information of the user's overall body information. As this process, for example, it may be specified from the proportion of the body displayed on the screen, or the dimension information may be specified based on any one of the reference points. And the analysis part 181 calculates an estimated value and correlation information based on the user's whole body information analyzed by the image analysis part 181a.

(Mode 7)
Next, mode 7 for calculating an estimated value and correlation information by measuring the distance from the focus of the camera to the subject when photographing the user himself will be described. In mode 7, as shown in FIG. 8G, the analysis unit 181 includes an image analysis unit 181a, and the information acquisition unit 182 includes a captured data acquisition unit 182a.

  First, in the imaging data acquisition unit 182a, the display information generation unit 185 is controlled to output an instruction to capture the user's partial or entire body information as a still image. Thereafter, the image analysis unit 181a acquires the image data captured by the imaging unit 16, analyzes the image, and calculates physical information related to partial or overall physical characteristics. At this time, the shape of the user is determined by recognizing a part such as a face, a shoulder, or a waist included in the image as a reference point.

  The image analysis unit 181a includes a shooting distance calculation unit 181c that measures the distance from the shooting unit 16 to the subject. The shooting distance calculation unit 181c acquires an adjustment value when the shooting unit 16 performs focusing, and measures the distance from the shooting unit 16 to the subject from the adjustment value. Then, the image analysis unit 181a identifies the dimensional information of the user's partial or total body information based on the distance from the photographing unit 16 to the subject. And the analysis part 181 calculates an estimated value and correlation information based on the user's whole body information analyzed by the image analysis part 181a.

(Mode 8)
Mode 8 in which an estimated value and correlation information are calculated by acquiring physical information only from a still image taken by the user will be described. In mode 8, as shown in FIG. 8 (h), the information acquisition unit 182 has a photographing data acquisition unit 182a, and the analysis unit 181 has an image analysis unit 181a.

  As described above, the imaging data acquisition unit 182a controls the display information generation unit 185 to acquire a still image in which a partial or overall physical feature of the user is captured. The image analysis unit 181a obtains image data of a still image captured by the imaging unit 16, analyzes the image, and calculates physical information relating to a partial or overall physical feature of the user. At this time, the user's shape is recognized as a reference point such as a face, eyes, shoulders, and waist included in the image when the entire physical features are captured.

  The image analysis unit 181a specifies size information of the user's overall body information. As this process, for example, it may be specified from the proportion of the body displayed on the screen, or the dimension information may be specified based on any one of the reference points. The analysis unit 181 calculates an estimated value and correlation information based on the entire body information of the user analyzed by the image analysis unit 181a.

  In addition, each mode mentioned above is an example, You may use each function rearranged. For example, when shooting a moving image in mode 5 or mode 6, it is also possible to photograph a partial physical feature of the user or a comparison object. In modes 3 and 4, the estimated value and the correlation information may be calculated only by photographing a partial physical feature of the user and a comparison object without selecting a pattern. Furthermore, the accuracy of the estimated value and the correlation information may be improved by appropriately combining the processes in each mode.

  Further, in the above-described mode, when photographing a partial or overall physical feature of the user, for example, the user's physical information is obtained from the photographing data photographed through the mirror by photographing using a mirror. You may make it do. Next, a processing method using such a mirror will be described.

(Shooting mode using a mirror)
In the shooting mode using a mirror, as in mode 4, the information acquisition unit 182 includes a shooting data acquisition unit 182a, a pattern selection unit 182c, and a known information acquisition unit 182d. On the other hand, the analysis unit 181 includes an image analysis unit 181a. Here, it is assumed that the photographing unit 16 photographs a still image.

  First, the pattern selection unit 182c controls the display information generation unit 185 to display a plurality of pattern data on the screen. And the pattern selection part 182c determines the pattern data selected from the operation signal. In the imaging data acquisition unit 182a, the display information generation unit 185 is controlled to display an instruction so that the entire user is captured through the mirror. At this time, the analysis unit 181 instructs the user to take a picture including the partial physical features of the user and the comparison target.

  Here, the comparison target is the user terminal 1 having the imaging unit 16. Further, the photographing data acquisition unit 182a displays guide display information (a humanoid frame) so that the user is placed at an appropriate position at a predetermined position on the screen, or a user terminal that is a comparison target. A guide frame indicating the location of 1 may be displayed. When displaying this humanoid frame, for example, the display form can be changed based on the pattern data selected by the pattern selection unit 182c, and the body input through the actual measurement value input unit 182b can be changed. The display form can also be changed based on information (simple information such as height, weight, etc.).

  The image analysis unit 181a acquires the image data photographed by the photographing unit 16, analyzes the image data by the image recognition function, and specifies the shape of the overall physical feature. The known information acquisition unit 182d extracts the comparison object captured in the image when the comparison object is captured in the image captured by the imaging unit 16, and obtains the dimension information of the extracted comparison object. get.

  The analysis unit 181 calculates an estimated value and correlation information based on the dimension information acquired by the known information acquisition unit 182d and the comparison result between the comparison object and the user's body in the image. Specifically, the analysis unit 181 obtains a ratio between the dimension information acquired by the known information acquisition unit 182d and the dimension information of the comparison target on the screen, and the part displayed in the image based on the ratio Dimensional information on typical physical features. Then, the analysis unit 181 calculates the estimated value and the correlation information by applying the body information analyzed by the image analysis unit 181a to the pattern data selected by the pattern selection unit 182c.

  Here, the selection of the pattern data is accepted, and the estimated value and the correlation information are calculated by applying the body information analyzed by the image analysis unit 181a to the pattern data. The estimated value and the correlation information may be created directly from the dimension information and shape of the entire image of the user photographed through the mirror without accepting. Further, in the above description, the image analysis is performed based on the image data. However, the image analysis can be performed using the moving image data.

  In addition, the CPU 169 includes a data correction unit 183 that corrects the estimated value related to a predetermined part of the user's body calculated by the analysis unit 181. Here, the data correction unit 183 includes a case where correction is performed based on correction data generated by the user 3D information management server 2 and a case where correction is performed by user operation.

-Correction based on correction data First, a case where correction is performed based on correction data will be described. The user terminal 1 includes a correction data storage unit 153d that stores correction data generated based on the estimated values and correlation information that have been tabulated. The correction data includes the estimated value and correlation information analyzed by the analysis unit 181 of each user terminal 1 on the user 3D information management server 2 side, and the user 3D information management server 2 side. It is data generated based on the estimated value and the correlation information. This correction data is acquired from the user 3D information management server 2 at predetermined intervals. Then, the data correction unit 183 corrects the estimated value related to the predetermined part of the user's body calculated by the analysis unit 181 based on the correction data, according to each mode described above.

-Correction by user operation initiative Next, the correction by user operation initiative will be described. Here, in the user operation, when the user directly measures the height, chest measurement, waist measurement, waist measurement, etc. and inputs the measurement value directly, or when the measurement value measured from an external device is input. There is.

  When a measured value is directly input by a user operation, the measured value input unit 182b accepts the input measured value, and the information is transmitted to the data correction unit 183. Then, the data correction unit 183 corrects the estimated value regarding the predetermined part of the user's body calculated by the analysis unit 181 based on the received input information. Note that the measured value input unit 182b can accept input for each part of the body. Therefore, when wearing a purchased product, for example, if there is a sense of incongruity in a part of the body, only that part can be corrected.

-Correction using an external device On the other hand, when performing correction based on data input from an external device, correction is performed based on image data captured by the external imaging device 18, and body composition measuring device 19 In some cases, correction is performed based on the body composition information measured in step (b).

(A) Correction processing using the external imaging device 18
In the case where correction is performed based on image data captured by the external imaging device 18, for example, the following correction processing is performed.

  For example, when an infrared camera is used as the external imaging device 18, an image captured by the infrared camera and transmitted through the clothing part is input to the actual measurement value input unit 182b. Further, for example, when a backscatter X-ray apparatus is used as the external imaging device 18, the magnitude of reflection from the inspection object is measured, and an image through which the clothing part is transmitted is input to the actual measurement value input unit 182b. The

  These transmission images acquired by the actual measurement value input unit 182b are input to the image analysis unit 181a and subjected to image analysis, whereby body information (shape and dimension information) is specified from the image through which the clothing part has been transmitted. Then, the body information is input to the data correction unit 183, and the data correction unit 183 calculates the estimated value related to the predetermined part of the user's body calculated by the analysis unit 181 from the transmitted image. Correction based on dimension information).

  Thus, the image data acquired from the external imaging device 18 is input to the analysis unit 181, and physical information is recognized in a state where the clothing portion is transmitted by the image analysis process described above. As described above, the clothing part is transmitted and the silhouette of the body shape is clarified, so that the 3D modeling information can be created based on the accurate body shape.

(B) Correction Using Body Composition Measuring Device Correction processing based on data input from the body composition measuring device includes, for example, the following correction processing. For example, it is estimated from the body weight, body fat percentage, BMI, and visceral fat level which part of the body fat has increased or decreased, and the estimated value related to a predetermined part of the user's body calculated by the analysis unit 181 is corrected. You can also. As another processing method, an increase / decrease in the body due to aging (height shrinks, shoulder width narrows, etc.) is estimated from the basal metabolic rate, skeletal muscle level, bone level, and body age information, and the analysis unit 181 It is also possible to correct the estimated value relating to the predetermined part of the user's body calculated in step (1). Further, as another processing method, an increase / decrease in skin sagging (cheek sagging, wrinkles, etc.) due to age is estimated from the moisture content and body age information, and an estimation regarding a predetermined part of the user's body calculated by the analysis unit 181 is performed. The value can also be corrected. Note that such correlation information with the body composition information is stored in advance in the body shape data storage unit 153c.

  In conjunction with the body composition information measured in this way, the estimated value related to the predetermined part of the user's body calculated by the analysis unit 181 is corrected (maintenance), thereby matching the 3D modeling information with the current body shape. It can be a body shape. As a result, the user can objectively recognize the change in the body shape of the 3D modeling information in real time, and thus can be expected to improve awareness of health care and beauty.

  Here, the CPU 169 can also store the body composition information acquired from the body composition measuring device 19 in the ROM 153 together with the date information, and display the difference in the body shape between the past and the present. In addition, when the CPU 169 is not connected to the body composition measuring device 19 for a predetermined period, the CPU 169 can also pop-up information on the screen informing that it is time to update the body information. At this time, the CPU 169 displays an input column for accepting inputs such as body weight, chest circumference, waist circumference, waist circumference, etc. for a user who does not have the body composition measuring device 19 or the like. And the input information which the user himself input is acquired, and the body information of the 3D modeling information is corrected based on the input information.

  Note that the notification of the update time can be switched on / off by the user, and the notification timing can be set by the user (once a month or every other month). In the above-described correction processing by the CPU 169, it is possible to select which method is used for correction by a user's selection operation, and it is also possible not to perform the correction processing.

  Further, the CPU 169 has a future prediction function for predicting a user's future body shape or face change based on the body composition information measured by the body composition measuring device 19 and displaying it on the screen. Based on the body composition information, the future prediction function refers to the body information stored in the body shape data storage unit 153c, and predicts and displays changes on the face and whole body of the user after a predetermined year on the screen. Specifically, as a change in face, sagging skin (cheek sagging, wrinkles, etc.) is predicted and the face image of the 3D modeling information is changed. On the other hand, the whole image of 3D modeling information is changed by predicting body sagging due to a decrease in muscle mass, posture change due to a decrease in muscle mass and bone density, etc. as changes in the whole body.

(2) Internal Configuration of User 3D Information Management Server 2 Next, an internal configuration of the user 3D information management server 2 will be described. The user 3D information management server 2 can be composed of a plurality of server groups such as a Web server and a database server in addition to a single server device. In this embodiment, as shown in FIG. A control unit 22 and a storage unit 23 are provided.

  The storage unit 23 is a database group that stores various types of information related to the present system. Here, the member database 231, the pattern storage unit 232, the body shape data storage unit 233, the image processing storage unit 234, and correction data are stored. And an accumulation unit 235. The member database 231 is a database that stores information related to the user terminal 1. In this embodiment, the user ID (such as the IP address of the user terminal 1) that identifies the user terminal 1 includes information related to the user (e-mail address of the terminal, In addition to telephone numbers, basic personal information such as age and gender is recorded in association with each other. In addition, the user ID is stored in association with the physical information of the user.

  The pattern storage unit 232 stores physical feature types as pattern data. The body shape data accumulation unit 233 is a storage device that accumulates each data acquired from the user terminal 1, and in addition to the estimated value and correlation information calculated in each user terminal 1, the image acquired by the imaging data acquisition unit 182a, Measured values acquired by the measured value input unit 182b, known information acquired by the known information acquisition unit 182d, and user information (gender, age, etc.) are acquired and stored. The correction data storage unit 235 is a storage device that stores correction data generated by the analysis processing based on the estimated value and the correlation information accumulated in the body shape data storage unit 233. The image processing storage unit 234 has a data configuration similar to that of the image processing storage unit 153b described above.

  The communication interface 21 is a communication interface that transmits and receives data to and from the user terminal 1 and each server device through the communication network 5. In the present embodiment, the communication interface 21 receives the body information of the 3D modeling information created by the user terminal 1 via the communication network 5 and has been updated as a result of totalizing and analyzing the body information of each user. Various physical information is distributed.

  The control unit 22 includes a processor such as a CPU or DSP (Digital Signal Processor), a memory, hardware such as other electronic circuits, software such as a program having the function, or a combination thereof. It is a module, and various function modules are virtually constructed by appropriately reading and executing a program, and various processes for operation control of each unit and user operations are performed by the constructed function modules. In the present embodiment, the control unit 22 includes an authentication unit 221, a member registration unit 222, a history information acquisition unit 224, and an analysis unit 223.

  The authentication unit 221 is a computer that verifies the legitimacy of the accessor or software having the function, acquires the identifier such as the user terminal 1 or the IP address of the user terminal 1 through the communication network 5, and collates the member database 231. This is a module for confirming whether or not the accessor has the right and whether or not the accessor is the principal.

  The member registration unit 222 is a module that processes member registration of a user who uses this system, and accepts access from the user terminal 1 to perform member registration. Specifically, the member registration unit 222 first acquires the IP address, MAC address, and the like of the user terminal 1 as identification information for specifying the user terminal 1 and records the acquired information in the member database 231. If the personal information is entered, information related to the user terminal 1 possessed by the user (e.g., personal information such as the user terminal 1 mail address, telephone number, user name, age, gender, etc.) is entered in the user ID. Record in association with the member database 231. The functions of the authentication unit 221 and the member registration unit 222 may be executed by the user management unit 83 of the clothing matching server 8. Further, it is assumed that each data in the storage unit 23 accumulated in the user 3D information management server 2 can be distributed to the clothing matching server 8, the product etc. information distribution server 6, and the recommendation server 9.

  The history information acquisition unit 224 is a module that acquires each data processed in each user terminal 1, and in this embodiment, in addition to the calculated estimated value and correlation information, the image acquired by the imaging data acquisition unit 182a. Then, information such as the actual measurement value acquired by the actual measurement value input unit 182b and the known information acquired by the known information acquisition unit 182d is acquired, and the information is input to the body shape data storage unit 233.

  The analysis unit 223 is a module that analyzes the data accumulated in the body shape data accumulation unit 233, and includes a correction data generation unit 223a and a pattern generation unit 223b. The correction data generation unit 223a is a module that generates correction data based on the estimated value and the correlation information accumulated in the body shape data storage unit 233, for example, the shape of a partial physical feature of the body And the correction data which analyzed the relationship between the dimension information and the body information of the whole body are created. The created correction data is stored in the correction data storage unit 235 and distributed to each user terminal 1.

  The pattern generation unit 223 b is a module that creates information related to 3D modeling stored in the pattern storage unit 232. The pattern generation unit 223b creates a 3D modeling pattern based on the user information stored in the body shape data storage unit 233. As a pattern created here, for example, the physical information of a person is classified according to each category such as age, height, sex, nationality, and body type (slim type, normal type, obesity type). The analysis results classified in this way are input to the pattern storage unit 232 and distributed to each user terminal 1. Note that the data distribution timing of the correction data and the pattern data to the user terminal 1 may be a predetermined interval or may be performed every time each database is updated. Note that the control unit 22 may generate 3D printer data that can be output by the 3D printer from the 3D modeling information and provide it to the user.

(3D modeling information creation support method)
By operating the 3D modeling information creation support function having the above configuration, it is possible to implement a 3D modeling information creation support method for generating 3D modeling information that is object data in which the physical characteristics of the user are reproduced. FIG. 10 is a flowchart showing a method according to the present embodiment. Here, it is assumed that a program is installed in the ROM 153 of the user terminal 1 and predetermined data is recorded in each of the databases 153a to 153e in advance.

  First, in the user 3D information management server 2, the control unit 22 always determines whether there is data to be distributed to the user terminal 1 (S201). Here, the conditions for whether or not to distribute are, for example, when the user terminal 1 installs the application, for example, when data is updated in each database in the storage unit 23, or the update timing is reached, etc. Is included. If there is no data to be distributed (“N” in S201), the server device waits until it acquires history information from the user terminal. On the other hand, when there is data to be distributed (“Y” in S201), the control unit 22 transmits various data in each database to the user terminal 1.

  When the user terminal 1 receives various data (S301), the user terminal 1 newly registers various data in the databases 153a to 153d in the ROM 153 or performs update processing. Thereafter, when this program is executed in the CPU 169 of the user terminal 1 (S302), first, a 3D modeling information creation menu is displayed on the screen. When a 3D modeling information creation menu is selected by a user operation (S303), 3D modeling information creation processing is performed. The CPU 169 displays a selection screen for each mode such as the above-described modes 1 to 8 and a mode for photographing through a mirror, and accepts selection of any mode through the input interface 12 (S304).

  After the mode is determined, the information acquisition unit 182 acquires physical information related to the partial or overall physical characteristics of the user according to the mode selected by the user (S305). Then, the analysis unit 181 mutually complements the partial or overall physical characteristics of the user included in the physical information, and calculates the estimated value regarding the predetermined part of the body and the partial or overall physical characteristics. Correlation information is calculated (S306).

  Here, for example, when the selected mode includes a process of receiving an input of an actual measurement value of the physical feature of the user based on a user operation, the actual measurement value input unit 182b inputs the actual measurement value. And the analysis unit 181 calculates an estimated value and correlation information based on the input actual measurement value. At this time, if correction data is accumulated in the terminal 1, the data correction unit 183 corrects the estimated value related to the predetermined part of the user's body calculated based on the correction data.

  Furthermore, when pattern data is used for the selected mode, the pattern selection unit 182c reads arbitrary pattern data from the pattern storage unit 153a based on a user operation, and the analysis unit 181 selects the selected pattern. Estimated values and correlation information are calculated by fitting the acquired physical information to the data.

  In addition, when shooting data is used for the selected mode, the shooting unit 16 captures part or all of the user's body, and the analysis unit 181 analyzes the captured image to calculate body information. . An estimated value and correlation information are calculated based on the calculated physical information.

  In addition, when the comparison object with a known dimension is shown in the photographed image, the comparison object shown in the image is extracted, and the known dimension information about the comparison object is stored. While acquiring the dimension information of the extracted comparison object from the information storage part 153e, the analysis part 181 is based on the acquired dimension information and the comparison result between the comparison object and the user's body in the image. Calculate estimated values and correlation information.

  As described above, the estimated value and the correlation information calculated by the analysis unit 181 are stored in the body shape data storage unit 153c, and at the same time, 3D modeling is object data in which the physical characteristics of the user are reproduced by the 3D modeling generation unit 184. Information is generated and displayed on the LCD 165 under the control of the display information generation unit 185 (S307).

  The user visually recognizes the 3D modeling information 501 displayed on the screen and selects either the correction icon or the save icon displayed on the screen. Here, when the save icon is selected by a user operation (“N” in S308), the created 3D modeling information data is overwritten and saved in the ROM 153 (S309).

  On the other hand, when a correction icon is selected by a user operation (“Y” in S308), the CPU 169 displays a screen for selecting a correction method. In this embodiment, the 3D modeling information 501 is corrected based on body shape input information input via the input interface 12 and correction based on data acquired using an external device. There is a method. Furthermore, you may perform the process according to each mode mentioned above.

  When receiving the selection of the correction processing method, the CPU 169 acquires each information according to the operation from the user, recalculates the estimated value and the correlation information, performs correction processing, and redisplays the 3D modeling information (S304). ~ S307). This correction processing is repeated until the save button is selected according to the user operation (“N” in S308).

  When the save button is selected in response to a user operation (“N” in S308), 3D modeling information data is stored in the ROM 153 (S309). At this time, the CPU 169 distributes the operation history information (calculated estimated value and correlation information, image, input physical information, etc.) when the 3D modeling information is created to the user 3D information management server 2 (S310).

  When the history information acquisition unit 224 of the user 3D information management server 2 acquires the history information (calculated estimated value and correlation information, etc.) (S203), the information is stored in the body shape data storage unit 233, Calculate the estimated value and correlation information. Thereafter, the correction data generation unit 223a and the pattern generation unit 223b of the analysis unit 223 perform analysis based on each accumulated data (S204), and generate correction data based on the estimated value and correlation information that have been aggregated. Or newly creating or updating pattern data. These pieces of information are stored in the correction data storage unit 235 or the pattern storage unit 232.

  Thereafter, the control unit 22 determines whether or not there is data to be distributed at a predetermined timing (S201), and if there is correction data or pattern data that is analyzed and created / updated by the analysis unit 223, It is determined that there is data to be distributed (“Y” in S201), and various updated information is distributed to the user terminal 1 (S202).

  In this way, the estimated value executed in the user terminal 1 and the content of the correlation information are always extracted by the user 3D information management server 2 and subjected to data analysis. Then, data analysis is performed by the user 3D information management server 2 to update the data in each database, and the updated data is distributed to the user terminal 1 and reflected in the next 3D modeling information creation process.

(Product offering program)
The above-described product etc. providing system and product etc. providing method can be realized by executing a product etc. providing program described in a predetermined language on a computer. That is, this program is a product providing program for providing products or services to a user through a user terminal used by the user from a communication network constructed by connecting communication paths to each other.
(1) In the user terminal, a physical information acquisition step for acquiring physical information related to the physical characteristics of the user;
(2) a user 3D information generation step of generating object data in which physical features are reproduced as 3D modeling information that can be displayed in a virtual space;
(3) a product etc. information acquisition step for acquiring product etc. information related to the product or service from the product etc. information distribution server distributed on the communication network;
(4) a product etc. 3D information generating step for generating product etc. 3D information that can be displayed in a virtual space based on the product etc. information acquired from the product etc. information distribution server;
(5) a comparison step for comparing the 3D modeling information with the 3D information such as a product;
A process having a comparison result output step for outputting a comparison result is executed.

  Then, by installing such a product providing program on a computer such as a user terminal or a Web server or an IC chip and executing it on the CPU, a system having the above-described functions can be easily constructed. The product etc. providing program can be distributed through a communication line, for example, and can be transferred as a package application that operates on a stand-alone computer.

  Such a product providing program can be recorded on a recording medium readable by a personal computer. Specifically, it can be recorded on various recording media such as a RAM card in addition to a magnetic recording medium such as a flexible disk or a cassette tape, or an optical disk such as a CD-ROM or DVD-ROM. According to the computer-readable recording medium in which the product providing program is recorded, the above-described system and method can be implemented using a general-purpose computer or a dedicated computer, and the program can be stored and transported. And installation can be performed easily.

(Action / Effect)
According to this embodiment, 3D modeling information called so-called avatar or mannequin information reflecting the physical characteristics of the user himself / herself in the virtual space, and products that reproduce objects related to products and services as 3D information, etc. The user terminal compares the 3D information and outputs the comparison result. For this reason, according to the present embodiment, a comparison result indicating whether a product related to clothes fits, or is large or small, with respect to the 3D modeling information in which the physical characteristics of the user are reproduced is output. As a result, it can be easily confirmed whether or not the product or the like is suitable for the user.

  Further, according to the present embodiment, the 3D information synthesis unit 821a synthesizes the 3D information such as the product to be compared with the 3D modeling information, and generates the comparison result 3D information that can be displayed in the virtual space. Since the comparison result output unit 169c outputs the comparison result 3D information included in the comparison result, it is possible to visually recognize the consistency and the coordinate image when the user's body is dressed in the virtual space. Thus, it can be easily confirmed whether or not the product or the like suits itself.

  Further, according to the present embodiment, the comparison result evaluation unit 169d accepts an operation by the user for an evaluation on the comparison result output by the comparison result output unit 169c, and the evaluation information collection unit 911 receives the evaluation information regarding this evaluation for each user. Collected from the terminal. Thereby, realistic information actually measured by the user can be acquired. The data analysis unit 92 totals and analyzes the collected evaluation information, and the clothing matching server 8 stores the analysis result in association with the product etc. information, and the comparison unit 821 stores the evaluation information in the evaluation information storage unit 863. Since the comparison is performed by reflecting the accumulated analysis result, the comparison result can be reflected so as to eliminate the difference between the comparison in the virtual space and the comparison with the real space. As a result, the accuracy of comparison from the next time can be improved, and the credibility of information such as products can be improved.

  Further, according to the 3D modeling creation function of the present embodiment, based on the physical information related to the partial or overall physical characteristics of the user, the estimated value related to the predetermined part of the body and the acquired physical characteristics (physical information ) Can be accumulated and aggregated. The aggregated information can be used as so-called big data. By analyzing the big data, the user can input partial or whole body information, and the estimated value related to a predetermined part of the body can be accurately obtained. It is expected to be able to calculate.

  In the present embodiment, the information acquisition unit 182 acquires image data from the imaging unit 16 that captures part or all of the user's body, and the image analysis unit 181a analyzes the image captured by the imaging unit to analyze the body information. Since the physical characteristics can be input by a simple operation of taking a picture, the operation can be simplified.

  Further, in the present embodiment, the correction data generation unit 223a that generates correction data based on the estimated value and the correlation information accumulated and aggregated in the data storage unit, and the analysis unit 181 based on the correction data. Since it has a data correction unit 183 that corrects the estimated value regarding the calculated predetermined part of the user's body, the big data is constructed based on the estimated value, the actually measured value, and the correlation information collected from many users. By correcting the method of calculating the estimated value based on the big data and generating correction data, and reflecting the information obtained from the big data via this correction data, the accuracy of calculating the estimated value from the next time Can be increased.

  Furthermore, in the present embodiment, an actual measurement value input unit 182b that inputs an actual measurement value of the user's physical characteristics based on a user operation is further provided, and the analysis unit 181 has the actual measurement value input by the actual measurement value input unit 182b. Since the estimated value and correlation information are calculated based on the real-time information, it is possible to obtain real information actually measured by the user, and by storing the correlation information by correcting the correlation information so as to eliminate the difference between the estimated value and the measured value. The reliability of the big data to be transmitted can be improved, and the accuracy can be improved by reflecting it in the calculation of the estimated value from the next time.

  In this embodiment, the pattern storage unit 153a stores the types of physical features as pattern data, and the pattern selection unit 182c reads and analyzes arbitrary pattern data from the pattern storage unit 153a based on a user operation. The unit 181 calculates the estimated value and the correlation information by applying the physical information acquired by the information acquisition unit 182 to the pattern data selected by the pattern selection unit 182c, so that the user is close to himself / herself. By selecting the type of physical feature and applying partial physical information to the pattern data, the range of error can be reduced when calculating the estimated value or correlation information, and the estimated value and correlation information. Can improve the accuracy.

  Furthermore, in the present embodiment, the known information storage unit 153e stores dimensional information related to the comparison target whose dimensions are known, and the known information acquisition unit 182d stores the comparison target in the image captured by the imaging unit 16. Is captured, the comparison object shown in the image is extracted, and the dimension information of the extracted comparison object is acquired. Since the analysis unit 181 calculates the estimated value and the correlation information based on the dimension information acquired by the known information acquisition unit 182d and the comparison result between the comparison object and the user's body in the image, By comparing with a comparison object whose dimensions are known, it is possible to obtain physical information close to the actual measurement value, and in calculating the estimated value and correlation information, it is possible to further reduce the range in which the error occurs, and to estimate The accuracy of values and correlation information can be increased.

  In the present embodiment, the user's own image reflected in the mirror is so-called `` selfie '' with a smartphone or the like, and the estimated value and correlation information are calculated based on the image taken by the user, Since the user's whole body and the smartphone as a comparison object whose dimensions can be determined from the model and the like are reflected in the same image under the same conditions, the estimated value and the correlation information can be calculated more accurately.

DESCRIPTION OF SYMBOLS 1, 1a ... User terminal 2 ... Information management server 3 ... Wireless base station 4 ... Relay apparatus 5 ... Communication network 6 ... Product etc. information delivery server 8 ... Clothing matching server 9 ... Recommendation server 11 ... Communication interface 12 ... Input interface 13 ... Output interface 16 ... Image capturing unit 18 ... External imaging device 19 ... Body composition measuring device 21 ... Communication interface 22 ... Control unit 23 ... Storage unit 61 ... Communication interface 62 ... Control unit 63 ... Product database 81 ... Communication interface 82 ... Try-on processing unit 83 ... User management unit 84 ... Analysis result acquisition unit 85 ... Virtual space generation unit 86 ... Display information generation unit 91 ... Data acquisition unit 92 ... Data analysis unit 93 ... Data storage unit 94 ... Data distribution unit 94a ... Recommendation distribution unit 94b ... Body data distribution unit 95 ... Communication Centers face 100 ... body 152 ... RAM
153 ... ROM
153a ... Pattern storage unit 153b ... Image processing storage unit 153c ... Body shape data storage unit 153d ... Correction data storage unit 153e ... Known information storage unit 165 ... LCD
169 ... CPU
169a ... Browser unit 169b ... User 3D information generation unit 169c ... Comparison result output unit 169d ... Comparison result evaluation unit 181 ... Analysis unit 181a ... Image analysis unit 181c ... Measurement distance acquisition unit 182 ... Information acquisition unit 182a ... Shooting data acquisition unit 182b ... actual value input unit 182c ... pattern selection unit 182d ... known information acquisition unit 183 ... data correction unit 184 ... 3D modeling generation unit 185 ... display information generation unit 221 ... authentication unit 222 ... member registration unit 223 ... analysis unit 223a ... for correction Data generation unit 223b ... Pattern generation unit 224 ... History information acquisition unit 231 ... Member database 232 ... Pattern storage unit 233 ... Body shape data storage unit 234 ... Image processing storage unit 235 ... Correction data storage unit 300 ... Touch panel 501 ... 3D modeling information 821... Comparison unit 821 ... 3D information synthesis unit 822 ... try-on product selection unit 823 ... 3D modeling information storage unit 831 ... authentication unit 832 ... member registration unit 833 ... member database 851 ... basic virtual space generation unit 852 ... select shop generation unit 853 ... virtual store generation unit 854 ... Internal layout determination unit 855 ... Product extraction unit 856 ... Virtual space database 861 ... Product etc. 3D information generation unit 862 ... Product database 863 ... Evaluation information storage unit 911 ... Evaluation information collection unit 912 ... User information acquisition unit 913 ... Usage history Acquisition department

Claims (7)

From a communication network constructed by connecting communication paths to each other, through a user terminal used by the user, a product etc. providing system for providing a product or service to the user,
In the user terminal, a physical information acquisition unit that acquires physical information related to the physical characteristics of the user;
A user 3D information generation unit that generates object data in which the physical features are reproduced as 3D modeling information that can be displayed in a virtual space;
A product etc. information distribution server that is distributed on the communication network and distributes product etc. information related to products or services;
A product etc. 3D information generating unit that generates product etc. 3D information that can be displayed on the virtual space based on the product etc. information acquired from the product etc. information distribution server;
A comparison unit that compares the 3D modeling information with the 3D information such as the product;
The product etc. providing system characterized in that the user terminal comprises a comparison result output unit for outputting the comparison result. The comparison unit includes a 3D information synthesis unit that synthesizes 3D information such as a product to be compared with the 3D modeling information and generates comparison result 3D information that can be displayed on the virtual space.
2. The product etc. providing system according to claim 1, wherein the comparison result output unit outputs the comparison result 3D information generated by the 3D information synthesis unit in the comparison result. A comparison result evaluation unit that inputs an evaluation for the comparison result output by the comparison result output unit based on an operation by the user;
Evaluation information collection unit that collects evaluation information on evaluation by the comparison result evaluation unit from each user terminal, and
And further comprising a correction information accumulating unit that aggregates and analyzes the evaluation information collected by the evaluation information collecting unit and accumulates the analysis result in association with product etc. information,
The product etc. providing system according to claim 1, wherein the comparison unit performs the comparison by reflecting the analysis result accumulated in the evaluation information accumulation unit. The user's partial or overall physical characteristics included in the physical information are mutually complemented, an estimated value about a predetermined part of the body, and correlation information with the partial or total physical characteristics An analysis unit for calculating
A data accumulating unit for accumulating and compiling the calculated estimated value and correlation information;
A correction data generation unit that generates correction data based on the estimated value and correlation information accumulated and aggregated in the data storage unit;
A data correction unit that corrects an estimated value related to the predetermined part of the body of the user calculated by the analysis unit based on the correction data;
The product etc. providing system according to claim 1 or 2, further comprising: The information acquisition unit
An imaging unit for imaging a part or all of the user's body;
The analysis unit analyzes an image captured by the imaging unit to calculate the physical information, and based on the user operation, an actual measurement value input unit that inputs an actual measurement value of the user's physical characteristics; With
The product etc. providing system according to claim 4, wherein the analysis unit calculates the estimated value and the correlation information based on the actual measurement value input by the actual measurement value input unit. From a communication network constructed by connecting communication paths to each other, through a user terminal used by the user, a product or the like providing method for the product or service to the user,
A physical information acquisition step in which the physical information acquisition unit of the user terminal acquires physical information relating to the physical characteristics of the user;
A user 3D information generation unit that generates object data in which the physical features are reproduced as 3D modeling information that can be displayed in a virtual space;
A product etc. information acquisition step for acquiring product etc. information related to a product or service from a product etc. information distribution server distributed on the communication network;
A product etc. 3D information generating step in which a product etc. 3D information generation unit generates product etc. 3D information that can be displayed on the virtual space based on the product etc. information acquired from the product etc. information distribution server;
A comparison step in which the comparison unit compares the 3D modeling information with the 3D information such as the product;
The product providing method, wherein the comparison result output unit of the user terminal includes a comparison result output step of outputting the comparison result. From a communication network constructed by connecting communication paths to each other, through a user terminal used by the user, a product etc. providing program for providing the user with a product or service, the computer,
In the user terminal, a physical information acquisition step for acquiring physical information related to the physical characteristics of the user;
A user 3D information generation step of generating object data in which the physical features are reproduced as 3D modeling information that can be displayed in a virtual space;
A product etc. information acquisition step for acquiring product etc. information related to a product or service from a product etc. information distribution server distributed on the communication network;
A product etc. 3D information generating step for generating product etc. 3D information that can be displayed on the virtual space based on the product etc. information acquired from the product etc. information distribution server;
A comparison step for comparing the 3D modeling information with the 3D information such as the product;
A program for providing goods or the like, characterized by causing a process including a comparison result output step for outputting the comparison result to be executed.