GB2541156A - Personalized garment image processing - Google Patents
Personalized garment image processing Download PDFInfo
- Publication number
- GB2541156A GB2541156A GB1510752.7A GB201510752A GB2541156A GB 2541156 A GB2541156 A GB 2541156A GB 201510752 A GB201510752 A GB 201510752A GB 2541156 A GB2541156 A GB 2541156A
- Authority
- GB
- United Kingdom
- Prior art keywords
- image
- garment
- user
- personalised
- electronic device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/16—Cloth
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/012—Dimensioning, tolerancing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/20—Indexing scheme for editing of 3D models
- G06T2219/2024—Style variation
Abstract
An electronic device configured to process a personalised garment image comprises: a personalised image generator configured to generate a personalised user image; a garment image generator configured to determine at least one garment image associated based on the at least one body setting wherein each of the at least one garment image comprises a layer identifier; and an image compositor configured to combine the at least one garment image and the personalised user image by overlaying the at least one garment image over the personalised user image, the order of the overlaying of the at least one garment image based on the layer identifier; and an image output configured to output the overlaid at least one garment image over the personalised user image. The personalised user image may be generated by separating a user head and neck image from a background image and combining this with a body image generated from at least one user input defining a body setting.
Description
PERSONALIZED GARMENT IMAGE PROCESSING Field of the Invention
The present invention relates to the personalisation of garment image processing. The invention further relates to apparatus for garment image processing whereby the garment(s) are layered and processed with personalised body and facial images.
Background
Online clothes shopping is big business and growing at a significant rate. In the UK alone the industry is worth £10 billion, indeed, online dothes shopping is generally globally accessible with many stores shipping worldwide. But how do consumers know what they’re getting until the item arrives and they can see it on themselves? St is known that consumers return up to 40% of their online purchases. This is a loss of earnings that both retailers and manufacturers need to overcome.
Fitting room applications and programs have been proposed wherein the user can enter measurements and a garment size is selected and shown to the user on an approximately sized model to show the fit of the item. However such applications are problematic for many reasons. They do not show a representation of the item of clothing on a near real representation of a user.
Other fitting room applications, such as virtual fitting room applications, attempt to overcome such problems by capturing a full body image of the person and superimposing an image of the selected dothes or garments over the image.
However there are several further problems with such applications. Firstly uniess the user is naked or near naked, it is difficult to present an accurate superimposition of the garment image on the body. Furthermore in order to capture an accurate fui! body image typically requires expensive imaging equipment to overcome foreshortening effects caused when holding the camera too dose to the user. Such equipment can thus typically only be implemented within the retailer environment and is not suitable for implementation within the home environment.
Furthermore such fitting room applications as described herein are typically limited to the superimposition of only one garment at a time and is not suitable for showing a representation of a complete ensemble of garments at the same time. Similarly fitting room applications display only a limited range of clothing and are typically unable to react to the user’s current selections to provide assistance in matching, push notifying and recommending other garments related to user preferences.
It is an aim of the present invention to provide a suitable virtual fitting room experience by implementing personalized garment display processing with substantiaiiy reduced user input.
It is a further aim to extend and enable the processing and sharing of images of a representation of the user for garment display and retailing, without placing any additional burden on a user.
It is a further aim to react to the user’s current personalisation seiections to provide assistance in matching, push-notification and recommending other garments related to user preferences to generate and display images representing these further garments.
Summary
According to a first aspect there is provided an eiectronic device configured to process a personalised garment image, the device comprising: a personalised image generator configured to generate a personalised user image; a garment image generator configured to determine at least one garment image based on the at least one body setting wherein each of the at least one garment image comprises a layer identifier; and an image compositor configured to combine the at ieast one garment image and the personalised user image by overlaying the at ieast one garment image over the personalised user image, the order of the overlaying of the at least one garment image based on the layer identifier; and an image output configured to output the overlaid at ieast one garment image over the personalised user image.
The personalised image generator may comprise an image separator configured to separate a user head and neck image apart from an image comprising the user and a background.
The electronic device may further comprise a camera configured to capture the at least one image comprising the user and the background.
The electronic device may further comprise an input configured to receive the image comprising the user and the background.
The personalised image generator may comprise a body image generator configured to generate a body image based on user input defining at ieast one body setting.
The body image generator may be configured to determine a body image colouring based on a determined colour from the user head and neck image part.
The body image generator may be further configured to determine a body image coiouring based on the user input defining a body colour.
The personalised image generator may comprise an image matcher configured to combine the user head and neck image part with the body image to generate a personalised user image.
The garment image generator may comprise a virtual garment selector configured to select at ieast one virtual garment based on a user input, the virtual garment selector may be further configured to determine a garment image associated with the at least one virtual garment based on the at least one body setting.
The garment image selector may be further configured to select at least one further virtual garment based on the selected at least one virtual garment, and wherein the virtual garment selector is configured to determine a garment image associated with the at least one further virtual garment based on the at least one body setting.
The garment image generator may further comprise a virtual garment layer definer configured to define a layer identifier associated with the at least one virtual garment.
The electronic device may comprise a background selector configured to select a background image, and wherein the image compositor may be configured to overlay the at least one garment image over the personalised user image, which is further overlaid over the background image, and wherein the image output is configured to output the overlaid images.
The electronic device may furthermore comprise an image sharer configured to share the combined at ieast one garment image and the personalised user image with a further electronic device, wherein the further electronic device may comprise an image compositor configured to combine the overlaid at ieast one garment image and the personalised user image with a further user at least one further user garment image and personalised further user image.
The electronic device may further comprise a further user image receiver configured to receive, from a further eiectronic device, at least one further user garment image and personalised further user image, and wherein the image compositor is configured to combine the overlaid at ieast one garment image over the personalised user image and at least one further user garment image and personalised further user image into a group image.
The garment image generator may be configured to retrieve the at least one garment image associated based on the at least one body setting from a retailer server,
The at least one garment image comprises an image of a garment on a colour keyed mannequin, the mannequin based on the at least one body setting.
According to a second aspect there is provided an apparatus configured to process a personalised garment image, the apparatus comprising: means for generating a personalised user image; means for determining at least one garment image based on the at least one body setting wherein each of the at least one garment image comprises a layer identifier; means for combining the at least one garment image and the personalised user image by overlaying the at least one garment image over the personalised user image, the order of the overlaying of the at ieast one garment image based on the layer identifier; and means for outputting the overlaid at ieast one garment image over the personalised user image.
The means for generating a personalised user image may comprise means for separating a user head and neck image apart from an image comprising the user and a background.
The apparatus may further comprise a means for capturing the at least one image comprising the user and the background.
The apparatus may further comprising means for receiving the image comprising the user and the background.
The means for generating a personalised user image may comprise means for generating a body image based on user input defining at ieast one body setting.
The means for generating a personalised user image may comprise means for determining a body image colouring based on a determined colour from the user head and neck image part.
The means for determining a body image colouring may comprise means for determining a body image colouring based on the user input defining a body colour.
The means for generating a personalised user image may comprise means for combining the user head and neck image part with the body image to generate a personalised user image.
The means for determining at least one garment image may comprise means for selecting at least one virtual garment based on a user input, the means for selecting at least one virtual garment may comprise means for determining a garment image associated with the at least one virtual garment based on the at least one body setting.
The means for determining at least one garment image may further comprise means for selecting at least one further virtual garment based on the selected at least one virtual garment, and wherein the means for selecting at least one further virtual garment may comprise means for determining a garment image associated with the at least one further virtual garment based on the at least one body setting.
The means for determining at least one garment image may further comprise means for defining a virtual garment layer identifier associated with the at least one virtual garment
The apparatus may comprise means for selecting a background image, and wherein the means for combining the at least one garment image and the personalised user image may comprise means for overlaying the at least one garment image over the personalised user image, which is further overlaid over the background image, and wherein the means for outputting may further comprise means for outputting the overlaid images.
The apparatus may comprise means for sharing the combined at least one garment image and the personalised user image with a further apparatus, wherein the further apparatus comprises means for combining the overiayed at least one garment image and the personalised user image with a further user at least one further user garment image and personalised further user image.
The apparatus may further comprise means for receiving, from a further apparatus, at ieast one further user garment image and personalised further user image, and wherein the means for combining the at ieast one garment image and the personalised user image comprises means for combining the overiaid at ieast one garment image over the personalised user image and at least one further user garment image and personalised further user image into a group image.
The means for determining at least one garment image may comprise means for retrieving the at least one garment image associated based on the at least one body setting from a retailer server.
The at least one garment image may comprise an image of a garment on a colour keyed mannequin, the mannequin based on the at least one body setting.
According to a third aspect there is provided a method of processing a personalised garment image, the method comprising: generating a personalised user image; determining at least one garment image based on the at least one body setting wherein each of the at least one garment image comprises a layer identifier; and combining the at least one garment image and the personalised user image by overlaying the at least one garment image over the personalised user image, the order of the overlaying of the at least one garment image based on the layer identifier; and outputting the overlaid at ieast one garment image over the personalised user image.
Generating a personaiised user image may comprise separating a user head and neck image apart from an image comprising the user and a background.
The method may further comprise capturing the at least one image comprising the user and the background.
The method may further comprise receiving the image comprising the user and the background.
Generating a personaiised user image may comprise generating a body image based on user input defining at ieast one body setting.
Generating a personalised user image may comprise determining a body image colouring based on a determined colour from the user head and neck image part.
Determining a body image coiouring may comprise determining a body image colouring based on the user input defining a body colour.
Generating a personalised user image may comprise combining the user head and neck image part with the body image to generate a personalised user image;
Determining at least one garment image may comprise selecting at least one virtual garment based on a user input, selecting at least one virtual garment may comprise determining a garment image associated with the at least one virtual garment based on the at least one body setting.
Determining at least one garment image may further comprise selecting at least one further virtual garment based on the selected at least one virtual garment, and wherein selecting at least one further virtual garment may comprise determining a garment image associated with the at least one further virtual garment based on the at least one body setting.
Determining at least one garment image may further comprise defining a virtual garment layer identifier associated with the at least one virtual garment.
The method may comprise selecting a background image, and wherein combining the at least one garment image and the personalised user image may comprise overlaying the at least one garment image over the personalised user image, which is further overlaid over the background image, and wherein outputting may comprise outputting the overlaid images,
The method may comprise sharing the combined at least one garment image and the personalised user image with an apparatus, and combining the overlaid at ieast one garment image and the personalised user image with a further user at ieast one further user garment image and personalised further user image,
The method may further comprise receiving at least one further user garment image and personalised further user image, and wherein combining the at least one garment image and the personalised user image may comprise combining the overlaid at ieast one garment image over the personalised user image and at least one further user garment image and personalised further user image into a group image.
Determining at least one garment image may comprise retrieving the at ieast one garment image associated based on the at least one body setting from a retailer server.
The at least one garment image may comprise an image of a garment on a colour keyed mannequin, the mannequin based on the at least one body setting.
The electronic device can take the form of any user terminal such as a personal computer, cell phone, tablet, personal entertainment device, games console or Smart mobile device.
The invention further provides a computer program product, comprising program code means which when executed on a computer at a user device implement the method as disciosed herein.
For a better understanding of the present invention and to show how the same may be carried into effect, reference will now be made to the accompanying drawings.
Brief Description of the Drawings
Figure 1 is a schematic block diagram of a technical platform for implementing a personalised garment image service;
Figures 2a to 2d show example screen shots of home pages of the service;
Figure 3 shows an example personalised image initialization screen shot;
Figures 4a and 4b show example screen shots of personalised image generator input pages;
Figures 5a to 5e show example screen shots of body image configuration pages of the service;
Figures 8a to 6c show example screen shots of garment image generation preferences;
Figures 7a to 7f show example screen shots of image sharing;
Figure 8a to 8f show example screen shots of garment image generation selection; Figures 9a to 9c show example screen shots of image composition for a user device application of the service;
Figure 10 shows a further example screen shot of image composition for a www application of the service;
Figure 11 shows an example of the layering of garment definitions;
Figure 12 shows an example colour keyed mannequin suitable for generating garment images;
Figure 13 shows a schematic diagram showing the processing of a personalised garment image.
Detailed Description of Preferred Embodiments
Figure 1 is a schematic diagram of an architectural platform for supporting a personalised garment image service. The platform of Figure 1 is web-based. That is, the service is available through standard browsers on a plurality of user terminals or eiectronic devices connected to the internet. St will be appreciated that there will be a very large number of eiectronic devices extending globally, but one is shown in Figure 1 by way of example. The eiectronic device 101 is connected to a controller 103 by way of a network such as the internet. The controller can comprise a distributed collection of servers such as represented by oioud server 105 or distributed servers. A user data storage 111 or database is connected to the controller 103. The data storage 111 or database can be managed by a distributed database server (for example, a sequel server) in the controller 111,
The controller 103 may serve primary front end web requests which are received via the Internet from the electronic device 101. The data storage 111 or database may serve the data storage and search needs of the controller.
Furthermore the controller 103 may be configured fo interrogate retailer servers) 109 using a suitable application programming interface 107 and retrieve information (such as garment images associated with a virtual garment as described hereafter).
The retailer server 109 may store and supply large, static content, when appropriate, such as images, That is, the virtual garment can include a pointer to media content, e.g. an image, to be displayed.
Although a web-based platform is shown and described herein it is understood that other data platforms such as dosed application platforms may be supported by the following embodiments.
Figure 14 shows a schematic view of the personalised garment image service. It is understood that the various components may be implemented across the architectural platform as shown in Figure 1 however in the following examples the personalised garment image service is implemented in a single entity for simplicity and clarity reasons.
The apparatus providing the personalised garment image service can comprise a personalised image generator 1411. The personalised image generator 1411 may be configured to generate a personalised user image. A personalised user image may be an image which comprises parts of a captured image of a user, such as output from a camera of the electronic device. The personalised user image may also comprise a generated body image which may be is based on one or more inputs provided by the user defining the user.
The personalised image generator 1411 may be part of an application (or app) running on the eiectronic device. To assist the user generate the user personalised image the application may implement a user interface/navigation subsystem. These may be represented such as shown in Figures 2a to 2d by the example screenshots or homepages shown.
Thus Figure 2a shows a screenshot of an initiai introduction page with selectable options. The selectable options shown herein are U! buttons. However any suitable U! switch or other selector input may be implemented to represent the selection options In other embodiments. The selectable options shown in Figure 2a are a ‘new user’ selection option 201 and an It’s me’/registered user selection option 203. Typically once registered and/or personalised the user would select the It’s me’V registered user selection option 203 which would retrieve or download the user preferences associated with the registered user account.
The selection of the “new user” option 201 may cause the device to generate and display the screenshot example shown in Figure 2b which shows a default or undefined body image 213 with a default or undefined head and neck image part 211. The screenshot further shows a continuefwhat do you want to do” selection option 215 which when selected causes the device to generate and display an image screen shots such as shown in Figure 2d,
The selection of the “it’s me'Yregistered user selection option 203 in Figure 2a may cause the device to generate and display an example screenshot image such as shown in Figure 2c. In some embodiments the device retrieves the registered user settings and displays the user personalised image comprising the personalised body image 223 and the personalised head and neck part image 221. The same continuefwhat do you want to do” seiection option 215 is also shown in the example screenshot image. in some embodiments the user may select the body image and/or the head and neck part images in order to select or change the body and/or head and neck part image respectiveiy. in some embodiments the registered user settings and preferences may be retrieved foiiowing accessing a user account through a touch ID or via a unique personal identification number or any suitable authentication or authorisation method. In some embodiments the personalised body image can be defined as being an unrobed body image or as the last dressed image that has been saved or configured. In some embodiments the screenshot further shows a selection option enabling the user to customise the images.
The selection of the continuation/" what do you want to do” selection output may cause the device to generate and display an example screenshot image, such as shown in Figure 2d, comprising a series of further possible selection options.
For example the screenshot shows a “personalise image” selection option 231 whereby the device can be configured to then personalise the image both in terms of the head and neck image part and the body part.
The screenshot further shows various garment related selection options. For example the screenshot shows a “favourite stores” selection option 233 whereby the device may then access stored or defined retail outlets comprising virtual garments suitable for image processing. In the following description the term virtual garment or accessory is a data record or data element representing a garment or accessory. The data record or element may be associated with or comprise a photographed image of the garment or accessory which is suitable to be used in manner described hereafter. The virtual garment data record or element may furthermore comprise further information on the garment or accessory which defines other aspects of the item. For example the data record or element may Sink to further items or records which are defined as matching Items. Furthermore the data record or element may comprise links to determine stock levels at locai stores for click and collect purposes. Furthermore in the following examples the photographed images of the garment are 2 dimensionai image formats. However the images may be 3 dimensional representation images or an Image or images suitable for generating 3 dimensional representations.
The screenshot image further shows a last store visited” selection option 235. The selection of the last store visited" option may cause the device to access virtual garment information from the last store ‘visited’. The screenshot shows an “ail stores" selection option 237 whereby the device may be configured to access all of the retaii outlets with suitable virtual garments. The screenshot shows a “categories” seiection option 239 whereby the device may be caused to generate and display suitable categories of garments. These categories may define further selection options to filter the virtual garments.
The screenshot image further shows a “recommendation” selection option 241, The selection of the “recommendation” option may cause the device to display recommended virtual garments based on previous user selections or preferences. Furthermore the screenshot shows an "offers" selection option 243. The selection of the “offers” option may cause the device to display pushed special offers of suitable virtual garments.
With respect to Figure 3 an example screenshot image generated and displayed by the device following the selection of the "personalise image” selection option 231 is shown. The “personalise image” screenshot presents to the user a further series of selection options. The first selection option shown in Figure 3 is the “take selfse'Vcapture image selection option 301. The screenshot further shows a “personalise body’Vbody image generation selection option 303, a "personalised choices” selection option 305 and a “choose favourite shops" selection option 307.
Figure 4 shows an example screenshot image generated and displayed by the device following the selection of the “take selfie’Vcapture image selection option 301. The “take selfie’Vcapture image selection option may cause the device to activate a camera 1400 to capture an image or series of Images. The device may furthermore be caused to activate a user interface 1402 In the form of a touch screen display to display the output of the camera 1400. Furthermore the device may be configured to generate and overlay the displayed images with a series of guidelines or a frame. The guidelines or frame enable the user to position their head and neck within the guidelines. For example the image 403 captured by the camera is shown within the framing guidelines 401 and aligned with the eye guideline.
Furthermore the example screenshot may display an instruction or notification to the user to place their head within the frame and to dick the photo button. This notification is shown in Figure 4a by reference 405,
This image captured by the camera 1400 may be passed to the image separator 1413 wherein the image separator 1413 may be configured to detect the face and hair edges within the captured image and separate the head and neck image part from the background. The image separator 1413 may output this head and neck part of the image to an image matcher 1417.
The image matcher 1417 may be configured to combine the user head and neck image part with a default or generic body image to generate a first personalised user image, in some embodiments the image matcher is configured to detect body lines and place the head and neck parts within the correct placement of the defauit or initial body image.
The initial personalised user image is shown in Figure 4b which shows the matching of the initial or default body image 411 and the personalised head and neck image part 403 (as captured and processed by the image separator). In some embodiments the image matcher 1417 is configured to generate a three-dimensional matching whereby the head and neck part image is overlaid over a three-dimensional mesh such that the three-dimensional head and body image can be manipulated by the user at a further time. In some embodiments based on a detected or determined hair colour the image matcher 1417 generates a suitable hair colour and back of head image to match the head and neck image hair colouring and style. in some embodiments the user can seiect or tap on the head and neck image to reposition or resize it. In some embodiments the user may select a save option to navigate to the next window. Similarly in some embodiments a user can select a body option to personalise the body image. in some embodiments of the personalised image generator 1411 comprises a body image generator 1415. The body image generator 1415 is configured to generate a customised body image and output the customised body image to the image match 1417 to generate a personalised image or personaiised user image. The body image generator 1415 may receive an input from the user interface 1402 and the image separator 1413. The personalisation of the body image is shown furthermore with respect to the screenshots shown in Figures 5a to 5e.
The output of the seiection of the “personalised body” selection option is shown for example by the screenshot image in Figure 5a. The screenshot image in Figure 5a shows a default body image 411 with the customised head and neck image part 403.
In some embodiments by selecting the default body image 411 the personalised image generator 1411 enables the personalised body options to be accessed. In some embodiments this may enable the selection of configured options for body shape, such as shown by the body shape screen shot 531 in Figure 5c whereby the type of shape of body such as triangular, inverse triangular, square, rectangular, hourglass, etc can be selected. Other preconfigured options may be predefined skin colour or tone selection shown by the screenshot image 541 in Figure 5d whereby predefined skin tones may be selected.
The personalised body screenshot shown in Figure 5a further shows an “enter statistics" selection option 501. Selecting the “enter statistics” selection option 501 may cause the device to generate and display the screenshot image such as shown in Figure 5b. The personalised body statistics selection option shown in Figure 5b shows further configurable options which may be selected by the user. These statistics seiection options may, for example, be a “maie/female” selection option 511 configured to switch between male body and female body images, a “height/weighf seiection option 513 configure to enable the body image generator 1423 to generate a suitable image based on the selected height/weight options, a chest size seiection option 515 configured to enable the body image generator to generate a suitable image based on the chest size, a "waist size” selection option 517 to generate body images in a similar manner based on the waist size, a “skin tone and colour” seiection option 519 to change or modify the image colour or tone, a “body shape selection” option 521 as discussed previously and an “age selection” option 523. In some embodiments further selection options may be provided to change the position of the body image, For example the body image may be switched between a seated body image and a standing body image. This may for example be usefui to provide assistance for consumers using wheelchairs.
An example of a “skin tone and colour” selection option screen shot is shown in Figure 5e whereby a colour palette selection option 553 is shown to enabie the user to change the default skin colour selection and which is presented by image biock 551. In some embodiments of the body image generator 1415 may be configured to generate a personalised image based on the selected skin tone or colour. in some embodiments of the body image generator 1415 may be configured to receive from the image separator the head and neck image part. From this image part the body image generator 1415 may be configured to determine a skin colour value which can be used to set a default skin tone and colour option in the generated image (which can then in some embodiments be modified by the skin tone and colour selection option shown in Figure 5b). in such a manner the user may select a live’ manipulation, choose one of numerous pre-built or defined body images, or enter statistics from which the body image generator may then generate a suitable body image. A live’ manipulation, for example, allows the user to pull, stretch, heighten or generally change aspects of the body shape and colour with finger gestures or any other suitable user input (such as mouse manipulation, keyboard, etc).
Furthermore the entering of statistics allows the user to input specific body details or simply tweak a prebuilt body. Enabling a very flexible body image to be generated.
The body image generator 1415 may in some embodiments be configured to output the image to the user interface to be displayed to the user via the image matcher 1417. The image matcher 1417 may be configured to match or connect the generated personalised body image (which has been customised) with the (captured) head and neck image part generated by the image separator 1413. This operation may be similar to the matching operation performed with the default body image.
With respect to Figures 6a to 6c example screenshots of the outputs following the personalised choices selection output shown in Figure 3 are shown.
For example Figure 6a shows an example "personalise choices” seiection output screenshot image comprising further seiection options. For example the user may personalise the application by entering a name via the “your name” selection option 601. Furthermore the user may enable/disable/customise the ability to receive push messages from retailers or shops via the “notifications” section option 603. The user may customize the filters used in garments searching via the “favourite garments” selection option 605 or by coiour via the “favourite colours” selection option, or by shop via the “favourite shop” selection option. Similarly the user may customize the searching for suitable accessories to selected garments via the “favourite accessories" selection option 607. In such a manner the device may access the garments by searching a list of other data format of virtual garments created by the retailers which qualifies every garment.
Furthermore Figure 6b shows an example screenshot image generated and displayed by the device following the selection of the “favourite colours” selection option 609. The screenshot image comprises a colour selection option 621. in some embodiments the colour selection may be pre»popu!ated or determined based on the head and neck skin colouring, shape or other characteristic of the body or head and neck image part.
Furthermore Figure 6c shows an example screenshot image generated and displayed by the device following the seiection of the “favourite shops” selection option 611. The screenshot image comprises further selection options of shop togo/brand as shown by selection options 631 to 841. By selecting one of these selection options the device may toggle the shop as a favourite shop (shown as selection options 835 and 641) or regular shops (shown as selection options 631, 633, 837, and 839). In such a manner the user can scroll through all available shops and or brands, swipe to make a shop/brand a favourite and this will be shown with a heart symbol next to the shop/brand name. in some embodiments the electronic device may be configured to use the favourite shops settings to push recommendations and offers to users.
In some embodiments the selection options may be filtered to view in alphabetical order, by country, by favourites, age appropriate, etc.
Having defined or generated suitable personalised user images, the user may enable the device to select virtual garments, generate a garment image based on the virtuai garment and pass these to the image compositor 1431 which may combine the at least one garment image and the personalised user image by overlaying the at least one garment image over the personalised user image, in some embodiments the image compositor 1431 may furthermore define and determine the order of the overlaying of the at least one garment image based on a layer identifier associated with the garment image.
The generation of garment images by the garment image generator may in some embodiments cause the device, via a virtual garment selector 1423, to select or determine at least one virtual garments. This may be shown with the assistance of the screenshots shown in Figures 8a to 8f.
For example as shown in figure 8a a ‘shop’ screenshot image may be generated and displayed by the device. The ‘shop’ screenshot may display further selection options. For example the further selection options may include a “last stores visited” selection option 801 which causes the device to display the screenshot image 811 shown in
Figure 8b showing the last store selected and enabling the user to select options such as “new in”, “clothing”, “shoes” end “accessories” selection options which enable the user to browse virtual garments. A further selection option is a “categories" selection option 803 which causes the device to generate and display the screenshot image 813 shown in Figure 8c showing a series of further selection options representing selectable categories of garments or ciothing such as “Dresses”, "Tops”, “Jackets/Coats”, “Skirts", “Jeans”, and “Swimwear". Another selection option is an “offers” selection option 805 which causes the device to generate and display the screenshot image 815 shown in Figure 8d which presents a virtual garment and a further “See it on me” selection option 817 which causes the device to select the virtual garment. A further selection option is a “See all stores" selection option 807 which causes the device to generate and display the screenshot Image 819 shown in Figure 8e which presents further selection options to narrow the selection of a virtual garment by shop or retail outlets. The final selection option in Figure 8a is a “recommendations” selection option 809 which causes the device to generate and display the screenshot image 821 shown in Figure 8f which presents a recommended virtual garment with a suitable “See it on me" selection option 823 which in a manner as described herein can cause the device, and the virtual garment selector to select the garment.
The search results returned via the various selection options may use stored data, proprietary sourced data and user-personalisation to push offers and recommendations. In some embodiments the selection options enable the user to input ciothing sizes which filter the complete list of clothing or garments available according to stock and/or based on the seiected size. In some embodiments the device (the virtual garment selector) may be configured to store or retrieve known data from each brand to use as a style guide and warn the user if it thinks the item will not fit. Furthermore in some embodiments other colour or variations of the garment can be shown.
In some embodiments the virtual garment selector may be configured to respond to a garment selection by determining matches or similar items, These matches or similar items may be determined based on the user’s body statistics and previous garment choices including colour, style, cut, etc. In such embodiments the device may be configured to present “pushed" items in the coiour preference selected in the personalisation options.
With respect to Figures 9a to 9c and Figure 10 screenshots are shown showing the operations of the garment image generator 1421 and the image compositor 1431 according to some embodiments. in some embodiments the garment image generator 1421 and the virtual garment selector 1423 are configured to determine at least one garment image based on at least one setting from the body image generator 1415 as defined by the user as discussed above. Furthermore the garment image generator 1421, and the virtual garment selector 1423 are configured to determine at ieast one garment image based on an input from the user input 1402. The garment image generator 1421 may furthermore be configured to communicate with various external databases, such as retail servers or garment or clothing image databases to retrieve garment information to enable the garment image to be generated. A simple example is shown in the screenshot in Figure 9a wherein the user, having selected a specific shop, causes the device to generate and display the screenshot image 901 which presents the user with a series of category selection options such as “dresses”, “tops", “jacket/coats", “skirts”, "shoes" etc, in this example the user selects the “dresses” selection option and the device generates and displays the screenshot image 903 shown in Figure 9b. The screenshot image 903 shows an example virtual garment and furthermore a selection option "See it on me”. The user may as shown in the screenshot by the arrows may swipe left and right to change the virtual garment. Furthermore selecting the “See it on me” selection option causes the device to generate and display the screenshot 905 as shown in Figure 9c.
The selection option input from the U! 1402 may thus cause the virtual garment selector to retrieve an image based on the personalised body information/user size selectlon/colour selection and may pass the determined garment image to an image compositor 1431.
The garment image generator 1421 may further comprise a virtual garment layer definer 1425 which is configured, when the virtual garment is selected to determine or generate a layer value or identifier associated with the selected virtual garment and passes this layer information to the image compositor 1431,
The image compositor 1431, having received the garment image from the garment image generator 1421 and the personaiised user image from the user matcher 1417, may be configured to generate a composite image combining the garment images with the personalised body and head and neck image part to generate a personaiised garment image. In some embodiments the order of overlaying the at least one garment image is based on the layer identifier. The image compositor 1431 may in some embodiments determine the body outline and locate or place of the garment image over the user body image in an optimised position.
The image compositor 1431 may then output this to an image output 1441.
The image output 1441 may be configured to save the image for later recall or pass the image to the user interface 1402 (in the form of a touch screen display) to display to the user.
An example of the combined image Is shown in Figure 9c which shows the composite image of the selected dress over the personalised user image.
In the words the user may select a shop to browse from and once they see a compatible item the user may ‘click’ the “see it on me" selection option which then may cause the device to present an image comprising the combination of the matched garment image and the personalised user image. in some embodiments the user may add additional garments, items of clothing or accessories which can be further added to the displayed image by generating these images and overlaying these further images based on the layer identifier values. in some embodiments the device can be caused to determine and display further garments/accessories which may match the selected garment to attempt to match the selected garment.
With respect to Figure 10 a further example is shown with respect to a website implementation of the invention. For example the www page image comprises various images of garments, one of which is an image of a dress 1001 with an associated “see it on me” selection option 1003. The operation of selecting the “see it on me” selection option may in some embodiments enable the device to generate a pop-up window 1002 comprising the image generated by the image compositor 1431 combining the at least one garment image and the personalised user image, in some embodiments the operation of seiecting the “see it on me” selection causes the device to communicate to a further device on which the window 1002 is displayed. in some embodiments the images may be shared and displayed between various electronic devices. For example the images may be shared between a mobiie phone or tablet device, a desktop computer and a ‘table’ smart device such that the user is not restricted to viewing on only one device or type of device. in these embodiments the window 1002 and screenshot 905 may comprise further selection options such as “changing colour", “changing size”, “viewing from the back", “matching”, “adding” or "removing" garments as well as seiecting and buying the item(s).
Furthermore in some embodiments “hovering” over an information icon in the window/screenshot can enabie the user to see the garments details.
Although the examples shown herein demonstrate the generation of the garment image by the selection from a virtue! garment in some embodiments actual garments within the shop and/or in advertisements are equipped with an identifier, such as a barcode, QR code, or RF~id tag which may be scanned by the electronic devices and cause the equipment to generate a garment image which may be passed to an image compositor as described herein.
With respect to Figure 11 an example of layering is shown. In some embodiments the garment Image generator 1421, and the virtual garment layer definer 1425, Is configured to associate a layer identifier with the selected virtual garment and the garment image. The layer identifier as described herein specifies to the image compositor 1431 the order of overlying the images to generate the combined images. The layers may for example be defined based on regions on a body such as the defined regions marked by dotted lines in Figure 11. For example a first layer 1105 may be feet layer which is associated with garments such as shoes and socks. A second layer 1103, the lower body layer may overlie the first layer and be associated with trousers and skirts. Third and fourth Sayers may be upper torso layers 1103. The third layer is associated with shirts or tops and which overlie the second layer. The fourth layer may be associated with coats or jackets and which overlies the third layer. Furthermore in some embodiments there may be defined a stand-alone or fifth layer which is the head and neck region which overlies ail of the other layers.
In some embodiments the layer identifier is based on the category of the garment or clothing. For example casual trousers, which would typically be worn under a T-shirt may have a layer value such that the images are overlaid in the order T-shirt over trousers, whereas formal trousers which would typically be worn over a shirt may have a layer value such that the images are overlaid in the order trousers over shirt.
In other words when multiple items are selected the head and neck layer overlies the coat or jacket layer which overlies the shirt or top layer which overiies the trousers or skirts Sayer which overlies the socks or shoes layer in order to produce an image suitable to display the users requirements. in order to select suitable images associated with virtual (and reai) garments it is understood that the garment images are to be captured or photographed in a determined or known format in order that the garment images may align correctly with the body images.
With respect to Figures 12 and 13 examples of determined or known (standardised) image generation are shown.
Thus for example as shown in Figure 12 a chroma-keyed mannequin 1203 Is shown. The chroma-keyed mannequin 1203 may be one of a number of bespoke body sizes on which garments may be placed and photographed from a determined angle and distance to generate suitable images. In some embodiments the images are captured on a further known colour background such that the garment image may be separated from both the mannequin shape and the background.
An example of such a known garment image is shown in Figure 13 wherein the garment image 1301 comprises shaped cutouts 1303 when photographed from the front such that the image may be overlaid over the body image without obscuring the neck region.
Once a personaiised garment image is generated and output the device may be configured to enable further processing of the image to assist the selection of the garment.
With respect to Figures 7a to 7f further processing of the personaiised garment image are shown.
For example following the generation of the personalised garment Image 701 such as shown in Figure 7a, the image may be presented on a blank or piain background 702. In some embodiments the device may further comprise a background seiector configured to select a suitable background image. The background image may then be passed to the image compositor. The image compositor may be configured to further overlay the personalised garment image over background image. This is shown, for example, in Figures 7b and 7c wherein the background selected is a “home” background (Figure 7b) 703 and a “nightclub” background (Figure 7c) 705.
Furthermore the device may comprise a suitable image sharer configured to share the combined at least one garment image and the personalised use image with a further electronic device and / or social networking platform. The further electronic device may for example comprise an image compositor configured to combine the personalised garment image with a further user’s personalised garment image.
Similarly in some embodiments the electronic device comprises a further user image receiver configured to receive from a further electronic device at least one further personalised garment image, in such embodiments the image compositor may be configured to combine the personalised garment image and the received personalised garment image. This is shown for example in Figure 7d wherein two personalised garment images 710, 712 are shown over a blank or piain background 711. Furthermore in some embodiments the multiple personalised garment images may be combined with suitable selected background images. For example this is shown in Figure 7e by the personalised garment images shown in Figure 7d over a wail background image 713, and in Figure 7f by the personalised garment images over an outdoors background image 715.
Claims (18)
1, An electronic device configured to process a personalised garment image, the device comprising: a personalised image generator configured to generate a personalised user image; a garment image generator configured to determine at least one garment image based on the at least one body setting wherein each of the at least one garment image comprises a layer identifier; and an image compositor configured to combine the at ieast one garment image and the personalised user image by overlaying the at ieast one garment image over the personalised user image, the order of the overlaying of the at least one garment image based an the layer identifier; and an image output configured to output the overlaid at least one garment image over the personalised user image.
2, The electronic device as claimed In claim 1, wherein the personalised image generator comprises an image separator configured to separate a user head and neck image apart from an image comprising the user and a background.
3, The electronic device as claimed in claim 2, further comprising a camera configured to capture the at least one image comprising the user and the background,
4, The electronic device as claimed in claim 2, further comprising an input configured to receive the image comprising the user and the background.
5, The electronic device as claimed in any of claims 2 to 4, wherein the personalised image generator comprises a body image generator configured to generate a body image based on user input defining at least one body setting.
6. The electronic device as claimed in claim 5, wherein the body image generator is configured to determine a body image colouring based on a determined colour from the user head and neck image part,
7. The electronic device as claimed in claim 8, wherein the body image generator is further configured to determine a body image colouring based on the user input defining a body coiour,
8. The electronic device as claimed in claim 5, wherein the personalised image generator comprises an image matcher configured to combine the user head and neck image part with the body image to generate a personalised user image,
9. The electronic device as claimed in any of claims 1 to 8, wherein the garment image generator comprises a virtual garment selector configured to select at least one virtual garment based on a user input, the virtual garment selector is further configured to determine a garment image associated with the at least one virtual garment based on the at least one body setting.
10. The electronic device as claimed in any of claim 9, wherein the garment image selector is further configured to select at least one further virtual garment based on the selected at least one virtual garment, and wherein the virtual garment selector is configured to determine a garment image associated with the at ieast one further virtual garment based on the at least one body setting.
11. The electronic device as claimed in any of claims 9 and 10, wherein the garment image generator further comprises a virtual garment layer definer configured to define a layer identifier associated with the at least one virtual garment.
12. The electronic device as claimed in any of claims 1 to 11, further comprising a background selector configured to select a background image, and wherein the image compositor is configured to overlay the at least one garment image over the personalised user image, which is further overlaid over the background image, and wherein the image output is configured to output the overlaid images.
13. The electronic device as claimed in any of claims 1 to 12, furthermore comprising an image sharer configured to share the combined at ieast one garment image and the personaiised user image with a further electronic device, wherein the further eiectronic device comprises an image compositor configured to combine the overlaid at least one garment image and the personalised user image with a further user at least one further user garment image and personalised further user image.
14. The electronic device as claimed in any of claims 1 to 13, further comprising a further user image receiver configured to receive, from a further electronic device, at least one further user garment image and personaiised further user image, and wherein the image compositor is configured to combine the overiaid at ieast one garment Image over the personaiised user image and at least one further user garment image and personalised further user image into a group image.
15. The electronic device as claimed in any of claims 1 to 14, wherein the garment image generator is configured to retrieve the at ieast one garment image associated based on the at least one body setting from a retailer server.
16. The electronic device as claimed in any of ciaims 1 to 15, wherein the at least one garment image comprises an image of a garment on a colour keyed mannequin, the mannequin based on the at ieast one body setting.
17. An apparatus configured to process a personalised garment image, the apparatus comprising: means for generating a personalised user image; means for determining at least one garment image based on the at least one body setting wherein each of the at least one garment image comprises a layer identifier; and means for combining the at feast one garment image and the personalised user image by overlaying the at least one garment image over the personalised user image, the order of the overlaying of the at least one garment image based on the layer identifier; and means for outputting the overlaid at least one garment Image over the personalised user image,
18. A method of processing a personalised garment image, the method comprising; generating a personalised user image; determining at least one garment image based on the at least one body setting wherein each of the at least one garment image comprises a layer identifier; and combining the at least one garment image and the personalised user image by overlaying the at least one garment image over the personaiised user image, the order of the overlaying of the at least one garment image based on the iayer identifier; and outputting the overlaid at least one garment image over the personaiised user image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| GB1510752.7A GB2541156A (en) | 2015-06-18 | 2015-06-18 | Personalized garment image processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| GB1510752.7A GB2541156A (en) | 2015-06-18 | 2015-06-18 | Personalized garment image processing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| GB201510752D0 GB201510752D0 (en) | 2015-08-05 |
| GB2541156A true GB2541156A (en) | 2017-02-15 |
Family
ID=53784151
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| GB1510752.7A Withdrawn GB2541156A (en) | 2015-06-18 | 2015-06-18 | Personalized garment image processing |
Country Status (1)
| Country | Link |
|---|---|
| GB (1) | GB2541156A (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114663552B (en) * | 2022-05-25 | 2022-08-16 | 武汉纺织大学 | Virtual fitting method based on 2D image |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090222127A1 (en) * | 2006-01-31 | 2009-09-03 | Dragon & Phoenix Software, Inc. | System, apparatus and method for facilitating pattern-based clothing design activities |
| GB2488237A (en) * | 2011-02-17 | 2012-08-22 | Metail Ltd | Using a body model of a user to show fit of clothing |
| US8525828B1 (en) * | 2010-05-05 | 2013-09-03 | Amazon Technologies, Inc. | Visualization of fit, flow, and texture of clothing items by online consumers |
| KR20140123228A (en) * | 2013-04-12 | 2014-10-22 | (주)에프엑스기어 | Apparatus and Method for providing three dimensional model which puts on clothes based on depth information |
| KR20140130638A (en) * | 2014-09-15 | 2014-11-11 | (주)인더스웰 | The smart fitting apparatus and method based real image |
-
2015
- 2015-06-18 GB GB1510752.7A patent/GB2541156A/en not_active Withdrawn
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090222127A1 (en) * | 2006-01-31 | 2009-09-03 | Dragon & Phoenix Software, Inc. | System, apparatus and method for facilitating pattern-based clothing design activities |
| US8525828B1 (en) * | 2010-05-05 | 2013-09-03 | Amazon Technologies, Inc. | Visualization of fit, flow, and texture of clothing items by online consumers |
| GB2488237A (en) * | 2011-02-17 | 2012-08-22 | Metail Ltd | Using a body model of a user to show fit of clothing |
| KR20140123228A (en) * | 2013-04-12 | 2014-10-22 | (주)에프엑스기어 | Apparatus and Method for providing three dimensional model which puts on clothes based on depth information |
| KR20140130638A (en) * | 2014-09-15 | 2014-11-11 | (주)인더스웰 | The smart fitting apparatus and method based real image |
Also Published As
| Publication number | Publication date |
|---|---|
| GB201510752D0 (en) | 2015-08-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI760299B (en) | Image display method and device for selling object information | |
| US20220058715A1 (en) | Method and system for search refinement | |
| JP2020194602A (en) | Search system, search method, and program | |
| US20140019281A1 (en) | Systems and methods of creating and using shopping portals | |
| KR20190000397A (en) | Fashion preference analysis | |
| WO2010022403A1 (en) | System and method to identify and visually distinguish personally relevant items | |
| US20030050864A1 (en) | On-line method for aiding a customer in the purchase of clothes | |
| CN111681070A (en) | Method, device, storage device and equipment for purchasing online commodities | |
| JP2007200099A (en) | Item selection support device, method and program | |
| JP6348657B2 (en) | RECOMMENDATION DEVICE, RECOMMENDATION SYSTEM, RECOMMENDATION METHOD, AND PROGRAM | |
| KR20230042243A (en) | Coordination combination generation system and coordination combination generation method | |
| JP2014160396A (en) | Commodity recommendation device, commodity recommendation method, program, and commodity recommendation system | |
| US20140244440A1 (en) | Method for searching products to which visual items are applied | |
| US20200402147A1 (en) | E-commerce system, fliktag | |
| GB2541156A (en) | Personalized garment image processing | |
| WO2020079235A1 (en) | Method and apparatus for accessing clothing | |
| WO2016188278A1 (en) | Method and device for collecting information about service object | |
| JP6916095B2 (en) | Server and product provision system | |
| JP2016091522A (en) | Commodity search apparatus, commodity search method, and commodity search system | |
| JP7013506B2 (en) | Information processing equipment, information processing methods and programs | |
| JP2008052498A (en) | Selling support system, selling support method, and selling support program | |
| JP6182125B2 (en) | Coordinate suggestion apparatus and method | |
| AU2020356715A1 (en) | Coordination assisting server and coordination assisting system | |
| JP2012155550A (en) | Commodity coordination system, commodity coordination apparatus and method, commodity coordination program | |
| NL2022937B1 (en) | Method and Apparatus for Accessing Clothing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| WAP | Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1) |