CN110135930A - Virtual application dressing effect and the method, system and storage media for promoting product - Google Patents

Virtual application dressing effect and the method, system and storage media for promoting product Download PDF

Info

Publication number
CN110135930A
CN110135930A CN201811313304.8A CN201811313304A CN110135930A CN 110135930 A CN110135930 A CN 110135930A CN 201811313304 A CN201811313304 A CN 201811313304A CN 110135930 A CN110135930 A CN 110135930A
Authority
CN
China
Prior art keywords
user
target image
file data
recommended products
makeup
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811313304.8A
Other languages
Chinese (zh)
Other versions
CN110135930B (en
Inventor
林宜玮
吴鸿
林盈吟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
British Cayman Islands Business By Ltd By Share Ltd
Original Assignee
British Cayman Islands Business By Ltd By Share Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by British Cayman Islands Business By Ltd By Share Ltd filed Critical British Cayman Islands Business By Ltd By Share Ltd
Publication of CN110135930A publication Critical patent/CN110135930A/en
Application granted granted Critical
Publication of CN110135930B publication Critical patent/CN110135930B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0251Targeted advertisements
    • G06Q30/0255Targeted advertisements based on user history
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0251Targeted advertisements
    • G06Q30/0269Targeted advertisements based on user profile or attribute
    • G06Q30/0271Personalized advertisement
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0631Item recommendations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0641Shopping interfaces
    • G06Q30/0643Graphical representation of items or shoppers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Strategic Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Economics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Game Theory and Decision Science (AREA)
  • Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Processing Or Creating Images (AREA)

Abstract

Disclosed in the present application is virtual application dressing effect and the method, system and storage media for promoting product, wherein a calculating equipment obtains and verifies a user credential as provided by a user of a client device.It calculates equipment and obtains the photograph album comprising multiple digital images, and access a file data relevant to user credential.According to file data, the target image of a group is extracted from multiple digital images, and each target image in group describes the face area for having user.Equipment is calculated according to file data, retrieves an at least recommended products for each target image.Equipment is calculated according at least recommended products being retrieved, edits each target image.It calculates equipment and generates the user interface for being shown in client device, user interface shows one or more target images to be edited, and user interface separately shows and is retrieved an at least recommended products relevant to one or more target images to be edited.

Description

Virtual application dressing effect and the method, system and storage media for promoting product
Technical field
It is the present invention relates to a kind of media editing, in particular to a kind of that the simulation dressing of cosmetics is found expression in into photograph album and can be pushed away Method, system and the non-instantaneous computer readable memory medium of wide cosmetics.
Background technique
With being widely used for smartphone, plate and other display equipment, people can access digital content at any time, and In order to watch media content, the application program in smartphone and other portable display devices is also therefore popular.Although mesh Mark formula advertisement (Targeted Advertising) is generally practiced for internet, but can promote product in public improvement platform mesh It is preceding still by demand.
Summary of the invention
In one embodiment, a calculating equipment obtains and verifies a user credential, and user credential is by a client device A user provided.It calculates equipment and obtains the photograph album comprising multiple digital images, and access relevant to user credential one File data.According to file data, the target image of a group is extracted from multiple digital images, wherein every in group One target image describes the face area for having user.Equipment is calculated according to file data, for each target image retrieve to A few recommended products edits each target image according at least recommended products being retrieved.Calculating equipment generation can show In a user interface of client device, user interface shows that one or more target images to be edited, user interface are separately shown It is retrieved an at least recommended products relevant to one or more target images to be edited.
Preferably, the step of editing each target image includes: that will correspond at least recommended products being retrieved The virtual dressing of one cosmetic product, finds expression in the face area of user.
Preferably, the step of accessing file data relevant to user credential includes that one subscriber profile data of access and one change Adornment preference file data, files on each of customers include personal data related to user;Makeup preference file data detailed description is selected by user One or more dressing effects selected, wherein each makeup preference file data be specified in makeup preference file data in retouch The reference picture for being painted with one or more dressing effects is related, wherein reference picture quilt relevant to makeup preference file data It uploads and calculates equipment in cloud.
Preferably, one or more dressing effects described in a reference image are applied by user in advance.
Preferably, be each target image according to file data, the step of retrieving an at least recommended products include: be every One target image: access one exchangeable image file format (Exchangeable Image File Format, EXIF), and be Each target image obtains a position data;Determine face's colour of skin of the face area of user;According to files on each of customers, determine to use One age at family;According to makeup preference file data, makeup preference is determined;And according to position data, the face colour of skin, user At least one of age and makeup preference retrieve an at least recommended products for each target image.
It preferably, is every according at least one of position data, face's colour of skin, the age of user and makeup preference One target image retrieve the step of at least recommended products include: distribute each position data, face's colour of skin, user age And the weight of makeup preference;It is combined according to a weight of position data, face's colour of skin, the age of user and preference of making up, An at least recommended products is retrieved for each target image.
Preferably, according to file data, the step of retrieving an at least recommended products for each target image includes: basis The file data of overlapping recognizes an another user;And according in advance by another user selects and applied at least one recommend produce Product retrieve an at least recommended products for each target image.
System in another embodiment includes the memory and the processor that is coupled to the memory for being stored with multiple instruction, Processor is configured multiple instruction and includes at least: obtaining and verify a user credential, user credential is by a client device One user is provided.Processor is separately configured to be able to obtain the photograph album comprising multiple digital images, and access and user credential A relevant file data.Processor is separately configured to be able to extract a group from multiple digital images according to file data Target image, wherein each target image in group describes the face area for having user.Processor is separately configured to be able to root According to file data, an at least recommended products is retrieved for each target image.Processor is separately configured to be able to according to being retrieved An at least recommended products, edit each target image.Processor is separately configured to be able to generate to be shown in the one of client device User interface, user interface show one or more target images to be edited, user interface separately show be retrieved with it is one or more The relevant at least recommended products of a target image to be edited.
Preferably, processor will be by that will correspond to the virtual adornment of a cosmetic product of at least recommended products being retrieved Hold the face area for finding expression in user, to edit each target image.
Preferably, processor accesses the instruction of file data relevant to user credential by access one files on each of customers and one Makeup preference file data;Files on each of customers includes personal data related to user, and makeup preference file data is described in detail by user Selection one or more dressing effects, wherein each makeup preference file data and be specified in make up preference file data in Describing has a reference picture of one or more dressing effects related, wherein reference picture relevant to makeup preference file data It is uploaded and calculates equipment in cloud.
Preferably, one or more dressing effects described in a reference image are applied by user in advance.
Preferably, processor is each target image according to file data, retrieves the instruction packet of an at least recommended products Include following steps: for each target image: accessing an exchangeable image file format, and obtain a position for each target image Data;Determine face's colour of skin of the face area of user;According to files on each of customers, the age of user is determined;It is inclined according to makeup Good file data determines makeup preference;And according in position data, face's colour of skin, the age of user and makeup preference At least one, retrieves an at least recommended products for each target image.
Preferably, processor is according at least one in position data, face's colour of skin, the age of user and makeup preference It is a, include the following steps: to distribute position data, face's skin for the instruction that each target image retrieves an at least recommended products The weight of color, the age of user and preference of making up;And according to position data, face's colour of skin, the age of user and makeup One weight of preference combines, and retrieves an at least recommended products for each target image.
Preferably, processor retrieves the instruction packet of an at least recommended products for each target image according to file data It includes the following steps: an another user is recognized according to the file data of overlapping;And according to being selected and answered by another user in advance An at least recommended products retrieves an at least recommended products for each target image.
The non-instantaneous computer readable memory medium of one of another embodiment is stored with multiple instruction, and multiple instruction is real Row calculates equipment in one with a processor, and when multiple instruction is rendered in processor, processor obtains and verifies a user Voucher, user credential are provided by a user of a client device.Processor is configured to be able to obtain comprising multiple numbers One photograph album of image.Processor is configured to be able to an access file data relevant to user credential.Processor is configured to be able to According to file data, the target image of a group is extracted from multiple digital images, wherein each target image in group is retouched It is painted with the face area of user.Processor is configured to be able to according to file data, retrieves at least one for each target image Recommended products.Processor is configured to be able to edit each target image according at least recommended products being retrieved.Processor It is configured to be able to generate the user interface for being shown in client device, user interface shows one or more target figures to be edited Picture, user interface, which is separately shown, is retrieved an at least recommended products relevant to one or more target images to be edited.
Preferably, processor will be by that will correspond to the virtual adornment of a cosmetic product of at least recommended products being retrieved Hold the face area for finding expression in user, to edit each target image.
Preferably, processor accesses file data relevant to user credential by access: a files on each of customers and a makeup Preference file data, files on each of customers include personal data related to user;Makeup preference file data detailed description is easily selected by a user One or more dressing effects, wherein each makeup preference file data be specified in makeup preference file data in describe There is a reference picture of one or more dressing effects related, wherein on reference picture relevant to makeup preference file data It passes and calculates equipment in cloud.
Preferably, one or more dressing effects described in a reference image are applied by user in advance.
Preferably, processor is each target image according to file data, and it includes following for retrieving an at least recommended products Step: for each target image: accessing an exchangeable image file format, and obtain a position data for each target image; Determine face's colour of skin of the face area of user;According to files on each of customers, the age of user is determined;And according to makeup preference File data determines makeup preference;And according to position data, face's colour of skin, user age and makeup preference in extremely It is one few, an at least recommended products is retrieved for each target image.
Preferably, processor is according at least one in position data, face's colour of skin, the age of user and makeup preference It is a, for each target image retrieve an at least recommended products include carry out the following steps: distribution position data, face's colour of skin, The weight of the age of user and preference of making up;And according to position data, face's colour of skin, the age of user and makeup preference Weight combination, retrieve an at least recommended products for each target image.Spy of the invention is further understood that be enabled Sign and technology contents, reference should be made to the following detailed description and accompanying drawings of the present invention, however provided attached drawing is merely provided for Reference and description is not intended to limit the present invention.
Detailed description of the invention
Feature and technology contents of the invention are further understood that be enabled, are please referred to below in connection with attached drawing of the invention, Attached drawing only emphasizes the criterion of the invention when implementing and is oppositely arranged relationship, wherein each component is not drawn according to actual ratio System.In addition, the position that the label in attached drawing is specified is common to various visual angles.
Fig. 1 is that the cloud of various embodiments of the invention calculates equipment virtual application dressing effect and promotes the square of product Figure.
Fig. 2 is that the cloud of various embodiments in Fig. 1 of the present invention calculates the schematic diagram of equipment.
Fig. 3 is that the cloud of various embodiments in Fig. 1 of the present invention calculates equipment execution part function in virtual application makeup effect Illustration top level flow diagram when fruit and popularization product.
Fig. 4 is that the cloud of various embodiments in Fig. 1 of the present invention calculates the target image that equipment extracts a group from a photograph album To promote the schematic diagram of product.
Fig. 5 calculates equipment for the cloud of various embodiments in Fig. 1 of the present invention and provides one in the display of a client device User interface is to promote the schematic diagram of product.
Specific embodiment
Although target formula advertisement is widely implemented in internet, an improvement platform is needed exist for by product promotion to big It is many.Various embodiments are to improve platform for one below, are schemed for the number by cosmetic product virtual application in a cloud photograph album Picture, and cosmetic product can be recommended to give user.It will be described the system for carrying out dressing effect virtual application to promote product below, then Component operational situation in description system.Fig. 1 is that a cloud calculates the implementation dressing effect virtual application of equipment 102 and promotes product Block diagram.It may include a server computer, a cloud underlying computing device or any with cloud that cloud, which calculates equipment 102, The system of computing capability.In addition, cloud, which calculates equipment 102, to be arranged to such as one or more server libraries with multiple The calculating equipment of (Server Bank), electronic calculator library (Computer Bank) or other arrangements, this calculates equipment It may be placed at single position or be scattered in diverse geographic location.
Cloud calculates equipment 102 and a network 120 coupling, and the type of network 120 can be internet (Internet), interior Portion's net (Intranets), extranets (Extranets), wide area network (Wide Area Networks, Wans), local area network (Local Area Networks, Lans), wired network (Wired Networks), wireless network (Wireless Networks) or Other suitable networks, can also be of coupled connections two or more networks.Client device 122a, 122b, 122c pass through network 120 The coupling of equipment 102 is calculated with cloud to be connected to, and is calculated in the database 116 that equipment 102 maintains with uploading and accessing by cloud Digital image 124 in the photograph album 118 of storage.As it is known to those skilled in the art, digital image 124 may be encoded as following One archives form: JPEG (Joint Photographic Experts Group), TIFF (Tagged Image File Format)、PNG(Portable Network Graphics)、GIF(Graphics Interchange Format)、BMP (Bitmap) or other kinds of digital form, but not limited to this.
In addition, digital image 124 can also be following archives form by the static image transform coding in a video: MPEG-1(Motion Picture Experts Group-1)、MPEG-2、MPEG-4、H.264、3GPP(Third Generation Partnership Project)、3GPP-2、SD-Video(Standard-Definition Video)、 HD-Video (High-Definition Video), DVD (Digital Versatile Disc) multimedia, VCD (Video Compact Disc) multimedia, HD-DVD (High-Definition Digital Versatile Disc) multimedia, DTV/ HDTV (Digital Television Video/High-Definition Digital Television) multimedia, AVI (Audio Video Interleave), DV (Digital Video), QT (Quicktime) archives, WMV (Windows Media Video)、ASF(Advanced System Format)、RM(Real Media)、FLV(Flash Media)、MP3 (MPEG Audio Layer III)、MP2(MPEG Audio Layer II)、WAV(Waveform Audio Format)、 WMA (Windows Media Audio) or other kinds of digital media content, but not limited to this.
One virtual dressing applicator 104 be implemented in cloud calculate equipment 102 in a processor on, and including a user with Demonstrate,prove server 106, a spot photograph identifier 108, a Products Show server 110 and an image editor 112.User credential Server 106 is configured to be able to obtain and verify the user credential of user's transmission from client device 122, to access previously The photograph album 118 uploaded by user.Once receiving the user credential of user, user credential server 106 can access database File data 126 in 116, to verify user credential.
If user credential is verified by user credential server 106, spot photograph identifier 108 can be configured to be able to The photograph album 118 comprising multiple digital images 124 is obtained, may include by the file data 126 that user credential server 106 accesses Where general information related to user, such as user account information (such as login and code data), user's age, user Ground, the friend/acquaintance of photograph album 118 for being agreed access user etc..File data 126 may also comprise the makeup preference shelves of user Case data, user is described in detail for cosmetics makeup result, the hobby for the cosmetic product that can produce various face features, past Once the data etc. of cosmetic product were bought.
Spot photograph identifier 108 can generate the target figure of a group from multiple digital images 124 according to file data The content of picture, the digital image 124 that individual can be appreciated that in photograph album 118 is extensive and may include such as landscape photograph or a comprising other The photograph of body.It include that related to file data and specific description has user's face in some embodiments, in the target image of group The digital image 124 in portion region.
Products Show server 110 is configured to be able to retrieve at least one according to file data for each target image and push away Recommend product.For example, it is bought according to past attempts in the age of user and makeup preference file data in file data specific Cosmetic product, Products Show server 110 can retrieve the lipstick of a specific label and recommend user.
Image editor 112 is configured to be able to each target image of recommended products editor according to being retrieved.Citing comes It says, the lipstick simulation of a specific label can be applied to some or all of by image editor 112 according to the attribute of target image On target image.Furthermore, image editor 112 can by the lipstick of specific label, with an outdoor setting simulation application in Description has in the target image of user, and image editor 112 can also be answered the eye shadow of specific label with an indoor setting simulation Have in the target image of user for describing.In this respect, image editor 112 can be configured to be able to according to file data and every The attributes edit target image of one target image.Image editor 112 is more configured to be able to generate to be shown in client device 122 A user interface, and user interface shows one or more target images to be edited.User interface more shows and is retrieved Relevant to one or more target images to be edited recommended products (such as: lipstick).
Fig. 2 is the block schematic diagram that cloud calculates equipment 102 in Fig. 1.It can be specially various wired that cloud, which calculates equipment 102, And/or any of wireless calculatings equipment, for example, a server electronic calculate equipment or it is any there is computing capability be System.As previously mentioned, cloud, which calculates equipment 102, to be arranged to such as one or more server libraries, electronics calculating with multiple The calculating equipment of device library or other arrangements.This calculates equipment and may be placed at single place or be scattered in different geographical positions It sets.
As shown in Fig. 2, it includes a memory 214, a processing equipment 202, multiple input/output that cloud, which calculates equipment 102, Outside interface (Input/Output Interface, I/O Interface) 204, one network interface 206, a display 208, one If interface 211 and a mass storage 226, each component in equipment 102 is calculated each by a local data bus The connection of (Local Data Bus) 210.
Processing equipment 202 may include an any customized or commercially available processor, to cloud calculate equipment 102 it is relevant One central processing unit (Central Processing Unit, CPU) or the coprocessor in several computation processors, half Conductor microprocessor (microchip format), a macrogenerator (Macroprocessor), one or more specific integrated circuits (Application Specific Integrated Circuits, Asics), multiple appropriately configured digital logic gates and For coordinating the integrated operation of computing system and comprising integrated operations multiple independent and with various combination coordination computing systems Other common electrical arrangements that discrete component is constituted.
Memory 214 may include volatile memory component (Volatile Memory Element) or non-volatile deposit Any of reservoir component (Nonvolatile Memory Elements).For example, volatile memory component include with Machine accesses memory (Random Access Memory, RAM), such as dynamic random access memory (Dynamic Random Access Memory, DRAM) or static random access memory (Static Random Access Memory, SRAM).It is non- Volatile memory component can be read-only memory (Read-Only Memory, ROM), hard disk, tape, reading memory CD (Compact Disc Read-Only Memory).Memory 214 generally include for any kind of operating system and/or One primary operating system 216 of simulation hardware platform or emulating operating system, one or more native applications programs (Native Application), analogue system (Emulation System) or emulation application (Emulated Application). For example, aforementioned applications program (i.e. native applications program or simulation application) may include specific software, i.e., fall into a trap including Fig. 1 Calculate some or all of equipment 102 component.In such embodiment, component is stored in memory 214 and by processing equipment 202 It executes, therefore, the operation/function of revealed feature can be performed in processing equipment 202.Component in memory 214 is ability The technical staff in domain is known with regard to Conventional wisdom, therefore the members in memory 214 are in order to succinctly without being described in detail record.Yu Yi In a little embodiments, cloud computing device 102 can be practiced in hardware and/or software.
Input/output interface 204 provides multiple to input or the interface of output information.For example, when cloud calculates equipment 102 include a personal computer when, aforementioned components can be connected with one or more input/output interfaces 204, such as keyboard and mouse Mark, as shown in Figure 2.Display 208 includes the liquid crystal of computer display, the plasma-based screen of personal computer, hand-held device Show device, Touch Screen or other display equipment.
In disclosure of the invention, a non-instantaneous computer readable memory medium is stored with for using or and referring to Enable the program of execution system, instrument or equipment connection.Specifically, the specific example of computer readable memory medium can wrap It is read-only to include but be not limited to a portable computer diskette, a random access memory, a read-only memory, an erasable programmable Memory (Erasable Programmable Read-Only Memory, EPROM, EEPROM or Flash Memory) and one Portable compact disc (Portable Compact Disc Read-Only Memory, CDROM).
It please refers to shown in Fig. 3, Fig. 3 is the void that cloud calculates dressing effect in the various embodiments of equipment 102 in Fig. 1 of the present invention The flow chart 300 of quasi- application and product promotion.Flow chart 300 in Fig. 3 is only that can be used for realizing that cloud calculates equipment 102 The example of the different types of function arrangement of the operation of various assemblies.In other words, the flow chart 300 of Fig. 3 can be considered as describing Carry out wherein one or more embodiments that cloud calculates the method for equipment 102.
Although the flow chart 300 of Fig. 3 discloses the specific of step and executes sequence, the sequence of step is only to assist in reason The solution present invention, practical operation sequence can be different from description.For example, the execution sequence of multiple block diagrams can opposite adjustment, exchange or It pieces together.Also, in Fig. 3 with sequencing multiple block diagrams can also carry out simultaneously or part at the same carry out.And above-mentioned adjustment Replacement is still in announcement range of the invention.
In square 310, the cloud in Fig. 1 calculates equipment 102 and can get and verify the use from a client device 122 The user credential that family provides.In square 320, cloud calculates equipment 102 and obtains a photograph album comprising multiple digital images.In side In block 330, cloud calculates a file data 126 (Fig. 1) of the access of equipment 102 about user credential.In some embodiments, it deposits The files on each of customers for taking the file data about user credential to include personal data of the access including user and access are by user One makeup preference archives of one or more dressing effects of selection.
In some embodiments, each makeup preference archives are that have one or more about description in makeup preference file data One image of dressing effect, and one or more aforementioned dressing effects can be applied by user in advance.In this regard, image can be used as one Reference picture, to indicate one or more dressing effects of user preference.In some embodiments, cloud calculates 102 quilt of equipment It is arranged to imitate to analyze reference picture and recognize the previously dressing effect applied by user with the makeup of discriminating user preference Fruit.Cloud calculates equipment 102 can provide user's recommended products followed by above- mentioned information.In some embodiments, about change The image of adornment preference file data is uploaded to cloud computing device 102.In square 340, cloud computing device 102 is according to shelves Case data extract the target image of a group from multiple digital images.In some embodiments, wrapped in the target image of group Include the face area for describing the user for having client device 122.
In square 350, cloud computing device 102 is recommended according to files on each of customers for each target image retrieval at least one Product.In some embodiments, cloud computing device 102 is the inspection of each target image with the following steps according to file data 126 A rope at least recommended products.Cloud computing device 102 accesses an exchangeable image file format (Exchangeable Image File Format, EXIF), and a position data is obtained for each target image.The face of the decision user of cloud computing device 102 One face's colour of skin in portion region.Cloud computing device 102 determines the age of user according to files on each of customers.Cloud computing device 102 determine makeup preference according to makeup preference file data.
Cloud computing device 102 according to position data, face's colour of skin, user age, makeup preference in and it is above-mentioned it At least one of combination, retrieves an at least recommended products.In some embodiments, the step of an at least recommended products is retrieved Suddenly it is related to distributing the weight of position data, face's colour of skin, the age of user and preference of making up, further according to position data, face The weight combination of the colour of skin, the age of user and preference of making up, retrieves an at least recommended products for each target image.
In some embodiments, cloud computing device 102 is that each target image retrieves according to the file data of overlapping At least a recommended products is to pass through: an another user is first recognized according to the file data of overlapping, further according to prior by another user Selection and at least recommended products applied retrieve an at least recommended products for each target image.It further illustrates, asks Referring back to shown in Fig. 1, for example, user credential server 106 can determine that the file data and one second of a current user There is similitude between the file data of user.For example, user credential server 106 can check subscriber profile data, and determine mesh Preceding user and second user are with the age and/or to inhabit same city (such as: place).User credential server 106 can check The makeup preference file data of second user simultaneously recognizes second user previously interested cosmetic product.According to above- mentioned information, produce Product recommendation server 110 can show identical cosmetic product and recommend current user.
In square 360, cloud calculates equipment 102 according at least recommended products being retrieved, and edits each target Image.In some embodiments, editing each target image includes: that will correspond at least recommended products being retrieved to be formed Virtual dressing find expression in the face area of user.
In square 370, cloud calculates equipment 102 in generating a user interface on client device, one or more to show A target image to be edited.User interface, which is more shown, to be retrieved and relevant extremely to one or more target images to be edited A few recommended products.Finally, the flow chart of Fig. 3 terminates.
After the basic framework for describing the system to form virtual dressing and popularization product, please refer to comprising various features Multiple embodiments it is diagrammatically shown.Fig. 4 is that cloud calculates the target image that equipment 102 extracts a group from a photograph album in Fig. 1 To promote the schematic diagram of the various embodiments of product.Cloud calculate equipment 102 in spot photograph identifier 108, access with The photograph album 118 for the relevant user of user credential that the user of client device 122 submits.
In embodiment, spot photograph identifier 108 will do it face recognition, and from the digital image of photograph album 118 124 Generate the target image 402 of a group.As previously mentioned, the content of digital image 124 is very extensive in photograph album 118, such as may It is landscape photograph or the photograph comprising other individuals etc..As shown in figure 4, spot photograph identifier 108, which extracts specific describe, to be had The digital image 124 of user's face area relevant to user credential.In some embodiments, spot photograph identifier 108 can It is further configured and is able to target images 402 that modification description has user and other individuals, cut target image 402 and only retain Cover the part of user, the photograph 404 after generating a cutting.
Fig. 5 is the user interface 502 that the display of the client 122 of Fig. 1 in various embodiments of the invention provides to promote The schematic diagram of the demonstration example of product.Client 122 can be specially a smartphone, a tablet computing device etc..Such as Fig. 5 institute Show, user interface 502 includes describing the preview window 504 for having user's face area.Image editor 112 (Fig. 1) is according to production The cosmetic product that product recommendation server 110 (Fig. 1) retrieves, virtual application show one or more dressing effects.
As shown in demonstration example, the display of user interface 502 is applied to the face area cosmetic product (such as lipstick) of user Information 506.The information 506 for being shown to user includes but is not limited to: product description (such as label name, ProductName, product image), Product specification (such as color, Packing Unit, quality), purchase information (such as internet retailer sell product unified resource positioning Accord with (Uniform Resource Locator, URL) etc..
Content disclosed above is only preferred possible embodiments of the invention, not thereby limits to right of the invention and wants The protection scope of book is sought, so all equivalence techniques variations done with description of the invention and accompanying drawing content, are both contained in In the protection scope of claims of the present invention.

Claims (20)

1. a kind of method for being rendered in cloud and calculating equipment, which comprises the following steps:
A user credential is obtained and verifies, the user credential is provided by a user of a client device;
Obtain the photograph album comprising multiple digital images;
Access a file data relevant to the user credential;
According to the file data, the target image of a group is extracted from multiple digital images, wherein in the group Each target image describe the face area for having the user;
According to the file data, an at least recommended products is retrieved for each target image;
According at least one recommended products being retrieved, each target image is edited;And
The user interface for being shown in the client device is generated, the user interface shows that one or more are to be edited described Target image, the user interface, which is separately shown, to be retrieved and one or more target images relevant at least one to be edited The recommended products.
2. the method according to claim 1, wherein the step of editing each target image includes:
The virtual dressing that a cosmetic product of at least one recommended products being retrieved will be corresponded to, finds expression in the user The face area.
3. the method according to claim 1, wherein the access file data relevant to the user credential The step of include access:
One subscriber profile data, the files on each of customers include personal data relevant to the user;And one makeup preference shelves One or more dressing effects selected by the user are described in detail in case data, the makeup preference file data, wherein each described Makeup preference file data has a ginseng of one or more dressing effects with being specified in describe in the makeup preference file data Examine image correlation, wherein the reference picture relevant to the makeup preference file data is uploaded to be calculated in the cloud Equipment.
4. according to the method described in claim 3, it is characterized in that, describing one or more describedization in the reference picture Adornment effect is applied by the user in advance.
5. according to the method described in claim 3, it is characterized in that, according to the file data be each target image, The step of retrieving an at least recommended products include:
Following steps are executed for each target image:
An exchangeable image file format is accessed, and obtains a position data for each target image;
Determine face's colour of skin of the face area of the user;
According to the files on each of customers, the age of the user is determined;And
According to the makeup preference file data, makeup preference is determined;And
According in the position data, face's colour of skin, the age of the user and the makeup preference at least One, at least one recommended products is retrieved for each target image.
6. according to the method described in claim 5, it is characterized in that, according to the position data, face's colour of skin, the use At least one of the age at family and the makeup preference retrieve for each target image and at least push away described in one The step of recommending product include:
Distribute the power of each position data, face's colour of skin, the age of the user and the makeup preference Weight;And
According to a weight of the position data, face's colour of skin, the age of the user and the makeup preference Combination retrieves at least one recommended products for each target image.
7. according to the method described in claim 3, it is characterized in that, being each target image according to the file data The step of retrieving an at least recommended products include:
An another user is recognized according to the file data of overlapping;And
It is each target image according at least one recommended products for being selected and being applied by another user in advance Retrieve at least one recommended products.
8. a kind of system for being rendered in cloud and calculating equipment characterized by comprising
One memory, the memory are stored with multiple instruction;And
One processor, the processor are coupled to the memory and configured with multiple described instructions, and multiple described instructions are at least Include:
A user credential is obtained and verifies, the user credential is provided by a user of a client device;
Obtain the photograph album comprising multiple digital images;
Access a file data relevant to the user credential;
According to the file data, the target image of a group is extracted from multiple digital images, wherein in the group Each target image describe the face area for having the user;
According to the file data, an at least recommended products is retrieved for each target image;
According at least one recommended products being retrieved, each target image is edited;And
The user interface for being shown in the client device is generated, the user interface shows that one or more are to be edited described Target image, the user interface, which is separately shown, to be retrieved and one or more target images relevant at least one to be edited The recommended products.
9. system according to claim 8, which is characterized in that the processor is retrieved at least by that will correspond to The virtual dressing of one cosmetic product of one recommended products finds expression in the face area of the user, to edit each institute State target image.
10. system according to claim 8, which is characterized in that the processor access is relevant to the user credential The instruction of the file data is by access:
One files on each of customers, the files on each of customers include personal data relevant to the user;And
One makeup preference file data, the makeup preference file data are described in detail one or more makeups selected by the user and imitate Fruit, wherein each makeup preference file data be specified in the makeup preference file data describe have it is one or more One reference picture of a dressing effect is related, wherein on the reference picture relevant to the makeup preference file data It passes and calculates equipment in the cloud.
11. system according to claim 10, which is characterized in that describe described in the reference picture one or more Dressing effect is applied by the user in advance.
12. system according to claim 10, which is characterized in that the processor is each institute according to the file data State target image, retrieve the instruction of an at least recommended products the following steps are included:
It is each target image by following steps:
An exchangeable image file format is accessed, and obtains a position data for each target image;
Determine face's colour of skin of the face area of the user;
According to the files on each of customers, the age of the user is determined;And
According to the makeup preference file data, makeup preference is determined;And
According in the position data, face's colour of skin, the age of the user and the makeup preference at least One, at least one recommended products is retrieved for each target image.
13. system according to claim 12, which is characterized in that the processor is according to the position data, the face At least one of portion's colour of skin, the age of the user and described makeup preference, for each target image retrieval The instruction of at least one recommended products includes the following steps: out
Distribute the weight of the position data, face's colour of skin, the age of the user and the makeup preference;With And
According to a weight of the position data, face's colour of skin, the age of the user and the makeup preference Combination retrieves at least one recommended products for each target image.
14. system according to claim 10, which is characterized in that the processor is each according to the file data The instruction that the target image retrieves an at least recommended products includes the following steps:
An another user is recognized according to the file data of overlapping;And
It is each target image according at least one recommended products for being selected and being applied by another user in advance Retrieve at least one recommended products.
15. a kind of non-instantaneous computer readable memory medium, which is characterized in that the non-instantaneous computer-readable storage matchmaker Body is stored with multiple instruction, and multiple described instructions are rendered in the calculating equipment with a processor, when multiple described instructions are real For row when the processor, the calculating equipment at least carries out following steps:
A user credential is obtained and verifies, the user credential is provided by a user of a client device;
Obtain the photograph album comprising multiple digital images;
Access a file data relevant to the user credential;
According to the file data, the target image of a group is extracted from multiple digital images, wherein in the group Each target image describe the face area for having the user;
According to the file data, an at least recommended products is retrieved for each target image;
According at least one recommended products being retrieved, each target image is edited;And
The user interface for being shown in the client device is generated, the user interface shows that one or more are to be edited described Target image, the user interface, which is separately shown, to be retrieved and one or more target images relevant at least one to be edited The recommended products.
16. non-instantaneous computer readable memory medium according to claim 15, which is characterized in that the processor is logical It crosses and the virtual dressing for corresponding to a cosmetic product of at least one recommended products being retrieved is found expression in the user's The face area, to edit each target image.
17. non-instantaneous computer readable memory medium according to claim 15, which is characterized in that the processor is deposited Take the file data relevant to the user credential by access:
One files on each of customers, the files on each of customers include personal data relevant to the user;And
One makeup preference file data, the makeup preference file data are described in detail one or more makeups selected by the user and imitate Fruit, wherein each makeup preference file data be specified in the makeup preference file data describe have it is one or more One reference picture of a dressing effect is related, wherein on the reference picture relevant to the makeup preference file data It passes and calculates equipment in the cloud.
18. non-instantaneous computer readable memory medium according to claim 17, which is characterized in that be depicted in the ginseng One or more the described dressing effects examined in image are applied by the user in advance.
19. non-instantaneous computer readable memory medium according to claim 17, which is characterized in that the processor root It is each target image according to the file data, retrieves an at least recommended products and include the following steps:
It is each target image by following steps:
An exchangeable image file format is accessed, and obtains a position data for each target image;
Determine face's colour of skin of the face area of the user;
According to the files on each of customers, the age of the user is determined;And
According to the makeup preference file data, makeup preference is determined;And
According in the position data, face's colour of skin, the age of the user and the makeup preference at least One, at least one recommended products is retrieved for each target image.
20. non-instantaneous computer readable memory medium according to claim 19, which is characterized in that the processor root According at least one of the position data, face's colour of skin, the age of the user and described makeup preference, it is It includes carrying out the following steps that each target image, which retrieves at least one recommended products:
Distribute the weight of the position data, face's colour of skin, the age of the user and the makeup preference;With And
According to a weight of the position data, face's colour of skin, the age of the user and the makeup preference Combination retrieves at least one recommended products for each target image.
CN201811313304.8A 2018-02-02 2018-11-06 Method, system and storage medium for virtually applying makeup effect and promoting product Active CN110135930B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862625400P 2018-02-02 2018-02-02
US62/625,400 2018-02-02

Publications (2)

Publication Number Publication Date
CN110135930A true CN110135930A (en) 2019-08-16
CN110135930B CN110135930B (en) 2022-02-11

Family

ID=67568334

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811313304.8A Active CN110135930B (en) 2018-02-02 2018-11-06 Method, system and storage medium for virtually applying makeup effect and promoting product

Country Status (1)

Country Link
CN (1) CN110135930B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113392671A (en) * 2020-02-26 2021-09-14 上海依图信息技术有限公司 Commodity retrieval method and device based on customer actions and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101668451A (en) * 2007-03-08 2010-03-10 惠普开发有限公司 Method and system for recommending a product based upon skin color estimated from an image
US20120223956A1 (en) * 2011-03-01 2012-09-06 Mari Saito Information processing apparatus, information processing method, and computer-readable storage medium
KR20140077322A (en) * 2012-12-14 2014-06-24 한국전자통신연구원 Method for recommending cosmetic products and apparatus using the method
CN104873197A (en) * 2014-02-28 2015-09-02 花王株式会社 Skin evaluation method, skin care product or cosmetic recommendation method
US20150339757A1 (en) * 2014-05-20 2015-11-26 Parham Aarabi Method, system and computer program product for generating recommendations for products and treatments

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101668451A (en) * 2007-03-08 2010-03-10 惠普开发有限公司 Method and system for recommending a product based upon skin color estimated from an image
US20120223956A1 (en) * 2011-03-01 2012-09-06 Mari Saito Information processing apparatus, information processing method, and computer-readable storage medium
KR20140077322A (en) * 2012-12-14 2014-06-24 한국전자통신연구원 Method for recommending cosmetic products and apparatus using the method
CN104873197A (en) * 2014-02-28 2015-09-02 花王株式会社 Skin evaluation method, skin care product or cosmetic recommendation method
US20150339757A1 (en) * 2014-05-20 2015-11-26 Parham Aarabi Method, system and computer program product for generating recommendations for products and treatments

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113392671A (en) * 2020-02-26 2021-09-14 上海依图信息技术有限公司 Commodity retrieval method and device based on customer actions and electronic equipment

Also Published As

Publication number Publication date
CN110135930B (en) 2022-02-11

Similar Documents

Publication Publication Date Title
JP6855595B2 (en) Using machine learning to recommend live stream content
US10607264B2 (en) Systems and methods for virtual application of cosmetic effects to photo albums and product promotion
US20100145794A1 (en) Media Processing Engine and Ad-Per-View
US20170142463A1 (en) Using cluster computing for generating personalized dynamic videos
CN108650558A (en) The generation method and device of video Previously on Desperate Housewives based on interactive video
WO2013138370A1 (en) Interactive overlay object layer for online media
TW201812614A (en) Page information processing system, and method and apparatus for generating pages and providing page information
US20220138836A1 (en) Systems and methods for virtual application of cosmetic products based on facial identification and corresponding makeup information
US20150073940A1 (en) System and method for online shopping from social media and do-it-yourself (diy) video files
JP5422157B2 (en) How to serve video ads
Zuo et al. Exploring consumers’ impulse buying behavior in live streaming shopping
TW200910114A (en) Gathering statistics based on container exchange
KR20100059646A (en) Method and apparatus for providing advertising moving picture
CN108769831B (en) Video preview generation method and device
Bazen et al. Musicians and the Creative Commons: A survey of artists on Jamendo
US20140214522A1 (en) Methods and systems for providing online events
CN110135930A (en) Virtual application dressing effect and the method, system and storage media for promoting product
Ziagkas et al. Greek traditional dances 3d motion capturing and a proposed method for identification through rhythm pattern analyses (terpsichore project)
Liang et al. Multiple facial image editing using edge–aware PDE learning
CN110135929A (en) It is rendered in the system, method and storage media of virtual makeup application program
US20040233200A1 (en) Systems and methods for interactive multimedia presentation and marketing
US20030101067A1 (en) Method of profiling talent in a multimedia format
JP7044460B2 (en) Distribution device, distribution method and distribution program
Wu et al. How to promote film tourism more effectively? From a perspective of self-congruity and film tourism experience
Sousa et al. Influencing wine tourists' decision-making with VR: The impact of immersive experiences on their behavioural intentions

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant