CN110930173B - System and method for execution on computing device - Google Patents
System and method for execution on computing device Download PDFInfo
- Publication number
- CN110930173B CN110930173B CN201910464460.2A CN201910464460A CN110930173B CN 110930173 B CN110930173 B CN 110930173B CN 201910464460 A CN201910464460 A CN 201910464460A CN 110930173 B CN110930173 B CN 110930173B
- Authority
- CN
- China
- Prior art keywords
- makeup
- user
- cosmetic
- digital image
- program
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0281—Customer communication at a business location, e.g. providing product or service information, consulting
-
- A—HUMAN NECESSITIES
- A45—HAND OR TRAVELLING ARTICLES
- A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
- A45D44/00—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
-
- A—HUMAN NECESSITIES
- A45—HAND OR TRAVELLING ARTICLES
- A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
- A45D44/00—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
- A45D44/005—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms for selecting or displaying personal cosmetic colours or hairstyle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0631—Item recommendations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0641—Shopping interfaces
- G06Q30/0643—Graphical representation of items or shoppers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- A—HUMAN NECESSITIES
- A45—HAND OR TRAVELLING ARTICLES
- A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
- A45D44/00—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
- A45D2044/007—Devices for determining the condition of hair or skin or for selecting the appropriate cosmetic or hair treatment
Abstract
The invention discloses a system and a method executed on computing equipment, wherein the method executed on the cosmetic evaluation computing equipment comprises the following steps: obtaining a request from a user to start a makeup evaluation program; starting a makeup evaluation program under the condition that a login certificate of a user is not required to be obtained; obtaining a digital image, wherein the digital image comprises a face area of a user; generating a user interface to display at least one cosmetic product; obtaining a selection of cosmetic products from the user, the selection including one or more displayed cosmetic products; virtually applying the selected cosmetic product to the user's facial area in the digital image; storing the selection of the cosmetic product; generating a makeup program package, wherein the makeup program package is provided with a digital image containing a face area of a user and a selection result of a stored makeup product; transmitting the makeup program package to a cloud server; the makeup evaluation procedure was terminated.
Description
Technical Field
The present invention relates to a system and method for executing on a computing device, and more particularly, to a system and method for virtually applying a cosmetic product according to facial recognition and corresponding cosmetic information.
Background
People still have difficulty achieving the makeup effect like a professional color dresser although investing a large amount of money in the makeup tools and accessories thereof. In some retail stores, professional color cosmetic consultants often recommend cosmetic products to assist customers in achieving a desired makeup. However, the professional makeup clerk may sometimes provide limited service due to the large number of customers seeking makeup counseling at the same time. In other retail stores, multimedia machines are installed for customers to evaluate and try out cosmetic products. It is very difficult for the customer to remember a large amount of makeup information for all cosmetic products that have been tried during the makeup evaluation. In addition, some customers consider that the operation of establishing an account on a multimedia machine to track makeup information is too tedious and tedious. Therefore, there is still a need for improvement of the existing equipment for customers to efficiently evaluate and track the cosmetic products expected to be purchased and for customers to make color cosmetic inquiries.
Disclosure of Invention
In one embodiment of the present invention, an execution method of a makeup evaluation computing device is provided, which includes: obtaining a request from a user to start a makeup evaluation program; starting a makeup evaluation program under the condition that a login certificate of a user is not required to be obtained; obtaining a digital image, wherein the digital image comprises a face area of a user; generating a user interface to display at least one cosmetic product; obtaining a selection of cosmetic products from the user, the selection including one or more displayed cosmetic products; virtually applying the selected cosmetic product to the facial area of the user in the digital image; storing the selection of the cosmetic product; generating a makeup program package, wherein the makeup program package is provided with a digital image containing a face area of a user and a selection result of a stored makeup product; transmitting the makeup program package to a cloud server; and terminating the makeup evaluation procedure.
Preferably, the makeup evaluation computing device is installed in a retail store.
Preferably, the step of generating a user interface for displaying at least one cosmetic product comprises:
identifying facial features depicted in the facial region; and
at least one cosmetic product is obtained according to the facial features.
Preferably, the method performed by the makeup evaluation computing device further comprises: and after the makeup evaluation program is terminated, deleting the digital image containing the face area of the user in a local storage of the makeup evaluation computing device and the cosmetic products in the stored selection result.
In another embodiment, a method performed by a customer premises equipment comprises: obtaining a request from a user to obtain makeup information from a cloud server; obtaining a digital image, wherein the digital image comprises a face area of a user; transmitting the digital image to a cloud server to start a communication program under the condition that a login certificate of a user is not required to be obtained; the cloud server searches a color cosmetic program package by comparing the digital images which are consistent with the transmitted digital images in the plurality of digital images of the cloud server, and transmits the color cosmetic program package, wherein the color cosmetic program package has a selection result of a corresponding cosmetic product; customer end equipment receives the makeup program package and extracts a selection result of a makeup product; generating a user interface to display the cosmetic products in the selection result; and virtually applying the cosmetic product in the selection result to the face area of the user in the digital image.
Preferably, the method performed by the customer-side device further comprises: identifying a group of currently online makeup consultants; generating a subset of color cosmetic consultants from the group based on the cosmetic products in the selection; displaying the subset of the color cosmetic consultants in a user interface; obtaining a selection from the user of the makeup advisor; and establishing a makeup counseling program between the client side equipment and the selected one of the makeup counselors.
Preferably, the step of generating a subset of the color cosmetic advisors from the group based on the cosmetic products in the selection comprises: acquiring data information of each makeup consultant in the group; and identifying a makeup consultant having past experience related to the use of the cosmetic product in the selected result among the makeup consultants of the group based on the data information.
Preferably, the step of establishing a makeup counseling procedure between the customer-side equipment and a selected one of the makeup counselors comprises: obtaining a login credential from a user; and establishing a color makeup consultation program between the client-side equipment and the selected color makeup consultant equipment based on the login voucher.
Preferably, the cosmetic products in the selection result are sequentially displayed according to the evaluation of the cosmetic products previously performed by the user in a cosmetic evaluation computing device installed in a retail store.
Preferably, the method performed by the customer-side device further comprises: in the user interface, a sequential list of cosmetic products selected by a user of the customer premises equipment is displayed.
In another embodiment, a makeup evaluation system includes: a memory storing a plurality of instructions; and a processor coupled to the memory and configured with a plurality of instructions. The plurality of instructions includes at least: obtaining a request from a user to start a makeup evaluation program; starting a makeup evaluation program under the condition that a login certificate of a user is not required to be obtained; obtaining a digital image, wherein the digital image comprises a face area of a user; generating a user interface to display at least one cosmetic product; obtaining a selection of cosmetic products from the user, the selection including one or more displayed cosmetic products; virtually applying the selected cosmetic product to the facial area of the user in the digital image; storing the selection of the cosmetic product; generating a makeup program package, wherein the makeup program package is provided with a digital image containing a face area of a user and a selection result of a stored makeup product; transmitting the makeup program package to a cloud server; and terminating the makeup evaluation procedure.
Preferably, the system is installed in a retail store.
Preferably, the processor generates the user interface to display at least one cosmetic product, further comprising: identifying facial features depicted in the facial region; and retrieving at least one cosmetic product according to the facial features.
Preferably, after terminating the makeup evaluation process, the processor is configured to delete the digital image including the face area of the user and the cosmetic product in the stored selection result from a local storage.
In yet another embodiment, a system comprises: a memory, the memory storing a plurality of instructions; and a processor coupled to the memory and configured with a plurality of instructions. The plurality of instructions includes at least: obtaining a request from a user to obtain makeup information from a cloud server; obtaining a digital image, wherein the digital image comprises a face area of a user; under the condition that a login certificate of a user is not required to be obtained, the digital image is transmitted to a cloud server so as to start a communication program; the cloud server searches a color cosmetic program package by comparing the digital images which are consistent with the transmitted digital images in the plurality of digital images of the cloud server, and transmits the color cosmetic program package, wherein the color cosmetic program package has a selection result of a corresponding cosmetic product; receiving a makeup program package and extracting a selection result of a makeup product; generating a user interface to display the cosmetic products in the selection result; and virtually applying the cosmetic product in the selection result to the face area of the user in the digital image.
Preferably, the processor is further configured to: identifying a group of currently online makeup consultants; generating a subset of color cosmetic consultants from the group based on the cosmetic products in the selection; displaying the subset of the color cosmetic advisor in a user interface; obtaining a selection result of the makeup counselor from the user; and establishing a makeup consultation program between the client-side equipment and the selected makeup consultant equipment.
Preferably, the instructions for generating a subset of the color cosmetic advisors from the group based on the cosmetic products in the selection further comprise: obtaining data information of each makeup consultant in the group; and identifying a makeup counselor having experience related to the use of the cosmetic product in the selection result in the past among the makeup counselors of the group according to the data information.
Preferably, the processor sets up a makeup advisory program of instructions between the customer-side equipment and a selected one of the makeup consultants, further comprising: obtaining a login credential from a user; and establishing a color makeup consultation program between the client-side equipment and the selected color makeup consultant equipment based on the login voucher.
Preferably, the cosmetic products in the selection result are sequentially displayed according to the evaluation of the cosmetic products previously made by the user in a cosmetic evaluation computing device installed in a retail store.
Preferably, the processor is further configured to: in the user interface, a sequential list of cosmetic products selected by a user of the customer premises equipment is displayed.
For a better understanding of the features and technical content of the present invention, reference should be made to the following detailed description of the invention and accompanying drawings, which are provided for purposes of illustration and description only and are not intended to limit the invention.
Drawings
For a better understanding of the features and technical content of the present invention, reference should be made to the following detailed description of the invention and accompanying drawings, which are provided for purposes of illustration and description only and are not intended to limit the invention.
FIG. 1 is a block diagram illustrating virtual application of makeup products in a network environment according to facial recognition and corresponding makeup information, in accordance with various embodiments of the present invention.
Fig. 2 shows a schematic diagram of the invention as performed by the apparatus of fig. 1 in various embodiments.
Fig. 3 illustrates a top-level flow diagram of a virtual application of a cosmetic product according to facial recognition and corresponding makeup information, implementing some of the functions of the device of fig. 1, in various embodiments of the present invention.
Detailed Description
The following is a description of a system and method for recommending cosmetic products to a user and for the user to evaluate the recommended cosmetic products by way of specific embodiments. And the user can obtain the relevant information of the concerned cosmetic product through the use of the digital image at a later date and can further utilize the information. For example, cosmetic products of interest may be purchased, or a cosmetic advisory program may be initiated with an available professional cosmetic applicator. It is noted that in various embodiments, the user does not need to provide login credentials (e.g., username and password) to access the information stored in the cloud. That is, the user may not submit personal contact information, such as an email box, or other information that the user would not like to disclose.
The following will describe a system for virtually applying a cosmetic product according to facial recognition and corresponding makeup information, and then describe the operation of components in the system. Fig. 1 is a block diagram of a network environment including a makeup evaluation computing device 102, a cloud server device 114, and a client device 122. The cosmetic evaluation computing device 102, the cloud server device 114, and the client device 122 are communicatively coupled to each other through a network 112, where the network 112 may be the Internet (Internet), intranet (intranet), extranet (extranet), wide Area Network (WANs), local Area network (LANs ), wired network (Wired Networks), wireless network (Wireless Networks), or other suitable Networks, and may also be coupled to more than two Networks.
Both the makeup evaluation computing device 102 and the customer-side device 122 may be implemented as a computing device such as, but not limited to: smart phones, tablet computing devices, notebook computers, or the like. Server device 114 may comprise a server computer or any other computing-enabled system. Additionally, server device 114 may be utilized by a plurality of computing devices that may be arranged, for example, one or more server libraries, computer libraries, or other arrangements. As such, the computing device may be installed at one location or may be distributed across multiple locations.
The makeup evaluation computing device 102 may be installed in a retail store, and the makeup evaluation computing device 102 may recommend a makeup product to a user and provide the user with an evaluation of the recommended makeup product. A makeup evaluation server 104 executes on a processor of the makeup evaluation computing device 102 to perform the operations and functions disclosed herein. The makeup evaluation server 104 includes a program manager 106, a User Interface (UI) generator 108, a virtual makeup applicator 110, and a packet generator 111.
The program manager 106 is configured to obtain a request from a user to initiate a makeup evaluation program. The program manager 106 may start the makeup evaluation program without obtaining a login credential for the user. Compared with the conventional method of starting the makeup evaluation program by using a login certificate (user name and password), the program manager 106 of the present invention starts the makeup evaluation program by obtaining a digital image, and using the obtained digital image, wherein the digital image includes the face area of the user. After omitting the step of entering the login credentials, the user may access the contents of cloud server 114 without spending time setting up an account on makeup evaluation computing device 102. In addition, the user does not need to submit contact information such as an email box, and personal privacy can be maintained.
As will be appreciated by those skilled in the art, the digital image may be encoded in the form of a file, such as but not limited to: JPEG (Joint Photographic Experts Group) File, TIFF (Tagged Image File Format) File, PNG (Portable Network Graphics) File, GIF (Graphics Interchange Format) File, BMP (Bitmap) File, or other types of digital File forms, but not limited thereto. In addition, the digital image can also be obtained from a still image of a video, such as but not limited to: MPEG-1 (Motion Picture Experts Group-1), MPEG-2, MPEG-4, H.264, 3GPP (Third Generation Partnership Project), 3GPP-2, SD-Video (Standard-Definition Video), HD-Video (High-Definition Video), DVD (Digital Video Disc) multimedia, VCD (Video Compact Disc) multimedia, HD-DVD (High-Definition Digital Video Disc) multimedia, DTV/HDTV (Digital Video/High-Definition Digital Video) multimedia AVI (Audio Video Interleave), DV (Digital Video), QT (QuickTime) files, WMV (Windows Media Video), ASF (Advanced System Format), RM (Real Media), FLV (Flash Media), MP3 (MPEG Audio Layer III), MP2 (MPEG Audio Layer II), WAV (wave form Audio Format), WMA (Windows Media Audio), 360Degree Video (360 DegreVideo), 3D Scan Model (3D Scan Model), or other kinds of Digital forms.
The user interface generator 108 is configured to generate a user interface to display one or more cosmetic products. The user interface generator 108 may obtain a selection of cosmetic products from the user, the selection including one or more of the displayed cosmetic products. The virtual makeup applicator 110 is configured to virtually apply the selected makeup product to the facial area of the user in the digital image, for the user to evaluate the use effect of the selected makeup product. The package generator 111 is configured to generate a makeup program package 113, the makeup program package 113 including a digital image 109 including a face area of the user, and product information 115 of the cosmetic product in the stored selection result. The package generator 111 may transmit the makeup kit package 113 to the cloud server device 114. A data management server 116 executes on the processor of the cloud server device 114, and may store the makeup kit package 113 in a database 118.
A virtual makeup applicator 124 is executed on a processor of the customer device 122 so that the customer device 122 can perform the operations and functions disclosed herein. Virtual makeup applicator 124 is configured to obtain a request from a user to retrieve makeup information from cloud server device 114. The virtual makeup application 124 may initiate a communication with the cloud server device 114 without obtaining a login credential for the user. As described above, after the step of inputting the login credentials of the user is omitted, the user can access the content on the cloud server 114 without spending time setting up an account. In addition, the user does not need to submit contact information such as an email box, and personal privacy can be maintained.
Virtual makeup applicator 124 may obtain a digital image that includes the facial area of the user and may transmit the digital image to cloud server device 114. The cloud server device 114 obtains the makeup program package 113, where the makeup program package 113 includes the digital image corresponding to the face area of the user and the corresponding makeup product in the selection result. Cloud server device 114 then sends makeup program package 113 to client device 122. The virtual makeup applicator 124 generates a user interface to display the makeup products in the selection result specified in the makeup program package 113. The virtual makeup applicator 124 virtually applies the makeup product selected in the result to the user's facial area in the digital image.
Fig. 2 is a block diagram of make-up evaluation computing device 102, cloud server device 114, and customer-side device 122 of fig. 1. The aforementioned Computing devices 102, 114, 122 may be implemented as any of a variety of wired or wireless Computing devices, such as a desktop Computer, a portable Computer, a Dedicated Server Computer (Dedicated Server Computer), a multi-tasking Computing Device (multi-processor Computing Device), a smart phone or tablet, and so forth. Referring to fig. 2, each of the computing devices 102, 114, and 122 includes a memory 214, a processing device 202, a plurality of Input/Output interfaces (I/O interfaces) 204, a network Interface 206, a display 208, a peripheral Interface 211, and a mass storage 226, which are connected by a Local Data Bus (Local Data Bus) 210.
The Processing device 202 may include any custom made or commercially available processor, a Central Processing Unit (CPU) associated with the computing device 102 or a coprocessor within the computing device, a semiconductor microprocessor (in the form of a microchip), a Macroprocessor (microprocessor), one or more Application Specific Integrated Circuits (ASICs), a plurality of suitably configured digital logic gates, and other conventional electronic configurations comprising a plurality of discrete components for coordinating the overall operation of the computing system, both independently and in various combinations.
The Memory 214 may include any one of Volatile Memory components (Volatile Memory Elements) or Nonvolatile Memory components (Nonvolatile Memory Elements). For example, the volatile Memory component includes a Random Access Memory (RAM), such as a Dynamic Random Access Memory (DRAM) or a Static Random Access Memory (SRAM). The non-volatile Memory component can be Read-Only Memory (ROM), hard disk, magnetic tape, or Compact Disc Read-Only Memory (Compact Disc Read-Only Memory). The memory 214 generally includes a Native operating System 216, one or more Native applications (Native Application), emulation systems (Emulation System), or Emulated applications (Emulated Application) for any kind of operating System and/or Emulated hardware platform or Emulated operating System. For example, the aforementioned applications (i.e., native applications or simulation applications) may include specific software, i.e., include some or all of the components of the computing devices 102, 114, 122 of FIG. 1. In such embodiments, the components are stored in the memory 214 and executed by the processing device 202 such that the processing device 202 may perform the operations/functions of the features disclosed herein. The components in the memory 214 are well known to those skilled in the art, and therefore some of the components in the memory 214 are not described in detail for the sake of brevity. In some embodiments, the computing devices 102, 114, 122 may execute in hardware and/or software.
Input/output interface 204 provides any number of interfaces to input or output data. For example, when the computing devices 102, 114, 122 comprise a personal computer, the aforementioned components may be connected to one or more input/output interfaces 204, such as a keyboard and mouse, as shown in FIG. 2. The display 208 may include a computer monitor, a plasma screen (LCD) of a personal computer, a liquid crystal display of a handheld device, a touch screen, or other display device.
In the present disclosure, a non-transitory computer readable medium stores a program for use by or in connection with an instruction execution system, apparatus, or device. More specifically, specific examples of computer-readable media may include, but are not limited to, a Portable computer diskette, a random access Memory, a Read-Only Memory, an Erasable Programmable Read-Only Memory (EPROM, EEPROM, or Flash Memory), and a Portable Compact Disc Read-Only Memory (CDROM).
Referring to fig. 3, fig. 3 is a flowchart 300 of virtual application of cosmetic products according to facial recognition and corresponding makeup information, based on interaction of components in the network environment of fig. 1. The flow diagram 300 of FIG. 3 is merely an example of a different type of functional layout that may be implemented by various components of the computing devices 102, 114, 122 of FIG. 1. In other words, the flowchart 300 of fig. 3 may be viewed as describing one or more of the embodiments of the steps performed in executing the method of the computing devices 102, 114, 122.
Although a particular order of execution is disclosed in the flowchart 300 of fig. 3, the order of execution is merely to aid in understanding the present invention, and the actual order of operation may vary from that described. For example, the order of execution of two or more block diagrams may be modified, interchanged, or combined. Also, several blocks shown in fig. 3 in sequence may be performed simultaneously or partially simultaneously. And such modifications and alterations are still within the scope of the present disclosure.
At block 310, the cosmetic evaluation computing device 102 initiates a cosmetic evaluation procedure based on the user input. In some embodiments, the makeup evaluation computing device 102 may be installed in a retail store. At block 315, the makeup evaluation computing device 102 obtains a digital image of the area containing the user's face and provides a plurality of makeup products. In some embodiments, the cosmetic product is displayed in the user interface generated by the cosmetic assessment computing device 102 based on facial features and parameters depicted in the digital image. At block 320, the makeup evaluation computing device 102 obtains one or more cosmetic product selections and virtually applies the selected cosmetic products to the digital image of the user.
At block 325, the makeup evaluation computing device 102 may generate a makeup program package 113 (FIG. 1) by entraining the packaged digital image and the makeup product selected by the user. In addition to this, other information related to cosmetic products, such as: the price, ingredients, manufacturing location and application method of the cosmetic product can also be packaged in the cosmetic program package 113. Then, the makeup evaluation computing device 102 may upload the makeup program package 113 to the cloud server device 114. At block 330, the cloud server device 114 stores the makeup program package 113 in the database 118 (fig. 1).
At block 335, the makeup evaluation computing device 102 terminates the makeup evaluation process. When the makeup evaluation program is terminated, the digital image of the user in the local storage of the makeup evaluation computing device 102 and the cosmetic product selected by the user in the stored selection result are deleted. In this case, the digital image and the makeup product in the selection result are only temporarily stored in the makeup evaluation computing device 102.
At a later date, the user may wish to retrieve information regarding cosmetic products previously selected in the retail store. As an example of this scenario, a user may communicate with cloud server device 114 via a client device 122 (e.g., a user's smart phone, laptop computer, or other computing device) to access information related to a previously selected cosmetic product. At block 340, the client device 122 obtains a digital image including the facial region of the user. At block 345, client device 122 sends the digital image to cloud server device 114 to initiate a communication with cloud server device 114. It is noted that the customer-side device 122 may initiate the communication procedure without using any login credentials (e.g., username and password) associated with the user.
In block 350, the cloud server device 114 analyzes the digital images uploaded by the client device 122, searches the database 118, and compares the uploaded digital images with the digital images in each of the makeup program packages 113 in the database 118. Cloud server device 114 retrieves a most appropriate digital image from database 118 and sends its corresponding cosmetic program package 113 to client device 122.
At block 355, the client device 122 analyzes the makeup program package 113 downloaded from the cloud server device 114 and obtains the makeup product included in the makeup program package 113. In some embodiments, the user may generate a user interface at the customer-side device 122 by using the color cosmetic evaluation computing device 102 in the retail store. The cosmetic products displayed in the user interface may be arranged in an order selected by the previous user. The customer-side device 122 may virtually apply the cosmetic products in the downloaded cosmetic program package 113.
In some embodiments, the client device 122 may identify a group of currently online makeup consultants and display a list of makeup consultants based on the makeup products specified in the makeup program package 113 downloaded from the cloud server device 114. Specifically, the client device 122 is configured to obtain data information of each online makeup advisor and identify a makeup advisor who has previously experienced a makeup product using the makeup program package 113. The customer-side device 122 displays a list of suitable color cosmetic advisors to the user (block 360).
The user may then initiate a makeup advisory program with a makeup advisor to obtain recommendations for other similar makeup products or other improved applications of makeup products previously selected by the user. In some embodiments, the user may attempt to enter login credentials via the client device 122 to provide information about the makeup advisor user to assist in the makeup consultation procedure. In the cosmetics advisory program, new cosmetic products and improved applications of previously selected cosmetic products may be stored and linked to the login credentials. Finally, the flow chart of fig. 3 ends.
The disclosure is only a preferred embodiment of the invention, and is not intended to limit the scope of the claims, so that all technical equivalents and modifications using the contents of the specification and drawings are included in the scope of the claims.
Claims (18)
1. A method performed on a makeup evaluation computing device, comprising:
obtaining a request from a user to start a makeup evaluation program;
starting the makeup evaluation program under the condition that a login certificate of the user is not required to be obtained;
obtaining a digital image, the digital image including the facial region of the user, and storing the digital image in a database of a makeup evaluation computing device;
generating a user interface to display at least one cosmetic product;
obtaining a selection of the cosmetic product from the user, the selection including one or more of the displayed cosmetic products;
virtually applying the selected cosmetic product to the user's facial area in the digital image;
storing the selection of the cosmetic product in the database of the makeup evaluation computing device;
generating a makeup program package having the digital image including the facial area of the user, and entraining the selection result of the makeup product in the makeup program package;
transmitting the makeup program package to a cloud server;
terminating the makeup evaluation program;
obtaining a request from a user to obtain makeup information from a cloud server;
obtaining a digital image, wherein the digital image comprises a face area of the user;
transmitting the digital image to the cloud server to start a communication program under the condition that a login certificate of the user is not required to be obtained; under the condition that a login certificate is not needed, by comparing a digital image which is consistent with the transmitted digital image and carrying out face identification in a plurality of digital images of the cloud server, the cloud server retrieves a color cosmetic program package and transmits the color cosmetic program package, wherein the color cosmetic program package has a selection result of a corresponding cosmetic product;
receiving the makeup program package and extracting the selection result of the makeup product;
generating a user interface to display the cosmetic product in the selection result; and
virtually applying the cosmetic product in the selection result to the face area of the user in the digital image.
2. The method of claim 1, wherein the makeup evaluation computing device is installed in a retail store.
3. The method of claim 1, wherein the step of generating a user interface to display at least one cosmetic product comprises:
recognizing facial features depicted in the facial region; and
and acquiring at least one cosmetic product according to the facial features.
4. The method of claim 1, wherein the performing the method further comprises:
deleting the digital image of the facial area of the user and the stored selection of the cosmetic product from a local storage of the cosmetic evaluation computing device when the cosmetic evaluation procedure is terminated.
5. The method of claim 4, wherein the performing the method further comprises:
identifying a group of currently online makeup consultants;
generating a subset of a makeup advisor from the cohort based on the makeup products in the selection;
displaying the subset of the makeup advisors in the user interface;
obtaining a selection of the makeup advisor from the user; and
a makeup advisory program is established between the customer's equipment and a selected one of the makeup consultants.
6. The method of claim 5, wherein the step of generating a subset of color cosmetic advisors from the cohort based on the cosmetic products in the selection comprises:
obtaining data information of each makeup consultant in the group; and
identifying, among the group of makeup consultants, a makeup consultant who has experienced in the past in relation to using the cosmetic product in the selection result, based on the data information.
7. The method of claim 5, wherein the step of establishing a makeup advisory program between the guest device and a selected one of the makeup advisors comprises:
obtaining a login credential from the user; and
and establishing the color makeup consultation program between the client-side equipment and the selected color makeup consultant equipment based on the login voucher.
8. The method of claim 1, wherein the cosmetic products in the selection result are sequentially displayed according to the evaluation of the cosmetic products previously made by the user in a cosmetic assessment computing device installed in a retail store.
9. The method of claim 1, wherein the performing the method further comprises:
displaying, in the user interface, an ordered list of the cosmetic products selected by the user of the customer-side device.
10. A makeup evaluation system executed on a computing device, comprising:
at least one memory storing a plurality of instructions; and
at least one processor coupled to the at least one memory and configured with a plurality of the instructions, the plurality of the instructions comprising:
obtaining a request from a user to start a makeup evaluation program;
starting the makeup evaluation program under the condition that a login certificate of the user is not required to be obtained;
obtaining a digital image, the digital image including the facial region of the user, and storing the digital image in a database of a makeup evaluation computing device;
generating a user interface to display at least one cosmetic product;
obtaining a selection of the cosmetic product from the user, the selection including one or more of the displayed cosmetic products;
virtually applying the selected cosmetic product to the user's facial area in the digital image;
storing the selection of the cosmetic product in the database of the makeup evaluation computing device;
generating a makeup program package, wherein the makeup program package is provided with the digital image containing the face area of the user, and the makeup product in the selection result is carried in the makeup program package;
transmitting the makeup program package to a cloud server;
terminating the makeup evaluation program;
obtaining a request from a user to obtain makeup information from a cloud server;
obtaining a digital image, wherein the digital image comprises a face area of the user;
transmitting the digital image to the cloud server to start a communication program under the condition that a login certificate of the user is not required to be obtained; under the condition that a login certificate is not needed, by comparing digital images which are consistent with the transmitted digital images in the plurality of digital images of the cloud server and carrying out face identification, the cloud server retrieves a color cosmetic program package and transmits the color cosmetic program package, wherein the color cosmetic program package has a selection result of a corresponding cosmetic product;
receiving the makeup program package and extracting the selection result of the makeup product;
generating a user interface to display the cosmetic products in the selection result; and
virtually applying the cosmetic product in the selection result to the face area of the user in the digital image.
11. The system of claim 10, wherein the system is installed in a retail store.
12. The system of claim 10, wherein the processor generates the user interface to display at least one cosmetic product, further comprising:
recognizing facial features depicted in the facial region; and
and capturing at least one cosmetic product according to the facial features.
13. The system according to claim 10, wherein the processor is configured to delete the digital image containing the facial region of the user and the cosmetic product in the stored selection from a local storage after terminating the cosmetic evaluation procedure.
14. The system of claim 10, wherein the processor is further configured to:
identifying a group of currently online makeup consultants;
generating a subset of a makeup advisor from the cohort based on the makeup products in the selection;
displaying the subset of color cosmetic consultants in the user interface;
obtaining a selection result of the makeup counselor from the user; and
a makeup advisory program is established between the customer's equipment and a selected one of the makeup consultants.
15. The system of claim 14, wherein the instructions for the processor to generate a subset of color cosmetic consultants from the group based on the cosmetic products in the selection result further comprise:
acquiring data information of each makeup consultant in the group; and
identifying, among the group of makeup consultants, a makeup consultant who has experienced in the past in relation to using the cosmetic product in the selection result, based on the data information.
16. The system of claim 15, wherein the processor sets up a makeup advisory program between the client device and a selected makeup advisor, further comprising:
obtaining a login credential from the user; and
and establishing a color makeup consultation program between the client-side equipment and the selected color makeup consultant on the basis of the login voucher.
17. The system of claim 10, wherein the cosmetic products in the selection result are sequentially displayed according to the user's previous evaluation of the cosmetic products in a cosmetic assessment computing device installed in a retail store.
18. The system of claim 10, wherein the processor is further configured to:
displaying, in the user interface, an ordered list of the cosmetic products selected by the user of the customer-side device.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201862733118P | 2018-09-19 | 2018-09-19 | |
| US62/733,118 | 2018-09-19 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110930173A CN110930173A (en) | 2020-03-27 |
| CN110930173B true CN110930173B (en) | 2022-11-25 |
Family
ID=69855692
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910464460.2A Active CN110930173B (en) | 2018-09-19 | 2019-05-30 | System and method for execution on computing device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110930173B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9674485B1 (en) * | 2015-12-23 | 2017-06-06 | Optim Corporation | System and method for image processing |
| CN108154121A (en) * | 2017-12-25 | 2018-06-12 | 深圳市美丽控电子商务有限公司 | Cosmetic auxiliary method, smart mirror and storage medium based on smart mirror |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9760935B2 (en) * | 2014-05-20 | 2017-09-12 | Modiface Inc. | Method, system and computer program product for generating recommendations for products and treatments |
| US10324739B2 (en) * | 2016-03-03 | 2019-06-18 | Perfect Corp. | Systems and methods for simulated application of cosmetic effects |
| US11120495B2 (en) * | 2016-09-15 | 2021-09-14 | GlamST LLC | Generating virtual makeup products |
-
2019
- 2019-05-30 CN CN201910464460.2A patent/CN110930173B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9674485B1 (en) * | 2015-12-23 | 2017-06-06 | Optim Corporation | System and method for image processing |
| CN108154121A (en) * | 2017-12-25 | 2018-06-12 | 深圳市美丽控电子商务有限公司 | Cosmetic auxiliary method, smart mirror and storage medium based on smart mirror |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110930173A (en) | 2020-03-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11682067B2 (en) | Systems and methods for virtual application of cosmetic products based on facial identification and corresponding makeup information | |
| EP3491963A1 (en) | Systems and methods for identification and virtual application of cosmetic products | |
| EP3522117B1 (en) | Systems and methods for virtual application of cosmetic effects to photo albums and product promotion | |
| CN110930186B (en) | System, method, device, equipment and storage medium for task display | |
| US20140032331A1 (en) | Method for interacting with customers at a point of sale for goods or services | |
| US11861672B2 (en) | Method, system, and non-transitory computer-readable medium for a digital personal care platform | |
| CN110110592A (en) | Method for processing business, model training method, equipment and storage medium | |
| US20190362521A1 (en) | Systems and methods for performing virtual application of makeup effects based on a source image | |
| EP3767575A1 (en) | Systems and methods for recommendation of makeup effects based on makeup trends and facial analysis | |
| EP3531361A1 (en) | Systems and methods for makeup consultation utilizing makeup snapshots | |
| CN114417146A (en) | Data processing method and device, electronic equipment and storage medium | |
| CN110930173B (en) | System and method for execution on computing device | |
| WO2022002964A1 (en) | High-resolution controllable face aging with spatially-aware conditional gans | |
| CN110135930B (en) | Method, system and storage medium for virtually applying makeup effect and promoting product | |
| EP3522094A1 (en) | Systems and methods for generating a digital signature for virtual application of cosmetic products | |
| CN111967924A (en) | Commodity recommendation method, commodity recommendation device, computer device, and medium | |
| TWM573465U (en) | Metadata generation system | |
| CN110135931A (en) | The method and system of color make-up consulting are provided using equipment is calculated | |
| KR20220050639A (en) | Method for providing nail art service and System for providing nail art service | |
| CN110149301A (en) | System and method for the color make-up advisory meeting based on event | |
| US20190251494A1 (en) | Systems and methods for event-based makeup consultation sessions | |
| CN112287744A (en) | Method and system for implementing makeup effect suggestion and storage medium | |
| CN111105283B (en) | Data processing method, apparatus and machine readable medium | |
| CN110570224A (en) | System, method and storage medium for execution on computing device | |
| JP2024043194A (en) | Information processing device, information processing method, and information processing program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |