WO2017118250A1 - Procédé, appareil, et dispositif terminal d'embellissement du visage - Google Patents

Procédé, appareil, et dispositif terminal d'embellissement du visage Download PDF

Info

Publication number
WO2017118250A1
WO2017118250A1 PCT/CN2016/108268 CN2016108268W WO2017118250A1 WO 2017118250 A1 WO2017118250 A1 WO 2017118250A1 CN 2016108268 W CN2016108268 W CN 2016108268W WO 2017118250 A1 WO2017118250 A1 WO 2017118250A1
Authority
WO
WIPO (PCT)
Prior art keywords
feature value
beauty
face
facial feature
terminal device
Prior art date
Application number
PCT/CN2016/108268
Other languages
English (en)
Chinese (zh)
Inventor
李明栋
琚凯
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2017118250A1 publication Critical patent/WO2017118250A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/77—Retouching; Inpainting; Scratch removal
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/169—Holistic features and representations, i.e. based on the facial image taken as a whole
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Definitions

  • Embodiments of the present invention relate to the field of image processing and communication technologies, and in particular, to a beauty processing method, apparatus, and terminal device.
  • the smart terminal needs to save the face feature value in advance, and preset the face processing parameter corresponding to the face feature value; specifically, when performing the beauty photo, firstly, Obtaining a face feature value of each face in the current shooting interface, and then matching the currently obtained face feature value with a preset face feature value. If a face can match the preset face feature value, It is considered that the face has been recognized. At this time, the corresponding face of the matched face feature value in the shooting interface can be processed by the smart terminal, and the beauty process is specifically processed according to the preset color preset in the smart terminal.
  • the beauty treatment parameters include, for example, skin tone adjustment, microdermabrasion, large eyes, and face-lifting.
  • the basis for judging which face in the photographing interface to perform the beauty treatment is whether the corresponding facial feature value is stored in the smart terminal, and since the storage space of the smart terminal is limited, usually only A fixed number of face feature values are stored, so it is difficult to satisfy a large number of faces for cosmetic processing at the same time, for example, there are usually dozens or even hundreds of people in a group photo.
  • the beauty photographing method in the related art due to the limitation of the storage space in the smart terminal performing the photographing, it is difficult to simultaneously satisfy the demand for the beauty processing of a large number of human faces, thereby resulting in the beauty of the smart terminal.
  • the problem of poor color processing performance due to the limitation of the storage space in the smart terminal performing the photographing, it is difficult to simultaneously satisfy the demand for the beauty processing of a large number of human faces, thereby resulting in the beauty of the smart terminal.
  • the problem of poor color processing performance due to the limitation of the storage space in the smart terminal performing the photographing, it is difficult to simultaneously satisfy the demand for the beauty processing of a large number of human faces, thereby resulting in the beauty of the smart terminal.
  • the problem of poor color processing performance due to the limitation of the storage space in the smart terminal performing the photographing, it is difficult to simultaneously satisfy the demand for the beauty processing of a large number of human faces, thereby resulting in the beauty of the smart terminal.
  • the problem of poor color processing performance due to the limitation of the storage space in
  • an embodiment of the present invention provides a beauty processing method, apparatus, and terminal device to solve the beauty photographing method in the related art. It satisfies the demand for beauty treatment of a large number of faces, which leads to a problem of poor cosmetic processing performance of the smart terminal.
  • an embodiment of the present invention provides a beauty treatment method, including:
  • the first facial feature value acquired by the terminal device is used to search for a matching second facial feature value and a beauty parameter in the network server, including:
  • the matching result includes the second facial feature value and the facial parameter, and the face corresponding to the second facial feature value is the first facial feature Some or all faces corresponding to the value.
  • the first facial feature value obtained by the terminal device before the searching for the matching second facial feature value and the beauty parameter in the network server, the first facial feature value obtained by the terminal device further includes:
  • the face feature value and the face parameter in the terminal device are stored or deleted.
  • the first facial feature value acquired by the terminal device is in a network Before finding matching second face feature values and beauty parameters in the server, it also includes:
  • the method further includes:
  • the operation instruction is used to instruct the network server to perform a face feature value and a beauty parameter in the stored face feature value library. Make one or more of the add, read, update, and delete operations.
  • an embodiment of the present invention provides a beauty treatment method, including:
  • the network server searches for the matched second facial feature value and the beauty parameter by using the first facial feature value of the terminal device;
  • the second facial feature value and the facial parameter are used to indicate the terminal device Performing a facial treatment on the part or all of the faces corresponding to the first facial feature value according to the second facial feature value according to the beauty parameter, and performing the facial treatment on the face as the second The face corresponding to the face feature value.
  • the network server is configured by using a terminal
  • the first face feature value of the device is searched for the matching second face feature value and the beauty parameter, including:
  • the network server matches the first facial feature value by using the stored facial feature value library, and the matched result includes the second facial feature value and the facial parameter, the second person
  • the face corresponding to the face feature value is part or all of the face corresponding to the first face feature value.
  • the method before the network server searches for the matched second facial feature value and the beauty parameter by using the first facial feature value of the terminal device, the method further includes:
  • the network server receives a facial feature value and a beauty parameter sent by the terminal device.
  • the method further includes:
  • the network server adds, reads, updates, and deletes one of a face feature value and a beauty parameter in the face feature value database in the network server according to the operation instruction, and
  • the terminal device returns an operation result.
  • the method further includes:
  • the face feature value stored in the terminal device matches the face feature value corresponding to the face to be subjected to the beauty process.
  • an embodiment of the present invention provides a beauty treatment device, including:
  • a search module configured to search for a matching second facial feature value and a beauty parameter in the network server by using the first facial feature value obtained by the terminal device;
  • a beauty module configured to find a second face feature value according to the search module
  • a part or all of the faces corresponding to one face feature value are subjected to a beauty treatment according to the beauty parameter, and the face subjected to the beauty treatment is a face corresponding to the second face feature value.
  • the searching module includes: a sending unit, configured to send the first facial feature value to the network server, where the first facial feature value is used Instructing the network server to match the first facial feature value by using the stored facial feature value library;
  • a receiving unit configured to receive a matching result sent by the network server, where the matching result includes the second facial feature value and the facial parameter, and the face corresponding to the second facial feature value is the Part or all of the face corresponding to the first face feature value.
  • the beauty processing device further includes: a sending module, configured to: in the searching module, find a match in the network server by using the first facial feature value Transmitting the facial feature value and the beauty parameter in the terminal device to the network server before the second facial feature value and the beauty parameter;
  • the processing module is configured to store or delete the facial feature value and the beauty parameter in the terminal device.
  • the searching module is further configured to pass the first person
  • the face feature value is used to find a matching second face feature value and a beauty parameter in the terminal device by using the first face feature value before searching for the matched second face feature value and the beauty parameter in the network server.
  • the searching module is configured to search for the matching second facial feature value and the beauty parameter in the network server by using the first facial feature value, that is, when the searching module is not in the terminal device When the second facial feature value matching the first facial feature value is found, the second facial feature value and the beauty parameter matching the first facial feature value are searched in the web server.
  • the sending module is further configured to send an operation instruction to the network server by using an operation performed by the user on the terminal device, where the operation instruction is used to indicate the
  • the web server performs one or more of adding, reading, updating, and deleting the face feature value and the beauty parameter in the stored face feature value library.
  • an embodiment of the present invention provides a beauty treatment device, including:
  • a searching module configured to search for a matching second facial feature value and a beauty parameter by using a first facial feature value of the terminal device
  • a sending module configured to send the second face feature value and the beauty parameter found by the searching module to the terminal device, where the second face feature value and the beauty parameter are used to indicate
  • the terminal device performs a beauty treatment on the part or all the faces corresponding to the first facial feature value according to the second facial feature value according to the beauty parameter, and the face processed by the beauty treatment is a The face corresponding to the second face feature value is described.
  • the searching module includes: a receiving unit, configured to receive the first facial feature value sent by the terminal device;
  • a matching unit configured to match, by using the stored face feature value library, the first face feature value received by the receiving unit, the matched result includes the second face feature value and the beauty parameter,
  • the face corresponding to the second facial feature value is a part or all of the face corresponding to the first facial feature value.
  • the beauty processing device further includes: a receiving module, configured to search for a matching second human face by using the first facial feature value of the terminal device in the searching module Before the feature value and the beauty parameter, the face feature value and the beauty parameter sent by the terminal device are received.
  • the receiving module is further configured to receive the sending by the terminal device Operation instruction
  • the beauty processing device further includes: a processing module configured to receive according to the receiving module And an operation instruction for one or more of adding, reading, updating and deleting the face feature value and the beauty parameter in the face feature value database in the network server;
  • the sending module is further configured to return an operation result to the terminal device.
  • the sending module is further configured to send the network to the terminal device a face feature value and a beauty parameter stored in the server, wherein the face feature value and the beauty parameter are used to indicate that the terminal device uses the face feature value stored in the terminal device before performing the beauty process
  • the face feature values corresponding to the faces to be subjected to the beauty treatment are matched.
  • an embodiment of the present invention provides a terminal device, including: a camera, a display, and a processor, wherein the processor is provided with the beauty processing device according to any one of the above third aspects;
  • the camera is configured to take a picture or a camera, and convert a face in the captured image into a face feature value
  • the display is configured to display a real-time captured image during photographing or photographing, and display the photographing result after the photographing or photographing is completed.
  • a computer storage medium is further provided, and the computer storage medium may store an execution instruction for executing the beauty processing method in the above embodiment.
  • the beauty processing method, device and terminal device provided by the embodiment of the present invention find the matching second facial feature value and the beauty parameter in the network server by using the first facial feature value acquired by the terminal device, and according to the found
  • the face of the two faces is subjected to the beauty treatment according to the beauty parameters of the face or the face corresponding to the first face feature value, and the face processed by the face is the face corresponding to the second face feature value, and the present invention passes
  • the face feature value and the beauty parameter stored on the network server side implement the beauty treatment method for the first face feature value acquired by the terminal device, and solve the beauty photographing mode in the related art, which is stored in the smart terminal performing the photographing.
  • Space limitation It is difficult to meet the demand for beauty treatment of a large number of faces at the same time, resulting in poor cosmetic processing performance of the smart terminal.
  • FIG. 1 is a flowchart of a beauty processing method according to an embodiment of the present invention
  • FIG. 2 is a flowchart of another beauty processing method according to an embodiment of the present invention.
  • FIG. 3 is a flowchart of still another beauty processing method according to an embodiment of the present invention.
  • FIG. 5 is a flowchart of still another beauty processing method according to an embodiment of the present invention.
  • FIG. 6 is a flowchart of signaling interaction of a beauty processing method according to an embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram of a beauty treatment device according to an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of another beauty treatment device according to an embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of still another beauty treatment device according to an embodiment of the present invention.
  • FIG. 10 is a schematic structural diagram of still another beauty treatment device according to an embodiment of the present invention.
  • the terminal device in the following embodiments is a smart terminal having a camera, such as a smart phone, a tablet computer, or a personal digital assistant (PDA).
  • the terminal device in the embodiments of the present invention usually has a terminal device. You can display a screen that captures images in real time or displays them.
  • the following specific embodiments of the present invention may be combined with each other, and the same or similar concepts or processes may not be described in some embodiments.
  • FIG. 1 is a flowchart of a beauty processing method according to an embodiment of the present invention.
  • the method may be performed by a beauty treatment device, which is combined by hardware and software.
  • the device can be integrated in the processor of the terminal device for use by the processor.
  • the method provided in this embodiment may include:
  • the object of the beauty treatment is usually a human face in the captured image.
  • the face in the current captured image can be used as the first facial feature value, similar to the related technology, and the basis of the beauty treatment.
  • the same is the stored face feature value library and the beauty parameter.
  • the face feature value library is the basis for determining whether to perform the face treatment on the face corresponding to the first face feature value, and the beauty parameter is performing the beauty.
  • the basis for processing is not obtained from the local machine, but are stored on a specific network, such as a Baiyun cloud disk, or an Apple mobile phone.
  • the terminal device that performs the beauty processing needs to register the user on the network server, for example, register "Meause User 1" on the network server, and store the "Made in the Beauty User 1"
  • the face feature value library and the beauty parameter so that the terminal device does not need to store a large number of face feature values, and the storage capacity of the network server is generally large, and more face feature values can be stored. Therefore, when the terminal device takes a photo, the second face feature value and the beauty parameter matching the first face feature value can be searched for by the registered user in the web server, so that the face feature value in the web server is obtained.
  • Library and beauty parameters are used as the basis for beauty treatment.
  • the network server generally stores the face feature value database and the beauty parameter in advance, that is, the S110 may include: S100, and send the face feature value and the beauty parameter in the terminal device to the network server; S101, Store or delete face feature values and beauty parameters in the terminal device.
  • the user who needs to set the facial feature value may be photographed by using the common photographing function of the terminal device, or the facial feature value of the specific user may be obtained from the photo of the terminal device, and may be first in the terminal device. Setting the beauty parameter; then, the terminal device sends its own data and parameters related to the beauty photo to the corresponding registered user on the network server, so that the facial feature value and the beauty parameter of the terminal device are synchronized to the network.
  • the face feature value and the beauty parameter in the terminal device can be selectively stored or deleted.
  • the expression of the face feature value in this embodiment may be a face photo taken by the terminal, or the terminal may process the feature parameters extracted from the face photo, such as a piece of text, a two-dimensional code, and the like.
  • the embodiment of the present invention does not limit the correspondence between the face feature value and the beauty parameter.
  • the face feature value and the face parameter may be, for example, a one-to-one correspondence, that is, different face effects for different faces.
  • Such a beauty mode is more targeted, and different beauty parameters can be set according to the characteristics of each person; for example, the face feature value and the beauty parameter can also be a many-to-one relationship, that is, the same beauty is set for multiple faces.
  • Yan parameters such a beauty way is relatively simple, reducing the complexity of beauty treatment, easy to implement.
  • the face feature value library and the beauty parameter pre-stored in the network server of the embodiment may be preset by other means, for example, the user directly uploads to the registered user of the network server through the network.
  • part or all of the face corresponding to the first facial feature value is processed according to the beauty parameter, and the face processed by the facial treatment is corresponding to the second facial feature value. Face.
  • some or all of the faces corresponding to the first face feature value have been found through the face feature value library in the web server, for example, part of the face is found in the network server and the corresponding face feature value is found in the network server. , while other faces don’t find the corresponding face in the web server.
  • the eigenvalue that is, the face corresponding to the second facial feature value is a subset of the face corresponding to the first facial feature value, and may be identical.
  • the beauty processing only the face corresponding to the second face feature value that has been found is subjected to the beauty treatment, and the other faces do not need to perform the beauty treatment; for example, when a user is in the group of other people, the terminal The device stores its own facial feature value. Therefore, among the multiple faces of the photo, only the face of the user has a corresponding face value, that is, the object processed by the beauty is only the user.
  • the terminal device can only store a limited number of facial feature values, and it is difficult to perform cosmetic processing on a large number of faces at the same time; for example, an object that currently needs to be beautiful is not stored in the terminal device, and needs to be photographed or The photo obtains the face feature value, and the parameter can be processed before the beauty process is performed. If the next time the beauty object is changed, the above method needs to be repeated; for example, after the terminal device is replaced, the face feature value and the beauty parameter are required. You can take a photo of your face after resetting it on a new terminal device, which adds extra work.
  • the beauty processing method provided by the embodiment searches for the matching second facial feature value and the beauty parameter in the web server by using the first facial feature value acquired by the terminal device, and according to the found second facial feature value Part or all of the faces corresponding to the first face feature value are subjected to the beauty treatment according to the beauty parameter, and the face subjected to the beauty treatment is the face corresponding to the second face feature value, and the embodiment is stored in the network server.
  • the face feature value and the beauty parameter of the terminal implement the beauty treatment method for the first face feature value acquired by the terminal device, and solve the beauty photographing mode in the related art, due to the limitation of the storage space in the smart terminal performing the photographing, It is difficult to meet the demand for beauty treatment of a large number of faces at the same time, resulting in poor cosmetic processing performance of the smart terminal.
  • the network server usually has a large storage space, and can store a large number of facial feature values. Therefore, the beauty processing method provided in this embodiment can also avoid various problems caused by limited storage space of the terminal device, for example, , when the object of beauty treatment changes, the network If there is a matching face in the face feature value stored in the server, it does not need to be reset, and can be directly searched and used; for example, after the terminal device is replaced, the data stored in the network server is not affected, and Repeating the setting in the terminal device greatly reduces the workload of the beauty treatment and improves the practicality of the beauty photograph.
  • FIG. 2 is a flowchart of another beauty processing method according to an embodiment of the present invention.
  • the present invention provides a specific manner for searching for a face feature value and a beauty parameter from a network server.
  • the S110 may include: S111, sending the first face feature value to the network server.
  • the first facial feature value is used to indicate that the network server matches the first facial feature value by using the stored facial feature value database; S112, receiving a matching result sent by the network server, the matching result including the second human face
  • the feature value and the beauty parameter, the face corresponding to the second face feature value is part or all of the face corresponding to the first face feature value.
  • the terminal device can perform data interaction with the registered user on the network server, for example, “beauty user 1” described above, and the data related to the terminal device is stored in “beauty user 1”, that is,
  • the web server can provide the above-mentioned beauty service for a plurality of terminal devices, and distinguish different terminal devices by different registered users.
  • FIG. 3 is a flowchart of still another beauty processing method according to an embodiment of the present invention.
  • the foregoing embodiment has been described that after the data related to the beauty processing is synchronized to the network server by the terminal device, the data can be saved in the terminal device. Therefore, when the terminal device performs the beauty processing, the terminal device can also query the terminal device first.
  • the stored face feature value is shown in FIG. 3 on the basis of the embodiment shown in FIG. 1 .
  • the method further includes: S102, searching for matching in the terminal device by using the first face feature value.
  • the second face feature value and the beauty parameter; correspondingly, the S110 may be replaced by: when the second face feature value matching the first face feature value is not found in the terminal device, searching and searching in the network server The second face feature value and the beauty parameter matched by one face feature value.
  • the beauty processing method provided in this embodiment considers that the face feature value of the certain data can be stored in the terminal device, and the corresponding face feature value is found from the local machine and the network server is reduced.
  • the steps of interaction are more time-sensitive. You can search for it locally. If it is not found in the machine, you can further search it in the network server.
  • the method provided in this embodiment further includes: S130, sending an operation instruction to the network server by using an operation performed by the user on the terminal device, the operation instruction And one or more of the operations of instructing the network server to add, read, update, and delete the facial feature values and the beauty parameters in the stored facial feature value library.
  • the execution order of the S130 is not limited.
  • the change of the facial feature value and the beauty parameter in the network server may be performed before or after the photographing, and may be performed by the user at any time.
  • S130 is executed after S120 as an example; in addition, the change of data in the network server can be performed not only by the terminal device but also by the user directly to the registered user of the network server through the network.
  • FIG. 4 is a flowchart of still another beauty processing method according to an embodiment of the present invention.
  • the method may be performed by a beauty treatment device, which is combined by hardware and software.
  • the device can be set in a network server.
  • the method provided in this embodiment may include:
  • the network server searches for the matched second facial feature value and the beauty parameter by using the first facial feature value of the terminal device.
  • the object of the beauty treatment is also a human face in the captured image.
  • the face in the current captured image may be used as the first facial feature value, and different from the related art, the implementation of the present invention
  • the face feature value library and the beauty parameter are not obtained from the local machine, but are stored in a specific network, such as a Baiyun cloud disk, or an Apple cloud (iCloud) of the Apple mobile phone, in a specific implementation.
  • the user who has the terminal device registration in the network server for example, the "Meause User 1" is registered on the network server, and the "Face User 1" stores the face feature value library and the beauty parameter, so that the terminal device does not need Store a large number of face feature values, and Moreover, the storage capacity of the network server is generally large, and more face feature values can be stored. Therefore, for a terminal device that needs to take a beautiful photo, the web server can provide a related server for performing beauty processing, that is, the web server searches for a second facial feature matching the first facial feature value under the registered user of the terminal device.
  • Value and beauty parameters in this embodiment, the face feature value library and the beauty parameter in the web server are specifically used as the basis for the beauty treatment.
  • the network server generally stores the face feature value library and the beauty parameter in advance, that is, the S210 may include: S200, the network server receives the face feature value and the beauty parameter sent by the terminal device.
  • the user who needs to set the facial feature value may be photographed by using the common photographing function of the terminal device, or the facial feature value of the specific user may be obtained from the photo of the terminal device, and may be first in the terminal device. Setting the beauty parameter; then, the terminal device sends its own data and parameters related to the beauty photo to the corresponding registered user on the network server, so that the facial feature value and the beauty parameter of the terminal device are synchronized to the network.
  • the server the server.
  • the terminal device in this embodiment may selectively store or delete the face feature value and the beauty parameter in the terminal device.
  • the expression of the face feature value in this embodiment may be a face photo taken by the terminal, or the terminal may process the feature parameters extracted from the face photo, such as a piece of text, a two-dimensional code, and the like.
  • the correspondence between the facial feature value and the facial parameter is not limited, and the facial feature value and the facial parameter may be, for example, a one-to-one correspondence, and the facial feature value and the facial parameter may be, for example, more The relationship to one.
  • the face feature value library and the beauty parameter pre-stored in the network server of the embodiment may be preset by other means, for example, the user directly uploads to the registered user of the network server through the network.
  • the network server sends the found second facial feature value and the facial parameter to the terminal device, where the second facial feature value and the facial parameter are used to instruct the terminal device to perform the first facial feature according to the second facial feature value.
  • the first and second faces have been searched through the face feature value database in the web server.
  • Some or all of the faces corresponding to the face feature values for example, some faces find the corresponding face feature values in the web server, and other faces do not find the corresponding face feature values in the web server, that is, It is said that the face corresponding to the second face feature value is a subset of the face corresponding to the first face feature value, and may be identical.
  • the beauty treatment only the face corresponding to the second face feature value that has been found is subjected to the beauty treatment, and the other faces do not need to perform the beauty treatment.
  • the network server searches for the matched second facial feature value and the beauty parameter by using the first facial feature value of the terminal device, and firstly searches for the second facial feature value according to the found second facial feature value.
  • Some or all of the faces corresponding to the face feature values are processed according to the beauty parameters, and the face processed by the face is the face corresponding to the second face feature value.
  • the face stored on the network server is used.
  • the feature value and the beauty parameter realize the beauty treatment method of the first face feature value acquired by the terminal device, and solve the beauty photographing mode in the related art. Due to the limitation of the storage space in the smart terminal performing the photographing, it is difficult to simultaneously It satisfies the demand for beauty treatment of a large number of faces, which leads to a problem of poor cosmetic processing performance of the smart terminal.
  • the network server usually has a large storage space, and can store a large number of facial feature values. Therefore, the beauty processing method provided in this embodiment can also avoid various problems caused by limited storage space of the terminal device. It has been specifically described in the examples, so it will not be described here.
  • FIG. 5 is a flowchart of still another beauty processing method according to an embodiment of the present invention.
  • the present invention provides a specific manner for searching for a face feature value and a beauty parameter from a network server.
  • S210 may include: S211, and the network server receives the first face sent by the terminal device.
  • the face corresponding to the second facial feature value is part or all of the face corresponding to the first facial feature value.
  • the registered user on the network server can perform data interaction with the terminal device, for example, “beauty user 1” described above, and the data related to the terminal device is stored in “beauty user 1”, that is,
  • the web server can provide the above-mentioned beauty service for a plurality of terminal devices, and distinguish different terminal devices by different registered users.
  • the data in the registered user of the network server is changeable at any time, that is, the method provided in this embodiment further includes: S230, the network server receives an operation instruction sent by the terminal device; and S240, the network server processes the network server according to the operation instruction.
  • the face feature value and the face parameter in the face feature value library are one or more of adding, reading, updating, and deleting operations, and returning the operation result to the terminal device.
  • the execution order of the S230-S240 is not limited, and the change of the facial feature value and the beauty parameter in the network server may be performed before or after the photographing, and may be performed by the user at any time.
  • the embodiment is shown as an example after S230 to S240 are executed after S220; in addition, the change of data in the network server can be performed not only by the terminal device but also by the user directly to the registered user of the network server through the network. in.
  • the network server in this embodiment can serve a plurality of terminal devices, that is, after the terminal device is replaced, the network server can also provide the server.
  • the method provided in this embodiment further includes: the network server to the terminal The device sends a facial feature value and a beauty parameter stored in the network server, where the facial feature value and the beauty parameter are used to indicate the facial feature value and the to-be-executed beauty stored in the terminal device before the terminal device performs the beauty processing.
  • the face feature values corresponding to the processed face are matched.
  • FIG. 6 is a flowchart of signaling interaction of a beauty processing method according to an embodiment of the present invention.
  • the embodiment shown in Figure 6 includes:
  • the terminal device sends the acquired first facial feature value to the network server, where the terminal device may be sent to a specific registered user on the network server.
  • the network server performs the stored face feature value database and the first face feature value. match.
  • the network server sends a matching result to the terminal device, where the matching result includes a second facial feature value and a beauty parameter, and the face corresponding to the second facial feature value is a part or all faces corresponding to the first facial feature value.
  • the method provided in this embodiment needs to perform a registration process before the terminal device performs the beauty processing through the data in the network server.
  • the method includes:
  • the terminal device sends a registration request to the network server.
  • the network server returns registration information to the terminal device, where the registration information includes information such as a registered account and a password.
  • the facial feature value and the beauty parameter in the terminal device can be synchronized to the network server, that is, before S310, the method further includes:
  • S303 Synchronize the beauty data, specifically, the terminal device sends the facial feature value and the beauty parameter to the network server.
  • the method provided in this embodiment includes: S304, the terminal device stores or deletes its own facial feature value and the beauty parameter.
  • the data in the network server can be changed by the terminal device interacting with the network server.
  • the method provided in this embodiment further includes: S314, sending an operation instruction to the network server by using an operation performed by the user on the terminal device.
  • the network server performs one or more of adding, reading, updating, and deleting operations on the face feature value and the beauty parameter in the stored face feature value library according to the operation instruction.
  • the network server returns an operation result to the terminal device.
  • the manner in which the network server presets data and the manner in which the data in the network server is changed may also be uploaded by the user directly to the registered user of the network server through the network.
  • the method provided in this embodiment further includes: S317, the network server sends the facial feature value and the beauty parameter stored in the network server to the terminal device.
  • the terminal device returns an acknowledgement message to the network server. For example, after the user replaces the terminal device, it is not necessary to reset the data content related to the beauty function, and the network content can be acquired by means of network synchronization.
  • S314 to S316 and S317 to S318 are independent execution steps, and the execution sequences of S314 to S316 and S317 to S318 and S310 to S313 are not limited; and S314 to S316 can be executed after the terminal device registers the user. S317 to S318 are usually performed after the terminal device registers the user, and the web server has the data related to the beauty.
  • FIG. 7 is a schematic structural diagram of a beauty treatment device according to an embodiment of the present invention.
  • the beauty treatment device provided in this embodiment is suitable for performing facial treatment on a face in a captured image of a terminal device
  • the beauty treatment device is implemented by a combination of hardware and software, and the device can be integrated in the terminal device.
  • the processor for the processor to call.
  • the beauty treatment device of this embodiment specifically includes: a search module 11 and a beauty module 12 .
  • the searching module 11 is configured to search for a matching second facial feature value and a beauty parameter in the network server by using the first facial feature value acquired by the terminal device.
  • the object of the beauty treatment is also a human face in the captured image.
  • the face in the current captured image can be used as the first facial feature value, which is different from the related art in various embodiments of the present invention.
  • the comparison between the face feature value library and the beauty parameter is not obtained from the local machine, but stored on a specific network side, and can also be a Baidu cloud disk, or an Apple cloud (iCloud) of an Apple mobile phone, for example,
  • the cosmetically processed terminal device needs to register the user on the web server, for example, also "beauty user 1". Therefore, when the terminal device takes a photo, the corresponding facial feature value and the beauty parameter can be searched for by the registered user in the web server, so that the facial feature value and the beauty parameter in the web server are used as the basis for the beauty treatment. .
  • the correspondence between the facial feature value and the facial parameter is not limited, and the facial feature value and the facial parameter may be, for example, a one-to-one correspondence, the facial feature value and the beauty.
  • the color parameter can also be, for example, a many-to-one relationship.
  • the beauty module 12 is configured to perform facial treatment on the part or all of the faces corresponding to the first facial feature value according to the second facial feature value found by the searching module 11 according to the beauty parameter, and perform the facial treatment on the face The face corresponding to the second face feature value.
  • some or all of the faces corresponding to the first face feature value have been found through the face feature value library in the web server, for example, part of the face is found in the network server and the corresponding face feature value is found in the network server.
  • the other face does not find the corresponding face feature value in the web server, that is, the face corresponding to the second face feature value is a subset of the face corresponding to the first face feature value, Can be identical. That is, when performing the beauty treatment, only part of the face corresponding to the found second face feature value is subjected to the beauty treatment, and other faces do not need to perform the beauty treatment.
  • the facial server feature value and the beauty parameter are generally pre-stored in the network server, that is, the beauty processing device provided in this embodiment may further include: a sending module 13 configured to pass the first person in the searching module 11
  • the face feature value is sent to the network server by the face feature value and the beauty parameter in the terminal device before the matching second face feature value and the beauty parameter are searched in the network server; the processing module 14 is configured to store or delete the terminal device.
  • Face feature values and beauty parameters may be preset by other means, for example, the user directly uploads to the registered user of the network server through the network.
  • the beauty treatment device provided by the embodiment of the present invention is used to perform the beauty treatment method provided by the embodiment shown in FIG. 1 of the present invention, and has a corresponding function module, and the implementation principle and technical effect thereof are similar, and details are not described herein again.
  • FIG. 8 is a schematic structural diagram of another beauty treatment device according to an embodiment of the present invention.
  • the searching module 11 in this embodiment may include: a sending unit 15 configured to send the first facial feature value to the network server, the first facial feature The value is used to indicate that the network server matches the first facial feature value by using the stored facial feature value database; the receiving unit 16 is configured to receive the matching result sent by the network server,
  • the matching result includes a second facial feature value and a facial parameter, and the human face corresponding to the second facial feature value is a part or all of the human face corresponding to the first facial feature value.
  • the beauty processing device provided by the embodiment of the present invention is used to perform the beauty processing method provided by the embodiment shown in FIG. 2 of the present invention, and has a corresponding functional module, and the implementation principle and the technical effect thereof are similar, and details are not described herein again.
  • the foregoing embodiment has been described that after the data related to the beauty processing is synchronized to the network server by the terminal device, the data may be saved in the terminal device. Therefore, when the terminal device performs the beauty processing, the terminal device may also be used first.
  • the search module 11 in this embodiment is further configured to: before finding the matching second face feature value and the beauty parameter in the web server by using the first face feature value, Searching for the matched second facial feature value and the beauty parameter in the terminal device by using the first facial feature value; the searching module 11 is configured to search the network server for the matching second facial feature value by using the first facial feature value And the beauty parameter means that when the search module 11 does not find the second face feature value matching the first face feature value in the terminal device, searching for the first face feature value in the network server Two face eigenvalues and beauty parameters.
  • the data in the registered user of the network server can be changed at any time.
  • the manner of changing the data in the network server can be performed, for example, by the beauty processing device provided in this embodiment.
  • the sending module 13 is further configured to pass The operation performed by the user on the terminal device sends an operation instruction to the network server, where the operation instruction is used to instruct the network server to add, read, update, and update the facial feature value and the beauty parameter in the stored facial feature value database. Delete one or more of the actions.
  • the beauty processing device provided by the embodiment of the present invention is used to perform the beauty processing method provided by the embodiment shown in FIG. 3 of the present invention, and has a corresponding functional module, and the implementation principle and technical effect thereof are similar, and details are not described herein again.
  • the execution order of the data in the network server is not limited, and the face feature value and the beauty parameter in the network server may be changed before or after taking a photo. Therefore, the user performs the data at any time; in addition, the change of the data in the network server can be performed not only by the terminal device, but also by the user directly to the registered user of the network server through the network.
  • FIG. 9 is a schematic structural diagram of still another beauty treatment device according to an embodiment of the present invention.
  • the beauty treatment device provided in this embodiment is suitable for performing beauty treatment on a face in a captured image of a terminal device
  • the beauty treatment device is implemented by a combination of hardware and software, and the device can be set on a network server.
  • the beauty processing device of this embodiment specifically includes a lookup module 21 and a sending module 22.
  • the searching module 21 is configured to search for the matched second facial feature value and the beauty parameter by using the first facial feature value of the terminal device.
  • the object of the beauty treatment is also a human face in the captured image.
  • the face in the current captured image can be used as the first facial feature value, which is different from the related art in various embodiments of the present invention.
  • the matching face value library and beauty parameters are not obtained from the local machine, but stored on a specific network side, which can also be Baidu cloud disk, or Apple cloud (iCloud) of Apple mobile phone.
  • the network server the user who has the terminal device registration, for example, the “Meause User 1” is registered on the network server.
  • the web server can provide a related server for performing beauty processing, that is, the web server searches for a second facial feature matching the first facial feature value under the registered user of the terminal device.
  • Value and beauty parameters in this embodiment, the face feature value library and the beauty parameter in the web server are specifically used as the basis for the beauty treatment.
  • the correspondence between the facial feature value and the facial parameter is not limited, and the facial feature value and the facial parameter may be, for example, a one-to-one correspondence, and the facial feature value and the facial parameter may be, for example, more The relationship to one.
  • the sending module 22 is configured to send the second facial feature value and the beauty parameter found by the searching module 21 to the terminal device, where the second facial feature value and the beauty parameter are used to indicate that the terminal device is configured according to the second facial feature value Part or all of the faces corresponding to the first face feature value are in accordance with the beauty face
  • the face is subjected to the beauty treatment, and the face subjected to the beauty treatment is the face corresponding to the feature value of the second face.
  • some or all of the faces corresponding to the first face feature value have been found through the face feature value library in the web server, for example, part of the face is found in the network server and the corresponding face feature value is found in the network server.
  • the other face does not find the corresponding face feature value in the web server, that is, the face corresponding to the second face feature value is a subset of the face corresponding to the first face feature value, Can be identical. That is, when performing the beauty treatment, only part of the face corresponding to the found second face feature value is subjected to the beauty treatment, and other faces do not need to perform the beauty treatment.
  • the web server typically stores the facial feature value and the facial parameter in advance, that is, the facial processing device provided in this embodiment may further include: a receiving module 23 configured to pass through the terminal device in the searching module 21 Before the first facial feature value finds the matched second facial feature value and the beauty parameter, the facial feature value and the facial parameter transmitted by the terminal device are received.
  • the face feature value and the beauty parameter pre-stored in the network server of the embodiment may be preset by other means, for example, the user directly uploads to the registered user of the network server through the network.
  • the beauty processing device provided by the embodiment of the present invention is used to perform the beauty processing method provided by the embodiment shown in FIG. 4 of the present invention, and has a corresponding functional module, and the implementation principle and the technical effect thereof are similar, and details are not described herein again.
  • FIG. 10 is a schematic structural diagram of still another beauty treatment device according to an embodiment of the present invention.
  • the searching module 21 in this embodiment may include: a receiving unit 24 configured to receive a first facial feature value sent by the terminal device; and a matching unit 25 configured to Matching the stored first face feature value library with the first face feature value received by the receiving unit 24, the matched result includes a second face feature value and a beauty parameter, and the face corresponding to the second face feature value It is part or all of the face corresponding to the first face feature value.
  • the data in the registered user of the network server can be changed at any time.
  • the manner of changing the data in the network server can be performed, for example, by the beauty processing device provided in this embodiment.
  • the receiving module 23 is further configured to receive An operation instruction sent by the terminal device;
  • the beauty processing device of this embodiment further includes: a processing module 26 configured to add, read, and read facial feature values and beauty parameters in the face feature value database in the network server according to the operation instruction received by the receiving module 23 One or more of the update and delete operations; the sending module 22 is further configured to return an operation result to the terminal device.
  • the network server in this embodiment can serve a plurality of terminal devices, that is, after the terminal device is replaced, the network server can also provide the server.
  • the sending module 22 is further configured. And sending the facial feature value and the beauty parameter stored in the network server to the terminal device, where the facial feature value and the beauty parameter are used to indicate that the terminal device stores the facial feature value and the waiting value in the terminal device before performing the beauty processing. Match the facial feature values corresponding to the face processed by the beauty treatment.
  • the beauty treatment device provided by the embodiment of the present invention is used to perform the beauty treatment method provided by the embodiment shown in FIG. 5 of the present invention, and has a corresponding function module, and the implementation principle and technical effect thereof are similar, and details are not described herein again.
  • the execution order of the data in the network server is not limited, and the change of the face feature value and the beauty parameter in the network server may be performed before or after the photographing, and may be performed by the user at any time;
  • the change of data in the network server can be performed not only by the terminal device, but also by the user directly to the registered user of the network server through the network.
  • the embodiment of the present invention further provides a terminal device, including: a camera, a display, and a processor, wherein the processor is provided with a beauty processing device in any of the embodiments shown in FIG. 7 and FIG. 8;
  • the camera is set to take a picture or a camera, and converts the face in the captured image into a face feature value;
  • the display is set to display a real-time captured image during photographing or photographing, and displays the shooting result after the photographing or photographing is completed.
  • the terminal device in this embodiment may be a smart phone, and the beauty photo can be taken after installing the beauty app, and the tablet computer and the micro single camera can also have the function of beauty photographing.
  • the terminal device provided in this embodiment is used to perform any of the embodiments shown in FIG. 1 to FIG. 6 of the present invention.
  • the provided beauty treatment method has the corresponding physical device, and its implementation principle and technical effect are similar, and will not be described here.
  • Embodiments of the present invention also provide a storage medium.
  • the foregoing storage medium may be configured to store program code for performing the following steps:
  • part or all of the face corresponding to the first facial feature value is processed according to the beauty parameter, and the face processed by the facial treatment is corresponding to the second facial feature value. Face.
  • the foregoing storage medium may include, but not limited to, a USB flash drive, a Read-Only Memory (ROM), a Random Access Memory (RAM), a mobile hard disk, and a magnetic memory.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • a mobile hard disk e.g., a hard disk
  • magnetic memory e.g., a hard disk
  • the first facial feature value obtained by the terminal device is searched for the matching second facial feature value and the beauty parameter in the network server, and the first person is compared according to the found second facial feature value.
  • Some or all of the faces corresponding to the face feature values are processed according to the beauty parameters, and the face processed by the face is the face corresponding to the feature values of the second face.
  • the present invention stores the face feature values stored on the network server side.
  • the beauty parameter realizes the beauty treatment method of the first facial feature value acquired by the terminal device, and solves the beauty photographing mode in the related technology. Due to the limitation of the storage space in the smart terminal performing the photographing, it is difficult to simultaneously satisfy the a larger number of faces The need for cosmetic processing results in poor cosmetic processing performance of the smart terminal.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Processing Or Creating Images (AREA)

Abstract

L'invention concerne un procédé, un appareil, et un dispositif terminal d'embellissement du visage. Le procédé d'embellissement du visage consiste : à rechercher une deuxième valeur d'attribut de visage et un paramètre d'embellissement du visage appariés dans un serveur de réseau sur la base d'une première valeur d'attribut de visage obtenue par un dispositif terminal (S110) ; et à procéder à un embellissement de visage sur tout ou partie d'un visage correspondant à la première valeur d'attribut de visage sur la base de la deuxième valeur trouvée d'attribut de visage et en fonction du paramètre d'embellissement de visage, le visage subissant l'embellissement de visage étant un visage correspondant à la deuxième valeur d'attribut de visage (S120). L'invention résout un problème d'une technique de photographie d'embellissement de visage selon l'état de la technique dans laquelle un besoin de réalisation d'embellissement de visage sur un grand nombre de visages en même temps ne pouvait être satisfait en raison de l'espace d'enregistrement limité du terminal intelligent prenant la photographie, résultant en une mauvaise performance d'embellissement de visage du terminal intelligent.
PCT/CN2016/108268 2016-01-04 2016-12-01 Procédé, appareil, et dispositif terminal d'embellissement du visage WO2017118250A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610004706.4A CN106940880A (zh) 2016-01-04 2016-01-04 一种美颜处理方法、装置和终端设备
CN201610004706.4 2016-01-04

Publications (1)

Publication Number Publication Date
WO2017118250A1 true WO2017118250A1 (fr) 2017-07-13

Family

ID=59273217

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/108268 WO2017118250A1 (fr) 2016-01-04 2016-12-01 Procédé, appareil, et dispositif terminal d'embellissement du visage

Country Status (2)

Country Link
CN (1) CN106940880A (fr)
WO (1) WO2017118250A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109903249A (zh) * 2019-01-29 2019-06-18 贾广袖 基于面容识别的美颜处理方法、存储设备及移动终端

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109288233A (zh) * 2017-07-25 2019-02-01 丽宝大数据股份有限公司 可标示修容区域的身体信息分析装置
CN107437269B (zh) 2017-08-03 2021-10-08 北京小米移动软件有限公司 一种处理图片的方法及装置
CN107730442A (zh) * 2017-10-16 2018-02-23 郑州云海信息技术有限公司 一种人脸美颜方法及装置
CN107844764B (zh) * 2017-10-31 2020-05-12 Oppo广东移动通信有限公司 图像处理方法、装置、电子设备和计算机可读存储介质
CN108765273B (zh) * 2018-05-31 2021-03-09 Oppo广东移动通信有限公司 人脸拍照的虚拟整容方法和装置
CN111062260B (zh) * 2019-11-25 2024-03-05 杭州绿度信息技术有限公司 一种面部整容推荐方案自动生成方法
CN111402154A (zh) * 2020-03-10 2020-07-10 北京字节跳动网络技术有限公司 图像美颜方法、装置、电子设备及计算机可读存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010095120A1 (fr) * 2009-02-23 2010-08-26 L'oreal Procede de maquillage mettant en oeuvre une source de lumiere a matrice adressable
CN103413270A (zh) * 2013-08-15 2013-11-27 北京小米科技有限责任公司 一种图像的处理方法、装置和终端设备
CN103632165A (zh) * 2013-11-28 2014-03-12 小米科技有限责任公司 一种图像处理的方法、装置及终端设备
CN104346136A (zh) * 2013-07-24 2015-02-11 腾讯科技（深圳）有限公司 一种图片处理的方法及装置
CN104574299A (zh) * 2014-12-25 2015-04-29 小米科技有限责任公司 人脸图片处理方法及装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010095120A1 (fr) * 2009-02-23 2010-08-26 L'oreal Procede de maquillage mettant en oeuvre une source de lumiere a matrice adressable
CN104346136A (zh) * 2013-07-24 2015-02-11 腾讯科技（深圳）有限公司 一种图片处理的方法及装置
CN103413270A (zh) * 2013-08-15 2013-11-27 北京小米科技有限责任公司 一种图像的处理方法、装置和终端设备
CN103632165A (zh) * 2013-11-28 2014-03-12 小米科技有限责任公司 一种图像处理的方法、装置及终端设备
CN104574299A (zh) * 2014-12-25 2015-04-29 小米科技有限责任公司 人脸图片处理方法及装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109903249A (zh) * 2019-01-29 2019-06-18 贾广袖 基于面容识别的美颜处理方法、存储设备及移动终端

Also Published As

Publication number Publication date
CN106940880A (zh) 2017-07-11

Similar Documents

Publication Publication Date Title
WO2017118250A1 (fr) Procédé, appareil, et dispositif terminal d'embellissement du visage
JP6878700B2 (ja) クロスブロックチェーン認証方法、装置、および電子デバイス
EP3079082B1 (fr) Procédé et appareil d'affichage d'album
US10068130B2 (en) Methods and devices for querying and obtaining user identification
WO2021196401A1 (fr) Procédé et appareil de reconstruction d'image, dispositif électronique, et support de stockage
WO2019174595A1 (fr) Procédé et appareil de configuration de ressources, terminal et support d'informations
US10831823B2 (en) Photo distribution method and terminal
US10608988B2 (en) Method and apparatus for bluetooth-based identity recognition
WO2018000585A1 (fr) Procédé, appareil, terminal et serveur de recommandation de thème d'interface
US20190306163A1 (en) Method and device for information interaction and association between human biological feature data and account
WO2022198853A1 (fr) Procédé et appareil de planification de tâches, dispositif électronique, support de stockage et produit-programme
RU2644511C2 (ru) Способ и устройство для отображения интерфейса настройки маршрутизатора
KR101859433B1 (ko) 영상 모자이크 처리 방법 및 이를 위한 장치
JP2016531362A (ja) 肌色調整方法、肌色調整装置、プログラム及び記録媒体
US10135816B2 (en) Electronic device and method of transceiving data
CN105554064B (zh) 设置头像的方法及装置
KR20170033775A (ko) 통신장치, 통신장치의 제어방법 및 기억매체
CN110677682A (zh) 直播检测与数据处理方法、设备、系统及存储介质
US9706102B1 (en) Enhanced images associated with display devices
WO2017219497A1 (fr) Procédé et appareil de génération de messages
JP2017521803A (ja) イメージ共有方法、装置、プログラム及び記録媒体
WO2021190625A1 (fr) Procédé et dispositif de capture d'image
CN111338971B (zh) 应用测试方法、装置、电子设备及存储介质
JP2017511089A (ja) ネットワークにアクセスする方法、装置、プログラム及び記録媒体
KR20200052673A (ko) 무선 네트워크에서 근접한 장치들 간 통신 방법 및 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16883376

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16883376

Country of ref document: EP

Kind code of ref document: A1