WO2019036866A1 - Control method, control device, intelligent mirror and computer-readable storage medium - Google Patents

Control method, control device, intelligent mirror and computer-readable storage medium Download PDF

Info

Publication number
WO2019036866A1
WO2019036866A1 PCT/CN2017/098362 CN2017098362W WO2019036866A1 WO 2019036866 A1 WO2019036866 A1 WO 2019036866A1 CN 2017098362 W CN2017098362 W CN 2017098362W WO 2019036866 A1 WO2019036866 A1 WO 2019036866A1
Authority
WO
WIPO (PCT)
Prior art keywords
human body
body image
face
display screen
camera
Prior art date
Application number
PCT/CN2017/098362
Other languages
French (fr)
Chinese (zh)
Inventor
俞大海
鞠汶奇
李建平
周均扬
陈术义
刁梁
Original Assignee
美的集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 美的集团股份有限公司 filed Critical 美的集团股份有限公司
Priority to PCT/CN2017/098362 priority Critical patent/WO2019036866A1/en
Priority to CN201780001082.3A priority patent/CN107690675A/en
Publication of WO2019036866A1 publication Critical patent/WO2019036866A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/02Non-photorealistic rendering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/166Detection; Localisation; Normalisation using acquisition arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds

Definitions

  • the present invention relates to consumer electronics, and more particularly to a control method, control device, smart mirror, and computer readable storage medium.
  • Embodiments of the present invention provide a control method, a control device, a smart mirror, and a computer readable storage medium.
  • the control method of the embodiment of the present invention is for controlling a smart mirror, the smart mirror includes a camera and a display screen, and the control method includes:
  • the human body image is displayed at a position of the display screen opposite to the front side of the front face of the face according to the offset angle.
  • the camera includes a plurality of the plurality of the camera interval settings
  • the control method includes:
  • the displaying, according to the offset angle, the position of the human body image on the display screen opposite to the front side of the front face of the face includes:
  • the three-dimensional human body image is displayed at a position of the display screen opposite to the front side of the face positive face according to the offset angle.
  • the processing the human body image to form a three-dimensional human body image comprises:
  • the three-dimensional human body image is formed according to the point cloud.
  • the cameras are three.
  • control method comprises:
  • the displaying, according to the offset angle, the position of the human body image on the display screen opposite to the front side of the front face of the face includes:
  • the virtual makeup image is displayed at a position of the display screen opposite to the front side of the front face of the face according to the offset angle.
  • the display screen includes a plurality of the display screens forming a predetermined angle with each other.
  • the display screen is three.
  • the control device of the embodiment of the invention is for controlling a smart mirror, the smart mirror comprises a camera and a display screen, and the control device comprises:
  • a first control module configured to control the camera to collect a human body image
  • a first processing module configured to process the human body image to determine an offset angle of a face positive face relative to the camera
  • a second control module configured to display the human body image on a position of the display screen opposite to a front side of the front face of the face according to the offset angle.
  • the camera includes a plurality of the plurality of the cameras spaced apart
  • the control device includes:
  • a second processing module configured to process the human body image to form a three-dimensional human body image
  • the second control module includes:
  • a first control unit configured to display the three-dimensional human body image at a position of the display screen opposite to a front side of the face positive face according to the offset angle.
  • the second processing module comprises:
  • An extracting unit configured to extract key points in the human body image
  • the matching unit is configured to match the key points to determine a point cloud for constructing the three-dimensional human body image
  • a building unit for forming the three-dimensional human body image according to the point cloud.
  • the cameras are three.
  • control device comprises:
  • a third processing module configured to perform a virtual makeup test on the human body image to obtain a virtual makeup image
  • the second control module includes:
  • a second control unit configured to display the virtual makeup image on a position of the display screen opposite to a front side of the front face of the face according to the offset angle.
  • the display screen includes a plurality of the display screens forming a predetermined angle with each other.
  • the display screen is three.
  • One or more processors are One or more processors;
  • One or more programs wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the program comprising any of the above-described embodiments for performing the present invention
  • the instructions of the control method comprising any of the above-described embodiments for performing the present invention
  • a computer readable storage medium in accordance with an embodiment of the present invention includes a computer program for use with a smart mirror, the computer program being executable by a processor to perform the control method of any of the above-described embodiments of the present invention.
  • the control method, the control device, the smart mirror and the computer readable storage medium of the embodiment of the present invention can display the human body image on the front side opposite to the front face of the face according to the offset angle of the face of the face with respect to the camera.
  • the smart mirror In the position of the screen, when the user wants to watch the non-frontal loading, it is only necessary to easily turn the body and the head, and the smart mirror can project the angle that the user wishes to view directly in front of the face of the face, which is convenient for the user to use. Smart mirrors and improved user experience.
  • FIG. 1 is a schematic flow chart of a control method according to an embodiment of the present invention.
  • FIG. 2 is a block diagram of a smart mirror in accordance with an embodiment of the present invention.
  • FIG 3 is a schematic view of a scene of a smart mirror according to an embodiment of the present invention.
  • FIG. 4 is a schematic view of a scene of a smart mirror according to another embodiment of the present invention.
  • FIG. 5 is a schematic flow chart of a control method according to another embodiment of the present invention.
  • FIG. 6 is a schematic view of a scene of a smart mirror according to still another embodiment of the present invention.
  • Fig. 7 is a block diagram showing a control device of an embodiment of the present invention.
  • FIG. 8 is a schematic flow chart of a control method according to still another embodiment of the present invention.
  • FIG. 9 is a block diagram of a second processing module according to an embodiment of the present invention.
  • FIG. 10 is a flow chart showing a control method according to still another embodiment of the present invention.
  • Figure 11 is a block diagram showing a control device of another embodiment of the present invention.
  • Figure 12 is a block diagram of a smart mirror in accordance with another embodiment of the present invention.
  • Figure 13 is a connection diagram of a smart mirror and a computer readable storage medium in accordance with an embodiment of the present invention.
  • Control device 10 first control module 11, first processing module 12, second control module 13, first control unit 131, second control unit 132, second processing module 14, extraction unit 141, matching unit 142, building unit 143, the third processing module 15, the camera 20, the first camera 21, the second camera 22, the third camera 23, the rear camera 24, the display screen 30, the first display screen 31, the second display screen 32, the third display Screen 33, processor 50, memory 60, smart mirror 100, computer readable storage medium 200.
  • control methods include:
  • Step S11 controlling the camera 20 to collect an image of a human body
  • Step S12 processing the human body image to determine an offset angle of the face of the face relative to the camera 20;
  • Step S13 The human body image is displayed on the position of the display screen 30 opposite to the front side of the face of the face according to the offset angle.
  • the control device 10 of the embodiment of the present invention is used to control the smart mirror 100.
  • the smart mirror 100 includes a camera 20 and a display screen 30.
  • the control device 10 includes a first control module 11, a first processing module 12, and a second control module 13.
  • the control method of the embodiment of the present invention can be realized by the control device 10 of the embodiment of the present invention.
  • step S11 can be implemented by the first control module
  • step S12 can be implemented by the first processing module 12
  • step S13 can be implemented by the second control module 13.
  • the first control module 11 can be used to control the camera 20 to capture a human body image.
  • the first processing module 12 can be configured to process the human body image to determine an offset angle of the face of the face relative to the camera 20.
  • the second control module 13 can be configured to display the human body image at a position relative to the display screen 30 directly in front of the front face of the face according to the offset angle.
  • the control method and the control device 10 of the embodiment of the present invention can display the human body image on the position of the display screen 30 opposite to the front side of the face of the face according to the offset angle of the face of the face with respect to the camera 20,
  • the user wants to watch the non-frontal loading, he only needs to easily turn the body and the head, and the smart mirror 100 can project the angle that the user wants to view to the front of the face of the face, which is convenient for the user to use the smart mirror 100 and improve The user experience.
  • step S12 includes processing the human body image to determine a face image and determining an offset angle of the face of the face from the camera 20 based on the face image.
  • the human body image is processed to determine that the face image can pass the face recognition technology, that is, face detection (the position and size of the face is calibrated in the human body image), face image preprocessing, face image feature extraction, and Match and identify.
  • face recognition technology that is, face detection (the position and size of the face is calibrated in the human body image), face image preprocessing, face image feature extraction, and Match and identify.
  • the face of the face has an offset angle with respect to the camera 20
  • features such as the shape and distance of the face organs in the face image (such as eyes, nose, mouth, facial contour) and face face
  • the offset angle of the face of the face with respect to the camera 20 can be determined.
  • the camera 20 is disposed above the display screen 30. It can be understood that the camera 20 is disposed above the display screen 30, and may be the upper left, or the upper right, or the upper right, and is not limited herein. Of course, the camera 20 can also be placed elsewhere on the display screen 30, rather than above the display screen 30.
  • the camera 20 is located directly above the first position of the display screen 30.
  • the front side of the face is facing the first position, that is, the face is opposite to the front face.
  • the camera 20 has no offset angle. It should be noted that the offset angle referred to herein is an offset angle in the horizontal direction.
  • the human body image captured by the camera 20 is a frontal human body image.
  • the smart mirror 100 displays the front human body image in the first position.
  • the front side of the face is facing the second position of the display screen 30, that is, the face of the face is shifted to the left by 30 degrees with respect to the camera 20.
  • the human body image captured by the camera 20 is a side human body image that is shifted to the left by 30 degrees.
  • the smart mirror 100 displays the side human body image shifted to the left by 30 degrees at the second position.
  • the smart mirror 100 can project the angle that the user desires to view directly in front of the face of the face.
  • the camera 20 includes a plurality.
  • a plurality of cameras 20 are spaced apart.
  • Control methods include:
  • Step S14 processing a human body image to form a three-dimensional human body image
  • Step S13 includes:
  • Step S131 Display the three-dimensional human body image on the opposite side of the front face of the face according to the offset angle. The position of the screen 30.
  • the camera 20 includes a plurality.
  • a plurality of cameras 20 are spaced apart.
  • Control device 10 includes a second processing module 14.
  • the second control module 13 includes a first control unit 131.
  • Step S14 can be implemented by the second processing module 14, and step S131 can be implemented by the first control unit 131.
  • the second processing module 14 can be used to process a human body image to form a three-dimensional human body image.
  • the first control unit 131 may be configured to display the three-dimensional human body image at a position of the display screen 30 opposite to the front side of the face of the face according to the offset angle.
  • the plurality of cameras 20 (such as the first camera 21, the second camera 22, and the third camera 23 in FIG. 6) simultaneously collect multiple frames of human body images from different angles, and then process the multi-frame human body images to form a three-dimensional human body. image.
  • the smart mirror 100 can display the three-dimensional human body image of the angle that the user desires to view on the position of the display screen 30 opposite to the front of the face of the human face, and the image is vivid and three-dimensional. Improve the user experience.
  • step S12 and step S14 may be performed first step S12 and then step S14; or step S14 may be performed first, then step S12 may be performed; or step S12 and step S14 may be performed simultaneously.
  • step S14 includes:
  • Step S141 extract key points in the human body image
  • Step S142 matching key points to determine a point cloud for constructing a three-dimensional human body image
  • Step S143 Forming a three-dimensional human body image according to the point cloud.
  • the second processing module 14 includes an extracting unit 141 , a matching unit 142 , and a building unit 143 .
  • Step S141 can be implemented by the extracting unit 141
  • step S142 can be implemented by the matching unit 142
  • step S143 can be implemented by the building unit 143.
  • the extracting unit 141 can be used to extract key points in the human body image.
  • Matching unit 142 can be used to match key points to determine a point cloud that constructs a three-dimensional human body image.
  • the building unit 143 can be configured to form a three-dimensional human body image from the point cloud.
  • the plurality of cameras 20 simultaneously collect human body images, extract key points for the human body images collected by each camera 20, match key points according to a predetermined human body model, and then calculate depth coordinates of each key point to determine a three-dimensional human body.
  • the point cloud of the image finally forms a three-dimensional human body image according to the point cloud, and maps the human skin texture on the three-dimensional human body image to form a three-dimensional human body image viewed by the user.
  • the camera 20 includes two.
  • the camera 20 includes a first camera 21 and a second camera 22.
  • First camera 21 and The two cameras 22 are arranged at intervals.
  • the camera 20 includes a first camera 21, a second camera 22, and a third camera 23.
  • the first camera 21, the second camera 22, and the third camera 23 are spaced apart.
  • the first camera 21, the second camera 22, and the third camera 23 may be arranged in an isosceles triangle.
  • the camera 20 when there are multiple cameras 20, the camera 20 includes a rear camera 24.
  • the rear camera 24 is disposed on a wall facing the front of the face when the human body is not displaced. In this way, it can be ensured that the camera 20 collects human body images of various places to form a more complete three-dimensional human body image.
  • control method includes:
  • Step S15 performing a virtual makeup test on the human body image to obtain a virtual makeup image
  • Step S13 includes:
  • Step S132 Display the virtual makeup image on the position of the display screen 30 opposite to the front side of the face of the face according to the offset angle.
  • control device 10 includes a third processing module 15.
  • the second control module 13 includes a second control unit 132.
  • Step S15 can be implemented by the third processing module 15, and step S132 can be implemented by the second control unit 132.
  • the third processing module 15 can be used to perform virtual makeup processing on the human body image to obtain a virtual makeup image.
  • the second control unit 132 may be configured to display the virtual makeup image on the position of the display screen 30 opposite the front of the face of the face according to the offset angle.
  • the virtual makeup test may be directed only to the whole body image of the human body, or may be directed only to the face image of the human body.
  • the virtual makeup test is mainly directed to a face image of a human body.
  • the smart mirror 100 includes a makeup material library.
  • the user can click on the makeup interface of the smart mirror 100.
  • the makeup material may include any one or more of eye shadow material, eyeliner material, blush material, lip gloss material, and eyebrow material.
  • the smart mirror 100 can perform virtual makeup processing on the human body image according to the makeup material selected by the user, and display the obtained virtual makeup image on the position of the display screen 30 opposite to the front side of the face of the face.
  • step S12 and step S15 may be performed first before step S12 and then step S15; or step S15 may be performed first, then step S12 may be performed; or step S12 and step S15 may be performed simultaneously.
  • forming a three-dimensional human body image can be used in conjunction with a virtual makeup test.
  • the smart mirror 100 can perform a virtual makeup test on the basis of a three-dimensional human body image.
  • the virtual makeup image is displayed, and the virtual makeup image is displayed on the display screen 30 opposite to the front side of the face.
  • the user is convenient to use the smart mirror 100, which enhances the user's viewing experience.
  • display screen 30 includes a plurality.
  • the plurality of display screens 30 form a predetermined angle with each other.
  • the smart mirror 100 includes a plurality of display screens 30, and the plurality of display screens 30 form a predetermined angle with each other, the human body can be rotated to a larger angle, so that when the human body shift is greater than or equal to 90 degrees, I can see my own image in front of the face.
  • the display screen 30 is three.
  • the display screen 30 includes a first display screen 31, a second display screen 32, and a third display screen 33.
  • the first display screen 31 and the second display screen 32 are symmetrically disposed on the left and right sides of the third display screen 33.
  • the three display screens 30 form a predetermined angle with each other.
  • the predetermined angle ranges from 120 to 150 degrees.
  • the angle between the first display screen 31 and the third display screen 33 ranges from 120 to 150 degrees
  • the angle between the second display screen 32 and the third display screen 33 ranges from 120 to 150 degrees
  • the first camera 21 and the second camera 22 are disposed above the first display screen 31 and the second display screen 32, respectively. If there are three cameras 20, the first camera 21, the second camera 22, and the third camera 23 are disposed above the first display screen 31, the second display screen 32, and the third display screen 33, respectively. If the number of cameras 20 is greater than three, the plurality of cameras 20 are spaced apart above the first display screen 31, the second display screen 32, and the third display screen 33.
  • a smart mirror 100 of an embodiment of the present invention includes a camera 20, a display screen 30, one or more processors 50, a memory 60, and one or more programs.
  • One or more of the programs are stored in memory 60 and are configured to be executed by one or more processors 50, the program including instructions for performing the control method of any of the above-described embodiments of the present invention.
  • a computer readable storage medium 200 of an embodiment of the present invention includes a computer program for use with the smart mirror 100.
  • the computer program can be executed by processor 50 to perform the control method of any of the above-described embodiments of the present invention.
  • the computer readable storage medium 200 may be a storage medium built in the smart mirror 100 or a storage medium that is pluggably inserted into the smart mirror 100.
  • first and second are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated.
  • features defining “first” or “second” may include one or more of the described features either explicitly or implicitly.
  • “multiple” The meaning is two or more unless specifically and specifically defined.
  • installation In the description of the embodiments of the present invention, it should be noted that the terms “installation”, “connected”, and “connected” are to be understood broadly, and may be fixed connections, for example, or They are detachable or integrally connected; they can be mechanically connected, they can be electrically connected or can communicate with each other; they can be connected directly or indirectly through an intermediate medium, which can be internal or two components of two components. Interaction relationship.
  • an intermediate medium which can be internal or two components of two components.
  • a "computer-readable medium” can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device.
  • a more specific example (non-exhaustive list) of computer readable media includes Bottom: electrical connection (electronic device) with one or more wires, portable computer disk cartridge (magnetic device), random access memory (RAM), read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM).
  • the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.
  • portions of the embodiments of the invention may be implemented in hardware, software, firmware or a combination thereof.
  • multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system.
  • a suitable instruction execution system For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.
  • each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist physically separately, or two or more units may be integrated into one module.
  • the above integrated modules can be implemented in the form of hardware or in the form of software functional modules.
  • the integrated modules, if implemented in the form of software functional modules and sold or used as stand-alone products, may also be stored in a computer readable storage medium.
  • the above mentioned storage medium may be a read only memory, a magnetic disk or an optical disk or the like.

Abstract

A control method for controlling an intelligent mirror (100). An intelligent mirror (100) comprises a camera (20) and a display screen (30). The control method comprises: controlling a camera (20) to acquire an image of a human body (S11); processing the image of the human body to determine a deviation angle of a human face relative to the camera (20) (S12); and displaying, according to the deviation angle, the image of the body on a position of the display screen (30) directly in front of the face (S13). The above method enables a user to see a non-front view of their attire simply by turning their body and head, such that an intelligent mirror (100) will project the view angle desired by the user directly in front of the face, improving user experience.

Description

控制方法、控制装置、智能镜子和计算机可读存储介质Control method, control device, smart mirror and computer readable storage medium 技术领域Technical field
本发明涉及消费性电子技术,特别涉及一种控制方法、控制装置、智能镜子和计算机可读存储介质。The present invention relates to consumer electronics, and more particularly to a control method, control device, smart mirror, and computer readable storage medium.
背景技术Background technique
在相关技术中,当用户使用智能镜子时,若用户希望观看非正面装束,需要侧着身子偏转头部别扭地看向智能镜子,导致用户体验不佳。In the related art, when the user uses the smart mirror, if the user wishes to view the non-frontal loading, it is necessary to sideways and deflect the head to look at the smart mirror awkwardly, resulting in a poor user experience.
发明内容Summary of the invention
本发明实施方式提供一种控制方法、控制装置、智能镜子和计算机可读存储介质。Embodiments of the present invention provide a control method, a control device, a smart mirror, and a computer readable storage medium.
本发明实施方式的控制方法,用于控制智能镜子,所述智能镜子包括摄像头和显示屏,所述控制方法包括:The control method of the embodiment of the present invention is for controlling a smart mirror, the smart mirror includes a camera and a display screen, and the control method includes:
控制所述摄像头采集人体图像;Controlling the camera to collect an image of a human body;
处理所述人体图像以确定人脸正脸相对于所述摄像头的偏移角度;和Processing the human body image to determine an offset angle of a face positive face relative to the camera; and
根据所述偏移角度将所述人体图像显示在与所述人脸正脸的正前方相对的所述显示屏的位置上。The human body image is displayed at a position of the display screen opposite to the front side of the front face of the face according to the offset angle.
在某些实施方式中,所述摄像头包括多个,多个所述摄像头间隔设置,所述控制方法包括:In some embodiments, the camera includes a plurality of the plurality of the camera interval settings, and the control method includes:
处理所述人体图像以形成三维人体图像;Processing the human body image to form a three-dimensional human body image;
所述根据所述偏移角度将所述人体图像显示在与所述人脸正脸的正前方相对的所述显示屏的位置上包括:The displaying, according to the offset angle, the position of the human body image on the display screen opposite to the front side of the front face of the face includes:
根据所述偏移角度将所述三维人体图像显示在与所述人脸正脸的正前方相对的所述显示屏的位置上。The three-dimensional human body image is displayed at a position of the display screen opposite to the front side of the face positive face according to the offset angle.
在某些实施方式中,所述处理所述人体图像以形成三维人体图像包括:In some embodiments, the processing the human body image to form a three-dimensional human body image comprises:
提取所述人体图像中的关键点;Extracting key points in the human body image;
匹配所述关键点以确定构建所述三维人体图像的点云;和Matching the key points to determine a point cloud that constructs the three-dimensional human body image; and
根据所述点云形成所述三维人体图像。The three-dimensional human body image is formed according to the point cloud.
在某些实施方式中,所述摄像头为三个。In some embodiments, the cameras are three.
在某些实施方式中,所述控制方法包括:In some embodiments, the control method comprises:
对所述人体图像进行虚拟试妆处理以得到虚拟试妆图像; Performing a virtual makeup test on the human body image to obtain a virtual makeup image;
所述根据所述偏移角度将所述人体图像显示在与所述人脸正脸的正前方相对的所述显示屏的位置上包括:The displaying, according to the offset angle, the position of the human body image on the display screen opposite to the front side of the front face of the face includes:
根据所述偏移角度将所述虚拟试妆图像显示在与所述人脸正脸的正前方相对的所述显示屏的位置上。The virtual makeup image is displayed at a position of the display screen opposite to the front side of the front face of the face according to the offset angle.
在某些实施方式中,所述显示屏包括多个,多个所述显示屏相互之间形成预定角度。In some embodiments, the display screen includes a plurality of the display screens forming a predetermined angle with each other.
在某些实施方式中,所述显示屏为三个。In some embodiments, the display screen is three.
本发明实施方式的控制装置,用于控制智能镜子,所述智能镜子包括摄像头和显示屏,所述控制装置包括:The control device of the embodiment of the invention is for controlling a smart mirror, the smart mirror comprises a camera and a display screen, and the control device comprises:
第一控制模块,所述第一控制模块用于控制所述摄像头采集人体图像;a first control module, configured to control the camera to collect a human body image;
第一处理模块,所述第一处理模块用于处理所述人体图像以确定人脸正脸相对于所述摄像头的偏移角度;和a first processing module, configured to process the human body image to determine an offset angle of a face positive face relative to the camera; and
第二控制模块,所述第二控制模块用于根据所述偏移角度将所述人体图像显示在与所述人脸正脸的正前方相对的所述显示屏的位置上。a second control module, configured to display the human body image on a position of the display screen opposite to a front side of the front face of the face according to the offset angle.
在某些实施方式中,所述摄像头包括多个,多个所述摄像头间隔设置,所述控制装置包括:In some embodiments, the camera includes a plurality of the plurality of the cameras spaced apart, and the control device includes:
第二处理模块,所述第二处理模块用于处理所述人体图像以形成三维人体图像;a second processing module, configured to process the human body image to form a three-dimensional human body image;
所述第二控制模块包括:The second control module includes:
第一控制单元,所述第一控制单元用于根据所述偏移角度将所述三维人体图像显示在与所述人脸正脸的正前方相对的所述显示屏的位置上。a first control unit, configured to display the three-dimensional human body image at a position of the display screen opposite to a front side of the face positive face according to the offset angle.
在某些实施方式中,所述第二处理模块包括:In some embodiments, the second processing module comprises:
提取单元,所述提取单元用于提取所述人体图像中的关键点;An extracting unit, configured to extract key points in the human body image;
匹配单元,所述匹配单元用于匹配所述关键点以确定构建所述三维人体图像的点云;和a matching unit, the matching unit is configured to match the key points to determine a point cloud for constructing the three-dimensional human body image; and
构建单元,所述构建单元用于根据所述点云形成所述三维人体图像。a building unit for forming the three-dimensional human body image according to the point cloud.
在某些实施方式中,所述摄像头为三个。In some embodiments, the cameras are three.
在某些实施方式中,所述控制装置包括:In some embodiments, the control device comprises:
第三处理模块,所述第三处理模块用于对所述人体图像进行虚拟试妆处理以得到虚拟试妆图像;a third processing module, configured to perform a virtual makeup test on the human body image to obtain a virtual makeup image;
所述第二控制模块包括:The second control module includes:
第二控制单元,所述第二控制单元用于根据所述偏移角度将所述虚拟试妆图像显示在与所述人脸正脸的正前方相对的所述显示屏的位置上。 a second control unit, configured to display the virtual makeup image on a position of the display screen opposite to a front side of the front face of the face according to the offset angle.
在某些实施方式中,所述显示屏包括多个,多个所述显示屏相互之间形成预定角度。In some embodiments, the display screen includes a plurality of the display screens forming a predetermined angle with each other.
在某些实施方式中,所述显示屏为三个。In some embodiments, the display screen is three.
本发明实施方式的智能镜子,包括:The smart mirror of the embodiment of the invention comprises:
摄像头;camera;
显示屏;Display screen
一个或多个处理器;One or more processors;
存储器;以及Memory;
一个或多个程序,其中所述一个或多个程序被存储在所述存储器中,并且被配置由所述一个或多个处理器执行,所述程序包括用于执行本发明上述任一实施方式所述的控制方法的指令。One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the program comprising any of the above-described embodiments for performing the present invention The instructions of the control method.
本发明实施方式的计算机可读存储介质,包括与智能镜子结合使用的计算机程序,所述计算机程序可被处理器执行以完成本发明上述任一实施方式所述的控制方法。A computer readable storage medium in accordance with an embodiment of the present invention includes a computer program for use with a smart mirror, the computer program being executable by a processor to perform the control method of any of the above-described embodiments of the present invention.
本发明实施方式的控制方法、控制装置、智能镜子和计算机可读存储介质,可根据人脸正脸相对于摄像头的偏移角度,将人体图像显示在与人脸正脸的正前方相对的显示屏的位置上,如此,当用户希望观看非正面装束时,只需要轻松地转动身体和头部,智能镜子即可将用户希望观看的角度投射到人脸正脸的正前方,方便了用户使用智能镜子及提高了用户体验。The control method, the control device, the smart mirror and the computer readable storage medium of the embodiment of the present invention can display the human body image on the front side opposite to the front face of the face according to the offset angle of the face of the face with respect to the camera. In the position of the screen, when the user wants to watch the non-frontal loading, it is only necessary to easily turn the body and the head, and the smart mirror can project the angle that the user wishes to view directly in front of the face of the face, which is convenient for the user to use. Smart mirrors and improved user experience.
本发明实施方式的附加方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本发明的实践了解到。Additional aspects and advantages of the embodiments of the invention will be set forth in part in the description.
附图说明DRAWINGS
本发明的上述和/或附加的方面和优点可以从结合下面附图对实施方式的描述中将变得明显和容易理解,其中:The above and/or additional aspects and advantages of the present invention will become apparent and readily understood from the description of the appended claims
图1是本发明实施方式的控制方法的流程示意图。FIG. 1 is a schematic flow chart of a control method according to an embodiment of the present invention.
图2是本发明实施方式的智能镜子的模块示意图。2 is a block diagram of a smart mirror in accordance with an embodiment of the present invention.
图3是本发明实施方式的智能镜子的场景示意图。3 is a schematic view of a scene of a smart mirror according to an embodiment of the present invention.
图4是本发明另一个实施方式的智能镜子的场景示意图。4 is a schematic view of a scene of a smart mirror according to another embodiment of the present invention.
图5是本发明另一个实施方式的控制方法的流程示意图。FIG. 5 is a schematic flow chart of a control method according to another embodiment of the present invention.
图6是本发明又一个实施方式的智能镜子的场景示意图。6 is a schematic view of a scene of a smart mirror according to still another embodiment of the present invention.
图7是本发明实施方式的控制装置的模块示意图。Fig. 7 is a block diagram showing a control device of an embodiment of the present invention.
图8是本发明又一个实施方式的控制方法的流程示意图。 FIG. 8 is a schematic flow chart of a control method according to still another embodiment of the present invention.
图9是本发明实施方式的第二处理模块的模块示意图。9 is a block diagram of a second processing module according to an embodiment of the present invention.
图10是本发明再一个实施方式的控制方法的流程示意图。FIG. 10 is a flow chart showing a control method according to still another embodiment of the present invention.
图11是本发明另一个实施方式的控制装置的模块示意图。Figure 11 is a block diagram showing a control device of another embodiment of the present invention.
图12是本发明另一个实施方式的智能镜子的模块示意图。Figure 12 is a block diagram of a smart mirror in accordance with another embodiment of the present invention.
图13是本发明实施方式的智能镜子和计算机可读存储介质的连接示意图。Figure 13 is a connection diagram of a smart mirror and a computer readable storage medium in accordance with an embodiment of the present invention.
主要元件及符号说明:Description of main components and symbols:
控制装置10、第一控制模块11、第一处理模块12、第二控制模块13、第一控制单元131、第二控制单元132、第二处理模块14、提取单元141、匹配单元142、构建单元143、第三处理模块15、摄像头20、第一摄像头21、第二摄像头22、第三摄像头23、后置摄像头24、显示屏30、第一显示屏31、第二显示屏32、第三显示屏33、处理器50、存储器60、智能镜子100、计算机可读存储介质200。 Control device 10, first control module 11, first processing module 12, second control module 13, first control unit 131, second control unit 132, second processing module 14, extraction unit 141, matching unit 142, building unit 143, the third processing module 15, the camera 20, the first camera 21, the second camera 22, the third camera 23, the rear camera 24, the display screen 30, the first display screen 31, the second display screen 32, the third display Screen 33, processor 50, memory 60, smart mirror 100, computer readable storage medium 200.
具体实施方式Detailed ways
下面详细描述本发明的实施方式,所述实施方式的示例在附图中示出,其中,相同或类似的标号自始至终表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施方式是示例性的,仅用于解释本发明的实施方式,而不能理解为对本发明的实施方式的限制。The embodiments of the present invention are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals indicate the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the drawings are intended to be illustrative of the embodiments of the invention and are not to be construed as limiting.
请参阅图1和图2,本发明实施方式的控制方法用于控制智能镜子100。智能镜子100包括摄像头20和显示屏30。控制方法包括:Referring to FIGS. 1 and 2, a control method of an embodiment of the present invention is used to control the smart mirror 100. The smart mirror 100 includes a camera 20 and a display screen 30. Control methods include:
步骤S11:控制摄像头20采集人体图像;Step S11: controlling the camera 20 to collect an image of a human body;
步骤S12:处理人体图像以确定人脸正脸相对于摄像头20的偏移角度;和Step S12: processing the human body image to determine an offset angle of the face of the face relative to the camera 20; and
步骤S13:根据偏移角度将人体图像显示在与人脸正脸的正前方相对的显示屏30的位置上。Step S13: The human body image is displayed on the position of the display screen 30 opposite to the front side of the face of the face according to the offset angle.
请参阅图2,本发明实施方式的控制装置10用于控制智能镜子100。智能镜子100包括摄像头20和显示屏30。控制装置10包括第一控制模块11、第一处理模块12和第二控制模块13。本发明实施方式的控制方法可以由本发明实施方式的控制装置10实现。例如,步骤S11可由第一控制模块11实现,步骤S12可由第一处理模块12实现,步骤S13可由第二控制模块13实现。Referring to FIG. 2, the control device 10 of the embodiment of the present invention is used to control the smart mirror 100. The smart mirror 100 includes a camera 20 and a display screen 30. The control device 10 includes a first control module 11, a first processing module 12, and a second control module 13. The control method of the embodiment of the present invention can be realized by the control device 10 of the embodiment of the present invention. For example, step S11 can be implemented by the first control module 11, step S12 can be implemented by the first processing module 12, and step S13 can be implemented by the second control module 13.
也即是说,第一控制模块11可以用于控制摄像头20采集人体图像。第一处理模块12可以用于处理人体图像以确定人脸正脸相对于摄像头20的偏移角度。第二控制模块13可以用于根据偏移角度将人体图像显示在与人脸正脸的正前方相对的显示屏30的位置上。 That is to say, the first control module 11 can be used to control the camera 20 to capture a human body image. The first processing module 12 can be configured to process the human body image to determine an offset angle of the face of the face relative to the camera 20. The second control module 13 can be configured to display the human body image at a position relative to the display screen 30 directly in front of the front face of the face according to the offset angle.
本发明实施方式的控制方法和控制装置10,可根据人脸正脸相对于摄像头20的偏移角度,将人体图像显示在与人脸正脸的正前方相对的显示屏30的位置上,如此,当用户希望观看非正面装束时,只需要轻松地转动身体和头部,智能镜子100即可将用户希望观看的角度投射到人脸正脸的正前方,方便了用户使用智能镜子100及提高了用户体验。The control method and the control device 10 of the embodiment of the present invention can display the human body image on the position of the display screen 30 opposite to the front side of the face of the face according to the offset angle of the face of the face with respect to the camera 20, When the user wants to watch the non-frontal loading, he only needs to easily turn the body and the head, and the smart mirror 100 can project the angle that the user wants to view to the front of the face of the face, which is convenient for the user to use the smart mirror 100 and improve The user experience.
在一个实施方式中,步骤S12包括处理人体图像以确定人脸图像和根据人脸图像确定人脸正脸相对于摄像头20的偏移角度。In one embodiment, step S12 includes processing the human body image to determine a face image and determining an offset angle of the face of the face from the camera 20 based on the face image.
具体地,处理人体图像以确定人脸图像可以通过人脸识别技术,即:人脸检测(在人体图像中标定出人脸的位置和大小)、人脸图像预处理、人脸图像特征提取以及匹配与识别。Specifically, the human body image is processed to determine that the face image can pass the face recognition technology, that is, face detection (the position and size of the face is calibrated in the human body image), face image preprocessing, face image feature extraction, and Match and identify.
可以理解,当人脸正脸相对于摄像头20存在偏移角度时,人脸图像中脸部各器官的形状和距离等特征(例如眼睛、鼻子、嘴巴、脸部轮廓线)与人脸正脸相对于摄像头20无偏移角度的情况下存在差异。因此,根据这一差异可以确定人脸正脸相对于摄像头20的偏移角度。It can be understood that when the face of the face has an offset angle with respect to the camera 20, features such as the shape and distance of the face organs in the face image (such as eyes, nose, mouth, facial contour) and face face There is a difference in the case where there is no offset angle with respect to the camera 20. Therefore, based on this difference, the offset angle of the face of the face with respect to the camera 20 can be determined.
在一个实施方式中,摄像头20设置显示屏30上方。可以理解,摄像头20设置在显示屏30的上方,可以是左上方,或者正上方,或者右上方,这里不作限制。当然,摄像头20还可设置在显示屏30其它地方,而非显示屏30上方。In one embodiment, the camera 20 is disposed above the display screen 30. It can be understood that the camera 20 is disposed above the display screen 30, and may be the upper left, or the upper right, or the upper right, and is not limited herein. Of course, the camera 20 can also be placed elsewhere on the display screen 30, rather than above the display screen 30.
请参阅图3,在一个例子中,摄像头20位于显示屏30的第一位置的正上方,当人体未偏转时,人脸正脸的正前方正对第一位置,即人脸正脸相对于摄像头20无偏移角度。需要指出的是,这里所说的偏移角度为水平方向的偏移角度。摄像头20采集的人体图像为正面的人体图像。智能镜子100将正面的人体图像显示在第一位置。Referring to FIG. 3, in an example, the camera 20 is located directly above the first position of the display screen 30. When the human body is not deflected, the front side of the face is facing the first position, that is, the face is opposite to the front face. The camera 20 has no offset angle. It should be noted that the offset angle referred to herein is an offset angle in the horizontal direction. The human body image captured by the camera 20 is a frontal human body image. The smart mirror 100 displays the front human body image in the first position.
请参阅图4,当人体向左偏转30度时,人脸正脸的正前方正对显示屏30的第二位置,即人脸正脸相对于摄像头20向左偏移30度。摄像头20采集的人体图像为向左偏移30度的侧面人体图像。智能镜子100将向左偏移30度的侧面人体图像显示在第二位置处。Referring to FIG. 4, when the human body is deflected to the left by 30 degrees, the front side of the face is facing the second position of the display screen 30, that is, the face of the face is shifted to the left by 30 degrees with respect to the camera 20. The human body image captured by the camera 20 is a side human body image that is shifted to the left by 30 degrees. The smart mirror 100 displays the side human body image shifted to the left by 30 degrees at the second position.
如此,当用户希望从任意角度观测自己时,只需要轻松地转动身体和头部,智能镜子100即可将用户希望观看的角度投射到人脸正脸的正前方。Thus, when the user wishes to observe himself from any angle, it is only necessary to easily turn the body and the head, and the smart mirror 100 can project the angle that the user desires to view directly in front of the face of the face.
请参阅图5和图6,在某些实施方式中,摄像头20包括多个。多个摄像头20间隔设置。控制方法包括:Referring to Figures 5 and 6, in some embodiments, the camera 20 includes a plurality. A plurality of cameras 20 are spaced apart. Control methods include:
步骤S14:处理人体图像以形成三维人体图像;Step S14: processing a human body image to form a three-dimensional human body image;
步骤S13包括:Step S13 includes:
步骤S131:根据偏移角度将三维人体图像显示在与人脸正脸的正前方相对的显示 屏30的位置上。Step S131: Display the three-dimensional human body image on the opposite side of the front face of the face according to the offset angle. The position of the screen 30.
请参阅图7,在某些实施方式中,摄像头20包括多个。多个摄像头20间隔设置。控制装置10包括第二处理模块14。第二控制模块13包括第一控制单元131。步骤S14可由第二处理模块14实现,步骤S131可由第一控制单元131实现。Referring to FIG. 7, in some embodiments, the camera 20 includes a plurality. A plurality of cameras 20 are spaced apart. Control device 10 includes a second processing module 14. The second control module 13 includes a first control unit 131. Step S14 can be implemented by the second processing module 14, and step S131 can be implemented by the first control unit 131.
也即是说,第二处理模块14可以用于处理人体图像以形成三维人体图像。第一控制单元131可以用于根据偏移角度将三维人体图像显示在与人脸正脸的正前方相对的显示屏30的位置上。That is, the second processing module 14 can be used to process a human body image to form a three-dimensional human body image. The first control unit 131 may be configured to display the three-dimensional human body image at a position of the display screen 30 opposite to the front side of the face of the face according to the offset angle.
具体地,多个摄像头20(如图6中的第一摄像头21、第二摄像头22、第三摄像头23)从不同角度同时采集多帧人体图像,再对多帧人体图像进行处理以形成三维人体图像。如此,当用户转动身体和头部时,智能镜子100即可将用户希望观看的角度的三维人体图像显示在与人脸正脸的正前方相对的显示屏30的位置上,形象生动,立体,提高了用户体验。Specifically, the plurality of cameras 20 (such as the first camera 21, the second camera 22, and the third camera 23 in FIG. 6) simultaneously collect multiple frames of human body images from different angles, and then process the multi-frame human body images to form a three-dimensional human body. image. In this way, when the user rotates the body and the head, the smart mirror 100 can display the three-dimensional human body image of the angle that the user desires to view on the position of the display screen 30 opposite to the front of the face of the human face, and the image is vivid and three-dimensional. Improve the user experience.
需要指出的是,步骤S12与步骤S14的先后顺序可以是先执行步骤S12,再执行步骤S14;或者可以是先执行步骤S14,再执行步骤S12;或者可以是同时执行步骤S12与步骤S14。It should be noted that the sequence of step S12 and step S14 may be performed first step S12 and then step S14; or step S14 may be performed first, then step S12 may be performed; or step S12 and step S14 may be performed simultaneously.
请参阅图8,在某些实施方式中,步骤S14包括:Referring to FIG. 8, in some embodiments, step S14 includes:
步骤S141:提取人体图像中的关键点;Step S141: extract key points in the human body image;
步骤S142:匹配关键点以确定构建三维人体图像的点云;和Step S142: matching key points to determine a point cloud for constructing a three-dimensional human body image; and
步骤S143:根据点云形成三维人体图像。Step S143: Forming a three-dimensional human body image according to the point cloud.
请参阅图9,在某些实施方式中,第二处理模块14包括提取单元141、匹配单元142和构建单元143。步骤S141可由提取单元141实现,步骤S142可由匹配单元142实现,步骤S143可由构建单元143实现。Referring to FIG. 9 , in some embodiments, the second processing module 14 includes an extracting unit 141 , a matching unit 142 , and a building unit 143 . Step S141 can be implemented by the extracting unit 141, step S142 can be implemented by the matching unit 142, and step S143 can be implemented by the building unit 143.
也即是说,提取单元141可以用于提取人体图像中的关键点。匹配单元142可以用于匹配关键点以确定构建三维人体图像的点云。构建单元143可以用于根据点云形成三维人体图像。That is to say, the extracting unit 141 can be used to extract key points in the human body image. Matching unit 142 can be used to match key points to determine a point cloud that constructs a three-dimensional human body image. The building unit 143 can be configured to form a three-dimensional human body image from the point cloud.
具体地,多个摄像头20同时采集人体图像,再对每个摄像头20采集的人体图像提取关键点,根据预定人体模型对关键点进行匹配,然后计算各个关键点的深度坐标,以确定构建三维人体图像的点云,最后根据点云形成三维人体图像,并在三维人体图像上映射人体皮肤纹理以形成用户观看到的三维人体图像。Specifically, the plurality of cameras 20 simultaneously collect human body images, extract key points for the human body images collected by each camera 20, match key points according to a predetermined human body model, and then calculate depth coordinates of each key point to determine a three-dimensional human body. The point cloud of the image finally forms a three-dimensional human body image according to the point cloud, and maps the human skin texture on the three-dimensional human body image to form a three-dimensional human body image viewed by the user.
请再次参阅图6,在某些实施方式中,摄像头20包括两个。Referring again to FIG. 6, in some embodiments, the camera 20 includes two.
可以理解,形成三维人体图像至少需要两个摄像头20从不同角度拍摄到人体的同一部位。具体地,摄像头20包括第一摄像头21和第二摄像头22。第一摄像头21和第 二摄像头22左右间隔设置。It can be understood that forming a three-dimensional human body image requires at least two cameras 20 to capture the same part of the human body from different angles. Specifically, the camera 20 includes a first camera 21 and a second camera 22. First camera 21 and The two cameras 22 are arranged at intervals.
请再次参阅图6,在某些实施方式中,摄像头20为三个。Referring again to Figure 6, in some embodiments, there are three cameras 20.
具体地,摄像头20包括第一摄像头21、第二摄像头22和第三摄像头23。第一摄像头21、第二摄像头22和第三摄像头23间隔设置。第一摄像头21、第二摄像头22和第三摄像头23可以呈等腰三角形分布。Specifically, the camera 20 includes a first camera 21, a second camera 22, and a third camera 23. The first camera 21, the second camera 22, and the third camera 23 are spaced apart. The first camera 21, the second camera 22, and the third camera 23 may be arranged in an isosceles triangle.
在某些实施方式中,当摄像头20为多个时,摄像头20包括后置摄像头24。In some embodiments, when there are multiple cameras 20, the camera 20 includes a rear camera 24.
具体地,后置摄像头24设置在人体未偏移时人脸正脸正后方所对的墙体上。如此,可以确保摄像头20采集到各方位的人体图像以形成更为完整的三维人体图像。Specifically, the rear camera 24 is disposed on a wall facing the front of the face when the human body is not displaced. In this way, it can be ensured that the camera 20 collects human body images of various places to form a more complete three-dimensional human body image.
请参阅图10和图11,在某些实施方式中,控制方法包括:Referring to FIG. 10 and FIG. 11, in some embodiments, the control method includes:
步骤S15:对人体图像进行虚拟试妆处理以得到虚拟试妆图像;Step S15: performing a virtual makeup test on the human body image to obtain a virtual makeup image;
步骤S13包括:Step S13 includes:
步骤S132:根据偏移角度将虚拟试妆图像显示在与人脸正脸的正前方相对的显示屏30的位置上。Step S132: Display the virtual makeup image on the position of the display screen 30 opposite to the front side of the face of the face according to the offset angle.
在某些实施方式中,控制装置10包括第三处理模块15。第二控制模块13包括第二控制单元132。步骤S15可由第三处理模块15实现,步骤S132可由第二控制单元132实现。In certain embodiments, control device 10 includes a third processing module 15. The second control module 13 includes a second control unit 132. Step S15 can be implemented by the third processing module 15, and step S132 can be implemented by the second control unit 132.
也即是说,第三处理模块15可以用于对人体图像进行虚拟试妆处理以得到虚拟试妆图像。第二控制单元132可以用于根据偏移角度将虚拟试妆图像显示在与人脸正脸的正前方相对的显示屏30的位置上。That is to say, the third processing module 15 can be used to perform virtual makeup processing on the human body image to obtain a virtual makeup image. The second control unit 132 may be configured to display the virtual makeup image on the position of the display screen 30 opposite the front of the face of the face according to the offset angle.
具体地,虚拟试妆处理可仅针对人体的全身图像,也可仅针对人体的脸部图像。Specifically, the virtual makeup test may be directed only to the whole body image of the human body, or may be directed only to the face image of the human body.
在本发明实施方式中,虚拟试妆处理主要针对人体的脸部图像。In the embodiment of the present invention, the virtual makeup test is mainly directed to a face image of a human body.
在一个例子中,智能镜子100包括妆容素材库。用户可以在智能镜子100的操作界面点选妆容素材。妆容素材可以包括眼影素材、眼线素材、腮红素材、唇彩素材和眉毛素材等中的任意一种或多种。智能镜子100可以根据用户点选的妆容素材对人体图像进行虚拟试妆处理,并将得到的虚拟试妆图像显示在与人脸正脸的正前方相对的显示屏30的位置上。In one example, the smart mirror 100 includes a makeup material library. The user can click on the makeup interface of the smart mirror 100. The makeup material may include any one or more of eye shadow material, eyeliner material, blush material, lip gloss material, and eyebrow material. The smart mirror 100 can perform virtual makeup processing on the human body image according to the makeup material selected by the user, and display the obtained virtual makeup image on the position of the display screen 30 opposite to the front side of the face of the face.
如此,用户可以直观感受自己化妆后的效果,提高了智能镜子100的实用性。In this way, the user can intuitively feel the effect of his own makeup, and improve the practicality of the smart mirror 100.
需要指出的是,步骤S12与步骤S15的先后顺序可以是先执行步骤S12,再执行步骤S15;或者可以是先执行步骤S15,再执行步骤S12;或者可以是同时执行步骤S12与步骤S15。It should be noted that the sequence of step S12 and step S15 may be performed first before step S12 and then step S15; or step S15 may be performed first, then step S12 may be performed; or step S12 and step S15 may be performed simultaneously.
在某些实施方式中,形成三维人体图像可以与虚拟试妆处理结合使用。In some embodiments, forming a three-dimensional human body image can be used in conjunction with a virtual makeup test.
也即是说,智能镜子100可以在三维人体图像的基础上进行虚拟试妆处理,以得 到虚拟试妆图像,并将虚拟试妆图像显示在与人脸正脸的正前方相对的显示屏30的位置上。That is to say, the smart mirror 100 can perform a virtual makeup test on the basis of a three-dimensional human body image. The virtual makeup image is displayed, and the virtual makeup image is displayed on the display screen 30 opposite to the front side of the face.
如此,方便了用户使用智能镜子100,提升了用户观感体验。In this way, the user is convenient to use the smart mirror 100, which enhances the user's viewing experience.
请再次参阅图6,在某些实施方式中,显示屏30包括多个。多个显示屏30相互之间形成预定角度。Referring again to FIG. 6, in some embodiments, display screen 30 includes a plurality. The plurality of display screens 30 form a predetermined angle with each other.
可以理解,而当智能镜子100包括多个显示屏30,且多个显示屏30相互之间形成预定角度时,可支持人体转动更大的角度,使得人体偏移大于或等于90度时,仍能看到在人脸正前方看到自己的图像。It can be understood that when the smart mirror 100 includes a plurality of display screens 30, and the plurality of display screens 30 form a predetermined angle with each other, the human body can be rotated to a larger angle, so that when the human body shift is greater than or equal to 90 degrees, I can see my own image in front of the face.
请再次参阅图6,在某些实施方式中,显示屏30为三个。Referring again to Figure 6, in some embodiments, the display screen 30 is three.
具体地,显示屏30包括第一显示屏31、第二显示屏32和第三显示屏33。第一显示屏31和第二显示屏32对称设置在第三显示屏33的左右两边。三个显示屏30相互之间形成预定角度。Specifically, the display screen 30 includes a first display screen 31, a second display screen 32, and a third display screen 33. The first display screen 31 and the second display screen 32 are symmetrically disposed on the left and right sides of the third display screen 33. The three display screens 30 form a predetermined angle with each other.
较佳地,预定角度的范围为120-150度。Preferably, the predetermined angle ranges from 120 to 150 degrees.
也即是说,第一显示屏31与第三显示屏33的夹角范围为120-150度,第二显示屏32与第三显示屏33的夹角范围为120-150度。That is to say, the angle between the first display screen 31 and the third display screen 33 ranges from 120 to 150 degrees, and the angle between the second display screen 32 and the third display screen 33 ranges from 120 to 150 degrees.
此时,若摄像头20为2个,则第一摄像头21和第二摄像头22分别设置在第一显示屏31和第二显示屏32的上方。若摄像头20为3个,则第一摄像头21、第二摄像头22和第三摄像头23分别设置在第一显示屏31、第二显示屏32和第三显示屏33的上方。若摄像头20的个数大于3个,则多个摄像头20间隔分布在第一显示屏31、第二显示屏32和第三显示屏33的上方。At this time, if there are two cameras 20, the first camera 21 and the second camera 22 are disposed above the first display screen 31 and the second display screen 32, respectively. If there are three cameras 20, the first camera 21, the second camera 22, and the third camera 23 are disposed above the first display screen 31, the second display screen 32, and the third display screen 33, respectively. If the number of cameras 20 is greater than three, the plurality of cameras 20 are spaced apart above the first display screen 31, the second display screen 32, and the third display screen 33.
请参阅图12,本发明实施方式的智能镜子100包括摄像头20、显示屏30、一个或多个处理器50、存储器60以及一个或多个程序。其中一个或多个程序被存储在存储器60中,并且被配置由一个或多个处理器50执行,程序包括用于执行本发明上述任一实施方式的控制方法的指令。Referring to FIG. 12, a smart mirror 100 of an embodiment of the present invention includes a camera 20, a display screen 30, one or more processors 50, a memory 60, and one or more programs. One or more of the programs are stored in memory 60 and are configured to be executed by one or more processors 50, the program including instructions for performing the control method of any of the above-described embodiments of the present invention.
请参阅图13,本发明实施方式的计算机可读存储介质200包括与智能镜子100结合使用的计算机程序。计算机程序可被处理器50执行以完成本发明上述任一实施方式的控制方法。Referring to FIG. 13, a computer readable storage medium 200 of an embodiment of the present invention includes a computer program for use with the smart mirror 100. The computer program can be executed by processor 50 to perform the control method of any of the above-described embodiments of the present invention.
需要指出的是,计算机可读存储介质200可以是内置在智能镜子100中的存储介质,也可以是能够插拔地插接在智能镜子100的存储介质。It should be noted that the computer readable storage medium 200 may be a storage medium built in the smart mirror 100 or a storage medium that is pluggably inserted into the smart mirror 100.
此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个所述特征。在本发明的实施方式的描述中,“多个”的 含义是两个或两个以上,除非另有明确具体的限定。Moreover, the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, features defining "first" or "second" may include one or more of the described features either explicitly or implicitly. In the description of the embodiments of the present invention, "multiple" The meaning is two or more unless specifically and specifically defined.
在本发明的实施方式的描述中,需要说明的是,除非另有明确的规定和限定,术语“安装”、“相连”、“连接”应做广义理解,例如,可以是固定连接,也可以是可拆卸连接,或一体地连接;可以是机械连接,也可以是电连接或可以相互通讯;可以是直接相连,也可以通过中间媒介间接相连,可以是两个元件内部的连通或两个元件的相互作用关系。对于本领域的普通技术人员而言,可以根据具体情况理解上述术语在本发明的实施方式中的具体含义。In the description of the embodiments of the present invention, it should be noted that the terms "installation", "connected", and "connected" are to be understood broadly, and may be fixed connections, for example, or They are detachable or integrally connected; they can be mechanically connected, they can be electrically connected or can communicate with each other; they can be connected directly or indirectly through an intermediate medium, which can be internal or two components of two components. Interaction relationship. For those skilled in the art, the specific meanings of the above terms in the embodiments of the present invention can be understood on a case-by-case basis.
上文的公开提供了许多不同的实施方式或例子用来实现本发明的实施方式的不同结构。为了简化本发明的实施方式的公开,上文中对特定例子的部件和设置进行描述。当然,它们仅仅为示例,并且目的不在于限制本发明。此外,本发明的实施方式可以在不同例子中重复参考数字和/或参考字母,这种重复是为了简化和清楚的目的,其本身不指示所讨论各种实施方式和/或设置之间的关系。此外,本发明的实施方式提供了的各种特定的工艺和材料的例子,但是本领域普通技术人员可以意识到其他工艺的应用和/或其他材料的使用。The above disclosure provides many different embodiments or examples for implementing different structures of embodiments of the present invention. In order to simplify the disclosure of embodiments of the present invention, the components and arrangements of the specific examples are described above. Of course, they are merely examples and are not intended to limit the invention. In addition, the embodiments of the present invention may repeat reference numerals and/or reference letters in different examples, which are for the purpose of simplicity and clarity, and do not in themselves indicate the relationship between the various embodiments and/or arrangements discussed. . Moreover, embodiments of the present invention provide examples of various specific processes and materials, but one of ordinary skill in the art will recognize the use of other processes and/or the use of other materials.
在本说明书的描述中,参考术语“一个实施方式”、“某些实施方式”、“示意性实施方式”、“示例”、“具体示例”或“一些示例”等的描述意指结合所述实施方式或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施方式或示例中。在本说明书中,对上述术语的示意性表述不一定指的是相同的实施方式或示例。而且,描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施方式或示例中以合适的方式结合。In the description of the present specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiment", "example", "specific example" or "some examples", etc. Particular features, structures, materials or features described in the embodiments or examples are included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms does not necessarily mean the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples.
流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为,表示包括一个或更多个用于实现特定逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分,并且本发明的优选实施方式的范围包括另外的实现,其中可以不按所示出或讨论的顺序,包括根据所涉及的功能按基本同时的方式或按相反的顺序,来执行功能,这应被本发明的实施例所属技术领域的技术人员所理解。Any process or method description in the flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a particular logical function or process. And the scope of the preferred embodiments of the invention includes additional implementations, in which the functions may be performed in a substantially simultaneous manner or in an opposite order depending on the functions involved, in the order shown or discussed. It will be understood by those skilled in the art to which the embodiments of the present invention pertain.
在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读介质中,以供指令执行系统、装置或设备(如基于计算机的系统、包括处理模块的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用,或结合这些指令执行系统、装置或设备而使用。就本说明书而言,"计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以 下:具有一个或多个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPROM或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDROM)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。The logic and/or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer readable medium, Used in conjunction with, or in conjunction with, an instruction execution system, apparatus, or device (eg, a computer-based system, a system including a processing module, or other system that can fetch instructions and execute instructions from an instruction execution system, apparatus, or device) Or use with equipment. For the purposes of this specification, a "computer-readable medium" can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device. A more specific example (non-exhaustive list) of computer readable media includes Bottom: electrical connection (electronic device) with one or more wires, portable computer disk cartridge (magnetic device), random access memory (RAM), read only memory (ROM), erasable editable read only memory ( EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.
应当理解,本发明的实施方式的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。例如,如果用硬件来实现,和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。It should be understood that portions of the embodiments of the invention may be implemented in hardware, software, firmware or a combination thereof. In the above-described embodiments, multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.
本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,该程序在执行时,包括方法实施例的步骤之一或其组合。One of ordinary skill in the art can understand that all or part of the steps carried by the method of implementing the above embodiments can be completed by a program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, one or a combination of the steps of the method embodiments is included.
此外,在本发明的各个实施例中的各功能单元可以集成在一个处理模块中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. The integrated modules, if implemented in the form of software functional modules and sold or used as stand-alone products, may also be stored in a computer readable storage medium.
上述提到的存储介质可以是只读存储器,磁盘或光盘等。The above mentioned storage medium may be a read only memory, a magnetic disk or an optical disk or the like.
尽管上面已经示出和描述了本发明的实施例,可以理解的是,上述实施例是示例性的,不能理解为对本发明的限制,本领域的普通技术人员在本发明的范围内可以对上述实施例进行变化、修改、替换和变型。 Although the embodiments of the present invention have been shown and described, it is understood that the above-described embodiments are illustrative and are not to be construed as limiting the scope of the invention. The embodiments are subject to variations, modifications, substitutions and variations.

Claims (16)

  1. 一种控制方法,用于控制智能镜子,其特征在于,所述智能镜子包括摄像头和显示屏,所述控制方法包括:A control method for controlling a smart mirror, wherein the smart mirror comprises a camera and a display screen, and the control method comprises:
    控制所述摄像头采集人体图像;Controlling the camera to collect an image of a human body;
    处理所述人体图像以确定人脸正脸相对于所述摄像头的偏移角度;和Processing the human body image to determine an offset angle of a face positive face relative to the camera; and
    根据所述偏移角度将所述人体图像显示在与所述人脸正脸的正前方相对的所述显示屏的位置上。The human body image is displayed at a position of the display screen opposite to the front side of the front face of the face according to the offset angle.
  2. 如权利要求1所述的控制方法,其特征在于,所述摄像头包括多个,多个所述摄像头间隔设置,所述控制方法包括:The control method according to claim 1, wherein the camera comprises a plurality of the plurality of the cameras spaced apart, and the control method comprises:
    处理所述人体图像以形成三维人体图像;Processing the human body image to form a three-dimensional human body image;
    所述根据所述偏移角度将所述人体图像显示在与所述人脸正脸的正前方相对的所述显示屏的位置上包括:The displaying, according to the offset angle, the position of the human body image on the display screen opposite to the front side of the front face of the face includes:
    根据所述偏移角度将所述三维人体图像显示在与所述人脸正脸的正前方相对的所述显示屏的位置上。The three-dimensional human body image is displayed at a position of the display screen opposite to the front side of the face positive face according to the offset angle.
  3. 如权利要求2所述的控制方法,其特征在于,所述处理所述人体图像以形成三维人体图像包括:The control method according to claim 2, wherein the processing the human body image to form a three-dimensional human body image comprises:
    提取所述人体图像中的关键点;Extracting key points in the human body image;
    匹配所述关键点以确定构建所述三维人体图像的点云;和Matching the key points to determine a point cloud that constructs the three-dimensional human body image; and
    根据所述点云形成所述三维人体图像。The three-dimensional human body image is formed according to the point cloud.
  4. 如权利要求2所述的控制方法,其特征在于,所述摄像头为三个。The control method according to claim 2, wherein said cameras are three.
  5. 如权利要求1所述的控制方法,其特征在于,所述控制方法包括:The control method according to claim 1, wherein said control method comprises:
    对所述人体图像进行虚拟试妆处理以得到虚拟试妆图像;Performing a virtual makeup test on the human body image to obtain a virtual makeup image;
    所述根据所述偏移角度将所述人体图像显示在与所述人脸正脸的正前方相对的所述显示屏的位置上包括:The displaying, according to the offset angle, the position of the human body image on the display screen opposite to the front side of the front face of the face includes:
    根据所述偏移角度将所述虚拟试妆图像显示在与所述人脸正脸的正前方相对的所述显示屏的位置上。 The virtual makeup image is displayed at a position of the display screen opposite to the front side of the front face of the face according to the offset angle.
  6. 如权利要求1所述的控制方法,其特征在于,所述显示屏包括多个,多个所述显示屏相互之间形成预定角度。The control method according to claim 1, wherein said display screen comprises a plurality of said display screens forming a predetermined angle with each other.
  7. 如权利要求6所述的控制方法,其特征在于,所述显示屏为三个。The control method according to claim 6, wherein said display screen is three.
  8. 一种控制装置,用于控制智能镜子,其特征在于,所述智能镜子包括摄像头和显示屏,所述控制装置包括:A control device for controlling a smart mirror, wherein the smart mirror comprises a camera and a display screen, and the control device comprises:
    第一控制模块,所述第一控制模块用于控制所述摄像头采集人体图像;a first control module, configured to control the camera to collect a human body image;
    第一处理模块,所述第一处理模块用于处理所述人体图像以确定人脸正脸相对于所述摄像头的偏移角度;和a first processing module, configured to process the human body image to determine an offset angle of a face positive face relative to the camera; and
    第二控制模块,所述第二控制模块用于根据所述偏移角度将所述人体图像显示在与所述人脸正脸的正前方相对的所述显示屏的位置上。a second control module, configured to display the human body image on a position of the display screen opposite to a front side of the front face of the face according to the offset angle.
  9. 如权利要求8所述的控制装置,其特征在于,所述摄像头包括多个,多个所述摄像头间隔设置,所述控制装置包括:The control device according to claim 8, wherein the camera comprises a plurality of the plurality of the cameras spaced apart, and the control device comprises:
    第二处理模块,所述第二处理模块用于处理所述人体图像以形成三维人体图像;a second processing module, configured to process the human body image to form a three-dimensional human body image;
    所述第二控制模块包括:The second control module includes:
    第一控制单元,所述第一控制单元用于根据所述偏移角度将所述三维人体图像显示在与所述人脸正脸的正前方相对的所述显示屏的位置上。a first control unit, configured to display the three-dimensional human body image at a position of the display screen opposite to a front side of the face positive face according to the offset angle.
  10. 如权利要求9所述的控制装置,其特征在于,所述第二处理模块包括:The control device of claim 9, wherein the second processing module comprises:
    提取单元,所述提取单元用于提取所述人体图像中的关键点;An extracting unit, configured to extract key points in the human body image;
    匹配单元,所述匹配单元用于匹配所述关键点以确定构建所述三维人体图像的点云;和a matching unit, the matching unit is configured to match the key points to determine a point cloud for constructing the three-dimensional human body image; and
    构建单元,所述构建单元用于根据所述点云形成所述三维人体图像。a building unit for forming the three-dimensional human body image according to the point cloud.
  11. 如权利要求9所述的控制装置,其特征在于,所述摄像头为三个。The control device according to claim 9, wherein said cameras are three.
  12. 如权利要求8所述的控制装置,其特征在于,所述控制装置包括:The control device according to claim 8, wherein said control device comprises:
    第三处理模块,所述第三处理模块用于对所述人体图像进行虚拟试妆处理以得到虚拟试妆图像;a third processing module, configured to perform a virtual makeup test on the human body image to obtain a virtual makeup image;
    所述第二控制模块包括: The second control module includes:
    第二控制单元,所述第二控制单元用于根据所述偏移角度将所述虚拟试妆图像显示在与所述人脸正脸的正前方相对的所述显示屏的位置上。a second control unit, configured to display the virtual makeup image on a position of the display screen opposite to a front side of the front face of the face according to the offset angle.
  13. 如权利要求8所述的控制装置,其特征在于,所述显示屏包括多个,多个所述显示屏相互之间形成预定角度。The control device according to claim 8, wherein said display screen comprises a plurality of said display screens forming a predetermined angle with each other.
  14. 如权利要求13所述的控制装置,其特征在于,所述显示屏为三个。The control device according to claim 13, wherein said display screen is three.
  15. 一种智能镜子,其特征在于,包括:A smart mirror, comprising:
    摄像头;camera;
    显示屏;Display screen
    一个或多个处理器;One or more processors;
    存储器;以及Memory;
    一个或多个程序,其中所述一个或多个程序被存储在所述存储器中,并且被配置由所述一个或多个处理器执行,所述程序包括用于执行权利要求1-7任意一项所述的控制方法的指令。One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the program comprising for performing any of claims 1-7 The instructions of the control method described in the item.
  16. 一种计算机可读存储介质,其特征在于,包括与智能镜子结合使用的计算机程序,所述计算机程序可被处理器执行以完成权利要求1-7任意一项所述的控制方法。 A computer readable storage medium comprising a computer program for use with a smart mirror, the computer program being executable by a processor to perform the control method of any of claims 1-7.
PCT/CN2017/098362 2017-08-21 2017-08-21 Control method, control device, intelligent mirror and computer-readable storage medium WO2019036866A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2017/098362 WO2019036866A1 (en) 2017-08-21 2017-08-21 Control method, control device, intelligent mirror and computer-readable storage medium
CN201780001082.3A CN107690675A (en) 2017-08-21 2017-08-21 Control method, control device, Intelligent mirror and computer-readable recording medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/098362 WO2019036866A1 (en) 2017-08-21 2017-08-21 Control method, control device, intelligent mirror and computer-readable storage medium

Publications (1)

Publication Number Publication Date
WO2019036866A1 true WO2019036866A1 (en) 2019-02-28

Family

ID=61154893

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/098362 WO2019036866A1 (en) 2017-08-21 2017-08-21 Control method, control device, intelligent mirror and computer-readable storage medium

Country Status (2)

Country Link
CN (1) CN107690675A (en)
WO (1) WO2019036866A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112766215A (en) * 2021-01-29 2021-05-07 北京字跳网络技术有限公司 Face fusion method and device, electronic equipment and storage medium
CN112784644A (en) * 2019-11-08 2021-05-11 佛山市云米电器科技有限公司 Multi-device synchronous display method, device, equipment and computer readable storage medium
CN114098385A (en) * 2021-10-29 2022-03-01 北京瞰瞰智能科技有限公司 Intelligent traveling mirror device, control method thereof and controller

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113168300A (en) * 2018-12-07 2021-07-23 深圳市柔宇科技股份有限公司 Control method and display device
CN112882536A (en) * 2021-01-22 2021-06-01 Oppo广东移动通信有限公司 Control method, control device, electronic device, and storage medium
WO2022165635A1 (en) * 2021-02-02 2022-08-11 浙江大学 Method for reconstructing three-dimensional human body by using mirror
CN115953389B (en) * 2023-02-24 2023-11-24 广州视景医疗软件有限公司 Strabismus judging method and device based on face key point detection

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102547209A (en) * 2012-02-06 2012-07-04 华为技术有限公司 Method and device for controlling videoconferencing equipment, and videoconferencing system
US20120320197A1 (en) * 2011-06-17 2012-12-20 Booty Cam Llc Dressing room rear view video system
CN103235645A (en) * 2013-04-25 2013-08-07 上海大学 Standing type display interface self-adaption tracking regulating device and method
CN104643747A (en) * 2013-11-25 2015-05-27 西安思创达通讯科技有限责任公司 Mirror capable of automatically swerving
CN105141944A (en) * 2015-09-10 2015-12-09 相汇网络科技(杭州)有限公司 Multidimensional stereoimaging fitting mirror
CN105321432A (en) * 2014-11-03 2016-02-10 苏州朗米尔照明科技有限公司 Multi-angle oled fitting mirror
CN106419337A (en) * 2016-11-30 2017-02-22 广西大学 Intelligent dressing mirror
CN107609490A (en) * 2017-08-21 2018-01-19 美的集团股份有限公司 Control method, control device, Intelligent mirror and computer-readable recording medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120320197A1 (en) * 2011-06-17 2012-12-20 Booty Cam Llc Dressing room rear view video system
CN102547209A (en) * 2012-02-06 2012-07-04 华为技术有限公司 Method and device for controlling videoconferencing equipment, and videoconferencing system
CN103235645A (en) * 2013-04-25 2013-08-07 上海大学 Standing type display interface self-adaption tracking regulating device and method
CN104643747A (en) * 2013-11-25 2015-05-27 西安思创达通讯科技有限责任公司 Mirror capable of automatically swerving
CN105321432A (en) * 2014-11-03 2016-02-10 苏州朗米尔照明科技有限公司 Multi-angle oled fitting mirror
CN105141944A (en) * 2015-09-10 2015-12-09 相汇网络科技(杭州)有限公司 Multidimensional stereoimaging fitting mirror
CN106419337A (en) * 2016-11-30 2017-02-22 广西大学 Intelligent dressing mirror
CN107609490A (en) * 2017-08-21 2018-01-19 美的集团股份有限公司 Control method, control device, Intelligent mirror and computer-readable recording medium

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112784644A (en) * 2019-11-08 2021-05-11 佛山市云米电器科技有限公司 Multi-device synchronous display method, device, equipment and computer readable storage medium
CN112766215A (en) * 2021-01-29 2021-05-07 北京字跳网络技术有限公司 Face fusion method and device, electronic equipment and storage medium
CN114098385A (en) * 2021-10-29 2022-03-01 北京瞰瞰智能科技有限公司 Intelligent traveling mirror device, control method thereof and controller

Also Published As

Publication number Publication date
CN107690675A (en) 2018-02-13

Similar Documents

Publication Publication Date Title
WO2019036866A1 (en) Control method, control device, intelligent mirror and computer-readable storage medium
Fischer et al. Rt-gene: Real-time eye gaze estimation in natural environments
US9495008B2 (en) Detecting a primary user of a device
US11747898B2 (en) Method and apparatus with gaze estimation
EP3332403B1 (en) Liveness detection
US9239460B2 (en) Calibration of eye location
US9829996B2 (en) Operations in a three dimensional display system
CN110363133B (en) Method, device, equipment and storage medium for sight line detection and video processing
US20130135295A1 (en) Method and system for a augmented reality
US11120613B2 (en) Image generating device and method of generating image
CN110926334B (en) Measuring method, measuring device, electronic device and storage medium
US20180262671A1 (en) Modifying images with simulated light sources
CN109272579B (en) Three-dimensional model-based makeup method and device, electronic equipment and storage medium
WO2019237745A1 (en) Facial image processing method and apparatus, electronic device and computer readable storage medium
CN108961195A (en) Image processing method and device, image collecting device, readable storage medium storing program for executing and computer equipment
US20160191903A1 (en) Three-dimensional image generation method and apparatus
US20210383097A1 (en) Object scanning for subsequent object detection
KR20160046399A (en) Method and Apparatus for Generation Texture Map, and Database Generation Method
EP3074844B1 (en) Estimating gaze from un-calibrated eye measurement points
JP2022518402A (en) 3D reconstruction method and equipment
US20200211275A1 (en) Information processing device, information processing method, and recording medium
WO2020208976A1 (en) Image processing device, image processing method, and program
JP2016111612A (en) Content display device
US11037323B2 (en) Image processing apparatus, image processing method and storage medium
KR20150039049A (en) Method and Apparatus For Providing A User Interface According to Size of Template Edit Frame

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17922136

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17922136

Country of ref document: EP

Kind code of ref document: A1