TWI775229B - A skin condition detection system and method thereof - Google Patents

A skin condition detection system and method thereof Download PDF

Info

Publication number
TWI775229B
TWI775229B TW109142323A TW109142323A TWI775229B TW I775229 B TWI775229 B TW I775229B TW 109142323 A TW109142323 A TW 109142323A TW 109142323 A TW109142323 A TW 109142323A TW I775229 B TWI775229 B TW I775229B
Authority
TW
Taiwan
Prior art keywords
skin
irradiation
data
beautifying
face
Prior art date
Application number
TW109142323A
Other languages
Chinese (zh)
Other versions
TW202222246A (en
Inventor
黎少倫
陳家興
Original Assignee
碁曄科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 碁曄科技股份有限公司 filed Critical 碁曄科技股份有限公司
Priority to TW109142323A priority Critical patent/TWI775229B/en
Priority to CN202111439239.5A priority patent/CN114596607A/en
Publication of TW202222246A publication Critical patent/TW202222246A/en
Application granted granted Critical
Publication of TWI775229B publication Critical patent/TWI775229B/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/243Classification techniques relating to the number of classes
    • G06F18/2431Multiple classes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/20Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/04Context-preserving transformations, e.g. by using an importance map
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/77Retouching; Inpainting; Scratch removal
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • G06T2207/30201Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Computer Graphics (AREA)
  • Architecture (AREA)
  • Computer Hardware Design (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Software Systems (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The present invention provides a skin condition detection system and method thereof. The method comprises storing multiple sets of facial feature model data and irradiation reference files in a remote server, establishing a 3D facial model data of the subject through the subject’s face color image data and face depth image data, distributing the skin condition detection and determination computing to a skin condition detection device and a skin irradiation device by the edge computing model to automatically detect and determine the skin condition feature image and to irradiate and repair the skin.

Description

美膚檢測系統及其方法Skin beauty detection system and method thereof

本發明是有關一種美膚檢測系統及其方法,特別是一種能夠以邊緣運算模式,將臉部特徵模型透過遠端伺服設備運行,而皮膚狀態檢測、判斷與照射相關運算係分散部署於周邊設備之系統及其方法。The invention relates to a skin beautifying detection system and a method thereof, in particular to a system capable of running a facial feature model through a remote servo device in an edge computing mode, and the skin state detection, judgment and irradiation related operations are distributed in peripheral devices system and method thereof.

光療、是利用電磁波輻射產生不同波長的光線來治療皮膚病的一種方法。光療是最古老、最有效的治療皮膚病的物理學手段。早在古希臘時期,就有使用日光浴治療皮膚病的文字記錄,但直到 20 世紀初,才開始對光療模式進行了系統研究。Phototherapy is a method of using electromagnetic radiation to generate light of different wavelengths to treat skin diseases. Phototherapy is the oldest and most effective physical treatment for skin diseases. The use of sunbathing to treat skin diseases has been documented as far back as the ancient Greeks, but it wasn't until the early 20th century that a systematic study of phototherapy patterns began.

然而,現今光療裝置結構過於龐大, 而致使用上不便利且無法隨攜使用,例如箱型光療裝置,使用者進入其內接受全身光照治療,然其由於體積龐大,因此需組設於特定地點而無法自由移動。However, the structure of today's phototherapy devices is too large, which makes it inconvenient to use and cannot be used with you. For example, a box-type phototherapy device is used by users to receive whole body light therapy. However, due to its large size, it needs to be assembled in a specific location. and cannot move freely.

而另一種較為小型之光療裝置,則以支撐架定位於地面,再以光線照射人體,然而這一類光療裝置必須手動調整與操作,故操作仍是複雜,且如何能夠準確對準患者需治療處進行照射,仍是一需解決之困難處。Another relatively small phototherapy device is positioned on the ground with a support frame, and then irradiates the human body with light. However, this type of phototherapy device must be manually adjusted and operated, so the operation is still complicated, and how to accurately target the patient to be treated. Irradiation is still a difficulty that needs to be solved.

故本案提供一套系統及其方法,能夠透過深度學習進行訓練出多組臉部特徵模型數據,並再透過被檢者的人臉彩色影像數據及人臉影像深度數據建立出被檢者的3D臉部模型數據,更由於為了於進行膚質檢測與判斷時,其反應速度不至於因為網絡狀況與要求裝置數量而受到影響,故將模型分散部署於邊緣端(裝置端),讓裝置可以自行判斷、檢測標的物與進行照射治療,如此將能夠極大化地增加裝置可用性,因此,本案應為一最佳解決方案。Therefore, this case provides a system and method, which can train multiple sets of facial feature model data through deep learning, and then use the color image data of the subject's face and the depth data of the face image to create a 3D image of the subject. Face model data, and in order to detect and judge skin quality, the response speed will not be affected by network conditions and the number of required devices, so the models are distributed on the edge (device side), so that the device can automatically Judging, detecting the target object and performing radiation therapy can greatly increase the availability of the device. Therefore, this case should be an optimal solution.

本發明美膚檢測系統,係包含一遠端伺服設備,係包含有:一目標特徵建立器,係依據多張具有人臉之照片,針對不同皮膚狀態特徵圖像進行目標分類,用以建立出多組臉部特徵模型數據;一照射參數儲存器,係依據不同皮膚狀態特徵圖樣,進行儲存多組的照射參考檔;一3D模型建立器,用以依據一被檢者的人臉彩色影像數據及人臉影像深度數據,進行建立出該被檢者的3D臉部模型數據;一或多個攝影設備,用以進行拍攝,以取得該被檢者的人臉彩色影像數據及人臉影像深度數據,並傳送至該遠端伺服設備;一或多個美膚檢測設備,係與該遠端伺服設備進行連線,用以接收多組臉部特徵模型數據及該被檢者的3D臉部模型數據,並進行比對,以標示出該被檢者臉部上某一個或某多個座標上的皮膚狀態特徵圖樣;一或多個美膚照射設備,係與該遠端伺服設備及該美膚檢測設備進行連線,而該美膚照射設備係包含:一照射數據調整器,係用以依據多組的照射參考檔,針對該被檢者臉部上某一個或某多個座標上的皮膚狀態特徵圖樣,進行設定一照射參數數據;以及一LED照射本體,係具有多個照射單元及一與該照射數據調整器相連接之控制單元,每一個照射單元係至少包含有一LED燈,其中該控制單元能夠依據該照射參數數據進行控制不同LED燈對該被檢者臉部上的某一個或某多個座標進行照射。The skin beautifying detection system of the present invention includes a remote servo device, and includes: a target feature creator, which is based on a plurality of photos with human faces to classify objects according to different skin state feature images, so as to establish a Multiple sets of facial feature model data; an irradiation parameter storage for storing multiple sets of irradiation reference files according to different skin condition feature patterns; a 3D model builder based on color image data of a subject's face and face image depth data, to establish the 3D face model data of the subject; one or more photographic devices for shooting to obtain the subject's face color image data and face image depth The data is sent to the remote server device; one or more skin beauty detection devices are connected to the remote server device to receive multiple sets of facial feature model data and the subject's 3D face model data, and compare them to indicate the skin condition feature pattern on one or more coordinates of the subject's face; one or more skin beautifying irradiation devices are connected to the remote servo device and the The skin beautifying detection device is connected, and the skin beautifying irradiation device includes: an irradiation data adjuster, which is used for targeting one or a plurality of coordinates on the subject's face according to a plurality of sets of irradiation reference files. The characteristic pattern of the skin state is used to set an irradiation parameter data; and an LED irradiation body has a plurality of irradiation units and a control unit connected with the irradiation data adjuster, and each irradiation unit includes at least one LED light, Wherein, the control unit can control different LED lights to irradiate one or more coordinates on the subject's face according to the irradiation parameter data.

更具體的說,所述皮膚狀態特徵圖樣係能夠為皮膚膚質或/及皮膚缺陷之圖像。More specifically, the skin condition characteristic pattern can be an image of skin texture or/and skin defects.

更具體的說,所述皮膚膚質之圖像係為中性膚質、油性膚質、乾性膚質或/及混合性膚質之圖像。More specifically, the skin type image is an image of normal skin type, oily skin type, dry skin type or/and combination skin type.

更具體的說,所述皮膚缺陷之圖像係為斑點、皺紋、痘痘、痘疤、角化或/及痣之圖像,而該皮膚缺陷之圖像並不限於斑點、皺紋、痘痘、痘疤、角化或/及痣之圖像。More specifically, the image of the skin defect is an image of spots, wrinkles, acne, acne scars, keratosis or/and moles, and the image of the skin defect is not limited to spots, wrinkles, acne , acne scars, keratinization or/and images of moles.

更具體的說,所述目標特徵建立器能夠以深度學習演算法,針對不同皮膚狀態特徵圖像進行目標分類,用以建立出多組臉部特徵模型數據。More specifically, the target feature builder can use a deep learning algorithm to classify targets for different skin state feature images, so as to create multiple sets of facial feature model data.

更具體的說,所述美膚檢測設備能夠依據多組臉部特徵模型數據,進行判斷該被檢者臉部上某一個或某多個座標上的皮膚狀態特徵圖樣之類別。More specifically, the skin beautifying detection device can determine the type of the skin condition feature pattern on one or more coordinates on the subject's face according to multiple sets of facial feature model data.

更具體的說,所述能夠以邊緣運算模式,將皮膚狀態檢測與判斷之運算分散部署於該美膚檢測設備及該美膚照射設備上,以由該美膚檢測設備及該美膚照射設備進行自行判斷與檢測出該皮膚狀態特徵圖樣。More specifically, the operation of skin condition detection and judgment can be dispersedly deployed on the skin beauty detection device and the skin beauty irradiation device in an edge computing mode, so that the skin beauty detection device and the skin beauty irradiation device can be Perform self-judgment and detect the characteristic pattern of the skin state.

更具體的說,所述於該美膚照射設備照射後,能夠透過該攝影設備進行拍攝新的人臉彩色影像數據及人臉影像深度數據,並傳送至該遠端伺服設備,以進行更新出一新的3D臉部模型數據,而該美膚檢測設備更能夠比較該被檢者經過照射前後的3D臉部模型數據,並透過該照射數據調整器重新設定出一新的照射參數數據。More specifically, after the skin beautifying irradiation device is irradiated, new face color image data and face image depth data can be captured by the photographing device, and sent to the remote servo device for updating. a new 3D face model data, and the skin beauty detection device can compare the 3D face model data of the subject before and after irradiation, and reset a new irradiation parameter data through the irradiation data adjuster.

更具體的說,所述LED照射本體之LED燈係為一可變光譜LED燈。More specifically, the LED light of the LED illuminating body is a variable spectrum LED light.

更具體的說,所述照射單元上更具有一或多個紅外線接受器,用以輔助判斷該LED燈與該被檢者臉部上的某一個或某多個座標之距離。More specifically, the irradiation unit has one or more infrared receivers to assist in determining the distance between the LED light and one or more coordinates on the subject's face.

更具體的說,所述控制單元能夠透過該位移機構改變該LED燈之照射深度、照射角度或/及照射位置。More specifically, the control unit can change the illumination depth, illumination angle or/and illumination position of the LED lamp through the displacement mechanism.

更具體的說,所述控制單元能夠改變不同LED燈之照射波長或/及照射時間。More specifically, the control unit can change the irradiation wavelength or/and the irradiation time of different LED lamps.

更具體的說,所述每一個照射單元更能夠透過一位移機構改變LED燈位置,該位移機構係能夠為一主動式調整機構或是一被動式調整機構。More specifically, each irradiation unit can change the position of the LED lamp through a displacement mechanism, and the displacement mechanism can be an active adjustment mechanism or a passive adjustment mechanism.

一種美膚檢測方法,係包含: (1)     於一遠端伺服設備上,依據多張具有人臉之照片,進行目標分類,用以建立出多組臉部特徵模型數據及照射參考檔; (2)     透過一或多個攝影設備,進行拍攝以取得一被檢者的人臉彩色影像數據及人臉影像深度數據,並透過該遠端伺服設備建立出該被檢者的3D臉部模型數據; (3)     將多組臉部特徵模型數據及該被檢者的3D臉部模型數據傳送給一美膚檢測設備,以由該美膚檢測設備進行比對,並標示出該被檢者臉部上某一個或某多個座標上的皮膚狀態特徵圖樣; (4)     再針對所標示之皮膚狀態特徵圖樣與該照射參考檔,進行設定一照射參數數據,以使一具有多個照射單元之LED照射本體能夠依據該照射參數數據對該被檢者臉部上的某一個或某多個座標進行照射。 A skin beautifying detection method, comprising: (1) On a remote servo device, according to a plurality of photos with faces, target classification is performed to establish multiple sets of facial feature model data and irradiation reference files; (2) Through one or more photographing equipment, take pictures to obtain the color image data and the depth data of the face image of a subject, and create a 3D face model of the subject through the remote servo equipment data; (3) Send multiple sets of facial feature model data and the subject's 3D face model data to a skin beautifying detection device for comparison by the skin beautifying detection device and mark the subject's face a pattern of skin state characteristics on one or more coordinates; (4) Then, according to the marked skin condition characteristic pattern and the irradiation reference file, set an irradiation parameter data, so that an LED irradiation body with a plurality of irradiation units can respond to the subject's face according to the irradiation parameter data. One or more coordinates on the irradiated.

更具體的說,所述皮膚狀態特徵圖樣係能夠為皮膚膚質或/及皮膚缺陷之圖像。More specifically, the skin condition characteristic pattern can be an image of skin texture or/and skin defects.

更具體的說,所述皮膚膚質之圖像係為中性膚質、油性膚質、乾性膚質或/及混合性膚質之圖像。More specifically, the skin type image is an image of normal skin type, oily skin type, dry skin type or/and combination skin type.

更具體的說,所述皮膚缺陷之圖像係為斑點、皺紋、痘痘、痘疤、角化或/及痣之圖像。More specifically, the image of the skin defect is an image of spots, wrinkles, acne, acne scars, keratinization or/and moles.

更具體的說,所述遠端伺服設備能夠以深度學習演算法,針對不同皮膚狀態特徵圖像進行目標分類,用以建立出多組臉部特徵模型數據。More specifically, the remote servo device can use a deep learning algorithm to classify objects according to the characteristic images of different skin states, so as to establish multiple sets of facial feature model data.

更具體的說,所述美膚檢測設備能夠依據多組臉部特徵模型數據,進行判斷該被檢者臉部上某一個或某多個座標上的皮膚狀態特徵圖樣之類別。More specifically, the skin beautifying detection device can determine the type of the skin condition feature pattern on one or more coordinates on the subject's face according to multiple sets of facial feature model data.

更具體的說,所述能夠以邊緣運算模式,將皮膚狀態檢測與判斷之運算分散部署於該美膚檢測設備及該美膚照射設備上,以由該美膚檢測設備及該美膚照射設備進行自行判斷與檢測出該皮膚狀態特徵圖樣。More specifically, the operation of skin condition detection and judgment can be dispersedly deployed on the skin beauty detection device and the skin beauty irradiation device in an edge computing mode, so that the skin beauty detection device and the skin beauty irradiation device can be Perform self-judgment and detect the characteristic pattern of the skin state.

更具體的說,所述於該美膚照射設備照射後,能夠透過該攝影設備進行拍攝新的人臉彩色影像數據及人臉影像深度數據,並傳送至該遠端伺服設備,以進行更新出一新的3D臉部模型數據,而該美膚檢測設備更能夠比較該被檢者經過照射前後的3D臉部模型數據,並透過該照射數據調整器重新設定出一新的照射參數數據。More specifically, after the skin beautifying irradiation device is irradiated, new face color image data and face image depth data can be captured by the photographing device, and sent to the remote servo device for updating. a new 3D face model data, and the skin beauty detection device can compare the 3D face model data of the subject before and after irradiation, and reset a new irradiation parameter data through the irradiation data adjuster.

更具體的說,所述能夠改變該LED燈之照射深度、照射角度、照射位置、照射波長或/及照射時間。More specifically, the irradiation depth, irradiation angle, irradiation position, irradiation wavelength or/and irradiation time of the LED lamp can be changed.

有關於本發明其他技術內容、特點與功效,在以下配合參考圖式之較佳實施例的詳細說明中,將可清楚的呈現。Other technical contents, features and effects of the present invention will be clearly presented in the following detailed description of the preferred embodiments with reference to the drawings.

請參閱1、2、3A~3C圖,為本發明美膚檢測系統及其方法之整體架構示意圖、遠端伺服設備之架構示意圖、美膚照射設備之架構示意圖、照射單元之架構示意圖、照射單元之簡易結構示意圖,由圖中可知,該美膚檢測系統係至少包含有遠端伺服設備1、攝影設備2、美膚檢測設備3及美膚照射設備4。Please refer to Figures 1, 2, 3A~3C, which are the schematic diagram of the overall structure of the skin beautifying detection system and the method thereof, the schematic diagram of the structure of the remote servo device, the schematic diagram of the structure of the skin beautifying irradiation equipment, the schematic diagram of the structure of the irradiation unit, and the schematic diagram of the irradiation unit of the present invention. Schematic diagram of a simple structure, it can be seen from the figure that the skin beautifying detection system at least includes a remote servo device 1 , a photographing device 2 , a skin beautifying detection device 3 and a skin beautifying irradiation device 4 .

該遠端伺服設備1係至少包含有至少一個處理器及至少一個電腦可讀取記錄媒體,該電腦可讀取記錄媒體更進一步儲存有電腦可讀取指令及多個應用單元,當由該等處理器執行該等電腦可讀取指令時,能夠進行執行該應用單元,而該應用單元係包含: (1)     一目標特徵建立器11,係依據多張具有人臉之照片,針對不同皮膚狀態特徵圖像進行目標分類,再以深度學習演算法(例如Object Detection)建立出多組臉部特徵模型數據(其中該皮膚狀態特徵圖樣係能夠為皮膚膚質或/及皮膚缺陷之圖像,該皮膚膚質之圖像係為中性膚質、油性膚質、乾性膚質或/及混合性膚質之圖像,而該皮膚缺陷之圖像係為斑點、皺紋、痘痘、痘疤、角化或/及痣之圖像,其中皮膚缺陷之圖像並不限於斑點、皺紋、痘痘、痘疤、角化或/及痣之圖像); (2)     一照射參數儲存器12,係依據不同皮膚狀態特徵圖樣,進行儲存多組的照射參考檔,該照射參考檔能夠人為建立之外,更能夠將既有不同顏色、範圍之皮膚狀態特徵圖樣與對應治療照射參數,透過深度學習進行訓練出一照射參考模型,用以藉由該照射參考模型,對於不同皮膚狀態,能夠提供不同的光療的照射調整參數,例如若是要治療老人斑,依據其老人斑的顏色深度或/及範圍,進行調整照射深度(LED照射頭與病徵處距離)、照射波長、照射時間、照射角度、照射範圍; (3)     一3D模型建立器13,用以依據一被檢者的人臉彩色影像數據及人臉影像深度數據,進行建立出該被檢者的3D臉部模型數據。 The remote servo device 1 at least includes at least one processor and at least one computer-readable recording medium. The computer-readable recording medium further stores computer-readable instructions and a plurality of application units. When the processor executes the computer-readable instructions, it is capable of executing the application unit, and the application unit includes: (1) A target feature generator 11, which is based on a plurality of photos with human faces, classifying targets according to different skin state feature images, and then using a deep learning algorithm (such as Object Detection) to establish multiple sets of facial feature models Data (wherein the skin condition characteristic pattern can be an image of skin skin type or/and skin defects, and the skin type image is normal skin type, oily skin type, dry skin type or/and combination skin type and the image of the skin defect is an image of spots, wrinkles, acne, acne scars, keratosis or/and moles, wherein the image of skin defects is not limited to spots, wrinkles, acne, images of acne scars, keratinization or/and moles); (2) An irradiation parameter storage 12, which stores multiple sets of irradiation reference files according to different skin condition characteristic patterns. The irradiation reference files can be created manually, and can also store existing skin condition characteristics of different colors and ranges. The pattern and the corresponding treatment irradiation parameters are trained through deep learning to create an irradiation reference model, which can provide different irradiation adjustment parameters for different skin conditions. For example, if you want to treat age spots, according to According to the color depth and/or range of age spots, adjust the irradiation depth (the distance between the LED irradiation head and the symptom), irradiation wavelength, irradiation time, irradiation angle, and irradiation range; (3) A 3D model generator 13 for creating 3D face model data of a subject according to the color image data of the subject's face and the depth data of the face image.

於其中一種實施樣態中,攝影設備2、美膚檢測設備3及美膚照射設備4能夠同時設置於一醫療機構內(但亦也能分別設置於不同位置處),而該遠端伺服設備1則是同時多個不同的醫療機構內的攝影設備2、美膚檢測設備3及美膚照射設備4進行連線;In one embodiment, the photographing device 2 , the skin beautifying detection device 3 and the skin beautifying irradiation device 4 can be installed in a medical institution at the same time (but can also be installed at different positions respectively), and the remote servo device 1 is to connect the photographing equipment 2, the skin-beautifying detection equipment 3 and the skin-beautifying irradiation equipment 4 in multiple different medical institutions at the same time;

然而若是同時多個美膚檢測設備3及美膚照射設備4皆與遠端伺服設備1提出要求要遠端伺服設備1進行膚質檢測與判斷時,輕則造成反應緩慢,重則導致系統崩潰,故為了避免因網絡狀況與要求裝置數量而受到影響,本案以邊緣運算模式,將模型訓練於遠端伺服設備1進行。然後皮膚狀態檢測與判斷時,則將模型分散部署於邊緣端(例如不同的醫療機構內的美膚檢測設備3及美膚照射設備4),讓裝置可以自行判斷與檢測標的物與進行照射治療,以極大化地增加裝置可用性;However, if multiple skin beautifying detection devices 3 and skin beautifying irradiation devices 4 all request the remote servo device 1 to perform skin quality detection and judgment with the remote servo device 1 at the same time, the response may be slow at light, and the system may crash at worst. Therefore, in order to avoid being affected by the network conditions and the number of required devices, the model is trained on the remote server equipment 1 in the edge computing mode in this case. Then, when the skin condition is detected and judged, the models are distributed at the edge (for example, the skin beauty detection equipment 3 and the skin beauty irradiation equipment 4 in different medical institutions), so that the device can judge and detect the target object and perform irradiation treatment by itself. , to maximize device availability;

上述邊緣運算模式,是一種分散式運算架構,可讓企業應用程式更接近 IoT 裝置或本端邊緣伺服器等資料來源。 接近資料來源可帶來強大的商業效益: 加速洞察、改善回應時間,以及提供更高的頻寬可用性。The above edge computing model is a distributed computing architecture that allows enterprise applications to be closer to data sources such as IoT devices or local edge servers. Proximity to the data source delivers powerful business benefits: accelerated insights, improved response times, and higher bandwidth availability.

而該攝影設備2係能夠以RGB鏡頭來拍攝彩色影像數據,並以紅外線鏡頭來拍攝人臉影像深度數據(於其中一實施例中,是以紅外線發射器和紅外線CMOS攝影機所構成的3D深度感應器用來擷取深度數據),並於拍攝完成後,能夠透過攝影設備2本身上傳至該遠端伺服設備1,亦或能夠將拍攝被檢者的人臉彩色影像數據及人臉影像深度數據取出,並由其他可與該遠端伺服設備1連線之電子裝置(例如桌上型電腦、筆記型電腦、智慧型手機或是平板電腦)上傳至該遠端伺服設備1。The photographing device 2 is capable of capturing color image data with an RGB lens, and capturing depth data of a face image with an infrared lens (in one embodiment, a 3D depth sensor composed of an infrared transmitter and an infrared CMOS camera is used) The camera is used to capture depth data), and after the shooting is completed, it can be uploaded to the remote servo device 1 through the photographing device 2 itself, or the color image data of the subject’s face and the depth data of the face image can be taken out. , and uploaded to the remote server device 1 by other electronic devices (such as a desktop computer, a notebook computer, a smart phone or a tablet computer) that can be connected to the remote server device 1 .

而該美膚檢測設備3係至少包含有至少一個處理器及至少一個電腦可讀取記錄媒體,該電腦可讀取記錄媒體更進一步儲存有電腦可讀取指令及多個檢測應用單元,當由該等處理器執行該等電腦可讀取指令時,能夠進行執行該檢測應用單元,而該檢測應用單元能夠接收多組臉部特徵模型數據及該被檢者的3D臉部模型數據,並透過多組臉部特徵模型數據,於被檢者的3D臉部模型數據上進行判斷是否具有皮膚狀態特徵圖樣,並將其位置與類別(類別是包含了皮膚狀態特徵的種類與嚴重程度(顏色深度或/及範圍))標示出來。The skin beautifying detection device 3 at least includes at least one processor and at least one computer-readable recording medium. The computer-readable recording medium further stores computer-readable instructions and a plurality of detection application units. When the processors execute the computer-readable instructions, they can execute the detection application unit, and the detection application unit can receive a plurality of sets of facial feature model data and the 3D facial model data of the subject, and pass Multiple sets of facial feature model data are used to determine whether there is a skin condition characteristic pattern on the subject's 3D face model data, and its position and category (category is the type and severity (color depth) of the skin condition characteristics. or/and range)) are marked.

而該美膚照射設備4係包含: (1)     一照射數據調整器41,取得遠端伺服設備1所建立之照射參考檔,並將所標示皮膚狀態特徵圖樣之位置及類別,依據多組的照射參考檔,進行設定一照射參數數據; (2)     一LED照射本體42,係具有: (a)      多個照射單元421,每一個照射單元421係至少包含有: (a1) 一個或多個LED燈4211,係為一可變光譜LED燈,能夠發出以下幾種波長的光(本案之照射單元421能夠使用特殊波長的發光本體包括LED但不限制使用LED): (a11) 紅光(622~780nm),紅色是最具穿透力的顏色。紅光對組織的穿透率比其它波長的色光都還要來得強,紅光可以刺激膠原蛋白增生,活化纖維母細胞,促進血液循環,抗發炎,加速傷口癒合等。 (a12) 橙光(位於紅光與黃光之間),可防止皮膚乾燥、增加皮膚彈性、舒展皺紋和妊娠紋、延緩皮膚老化等功效。 (a13) 黃光(575~600nm),有效修復皮膚紅印,紅斑,緩解紅腫,色素紅腫等效果,可以促進黑色素代謝,提亮膚色,舒緩敏感肌膚,提升肌膚對保養品的吸收力,促進皮膚再生。 (a14) 綠光(位於黃光與藍光之間),綠光是大自然中最普遍的顏色,被視為中性的顏色。具有平衡和安定的作用,能夠改善因疲勞、精神緊張引起的皮膚粗糙、皺紋、黑頭、粉刺及暗瘡。 (a15) 藍光(475~500nm),藍光是平靜的顏色,被視為冷色。藍光可以抑制油脂分泌,消炎殺菌,消滅痤瘡桿菌,治療青春痘、疤痕,抑制挫傷桿菌生長,減少皮膚皮脂腺的分泌,改善粉刺及青春痘的問題。 (a16) 紫外光(100~400nm),係包含: 1.         UVA波段,波長320~400nm,又稱為長波黑斑效應紫外線 。它有很強的穿透力,可以穿透大部分透明的玻璃以及塑膠。UVA可以直達 肌膚的真皮層,破壞彈性纖維和膠原蛋白纖維,將我們的皮膚曬黑。 2.         UVB波段,波長275~320nm,又稱為中波紅斑效應紫外線 。中等穿透力,在夏天和午後會特別強烈。UVB紫外線對人體具有紅斑作用,能促進體內礦物質代謝和維生素D的形成,但長期或過量照射會令皮膚曬黑,並引起紅腫脫皮。 3.         UVC波段,波長200~275nm,又稱為短波滅菌紫外線。它的穿透能力最弱,無法穿透大部分的透明玻璃及塑膠。短波紫外線對人體的傷害很大,短時間照射即可灼傷皮膚,長期或高強度照射還會造成皮膚癌。紫外線殺菌燈發出的就是UVC短波紫外線。 4.         UVD波段,波長100~200nm,又稱為真空紫外線。 (a2) 一能夠改變該LED燈4211位置之位移機構4212,其內部更連接有馬達或是類似驅動機構,用以能夠驅動該位移機構4212,以控制LED燈之進行前、後、左、右或/及傾斜位移、位移幅度、位移角度,以透過LED燈4211進行特定部位、特定深度,小角度照射、特定波長進行治療。 (a3) 一紅外線接收器4213,該紅外線接收器4213用以輔助判斷該LED燈4211與該被檢者臉部上的某一個或某多個座標之距離; (b)     一與該照射數據調整器41相連接之控制單元422,其中該控制單元422能夠依據該照射參數數據進行控制不同LED燈對該被檢者臉部上的某一個或某多個座標進行照射。 And the 4 series of skin beauty irradiation equipment includes: (1) An irradiation data adjuster 41, obtains the irradiation reference file established by the remote servo device 1, and sets the position and type of the marked skin condition characteristic pattern according to multiple sets of irradiation reference files to set an irradiation parameter data ; (2) An LED illuminates the body 42, which has: (a) a plurality of irradiation units 421, each irradiation unit 421 at least includes: (a1) One or more LED lights 4211, which are variable spectrum LED lights, which can emit light of the following wavelengths (the illumination unit 421 in this case can use light-emitting bodies with special wavelengths including LEDs but is not limited to use LEDs): (a11) Red light (622~780nm), red is the most penetrating color. The penetration rate of red light to tissues is stronger than that of other wavelengths of color light. Red light can stimulate collagen proliferation, activate fibroblasts, promote blood circulation, resist inflammation, and accelerate wound healing. (a12) Orange light (between red light and yellow light), can prevent skin dryness, increase skin elasticity, stretch wrinkles and stretch marks, delay skin aging, etc. (a13) Yellow light (575~600nm), can effectively repair skin red marks, erythema, relieve redness, redness and swelling of pigment, etc., can promote melanin metabolism, brighten skin tone, soothe sensitive skin, improve skin’s absorption of skin care products, promote Skin regeneration. (a14) Green light (between yellow and blue light), green light is the most common color in nature and is considered a neutral color. It has a balancing and stabilizing effect and can improve rough skin, wrinkles, blackheads, acne and acne caused by fatigue and mental stress. (a15) Blue light (475~500nm), blue light is a calm color and is regarded as a cool color. Blue light can inhibit oil secretion, anti-inflammatory and sterilization, eliminate acne bacillus, treat acne, scars, inhibit the growth of contusion bacillus, reduce the secretion of skin sebaceous glands, and improve acne and acne problems. (a16) Ultraviolet light (100~400nm), including: 1. UVA band, wavelength 320~400nm, also known as long-wave dark spot effect ultraviolet. It has strong penetrating power and can penetrate most transparent glass and plastic. UVA can reach the dermis layer of the skin, destroy elastic fibers and collagen fibers, and tan our skin. 2. UVB band, wavelength 275~320nm, also known as medium wave erythema effect ultraviolet. Medium penetrating power, especially strong in summer and afternoon. UVB ultraviolet rays have an erythematous effect on the human body, which can promote the metabolism of minerals and the formation of vitamin D in the body, but long-term or excessive exposure will tan the skin and cause redness and peeling. 3. UVC band, wavelength 200~275nm, also known as short-wave sterilization ultraviolet. It has the weakest penetrating ability and cannot penetrate most transparent glass and plastics. Short-wave ultraviolet rays are very harmful to the human body. Short-term exposure can burn the skin. Long-term or high-intensity exposure can also cause skin cancer. Ultraviolet germicidal lamps emit UVC short-wave ultraviolet rays. 4. UVD band, wavelength 100~200nm, also known as vacuum ultraviolet. (a2) A displacement mechanism 4212 capable of changing the position of the LED light 4211, and a motor or a similar driving mechanism is further connected inside to drive the displacement mechanism 4212 to control the forward, backward, left and right of the LED light Or/and tilt displacement, displacement amplitude, and displacement angle to conduct treatment at specific parts, specific depths, small-angle irradiation, and specific wavelengths through the LED light 4211. (a3) an infrared receiver 4213, the infrared receiver 4213 is used to assist in determining the distance between the LED light 4211 and one or more coordinates on the subject's face; (b) A control unit 422 connected to the irradiation data adjuster 41, wherein the control unit 422 can control one or more coordinates of different LED lights on the subject's face according to the irradiation parameter data Irradiate.

另外LED照射本體42上係具有多個照射單元421,該LED照射本體42係能夠由多根LED來組成矩形陣列(例如20 * 20 = 400根,每一根可獨立控制向前距離、向後距離、向左距離、向右距離、傾斜位移、位移幅度或/及位移角度),而每一根照射單元421如第3C圖所示,於每一個照射單元421之正面上具有LED燈4211及紅外線接收器4213。In addition, the LED illumination body 42 is provided with a plurality of illumination units 421, and the LED illumination body 42 can be composed of a plurality of LEDs to form a rectangular array (for example, 20*20=400 pieces, each of which can independently control the forward distance and the backward distance. , distance to the left, distance to the right, tilt displacement, displacement amplitude or/and displacement angle), and each illumination unit 421 as shown in FIG. 3C has LED lights 4211 and infrared rays on the front of each illumination unit 421 Receiver 4213.

而該照射單元421之LED燈4211能夠依據該被檢者的3D臉部模型數據進行調整前後深度,如第4圖所示,用以使每一個照射單元421與被檢者臉部都能保持相同距離,除此之外,為了因應不同的皮膚狀態特徵的位置、顏色深度或/及範圍,則能夠改變該LED燈之照射深度、照射角度照射位置或/及照射範圍,也能夠透過該控制單元422直接改變不同LED燈4211之照射波長、照射亮度或/及照射時間,以加強對某一個或某幾個座標位置上的皮膚進行照射治療。The LED lights 4211 of the irradiation unit 421 can adjust the front and rear depths according to the 3D face model data of the subject, as shown in FIG. 4 , so that each irradiation unit 421 and the subject's face can remain The same distance, in addition, in order to respond to the position, color depth or/and range of different skin condition characteristics, the illumination depth, illumination angle illumination position or/and illumination range of the LED light can be changed, and can also be controlled through the control The unit 422 directly changes the irradiation wavelength, irradiation brightness or/and irradiation time of different LED lamps 4211, so as to strengthen the irradiation treatment of the skin on one or several coordinate positions.

而該位移機構4212能夠是主動式機構或是被動式機構,若是主動式機構,則能夠透過該由該控制單元422透過該位移機構4212改變該LED燈之照射深度、照射角度照射位置或/及照射範圍,以因應不同的皮膚狀態特徵的位置、顏色深度或/及範圍;The displacement mechanism 4212 can be an active mechanism or a passive mechanism. If it is an active mechanism, the control unit 422 can change the irradiation depth, irradiation angle, irradiation position or/and irradiation of the LED light through the displacement mechanism 4212. range to account for the location, colour depth or/and extent of features of different skin conditions;

然而若是被動式機構,雖然無法由該控制單元422控制該位移機構4212進行位移或改變方向,但由於每個LED燈(管)具有較高之摩擦係數,故只要將多個LED燈4211組成之LED矩陣碰觸人臉後,被動式機構會被動伸縮,故自然可得到臉的模型,而該控制單元422則能夠依據被檢者的3D臉部模型數據,將對應每一個被動式機構位置的LED燈進行控制照射。 However, if it is a passive mechanism, although the control unit 422 cannot control the displacement mechanism 4212 to displace or change the direction, since each LED lamp (tube) has a high friction coefficient, it is only necessary to combine a plurality of LED lamps 4211 to form an LED. After the matrix touches the face, the passive mechanism will passively expand and contract, so the face model can be obtained naturally, and the control unit 422 can control the LED light corresponding to each passive mechanism position according to the 3D face model data of the subject. Control exposure.

而以下提供實施例說明:(1)當被檢者5的3D臉部模型數據建立出來之後,能夠進行判斷是否具有皮膚狀態特徵圖樣,並將其位置與類別(類別是包含了皮膚狀態特徵的種類與嚴重程度(顏色深度或/及範圍))標示出來;(2)如第5圖所示,於座標A1,A2,A3,A4的範圍內判斷有濕疹51的情況之後,針對濕疹51的情況,判斷並提供一第一照射參數數據(應離皮膚2公分處,照射波長為365nm,照射時間為10秒鐘);(3)如第5圖所示,於座標B1,B2,B3,B4的範圍內判斷有老人斑52的情況之後,針對老人斑52的情況,判斷並提供一第二照射參數數據(於離皮膚1公分處,照射波長為280nm,照射時間為5秒);(4)之後,對應該位置之照射單元421(Led柱體)能夠根據臉部建模(被檢者的3D臉部模型數據)之深度資料與紅外線測距之輔助,將多個對應位置之照射單元421(對應於座標A1,A2,A3,A4及座標B1,B2,B3,B4的照射單元421),往前延伸至對應位置,並發出對應波長與時間之光線進行治療。 The following provides an example description: (1) After the 3D face model data of the subject 5 is established, it can be judged whether there is a skin condition feature pattern, and its position and category (the category includes the skin condition feature) can be determined. Type and severity (color depth or/and range)) are indicated; (2) As shown in Figure 5, after judging the presence of eczema 51 within the range of coordinates A1, A2, A3, and A4, for eczema 51, judge and provide a first irradiation parameter data (should be 2 cm away from the skin, the irradiation wavelength is 365 nm, and the irradiation time is 10 seconds); (3) As shown in Figure 5, at coordinates B1, B2, After judging the presence of age spots 52 within the range of B3 and B4, according to the age spots 52, determine and provide a second irradiation parameter data (at 1 cm from the skin, the irradiation wavelength is 280 nm, and the irradiation time is 5 seconds) (4) After that, the irradiation unit 421 (Led cylinder) corresponding to the position can be based on the depth data of the face modeling (the 3D face model data of the subject) and the aid of infrared ranging, and a plurality of corresponding positions The irradiation unit 421 (corresponding to the irradiation unit 421 of the coordinates A1, A2, A3, A4 and the coordinates B1, B2, B3, and B4) extends forward to the corresponding position, and emits light of the corresponding wavelength and time for treatment.

而當美膚照射設備4照射後,能夠透過該攝影設備2再次進行拍攝新的人臉彩色影像數據及人臉影像深度數據,並傳送至該遠端伺服設備1,以進行更新出一新的3D臉部模型數據,而該美膚檢測設備3更能夠比較該被檢者經過 照射前後的3D臉部模型數據,並透過該照射數據調整器重新設定出一新的照射參數數據(例如某甲有濕疹,需要透過照射波長350~390nm的紫外線進行治療,然而並非治療一次就可痊癒,在每次照射後,會重新拍攝照片紀錄並分析濕疹程度,並與之前資料作為比較,作為下次治療時治療方案的參考與制定)。 After the skin beautifying irradiation device 4 is irradiated, new face color image data and face image depth data can be captured again through the photographing device 2, and sent to the remote servo device 1 for updating a new one. 3D face model data, and the skin beauty detection device 3 can compare the The 3D face model data before and after irradiation, and the irradiation data adjuster is used to reset a new irradiation parameter data (for example, if a nail has eczema, it needs to be treated by irradiating ultraviolet rays with a wavelength of 350~390nm, but it is not a one-time treatment. It can be cured. After each irradiation, photos will be taken to record and analyze the degree of eczema, and compared with the previous data as the reference and formulation of the treatment plan for the next treatment).

如第6圖所示,本案之美膚檢測方法,係包含:(1)601於一遠端伺服設備上,依據多張具有人臉之照片,進行目標分類,用以建立出多組臉部特徵模型數據及照射參考檔;(2)602透過一或多個攝影設備,進行拍攝以取得一被檢者的人臉彩色影像數據及人臉影像深度數據,並透過該遠端伺服設備建立出該被檢者的3D臉部模型數據;(3)603將多組臉部特徵模型數據及該被檢者的3D臉部模型數據傳送給一美膚檢測設備,以由該美膚檢測設備進行比對,並標示出該被檢者臉部上某一個或某多個座標上的皮膚狀態特徵圖樣;(4)604再針對所標示之皮膚狀態特徵圖樣與該照射參考檔,進行設定一照射參數數據,以使一具有多個照射單元之LED照射本體能夠依據該照射參數數據對該被檢者臉部上的某一個或某多個座標進行照射。 As shown in Fig. 6, the skin beautifying detection method of this case includes: (1) 601 On a remote servo device, classifying objects according to a plurality of photos with human faces, so as to create a plurality of sets of facial features model data and irradiation reference file; (2) 602, through one or more photographing equipment, take pictures to obtain the color image data and depth data of the face image of a subject, and create the image data through the remote servo equipment 3D face model data of the subject; (3) 603 transmits multiple sets of facial feature model data and the subject's 3D face model data to a skin beautifying detection device for comparison by the skin beautifying detection device; Yes, and mark the skin condition characteristic pattern on one or more coordinates on the subject's face; (4) 604 and then set an irradiation parameter according to the marked skin condition characteristic pattern and the irradiation reference file data, so that an LED irradiating body with a plurality of irradiating units can irradiate one or a plurality of coordinates on the subject's face according to the irradiation parameter data.

本發明所提供之美膚檢測系統及其方法,與其他習用技術相互比較時,其優點如下: The skin beautifying detection system and method thereof provided by the present invention, when compared with other conventional techniques, have the following advantages:

1.本發明提供一套系統及其方法,能夠透過深度學習進行訓練出多組臉部特徵模型數據,並再透過被檢者的人臉彩色影像數據及人臉影像深度數據建立出被檢者的3D臉部模型數據,更由於為了於進行膚質檢測與判斷時,其反應速度不至於因為網絡狀況與要求裝置數量而受到影響,故將模型分散部署於邊緣端(裝置端),讓裝置可以自行判斷、檢測標的物與進行照射治療,如此將能夠極大化地增加裝置可用性。 2.         本案能夠透過不斷蒐集數據與治療反應,在去除可識別資料後,進行數據整合與分析,發現某些病症的好發年紀與個人生活背景,供作為未來病患發病風險預測。 3.         透過本案之系統及其方法,在每一次診療的過程中透過3D相機加上使用邊緣運算,使初期在雲端所建立屬於個人膚質檢測的模型和治療的手法可以達到動態式優化(Dynamic Optimization)之目的 。 1. The present invention provides a system and a method thereof, which can train multiple sets of facial feature model data through deep learning, and then establish the subject through the color image data of the subject's face and the depth data of the face image. 3D facial model data, and because the response speed will not be affected by network conditions and the number of required devices when performing skin quality detection and judgment, the models are distributed on the edge (device side), so that the device It can judge, detect the target and carry out radiation therapy by itself, which will greatly increase the usability of the device. 2. In this case, by continuously collecting data and treatment response, after removing identifiable data, data integration and analysis can be carried out to find out the predisposing age and personal life background of certain diseases, which can be used as a risk prediction for future patients. 3. Through the system and method of this case, the 3D camera and the use of edge computing are used in each diagnosis and treatment process, so that the initial cloud-based model for personal skin quality detection and treatment methods can achieve dynamic optimization (Dynamic optimization). Optimization) purpose.

本發明已透過上述之實施例揭露如上,然其並非用以限定本發明,任何熟悉此一技術領域具有通常知識者,在瞭解本發明前述的技術特徵及實施例,並在不脫離本發明之精神和範圍內,當可作些許之更動與潤飾,因此本發明之專利保護範圍須視本說明書所附之請求項所界定者為準。The present invention has been disclosed above through the above-mentioned embodiments, but it is not intended to limit the present invention. Anyone familiar with this technical field with ordinary knowledge can understand the aforementioned technical features and embodiments of the present invention without departing from the present invention. Within the spirit and scope, some changes and modifications can be made, so the scope of patent protection of the present invention shall be determined by the claims attached to this specification.

1:遠端伺服設備 11:目標特徵建立器 12:照射參數儲存器 13:3D模型建立器 2:攝影設備 3:美膚檢測設備 4:美膚照射設備 41:照射數據調整器 42:LED照射本體 421:照射單元 4211:LED燈 4212:位移機構 4213:紅外線接收器 422:控制單元 5:被檢者 51:濕疹 52:老人斑 A1:座標 A2:座標 A3:座標 A4:座標 B1:座標 B2:座標 B3:座標 B4:座標 1: Remote Servo Device 11: Target Feature Builder 12: Irradiation parameter storage 13: 3D Model Builder 2: Photography equipment 3: Skin beauty testing equipment 4: Skin beauty irradiation equipment 41: Irradiation data adjuster 42: LED illumination body 421: Irradiation unit 4211: LED light 4212: Displacement mechanism 4213: Infrared Receiver 422: Control Unit 5: The subject 51: Eczema 52: Age spots A1: Coordinates A2: Coordinates A3: Coordinates A4: Coordinates B1: Coordinates B2: Coordinates B3: Coordinates B4: Coordinates

[第1圖] 係本發明美膚檢測系統及其方法之整體架構示意圖。 [第2圖] 係本發明美膚檢測系統及其方法之遠端伺服設備之架構示意圖。 [第3A圖] 係本發明美膚檢測系統及其方法之美膚照射設備之架構示意圖。 [第3B圖] 係本發明美膚檢測系統及其方法之照射單元之架構示意圖。 [第3C圖] 係本發明美膚檢測系統及其方法之照射單元之簡易結構示意圖。 [第4圖] 係本發明美膚檢測系統及其方法之多個照射單元之矩形陣列佈設示意圖。 [第5圖] 係本發明美膚檢測系統及其方法之臉部建模及皮膚狀態特徵標示之實施示意圖。 [第6圖] 係本發明美膚檢測系統及其方法之流程示意圖。 [Fig. 1] is a schematic diagram of the overall structure of the skin beautifying detection system and the method thereof of the present invention. [Fig. 2] is a schematic diagram of the structure of the remote servo device of the skin beautifying detection system and the method thereof of the present invention. [Fig. 3A] is a schematic diagram of the structure of the skin beautifying irradiation equipment of the skin beautifying detection system and the method thereof of the present invention. [FIG. 3B] is a schematic diagram of the structure of the irradiation unit of the skin beautifying detection system and the method thereof of the present invention. [FIG. 3C] It is a simple structural schematic diagram of the irradiation unit of the skin beautifying detection system and the method thereof of the present invention. [FIG. 4] It is a schematic diagram of the rectangular array layout of a plurality of irradiation units of the skin beautifying detection system and the method thereof of the present invention. [Fig. 5] It is a schematic diagram of the implementation of face modeling and skin condition feature marking of the skin beautifying detection system and method of the present invention. [Fig. 6] is a schematic flow chart of the skin beautifying detection system and the method thereof of the present invention.

1:遠端伺服設備 1: Remote Servo Device

2:攝影設備 2: Photography equipment

3:美膚檢測設備 3: Skin beauty testing equipment

4:美膚照射設備 4: Skin beauty irradiation equipment

Claims (18)

一種美膚檢測系統,係包含: 一遠端伺服設備,係包含有: 一目標特徵建立器,係依據多張具有人臉之照片,針對不同皮膚狀態特徵圖像進行目標分類,用以建立出多組臉部特徵模型數據; 一照射參數儲存器,係依據不同皮膚狀態特徵圖樣,進行儲存多組的照射參考檔; 一3D模型建立器,用以依據一被檢者的人臉彩色影像數據及人臉影像深度數據,進行建立出該被檢者的3D臉部模型數據; 一或多個攝影設備,用以進行拍攝,以取得該被檢者的人臉彩色影像數據及人臉影像深度數據,並傳送至該遠端伺服設備; 一或多個美膚檢測設備,係與該遠端伺服設備進行連線,用以接收多組臉部特徵模型數據及該被檢者的3D臉部模型數據,並進行比對,以標示出該被檢者臉部上某一個或某多個座標上的皮膚狀態特徵圖樣; 一或多個美膚照射設備,係與該遠端伺服設備及該美膚檢測設備進行連線,而該美膚照射設備係包含: 一照射數據調整器,係用以依據多組的照射參考檔,針對該被檢者臉部上某一個或某多個座標上的皮膚狀態特徵圖樣,進行設定一照射參數數據;以及 一LED照射本體,係具有多個照射單元及一與該照射數據調整器相連接之控制單元,每一個照射單元係至少包含有一LED燈,其中該控制單元能夠依據該照射參數數據進行控制不同LED燈對該被檢者臉部上的某一個或某多個座標進行照射。 A skin beautifying detection system, comprising: A remote servo device, including: A target feature builder, which is based on a plurality of photos with human faces, and performs target classification for different skin state feature images, so as to establish a plurality of sets of facial feature model data; an irradiation parameter storage, which stores multiple sets of irradiation reference files according to the characteristic patterns of different skin conditions; a 3D model builder for creating 3D face model data of a subject according to the color image data of the subject's face and the depth data of the face image; one or more photographing equipment for photographing to obtain color image data and depth data of the subject's face image, and transmit them to the remote servo equipment; One or more skin beautifying detection devices are connected to the remote servo device for receiving multiple sets of facial feature model data and the subject's 3D facial model data, and comparing them to indicate The characteristic pattern of the skin condition on one or more coordinates of the subject's face; One or more skin beautifying irradiation devices are connected with the remote servo device and the skin beautifying detection device, and the skin beautifying irradiation device includes: an irradiation data adjuster for setting an irradiation parameter data according to a plurality of sets of irradiation reference files for a skin condition characteristic pattern on one or more coordinates of the subject's face; and An LED illuminating body has a plurality of illuminating units and a control unit connected with the illuminating data regulator, each illuminating unit at least includes an LED light, wherein the control unit can control different LEDs according to the illuminating parameter data The lamp illuminates one or a plurality of coordinates on the subject's face. 如請求項1所述之美膚檢測系統,其中該皮膚狀態特徵圖樣係能夠為皮膚膚質或/及皮膚缺陷之圖像。The skin beautifying detection system according to claim 1, wherein the skin condition characteristic pattern can be an image of skin texture or/and skin defects. 如請求項2所述之美膚檢測系統,其中該皮膚膚質之圖像係為中性膚質、油性膚質、乾性膚質或/及混合性膚質之圖像。The skin beautifying detection system according to claim 2, wherein the image of the skin type is an image of normal skin type, oily skin type, dry skin type or/and combination skin type. 如請求項2所述之美膚檢測系統,其中該皮膚缺陷之圖像係為斑點、皺紋、痘痘、痘疤、角化或/及痣之圖像。The skin beauty detection system according to claim 2, wherein the image of the skin defect is an image of spots, wrinkles, acne, acne scars, keratinization or/and moles. 如請求項1所述之美膚檢測系統,其中該目標特徵建立器能夠以深度學習演算法,針對不同皮膚狀態特徵圖像進行目標分類,用以建立出多組臉部特徵模型數據。The skin beautifying detection system according to claim 1, wherein the target feature builder can use a deep learning algorithm to classify targets according to different skin state feature images, so as to create multiple sets of facial feature model data. 如請求項1所述之美膚檢測系統,其中該美膚檢測設備能夠依據多組臉部特徵模型數據,進行判斷該被檢者臉部上某一個或某多個座標上的皮膚狀態特徵圖樣之類別。The skin beautifying detection system according to claim 1, wherein the skin beautifying detection device is capable of judging the skin condition feature patterns on one or more coordinates of the subject's face according to multiple sets of facial feature model data. category. 如請求項1所述之美膚檢測系統,其中能夠以邊緣運算模式,將皮膚狀態檢測與判斷之運算分散部署於該美膚檢測設備及該美膚照射設備上,以由該美膚檢測設備及該美膚照射設備進行自行判斷與檢測出該皮膚狀態特徵圖樣。The skin beautifying detection system according to claim 1, wherein the operations of skin condition detection and judgment can be dispersedly deployed on the skin beautifying detection device and the skin beautifying irradiation device in an edge operation mode, so that the skin beautifying detection device and the skin beautifying irradiation device The skin-beautifying irradiation device judges and detects the characteristic pattern of the skin state by itself. 如請求項1所述之美膚檢測系統,其中於該美膚照射設備照射後,能夠透過該攝影設備進行拍攝新的人臉彩色影像數據及人臉影像深度數據,並傳送至該遠端伺服設備,以進行更新出一新的3D臉部模型數據,而該美膚檢測設備更能夠比較該被檢者經過照射前後的3D臉部模型數據,並透過該照射數據調整器重新設定出一新的照射參數數據。The skin beautifying detection system according to claim 1, wherein after the skin beautifying irradiation device is irradiated, new face color image data and face image depth data can be captured by the photographing device, and sent to the remote servo device , so as to update a new 3D face model data, and the skin beauty detection device can compare the 3D face model data of the subject before and after irradiation, and reset a new one through the irradiation data adjuster. Irradiation parameter data. 如請求項1所述之美膚檢測系統,其中LED照射本體之LED燈係為一可變光譜LED燈。 The skin beautifying detection system according to claim 1, wherein the LED light for the LED illuminating the body is a variable spectrum LED light. 如請求項1所述之美膚檢測系統,其中該照射單元上更具有一或多個紅外線接受器,用以輔助判斷該LED燈與該被檢者臉部上的某一個或某多個座標之距離。 The skin beautifying detection system according to claim 1, wherein the irradiation unit is further provided with one or more infrared receivers for assisting in judging the relationship between the LED light and one or more coordinates on the subject's face distance. 如請求項1所述之美膚檢測系統,其中該控制單元能夠改變該LED燈之照射深度、照射角度或/及照射位置。 The skin beauty detection system according to claim 1, wherein the control unit can change the irradiation depth, irradiation angle or/and irradiation position of the LED light. 如請求項1所述之美膚檢測系統,其中該控制單元能夠改變不同LED燈之照射波長或/及照射時間。 The skin beauty detection system according to claim 1, wherein the control unit can change the irradiation wavelength or/and irradiation time of different LED lamps. 如請求項1所述之美膚檢測系統,其中該每一個照射單元更能夠透過一位移機構改變LED燈位置,該位移機構係能夠為一主動式調整機構或是一被動式調整機構。 The skin beautifying detection system according to claim 1, wherein each irradiation unit can further change the position of the LED light through a displacement mechanism, and the displacement mechanism can be an active adjustment mechanism or a passive adjustment mechanism. 一種美膚檢測方法,係包含:於一遠端伺服設備上,依據多張具有人臉之照片,進行目標分類,用以建立出多組臉部特徵模型數據;透過一或多個攝影設備,進行拍攝以取得一被檢者的人臉彩色影像數據及人臉影像深度數據,並透過該遠端伺服設備建立出該被檢者的3D臉部模型數據;將多組臉部特徵模型數據及該被檢者的3D臉部模型數據傳送給一美膚檢測設備,以由該美膚檢測設備進行比對,並標示出該被檢者臉部上某一個或某多個座標上的皮膚狀態特徵圖樣。 A skin beautifying detection method, comprising: on a remote servo device, classifying objects according to a plurality of photos with human faces, so as to establish a plurality of sets of facial feature model data; through one or more photographing devices, Shooting to obtain color image data and depth data of a subject's face, and creating 3D face model data of the subject through the remote servo device; combining multiple sets of facial feature model data and The 3D face model data of the subject is sent to a skin beautifying detection device for comparison by the skin beautifying detection device and marking the skin state on one or more coordinates of the subject's face feature pattern. 如請求項14所述之美膚檢測方法,其中該皮膚狀態特徵圖樣係能夠為皮膚膚質或/及皮膚缺陷之圖像。 The skin beautifying detection method according to claim 14, wherein the skin condition characteristic pattern can be an image of skin skin quality or/and skin defects. 如請求項15所述之美膚檢測方法,其中該皮膚膚質之圖像係為 中性膚質、油性膚質、乾性膚質或/及混合性膚質之圖像。 The skin beauty detection method as claimed in claim 15, wherein the image of the skin texture is Image for normal, oily, dry or/and combination skin. 如請求項15所述之美膚檢測方法,其中該皮膚缺陷之圖像係為斑點、皺紋、痘痘、痘疤、角化或/及痣之圖像。 The skin beauty detection method according to claim 15, wherein the image of the skin defect is an image of spots, wrinkles, acne, acne scars, keratinization or/and moles. 如請求項14所述之美膚檢測方法,其中該遠端伺服設備能夠以深度學習演算法,針對不同皮膚狀態特徵圖像進行目標分類,用以建立出多組臉部特徵模型數據。 The skin beautifying detection method according to claim 14, wherein the remote servo device can use a deep learning algorithm to classify objects according to different skin state characteristic images, so as to establish multiple sets of facial characteristic model data.
TW109142323A 2020-12-02 2020-12-02 A skin condition detection system and method thereof TWI775229B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
TW109142323A TWI775229B (en) 2020-12-02 2020-12-02 A skin condition detection system and method thereof
CN202111439239.5A CN114596607A (en) 2020-12-02 2021-11-30 Skin makeup detection system and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW109142323A TWI775229B (en) 2020-12-02 2020-12-02 A skin condition detection system and method thereof

Publications (2)

Publication Number Publication Date
TW202222246A TW202222246A (en) 2022-06-16
TWI775229B true TWI775229B (en) 2022-08-21

Family

ID=81804186

Family Applications (1)

Application Number Title Priority Date Filing Date
TW109142323A TWI775229B (en) 2020-12-02 2020-12-02 A skin condition detection system and method thereof

Country Status (2)

Country Link
CN (1) CN114596607A (en)
TW (1) TWI775229B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011106792A2 (en) * 2010-02-26 2011-09-01 Myskin, Inc. Analytic methods of tissue evaluation
US10016185B2 (en) * 2012-05-21 2018-07-10 Precision Biopsy, Inc. Diagnosis and treatment of tissue
WO2018160963A1 (en) * 2017-03-02 2018-09-07 Spectral Md, Inc. Machine learning systems and techniques for multispectral amputation site analysis
TW201922163A (en) * 2017-08-17 2019-06-16 新加坡商三維醫學影像分析公司 Systems and methods for analyzing cutaneous conditions

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011106792A2 (en) * 2010-02-26 2011-09-01 Myskin, Inc. Analytic methods of tissue evaluation
US10016185B2 (en) * 2012-05-21 2018-07-10 Precision Biopsy, Inc. Diagnosis and treatment of tissue
WO2018160963A1 (en) * 2017-03-02 2018-09-07 Spectral Md, Inc. Machine learning systems and techniques for multispectral amputation site analysis
TW201922163A (en) * 2017-08-17 2019-06-16 新加坡商三維醫學影像分析公司 Systems and methods for analyzing cutaneous conditions

Also Published As

Publication number Publication date
CN114596607A (en) 2022-06-07
TW202222246A (en) 2022-06-16

Similar Documents

Publication Publication Date Title
US11247068B2 (en) System and method for providing light therapy to a user body
JP6893877B2 (en) Reflection Mode Multispectral Time-Resolved Optical Imaging Methods and Devices for Tissue Classification
US20110218428A1 (en) System and Method for Three Dimensional Medical Imaging with Structured Light
JP2018502677A5 (en)
WO2018040842A1 (en) Intelligent nevus flammeus photodynamic therapeutic instrument system
CN105960264B (en) The monitoring based on camera to the vital sign during phototherapy disposition
Qiu et al. Monitoring microcirculation changes in port wine stains during vascular targeted photodynamic therapy by laser speckle imaging
CN103920248B (en) A kind of synchronizable optical power therapentic equipment
WO2018035919A1 (en) Cosmetic method on the basis of led light biological skin care and cosmetic device
CN108355252A (en) A kind of accurate treatment system of nevus flammeus light power
JP2023528678A (en) Systems and methods for determining skin contact for personal care devices
TWI775229B (en) A skin condition detection system and method thereof
Chakravorty et al. Low-cost subcutaneous vein detection system using ARM9 based single board computer
CN106073718A (en) The fluorescence camera of the PpIX concentration distribution of detection by quantitative 5 ALA induction and fluorescent quantitation method
CN109843150A (en) The ultraviolet equipment of assessment skin problem based on smart phone
JP2022554010A (en) skin evaluation
CN218793588U (en) Myopia prevention and control device
US20130331765A1 (en) Treating erythematotelangiectatic rosacea or papulopustular rosacea with narrow-band infrared light radiation and radiation kits therefor
Hu et al. Three-dimensional illumination procedure for photodynamic therapy of dermatology
WO2022245784A1 (en) Skin contouring using photo-responsive materials
Wang et al. Irradiance uniformity optimization for a photodynamic therapy treatment device with 3D scanner
CN209361676U (en) A kind of phototherapy treatment device
Wang et al. Three-dimensional image-guided topical photodynamic therapy system with light dosimetry dynamic planning and monitoring
CN111374489A (en) Intelligent mirror skin measuring method and device
CN105363132A (en) UVB-LED portable automatic tracking psoriasis treatment machine

Legal Events

Date Code Title Description
GD4A Issue of patent certificate for granted invention patent