JP2023524416A - 患者の2dの正面画像から患者の3dの顔情報の決定 - Google Patents

患者の2dの正面画像から患者の3dの顔情報の決定 Download PDF

Info

Publication number
JP2023524416A
JP2023524416A JP2022565568A JP2022565568A JP2023524416A JP 2023524416 A JP2023524416 A JP 2023524416A JP 2022565568 A JP2022565568 A JP 2022565568A JP 2022565568 A JP2022565568 A JP 2022565568A JP 2023524416 A JP2023524416 A JP 2023524416A
Authority
JP
Japan
Prior art keywords
patient
frontal image
determining
facial information
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2022565568A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023524416A5 (https=
Inventor
シャンムガナサン プラヴェーン クマル パンディアン
リチャード アンドリュー ソフランコ
アンソニー ヴィンセント スタータレ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of JP2023524416A publication Critical patent/JP2023524416A/ja
Publication of JP2023524416A5 publication Critical patent/JP2023524416A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/50Depth or shape recovery
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/64Three-dimensional [3D] objects
    • G06V20/647Three-dimensional [3D] objects by matching two-dimensional images to three-dimensional objects
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M16/00Devices for influencing the respiratory system of patients by gas treatment, e.g. ventilators; Tracheal tubes
    • A61M16/06Respiratory or anaesthetic masks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0464Convolutional networks [CNN, ConvNet]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/09Supervised learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • G06V40/171Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M16/00Devices for influencing the respiratory system of patients by gas treatment, e.g. ventilators; Tracheal tubes
    • A61M16/06Respiratory or anaesthetic masks
    • A61M2016/0661Respiratory or anaesthetic masks with customised shape
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M2205/00General characteristics of the apparatus
    • A61M2205/33Controlling, regulating or measuring
    • A61M2205/3306Optical measuring means
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • G06T2207/30201Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • Artificial Intelligence (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Multimedia (AREA)
  • Emergency Medicine (AREA)
  • Pulmonology (AREA)
  • Anesthesiology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Hematology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Human Computer Interaction (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
JP2022565568A 2020-05-15 2021-05-08 患者の2dの正面画像から患者の3dの顔情報の決定 Pending JP2023524416A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202063025822P 2020-05-15 2020-05-15
US63/025,822 2020-05-15
PCT/EP2021/062241 WO2021228727A1 (en) 2020-05-15 2021-05-08 Determining 3-d facial information of a patient from a 2-d frontal image of the patient

Publications (2)

Publication Number Publication Date
JP2023524416A true JP2023524416A (ja) 2023-06-12
JP2023524416A5 JP2023524416A5 (https=) 2024-03-26

Family

ID=75904923

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022565568A Pending JP2023524416A (ja) 2020-05-15 2021-05-08 患者の2dの正面画像から患者の3dの顔情報の決定

Country Status (5)

Country Link
US (1) US12056884B2 (https=)
EP (1) EP4150509B1 (https=)
JP (1) JP2023524416A (https=)
CN (1) CN115605923A (https=)
WO (1) WO2021228727A1 (https=)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11810256B2 (en) * 2021-11-11 2023-11-07 Qualcomm Incorporated Image modification techniques
US12573151B2 (en) * 2023-09-18 2026-03-10 Qualcomm Incorporated Personalized deformable mesh by finetuning on personalized texture

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019063769A1 (en) * 2017-09-29 2019-04-04 Koninklijke Philips N.V. PRODUCTION OF A MASK FOR A PATIENT BASED ON A TEMPORAL MODEL GENERATED FROM A PLURALITY OF FACIAL SCANS

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7904193B2 (en) * 2006-09-29 2011-03-08 Nellcor Puritan Bennett Llc Systems and methods for providing custom masks for use in a breathing assistance system
CN119345549A (zh) * 2015-06-30 2025-01-24 瑞思迈私人有限公司 使用移动应用的面罩大小调整工具
US10055880B2 (en) * 2016-12-06 2018-08-21 Activision Publishing, Inc. Methods and systems to modify a two dimensional facial image to increase dimensional depth and generate a facial image that appears three dimensional
EP3598946B1 (de) * 2018-07-26 2024-10-16 Siemens Healthineers AG Ermittlung eines darzustellenden interessierenden bereichs
US10650564B1 (en) * 2019-04-21 2020-05-12 XRSpace CO., LTD. Method of generating 3D facial model for an avatar and related device
US11602314B2 (en) * 2020-06-15 2023-03-14 Microsoft Technology Licensing, Llc Animating physiological characteristics on 2D or 3D avatars

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019063769A1 (en) * 2017-09-29 2019-04-04 Koninklijke Philips N.V. PRODUCTION OF A MASK FOR A PATIENT BASED ON A TEMPORAL MODEL GENERATED FROM A PLURALITY OF FACIAL SCANS

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
PENGRUI WANG, ET. AL.: "A Unified Multi-output Semi-supervised Network for 3D Face Reconstruction", 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), vol. Year: 2019, JPN6025045386, 14 July 2019 (2019-07-14), ISSN: 0005727899 *

Also Published As

Publication number Publication date
US12056884B2 (en) 2024-08-06
CN115605923A (zh) 2023-01-13
US20210358144A1 (en) 2021-11-18
EP4150509B1 (en) 2026-03-11
WO2021228727A1 (en) 2021-11-18
EP4150509A1 (en) 2023-03-22

Similar Documents

Publication Publication Date Title
CN107735136B (zh) 使用移动应用的面罩大小调整工具
US11791042B2 (en) Methods and systems for providing interface components for respiratory therapy
CN108348719B (zh) 确定关于患者的面部的信息
JP2023507899A (ja) マスクのフィッティングをガイドするアプリケーション
JP2023524416A (ja) 患者の2dの正面画像から患者の3dの顔情報の決定
US10881827B2 (en) Providing a mask for a patient based on a temporal model generated from a plurality of facial scans
US20190188455A1 (en) Capturing and using facial metrics for mask customization
US11583649B2 (en) Patient interface device component design selection or generation systems and methods
US20240001062A1 (en) Method and system for patient interface device data collection with privacy
US20240099621A1 (en) Prescribing a cpap mask based on patients stress response
NZ762184B2 (en) Methods and systems for providing interface components for respiratory therapy
NZ762184A (en) Methods and systems for providing interface components for respiratory therapy
NZ762180B2 (en) Methods and systems for providing interface components for respiratory therapy
NZ726142B2 (en) Methods and systems for providing interface components for respiratory therapy

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240311

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20240311

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20250124

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20250227

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20250515

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250715

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20251111

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20260129

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20260227