WO2023242074A1 - Oral health care - Google Patents

Oral health care Download PDF

Info

Publication number
WO2023242074A1
WO2023242074A1 PCT/EP2023/065562 EP2023065562W WO2023242074A1 WO 2023242074 A1 WO2023242074 A1 WO 2023242074A1 EP 2023065562 W EP2023065562 W EP 2023065562W WO 2023242074 A1 WO2023242074 A1 WO 2023242074A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
health care
video data
oral health
neural network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2023/065562
Other languages
English (en)
French (fr)
Inventor
Nikhil Vikram KULKARNI
Ravindra Balasaheb Patil
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Priority to JP2024568030A priority Critical patent/JP2025523350A/ja
Priority to US18/875,143 priority patent/US20250359655A1/en
Priority to CN202380046512.9A priority patent/CN119365100A/zh
Priority to EP23731688.0A priority patent/EP4539705A1/en
Publication of WO2023242074A1 publication Critical patent/WO2023242074A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A46—BRUSHWARE
    • A46B—BRUSHES
    • A46B15/00—Other brushes; Brushes with additional arrangements
    • A46B15/0002—Arrangements for enhancing monitoring or controlling the brushing process
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/30—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/70—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients
    • A—HUMAN NECESSITIES
    • A46—BRUSHWARE
    • A46B—BRUSHES
    • A46B2200/00—Brushes characterized by their functions, uses or applications
    • A46B2200/10—For human or animal care
    • A46B2200/1046—Brush used for applying cosmetics
    • A—HUMAN NECESSITIES
    • A46—BRUSHWARE
    • A46B—BRUSHES
    • A46B2200/00—Brushes characterized by their functions, uses or applications
    • A46B2200/10—For human or animal care
    • A46B2200/1066—Toothbrush for cleaning the teeth or dentures
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B26—HAND CUTTING TOOLS; CUTTING; SEVERING
    • B26B—HAND-HELD CUTTING TOOLS NOT OTHERWISE PROVIDED FOR
    • B26B21/00—Razors of the open or knife type; Safety razors or other shaving implements of the planing type; Hair-trimming devices involving a razor-blade; Equipment therefor
    • B26B21/40—Details or accessories
    • B26B21/405—Electric features; Charging; Computing devices
    • B26B21/4056—Sensors or controlling means

Definitions

  • This invention relates to the field of oral health care routines, and in particular to the field of assisting an oral health care routine of a user.
  • Oral care devices such as electric toothbrushes or mouthpieces, are used on a regular (e.g. daily) basis, and the oral health care routines involving these devices often involve several complex steps. Thus, the user performing the oral health care routine is often unable to judge their own performance of the routine accurately. Particularly problematic examples are that of proper brushing of the teeth and flossing.
  • Guided brushing is a feature for toothbrush users to provide them with better oral care. Users are often prone to bias, brushing one side of their mouth more than the other, or focusing on the front teeth at the expense of the back. Better oral care can thus be achieved by providing to the users important brushing information, such as total time spent brushing each region of the mouth, or whether basic oral hygiene procedures have taken place, such as flossing. This information can be especially useful for parents keeping track of their children’s dental cleaning routine.
  • US 2020/201272 Al describes a system and method for operating a personal grooming/household appliance, including providing a personal grooming/household appliance including at least one physical sensor.
  • “Method and System for Measuring Effectiveness of Tooth Brushing ED - Dari Kuhn” describes a method and system for measuring effectiveness of tooth brushing for a user by dynamically evaluating degree of plaque removal along with practice of proper brushing techniques.
  • WO 2021/197801 Al describes a method of tracking a user’s toothcare activity comprising receiving video images of a user’s face during, e.g. a tooth-brushing session.
  • US 2018/132602 Al describes an oral care system which may include a toothbrush comprising a physical property, and a programmable processor configured to receive physical property data.
  • US 2020/179089 Al describes an oral hygiene monitoring system to track motion and orientation of an oral hygiene device. The control system may process data output from a motion sensor to determine position and orientation of an oral hygiene device.
  • a method for assisting an oral health care routine of a user According to examples in accordance with an aspect of the invention, there is provided a method for assisting an oral health care routine of a user.
  • the method comprises: obtaining video data from captured video of the user performing the oral health care routine using a personal care device; processing the video data to obtain motion data describing motion of a portion of the user during performance of the oral health care routine; and analysing the motion data to determine at least one parameter value of the oral health care routine, wherein the portion of the user comprises a hand of the user.
  • Proposed concepts thus aim to provide schemes, solutions, concept, designs, methods and systems pertaining to assisting an oral health care routine of a user.
  • embodiments aim to determine at least one parameter value of an oral health care routine based on the motion of a personal care device and/or a portion of the user during performance of the oral health care routine.
  • Information on the motion of a personal care device and/or a portion of the user may be obtained from video of the user and/or the personal care device captured during performance of an oral health care routine. That is, in an example of a user brushing their teeth, video may be captured of the user brushing their teeth and then analysed. From analysis of the movements of the user and their toothbrush, insights into how well they brushed their teeth, i.e. spending the right amount of time on each tooth, may be derived. Guidance may then be offered to the user informing them on the quality of their performance.
  • the motion of one or two of the user’s hands may be analysed to determine if the user is flossing correctly or comprehensively, and guidance may be offered to the user informing them how they may floss more effectively in future.
  • captured video of the user and/or a personal care device during performance of an oral health care routine may be analysed to obtain motion data that may then be leveraged to determine at least one parameter value of the personal health care routine. That is, insights may be derived into the user’s performance of an oral health care routine based on movements of their body and/or a personal care device, such as a toothbrush or a flossing device.
  • Such video may be obtained using existing or conventional devices that include cameras already owned by a user.
  • the personal care device may also comprise a mouthpiece, a flossing device, or any other personal oral care device.
  • One or more proposed concept(s) may therefore be employed in a range of different personal care devices.
  • Embodiments may therefore have wide application in the field of personal care devices, and be of particular relevance to dentistry propositions. For example, by enabling improved cleaning of a user’s teeth, gum, tongue, etc. any by reducing unwanted tissue damage. Accordingly, embodiments may be used in relation to dental treatment so as to support a dental care professional when providing treatment for a subject.
  • embodiments may support improved dental care. Improved oral health care routines may therefore be provided by proposed concepts.
  • one or more insights or statistics may be determined that may be of use to the user.
  • An example parameter value may, for instance, pertain to user bias. For instance, if the oral health care routine is the user brushing their teeth, the parameter value may be a ratio of time spent brushing the left side of the mouth to time spent brushing the right side of the mouth, or alternatively, percentage of the mouth cleaned.
  • Such insights may enable the provision of feedback to the user, such that favourable habits are reinforced and unfavourable behaviour highlighted.
  • an improved performance of an oral health care routine by a user may be supported by the proposed concept(s).
  • the at least one parameter value may comprise at least one of: a user bias; a measure of completion of the oral health care routine; a measure of completion of a subroutine of the oral health care routine; and a time duration.
  • user bias may be a ratio of time spent brushing the upper teeth to the time spent brushing the lower teeth.
  • An example of a measure of completion of the oral health care routine may be a number of teeth remaining to be properly cleaned.
  • An example of a measure of completion of a subroutine of the oral health care routine may be whether the user has flossed.
  • An example of time duration may be the total time spent brushing each region of the mouth.
  • the obtained motion data further describes motion of the personal care device. This may allow the tracking of the motion of a toothbrush or a flossing device, for example, which may allow for further insights into the user’s performance of the oral health care routine.
  • processing the video data to obtain motion data describing motion of the personal care device may comprise: providing the video data as input to a first convolutional neural network, CNN, the first CNN being trained to predict, for the personal care device associated with the video data, motion data indicating a series of locations of the personal care device.
  • the use of a CNN instead of a plain object detection algorithm may allow pixel level segmentation of the personal care device compared to a simple bounding box. This may facilitate more accurate location and movement tracking of the personal care device.
  • the series of locations of the personal care device may describe a region of the personal care device.
  • the location and motion of the top of a toothbrush e.g. the brushing head, may be of specific use during analysis of the motion data to determine parameter values of the oral health care routine.
  • the first CNN may be trained using a training algorithm configured to receive an array of training inputs and respective known outputs, wherein a training input comprises video data associated with a personal care device and respective known output comprises motion data indicating a series of locations of the personal care device. In this way, the first CNN may be trained to output motion data indicating a series of locations of the personal care device when provided with video data associated with a personal care device during an oral health care routine.
  • the first CNN is a pretrained model further trained on videos of subjects using the personal care device that have been manually annotated. This allows the CNN to become especially proficient at identifying the personal care device.
  • processing the video data to obtain motion data describing motion of a portion of the user comprises: providing the video data as input to a second neural network, the second neural network being trained to predict, for the portion of the user associated with the video data, motion data indicating a series of locations of a palm of a hand of the user; providing the video data as input to a third neural network, the third neural network being trained to predict, for the portion of the user associated with the video data, motion data indicating a series of locations of landmarks on a hand of the user.
  • This split model separately identifying the location of a palm of a hand of the user and locations of landmarks on a hand of the user allows quick and accurate hand tracking without the use of any specialized hardware like a depth-perception camera.
  • the third neural network can identify the locations of landmarks on a hand quickly by only searching within the bounding box identified by the second neural network.
  • the second neural network is trained using a training algorithm configured to receive an array of training inputs and respective known outputs, wherein a training input comprises video data associated with a portion of the user and respective known output comprises motion data indicating a series of locations of a palm of a hand of the user. This allows the second neural network to become proficient at identifying palms of users.
  • the third neural network is trained using a training algorithm configured to receive an array of training inputs and respective known outputs, wherein a training input comprises video data associated with a portion of the user and respective known output comprises motion data indicating a series of locations of landmarks on a hand of the user. This allows the third neural network to become proficient at identifying landmarks on a hand of a user.
  • the second neural network comprises single shot multibox detector architecture
  • the third neural network comprises a feature pyramid network.
  • Single shot multibox detector architecture allows multiple objects present in an image to be detected in single forward pass of the network. This allows multiple objects, such as two palms, to be detected quickly.
  • Feature pyramid networks are especially proficient at identifying small objects, such as knuckles or finger joints, and so are well suited to detecting landmarks on a hand of a user.
  • processing the video data to obtain motion data describing motion of a portion of the user comprises: providing the video data as input to a fourth neural network, the fourth neural network being trained to predict, for the portion of the user associated with the video data, motion data indicating a series of locations of a face of the user; providing the video data as input to a fifth neural network, the fifth neural network being trained to predict, for the portion of the user associated with the video data, motion data indicating a series of locations of landmarks on a face of the user.
  • This split model separately identifying the location of a face of the user and locations of landmarks on the face of the user allows quick and accurate face tracking without the use of any specialized hardware like a depth-perception camera.
  • the landmarks on the face can then be identified quicker by the fifth neural network by only searching within the bounding box detected by the fourth neural network.
  • the fourth neural network is trained using a training algorithm configured to receive an array of training inputs and respective known outputs, wherein a training input comprises video data associated with a portion of the user and respective known output comprises motion data indicating a series of locations of a face of the user. This allows the fourth neural network to become proficient at identifying faces of users.
  • the fifth neural network is trained using a training algorithm configured to receive an array of training inputs and respective known outputs, wherein a training input comprises video data associated with a portion of the user and respective known output comprises motion data indicating a series of locations of landmarks on a face of the user.
  • a training input comprises video data associated with a portion of the user and respective known output comprises motion data indicating a series of locations of landmarks on a face of the user.
  • the fifth neural network comprises a feature pyramid network.
  • Single shot multibox detector architecture allows multiple objects present in an image to be detected in single forward pass of the network. This allows single or multiple objects, such as one or more faces, to be detected quickly.
  • Feature pyramid networks are especially proficient at identifying small objects, such as nostrils and eyes, and so are well suited to detecting landmarks on a face of a user.
  • analysing the motion data to determine at least one parameter value of the oral health care routine comprises: providing the motion data as input to a machine learning algorithm, the machine learning algorithm being trained to predict, for the oral health care routine associated with the motion data, at least one parameter value of the oral health care routine.
  • the machine learning algorithm can deduce useful information. For example, in the case of a user brushing their teeth, the machine learning algorithm can predict the angle of the personal care device with respect to the user’s mouth.
  • the machine learning algorithm comprises a supervised classifier model. This is especially useful for classifying detected behaviour, such as brushing specific regions of a user’s mouth.
  • the machine learning algorithm is trained using a training algorithm configured to receive an array of training inputs and respective known outputs, wherein a training input comprises motion data associated with an oral health care routine and respective known output comprises at least one parameter value of the oral health care routine. This allows the machine learning algorithm to become especially proficient at determining parameter values of oral health care routines.
  • analysing the motion data to determine at least one parameter value of the oral health care routine comprises: providing the motion data as input to a rule-based algorithm designed to predict, for the oral health care routine associated with the motion data, at least one parameter value of the oral health care routine. This allows parameter values to be deduced from the motion data without the use of a machine learning algorithm which may ease computational demands.
  • analysing the motion data to determine at least one parameter value of the oral health care routine comprises: predicting a location of contact between the personal care device and a surface of the user. For example, in the case of a user brushing their teeth, from the location of contact between the personal care device and a surface of the user, the region of brushing taking place can be deduced. For instance, it can be deduced the user is currently brushing their left molar.
  • analysing the motion data to determine at least one parameter value of the oral health care routine comprises: predicting a distance between each palm of the user and the face of the user, and optionally wherein the predicted distances between each palm of the user and the face of the user are compared to predetermined thresholds.
  • a computer program comprising code means for implementing any of the methods described above when said program is run on a processing system.
  • a system for assisting an oral health care routine of a user comprises: an input interface configured to obtain video data from captured video of the user performing the personal health care routine using a personal care device; a processor arrangement configured to: process the video data to obtain motion data describing motion of a portion(s) of the user during performance of the oral health care routine; analyse the motion data to determine at least one parameter value of the oral health care routine, wherein the portion of the user comprises a hand of the user.
  • Fig. 1 is a simplified flow diagram of a method for assisting an oral health care routine of a user according to a proposed embodiment
  • Fig. 2 is a more in-depth flow diagram of a method for assisting an oral health care routine of a user according to a proposed embodiment
  • Fig. 3a is a simplified diagram of tracking a personal care device according to a proposed embodiment
  • Fig. 3b is a simplified diagram of tracking a personal care device at an alternate angle according to a proposed embodiment
  • Fig. 4 is a simplified block diagram of a system for assisting an oral health care routine of a user according a proposed embodiment
  • Fig. 5 illustrates an example of a computer within which one or more parts of an embodiment may be employed
  • Implementations in accordance with the present disclosure relate to various techniques, methods, schemes and/or solutions pertaining to assisting an oral health care routine of a user.
  • a number of possible solutions may be implemented separately or jointly. That is, although these possible solutions may be described below separately, two or more of these possible solutions may be implemented in one combination or another.
  • Embodiments of the invention aim to assist an oral health care routine of a user by analysing motion (i.e. movement) of a user and a personal care device during performance of the oral health care routine.
  • This can be achieved by obtaining video data from captured video of the user performing the oral health care routine using a personal care device.
  • the video data can then be processed to obtain motion data describing motion of at least one of: the personal care device, and a portion of the user during performance of the oral health care routine.
  • the motion data can then be analysed to determine at least one parameter value of the oral health care routine.
  • Proposed concepts thus aim to determine at least one parameter value of an oral health care routine based on the motion of a personal care device and/or a portion of the user during performance of the oral health care routine.
  • Information on the motion of a personal care device and/or a portion of the user may be obtained from video of the user and/or the personal care device captured during performance of an oral health care routine. That is, in an example of a user brushing their teeth, video may be captured of the user brushing their teeth and then analysed. From analysis of the movements of the user and/or their toothbrush, insights into how well they brushed their teeth, i.e. spending the right amount of time on each tooth, may be derived. Guidance may then be offered to the user informing them on the quality of their performance.
  • FIG. 1 there is depicted a flow diagram of a method 100 for assisting an oral health care routine of a user according to a proposed embodiment.
  • the method begins with the step 110 of obtaining video data from captured video of the user performing the oral health care routine using a personal care device.
  • video can be obtained using existing or conventional devices that include cameras already owned by a user.
  • a conventional device may be one of: a smartphone, a tablet, a laptop, or any other suitable device.
  • feedback analogous to guided brushing may be provided to users irrespective of the type of the toothbrush or personal care device being used.
  • the use of video data alone to derive insights into a user’s performance of an oral health care routine may permit assistance to the user in their routine without the need for dedicated sensors in the personal care device which are costly and increase the complexity of the required personal care device.
  • assistance may be provided to users performing oral health care routines regardless of whether or not the personal care device involved has sensors suitable for monitoring an oral health care routine.
  • step 120 the video data is processed to obtain motion data describing motion of at least one of: the personal care device, and a portion of the user during performance of the oral health care routine.
  • the details of the processing of the video data will be more fully explained later.
  • the motion data is analysed to determine at least one parameter value of the oral health care routine.
  • An example parameter value may, for instance, pertain to user bias.
  • the parameter value may be a ratio of time spent brushing the left side of the mouth to time spent brushing the right side of the mouth, or alternatively, percentage of the mouth cleaned.
  • the at least one parameter value may comprise at least one of: a user bias; a measure of completion of the oral health care routine; a measure of completion of a subroutine of the oral health care routine; and a time duration.
  • user bias may be a ratio of time spent brushing the upper teeth to the time spent brushing the lower teeth.
  • An example of a measure of completion of the oral health care routine may be a number of teeth remaining to be properly cleaned.
  • An example of a measure of completion of a subroutine of the oral health care routine may be whether the user has flossed.
  • An example of time duration may be the total time spent brushing each region of the mouth.
  • a more in-depth flow diagram of a method 200 for assisting an oral health care routine of a user begins with the step 110 of obtaining video data from captured video of the user performing the oral health care routine using a personal care device, as described above.
  • the video data is processed to predict motion data indicating a series of locations of the personal care device.
  • the processing of the video data is facilitated by providing the video data as input to a first convolutional neural network, CNN, the first CNN being trained to predict, for the personal care device motion data indicating a series of locations of the personal care device.
  • a first convolutional neural network CNN
  • the first CNN being trained to predict, for the personal care device motion data indicating a series of locations of the personal care device.
  • a CNN instead of a plain object detection algorithm allows pixel level segmentation of the personal care device compared to a simple bounding box. This may facilitate more accurate location and movement tracking of the personal care device.
  • Neural networks are comprised of layers, each layer comprising a plurality of neurons.
  • Each neuron comprises a mathematical operation.
  • each neuron may comprise a different weighted combination of a single type of transformation (e.g. the same type of transformation, sigmoid etc. but with different weightings).
  • the mathematical operation of each neuron is performed on the input data to produce a numerical output, and the outputs of each layer in the neural network are fed into the next layer sequentially. The final layer provides the output.
  • CNNs convolutional neural networks
  • RNNs recurrent neural networks
  • CNNs typically contain several layers, including a convolutional layer, a pooling layer, and a fully connected layer.
  • the convolutional layer consists of a set of learnable filters and extracts features from the input.
  • the pooling layer is a form of non-linear down-sampling, reducing the data size by combining the outputs of a plurality of neurons in one layer into a single neuron in the next layer.
  • the fully connected layer connects each neuron in one layer to all the neurons in the next layer.
  • Methods of training a machine-learning algorithm are well known.
  • such methods comprise obtaining a training dataset, comprising training input data entries and corresponding training output data entries.
  • An initialized machine-learning algorithm is applied to each input data entry to generate predicted output data entries.
  • An error between the predicted output data entries and corresponding training output data entries is used to modify the machine-learning algorithm. This process can be repeated until the error converges, and the predicted output data entries are sufficiently similar (e.g. ⁇ 1%) to the training output data entries. This is commonly known as a supervised learning technique.
  • weightings of the mathematical operation of each neuron may be modified until the error converges.
  • Known methods of modifying a neural network include gradient descent, backpropagation algorithms and so on.
  • the training input data entries for the first CNN used in method 200 correspond to example video data associated with a personal care device.
  • the training output data entries correspond to motion data indicating a series of locations of the personal care device.
  • several pre-processing methods may be employed to improve the training samples.
  • the first CNN can be trained using a training algorithm configured to receive an array of training inputs and respective known outputs, wherein a training input comprises video data associated with a personal care device and respective known output comprises motion data indicating a series of locations of the personal care device. In this way, the first CNN is trained to output motion data indicating a series of locations of the personal care device when provided with video data associated with a personal care device during an oral health care routine.
  • the first CNN is a pretrained model further trained on videos of subjects using the personal care device that have been manually annotated. This allows the CNN to become especially proficient at identifying the personal care device.
  • the pretrained model is trained on a COCO dataset based on RESNET34, RESNET 50, and/or RESNET101 backbone architecture.
  • the first CNN is more specifically a Mask-RCNN deep neural based model trained on custom toothbrush annotations.
  • the series of locations of the personal care device describes a region of the personal care device.
  • the location and motion of the top edge of a toothbrush e.g. the brushing head, may be of specific use during analysis of the motion data to determine parameter values of the oral health care routine.
  • the video data is processed to predict motion data indicating a series of locations of a portion of the user during performance of the oral health care routine.
  • the portion of the user is a palm of a hand of the user.
  • the processing is facilitated by providing the video data as input to a second neural network, the second neural network being trained to predict, for the portion of the user associated with the video data, motion data indicating a series of locations of a palm of a hand of the user.
  • the second neural network comprises single shot multibox detector architecture.
  • Single shot multibox detector architecture allows multiple objects present in an image to be detected in single forward pass of the network. This allows multiple objects, such as two palms, to be detected quickly.
  • the second neural network is trained using a training algorithm configured to receive an array of training inputs and respective known outputs, wherein a training input comprises video data associated with a portion of the user and respective known output comprises motion data indicating a series of locations of a palm of a hand of the user. This allows the second neural network to become proficient at identifying palms of users and drawing bounding boxes around them.
  • the video data is processed to predict motion data indicating a series of locations of a portion of the user during performance of the oral health care routine.
  • the portion of the user is locations of landmarks on a hand of the user.
  • the processing is facilitated by providing the video data as input to a third neural network, the third neural network being trained to predict, for the portion of the user associated with the video data, motion data indicating a series of locations of landmarks on a hand of the user.
  • the third neural network comprises a feature pyramid network. Feature pyramid networks are especially proficient at identifying small objects, such as knuckles or finger joints, and so are well suited to detecting landmarks on a hand of a user. In an embodiment, at least 21 landmarks on the hand are detected.
  • the third neural network is trained using a training algorithm configured to receive an array of training inputs and respective known outputs, wherein a training input comprises video data associated with a portion of the user and respective known output comprises motion data indicating a series of locations of landmarks on a hand of the user. This allows the third neural network to become proficient at identifying landmarks on a hand of a user. In an embodiment, the coordinates of identified landmarks on a hand of a user are saved to a memory for further analysis.
  • This split model separately identifying the location of a palm of a hand of the user and locations of landmarks on a hand of the user allows quick and accurate hand tracking, for instance tracking of a hand skeleton, without the use of any specialized hardware like a depth-perception camera.
  • the third neural network can identify the locations of landmarks on a hand quickly by only searching within the bounding box identified by the second neural network.
  • the landmarks can be identified using encoder-decoder architecture.
  • the video data is processed to predict motion data indicating a series of locations of a portion of the user during performance of the oral health care routine.
  • the portion of the user is a face of the user.
  • the processing is facilitated by providing the video data as input to a fourth neural network, the fourth neural network being trained to predict, for the portion of the user associated with the video data, motion data indicating a series of locations of a face of the user.
  • the fourth neural network comprises single shot multibox detector architecture.
  • Single shot multibox detector architecture allows multiple objects present in an image to be detected in single forward pass of the network. This allows single or multiple objects, such as one or more faces, to be detected quickly.
  • the fourth neural network is trained using a training algorithm configured to receive an array of training inputs and respective known outputs, wherein a training input comprises video data associated with a portion of the user and respective known output comprises motion data indicating a series of locations of a face of the user. This allows the fourth neural network to become proficient at identifying faces of users.
  • the video data is processed to predict motion data indicating a series of locations of a portion of the user during performance of the oral health care routine.
  • the portion of the user is locations of landmarks on a face of the user.
  • the processing is facilitated by providing the video data as input to a fifth neural network, the fifth neural network being trained to predict, for the portion of the user associated with the video data, motion data indicating a series of locations of landmarks on a face of the user.
  • the fifth neural network comprises a feature pyramid network. Feature pyramid networks are especially proficient at identifying small objects, such as nostrils and eyes, and so are well suited to detecting landmarks on a face of a user. In an embodiment, at least 230 landmarks on the face are detected.
  • the fifth neural network is trained using a training algorithm configured to receive an array of training inputs and respective known outputs, wherein a training input comprises video data associated with a portion of the user and respective known output comprises motion data indicating a series of locations of landmarks on a face of the user.
  • a training input comprises video data associated with a portion of the user
  • respective known output comprises motion data indicating a series of locations of landmarks on a face of the user.
  • This split model separately identifying the location of a face of the user and locations of landmarks on the face of the user allows quick and accurate face tracking without the use of any specialized hardware like a depth-perception camera.
  • the landmarks on the face can then be identified quicker by the fifth neural network by only searching within the bounding box detected by the fourth neural network.
  • the landmarks can be identified using encoderdecoder architecture.
  • step 260 the motion data determined by steps 210, 220, 230, 240, and 250 is analysed to determine at least one parameter value of the oral health care routine.
  • the motion data may be provided as input to a machine learning algorithm, the machine learning algorithm being trained to predict, for the oral health care routine associated with the motion data, at least one parameter value of the oral health care routine.
  • the machine learning algorithm can deduce useful information. For example, in the case of a user brushing their teeth, the machine learning algorithm can predict the angle of the personal care device with respect to the user’s mouth.
  • the machine learning algorithm comprises a supervised classifier model. This is especially useful for classifying detected behaviour, such as brushing specific regions of a user’s mouth. Region of brushing can be deduced based on personal care device, hand and facial landmarks coordinates and pattern matching.
  • the machine learning algorithm is trained using a training algorithm configured to receive an array of training inputs and respective known outputs, wherein a training input comprises motion data associated with an oral health care routine and respective known output comprises at least one parameter value of the oral health care routine. This allows the machine learning algorithm to become especially proficient at determining parameter values of oral health care routines.
  • the motion data may be provided as input to a rule-based algorithm designed to predict, for the oral health care routine associated with the motion data, at least one parameter value of the oral health care routine.
  • a rule-based algorithm designed to predict, for the oral health care routine associated with the motion data, at least one parameter value of the oral health care routine. This allows parameter values to be deduced from the motion data without the use of a machine learning algorithm which may ease computational demands. For instance, if a toothbrush head is closer to the right edge of a mouth than the left, and the angle between the toothbrush and a line parallel to a plane of the face is 95 degrees then it can be determined that brushing is taking place on the right side of the mouth.
  • analysing the motion data to determine at least one parameter value of the oral health care routine by either method comprises predicting a location of contact between the personal care device and a surface of the user. For example, in the case of a user brushing their teeth, from the location of contact between the personal care device and a surface of the user, the region of brushing taking place can be deduced. For instance, it can be deduced that the user is currently brushing their left molar.
  • analysing the motion data to determine at least one parameter value of the oral health care routine comprises predicting a distance between each palm of the user and the face of the user. The predicted distance between each palm of the user and the face of the user can then be compared to predetermined thresholds. This allows the detection of a user flossing, as they will need both hands close to their mouth while flossing, but is not limited to this purpose.
  • FIG. 3a and Fig. 3b there are depicted simplified diagrams of tracking a personal care device according to a proposed embodiment. These diagrams depict a user performing an oral health care routine, for example, brushing their teeth.
  • a personal care device 320 is being held up to the face 310 of a user.
  • the top edge 340 of the personal care device and the bottom edge 350 are used to find an angle 360 of the personal care device against a line 330 parallel to the plane of the face and going through the top edge.
  • the first CNN From processing of the video data to obtain motion data indicating a series of locations of the personal care device 320, the first CNN outputs a mask of the personal care device.
  • the first CNN is a Mask-RCNN, but in this embodiment, the mask of the personal care device 320 generated by the Mask-RCNN can be made up of many sub masks.
  • the following algorithm is implemented:
  • the bottom edge 350 is extracted by finding the maximum Y-coordinate of the mask and by finding its corresponding X-coordinate.
  • the top edge and the bottom edge of each sub-mask is found iteratively and the two prior steps are repeated to arrive at the top and bottom edges of the personal care device.
  • the angle 360 of the personal care device with respect to the plane 330 of the face 310 can be found.
  • the angle between the toothbrush and the face is used to determine the location of brushing. For example, if the user is brushing the sides of their mouth then the toothbrush is almost perpendicular to the plane of the face, while if the user is brushing the front of the mouth then the toothbrush is nearly parallel to the face.
  • the top edge and the bottom edge of the toothbrush are connected with a straight line. This line then intersects the reference line 330 parallel to the plane of the face 310 at the top edge, which enables the angle between the two lines to be determined using dot product. This angle is equal to the angle between the toothbrush and the face.
  • a. b is the dot product between the two vectors and
  • the output coordinates of each first to fifth neural networks are saved to a memory.
  • the saved coordinates are then analysed and the location of brushing is predicted using either the rule based or machine-learning based approach.
  • a memory can include any one or combination of volatile memory elements (e.g., random access memory (RAM), such as dynamic random access memory (DRAM), static random access memory (SRAM), etc.) and non-volatile memory elements (e.g., ROM, erasable programmable read only memory (EPROM), electronically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), tape, compact disc read only memory (CD-ROM), disk, diskette, cartridge, cassette or the like, etc.).
  • RAM random access memory
  • DRAM dynamic random access memory
  • SRAM static random access memory
  • non-volatile memory elements e.g., ROM, erasable programmable read only memory (EPROM), electronically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), tape, compact disc read only memory (CD-ROM), disk, diskette, cartridge, cassette or the like, etc.
  • the memory may incorporate electronic, magnetic, optical, and/or other types of storage media.
  • a computer program comprising code means for implementing any of the methods described above when said program is run on a processing system.
  • Fig. 4 there is depicted a simplified block diagram of a system 400 for assisting an oral health care routine of a user according an embodiment.
  • the system configured for assisting an oral health care routine of a user comprises an input interface 410, and one or more processors 430.
  • the system 400 is configured to analyse a user’s motion, and the motion of a personal care device, during performance of an oral health care routine.
  • Video 415 captured of the user performing the oral health care routine is obtained.
  • the system outputs an output 450 comprising at least one parameter value of the oral health care routine.
  • the output 450 is generated based on the analysis of the motion data, and is for providing feedback to the user on their performance of the oral health care routine.
  • the input interface 410 receives video data 415 from captured video of the user during performance of an oral health care routine.
  • the input interface 410 provides the video data 415 to one or more neural networks 420 for predicting locations of a portion(s) of the user within the video data, and for predicting locations of the personal health care device within the video data. This facilitates motion pattern analysis of an oral health care routine.
  • the processor(s) 430 then processes the video data with a motion detection algorithm to obtain motion data describing motion of at least one of the personal care device and a portion(s) of the user during performance of the oral health care routine.
  • a motion detection algorithm For this, a multiperson detection network may be used to avoid external disturbances by focusing on the user performing the oral health care routine only.
  • the resulting motion data are then processed by the processor(s) 430 to produce an output 450 comprising at least one parameter value of the oral health care routine.
  • Fig. 5 illustrates an example of a computer 500 within which one or more parts of an embodiment may be employed.
  • Various operations discussed above may utilize the capabilities of the computer 500.
  • system functional blocks can run on a single computer or may be distributed over several computers and locations (e.g. connected via internet).
  • the computer 500 includes, but is not limited to, PCs, workstations, laptops, PDAs, palm devices, servers, storages, and the like.
  • the computer 500 may include one or more processors 510, memory 520 and one or more I/O devices 530 that are communicatively coupled via a local interface (not shown).
  • the local interface can be, for example but not limited to, one or more buses or other wired or wireless connections, as is known in the art.
  • the local interface may have additional elements, such as controllers, buffers (caches), drivers, repeaters, and receivers, to enable communications. Further, the local interface may include address, control, and/or data connections to enable appropriate communications among the aforementioned components.
  • the processor 510 is a hardware device for executing software that can be stored in the memory 520.
  • the processor 510 can be virtually any custom made or commercially available processor, a central processing unit (CPU), a digital signal processor (DSP), or an auxiliary processor among several processors associated with the computer 500, and the processor 510 may be a semiconductor based microprocessor (in the form of a microchip) or a microprocessor.
  • the memory 520 can include any one or combination of volatile memory elements (e.g., random access memory (RAM), such as dynamic random access memory (DRAM), static random access memory (SRAM), etc.) and non-volatile memory elements (e.g., ROM, erasable programmable read only memory (EPROM), electronically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), tape, compact disc read only memory (CD-ROM), disk, diskette, cartridge, cassette or the like, etc.).
  • RAM random access memory
  • DRAM dynamic random access memory
  • SRAM static random access memory
  • non-volatile memory elements e.g., ROM, erasable programmable read only memory (EPROM), electronically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), tape, compact disc read only memory (CD-ROM), disk, diskette, cartridge, cassette or the like, etc.
  • the memory 520 may incorporate electronic, magnetic, optical, and/or other types
  • the software in the memory 520 may include one or more separate programs, each of which comprises an ordered listing of executable instructions for implementing logical functions.
  • the software in the memory 520 includes a suitable operating system (O/S) 550, compiler 560, source code 570, and one or more applications 580 in accordance with exemplary embodiments.
  • the application 580 comprises numerous functional components for implementing the features and operations of the exemplary embodiments.
  • the application 580 of the computer 500 may represent various applications, computational units, logic, functional units, processes, operations, virtual entities, and/or modules in accordance with exemplary embodiments, but the application 580 is not meant to be a limitation.
  • the operating system 550 controls the execution of other computer programs, and provides scheduling, input-output control, file and data management, memory management, and communication control and related services. It is contemplated by the inventors that the application 580 for implementing exemplary embodiments may be applicable on all commercially available operating systems.
  • Application 580 may be a source program, executable program (object code), script, or any other entity comprising a set of instructions to be performed.
  • a source program then the program is usually translated via a compiler (such as the compiler 560), assembler, interpreter, or the like, which may or may not be included within the memory 520, so as to operate properly in connection with the O/S 550.
  • the application 580 can be written as an object oriented programming language, which has classes of data and methods, or a procedure programming language, which has routines, subroutines, and/or functions, for example but not limited to, C, C++, C#, Pascal, BASIC, API calls, HTML, XHTML, XML, ASP scripts, JavaScript, FORTRAN, COBOL, Perl, Java, ADA, NET, and the like.
  • the I/O devices 530 may include input devices such as, for example but not limited to, a mouse, keyboard, scanner, microphone, camera, etc. Furthermore, the I/O devices 530 may also include output devices, for example but not limited to a printer, display, etc. Finally, the I/O devices 530 may further include devices that communicate both inputs and outputs, for instance but not limited to, a NIC or modulator/demodulator (for accessing remote devices, other files, devices, systems, or a network), a radio frequency (RF) or other transceiver, a telephonic interface, a bridge, a router, etc. The I/O devices 530 also include components for communicating over various networks, such as the Internet or intranet.
  • a NIC or modulator/demodulator for accessing remote devices, other files, devices, systems, or a network
  • RF radio frequency
  • the I/O devices 530 also include components for communicating over various networks, such as the Internet or intranet.
  • the software in the memory 520 may further include a basic input output system (BIOS) (omitted for simplicity).
  • BIOS is a set of essential software routines that initialize and test hardware at start-up, start the O/S 550, and support the transfer of data among the hardware devices.
  • the BIOS is stored in some type of read-only- memory, such as ROM, PROM, EPROM, EEPROM or the like, so that the BIOS can be executed when the computer 800 is activated.
  • the processor 510 When the computer 500 is in operation, the processor 510 is configured to execute software stored within the memory 520, to communicate data to and from the memory 520, and to generally control operations of the computer 500 pursuant to the software.
  • the application 580 and the O/S 550 are read, in whole or in part, by the processor 510, perhaps buffered within the processor 510, and then executed.
  • a computer readable medium may be an electronic, magnetic, optical, or other physical device or means that can contain or store a computer program for use by or in connection with a computer related system or method.
  • the application 580 can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions.
  • a "computer- readable medium" can be any means that can store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
  • the computer readable medium can be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium.
  • Figs. 1-2 may be implemented in hardware or software, or a mixture of both (for example, as firmware running on a hardware device).
  • the functional steps illustrated in the process flowcharts may be performed by suitably programmed physical computing devices, such as one or more central processing units (CPUs) or graphics processing units (GPUs).
  • CPUs central processing units
  • GPUs graphics processing units
  • Each process - and its individual component steps as illustrated in the flowcharts - may be performed by the same or different computing devices.
  • a computer-readable storage medium stores a computer program comprising computer program code configured to cause one or more physical computing devices to carry out an encoding or decoding method as described above when the program is run on the one or more physical computing devices.
  • Storage media may include volatile and non-volatile computer memory such as RAM, PROM, EPROM, and EEPROM, optical discs (like CD, DVD, BD), magnetic storage media (like hard discs and tapes).
  • Various storage media may be fixed within a computing device or may be transportable, such that the one or more programs stored thereon can be loaded into a processor.
  • the blocks shown in the block diagrams of Fig. 4 may be separate physical components, or logical subdivisions of single physical components, or may be all implemented in an integrated manner in one physical component.
  • the functions of one block shown in the drawings may be divided between multiple components in an implementation, or the functions of multiple blocks shown in the drawings may be combined in single components in an implementation.
  • Hardware components suitable for use in embodiments of the present invention include, but are not limited to, conventional microprocessors, application specific integrated circuits (ASICs), and field-programmable gate arrays (FPGAs).
  • ASICs application specific integrated circuits
  • FPGAs field-programmable gate arrays
  • One or more blocks may be implemented as a combination of dedicated hardware to perform some functions and one or more programmed microprocessors and associated circuitry to perform other functions.
  • a computer program may be stored/distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
  • a suitable medium such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical fiinction(s).
  • the functions noted in the block may occur out of the order noted in the figures.
  • two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration can be implemented by special purpose hardware-based systems that perform the specified functions or acts or carry out combinations of special purpose hardware and computer instructions .
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s).
  • the functions noted in the block may occur out of the order noted in the figures.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Public Health (AREA)
  • Medical Informatics (AREA)
  • Epidemiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Biomedical Technology (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Biophysics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Image Analysis (AREA)
  • Brushes (AREA)
  • Endoscopes (AREA)
PCT/EP2023/065562 2022-06-16 2023-06-12 Oral health care Ceased WO2023242074A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2024568030A JP2025523350A (ja) 2022-06-16 2023-06-12 口腔ケア
US18/875,143 US20250359655A1 (en) 2022-06-16 2023-06-12 Oral health care
CN202380046512.9A CN119365100A (zh) 2022-06-16 2023-06-12 口腔健康护理
EP23731688.0A EP4539705A1 (en) 2022-06-16 2023-06-12 Oral health care

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP22179367.2 2022-06-16
EP22179367.2A EP4292472A1 (en) 2022-06-16 2022-06-16 Oral health care

Publications (1)

Publication Number Publication Date
WO2023242074A1 true WO2023242074A1 (en) 2023-12-21

Family

ID=82117538

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2023/065562 Ceased WO2023242074A1 (en) 2022-06-16 2023-06-12 Oral health care

Country Status (5)

Country Link
US (1) US20250359655A1 (cg-RX-API-DMAC7.html)
EP (2) EP4292472A1 (cg-RX-API-DMAC7.html)
JP (1) JP2025523350A (cg-RX-API-DMAC7.html)
CN (1) CN119365100A (cg-RX-API-DMAC7.html)
WO (1) WO2023242074A1 (cg-RX-API-DMAC7.html)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2701617A (en) * 2024-10-11 2026-05-06 Mdbuddy Uk Ltd AI-based camera tracking system for monitoring and enhancing toothbrushing effectiveness without sensors
WO2026104381A1 (en) * 2024-11-14 2026-05-21 Koninklijke Philips N.V. System for monitoring and improving brushing technique of user during brushing operation

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160235357A1 (en) * 2013-06-19 2016-08-18 Benjamin Ohmer Method for determining of movement patterns during a dental treatment
US20180132602A1 (en) 2016-11-14 2018-05-17 Colgate-Palmolive Company Oral Care System and Method
US20200179089A1 (en) 2016-08-22 2020-06-11 Kolibree SAS Oral Hygiene System for Compliance Monitoring and Tele-Dentistry System
US20200201272A1 (en) 2018-12-21 2020-06-25 The Procter & Gamble Company Apparatus and method for operating a personal grooming appliance or household cleaning appliance
WO2021197801A1 (en) 2020-03-31 2021-10-07 Unilever Ip Holdings B.V. Motion tracking of a toothcare appliance

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160235357A1 (en) * 2013-06-19 2016-08-18 Benjamin Ohmer Method for determining of movement patterns during a dental treatment
US20200179089A1 (en) 2016-08-22 2020-06-11 Kolibree SAS Oral Hygiene System for Compliance Monitoring and Tele-Dentistry System
US20180132602A1 (en) 2016-11-14 2018-05-17 Colgate-Palmolive Company Oral Care System and Method
US20200201272A1 (en) 2018-12-21 2020-06-25 The Procter & Gamble Company Apparatus and method for operating a personal grooming appliance or household cleaning appliance
WO2021197801A1 (en) 2020-03-31 2021-10-07 Unilever Ip Holdings B.V. Motion tracking of a toothcare appliance

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"Method and System for Measuring Effectiveness of Tooth Brushing ED - Darl Kuhn", IP.COM, IP.COM INC., WEST HENRIETTA, NY, US, 6 December 2018 (2018-12-06), XP013181263, ISSN: 1533-0001 *

Also Published As

Publication number Publication date
EP4292472A1 (en) 2023-12-20
US20250359655A1 (en) 2025-11-27
JP2025523350A (ja) 2025-07-23
EP4539705A1 (en) 2025-04-23
CN119365100A (zh) 2025-01-24

Similar Documents

Publication Publication Date Title
Koh et al. Understanding black-box predictions via influence functions
US20250359655A1 (en) Oral health care
WO2020077198A1 (en) Image-based models for real-time biometrics and marker-less motion tracking in imaging applications
Kruse et al. Glottisnetv2: temporal glottal midline detection using deep convolutional neural networks
US12100152B1 (en) Compute system with acne diagnostic mechanism and method of operation thereof
CN120690070A (zh) 基于大数据分析的医疗实训模拟仿真系统
EP4634823A1 (en) Determining the body posture of a laying infant
CN116612886B (zh) 一种脑卒中早期辅助诊断方法、系统、装置及存储介质
EP4388933A1 (en) Oral health care
Büchner et al. Facing asymmetry-uncovering the causal link between facial symmetry and expression classifiers using synthetic interventions
Gutstein et al. Optical flow, positioning, and eye coordination: automating the annotation of physician-patient interactions
Stiles Efficient Segment Anything on the Edge
CN113553886A (zh) 用于监视洗手过程的装置、方法以及存储介质
US20230281804A1 (en) Landmark detection in medical images
Naouali et al. AVPENet: Pain estimation from audio-visual fusion of non-speech sounds
Ghayoumi et al. Early Alzheimer’s detection using bidirectional LSTM and attention mechanisms in eye tracking
Sadiq et al. A context-aware dropout-based occlusion-adaptive network for robust facial landmark and emotion detection
EP4581575B1 (en) ESTIMATION OF LIQUID VOLUMES
EP4654211A1 (en) Medical imaging
Bhatt et al. Improving Student Stress Analysis: Novel Methods for Collecting, Preprocessing, and Fusing Features
CN115192003B (zh) 一种镇静水平的自动评估方法及相关产品
Ponmani et al. Enhancing Heart Rate Prediction Through Deep CNNs Using Facial Features from Non-Contact Video Analysis
EP4451224A1 (en) Heart valve leaflet modelling
Abawi et al. Unified Dynamic Scanpath Predictors Outperform Individually Trained Neural Models
US20250302352A1 (en) Devices, systems and methods of remote determination of physiological indices for a remote polygraph test

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23731688

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2024568030

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 202380046512.9

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 18875143

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2023731688

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

WWP Wipo information: published in national office

Ref document number: 202380046512.9

Country of ref document: CN

ENP Entry into the national phase

Ref document number: 2023731688

Country of ref document: EP

Effective date: 20250116

WWP Wipo information: published in national office

Ref document number: 2023731688

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 18875143

Country of ref document: US