CN107832719B - Tooth brushing analysis method and device and tooth brushing system - Google Patents

Tooth brushing analysis method and device and tooth brushing system Download PDF

Info

Publication number
CN107832719B
CN107832719B CN201711135423.4A CN201711135423A CN107832719B CN 107832719 B CN107832719 B CN 107832719B CN 201711135423 A CN201711135423 A CN 201711135423A CN 107832719 B CN107832719 B CN 107832719B
Authority
CN
China
Prior art keywords
user
tooth brushing
brushing
tooth
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201711135423.4A
Other languages
Chinese (zh)
Other versions
CN107832719A (en
Inventor
郎朗
李叶磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TIBET BANGONG LAKE TIBETAN MEDICINE DEVELOPMENT Co.,Ltd.
Original Assignee
Tibet Bangong Lake Tibetan Medicine Development Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tibet Bangong Lake Tibetan Medicine Development Co ltd filed Critical Tibet Bangong Lake Tibetan Medicine Development Co ltd
Priority to CN201711135423.4A priority Critical patent/CN107832719B/en
Publication of CN107832719A publication Critical patent/CN107832719A/en
Application granted granted Critical
Publication of CN107832719B publication Critical patent/CN107832719B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/22Social work

Abstract

The invention provides a tooth brushing analysis method, a tooth brushing analysis device and a tooth brushing system, and relates to the technical field of intelligent toothbrushes, wherein the method is executed by a user terminal, the user terminal is in communication connection with the intelligent toothbrush, and the method comprises the following steps: when the situation that the intelligent toothbrush is started by a user is monitored, identifying identity information of the user; determining the tooth brushing standard corresponding to the identity information; extracting tooth brushing characteristic information of a user through the intelligent toothbrush; the tooth brushing characteristic information comprises one or more of tooth brushing efficiency, tooth brushing effective time corresponding to each tooth brushing area, action frequency corresponding to each tooth brushing area, tooth brushing motion track, tooth brushing angle track and tooth brushing acceleration track; and generating a tooth brushing analysis report of the user according to the tooth brushing characteristic information of the user and the tooth brushing specification corresponding to the identity information. The invention can enable the user to clearly know the tooth brushing behavior of the user, is beneficial to standardizing the tooth brushing behavior of the user and improves the tooth brushing effect.

Description

Tooth brushing analysis method and device and tooth brushing system
Technical Field
The invention relates to the technical field of intelligent toothbrushes, in particular to a tooth brushing analysis method, a tooth brushing analysis device and a tooth brushing system.
Background
Toothbrushes are a daily necessity for people to clean teeth. However, studies have shown that most people do not have regular brushing behavior, resulting in poor brushing effect, and irregular brushing behavior can even wear teeth. Different people have different tooth brushing specifications due to different factors such as age, oral cavity state and the like. However, the existing tooth brushing people are difficult to determine whether the tooth brushing action is correct.
Disclosure of Invention
In view of the above, the present invention is to provide a tooth brushing analysis method, a tooth brushing analysis device and a tooth brushing system, so that a user can clearly understand the tooth brushing behavior of the user, the tooth brushing behavior can be normalized by the user, and the tooth brushing effect can be improved.
In order to achieve the above purpose, the embodiment of the present invention adopts the following technical solutions:
in a first aspect, an embodiment of the present invention provides a tooth analysis method, where the tooth analysis method is performed by a user terminal, and the user terminal is in communication connection with an intelligent toothbrush, where the method includes: when the situation that the intelligent toothbrush is started by a user is monitored, identifying identity information of the user; determining the tooth brushing standard corresponding to the identity information; extracting tooth brushing characteristic information of a user through the intelligent toothbrush; the tooth brushing characteristic information comprises one or more of tooth brushing efficiency, tooth brushing effective time corresponding to each tooth brushing area, action frequency corresponding to each tooth brushing area, tooth brushing motion track, tooth brushing angle track and tooth brushing acceleration track; and generating a tooth brushing analysis report of the user according to the tooth brushing characteristic information of the user and the tooth brushing specification corresponding to the identity information.
With reference to the first aspect, an embodiment of the present invention provides a first possible implementation manner of the first aspect, where the identifying identity information of the user includes: determining identity information of a user according to a brush holder number and/or a brush head number of the intelligent toothbrush; or, the biological characteristics of the user are collected through the intelligent toothbrush, and the identity information of the user is determined according to the biological characteristics; wherein the biometric characteristic comprises a fingerprint characteristic or an iris characteristic; or, collecting identity information input by a user through the intelligent toothbrush; or after the tooth brushing characteristic information of the user is extracted, comparing the tooth brushing characteristic information with a pre-stored characteristic template library to determine the identity information of the user corresponding to the tooth brushing characteristic information; the feature template library stores the corresponding relation between the identity information of the user and the tooth brushing feature template, and the tooth brushing feature template is generated based on the tooth brushing feature information of the user for multiple times.
With reference to the first possible implementation manner of the first aspect, an embodiment of the present invention provides a second possible implementation manner of the first aspect, wherein the step of comparing the brushing characteristic information with a pre-stored characteristic template library to determine identity information of a user corresponding to the brushing characteristic information includes: inputting the tooth brushing characteristic information into a neural network obtained through machine learning training, and acquiring the matching degree of the tooth brushing characteristic information output by the neural network and each user; the machine learning comprises supervised learning, template matching learning or unsupervised clustering learning; and determining the identity information of the user corresponding to the tooth brushing characteristic information according to the matching degree.
With reference to the first possible implementation manner of the first aspect, an embodiment of the present invention provides a third possible implementation manner of the first aspect, where the method further includes: and updating the tooth brushing characteristic template corresponding to the user according to the current tooth brushing characteristic information of the user, the stored historical tooth brushing characteristic information of the user and a preset historical residue factor.
With reference to the first aspect, an embodiment of the present invention provides a fourth possible implementation manner of the first aspect, where the method further includes: determining the age of the user and the oral cavity condition of the user according to the identity information of the user; establishing a brushing regimen for the user based on the user's age and oral condition; storing the brushing profile of the user.
With reference to the first aspect, an embodiment of the present invention provides a fifth possible implementation manner of the first aspect, where the method further includes: and prompting the brushing tooth specification corresponding to the identity information of the user to the user in a video, image or voice mode.
With reference to the first aspect, an embodiment of the present invention provides a sixth possible implementation manner of the first aspect, where the method further includes: and when the identity of the user cannot be identified, prompting the user to enter new user information through the display screen and/or the player.
In a second aspect, an embodiment of the present invention further provides a tooth analysis device, where the tooth analysis device is disposed in a user terminal, and the user terminal is in communication connection with an intelligent toothbrush, where the tooth analysis device includes: the identity recognition module is used for recognizing identity information of the user when the situation that the intelligent toothbrush is started by the user is monitored; the standard determining module is used for determining the tooth brushing standard corresponding to the identity information; the characteristic extraction module is used for extracting tooth brushing characteristic information of a user through the intelligent toothbrush; the tooth brushing characteristic information comprises one or more of tooth brushing efficiency, tooth brushing effective time corresponding to each tooth brushing area, action frequency corresponding to each tooth brushing area, tooth brushing motion track, tooth brushing angle track and tooth brushing acceleration track; and the report generating module is used for generating a tooth brushing analysis report of the user according to the tooth brushing characteristic information of the user and the tooth brushing specification corresponding to the identity information.
In a third aspect, the embodiment of the present invention provides a tooth brushing system, which includes a user terminal provided with the tooth brushing analysis device of the second aspect, and further includes an intelligent toothbrush in communication connection with the user terminal; the user terminal comprises a mobile phone, a tablet computer, a HUD device or a projection device.
With reference to the third aspect, an embodiment of the present invention provides a first possible implementation manner of the third aspect, where the third aspect further includes a server in communication connection with the user terminal, where the server is configured to interact information with the user terminal.
The embodiment of the invention provides a tooth brushing analysis method, a tooth brushing analysis device and a tooth brushing system, which can determine tooth brushing specifications corresponding to user identity information, and generate a tooth brushing analysis report of a user according to tooth brushing characteristic information of the user and the tooth brushing specifications extracted by an intelligent toothbrush. The mode can analyze the tooth brushing behavior of the user based on the tooth brushing specification corresponding to the user, so that the user can clearly know the tooth brushing behavior, the tooth brushing behavior can be normalized by the user, and the tooth brushing effect is improved.
Additional features and advantages of the disclosure will be set forth in the description which follows, or in part may be learned by the practice of the above-described techniques of the disclosure, or may be learned by practice of the disclosure.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 shows a block diagram of a user terminal according to an embodiment of the present invention;
FIG. 2 shows a front view of a HUD device provided by an embodiment of the present invention;
FIG. 3 shows a side view of a HUD device provided by an embodiment of the present invention;
FIG. 4 is a flow chart illustrating a method for analyzing teeth according to an embodiment of the present invention;
FIG. 5 is a schematic diagram illustrating a neural network-based identity recognition scheme according to an embodiment of the present invention;
FIG. 6 is a schematic structural view illustrating a tooth brushing analysis device according to an embodiment of the present invention;
FIG. 7 is a schematic structural view of a tooth brushing system provided by an embodiment of the present invention;
fig. 8 is a schematic structural view of another tooth brushing system provided by an embodiment of the present invention.
Icon:
1-head up display; 2-base.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
At present, most users are difficult to determine whether the tooth brushing behavior is correct or not, so that the tooth brushing effect is not good, and in order to improve the problem, the embodiment of the invention provides a tooth brushing analysis method, a tooth brushing analysis device and a tooth brushing system.
Referring to fig. 1, a block diagram of a user terminal is shown; the user terminal includes a processing unit 10, and a display unit 20, a storage unit 30, a communication unit 40, a human-computer interaction unit 50, and a power supply unit 60 respectively connected to the processing unit 10.
The man-machine interaction unit can comprise buttons, an input keyboard, a handwriting input screen and the like. It will be appreciated that the smart toothbrush described above may also include other structures, such as LED lights, etc.
The user terminal can be installed with contents guiding the user to brush teeth, such as games, animations, audio and the like, and can also store a brushing teeth database recorded with the user, brushing teeth characteristic information recorded with the user and the like in the storage unit. Meanwhile, various information of the user, such as the user name/nickname, the user age, the user gender, the user's past oral health record, and the like, may also be entered. When the method is applied specifically, relevant application software with the functions can be specially installed.
In one embodiment, the user terminal is a personal electronic communication device such as a mobile phone, a smart tablet, a wearable electronic device, and the like.
In another embodiment, the user terminal is a HUD (Head Up Display) device. This embodiment gives a specific example, referring to a front view of a HUD device shown in fig. 2 and a side view of a HUD device shown in fig. 3, showing a head-up display 1 and a base 2; among them, the base may be provided thereon with, for example, a switch button, a function button, etc., and the base may be internally provided with various function units such as a storage unit, a communication unit, a processing unit, and a power supply unit. After the condition that the user triggers the toothbrush is monitored, the user terminal activates a head-up display, and the head-up display can display corresponding contents according to the identity of the user or according to preset settings of the user, such as interactive games, animations and the like which guide the user to standardize actions when children brush teeth; when an adult brushes his/her teeth, the heads-up display may prompt information such as brushing regimen. In addition, the user terminal can provide functions of news feed, mail push and the like through the head-up display so as to be convenient for a user to check during tooth brushing, and the content displayed by the user terminal through the head-up display can be content of the terminal which is synchronous with a network or content pushed by built-in news software and the like.
In addition, in other embodiments, the user terminal may include a projection device or the like, or may be displayed by using HUD technology, but other projection carriers such as a mirror, a glass, a wall surface and the like may be used as the display terminal, so that the display terminal may not be separately provided.
The intelligent toothbrush connected with the user terminal comprises a processor, and a sensor, a memory, a wireless communication unit, a motor, a switch and the like which are respectively connected with the processor. The sensors may include accelerometers (accelerometers), gyroscopes (gyroscopes), magnetometers (magnetometers), brushhead pressure sensors (pressure sensors), and the like; the accelerator may be specifically a three-axis accelerator; the wireless communication unit can be a low-power Bluetooth module (BLUETOOTH module), a WIFI module, etc.; the motor may be an Ultrasonic motor (Ultrasonic motor). The intelligent toothbrush can collect tooth brushing characteristic information of a user through the functional components and send the tooth brushing characteristic information to the user terminal through the wireless communication unit.
Referring to fig. 4, a flowchart of a tooth analysis method executed by a user terminal, that is, described by way of example from a user terminal, the user terminal being in communication with an intelligent toothbrush, includes the following steps:
and step S402, when the situation that the intelligent toothbrush is started by the user is monitored, identifying the identity information of the user.
And step S404, determining the tooth brushing specification corresponding to the identity information.
Step S406, extracting tooth brushing characteristic information of a user through the intelligent toothbrush; the tooth brushing characteristic information comprises one or more of tooth brushing efficiency, tooth brushing effective time corresponding to each tooth brushing area, action frequency corresponding to each tooth brushing area, tooth brushing motion track, tooth brushing angle track and tooth brushing acceleration track. Wherein the brushing characteristic information can be obtained by each sensor in the intelligent toothbrush during the brushing process of the user using the intelligent toothbrush, such as analyzing the high frequency signal of the motion sensor to determine the brushing frequency.
And step S408, generating a tooth brushing analysis report of the user according to the tooth brushing characteristic information of the user and the tooth brushing specification corresponding to the identity information. In particular, the brushing analysis report can include the user's brushing characteristics information, data growth curves, brushing recommendations, and the like. The brushing analysis report may be generated every time, or according to a preset period, or according to a request of a user.
The tooth brushing analysis method provided by the embodiment of the invention can determine the tooth brushing specification corresponding to the user identity information, and generate the tooth brushing analysis report of the user according to the tooth brushing characteristic information of the user and the tooth brushing specification extracted by the intelligent toothbrush. The mode can analyze the tooth brushing behavior of the user based on the tooth brushing specification corresponding to the user, so that the user can clearly know the tooth brushing behavior, the tooth brushing behavior can be normalized by the user, and the tooth brushing effect is improved.
It should be noted that the brushing analysis method of the present invention is not limited by the specific sequence depicted in FIG. 4 and described below. It should be understood that in other embodiments, the order of some steps in the method may be interchanged according to actual needs, or some steps may be omitted or deleted. For example, there is no precedence relationship between step S402 and step S406, or between step S404 and step S406, and they are interchangeable in practical applications.
The embodiment further provides a mode that the user terminal acquires user data through the intelligent toothbrush, the intelligent toothbrush acquires all signals of the tooth brushing behavior of the user through an accelerator, a gyroscope, a magnetometer and the like, and can receive necessary data sent by the intelligent toothbrush according to preset conditions so as to save storage space.
The user terminal can also periodically transmit data acquired from the intelligent toothbrush and data generated by analysis of the user terminal, such as a tooth brushing analysis report and tooth brushing specifications corresponding to identity information, to the server, namely to the cloud, and store the data in a storage space corresponding to the user in the cloud. In one example, the user terminal is a personal device of a user such as a mobile phone and the like, and can store data and interact with each other; the user terminal can be provided with tooth brushing software, and data cloud transmission is carried out on the premise that the personal equipment is confirmed to be connected to the wireless network. In another example, the user terminal is a standalone terminal as shown in fig. 2; when each tooth brushing is completed, the independent terminal can synchronize data to the cloud terminal through the connected home wireless network. The data to be transmitted includes the individual ID of the user, the hardware ID information of the toothbrush, and the terminal information. The independent ID information of the user ensures that the data can be accurately imported into the cloud space of the corresponding user; the hardware ID information of the toothbrush can be used as reference data such as the frequency of brushhead replacement for a series of subsequent applications; the terminal information may be used as reference data for subsequent applications including user usage environment and the like. And if the cloud server detects that the user data is not synchronized for a long time, the cloud server can send a data synchronization prompt to the user terminal.
For step S402, the present embodiment provides the following four ways of identifying the identity information of the user:
the first method is as follows:
and determining the identity information of the user according to the brush handle number and/or the brush head number of the intelligent toothbrush.
When the intelligent toothbrush is in communication connection with the user terminal, the user terminal can determine the identity of the intelligent toothbrush, each intelligent toothbrush is provided with a unique identifier, and specifically, the brush holder number and the brush head number of the intelligent toothbrush are unique.
The smart toothbrush can be used as a device in the unit of home. Smart toothbrushes may comprise one or more handles; under the application that a plurality of people use one brush handle, family members change the brush head before brushing teeth, the identity of the members who use the brush head can be determined according to the matching information of the brush head and the brush handle, specifically, the brush handle number and/or the brush head number, and the brushing teeth data is recorded into the corresponding member database. In case there are multiple handles we can identify based on the brush head handle match information as well or just the handle number.
The second method comprises the following steps:
acquiring biological characteristics of a user through the intelligent toothbrush, and determining identity information of the user according to the biological characteristics; wherein the biometric characteristic comprises a fingerprint characteristic or an iris characteristic.
The intelligent toothbrush can be provided with a fingerprint acquisition area or an iris acquisition area and the like, and identity information of a user is determined based on biological identification modes such as fingerprint identification and iris identification.
The third method comprises the following steps:
and acquiring identity information input by a user through the intelligent toothbrush.
The intelligent toothbrush can be provided with a user identity input end, and a user can directly input own identity information on the intelligent toothbrush.
The method is as follows:
after the tooth brushing characteristic information of the user is extracted, comparing the tooth brushing characteristic information with a pre-stored characteristic template library to determine the identity information of the user corresponding to the tooth brushing characteristic information; the feature template library stores the corresponding relation between the identity information of the user and the tooth brushing feature template, and the tooth brushing feature template is generated based on the tooth brushing feature information of the user for multiple times. That is, the tooth brushing characteristic template is generated according to the tooth brushing habit of the user, and is different for different users.
In the fourth embodiment, the identification information for identifying the user in step S402 is not executed immediately, but the step S406 is preferentially executed, and the user is identified by matching the acquired tooth brushing characteristic information. Specifically, the user terminal identifies the tooth brushing actions of the user through quantification and feature extraction, and the tooth brushing actions of different users, such as frequency, hand-held toothbrush posture, tooth brushing specification of different areas and other detailed features are obviously distinguished; especially, the total number of members of a family user group is limited, and the identification complexity is greatly reduced.
When the machine learning mode is used for identification, the user terminal can input the tooth brushing characteristic information into the neural network obtained through machine learning training, and the matching degree of the tooth brushing characteristic information output by the neural network and each user is obtained; the machine learning comprises supervised learning, template matching learning or unsupervised clustering learning; and determining the identity information of the user corresponding to the tooth brushing characteristic information according to the matching degree.
In one example, a multi-layer neural network may be selected for user identification. Preselected tooth brushing characteristic information is input into the neural network. The neural network input is subjected to dimensionality reduction or feature nonlinear fusion by a feature dimensionality reduction method such as principal component analysis (principal component analysis), self-encoding network (autoencoder) or the like. See fig. 5 for oneIdentity recognition schematic diagram based on neural network, input characteristic (F)1~FM) Dimension reduction into features (f) by self-coding networks1~fN) Wherein M is greater than N. Performing nonlinear fitting by k layers of neural networks, wherein each layer of neural network comprises j sub-networks, and the first layer of neural network is b11~b1j(ii) a Layer k neural network is bk1~bkj. Converge to sm (softmax) activation unit (activation function). The output of this example is the probability (%) of different users, and as shown in the figure, the probability value of user 1, the probability value of user 2, and the probability value of user i are respectively output, if the output results are all lower than the probability threshold, then it is suggested that a new user may appear.
Considering that the brushing specification of the user changes with time and other factors, particularly the brushing action during childhood brushing is greatly improved, in order to make the brushing analysis more accurate and to specify a more reasonable brushing specification, the model can be iteratively updated: in one example, the historical residue factor can be considered, and the corresponding brushing characteristic template of the user can be updated according to the current brushing characteristic information of the user, the stored historical brushing characteristic information of the user and the preset historical residue factor. Specifically, for the updated brushing characteristics template of the user i, the following formula can be referred to:
the brushing characteristic template of the user i is mu, the current brushing characteristic information of the user i is + (1-mu), and the user i has the historical brushing characteristics.
When a new user appears, the brushing characteristic template of the user can be stable after the completion of a plurality of brushing activities through the iteration of the formula. In the above example, the user terminal can not only identify the user of the unknown user when the unknown device is present, but can also potentially remind the user to misuse another toothbrush.
For different users, there are brushing specifications specified for their own features. The method may further comprise pre-establishing a brushing profile for the user, and the specific steps are as follows:
(1) according to the identity information of the user, the age of the user and the oral condition of the user are determined. Specifically, the age and the oral condition corresponding to the identity information are stored in a user database of the user terminal. According to the identity of the user, the age and the oral condition of the user can be directly found.
(2) Based on the user's age and oral condition, a user's brushing regimen is established.
(3) Storing the brushing profile of the user.
Different people have different oral cavity conditions, and in order to achieve a better tooth brushing effect, corresponding tooth brushing standard adjustment can be carried out according to the historical oral cavity health conditions of the user aiming at different user objects. In one example, the user scans cases through a mobile phone camera or introduces oral treatment history through a user case interface logged in the user terminal, and if the user terminal detects that oral symptoms are recently appeared, the user terminal immediately updates the working state of the toothbrush. For example, when a gum bleeding symptom is detected in a certain area in the oral cavity of the user, the user terminal controls the intelligent toothbrush to automatically turn down the vibration intensity or turn off the motor manually when the intelligent toothbrush is detected to be close to the area.
In one example, the user object is a child in a tooth replacement period, and the user can be reminded to bypass the corresponding area or to adopt different brushing strengths according to the tooth replacement position of the oral cavity. The tooth changing condition of the oral cavity can be completed through manual input of a user in interactive software, and the tooth changing area can also be found through a camera sampling oral cavity image and utilizing an image analysis method. Methods of image analysis include, but are not limited to, anomaly detection (anomaly detection) and machine learning. In another example, a neural network is trained by using the tooth-changing image sample with labels in the database, wherein the feature extraction network samples the superposition of a convolutional network (convolutional network) and max pooling, and the fitting network is realized by a multilayer neural network. In the training sample, the taken oral cavity image is divided into blocks, namely, the oral cavity image is divided into a plurality of areas, the block (tooth changing area) containing tooth changing in the block picture is marked with 1, and other normal areas are marked with 0. When the toothbrush reaches the tooth changing area, the tooth brushing motor can automatically stop or remind the user; in the manual toothbrush example, a user terminal or an intelligent toothbrush embedded indicator light would generate the alert signal.
In addition, the user terminal can call the user anonymization historical data for big data analysis and feature mining under the condition of obtaining the user consent. In one example, the system collects all data nodes showing gum bleeding symptoms and brushing history data for a certain time window for causal analysis (cause analysis); the user terminal quantifies factors related to symptoms, such as brushing intensity, brushing duration, brushing type, etc., to further optimize the brushing regimen for the corresponding user. In another quantitative analysis, the user terminal classifies healthy people and people with certain oral diseases, and effective tooth brushing characteristic information capable of distinguishing the two groups of people is extracted through analysis of tooth brushing specifications before symptoms appear; the probability of onset of certain oral symptoms by a user in the case of substandard brushing specifications is predicted by designing a classification learning algorithm (e.g., logistic regression analysis, supervised machine learning network with soft-max output activation function).
In the above-described example, the user object is a child who brushes teeth at first study, and the user terminal sets the tendency to the formation of the brushing motion specification for the brushing specification of the child. In this application example, the brushing analysis and feedback for children is focused to the action specification growth curve: including the brushing frequency, brushing efficiency, brushing duration, effective area, etc. of the user. The children brushing teeth standard is formed, and when the toothbrush is initially used, the judgment of the brushing teeth standard is set to be an extremely wide range so as to ensure that a user has brushing teeth learning interest without frustration. In the brushing analysis report, the user terminal can judge whether the user reaches the development of the brushing standard or not by quantifying the characteristic parameter repeatability of a plurality of times of brushing events of the user. In one example, we predict the next brushing characteristics by regression analysis (regression analysis) of the user's brushing characteristics and compare them to the actual brushing characteristics after the next brushing event is completed. If the deviation between the predicted parameter and the actual measurement is within the set range for a plurality of consecutive times, the user can be determined that the brushing regimen was completed and is embodied in the brushing analysis report.
The brushing regimen can be formulated into a number of phases, depending on the age level of the user: in one example, the first phase is set to the creation of brushing active areas, and the user needs to cover each active brushing area of the mouth during a brushing event according to guidance and prompting; the second stage is set as standard formation of tooth brushing action, and the user forms correct tooth brushing standard in a designated area, such as the outer side of incisors, and the user needs to brush up and down along the vertical direction; the third phase is set to the development of brushing efficiency, and in combination with the previous specification development results, the user must complete the brushing events for all the active areas with the correct action specification and achieve the specified brushing efficiency. At different stages, we can achieve the guiding effect through different interactive contents.
In another example, the user object is an adult or a user who has developed a brushing regimen, and the setting of the user terminal is inclined toward supervision of brushing regularity and improvement of the regimen. In the data analysis link, a brushing analysis report is generated periodically or according to a user request. The brushing analysis reports include, but are not limited to, a user's brushing data tracking, brushing efficiency, completion of brushing over a time period, and a brushing regimen that incorporates the user's oral health or medical history, among others.
By the mode, the personalized tooth brushing specification for each user can be established, the tooth brushing behavior can be improved by combining the actual conditions of the user, and the tooth brushing efficiency is improved.
In order to better guide the user to brush teeth in a correct manner, the method provided by the embodiment further includes: and prompting the brushing tooth specification corresponding to the identity information of the user to the user in a video, image or voice mode. Specifically, the user can be prompted on a display screen of the user terminal in the modes of interactive games, animations, short-film prompts and the like, a correct tooth brushing picture can be displayed, or the user is instructed to brush teeth according to a correct tooth brushing mode and tooth brushing duration in a voice mode.
Considering that there may be a new user performing a tooth brushing operation by using the smart toothbrush, or an old user accessing a user terminal by using a new device, that is, there may be 1) a user replacing a new brush head 2) a user replacing a new brush handle 3) a new user joining, in order to better identify and enter a user identity, the method further includes: and when the identity of the user cannot be identified, prompting the user to enter new user information through the display screen and/or the player. In one example, a user terminal pops up a prompt of 'detecting new equipment' and an interactive window through a display screen, and options such as 'existing user list' and 'adding new members' are set in the interactive window; the user selects the corresponding option according to the addition reason. In another example, the user terminal pops up a reminder only after the first or few brushings after detecting a new device; the system firstly performs feature extraction and autonomous learning on the tooth brushing information of the new equipment in a machine learning mode, and compares the tooth brushing information with existing tooth brushing historical data of a user; the information of the pop-up prompt may be "is the new device user x? And "other options". In this example, the user need only make manual device entries if the user terminal identifies an error.
Referring to fig. 6, a schematic structural diagram of a tooth analysis apparatus is shown, the apparatus is disposed in a user terminal, and the user terminal is in communication connection with an intelligent toothbrush, and the apparatus includes:
the identity recognition module 602 is configured to recognize identity information of a user when it is monitored that the user activates the intelligent toothbrush;
the specification determining module 604 is configured to determine a brushing specification corresponding to the identity information;
a feature extraction module 606, configured to extract tooth brushing feature information of the user through the intelligent toothbrush; the tooth brushing characteristic information comprises one or more of tooth brushing efficiency, tooth brushing effective time corresponding to each tooth brushing area, action frequency corresponding to each tooth brushing area, tooth brushing motion track, tooth brushing angle track and tooth brushing acceleration track;
the report generating module 608 is configured to generate a brushing analysis report of the user according to the brushing characteristic information of the user and the brushing specification corresponding to the identity information.
The tooth brushing analysis device provided by the embodiment of the invention can determine the tooth brushing specification corresponding to the user identity information, and generate the tooth brushing analysis report of the user according to the tooth brushing characteristic information of the user and the tooth brushing specification extracted by the intelligent toothbrush. The mode can analyze the tooth brushing behavior of the user based on the tooth brushing specification corresponding to the user, so that the user can clearly know the tooth brushing behavior, the tooth brushing behavior can be normalized by the user, and the tooth brushing effect is improved.
The device provided by the embodiment has the same implementation principle and technical effect as the foregoing embodiment, and for the sake of brief description, reference may be made to the corresponding contents in the foregoing method embodiment for the portion of the embodiment of the device that is not mentioned.
Referring to fig. 7, a schematic structural diagram of a tooth brushing system includes a user terminal 100 provided with a tooth brushing analysis device, and further includes an intelligent toothbrush 200 communicatively connected to the user terminal 100;
the user terminal 100 includes a mobile phone, a tablet computer, a HUD device, or a projection device.
Referring to fig. 8, another toothbrush system is shown, which further includes a server 300 communicatively connected to the user terminal 100 on the basis of fig. 7, wherein the server 300 is configured to interact with the user terminal 100.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the system described above may refer to the corresponding process in the foregoing embodiments, and is not described herein again.
The tooth brushing analysis method, the tooth brushing analysis device and the computer program product of the tooth brushing system provided by the embodiment of the invention comprise a computer readable storage medium storing program codes, wherein instructions included in the program codes can be used for executing the method described in the previous method embodiment, and specific implementation can refer to the method embodiment and is not described herein again.
In addition, in the description of the embodiments of the present invention, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present invention, which are used for illustrating the technical solutions of the present invention and not for limiting the same, and the protection scope of the present invention is not limited thereto, although the present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present invention, and they should be construed as being included therein. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.

Claims (9)

1. A tooth analysis method, the method being performed by a user terminal communicatively coupled to an intelligent toothbrush, the method comprising:
when it is monitored that a user starts the intelligent toothbrush, identifying identity information of the user;
determining the tooth brushing specification corresponding to the identity information;
extracting tooth brushing characteristic information of the user through the intelligent toothbrush; the tooth brushing characteristic information comprises one or more of tooth brushing efficiency, tooth brushing effective time corresponding to each tooth brushing area, action frequency corresponding to each tooth brushing area, tooth brushing motion track, tooth brushing angle track and tooth brushing acceleration track;
generating a tooth brushing analysis report of the user according to the tooth brushing characteristic information of the user and the tooth brushing specification corresponding to the identity information;
the method further comprises the following steps:
determining the age of the user and the oral condition of the user according to the identity information of the user;
establishing a brushing profile for the user based on the user's age and the oral condition;
storing the user's brushing profile.
2. The method of claim 1, wherein the step of identifying the identity information of the user comprises:
determining identity information of the user according to a brush holder number and/or a brush head number of the intelligent toothbrush;
alternatively, the first and second electrodes may be,
collecting biological characteristics of the user through the intelligent toothbrush, and determining identity information of the user according to the biological characteristics; wherein the biometric characteristic comprises a fingerprint characteristic or an iris characteristic;
alternatively, the first and second electrodes may be,
collecting identity information input by the user through the intelligent toothbrush;
alternatively, the first and second electrodes may be,
after the tooth brushing characteristic information of the user is extracted, comparing the tooth brushing characteristic information with a pre-stored characteristic template library, and determining the identity information of the user corresponding to the tooth brushing characteristic information; the feature template library stores the corresponding relation between the identity information of the user and the tooth brushing feature template, and the tooth brushing feature template is generated based on the tooth brushing feature information of the user for multiple times.
3. The method of claim 2, wherein the step of comparing the brushing characteristics information with a pre-stored characteristics template library to determine the identity information of the user corresponding to the brushing characteristics information comprises:
inputting the tooth brushing characteristic information into a neural network obtained through machine learning training, and acquiring the matching degree of the tooth brushing characteristic information output by the neural network and each user; the machine learning comprises supervised learning, template matching learning or unsupervised clustering learning;
and determining the identity information of the user corresponding to the tooth brushing characteristic information according to the matching degree.
4. The method of claim 2, further comprising:
and updating the corresponding tooth brushing characteristic template of the user according to the current tooth brushing characteristic information of the user, the stored historical tooth brushing characteristic information of the user and a preset historical residual factor.
5. The method of claim 1, further comprising:
prompting the user of the tooth brushing specification corresponding to the identity information of the user in a video, image or voice mode.
6. The method of claim 1, further comprising:
and when the identity of the user cannot be identified, prompting the user to enter new user information through a display screen and/or a player.
7. The utility model provides a tooth analysis device, its characterized in that, the device sets up in user terminal, user terminal and intelligent toothbrush communication connection, the device includes:
the identity recognition module is used for recognizing identity information of a user when the situation that the user starts the intelligent toothbrush is monitored;
the standard determining module is used for determining the tooth brushing standard corresponding to the identity information;
the characteristic extraction module is used for extracting tooth brushing characteristic information of the user through the intelligent toothbrush; the tooth brushing characteristic information comprises one or more of tooth brushing efficiency, tooth brushing effective time corresponding to each tooth brushing area, action frequency corresponding to each tooth brushing area, tooth brushing motion track, tooth brushing angle track and tooth brushing acceleration track;
the report generating module is used for generating a tooth brushing analysis report of the user according to the tooth brushing characteristic information of the user and the tooth brushing specification corresponding to the identity information;
the apparatus further comprises a specification establishing module configured to:
determining the age of the user and the oral condition of the user according to the identity information of the user;
establishing a brushing profile for the user based on the user's age and the oral condition;
storing the user's brushing profile.
8. A tooth brushing system comprising a user terminal provided with the tooth brushing analysis device of claim 7, and further comprising a smart toothbrush communicatively connected to the user terminal;
the user terminal comprises a mobile phone, a tablet computer, a HUD device or a projection device.
9. The tooth brushing system according to claim 8 further comprising a server communicatively connected to the user terminal, the server for interacting with information with the user terminal.
CN201711135423.4A 2017-11-15 2017-11-15 Tooth brushing analysis method and device and tooth brushing system Active CN107832719B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711135423.4A CN107832719B (en) 2017-11-15 2017-11-15 Tooth brushing analysis method and device and tooth brushing system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711135423.4A CN107832719B (en) 2017-11-15 2017-11-15 Tooth brushing analysis method and device and tooth brushing system

Publications (2)

Publication Number Publication Date
CN107832719A CN107832719A (en) 2018-03-23
CN107832719B true CN107832719B (en) 2020-09-04

Family

ID=61652653

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711135423.4A Active CN107832719B (en) 2017-11-15 2017-11-15 Tooth brushing analysis method and device and tooth brushing system

Country Status (1)

Country Link
CN (1) CN107832719B (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108776827A (en) * 2018-05-24 2018-11-09 深圳缇铭科技有限公司 Identify the method and system for data of brushing teeth
CN109380860A (en) * 2018-11-09 2019-02-26 重庆仙桃前沿消费行为大数据有限公司 It is a kind of that the intelligent method for brushing teeth effectively brushed teeth and system are judged by duration
CN109222403A (en) * 2018-11-09 2019-01-18 重庆仙桃前沿消费行为大数据有限公司 A kind of intelligence method for brushing teeth and system
CN109222404A (en) * 2018-11-09 2019-01-18 重庆仙桃前沿消费行为大数据有限公司 It is a kind of that the intelligent method for brushing teeth effectively brushed teeth and system are judged by arc length
CN113168542A (en) * 2018-12-21 2021-07-23 宝洁公司 Device and method for operating a personal grooming appliance or a household cleaning appliance
BR112021012783A2 (en) * 2019-02-05 2021-09-14 Unilever Ip Holdings B.V. METHOD OF IDENTIFYING USERS OF A TOOTHBRUSH, TOOTHBRUSH MOVEMENT TRACKING SYSTEM AND COMPUTER PROGRAM
CN109965999B (en) * 2019-04-23 2022-05-17 北京小米移动软件有限公司 Method and device for controlling equipment operation
CN111281589B (en) * 2020-01-22 2021-12-28 京东方科技集团股份有限公司 Tooth brushing guidance method and device and toothbrush
CN111576562A (en) * 2020-02-28 2020-08-25 佛山市云米电器科技有限公司 Water outlet control method, intelligent water outlet equipment and storage medium
CN111726580B (en) * 2020-06-17 2022-04-15 京东方科技集团股份有限公司 Intelligent nursing mirror, intelligent nursing equipment, image display method and system
CN112051868A (en) * 2020-09-10 2020-12-08 湖北咿呀医疗投资管理股份有限公司 Method and system for positioning track of intelligent electric toothbrush
CN113325722B (en) * 2020-12-22 2024-03-26 广州富港生活智能科技有限公司 Multi-mode implementation method and device for intelligent cooking and intelligent cabinet
CN114948310A (en) * 2021-10-29 2022-08-30 青岛经济技术开发区海尔热水器有限公司 Tooth brushing method, server and control equipment of electric toothbrush
CN114299576A (en) * 2021-12-24 2022-04-08 广州星际悦动股份有限公司 Oral cavity cleaning area identification method, tooth brushing information input system and related device
CN114577259A (en) * 2022-02-08 2022-06-03 深圳市云顶信息技术有限公司 Tooth brushing information feedback method and device, electronic equipment and storage medium

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103565102A (en) * 2013-11-20 2014-02-12 江南大学 Toothbrush capable of judging tooth brushing actions and duration
CN204048584U (en) * 2014-04-30 2014-12-31 上海华博信息服务有限公司 A kind of Intelligent toothbrush system
CN104523000A (en) * 2014-11-28 2015-04-22 赵昊翔 Interactive intelligent toothbrush system
CN104765952A (en) * 2015-03-11 2015-07-08 成迪寒 Tooth-brushing posture detection and assessment system
CN105029891A (en) * 2015-08-19 2015-11-11 秦立新 Tooth brushing motion detecting and correcting method and system, toothbrush and remote control device
CN105590007A (en) * 2016-02-26 2016-05-18 馥德(上海)科技有限公司 Method and system for analyzing tooth brushing posture
CN105982430A (en) * 2016-04-26 2016-10-05 曾勇 Intelligent toothbrush
CN106213784A (en) * 2016-08-30 2016-12-14 北京易得道科技有限公司 A kind of toothbrush system and monitoring method of brushing teeth
CN106846745A (en) * 2017-02-23 2017-06-13 郑洪� Brush teeth system for prompting
CN107212940A (en) * 2017-04-25 2017-09-29 深圳市云顶信息技术有限公司 Control method, the control system of intelligent toothbrush

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103565102A (en) * 2013-11-20 2014-02-12 江南大学 Toothbrush capable of judging tooth brushing actions and duration
CN204048584U (en) * 2014-04-30 2014-12-31 上海华博信息服务有限公司 A kind of Intelligent toothbrush system
CN104523000A (en) * 2014-11-28 2015-04-22 赵昊翔 Interactive intelligent toothbrush system
CN104765952A (en) * 2015-03-11 2015-07-08 成迪寒 Tooth-brushing posture detection and assessment system
CN105029891A (en) * 2015-08-19 2015-11-11 秦立新 Tooth brushing motion detecting and correcting method and system, toothbrush and remote control device
CN105590007A (en) * 2016-02-26 2016-05-18 馥德(上海)科技有限公司 Method and system for analyzing tooth brushing posture
CN105982430A (en) * 2016-04-26 2016-10-05 曾勇 Intelligent toothbrush
CN106213784A (en) * 2016-08-30 2016-12-14 北京易得道科技有限公司 A kind of toothbrush system and monitoring method of brushing teeth
CN106846745A (en) * 2017-02-23 2017-06-13 郑洪� Brush teeth system for prompting
CN107212940A (en) * 2017-04-25 2017-09-29 深圳市云顶信息技术有限公司 Control method, the control system of intelligent toothbrush

Also Published As

Publication number Publication date
CN107832719A (en) 2018-03-23

Similar Documents

Publication Publication Date Title
CN107832719B (en) Tooth brushing analysis method and device and tooth brushing system
CN102124493B (en) Face authentification device, person image search system, face authentification device control method
CN106956271B (en) Predict the method and robot of affective state
CN108778052A (en) Method and system for realizing optimal oral hygiene by the means of feedback
CN109117952B (en) Robot emotion cognition method based on deep learning
WO2014210210A1 (en) Method for classifying user motion
CN102982059A (en) Information processing apparatus, information processing method, and program
CN107729092B (en) Automatic page turning method and system for electronic book
CN107209807A (en) Pain management wearable device
CN109659009A (en) Motion management method, apparatus and electronic equipment
WO2016193824A1 (en) System and method for multimodal human state recognition
CN106469297A (en) Emotion identification method, device and terminal unit
CN108958482A (en) A kind of similitude action recognition device and method based on convolutional neural networks
CN109783656A (en) Recommended method, system and the server and storage medium of audio, video data
CN115274104A (en) Digital biomarker
KR20150000591A (en) System and method for lifestyle analysis
US11769077B2 (en) Methods and systems to characterize the user of a personal care device
CN110138638A (en) A kind of processing method and processing device of network flow
KR102285482B1 (en) Method and apparatus for providing content based on machine learning analysis of biometric information
KR20150001031A (en) Apparatus and method for modeling a personalized lifestyle
CN114169364A (en) Electroencephalogram emotion recognition method based on space-time diagram model
US11928163B2 (en) Apparatus, method and computer program for creating digital memories for a particular person
CN108629362A (en) A kind of learning behavior custom discovery quantization system and method towards mobile environment
CN108109628A (en) Information collecting method, device and electronic equipment
CN114842957A (en) Senile dementia auxiliary diagnosis system and method based on emotion recognition

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20200728

Address after: 355 200 No. 22 Pengjialan, Zhuxia Village, Tai Lao Shan Town, Fuding City, Ningde City, Fujian Province

Applicant after: Lin Zefeng

Address before: No. 1, No. 1, courtyard No. 9, Jiuxianqiao East Road, Chaoyang District, Beijing (No. 004 of the central office area of the Electronic City Science Park)

Applicant before: BEIJING LANGMENG TECHNOLOGY DEVELOPMENT Co.,Ltd.

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20200810

Address after: Kim Lhasa City West Tibet autonomous region 850000 No. 158 Metro Building 4 unit 2 WorldCom sunshine 3 Building No. 1

Applicant after: TIBET BANGONG LAKE TIBETAN MEDICINE DEVELOPMENT Co.,Ltd.

Address before: 355 200 No. 22 Pengjialan, Zhuxia Village, Tai Lao Shan Town, Fuding City, Ningde City, Fujian Province

Applicant before: Lin Zefeng

GR01 Patent grant
GR01 Patent grant