WO2022181907A1 - Procédé, appareil et système pour la fourniture d'informations nutritionnelles sur la base d'une analyse d'image de selles - Google Patents

Procédé, appareil et système pour la fourniture d'informations nutritionnelles sur la base d'une analyse d'image de selles Download PDF

Info

Publication number
WO2022181907A1
WO2022181907A1 PCT/KR2021/011368 KR2021011368W WO2022181907A1 WO 2022181907 A1 WO2022181907 A1 WO 2022181907A1 KR 2021011368 W KR2021011368 W KR 2021011368W WO 2022181907 A1 WO2022181907 A1 WO 2022181907A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
training
objects
stool
neural network
Prior art date
Application number
PCT/KR2021/011368
Other languages
English (en)
Korean (ko)
Inventor
전정욱
정윤석
Original Assignee
주식회사 넘버제로
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 넘버제로 filed Critical 주식회사 넘버제로
Publication of WO2022181907A1 publication Critical patent/WO2022181907A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/60—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to nutrition control, e.g. diets
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7271—Specific aspects of physiological measurement analysis
    • A61B5/7275—Determining trends in physiological measurement data; Predicting development of a medical condition based on physiological measurements, e.g. determining a risk factor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/90—Determination of colour characteristics
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/30—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/70—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients

Definitions

  • the following embodiments relate to a method, apparatus and system for providing nutritional information based on analysis of stool image.
  • Korea Patent Publication KR 10-2020-0141776 A discloses a method and apparatus for managing infant health using a stool image.
  • the prior literature includes the steps of collecting at least one or more of vital sign data and hospital record data along with stool images in a time-series manner for a preset time, and deriving stool status information through analysis of each collected stool image.
  • Steps Based on the stool condition information and the acquired data, generating and storing stool status information for determination by normal state, disease state and health condition in the user database, Afterwards, acquiring a stool image of infants; Thereafter, the step of generating stool status information through analysis of the acquired stool image, Determining whether or not matching stool status information for judgment within a preset threshold range exists in the user database; Disclosed is a fecal image-based health care method for infants and toddlers, which includes transmitting state determination information to a pre-registered user-side terminal.
  • the prior literature uses at least one or more of hospital record data, feeding record data, and vital sign data along with the stool image of infants and toddlers to generate stool status information for each condition of infants and toddlers, and then use the stool image based on this. By judging the condition of infants and young children, it can help manage the health of infants and young children.
  • Korean Patent Laid-Open Publication No. KR 10-2020-0119135 A discloses a stool state analysis method using a neural network module and a system therefor.
  • the prior literature discloses temperature information, humidity information for a predetermined time period from a temperature sensor, a humidity sensor, a gyro sensor, a gas sensor, and an image sensor installed in the mounting port of an automatic excrement treatment device mounted on the patient's body, respectively.
  • a processing unit configured to collect the patient's posture information, gas information, and image information to perform a pre-processing step on the collected information, and a temperature value that is input information output from the processing unit after the pre-processing step is performed;
  • a server comprising a neural network module that receives a humidity value, a posture value, a gas concentration value, the number of times of gas generation, and an image value and outputs a stool state value of the patient.
  • the prior literature may provide a method for analyzing the stool state of a patient using a neural network module and a server therefor.
  • Patent Document 1 Korean Patent Publication No. KR 10-2020-0141776 A
  • Patent Document 2 Korean Patent Publication No. KR 10-2020-0119135 A
  • Embodiments are intended to provide nutritional information based on stool image analysis.
  • Embodiments are intended to provide recommended food information based on necessary nutritional information.
  • Embodiments are intended to provide feedback on the digestive status after ingestion of food according to recommended food information.
  • a method for providing nutritional information based on analysis of stool image includes: obtaining stool images corresponding to identifiers; extracting lump objects, which are objects that have not been completely digested, from the stool images; Incomplete digestion of the chunk objects using a first neural network trained in advance based on first training chunk objects and first labels, wherein the first labels are information of foods corresponding to the training chunk objects. classifying into food information; and generating necessary nutrient information corresponding to the identifier based on incompletely digested food information corresponding to the lump objects.
  • the method may further include generating recommended food information corresponding to the identifier, based on the necessary nutrient information.
  • the method comprising: obtaining at least one second stool image after ingesting food according to the recommended food information; determining a digestion state of food according to the recommended food information by using the second stool image; generating feedback information on food according to the recommended food information based on the digestive state of the food; and providing the feedback information to a user corresponding to the identifier.
  • the obtaining of the stool images includes obtaining the stool images based on a predetermined period for obtaining stool images corresponding to the identifier and the number of stool images, wherein the predetermined period and The number of stool images may be predefined based on at least one of age, gender, breastfeeding status, and weight corresponding to the identifier.
  • the extracting of the lumped objects may include: detecting candidate objects having a specific pattern from the stool images; classifying the candidate objects as food or foreign substances using a second neural network learned in advance; and classifying the candidate object classified as food into a lump object.
  • a method comprising: obtaining first training stool images; extracting the first training chunk objects from the first training stool images; obtaining the first labels that are information of foods corresponding to the first training mass objects; applying the first training chunk objects to the first neural network to generate training outputs corresponding to the first training chunk objects; and training the first neural network based on the training outputs and the first labels.
  • the step of classifying the incompletely digested food information includes: acquiring sizes and numbers of the lump objects included in the stool images; and applying the obtained distribution information of sizes and numbers to a third neural network learned in advance to generate incompletely digested food information corresponding to the stool images.
  • a method comprising: obtaining training stool images; extracting the first training chunk objects from the training stool images; extracting first training distribution information, which is distribution information of sizes and numbers of the first training chunk objects, from the first training chunk objects; obtaining second labels that are incompletely digested food information corresponding to the first training distribution information; applying the first training distribution information to the third neural network to generate training outputs corresponding to the first training distribution information; and training the third neural network based on the training outputs and the second labels.
  • the forming of the necessary nutrient information corresponding to the identifier may include: weighting each of the lump objects in consideration of the sizes and numbers of the lump objects included in the stool images; calculating a digestibility index by summing the weights given for each necessary nutrient corresponding to each of the lump objects; and calculating a digestibility ranking of the identifier based on the digestibility index.
  • the computer program according to an embodiment of the present invention may be stored in a computer-readable recording medium to execute the above-described method for providing necessary nutritional information based on analysis of a stool image.
  • an apparatus for providing nutritional information based on stool image analysis comprising: a memory for acquiring and storing stool images corresponding to identifiers; and extracting lump objects that are incompletely digested objects from the feces images, and first training lump objects and first labels, wherein the first labels are information of foods corresponding to the training lump objects.
  • Classifying the lump objects into incompletely digested food information using a first neural network trained in advance based on It may include a processor that generates
  • Embodiments may provide necessary nutritional information based on a result of analysis of stool images of a plurality of users, and provide recommended food information based on necessary nutritional information to help each user to consume suitable food.
  • FIG. 1 is a diagram for explaining a system for providing nutritional information based on analysis of a stool image according to an embodiment.
  • FIG. 2 is a diagram for explaining learning of a neural network according to an embodiment of the present invention.
  • FIG 3 is an exemplary view of a stool image according to an embodiment of the present invention.
  • FIG. 4 is a diagram for explaining an apparatus for providing nutritional information according to an embodiment.
  • FIG. 5 is a flowchart of a method for providing necessary nutritional information according to an embodiment.
  • FIG. 6 is an exemplary diagram of a configuration of an apparatus according to an embodiment.
  • first or second may be used to describe various elements, these terms should be interpreted only for the purpose of distinguishing one element from another.
  • a first component may be termed a second component, and similarly, a second component may also be termed a first component.
  • the embodiments may be implemented in various types of products, such as personal computers, laptop computers, tablet computers, smart phones, televisions, smart home appliances, intelligent cars, kiosks, wearable devices, and the like.
  • An artificial intelligence (AI) system is a computer system that implements human-level intelligence, and unlike the existing rule-based smart system, the machine learns and makes decisions on its own. The more the AI system is used, the better the recognition rate and the more accurate understanding of user preferences, and the existing rule-based smart systems are gradually being replaced by deep learning-based AI systems.
  • Machine learning is an algorithm technology that categorizes/learns characteristics of input data by itself, and element technology uses machine learning algorithms such as deep learning to simulate functions such as cognition and judgment of the human brain. It consists of technical fields such as understanding, reasoning/prediction, knowledge expression, and motion control.
  • Linguistic understanding is a technology for recognizing and applying/processing human language/text, and includes natural language processing, machine translation, dialogue system, question and answer, and speech recognition/synthesis.
  • Visual understanding is a technology for recognizing and processing objects like human vision, and includes object recognition, object tracking, image search, human recognition, scene understanding, spatial understanding, image improvement, and the like.
  • Inferential prediction is a technology for logically reasoning and predicting by judging information, and includes knowledge/probability-based reasoning, optimization prediction, preference-based planning, and recommendation.
  • Knowledge expression is a technology that automatically processes human experience information into knowledge data, and includes knowledge construction (data generation/classification) and knowledge management (data utilization).
  • Motion control is a technology for controlling autonomous driving of a vehicle and movement of a robot, and includes motion control (navigation, collision, driving), manipulation control (action control), and the like.
  • FIG. 1 is a diagram for explaining a system for providing nutritional information based on analysis of a stool image according to an embodiment.
  • the system 100 for providing nutritional information based on fecal image analysis includes a plurality of user terminals 110-1, 110-2, ..., 110-n, a nutritional information providing device 120, and a database. 130 and a network N.
  • the database 130 is illustrated as being configured separately from the nutritional information providing apparatus 120 , the present invention is not limited thereto, and the database 130 may be provided in the nutritional information providing apparatus 120 .
  • the nutritional information providing apparatus 120 may include a plurality of neural networks for performing a machine learning algorithm.
  • Nutritional information providing device 120 a plurality of user terminals (110-1, 110-2, ..., 110-n) from any one user terminal (eg, 110-1) for a preset period of time Images can be obtained.
  • the nutritional information providing apparatus 120 provides a predetermined period (eg, 3 days, 1 week, 1 month, etc.) for acquiring stool images corresponding to the identifier and the number of stool images (eg, 10, 15, 100, etc.), the stool images may be acquired, and the predetermined period and the number of stool images are preset based on at least one of age, gender, breastfeeding status, and weight corresponding to the identifier. can be defined.
  • the nutritional information providing apparatus 120 obtains first training stool images, extracts first training mass objects from the first training stool images, and information on foods corresponding to the first training mass objects. obtain first labels , and apply the first training chunk objects to the first neural network to generate training outputs corresponding to the first training chunk objects, based on the training outputs and the first labels, 1 A neural network can be trained.
  • the nutritional information providing apparatus 120 may extract lump objects, which are objects that have not been completely digested, from the stool images obtained from the user terminal 110 - 1 .
  • the nutritional information providing apparatus 120 detects candidate objects having a specific pattern from stool images, classifies the candidate objects as food or foreign substances using a pre-learned second neural network, and Candidate objects classified as a lumped object can be classified.
  • the nutritional information providing apparatus 120 may classify the chunk objects into incompletely digested food information by using a first neural network previously learned based on the first training chunk objects and the first labels.
  • the first labels may indicate information of foods corresponding to the training mass objects.
  • the nutritional information providing apparatus 120 obtains the sizes and numbers of lump objects included in the stool images, and applies distribution information of the obtained sizes and numbers to a pre-learned neural network to obtain a stool image. It is possible to generate incompletely digested food information corresponding to them.
  • the nutritional information providing apparatus 120 extracts the first training chunk objects from the training stool images, and the distribution information of the sizes and numbers of the first training chunk objects from the first training chunk objects.
  • the nutritional information providing apparatus 120 may generate necessary nutrient information corresponding to the identifier based on the incompletely digested food information corresponding to the lump objects. According to an embodiment, the nutritional information providing apparatus 120 gives weight to each of the lump objects in consideration of the sizes and the number of lump objects included in the stool images, and a need corresponding to each of the lump objects.
  • the digestibility index is calculated by adding the weights given to each nutrient, and the digestibility ranking of the identifier can be calculated based on the digestibility index.
  • the nutritional information providing apparatus 120 may generate recommended food information corresponding to the identifier, based on the necessary nutrient information. According to an embodiment, the nutritional information providing apparatus 120 may generate recommended food information using a mapping table stored in the database 130 or may generate recommended food information using a pre-learned neural network. have.
  • the recommended food information may include information on health functional food, health food, and alternative food.
  • Health functional food refers to the processing of ingredients that can help health in the form of easily ingestible food
  • health food refers to food eaten to maintain and promote health
  • substitute food refers to food that is It can indicate foods that can be eaten.
  • the nutritional information providing device 120 acquires at least one second fecal image after consuming food according to the recommended food information, and determines the digestive status of the food according to the recommended food information by using the second fecal image, , it is possible to generate feedback information on food according to the recommended food information based on the digestion state of the food, and provide the feedback information to a user corresponding to the identifier.
  • Network a plurality of user terminals (110-1, 110-2, ..., 110-n), nutritional information providing device 120, database 130, and the like to perform wireless or wired communication between have.
  • the network includes long-term evolution (LTE), LTE Advanced (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), Wireless BroadBand (WiBro), wireless fidelity (WiFi), Bluetooth ( Bluetooth), near field communication (NFC), GPS (Global Positioning System), or GNSS (global navigation satellite system) may be configured to perform wireless communication.
  • the network may perform wired communication according to a method such as universal serial bus (USB), high definition multimedia interface (HDMI), recommended standard 232 (RS-232), or plain old telephone service (POTS). .
  • USB universal serial bus
  • HDMI high definition multimedia interface
  • RS-232 recommended standard 232
  • POTS plain old telephone service
  • the database 130 may store various data. Data stored in the database 130, a plurality of user terminals (110-1, 110-2, ..., 110-n), obtained by at least one component of the nutritional information providing apparatus 120, processed or , as data used may include software (eg: a program). Database 130 may include volatile and/or non-volatile memory. As an embodiment, the database 130 may include stool images acquired from a plurality of user terminals 110-1, 110-2, ..., 110-n, a lump object formed in the nutritional information providing device 120, and incomplete It is possible to store digested food information, necessary nutrient information, and the like.
  • the program is software stored in the database 130, a plurality of user terminals (110-1, 110-2, ..., 110-n) and an operating system for controlling the resources of the nutritional information providing apparatus (120) , middleware that provides various functions to the application so that the application and/or the application can utilize the resources of the plurality of user terminals 110-1, 110-2, ..., 110-n and the nutritional information providing apparatus 120, etc.
  • middleware that provides various functions to the application so that the application and/or the application can utilize the resources of the plurality of user terminals 110-1, 110-2, ..., 110-n and the nutritional information providing apparatus 120, etc.
  • AI artificial intelligence
  • ML Machine Learning
  • Artificial intelligence technology is an algorithm of machine learning that can analyze input data, learn the results of the analysis, and make judgments or predictions based on the results of the learning.
  • technologies that use machine learning algorithms to simulate functions such as cognition and judgment of the human brain can also be understood as a category of artificial intelligence.
  • technical fields such as verbal comprehension, visual comprehension, reasoning/prediction, knowledge expression, and motion control may be included.
  • Machine learning may refer to the process of training a neural network model using experience of processing data. With machine learning, computer software could mean improving its own data processing capabilities.
  • the neural network model is constructed by modeling the correlation between data, and the correlation may be expressed by a plurality of parameters.
  • a neural network model extracts and analyzes features from given data to derive correlations between data, and repeating this process to optimize parameters of a neural network model can be called machine learning.
  • a neural network model may learn a mapping (correlation) between an input and an output with respect to data given as an input/output pair.
  • the neural network model may learn the relationship by deriving regularity between the given data even when only input data is given.
  • the artificial intelligence learning model or neural network model may be designed to implement a human brain structure on a computer, and may include a plurality of network nodes that simulate neurons of a human neural network and have weights.
  • a plurality of network nodes may have a connection relationship with each other by simulating a synaptic activity of a neuron through which a neuron sends and receives a signal through a synapse.
  • a plurality of network nodes can exchange data according to a convolutional connection relationship while being located in layers of different depths.
  • the artificial intelligence learning model may be, for example, an artificial neural network model, a convolutional neural network model, or the like.
  • the AI learning model may be machine-learned according to a method such as supervised learning, unsupervised learning, reinforcement learning, or the like.
  • Machine learning algorithms for performing machine learning include Decision Tree, Bayesian Network, Support Vector Machine, Artificial Neural Network, Ada-boost. , Perceptron, Genetic Programming, Clustering, etc. may be used.
  • CNNs are a type of multilayer perceptrons designed to use minimal preprocessing.
  • CNN consists of one or several convolutional layers and general artificial neural network layers on top of it, and additionally utilizes weights and pooling layers. Thanks to this structure, CNN can fully utilize the input data of the two-dimensional structure. Compared with other deep learning structures, CNN shows good performance in both video and audio fields. CNNs can also be trained through standard back-passing. CNNs are easier to train than other feed-forward neural network techniques and have the advantage of using fewer parameters.
  • Convolutional networks are neural networks that contain sets of nodes with bound parameters.
  • overfitting is not important, and increasing the size of the network improves test accuracy.
  • Optimal use of computing resources becomes a limiting factor.
  • a distributed, scalable implementation of deep neural networks may be used.
  • FIG. 2 is a diagram for explaining learning of a neural network according to an embodiment of the present invention.
  • the learning apparatus may train the neural network 124 to extract lumped objects included in the stool images.
  • the learning apparatus may be a separate entity different from the nutritional information providing apparatus 120 , but is not limited thereto.
  • the neural network 124 includes an input layer 122 to which training samples are input and an output layer 126 to output training outputs, and can be trained based on differences between the training outputs and labels.
  • the labels may be defined based on lump objects, information on foods corresponding to the lump objects, and incompletely digested food information.
  • the neural network 124 is connected to a group of a plurality of nodes, and is defined by weights between the connected nodes and an activation function that activates the nodes.
  • the learning apparatus may train the neural network 124 using a Gradient Decent (GD) technique or a Stochastic Gradient Descent (SGD) technique.
  • the learning apparatus may use a loss function designed by the outputs and labels of the neural network.
  • the learning apparatus may calculate the training error using a predefined loss function.
  • the loss function may be predefined with labels, outputs and parameters as input variables, where the parameters may be set by weights in the neural network 124 .
  • the loss function may be designed in a Mean Square Error (MSE) form, an entropy form, or the like, and various techniques or methods may be employed in an embodiment in which the loss function is designed.
  • MSE Mean Square Error
  • the learning apparatus may find weights affecting the training error by using a backpropagation technique.
  • the weights are relationships between nodes in the neural network 124 .
  • the learning apparatus may use the SGD technique using labels and outputs to optimize the weights found through the backpropagation technique. For example, the learning apparatus may update the weights of the loss function defined based on the labels, outputs, and weights using the SGD technique.
  • the learning apparatus may acquire first training stool images and extract first training chunk objects from the first training stool images.
  • the learning apparatus may obtain pre-labeled information (first labels) for each of the first training mass objects, and may obtain first labels that are information of foods corresponding to the first training mass objects.
  • the learning apparatus may generate first training feature vectors based on appearance features, pattern features, and color features of the first training chunk objects.
  • Various methods may be employed for extracting the feature.
  • the learning apparatus may obtain training outputs by applying the first training feature vectors to the neural network 124 .
  • the learning apparatus may train the neural network 124 based on the training outputs and the first labels.
  • the learning apparatus may train the neural network 124 by calculating training errors corresponding to the training outputs and optimizing the connection relationships of nodes in the neural network 124 to minimize the training errors.
  • the nutritional information providing apparatus 120 may extract lump objects from the stool images using the trained neural network 124 .
  • the learning apparatus may acquire second training stool images and extract second training chunk objects from the second training stool images.
  • the learning apparatus may obtain pre-labeled information (second labels) for each of the second training mass objects, and may obtain second labels that are information on food or foreign substances corresponding to the second training mass objects. have.
  • the learning apparatus may generate second training feature vectors based on appearance features, pattern features, and color features of the second training chunk objects.
  • Various methods may be employed for extracting the feature.
  • the learning apparatus may obtain training outputs by applying the second training feature vectors to the neural network 124 .
  • the learning apparatus may train the neural network 124 based on the training outputs and the second labels.
  • the learning apparatus may train the neural network 124 by calculating training errors corresponding to the training outputs and optimizing the connection relationships of nodes in the neural network 124 to minimize the training errors.
  • the nutritional information providing apparatus 120 may extract lump objects from the stool images using the trained neural network 124 .
  • the learning apparatus may acquire third training stool images and extract third training chunk objects from the third training stool images.
  • the learning apparatus may extract first training distribution information that is distribution information of sizes and numbers of the third training chunk objects from the third training chunk objects.
  • the learning apparatus may obtain pre-labeled information (third labels) for each of the first training distribution information, and may obtain third labels that are incompletely digested food information corresponding to the first training distribution information.
  • the learning apparatus may generate third training feature vectors based on appearance features, pattern features, and color features of the first training distribution information.
  • Various methods may be employed for extracting the feature.
  • the learning apparatus may obtain training outputs by applying the third training feature vectors to the neural network 124 .
  • the learning apparatus may train the neural network 124 based on the training outputs and the third labels.
  • the learning apparatus may train the neural network 124 by calculating training errors corresponding to the training outputs and optimizing the connection relationships of nodes in the neural network 124 to minimize the training errors.
  • the nutritional information providing apparatus 120 may extract incompletely digested food information from the stool images by using the learned neural network 124 .
  • the learning apparatus may acquire fourth training stool images and extract fourth training chunk objects from the fourth training stool images.
  • the learning apparatus may extract fourth training incompletely digested food information from the fourth training chunk objects.
  • the learning apparatus may acquire pre-labeled information (fourth labels) for each of the fourth training incompletely digested food information, and the fourth training, health functional food, health food corresponding to the fourth training incompletely digested food information.
  • the fourth labels which are information of substitute foods, may be obtained.
  • Health functional food refers to the processing of ingredients that can help health in the form of easily ingestible food
  • health food refers to food eaten to maintain and promote health
  • substitute food refers to food that is It can indicate foods that can be eaten.
  • the learning apparatus may generate the fourth training feature vectors based on the appearance features, pattern features, and color features of the fourth training fourth training incompletely digested food information.
  • Various methods may be employed for extracting the feature.
  • the learning apparatus may obtain training outputs by applying the fourth training feature vectors to the neural network 124 .
  • the learning apparatus may train the neural network 124 based on the training outputs and the fourth labels.
  • the learning apparatus may train the neural network 124 by calculating training errors corresponding to the training outputs and optimizing the connection relationships of nodes in the neural network 124 to minimize the training errors.
  • the nutritional information providing apparatus 120 may extract necessary nutritional information from the stool images by using the learned neural network 124 .
  • FIG 3 is an exemplary view of a stool image according to an embodiment of the present invention.
  • the nutritional information providing apparatus 120 is an object that has not been completely digested from stool images obtained from a plurality of user terminals 110-1, 110-2, ..., 110-n. It is possible to extract the lumped objects (MO). According to an embodiment, the nutritional information providing apparatus 120 detects candidate objects having a specific pattern from the acquired stool images, classifies the candidate objects as food or foreign substances using a pre-learned neural network, and It is possible to extract those classified as lumped objects (MO).
  • Digestible food may vary from infant to infant according to the state in which teeth and digestive organs are formed during the growth of infants. Some infants cannot digest broccoli, and some cannot digest carrots. Foods that infants cannot digest are directly discharged into feces, and the nutritional information providing apparatus 120 may extract these indigestible foods from the feces image. According to an embodiment, the nutritional information providing apparatus 120 may label and learn the classification of lump objects based on a machine learning algorithm such as deep learning, and perform classification according to the learned model. have.
  • a machine learning algorithm such as deep learning
  • the nutritional information providing apparatus 120 receives a first part stool image from the first user terminal (eg, 110-1), and a second user account is logged in.
  • a second part stool image is received from the user terminal (eg, 110-2), a first stool image is generated by combining the first part stool image and the second part stool image, and a first stool image is obtained from the first stool image.
  • a first ratio that is a ratio occupied by the part stool image is obtained
  • a second ratio that is a ratio that the second part stool image occupies in the first stool image is obtained, and when it is confirmed that the first ratio is greater than the second ratio, the first
  • the information of the user account is registered as the first author information of the first credit image
  • the information of the second user account is registered as the second author information of the first credit image
  • register the information of the second user account as the first author information of the first credit image register the information of the first user account as the second author information of the first credit image
  • the information of the first user account is added to the second stool image of the first stool image.
  • Register as 1 author information register the information of the second user account as the second author information of the first credit image, and register the third user terminal (eg, 110-n) as the original author of the first credit image
  • Registers the logged-in third user account information as third author information indicating the third author of the first credit image, and when it is confirmed that the first ratio is smaller than the second ratio, the information of the second user account is transferred to the first credit first authoring of the image Child information may be registered, information of the first user account may be registered as second author information of the first credit image, and information of the third user account may be registered as third author information of the first credit image.
  • FIG. 4 is a diagram for explaining an apparatus for providing nutritional information according to an embodiment.
  • the nutritional information providing apparatus 120 may include one or more processors 121 , one or more memories 123 and/or a transceiver 125 . As an embodiment, at least one of these components of the nutritional information providing apparatus 120 may be omitted, or other components may be added to the nutritional information providing apparatus 120 . Additionally or alternatively, some components may be integrated and implemented, or may be implemented as a singular or a plurality of entities. At least some of the components inside and outside the nutritional information providing device 120 are connected to each other through a bus, general purpose input/output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI). It can be connected to send and receive data and/or signals.
  • GPIO general purpose input/output
  • SPI serial peripheral interface
  • MIPI mobile industry processor interface
  • the one or more processors 121 may control at least one component of the nutritional information providing apparatus 120 connected to the processor 121 by driving software (eg, an instruction, a program, etc.). In addition, the processor 121 may perform various operations, processing, data generation, processing, etc. related to the present invention. In addition, the processor 121 may load data or the like from one or more memories 123 or store it in one or more memories 123 .
  • driving software eg, an instruction, a program, etc.
  • the processor 121 may perform various operations, processing, data generation, processing, etc. related to the present invention.
  • the processor 121 may load data or the like from one or more memories 123 or store it in one or more memories 123 .
  • the one or more processors 121 through the transceiver 125, a plurality of user terminals (110-1, 110-2, ..., 110-n) any one of the user terminals (eg, 110) It is possible to receive the stool images from -1) in the form of digital packets in real time or in non-real time.
  • the one or more processors 121 may extract lump objects, which are objects that have not been completely digested, by using the stool images received from the user terminal 110 - 1 through the transceiver 125 .
  • the one or more processors 121 obtain first training stool images, extract first training mass objects from the first training mass objects, obtaining first labels that are information, applying the first training chunk objects to the first neural network, to generate training outputs corresponding to the first training chunk objects, based on the training outputs and the first labels,
  • the first neural network may be trained to extract lumped objects from stool images.
  • the one or more processors 121 may classify the chunk objects into incompletely digested food information using the first neural network pre-trained based on the first training chunk objects and the first labels.
  • the first labels may indicate information of foods corresponding to training chunk objects.
  • the one or more processors 121 may generate necessary nutrient information corresponding to the identifier based on the incompletely digested food information corresponding to the lump objects.
  • One or more memories 123 may store various data.
  • Data stored in the memory 123 is data obtained, processed, or used by at least one component of the nutritional information providing apparatus 120 , and may include software (eg, instructions, programs, etc.). .
  • Memory 123 may include volatile and/or non-volatile memory.
  • the command or program is software stored in the memory 123 , and an operating system, an application and/or an application for controlling the resources of the nutritional information providing apparatus 120 utilize the resources of the nutritional information providing apparatus 120 . It may include middleware, etc. that provides various functions to applications.
  • the one or more memories 123 may include stool images received through the network N from the plurality of user terminals 110-1, 110-2, ..., 110-n described above, and a lump formed by the one or more processors 121 . It is possible to store objects, incompletely digested food information, necessary nutrient information, and the like. Also, the one or more memories 123 may store instructions that, when executed by the one or more processors 121 , cause the one or more processors 121 to perform an operation.
  • the nutritional information providing apparatus 120 may further include a transceiver 125 .
  • Transceiver 125 a plurality of user terminals (110-1, 110-2, ..., 110-n), nutritional information providing device 120, database 130, and / or wireless or wired communication between other devices can be done
  • the transceiver 126 may include enhanced Mobile Broadband (eMBB), Ultra Reliable Low-Latency Communications (URLLC), Massive Machine Type Communications (MMTC), long-term evolution (LTE), LTE Advance (LTE-A), UMTS (Universal Mobile Telecommunications System), GSM (Global System for Mobile communications), CDMA (code division multiple access), WCDMA (wideband CDMA), WiBro (Wireless Broadband), WiFi (wireless fidelity), Bluetooth (Bluetooth), NFC ( Near field communication), a global positioning system (GPS), or a global navigation satellite system (GNSS) may perform wireless communication.
  • the transceiver 125 may perform wired communication according to a method such as universal serial bus (US), Ultra Reliable
  • one or more processors 121 control the transceiver 125 to obtain information from a plurality of user terminals 110-1, 110-2, ..., 110-n, and the nutritional information providing device 120 . can do. Information obtained from a plurality of user terminals 110-1, 110-2, ..., 110-n, and the nutritional information providing apparatus 120 may be stored in one or more memories 123 .
  • the nutritional information providing apparatus 120 may be of various types.
  • the nutritional information providing device 120 may be a portable communication device, a computer device, or a device according to a combination of one or more of the above devices.
  • the nutritional information providing device 120 of the present invention is not limited to the aforementioned devices.
  • Various embodiments of the nutritional information providing apparatus 120 according to the present invention may be combined with each other. Each of the embodiments may be combined according to the number of cases, and embodiments of the nutritional information providing apparatus 120 made in combination also fall within the scope of the present invention.
  • the above-described internal/external components of the nutritional information providing apparatus 120 according to the present invention may be added, changed, replaced, or deleted according to embodiments.
  • internal/external components of the nutritional information providing apparatus 120 described above may be implemented as hardware components.
  • the nutritional information providing apparatus 120 may collect stool images of a specific infant (A). For example, the nutritional information providing apparatus 120 may designate a period to collect stool images for a corresponding period, or designate a number to collect the corresponding number of stool images.
  • the nutritional information providing apparatus 120 may form a stool list (including M pieces of stool information) of a specific infant A using the collected stool images, and may extract lump objects from each of the collected stool images. .
  • the lump objects may represent a piece of food that has not been fully digested in a specific infant (A).
  • the nutritional information providing apparatus 120 may detect a specific pattern region based on a color or shape of the collected stool images.
  • the nutritional information providing device 120 determines foods (eg, carrots, broccoli, etc.) that are continuously incompletely digested from the M stools of a specific infant (A), and from the result of the determination, it is necessary for a specific infant (A).
  • Nutrient information can be derived.
  • the nutritional information providing apparatus 120 may label the food for each lump object and classify the lump objects using a machine learning algorithm such as deep learning based on color, shape, or the like.
  • the nutritional information providing apparatus 120 may recommend (curate) an optimal health functional food or alternative food combination to a specific infant A from the derived nutrient information.
  • the nutritional information providing device 120 may re-analyze the digestive state of the optimal health functional food or alternative food combination and provide the result to the guardian of the specific infant A as feedback.
  • the nutritional information providing apparatus 120 may derive nutritional information necessary for a specific infant A based on the size and number of repeated lump objects based on the distribution of lump objects extracted from the collected stool images.
  • FIG. 5 is a flowchart of a method for providing necessary nutritional information according to an embodiment.
  • step S510 stool images corresponding to the identifier are obtained.
  • the nutritional information providing apparatus 120 includes any one user terminal (eg, a plurality of user terminals 110-1, 110-2, ..., 110-n). For example, it is possible to obtain stool images from 110-1) through the network N.
  • step S520 lump objects, which are objects that have not been completely digested, are extracted from the stool images.
  • the nutritional information providing apparatus 120 may extract lump objects, which are objects that have not been completely digested, from the stool images obtained in step S510 .
  • the nutritional information providing apparatus 120 may extract lump objects from the stool images using a pre-trained neural network.
  • step S530 the lump objects are classified into incompletely digested food information by using the first neural network learned in advance based on the first training objects and the first labels.
  • the nutritional information providing apparatus 120 extracts in step S520 using a first neural network learned in advance based on first training objects and first labels.
  • the lumped objects can be classified as incompletely digested food information.
  • step S540 the necessary nutrient information corresponding to the identifier is formed based on the incompletely digested food information corresponding to the lump objects.
  • the nutritional information providing apparatus 120 may provide necessary nutrient information corresponding to a specific identifier based on incompletely digested food information corresponding to the lump objects classified in step S530. can create
  • FIG. 6 is an exemplary diagram of a configuration of an apparatus according to an embodiment.
  • the device 401 includes a processor 402 and a memory 403 .
  • the device 401 may be the above-described server or terminal.
  • the processor may include at least one of the devices described above with reference to FIGS. 1 to 5 , or may perform at least one method described above with reference to FIGS. 1 to 5 .
  • the memory 403 may store information related to the above-described method or may store a program in which the above-described method is implemented.
  • Memory 403 may be volatile memory or non-volatile memory.
  • the processor 402 may execute a program and control the device 401 .
  • the code of the program executed by the processor 402 may be stored in the memory 403 .
  • the device 401 may be connected to an external device (eg, a personal computer or a network) through an input/output device (not shown) and exchange data.
  • the embodiments described above may be implemented by a hardware component, a software component, and/or a combination of a hardware component and a software component.
  • the apparatus, methods and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate (FPGA). array), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions, may be implemented using one or more general purpose or special purpose computers.
  • the processing device may execute an operating system (OS) and one or more software applications running on the operating system.
  • the processing device may also access, store, manipulate, process, and generate data in response to execution of the software.
  • OS operating system
  • the processing device may also access, store, manipulate, process, and generate data in response to execution of the software.
  • the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that may include For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.
  • the method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium.
  • the computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination.
  • the program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and available to those skilled in the art of computer software.
  • Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic such as floppy disks.
  • - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like.
  • Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.
  • the hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.
  • the software may comprise a computer program, code, instructions, or a combination of one or more thereof, which configures a processing device to operate as desired or is independently or collectively processed You can command the device.
  • the software and/or data may be any kind of machine, component, physical device, virtual equipment, computer storage medium or device, to be interpreted by or to provide instructions or data to the processing device. , or may be permanently or temporarily embody in a transmitted signal wave.
  • the software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Biomedical Technology (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Pathology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • Biophysics (AREA)
  • Evolutionary Computation (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Nutrition Science (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Radiology & Medical Imaging (AREA)
  • Geometry (AREA)
  • Physiology (AREA)
  • Psychiatry (AREA)
  • Signal Processing (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Computational Linguistics (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
  • Investigating Or Analysing Biological Materials (AREA)
  • Image Analysis (AREA)

Abstract

L'invention concerne un procédé, un appareil et un système pour la fourniture d'informations nutritionnelles nécessaires sur la base d'une analyse d'image de selles. Le procédé pour la fourniture d'informations nutritionnelles nécessaires sur la base d'une analyse d'image de selles, selon un mode de réalisation, consiste à : obtenir des images de selles correspondant à un identifiant ; extraire des objets de morceaux, qui sont des objets qui n'ont pas été complètement digérés, à partir des images de selles ; classer les objets de morceaux en fragments d'informations d'aliments incomplètement digérés en utilisant un premier réseau neuronal entraîné à l'avance sur la base de premiers objets de morceaux d'entraînement et de premières étiquettes, les premières étiquettes étant des fragments d'informations concernant des aliments correspondant à des objets de morceaux d'entraînement ; et générer des informations nutritionnelles nécessaires correspondant à l'identifiant, sur la base des fragments d'informations d'aliments incomplètement digérés correspondant aux objets de morceaux.
PCT/KR2021/011368 2021-02-24 2021-08-25 Procédé, appareil et système pour la fourniture d'informations nutritionnelles sur la base d'une analyse d'image de selles WO2022181907A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2021-0024538 2021-02-24
KR1020210024538A KR102288151B1 (ko) 2021-02-24 2021-02-24 대변 이미지 분석 기반 영양 정보 제공 방법,　장치 및 시스템

Publications (1)

Publication Number Publication Date
WO2022181907A1 true WO2022181907A1 (fr) 2022-09-01

Family

ID=77313969

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2021/011368 WO2022181907A1 (fr) 2021-02-24 2021-08-25 Procédé, appareil et système pour la fourniture d'informations nutritionnelles sur la base d'une analyse d'image de selles

Country Status (2)

Country Link
KR (6) KR102288151B1 (fr)
WO (1) WO2022181907A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102288151B1 (ko) * 2021-02-24 2021-08-11 주식회사 넘버제로 대변 이미지 분석 기반 영양 정보 제공 방법,　장치 및 시스템

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20150119334A (ko) * 2013-02-18 2015-10-23 테라노스, 인코포레이티드 생체시료의 이미지 분석 및 측정
KR20160061856A (ko) * 2014-11-24 2016-06-01 삼성전자주식회사 객체 인식 방법 및 장치, 및 인식기 학습 방법 및 장치
KR20190027196A (ko) * 2017-09-06 2019-03-14 한국과학기술연구원 음식 이미지 인식을 이용한 영양분 분석 방법 및 장치
KR20200119135A (ko) * 2019-04-09 2020-10-19 주식회사 큐라코 신경망 모듈을 이용한 대변상태 분석방법 및 이를 위한 시스템
KR20200141776A (ko) * 2019-06-11 2020-12-21 김민후 대변 이미지를 이용한 영유아 건강 관리 방법 및 장치
KR102288151B1 (ko) * 2021-02-24 2021-08-11 주식회사 넘버제로 대변 이미지 분석 기반 영양 정보 제공 방법,　장치 및 시스템

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20150119334A (ko) * 2013-02-18 2015-10-23 테라노스, 인코포레이티드 생체시료의 이미지 분석 및 측정
KR20160061856A (ko) * 2014-11-24 2016-06-01 삼성전자주식회사 객체 인식 방법 및 장치, 및 인식기 학습 방법 및 장치
KR20190027196A (ko) * 2017-09-06 2019-03-14 한국과학기술연구원 음식 이미지 인식을 이용한 영양분 분석 방법 및 장치
KR20200119135A (ko) * 2019-04-09 2020-10-19 주식회사 큐라코 신경망 모듈을 이용한 대변상태 분석방법 및 이를 위한 시스템
KR20200141776A (ko) * 2019-06-11 2020-12-21 김민후 대변 이미지를 이용한 영유아 건강 관리 방법 및 장치
KR102288151B1 (ko) * 2021-02-24 2021-08-11 주식회사 넘버제로 대변 이미지 분석 기반 영양 정보 제공 방법,　장치 및 시스템

Also Published As

Publication number Publication date
KR20220121157A (ko) 2022-08-31
KR20220121153A (ko) 2022-08-31
KR102546807B1 (ko) 2023-06-22
KR20220121156A (ko) 2022-08-31
KR20220121154A (ko) 2022-08-31
KR102288151B1 (ko) 2021-08-11
KR102546353B1 (ko) 2023-06-22
KR102615445B1 (ko) 2023-12-20
KR102546349B1 (ko) 2023-06-21
KR20220121155A (ko) 2022-08-31
KR102546355B1 (ko) 2023-06-21

Similar Documents

Publication Publication Date Title
CN112288075B (zh) 一种数据处理方法及相关设备
CN116415654A (zh) 一种数据处理方法及相关设备
WO2018212584A2 (fr) Procédé et appareil de classification de catégorie à laquelle une phrase appartient à l'aide d'un réseau neuronal profond
Almutairi et al. Detecting elderly behaviors based on deep learning for healthcare: Recent advances, methods, real-world applications and challenges
CN113673244A (zh) 医疗文本处理方法、装置、计算机设备和存储介质
KR102494373B1 (ko) 기저귀 대변 이미지를 활용한 아기 건강 진단 솔루션 제공 방법, 장치 및 시스템
WO2022181907A1 (fr) Procédé, appareil et système pour la fourniture d'informations nutritionnelles sur la base d'une analyse d'image de selles
Huu et al. Proposal gesture recognition algorithm combining cnn for health monitoring
Tanwani et al. Sequential robot imitation learning from observations
Li et al. Act as what you think: Towards personalized eeg interaction through attentional and embedded lstm learning
Zhu et al. Human activity recognition based on a modified capsule network
Luo et al. Knowledge grounded conversational symptom detection with graph memory networks
Weng et al. Emergent Turing machines and operating systems for brain-like auto-programming for general purposes
Goyal et al. Internet of things information analysis using fusion based learning with deep Neural Network
KR102430959B1 (ko) 인공지능 기반 식물 정보 큐레이션 서비스 제공 방법, 장치 및 시스템
WO2021137395A1 (fr) Système et procédé de classification de comportement problématique reposant sur un algorithme de réseau de neurones profond
KR102330859B1 (ko) 반려 동물의 대변 이미지 분석 정보 제공 방법,　장치 및 시스템
KR102142585B1 (ko) 반려 동물 의료상담 방법 및 장치
Nguyen et al. Swarm filter-a simple deep learning component inspired by swarm concept
KR102478367B1 (ko) 이미지 인식 기반 음원 매칭 및 추천 방법, 장치 및 시스템
Harish et al. Forecasting of Congestive Cardiac Failure Using Deep Learning Algorithms
KR102422255B1 (ko) 인공지능 기반 연애 상담 서비스 제공 방법, 장치 및 시스템
Sethuraman et al. Semantic web service-based messaging framework for prediction of fitness data using Hadoop distributed file system
Han et al. Utilizing Quantum Particle Swarm Optimization for Multimodal Fusion of Gestures and Facial Expressions in Ensemble Conducting for Emotional Recognition
MEIER Project Number: 284941 Project Title: Human Brain Project

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21928201

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 17/01/2024)