WO2020069500A1 - Smart health expert and manager - Google Patents

Abstract

The expert system uses proven and reliable human health data and the user's and the user's household's health information and other information such as food preferences, habits and religion, as a baseline for health analysis and recommendation. The expert system tracks and records, using AI technologies, all meals, physical activities and the users' biometrics, health information and medical records, and analyzes this information to identify the relationship among the many factors to establish the user's and the user's household's personally optimal nutritional needs, physical activities amount and intensity, lifestyle and environmental factors for each individual user. Using the baseline and the personalized health parameters, the expert system can provide the user and the user's household customizable and completely personalized meals, physical activities, lifestyle and environment recommendations and guidance in order to help the user to achieve lifelong optimal health and prevent contracting diseases and disorders.

Description

SMART HEALTH EXPERT AND MANAGER

Background

The present invention relates generally to help users achieve or maintain their ideal health conditions throughout their lives. More particularly, the present invention is a system and method for recording, tracking, calculating, analyzing, guiding, recommending and managing of every user's daily life and biometrics and other health impacting environmental data to explore and establish the user's and the user's household's, at each individual life stages, ideal life style, health parameters, and living environments and conditions, thereby enabling every user an easy and accessible way to maximally use modern science and scientific findings to reduce risk of diseases and maintain lifelong health and happiness.

A person's health is determined by both the internal factors, one's age, gender, genetics and epigenetics, and external factors, environment, society, etc. Among the factors, the personal choices and behaviors based on one's knowledge, beliefs, habits and surroundings play crucial roles in determining one's health.

According to Center of Diseases Control and Prevention (CDC), 86% of the United States' $2.7 trillion in annual health care expenditures are for people with chronic and mental health conditions, in 2010. It had increased by 11% comparing to the spending in 2005, which is consistent with the rising trend of the incidence of chronic disease between 2005 and 2010. Newest available data from CDC shows the prevalence of chronic diseases in the United States is still increasing. Obviously, the chronic diseases, which are predominantly caused by unhealthy personal behaviors and choices, are becoming a heavier and heavier burden to the nation, which makes the economy unsustainable. The same or worse trend occurs in other parts of the world.

To solve the problem, governments and health research institutions of USA and other nations have put great efforts in the fields. CDC and World Health Organization estimate that by eliminating the unhealthy diet, the lack of physical activities and smoking can prevent 80 % of all heart diseases, stroke and type 2 diabetes and 40% of cancers. HeathyPeople 2020, a US government health program to promote healthy lifestyle, prove to have very limited effectiveness up to now, as the prevalence of chronic diseases is not dropping down in the USA and is increasing rapidly in some countries. This is due to most of the people's unawareness of the diseases' causes and methods to improve health, unwillingness to change, or unableness to follow the guidelines that sometimes are too generalized to fit each individual's needs.

In addition, there are many professional medical related guidelines for chronic diseases prevention and treatment made by government agencies and major health research institutions. They are regularly updated with the newest research progress and their reliability is repeatedly proven in clinical trials of many developed countries and regions. These guidelines are easily accessible by the public of developed countries. However, it is very time consuming and difficult to understand every aspect or even part of aspects of health information for non-medical professionals, let alone applying these guidelines to one's everyday life.

For example, the Dietary Reference Intake (DRI) introduced by the Institute of Medicine of the National Academies (NIH) of the USA gives very specific daily nutrition intake values for different age groups, gender groups and women who are pregnant or in lactation. For the non-health-professionals, it is impossible to apply the DRI properly and easily to the daily diet because, 1). the DRI cannot be directly used to form diet plans. 2) It does not provide adjustment formulas and models to adapt to the varying amount of all nutritional requirements imposed by the dynamicity of daily life, nor does easy ways for adjustment exist. In addition, even for a health professional, such as registered dietitian, designing each meal of his or her own to completely meet the required DRI everyday with currently available methods (excluding this invention) is a huge task.

For another example, Dietary Approaches to Stop Flypertension (DASH diet) promoted by National Institutes of Health is one of the most recommended health diets by health professionals. Based on calorie expenditure, it recommends people to eat set servings of different groups of foods, including vegetables and fruits, lean meat, whole grains, etc., that are low in saturated and trans fats, lower in sodium and rich in potassium, calcium, magnesium, fiber and protein. While it is effective in alleviating hypertension and is much healthier than the average American's diet, it can be difficult to follow and cannot reliably fulfil every nutrient intake requirement. Partial reasons include, 1. Foods have different nutrition values, for example, one serving of one vegetable can vary drastically in nutrition value than one serving of another vegetable. 2. DASH diet food servings recommendation are based on calorie expenditure that is determined by age, gender and activity level, but weight, height, percent body fat, health statuses and other factors that all greatly influence calorie expenditure are not taken into account. This shortcoming can create a big gap between the intake and expenditure for many users. 3. It is difficult for most people to precisely calculate calorie expenditure of dynamic life, which can cause eating wrong amount of foods. 4. Some people may still be hungry by eating a set amount of foods, which can cause eating additional foods to satisfy the hunger.

Furthermore, many people in developing and undeveloped countries may not have the ability to or cannot access these guidelines or instructions.

The reasons mentioned above make the global incidence rate of chronic diseases rise continuously.

Therefore, there is an urgent need to find new means and systemic methods to guide people with all backgrounds to improve health with easily accessible, followable, understandable and personalized instructions and information pertaining to health affecting lifestyles and personal choices. Artificial intelligence, powerful computer and internet, and new technologies provide us new tools and new directions to solve the problems.

There are some calculation tools and software invented to help people eat more healthily and exercise more, but they all fall short in solving the problems. Most of them typically only offer people the generalized diets and exercises without taking into account of the many varying factors that exist in different individuals. Some suggest foods that are high in certain nutrients that the users have deficiency in. However, these fail to take into account of the nutrients that are already too high, and ingesting additional food may cause overdose in those nutrients. Furthermore, the diet programs that factor in exercises only calculate the additional calories the exercises caused. This is problematic because exercises require not just additional calories to be ingested, but also additional other nutrients. In addition, different physical activities and their intensity, duration and the environment in which they are performed in require the addition of different amounts of nutrients, and may require the addition of some nutrients much higher in ratio than other nutrients. In addition, they do not factor in the other physical activities, such as working or housework, users perform in their daily life, which can significantly influence the not only the calories expenditure but also other nutrients. Therefore, a simple linear adjustment in servings proportionate to calories increase cannot reliably help users to achieve a good balance in intake and expenditure.

As aforementioned, health is affected by many factors. However, proper diet and physical activities, while crucial, are not the only determining factors of health. Personal choices for health, such as lifestyle, routines, environment, attitude, mental health, etc., all contribute to one's health. Computer based software or artificial intelligence are powerful and hopeful direction for solving the complex and challenged problems mentioned above. Up to now, no existing programs solved the critical problems or these challenge problems comprehensively. In other words, no existing programs or systems have successfully integrated these factors comprehensively.

Therefore, an urgent need exists in the field for novel health analysis, tracking, guiding and recommendation system capable of giving users the most reliable, comprehensive and personalized recommendations and guidance on each individual's health impacting life choices, and, at the same time, is easy to use and understand by people in all age groups and regions on earth, to help everyone to reach their optimal health state.

Brief summary of the Invention

To overcome the shortcomings of other methods and programs on healthy diet, health lifestyle or health promotion, the present invention integrates most of the direct health determinants, including all direct impacting factors on health such as behavior, lifestyle, routines, environmental factors (air quality, temperature, humidity, PM2.5, etc.), personal hygiene, sleep, vaccination, guidance for the measurement of anthropometries and other metrics, and education about physical and mental health, etc. for each user. Therefore, the present invention is a novel health analysis, tracking, guiding, recommending and managing system of health. It is capable of giving users the most reliable, comprehensive and personalized recommendations and guidance on each individual's health affecting life choices to help everyone to reach their optimal health state. At the same time, is easy to use and understand by people in all age groups and regions around the world.

The expert system uses proven and reliable human health scientific data and knowledge such as NIH and government provided health guidelines and the user's and the user's household's health information and other information such as food preferences, habits and religion, as a baseline for health analysis and recommendation. In addition, the expert system tracks all meals, physical activities and the users' biometrics, health information , medical records and the feedbacks from the users, and analyzes these information to identify the relationship among the many factors to establish the user's and the user's household's personally optimal nutritional needs, physical activities amount and intensity, lifestyle and environmental factors for each individual user and set improvement targets for reaching the optimal state. Using the baseline and the personalized health parameters, the expert system can provide the user and the user's household customizable and completely personalized meals, physical activities, lifestyle and environment recommendations in order to help the user to achieve and maintain lifelong optimal health and prevent contracting diseases and disorders.

Furthermore, the system uses well-established medical knowledge to inform and educate the users whenever the users fall ill or are in danger of falling ill and to help users to correctly recognize any discomfort and self-determine the need to seek health professional help. Additionally, the system suggests and reminds users to do physical exams and medical exams and when system determines necessary and provides doctor appointment services.

It is a collection of methods that collects, tracks and analyzes the user's and the user's household's daily food and nutrition intake, physical activities and routines, biometrics, blood profile, health information, medical exams, medical records and other health impacting environmental data to determine the user's and each of the user's household member's optimal health parameters. Health parameters consist of, user's all nutritional requirements, physical activities' types, intensity and duration, biometrics such as weight, waist size, hip size, percent body fat and lean muscle mass, blood profile values such as the lipid profile, the metabolic panel values, etc. It is also a method that provides the users with a multitude of ways to input and record. The different methods of input include manual form input, voice recognition and image recognition. The input methods can be applied to foods, weight or volume of foods, activities, health indexes and all input fields within the system.

It is also a method that provides the users with a physical activity and daily routine templates that allow the users to quickly establish an accurate physical activities and daily routine schedule for the system to: 1) accurately analyze not just the exercises, but also all of the user's physical activities and calculate requirements for each nutrient. 2) Automatically establish and select the template that fits each the user's physical activities pattern, so that the user will not have to input physical activities regularly until changes are needed.

It is also a method that queries the user about the user's physical and mental wellbeing, and reaction and feedbacks to certain events such as a meal, physical activity and a change in lifestyle. After receiving results, the program will use various diagnostic algorithms and guidelines to determine the user's physical and mental health and the program's performance and effects on the user. After analyzing the diagnostic results, the program can determine the causes of the user's change in health, whether positive or negative, and determine treatment plans when necessary.

It is also a method that guides the users to correctly do biometric measurements and assess environmental factors. The guidance can be in the forms of text, image, audio and video.

It is also a method that provides the users with various treatment plans when the user falls ill or is in danger of falling ill. The treatment plans, include without limitation, dietary plans, physical activities plans, daily routine plans, and mental health treatments such as cognitive behavioral therapy for depress, anxiety, PTSD, substance abuse, eating disorders, personality disorder and sleep.

It is also a method that provides the users with hospital, clinic and doctors information and appointment services when the user contracts diseases, disorders or other serious medical problems that the program cannot alleviate or treat.

It is also a method that provides the users with recommendations of physical activities and daily routine based on the user's optimal health parameters that are determined by the program, the user and the user's household members' preferences and schedule, and environment factors such as temperature, humidity and air quality. At the same time records user's physical activities and analyzes them to determine the physical activities imposed nutritional requirements. It is also a method that provides the users with instructions of physical activities in text, audio, image and video forms. The instructions guide the users to perform the physical activities in correct forms and techniques to reach the physical activities effectiveness and to prevent any injuries.

It is also a method that provides the users and the users' households with meal plans in compliance with the user's and each individual in the user's household members' 1). All nutritional intake requirement, which is determined by Dietary Reference Intake, physical activities imposed nutritional intake requirements, and program determined user's optimal nutritional intake requirements. 2). Food preferences, which consist of likes and dislikes, religion, ethnicity, and allergies. 3) Medical conditions, which may require more or less nutrition intake in one or more nutrients, and may avoid specific foods. 4). Region, which can affect the foods availabilities, cooking styles, e) cooking and preparation time duration. 5.) Food safety and lastly. 6). User's budget.

It is also a method that provides meal plan revisions in accordance with the user's changes. The user's changes can be any user physical and mental condition changes or changes in physical activities that require a different nutrition intake than previously planned. The meal plan revision method will always be in compliance of nutritional requirements. The method will 1). Modify meal servings if existing foods in the user's food inventory are sufficient to accommodate this modification. 2). If "1" fails to accomplish the objective, it will recommend recipes and meals that can be made using the existing foods in the user's food inventory thus eliminating the need for the user to make additional grocery shopping trips. 3). If "2" fails to accomplish the objective, it will recommend recipes and meals that can be made using the existing foods in the user's food inventory and other additional food items that will require the user to purchase.

It is also a method that provides grocery shopping list for the user for the meal plans and meal plan revisions.

It is also a method that provides a food inventory system for the user. It serves a multitude of purposes, 1) tracks total food inventory; 2) gives signals when food inventory runs low; 3) gives signals when food in food inventory approaches expiration date; d) aids in meal plan recommendation and meal plan revision; e) prevents food waste.

It is also a method that analyzes recipe's preparation and cooking instructions, from which, to determine the varying degree of how cooked each of the ingredient is for calculating accurate nutrition value of the said recipe. In addition, using the preparation and cooking instructions, it determines potential health hazard that can be caused by unsafe and unhealthy ways of food preparation and cooking, and at the same time give recommendations of safe and healthy ways in substitution of the unsafe and unhealthy ways. It is also a method that provides the users with animated cooking instructions in text, audio, image and video forms. The program can automatically instruct and guide the users to prepare and cook a recipe or a meal. The program provides step-by-step food preparation, cooking utensil preparation, and cooking instructions with a timer and present the instructions in text, audio, image and video forms. The program also provides, alongside of the original instructions, additional food safety notices and instructions on how to eliminate the food safety issues with proper food preparation and cooking techniques.

It is also that provides users with health information for educating the users on all aspects of health including, without limitation, diet, physical activities, the principles and procedures for the prevention and avoidance of chronic diseases, infectious diseases, injuries and substance abuses. The information and education can be in the forms of text, image, audio and video.

Detailed description of the invention

Referring to Fig. 1, a computerized system 100 to facilitate the tracking, analysis, recommendation and guidance of meal plans, physical activities, lifestyles and environment and general health education designed to help users reach their ideal health state. In one embodiment is designed to be web-based and therefore includes a web server 101 containing the program 103 and a database 102. The program 103 is coded to communicate with database 102 and execute the tracking, analysis and recommendation of meal plans, physical activities and lifestyles functions. In a preferred embodiment, the system 101 communicates with the users' devices 104 via an internet connection, but is understood that other types of electronic communications could be used. The users' devices can be computer, tablets and phones ideally, but can also be other forms of devices. The computerized system 101 also includes a database 102 consists of a multitude of database tables including user profile database 105, a user health information database 106, a recipe and procedure database 107, a food and nutrition database 108, user food and nutrition database 109, and food price and availability database 110, a physical activity and activities instructions database 111, a user activity and routine database 112, a mental health database 113, a sleep health database 114, a cognitive behavioral therapy database 115, a disorder, disease diagnostics database 116, a disorder, disease treatment database 117, a disorder, disease information database 118, a food safety, pesticides residue and carcinogen database 119, an environmental factors database 120, a checkup and vaccinations database 121, an education and forum database 122, a research and exploring programs database 123, a questionnaires and inquiries database 124, a keyword word bank database 125, a healthy food preparing and cooking procedure database 126, a user food inventory database 127, and a health guidelines database 128.

The user health information database 106 includes the user's history of biometrics, allergies, illnesses, disorders and medical. The recipe and procedure database 107 contains recipes uploaded by users and staff. The food and nutrition database 108 contains food items and their nutrition values. The user food and nutrition database 109 contains the users' all past nutrition and food intake. The food price and availability database 110 contains local food prices for each food item and its availability in various locations. The physical activity and activities instructions database 111 contains a multitude of physical activities, their calorie expenditure and their respective activity instructions. The physical activity database 112 contains the users' all past physical activities and the activities' time, duration, intensity and environment. The mental health database 113 contains information, diagnostics and treatments of relating to mental health. The sleep health database 114 contains information, diagnostics and treatments of relating to sleep health. The cognitive behavioral therapy (CBT) database 115 contains CBT treatments for mental health and sleep health (CBT-S). The disorder, disease diagnostics 116, treatment 117 and information 118 databases contain information, diagnostics and treatment for all illnesses. The food safety, pesticides residue and carcinogen database 119 contains up-to-date information on food safety, local food pesticide residue and carcinogen information. The environmental factors database 120 contains information on indoor and outdoor environment induced health affecting factors and resolution to each respective problems. The checkup, vaccination, clinics and hospitals, doctors and appointment database 121 contains health checkup recommendations and scheduling intervals, recommended vaccinations for various age groups, clinics and hospital information, doctors information and appointments. The education and forum database 122 contains information on health education covering all aspects of health, and forum for all health related discussions. The research and exploring programs database 123 contains program established new health and medical related research and exploration results. The questionnaires and inquiries database 124 contains questionnaires and inquiries covering all aspects of the program. The keyword word bank database 125 contains keywords for queries and automatic analysis of word input. The healthy food preparation, cooking procedure and storage database 126 contains phrases and instructions on healthy and safe food preparation, cooking procedures and food storage. The user food inventory database 127 contains food information in the user's food inventory. The health guidelines database 128 contains well-proven guidelines for all aspects of health, including without limitation, dietary, activities, lifestyle and environment recommendations for different genders, ages, ethnicities, region and health conditions.

Fig. 2 is a flowchart depicting the general sequence of operations for the invention's core functions that achieve the main objectives. The main objectives are: 1). Find the personal ideal health parameters for each user. 2). Guide the users to reach their ideal health state. 3). Educate the users about health. 4). Provide users with information of health professionals and health care facilities when the users require help from health professionals. The system records and monitors the user's daily routine and physical activities, food and nutritional intake, sleep, mental health, physical health, living environment, and biometrics and medical profile. By using well-established health guidelines and knowledge and analyzing the user's records, the system determines the health status of the users. If any part of the user's health parameters is non-optimal or the user reports non-optimal health status such as low stamina or worse memory or concentration, the system will establish improvement targets for the non-optimal health status. The improvement targets include biometric targets such as weight and PBF, medical targets such as blood pressure and cholesterol level, nutritional targets, distribution of nutrient in different meals, physical activities targets, health impacting behaviors and choices such as ways of cooking and substance abuse, and environmental targets such as temperature, humidity and air quality in both indoor and outdoor environments. Depending on the nature of the user's non-optimal health status, the system may suggest the user to seek assistance from health professionals or provide personalized recommendations for the users to reach the improvement targets. After the user return from the doctors, the system will acquire the prescribed medications and treatment plans and incorporate into the system's analysis and recommendations. The recommendations and computerized treatment plans include physical activities and routines, meal plans, sleep and Cognitive Behavioral Therapy for Sleep (CBT-S), mental health and Cognitive Behavioral Therapy (CBT), and living environment. To reinforce and to complement the above main recommendations and treatment plans, the system provides a multitude of education, guidance and reminders. In addition to the recommendations 213-217, the system provides the users with well established and proven guidelines and tools 218-231 in easy to follow and understand ways such as imagery and video forms. The guidelines 218 educates users with health and medical knowledge from well established and proven health guidelines from governmental agencies, such as NIH and American Heart Association, medical textbooks and health and medical publications. The guidelines can include every day routines that affect user's daily lives, such as recommended way to brush one's teeth, and information and education on the different lifestyles and health, such as the pros and cons of low carb diet, vaccination and disorders and diseases, etc. The program 219-220 uses user's health information and health guidelines to suggest the user to do regular physical checkups and doctor visits. The program 221 uses cooking guidelines to guide users to cook healthfully. This can include proper way to prepare the foods to minimize pesticides and bacteria and proper temperature to cook the foods to maintain the most of the nutritional values and prevent or reduce the chance of creating inedible foods such as burnt foods or poisonous foods, such as puffer fish if not properly prepared. The program 222 provides users a grocery list based on the recommended meals from program 214. The program 223 guides user to correctly store foods to maximize the foods storage to prevent or minimize spoilage. The program 224 uses physical activities guidelines to guide user to perform physical activities correctly and safely to prevent injuries. The program 225-226 educate and guide users to prevent smoking and substance abuse and provides users information on overcoming substance abuse. The program 227 educates and guides users to proper hygiene to prevent infectious diseases and viruses. This can include proper ways to wash hands and usage of condoms, etc. The program 228 educates and guides users on giving first aid on one's self or others, such as CPR and Heimlich maneuver, etc. The specifics of each function will be described in detail below.

Fig. 3 is a flowchart depicting the general sequence of operations for creating the user's profile. The system starts by user creating an account with their basic biometrics and information, including age, sex, weight, height, race, waist, hip, chest and neck circumferences, allergies, religion and other health related information such as disorders, diseases and current and past medications, etc. Then prompts user to enter in more in depth health information such as percent body fat and lean muscle mass measured by advanced equipment like BodPod, blood profile from blood tests. It should be noted that the more in depth health information is not required to create the user's profile, and can be input in any time during and after the user profile is created. The program will work with or without the more in depth health information, though this information is preferred to have due to it can provide more accurate insight into the user's health. The program will also acquire user and their household's geographical locations to assess the environments in which the user and their household spend time in. The program can acquire the geographical locations by prompting the user to manually input such information, or, with user's consent, acquire such information through user devices' GPS and IP address. The environment information can include, temperature, weather, air quality, air pressure and humidity, which can be acquired from public available data sources, such as United States Environmental Protection Agency. The program will also prompt the user to add a multitude of household and family members and create profiles from each of these members as a part of the main user's profile. After the profiles are created, the profiles are then sent through the internet to a server in which the profiles will be stored. After storing user basic information and in depth health information should it be entered in by the user, the program will analyze the user's health using the information provided. With basic information, the program will be able to use mathematical formulas calculate the users' Basal Metabolic Rate (BM R), Body Mass Index (BMI), Percent Body Fat (PBF), lean muscle mass and waist to height ratio. These calculations will enable the program to determine initial appropriate requirements and recommendations for nutrition and physical activity, and suggestions and goal(s) such as weight gain or weight loss to reach a healthy weight, blood pressure and blood cholesterol targets, and recommendation to do physical exam or visit doctor. In addition, with the additional data such as blood test results and lab tested PBF, the program will be able to more accurately determine the abovementioned requirements and goals. If the additional health information was not entered during account creation, the program will regularly prompt the user to enter in the information during the user's everyday use of the program.

The initial goals mentioned above are based on well-established scientific data repeatedly proven by clinical research around the world. The goals include, healthy BMI, PBF, waist size, muscle mass, blood profile such as blood cholesterol level, blood sugar level and blood pressure, etc. The goals' values can be a specific value, for example 120 lbs in body weight, and a range of values, for example 12-15% body fat.

The initial requirements and recommendations for nutrition and physical activities are based on well- established scientific data, such as DRI, and government and major health research institutions published guidelines, such as guidelines for sports nutrition, diabetes, heart, etc. These requirements and

recommendations also take into consideration of the aforementioned goals.

The initial nutritional requirement consists of 1). Total calorie expenditure of all physical activities performed in a day, including all exercises and daily activities such as sleeping, working, cooking, driving and watching TV, 2). DRI of every nutrient for the specific user, 3). All additional nutritional requirement imposed by physical activities, health conditions and medications, 4). Nutritional requirement for the above- mentioned health goals such as weight gain or loss, reduction of PBF, increase of lean muscle mass and reduction of blood pressure and cholesterol level.

The initial physical activities recommendations consist of a physical activity or multiple physical activities that meet minimum physical activity intensity and duration targets set by the health guidelines, meet calorie expenditure required to achieve the health goals and are appropriate for the user such that the user can safely perform the activity without causing negative health issues and that the activity is not on the user's dislike and prohibited list. The requirements and recommendations will always follow the rules of nutrition and energy balance such that the all energy and nutrients expenditure is in balance with all energy and nutrients intake while taking the health goals into account.

For example, in order to lose weight, a combined energy intake from food consumption and energy expenditure from physical activities need to be lower than the total energy required to maintain weight.

Vice versa, in order to gain weight, energy intake needs to be higher than the energy expenditure. Flowever, just by increasing total energy input is not a healthy way to increase weight, because this way mainly increases the user's body fat. In order to healthfully increase weight, increases in the intake of different nutrients and energy must be made in accordance to the total expenditure of both energy and nutrients by physical activities and other nutritional requirements by health conditions. Similarly, in order to lower blood cholesterol level, a variety of nutrition intake, such as LDL cholesterol and HDL cholesterol and physical activities need to be appropriately adjusted from the user's diet and physical activities. The methods to determine the appropriate health parameters to achieve optimal health and prevent diseases and disorders will be explained further below.

Referring to Fig. 4, there are multiple ways for the user to enter in information into the program, manual input, voice input, image input, barcode scan, electronic measurement and tracking devices if user has any compatible devices such as a WIFI body weight scale, activity tracking electronics such as a smart watch, a smart phone or even exercise machines such as a treadmill and Al image processor to determine activities and foods. Manual input consists of forms displayed on user's devices such as smart phone or computer, and the user can type into these forms. Additionally, guidance to measurements, such as waist

measurement, in text, image or video forms will be provided automatically as the user click or tap on the respective form elements. Voice and image recognition and analysis are also included to provide data entry. A person skilled in the art will recognize that commercial and open source speed recognition, analysis and synthesis software system, such as Vuforia, SpeechRecognizer by Android and open source image recognition deep learning software such as TensorFlow by Google and other similar software, are well known and widely available. The system supplies these plugins word bank or dictionary database to form accurate data entry. By using Al image processor, the program can decipher the images, taken from a camera from devices such as a smart phone, or images uploaded to the program, and determine the ingredients in the image and the amount for the respective ingredients. In the cases which the amount is not able to be determined using the image, the Al image processor can predict the recipe using the image. The program then queries the food database using the result from the Al image processor and give the most closely matched recipes, their ingredients, and the amount for each ingredient. Additionally, when users eats a premade product or in a restaurant, and the product has compatible barcode or QR code, the users can use their smartphone to scan the code and the program will automatically record the food.

Furthermore, the program is built to accept data from a multitude of user devices digitally. These devices can include, but not limited in, smart watch and smart phone, WIFI body weight and food scales, WIFI blood pressure monitors, WIFI heart rate monitors, exercises equipment such as treadmills. The program will analyze the data from the various devices and convert the data if the data is different format than the program's data.

Referring to Fig. 5, one implementation to calculate the daily nutritional requirements for each of the nutrients is scheduling of physical activities. Users enter in their schedules of physical activities to the program, which identifies the physical activities and the duration and intensity of the physical activities, and uses the identified information to analyze and calculate all nutritional requirements. The nutritional requirements can include calories and all or part of the nutrients in both macronutrients and micronutrients. The schedules can be in the form of one day or multiple days, but preferably in the form of one week.

Flowever, it can be very tedious to enter in so many physical activities regularly. Therefore, in another implementation, a template system for the scheduling of physical activities is provided in an effort to ease the process. Since most people have a regular routine for everyday life, their schedules for physical activities from the past can be applied to the present and future. The program provides a variety of templates for activities schedules categorized by age groups, occupations, hobbies, preferences, ethnicities, regions and religions. The templates consist of detailed schedules for physical activities specified by the time and physical activities. For example, 07:30-08:00 Commuting to work through driving. Users can choose any preformed templates that match their own schedule and routine. If no template completely matches the user's schedules, the users can create their own template from scratch or choose the templates that are the closest to their schedule and routine and modify the template by changing its content. The system will save the user created or user modified templates for physical activities to the server and provide these templates to the user in the future.

The program also can make use of the user's electronic devices such as a smart phone and smart watch to record the user's physical activities. The program will make use of the GPS, accelerometer, gyroscope, altimeter, speedometer and pedometer to determine the physical activities done by the users who are actively equipping their devices. These data are automatically stored into the server, and the program will update the user's schedule of physical activities if any activities performed by the user differ from the planned schedule. At the same time, nutritional requirements are updated with the changes in physical activities.

Fig. 6 is a flowchart depicting the process of the analysis and recommendation of physical activities and routines. The module uses guidelines for physical activities, user's preference and health profile to determine inappropriate physical activities and inactivities and to suggest substitution physical activities in place of the inappropriate ones. The module begins after the users either input physical activities they have already performed or are planning to do, or choose a template for physical activities provided by the program or by the users. The program calculate the total energy expenditure of all physical activities done in that day and record these physical activities. Then the program will categorize the physical activities by the intensities, find the activities that classify as exercises and categorize them into aerobic, anaerobic, muscle strengthening, bone strengthening and balance strengthening activities. Then it will analyze each exercise's intensity and duration and the energy expenditure. The program will access user's health profile and health improvement targets and form query parameters including the user's health conditions, fitness level, age and various body measurements such as body weight, height and percent body fat. Using the query parameters, the program finds the user-appropriate recommendation of physical activities from the database for physical activities guidelines. After finding the recommendations, the program will compare the user's physical activities in that day with the recommendations and identify if any physical activities entered by the user or in the template should be changed. If such activities exist, the program will query the database of physical activities with the previously established query parameters and recommendations to find and form a list of substituting physical activities. For example, according to physical activities guideline, aerobic activities should be perform continuously for at least ten minutes, if user has an aerobic activity that lasts less than 10 minutes, program will suggest the user to increase the duration of that activity to at least 10 minutes. For another example, intense physical activities should not be performed within two hours after eating a meal or before sleep, if such activities exist in those time frames in the user's template for physical activities, the program will suggest the user to either to move the activities to appropriate time or suggest a list of moderate intensity activities in substitution.

The program then analyzes if the user will be inactive, not including resting such as sleeping, for a prolonged amount of time, for example 2 hours. If such inactivity is found, the program will find and form a list of appropriate physical activities to fit into the inactive period. The parameters for this query are formed using 1). the user's health conditions, fitness level, age and various body measurements such as body weight, height and percent body fat, and 2). Situational appropriateness. The situational appropriateness determines the appropriateness of the physical activities and consists of 1). The time during which the activities would be performed in. For example, it would be inappropriate to suggest the user to go swimming one hour before the user is going to sleep, but it can be appropriate to take a walk around the house for 5 minutes; 2). what the user is doing, for example, if the user is working at a desk job, it would be inappropriate to suggest the user to go cycling, but it can be appropriate to suggest the user to walk around the office or do a set of pushups; 3). where the user is, for reasons similar to number 2, the activities suggested should be appropriate for the location of the user; and 4). Weather, such as weather, temperature, air quality, etc., if the weather data for the user's location is available for that date. Calculation of the total Then it will use the health parameters and health information as a guideline and determine whether any improvements can be added, subtracted or substituted into the user's physical activities. For example, a user has jogged for 5 minutes for one physical activity, recommendation of aerobic exercises suggests that aerobic exercises should last at least 10 minutes; therefore, the program will recommend the user to increase the duration of this particular exercise to at least 10 minutes. Lastly, the program will send the analysis report and recommendations to the user.

After the above two processes complete, the analysis and recommendations, if any, are sent to the user.

The user can choose to modify the template and submit the modification for another analysis. This process can infinitely repeat until the user finalizes the template or choose not to follow the recommendations and submit the template. Lastly, the program will store the user's template to the user's database for physical activities and routines, and the template itself will be stored to the user's database for templates.

Referring to Fig. 7, an inactivity monitor and notice module helps to prevent the user from staying inactive for a prolonged amount of time, which has strong links to multiple chronic diseases found by many proven research studies. The module works in two ways, one for users who do not have or not actively equipping an electronic device that can track physical activity and another for those who are equipping a said device. For those who are equipping a said device, the program will use the device's GPS, accelerometer, gyroscope, altimeter, speedometer, pedometer and timer to find out whether the user has been inactive for a prolonged amount of time, For example 2 hours. And when the program detects prolonged inactivity, the program will send user a message or alarm and a list of physical activities that is short in duration, moderate in intensity, For example 3 MET, easy to do, For example walk around, and appropriate, For example it will not suggest go for a swim or play soccer, to remind the user to do some physical activities. Moreover, for those who do not have or are not actively equipping such device, the program will use the user's physical activities schedule and find the prolonged inactivity in the schedule and give the same aforementioned reminder to the user. If the user does have a physical activities schedule planned for the present, the program will access the user's physical activity schedule history and attempt to find whether a pattern in user's physical activities for the current day of the week. For example, if the program finds that on multiple Mondays in the past, the user does deskwork for three hours from 08:30 AM to 11:30 AM, and the program will note down that the user will likely do the same activity in the present and the future. If the program finds such inactivity pattern, it will send the aforementioned reminder to the user at the time during the found patterns. If no pattern can be found, the program can send user regular reminders to do moderate intensity activities regularly, For example, every two hours. The user can also manually set a reminder and the time interval or specific times the reminders should be sent.

Referring to Fig. 9. Expanding upon the recommending physical activities to daily routines, a workout and trainer module is also included in the system. A workout database containing a multitude of exercises in different combinations categorized by intensity, duration, purpose and muscles and muscle groups. In addition, a workout instruction database that contains instructions such as proper techniques, repetitions, durations, interval, speed and intensity in text, audio, image and video forms for every exercise. The user begin by entering their goals, including, weight, percent body fat, lean muscle mass, speed, endurance, strength in different muscle groups and time to achieve these goal. The program will receive these goals and analyze whether the goals are appropriate for the user. For example, for a 70-year-old male user at a height of 6 feet and a weight of 130 lbs and with heart diseases and high blood pressure and low physical activity history, he decides to jog 3 miles a day to improve his physical health conditions. The program will analyze the man's information and will determine that physical activity "jogging" has an intensity of over 5 MET, and this intensity will raise the man's heart rate above 80% of his maximum heart rate and raise his blood pressure above the safe threshold, and thus significantly increase the chance health hazards such as an heart attack. The program will recognize the user's motive as improving health, and will look for exercises and workout plans that have safe intensity for the said user, and then send the reasons of why he should not jog and the list of recommended workout plans to the user. The user will then revise his plan accordingly. In another case, an obese 25-year-old 6 feet tall male user who weighs 200 lbs and a PBF of 32% wants to lose 50 lbs over the next 4 months. The program will recognize the user high body weight is due to high body fat content not high lean muscle mass, and a loss of 50 lbs in 4 months is an average of 3 lbs of weight loss per week which equates to 10,500 kCal loss per week or 1,500 kCal loss per day. The BMR of the user at the current state is around 1,930 kCal, and, depending on the user's activity level, the daily calorie intake to maintain weight is between 2,600 kCal to over 3,600 kCal. In order to achieve 1,500 kCal loss while still meeting the BMR will require the user to eat a diet that is around 3,430 kCal and a daily calorie expenditure of 4,930 kCal. After the program examined the user's physical activities routines, it takes 20 hours to do the essential routine activities such as sleep, work, commute and eating in a regular day at a desk job work without any exercises, and the caloric expenditure for doing these activities is around 1,600 kCal. This leaves the user with 4 hours to expend the rest of the 3,330 kCal, which requires the user performing exercises that are on average 9 MET in intensity per hour for 4 hours. This is equivalent to running at 5.2 mph for 4 hours.

It is impractical for most people to exercise that long in terms of time and in terms of intensity. If the user's goals are deemed appropriate by the program, the program will query the workout data for a list of appropriate workouts that will help the user to reach their goals. After which, the list will be sent to the user and the user will pick out a suitable workout plan from within. The program will then analyze the exercises and calculate all extra nutritional requirement imposed by the exercises. Then it will access the user's diet database and find whether a meal plan exists during the user's workout plan period. If it does not, the program will prompt the user to start the meal plan module, which will be discussed in detail below. If it does, and the existing meal plan does not cover all nutritional requirements, the program will start the revision module for meal plan, which will be discussed in detail below.

Referring to Fig. 8, when the user starts their workout, the trainer module will start. The trainer module will start by displaying information about the current workout, such as time needed, exercises, intensity, energy expenditure, equipment needed and safety notices. When the user selects "Start", the program will give out text, audio, image or video instructions to the user depending on the user's preference in the instructions. For example, if the exercise is bench pressure, the instruction in video form will instruct the user the proper techniques and forms of bench pressing, and the instruction is audio form will say, for example, "Start the first set of 3 reps. Up . Down . Up . Down . Up . Down." A timer will also start, and at regular intervals, depending on the intensity and types of the workout, safety notices and directions will be provided to the user. For example, in the instance of the user not having or not equipping a heart rate monitor that is connected to the program, after sprinting for 4 minutes, the program will ask the user to stop and check their heart rate. If the heart rate is above 80% of the user's maximum heart rate, which when having exceedingly high heart rate for a prolonged amount of time, the risk of heart disease rises significantly, the program will instruct the user to rest a minute and then check the heart rate again.

Moreover, if the heart rate drops to a safe range, the program will instruct the user to continue the workout. If the user is experiencing heartache, or other forms of abnormal conditions or injuries, such as a pulled muscle, the program will determine that these conditions cannot be appease by briefly resting and will instruct the user to stop the workout and depending on the seriousness of the conditions, the program may instruct the user to seek medical help. In the case of user equipping health monitors that can be connected to the program, the program will continuously monitor the user's conditions and will give out instructions when any abnormality happens, such as abnormal heart rate. The process will repeat until the user finishes the workout plan.

Referring to Fig. 10 and 15, in order for the meal planning system to work, a recipe system is needed. The invention has a user-based recipe uploading system. Every user can freely create their own recipes and modify other's recipes to make their own versions of recipes. The recipe upload system can be used on a multitude of user electronic devices, preferably computer, tablet and smart phone. Each recipe is composed of, preferably, a title, preparation and cooking, time, a set of ingredients along with each respective amount, and a set of procedures. There are multiple ways provided to the user to record and upload a recipe; they include, manually type in each element into the recipe upload forms, audio recognition system to record the recipes element by element, image scanning system to record the recipes written on paper and or in printed form such as cooking books and an automatic digital conversion system to convert recipes existing digitally such as in a word document or an digital image. The system also provides the user to enter in time, images and videos to each of the cooking procedures in order to form an animated cooking instruction module, which will be discussed in detail below.

In the recipe upload system, the system provides thorough nutrition analysis. The nutrition analysis program will analyze and categorize the recipe's procedures. It will look for cooking key words such as, fry, stir-fry, broil, bake, smoke and boil, temperature key words such as, 100 degrees Celsius, 145 degrees Fahrenheit, and time key words such as minutes and hours. In the case of temperature, if Celsius or Fahrenheit is not specified, the program will determine it based on the user's location, For example, people in the USA generally use Fahrenheit, while people in Europe use Celsius. Moreover, to make certain of the

determination, the program will query the user on the temperature mode and ask whether it should always use the user's selection as default until the user changes the selection. The program will tag the recipe with the key words found and will then analyze the procedures and determine whether the ways of cooking will produce inedible foods. For example, in a steak recipe, it states to cook the steak at 400 degrees Fahrenheit for 6 minutes. The program will recognize that meats when cooked at over 355 degrees Fahrenheit or 180 degrees Celsius will burn, which will result in carcinogens to be produced, which can cause digestive system problems and cancer. In addition, olive oil start to smoke when heated to 375 degrees Fahrenheit or 191 degrees Celsius. The smoke is an airborne carcinogen that is one of the main in door pollutant that causes multiple chronic diseases. When such health hazards are recognized, the program will send the user feedback and suggest the user to modify the recipe to safe standards. If the user makes changes, the nutrition analysis will start over; if changes were not made, the program will tag the recipe with health hazard due to cooking and will provide explanation and alternative procedures alongside of the original procedures and store these into the database. It will determine whether the ingredients will be cooked or not based on the procedures provided by the user. It will access a recipe procedure word bank or dictionary database to identify the key words in the procedures. For example, for a recipe of steak, ¼ lbs of beef is included in the ingredient list, and one procedure states, "Cook the steak in 145 degrees for 6 minutes", the system will distinguish the temperature for cooking, which is 145 degrees Fahrenheit, and time spent, which is 6 minutes. The program will then look into recipe cooking database and find, ¼ lbs of beef to be cooked at 145 degrees Fahrenheit for 6 minutes will produce a medium cooked steak, which is 75% cooked. Then the program will go into ingredient nutrition database and find the nutrition for both cooked and uncooked beef, and will calculate the combined nutrition of 75% of ¼ lbs of cooked beef and 25% of ¼ lbs of raw beef. The program will repeat this process for all ingredients that change nutrition values when cooked and then those that do not. Finally, it will calculate the total combine nutrition for the entire recipe. Then it will calculate the weight ratio and nutrition ratio of each individual ingredients to the whole recipe, and categorize the ingredients within the recipe. For example, in the same steak recipe aforementioned, there is an additional of 1 tablespoon of salt, 2 tablespoon of olive oil, 1 teaspoon of black pepper, 2 cloves of garlic and ¼ of beef steak 90% lean and 10% fat. The program will recognize the beefsteak is from beef products category from the database and has a significant weight in the recipe, garlic is from vegetable category, and weighs insignificantly, and salt, black pepper and olive oil are in the condiment and oil products and also weigh insignificantly. And the program will categorize these as main ingredient, sub ingredient and condiments and oil, respectively. After determining the categories of the ingredients, the program will also categorize the recipe as a whole. For example, the aforementioned steak recipe contains beef, which is meat and beef, this will give the recipe a tag of meat, which means it is non-vegetarian/vegan, and since it contains beef, it will gain a tag of beef, which is prohibited by the Hindu religion. Additionally, the program will use the amount of ingredient and total nutrition to determine whether the recipe can be considered a full meal or part of a meal and form tags accordingly. For example, the aforementioned steak recipe is rich in fat, protein, vitamins and some minerals, but it lacks the carbohydrates which should be the main energy source, and therefore, the recipe will be ragged as part of a course and as a dish. Similarly, a spaghetti with meatballs recipe consist of nearly all of the nutrients, and it will be tagged as a meal. These tags will prevent the program from suggesting inappropriate meals in the meal planning module. The program will also access a food safety database and identify all food safety issues in the recipe and tag the recipe with all food safety issue tags. The nutrition analysis program will then use the ingredients and procedures in the recipes to query the entire recipe database for similar recipes, and find alternatives to the ingredients and procedures. Lastly, the recipe, nutrition, the tags and categories, food safety and alternative ingredients and procedures will be stored to the recipe database.

In addition to the nutrition analysis module, the program will also access a food safety database in which it will look for food safety issues that exist in any of the ingredients of the recipe. For example, at the time of the writing of the application, there is an outbreak of E. coli virus in romaine lettuce in multiple states in the USA, if any recipe contains romaine lettuce, the program will tag every these recipes with E. coli virus, and every time these recipes are accessed by any user in the affected states, the user will be notified of this issue and be given instructions on how to safely prepare the romaine lettuce, such as thoroughly wash and cooking the romaine lettuce in above 60 degrees Celsius for over 2 minutes. And when this food safety issue is resolved, if ever, the program will deactivate the specific food safety issue tag from all recipes that contain these tags and users will not be notified of these nonexistent food safety issues.

It should be noted that the food safety database will include all present food safety issues, and will be updated regularly to reflect any changes in the issues.

Referring to Fig. 11 and Fig. 12, meal recommendation module is designed to allow a user to dynamically customize a meal plan for him or herself or for his or her household, whether in whole or in part, at the same time while ensuring the following: 1). everyone's all nutritional requirement will be met and not exceed the upper limits of nutrient intake, which includes all, but not limited to, nutrients included in the Dietary Reference Intake set by the USDA, N I H and the FDA, essential and nonessential amino acids, and other nutrients that have not yet have established nutritional requirements; 2). meals will be the same or similar in ingredient and cooking style; 3). the cooking and preparation time fit in the cook's schedule; 4). the meals are in the styles that the users prefer; 5). none of the ingredients are in the users' dislike, prohibited due to allergies or religion or other reason. The program can recommend single meal to multiple meals for one day or multiple days in the present or the future.

The program will start by requesting preferences from the user. The preferences may include, but not limited to, style of the meals, number of the meals, cooking and preparation time, types of the ingredient, specific ingredients, etc. Then the program will receive the user's preferences, and access and pull the user's physical activities for the days the user want the recommendations. If no physical activities are found or planned for the day(s) the user want the meal recommendations, the program will ask the user if he or she wants to input the physical activities or wants the program to estimate nutritional requirement based on user's and user's household members' activity level and biometrics instead. The program will then use the physical activities data or the estimation to calculate if any additional nutrients are needed to be increased to the existing DRI nutrient list. For example, for a typical male adult with sedentary to light activity level, an intake of 1.2mg of Thiamin per day is the DRI recommended value; but for someone who has expended more energy than the average adult male, approximately a 0.5 mg of Thiamin per day per 1,000 kcals is needed to fulfil the nutritional need but not exceeding 3.0 mg in total per day. Additional nutritional requirement can include, but not limited to calories, fat, protein, carbohydrate, Vitamin A, thiamin, riboflavin, niacin, Vitamin B6, Vitamin B12, folic ac acid, biotin, Vitamin C, Vitamin D, Vitamin E, Vitamin K, calcium, phosphorous, magnesium, sodium, potassium, chloride, iron, zinc, iodine, selenium, copper, manganese, chromium, etc. The program will also access the users' health database and find additional nutritional requirements caused by health issues or medications. For example, for someone who is diabetic, sugar and glucose need to be severely limited or even eliminated from the diet.

The program will compile the variance in nutrient intake for each person in the user's household if the user wants meal recommendation for his or her household. If more recommendation is wanted for more than one person at the same time, the program will compare the users' entire nutritional requirement, and categorize the users into different recommendation groups if needed. For example, a 4-year-old, 3 feet tall and 50 pounds male child has vastly different nutrient requirement than a 30-year-old, 6 feet tall and 150 pounds female adult, and just by giving the child a proportionally smaller serving of the same meal that the adult eats is usually not able to satisfy the child's nutritional requirement. In addition, if the user has specified a budget range and there is local grocery pricing data available for the user in the system's grocery pricing database, the program can exclude out of budget ingredients or form list on only in-budget ingredients. The program will use all dietary restrictions for the user(s), favorite foods, and other user's preferences and the nutritional requirement as query parameters and find recipes and meals and combine them into different meals to fulfil the said parameters. It should be noted that the food recommended can be a single food item such as an apple, a manufactured food such as an energy bar, a restaurant made food such as a hamburger or a sandwich, recipes uploaded by users and staff in the program, or a combination of the aforementioned.

If the user requests recommendation for a full day's meal, the program will find the user's physical activities scheduled for the specific day from the database or query the user for the information if no schedule is found. The user can also choose to not enter in the physical activities and use program estimated nutritional requirement. Depending on the user's preferences on number of meals per day, for example, most people eat three meals per day, some people may eat four or five or even more meals per day, while Muslims during Ramadan may only eat two meals a day, a breakfast and a dinner, the program will use course energy and nutrition ratio, pre-established by the personalized health manager which will be described in detail later, to find appropriate meals for each course.

If the user requests recommendation for a singular meal, the program will access user's food intake database and find consumed foods in the specific day. It will prompt the user to enter in consumed foods if none is found in the database. It will also find the user's physical activities scheduled for the specific day from the database or query the user for the information if no schedule is found. The user can also choose to not enter in the physical activities and use program estimated nutritional requirement. If the meal recommendation is for the first meal of the day, the program will find, from the food and recipe databases, a breakfast that fits the course energy and nutrition ratio and the user's preferences while not exceeding any nutrient upper limit or contains any prohibited foods, such as allergens or religion prohibited foods, or prohibited nutrients, such as added sugar if the user is diabetic. If the meal is not the first meal of the day, but not the last meal of the day, the program will find a meal, such as a lunch or a mid-day meal, that fits the course energy and nutrition ratio and the user's preferences while not exceeding any nutrient upper limit or contains any prohibited foods or nutrients. If the meal is the last meal of the day, the program will find a meal or dinner, that completes the user's nutritional requirement and fits the user's preferences while not exceeding any nutrient upper limit or contains any prohibited foods or nutrients.

If there are different recommendation groups, the program will, should the user choose to use this function, make meal recommendations based on the same or similar main ingredients and other sub ingredients in order to make the cooking procedures simpler. It should be noted that the program will prioritize meal combinations that will give the different groups the same meals, it will give different meals only if the same meals cannot satisfy everyone's nutritional requirement.

The users will receive the recommendation and can send feedbacks or request changes to be made to the recommendations should they be unsatisfied by the recommendations.

The meal planner can factor in all of the following in the process of coming up with a meal plan for the user. The factors include, nutritional requirements, these can include all nutrients on the Dietary Reference Intake chart and other nutrients not specified by the DRI such as tryptophan; cooking styles, such as boil, bake and stir-fry; ingredients, such as user likes and dislikes; allergies, which will exclude specific allergy causing ingredients; religion, which will exclude specific religion prohibited and should be avoided ingredients; ethnics, which will narrow down the meal planning on the user's ethnics or the user's selected ethnics, For example, a Chinese user may only want Chinese Cuisine and Japanese Cuisine and the program will only select the Chinese and Japanese ethnic meals; special conditions, such as diabetes, which will exclude most foods with glucose contents and some foods with over the limit fructose to glucose conversion ratios;

ingredient availability, which is a regional foods availability database that will eliminate meals that have ingredients that are not available to the user's region; time, which will suit the user's schedule and preferred time spent on food preparation and cooking; cooking equipment, which will eliminate meals that cannot be cooked without these specified cooking equipment. For example, if any recipe states a pressure cooker is needed and the user does not have one and does not wish to purchase one, these recipes will be eliminated from the meal planning; budget and price, a regional food pricing database will help the program make sure that the meals planned will not exceed the user's chosen budget; food safety, a food safety database will record all present food safety issues, these can include regional food virus outbreak, toxins within the foods, nutrients that can cause unhealthy conditions when overdosed, genetically modified foods' toxins, pesticides and herbicides on foods from certain farms or areas, these information can help the program eliminate foods or provide notices to the user on foods with these food safety issues and how to prevent getting poisoned.

After the user accepts the meal plan, the program will form a grocery list using all of the ingredients in the meal plan and save the grocery list to the server. All of the same ingredients from different recipes will be merged together. Since many ingredients do not need to be purchased frequently, such as condiments like vegetable oil, salt and black pepper, the program, at the user's choice, will not include these types of ingredients in the grocery list. And an estimate pricing for individual ingredients and total pricing can also be included in the grocery list. And pricing estimation is done by accessing local foods pricing database, and the average price can be calculated through this way. Also, if any store is partner with the program, the program can acquire pricing on items from the stores.

Referring to Fig. 13, a food inventory tracking method is included. This method will track user's food purchases and will aid the program in guiding the users to correct food preservation and storage and meal plan revisions. The program will prompt the user to input in these ingredients and their respective quantity to the program, whether pre-existing in the user's inventory or bought in the future. Every time user purchases new groceries, preferably purchased according to the program generated grocery lists, the system will prompt whether the foods purchased match the grocery list. If yes, the program will record these foods into the user's food inventory database; if not, the program will ask the user to input the foods purchased and record them into the food inventory database. There are multiple ways for the user to input these purchased foods into the program, manually typing into food inventory form, audio recognition, receipt scanning, which is a form of image recognition. These methods are the same as the aforementioned various data entry methods. In addition to these methods, if the stores from which the user purchased foods from is partnered with the program, the store can provide user's purchase history to the program, and the program will automatically acquire and record the foods upon receiving the receipt number or other receipt identifying ID such as barcode from the user. When the inventory becomes low, For example, only 2 days of foods left, the program will give user notice to start the next meal planning and plan on doing another grocery shopping list.

Referring to Fig 14, the revision module for meal plan makes modifications to the existing meal plans to meet the new nutritional requirements imposed by user's changes in physical activities and other factors such as user's newly discovered health conditions like diabetes. Due to the user would have already purchased groceries based on the existing meal plan, the revision module for meal plan will attempt the modify the meal plan without making the user have to purchase more food too frequently until the food supply in the food inventory is low. The module will utilize the meal recommendation module and apply the appropriate parameters to achieve the objectives. The program will find the foods left in the user's food inventory, and attempt to expand the servings of the existing planned meals without changing the recipes with the foods left in the food inventory while making certain that the nutritional requirement will still be met and not exceed the nutrition intake upper limit. If the first attempt fails to accomplish the objective, it will find new recipes can be made with only the foods left in the food. If the second attempt does not work, the program will attempt to find recipes that contains both the foods left in the food inventory and new foods that the user will need to additionally purchase. It should be noted that all three methods will be completed by the aforementioned meal planning module, and despite it being a revision process, the meal revision will follow all rules in the meal planning module.

Referring to Fig 16. The cooking instruction module is a program animated and timed cooking instruction with text instruction, computer synthesized audio instruction, and user uploaded image or video instructions. The instructions are obtained from the recipe uploading process discussed above. The user can choose the presentation forms of the cooking instruction. When the user selects a recipe and starts its cooking instruction, the module will access the recipe database and nutrition database for this particular recipe. The module will tell the user the necessary foods, ingredients and cooking utensils and wait for the user to finish this step and click "Next Step". After the user is finished this step, the program will proceed to food preparation step, such as washing and cutting the foods. The module will also notify the user on how to correctly clean the foods to maximally remove the pesticides, herbicides and other harmful substances such as viruses from the foods. User will press "Start Cooking" soft button when finished with preparation, and the module will proceed to the first cook step instruction and start the timer for this step. When the timer ends for this step, the module will ask the user whether this step is finished. If it is, the module will continue to the next step. If not, the module will wait until the user pressure "Next Step". This process will repeat until the cooking is finished. When the cooking is finished, the module will give user instructions to separate the foods into different servings and the each serving' quantity if the foods are prepared for multiple people.

Referring to Fig. 17, Fig. 18, Fig. 19 and Fig. 20, the program utilizes several ways to determine the accuracy of the recommendations, suggestions and guidance in relation to the user's health. One of the ways is to suggest the user to take physical exams, blood tests, urine test and other medical exams if the user has not uploaded these test results recently. The program can provide the user with locations of exam locations and appointments. Another way is the inquiry and questionnaire system. It works in several ways, one being questions and inquiries after each user event. The event stands for use's physical activities, meals, actions, changes and any feedbacks to any of the system's features. For example, after each exercise, either detected by user's activity tracking devices or determined by the program using the user's physical activities schedules, the program will inquire the user's conditions and feelings about the activities. The questions can include inquiries about the user's heart rate if the user did not equip a program connected heart rate monitor, the user's general feeling to the activities done, fatigue, strain on the body, comparisons with the past physical activities to judge things such as strength and stamina increase, and any abnormal conditions felt, such as short of breath and heartaches. The questions will revolve around the effect of the physical activities on the user's body and the user's feelings and conditions towards the physical activities. For another example, if the user does equip a program connected sleep tracking device when sleeping, when the user wakes up in the morning, the program will inquire the user about the sleep's quality, total duration, how long it took to fall asleep, how many times the user woke up in the middle of the sleep, if the user woke up in the middle of the sleep, how long it took to fall back to sleep, and if the user had trouble with sleep, potential causes such as unwanted light and noises. The questions are preferable short in time completion and few in numbers for the maximum user convenience, but will be longer in time and more in numbers if the program determines the former option cannot provide sufficient information about the user's conditions. The second method of inquiry focuses on the user's psychology, mental health, memory, reaction time and intelligence. The part features mental health questionnaires for examining the user's mental health and puzzles, memory games and IQ tests to determining the user's memory, reaction time and intelligence. The test results will be compared with the past results to determine the user's mental health progress. In addition, the test results and their respective history will be cross-examined with the user's physical activities, nutrition intake, foods, other mental health results, biometrics, medical exam results, and environment histories to form links and patterns in an attempt to reveal the relationships and causes and effects each of the elements or the combination of the elements have on each other in order to determine the best combination of diet, physical activities, lifestyles and environment to reach the user's most optimal physical and mental health. As mentioned above, the tests on memory, reaction time and intelligence are in the forms of questionnaires and games. In other words, they exist in different forms in order to appeal to different people with different interests. Lists of questions will usually not appeal to kids, and in order to get accurate and consistent, in terms of time intervals in between the tests, results to compare and be analyzed with other user data, program integrated games are made. These games may be puzzle games and image recognition and memory games. It should be noted that these games have different difficulties for different age groups, whereas they will be the easiest for the youngest and harder as the age increases up until reaching adult and elder age groups. It should also be noted that these tests, whether in question form or game form, can be used by all age groups regardless of forms.

Personalized health formulation module is a module that analyzes user's health information and, using various health metrics and indexes, determines the user's comprehensive health both physical and mental and offers resolutions, suggestions and guidance to better the user's health in ways of helping user change lifestyles and habits, guiding user to correct or avoid any indoor or outdoor environmental health hazards, changing the user's nutritional requirements and diets, and adjusting the user's physical activities and routines. In one embodiment, the module is a method that helps user to maintain health and to prevent most chronic diseases through various ways. The module is also method that repeatedly adjust, monitor, track and analyze the user's health to explore the most personally accurate, suitable and optimal health indexes, nutrition intakes, lifestyles, physical activities and environment factors to each individual user.

The module can gather user's health information and health statuses through questionnaires and tests and exams. These questionnaires, tests and exams include, but not limited in, user's daily self-rated physical conditions, mental conditions, intelligence exams, memory exams, and physical readiness, strength, endurance exams. The module will use the user's answers to these questions and determine the user's health that is otherwise not able to be detected by regular biometrics and blood profile. Through these answers, the module access the respective health guideline databases, For example mental health database for the mental health questions, and determine any causes to the user's abnormal or unhealthy conditions if the user is deemed to be abnormal or unhealthy.

In addition to the questionnaires, the module will also use user biometrics and blood profile data for analysis. The module can calculate the many biometrics derived values such as body mass index and percent body fat. And the blood profiles, if the user has provided any, can inform the module many in depth health related information, such as blood cholesterol and blood sugar level. The module will access the respective health guideline databases, For example body mass index databases for the calculated BMI, and identify any abnormal values, For example a high BMI or PBF. Then it will determine the potential causes to these abnormalities, For example, a high percent body can be caused by improper diet or lack of physical activities or the combination of both. After the causes are identified, the module will determine the seriousness of the problems and whether the system has the capability to resolve the problems. If the problems are too serious or the system does not have the capability to resolve the problems, the module will suggest the user to seek help from medical professional. In addition, the module will provide the user with the determined causes and guide the user to the appropriate medical professionals. For example, the user is experiencing heartaches and the module determined to have a serious heart problem, the module will inform the user the problems and provide the user with heart diseases information, such as heart disease guidelines by the American Heart Association, and provide the user with a list of medical centers that can treat heart diseases and a list of cardiovascular doctors and help the user setup appointments. If the doctor can provide the user with recommendations compatible with the program's, the program will store these recommendations to the server and apply them to the user. For example, the doctor has provided a special nutritional requirement for the user, the doctor can use the system's medical professional portal and replace the existing nutritional requirement. If the doctor does not use the system's medical professional portal, the user can record the doctor's recommendations to the system through various ways using the aforementioned information input system.

If the module determines that it has the capability to help the user to regain health, it will give the user appropriate suggestions, recommendation, guidance and changes. The module can help the user from four main categories. They are lifestyle and habits, food and nutrition, physical activities and routines, and environment. The module can provide help from each individual categories or a combination of these categories.

If the module determines one or more of the causes fall under the lifestyle and habits categories, it will give the user suggestions and recommendations to change one or more of the user's lifestyles and habits. For example, the user reports respiratory system problems, and the module discovers the user is a smoker through further questioning on the reported problem. The module will access health information database and find smoking related information. Then it will suggest the user to quit smoking, and will provide the user with information on the cons of smoking and guidance to quit smoking. In addition, the module will give the user information such as smoking cessation center, or alternatives to smoking such as electronic cigarettes.

If the module determines one or more of the causes fall under food and nutrition category, it will determine whether the problem is specific food related or nutrition related. If it is food related, For example undiscovered food allergies, the module will add the allergy causing foods to the user's prohibited food list.

If it is nutrition related, the module will follow the appropriate guidelines and algorithms and adjust the nutritional requirement for the user accordingly. For example, an abnormally high percent body fat is detected, or the percent body fat is increasing when it is not supposed to be. The module examines the user's nutrition intake history and determines that the user needs to ingest less fat. To solve this problem, the module will modify the user's nutritional requirement and lower the fat consumption. In another example, the user reports to have experienced low blood pressure and muscle weakness, and after the module examining the user's nutrition intake history, the module determines that low sodium and high magnesium intakes are the causes. To resolve this, the module will modify the user's nutritional requirement, raise the sodium intake and lower the magnesium intake per guideline. Depending on the changes in nutrition intake, physical activities and routines may need to be adjusted to comply with the new nutrition intake. For example, if the user's energy intake is adjusted to be lower, to maintain the nutritional balance, physical activities caused nutritional expenditure needs to be lowered accordingly. This is done by reducing the intensity, duration or types of the physical activities performed by the user.

The diet part of this module can also determine the distribution of energy and nutrient intake in each meal of the day. There is no established exact ratio for energy or nutrient intake. But, the general rule of thumb for energy intake in breakfast, lunch and dinner is 3:4:3 such that in a 2,000 kcal diet, the rough distribution of energy intake in break to lunch to dinner is 600 kcal to 800 kcal to 600 kcal. However, this does not suit every individual. The module will adjust the distribution of energy and nutrient intake for each meal repeatedly using analysis of the user's biometrics, medical exams, physical activities and routines and the user's feedbacks. For example, if a user reports that he feel famished in the morning, the module can increase future intake of calories in the breakfast, and reduce the intake of calories in the other meals; a ratio of distribution of energy in this case can become 4:4:2. If the user reports that despite the changes made previously, the user still feels hungry three hours after eating breakfast. In this case, the module may suggest the user to eat numbers of meals different to three meals a day. For example, the module may change split the 3 meals into 4 meals, and suggest the user to eat the extra meal three hours after eating breakfast, and move the lunch to a later time. In this case, the distribution of energy in the meals may become 3:2:3:2. The individual nutrients will also be adjusted accordingly. For example, the user reports that has low endurance during a workout. The module will query the guidelines of diets for physical activities, and find nutrients such as carbohydrate, protein, vitamin D, the B vitamins, etc. affect the physical performance. The module will then increase the distribution of these nutrients in the meal that precedes the workout and lower the distribution of these nutrients in other meals. The ratios used above can be invention provided for different scenarios such that the programs and other staff that made this system can provide the ratios for different scenarios. The ratios can be in any numeric combinations that add up to 10 such that a ratio of 10 for a single meal, a ratio of A:B for two meals (where A and B are numbers in between 0 and 10, A can equal to B, and A + B = 10) and so on. The process will repeat until the following conditions have been met: 1). The user reports no abnormalities; 2). The user reports that he or she is at his or her peak performance; 3). All of the user's biometrics and medical record such as blood work are within the healthy range. Furthermore, the distribution ratios of the energy and nutrients will be stored into the server. And the ratios of one individual may be used on another individual in the same or similar situations to increase the speed of the process.

If the module determines one or more of the causes fall under the physical activity categories, it will follow the respective guidelines to adjust the physical activities, the physical activities intensity, duration, time frame during which the physical activities will be performed or suggest to cease any inappropriate physical activities or types of physical activities based on the types, intensity and environment in which the physical activities will be performed. For example, a user has reported fatigue and drowsiness in the mornings, and the user's biometrics and blood profile show normal values and the user has been following a proper meal plan while exercised appropriately according to recommendations. Flowever, after examined the user's physical activities routines, the module discovered that the user has been exercising intensely in the early mornings. The module determines that due to the high-energy expenditure in the mornings, the user, despite is overall energy and nutrition balanced, does not have enough energy for the morning activities and, therefore, experienced fatigue and drowsiness. The module will analyze the user's daily physical activity routine and find appropriate alternative time frames for the exercises, or split the exercises to shorter time intervals spread across the day, and send the user the recommendations and the analysis. Alternatively, the module can change the user's meal plan by making the breakfast recommendations higher in carbohydrates, fats and proteins (calories) and other nutrients, such as sodium and potassium due to significant quantities of them can be lost in sweat, and the other meals lower in the respective nutrients accordingly per the requirements of nutrition intake. In addition, should the intensity or duration of the physical activities be changed, the module will calculate the new nutritional requirements accordingly to reach nutrition intake and expenditure balance.

If the module determines one or more of the causes fall under the environment category, it will follow guidelines for environment health and provide user suggestions and guidance on how to improve the user's environment. This section is mainly composed of providing users with reliable and appropriate information. The environment issues can be classified as two main sections, indoor and outdoor. Indoor environment that affects most people's lives mainly consist of harmful building and furnishing materials, ie. asbestos insulation and lead paint, hazardous gases from fuel-burning combustion appliances, ie. natural gas, carbon dioxide and carbon monoxide, temperature, humidity, indoor air pollutions, ie. second hand smoke, unhealthy cooking styles produced smoke, ie. vegetable oil smoke due to high cooking temperature, water source pollution, outdoor air pollution that leaks into indoor and natural harmful gases that leaks into indoor, ie. radon gas. Outdoor environment that affects most people's lives mainly consist of temperature, humidity, air quality, air pollution and allergies, ie. pollen and certain plants. While the module cannot directly change, prevent or mitigate these health risk factors, it is capable of providing the user a series of guidelines and information and suggestions. For example, if user is experiencing a newly discovered pollen allergic reactions, the module may recommend the user to not go outside when the local pollen index is not safe for the user, or suggest the user to wear facemask when going outside. In addition, the module will record down the user's newly discovered pollen allergy. It should be noted, if the user has reported pollen allergies, the recommendation module for physical activities would factor in those when making recommendations and suggestions as described above in the physical activities recommendation section.

For another example, the user is experiencing sleep problems, and the module determined that it is due to the user's sleeping environment, such as improper temperature, humidity, and light or noises from various sources such as electronics and from outside. The module can recommend the user to decrease or increase the room temperature and humidity to recommended levels, for example, 68 degrees Fahrenheit is determined to be the ideal sleeping temperature for most of the population. The module, in the example, can also instruct the user to remove light pollutions in the room, for example, remove the light producing items from the room, cover over such items, or install blackout curtains. The module, in the example, can also suggest the user to wear earplugs, install sound insulation on doors and wall or install better sound proofing windows to reduce the noise pollutions.

The module will regularly inquire the user on the progress and status on the problems. It can provide further suggestions, recommendations and information based on any updates on the problems by repeating the algorithm. At the same time, it will record all of the process and data and provide relevant information to the other modules within the system.

Most, if not all, diseases and disorders, especially chronic diseases, such as hypertension and diabetes, have been proven to be improved by lifestyle, dietary, physical activity and some environmental changes. It should be noted that the module described above is a universal health management and guidance system that can be adapted to a multitude of diseases and disorder treatment algorithms. While only an obesity treatment algorithm is included in this application for exemplary illustration purposes, as long as the program can obtain reliable and medically proven treatment algorithms and the said algorithms are within the program's abilities disclosed herein this application, the module can execute each of the algorithms with or without slight modifications that are within the scope of the invention.

For example, a user reports to the system that he is experiencing severe vomiting, diarrhea, abdominal pain and dehydration, the system then use the symptoms as parameters to query medical health database on potential causes. One cause can be iron poisoning. For this cause, the system will analyze the user's nutrition intake on whether the user has overdosed in iron through foods and supplements, or any medication or medical condition that negatively affects the user in such a way that normal iron intake is too high, if relationship is found, the system will recommend the user to seek medical attention and recommend meal plans with less iron as a nutrient in the future. If no relationship is found, the system will query the user for more information such as, whether the user is use iron kitchen tools to cook and whether user's water supply is safe.

The health program also includes a variety of other health modules to help users to reach their ideal health. These modules include, but not limited in, medical reminder module such as medical exams, physical exams and vaccinations, and health education module.

Referring to Fig. 18 and Fig. 20, the mental health and sleep health modules are parts of the personalized health module. These two modules utilize computer based cognitive behavioral therapies (CBT) and cognitive behavioral therapies for sleep (CBT-S) to help users to improve their mental health or sleep health. The CBT and CBT-S provided by the modules are self-administered and can work at the user's own pace. The system will continuously monitor the user's therapy progress through all aforementioned means, and determine the effectiveness of the therapies and will provide additional help when necessary, such as give user suggestions to seek help from condition related health professionals, educate users on their conditions and other methods for improving their health.

Any embodiment may include any of the optional or preferred features of the other embodiments. The exemplary embodiments herein disclosed are not intended to be exhaustive or to unnecessarily limit the scope of the invention. The exemplary embodiments were chosen and described in order to explain the principles so that others skilled in the art may practice the invention. Flaving shown and described exemplary embodiments, those skilled in the art will realize that many variations and modifications may be made to affect the described invention. Many of those variations and modifications will provide the same result and fall within the spirit of the claimed invention. It is the intention, therefore, to limit the invention only as indicated by the scope of the claims.

Claims

Claim

1) A method comprising: a) a data component that provides scientifically well-established, proven and reliable health information relating to food and recipes, nutrition, physical activities, diseases, disorders, disabilities, environmental health, sleep health and mental health; b). a processing component that receives user daily life, biometrics, blood profile, health information, medical exams, medical records, medical information, hobbies, preferences, physical activities, nutrition intakes, living location and environment information of a plurality of users; c). a data component that stores and tracks users’ information; d). a processing component that analyzes all historic user information and health information to determines users’ ideal health parameters and improvement targets; e). a processing component that gives users recommendation and suggestions on a multitude of aspects affecting health and wellbeing; f). a processing component that reminds users to do regular medical exams and other medical procedures such as vaccination; g). a data component that stores food safety, food price and food availability information; h). a data component that stores hospital, clinic and doctors information; i). a processing component that uses a physical activity and routine template to track and plan physical activities and routines and calculate the nutritional requirements induced by the activities; j). a processing component that provides users with cognitive behavioral therapies for mental and sleep health.

2) The method of claim 1, wherein the health information are scientifically proven and reliable, and can contain information relating to any aspect of health, such as Dietary Reference Intake and Dietary Guidelines set forth by government agencies.

3) The method of claim 1, wherein the processing component that receives user’s information can

receive the information through manual input, voice recognition and image recognition.

4) The method of claim 1, wherein food information includes USDA Food Composition Databases, and other reliable food composition nutrition databases.

5) The method of claim 1, wherein user information and biometrics include age, sex, height, weight, circumferences of chest, hip and neck, percent body fat, bone mass, lean muscle mass, ethnicity, race, religion, location, occupation, income.

6) The method of claim 1, wherein user health information, medical exams, medical records, medical information include, but not limited in, allergies, blood pressure, cholesterol level, blood profile, CT scan, medical imaging, current and past medications, current and past medical conditions and any user feedbacks relating to health such as user’s emotion state and any positive and negative physical and mental feeling. 7) The method of claim 1, wherein user hobbies and preferences comprise of any user favorite and least favorite activities, food preferences, favorite foods, least favorite foods.

8) The method of claim 1, wherein living location and environment information include user's

residence address, area of residence, area of work, user's visited places, and the environment, such as water quality, air quality and weather in the previously mentioned locations.

9) The method of claim 1, wherein processing component "d" reads all user information, such as all historic nutrition intake and physical activities and any relating established health information, determines the healthy or ideal health parameters and establishes improvement targets to achieve the healthy or ideal health parameters.

10) The method of claim 8, wherein user's changes and conditions can include both physical and mental changes such as weight, percent body fat, bone mass, blood pressure, blood profile, mood, sleep, appetite, endurance, strength, memory, reaction speed, intelligence, etc.

11) The method of claim 1, wherein the processing component "e" comprises of the recommendation and suggestion of nutrition intake, foods, meal plans, diets, physical activities, daily routines and schedules, doctor visits, physical exams, vaccinations, cooking instructions, physical activities instructions and environments.

12) The method of 10, wherein the recommendation and suggestion of nutrition intake means the system can establish personalized dietary intake that is an improvement of the established Dietary Reference Intake.

13) The method of 10, wherein the recommendation and suggestion of foods means the system can determine which foods are more suited to the user, and the deciding factors can include user's location, preferences and health.

14) The method of 10 and 1, wherein the recommendation and suggestion of meal plans and diets means that the system further comprising: generating a list of recipes and meals in accordance to the user's and the user's household members' nutritional requirement, preferences, and other health parameters such as allergies, medical restrictions, religion restrictions.

15) The method of 10, wherein the nutritional requirement includes nutritional requirement set forth by the Dietary Reference Intake, personalized nutrition intake suggestions determined by the invention and additional nutritional requirement imposed by physical activities.

16) The method of 10 and 1, wherein the recommendation and suggestion of meal plans and diets means that the system further comprising: generating a list of recipes and meals for a single meal or multiple meals for a single day or multiple days for the present or the future. 17) The method of 10 and 1, wherein the recommendation and suggestion of meal plans and diets means that the system further comprising: generating a list of food items from the

recommendations as a grocery list for the users.

18) The method of claim 10 and 1, wherein the recommendation and suggestion of physical activities mean the system further comprising: determining lists of activities that the users can do and cannot do due to any health or preference issues.

19) The method of claim 10 and 1, wherein the recommendation and suggestion of physical activities mean the system further comprising: receiving user's and the user's household's physical activities, duration, intensity and the environment in which the physical activities were done or will be done.

20) The method of claim 10 and 1, wherein the recommendation and suggestion of physical activities mean the system further comprising: determining changes to the user's physical activities, such as changes in duration or intensity of the physical activities, removing unsuitable physical activities, adding suitable physical activities.

21) The method of claim 10 and 1, wherein the recommendation and suggestion of physical activities mean the system further comprising: determining users' recommended physical activities and exercises, duration, intensity and time frames in which the physical activities should be performed and should be avoided.

22) The method of claim 10, wherein the recommendation and suggestion of cooking instructions means the system further comprising: instructing users on different methods used in cooking to produce safely prepared and cooked food items.

23) The method of claim 10, wherein the recommendation and suggestion of daily routines and

schedules means the system further comprising: analyzing users' health history and generating a list of everyday activities, such as exercising, eating and sleeping, with their individual recommended time frames based on established health information.