WO2016138327A1

WO2016138327A1 - Method and system for a positional display of nutrients and their effect on the human body

Info

Publication number: WO2016138327A1
Application number: PCT/US2016/019666
Authority: WO
Inventors: Matthias W. Rath; Aleksandra Niedzwiecki; Dirk Fried KARNATH
Original assignee: Rath Matthias W
Priority date: 2015-02-26
Filing date: 2016-02-25
Publication date: 2016-09-01

Abstract

The instant disclosure shows the importance of public awareness of each and every food group and food products and how it affects each organ. The positional display of the product and its relation the nutrients present in them and any supplement that may be required to fill the gap has been shown as a system and method.

Description

METHOD AND SYSTEM FOR A POSITIONAL DISPLAY OF NUTRIENTS AND THEIR EFFECT ON THE HUMAN BODY

CROSS REFERNCE TO RELATED APPLICATION

[001] This application claims priority to US Provisional application 62121449 filed on 26^th February 2015. The instant application is a PCT application of the US provisional application 62121449 which is hereby incorporated by reference in its entireties for all of its teachings.

FIELD OF TECHNOLOGY

[002] This disclosure relates generally to a field of a method and system for real time positional display of nutrient information, effect on cell, product information, allergy and side effects of any given product.

BACKGROUND

[003] National health cost and personal insurance cost for health care has increased and continues to increase year after year. The nutritional awareness has increased over a period time where all the products are mandatorily required to provide important nutritional information. However general public are not savvy enough to understand the implication of the metrics at body and cell level.

[004] General public buying a product do not have a clue on what those nutritional information really mean. The national statistics agency mandate the printing of such information, but interpretation has largely been left to the users themselves.

[005] There is largely no information available as part of the product to correlate the product to the wellbeing aspect of a user. General information on Proteins and vitamins in the product do not clearly reflect the usefulness at a personal level.

[006] There is an urgent requirement of an expert who is available all the time either online or direct to interpret the nutritional information. Today, there is no direct connectivity to an expert or an expert system that can guide a user real-time. [007] Personalized health care and wellbeing information is provided separately and not immediately at product buying stage. An expert system with clear digital user interface that comprehensively provides the user care at product, biochemistry and cell level information is missing today.

[008] With Internet being ubiquitous, the user's requirement to share the data with others through a digital media integrated with the health and wellbeing station right at the place of buying the product is missing today.

SUMMARY

[009] Several embodiments for a system and method for a real time visualization of the individual health condition on a digital media station are disclosed.

[010] In one embodiment, the digital media station can be placed to display in a health store that sells healthcare products including food and vitamins.

[011] In another embodiment, the digital media station can be placed to display in a small or a large food store where a user buys vegetables, fruits, meat and other edible products.

[012] In another embodiment, the digital media station can be placed in a mall that has variety of store providing products and services to general public that include food, healthcare and other products to display the value of the products that there are placed in front.

[013] In one embodiment, the digital media station provides RFID and GPS capability to automatically learn the geographical location where the digital media station is placed. In addition, the local data base has information tailored immediately for those surroundings thus not requiring to be manually updated due to movement of digital media stations. In another embodiment, the digital media station is ubiquitous and portable seamlessly where it acquires the data based on its location automatically.

[014] In another embodiment, the digital media station can be placed in a health center where patients and users visit healthcare professionals and doctors.

[015] In another embodiment, the digital media station can be placed in pharmacy where users are interested in understanding the prescription, products and services.

[016] In another embodiment, the digital media station automatically learns about the products that users scan and input to update its local knowledgebase. [017] In one embodiment, the digital media station displays a specific organ as voice, video and data, by gathering the nutrition, product information and medical data of a person who is using the digital media station.

[018] The digital media station provides Education, Wellbeing, and Social aspects of the product and service to the user. When a user buys a product, there is a correlation between interpreting the nutritional information and the user characteristics. For example, a person who is tall will have a different daily requirement compared to a person who is short.

[019] In one embodiment, the proposed system authenticates user for security purposes using various methods including username, password and other biometric means to protect the data and for privacy. In one embodiment, the digital media station acquires the product information through bar code, QR code, and product code or product details and provides information in the description window important information regarding the product.

[020] Direct interpretation of nutritional information without the medical background history of a user is not only useless but dangerous. This leads to the importance of education. In one embodiment, the digital media station provides nutritional interpretations of the product.

[021] A user is educated on the nutrition of the product on what those percentage and metrics mean related to their personal data. In one embodiment, the user through the digital media station is provided explanation of the product nutritional information and the definition of metrics in particular.

[022] In addition, the digital media station allows the user to understand the cell level interaction of that particular product and how it relates to the user's situation. The education also includes the biochemistry of the product ingredients on the body mechanism. In one

embodiment, the digital media station provides the important biochemistry and cell level details of the product's impact on the user.

[023] In addition, the user understanding is enhanced through graphical method in both user interface and media that include voice, video and data. In one embodiment, the digital media station provides the expert biochemistry and cell level details through high definition graphics media with high quality voice and video. The video is also shown in 3D for proper

understanding of the cell structures and body parts.

[024] In addition, the user understanding needs to be validated by asking relevant questions that adds value to user. In one embodiment, the digital media station provides an interface to a direct expert who is available to engage with the user on important questions and to provide relevant answers.

[025] In one embodiment, the user can request additional information to the expert by providing important details such as blood pressure by using the blood pressure machine connected to the digital media station. In another embodiment, a user can request additional information to the expert by providing a picture or video snapshot using camera connected to the digital media station.

[026] In one embodiment, the digital media station provides voice, video and data interface to the expert on-line and real-time. The expert advice could be either through expert system or through a live health care professional.

[027] In one embodiment, the expert advice can either be free or monetized. When monetized, the fee can be transferred through various digital media station interfaces including credit cards.

[028] In addition, the system needs to take these question and answers and user requirement into its knowledgebase for further analysis to draw intelligent conclusions and be prepared for the user the next time they come around with either same or different product. In one

embodiment, the digital media system architecture provides a back end cloud based media expert system that takes the user questions, buying patterns, background information, and other relevant information to conduct intelligent analysis to provide proper guidance specific to the user.

[029] There is not much of a concern provided to the wellbeing portion today. A person who buys a product does not fully understand at the expert level the various things that can be done with the product. In one embodiment, the digital media station provides the wellbeing aspect of the product or service specific to the user.

[030] The product itself per-se may not be of much interest to the user, as long as the usefulness of that product is clearly articulated. The wellbeing portion should expand the use of the product with interesting recipes that can add to the wholesomeness of the person. In one embodiment, the digital media station provides important recipes that the user can try based on the product or collection of products that has been acquired.

[031] In another embodiment, the digital media station allows scanning multiple products such as fruits and vegetables to intelligently suggest recipes that include all or majority of the items. In addition, the digital media station shows the combined nutrition aspect of all of them and their impact on body and cell level structures. [032] In another embodiment, based on the user requirement and goals that includes weight, BMI and other parameters, the expert system can suggest recipes for attaining the goal taking constraints such as allergy and other sensitivities into account.

[033] In addition, the wellbeing includes important information such as exercises that can help the person stay in shape. Especially, if the product is related to body maintenance. In one embodiment, the digital media station provides exercise routines that help development and/or maintenance of a portion or body. In another embodiment, a user who is interested in buying protein shakes can understand the exercise routines needed to develop triceps or abs. In another embodiment, the user is shown the muscular and cell level details of the impact on exercise and the present verses future impact on the body.

[034] In addition, the wellbeing shows the groups, the person can belong, to increase awareness and exchange of information and to increase the user knowledge. In one embodiment, the media expert system provides important support groups available for a user who needs additional support.

[035] With the advent of technology, Internet has become a necessity. The user needs to get direct access to the social media anytime-anywhere to connect with people. In one embodiment, the digital media station provides interface to Internet so the user can communicate the product information and analysis results to others.

[036] In another embodiment, the user is provided digital input/output access for acquiring the data that is shown in the digital media station. In another embodiment, expert advice obtained by the user can be transferred through USB, Bluetooth, WiFi, smart phones, WiMAX, 2G/3G/LTE and paper printing for filing and other purposes.

[037] In addition, a provision to exchange the information over email is provided so it instantly registers in user's personal logs. In one embodiment, the digital media station provides the interface to compose the email, attach the findings and other important advice and send.

[038] In addition, the system provides an interface to social media and message system where the user can instantaneously send information learnt to their like-minded group. In one embodiment, the user can share the information through social media applications such as Facebook, What's app, Hangouts, Twitter, Tumblr, Instagram, Google Drive, and Dropbox in addition to all the mechanisms provided by Apple Company. In another embodiment, the digital media station allows the data to be sent to any operating system including Apple IOS, Android, Windows and any/all Microsoft operating systems, Linux and other experimental system that allow communication.

[039] There is also a need for constant monitoring of information by experts. Similarly, experts such as health care professionals can monitor users and provide consultation on a real-time basis. In one embodiment, the user data that is collected is analyzed in the expert system, and combined with the expert opinions provided to draw important conclusions. In one embodiment, the expert system input and expert advice is combined in the media intelligence to draw important conclusions of user data with high confidence interval. In another embodiment, hysteresis based on past data is used along with expert advice to conduct predictive models on the user condition to obtain important next steps for the user.

[040] There is a need for experts to analyze through hysteresis and come to important conclusions towards making a sound decision based on historical and present values collected through the digital display system. In one embodiment, the cloud based media expert system conducts such an analysis.

[041] There is a need for experts and the users to run "What if scenarios based on past and present collected information and analyze the future to take important decisions towards introducing positive life changing activities. In one embodiment, the cloud based media expert system conducts such an analysis to show options to the user for future wellbeing.

[042] In one embodiment, a user can participate in creating the input, study the content, share the content and interactively use the content. The user may also explore the image at an organ level, cross sectional view and at a tissue level. In another embodiment, the user may

interactively observe, change and learn effect of modulation of at least one of micronutrients, drugs, environmental toxins and pathogen levels and their effect on cellular level, organ level and tissue level. Micronutrients may be, not limited to, vitamins, amino acids, supplements; drugs may be chemotherapy drugs, antibiotics, antihistamines, steroids etc.

[043] In another embodiment, the user can understand the different functionality of

micronutrients affecting the microenvironment of the cells and their effects of modulation in the cell and their general health.

[044] The expert may require additional information through wearable sensors available through digital monitor station. In one embodiment, the system may be able to receive and interact with various other devices, sensors, wearables, monitors, databases, wireless connected devices, data and manual input and to collate the data and display a rendition of an organ and its sub parts in real time. The data when received and transmitted will comply with local authority rules such as HIPPA compliance. In another embodiment, the smart devices can be used as sensor devices when they are connected through Bluetooth or USB interfaces of the digital media station.

[045] The system in one embodiment may have many modules that have different functions to integrate the individual data and present the image of the organ. The rendering of the image, in another embodiment, may be the result of cause and effect that depends on the input, activity and nutritional status along with the medical status of the individual. The method, process and system may use big screen displays throughout the stores to show the local area where the produce was being sowed, harvested and processed. That way it would be more interactive for the user.

[046] In one embodiment, a system may comprise of various mobile devices such as tablets, wrist band devices, iPad, computers, cell phones, gaming devices and wearables such as a watch or glasses. The data may be portable from one device to another. All the devices may be connected using a network, and the data may be stored in a database or a cloud based storage arrangement. The system provides networking interfaces, wired and wireless, to connect to various mobile devices such as tablets, wrist band devices, iPad, computers, cell phones, laptops, gaming devices and wearables such as watch or glasses.

[047] The system comprises of several modules, and all of them are run on hardware's. In one embodiment, a processor may contain a user module, device module and a server module. In another embodiment, a method of gathering at least one of a physiological parameter, pathological parameter and therapeutic parameter automatically from a user to present for a personalized interactive display for the user on a mobile device. In another embodiment, rendering of at least one of a personalized reformatable physiological model and pathological model at the level of an organ, a cross section of an organ, parts of an organ is done at the cellular level of an organ and the subcellular level of said organ on the device. The device may be mobile or wearable interfaced to the digital media station.

[048] In another embodiment, switching from one level to another (e.g. organ to cell or cell to subcellular) on that visual device by performing a swiping action on a screen of the device. A reverse sweep also would render the image to revert to the previous state of display. In one embodiment, dynamically updating a relevant data pertaining to a normal, disease and treatment option; and recording a variable in the user health for a data storage purpose is done.

[049] In one embodiment, modifying at least one of the physiological parameter, pathological parameter and therapeutic parameter on the screen of the device and changing the rendition of the organ and the cellular level to show the effect is performed.

[050] In one embodiment, body sensors constituting Implanted sensors, Surface mounted sensors and Accompanied unattached sensors communicate over wireless medium to user devices consisting of tablet, laptop, desktop and smart device to collect important physiological information to be stored in local database and track the information through proper metrics. The information collected can be seamlessly transferred to the digital media station to be transferred to the expert for further analysis.

[051] The proposed system interfaces seamlessly with body sensor network, real-time body information through monitoring devices and other products.

[052] In one embodiment, the proposed system conducts the analytics and provides a comprehensive report with statistics and metrics tailored to the user's requirement.

[053] In another embodiment, the proposed system consolidates the user questions and expert answers as a report to be read or downloaded by the user through the input/output interfaces.

[054] The proposed system handles the product information including pricing and discounts. In one embodiment, user specific discounts are introduced in the system to encourage users to buy specific products and services that are to their wellbeing.

[055] The proposed system handles the accounting and billing portion. In one embodiment, the user can pay for the product through the system using various payment methods including cash and credit cards. In another embodiment, the proposed system automatically calculates discounts and other user incentives, such as points, before, during or after the payment process.

[056] In one embodiment, the proposed system handles the returns and the account

reconciliation through backend accounting process.

[057] The proposed system collects user email and other social media information and disseminates important health related and discount information periodically or on a need basis. In one embodiment, the proposed system provides the option for user to deny future

communication by the system for the purposes of marketing. [058] The methods and systems disclosed herein may be implemented in any means for achieving various aspects, and may be executed in a form of a machine -readable medium embodying a set of instructions that, when executed by a machine, cause the machine to perform any of the operations disclosed herein. Other features will be apparent from the accompanying drawings and from the detailed description that follows.

BRIEF DESCRIPTION OF THE DRAWINGS

[059] Example embodiments are illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements and in which:

[060] Figure 1 is a view of the display media station and the major goals it accomplishes.

[061] Figure 2 illustrates the end to end architecture of the proposed system that constitutes digital media station 202 and the cloud based media expert system 210.

[062] Figure 3 illustrates the digital media station 202 system architecture that constitutes display unit 302, display I/O 304, and display controller 306 communicating through LAN 206.

[063] Figure 4 is an exploded view of the display unit 302 and its interfaces to display controller 306 and the display I/O 304.

[064] Figure 5 is an exploded view of the display I/O 304 system architecture and its interfaces to display unit 302 and display controller 306.

[065] Figure 6 illustrates the system architecture of display controller 306. The display controller 306 interfaces with display unit 302, display I/O 304, LAN 206 and local databases 624, 626 and 628.

[066] Figure 7 illustrates the backend cloud based media expert system 210 architecture that interfaces with expert client 216, knowledgebase 214 and 212.

[067] Figure 8 shows the media intelligence module 714 dependencies to other constituent modules within the backend cloud based media expert system 210.

[068] Figure 9 illustrates the digital media station 202 connectivity to the local area network 206 and to the backend cloud based media expert system 210 through Internet 208.

[069] Figure 10 illustrates the message sequence diagram for the new user input and the authentication portion of the user.

[070] Figure 11 illustrates the message sequence diagram for the expert consultation set up mechanism. [071] Other features of the present embodiments will be apparent from the accompanying drawings and from the detailed description that follows.

DETAILED DESCRIPTION

[072] Several method, process and systems for informational, integrated and interactive educational modules using modular multimedia tools for medical, physiological and pathological conditions of the virtual human body are disclosed. Although the present embodiments have been described with reference to specific example embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the various embodiments. This disclosure also relates to a comprehensive methodology of providing users a meaningful analysis of health, wellbeing, network connectivity to an expert for real-time consultation, product acquisition, direct dissemination of information into social media and expert comments over input/output devices. More particularly, it relates to an expert system that continuously over real-time caters to user requirements, observes the user pattern, analyze through hysteresis their concerns and draws conclusion using experts interaction and to meaningfully convey the health condition and education to the users directly, on-line, real-time over network through the display.

[073] Figure 1 illustrates the display media station functionality. They are broadly classified as Education 102, Wellbeing 104 and Social 106. Education 102 portion of the digital media station covers the aspects of providing nutritional information, cell level interaction, allergens and side effects to the user. Any information at the organ and cellular level comes under the purview of the education 102. The display media station has the goal of providing information on wellbeing 104 to the user as well. Here the display media station provides information about recipes, exercise routines, community support groups and other wellbeing information that helps users achieve their goal. The third important goal of display media station is to provide connectivity to the social networks 106 that include email, social media such as Facebook, Twitter, Hangouts, Apps, What's app, and other messaging services.

[074] Figure 2 illustrates the end to end architecture of the proposed system. The digital media station 202 that consists of local information is connected through local area network to the Internet and to the cloud based media expert system in the backend 210. In one embodiment, several digital media station 202 can be connected to the LAN providing main graphical user interface to communicate with the user. In one embodiment, the digital media station 202 is connected to the LAN through wireless medium to a WiFi router 204. In another embodiment, the digital media station 202 is connected over wireless medium over any of the wireless technologies such as WiMAX, WiFi and Zigbee. In another embodiment, the digital media station 202 is connected to the local area network through cellular network such as 2G, 3G and LTE technologies. In another embodiment, the digital media station 202 is connected to the local area network 206 through wired interface such as Ethernet and fiber. Digital media station 202 communicates with user to obtain user requirements on products and services and handles the local queries directly. In one embodiment, the digital media station 202 acquires user information and relays to the cloud based media expert system 210 in the backend through Internet 208 via local area network 206. The cloud based media expert system 210 handles the backend intelligence to cater to the specific needs of the user. If the user requires consulting, the cloud based media expert system 210 provides direct interface to a resident expert through expert client 216 who can communicate directly with the user. In one embodiment, the expert client is remotely connected to the cloud based expert system through Internet 208. The cloud based media expert system 210 interfaces with user knowledgebase 214 and education knowledgebase 212. The user knowledgebase 214 consists of all the information related to the user, including their history, medical data, user names and passwords. In one embodiment, the user

knowledgebase 214 is redundant providing fault tolerance for reliability purposes. The education knowledgebase 212 consist of all the information regarding medical, pharmaceutical, nutritional and other wellbeing information. In one embodiment, the education knowledgebase 212 is redundant for reliability purposes.

[075] Figure 3 illustrates the components of the digital media station system. The architecture consists of display unit 302, display input/output 304 and the display controller 306. The display unit 302 is connected to the display controller 306, and the display I/O 304 is connected to display controller 306. The display controller 306 manages both Display I/O 304 and Display unit 302. The information gathered from the user is relayed to the back end cloud based media expert system 210 through Internet 208 via local area network 206. In one embodiment, the display controller 306 is directly connected over wire using technology such as fiber and

Ethernet, to the display unit 302 and display I/O 304. In another embodiment, the display controller 306 is connected to the display unit 302 and display I O 304 through wireless interfaces through a WiFi router 204. In another embodiment, the display controller 306 is connected to the display unit 302 and display I/O 304 through cellular network technology including 2G, 3G and LTE. Without loss of generality, the communication between the components carry information from user to the backend cloud based media expert system 210 seamlessly.

[076] Figure 4 illustrates the display unit 302 system architecture. Display unit 302 provides the main function of interfacing with the users. The display unit 302 provides space for the display window 402 which is a monitor space to show digital voice, video and data. In one embodiment, the description window 402 can be a high definition LED monitor. In another embodiment, the description window 402 can be a digital television. In another embodiment, the description window 402 can be a projected video through a projector. The description window 402 can be an integrated monitor as well. The display unit 302 provides the functionalities of nutrition 404, health 406, recipe 408, expert consulting 410 and pricing 412. In addition, the display unit provides the network connectivity to social media portions through email 414, messages 418, post a question 416 and direct input to Apple and Android Apps such as Fitbit 420. The display unit 302 is connected to the display controller 306 that controls the operation of the display unit 302.

[077] Nutrition 404 provides the information regarding the nutrition of a particular product that has been scanned using display I/O 304. In one embodiment, a user can scan a product or write a query in the display I/O 304 and the description window 402 shows the nutrition information of that particular product. In one embodiment, a virtual human organ or cellular level or subcellular level rendition may be created with all the details of each physiological system such as circulatory system, function of a cell, organ function such as a liver function, heart function, effect of nutrient deficiency in the heart or skin, effect of exercise or movement on the healthy heart, effect of nutrient sufficiency or deficiency on the normal, and diseased heart. The description window 402 shows a virtual human body as soon as the user chooses where and what to enter using the graphical user interface in display I/O 304. In another embodiment, the animation of the virtual human body with narration may be switched on or off. The purpose of this invention is to educate the user and evaluate the user for their ability to understand scientific facts and scenarios in a graphical format in real time.

[078] In one embodiment, the user selection of nutrition 404 shows the effect of micronutrient concentration increase in preventing plaque formation may be observed by the user who is travelling inside the virtual human artery. In another example the effect of a heart attack may be felt by the red blood shaped space ship as crushing effect and a jolt and/or narrowing of the artery. These are examples and the embodiments are not limited to these examples. An user could be an individual who is a teacher, patient, software developer, system manager and not limited to these definitions.

[079] Health information 406 is provided consisting of Education 102 and wellbeing 104 aspects of a particular product, a set of products or a set of questions from the user. The information could be very detailed on the cause and effect of a particular scenario.

[080] In another embodiment, the health 406 query could lead to the human body visualized at tissue level, cross sectional level, system level and/or an organ level. The system level is at least one of circulatory system, respiratory system, digestive system, musculoskeletal system, endocrine system, integumentary system, immune system, lymphatic system, reproductive system, urinary system, vestibular system and nervous system. The organ level is at least one of a brain, amygdala, basal ganglia, brain stem, medulla, midbrain, pons, cerebellum, cerebral cortex, hypothalamus, limbic system, eye, pituitary, thyroid, parathyroid, ears, heart, lung, esophagus, thymus, pleura, adrenals, appendix, bladder, gallbladder, large intestine, small intestine, kidney, liver, pancreas, spleen, stomach, prostate, testes, ovaries, uterus, breasts, hips, legs and throat.

[081] In another embodiment, the user could request the cause and effect information as part of health 406 and information on diseases is shown, such as autoimmune diseases, cancer types, communication disorders, cutaneous conditions, metabolic disorders, endocrine diseases, eye diseases and disorders, genetic disorders, infectious diseases, intestinal diseases, heart diseases (arrhythmia, arteriosclerosis and heart attack) and neurological disorders.

[082] Recipe module 408 provides the user with an interface to scan a product and find useful recipe to achieve the goal in terms of nutrition and wellbeing. In one embodiment, the user can scan multiple products such as vegetables, meat and fruits to find common recipes to achieve the goal. In another embodiment, the selection of recipe 408 and input of various products using display I/O 304 enables the display in description window 402 various recipe, consolidated nutritional information and visuals on the method of preparing food.

[083] Expert consulting 410 functions provides the user an access to live communication with an expert. The expert takes in important information either through query or through various sensors in Display I/O to relay important diagnostic and preventative mechanisms to the user. The expert may gather through display I/O 304 module user input and other sensor input from other devices such as oximeter, fitbit, jawbone, sensors of other equipment's, blood pressure cuffs, and heart rate monitoring devices. In one embodiment, the user may need to authenticate using username and password to invoke this feature. In another embodiment, the user may have to pay to access this feature.

[084] Pricing module 412 provides the important function of product pricing, discount and services pricing. In one embodiment, the user can scan the product using display I/O 304 and purchase the product directly by applying appropriate discounts. In another embodiment, the user can pay using pricing module 412 to access expert consulting 410 if such a service requires payment of funds.

[085] Display unit 302 also provides interfaces to the social media using email 414. The user can access email function to compose, write, edit, and send an email from the display unit 302. In one embodiment, the display unit 302 may limit the email 414 functionality for specific purposes. The user can post 416 a query to the expert on specific concerns. The user can write 418 a message from the display unit 302 to social media sites such as Facebook, Twitter, Hangout, What's app, Instagram, Tumbler and other user groups. The user can also interact over network to Apps 420 and wearable technology applications such as Fitbit.

[086] Figure 5 illustrates the display I/O architecture. Display I/O 304 interfaces with display unit 302 and display controller 306. Display I/O provides the Input and Output devices using which the expert system and the experts gather input and provide expert comments. Camera 502 function allows the user to be in front and focus their area of concern. For example, the user may wish to show a skin patch and an ointment to verify the usefulness. In one embodiment, the camera takes in high quality still picture to be sent to experts. In another embodiment, the camera takes video clips to share with experts. The printer 504 module is used for obtaining printed data from the display I/O. The user can request a consolidated report in print format, or just take product information.

[087] User input 518 modules are used to gather the information about the user. In one embodiment, the user input could be parameters such as physiological parameter, pathological parameter and therapeutic parameter. The user input module 518 is also used for collecting the authentication verification information, such as username and password. [088] The payment module 520 constitutes information gathering regarding payment through credit card and other means such as cash and Paypal. The payment module 520 interfaces with the controller 306 and backend system for authentication verification purposes.

[089] Various input methods are used for collecting user and locational information. RFID 506 is used for obtaining positioning information. In one embodiment, the digital media station 202 can be placed in any aisle in a super market without customizing. The digital media station 202 obtains the product information and customizes automatically using RFID function 506 where available. In another embodiment, the system readily recognizes a product using RFID code. Similarly, user or a product information can be read using QR code 508 where available. A bar code 510 can also be used to obtain product information or user ID information. USB 512 interface can be used both the input and output information. In one embodiment, a smart device can be connected over USB to download information. In another embodiment, a smart device can be connected over USB to provide information collected in an App to the digital media station 202. In another embodiment, a USB stick can be used to provide or store information to the digital media station 202. Similarly, Bluetooth 514 can be a mechanism to connect to and either provide or download information from the digital media station 202. An expert comment can be directly downloaded over Bluetooth to the smart device, laptop or any other user equipment that supports Bluetooth. A wearable sensor monitor 516 is used for collecting important physiological parameters of the user. In one embodiment, a blood pressure monitor can be providing input 516.

[090] The display I/O 304 consists of multiple wearable sensor monitors that collect information on parameters such as blood pressure, heart rate, height, weight and BMI. The data gathering modules 502-518 are used for getting medical data of the individual user, age, sex, weight, the nutritional information of what they ate, what nutritional supplements did they consume, what medications do they take, what type of exercise did they do and do on a regular basis, any other device that they use that collects vital signs, their projected goal such as a weight loss goal and a time limit for it. This module 304 not only gathers data that has been input by the user into the device but also from other devices such as oximeter, Fitbit, jawbone, sensors of other equipment's, blood pressure cuffs and heart rate monitoring devices.

[091] Figure 6 illustrates the display controller system architecture. The controller 306 interfaces with the display unit 302, display I/O 304 and the local area network 206. The network interface module 622 provides the drivers and connectivity to the network. The authentication 602 module obtains the username and password from the user through display I/O 304 and authenticates locally or by interfacing with the backend media expert system 210. The accounting module 604 interfaces with the payment module 520 in display I/O 304 to track the payment portion. The accounting module 604 also interfaces with the backend media expert system 210 to synchronize the available credits and payment information.

[092] The local analytics 606 module gathers the analytics metrics regarding users, products, services and questions in general posted by users. The local analytics 606 interfaces with the backend media expert system 210 to download the findings, and in the process updating local user information. The GPS unit 608 synchronizes the GPS pulse for exact time and geographical positioning purposes. The unit 608 allows the backend expert system 210 to provide location specific services to the users. The media expert system interface 610 brings the important backend interface to the media expert system 210. The display controller 306 has the

intelligence to handle local user level issues, but it does update the media expert system 210 through media expert system interface 610 for data consistency purposes, and to support the expert consulting purposes. Media expert system interface 610 is the main artery to the backend intelligence. In one embodiment, the local analytics 606 engine handles the advertisement modules for location based advertisement to be shown to the user using the display unit 302.

[093] Auto position identified 612 uses the RFID 506 module in display I/O 304 and the GPS unit 608 to obtain the position of digital media station 202 accurately. Display unit status 614 module is used for monitoring the display unit 302 module. The user interaction using GUI is through the display unit 302 and hence the display unit status 614 module closely monitors the unit. In one embodiment, the display unit status 614 proactively estimates the life of the unit by monitoring the performance of subcomponents.

[094] Price/billing database interface 616 uses the local accounting database 624 to obtain the pricing, discount, billing, invoice and logistics information for the products available in that location. The module 616 also interfaces with the backend expert system 210 to update periodically to keep the database up-to-date. The interface 616 is accessed during payment 520 process.

[095] The user database interface 618 uses the local user database 626 to collect and store information regarding users who are local to that unit. The interface 618 also interacts with the backend expert system 210 to bring the latest user information to keep the database up-to-date. The user database 626 consist information such as username, password, identification and other user parameters.

[096] The info database interface 620 interfaces with the local info database 628 to obtain information about product, services and body, cellular and organ level description to quickly provide voice, video and data to the user. The info database interface 620 also interacts with the backend expert system 210 to synchronize the data based on hysteresis. In one embodiment, keeping information locally helps speed up the access process. In another embodiment, the local database access saves bandwidth in the backend due to local resolution of queries. In another embodiment, the local information enables the continuation of service when the backend system 210 is not reachable.

[097] Figure 7 illustrates the cloud based media expert system architecture 210. In one embodiment, the media expert system may be collocated with the digital media station 202 either connected directly or through Wireless LAN, LAN or Cellular network 2G/3G/LTE 206. The cloud based media expert system 210 connects to the digital media station 202 through Internet 208. It also interfaces with the Expert Client 216, redundant user knowledgebase 214 and the redundant education knowledgebase 212.

[098] The cloud based media expert system 210 broadly consists of sever distinct modules. The user knowledgebase interface 702 provides the mechanism to interface with the redundant user knowledgebase 214. The education knowledgebase interface 708 provides the mechanism to interface with redundant education knowledgebase 212. The network interface 704 handles the information transfer to and from the Internet 208 All sensor data and expert data that are communicated to and from wearable sensors 516 and user devices are done through the Internet 208 and managed in the cloud based expert system 210 by the network interface 704.

[099] Redundancy management 706 module is responsible for managing the user

knowledgebase 214 and education knowledgebase 212 redundancies for fault tolerance purposes and to increase the reliability and availability. The redundancy module 706 monitors the knowledgebase constantly, handles mirroring, consistency, and data consistency. The module 706 also handles the detection of fault, fault recovery, switch over and maintenance tasks to make sure the knowledgebase is consistent and highly available at all times. [0100] Expert user consulting interface 712 manages user connectivity to the expert system 210. The connectivity can be direct or through Internet 208. The interface 712 provides the username and password verification, where the interface module 712 interacts with Authentication 710 to validate the expert logging in. In addition, the expert consulting interface 712 interacts with the expert client 216 to bring them online to interact directly with the end user.

[0101] The Authentication module 710 handles the security aspect of the expert system 210 where it validates any login to the expert system for analyzing or communicating with either users or sensors. The authentication module handles the user validation portion of password, number of attempts allowed, password recovery, and user verification to reset password and the setup of new user and password. The authentication module 710 provides support to the local authentication 602 module in the digital media station.

[0102] Finally the media intelligence 714 function is the main engine that provides the education intelligence and computation mechanism. The system intelligence 714 handles the backend expert system through hysteresis, predictive models and artificial intelligence techniques.

[0103] Figure 8 shows the media intelligence module 714 function in detail. The media intelligence 714 interfaces with redundancy management 706, education 708 and user 702 knowledgebase interfaces to communicate with the redundant user knowledgebase 214 and education knowledgebase 212. The media intelligence 714 communicates to user and sensors over Internet 208 through the network interface 704. In addition, media intelligence 714 interfaces with experts through authentication module 710 and expert user consulting interface 712.

[0104] Media intelligence 714 has eight major functions to provide useful analytical results using artificial intelligence techniques. Graphical interface 804 provides the graphical user interface back end support to the experts and the user. The interface 804 manages both data visualization, representation and animation portion of the architecture. The interface 804 assists the digital media station 202 through the controller for proper digital display of educational and expert information. Consulting real-time scheduler 814 modules is crucial as it handles the heartbeat of the expert consulting service. The schedule 814 collects sets up important expert consulting sessions in a timely fashion and monitors the links for timely completion. In one embodiment, the scheduler impacts the payment module as the consultancy could be done on a timely basis. [0105] Hysteresis 818 module operates on the data that is stored in user knowledgebase 214, user history 816 and the new data obtained to analyze the trend and metrics that is most useful for the user. For example, an expert might analyze Body Mass Index or other complicated scenarios based on hysteresis. Predictive model module 820 module uses the hysteresis 818 results and predictive methods to generate answers to "What if scenarios asked by users and experts. Predictive model module 820 interacts with graphical interface 804 to provide the results in a visually pleasing form to the digital media platform. User knowledgebase update 810 module interfaces with user knowledge interface 702 to update both user knowledgebase 214 and education knowledgebase 212. For example, journal studies, articles, major finding, analysis, results, and important data are updated periodically so the experts and users have latest information available at all time.

[0106] User background module 806 takes the wearable sensor input from a particular user and intelligently maps it to keywords and tags needed for classification in education. Education knowledgebase inference 808 module provides the intelligence needed to take the tags and keywords to identify the relevant educational portfolio in the education knowledgebase 212 that can impact the user. For example, if the analysis finds a user's cholesterol level as high, then the education database inference engine 808 gets impact articles based on tags produced by mapping module 806. The tags in this case could be heart disease, heart attack, plaque, stroke, cardio exercises etc. The predictive models 820 uses hysteresis 818, user history 816 and the knowledgebase 808 to provide a collective complete documentation to the user on present scenario, educational information and future predictions.

[0107] Figure 9 shows the digital media station 202 connectivity to the Internet 208 to access the media expert system 210. The digital media station 202 connects over LAN, Wireless LAN 204 or Cellular network connectivity 206 to the Internet. If the digital media station 202 uses the wired medium such as DSL908, COAX 910 and Fiber 912, the Internet access is through modem, switch hub and a router 904. Router or switch 904 is needed even when a wireless CPE 914 or a satellite 918 is used as an access medium. If the access to the internet is over Cellular network then the connectivity is through SIM directly over a 2G, 3G or a LTE network 906 to the Internet 208.

[0108] Although the present embodiments have been described with reference to specific example embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the various embodiments. For example, the various devices, modules, analyzers, generators, etc. described herein may be enabled and operated using hardware circuitry (e.g., CMOS based logic circuitry), firmware, software and/or any combination of hardware, firmware, and/or software (e.g., embodied in a machine readable medium). For example, the various electrical structure and methods may be embodied using transistors, logic gates, and electrical circuits (e.g., application specific integrated (ASIC) circuitry and/or in Digital Signal Processor (DSP) circuitry).

Displaying all the values for the food on the personal mobile device such as a mobile phone 922, ipad 920 and computer 924 for the user to view a consolidated display for smart buying.

[0109] Figure 10 provides the message sequence chart for the new user input mechanism. It shows the dependency between various modules. When a new user accesses the display unit 302, it requests a session through display I/O 304, which provides a request for authentication through display controller 306. The display controller 306 authenticates in the local database 624-628. In addition, the display controller 306 communicates over Internet 210 to the media expert system 210 for authentication of the user, and update of the user information in case of new user. The media expert system 210 updates the user knowledgebase 214 and communicates the information back to the display controller 306, which synchronizes with local database before providing the access or deny the access to the user through display unit 302.

[0110] Figure 11 provides the message sequence chart for the scenario where a user requests expert consultation. The user provides the request to expert from display unit 302 through display I/O 304. The Controller 306 receives the request and sends to media expert system 210 through Internet 208. The media expert system 210 uses the expert client interface to contact expert client 216 and sets up a session over Internet 208 to the digital controller 306 and display unit 302.

[0111] In addition, it will be appreciated that the various operations, processes, apparatuses and methods disclosed herein may be embodied in a machine-readable medium and/or a machine accessible medium compatible with a data processing system (e.g., a computer system), and may be performed in any order (e.g., including using means for achieving the various operations). Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.

Claims

CLAIMS What is claimed is:

1. A system, comprising:

a computer aided device that has a digital media station for display;

a nutritional product displaying and selling station; and

a health related nutrient products; wherein the digital media station displays a nutritional value, price and an effect of the nutritional product and health related nutrient product from the computer aided device for display to an individual mobile device.

2. The system of claim 1, further comprising:

a QR code reader to be installed to read and display the nutritional value, price, diet value, and calorie value for each nutritional product and the health related nutrient product.

3. The system of claim 2, wherein the nutritional value, price, diet value, and calorie value for each nutritional product and the health related nutrient product helps the individual to buy according to his nutritional needs or diet plan.

4. The system of claim 2, wherein nutritional value, price, diet value, and calorie value for each nutritional product and the health related nutrient product is used for educational purpose.

5. The system of claim 2, further comprising:

the computer aided device enables the user to set preferences to visualize a cellular level effect display and disease state effect of each nutritional product and the health related nutrient product that is being scanned by the QR code and being displayed on the computer aided device.