CN108121974A - A kind of display module structure and terminal device - Google Patents
A kind of display module structure and terminal device Download PDFInfo
- Publication number
- CN108121974A CN108121974A CN201711438846.3A CN201711438846A CN108121974A CN 108121974 A CN108121974 A CN 108121974A CN 201711438846 A CN201711438846 A CN 201711438846A CN 108121974 A CN108121974 A CN 108121974A
- Authority
- CN
- China
- Prior art keywords
- food
- measured
- energy value
- mentioned
- intake
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
Abstract
The embodiment of the invention discloses a kind of detection method of food energy, terminal device and computer-readable medium, wherein, method includes：The first image of food to be measured is obtained by camera, the species that image identification determines the food to be measured is carried out to the first image of the food to be measured；Obtain the quality of the food to be measured；The energy value and nutritional ingredient of the food to be measured of the quality of the species are calculated, sends the first prompt message comprising the energy value and the nutritional ingredient.The embodiment of the present invention can determine the species of food to be measured by identifying the image of food to be measured, obtain the energy value and nutritional ingredient of food to be measured, user can be prompted, user is facilitated quickly to know the energy situation of food to be measured, so as to aid in user's reasonable diet.
Description
Technical field
The present invention relates to field of terminal equipment more particularly to a kind of food energy detection method and terminal devices.
Background technology
With the continuous improvement of people's living standards, also occur increasingly abundanter selection in terms of diet, however it is fat
Number it is also more and more, many people start to pay attention to oneself weight and dietetic nutrition, it is desirable to be able to weight-reducing or maintain body
Weight is kept fit, and general people can formulate the recipe of oneself by professional institution, avoid taking in excessive heat, so as to reach
Weight-reducing maintains to keep the effect of the nutrition supply needed for body while stature, it is necessary to there is certain consuming capacity, and so
People still can not quickly know the energy in food.
The content of the invention
In a first aspect, an embodiment of the present invention provides a kind of food energy detection method, this method includes：
The first image of food to be measured is obtained by camera, image identification is carried out to the first image of the food to be measured
Determine the species of the food to be measured；Obtain the quality of the food to be measured；
The energy value and nutritional ingredient of the food to be measured of the quality of the species are calculated, is sent comprising the energy
First prompt message of magnitude and the nutritional ingredient.
Second aspect, an embodiment of the present invention provides a kind of terminal device, which includes performing above-mentioned the
The unit of the method for one side.
The embodiment of the present invention obtains the image of food to be measured by camera, and institute is determined according to the image of the food to be measured
State the species of food to be measured, obtain the quality of the food to be measured, calculate the species, the quality food to be measured energy value and
Nutritional ingredient sends the prompt message comprising above-mentioned energy value and above-mentioned nutritional ingredient, user can be facilitated quickly to know and treated
The energy situation of food is surveyed, so as to aid in user's reasonable diet.
Description of the drawings
Technical solution in order to illustrate the embodiments of the present invention more clearly, below will be to needed in embodiment description
Attached drawing is briefly described, it should be apparent that, the accompanying drawings in the following description is some embodiments of the present invention, general for this field
For logical technical staff, without creative efforts, other attached drawings are can also be obtained according to these attached drawings.
Fig. 1 is a kind of schematic flow diagram of food energy detection method provided in an embodiment of the present invention；
Fig. 2 is a kind of schematic flow diagram for food energy detection method that another embodiment of the present invention provides；
Fig. 3 a are a kind of terminal device food energy detection interface schematic diagrams provided in an embodiment of the present invention；
Fig. 3 b are another terminal device food energy detection interface schematic diagrams provided in an embodiment of the present invention；
Fig. 4 is a kind of structure diagram of terminal device provided in an embodiment of the present invention.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is part of the embodiment of the present invention, instead of all the embodiments.Herein
" embodiment " is referred to it is meant that a particular feature, structure, or characteristic described may be embodied in the present invention at least in conjunction with the embodiments
In one embodiment.The phrase, which occurs, in each position in the description might not each mean identical embodiment, nor
With the independent or alternative embodiment of other embodiments mutual exclusion.Those skilled in the art explicitly and implicitly understand,
Embodiment described herein can be combined with other embodiments.
Based on the embodiments of the present invention, those of ordinary skill in the art are obtained without making creative work
The every other embodiment obtained, belongs to the scope of protection of the invention.
Term " first ", " second " in description and claims of this specification and above-mentioned attached drawing etc. are for distinguishing
Different objects rather than for describing particular order.In addition, term " comprising " and " having " and their any deformations, it is intended that
It is to cover non-exclusive include.Such as process, method, system, product or the equipment for containing series of steps or unit do not have
The step of having listed or unit are defined in, but optionally further includes the step of not listing or unit or optionally also wraps
It includes for other intrinsic steps of these processes, method, product or equipment or unit.
It is also understood that term used in this description of the invention for description specific embodiment purpose and simultaneously
It is not intended to the limitation present invention.As description of the invention and it is used in the attached claims, unless context is clear
Indicate to Chu other situations, otherwise " one " of singulative, "one" and "the" are intended to include plural form.
It will be further appreciated that the term "and/or" used in description of the invention and the appended claims is
Refer to any combinations and all possible combinations of one or more of the associated item listed, and including these combinations.
As used in this specification and in the appended claims, term " if " can be according to context quilt
Be construed to " when ... " or " once " or " in response to determining " or " in response to detecting ".Similarly, phrase " if it is determined that " or
" if detecting [described condition or event] " can be interpreted to mean according to context " once it is determined that " or " in response to true
It is fixed " or " once detecting [described condition or event] " or " in response to detecting [described condition or event] ".
In the specific implementation, the terminal device described in the embodiment of the present invention is including but not limited to such as with the sensitive table of touch
Mobile phone, laptop computer or the tablet computer in face (for example, touch-screen display and/or touch tablet) etc it is other
Portable device.It is to be further understood that in certain embodiments, the equipment is not portable communication device, but is had
The desktop computer of touch sensitive surface (for example, touch-screen display and/or touch tablet).
In discussion below, the terminal device including display and touch sensitive surface is described.However, it should manage
Solution, one or more of the other physical User that terminal device can include such as physical keyboard, mouse and/or control-rod connect
Jaws equipment.
Terminal device supports various application programs, such as one or more of following：Drawing application program, demonstration application
Program, word-processing application, website establishment application program, disk imprinting application program, spreadsheet applications, game are answered
With program, telephony application, videoconference application, email application, instant messaging applications, forging
Refining supports application program, photo management application program, digital camera application program, digital camera application program, web-browsing should
With program, digital music player application and/or video frequency player application program.
The various application programs that can be performed on the terminal device can use at least one of such as touch sensitive surface
Public physical user-interface device.It can be adjusted among applications and/or in corresponding application programs and/or change touch is quick
Feel the corresponding information shown in the one or more functions and terminal device on surface.In this way, the public physics frame of terminal device
Structure (for example, touch sensitive surface) can be supported various using journey with user interface directly perceived and transparent for a user
Sequence.
It is a kind of schematic flow diagram of food energy detection method provided in an embodiment of the present invention, such as Fig. 1 institutes referring to Fig. 1
Show that this method may include：
101st, terminal device obtains the first image of food to be measured by camera, to the first image of above-mentioned food to be measured
Carry out the species that image identification determines above-mentioned food to be measured.
Terminal device in the embodiment of the present invention includes camera or referred to as camera assembly, and camera, which generally has, to be regarded
The basic functions such as frequency camera shooting, video transmission and still image capture, terminal device can be obtained to be measured by shooting food to be measured
First image of food.
Terminal device can carry out image identification to the first image of above-mentioned food to be measured, determine the kind of above-mentioned food to be measured
Class.Specifically, terminal device can identify the food to be measured in above-mentioned first image, and terminal device can be inquired about by networking
Mode, from server obtain with the matched image of food image to be measured and corresponding food species, that is, identify that this is treated
The species of food is surveyed, optionally, terminal device can access the internal database of the terminal device, obtain and the food figure to be measured
As matched image and corresponding food species, so as to identify the species of the food to be measured, the species of above-mentioned food to be measured
Can be the major class (such as noodles) that the food to be measured belongs to, further, which may recognize that first figure
The ingredient that the food to be measured includes as in determines the specific species (such as the miscellaneous sauce face of pea) of the food to be measured.Optionally, if on
The kind that the text information further confirms that the food to be measured can be combined comprising text information, terminal device by stating in the first image
Class.For example, user has taken a photo for including a fried rice in dining room by mobile phone, terminal device can pass through above-mentioned side
Method identifies the species of the food to be measured in photo as fried rice, and terminal device can also identify specific in the fried rice from photo
Comprising garnishes species so that not going out this part of fried rice belongs to fish-flavoured shredded pork fried rice；For another example, user has taken a box by mobile phone
The photo of Yoghourt, it can be seen that the brand of the Yoghourt is A on photo, terminal device can identify the text information in photo
" A ", so as to further determine that Yoghourt of the species of the food to be measured for A brands.
102nd, terminal device obtains the quality of above-mentioned food to be measured.
Specifically, terminal device can account for screen than calculating above-mentioned treat with terminal device screen area by food to be measured
The image area of food is surveyed, the screen area of the terminal device can be stored in terminal device, is multiplied by above-mentioned screen area
The image area shielded than can be obtained by above-mentioned food to be measured is accounted for above-mentioned；Optionally, terminal device can pass through food to be measured
Account for image area of the figure than going out above-mentioned food to be measured with the areal calculation of above-mentioned first image, wherein, account for figure ratio be above-mentioned
The image area of the food to be measured of this in first image accounts for the ratio of the area of first image, passes through the area of above-mentioned first image
Be multiplied by above-mentioned food to be measured accounts for image area of the figure than can be obtained by above-mentioned food to be measured.When above-mentioned camera is double camera shootings
Head, in the case where performing step 101, terminal device can obtain above-mentioned food to be measured to upper by dual camera range measurement principle
The distance of the plane where dual camera is stated, passes through the focal length f of above-mentioned dual camera, above-mentioned food to be measured to above-mentioned dual camera
The image area s of the distance d of the plane at place and above-mentioned food to be measured, terminal device can calculate the true of above-mentioned food to be measured
Solid area S, calculation formula are：S=fs/d.
Likewise, terminal device can obtain the thickness of the above-mentioned food to be measured, terminal by dual camera range measurement principle
Equipment can calculate above-mentioned food to be measured by the true area S of above-mentioned food to be measured and the thickness h of the above-mentioned food to be measured
Volume v, calculation formula is：V=Sh.Optionally, terminal device can receive food volume input by user, further,
Terminal device can obtain the density p of above-mentioned food to be measured, calculate the quality m of above-mentioned food to be measured, and the method can be applied to
Terminal device comprising single camera, because the terminal device of single camera can not calculate image by camera gathered data
The volume of middle food.Calculation formula is m=vp.
103rd, terminal device calculates the energy value and nutritional ingredient of the above-mentioned food to be measured of the above-mentioned quality of the species, sends
The first prompt message comprising above-mentioned energy value and above-mentioned nutritional ingredient.
The all life activity of human body is required for energy, such as the synthetic reaction of metabolism, contraction of muscle, glandular secretion
Deng, and these energy are mainly derived from food, contained nutrient can be divided into five major classes in animal and plant food：Carbon hydrate
Object, lipid, protein, minerals and vitamins, in addition water is then six major classes.Wherein, carbohydrate, fat and protein warp
Vivo oxidation releasable energy, the nutritional ingredient in the embodiment of the present invention can include：Carbohydrate, fat and/or albumen
Matter.
It can be appreciated that heat, heat are one kind of energy, how many general heat can have been said more above-mentioned energy
Few energy, the two is quantitatively equal, but how many energy cannot be said with regard to how many heat.The unit of heat is calorie
(Calorie is abbreviated as cal), can referred to as block, and can also use joule.1 card is equal to 4.2 joules, is defined as in 1 air
1 gram of water is promoted 1 degree Celsius of required heat by pressure.
The energy value of the unit mass of various types of food can be stored in terminal device, such as with food energy table
Form stores, and above-mentioned food energy table can include food species and the corresponding unit mass (such as 100 of different food species
Gram) food in contained energy, the unit of energy can be joule (J) or kilojoule (KJ).Terminal device can calculate this
The energy value of the food to be measured of the above-mentioned quality of species, specifically, terminal device can obtain the food unit to be measured of the species
The energy value of quality can also pass through the species by the energy value for the food unit mass to be measured for obtaining the species of networking
The quality m of the energy value c of food unit mass to be measured and above-mentioned food to be measured can obtain the energy value E of the food to be measured, meter
It can be E=cm to calculate formula.For example, terminal device gets the energy value of every 100 grams of food A as 370KJ, terminal device
The food A mass of acquisition is 200 grams, and terminal device can calculate food A 370/100*200=740KJ containing protein.
Likewise, the nutritional ingredient information of various types of food unit mass can be stored in terminal device, for example, often
The fat content etc. of the protein content of 100 grams of food, every 50 grams of food, terminal device can be from the nutritional ingredient information of storage
The middle nutrient composition content for obtaining the food items unit mass can also obtain the food items unit mass by networking
Nutrient composition content, the quality m terminal devices of nutrient composition content a and food to be measured by the food items unit mass can
To calculate the nutrient composition content n of above-mentioned food to be measured, calculation formula n=am.For example, terminal device is got often
The protein content of 100 grams of food A is 5 grams, and the food A mass that terminal device obtains is 200 grams, and terminal device can calculate
5/100*200=10 containing protein grams of food A.
Optionally, before step 103 is performed, terminal device may determine that whether food to be measured is to have recorded energy information
Food, if so, terminal device can be obtained from the energy information recorded the energy value of above-mentioned food to be measured and nutrition into
Point.It, can be with specifically, terminal device can store the energy value and nutrient composition content of the unit mass of variety classes food
Form is stored in terminal device, also, every time after execution step 10, it can be by the food to be measured of above-mentioned quality
The energy value and nutrient composition content of energy value and nutritional ingredient or food unit mass to be measured are stored.
It, can be with after energy value and nutritional ingredient that the food to be measured of the above-mentioned quality of the species is calculated in terminal device
Send the first prompt message comprising the energy value and above-mentioned nutritional ingredient.Wherein, above-mentioned first prompt message can be text
This information, terminal device can show that the energy value of the food to be measured and nutritional ingredient (can be shown contained on a display screen
Nutritional ingredient name or the content for also showing each nutritional ingredient)；Above-mentioned first prompt message or voice messaging, can be with
Speech play is carried out by handset mode or speaker mode.Such as shown in Fig. 3 a, on the screen of terminal device in step display 1
First image of the food to be measured, food to be measured are food Q, show energy value, the fat content of food Q in the picture
And protein content.
The embodiment of the present invention can determine the species of food to be measured by identifying the image of food to be measured, obtain food to be measured
Energy value and nutritional ingredient, user can be prompted, facilitate user quickly know the energy of food to be measured and nutrition into
Point, so as to aid in user's reasonable diet.
Fig. 2 is referred to, Fig. 2 is a kind of exemplary flow of the detection method for food energy that second embodiment of the invention provides
Figure, further optimization obtains Fig. 2 on the basis of Fig. 1.As shown in Fig. 2, the food energy detection method may include：
201st, terminal device obtains the first image of food to be measured by camera, to the first image of above-mentioned food to be measured
Carry out the species that image identification determines above-mentioned food to be measured.
202nd, terminal device obtains the quality of above-mentioned food to be measured.
203rd, the energy value and nutritional ingredient of the above-mentioned food to be measured of the above-mentioned quality of the species are calculated, is sent comprising above-mentioned
First prompt message of energy value and above-mentioned nutritional ingredient.
Optionally, if the food to be measured in the first image is for two kinds and two or more, after performing step 301, this method
It further includes：
Terminal device shows the energy of the above-mentioned food to be measured of the unit mass of each mentioned kind in above-mentioned first image
Magnitude and nutritional ingredient.
Specifically, in above-mentioned first image can there are two types of and two or more species food to be measured, terminal device can be with
The energy value and nutritional ingredient of the above-mentioned food to be measured of the unit mass of each species are shown in above-mentioned first image, for example,
The energy value for the unit mass food items that terminal device can mark on the food image to be measured of each species and nutrition
Ingredient, the screen diagrams of terminal device as shown in Figure 3b are shown on the screen of the terminal device comprising food to be measured (food
Object A, food B and food C) image, be labelled with by above-mentioned three kinds of food each food per 100g energy value and fat
Content, by taking food A as an example, the energy contained by each hectogram food A is 210KJ, fat content 2.6g.
204th, terminal device obtains the second image of above-mentioned food to be measured by above-mentioned camera, to above-mentioned food to be measured
Second image carries out image identification, obtains the intake quality of above-mentioned food to be measured.
After step 203, terminal device can obtain the second image of above-mentioned food to be measured by camera, wherein,
Second image of above-mentioned food to be measured can eat the image of remaining food to be measured later with user, and terminal device can be to above-mentioned
Second image is identified, and terminal device can obtain the quality of the food to be measured in above-mentioned second image, may be referred to Fig. 1 institutes
The specific descriptions of step 102 in the embodiment shown.Terminal device can pass through the quality m of the food to be measured in above-mentioned first image
Calculate with the quality k of the food to be measured in above-mentioned second image it is of poor quality, it is above-mentioned it is of poor quality be that above-mentioned food to be measured is taken the photograph
Enter quality z, calculation formula z=m-k.Terminal device can obtain the intake quality of food to be measured by above-mentioned steps, that is, use
The quality for the food to be measured that family is eaten.
205th, terminal device calculates the intake energy value of the above-mentioned food to be measured of above-mentioned intake quality and intake nutritional ingredient
Content sends the second prompt message comprising above-mentioned intake energy value and above-mentioned intake nutrient composition content.
After the intake quality of food to be measured is obtained, terminal device can calculate the above-mentioned food to be measured of above-mentioned intake quality
Intake energy value and intake nutrient composition content, above-mentioned intake energy value can be understood as contained by the food to be measured that user eats
Energy value, above-mentioned intake nutrient composition content can be understood as the nutrient composition content contained by the food to be measured that user eats,
The specific description that may be referred to above-mentioned steps 103, taking the photograph for food to be measured is replaced with by the quality m of the food to be measured in step 103
Enter quality z, by the energy value c of the food unit mass to be measured of the species and intake quality z of above-mentioned food to be measured, can obtain
Energy value E must be taken in, calculation formula can be E=cz；By the nutrient composition content a of the food items unit mass and above-mentioned
The intake quality z of food to be measured, terminal device can calculate the content n of the intake nutritional ingredient of above-mentioned food to be measured, calculate
Formula is n=am.
Further, terminal device can send comprising above-mentioned intake energy value and above-mentioned intake nutrient composition content
Two prompt messages, wherein, above-mentioned second prompt message can be text message, and terminal device can show above-mentioned on a display screen
Energy value and above-mentioned intake nutrient composition content are taken in, optionally, the second prompt message can be also used for prompting user's same day
Take in energy value situation；Above-mentioned first prompt message or voice messaging can pass through handset mode or speaker mode
Carry out speech play.By above-mentioned second prompt message, user, which can be visually known, has taken in how many energy and how many battalion
Dining plan or exercise program after forming point and being determined in order to user, if for example, user carries by above-mentioned second
Show that information recognizes that intake energy value is excessively high, the diet after can adjusting reduces Energy intaking or increases amount of exercise and increases
Energy expenditure can cause obesity to avoid intake excessive power.
Optionally, terminal device can also record the intake energy value of the food to be measured of above-mentioned intake quality and intake nutrition
Component content, specifically, terminal device calculates the intake energy value of the above-mentioned food to be measured of above-mentioned intake quality and intake is sought
It after supporting component content, can be recorded in the terminal device, such as record in third-party application on the terminal device,
Above-mentioned intake energy value is included in the same day and has taken in energy value, above-mentioned intake nutrient composition content is included in the same day has taken in nutrition
Component content uses when being calculated convenient for next time, while user can also check in terminal device, understands oneself same day and has taken in
Energy value and nutritional ingredient.
206th, terminal device obtains the health management information of user in third-party application, and above-mentioned health management information includes upper
State the history intake energy value on user's same day and history intake nutritional ingredient.
Optionally, terminal device can obtain the health management information of user in third-party application, wherein, the present invention is implemented
In example, (English is Application Program, referred to as third-party application, also referred to as third party application：APP the), the 3rd
Square application software, third-party application are the application programs for terminal extension functions of the equipments of non-terminal equipment producer exploitation.On
State history intake energy value and the history intake nutritional ingredient that health management information includes user's same day.Above-mentioned history takes in energy
Value and above-mentioned history take in nutritional ingredient, it can be understood as before step 206 is performed, the user of record works as in the terminal device
Day energy value taken in and the nutritional ingredient taken in, terminal device can obtain user's intake energy value and intake every time
After nutritional ingredient, above-mentioned intake energy value is included in above-mentioned history and takes in energy value, above-mentioned intake nutritional ingredient is included in
State history intake nutritional ingredient, i.e., terminal device can constantly update the energy value of intake on user's same day with taken in nutrition into
The information divided, checks and is referred to convenient for user, with aiding in user's reasonably healthy diet.
207th, terminal device is worth to the same day and has taken in energy according to above-mentioned intake energy value and above-mentioned history intake energy
Value obtains the same day and has taken in nutritional ingredient according to above-mentioned intake nutritional ingredient and above-mentioned history intake nutritional ingredient.
Specifically, can be stored in terminal device user setting or by physical condition information input by user
The every daily planning intake energy value and/or nutritional ingredient, terminal are taken in per daily planning that (such as height, weight, age etc.) obtains
Equipment can calculate that the same day has taken in energy value and the same day has taken in nutritional ingredient：The same day has taken in energy value and has been equal to above-mentioned go through
History intake energy value adds above-mentioned intake energy value；The same day has taken in nutrient composition content and has been added equal to history intake nutritional ingredient
Take in nutrient composition content.
208th, terminal device has taken in the above-mentioned same day energy value and the above-mentioned same day has taken in nutritional ingredient and analyzed, defeated
Go out advisory information.
Terminal device may determine that the same day has taken in whether energy value reaches every daily planning intake energy value, if reaching, eventually
End equipment can export the advisory information of the energy value more than the above-mentioned intake energy value per daily planning, if not up to, terminal device
The advisory information for also not up to planning intake energy value can be exported, such as：" it has been more than that energy value is taken in per daily planning
280KJ”.Above-mentioned advisory information can also include recommended intake, and above-mentioned recommended intake can be to take in energy on the above-mentioned same day
The energy differences of magnitude and the above-mentioned intake energy value per daily planning, terminal device can calculate the above-mentioned same day and take in energy value
With the energy differences of the above-mentioned intake energy value per daily planning, the advisory information of terminal device output can be the above-mentioned of suggestion intake
Energy differences.It is taken the photograph likewise, terminal device may determine that the above-mentioned same day has taken in nutrient composition content and whether reaches every daily planning
Enter nutrient composition content, if reaching, terminal device can export the suggestion more than the above-mentioned intake nutrient composition content per daily planning
Information, if not up to, terminal device can export the advisory information of the also intake nutrient composition content not up to per daily planning.
Optionally, above-mentioned health management information can also include user's same day consumed energy value, and terminal device can be to upper
It states that the same day has taken in energy value and same day consumed energy value is analyzed, exports advisory information.Specific determination methods can be with
For terminal device judges that the above-mentioned same day has taken in after energy value subtracts same day consumed energy value whether reach every daily planning intake
Energy value, so as to export corresponding advisory information.
Optionally, above-mentioned advisory information is further included had taken in energy value and the above-mentioned same day has taken in nutrition for the above-mentioned same day
The recommendation food information that ingredient determines, wherein, above-mentioned recommendation food information can include recommending the species of food and the recommendation
The recommended intake of food.For example, terminal device can show and build after the energy value of food to be measured and nutritional ingredient is shown
It discusses the energy value of intake and recommends food information, such as recommend the food Y of the same day edible 220g to user, to ensure to reach
Intake energy value or the intake nutritional ingredient per daily planning per daily planning.
Terminal device can take in energy value on the same day and in the case of intake energy value, calculated not up to per daily planning
The above-mentioned same day has taken in the difference of energy value and the above-mentioned intake energy value per daily planning, recommends energy value to user as the difference
Food information, i.e. user can select the food of terminal device recommendation in the works in dining afterwards, relatively accurately reach every
Energy value is taken in daily planning.Likewise, terminal device can take in nutritional ingredient on the same day, not up to per daily planning, intake is sought
In the case of forming point, the content difference that the above-mentioned same day taken in nutritional ingredient and the above-mentioned intake nutritional ingredient per daily planning is calculated
Value recommends the food information that nutrient composition content is the content difference to user, i.e. user can be in dining afterwards in the works
The food that terminal device is selected to recommend relatively accurately reaches every daily planning intake nutrient composition content.
Optionally, above-mentioned advisory information includes edible option, and terminal device can be received in above-mentioned edible option
The selection instruction of targets option obtains the intake quality of the corresponding food to be measured of targets option.Terminal device can be on the screen
The edible option of display, user can therefrom select to correspond to the targets option of the intake quality of food to be measured, such as：It eats entirely, eats one
Half, it does not eat.Terminal device can obtain the corresponding intake quality of the metering options of user's selection.Finally, terminal device can
To record the intake energy value of the food to be measured of above-mentioned intake quality and intake nutritional ingredient, energy value can be taken in history
On the basis of be worth to the same day plus the intake energy of the food to be measured of above-mentioned intake quality and taken in energy value, take in and seek in history
The nutrient composition content on the basis of component content plus the food to be measured of above-mentioned intake quality is supported to obtain the same day and taken in nutrition
Component content.Optionally, user can be manually entered above-mentioned intake quality, that is, input the occurrence of an intake quality.
Step 201- steps 203 in the embodiment of the present invention may be referred to the step 101- steps in embodiment illustrated in fig. 1
103 specific descriptions are not repeating herein.
By above-mentioned first prompt message and above-mentioned advisory information, user can be visually known contained by food to be measured
Energy and nutritional ingredient information and the Energy intaking situation on the same day itself, while can also be according to suggestion and according to itself
It needs to select suitable food and corresponding intake.
The embodiment of the present invention can determine the species of food to be measured by identifying the image of food to be measured, obtain food to be measured
Energy value and nutritional ingredient, user can be prompted, facilitate user quickly know the energy of food to be measured and nutrition into
Point, so as to aid in user's reasonable diet.
Another embodiment of the present invention also provides a kind of terminal device, which includes to perform foregoing any implementation
The unit of method described in example.
Specifically, referring to Fig. 4, it is a kind of schematic block diagram of terminal device provided in an embodiment of the present invention, as shown in the figure, being somebody's turn to do
Terminal device includes：Image identification unit 410, quality acquiring unit 420, computing unit 430 and prompt unit 440.
Image identification unit 410 determines above-mentioned food to be measured for carrying out image identification to the first image of food to be measured
Species.
Specifically, terminal device includes camera, and terminal device can obtain the of food to be measured by above-mentioned camera
One image, image identification unit 410 can carry out image identification to the first image of food to be measured, so that it is determined that above-mentioned food to be measured
The species of object.Image identification unit 410 can identify the food to be measured in above-mentioned first image, and pass through the side of networking inquiry
Formula, from server obtain with the matched image of food image to be measured and corresponding food species, that is, identify the food to be measured
The species of object, optionally, image identification unit 410 can access the internal database of the terminal device to obtain and the food to be measured
The matched image of object image and corresponding food species, so as to identify the species of the food to be measured.
Quality acquiring unit 420, for obtaining the quality of above-mentioned food to be measured.
Specifically, quality acquiring unit 420, which can possess computing function, to account for screen ratio and terminal by food to be measured
Device screen areal calculation goes out the image area of above-mentioned food to be measured, and the screen of the terminal device can be stored in terminal device
Area is multiplied by by above-mentioned screen area and above-mentioned accounts for the image area shielded than can be obtained by above-mentioned food to be measured；Optionally, matter
Amount acquiring unit 420 can account for figure than going out above-mentioned food to be measured with the areal calculation of above-mentioned first image by food to be measured
Image area, wherein, account for area of the figure than accounting for first image for the image area of the food to be measured in above-mentioned first image
Ratio, account for figure than can be obtained by above-mentioned food to be measured by what the area of above-mentioned first image was multiplied by above-mentioned food to be measured
Image area.When above-mentioned camera is dual camera, in the case where performing step 101, terminal device can pass through double camera shootings
Head range measurement principle obtains above-mentioned food to be measured to the distance of the plane where above-mentioned dual camera, passes through the coke of above-mentioned dual camera
The image area s of distance d and above-mentioned food to be measured away from the plane where f, above-mentioned food to be measured to above-mentioned dual camera, quality
Acquiring unit 420 can calculate the true area S of above-mentioned food to be measured, and calculation formula is：S=fs/d.
Likewise, terminal device can obtain the thickness of the above-mentioned food to be measured, quality by dual camera range measurement principle
Acquiring unit 420 can calculate above-mentioned treat by the true area S of above-mentioned food to be measured and the thickness h of the above-mentioned food to be measured
The volume v of food is surveyed, calculation formula is：V=Sh.Optionally, terminal device can receive food volume input by user.Quality
Acquiring unit 420 can obtain the density p of above-mentioned food to be measured, so as to calculate the quality m of above-mentioned food to be measured, calculation formula
For m=vp.
Computing unit 430, for calculating the energy value and nutritional ingredient of the above-mentioned food to be measured of the above-mentioned quality of the species.
Prompt unit 440, for sending the first prompt message for including above-mentioned energy value and above-mentioned nutritional ingredient.
After energy value and nutritional ingredient that the food to be measured of the above-mentioned quality of the species is calculated in terminal device, prompt
Unit 440 can send the first prompt message comprising the energy value and above-mentioned nutritional ingredient.
Optionally, which further includes judging unit 450, for judging whether food to be measured is to have recorded energy letter
The food of breath, if so, computing unit 430 can obtain energy value and the battalion of above-mentioned food to be measured from the energy information recorded
It forms point, need not be calculated.
Optionally, prompt unit 440 is additionally operable to show the unit mass of each mentioned kind in above-mentioned first image
The energy value and nutritional ingredient of above-mentioned food to be measured.
Specifically, if the food to be measured in the first image is for two kinds and two or more, in image identification unit 410 to be measured
First image of food is carried out after image identification determines the species of above-mentioned food to be measured, and prompt unit 440 can be above-mentioned the
The energy value and nutritional ingredient of the above-mentioned food to be measured of the unit mass of each mentioned kind are shown in one image.
Optionally, image identification unit 410 is additionally operable to carry out image identification, quality to the second image of above-mentioned food to be measured
Acquiring unit 420 is additionally operable to obtain the intake quality of above-mentioned food to be measured.
Specifically, terminal device can obtain the second image of above-mentioned food to be measured by camera, wherein, it is above-mentioned to be measured
Second image of food can eat the image of remaining food to be measured later with user, and image identification unit 410 can be to above-mentioned
Second image is identified, and quality acquiring unit 420 can obtain the quality of the food to be measured in above-mentioned second image, and quality obtains
Take unit 420 can be by the food to be measured in the quality m and above-mentioned second image of the food to be measured in above-mentioned first image
Quality k calculates of poor quality, intake the quality z, calculation formula z=m-k of above-mentioned as above-mentioned food to be measured of poor quality.Quality
Acquiring unit 420 can obtain the quality of the intake quality of food to be measured, the i.e. food to be measured that user eats by above-mentioned steps.
Computing unit 430, the intake energy value and intake for being additionally operable to calculate the above-mentioned food to be measured of above-mentioned intake quality are sought
Support component content.
Prompt unit 440, is additionally operable to send and includes the second of above-mentioned intake energy value and above-mentioned intake nutrient composition content
Prompt message.Wherein, above-mentioned second prompt message can be text message, can show above-mentioned intake energy value on a display screen
With above-mentioned intake nutrient composition content, optionally, the second prompt message can be also used for prompting user and take in energy value on the same day
Situation.By above-mentioned second prompt message, user can be visually known how many energy and how many nutritional ingredient taken in, with
And the dining plan after being determined in order to user or exercise program.
Optionally, which further includes recording unit 460, for that can also record the food to be measured of above-mentioned intake quality
The intake energy value of object and intake nutrient composition content.Specifically, computing unit 430 calculates above-mentioned the above-mentioned of intake quality and treats
It surveys after the intake energy value of food and intake nutrient composition content, recording unit 460 can be recorded in the terminal device
In, it such as records in third-party application on the terminal device, above-mentioned intake energy value is included in the same day and taken the photograph by recording unit 460
Entering energy value, above-mentioned intake nutrient composition content is included in the same day has taken in nutrient composition content, is used when being calculated convenient for next time,
User can also check in terminal device simultaneously, understand energy value and nutritional ingredient that oneself same day has been taken in.
Optionally, which further includes information acquisition unit 470, for obtaining the health of user in third-party application
Management information, above-mentioned health management information include the history intake energy value on above-mentioned user's same day and history intake nutritional ingredient.
Computing unit 430 is additionally operable to, and is worth to the same day according to above-mentioned intake energy value and above-mentioned history intake energy and has been taken in energy value,
It obtains the same day according to above-mentioned intake nutritional ingredient and above-mentioned history intake nutritional ingredient and has taken in nutritional ingredient.The terminal device is also
It including analytic unit 480, has taken in nutritional ingredient for having taken in energy value and the above-mentioned same day to the above-mentioned same day and has analyzed, led to
It crosses prompt unit 440 and exports advisory information.Optionally, above-mentioned health management information can also include user's same day consumed energy
Value, analytic unit 480 can take in the above-mentioned same day energy value and same day consumed energy value is analyzed, single by prompting
Member 440 exports advisory information.Specific determination methods can be that analytic unit 480 judges that the above-mentioned same day has taken in energy value and subtracted
Go after same day consumed energy value whether to reach every daily planning intake energy value, so as to export pair by prompt unit 440
The advisory information answered.Optionally, above-mentioned advisory information further includes analytic unit 480 and had taken in energy value and upper for the above-mentioned same day
It states the same day and has taken in the recommendation food information that nutritional ingredient determines, wherein, above-mentioned recommendation food information can include recommending food
Species and it is described recommend food recommended intake.
Optionally, quality acquiring unit 420 is additionally operable to, and in the case where above-mentioned advisory information includes edible option, is received
For the selection instruction of the targets option in above-mentioned edible option, the intake quality of the corresponding food to be measured of acquisition targets option.
Optionally, quality acquiring unit 420 is additionally operable to, and obtains the above-mentioned intake quality that user is manually entered.
By above-mentioned first prompt message and above-mentioned advisory information, user can be visually known contained by food to be measured
Energy and nutritional ingredient information and the Energy intaking situation on the same day itself, while can also be according to suggestion and according to itself
It needs to select suitable food and corresponding intake.
The embodiment of the present invention can determine the species of food to be measured by identifying the image of food to be measured, obtain food to be measured
Energy value and nutritional ingredient, user can be prompted, facilitate user quickly know the energy of food to be measured and nutrition into
Point, so as to aid in user's reasonable diet.
The steps in the embodiment of the present invention can be sequentially adjusted, merged and deleted according to actual needs.Upper
It states in embodiment, all emphasizes particularly on different fields to the description of each embodiment, the part being not described in some embodiment, Ke Yican
See the associated description of other embodiment.
Those of ordinary skill in the art may realize that each exemplary lists described with reference to the embodiments described herein
Member and algorithm steps can be realized with the combination of electronic hardware, computer software or the two, in order to clearly demonstrate hardware
With the interchangeability of software, each exemplary composition and step are generally described according to function in the above description.This
A little functions are performed actually with hardware or software mode, specific application and design constraint depending on technical solution.Specially
Industry technical staff can realize described function to each specific application using distinct methods, but this realization is not
It is considered as beyond the scope of this invention.
It is apparent to those skilled in the art that for convenience of description and succinctly, the end of foregoing description
The specific work process of end equipment and unit may be referred to the corresponding process in preceding method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed terminal device and method, Ke Yitong
Other modes are crossed to realize.For example, the apparatus embodiments described above are merely exemplary, for example, the unit is drawn
Point, it is only a kind of division of logic function, there can be other dividing mode in actual implementation, such as multiple units or component can
To combine or be desirably integrated into another system or some features can be ignored or does not perform.It is in addition, shown or discussed
Mutual coupling, direct-coupling or communication connection can be by the INDIRECT COUPLING of some interfaces, device or unit or
Communication connection or electricity, the connection of mechanical or other forms.
The unit illustrated as separating component may or may not be physically separate, be shown as unit
The component shown may or may not be physical location, you can be located at a place or can also be distributed to multiple
In network element.Some or all of unit therein can be selected to realize the embodiment of the present invention according to the actual needs
Purpose.In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit or
Unit is individually physically present or two or more units integrate in a unit.Above-mentioned integrated list
The form that hardware had both may be employed in member is realized, can also be realized in the form of SFU software functional unit.
The above description is merely a specific embodiment, but protection scope of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can readily occur in various equivalent modifications or replace
It changes, these modifications or substitutions should be covered by the protection scope of the present invention.Therefore protection scope of the present invention should be with right
It is required that protection domain subject to.
Claims (10)
1. a kind of detection method of food energy, which is characterized in that including：
The first image of food to be measured is obtained by camera, carrying out image identification to the first image of the food to be measured determines
The species of the food to be measured；Obtain the quality of the food to be measured；
The energy value and nutritional ingredient of the food to be measured of the quality of the species are calculated, is sent comprising the energy value
And the first prompt message of the nutritional ingredient.
2. according to the method described in claim 1, it is characterized in that, first prompt message includes edible option, the hair
Go out after the first prompt message comprising the energy value and the nutritional ingredient, the method further includes：
The selection instruction for the targets option in the edible option is received, obtains the corresponding food to be measured of the targets option
Intake quality.
3. according to the method described in claim 1, it is characterized in that, it is described send comprising the energy value and the nutrition into
After the first prompt message divided, the method further includes：
The second image of the food to be measured is obtained by camera, image identification is carried out to the second image of the food to be measured
Obtain the intake quality of the food to be measured；
The intake energy value of the food to be measured of the intake quality and intake nutritional ingredient are calculated, is sent comprising the intake
Second prompt message of energy value and the intake nutritional ingredient, the described of the food to be measured for recording the intake quality are taken the photograph
Enter energy value and the intake nutritional ingredient.
4. according to the method in claim 2 or 3, which is characterized in that the method further includes：
The health management information of user in third-party application is obtained, the health management information includes the history on user's same day
Take in energy value and history intake nutritional ingredient；
The same day is worth to according to intake energy value and the history intake energy and has taken in energy value, is sought according to the intake
It forms point and to obtain the same day with history intake nutritional ingredient and taken in nutritional ingredient；
Energy value had been taken in the same day and the same day has taken in nutritional ingredient and analyzed, has exported advisory information, it is described
Advisory information determines the intake of the food to be measured for user.
5. according to the method described in claim 4, it is characterized in that, the health management information also disappeared comprising user's same day
Consume energy magnitude, and the method further includes：
Energy value had been taken in the same day and the same day consumed energy value is analyzed, has exported the advisory information.
6. according to the method described in claim 5, it is characterized in that, the advisory information further includes：It had been taken the photograph for the same day
Enter energy value and the same day has taken in the recommendation food information that nutritional ingredient determines, the recommendation food information includes recommending to eat
The species of object and the recommended intake for recommending food.
7. according to the method described in claim 4, it is characterized in that, the quality for calculating the species it is described to be measured
Before the energy value and nutritional ingredient of food, the method further includes：
Judge whether the food to be measured is the food for having recorded energy information；
If so, the energy value and nutritional ingredient of the food to be measured are obtained from the energy information recorded.
8. according to the method described in claim 7, the method is applied to the terminal device comprising single camera, feature exists
In the quality for obtaining the food to be measured includes：
Food volume input by user is received, calculates the quality of the food to be measured of the food volume.
9. according to the method described in claim 1, it is characterized in that, the food to be measured in described first image is two kinds and two kinds
More than, it is described after first image to the food to be measured carries out the species of the definite food to be measured of image identification
Method includes：
The energy value of the food to be measured of the unit mass of each species is shown in described first image and described is treated
Survey the nutritional ingredient of food.
10. a kind of terminal device, which is characterized in that including being used to perform the side as described in claim 1-9 any claims
The unit of method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711438846.3A CN108121974A (en) | 2017-12-26 | 2017-12-26 | A kind of display module structure and terminal device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711438846.3A CN108121974A (en) | 2017-12-26 | 2017-12-26 | A kind of display module structure and terminal device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108121974A true CN108121974A (en) | 2018-06-05 |
Family
ID=62231925
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711438846.3A Pending CN108121974A (en) | 2017-12-26 | 2017-12-26 | A kind of display module structure and terminal device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108121974A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109065125A (en) * | 2018-07-24 | 2018-12-21 | 北京大学第医院 | A kind of diet control method, device and mobile terminal |
| CN109785934A (en) * | 2019-01-22 | 2019-05-21 | Oppo广东移动通信有限公司 | Food recommended method and relevant apparatus |
| CN109948488A (en) * | 2019-03-08 | 2019-06-28 | 上海达显智能科技有限公司 | A kind of intelligence smoke eliminating equipment and its control method |
| CN111027500A (en) * | 2019-12-17 | 2020-04-17 | 张正东 | Health management method based on image recognition technology and electronic equipment |
| WO2020103001A1 (en) * | 2018-11-20 | 2020-05-28 | 华为技术有限公司 | Method for estimating object parameters and electronic device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7526100B1 (en) * | 2003-04-22 | 2009-04-28 | Advanced Optical Systems, Inc. | System for processing and recognizing objects in images |
| US20110087439A1 (en) * | 2009-10-09 | 2011-04-14 | Ziegler Lawrence D | Systems and methods for identifying materials utilizing multivariate analysis techniques |
| CN105512501A (en) * | 2016-01-05 | 2016-04-20 | 京东方科技集团股份有限公司 | Intelligent diet analysis system |
| CN105809598A (en) * | 2016-03-10 | 2016-07-27 | 青岛海尔智能家电科技有限公司 | Dietary intake management method, device and cloud platform |
| CN106570803A (en) * | 2016-11-09 | 2017-04-19 | 赵鹏 | APP platform based diet photo and video management system and method |
| CN106872513A (en) * | 2017-01-05 | 2017-06-20 | 深圳市金立通信设备有限公司 | A kind of method and terminal for detecting fuel value of food |
| CN107493390A (en) * | 2017-09-01 | 2017-12-19 | 陕西科技大学 | A kind of mobile device automatic identification energy intake and the method for consumption, system |
-
2017
- 2017-12-26 CN CN201711438846.3A patent/CN108121974A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7526100B1 (en) * | 2003-04-22 | 2009-04-28 | Advanced Optical Systems, Inc. | System for processing and recognizing objects in images |
| US20110087439A1 (en) * | 2009-10-09 | 2011-04-14 | Ziegler Lawrence D | Systems and methods for identifying materials utilizing multivariate analysis techniques |
| CN105512501A (en) * | 2016-01-05 | 2016-04-20 | 京东方科技集团股份有限公司 | Intelligent diet analysis system |
| CN105809598A (en) * | 2016-03-10 | 2016-07-27 | 青岛海尔智能家电科技有限公司 | Dietary intake management method, device and cloud platform |
| CN106570803A (en) * | 2016-11-09 | 2017-04-19 | 赵鹏 | APP platform based diet photo and video management system and method |
| CN106872513A (en) * | 2017-01-05 | 2017-06-20 | 深圳市金立通信设备有限公司 | A kind of method and terminal for detecting fuel value of food |
| CN107493390A (en) * | 2017-09-01 | 2017-12-19 | 陕西科技大学 | A kind of mobile device automatic identification energy intake and the method for consumption, system |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109065125A (en) * | 2018-07-24 | 2018-12-21 | 北京大学第医院 | A kind of diet control method, device and mobile terminal |
| WO2020103001A1 (en) * | 2018-11-20 | 2020-05-28 | 华为技术有限公司 | Method for estimating object parameters and electronic device |
| CN112970026A (en) * | 2018-11-20 | 2021-06-15 | 华为技术有限公司 | Method for estimating object parameters and electronic equipment |
| CN112970026B (en) * | 2018-11-20 | 2024-02-02 | 华为技术有限公司 | Method for estimating object parameters and electronic equipment |
| CN109785934A (en) * | 2019-01-22 | 2019-05-21 | Oppo广东移动通信有限公司 | Food recommended method and relevant apparatus |
| CN109785934B (en) * | 2019-01-22 | 2023-08-08 | Oppo广东移动通信有限公司 | Food recommendation method and related device |
| CN109948488A (en) * | 2019-03-08 | 2019-06-28 | 上海达显智能科技有限公司 | A kind of intelligence smoke eliminating equipment and its control method |
| CN111027500A (en) * | 2019-12-17 | 2020-04-17 | 张正东 | Health management method based on image recognition technology and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108121974A (en) | A kind of display module structure and terminal device | |
| US20230078186A1 (en) | Providing automatically-edited user-customized digital images to a user in real-time or just-in-time | |
| Yang et al. | Yum-me: a personalized nutrient-based meal recommender system | |
| Vartanian et al. | Modeling of food intake: a meta-analytic review | |
| JP6412429B2 (en) | System and method for user specific adjustment of nutrient intake | |
| AU2018370069A1 (en) | Meal service management system and operating method therefor | |
| US20060229504A1 (en) | Methods and sytems for lifestyle management | |
| CN109243579B (en) | Cooked food nutrition data processing method, system, storage medium and terminal | |
| CN106872513A (en) | A kind of method and terminal for detecting fuel value of food | |
| JP6149233B1 (en) | Meal management system, meal management method, server device, and program | |
| CN107731281A (en) | A kind of method for recommending dining | |
| CN102053158B (en) | Blood sugar analysis system and device | |
| WO2020132478A1 (en) | Diet quality fingerprinting | |
| CN112951373A (en) | Food material recommendation method and device, intelligent refrigerator and intelligent terminal | |
| KR20210052122A (en) | System and method for providing user-customized food information service | |
| JP2016173658A (en) | Health management system, health management method, program, and recording medium | |
| M. Silva et al. | Investigating preferred food description practices in digital food journaling | |
| US20190328322A1 (en) | Information processing apparatus and operation method thereof | |
| Ntalaperas et al. | DISYS: An intelligent system for personalized nutritional recommendations in restaurants | |
| KR20210052123A (en) | Method for providing user-customized food information service and server using the same | |
| JP2014164411A (en) | Health management support system and program | |
| JP2001318991A (en) | Nutrition control system using information system | |
| JP2008052459A (en) | Information processing system device, virtual device, portable information processing terminal and recording media | |
| CN113569140A (en) | Information recommendation method and device, electronic equipment and computer-readable storage medium | |
| TW201202991A (en) | System and method thereof for generating recipes according to personal physical data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180605 |