CN107885425A - A kind of refrigerator food materials input method - Google Patents
A kind of refrigerator food materials input method Download PDFInfo
- Publication number
- CN107885425A CN107885425A CN201610865483.0A CN201610865483A CN107885425A CN 107885425 A CN107885425 A CN 107885425A CN 201610865483 A CN201610865483 A CN 201610865483A CN 107885425 A CN107885425 A CN 107885425A
- Authority
- CN
- China
- Prior art keywords
- food materials
- species
- prediction
- refrigerator
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0486—Drag-and-drop
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Abstract
The invention discloses a kind of refrigerator food materials input method, including：Obtain the food materials image of storage in refrigerator；Display interface of the display comprising the food materials image and prediction food materials species selection window；Detect the species that the operation to display interface is used to determine food materials；The food materials species that typing determines.Pass through the solution of the present invention, by increasing capacitance it is possible to increase the interaction of user and refrigerator, increase the interest of Input Process, improve user experience.
Description
Technical field
The present invention relates to refrigerator application design field, more particularly to a kind of refrigerator food materials input method.
Background technology
With the intelligentized development of household electrical appliances, refrigerator also begins to intellectuality, in the market band display screen, have recipe manage work(
The intelligent refrigerator of energy is more and more；
But the food materials typing mode of intelligent refrigerator at present, mainly manually input, be typing the shortcomings that manual entry
Speed is slow, and cumbersome;Also there is the method using voice typing, the problem of various regions accent be present yet with voice typing, accurately
Degree is also not high enough.
There is the function that many refrigerators support scanning bar code addition refrigerator food, refrigerator can be scanned by infrared camera
Bar code in packaging for foodstuff, the information such as the title of food, date of manufacture, shelf-life are read, are then saved in these information
Server, as the foundation being managed to food.But make in this way typing food information user experience it is very poor,
Without an enjoyment, and the typing mode is not perfect at present.
The content of the invention
In order to solve the above problems, the present invention proposes a kind of refrigerator food materials input method, by increasing capacitance it is possible to increase user and refrigerator
Interaction, increase the interest of Input Process, improve user experience.
In order to achieve the above object, the present invention proposes a kind of refrigerator food materials input method, and this method includes：
Obtain the food materials image of storage in refrigerator.
Display interface of the display comprising the food materials image and prediction food materials species selection window.
Detect the species that the operation to display interface is used to determine food materials.
Food materials species determined by typing.
Alternatively, prediction food materials species is obtained by one or more of mode：
The edible frequency to prestore is more than to m food materials species for eating frequency preset value as prediction food materials species, wherein, m >=
1, m is positive integer.
The one or more food materials species inputted in advance in the default prediction alternative frame of food materials species are eaten as prediction
Assortment class.And
The confidence level that image recognition is gone out is more than n food materials species of the first confidence level preset value as predicting food materials species, its
In, n >=1, n are positive integer.
Alternatively, this method also includes：
Food materials species in image recognition food materials image.
When the confidence level for predicting food materials species is more than or equal to the second confidence level preset value, determine food materials for prediction food materials kind
Class.
When the confidence level for predicting food materials species is less than the second confidence level preset value and is more than the first confidence level preset value, lead to
Cross prediction food materials species selection window display prediction food materials species.
Alternatively, the operation to display interface is detected to be used to determine that the species of food materials includes：
Detection is applied to the touch operation of prediction food materials species selection window.
Determine prediction food materials species of the food materials corresponding to touch operation.
Alternatively, before detection is applied to the touch operation of prediction food materials species selection window, in addition to：
Detection is applied to the touch operation of food materials position on food materials image.
Food materials according to selected by position of the touch operation on food materials image determines touch operation.
Show the prediction food materials species selection window of currently selected food materials.
Alternatively, the operation to display interface is detected to be used to determine that the species of food materials also includes：
Detect the drag operation of the prediction food materials species on display interface.
Determine final stop place of the drag operation on food materials image.
Food materials corresponding to final stop place on food materials image are defined as to dragged prediction food materials species, gone forward side by side
Row food materials Data Enter.
Alternatively,
Predict food materials species selection window in also include manually and/or phonetic entry food materials species typing window.
When the typing operation of prediction food materials species is not detected by preset time, the typing food materials kind of typing window is detected
Class, and by food materials species be defined as touch operation selection food materials food materials species.
Alternatively, this method also includes：Typing is shown on the food materials corresponding to final stop place on food materials image
Food materials species.
Alternatively, predict that the default food materials species in food materials species selection window is entered in predeterminated position in the form of scroll bar
Row display.
The prediction food materials species shown in scroll bar puts in order including following one or several kinds of combinations：
Random alignment.
The sequence of the confidence level of the prediction food materials gone out according to image recognition arranges.
Sequence according to the edible frequency of food materials arranges.
Alternatively, this method also includes：
The slide of optional position on scroll bar is detected, when it is determined that slide is effectively operates, control scroll bar is in cunning
Rolled in the glide direction of dynamic operation.
Compared with prior art, the present invention includes：Obtain the food materials image of storage in refrigerator；Display includes the food materials image
With the display interface of prediction food materials species selection window；Detect the species that the operation to display interface is used to determine food materials；Typing
The food materials species of determination.Pass through the solution of the present invention, by increasing capacitance it is possible to increase the interaction of user and refrigerator, increase the entertaining of Input Process
Property, improve user experience.
Brief description of the drawings
The accompanying drawing in the embodiment of the present invention is illustrated below, the accompanying drawing in embodiment is for entering one to the present invention
Step understands, is used to explain the present invention together with specification, does not form limiting the scope of the invention.
Fig. 1 is the refrigerator food materials input method flow chart of the embodiment of the present invention；
Fig. 2 is the refrigerator food materials input method schematic diagram of the embodiment of the present invention.
Embodiment
For the ease of the understanding of those skilled in the art, the invention will be further described below in conjunction with the accompanying drawings, not
It can be used for limiting the scope of the invention.
In order to achieve the above object, the present invention proposes a kind of refrigerator food materials input method, as shown in Figure 1 and Figure 2, the party
Method includes step S101-S104：
S101, the food materials image for obtaining storage in refrigerator.
In embodiments of the present invention, food materials are put into refrigerator in each user, and after refrigerator doors closing, ice can be passed through
Default camera is taken pictures to the food materials deposited in refrigerator in case, obtains the food materials image that food materials are deposited in refrigerator.
The display interface of S102, display comprising the food materials image and prediction food materials species selection window.
In embodiments of the present invention, the display screen for user's viewing can be pre-set on refrigerator, the display screen can pacify
In refrigerator doors, refrigerator side can also be installed on, is not limited for its specific installation site., can by the display screen
So that food materials image captured in step S101 to be shown.Now, user can be very clear to the food materials in refrigerator, because
This, user can carry out typing one by one on food materials input interface according to food materials image to food materials in refrigerator so that food materials typing
More targetedly, and the interest of food materials typing is added.In addition, food materials shown on food materials image can also be shown on display screen
Prediction food materials species selection window, the food materials species of current food materials can be determined by the prediction food materials species selection window,
So that user carries out Select input according to the food materials situation on photo.For example, enumerated in food materials species selection window is predicted
A variety of default food materials such as Chinese cabbage, corn, eggplant, potato, user can be according to the food materials images on photo targetedly to ice
The food materials being put into case carry out typing.
Alternatively, prediction food materials species is obtained by one or more of mode：
Mode one, the edible frequency to prestore is more than to m food materials species of edible frequency preset value as predicting food materials species, its
In, m >=1, m are positive integer.
In embodiments of the present invention, refrigerator can count the edible frequency that food materials are deposited in refrigerator, and to counting
The edible frequency of various food be ranked up, can be enumerated the edible several food materials of frequency highest as prediction food materials species
In food materials species selection window is predicted.Here, refrigerator can be by counting every to the statistics of the edible frequency of deposited food materials
The typing number of kind of food materials, or the taking-up numbers of the every kind of food materials of statistics realize, certainly, in other embodiments, can be with
Select other methods to be counted, be not limited for specific statistical method or algorithm herein.
Mode two, using in advance in the default prediction alternative frame of food materials species one or more food materials species for inputting as
Predict food materials species.
In embodiments of the present invention, the input window of alternative food materials species, i.e., above-mentioned prediction food can also be pre-set
The alternative frame of assortment class, by the input window, user can pre-enter one or more food materials alternately food materials or default
Food materials species, so that user is selected in food materials typing for the prediction food materials species, save each typing of user
Time.
Mode three, the confidence level for going out image recognition are more than n food materials species of the first confidence level preset value as prediction
Food materials species, wherein, n >=1, n are positive integer.
In embodiments of the present invention, refrigerator inside can also pre-set pattern recognition device, be filled by the image recognition
The one or more food materials species that can be identified on food materials image are put, and can be according to the readability of food materials or identification etc.
The confidence level of image recognition is determined, the confidence level is ranked up, obtains confidence level highest or higher several food materials kinds
Class, as prediction food materials species；Or a confidence level preset value is set to be preset as critical value, the first confidence level described above
Value, when the confidence level that image recognition goes out is more than the first confidence level preset value, illustrates pattern recognition device to current food materials
Resolution is higher, and prediction food materials species can be used as to enumerate and select or determine for user in food materials species selection window is predicted.
In embodiments of the present invention, the accurate of refrigerator automatic input food materials further improves by the setting of image recognition confidence level
Property, it can more effectively aid in user to carry out food materials typing, improve operating efficiency.
Alternatively, predict that the default food materials species in food materials species selection window can be with the shape of scroll bar in predeterminated position
Formula is shown.
In embodiments of the present invention, watched for the ease of user, the prediction food materials species selection window is on a display screen
Display format can be scroll bar, can show the information of every kind of food materials, and every kind of food materials information successively in the scroll bar
In can include title, picture, label symbol and/or access time etc. of food materials species, the access time can be used as food materials
Freshness, the rotten foundation reminded.In addition, the display location of the scroll bar can be predeterminated position or optional position,
And the scroll bar be able to can drag, needed to drag to different positions according to user.
Alternatively, the prediction food materials species shown in scroll bar puts in order including following one or several kinds of combinations：
Random alignment, the sequence arrangement of the confidence level of the prediction food materials gone out according to image recognition and/or the edible frequency according to food materials
Secondary sequence arrangement.
In embodiments of the present invention, for predicting that specific put in order of food materials species is not particularly limited in scroll bar,
Any display order that can show default food materials species is all within the protection domain of the embodiment of the present invention.
Alternatively, this method also includes：
The slide of optional position on scroll bar is detected, when it is determined that slide is effectively operates, control scroll bar is in cunning
Rolled in the glide direction of dynamic operation.
In embodiments of the present invention, when all default food materials species can not be shown in the current display interface of scroll bar completely
When, part food materials species can be hidden, when refrigerator detects the slide to scroll bar, the scroll bar rolls
It is dynamic, so that user can watch the food materials species of hidden parts.In other embodiments, can also be the two of scroll bar
End sets scroll button, and refrigerator can detect the pressing operations in the scroll button, it is determined that the pressing operations are effectively operation
When, control scroll bar rolls on the direction to match with scroll button according to default speed loop.In another embodiment
In, above-mentioned scroll bar can not also be rolled by the operation detected to scroll bar, i.e., identification is shown on scroll bar
After the food materials species gone out, scroll bar is automatically according to pre-set velocity circulating rolling, rolling speed on some default direction
Degree can be set, and when user clicks on any food materials species or optional position on the scroll bar, the scroll bar can suspend
Roll.
In addition, in other embodiments, prediction food materials species selection window different from the displaying scheme of above-mentioned scroll bar
Mouth can not be the scroll bar or displaying bar of an entirety, without showing all prediction food materials species simultaneously；It can be with
It is multiple small display windows, is respectively displayed on the display window of different food materials positions on food materials image, and only display is directed to
The default food materials species of current location food materials.More directly perceived in order to watch, the plurality of small display window can be directly displayed at often
Individual food materials opening position；In order to not influence viewing effect, avoid display picture too chaotic, only can also click on corresponding food in user
Just shown during material.It is further to note that the displaying scheme can be deposited simultaneously with the displaying scheme of above-mentioned scroll bar
, can be using the displaying scheme of scroll bar as main displaying scheme, the program is as auxiliary displaying scheme.
Alternatively, this method also includes：
Different display background is set to the different food materials species shown in scroll bar；Wherein, different display background includes
Different display color, different display patterns and/or different display effects；And/or to the food materials under different conditions information
Species sets the different display time；Wherein, the status information includes：Height, the food materials of the recognition confidence of food materials are stored in
The height of the priority of time and/or the edible frequency of food materials.
In embodiments of the present invention, in order that the display of the various food materials species in scroll bar is more eye-catching, user is increased
The interest of typing food materials, the different food materials species shown in scroll bar can be arranged to different display background.In addition,
, can be when rolling adjustment and showing various food materials according to different for the ease of directly perceived understanding of the user to food materials information in refrigerator
Order or different time are shown, for example, the food materials that the edible frequency of preferential display is most somebody's turn to do, or preferentially show entry time
Earliest food materials etc..
The operation of S103, detection to display interface is used for the species for determining food materials.
In embodiments of the present invention, on the basis of above-mentioned food materials image and prediction food materials species selection window,
With by operation of the detection to the food materials image on display interface or to the food materials species in prediction food materials species selection window
Selection operation determines food materials species.
Alternatively, the operation to display interface is detected to be used to determine that the species of food materials includes：
Detection is applied to the touch operation of prediction food materials species selection window；Determine prediction food of the food materials corresponding to touch operation
Assortment class.
In embodiments of the present invention, no matter whether pattern recognition device is pre-set in refrigerator, as long as directly detection pair
The selection operation of the food materials species in food materials species selection window is predicted, the food of typing can be determined by the selection operation
Material.If pre-setting pattern recognition device in refrigerator, can also be aided in by the image identification function of pattern recognition device
User completes the determination work of food materials species, can specifically be accomplished by the following way.
Alternatively, this method also includes step S201-S202：
Food materials species in S201, image recognition food materials image.
In embodiments of the present invention, by foregoing teachings, it is known that default pattern recognition device can pass through image recognition
Food materials in refrigerator are identified function, and the recognition result for being directed to different food materials determines the confidence level of image recognition, herein
It is not limited for specific recognition methods.
S202, when predict food materials species confidence level be more than or equal to the second confidence level preset value when, determine food materials for predict
Food materials species.
In embodiments of the present invention, if pattern recognition device is identified for a certain food materials, and determine to this
The recognition confidence of food materials is very high, i.e., then at this moment can directly will be pre- after identification more than or equal to the second confidence level preset value
Survey food materials species of the food materials species as the food materials currently identified, and carry out food materials typing, without user again by operate into
Row food materials typing.
S203, when the confidence level of prediction food materials species is less than the second confidence level preset value and is more than the first confidence level preset value
When, by predicting food materials species selection window display prediction food materials species.
In embodiments of the present invention, if pattern recognition device is identified for a certain food materials, and determine to this
The recognition confidence of food materials is not high, i.e., then at this moment can be by the prediction food materials species after identification less than the second confidence level preset value
It is put into prediction food materials species selection window, so that user is by predicting food materials species selection window to the food materials after identification again
Confirm, so as to correct typing whole food materials species.
In embodiments of the present invention, on the basis of image recognition is carried out to food materials in refrigerator by pattern recognition device,
The operation to display interface can also be detected by following scheme, to determine the species of food materials.
Alternatively, before detection is applied to the touch operation of prediction food materials species selection window, in addition to step S301-
S302：
S301, detection are applied to the touch operation of food materials position on food materials image.
In embodiments of the present invention, in order to improve efficiency of inputting, user can be directly to a certain food materials on food materials image
Operated, for example, when the potato identification that user is thought on food materials image is incorrect, can be directly to the soil on food materials image
Beans carry out touch operation, and the touch operation can include the operations such as click, slip.At this moment, refrigerator can detect user to potato
The touch operation of position.
S302, the position according to touch operation on food materials image determine touch operation selected by food materials.
In embodiments of the present invention, after refrigerator detects above-mentioned touch operation, further touch location can be carried out
Confirm, so as to which the touch location is corresponding with the food materials on food materials image, so that it is determined that selected by the touch operation of user
Food materials.For example, if refrigerator may show the possible food materials species of every kind of food materials after image recognition is carried out at the beginning
In corresponding food materials opening position, such as food materials A, B, C ..., it is other such as food materials A after user touches a certain food materials
Food materials species（The titles of the food materials, code name etc.）Such as B, C ... it can not temporarily show, only show the food currently selected
Material A food materials species.In addition, if the food materials that user confirms currently to show are not the food materials selected by him, as user wants to select
Be A, but currently be shown B, then user can within the default time from newly to be selected when just touch, so as to
Refrigerator reaffirms touch location, and aforesaid operations can be repeated between user and refrigerator, until refrigerator finally shows that user thinks
The food materials species wanted, or confirm that user wants the position clicked on.In addition, above-mentioned preset time is in order to avoid user moves
The position that making too slow refrigerator can give tacit consent to corresponding to currently displayed food materials species automatically is exactly the food materials kind that user wants to touch
The position of class.The program more clearly can confirm user's currently touch location on food materials image to user.
S303, the currently selected food materials of display prediction food materials species selection window.
In embodiments of the present invention, after the food materials selected by the touch operation of user are determined, it can be determined that touch
The food materials of selection are operated whether for the food materials that have identified；When touch operation selection food materials for identified food materials when, can
Further to jump out the determination window of currently selected food materials identification correctness；If it is determined that selected food materials identification is just
Really, typing directly can be carried out using the food materials species currently identified as the food materials species of the food materials；It is if it is determined that selected
Food materials identification is incorrect, can go out to predict food materials species selection window, and the prediction food materials in the position display of current food materials
The possible one or more prediction food materials species of the food materials can be set out in species selection window to be selected for user.
Here still illustrated by taking step S302 citing as an example, after A food materials position is touched, then confirm that position is touched
In the case of touching correctly, the current food materials species for only showing A food materials, at this moment it can jump out for whether food materials A identifies correctly really
Recognize window, or whether the A food materials species for prompting user currently to show by the way of voice message is correct.If general food
Material identifies that correctly, user will not operate to the food materials at the beginning, is generally only directed to when identifying incorrect just to enter
Row operation, the situation of certain maloperation shoulds be regarded as a different matter, and food materials identify whether correct confirmation process also for avoiding maloperation,
Incorrect situation, which is described in detail, only to be identified to current food materials below.When user confirms that the food materials species of A food materials is incorrect
When, refrigerator can show the prediction food materials species selection window of the food materials in the food materials opening position touched, for example, one enumerates
B, C, D, E ... wait the window of a variety of default food materials species, or scroll bar, displaying bar etc..User can be by right again
Food materials species B, C, D, E ... in the window, scroll bar or displaying bar are selected, and refrigerator can enter to the selection result of user
Row is detected and confirmed, to determine to correspond to the correct food materials species of food materials at current institute's touch location.
But the food materials species in food materials species selection window may include correct food materials species, it is also possible to not comprising correct
Food materials species, both of these case can be handled respectively by following scheme.
Situation one, when correct food materials species be shown in prediction food materials species selection window in when, user can be directly right
The correct food materials species carries out touch operation and selected, refrigerator can according to the selection result to predicting food materials species, it is determined that
The food materials species of the food materials of touch operation selection, can specifically be realized by following scheme.
Alternatively, according to predict food materials species selection result, determine touch operation selection food materials food materials species
Including：
The click for detecting a kind of food materials species of prediction in the food materials species to one or more prediction confirms instruction.
When the food materials kind of any one prediction in the food materials species that one or more predictions are detected in preset time
When the click of class confirms instruction, it is determined that the food materials species of prediction includes the food materials species of currently selected food materials, and it will click on
The food materials species of this kind prediction confirmed is defined as the food materials species of the food materials of touch operation selection.
When the food materials of any one prediction in the food materials species that one or more predictions are not detected by preset time
When the click of species confirms instruction, it is determined that not including the food materials species of currently selected food materials in the food materials species of prediction, and examine
Survey the typing information of the typing window of following food materials species；Food materials species included in typing information is defined as to touch behaviour
The food materials species of the food materials to elect.
Situation two, when correct food materials species be not shown in prediction food materials species selection window in when, user can pass through
Following manual or voice typing windows voluntarily typing food materials species, can also realize current food materials by following Pullings
Food materials species typing.
Alternatively, the operation to display interface is detected to be used to determine that the species of food materials also includes step S401-S403：
The drag operation of prediction food materials species on S401, detection display interface.
In embodiments of the present invention, when predict in food materials species selection window do not include current food materials correct food materials species
When, in order to save the typing of user operation or improve efficiency of inputting, user can select what is had shown that in current display screen
Food materials species is dragged, such as from above-mentioned scroll bar, or the prediction food materials species selection window on other food materials positions
Correct food materials species is selected in the food materials species shown in mouthful, and drags on the food materials for being currently needed for determining and is used as the food materials
Food materials species.At this moment, refrigerator needs to detect the drag operation on display screen.Specifically include：Detection is to any prediction
The dragging behaviour of the food materials species of any one prediction in food materials species selection window in the food materials species of one or more predictions
Make, or, detect the drag operation to any one food materials species in scroll bar.
S402, determine final stop place of the drag operation on food materials image.
In embodiments of the present invention, can be with after the drag operation for detecting the prediction food materials species on display interface
Determine the final stop place of food materials species that the drag operation is dragged on food materials image；To determine the final stop place
The corresponding food materials on food materials image.
S403, the food materials corresponding to the final stop place on food materials image are defined as to dragged prediction food materials kind
Class, and carry out food materials Data Enter.
In embodiments of the present invention, it is determined that, can be with after the food materials corresponding to the final stop place of drag operation
Food materials species of the food materials species that drag operation is dragged directly as the food materials corresponding to final stop place is subjected to food materials
Data Enter.
Alternatively, predict also is included manually and/or phonetic entry food materials species in the selection window of food materials species
Typing window.
When the typing operation of prediction food materials species is not detected by preset time, the typing food materials kind of typing window is detected
Class, and by food materials species be defined as touch operation selection food materials food materials species.
In embodiments of the present invention, when correct food materials species is not shown in prediction food materials species selection window, i.e.,
It is not detected by preset time any in one or more of the prediction food materials species selection window food materials species of prediction
When the click of the food materials species of prediction a kind of confirms instruction, user can pass through default typing window voluntarily typing food materials kind
Class, can be to be manually entered or the various ways such as phonetic entry realize that typing works by the typing window, and is manually entered
When can input word, numeral, character, picture etc..
The food materials species that S104, typing determine.
In embodiments of the present invention, after the typing operation to display interface is detected by any of the above scheme, to record
The corresponding food materials and corresponding food materials species for entering operation carry out typing, to complete the typing of refrigerator food materials species work.
Alternatively, this method also includes：Typing is shown on the food materials corresponding to final stop place on food materials image
Food materials species.
In embodiments of the present invention, can be corresponding on food materials image after the typing work of various food materials is completed
Food materials opening position shows corresponding food materials species, so that user is very clear to the food materials information in refrigerator, is easy to user to carry out
Food materials are purchased or taken.
Alternatively, this method also includes：After each refrigerator doors are closed, refrigerator built-in camera is to the food materials deposited in refrigerator
Take pictures again；The food materials photo shot after the food materials photo newly taken is closed with last refrigerator doors by pattern recognition device enters
Row compares, and when it is determined that lacking a kind of food materials in the food materials photo newly taken, food materials are from the food materials information of typing by lacking in
Delete.The food materials species and take-off time of the food materials are put into default history simultaneously to eat in food materials database of record.
Alternatively, this method also includes：By default integrating system to user when secondary food materials typing situation is accumulated
Point.For example, when user is when secondary food materials entry time is less than or equal to default time threshold, once integrated.The party
Case can increase the game of user's food materials Input Process, and reduce monotonicity when being manually entered, and improve the experience of user
Sense.In addition, in embodiments of the present invention, can also by the Fancy Match of current trend, see etc. that game is attached to food materials typing repeatedly
During, for example, when user to prediction food materials species selection window in or scroll bar in food materials select when, for not by
The food materials of selection can make its disappearance in the form of Fancy Match, and be equipped with corresponding music and set off atmosphere by contrast, and user can be with side typing
Play on side so that the Input Process of whole food materials is more fresh interesting.
Alternatively, this method also includes：Refrigerator typing operating system is combined with mobile terminal application APP, passes through shifting
Dynamic terminal completes the typing work of refrigerator food materials.This scheme make it that refrigerator intelligent function is no longer chicken ribs, further increases
Intercommunication between each intelligent terminal of user is mutually used so that user's life is more intelligent, and user can be made to carry out ice at any time
Case food materials check or typing, add the flexibility of food materials typing.
Compared with prior art, the present invention includes：Obtain the food materials image of storage in refrigerator；Display includes the food materials image
With the display interface of prediction food materials species selection window；Detect the species that the operation to display interface is used to determine food materials；Typing
The food materials species of determination.Pass through the solution of the present invention, by increasing capacitance it is possible to increase the interaction of user and refrigerator, increase the entertaining of Input Process
Property, improve user experience.And various food typing mode is combined, is improving input speed and reducing typing operation
Meanwhile improve the accuracy of typing.
It should be noted that embodiment described above be for only for ease of it will be understood by those skilled in the art that, and
It is not used in and limits the scope of the invention, on the premise of the inventive concept of the present invention is not departed from, those skilled in the art couple
Any obvious replacement and improvement that the present invention is made etc. is within protection scope of the present invention.
Claims (10)
1. a kind of refrigerator food materials input method, it is characterised in that methods described includes：
Obtain the food materials image of storage in refrigerator；
Display interface of the display comprising the food materials image and prediction food materials species selection window；
Detect the species that the operation to the display interface is used to determine the food materials；
Food materials species determined by typing.
2. refrigerator food materials input method as claimed in claim 1, it is characterised in that obtained by one or more of mode
The prediction food materials species：
The m food materials species that the edible frequency to prestore is more than to edible frequency preset value predicts food materials species as described, wherein,
M >=1, m are positive integer；
Using the one or more food materials species inputted in advance in the default prediction alternative frame of food materials species as the prediction food
Assortment class；And
The confidence level that image recognition is gone out is more than n food materials species of the first confidence level preset value as the prediction food materials kind
Class, wherein, n >=1, n are positive integer.
3. refrigerator food materials input method as claimed in claim 2, it is characterised in that methods described also includes：
Food materials species in food materials image described in image recognition；
When the confidence level of the prediction food materials species is more than or equal to the second confidence level preset value, determine that food materials are eaten for the prediction
Assortment class；
When the confidence level of the prediction food materials species is less than the second confidence level preset value and is more than the first confidence level preset value, lead to
Cross the prediction food materials species selection window and show the prediction food materials species.
4. the refrigerator food materials input method as described in claim 1 or 2 or 3, it is characterised in that detection is to the display interface
Operate for determining that the species of the food materials includes：
Detection is applied to the touch operation of the prediction food materials species selection window；
Determine prediction food materials species of the food materials corresponding to touch operation.
5. refrigerator food materials input method as claimed in claim 4, it is characterised in that be applied to the prediction food materials kind in detection
Before the touch operation of class selection window, in addition to：
Detection is applied to the touch operation of food materials position on the food materials image；
Food materials according to selected by position of the touch operation on the food materials image determines the touch operation；
Show the prediction food materials species selection window of currently selected food materials.
6. refrigerator food materials input method as claimed in claim 4, it is characterised in that operation of the detection to the display interface is used
In it is determined that the species of the food materials also includes：
Detect the drag operation of the prediction food materials species on the display interface；
Determine final stop place of the drag operation on the food materials image；
Food materials corresponding to final stop place on the food materials image are defined as to dragged prediction food materials species, gone forward side by side
Row food materials Data Enter.
7. refrigerator food materials input method as claimed in claim 4, it is characterised in that
It is described prediction food materials species selection window in also include manually and/or phonetic entry food materials species typing window
Mouthful；
When the typing operation of prediction food materials species is not detected by preset time, the typing food materials kind of the typing window is detected
Class, and the food materials species is defined as to the food materials species of the food materials of touch operation selection.
8. refrigerator food materials input method as claimed in claim 6, it is characterised in that methods described also includes：In the food materials
The food materials species of typing is shown on the food materials corresponding to final stop place on image.
9. refrigerator food materials input method as claimed in claim 2 or claim 3, it is characterised in that the prediction food materials species selection window
Default food materials species in mouthful is shown in predeterminated position in the form of scroll bar；
The prediction food materials species shown in the scroll bar puts in order including following one or several kinds of combinations：
Random alignment；
The sequence of the confidence level of the prediction food materials gone out according to image recognition arranges；
Sequence according to the edible frequency of food materials arranges.
10. refrigerator food materials input method as claimed in claim 9, it is characterised in that methods described also includes：
The slide of optional position on the scroll bar is detected, when it is determined that the slide is effectively operates, controls institute
Scroll bar is stated to roll in the glide direction of the slide.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610865483.0A CN107885425A (en) | 2016-09-29 | 2016-09-29 | A kind of refrigerator food materials input method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610865483.0A CN107885425A (en) | 2016-09-29 | 2016-09-29 | A kind of refrigerator food materials input method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107885425A true CN107885425A (en) | 2018-04-06 |
Family
ID=61769815
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610865483.0A Pending CN107885425A (en) | 2016-09-29 | 2016-09-29 | A kind of refrigerator food materials input method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107885425A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112535408A (en) * | 2019-09-23 | 2021-03-23 | 佛山市顺德区美的电热电器制造有限公司 | Auxiliary cooking method, device and computer storage medium |
| CN113465251A (en) * | 2020-05-28 | 2021-10-01 | 海信集团有限公司 | Intelligent refrigerator and food material identification method |
| EP3852038B1 (en) * | 2018-11-05 | 2022-12-14 | Samsung Electronics Co., Ltd. | Food management system, server apparatus, and refrigerator |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101228558A (en) * | 2005-06-10 | 2008-07-23 | 埃森哲环球服务有限公司 | Electronic vehicle identification |
| KR20110007663A (en) * | 2009-07-17 | 2011-01-25 | (주)브이아이지 | The refrigerator substance confirmation system uses lcd display and support the reader |
| CN102456021A (en) * | 2010-10-26 | 2012-05-16 | 深圳市金蝶友商电子商务服务有限公司 | Method and device for rapidly filling document data |
| JP2012193873A (en) * | 2011-03-15 | 2012-10-11 | Nikon Corp | Storage device |
| US20140101589A1 (en) * | 2012-10-10 | 2014-04-10 | Samsung Electronics Co., Ltd. | Refrigerator and control method thereof |
| CN104061749A (en) * | 2013-03-18 | 2014-09-24 | 海尔集团公司 | Refrigerator food storage position recording method, device and terminal and refrigerator |
| CN104361041A (en) * | 2014-10-28 | 2015-02-18 | 华南理工大学 | Auxiliary method and auxiliary system of intelligent refrigerator |
| CN105022480A (en) * | 2015-07-02 | 2015-11-04 | 深圳市金立通信设备有限公司 | Input method and terminal |
-
2016
- 2016-09-29 CN CN201610865483.0A patent/CN107885425A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101228558A (en) * | 2005-06-10 | 2008-07-23 | 埃森哲环球服务有限公司 | Electronic vehicle identification |
| KR20110007663A (en) * | 2009-07-17 | 2011-01-25 | (주)브이아이지 | The refrigerator substance confirmation system uses lcd display and support the reader |
| CN102456021A (en) * | 2010-10-26 | 2012-05-16 | 深圳市金蝶友商电子商务服务有限公司 | Method and device for rapidly filling document data |
| JP2012193873A (en) * | 2011-03-15 | 2012-10-11 | Nikon Corp | Storage device |
| US20140101589A1 (en) * | 2012-10-10 | 2014-04-10 | Samsung Electronics Co., Ltd. | Refrigerator and control method thereof |
| CN104061749A (en) * | 2013-03-18 | 2014-09-24 | 海尔集团公司 | Refrigerator food storage position recording method, device and terminal and refrigerator |
| CN104361041A (en) * | 2014-10-28 | 2015-02-18 | 华南理工大学 | Auxiliary method and auxiliary system of intelligent refrigerator |
| CN105022480A (en) * | 2015-07-02 | 2015-11-04 | 深圳市金立通信设备有限公司 | Input method and terminal |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3852038B1 (en) * | 2018-11-05 | 2022-12-14 | Samsung Electronics Co., Ltd. | Food management system, server apparatus, and refrigerator |
| CN112535408A (en) * | 2019-09-23 | 2021-03-23 | 佛山市顺德区美的电热电器制造有限公司 | Auxiliary cooking method, device and computer storage medium |
| CN112535408B (en) * | 2019-09-23 | 2022-04-01 | 佛山市顺德区美的电热电器制造有限公司 | Auxiliary cooking method, device and computer storage medium |
| CN113465251A (en) * | 2020-05-28 | 2021-10-01 | 海信集团有限公司 | Intelligent refrigerator and food material identification method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101911034B1 (en) | Organizing graphical representations on computing devices | |
| US20240094872A1 (en) | Navigating through documents in a document viewing application | |
| US11899703B2 (en) | Arrangements of documents in a document feed | |
| CN103365525B (en) | Mobile terminal and multi-window displaying method for mobile terminal | |
| US9490997B2 (en) | Control method for information apparatus and computer-readable recording medium | |
| CN103019761B (en) | The method for arranging and device of the user interface object of portable terminal | |
| KR101725887B1 (en) | Method and apparatus for searching contents in touch screen device | |
| US11886690B2 (en) | System and method for content selection | |
| US20150113414A1 (en) | Control method for information apparatus and computer-readable recording medium | |
| US20130117702A1 (en) | Method and apparatus for managing reading using a terminal | |
| KR20150010516A (en) | Method and apparatus for displaying object by flexible device | |
| KR20190108205A (en) | Positioning of components in a user interface | |
| KR20120095299A (en) | Method and apparatus for navigating a hierarchical menu based user interface | |
| WO2019085820A1 (en) | Processing method, device, apparatus, and machine-readable medium | |
| US20160357712A1 (en) | Document Summary Feed Generation Method, Apparatus and System | |
| CN107885425A (en) | A kind of refrigerator food materials input method | |
| CN105373301A (en) | Control display method, control display apparatus, and terminal | |
| US20090254860A1 (en) | Method and apparatus for processing widget in multi ticker | |
| CN106354372A (en) | Information preview method and device | |
| CN106020629A (en) | Triggering method and device of application program selection menu | |
| CN106201234A (en) | The inspection method of content of pages and device | |
| CN104053063A (en) | Intuitive image-based program guide for controlling display device | |
| CN106227488A (en) | The display packing of a kind of reminder message and mobile terminal | |
| CN106547430A (en) | A kind of management application drawing calibration method and terminal | |
| US8032908B2 (en) | Graphical indicator within an interactive program guide |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180406 |