CN101506603A - Operation method of interactive refrigerator system - Google Patents
Operation method of interactive refrigerator system Download PDFInfo
- Publication number
- CN101506603A CN101506603A CNA200780031797XA CN200780031797A CN101506603A CN 101506603 A CN101506603 A CN 101506603A CN A200780031797X A CNA200780031797X A CN A200780031797XA CN 200780031797 A CN200780031797 A CN 200780031797A CN 101506603 A CN101506603 A CN 101506603A
- Authority
- CN
- China
- Prior art keywords
- information
- user
- input
- stored items
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
- G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D2400/00—General features of, or devices for refrigerators, cold rooms, ice-boxes, or for cooling or freezing apparatus not covered by any other subclass
- F25D2400/36—Visual displays
- F25D2400/361—Interactive visual displays
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D2500/00—Problems to be solved
- F25D2500/06—Stock management
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D2700/00—Means for sensing or measuring; Sensors therefor
- F25D2700/04—Sensors detecting the presence of a person
Abstract
An operation method of an interactive refrigerator system, includes displaying information about stored items corresponding to a speech input by a user, generating and outputting a response message for the information about the stored items, checking whether or not storage periods of the stored items are expired; and outputting expiration information about storage periods of the stored items or expected expiration information about storage periods of the stored items.
Description
Technical field
The present invention relates to refrigerator, relate in particular to the method for operating of interactive refrigerator system.
Background technology
Generally speaking, the user must manually import a plurality of food titles by input block such as keyboard, to such an extent as to input is about being stored in the information of the food in the refrigerator, refrigerator is based on the information of being stored by the food title of the manual income of user about corresponding food then.In addition, the user can manually import the food title by input block, so that obtain about being stored in the information of the food in the refrigerator, obtains information about corresponding food based on the food title of so artificial input then.
Yet there is inconvenience in the refrigerator of correlation technique requiring the user manually to import a plurality of food title this respects by input block such as keyboard.
In addition, the refrigerator of correlation technique requires input block such as keyboard to be set in the refrigerator, has therefore increased the manufacturing cost of refrigerator.
And, in the refrigerator of correlation technique, carry out input by input block such as keyboard, increased like this and carried out the required time of input operation.
Summary of the invention
Therefore, one object of the present invention is to provide the method for operating of interactive refrigerator system, and it makes the user to come input information by voice.
Another object of the present invention is to provide the method for operating of interactive refrigerator, and it is by means of providing the response message corresponding to phonetic entry to make the user can easily discern the voice recognition result by the avatar (avatar) that adopts given shape or make given pose to the user.
Another purpose of the present invention is to provide the method for operating of interactive refrigerator system, and it is by means of the project that provides the information about stored items to make user's administrative institute's storage easily to the user in advance by the avatar that adopts given shape or make given pose.
In order to realize these and other advantage and according to purpose of the present invention, such as here embodiment and broadly described, a kind of method of operating of interactive refrigerator system is provided, comprising: show about corresponding to information by the stored items of the voice of user's input; Generate and output needle to response message about the information of stored items; Whether the storage life of checking stored items expires; And output is about the information that expires of storage life of stored items or about the information that expires of storage life of the anticipation of stored items.
A kind of method of operating of interactive refrigerator system also is provided, has comprised:, and shown about information corresponding to the stored items of the voice signal of being imported by voice signal input information about the food stored; From information, extract the term of validity, and check whether the term of validity of being extracted expires about stored items; And whether expire based on the term of validity and to generate and show the food information list window, so that show the corresponding information relevant with food.
Description of drawings
Fig. 1 shows the schematic block diagram of the structure of the information management apparatus that is applied to refrigerator according to an embodiment of the invention;
Fig. 2 is the enlarged drawing of the part of the front view of the refrigerator among Fig. 1 and this figure;
Fig. 3 shows the flow chart according to the method for operating of the interactive refrigerator system of the first embodiment of the present invention;
Fig. 4 shows the flow chart of the method for operating of interactive refrigerator system according to a second embodiment of the present invention;
Fig. 5 shows the flow chart of method of operating of the interactive refrigerator system of a third embodiment in accordance with the invention;
Fig. 6 and Fig. 7 show the embodiment of the initial user interface of the information management service of Fig. 3 in Fig. 5;
Fig. 8 shows the embodiment of information memory module to Figure 10;
Figure 11 and Figure 12 show the embodiment of information search pattern; And
Figure 13 and Figure 14 show the embodiment of information notification mode.
The specific embodiment
Describe the preferred embodiment of the method for operating of interactive refrigerator system in detail to Figure 14 below with reference to Fig. 1, the output of the method for operating of this interactive refrigerator system is corresponding to the response message of phonetic entry or carry out control function corresponding to phonetic entry, so that through port language sound is answered execution result, make user's managed storage project easily like this.
Fig. 1 shows the schematic block diagram of the structure of the information management apparatus that is applied to refrigerator according to an embodiment of the invention.Fig. 2 is the enlarged drawing of the part of the front view of the refrigerator among Fig. 1 and this figure.
As shown in Figure 1, refrigerator 100 according to the present invention comprises: the input unit 10 that is used to import certain voice that comes from the user; Be used to discern voice recognition module 20 corresponding to the information of user's input voice; Be used for showing and come the display unit 30 of picture displayed (for example user interface etc.), information etc. at information management service; Be used to be provided with the date counting device 40 of date and/or time; Be used to store and come the storage device 50 of picture displayed, information etc. at information management service; Be used to generate the sensor device 60 of the approaching signal of sensing user; Control device 70, be used to control above-mentioned parts and the communicator 80 that will be described below, the user is transfused to about being kept at the information of the stored items in the refrigerator by user's voice, and the information imported of identification, so that can check, the information of storage and administrative institute's input; The voice signal that is used for exporting from refrigerator 100 sends the user to or receives the communicator 80 of the control command relevant with refrigerator that comes from the user.In addition, control device 70 can be carried out the freezing of refrigerator 100 and/or refrigeration control operation.In addition, refrigerator 100 can comprise that the supply unit (not shown) is to supply each parts required electric power.
As shown in Figure 2, selecting arrangement 10a comprises: the temperature setting device 11 that is used to be provided with the temperature of refrigerating chamber and refrigerating chamber; Be used to be provided with the distributor setting device 12 of the COS (square ice cube, water, borneol etc.) of distributor; Be used to activate and be chosen in the menu apparatus 13 of the user interface that shows on the display unit 30; Be used to start or stop the voice recognition selecting arrangement 14 of voice recognition pattern; The selecting arrangement 15,16,17 that is used for other option (for example activation of refrigerator lamp, the locking/unlocking of input unit 10); And the menu/selector button 18 that is used to check and be chosen in the information that shows on the display unit 30.
Microphone 10b is installed on the front surface of refrigerator 100, to be easy to obtain user's voice.In addition, consider user's executable operations in the zone that display unit 30 is installed, as the information input, microphone 10b can be installed in a side of display unit 30.
Under the control of control device 70, voice recognition module 20 is provided the user speech (or voice signal) that comes from microphone 10b, so that, discern the voice that provided thus with the information (for example text, numeral, character etc.) of this speech conversion one-tenth corresponding to the voice that provided.Voice recognition module 20 can be realized by hardware, software is realized and firmware one or more in realizing are planted and realized.Voice recognition module 20 transmits the information of being discerned to control device 70, then under the control of control device 70, the information that is transmitted is shown as text or numeral on display unit 30, or the information that is transmitted is exported on display unit 30 by being converted to voice corresponding to the response message of the information that is transmitted.
Preferably, display unit 30 is at least a or more kinds of colorful film transistor liquid crystal display (TFT-LCD)s (TFT LCD) that are used for explicit user interface, avatar and information.User interface can be the background that shows avatar on it.In addition, user interface can add the information that shows about the refrigerator situation discretely with avatar or with avatar.That is to say that figure is shown in 2, display unit 30 shows as avatar (picture of the bear) 30a of standby screen and the essential information 31 of refrigerator, and the additional Weather information (or weather conditions of this day) 32 that shows.
In addition, pass or the status information of refrigerator when changing when the default time interval, the avatar information on being presented at display unit 30, audio output device 33 can also be exported the voice corresponding to the status information that prestores of refrigerator, so that notify the current state information of user's refrigerator.
When sensor device 60 sensed user approaching around the refrigerator, audio output device 33 can be configured to export the voice corresponding to the status information that prestores of refrigerator, so that the current state information of notice refrigerator.
When from microphone 10b input voice maybe when receiving the control command that for example is used to store that comes from the user, date counting device 40 calculates the information with time correlation, as date and/or time etc.And if the information of control device 70 request and time correlation, when this request was received, date counting device 40 provided time point information with time correlation to control device 70.
At least a or more kinds of in the following information of storage device 50 storage: be shown with picture (user interface) that the information management service that is provided by refrigerator 100 is provided to the user, by the synthetic information of control device 70, avatar data and the voice message corresponding with the status information of refrigerator.Picture is meant user interface screen, and it helps user's management information easily.Here, information comprises from date, quantity of title, storage or the storage life/fate of stored items or the term of validity etc.In addition, storage device 50 storages will be displayed on the avatar image on the initial screen etc., so that the user can therefrom select.Storage device 50 is also stored the avatar image of representing stored items, easily discerns stored items to help the user.
In order to manage the information about stored items, control device 70 is carried out the voice recognition pattern, and obtains user's voice by microphone 10b, thereby obtains the information corresponding to the user speech that obtains by control voice recognition module 20.Control device 70 provides information management service, as information memory module, information search pattern, information deletion pattern and information notification mode.This information management service is carried out with the voice recognition pattern, and can be configured to carry out information management service in response to importing by selecting arrangement 10a rather than by the user that voice are carried out.
The information memory module is meant the pattern of control device 70 storages by the information of microphone 10b acquisition.The information search pattern is meant that control device 70 reads the information that is stored in the storage device 50 so that the user can find the pattern of the information of wanting in the information that so reads.The information deletion pattern is meant and makes the user can delete the pattern of at least a portion among the information that is stored in the storage device 50.The information notification mode is such pattern: control device 70 reads the information that is stored in the storage device 50, and based on providing relevant have the information of the stored items of overdue effective storage life with information time correlation to the user by date counting device 40 is that obtain.Above-mentioned information memory module, information search pattern and information deletion pattern-dependent are carried out in user's input.The information notification mode is a kind of service, after the user selects the information notification mode or after this information notification mode is selected automatically, provides this service automatically by control device 70.
For example, voice recognition selecting arrangement 14 can be selected to start the voice recognition pattern.Then, if the project that is stored in the refrigerator is a milk, then the user can speak facing to microphone 10b, says＜suckle〉or＜Soul milk〉and brand name.Reach the degree that the user can discern stored items by the input word and carry out phonetic entry.Here, be not limited to the word that is used to import, can be by various modification input words.
Voice＜the milk of input〉can be converted into＜suckle character information, this character information is that this information is transmitted to control device 70 then corresponding to the information of passing through the voice that voice recognition module 20 imports.Control device 70 on display unit 30, show be transmitted＜milk character information.In addition, corresponding to＜milk〉the voice of character information can under the control of control device 70, export by audio output device 33.
When the user to being presented at character on the display unit 30 and checking and selecting＜cancel during the button (not shown), require the user re-enter the text of voice or voice suggestion under the control of control device 70 by display unit 30 or audio output device 33 outputs.
And, when the user checks being presented at character on the display unit 30, selection＜menu/selection then during button 18, the character that control device 70 will be presented on the display unit 30 stores in the storage device 50.Here, storage device 50 can also be provided by current time and the character that is provided by date counting device 40.
In＜menu/selection〉after button 18 is selected, the storage life and/or the term of validity of under the control of control device 70, pointing out the user to import stored items by display unit 30 or audio output device 33.If the user imports the storage life and/or the term of validity by speaking, then the information by 20 conversions of voice recognition module is transmitted to control device 70.Therefore, control device 70 is exported the information that is transmitted by display unit 30 or audio output device 33.Experienced the user in the information of being exported and confirmed that afterwards, the character that control device 70 will be presented on the display unit 30 stores in the storage device 50 process (in user's selection＜menu/selection〉situation of button 18 under).Then, by input unit 10 input quantity informations, subsequently, after the quantity of input was examined, this quantity information was stored in the storage device 50.
In case the stored items selection course of particular memory project and storage life with and/or term of validity setting up procedure finish, control device 70 just management about the information that is stored in the project in the storage device 50 (for example: the food title:＜milk 〉, quantity:＜1 〉, storage life: 30 days, the term of validity: on July 31st, 2007).
For example, if effective up to the storage life on July 31st, 2007, and the confirmation of the reservation time limit be set to then before 31 days July in 2007 7 days 7 days, promptly on July 24th, 2007, by display unit 30 to the user provide the storage life of indication stored items will be in 7 days overdue notice.
For example, the also surplus 7 days storage life of saying＜please note the milk that begins to store from July 1st, 2007〉voice by display unit 30 or audio output device 33 outputs.Here＜2,007 1, on July〉and＜milk〉be the information that after being transfused to, is stored in the storage device 50 with the voice recognition pattern,＜7 days〉be in storage device 50 as the pre-stored values in the notice period of being scheduled to by the user,＜from ... begin storage 〉,＜storage life and＜please note ... also surplus ...〉be the phrase of giving tacit consent in the storage device 50 of being pre-stored in.
And communicator 80 can also be configured to come from the control command user, relevant with refrigerator by wireless or the reception of wire communication signal, and the signal that receives is input to refrigerator 100.70 pairs of signals that are input to refrigerator 100 of control device are analyzed, and carry out the control operation corresponding to the information of being analyzed, then by the voice signal of display unit 30 outputs corresponding to execution result.
Below with reference to Fig. 1 and Fig. 2 the method for operating according to the interactive refrigerator system of the first embodiment of the present invention is described in detail.
Fig. 3 shows the flow chart according to the method for operating of the interactive refrigerator system of the first embodiment of the present invention.
At first, whether sensor device 60 sensings that are attached to refrigerator 100 have the user near this refrigerator.According to sensing result, if sensor device 60 does not sense the approaching of user, then keep standby mode, if but sensor device 60 sense the user near (S101), then the approaching sensing result of user is transmitted to control device 70.Then, control device 70 becomes default voice signal with relevant information translation with any food of overdue storage life, so that by audio output device 33 this notification of information is output as voice signal, perhaps visually shows this notification of information by display unit 30.
In addition, when output during about the information of food, can be configured to by display unit 30 to user output about having the food information of certain remaining effective storage life by user preset, and about the storage life information of overdue any food (S102).
Then, control device 70 determine the voice recognition patterns whether by undertaken by user's manipulation to the input of voice recognition selecting arrangement 14 and selected (S103).
According to definite result, if the voice recognition pattern is selected, then control device 70 shows the initial user interface of information management service on display unit 30.This initial user interface can use predetermined avatar, and this avatar shows text, will start as phrase＜voice recognition pattern 〉, or export the voice corresponding to this phrase (S104) that prestore.
Then, by microphone 10b user's voice is inputed to control device 70.
In order to check in the voice of user's input whether have mistake, the voice of being imported are converted into corresponding information (for example: text, numeral, character etc.) by voice recognition module 20.If this conversion can normally be carried out, determine that then there is not mistake in the voice of user's input, carry out next procedure (S107) then.If this conversion can not normally be carried out, determine that then there is mistake in the voice of user's input.Control device 70 shows that to the user text＜pardon by display unit 30 〉, use the avatar demonstration text or output pre-stored voice (S106), so that require the user to import voice once more corresponding to the text.
In addition, control device 70 can come to show to the user whether the voice of this user's input exist mistake by the shape or the posture of avatar.For example, there is not mistake in the voice that on behalf of this user, the avatar that can be configured to smile import, and has wrong (S105) in the voice that on behalf of this user, the avatar of cryying import.
When not having mistake in the voice of user input, voice recognition module 20 converts the user's voice input to corresponding to these voice information.Based on the information of conversion like this, can analyze about being stored in the information of the project in the refrigerator, analysis result can be sent to the outside by communicator 80 then.
In addition, 70 pairs of control device information or the control command relevant with refrigerator 80 that there receive from the user by communicator, that be transmitted to control device 70 then by 20 conversions of voice recognition module analyzed.
Here, at least one in the speech message of the input title, quantity, the term of validity, storage life that can comprise stored items and the control command relevant and more a plurality of data (S107) with refrigerator.
According to analysis result, determine whether the information or the control command that are transmitted are freezing/refrigeration operation control command or information (S108).
According to definite result, if information that is transmitted or control command are freezing/refrigeration operation control command or information, then the control function corresponding to freezing/refrigeration operation control command or information is performed.The result that the control function is carried out is converted into the result's who prestores, carry out corresponding to this control function voice or text, exports by display unit 30 then.
For example, if information that is transmitted or control command are＜storage 〉, the current situation of control device 70 storage then, and event memory is converted to voice or text corresponding to this event memory, then by display unit 30 output these results (S109).
As the result who determines,, determine then whether the information that is transmitted is common conversation message if information that is transmitted or control command are not freezing/refrigeration operation control command or information.
Here, control command relates to the control of the freezing/refrigeration cycle of refrigerator, the control of information management service etc., as＜storage 〉,＜search 〉,＜delete,＜cancellation 〉,＜finish,＜store all,＜check all,＜store and finish,＜confirm etc.And, be not the common conversation message of the control command title that relates to stored items, quantity, the term of validity, storage life etc., as＜refrigerating chamber 〉,＜refrigerating chamber,＜strawberry,＜3 days,＜on July 1st, 2007,＜beef,＜2 kilograms etc. (S110).
Definite result according to above step (S110), if information that is transmitted or control command are not common conversation messages, then generate voice or text corresponding to input message, and by display unit 30 outputs, so so that operation proceeds to phonetic entry step (S105) (S111).
Otherwise according to definite result of step (S110), if the information that is transmitted is common conversation message, then the response message corresponding to this input message is generated as voice or text, thus voice or the text that is generated by display unit 30 outputs.
Here, in order to generate response message, in storage device 50, store one or more session statement or word at least in advance corresponding to input message.At least one or more a plurality of session statement or the word of control device 70 by using storage in the storage device 50 generates as voice or text corresponding to the appropriate responsive message of input message.
In addition, when the response message that generates corresponding to input message, control device 70 calculates the storage life or the term of validity of stored items based on analysis result, and shows result of calculation on display unit 30.Control device 70 checks then whether storage life/the term of validity of stored items expires, visually show the storage life of respective stored project or the information that expires of the term of validity in storage Expiration Date or term of validity Expiration Date by display unit 30 subsequently, or this information is output as voice signal by audio output device 33.
In addition, control device 70 checks whether the storage life/term of validity of stored items expires.Consider by the user at the storage life/term of validity of stored items and the expiration notice day of default anticipation, by the user according to the expiration notice of the default anticipation of the storage life/term of validity of stored items before day, control device 70 visually shows the storage life of respective stored project or the information that expires of the term of validity by display unit 30, perhaps by audio output device 33 this information is output as voice signal.
For example, if by being set to expiration notice day 7 days of the anticipation of user preset, date before 7 days Expiration Dates of the term of validity of distance stored items then, the term of validity of the respective stored project information that expires visually is shown to the user by display unit 30, or is output as voice signal by audio output device 33.Like this, before the Expiration Date of the term of validity, in advance the user is notified, help management thus stored items.
In addition, the voice of user's input are distinguished,,, then this information relevant with food is analyzed if the voice of input are the information relevant with food as the result who distinguishes.Then, the shape with the feature that meets analysis result that prestores or the avatar of posture are generated as by display unit 30 and visually show (S112).
In (S112), the information that shows by display unit 30 can be sent to the outside by communicator 80 in step (S101).
Afterwards, whether whether control device 70 finished input by input unit 10 according to the user or existed in the Preset Time section and come from the user's voice input and determine that input finishes (S113).
As definite result of step (S113), if the input of determining to come from the user is then carried out phonetic entry step (S105) continuing.
Yet, as definite result of step (S113), to finish if determine the input that comes from the user, control device 70 Stop message management services show default initial screen (S114) then on display unit 30.
Below with reference to Fig. 1 and Fig. 2 the method for operating of according to a second embodiment of the present invention interactive refrigerator system is described in detail.
Fig. 4 shows the flow chart of the method for operating of interactive refrigerator system according to a second embodiment of the present invention.
Step (S201) arrives (S107) to (S207) corresponding to the step among Fig. 3 (S101).
Based on the analysis result in the step (S207), if the information that is transmitted relates to stored items, then control device 70 control input units 10 receive the additional input data about the respective stored project, and by voice recognition module 20 with the input data be converted to corresponding information, then with the conversion information store in the storage device 50.
Based on the analysis result in the step (S207), if the information that is transmitted is control command or control information, if perhaps the information that receives by communicator 80 is control command, then can be configured to carry out control corresponding to control command/information, and by the voice of display unit 30 outputs corresponding to execution result.
Here, the data of additional input can comprise at least one and a plurality of data (S208) in title, storage life, the term of validity and the quantity of stored items.
Then, be generated as voice or text to export corresponding to the response message of user's voice input or corresponding to the response message about the Storage Item destination data of additional input by display unit 30.
Here, in order to generate corresponding to the response message of user's voice input or corresponding to the response message about the Storage Item destination data of additional input, storage one or more session statement or word at least in storage device 50 in advance.Control device 70 generates voice or text by at least one or more a plurality of session statement or the word that use is stored in the storage device 50, as corresponding to the appropriate responsive message of input message or corresponding to the appropriate responsive message about the Storage Item destination data of additional input.
In addition, when generate corresponding to the response message of phonetic entry or corresponding to additional input about the response message of Storage Item destination data the time, control device 70 calculates and shows the storage life or the term of validity of the stored items of input.Control device 70 checks whether the storage life/term of validity of stored items expires, visually show the storage life of respective stored project or the information that expires of the term of validity in storage Expiration Date or term of validity Expiration Date by display unit 30 then, or be output as voice signal by audio output device 33.
In addition, the voice of input are distinguished,,, then this information relevant with food is analyzed if the voice of input are the information relevant with food as this result who distinguishes.Then, the shape with the feature that meets analysis result that prestores or the avatar of posture are generated as by display unit 30 and visually show (S209).
In (S209), the information that shows by display unit 30 can be sent to the outside by communicator 80 in step (S201).
Afterwards, whether whether control device 70 finished input by input unit 10 according to the user or existed in the Preset Time section and come from the user's voice input and determine that input finishes (S210).
As definite result of step (S210), if the input of determining to come from the user is then carried out phonetic entry step (S205) continuing.
As definite result of step (S210), finish if determine the input that comes from the user, then control device 70 Stop message management services show default initial screen (S211) then on display unit 30.
Below with reference to Fig. 1 and Fig. 2 the method for operating of the interactive refrigerator system of a third embodiment in accordance with the invention is described in detail.
Fig. 5 shows the flow chart of method of operating of the interactive refrigerator system of a third embodiment in accordance with the invention.
It is identical that step (S301) arrives (S104) to the step (S101) among (S304) and Fig. 3.
Afterwards, the information relevant with food that will store by microphone 10b inputs to control device 70 as voice signal.
In order to check in the user speech of input whether have mistake, the voice of being imported are converted into corresponding information by voice recognition module 20.If this conversion can normally be carried out, then really, decide user's voice input and do not have mistake, carry out next procedure (S307) then.If this conversion can not normally be carried out, determine that then there is mistake in the user's voice input.Control device 70 shows text by display unit 30 to the user, as＜pardon 〉, use avatar to show the voice corresponding to the text (S306) that the text or output prestore, so that require the user to import voice once more.
In addition, control device 70 can come to show to the user whether the voice of this user's input exist mistake by the shape or the posture of avatar.For example, there is not mistake in the voice of the avatar representative of consumer input that can be configured to smile, and has wrong (S305) in the voice of the avatar representative of consumer of cryying input.
When not having mistake in the voice of user input, voice recognition module 20 converts user's voice to corresponding to these voice information.Based on the information of conversion like this, can analyze about being stored in the information of the project in the refrigerator, analysis result can be sent to the outside by communicator 80 then.
In addition, 70 pairs of control device are analyzed by the information of voice recognition module 20 conversions, or the control command relevant with refrigerator 80 that there receive from the user by communicator, that be transmitted to control device 70 then analyzed.
Whether control device 70 extracts the term of validity or storage life from the information of being distinguished relevant with food, and expire according to the term of validity/storage life of being extracted and to generate the information list window relevant with food, so that show the corresponding information relevant with food.Then, control device 70 is voice or text with the corresponding information translation relevant with food, so that by display unit 30 outputs.
Here, the information that shows on the food information list window comprises title, storage life, the term of validity, the quantity of corresponding food and represents at least a or more kinds of in the avatar of corresponding food.
Based on analysis result, if the information that is transmitted is control command or control information, if perhaps the information that receives from communicator 80 is control command, then can be configured to carry out control, then from the voice (S307) of display unit 30 outputs corresponding to execution result corresponding to this control command/information.
Afterwards, be generated as voice or text, so that by display unit 30 outputs corresponding to response message at the speech message of the information of being imported relevant with food.
Here, in order to generate response message, in storage device 50, store one or more session statement or word at least in advance corresponding to the speech message of being imported.Control device 70 generates voice or text by at least one or more a plurality of session statement or the word that use is stored in the storage device 50, as the appropriate responsive message corresponding to input message.
In addition, when the response message corresponding to input message generated, control device 70 calculated and shows the storage life or the term of validity of the stored items of being imported.Control device 70 checks whether the storage life/term of validity of stored items expires, visually show the storage life of respective stored project or the information that expires of the term of validity in storage Expiration Date or term of validity Expiration Date by display unit 30 then, perhaps by audio output device 33 output voice signals.
In addition, the voice of input are distinguished,,, then this information relevant with food is analyzed if the voice of input are the information relevant with food as this result who distinguishes.Then, the shape with the feature that meets analysis result that prestores or the avatar of posture are generated visually to show (S308) by display unit 30.
In (S308), the information that shows by display unit 30 can be sent to the outside by communicator 80 in step (S301).
Afterwards, whether whether control device 70 finished input by input unit 10 according to the user or existed in the Preset Time section and come from the user's voice input and determine that input finishes (S309).
As definite result of step (S309), if the input of determining to come from the user is then carried out phonetic entry step (S305) continuing.
As definite result of step (S309), finish if determine the input that comes from the user, then control device 70 Stop message management services show default initial screen (S310) then on display unit 30.
Fig. 6 and Fig. 7 show the embodiment to the initial user interface of the information management service of Fig. 5 according to Fig. 3.
With reference to figure 6 and Fig. 7, according to the input of the voice recognition selecting arrangement 14 of user by selecting device 10a, control device 70 reads corresponding to the user interface of voice recognition pattern in the step S303 of the step S203 of the step S103 of Fig. 3 and S104, Fig. 4 and S204, Fig. 5 and S304 from storage device 50 and shows this user interface.Above embodiment is intended to manage the storage food as stored items.
Fig. 6 shows control device 70 and notifies the user startup about speech recognition mode.
Initial user interface as shown in Figure 7 can be the initial screen of information management service or the initial screen of voice recognition pattern.The user can manage about being stored in the information of the project in refrigerating chamber and the refrigerating chamber.This information management comprises following function, as information storage, information search and information deletion.Below all user interfaces and the initial user interface of describing is comprised how relevant user carries out the instruction of phonetic entry with what order (command sequences) in each step.In addition, in user interface, if the user says＜the refrigerating chamber storage 〉, then control device 70 is prepared execution information memory module.
In addition, demonstration＜cancellation〉button is in order to the input of cancellation user's voice, show＜stop button being in order to stop the user interface in the active procedure.Especially, because＜cancellation〉and＜stop button relating to control information, so be performed according to the control of each this button.Display unit 30 is at performed control result, shows voice or the text corresponding to the control result of this execution that prestores to the user.
The initial user interface also shows avatar (bear), so that the sensation of getting close to be provided to the user.
Can select the initial user interface by voice or by selecting arrangement 10a.
Fig. 8 shows the embodiment of information memory module to Figure 10.Fig. 8 has shown situation when the user selects the information memory module to Figure 10.
With reference to figure 8, when the user imports＜3 portions of salads on July 1st, 3 days in order 〉,＜3 carrots on July 8th, 7 days〉and＜1 box strawberry 3 days〉time, control device 70 shows the information of this input on display unit 30.For example, when input＜3 portions of salads on July 1st, 3 days〉time, control device 70 at first is transfused to voice＜salad 〉, on display unit 30, show corresponding to the response message of importing message to S307 to the step S305 among S208 and Fig. 5 to the step S205 among S111, Fig. 4 by the step S105 among Fig. 3 then.Next,＜3 part 〉,＜3 days and＜on July 1st, 2007〉follow same process.Here, the user can allow between each independent word at interval free, makes control device 70 can confirm that these 4 voice import separatedly.That is to say, can distinguish voice by the step S113 among Fig. 3, step S210 among Fig. 4 and the step S309 among Fig. 5.In addition, the user can select to import in the storage life or the term of validity at least one or more a plurality of.In other words, the storage life and the term of validity can be imported, perhaps the storage life or the term of validity can be imported.
In Fig. 9, in step S106, can not correctly carry out when distinguishing from user's voice when control device 70, this is distinguished and causes showing the avatar of frowning, and error message, as＜pardon 〉.
Figure 10 shows when Fig. 8 shows user's input＜storage and finishes〉time situation.That is to say, finish if control device 70 obtains input＜storage by selecting arrangement 10a or microphone 10b, then control device 70 will be stored in the storage device 50 to the information that S308 shows to the step S305 among S209 and Fig. 5 to the step S205 among S112, Fig. 4 by the step S105 among Fig. 3.Here, about when obtaining or stored information and information time correlation, information with time correlation (for example date and/or time) that will be provided by date counting device 40 and the information that shows be stored in the storage device 50 control device 70 then from date counting device 40 request.That provided and information time correlation are meant the storage from date of stored items.And control device 70 can be finished the storage of user's input by audio output device 33 output needles.For example, can output audio signal be stored〉as＜one box strawberry.
Figure 11 and Figure 12 show the embodiment of information search pattern.Figure 11 shows situation when the user selects the information search pattern to Figure 12.That is to say that in the user interface of Fig. 6 and Fig. 7, the embodiment of information search pattern is the type of the user interface that shows to S308 by the step S305 of the step S205 of the step S105 among Fig. 3 in S112, Fig. 4 in S209 and Fig. 5.
As shown in figure 11, control device 70 reads about being stored in the information of the project in the storage device 50 to S308 by the step S305 of the step S205 of the step S105 among Fig. 3 in S112, Fig. 4 in S209 and Fig. 5, and shows this information on display unit 30.Here, when calculating and showing the storage life of each stored items, control device 70 reads information about stored items from storage device 50, and gets Date and the time (date and/or time) from date counting device 40, calculates and show the storage life of each stored items thus.Calculate the storage life by the from date that deducts storage from current date.
And control device 70 can show the storage life based on the from date of storage or based on the residue fate of the distance term of validity, so that the user can easily distinguish stored items.
Figure 12 shows control device 70 and obtains in the information search pattern and show that the input that comes from the user among Figure 11 is as＜mackerel〉or＜2 mackerels 〉, export situation then corresponding to the details of this information.
Figure 13 and 14 shows the embodiment of information notification mode.
Figure 13 shows control device 70 and notifies the user to have the project of being stored for a long time via display unit 30 by using avatar (having unusual big nose).
Figure 14 shows control device 70 by the display unit 30 detailed information that show about the project of being stored for a long time.
Revise and the situations such as outside transmission of information as the approaches to IM of describing in detail the of the present invention information that can also be applied to, and the storage of information, search and deletion.
Industrial usability
Such as description up to the present, the present invention allow user's store and management stored items title and Out of Memory, rather than directly with this input information to keyboard etc., help thus information management.
In the present invention, the user can pass through speech input information, identifies input by avatar Information distinguish the result, and check corresponding to the recognition result of the execution result of input message, make thus Get and to control and information management by voice.
In addition, the present invention can prenotice the user about storage by avatar or by voice The information of project helps to carry out management to the situation of stored items by the user thus.
Claims (12)
1. the method for operating of an interactive refrigerator system comprises:
Demonstration is about corresponding to the information by the stored items of the voice of user input;
Generate and export response message about the described information of described stored items;
Whether the storage life of checking described stored items expires; And
Output is about the information that expires of the storage life of described stored items or about the information that expires of the anticipation of storage life of described stored items.
2. method according to claim 1 also comprises:
If the described voice by described user's input are freezing/refrigeration operation control commands, then control the freezing accordingly/refrigeration operation of refrigerator, and pass through the operating result of the described control of speech response.
3. method according to claim 1, wherein, by considering by described user at Expiration Date of the described storage life of described stored items and the default time limit, about the Expiration Date of the anticipation of described storage life of information calculations that expires of the described anticipation of storage life of described stored items.
4. method according to claim 1, wherein about the described information of described stored items comprise in title, quantity, storage life and the term of validity of stored items at least one or more a plurality of.
5. method according to claim 1 also comprises:
If sense the approaching of user, then will be about the information translation of food for default voice signal and export the information of described conversion with overdue term of validity.
6. method according to claim 1 also comprises:
Distinguish voice signal,, then analyze the described information relevant, the shape that generation and demonstration prestore or the avatar of posture with the feature that meets analysis result with food if the described voice signal of distinguishing is the information relevant with food.
7. method according to claim 1 also comprises:
To convert to wireless or the wire communication signal from the described voice signal of refrigerator output, and send the signal of described conversion to user; Perhaps
Receive the control command relevant that comes from described user by wireless or wire communication signal, and the described control command that receives is input to refrigerator with refrigerator.
8. the method for operating of an interactive refrigerator system comprises:
By voice signal input information, and show about information corresponding to the stored items of the voice signal of described input about the food stored;
From described information, extract the term of validity, and check whether the term of validity of described extraction expires about described stored items; And
Whether generate and show food information list window, so that show the corresponding information relevant with food based on the described term of validity if expiring.
9. method according to claim 8 also comprises:
If sense the approaching of user, then will become default voice signal and export the information of described conversion about the information translation of food with overdue term of validity.
10. method according to claim 8, wherein said food information list window comprise in described title, quantity, storage life and the term of validity of described stored items at least one or more a plurality of.
11. method according to claim 8 also comprises:
Distinguish described voice signal,, then analyze the described information relevant, the shape that generation and demonstration prestore or the avatar of posture with the feature that meets described analysis result with food if the described voice signal of distinguishing is the described information relevant with food.
12. method according to claim 8 also comprises:
To convert to wireless or the wire communication signal from the described voice signal of described refrigerator output, and send the signal of described conversion to user; Perhaps
Receive the control command relevant that comes from described user by wireless or wire communication signal, and the described control command that receives is input to described refrigerator with refrigerator.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020060068142A KR100764281B1 (en) | 2006-07-20 | 2006-07-20 | Information managing apparatus for refrigerator |
| KR1020060068142 | 2006-07-20 | ||
| KR1020060094513 | 2006-09-28 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101506603A true CN101506603A (en) | 2009-08-12 |
Family
ID=39419371
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA200780031797XA Pending CN101506603A (en) | 2006-07-20 | 2007-07-20 | Operation method of interactive refrigerator system |
Country Status (2)
| Country | Link |
|---|---|
| KR (1) | KR100764281B1 (en) |
| CN (1) | CN101506603A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102927784A (en) * | 2012-11-28 | 2013-02-13 | 合肥美的荣事达电冰箱有限公司 | Refrigerator and refreshing control method of food in same |
| CN102954664A (en) * | 2011-08-22 | 2013-03-06 | 创利通有限公司 | Method and system for managing and controlling medical articles stored in medical refrigerator or freezer |
| CN103423959A (en) * | 2012-05-03 | 2013-12-04 | 合肥美菱股份有限公司 | Method for managing refrigerator through voice |
| CN103542687A (en) * | 2013-09-29 | 2014-01-29 | 澳柯玛股份有限公司 | Intelligent control system for refrigerator and operating method thereof |
| CN103822431A (en) * | 2014-02-25 | 2014-05-28 | 四川长虹电器股份有限公司 | Refrigerator |
| CN105654270A (en) * | 2014-11-18 | 2016-06-08 | 博西华家用电器有限公司 | Refrigerator, terminal, and management system and management method for food materials in refrigerator |
| CN106054619A (en) * | 2015-04-16 | 2016-10-26 | 松下知识产权经营株式会社 | Information notifying method and voice output device |
| CN106338181A (en) * | 2016-11-10 | 2017-01-18 | 四川长虹电器股份有限公司 | Voice Reminding System Applied in Refrigerator and Voice Reminding Methods |
| CN106710601A (en) * | 2016-11-23 | 2017-05-24 | 合肥华凌股份有限公司 | Voice signal de-noising and pickup processing method and apparatus, and refrigerator |
| CN106796671A (en) * | 2014-12-01 | 2017-05-31 | 夏普株式会社 | Food management system, refrigerator, server, terminal installation and control program |
| CN106949700A (en) * | 2013-06-25 | 2017-07-14 | 东芝生活电器株式会社 | Refrigerator |
| CN110671875A (en) * | 2019-09-09 | 2020-01-10 | 珠海格力电器股份有限公司 | Control method for use conflict behavior of refrigerator compartment |
| CN111696541A (en) * | 2019-03-13 | 2020-09-22 | 青岛海尔电冰箱有限公司 | Voice data interaction method and system for adding food materials into refrigerator |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101262081B1 (en) | 2012-01-05 | 2013-05-08 | 해태제과식품주식회사 | Show-case for commercial displaying |
| KR102109405B1 (en) * | 2013-04-25 | 2020-05-12 | 엘지전자 주식회사 | Refrigerator |
| KR102470037B1 (en) * | 2015-09-01 | 2022-11-23 | 삼성전자주식회사 | Refrigerator |
| WO2017039219A1 (en) * | 2015-09-03 | 2017-03-09 | 삼성전자주식회사 | Refrigerator |
| KR102223627B1 (en) | 2015-09-03 | 2021-03-05 | 삼성전자주식회사 | Refrigerator |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR0159625B1 (en) * | 1995-12-26 | 1999-01-15 | 김광호 | Designation part control device of a refrigerator |
| JP2002081849A (en) * | 2000-09-08 | 2002-03-22 | Matsushita Refrig Co Ltd | Food information outgoing device and storage chamber equipped therewith |
| JP2003202180A (en) * | 2002-01-04 | 2003-07-18 | Venus Japan:Kk | Refrigerator with pc loaded with pet type animation image management software |
| US20040117274A1 (en) * | 2001-02-23 | 2004-06-17 | Claudio Cenedese | Kitchen and/or domestic appliance |
-
2006
- 2006-07-20 KR KR1020060068142A patent/KR100764281B1/en active IP Right Grant
-
2007
- 2007-07-20 CN CNA200780031797XA patent/CN101506603A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR0159625B1 (en) * | 1995-12-26 | 1999-01-15 | 김광호 | Designation part control device of a refrigerator |
| JP2002081849A (en) * | 2000-09-08 | 2002-03-22 | Matsushita Refrig Co Ltd | Food information outgoing device and storage chamber equipped therewith |
| US20040117274A1 (en) * | 2001-02-23 | 2004-06-17 | Claudio Cenedese | Kitchen and/or domestic appliance |
| JP2003202180A (en) * | 2002-01-04 | 2003-07-18 | Venus Japan:Kk | Refrigerator with pc loaded with pet type animation image management software |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102954664B (en) * | 2011-08-22 | 2017-03-01 | 创利通有限公司 | Method and system for managing and controlling medical articles stored in medical refrigerator or freezer |
| CN102954664A (en) * | 2011-08-22 | 2013-03-06 | 创利通有限公司 | Method and system for managing and controlling medical articles stored in medical refrigerator or freezer |
| CN103423959A (en) * | 2012-05-03 | 2013-12-04 | 合肥美菱股份有限公司 | Method for managing refrigerator through voice |
| CN102927784A (en) * | 2012-11-28 | 2013-02-13 | 合肥美的荣事达电冰箱有限公司 | Refrigerator and refreshing control method of food in same |
| CN107192207A (en) * | 2013-06-25 | 2017-09-22 | 东芝生活电器株式会社 | Refrigerator |
| CN106949700A (en) * | 2013-06-25 | 2017-07-14 | 东芝生活电器株式会社 | Refrigerator |
| CN103542687B (en) * | 2013-09-29 | 2015-09-30 | 澳柯玛股份有限公司 | A kind of intelligence control system for refrigerator and operation method thereof |
| CN103542687A (en) * | 2013-09-29 | 2014-01-29 | 澳柯玛股份有限公司 | Intelligent control system for refrigerator and operating method thereof |
| CN103822431A (en) * | 2014-02-25 | 2014-05-28 | 四川长虹电器股份有限公司 | Refrigerator |
| CN103822431B (en) * | 2014-02-25 | 2016-02-10 | 四川长虹电器股份有限公司 | A kind of refrigerator |
| CN105654270A (en) * | 2014-11-18 | 2016-06-08 | 博西华家用电器有限公司 | Refrigerator, terminal, and management system and management method for food materials in refrigerator |
| CN106796671A (en) * | 2014-12-01 | 2017-05-31 | 夏普株式会社 | Food management system, refrigerator, server, terminal installation and control program |
| CN106796671B (en) * | 2014-12-01 | 2021-01-12 | 夏普株式会社 | Food management system, refrigerator, server, and recording medium |
| CN106054619A (en) * | 2015-04-16 | 2016-10-26 | 松下知识产权经营株式会社 | Information notifying method and voice output device |
| CN106054619B (en) * | 2015-04-16 | 2021-09-24 | 松下知识产权经营株式会社 | Information notification method and audio output device |
| CN106338181A (en) * | 2016-11-10 | 2017-01-18 | 四川长虹电器股份有限公司 | Voice Reminding System Applied in Refrigerator and Voice Reminding Methods |
| CN106710601A (en) * | 2016-11-23 | 2017-05-24 | 合肥华凌股份有限公司 | Voice signal de-noising and pickup processing method and apparatus, and refrigerator |
| CN106710601B (en) * | 2016-11-23 | 2020-10-13 | 合肥美的智能科技有限公司 | Noise-reduction and pickup processing method and device for voice signals and refrigerator |
| CN111696541A (en) * | 2019-03-13 | 2020-09-22 | 青岛海尔电冰箱有限公司 | Voice data interaction method and system for adding food materials into refrigerator |
| CN110671875A (en) * | 2019-09-09 | 2020-01-10 | 珠海格力电器股份有限公司 | Control method for use conflict behavior of refrigerator compartment |
| CN110671875B (en) * | 2019-09-09 | 2020-11-17 | 珠海格力电器股份有限公司 | Control method for use conflict behavior of refrigerator compartment |
Also Published As
| Publication number | Publication date |
|---|---|
| KR100764281B1 (en) | 2007-10-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101506603A (en) | Operation method of interactive refrigerator system | |
| AU2007275991B2 (en) | Operation method of interactive refrigerator system | |
| US8744413B2 (en) | Mobile terminal and method for displaying standby screen according to analysis result of user's behavior | |
| JP6153656B2 (en) | Smart home appliance control method, control device, and terminal | |
| US7590415B2 (en) | Adaptive communication data retrieval system | |
| US20120316876A1 (en) | Display Device, Method for Thereof and Voice Recognition System | |
| US20010054291A1 (en) | System and method for controlling communication-executable refrigerator | |
| US20050188412A1 (en) | System and method for providing content list in response to selected content provider-defined word | |
| CN1938757A (en) | Method for driving multiple applications by common dialog management system | |
| KR101912409B1 (en) | Mobile terminal and mothod for controling of the same | |
| JP2016076799A (en) | Consumer electronics administrative system, consumer electronics, remote-control device, and robot | |
| KR101483191B1 (en) | Apparatus and method for providing conversation service and, server | |
| JP2016522609A5 (en) | ||
| CN113132787A (en) | Live content display method and device, electronic equipment and storage medium | |
| WO2020105302A1 (en) | Response generation device, response generation method, and response generation program | |
| JP2000231398A (en) | Device provided with voice and manual user interface and method for supporting voice command learning of this device | |
| US20020046068A1 (en) | Use guide system for amusement park facilities and method of the same | |
| KR20150011879A (en) | Method and apparatus for registering schedule on mobile terminal | |
| US20040254649A1 (en) | System and method for application communication | |
| CN106251858A (en) | Clock alarming method based on Intelligent television terminal and device | |
| KR20030007973A (en) | Reminder system using a service station | |
| JP5348284B2 (en) | Portable terminal device and program | |
| CN112002321B (en) | Display device, server and voice interaction method | |
| KR100525729B1 (en) | Apparatus for home automation | |
| WO2006104345A1 (en) | Morning call service by mobile robot |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20090812 |