CN108826824B

CN108826824B - Refrigerator control method and device, storage medium and refrigerator

Info

Publication number: CN108826824B
Application number: CN201810867080.9A
Authority: CN
Inventors: 艾思芹; 李海媚; 吴伟
Original assignee: Gree Electric Appliances Inc of Zhuhai
Current assignee: Gree Electric Appliances Inc of Zhuhai
Priority date: 2018-08-01
Filing date: 2018-08-01
Publication date: 2020-09-15
Anticipated expiration: 2038-08-01
Also published as: CN108826824A

Abstract

The invention discloses a control method and device of a refrigerator, a storage medium and the refrigerator, wherein the method comprises the following steps: acquiring a voice instruction of a user in a space where the refrigerator is located; identifying the user identity and the instruction content corresponding to the voice instruction; and executing the instruction content corresponding to the user identity to realize the control of the refrigerator. According to the scheme provided by the invention, the problem of low intelligent degree of the refrigerator in the prior art can be solved, and the effect of improving the intelligent degree is achieved.

Description

Refrigerator control method and device, storage medium and refrigerator

Technical Field

The invention belongs to the technical field of refrigerators, and particularly relates to a refrigerator control method, a device, a storage medium and a refrigerator, in particular to a method for controlling a refrigerator by voice, a device corresponding to the method, a refrigerator with the device, a computer-readable storage medium storing instructions corresponding to the method, and a refrigerator capable of executing the instructions corresponding to the method.

Background

At present, the intelligent refrigerator on the market is mainly through embedded voice broadcast system, carries out intelligent operation to the refrigerator through visual operating area above the manual trigger refrigerator, still can not realize real artificial intelligence.

Disclosure of Invention

The invention aims to provide a control method and device of a refrigerator, a storage medium and the refrigerator, aiming at the defects, so as to solve the problem of low intelligent degree of the refrigerator in the prior art and achieve the effect of improving the intelligent degree.

The invention provides a control method of a refrigerator, which comprises the following steps: acquiring a voice instruction of a user in a space where the refrigerator is located; identifying the user identity and the instruction content corresponding to the voice instruction; and executing the instruction content corresponding to the user identity to realize the control of the refrigerator.

Optionally, the identifying the user identity and the instruction content corresponding to the voice instruction includes: performing semantic recognition at least comprising keyword extraction and keyword analysis on the voice instruction, and determining instruction content corresponding to the voice instruction; and performing voiceprint recognition at least comprising voiceprint extraction and voiceprint analysis on the voice instruction, and determining the user identity corresponding to the voice instruction; and/or executing the instruction content corresponding to the user identity, wherein the instruction content comprises: determining preference information corresponding to the instruction content corresponding to the user identity according to the corresponding relation among the set user identity, the set instruction content and the set preference information; and controlling the refrigerator to execute the instruction content according to the preference information.

Optionally, wherein the instruction content includes: adjusting at least one of temperature, providing a recipe, providing a nutrition collocation scheme, delivering food materials, delivering beverages, and playing a leave word; and/or, the preference information includes: at least one of refrigerating temperature, freezing temperature, favorite food material, favorite taste, favorite food amount, favorite beverage and drinking temperature, and message information.

Optionally, executing the instruction content corresponding to the user identity, further includes: determining whether the favorite information of the user in the space of the refrigerator meets the set standard health information; if the favorite information does not accord with the standard health information, health reminding information of which the favorite information does not accord with the standard health information is initiated, and a recommendation scheme which accords with the standard health information is given; and/or acquiring the purchase date or the production date of the existing food materials in the refrigerator; determining the shelf life of the existing food materials in the refrigerator; and/or determining that the shelf life of the existing food materials in the refrigerator reaches a set early warning period; if the shelf life of the existing food materials in the refrigerator reaches the set early warning period, initiating an early warning reminding message of the shelf life of the existing food materials about to expire or the remaining service time; and/or determining that the shelf life of the existing food materials in the refrigerator reaches a set period; if the shelf life of the existing food material in the refrigerator reaches the set period, initiating an expiration reminding message that the shelf life of the existing food material is over; and/or determining whether the eating mode or drinking mode of the existing food materials in the refrigerator has matters needing attention; if the eating mode or drinking mode of the existing food materials in the refrigerator has matters needing attention, a use reminding message for reminding food eating attention matters or beverage drinking attention matters is initiated.

Optionally, the method further comprises: the method comprises the steps of establishing a corresponding relation among a set user identity, a set instruction content and set preference information in advance in a data calling mode; and/or generating a corresponding relation among the set user identity, the set instruction content and the set preference information in an autonomous learning mode or a neural network learning mode, or correcting the corresponding relation among the preset user identity, the set instruction content and the set preference information.

Optionally, the pre-establishing a corresponding relationship between the set user identity, the set instruction content, and the set preference information, or generating a corresponding relationship between the set user identity, the set instruction content, and the set preference information includes: determining user identities of all users in the space where the refrigerator is located, instruction contents of all users and preference information of all users; and forming a corresponding relation among the user identities, the instruction contents and the favorite information of all the users in the space where the refrigerator is located based on a big data analysis mode.

Optionally, determining preference information of all users in the space where the refrigerator is located includes: acquiring at least one of purchasing habits and using habits of all users in the space where the refrigerator is located; and after at least one of the purchasing habit and the using habit is subjected to portrait analysis based on big data, determining preference information of each user.

In accordance with the above method, another aspect of the present invention provides a control apparatus for a refrigerator, comprising: the acquisition unit is used for acquiring a voice instruction of a user in the space where the refrigerator is located; the control unit is used for identifying the user identity and the instruction content corresponding to the voice instruction; the control unit is further configured to execute the instruction content corresponding to the user identity to realize control over the refrigerator.

Optionally, the identifying, by the control unit, the user identity and the instruction content corresponding to the voice instruction includes: performing semantic recognition at least comprising keyword extraction and keyword analysis on the voice instruction, and determining instruction content corresponding to the voice instruction; and performing voiceprint recognition at least comprising voiceprint extraction and voiceprint analysis on the voice instruction, and determining the user identity corresponding to the voice instruction; and/or the control unit executes the instruction content corresponding to the user identity, and the instruction content comprises the following steps: determining preference information corresponding to the instruction content corresponding to the user identity according to the corresponding relation among the set user identity, the set instruction content and the set preference information; and controlling the refrigerator to execute the instruction content according to the preference information.

Optionally, the controlling unit executes the instruction content corresponding to the user identity, and further includes: determining whether the favorite information of the user in the space of the refrigerator meets the set standard health information; if the favorite information does not accord with the standard health information, health reminding information of which the favorite information does not accord with the standard health information is initiated, and a recommendation scheme which accords with the standard health information is given; and/or acquiring the purchase date or the production date of the existing food materials in the refrigerator; determining the shelf life of the existing food materials in the refrigerator; and/or determining that the shelf life of the existing food materials in the refrigerator reaches a set early warning period; if the shelf life of the existing food materials in the refrigerator reaches the set early warning period, initiating an early warning reminding message of the shelf life of the existing food materials about to expire or the remaining service time; and/or determining that the shelf life of the existing food materials in the refrigerator reaches a set period; if the shelf life of the existing food material in the refrigerator reaches the set period, initiating an expiration reminding message that the shelf life of the existing food material is over; and/or determining whether the eating mode or drinking mode of the existing food materials in the refrigerator has matters needing attention; if the eating mode or drinking mode of the existing food materials in the refrigerator has matters needing attention, a use reminding message for reminding food eating attention matters or beverage drinking attention matters is initiated.

Optionally, the method further comprises: the control unit is also used for pre-establishing the corresponding relation among the set user identity, the set instruction content and the set preference information in a data calling mode; and/or the control unit is further configured to generate a corresponding relationship between the set user identity, the set instruction content, and the set preference information in an autonomous learning manner or a neural network learning manner, or correct a corresponding relationship between the set user identity, the set instruction content, and the set preference information that is established in advance.

Optionally, the pre-establishing, by the control unit, a correspondence between the set user identity, the set instruction content, and the set preference information, or generating a correspondence between the set user identity, the set instruction content, and the set preference information includes: determining user identities of all users in the space where the refrigerator is located, instruction contents of all users and preference information of all users; and forming a corresponding relation among the user identities, the instruction contents and the favorite information of all the users in the space where the refrigerator is located based on a big data analysis mode.

Optionally, the determining, by the control unit, preference information of all users in the space where the refrigerator is located includes: acquiring at least one of purchasing habits and using habits of all users in the space where the refrigerator is located; and after at least one of the purchasing habit and the using habit is subjected to portrait analysis based on big data, determining preference information of each user.

In accordance with the above apparatus, another aspect of the present invention provides a refrigerator, comprising: the control device of the refrigerator is described above.

In accordance with the above method, a further aspect of the present invention provides a storage medium comprising: the storage medium has stored therein a plurality of instructions; the plurality of instructions are used for loading and executing the control method of the refrigerator by the processor.

In accordance with the above method, another aspect of the present invention provides a refrigerator, comprising: a processor for executing a plurality of instructions; a memory to store a plurality of instructions; wherein the plurality of instructions are stored by the memory, and loaded and executed by the processor.

According to the scheme, the refrigerator is controlled through voice, the aim of realizing personal multithreading work based on liberation of two hands is achieved, the intelligent degree of the refrigerator is improved, and the refrigerator is more convenient to use and better in humanization for users.

Furthermore, according to the scheme of the invention, the private food matching set and the menu with reasonable nutrition are recommended according to the usual purchasing habits of the user, so that the human health is facilitated, the intelligent degree is better, and the humanization is better.

Furthermore, according to the scheme of the invention, the shelf life of the food is counted to be long according to the date of the user purchasing the food and the production date carried by the food, and the user is prompted when the shelf life of the food is about to expire, so that unnecessary waste is reduced, the humanization is good, and the energy conservation is facilitated.

Furthermore, according to the scheme of the invention, by detecting the daily eating habits of the user, if unhealthy eating habits exist, prompt is timely given, so that the human health is facilitated, and the user experience is good.

Furthermore, according to the scheme of the invention, the refrigerator can be more intelligent and the use by a user is more convenient and quicker by providing a most convenient resource-free mode of combining the technologies such as a voice interaction technology, cloud computing, food identification, automatic input problem, voice identification, deep learning and the like.

Therefore, according to the scheme provided by the invention, the refrigerator is controlled by voice, so that the problem of low intelligent degree of the refrigerator in the prior art is solved, the defects of low intelligent degree, poor use convenience and poor user experience in the prior art are overcome, and the beneficial effects of high intelligent degree, good use convenience and good user experience are realized.

Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.

Drawings

Fig. 1 is a schematic flowchart of a control method of a refrigerator according to an embodiment of the present invention;

FIG. 2 is a schematic flow chart illustrating an embodiment of identifying a user identity and instruction content corresponding to the voice instruction in the method of the present invention;

FIG. 3 is a flow chart illustrating an embodiment of executing the command content corresponding to the user identity in the method of the present invention;

FIG. 4 is a flowchart illustrating an embodiment of a method for performing a health alert on a user according to the present invention;

FIG. 5 is a schematic flow chart illustrating an embodiment of determining shelf life in the method of the present invention;

FIG. 6 is a flow chart illustrating an embodiment of shelf life reminding in the method of the present invention;

FIG. 7 is a flowchart illustrating an embodiment of an expiration reminder in the method of the present invention;

FIG. 8 is a flow diagram illustrating one embodiment of an attention reminder in the method of the present invention;

FIG. 9 is a flowchart illustrating an embodiment of forming a correspondence between user identities, command content, and preference information according to the method of the present invention;

FIG. 10 is a flowchart illustrating an embodiment of determining preference information according to the method of the present invention;

fig. 11 is a schematic structural diagram of an embodiment of a control device of a refrigerator according to the present invention;

fig. 12 is a schematic diagram of a voice-controlled refrigerator according to an embodiment of the present invention.

The reference numbers in the embodiments of the present invention are as follows, in combination with the accompanying drawings:

102-an obtaining unit; 104-control unit.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the specific embodiments of the present invention and the accompanying drawings. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

According to an embodiment of the present invention, a method for controlling a refrigerator is provided, as shown in fig. 1, which is a schematic flow chart of an embodiment of the method of the present invention. The control method of the refrigerator may include: step S110 to step S130.

At step S110, a voice instruction of a user in a space where the refrigerator is located is acquired. For example: the voice command is acquired through a voice receiver, a microphone, etc. installed at the outer wall of the refrigerator door.

At step S120, the user identity and the instruction content corresponding to the voice instruction are identified.

Optionally, with reference to a flowchart of an embodiment of the method of the present invention shown in fig. 2, which identifies the user identity and the instruction content corresponding to the voice instruction, further describing a specific process of identifying the user identity and the instruction content corresponding to the voice instruction in step S120, the method may include: step S210 to step S220.

Step S210, performing semantic recognition, which may at least include keyword extraction and keyword analysis, on the voice instruction, and determining instruction content corresponding to the voice instruction. And the number of the first and second groups,

step S220, performing voiceprint recognition, which may at least include voiceprint extraction and voiceprint analysis, on the voice instruction, and determining a user identity corresponding to the voice instruction.

For example: and voice recognition and voiceprint recognition are realized by utilizing a voice interaction technology, and the private customized function of the current user is matched.

Therefore, the instruction content is determined by semantic recognition based on the voice instruction of the user, and the user identity is determined by voiceprint recognition, so that the determination mode of the instruction content and the user identity is simple and reliable, and the accuracy and the reliability of executing the instruction content based on the user identity are improved.

In step S130, the instruction content corresponding to the user identity is executed to implement control over the refrigerator, in particular to implement personalized voice control over the refrigerator by different users in the space where the refrigerator is located. For example: and voice recognition and voiceprint recognition are realized by utilizing a voice interaction technology, and the private customized function of the current user is matched.

For example: the most convenient and resource-consuming mode of combined use among technologies such as a voice interaction technology, cloud computing, food recognition, automatic input problem, voice recognition and deep learning is provided, so that the refrigerator is more intelligent, a user can use the refrigerator more conveniently and quickly, and a first pass is good for health and life.

For example: the intelligent voice refrigerator realizes the control of the refrigerator by sending voice instructions. For example: after the user sends out the instruction, the system firstly carries out voice recognition on the instruction, carries out user data analysis and finally transmits related information to the user.

Therefore, after the user identity and the instruction content of the current user are identified by acquiring the voice instructions of different users in the space where the refrigerator is located, the instruction content corresponding to the user identity is executed, the personalized voice control of the different users in the space where the refrigerator is located on the refrigerator is realized, the intelligent degree of the refrigerator is greatly improved, and the convenience degree and the comfort experience of the user are also improved.

Optionally, a specific process of executing the instruction content corresponding to the user identity in step S130 may be further described with reference to a flowchart of an embodiment of the method of the present invention shown in fig. 3, where the flowchart is used to execute the instruction content corresponding to the user identity, and the specific process may include: step S310 to step S320.

Step S310, determining preference information corresponding to the instruction content corresponding to the user identity according to the corresponding relationship among the set user identity, the set instruction content and the set preference information.

The preference information may include: at least one of refrigerating temperature, freezing temperature, favorite food material, favorite taste, favorite food amount, favorite beverage and drinking temperature, and message information.

Therefore, various personalized requirements of the user can be met through the favorite information in various forms, and the user experience is good.

Step S320, controlling the refrigerator to execute the instruction content according to the preference information.

Therefore, the preference information of the user corresponding to the user identity and the instruction content is determined according to the corresponding relation among the set user identity, the set instruction content and the set preference information, and the instruction content is executed according to the preference information, so that the use requirement and the use experience of the user can be better met, and the intelligent degree is higher.

The instruction content may include: adjusting temperature, providing a recipe, providing a nutrition collocation scheme, delivering food materials, delivering beverages, and playing a lingering word.

For example: the temperature in the refrigerator is adjusted through the voice of the refrigerator.

For example: the refrigerator has the active learning ability, and recommends a set of food and a menu with reasonable nutrition according to the usual purchasing habit of a user.

For example: and leaving a message in the refrigerator through voice.

Therefore, various operation requirements of a user can be met through various instruction contents, and convenience and flexibility of use of the user are greatly improved.

Further optionally, the executing of the instruction content corresponding to the user identity in step S130 may further include at least one of the following control situations.

The first control scenario: and (5) carrying out a health reminding process on the user.

The following further describes a specific process of performing health alert on a user with reference to a flowchart of an embodiment of a process of performing health alert on a user in the method of the present invention shown in fig. 4, which may include: step S410 to step S420.

Step S410, determining whether the favorite information of the user in the space of the refrigerator meets the set standard health information.

Step S420, if the favorite information does not conform to the standard health information, initiating health reminding information that the favorite information does not conform to the standard health information, and providing a recommendation scheme that conforms to the standard health information.

For example: daily eating habits of the user are detected, and if unhealthy eating habits exist, the user can be reminded in time. For example: and data collection is carried out according to the daily purchasing habits of the user, and friendly prompt is carried out on unreasonable habits.

For example: and analyzing whether the eating habits of the user are healthy or not according to the usual habits of the user, if the hidden health hazards are found, reminding the user in time, and providing more nutritional diet collocation.

Therefore, whether the use habit of the user accords with the set standard health information or not is judged according to the user preference information, and the corresponding health reminding information is launched and the corresponding recommendation scheme is given under the condition that the use habit of the user does not accord with the standard health information, so that the use of the user is facilitated, the physical health of the user can be considered, and the humanization is better.

The second control scenario: the process of determining shelf life.

Referring to fig. 5, a flow chart of an embodiment of determining shelf life in the method of the present invention is shown, and a specific process of determining shelf life is further defined, which may include: step S510 to step S520.

In step S510, a purchase date or a production date of the existing food material in the refrigerator is obtained (for example, by manually inputting or scanning the two-dimensional code).

For example: the date of food production is recorded manually or a two-dimensional code on the food is scanned.

Step S520, determining the shelf life of the existing food materials in the refrigerator.

Therefore, the quality guarantee period of the food material is determined based on the information such as the purchase date and the production date of the food material, so that the safe use condition of the food material can be grasped, the use safety and the health condition of a user can be improved, and the food material can be prevented from being wasted.

The third control scenario: and (4) reminding the shelf life.

Referring to fig. 6, a flow chart of an embodiment of the shelf-life reminder in the method of the present invention is shown, and a specific process of the shelf-life reminder will be further described, which may include: step S610 to step S620.

Step S610, determining that the shelf life of the existing food materials in the refrigerator reaches a set early warning period.

Step S620, if the shelf life of the existing food material in the refrigerator reaches the set early warning period, initiating an early warning reminding message indicating that the shelf life of the existing food material is about to expire or the remaining usage time.

For example: the refrigerator has the function of early warning, the shelf life of the food is counted for a long time according to the date of the user purchasing the food and the production date carried by the food, the user is prompted when the shelf life of the food is about to expire, and unnecessary waste is reduced.

Therefore, by setting the early warning period before the food materials reach the quality guarantee period and reminding when the quality guarantee period of the food materials reaches the early warning period, a user can know that the service life of the corresponding food materials is about to reach the quality guarantee period and use the food materials as soon as possible, so that the user can be reminded of using the food materials in the quality guarantee period to be beneficial to the health of the user, and the user can be reminded of using the corresponding food materials in time to avoid waste of the food materials due to the fact that the food materials cannot be used after the quality guarantee period.

The fourth control scenario: and (5) a process of overdue reminding.

The following further describes a specific process of the overdue reminder with reference to a flowchart of an embodiment of the overdue reminder in the method of the present invention shown in fig. 7, where the process may include: step S710 to step S720.

Step S710, determining that the shelf life of the existing food materials in the refrigerator reaches a set period.

Step S720, if the shelf life of the existing food material in the refrigerator reaches the set time limit, initiating an expiration reminding message that the shelf life of the existing food material is over.

For example: storing the food production date in a refrigerator background database, and sending a food expiration reminder as soon as the expiration date passes.

Therefore, the user is reminded when the food materials are determined to have passed the quality guarantee period, so that the user is reminded of the fact that the corresponding food materials are unusable after the quality guarantee period, the user is prevented from mistaking the user and losing health, and the user is reminded of the corresponding food materials after the quality guarantee period, so that the user is reminded of processing the food materials in time, and the situation that the food materials are spoiled and tainted with taste to influence other food materials in the refrigerator and even damage the refrigerator is avoided.

Fifth control scenario: and (4) a notice reminding process.

The following further describes a specific process of the notice alert with reference to a flowchart of an embodiment of the notice alert in the method of the present invention shown in fig. 8, which may include: step S810 to step S820.

Step S810, determining whether there is a need to pay attention to the eating mode or drinking mode of the existing food material in the refrigerator.

Step S820, if there is a notice that needs to be taken in the eating manner or drinking manner of the existing food material in the refrigerator, initiating a use reminding message for reminding food eating notice or beverage drinking notice.

The reminding mode can be voice broadcast reminding or popup window reminding sent in a visible area of the refrigerator.

Therefore, the reminding is initiated when the using mode of the corresponding food material is determined to have the items needing attention, so that the user can use the food material conveniently according to the items needing attention, the using value of the food material is favorably exerted on one hand, and the user can be reminded of the occurrence of the situations of health damage and the like caused by misuse.

In an alternative embodiment, the method may further include: at least one of the following forms a situation of setting the corresponding relationship among the user identity, the instruction content and the preference information.

The first case: before the user identity and the instruction content corresponding to the voice instruction are identified, the corresponding relation among the set user identity, the set instruction content and the set preference information is established in advance in a data calling mode (such as data obtained by research) and is stored in a database of the refrigerator.

The second case: after the user identity and the instruction content corresponding to the voice instruction are recognized, the corresponding relation among the set user identity, the set instruction content and the set preference information is generated in an autonomous learning mode or a neural network learning mode, or the corresponding relation among the set user identity, the set instruction content and the set preference information which are established in advance is corrected and stored in a database of the refrigerator.

For example: through deep learning, a machine learning model and massive training data are constructed, so that new useful characteristics are learned, and the accuracy of classification and prediction is improved at one time.

For example: the deep learning is mainly used for collecting food frequently purchased by a user, the quantity of the food purchased at one time, frequent matching and the like, connecting a cloud recipe and recommending the matching which is most suitable for the preference of the previous user.

Therefore, by pre-establishing the corresponding relation among the set user identity, the set instruction content and the set preference information, the preference information can be conveniently determined according to the user identity and the instruction content; by establishing the corresponding relation among the set user identity, the set instruction content and the set preference information afterwards, the accuracy and the reliability of determining the preference information according to the user identity and the instruction content can be improved.

Alternatively, the pre-establishing a corresponding relationship between the set user identity, the set instruction content, and the set preference information, or generating a corresponding relationship between the set user identity, the set instruction content, and the set preference information may include the following steps:

the following further describes a specific process of forming the corresponding relationship among the user identity, the instruction content, and the preference information with reference to a flowchart of an embodiment of forming the corresponding relationship among the user identity, the instruction content, and the preference information in the method of the present invention shown in fig. 9, which may include: step S910 and step S920.

Step S910, determining the user identities of all users in the space where the refrigerator is located, the instruction contents of all users, and the preference information of all users.

In combination with the flow chart of fig. 10, which shows an embodiment of determining the preference information in the method of the present invention, a specific process of further determining the preference information (i.e. determining the preference information of all users in the space where the refrigerator is located in step S910) may include: step S1010 and step S1020.

Step S1010, at least one of purchasing habits and using habits of all users in the space where the refrigerator is located is obtained. For example: the food materials put into the refrigerator by the user can be obtained through the camera arranged in the refrigerator, and purchasing habits are obtained. The food material taken by the user from the existing food material in the refrigerator can be obtained through the camera arranged in the refrigerator, so that the use habit is obtained.

For example: and the food information is acquired and analyzed by cooperatively using an image recognition technology and an intelligent label technology. For example: a built-in camera is required to be arranged in the refrigerator and is used for scanning food and carrying out image recognition operation on the food; and after the scanning is finished, the generated picture is automatically input into a background database.

Step S1020, after performing portrait analysis based on big data on at least one of the purchasing habit and the using habit, determining favorite information of each user, and recording a user identity and instruction content of the user corresponding to the favorite information.

For example: and collecting and analyzing the purchasing habits of the user by utilizing deep learning, then carrying out portrait analysis, and finally, actively giving out a nutrition collocation scheme according with the preference of the user.

Therefore, by acquiring information such as purchasing habits and using habits of all users in the space where the refrigerator is located, performing portrait analysis of big data based on the information, determining favorite information of each user, the determination method is simple and convenient, and the determination result is reliable.

Step S920, based on the big data analysis, forming a corresponding relationship between the user identities, the instruction contents, and the preference information of all users in the space where the refrigerator is located.

Therefore, the corresponding relation among the user identities, the instruction contents and the preference information of all the users in the space where the refrigerator is located is obtained by determining the user identities, the instruction contents and the preference information of all the users in the space where the refrigerator is located and carrying out big data analysis on the information, so that the intelligent control of all the users in the space where the refrigerator is located on the refrigerator is convenient to achieve, and the control reliability is high and the control accuracy is good.

Through a large number of tests, the technical scheme of the embodiment is adopted, the refrigerator is controlled through voice to achieve the aim of personal multithreading work based on liberation of two hands, the intelligent degree of the refrigerator is improved, and the refrigerator is more convenient to use and better in humanization.

According to an embodiment of the present invention, there is also provided a control apparatus of a refrigerator corresponding to the control method of the refrigerator. Referring to fig. 11, a schematic diagram of an embodiment of the apparatus of the present invention is shown. The control apparatus of the refrigerator may include: an acquisition unit 102 and a control unit 104.

In an optional example, the obtaining unit 102 may be configured to obtain a voice instruction of a user in a space where the refrigerator is located. For example: the voice command is acquired through a voice receiver, a microphone, etc. installed at the outer wall of the refrigerator door. The specific functions and processes of the acquiring unit 102 are referred to in step S110.

In an alternative example, the control unit 104 may be configured to recognize the user identity and the instruction content corresponding to the voice instruction. The specific function and processing of the control unit 104 are referred to in step S120.

Optionally, the recognizing, by the control unit 104, the user identity and the instruction content corresponding to the voice instruction may include:

the control unit 104 may be further configured to perform semantic recognition, which may include at least keyword extraction and keyword analysis, on the voice instruction, and determine instruction content corresponding to the voice instruction. The specific functions and processes of the control unit 104 are also referred to in step S210. And the number of the first and second groups,

the control unit 104 may be further configured to perform voiceprint recognition, which may include at least voiceprint extraction and voiceprint analysis, on the voice instruction, and determine a user identity corresponding to the voice instruction. The specific functions and processes of the control unit 104 are also referred to in step S220.

In an optional example, the control unit 104 may be further configured to execute the instruction content corresponding to the user identity to implement control over the refrigerator, and in particular implement personalized voice control over the refrigerator by different users in a space where the refrigerator is located. For example: and voice recognition and voiceprint recognition are realized by utilizing a voice interaction technology, and the private customized function of the current user is matched. The specific function and processing of the control unit 104 are also referred to in step S130.

Optionally, the executing, by the control unit 104, the instruction content corresponding to the user identity may include:

the control unit 104 may be further configured to determine preference information corresponding to the instruction content corresponding to the user identity according to a corresponding relationship among a set user identity, a set instruction content, and set preference information. The specific functions and processes of the control unit 104 are also referred to in step S310.

The control unit 104 may be further configured to control the refrigerator to execute the instruction content according to the preference information. The specific functions and processes of the control unit 104 are also referred to in step S320.

For example: and leaving a message in the refrigerator through voice.

Further optionally, the control unit 104 executes the instruction content corresponding to the user identity, and may further include at least one of the following control situations.

The first control scenario: the process of carrying out health reminding on the user specifically comprises the following steps:

the control unit 104 may be further configured to determine whether the favorite information of the user in the space where the refrigerator is located meets the set standard health information. The specific functions and processes of the control unit 104 are also referred to in step S410.

The control unit 104 may be further configured to initiate health reminding information that the favorite information does not conform to the standard health information and provide a recommendation scheme that conforms to the standard health information if the favorite information does not conform to the standard health information. The specific function and processing of the control unit 104 are also referred to in step S420.

The second control scenario: the process of determining shelf life is as follows:

the obtaining unit 102 may be further configured to obtain a purchase date or a production date of an existing food material in the refrigerator (for example, by manually inputting or scanning a two-dimensional code). The specific functions and processes of the acquisition unit 102 are also referred to in step S510.

The control unit 104 may also be configured to determine the shelf life of the food material currently in the refrigerator. The specific functions and processes of the control unit 104 are also referred to in step S520.

The third control scenario: the quality guarantee period reminding process specifically comprises the following steps:

the control unit 104 may be further configured to determine that the shelf life of the existing food material in the refrigerator reaches a set early warning period. The specific functions and processes of the control unit 104 are also referred to in step S610.

The control unit 104 may be further configured to initiate an early warning reminding message indicating that the shelf life of the existing food material is about to expire or the remaining usage time if the shelf life of the existing food material in the refrigerator reaches the set early warning period. The specific functions and processes of the control unit 104 are also referred to in step S620.

The fourth control scenario: the process of overdue reminding specifically comprises the following steps:

the control unit 104 may be further configured to determine that the shelf life of the existing food material in the refrigerator reaches a set period. The specific functions and processes of the control unit 104 are also referred to in step S710.

The control unit 104 may be further configured to initiate an expiration reminding message that the shelf life of the existing food material in the refrigerator has expired if the shelf life of the existing food material in the refrigerator reaches the set period. The specific functions and processes of the control unit 104 are also referred to in step S720.

Fifth control scenario: the process of notice reminding specifically comprises the following steps:

the control unit 104 may also be configured to determine whether there is a need to take care about the eating manner or drinking manner of the existing food material in the refrigerator. The specific functions and processes of the control unit 104 are also referred to in step S810.

The control unit 104 may be further configured to initiate a use reminding message for reminding food consumption cautionary events or beverage drinking cautionary events if the food consumption mode or the drinking mode of the existing food material in the refrigerator has events needing to be noticed. The specific function and processing of the control unit 104 are also referred to in step S820.

The first case: the control unit 104 may be further configured to, before recognizing the user identity and the instruction content corresponding to the voice instruction, pre-establish a corresponding relationship between a set user identity, a set instruction content, and set preference information by calling data (e.g., data obtained by research), and store the corresponding relationship in the database of the refrigerator.

The second case: the control unit 104 may be further configured to generate a corresponding relationship between the set user identity, the set instruction content, and the set preference information in an autonomous learning manner or a neural network learning manner after recognizing the user identity and the instruction content corresponding to the voice instruction, or correct a corresponding relationship between the set user identity, the set instruction content, and the set preference information, and store the corrected corresponding relationship in the database of the refrigerator.

The control unit 104 may pre-establish a corresponding relationship between the set user identity, the set instruction content, and the set preference information, or generate a corresponding relationship between the set user identity, the set instruction content, and the set preference information, which may include the following ways:

the control unit 104 may be further configured to determine user identities of all users in the space where the refrigerator is located, instruction contents of all users, and preference information of all users. The specific functions and processes of the control unit 104 are also referred to in step S910.

Optionally, the determining, by the control unit, preference information of all users in the space where the refrigerator is located may include:

the obtaining unit 102 may further be configured to obtain at least one of purchasing habits and using habits of all users in the space where the refrigerator is located. For example: the food materials put into the refrigerator by the user can be obtained through the camera arranged in the refrigerator, and purchasing habits are obtained. The food material taken by the user from the existing food material in the refrigerator can be obtained through the camera arranged in the refrigerator, so that the use habit is obtained. The specific functions and processes of the control unit 104 are also referred to in step S1010.

The control unit 104 may be further configured to determine preference information of each user after performing portrait analysis based on big data on at least one of the purchasing habit and the using habit, and record a user identity and instruction content of the user corresponding to the preference information. The specific functions and processes of the control unit 104 are also referred to in step S1020.

The control unit 104 may be further configured to form a corresponding relationship between the user identities, the instruction contents, and the preference information of all the users in the space where the refrigerator is located, based on a big data analysis manner. The specific functions and processes of the control unit 104 are also referred to in step S920.

Since the processes and functions implemented by the apparatus of this embodiment substantially correspond to the embodiments, principles and examples of the method shown in fig. 1 to 10, the description of this embodiment is not detailed, and reference may be made to the related descriptions in the foregoing embodiments, which are not repeated herein.

Through a large number of tests, the technical scheme of the invention recommends a set of nutritious and reasonable private food matching and a menu according to the usual purchasing habits of a user, which is beneficial to human health, has better intelligent degree and better humanization.

According to an embodiment of the invention, a refrigerator corresponding to the control device of the refrigerator is also provided. The refrigerator may include: the control device of the refrigerator is described above.

In an optional embodiment, the scheme of the invention provides a most convenient and resource-saving mode for combined use among technologies such as a voice interaction technology, cloud computing, food recognition, automatic problem entry, voice recognition, deep learning and the like, so that the refrigerator is more intelligent, a user can use the refrigerator more conveniently and quickly, and a first relation is good for health and life.

Specifically, the scheme of the invention can adopt a scheme of controlling the refrigerator by voice. The voice control refrigerator is generated based on the goal of freeing both hands and realizing personal multithreading work, and solves the problem of remotely controlling the refrigerator in real time.

The intelligent voice refrigerator controls the refrigerator by sending a voice command, and acquires and analyzes food information by cooperatively using an image recognition technology and an intelligent label technology; voice recognition and voiceprint recognition are realized by utilizing a voice interaction technology, and the private customized function of the current user is matched; and collecting and analyzing the purchasing habits of the user by utilizing deep learning, then carrying out portrait analysis, and finally, actively giving out a nutrition collocation scheme according with the preference of the user.

In an alternative example, as shown in fig. 12, the refrigerator of the present invention has an active learning ability, and recommends a nutritionally appropriate set of personal food and a recipe according to the user's usual purchasing habits. Through deep learning, a machine learning model and massive training data are constructed, so that new useful characteristics are learned, and the accuracy of classification and prediction is improved at one time.

In an optional example, in the scheme of the invention, the refrigerator has an early warning function, the shelf life time of the food is counted according to the date of the food purchased by a user and the production date carried by the food, and the user is prompted when the shelf life of the food is about to expire, so that unnecessary waste is reduced; meanwhile, the daily eating habits of the user are detected, and if unhealthy eating habits exist, the user can be reminded in time. The food production date is manually recorded or the two-dimensional code on the food is scanned, the food production date is stored in a refrigerator background database, and a food expiration reminder is sent as soon as the expiration date passes. The reminding mode can be voice broadcast reminding or popup window reminding sent in a visible area of the refrigerator. And data collection is carried out according to the daily purchasing habits of the user, and friendly prompt is carried out on unreasonable habits.

In an alternative example, the refrigerator adjusts the temperature in the refrigerator by voice.

In an optional example, in the scheme of the invention, the refrigerator leaves a message in voice.

In an optional specific embodiment, the technical implementation of the scheme of the invention mainly depends on a voice recognition technology, an image recognition technology and an automatic image recording function, and the voice function supports voice recognition and voice broadcasting; the image recognition comprises food detection and recognition; the deep learning is mainly used for collecting food frequently purchased by a user, the quantity of the food purchased at one time, frequent matching and the like, connecting a cloud recipe and recommending the matching which is most suitable for the preference of the previous user. Meanwhile, whether the eating habits of the user are healthy or not is analyzed according to the usual habits of the user, if the health hidden danger is found, the user is reminded in time, and more nutritional diet matching is provided.

In an optional specific example, the refrigerator is more intelligent and is in charge of supervising the health of family members and has great responsibility by matching a voice recognition technology with an image recognition technology and matching a deep learning technology of big data.

In an alternative embodiment, the implementation of the solution of the present invention may comprise the following main steps:

the refrigerator is internally provided with a built-in camera which is used for scanning food and carrying out image recognition operation on the food. And after the scanning is finished, the generated picture is automatically input into a background database.

The voice interaction technology mainly comprises voice recognition, voice synthesis and voiceprint recognition. After the user sends out the instruction, the system firstly carries out voice recognition on the instruction, carries out user data analysis and finally transmits related information to the user.

Since the processes and functions implemented by the refrigerator of this embodiment substantially correspond to the embodiments, principles and examples of the device shown in fig. 11, the description of this embodiment is not given in detail, and reference may be made to the related descriptions in the foregoing embodiments, which are not repeated herein.

Through a large number of tests, the technical scheme of the invention counts the long shelf life of the food according to the date of the user purchasing the food and the production date carried by the food, and prompts the user when the shelf life of the food is about to expire, thereby reducing unnecessary waste, having good humanization and being beneficial to saving energy.

According to an embodiment of the present invention, there is also provided a storage medium corresponding to a control method of a refrigerator. The storage medium may include: the storage medium has stored therein a plurality of instructions; the plurality of instructions are used for loading and executing the control method of the refrigerator by the processor.

Since the processing and functions implemented by the storage medium of this embodiment substantially correspond to the embodiments, principles, and examples of the methods shown in fig. 1 to fig. 10, details are not described in the description of this embodiment, and reference may be made to the related descriptions in the foregoing embodiments, which are not described herein again.

Through a large number of tests, the technical scheme of the invention detects the daily eating habits of the user, and timely reminds if unhealthy eating habits exist, so that the method is beneficial to human health and has good user experience.

According to an embodiment of the invention, a refrigerator corresponding to a control method of the refrigerator is also provided. The refrigerator may include: a processor for executing a plurality of instructions; a memory to store a plurality of instructions; wherein the plurality of instructions are stored by the memory, and loaded and executed by the processor.

Since the processing and functions of the refrigerator of this embodiment are basically corresponding to the embodiments, principles and examples of the methods shown in fig. 1 to 10, the description of this embodiment is not detailed, and reference may be made to the related descriptions in the foregoing embodiments, which are not repeated herein.

Through a large number of tests, the technical scheme of the invention is adopted, and the refrigerator can be more intelligent and the use of a user is more convenient and rapid by providing the most convenient resource-free mode of combined use among the technologies such as the voice interaction technology, the cloud computing, the food identification, the automatic input problem, the voice identification, the deep learning and the like.

In summary, it is readily understood by those skilled in the art that the advantageous modes described above can be freely combined and superimposed without conflict.

The above description is only an example of the present invention, and is not intended to limit the present invention, and it is obvious to those skilled in the art that various modifications and variations can be made in the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the scope of the claims of the present invention.

Claims

1. A control method of a refrigerator, comprising:

obtaining a voice instruction of a user in a space where the refrigerator is located, the method comprises the following steps: performing semantic recognition at least comprising keyword extraction and keyword analysis on the voice instruction, and determining instruction content corresponding to the voice instruction; and performing voiceprint recognition at least comprising voiceprint extraction and voiceprint analysis on the voice instruction, and determining the user identity corresponding to the voice instruction;

identifying the user identity and the instruction content corresponding to the voice instruction;

executing the instruction content corresponding to the user identity, including: determining preference information corresponding to the instruction content corresponding to the user identity according to the corresponding relation among the set user identity, the set instruction content and the set preference information; controlling the refrigerator to execute the instruction content according to the preference information so as to realize the control of the refrigerator; through the usual purchasing habit of the user, the private food matching set meal and the menu with reasonable nutrition are recommended.

2. The method of claim 1, wherein,

the instruction content comprises: adjusting at least one of temperature, providing a recipe, providing a nutrition collocation scheme, delivering food materials, delivering beverages, and playing a leave word;

and/or the presence of a gas in the gas,

the preference information includes: at least one of refrigerating temperature, freezing temperature, favorite food material, favorite taste, favorite food amount, favorite beverage and drinking temperature, and message information.

3. The method of claim 2, wherein executing the instructional content corresponding to the user identity further comprises:

determining whether the favorite information of the user in the space of the refrigerator meets the set standard health information;

if the favorite information does not accord with the standard health information, health reminding information of which the favorite information does not accord with the standard health information is initiated, and a recommendation scheme which accords with the standard health information is given;

and/or the presence of a gas in the gas,

acquiring the purchase date or the production date of the existing food materials in the refrigerator;

determining the shelf life of the existing food materials in the refrigerator;

and/or the presence of a gas in the gas,

determining that the shelf life of the existing food materials in the refrigerator reaches a set early warning period;

if the shelf life of the existing food materials in the refrigerator reaches the set early warning period, initiating an early warning reminding message of the shelf life of the existing food materials about to expire or the remaining service time;

and/or the presence of a gas in the gas,

determining that the shelf life of the existing food materials in the refrigerator reaches a set period;

if the shelf life of the existing food material in the refrigerator reaches the set period, initiating an expiration reminding message that the shelf life of the existing food material is over;

and/or the presence of a gas in the gas,

determining whether the eating mode or drinking mode of the existing food materials in the refrigerator has items needing attention or not;

if the eating mode or drinking mode of the existing food materials in the refrigerator has matters needing attention, a use reminding message for reminding food eating attention matters or beverage drinking attention matters is initiated.

4. The method of any one of claims 1-3, further comprising:

the method comprises the steps of establishing a corresponding relation among a set user identity, a set instruction content and set preference information in advance in a data calling mode;

and/or the presence of a gas in the gas,

and generating a corresponding relation among the set user identity, the set instruction content and the set preference information in an autonomous learning mode or a neural network learning mode, or correcting the corresponding relation among the preset user identity, the set instruction content and the set preference information.

5. The method of claim 4, wherein pre-establishing a corresponding relationship between the set user identity, the set instruction content, and the set preference information, or generating a corresponding relationship between the set user identity, the set instruction content, and the set preference information comprises:

determining user identities of all users in the space where the refrigerator is located, instruction contents of all users and preference information of all users;

and forming a corresponding relation among the user identities, the instruction contents and the favorite information of all the users in the space where the refrigerator is located based on a big data analysis mode.

6. The method of claim 5, wherein determining the preference information of all users in the space where the refrigerator is located comprises:

acquiring at least one of purchasing habits and using habits of all users in the space where the refrigerator is located;

and after at least one of the purchasing habit and the using habit is subjected to portrait analysis based on big data, determining preference information of each user.

7. A control apparatus of a refrigerator, comprising:

the acquisition unit is used for acquiring the voice instruction of the user in the space where the refrigerator is located, and comprises: performing semantic recognition at least comprising keyword extraction and keyword analysis on the voice instruction, and determining instruction content corresponding to the voice instruction; and performing voiceprint recognition at least comprising voiceprint extraction and voiceprint analysis on the voice instruction, and determining the user identity corresponding to the voice instruction;

the control unit is used for identifying the user identity and the instruction content corresponding to the voice instruction;

the control unit is further configured to execute the instruction content corresponding to the user identity, and includes: determining preference information corresponding to the instruction content corresponding to the user identity according to the corresponding relation among the set user identity, the set instruction content and the set preference information; controlling the refrigerator to execute the instruction content according to the preference information so as to realize the control of the refrigerator; through the usual purchasing habit of the user, the private food matching set meal and the menu with reasonable nutrition are recommended.

8. The apparatus of claim 7, wherein,

and/or the presence of a gas in the gas,

9. The apparatus according to claim 7 or 8, wherein the control unit executes the instruction content corresponding to the user identity, further comprising:

and/or the presence of a gas in the gas,

determining the shelf life of the existing food materials in the refrigerator;

and/or the presence of a gas in the gas,

10. The apparatus of claim 7 or 8, further comprising:

the control unit is also used for pre-establishing the corresponding relation among the set user identity, the set instruction content and the set preference information in a data calling mode;

and/or the presence of a gas in the gas,

the control unit is further configured to generate a corresponding relationship between the set user identity, the set instruction content, and the set preference information in an autonomous learning manner or a neural network learning manner, or correct a corresponding relationship between the set user identity, the set instruction content, and the set preference information that is established in advance.

11. The apparatus of claim 9, further comprising:

and/or the presence of a gas in the gas,

12. The apparatus of claim 10, wherein the control unit pre-establishes a correspondence between the set user identity, the set instruction content, and the set preference information, or generates a correspondence between the set user identity, the set instruction content, and the set preference information, including:

13. The apparatus of claim 11, wherein the control unit pre-establishes a correspondence between the set user identity, the set instruction content, and the set preference information, or generates a correspondence between the set user identity, the set instruction content, and the set preference information, including:

14. The apparatus as claimed in claim 12 or 13, wherein the control unit determines the preference information of all users in the space where the refrigerator is located, including:

15. A refrigerator, characterized by comprising: the control device of the refrigerator as claimed in any one of claims 7 to 14.

16. A storage medium having a plurality of instructions stored therein; the plurality of instructions for being loaded by a processor and executing the control method of the refrigerator according to any one of claims 1 to 6.

17. A refrigerator, characterized by comprising:

a processor for executing a plurality of instructions;

a memory to store a plurality of instructions;

wherein the plurality of instructions are stored by the memory, and loaded and executed by the processor to perform the control method of the refrigerator according to any one of claims 1 to 6.