CN115265034A

CN115265034A - Intelligent refrigerator, food material management method and equipment

Info

Publication number: CN115265034A
Application number: CN202110479265.4A
Authority: CN
Inventors: 高雪松; 田羽慧; 谢飞学
Original assignee: Hisense Group Holding Co Ltd
Current assignee: Hisense Group Holding Co Ltd
Priority date: 2021-04-30
Filing date: 2021-04-30
Publication date: 2022-11-01
Anticipated expiration: 2041-04-30
Also published as: CN115265034B

Abstract

The embodiment of the application discloses an intelligent refrigerator, a food material management method and equipment, and aims to solve the problem that in the prior art, when food materials are wrapped, the information of the food materials cannot be recorded. In order to record food material information, in response to a food material storing operation, if the stored food material is identified to be wrapped, controlling an input/output unit to output identification information of the input food material; and responding to the received input information, determining the identification information of the stored food material according to the input information, and managing the food material of the identification information. In the embodiment of the application, when the stored food material is determined to be wrapped, the user is prompted to input corresponding information by outputting and inputting the identification information of the food material, and the identification information of the wrapped food material can be accurately determined according to the received input information, so that the recording of the food material information is realized, and the use experience of the user is improved.

Description

Intelligent refrigerator, food material management method and equipment

Technical Field

The application relates to the technical field of voice interaction, in particular to an intelligent refrigerator, a food material management method and food material management equipment.

Background

Along with the rise of the concept of the internet of things, products in the household appliance industry are more intelligent, and a series of intelligent refrigerators are provided. An existing intelligent refrigerator is provided with a database at the background, and the database is used for storing food material information in the intelligent refrigerator. When food materials are stored in the intelligent refrigerator, the stored food materials are generally identified by the intelligent refrigerator, so that the food material information in the database is changed; or the user manually changes the food material information in the database, so that the food materials in the intelligent refrigerator are consistent with the food material information in the database.

When depositing the edible material of parcel in the plastic bag in intelligent refrigerator, perhaps by the edible material of the object parcel of other materials, for example can be by paper parcel, can directly deposit the object of plastic bag or other materials together, if only by the edible material of depositing of intelligent refrigerator discernment, then can lead to the edible material that can't confirm to deposit because the parcel of the object of plastic bag or other materials, nevertheless by the manual change data of user also comparatively inconvenient. Therefore, in the prior art, information of the wrapped food materials stored in the smart refrigerator cannot be intelligently recorded.

Disclosure of Invention

The embodiment of the application provides an intelligent refrigerator, a food material management method, a food material management device, food material management equipment and a food material management medium, and aims to solve the problem that in the prior art, when food materials are wrapped, the food material information cannot be recorded.

In a first aspect, an embodiment of the present application provides an intelligent refrigerator, which includes:

an input-output unit configured to output information and receive input information;

a controller configured to:

responding to the food material storing operation, acquiring information of a first position where the stored food material is stored, and if the stored food material is identified to be wrapped, controlling the input-output unit to output identification information of the input food material;

and responding to the received input information, determining first identification information of the stored food material, and managing the food material of the first identification information.

In a second aspect, an embodiment of the present application provides a food material management method, where the method includes:

receiving food material storing operation, acquiring information of a first position where the stored food material is stored, and outputting identification information of input food material if the stored food material is identified to be wrapped;

receiving input information, determining first identification information of the stored food materials, and managing the food materials of the first identification information.

In a third aspect, an embodiment of the present application provides a food material management apparatus, where the apparatus includes:

the processing module is used for receiving food material storage operation, acquiring information of a first position where the stored food material is stored, and outputting identification information of the input food material if the stored food material is identified to be wrapped;

the determining module is used for receiving input information, determining first identification information of the stored food materials, and managing the food materials of the first identification information.

In a fourth aspect, an embodiment of the present application provides an electronic device, where the electronic device at least includes a processor and a memory, and the processor is configured to execute the steps of the food material management method described in any one of the foregoing methods when executing a computer program stored in the memory.

In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program, and the computer program, when executed by a processor, performs the steps of the food material management method described in any one of the above.

In order to record the food material information, in response to the food material storing operation, if the stored food material is identified to be wrapped, the input/output unit is controlled to output the identification information of the input food material; and responding to the received input information, determining the identification information of the stored food material according to the input information, and managing the food material of the identification information. In the embodiment of the application, when the stored food material is determined to be wrapped, the user is prompted to input corresponding information by outputting and inputting the identification information of the food material, and the identification information of the wrapped food material can be accurately determined according to the received input information, so that the recording of the food material information is realized, and the use experience of the user is improved.

Drawings

In order to more clearly explain the technical solutions of the present application, the drawings required for the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.

Fig. 1 is a schematic structural diagram of an intelligent refrigerator 100 according to some embodiments of the present application;

fig. 2 is a detailed schematic diagram illustrating determination of food materials stored in an intelligent refrigerator according to an embodiment of the present application;

fig. 3 is a detailed schematic diagram illustrating determination of food materials taken out of an intelligent refrigerator according to an embodiment of the present disclosure;

fig. 4 is a schematic diagram of an intelligent refrigerator provided in an embodiment of the present application;

fig. 5 is a process schematic diagram of a food material management method according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a food material management apparatus according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application are within the scope of protection of the present application.

In order to better record the food materials wrapped in the intelligent refrigerator and improve the use experience of a user, in the embodiment of the application, the intelligent refrigerator comprises an input and output unit and a controller, when the food materials are stored in the intelligent refrigerator, the controller of the intelligent refrigerator controls the input and output unit to output identification information of the input food materials if the stored food materials are identified to be wrapped, and if the input information is received, the controller manages the food materials of the identification information according to the identification information of the food materials carried in the input information.

In order to record food material information of a wrapped food material stored in an intelligent refrigerator, the embodiment of the application provides the intelligent refrigerator, a food material management method, a food material management device, equipment and a medium.

Fig. 1 is a schematic structural diagram of an intelligent refrigerator 100 according to some embodiments of the present application, where the intelligent refrigerator 100 includes:

an input-output unit 101, the input-output unit 101 configured to output information and receive input information;

a controller 102, the controller 102 configured to:

responding to the food material storing operation, acquiring information of a first position where the stored food material is stored, and controlling the input and output unit to output identification information of the input food material if the stored food material is identified to be wrapped;

in response to the received input information, determining first identification information of the stored food material, and managing the food material of the first identification information.

When the food material is stored in the intelligent refrigerator, the intelligent refrigerator recognizes the food material storing operation and acquires information of a first position where the stored food material is stored. The food material storing operation can be an operation of manual storing of a user or an operation of voice storing.

Specifically, when the information of the first position where the stored food material is stored is determined, different determination modes are provided for different food material storing operations. If the food material storing operation is the operation of manual storing of the user, the input and output unit acquires the image of the user when the food material is stored. At this time, the input/output unit may be a visual intelligence sensor through which an image is collected and the collected image is recognized. Specifically, the visual intelligent sensor comprises a recognition model which is trained in advance, after the visual intelligent sensor collects an image, the collected image is input into the recognition model, and information of a first position where the food material is stored is obtained through the recognition model. When the food materials are stored, the hand postures corresponding to different stored positions are different, so that the acquired images are different, and the recognition model can be trained according to the different images acquired when the food materials are stored in different positions by a user. Specifically, how to determine the position of the food material stored in the acquired image according to the recognition model is the prior art, and is not described herein again.

If the food material storage operation is a voice storage operation, the input and output unit collects voice information of the user when the food material is stored. Wherein the voice message may be "put a red plastic bag on the first layer". At this time, the input/output unit may be a voice intelligence sensor, the voice intelligence sensor recognizes a keyword in the received voice information through a natural language processing technology, and the intelligent refrigerator may determine information of the first location where the food material is stored according to the keyword recognized by the voice intelligence sensor. For example, if the voice message is "put a red plastic bag on the first layer", the position where the food material is stored can be determined as the first layer according to the voice message.

The intelligent refrigerator identifies food material storage operation, and identifies whether the food material is wrapped or not after information of a stored first position of the food material is acquired. And if the food material storing operation is the operation of manual storing by the user, identifying the food material by the image acquired by the visual intelligent sensor. Specifically, the image collected by the visual intelligent sensor is input into a feature extraction model trained by the visual intelligent sensor in advance, a feature vector corresponding to the input image can be determined through the feature extraction model, and the controller judges according to the received feature vector sent by the visual intelligent sensor. If the characteristics in the characteristic vector are the characteristics corresponding to the packaged food, the stored food is packaged. How to determine whether the food material in the collected image is wrapped through the feature extraction model is the prior art and is not described herein again.

If the food material storage operation is voice storage operation, the voice information received by the voice intelligent sensor is identified, and the voice intelligent sensor identifies the keywords of the received voice information through a natural voice processing technology, so that the controller judges whether the stored food material is wrapped or not according to the keywords determined by the voice intelligent sensor and a plurality of corresponding keywords when the food material is wrapped.

If the stored food material is identified to be wrapped, the controller controls the input and output unit to output the identification information of the input food material, and at this time, the input and output unit can be a voice intelligent sensor. Specifically, the output identification information for prompting the user to input the food material may be the voice information "please describe the name of the stored food material" played through the voice intelligent sensor, or the voice intelligent sensor may play "what is in the red plastic bag in the second layer, ask for what? "to the user.

In the embodiment of the application, after a user receives identification information which is output by an intelligent refrigerator and prompts the user to input food materials, the user replies input information of first identification information carried by the intelligent refrigerator with the food materials according to the prompt information, wherein when the input information carrying the first identification information of the food materials is input through voice, a voice intelligent sensor receives the input information, extracts keywords in the input information and sends the extracted keywords of the input information to a controller, and the controller determines the first identification information of the food materials carried in the input information according to the received keywords in the input information and a plurality of keywords corresponding to the identification information of the food materials, determines the stored food materials of the first identification information and manages the food materials of the first identification information.

For example, after a user places an apple wrapped by a red plastic bag on a first layer in an intelligent refrigerator, the position where the stored food materials are stored can only be obtained as the first layer through image recognition, the red plastic bag is recognized in the image, the food materials in the red plastic bag cannot be recognized, namely, the food materials stored in the intelligent refrigerator can only be recognized to be wrapped, and then the controller controls the voice intelligent sensor to play voice information of 'what the first layer is placed in the red plastic bag and the red plastic bag' to prompt the user. After the user receives the identification information prompting the user to input the food material, the stored input information of the apple is input, and after the intelligent refrigerator receives the input information, the food material of the identification information, the stored position of the food material and the plastic bag wrapping the food material are recorded according to the identification information of the food material carried in the input information, so that the input of the food material in the red plastic bag in the first layer is realized.

In order to accurately distinguish the food material information stored in the intelligent refrigerator, on the basis of the above embodiments, in the embodiment of the present application, the controller 102 is configured to:

and if the stored food material is determined to be wrapped, determining a first characteristic of the wrapping of the food material, and determining the food material number of the food material with the first identification information according to the first characteristic and whether the first position contains other food materials wrapped by the wrapping of the first characteristic.

In this application embodiment, if a plurality of parcels with the same characteristics are stored in the same layer of the intelligent refrigerator, the food materials wrapped in the parcels with the same characteristics cannot be distinguished, and therefore in order to distinguish the food materials wrapped in the parcels with the same characteristics, in this application embodiment, the wrapped food materials are distinguished in a numbering manner.

Specifically, if the stored food material is determined to be wrapped, a first characteristic of the wrapping of the food material is determined. Wherein the first characteristic may include one or more of a name of the package, color information of the package, shape information of the package, and the like. If the first feature is the name of the package and the color information of the package, the first feature may be a red plastic bag, a black plastic box, etc.

In the embodiment of the application, if the food material storing operation is an operation of manual storing by a user, a feature vector corresponding to an input image can be determined through a trained feature extraction model in a visual sensor, and the controller determines a first feature of a package wrapping the food material according to features contained in the received feature vector. If the food material storing operation is voice storing operation, keywords in the received voice information can be extracted through the voice intelligent sensor, and the controller determines a first characteristic of a package wrapping the food material according to the received keywords and a plurality of keywords corresponding to the characteristics of the package.

In the embodiment of the present application, when the food materials wrapped by the packages with the same characteristics are stored at the same position. In order to distinguish food materials, after determining the first characteristic of the package wrapping the food materials, the number of the food materials can be determined according to whether the first position contains other food materials wrapped by the package with the first characteristic, aiming at the food materials wrapped by the package with the same characteristic and stored in the same position in the intelligent refrigerator. Therefore, according to the difference of the serial numbers of the food materials, the stored food materials wrapped by the packages with the same characteristics at the same position in the intelligent refrigerator are distinguished.

In order to accurately distinguish the food materials stored in the intelligent refrigerator, on the basis of the above embodiments, in the embodiment of the present application, the controller 102 is configured to:

determining whether the first location contains other food material that is wrapped by the package of the first characteristic;

if so, determining the number of the food material of the first identification information according to the numbers corresponding to the other food materials;

and if not, determining the number of the food material of the first identification information as a preset numerical value.

In the embodiment of the application, in order to accurately distinguish the food materials wrapped by the packages with the same characteristics stored in the intelligent refrigerator, each wrapped food material is numbered. And when the number of the food material of the first identification information is determined, numbering according to the characteristic of the package food material stored in the intelligent refrigerator. In the embodiment of the present application, the numbers can be numbered according to the characteristics of the stored packages of the packaged food materials at the first position.

Specifically, whether other food materials wrapped by the package with the first characteristic are included at the first position is judged, if the other food materials wrapped by the package with the first characteristic are included, it is indicated that a package similar to or identical to the package wrapping the food material with the first identification information already exists at the first position, the food material with the first identification information is marked, and the number of the food material with the first identification information is determined according to the number stored in the first position corresponding to the other food materials wrapped by the package with the first characteristic. Specifically, if the first position includes other food materials wrapped by the package with the first characteristic, when determining the number of the food material of the first identification information, it may be determined that the number of the food material of the first identification information is a sum of the number of the other food materials and 1 if the numbers corresponding to the other food materials are consecutive numerical values starting from 1; if the numbers corresponding to the other food materials are not continuous, determining that the number of the food material of the first identification information is any missing numerical value, specifically, determining that the minimum value of the missing numerical values in the discontinuous numerical values is the number of the food material of the first identification information.

If the first location does not include other food materials wrapped by the package of the first characteristic, it indicates that there is no package similar to or identical to the package wrapping the food material of the first identification information at the first location, and when marking the food material of the first identification information, the number of the food material of the first identification information is determined as a preset value, and in general, the preset value is 1.

For example, the first layer of the refrigerator is stored with food materials wrapped by three red plastic bags, and the numbers are 1, 3 and 4 respectively. If the package of the food material wrapped by the first identification information stored in the first layer is also identified as a red plastic bag, the first layer contains other food materials wrapped by the red plastic bag, so that the number of the food material of the first identification information is determined according to the numbers corresponding to the other food materials. Since the numbers corresponding to the other food materials are respectively 1, 3, and 4, the numbers corresponding to the other food materials are not consecutive, and the minimum value among the absent values is 2, it can be determined that the number of the food material of the first identification information is 2. By determining the number of the food material of the first identification information, the number of the taken-out wrapped food material can be determined when the food material is taken out, so that which food material the taken-out wrapped food material is, and management of the wrapped food material at the same position in the intelligent refrigerator is realized.

In order to accurately record the food material information, on the basis of the foregoing embodiments, in an embodiment of the present application, the controller 102 is configured to:

determining the intermediate quality guarantee period of the food material of the first identification information according to the corresponding relation between the pre-stored food material and the quality guarantee period;

determining a target quality guarantee period reduction value corresponding to the position range to which the first position belongs according to the corresponding relation between different pre-stored position ranges and quality guarantee period reduction values;

determining a target shelf-life of the food material of the first identification information according to the intermediate shelf-life and the target shelf-life reduction value.

In the embodiment of the application, in order to accurately record the food material information, when the food material of the first identification information is stored, the shelf life of the food material of the first identification information is also recorded. When the quality guarantee period of the food material of the first identification information is determined, the intermediate quality guarantee period corresponding to the food material of the first identification information is determined according to the corresponding relation between the pre-stored food material and the quality guarantee period. Wherein the intermediate shelf life refers to the shelf life of the food material stored in the fixed position in the intelligent refrigerator when the food material of the first identification information is not wrapped.

Since the shelf-life of the coated food material is different from the shelf-life of the non-coated food material, the shelf-life of the food material when coated is usually shorter. Therefore, in the embodiment of the present application, the shelf life of the food material of the first identification information is determined to be reduced due to being wrapped. Specifically, since the food materials are stored at different positions and have different shelf lives, the correspondence between different position ranges and shelf life reduction values is pre-stored, and the shelf life reduction value corresponding to the position range to which the position of the food material of the first identification information is stored is determined as the target shelf life reduction value when the food material of the first identification information is stored. According to the intermediate quality guarantee period and the target quality guarantee period reduction value, the corresponding target quality guarantee period when the food material of the first identification information is stored in the first position can be determined. Specifically, the difference between the intermediate shelf life and the target shelf life reduction value is the target shelf life.

In the embodiment of the present application, the correspondence between the different position ranges and the shelf life reduction values can be divided into specific correspondence between each layer and the shelf life reduction value; or the corresponding relationship between the freezing area and the storage area and the shelf life reduction value. If the data is divided into the freezing area and the corresponding relation between the cold storage area and the shelf life reduction value, the shelf life reduction value corresponding to the freezing area is smaller than the shelf life reduction value corresponding to the cold storage area under normal conditions.

Fig. 2 is a detailed schematic diagram of determining food materials stored in an intelligent refrigerator according to an embodiment of the present disclosure.

S201: and starting.

S202: identifying a food material storage operation.

If the food material storing operation is the operation of manual storing by a user, image recognition is carried out according to the images collected by the visual intelligent sensor, and if the food material storing operation is the operation of voice storing, voice recognition is carried out according to the voice information received by the voice intelligent sensor.

S203: the method comprises the steps of obtaining a first characteristic of a package wrapping the stored food material and a first position where the food material is stored.

When the food material is wrapped, the wrapped food material cannot be directly identified, and only the first characteristic of the wrapping of the wrapped food material can be identified.

S204: and judging whether the first position contains other food materials wrapped by the package with the first characteristic, if so, executing S205, and if not, executing S206.

S205: and determining the number of the food material of the first identification information according to the numbers corresponding to other food materials. And S207 is performed.

S206: and determining the number of the food material of the first identification information as 1. And S207 is performed.

S207: and outputting the identification information of the input food material.

Wherein, the identification information of the input food material can be' first layer is put into plastic bag, ask what is in plastic bag? ".

S208: input information is received.

S209: determining first identification information of the stored food material.

S210: determining an intermediate shelf life of the food material of the first identification information.

S211: determining whether the food material of the first identification information is placed in the freezing area, if yes, executing S212, and if not, executing S213.

S212: determining the target shelf life reduction value of the food material to be M days. And performs S214.

S213: determining the target shelf life reduction value of the food material to be S days. And performs S214.

In general, in the examples of the present application, S > M.

S214: determining a target shelf life of the food material of the first identification information.

S215: and adding the information of the food materials, the number of the food materials, the package characteristics, the serial numbers of the food materials, the positions where the food materials are stored and the shelf life of the food materials of the first identification information into a pre-stored food material database.

S216: and (6) ending.

In order to accurately record food material information, on the basis of the foregoing embodiments, in an embodiment of the present application, the controller 102 is configured to:

and modifying the quality guarantee period of the food material of the first identification information according to the current time, the target quality guarantee period and the time for storing the food material of the first identification information.

Since the shelf life of a food material can change over time, the shelf life of the food material is not only determined when the food material is stored, but also modified over time. Specifically, when the shelf life of the food material of the first identification information is modified along with the change of time, the determination may be performed according to the current time, the determined target shelf life of the food material of the first identification information, and the time when the food material of the first identification information is stored. Specifically, when the shelf life of the food material of the first identification information is modified, a time difference value may be determined according to the current time and the time when the food material of the first identification information is stored, and the difference value determined by the target shelf life of the food material of the first identification information and the time difference value is the modified shelf life of the food material of the first identification information. The shelf life of the food material of the first identification information can be reduced by one day at a preset time every day, whether the preset time is reached currently is judged, and if the preset time is reached currently, the shelf life of the food material of the first identification information is reduced by one day. By the mode, the quality guarantee period of the food materials in the intelligent refrigerator is updated in real time.

determining the number of food materials carried in the input information, and adding the information of the food materials of the first identification information, the number of the food materials, the first characteristic of the package, the serial number of the food materials, the position of the stored food materials and the shelf life into a pre-stored food material database.

In order to accurately manage the food material information, in the embodiment of the present application, a food material database is stored in advance. When the intelligent refrigerator recognizes the food material storing operation and recognizes that the stored food material is wrapped, the controller controls the input and output unit to output the identification information of the input food material, and in addition, in order to more accurately acquire the information of the stored food material, the input and output unit also outputs the quantity information of the input food material when outputting the identification information of the input food material. After receiving the quantity information which is output by the intelligent refrigerator and prompts the user to input food materials, the user replies the input information of the quantity information of the food materials carried by the intelligent refrigerator according to the prompt information.

When input information carrying quantity information of food materials is input, the input information can be input through voice, the voice intelligent sensor receives the input information, extracts key words contained in the input information and sends the key words to the controller, and the controller determines the quantity of the food materials carried in the input information according to the received key words in the input information and a plurality of key words related to the quantity, wherein the number of the key words is pre-stored. And adding the food material of the first identification information, the number of the food materials carried in the input information, the first characteristic of the package of the food material wrapping the first identification information, the number of the food material of the first identification information, the position where the food material of the first identification information is stored and the shelf life of the food material of the first identification information into a pre-stored food material database, and managing the stored food material in the intelligent refrigerator through the information of the food material stored in the food material database.

In addition, in the embodiment of the application, the serial numbers of the food materials are added into the food material database, so that the food materials in the intelligent refrigerator and the characteristics of packages wrapping the food materials are conveniently managed and inquired in real time.

In order to improve the user experience, on the basis of the foregoing embodiments, in the embodiment of the present application, the intelligent refrigerator 100 further includes:

a display 102, the display 102 configured to display information held in a food material database;

the controller 102 is further configured to control the display 102 to display the information stored in the food material database.

In order to improve user experience and facilitate the user to know the information of the food materials in the intelligent refrigerator, in the embodiment of the application, the intelligent refrigerator further comprises a display, the information of the food materials stored in the food material database is displayed through the display, and specifically, the display is controlled through the controller, so that the display displays the information of the food materials stored in the food material database.

In addition, in the embodiment of the application, in order to improve user experience, the food materials can be identified through the cartoon patterns corresponding to different food materials, the cartoon patterns corresponding to the food materials in the intelligent refrigerator are determined according to the corresponding relation between the identification information of the food materials and the cartoon patterns, and the cartoon patterns corresponding to the food materials are displayed when the information of the food materials in the food material database is displayed in the display. And the layer number structure of the intelligent refrigerator can be displayed in the display, according to which layer each food material in the intelligent refrigerator is stored in, the food material is displayed in the corresponding layer in the layer number structure, so that the layer number structure of the intelligent refrigerator and the specific food material stored in each layer are displayed in the display of the intelligent refrigerator.

In order to accurately record food material information, on the basis of the foregoing embodiments, in an embodiment of the present application, the controller 102 is further configured to:

in response to the food material taking operation, determining information of a second position where the taken food material is stored, and if the taken food material is identified to be wrapped, determining a second characteristic of the wrapping the food material; determining whether the second location contains other food material that is wrapped by the package of the second characteristic;

if yes, controlling the input and output unit to output the identification information of the input food material, receiving the input information, and determining the food material of the taken second identification information;

if not, determining the food material of the extracted second identification information.

When the food materials in the intelligent refrigerator are taken out, the intelligent refrigerator can recognize the food material taking-out operation and acquire the information of the second position where the taken-out food materials are taken out. The operation of taking out the food material can be an operation of manually taking out the food material by a user or an operation of taking out the food material by voice.

Specifically, the process of determining whether the taken out food material is wrapped or not at the stored second position according to the taking out operation of the user is the same as the process of determining whether the stored food material is wrapped or not at the stored first position according to the taking out operation of the user, and details are not repeated herein.

And if the extracted food material is identified to be wrapped, determining the extracted food material with the second identification information according to the second characteristic of the wrapping the food material and the position of the stored extracted food material. Specifically, when the food material is determined to be taken out, a second characteristic of the taken out package wrapping the food material is determined, and whether other food materials wrapped by the package with the second characteristic are included at a second position where the taken out food material is located is determined. Moreover, the process of determining the second characteristic of the retrieved package is the same as the process of determining the first characteristic of the stored package, and is not described herein again.

If the second position contains other food materials wrapped by the package with the second characteristic, the food materials with the taken-out second identification information cannot be determined by the second characteristic of the package wrapping the food materials, so that the taken-out food materials in the intelligent refrigerator cannot be recorded, the input and output unit is controlled to input the identification information of the food materials, the user taking out the food materials is reminded of the identification information of the input food materials output by the input and output unit, and specifically, when the input and output unit is controlled to input the identification information of the food materials, the output voice information can be 'what the taken-out food materials are asked for'; it may also be that "the food material taken out is, if not, any" which is any of the other food materials wrapped in the second characteristic at the second position.

After a user receives identification information which is output by the intelligent refrigerator and prompts the user to input food materials, the user inputs input information carrying second identification information of the food materials according to the prompt information, the input and output unit receives the input information, at the moment, the input and output unit is a voice intelligent sensor which identifies the input information, extracts key words in the input information and sends the extracted key words to the controller, and the controller determines the food materials of the extracted second identification information according to the key words in the received input information.

If the second position does not contain other food materials wrapped by the package of the second characteristic, the food material with the taken-out second identification information can be determined directly through the second characteristic of the package wrapping the food material and the information of the food materials stored in the food material database.

For example, an apple wrapped by red plastic bag, a pineapple wrapped by black plastic bag, a strawberry wrapped by black plastic bag are stored in the first layer of the intelligent refrigerator. If the user takes out the black plastic bag on the first layer, the intelligent refrigerator cannot determine which food material is taken out, the user is reminded through the input and output unit, and whether the taken food material is pineapple or strawberry is determined according to the received input information. If the user takes out a red plastic bag on the first layer, the intelligent refrigerator can determine that the taken-out food material is an apple according to the characteristics of the package wrapping the food material and the position of the taken-out food material stored in the intelligent refrigerator.

Because the information of each food material corresponds to the food material one by one, when the food material is taken out of the intelligent refrigerator, the information of the food material in the food material library is reduced, and meanwhile, the food material information on the display is synchronously updated.

In addition, in the embodiment of the application, after the food material of the second identification information is determined, in order to remind the user, the voice information of the food material including the second identification information, the second characteristic of the package wrapping the food material, and the position of the food material of the second identification information when the food material is stored is synthesized and broadcasted through the input and output unit, and at this time, the input and output unit may be a voice sensor. Wherein, the voice message can be 'the second layer takes out a red plastic bag, and the plastic bag is placed with apples'.

Fig. 3 is a detailed schematic diagram of determining food materials taken out of an intelligent refrigerator according to an embodiment of the present disclosure.

S301: and starting.

S302: recognizing the food material taking-out operation.

The image is manually taken out by a user and is recognized according to the image collected by the visual intelligent sensor, or the image is taken out by voice and is recognized according to the voice information received by the voice intelligent sensor.

S303: obtaining a second characteristic of the package of the taken out food material, and a second position of the taken out food material stored in.

S304: determining whether the second location includes other food materials wrapped by the package with the second characteristic, if so, performing S305, and if not, performing S306.

S305: and outputting the identification information of the input food material. And performs S307.

S306: and determining the food material of the taken out second identification information. S308 is performed.

S307: input information is received.

S308: and determining the food material of the extracted second identification information.

S309: and synthesizing voice broadcasting.

And manually taking out the food materials of the determined second identification information according to the voice, and synthesizing the voice broadcast content, wherein the 'first layer is taken out of a plastic bag, and the plastic bag is filled with vegetables'.

S310: and (6) ending.

Fig. 4 is a schematic diagram of an intelligent refrigerator provided in an embodiment of the present application.

As shown in fig. 4, the input/output unit may be a visual sensor and a voice sensor, or may be a voice sensor, in this embodiment, it can be determined through the voice sensor or the visual sensor whether the food material is stored, taken out, or wrapped when the food material is stored or taken out, the location of the stored food material, the location when the taken out food material is stored, and the characteristics of the wrapping, and the voice sensor can prompt the user to input the identification information of the food material, and receive the input information through the voice sensor. As can be seen from fig. 4, the intelligent refrigerator includes a plurality of layers, which are specifically divided into a freezing zone and a refrigerating zone, wherein the upper four layers of the intelligent refrigerator shown in fig. 4 are refrigerating zones, and the lower two layers of the intelligent refrigerator are freezing zones.

In order to record food material information of a packaged food material stored in an intelligent refrigerator, an embodiment of the present application provides a food material management method, and fig. 5 is a schematic process diagram of the food material management method provided in the embodiment of the present application, where the process includes the following steps:

s501: receiving food material storing operation, acquiring information of a first position where the stored food material is stored, and outputting identification information of input food material if the stored food material is identified to be wrapped;

s502: receiving input information, determining first identification information of the stored food material, and managing the food material with the first identification information.

In one possible embodiment, the method further comprises:

In a possible embodiment, the determining the food material number of the food material of the first identification information according to the first characteristic and whether the first location contains other food materials wrapped by the package of the first characteristic includes:

In one possible embodiment, the method further comprises:

determining the quantity of food materials carried in input information, and adding the information of the food materials of the first identification information, the quantity of the food materials, the first characteristic of the package, the serial number of the food materials, the position where the food materials are stored and the shelf life into a pre-stored food material database.

In one possible embodiment, the method further comprises:

and controlling a display to display the information stored in the food material database.

In one possible embodiment, the method further comprises:

receiving food material taking operation, determining information of a second position where the taken food material is stored, and if the taken food material is identified to be wrapped, determining a second characteristic of the wrapping of the food material; determining whether the second location contains other food material that is wrapped by the package of the second characteristic;

if so, outputting the identification information of the input food material, receiving the input information, and determining the food material of the taken out second identification information;

The method is applied to the intelligent refrigerator, and the process of executing the food material management method by the specific intelligent refrigerator can join the other embodiments, and specific contents are not described again.

Fig. 6 is a schematic structural diagram of a food material management apparatus provided in an embodiment of the present application, where the apparatus includes:

the processing module 601 is configured to receive a food material storing operation, obtain information of a first position where the stored food material is stored, and output identification information of an input food material if the stored food material is identified to be wrapped;

the determining module 602 is configured to receive input information, determine first identification information of a stored food material, and manage the food material of the first identification information.

Further, the processing module 601 is further configured to determine a first characteristic of a package wrapping the food material if it is determined that the stored food material is wrapped, and determine a food material number of the food material of the first identification information according to the first characteristic and whether the first position includes other food materials wrapped by the package of the first characteristic.

Further, the processing module 601 is specifically configured to determine whether the first location contains other food materials wrapped by the package with the first characteristic; if so, determining the number of the food material of the first identification information according to the numbers corresponding to the other food materials; and if not, determining the number of the food material of the first identification information as a preset numerical value.

Further, the processing module 601 is further configured to determine an intermediate shelf life of the food material of the first identification information according to a pre-stored correspondence between the food material and the shelf life; determining a target quality guarantee period reduction value corresponding to the position range to which the first position belongs according to the corresponding relation between different pre-stored position ranges and quality guarantee period reduction values; determining a target shelf-life of the food material of the first identification information according to the intermediate shelf-life and the target shelf-life reduction value.

Further, the processing module 601 is further configured to modify the shelf life of the food material of the first identification information according to the current time, the target shelf life and the time when the food material of the first identification information is stored.

Further, the processing module 601 is further configured to determine the number of food materials carried in the input information, and add the food material of the first identification information, the number of the food materials, the first characteristic of the package, the number of the food material, the location where the food material is stored, and the information of the shelf life to a pre-stored food material database.

Further, the processing module 601 is further configured to control a display to display information stored in the food material database.

Further, the determining module 602 is further configured to receive a food material taking operation, determine information of a second location where the taken food material is stored, and if it is identified that the taken food material is wrapped, determine a second characteristic of the wrapping of the food material; determining whether the second location contains other food material that is wrapped by the package of the second characteristic; if so, outputting the identification information of the input food material, receiving the input information, and determining the food material of the taken out second identification information; if not, determining the food material of the extracted second identification information.

On the basis of the foregoing embodiments, an embodiment of the present application further provides an electronic device, as shown in fig. 7, including: the system comprises a processor 701, a communication interface 702, a memory 703 and a communication bus 704, wherein the processor 701, the communication interface 702 and the memory 703 are communicated with each other through the communication bus 704.

The memory 703 has stored therein a computer program which, when executed by the processor 701, causes the processor 701 to perform the steps of:

receiving input information, determining first identification information of the stored food material, and managing the food material with the first identification information.

In one possible embodiment, the method further comprises:

The communication bus mentioned in the above server may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.

The communication interface 702 is used for communication between the above-described electronic apparatus and other apparatuses.

The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Alternatively, the memory may be at least one memory device located remotely from the aforementioned processor.

The Processor may be a general-purpose Processor, including a central processing unit, a Network Processor (NP), and the like; but may also be a Digital instruction processor (DSP), an application specific integrated circuit, a field programmable gate array or other programmable logic device, discrete gate or transistor logic, discrete hardware components, etc.

On the basis of the foregoing embodiments, an embodiment of the present application further provides a computer-readable storage medium, where a computer program executable by an electronic device is stored in the computer-readable storage medium, and when the program is run on the electronic device, the electronic device is caused to perform the following steps:

In one possible embodiment, the method further comprises:

In a possible embodiment, the determining the food material number of the food material of the first identification information according to the first characteristic and whether the first position contains other food materials wrapped by the package of the first characteristic includes:

In one possible embodiment, the method further comprises:

and determining the target quality guarantee period of the food material of the first identification information according to the intermediate quality guarantee period and the target quality guarantee period reduction value.

In one possible embodiment, the method further comprises:

if yes, outputting identification information of the input food material, receiving the input information, and determining the food material of the taken out second identification information;

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

For the system/apparatus embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference may be made to some descriptions of the method embodiments for relevant points.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While the preferred embodiments of the present application have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.

Claims

1. An intelligent refrigerator, characterized in that the intelligent refrigerator comprises:

a controller configured to:

2. The intelligent refrigerator of claim 1, wherein the controller is configured to:

if the stored food material is determined to be wrapped, determining a first characteristic of the wrapping of the food material, and determining the food material number of the food material with the first identification information according to the first characteristic and whether the first position contains other food materials wrapped by the wrapping of the first characteristic.

3. The intelligent refrigerator of claim 2, wherein the controller is configured to:

4. The intelligent refrigerator of claim 1, wherein the controller is configured to:

5. The intelligent refrigerator of claim 4 wherein the controller is configured to:

6. The intelligent refrigerator of claim 5, wherein the controller is configured to:

7. The intelligent refrigerator of claim 6, further comprising:

a display configured to display information held in a food material database;

the controller is further configured to control the display to display information stored in the food material database.

8. The intelligent refrigerator of claim 1, wherein the controller is configured to:

determining information of a second position where the taken-out food material is stored in response to the food material taking-out operation, and if the taken-out food material is identified to be wrapped, determining a second characteristic of the wrapping of the food material; determining whether the second location contains other food material that is wrapped by the package of the second characteristic;

9. A method of food material management, the method comprising:

10. An electronic device comprising a processor and a memory, characterized in that the memory is configured to store program instructions and the processor is configured to carry out the steps of the food material management method according to claim 9 when executing a computer program stored in the memory.