CN114691730A - Storage position prompting method and device, storage medium and electronic device - Google Patents
Storage position prompting method and device, storage medium and electronic device Download PDFInfo
- Publication number
- CN114691730A CN114691730A CN202210171081.6A CN202210171081A CN114691730A CN 114691730 A CN114691730 A CN 114691730A CN 202210171081 A CN202210171081 A CN 202210171081A CN 114691730 A CN114691730 A CN 114691730A
- Authority
- CN
- China
- Prior art keywords
- food material
- information
- storage
- refrigerator
- storage position
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 235000013305 food Nutrition 0.000 claims abstract description 190
- 239000000463 material Substances 0.000 claims abstract description 177
- 230000003993 interaction Effects 0.000 claims description 46
- 230000008859 change Effects 0.000 claims description 22
- 238000004590 computer program Methods 0.000 claims description 10
- 230000004044 response Effects 0.000 claims description 10
- 238000004891 communication Methods 0.000 claims description 7
- 230000003213 activating effect Effects 0.000 claims description 4
- 235000002595 Solanum tuberosum Nutrition 0.000 description 10
- 244000061456 Solanum tuberosum Species 0.000 description 10
- 238000010586 diagram Methods 0.000 description 7
- 235000012015 potatoes Nutrition 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000005406 washing Methods 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 238000004887 air purification Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 235000019504 cigarettes Nutrition 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000008014 freezing Effects 0.000 description 1
- 238000007710 freezing Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000010408 sweeping Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
Abstract
The application discloses a storage position prompting method and device, a storage medium and an electronic device, and relates to the technical field of smart families, wherein the method comprises the following steps: shooting the first food material through an image acquisition device on the refrigerator to obtain a first image; under the condition that a first food material is identified in the first image, acquiring first identification information of the first food material; determining a first storage position of a first food material in the refrigerator through a storage position identification device on the refrigerator, and storing first identification information and the first storage position which have an association relationship; under the condition that a target query request is received, responding to the target query request, searching first identification information matched with first description information, obtaining a first storage position having an association relation with the first identification information, and outputting the first storage position, wherein the first description information is the description information of the food material to be searched and identified in the target query request.
Description
Technical Field
The invention relates to the field of communication, in particular to a storage position prompting method and device, a storage medium and an electronic device.
Background
With the progress of science and technology and the development of artificial intelligence, intelligent algorithms are also increasingly applied to daily life, the intelligent development is very important, and the most key problem of intelligence lies in the urgent need of intelligent solution users.
The storage space of the existing household refrigerator with a single door is stored in more than 3 areas, the storage space for freezing is also more than 3, the storage space of the refrigerator with multiple doors can exceed more than 10, and each storage space can store various food materials. Many times, when a user opens the refrigerator and searches for food needed by the user, the refrigerator needs to be turned up, down and up, and a large amount of time is wasted.
Aiming at the problems that in the related art, a large amount of time may be wasted when a user opens a refrigerator and searches for food required by the user, and the like, an effective solution is not provided.
Disclosure of Invention
The embodiment of the invention provides a storage position prompting method and device, a storage medium and an electronic device, and at least solves the problems that in the related art, a large amount of time may be wasted when a user opens a refrigerator and searches for food required by the user.
According to an embodiment of the present invention, a method for prompting a storage location is provided, including: shooting a first food material through an image acquisition device on a refrigerator to obtain a first image; under the condition that the first food material is identified in the first image, acquiring first identification information of the first food material; determining a first storage position of the first food material in the refrigerator through a storage position identification device on the refrigerator, and storing the first identification information and the first storage position which have an association relationship; under the condition that a target query request is received, responding to the target query request, searching the first identification information matched with first description information, acquiring the first storage position having an association relation with the first identification information, and outputting the first storage position, wherein the first description information is the description information of the food material to be searched and is identified in the target query request.
In an exemplary embodiment, the determining, by the storage location identification device on the refrigerator, a first storage location of the first food material in the refrigerator comprises one of: under the condition that the storage position recognition device is a voice interaction device, acquiring first voice information through the voice interaction device, and recognizing the first storage position of the first food material from the first voice information; determining, by the weight recognition device, weight change information corresponding to a plurality of storage areas in the refrigerator, respectively, and determining the first storage location of the first food material according to the weight change information, in a case where the storage location recognition device is a weight recognition device; and under the condition that the storage position identification device is an information interaction device, acquiring a first storage position of the input first food material through the information interaction device.
In an exemplary embodiment, the obtaining, by the voice communication device, first voice information and identifying, from the first voice information, the first storage location of the first food material includes one of: acquiring first voice information through the voice delivery device, identifying the first storage position from the first voice information, and determining the first storage position as a storage position of the first food material in the refrigerator under the condition that the first voice information is acquired within a first duration after or before the first image is shot; acquiring second voice information through the voice communication device, recognizing the first storage position and second description information from the second voice information, and determining the first storage position as the storage position of the first food material in the refrigerator under the condition that the second description information is matched with the first identification information; the method comprises the steps that first voice information is obtained through the voice delivery device, the first storage position is identified from the first voice information, and the first storage position is determined to be the storage position of the first food material in the refrigerator when the first voice information is obtained after the first image is shot and before the image acquisition device shoots a second food material to obtain a second image.
In an exemplary embodiment, the determining, by the weight recognizing device, weight change information respectively corresponding to a plurality of storage areas in the refrigerator, and the determining the first storage location of the first food material according to the weight change information, includes: in a case where the weight identifying means includes a weight identifying means provided in each of the plurality of storage areas, acquiring a weight change value identified by the weight identifying means provided in each of the storage areas within a second period of time after the first image is captured; determining a target storage area as the first storage location of the first food material if there is the target storage area having a weight variation value greater than or equal to a preset threshold among the plurality of storage areas.
In an exemplary embodiment, the obtaining, by the information interaction device, the input of the first storage location of the first food material includes: under the condition that the information interaction device is a touch screen and the marks of the storage areas are displayed on the touch screen, when the mark of a target storage area in the marks of the storage areas is selected, determining the target storage area as the first storage position of the first food material; or in the case that the information interaction apparatus includes an interaction module disposed in each of the plurality of storage areas, when a target storage area in which the interaction module is selected exists in the plurality of storage areas, determining the target storage area as the first storage location of the first food material.
In one exemplary embodiment, prior to responding to the target query request, the method includes at least one of: acquiring the target query request sent by a target terminal, wherein the target terminal has a binding relationship with the refrigerator, the first description information included in the target query request is identification information or a name of the food material to be searched, and the identification information of the food material to be searched is the first identification information acquired by the target terminal from the refrigerator, or is the identification information acquired by the target terminal, or is identification information selected from identification information of a group of food materials stored on the target terminal; or third voice information recognized by the voice interaction device on the refrigerator is acquired, and the target query request is recognized in the third voice information, wherein the first description information included in the target query request is identification information or name of the food material to be searched, and the identification information of the food material to be searched is the first identification information acquired by the target terminal from the refrigerator, or the identification information acquired by the target terminal, or identification information selected from identification information of a group of food materials stored on the target terminal.
In an exemplary embodiment, said outputting said first storage location comprises one of: displaying the first storage position of the food material to be searched on the refrigerator; playing the first storage position of the food material to be searched on the refrigerator; activating a notification light in the refrigerator at the first storage location.
According to another embodiment of the present invention, there is provided a storage location notification apparatus, including: the first acquisition module is used for shooting the first food material through an image acquisition device on the refrigerator to obtain a first image; the second obtaining module is used for obtaining first identification information of the first food material under the condition that the first food material is identified in the first image; the determining module is used for determining a first storage position of the first food material in the refrigerator through a storage position identification device on the refrigerator, and storing the first identification information and the first storage position which have an association relationship; the response module is configured to, in response to a target query request, search for the first identification information matching first description information in response to the target query request, obtain the first storage location having an association relationship with the first identification information, and output the first storage location, where the first description information is description information of the first food material identified in the target query request.
According to another aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium, in which a computer program is stored, where the computer program is configured to execute the above method for prompting a storage location when the computer program runs.
According to another aspect of the embodiments of the present invention, there is provided an electronic apparatus, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the method for prompting the storage location through the computer program.
In the embodiment of the invention, the first food material is shot through the image acquisition device on the refrigerator to obtain a first image; under the condition that the first food material is identified in the first image, acquiring first identification information of the first food material; determining a first storage position of the first food material in the refrigerator through a storage position identification device on the refrigerator, and storing the first identification information and the first storage position which have an association relationship; under the condition that a target query request is received, responding to the target query request, searching the first identification information matched with first description information, acquiring the first storage position in association relation with the first identification information, and outputting the first storage position, wherein the first description information is the description information of the food material to be searched and is identified in the target query request; by adopting the technical scheme, the problems that a large amount of time can be wasted and the like when a user opens the refrigerator and searches for food required by the user are solved, and the time for the user to search for the food is further reduced.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art to obtain other drawings without inventive exercise.
Fig. 1 is a schematic diagram of a hardware environment of an interaction method of a smart device according to an embodiment of the present application;
FIG. 2 is a flow chart of a method for prompting a storage location according to an embodiment of the invention;
FIG. 3 is a diagram illustrating a method for providing a hint of storage locations according to an embodiment of the present invention;
FIG. 4 is a block diagram (I) of a storage location notification apparatus according to an embodiment of the present invention;
fig. 5 is a block diagram of a storage location notification apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
According to an aspect of an embodiment of the present application, a method for prompting a storage location is provided. The prompting method of the storage position is widely applied to full-House intelligent digital control application scenes such as intelligent homes (Smart Home), intelligent homes, intelligent Home equipment ecology, intelligent House (Intelligent House) ecology and the like. Alternatively, in this embodiment, the above storage location prompting method may be applied to a hardware environment formed by the terminal device 102 and the server 104 as shown in fig. 1. As shown in fig. 1, the server 104 is connected to the terminal device 102 through a network, and may be configured to provide a service (e.g., an application service) for the terminal or a client installed on the terminal, set a database on the server or independent of the server, and provide a data storage service for the server 104, and configure a cloud computing and/or edge computing service on the server or independent of the server, and provide a data operation service for the server 104.
The network may include, but is not limited to, at least one of: wired networks, wireless networks. The wired network may include, but is not limited to, at least one of: wide area networks, metropolitan area networks, local area networks, which may include, but are not limited to, at least one of the following: WIFI (Wireless Fidelity), bluetooth. Terminal equipment 102 can be but not limited to be PC, the cell-phone, the panel computer, intelligent air conditioner, intelligent cigarette machine, intelligent refrigerator, intelligent oven, intelligent kitchen range, intelligent washing machine, intelligent water heater, intelligent washing equipment, intelligent dish washer, intelligent projection equipment, intelligent TV, intelligent clothes hanger, intelligent (window) curtain, intelligence audio-visual, smart jack, intelligent stereo set, intelligent audio amplifier, intelligent new trend equipment, intelligent kitchen guarding equipment, intelligent bathroom equipment, intelligence robot of sweeping the floor, intelligence robot of wiping the window, intelligence robot of mopping the ground, intelligent air purification equipment, intelligent steam ager, intelligent microwave oven, intelligent kitchen is precious, intelligent clarifier, intelligent water dispenser, intelligent lock etc..
In this embodiment, a method for prompting a storage location is provided, which is applied to the computer terminal, and fig. 2 is a flowchart of a method for prompting a storage location according to an embodiment of the present invention, where the flowchart includes the following steps:
step S202, shooting a first food material through an image acquisition device on a refrigerator to obtain a first image;
step S204, acquiring first identification information of the first food material under the condition that the first food material is identified in the first image;
step S206, determining a first storage position of the first food material in the refrigerator through a storage position identification device on the refrigerator, and storing the first identification information and the first storage position which have an association relationship;
step S208, in a case that a target query request is received, in response to the target query request, searching for the first identification information matched with first description information, acquiring the first storage location having an association relationship with the first identification information, and outputting the first storage location, where the first description information is description information of the food material to be searched identified in the target query request.
It should be noted that the "first food material" is a plurality of food materials to be stored in the refrigerator; the "food to be searched" is any one of the food materials stored in the refrigerator, and may be any one or more of the "first food materials", for example.
Through the steps, shooting the first food material through an image acquisition device on the refrigerator to obtain a first image; under the condition that the first food material is identified in the first image, acquiring first identification information of the first food material; determining a first storage position of the first food material in the refrigerator through a storage position identification device on the refrigerator, and storing the first identification information and the first storage position which have an association relationship; under the condition that a target query request is received, responding to the target query request, searching the first identification information matched with first description information, acquiring the first storage position in association relation with the first identification information, and outputting the first storage position, wherein the first description information is the description information of the food material to be searched and is identified in the target query request; the problem of among the related art, the user opens the refrigerator, under the condition of looking for the food that the user needs, probably wastes a large amount of time scheduling is solved, and then reduces the time that the user looked for food.
In an exemplary embodiment, the determining, by the storage location identification device on the refrigerator, a first storage location of the first food material in the refrigerator comprises one of: under the condition that the storage position recognition device is a voice interaction device, acquiring first voice information through the voice interaction device, and recognizing the first storage position of the first food material from the first voice information; determining, by the weight recognition device, weight change information corresponding to a plurality of storage areas in the refrigerator, respectively, and determining the first storage location of the first food material according to the weight change information, in a case where the storage location recognition device is a weight recognition device; and under the condition that the storage position identification device is an information interaction device, acquiring a first storage position of the input first food material through the information interaction device.
That is, in the embodiment of the present invention, the identification device of the storage location on the refrigerator may be: a voice interaction device, a weight recognition device and an information interaction device, in particular, in case the storage location recognition device is a voice interaction device, determining said first storage location of the first food material by recognizing a first voice message uttered by a user, for example, determining the location of a potato by recognizing that "the potato is placed on the left side of the second layer"; in the case where the storage location recognition means is a weight recognition means, determining a first storage location of the first food material by determining weight change information corresponding to each of a plurality of storage areas in the refrigerator when the user puts the first food material, for example, determining a location of a potato by recognizing that the user puts the potato on the left of the second floor and determining that the weight of the second floor of the refrigerator is changed; and under the condition that the storage position identification device is an information interaction device, determining a first storage position of the first food material by receiving input information sent by a user through the terminal equipment.
In an exemplary embodiment, the obtaining, by the voice communication device, first voice information and identifying, from the first voice information, the first storage location of the first food material includes one of: acquiring first voice information through the voice delivery device, identifying the first storage position from the first voice information, and determining the first storage position as a storage position of the first food material in the refrigerator under the condition that the first voice information is acquired within a first duration after or before the first image is shot; acquiring second voice information through the voice communication device, recognizing the first storage position and second description information from the second voice information, and determining the first storage position as the storage position of the first food material in the refrigerator under the condition that the second description information is matched with the first identification information; the method comprises the steps that first voice information is obtained through the voice delivery device, the first storage position is identified from the first voice information, and the first storage position is determined to be the storage position of the first food material in the refrigerator when the first voice information is obtained after the first image is shot and before the image acquisition device shoots a second food material to obtain a second image.
That is, determining to determine the first storage location as the storage location with the first food material in the refrigerator is determined in three cases: 1) determining a first storage position as the storage position of the first food material in the refrigerator under the condition that the first voice information only comprises the first storage position and is acquired within a first duration after or before the first image is shot;
2) determining a first storage position as a storage position of a first food material in the refrigerator under the condition that the first voice information comprises the first storage position and second description information, and the second description information is matched with first identification information of the first food material in the first image; 3) and when the first voice information is the voice information acquired after the first image is shot and before the image acquisition device shoots the second food material to obtain the second image, determining that a first storage position in the first voice information is determined as the storage position of the first food material in the refrigerator.
In an exemplary embodiment, the determining, by the weight recognizing device, weight change information respectively corresponding to a plurality of storage areas in the refrigerator, and the determining the first storage location of the first food material according to the weight change information, includes: in the case where the weight identifying means includes a weight identifying module provided in each of the plurality of storage areas, acquiring a weight change value identified by the weight identifying module provided in each of the plurality of storage areas within a second period of time after the first image is captured; determining a target storage area as the first storage location of the first food material if there is the target storage area having a weight variation value greater than or equal to a preset threshold among the plurality of storage areas.
That is, a region in which the weight change value is greater than or equal to the preset threshold value among the plurality of storage regions is a target storage region, and the target storage region is taken as the first storage position.
In an exemplary embodiment, the obtaining, by the information interaction device, the input of the first storage location of the first food material includes: under the condition that the information interaction device is a touch screen and the marks of the storage areas are displayed on the touch screen, when the mark of a target storage area in the marks of the storage areas is selected, determining the target storage area as the first storage position of the first food material; or in the case that the information interaction apparatus includes an interaction module disposed in each of the plurality of storage areas, when a target storage area in which the interaction module is selected exists in the plurality of storage areas, determining the target storage area as the first storage location of the first food material.
That is, the first storage location of the first food material that is input can be obtained through the information interaction device in the following two ways: 1) selecting an identifier of the target storage area on the touch screen; 2) and selecting a module of the target storage area by the target object.
In one exemplary embodiment, obtaining the target query request includes one of: acquiring the target query request sent by a target terminal, wherein the target terminal has a binding relationship with the refrigerator, the first description information included in the target query request is identification information or a name of the food material to be searched, and the identification information of the food material to be searched is the first identification information acquired by the target terminal from the refrigerator, or is the identification information acquired by the target terminal, or is identification information selected from identification information of a group of food materials stored on the target terminal; or third voice information recognized by the voice interaction device on the refrigerator is acquired, and the target query request is recognized in the third voice information, wherein the first description information included in the target query request is identification information or name of the food material to be searched, and the identification information of the food material to be searched is the first identification information acquired by the target terminal from the refrigerator, or the identification information acquired by the target terminal, or identification information selected from identification information of a group of food materials stored on the target terminal.
It should be noted that, in the embodiment of the present invention, the target query request is obtained through the following three ways: 1) the target object sends a target query request through a target terminal, and then the refrigerator terminal obtains the target query request sent by the target terminal; 2) acquiring third voice information through a voice interaction device on the refrigerator, and identifying the third voice information to acquire a target query; 3) and selecting the identification information of the food material to be searched through a touch screen on the refrigerator and the like.
In an exemplary embodiment, the first storage location of the food material to be looked up is prompted by: 1) displaying the first storage position of the food material to be searched on the refrigerator; 2) playing the first storage position of the food material to be searched on the refrigerator; 3) activating a notification light in the refrigerator at the first storage location.
In an exemplary embodiment, determining a first storage location of the first food material in the refrigerator by a storage location identification device on the refrigerator comprises at least one of: acquiring multi-frame continuous action images of the first food material placed in the target object through an image acquisition device; identifying the plurality of frames of continuous action images through the storage position identification device to determine a first storage position of the first food material in the refrigerator; acquiring a plurality of storage areas in the refrigerator, and determining a second storage area where no food material exists among the plurality of storage areas; determining the first storage position of the first food material according to the weight change information of the second storage area; acquiring a first refrigerator door with the refrigerator opened; determining a third storage area corresponding to the first refrigerator door according to the first refrigerator door, and determining the first storage position of the first food material according to weight change information of the third storage area.
In an exemplary embodiment, after outputting the first storage location, the method further comprises: determining a target menu in a menu set according to the first identification information, determining associated food materials in the target menu, determining a fourth storage position corresponding to the associated food materials, and prompting the fourth storage position.
In order to better understand the process of the above prompting method for the storage location, the following describes a flow of the implementation method for prompting the storage location with reference to an optional embodiment, but the flow is not limited to the technical solution of the embodiment of the present invention.
In this embodiment, a method for prompting a storage location is provided, and fig. 3 is a schematic diagram of a method for prompting a storage location according to an embodiment of the present invention, as shown in fig. 3, the following steps are specifically provided:
step S301: receiving first voice information sent by a target object under the condition that a user puts a potato in a refrigerator;
step S302: identifying the second voice information to determine a storage location of the potato;
step S303: the refrigerator records the storage position of the potatoes and food information through software;
step S304: receiving second voice information sent by a target object under the condition that a user wants to obtain potatoes;
step S305: identifying food material information in the second voice information, and determining a storage position of the potato;
step S306: voice prompts are issued, for example: the potatoes are placed in the upper left corner of the first layer.
In the embodiment of the invention, the first food material is shot through the image acquisition device on the refrigerator to obtain a first image; under the condition that the first food material is identified in the first image, acquiring first identification information of the first food material; determining a first storage position of the first food material in the refrigerator through a storage position identification device on the refrigerator, and storing the first identification information and the first storage position which have an association relationship; acquiring a target query request, wherein the target query request is used for requesting to acquire the storage position of the food material to be searched in the refrigerator; responding to the target query request, searching the first identification information matched with first description information, acquiring the first storage position having an association relation with the first identification information, and outputting the first storage position, wherein the first description information is the description information of the food material to be searched and is identified in the target query request; by adopting the technical scheme, the problems that a large amount of time can be wasted and the like under the condition that a user opens the refrigerator and searches for food required by the user are solved, and the time for the user to search for the food is further reduced.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
In this embodiment, a prompting device for storing a location is further provided, and the prompting device for storing a location is used to implement the foregoing embodiments and preferred embodiments, which have already been described and are not described again. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware or a combination of software and hardware is also possible and contemplated.
FIG. 4 is a block diagram (I) of a storage location notification device according to an embodiment of the present invention; as shown in fig. 4, includes:
the first obtaining module 42 is configured to shoot the first food material through an image collecting device on the refrigerator to obtain a first image;
a second obtaining module 44, configured to obtain first identification information of the first food material when the first food material is identified in the first image;
a determining module 46, configured to determine, through a storage location identification device on the refrigerator, a first storage location of the first food material in the refrigerator, and store the first identification information and the first storage location having an association relationship;
the response module 48 is configured to, in a case that a target query request is received, in response to the target query request, search for the first identification information matched with first description information, obtain the first storage location having an association relationship with the first identification information, and output the first storage location, where the first description information is description information of the food material to be searched and identified in the target query request.
By the device, the first food material is shot through the image acquisition device on the refrigerator, and a first image is obtained; under the condition that the first food material is identified in the first image, acquiring first identification information of the first food material; determining a first storage position of the first food material in the refrigerator through a storage position identification device on the refrigerator, and storing the first identification information and the first storage position which have an association relationship; under the condition that a target query request is received, responding to the target query request, searching the first identification information matched with first description information, acquiring the first storage position in association relation with the first identification information, and outputting the first storage position, wherein the first description information is the description information of the food material to be searched and is identified in the target query request; by adopting the technical scheme, the problems that a large amount of time can be wasted and the like when a user opens the refrigerator and searches for food required by the user are solved, and the time for the user to search for the food is further reduced.
In an exemplary embodiment, fig. 5 is a block diagram of a storage location notification apparatus according to an embodiment of the present invention; as shown in fig. 5, the above apparatus further includes: the recognition module 52 is configured to, when the storage location recognition device is a voice interaction device, obtain first voice information through the voice interaction device, and recognize the first storage location of the first food material from the first voice information; the determining module is further configured to, in a case that the storage location identifying device is a weight identifying device, respectively determine, by the weight identifying device, weight change information respectively corresponding to a plurality of storage areas in the refrigerator, and determine the first storage location of the first food material according to the weight change information; the determining module is further configured to, when the storage location identifying device is an information interaction device, obtain, through the information interaction device, the input first storage location of the first food material.
In an exemplary embodiment, the identification module is configured to one of: acquiring first voice information through the voice delivery device, identifying the first storage position from the first voice information, and determining the first storage position as a storage position of the first food material in the refrigerator under the condition that the first voice information is acquired within a first duration after or before the first image is shot; acquiring second voice information through the voice communication device, recognizing the first storage position and second description information from the second voice information, and determining the first storage position as the storage position of the first food material in the refrigerator under the condition that the second description information is matched with the first identification information; the method comprises the steps that first voice information is obtained through the voice delivery device, the first storage position is identified from the first voice information, and the first storage position is determined to be the storage position of the first food material in the refrigerator when the first voice information is obtained after the first image is shot and before the image acquisition device shoots a second food material to obtain a second image.
In an exemplary embodiment, the determining module 46 is further configured to, in a case where the weight identifying device includes a weight identifying module disposed in each of the plurality of storage areas, acquire the weight change value identified by the weight identifying module disposed in each of the plurality of storage areas within a second time period after the first image is captured; determining a target storage area as the first storage location of the first food material if there is the target storage area having a weight variation value greater than or equal to a preset threshold among the plurality of storage areas.
In an exemplary embodiment, the determining module 46 is further configured to, in a case that the information interaction apparatus is a touch screen and the identifiers of the plurality of storage areas are displayed on the touch screen, determine, when an identifier of a target storage area of the identifiers of the plurality of storage areas is selected, the target storage area as the first storage location of the first food material; or in the case that the information interaction apparatus includes an interaction module disposed in each of the plurality of storage areas, when a target storage area in which the interaction module is selected exists in the plurality of storage areas, determining the target storage area as the first storage location of the first food material.
In an exemplary embodiment, the first obtaining module is further configured to obtain the target query request sent by a target terminal, where the target terminal has a binding relationship with the refrigerator, the first description information included in the target query request is identification information or a name of the food material to be searched, and the identification information of the food material to be searched is the first identification information obtained by the target terminal from the refrigerator, or is identification information obtained by the target terminal, or is identification information selected from identification information of a group of food materials stored on the target terminal; or third voice information recognized by the voice interaction device on the refrigerator is acquired, and the target query request is recognized in the third voice information, wherein the first description information included in the target query request is identification information or name of the food material to be searched, and the identification information of the food material to be searched is the first identification information acquired by the target terminal from the refrigerator, or the identification information acquired by the target terminal, or identification information selected from identification information of a group of food materials stored on the target terminal.
In an exemplary embodiment, the response module is further configured to one of: displaying the first storage position of the food material to be searched on the refrigerator; playing the first storage position of the food material to be searched on the refrigerator; activating a notification light in the refrigerator at the first storage location.
An embodiment of the present invention further provides a storage medium including a stored program, wherein the program executes any one of the methods described above.
Alternatively, in the present embodiment, the storage medium may be configured to store program codes for performing the following steps:
s1, shooting the first food material through an image acquisition device on the refrigerator to obtain a first image;
s2, acquiring first identification information of the first food material under the condition that the first food material is identified in the first image;
s3, determining a first storage position of the first food material in the refrigerator through a storage position identification device on the refrigerator, and storing the first identification information and the first storage position which have an association relationship;
s4, in the case of receiving a target query request, in response to the target query request, searching for the first identification information matched with first description information, acquiring the first storage location having an association relationship with the first identification information, and outputting the first storage location, wherein the first description information is description information of the food material to be searched identified in the target query request.
Embodiments of the present invention also provide an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, shooting the first food material through an image acquisition device on the refrigerator to obtain a first image;
s2, acquiring first identification information of the first food material under the condition that the first food material is identified in the first image;
s3, determining a first storage position of the first food material in the refrigerator through a storage position identification device on the refrigerator, and storing the first identification information and the first storage position which have an association relationship;
s4, in the case of receiving a target query request, in response to the target query request, searching for the first identification information matched with first description information, acquiring the first storage location having an association relationship with the first identification information, and outputting the first storage location, wherein the first description information is description information of the food material to be searched identified in the target query request.
Optionally, in this embodiment, the storage medium may include, but is not limited to: various media capable of storing program codes, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The foregoing is only a preferred embodiment of the present application and it should be noted that those skilled in the art can make several improvements and modifications without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.
Claims (10)
1. A method for indicating a storage location, comprising:
shooting the first food material through an image acquisition device on the refrigerator to obtain a first image;
under the condition that the first food material is identified in the first image, acquiring first identification information of the first food material;
determining a first storage position of the first food material in the refrigerator through a storage position identification device on the refrigerator, and storing the first identification information and the first storage position which have an association relationship;
under the condition that a target query request is received, responding to the target query request, searching the first identification information matched with first description information, acquiring the first storage position having an association relation with the first identification information, and outputting the first storage position, wherein the first description information is the description information of the food material to be searched and is identified in the target query request.
2. The method of claim 1, wherein the determining, by a storage location identification device on the refrigerator, a first storage location of the first food material in the refrigerator comprises one of:
under the condition that the storage position recognition device is a voice interaction device, acquiring first voice information through the voice interaction device, and recognizing the first storage position of the first food material from the first voice information;
determining, by the weight recognition device, weight change information corresponding to a plurality of storage areas in the refrigerator, respectively, and determining the first storage location of the first food material according to the weight change information, in a case where the storage location recognition device is a weight recognition device;
and under the condition that the storage position identification device is an information interaction device, acquiring a first storage position of the input first food material through the information interaction device.
3. The method of claim 2, wherein the obtaining of the first voice message by the voice messaging device and the identifying of the first storage location of the first food material from the first voice message comprises one of:
acquiring first voice information through the voice delivery device, identifying the first storage position from the first voice information, and determining the first storage position as a storage position of the first food material in the refrigerator under the condition that the first voice information is acquired within a first duration after or before the first image is shot;
acquiring second voice information through the voice communication device, recognizing the first storage position and second description information from the second voice information, and determining the first storage position as the storage position of the first food material in the refrigerator under the condition that the second description information is matched with the first identification information;
the method comprises the steps that first voice information is obtained through the voice delivery device, the first storage position is identified from the first voice information, and the first storage position is determined to be the storage position of the first food material in the refrigerator when the first voice information is obtained after the first image is shot and before the image acquisition device shoots a second food material to obtain a second image.
4. The method of claim 2, wherein the determining, by the weight recognition device, weight change information corresponding to a plurality of storage areas in the refrigerator respectively, and the determining the first storage location of the first food material according to the weight change information comprises:
in the case where the weight identifying means includes a weight identifying module provided in each of the plurality of storage areas, acquiring a weight change value identified by the weight identifying module provided in each of the plurality of storage areas within a second period of time after the first image is captured;
determining a target storage area as the first storage location of the first food material if the target storage area has a weight variation value greater than or equal to a preset threshold value among the plurality of storage areas.
5. The method of claim 2, wherein the obtaining the input of the first storage location of the first food material via the information interaction device comprises:
under the condition that the information interaction device is a touch screen and the marks of the storage areas are displayed on the touch screen, when the mark of a target storage area in the marks of the storage areas is selected, determining the target storage area as the first storage position of the first food material; or
In a case where the information interaction apparatus includes an interaction module provided in each of the plurality of storage areas, when a target storage area in which the interaction module is selected exists among the plurality of storage areas, the target storage area is determined as the first storage location of the first food material.
6. The method of claim 1, wherein prior to responding to the target query request, the method includes at least one of:
acquiring the target query request sent by a target terminal, wherein the target terminal has a binding relationship with the refrigerator, the first description information included in the target query request is identification information or a name of the food material to be searched, and the identification information of the food material to be searched is the first identification information acquired by the target terminal from the refrigerator, or is the identification information acquired by the target terminal, or is identification information selected from identification information of a group of food materials stored on the target terminal; or
Acquiring third voice information recognized by the voice interaction device on the refrigerator, and recognizing the target query request in the third voice information, wherein the first description information included in the target query request is identification information or name of the food material to be searched, and the identification information of the food material to be searched is the first identification information acquired by the target terminal from the refrigerator, or the identification information acquired by the target terminal, or identification information selected from identification information of a group of food materials stored on the target terminal.
7. The method of any one of claims 1 to 6, wherein said outputting said first storage location comprises one of:
displaying the first storage position of the food material to be searched on the refrigerator;
playing the first storage position of the food material to be searched on the refrigerator;
activating a notification light in the refrigerator at the first storage location.
8. A storage location reminder device, comprising:
the first acquisition module is used for shooting the first food material through an image acquisition device on the refrigerator to obtain a first image;
the second obtaining module is used for obtaining first identification information of the first food material under the condition that the first food material is identified in the first image;
the determining module is used for determining a first storage position of the first food material in the refrigerator through a storage position identification device on the refrigerator, and storing the first identification information and the first storage position which have an association relationship;
the response module is used for responding to a target query request under the condition that the target query request is received, searching the first identification information matched with the first description information, acquiring the first storage position having an association relation with the first identification information, and outputting the first storage position, wherein the first description information is the description information of the food material to be queried, which is identified in the target query request.
9. A computer-readable storage medium, comprising a stored program, wherein the program is operable to perform the method of any one of claims 1 to 7.
10. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to execute the method of any of claims 1 to 7 by means of the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210171081.6A CN114691730A (en) | 2022-02-23 | 2022-02-23 | Storage position prompting method and device, storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210171081.6A CN114691730A (en) | 2022-02-23 | 2022-02-23 | Storage position prompting method and device, storage medium and electronic device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114691730A true CN114691730A (en) | 2022-07-01 |
Family
ID=82138009
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210171081.6A Pending CN114691730A (en) | 2022-02-23 | 2022-02-23 | Storage position prompting method and device, storage medium and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114691730A (en) |
-
2022
- 2022-02-23 CN CN202210171081.6A patent/CN114691730A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115167164A (en) | Method and device for determining equipment scene, storage medium and electronic device | |
| CN114697150A (en) | Command issuing method and device, storage medium and electronic device | |
| CN114855416A (en) | Recommendation method and device of washing program, storage medium and electronic device | |
| CN115174512A (en) | Message pushing method and device, storage medium and electronic device | |
| CN114675928A (en) | Container mirror image construction method and device, storage medium and electronic device | |
| CN113194155A (en) | Method and device for intelligently recommending scenes in Internet of things | |
| CN114915514B (en) | Method and device for processing intention, storage medium and electronic device | |
| CN116382111A (en) | Equipment control method and device, storage medium and electronic device | |
| CN114691730A (en) | Storage position prompting method and device, storage medium and electronic device | |
| CN114691731A (en) | Usage preference determination method and apparatus, storage medium, and electronic apparatus | |
| CN115473755A (en) | Control method and device of intelligent equipment based on digital twins | |
| CN115631832A (en) | Cooking plan determination method and device, storage medium and electronic device | |
| CN114864047A (en) | Recipe recommendation method, storage medium and electronic device | |
| CN114861678A (en) | Method and apparatus for determining time information, storage medium, and electronic apparatus | |
| CN115988152B (en) | Method and device for generating target cooking video, storage medium and electronic device | |
| CN115168699A (en) | Behavior data processing method, storage medium and electronic device | |
| CN116980439A (en) | Label data adjusting method and device, storage medium and electronic device | |
| CN116382110A (en) | Equipment scheduling method and device, storage medium and electronic device | |
| CN115691558A (en) | Method and device for receiving reply result, storage medium and electronic device | |
| CN115032907A (en) | Method and device for updating perception parameters, storage medium and electronic device | |
| CN117376042A (en) | Functional platform configuration method and device of intelligent equipment and electronic device | |
| CN115987935A (en) | Notification message pushing method and device, storage medium and electronic device | |
| CN115453897A (en) | Method and device for determining intention instruction, storage medium and electronic device | |
| CN115062221A (en) | Method and device for determining corpus hotness, storage medium and electronic device | |
| CN115866032A (en) | Data transmission method and device, storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |