CN114294898B

CN114294898B - Refrigerator and voice control method

Info

Publication number: CN114294898B
Application number: CN202110433466.0A
Authority: CN
Inventors: 卢可敬; 孔祥键; 刘洋
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2021-04-19
Filing date: 2021-04-19
Publication date: 2023-02-17
Anticipated expiration: 2041-04-19
Also published as: CN114294898A

Abstract

The application discloses a refrigerator and a voice control method, and when a food material editing interface is displayed, a user can input or modify the quantity of food materials by inputting a voice password. When the quantity of the food materials is input through voice control, even if the quantity metering units displayed in the food material editing interface are inconsistent with the quantity metering units in the voice passwords of the user, the input operation can be finished, and the user does not need to input the voice passwords according to the displayed quantity metering units. When the quantity of the food materials stored in advance is modified through voice control, the modification operation can be completed only by matching the quantity measuring unit in the voice password of the user with the category of the metering unit stored in advance, and the quantity measuring unit in the voice password of the user is not required to be completely consistent with the metering unit stored in advance. And the refrigerator displays the quantity metering units spoken by the user when the quantity metering units spoken by the user are inconsistent with the currently default displayed metering units so as to improve the user experience.

Description

Refrigerator and voice control method

Technical Field

The application relates to the technical field of refrigerators, in particular to a refrigerator and a voice control method.

Background

Currently, a multi-compartment refrigerator having a Radio Frequency Identification (RFID) function can intelligently manage food stored therein.

Generally, a user can control a food material editing interface displayed on a display screen, so that food material information for associating with the RFID tag, such as a food material name, a food material shelf life, a food material quantity and the like, is input in the food material editing interface. After receiving the food material information input by the user, the refrigerator establishes association with the tag information of the RFID tag and stores the tag information. After the food materials attached with the RFID tags are placed in the storage chamber by a user, the tag information of the RFID tags on the food materials can be read by the antenna in the storage chamber, and then the refrigerator can determine the food material information related to the tags according to the tag information.

In order to improve the user experience, some refrigerators support the user to input food material information by voice. When the food material information is input through voice control, if the expression mode of a user is not standard, the accuracy of receiving the food material information by the refrigerator is affected. Therefore, when the expression of the user is not standard, how to process the voice data of the user is an urgent technical problem to be solved.

Disclosure of Invention

The application provides a refrigerator and a voice control method, which aim to solve the problem of how to process voice data of a user if the expression mode of the user is not standard when food material information is input through voice control.

In a first aspect, the present application provides a refrigerator comprising:

a case having a storage chamber therein;

the door is arranged at the opening of the storage chamber;

the display screen is arranged on the box door and used for displaying a food material editing interface, and input items corresponding to the number of food materials are displayed on the food material editing interface;

the voice collector is used for receiving a voice password input by a user;

a controller coupled to the display screen and the sound collector and configured to:

when the food material editing interface is displayed, receiving a voice command input by a user through a sound collector;

analyzing the voice password to obtain an operation type and target operation data for operating the food material quantity, wherein the target operation data comprises a target operand value and a target metering unit;

determining a target display numerical value measured in the target metering unit according to the operation type and the target operation data, wherein the target display numerical value is the target operation numerical value when the operation type represents an operation of inputting the quantity of the food materials, and the target display numerical value is determined according to the target operation numerical value and the quantity of the previously stored food materials when the operation type represents an operation of modifying the quantity of the previously stored food materials and the target metering unit is matched with the previously stored metering unit type;

and taking the target display numerical value and the target metering unit as input contents corresponding to the food material quantity, and displaying the input contents in the food material editing interface.

In a second aspect, the application further provides a voice control method, which is applied to a refrigerator, wherein the refrigerator comprises a display screen, the display screen is used for displaying a food material editing interface, and input items corresponding to the number of food materials are displayed on the food material editing interface; the method comprises the following steps:

when the food material editing interface is displayed, receiving a voice password input by a user;

According to the technical scheme, based on the refrigerator and the voice control method provided by the embodiment of the application, when the food material editing interface is displayed, a user can input or modify the number of food materials by inputting a voice command. When the quantity of the food materials is input through voice control, even if the quantity metering unit displayed in the food material editing interface is inconsistent with the quantity metering unit in the user voice password, the input operation can be finished, the user does not need to input the voice password according to the displayed quantity metering unit, and only the spoken quantity metering unit is the preset metering unit. When the quantity of the food materials stored in advance is modified through voice control, the modification operation can be completed only by matching the quantity metering unit in the user voice password with the type of the metering unit stored in advance, and the quantity metering unit in the user voice password is not required to be completely consistent with the metering unit stored in advance. And the refrigerator displays the quantity metering units spoken by the user when the quantity metering units spoken by the user are inconsistent with the currently default displayed metering units so as to improve the user experience.

Drawings

In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.

FIG. 1a is a perspective view of a refrigerator illustrated in accordance with an exemplary embodiment of the present application;

FIG. 1b is a schematic view of the exterior of a refrigerator shown in accordance with an exemplary embodiment of the present application;

FIG. 2 is a schematic diagram of a hardware configuration of a refrigerator shown in accordance with an exemplary embodiment of the present application;

fig. 3 illustrates a food material management interface according to an exemplary embodiment of the present application;

fig. 4 is a food material editing interface according to an exemplary embodiment of the present application;

fig. 5 is another food material editing interface according to an exemplary embodiment shown in the present application;

fig. 6 is a further food material editing interface shown according to an exemplary embodiment of the present application;

fig. 7 is a further food material editing interface shown in the present application according to an exemplary embodiment;

fig. 8 is a further food material editing interface according to an exemplary embodiment shown in the present application;

fig. 9 is a further food material editing interface according to an exemplary embodiment shown herein;

fig. 10 is a further food material editing interface shown in the present application according to an exemplary embodiment;

FIG. 11 is a flow chart illustrating a voice control method according to an exemplary embodiment of the present application.

Detailed Description

In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

In the description of the present invention, it is to be understood that the terms "center", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. indicate orientations or positional relationships based on those shown in the drawings, and are merely for convenience of description and simplicity of description, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be constructed in a particular orientation, and be operated, and thus, are not to be construed as limiting the present invention.

The terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, "a plurality" means two or more unless otherwise specified.

In the description of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.

Fig. 1a is a perspective view of a refrigerator according to an exemplary embodiment of the present application, which is provided in an embodiment of the present invention and has a shape of an approximately rectangular parallelepiped. The external appearance of the refrigerator is defined by a storage chamber 101 providing a limited storage space and a plurality of doors 200 provided at an opening of the storage chamber 101. The storage chamber 101 is a cabinet 100 having an opening, and in the example shown in fig. 1A, the storage chamber 101 is comprised of a freezing chamber 101A located below and a refrigerating chamber 101B located above, and the freezing chamber 101A and the refrigerating chamber 101B have one or more independent storage spaces, respectively.

In some embodiments, the freezer compartment 101A may be selectively covered by a drawer-style freezer compartment door 200A. The refrigerating compartment 101B is partitioned into left and right sides. The refrigerating compartment 101B is selectively opened or closed by a refrigerating compartment door 200B pivotably mounted on the refrigerating compartment 101B.

Fig. 1B is a schematic external view of a refrigerator according to an exemplary embodiment of the present disclosure, and as shown in fig. 1B, a display screen is disposed on the refrigerating chamber door 200B, and the display screen is embedded in the door body. A tag reading area is provided at a position below the display screen on the refrigerating chamber door 200B, and an antenna for reading an RFID tag is built in the tag reading area to be used for recognizing the RFID tag at a short distance.

In some embodiments, the screen of the display screen is positioned in a plane flush with the outer surface of the door.

As shown in fig. 1a and fig. 1b, a refrigerator provided in an embodiment of the present application has at least two storage compartments, such as a freezing compartment, a refrigerating compartment, a temperature-changing compartment, and/or a fresh food compartment, disposed inside a refrigerator body. Each storage compartment may have a plurality of separate storage spaces therein, such as drawer compartments.

Fig. 2 is a schematic diagram of a hardware configuration of a refrigerator according to an exemplary embodiment of the present application, and by way of example, the refrigerator 200 may include a display screen 210, a controller 220, a plurality of antennas 230 for detecting an RFID tag, a detector 240, a memory 250, and several user input interfaces. The display screen 210, antenna 230, detector 240, and memory 250 are coupled to the controller 220 through a communication interface. The display 210 is configured to receive the image signal output by the controller 220, perform a component for displaying video content and images and a menu manipulation interface, and display a user manipulation UI interface for controlling the refrigerator 200.

The controller 220 may include one or more processing units, such as a system on a chip (SoC), a Central Processing Unit (CPU), a Microcontroller (MCU), a memory controller, and the like. The different processing units may be separate devices or may be integrated into one or more processors.

In some embodiments, controller 220 communicates with antenna 230 via a serial port.

In some embodiments, the controller 220 includes an RFID module, and the RFID module, the antenna 230 and the RFID tag form an RFID read/write system, the antenna 230 is used for transmitting radio frequency signals between the RFID module and the RFID tag, and the RFID module completes read/write operations on the RFID tag through the antenna 230.

In some embodiments, the RFID module communicates with the antenna through a serial port.

The memory 250 may include one or more memory units, for example, a volatile memory (volatile memory), such as: dynamic Random Access Memory (DRAM), static Random Access Memory (SRAM), and the like; non-volatile memory (NVM) may also be included, such as: read-only memory (ROM), flash memory (flash memory), and the like. The different memory units may be separate devices, or may be integrated or packaged in one or more processors or communication interfaces, and become a part of the processors or communication interfaces.

The memory 250 has stored therein program instructions and application programs, such as voice applications. The controller 220 may call the program instructions in the memory 250 or run an application program, so that the refrigerator executes a related method, for example, the method for scanning the food material tag provided in the embodiment of the present application.

The detector 240, including at least a sound collector such as a microphone, may be used to receive the user's voice. Illustratively, a voice signal including a control instruction of the user controlling the refrigerator 200. The detector 240 may further include a door opening and closing state sensor, such as a detection magnetic sensitive switch, a mechanical switch, for detecting an opening and closing signal of each door, and transmitting opening and closing state information to the controller 220 while recording the opening and closing state of the door according to the detected opening and closing signal. Illustratively, when the detector detects an opening signal or a closing signal of any one of the doors, the latest switch state information is transmitted to the controller 220.

A user input interface including at least one of a microphone, a touchpad, a sensor, a key, and other input interfaces. Such as: the user can input a user command through voice, touch, gesture, pressing, and other actions, and the input interface converts the received analog signal into a digital signal and converts the digital signal into a corresponding command signal, and sends the command signal to the controller 220.

In some embodiments, the controller 220 may include a voice recognition module, and the voice recognition module further includes a voice parsing unit and a voice command database, so that the refrigerator can independently perform voice recognition of voice data input by a user and a process of matching recognized voice contents with voice commands in the voice command database.

The number of antennas 230 is not limited in this application. For example, the antenna 230 may include an antenna provided in each of the storage compartments and an antenna provided inside the tag reading area, wherein the antenna provided in each of the storage compartments is mainly used to scan the RFID tag in each of the storage compartments to read the tag information of the RFID tag, and the antenna provided inside the tag reading area is mainly used to scan the RFID tag on the tag reading area to read the tag information of the RFID tag.

In some embodiments, the power of the antennas provided in different storage compartments may be different. And the power of the antenna of each storage room can ensure that the antenna can identify the food materials in the self room, thereby avoiding that the error identification rate is increased when the power is too high and the food materials in the incomplete self room can be identified when the power is too low. In a specific implementation, the power of the antenna can be determined in advance according to the space size of each storage room, and the power of each antenna is set in the refrigerator, and the larger the space is, the larger the power is.

In some embodiments, the antenna disposed under the tag reading area is referred to as a first antenna, and the antenna disposed in the storage compartment is referred to as a second antenna.

In order to realize intelligent management of food materials, the food materials in the storeroom are identified by using RFID labels.

In some embodiments, the virtual association between the RFID tag and the food material information is achieved by establishing a correspondence between the RFID tag and the food material information. By modifying the corresponding relation between the RFID tags and the food material information, the same RFID tag is sequentially associated with different food material information, and the use flexibility of the RFID tag is improved. And storing the food material attached with the RFID tag in a refrigerator, detecting the RFID tag in the storage room through the second antenna to acquire tag information of the food material, and determining the food material identified by the tag according to the incidence relation between the tag information and the food material information.

It should be understood that the food material associated/identified by the RFID tag in the embodiments of the present application refers to food material information associated/corresponding to the RFID tag.

In some embodiments, the tag information includes a tag code, and a particular code segment in the tag code identifies the tag. The corresponding relation between the identification information of the RFID tag and the food material information is established, and the virtual association of the RFID tag and the food material can be realized. And then, after the tag identification of the RFID tag in the storage room is obtained, the food material corresponding to the RFID tag can be determined according to the tag identification and the pre-established corresponding relation.

In some embodiments, the food material information includes one or more of a food material ID, a food material name, storage compartment information, a food material number, a food material shelf life, a putting time, and the like. The storage position of the food material can be determined according to the storage room information, and if the storage room information contained in the food material information apple is 'refrigerating room', the apple can be determined to be stored in the refrigerating room.

For example, the pre-established correspondence relationship between the RFID tag and the food material information may be shown in the following table:

RFID	food material information
		Identification
1	001, apple, refrigerator, 1000g, 5 days 2 month
		Identification
2	002, cucumber, cold storage, 1000g,2 months and 2 days
		Identification
3	003, pork, freezing chamber, 4000g,1 month and 8 days
		……	……

In some embodiments, a food material management interface is displayed on the display screen 210, and the user manages food materials in the refrigerator by operating the food material management interface. For example, corresponding food material controls/icons are drawn in the food material management interface according to the food material information associated with each RFID tag in the storage room, so that the food materials in the refrigerator are displayed in the forms of icons, pictures and texts, and the like. In addition, functional controls, such as an RFID tag editing control, a food material adding control, and the like, can be drawn in the food material management interface, so that a user can operate the functional controls to trigger the controller 220 to implement corresponding functions.

In some embodiments, the food material management interface can include a plurality of food material display areas, and one food material display area can correspond to one storage chamber. The food material icons of the food materials in the storage chambers are displayed in the food material display areas corresponding to the storage chambers, so that the food materials in the refrigerator are displayed in a partitioned mode. For example, food material icons of the food materials in the refrigerating chamber are displayed in the food material display area corresponding to the refrigerating chamber. The food material icons displayed in the food material management interface include but are not limited to food material pictures, food material names and freshness identifiers of food materials. The food material picture can be a pictographic picture of a food material, the freshness identification of the food material is used for showing any one or more of the input time, the remaining time with the overdue distance and the expiration time of the food material, and the remaining time with the overdue distance is determined according to the input time and the expiration date of the food material. It is to be understood that the food material picture, the food material name, the freshness identification of the food material, etc. may be part of, i.e. comprised in, the food material icon.

Fig. 3 is a user interface according to an exemplary embodiment of the present application, which is specifically an exemplary food material management interface. Referring to fig. 3, the food material management interface includes an RFID tag editing control 301, a recommended menu control 302, and an add food material control 306, and further includes food material display areas corresponding to the storage chambers, such as a food material display area 303 corresponding to the cold storage chamber, a food material display area 304 corresponding to the temperature-changing chamber, and a food material display area 305 corresponding to the cold temperature chamber. Food material icons corresponding to the food materials in the storage chamber are displayed in each food material display area, such as food material 1, food material 2 and food material 3 in the food material display area 303, food material 4 and food material 5 in the food material display area 304, and food material 6 and food material 7 in the food material display area 305. Each food material icon comprises a food material picture, a food material name and a freshness identification of the food material. Taking the food material 3[3031] as an example, it includes a food material picture 30311, a food material name "food material 1"30312, and a freshness identifier 30313. It should be noted that, in fig. 3, since the food material 1 is expired, the stamp mark having the word "expired" is displayed on the food material picture as the freshness mark of the food material 1, so that the user can quickly notice the expired food material in the refrigerator.

In some embodiments, when the food material is less than a preset number of days away from the remaining days of expiration, the specific number of days remaining is explicitly shown by the freshness indicator. For example, in the food material management interface shown in fig. 3, since the remaining days from the expiration of the food material 4[3041] is less than the preset number of days, the freshness indicator [30411] of the food material 4 includes a text prompt of "2 days remaining", so that the user can quickly obtain the remaining days of the food material to be expired.

In specific implementation, the food material management interface may be an interface of a food material management related application operated by the controller 220, and the user may trigger and display the food material management interface on the food material management related application. When the food material management related application receives user operation for triggering display of the food material management interface, the food material information set is read from the memory, and corresponding food material icons are displayed in the food material management interface according to the food material information in the food material information set.

In some embodiments, the tag encoding of the RFID tag may include one or more code segments.

In some embodiments, a plurality of code segments included in the tag code of the RFID tag conform to a preset composition rule, and after the tag code is obtained, the controller intercepts a code segment corresponding to the tag identifier according to the preset composition rule to obtain a unique identifier of the tag, that is, the tag identifier. One code segment in the label code is used as the label identification of the RFID label, and the identification length is shortened, so that the efficiency of the identification comparison process can be improved.

In some embodiments, the RFID tags may include predefined tags and custom tags, where the predefined tags are associated with preset food material information in advance and cannot be changed or defined by a user; the custom tag can be associated with the food material information input by the user, namely, can be defined by the user. When an RFID tag is given, it can be distinguished as either a custom tag or a predefined tag according to its tag code. For example, a specific code segment encoded by its tag is a predefined code 00, it is a custom tag, and a specific code segment encoded by its tag is not a predefined code 00, it is a predefined tag.

In some embodiments, an instruction for instructing to edit the food material information may be input in the food material management interface, or an RFID tag to be edited may be directly placed on the tag reading area, so as to trigger a process of establishing an association relationship between the food material information and the custom tag.

Specifically, when the food material management interface is displayed on the display screen, the user clicks a food material information editing control provided by the food material management interface to input an instruction for instructing to edit the food material information. After receiving the instruction, the controller displays a label scanning interface, displays a scanning prompt in the label scanning interface, and scans signals of the RFID label on the label reading area through the RFID module and the antenna 230. Wherein, by displaying the scan prompt, the user is prompted to place the RFID tag to be edited on the tag reading area. According to the scanning prompt, the user places the RFID tag to be edited on the tag reading area, and the RFID module and the antenna 230 scan the RFID tag on the tag reading area and acquire the tag encoding information of the tag. Then, the controller intercepts an appointed code segment from the label code, judges whether the label is a self-defined label according to whether the appointed code segment is a preset code or not, judges that the label is the self-defined label if the appointed code segment is the preset code, intercepts a label identification from the label code at the moment, and displays a food material editing interface.

Or, the user directly places the RFID tag to be edited on the tag reading area without clicking the food material information editing control on the food material management interface. And the controller responds to the detection of the RFID label on the label reading area and displays the food material editing interface.

In some embodiments, the user may also instruct the instruction for editing the food material information by speaking a preset voice password. For example, the user speaks: "tag editing". When voice data input by a user is received and the content is recognized as 'tag editing', the fact that an input preset voice instruction for triggering the food material information corresponding to the RFID tag to be edited is received is confirmed. At this time, the controller displays a tag scanning interface in response to the instruction, and starts detecting the RFID tag on the tag reading area. And when the RFID label on the label reading area is detected, displaying a food material editing interface.

The user can input food material information in the food material editing interface, and after the controller receives the food material information input by the user, the controller associates the food material information with the RFID tag and stores the association relationship locally.

And if the appointed code segment intercepted from the label code is not the preset code, judging that the label is the predefined label, at the moment, acquiring preset food material information corresponding to the predefined label according to the food material code contained in the label code of the label, displaying a food material editing interface according to the preset food material information corresponding to the label, and prompting a user that the label cannot be marked. The corresponding relation between the food material codes and the preset food material information can be stored in the cloud and preset locally.

In some embodiments, at least one input item is displayed in the food material editing interface, each input item comprises an item name and input content, wherein the input content is a part to be edited, and a user can input food material information for associating with the target tag by inputting the input content of each item at an input position. After the input is finished, the controller correspondingly stores the input food material information and the identification information of the tag in the food material information set, so that the establishment of the association relationship between the tag and the food material information is finished.

For example, the input items in the food material editing interface may include a food material name input item, a food material shelf life input item, a food material quantity input item, and the like. It should be understood that the item name of the food material name input item may be "tag name", the input content is the name of the food material to be input, the item name of the food material shelf life input item may be "shelf life", the input content is the shelf life to be input, the item name of the food material quantity input item may be "quantity", and the input content is the quantity to be input. In addition, the identification information of the tag to be edited can be displayed in the food material editing interface, so that a user can visually see the identification information of the tag without manually inputting the identification information by the user, and the user experience is improved.

Fig. 4 is a food material editing interface according to an exemplary embodiment of the present application, as shown in fig. 4, identification information "20200005" of an RFID tag is displayed on the food material editing interface, so that a user does not need to manually input the identification information, thereby avoiding an input error and saving user operations. Also displayed are a plurality of input items, respectively a food material name input item 410, a food material expiration date input item 420, and a food material quantity input item 430, wherein each food material input item corresponds to an input position for inputting corresponding content. In addition, a "cancel" control 440 and a "determine" control 450 are displayed. After the information input is finished, the user can click the 'confirm' control to indicate that the input food material information is stored, or click the 'cancel' control to indicate that the input food material information returns to the upper-level interface.

In some embodiments, the process of the controller displaying the food material editing interface may include: firstly, judging whether corresponding food material information exists in a food material information set or not according to identification information of a label to be edited; if the corresponding food material information exists in the food material information set, displaying input contents corresponding to the input items in a food material editing interface according to the food material information; and if the corresponding food material information does not exist in the food material information set, displaying item contents corresponding to the editing items in a food material editing interface according to the preset filling information.

In one example, determining whether the food material information set has corresponding food material information according to the identification information of the tag to be edited specifically includes: fig. 5 shows the food material editing interfaces displayed for apple, 1 month, and 2 portions. Referring to fig. 5, in the food material editing interface, the input content corresponding to the "label name" is "apple", the input content corresponding to the "shelf life" is "1 month", and the input content corresponding to the "number" is "2 copies". Through the food material editing interface, a user can know the food material information related to the tag to be edited in advance, and can input new food material information by modifying the displayed input content.

In another example, if it is determined that there is no corresponding food material information in the food material information set according to the identification information of the tag to be edited, the displayed food material editing interface is as shown in fig. 6. Referring to fig. 6, in the food material editing interface, the input contents corresponding to the "label name", "shelf life", and "quantity" are all predefined filling characters "undefined". Through the food material editing interface, a user can know that a target label is a brand-new label, and can input food material information used for being associated with the label to be edited through inputting the content of each editing item.

It should be noted that in the food material editing interfaces shown in fig. 4-6, the input positions corresponding to the "shelf life" and the "number" are displayed with the measurement units by default, and as in fig. 4, the measurement units of the shelf life are displayed as "days" and the measurement units of the number are not displayed as "g". In fig. 5, the measured units of shelf life are shown as "months" and the measured units of quantity are shown as "parts". And in fig. 6, the measured units of shelf life are shown as "days" and the measured units of quantity are shown as "jin". When the food material editing interface is displayed, a user can set the quality guarantee period and/or the metering units of the quantity of food materials according to requirements. For example, when the food material management interface shown in fig. 4 is displayed, the user may click on a pull-down control next to a measurement unit to control the display of the measurement unit options.

For example, when the food material editing interface shown in fig. 4 is displayed, the user may click on a pull-down control next to the food material quantity metering unit to control the metering unit option of the food material quantity to pop up, as shown in fig. 7. After the metering unit option of the food material quantity is popped up, the user can select the metering unit to be set through click operation, as shown in the example shown in fig. 7, after the user selects "share", the metering unit option is retracted, and the metering unit displayed in the food material editing interface is changed from "g" to "share".

In some embodiments, the user may input the food material information through a voice password while displaying the food material editing interface. The voice password may comprise one or more pieces of operation instruction information, such as instruction information of the name of the operation food material, instruction information of the shelf life of the operation food material and instruction information of the quantity of the operation food material. For example, when displaying the food material editing interface, if the user says: the controller can analyze the instruction information for operating the name of the food material and the instruction information for operating the quantity of the food material from the voice command by defining the beef tag of 2 jin. As another example, when displaying the food material editing interface, if the user says: the controller can analyze instruction information for operating the food material shelf life from the voice password. Furthermore, the controller can input the content corresponding to the corresponding item according to the analyzed instruction information and display the content in the food material editing interface without inputting characters by a user. Therefore, user operation can be further reduced, the editing process is quicker, the universality degree of the function can be improved, and old people or children who cannot type can also edit food material information.

In some embodiments, when the controller detects that the user places the RFID tag on the tag reading area, a voice recognition content area is displayed in the food material editing interface, and the receiving and recognizing of the voice password of the user are started, wherein the input prompt and the recognized voice content can be displayed in the voice recognition content area. In some embodiments, the food material editing area and the speech recognition content area may be two different view display areas. The different view display areas may be areas belonging to the same layer, or may be areas belonging to different layers.

Fig. 8 illustrates a food material editing interface including a speech recognition content area according to some embodiments of the present application. As shown in fig. 8, the speech recognition content area 810 is displayed at the uppermost layer of the food material editing interface, and is not overlapped with the food material editing area 820. An input prompt is displayed in the speech recognition content area 810, specifically, a text prompt indicating that "you can say i want to define 2 jin of juicy peaches" is displayed. When the voice password input by the user is received and the voice content is recognized, the recognized voice content can be displayed in the voice recognition content area.

In some embodiments, the controller receives a voice password input by a user and sends voice password data to the server; the server analyzes the voice password data to obtain corresponding voice content, and generates voice instruction information according to the voice content, wherein the voice instruction information comprises a plurality of fields, one field corresponds to one food input item, the field name is an item name, and the field value is an operation type and/or operation data. The server returns the generated voice instruction information to the controller, and the controller operates the corresponding input items according to the field values of the fields in the voice instruction information and displays the contents of the corresponding input items.

In some embodiments, the controller obtains instruction information for operating the food material quantity by analyzing the input voice password, wherein the instruction information comprises an operation type and target operation data, and the target operation data comprises a target operand value and a target metering unit. The target operand carrying the target metering unit is the original voice content directly analyzed from the voice password, for example, if the voice password input by the user is 'i want to define 2 jin beef', the target operand carrying the target metering unit is '2 jin'. As a possible implementation manner, the operation on the number of the food materials comprises an input operation and a modification operation, wherein the input operation is to store a target operand value indicated in a voice password under the condition that the number of the food materials is not stored in advance; the modifying operation refers to increasing or decreasing the number of the previously stored food materials according to the target operation value indicated in the voice password under the condition of the number of the previously stored food materials.

It is noted that in some implementations, the controller parses the entered voice password through the server, and the server parses the voice content from the voice password and returns the voice content to the refrigerator controller. And the refrigerator controller determines instruction information for operating the food material quantity according to the voice content returned by the server. In other implementation manners, the controller analyzes the input voice password through the server, the server analyzes the voice content from the voice password, determines the instruction information for operating the food material quantity according to the voice content, and returns the instruction information to the refrigerator controller. The voice content comprises a target operand value carrying a target metering unit.

In the implementation mode, after the server or the refrigerator controller analyzes the target metering unit and the target operation numerical value from the voice password, whether the target metering unit is a preset metering unit or not and whether the target operation numerical value falls within an allowable operation range preset by the target metering unit or not are judged; and if the target metering unit is a preset metering unit and the target operand value is within the allowable operation range, obtaining target operation data comprising the target operand value and the target metering unit. If the target measurement unit is not the preset measurement unit, or the target operand value does not fall within the allowable operation range, the flow ends. For example, the preset measurement units may be divided into a weight measurement unit, a singular measurement unit, and a plural measurement unit. Wherein, the weight measurement unit can include kilogram, gram and kilogram, the unit measurement unit can include handle, share, piece, block, strip, bottle, root, only, granule, piece, string, disk, can, cup, can, etc., the plural measurement unit can include bag, box, etc.

It should be noted that, when the voice password input by the user includes the operation type information, the server may parse the operation type information from the voice password, and when the voice password input by the user does not include the operation type information, the server may not parse the operation type information from the voice password. And if the server fails to analyze the operation type information from the voice password or the analyzed operation type is not an operation type supported by the refrigerator controller, taking the input operation as a target operation to determine an operation type representing the input operation.

The controller obtains instruction information for operating the quantity of the food materials by analyzing the input voice password according to the controller, determines a target display numerical value in a target metering unit according to the operation type and the target operation data in the instruction information, and displays the target display numerical value and the target metering unit in a food material editing interface as input content corresponding to the quantity of the food materials. The step of determining the target display numerical value may specifically include:

and when the operation type represents the input operation, determining the target operand value in the instruction information as a target display numerical value. For example, the voice password input by the user is "i want to define 2 jin beef", and it can be known from the voice password that the operation type is input operation, the target operand is 2, and the target measurement unit is jin. In this example, the target display numerical value is the target operand value, i.e., 2. In this way, even if the quantity metering unit displayed in the food material editing interface is inconsistent with the quantity metering unit in the user voice password, the input operation of the food material quantity can be completed, and the user does not need to input the voice password according to the displayed quantity metering unit, and only needs to say that the quantity metering unit is the preset metering unit. And the refrigerator displays the quantity metering units spoken by the user when the quantity metering units spoken by the user are inconsistent with the currently default displayed metering units so as to improve the user experience.

When the operation type representation modification operation is performed, whether the target metering unit is matched with the category of the previously stored metering unit is judged firstly. The previously stored metering unit is the metering unit of the amount of the previously stored food materials. Under the condition that the target metering unit is matched with the type of the metering unit stored in advance, if the operation type represents the increasing operation, determining the sum of the food material quantity value stored in advance and the target operand value as a target display numerical value; and if the operation type represents the reduction operation, determining the difference value between the previously stored food material quantity value and the target operand value as a target display numerical value. Therefore, when a user modifies the quantity of the food materials stored in advance through voice control, the modification operation can be completed only by matching the quantity measuring unit in the voice password of the user with the category of the metering unit stored in advance, and the quantity measuring unit in the voice password of the user is not required to be completely consistent with the metering unit stored in advance. And the refrigerator displays the quantity metering units spoken by the user when the quantity metering units spoken by the user are inconsistent with the currently default displayed metering units so as to improve the user experience.

On the contrary, if the target metering unit is not matched with the type of the previously stored metering unit, preset prompt information is displayed on the upper layer of the food material editing interface to prompt a user that the quality guarantee period of the food material cannot be operated according to the input voice command.

In some implementations, the controller determines whether the target unit of measure and the previously stored unit of measure are both units of weight, units of single measure, or units of multiple measure; if the target and previously stored units of measure are weight units, single units of measure or plural units of measure, then it is determined that the categories of the target and previously stored units of measure match. In one example, the input voice password is "i want to define 5 bags of beef", that is, the target metering unit is "bag", and the previously stored metering unit is "jin", which belongs to the weight metering unit. In this example, since "bag" belongs to a plurality of measurement units and "jin" belongs to a weight measurement unit, the two categories do not match. Therefore, a prompt message as shown in fig. 9 needs to be displayed on the food material editing interface, specifically, "the current operation cannot be completed due to a mismatch in measurement units".

It should be noted that, in the case that the target measurement unit and the previously stored measurement unit are both weight units, the step of determining the target display numerical value by the controller may specifically include: judging whether the target metering unit is consistent with the previously stored metering unit; when the target metering unit is inconsistent with the previously stored metering unit, converting the quantity of the previously stored food materials into an intermediate numerical value metered by the target metering unit; and finally, determining a target display numerical value according to the target operand value and the intermediate numerical value, namely determining the sum of the intermediate numerical value and the target operand value as the target display numerical value if the operation type representation increases the operation, and determining the difference value of the intermediate numerical value and the target operand value as the target display numerical value if the operation type representation decreases the operation.

For example, when the food material editing interface is displayed, in response to a voice password input by a user, "i want to define 2 jin of beef and 3 months of shelf life," the content corresponding to the tag name in the food material management interface will be displayed as "beef," the content corresponding to the shelf life of the food material will be displayed as "3 months," and the content corresponding to the number of the food material will be displayed as "2 jin," as shown in fig. 10.

After the content of each input item in the food material editing interface is input, a user can click a confirmation control on the food material editing interface to input confirmation operation. And the controller responds to the received confirmation operation and correspondingly stores the received food material information input by the user and the identification information of the tag to be edited in the food material information set. When the operation on the number of the food materials is an input operation, a target display numerical value carrying a target metering unit is used as one item of food material information and is stored in a food material information set. And when the operation on the number of the food materials is a modification operation, updating the previously stored value of the number of the food materials and the metering unit by using the target display numerical value and the target metering unit.

In addition, the controller also cancels the food material editing interface, displays the food material management interface and updates the food material management interface according to the input food material information in response to the confirmation operation. For example, a food material icon generated according to the input food material information is added to the updated food material management interface.

As can be seen from the above embodiments, based on the refrigerator provided in the embodiments of the present application, when the food material editing interface is displayed, a user can input or modify the number of food materials by inputting a voice password. When the quantity of the food materials is input through voice control, even if the quantity metering unit displayed in the food material editing interface is inconsistent with the quantity metering unit in the user voice password, the input operation can be finished, the user does not need to input the voice password according to the displayed quantity metering unit, and only the spoken quantity metering unit is the preset metering unit. When the quantity of the food materials stored in advance is modified through voice control, the modification operation can be completed only by matching the quantity measuring unit in the voice password of the user with the category of the metering unit stored in advance, and the quantity measuring unit in the voice password of the user is not required to be completely consistent with the metering unit stored in advance. And the refrigerator displays the quantity metering units spoken by the user when the quantity metering units spoken by the user are inconsistent with the currently default displayed metering units so as to improve the user experience.

Based on the refrigerator provided in the embodiment of the present application, an embodiment of the present application further provides a voice control method, as shown in fig. 11, the method may include:

and S111, receiving a voice password input by a user when the food material editing interface is displayed.

And S112, analyzing the voice password to obtain an operation type and target operation data for operating the food material quantity, wherein the target operation data comprises a target operand and a target metering unit.

In some embodiments, the operation type of the operation characterizing the number of input food materials is determined when the operation type is not parsed from the voice password.

In some embodiments, after parsing out a target metering unit and a target operand value from the voice password, determining whether the target metering unit is a preset metering unit and whether the target operand value falls within a preset allowable operation range of the target metering unit; and if the target metering unit is a preset metering unit and the target operand value is within the allowable operation range, determining target operation data comprising the target operand value and the target metering unit.

And S113, determining a target display numerical value measured in the target metering unit according to the operation type and the target operation data, wherein when the operation type represents an operation of inputting the quantity of the food material, the target display numerical value is the target operand value, and when the operation type represents an operation of modifying the quantity of the previously stored food material, the target display numerical value is determined according to the target operand value and the quantity of the previously stored food material under the condition that the target metering unit is matched with the previously stored metering unit type.

In some embodiments, determining whether the target unit of measure matches a category of previously stored units of measure is performed by: judging whether the target metering unit and the previously stored metering unit are both weight units, single metering units or complex metering units; determining that the target metric unit and the previously stored metric unit match in category if the target metric unit and the previously stored metric unit are both weight units, single metric units, or plural metric units.

In some embodiments, the operation of modifying the number of previously stored food materials comprises an increase operation and a decrease operation. Determining the target display value according to the following steps: when the operation type represents the increasing operation, determining the sum of the previously stored food material quantity value and the target operand value as the target display value; and when the operation type represents the reduction operation, determining the difference value between the previously stored food material quantity value and the target operand value as the target display numerical value.

In some embodiments, the step of determining the target display value when the target unit of measure and the previously stored unit of measure are both units of weight further comprises: judging whether the target metering unit is consistent with a previously stored metering unit or not; when the target metering unit is inconsistent with the previously stored metering unit, converting the previously stored food material quantity into an intermediate numerical value metered by the target metering unit; and determining the target display numerical value according to the target operand value and the intermediate numerical value.

In some embodiments, when the operation type represents an operation of modifying the amount of the food material stored in advance, if the target metering unit does not match the category of the metering unit stored in advance, a predetermined prompt message is displayed to prompt a user that the food material shelf life cannot be operated according to the input voice password.

And S114, taking the target display numerical value and the target metering unit as input contents corresponding to the food material quantity, and displaying the input contents in the food material editing interface.

In some embodiments, the method provided in the embodiments of the present application further includes: and updating the previously stored food material quantity value and the previously stored measuring unit by using the target display value and the target measuring unit.

According to the embodiment, based on the voice control method provided by the embodiment of the application, when the food material editing interface is displayed, a user can input or modify the quantity of the food materials by inputting the voice password. When the quantity of the food materials is input through voice control, even if the quantity metering units displayed in the food material editing interface are inconsistent with the quantity metering units in the user voice passwords, the input operation can be finished, the user does not need to input the voice passwords according to the displayed quantity metering units, and only the spoken quantity metering units are preset metering units. When the quantity of the food materials stored in advance is modified through voice control, the modification operation can be completed only by matching the quantity metering unit in the user voice password with the type of the metering unit stored in advance, and the quantity metering unit in the user voice password is not required to be completely consistent with the metering unit stored in advance. And the refrigerator displays the quantity metering units spoken by the user when the quantity metering units spoken by the user are inconsistent with the currently default displayed metering units so as to improve the user experience.

In a specific implementation, the present invention further provides a computer storage medium, where the computer storage medium may store a program, and when the program is executed, the program may include some or all of the steps in each embodiment of the voice control method provided by the present invention. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a Random Access Memory (RAM).

Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented using software plus any required general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments.

The same and similar parts in the various embodiments in this specification may be referred to each other. In particular, for the embodiment of the refrigerator, since it is substantially similar to the embodiment of the method, the description is simple, and the relevant points can be referred to the description of the embodiment of the method.

The above-described embodiments of the present invention should not be construed as limiting the scope of the present invention.

Claims

1. A refrigerator, characterized by comprising:

a case having a storage chamber therein;

the door is arranged at the opening of the storage chamber;

the display screen is arranged on the box door and used for displaying a food material editing interface, input items corresponding to the number of food materials are displayed on the food material editing interface, and the input items comprise numerical values and metering units;

the system comprises a sound collector, a data processing unit and a data processing unit, wherein the sound collector is used for receiving a voice password input by a user, the voice password is used for operating the quantity of food materials, and the operation comprises an input operation and a modification operation;

when the target operation data of the food materials in the voice password are inconsistent with the records of the previously stored numerical values and/or metering units, judging whether the target metering unit is a preset metering unit or not and whether the target operation numerical values are within the preset allowable operation range of the target metering unit or not;

if the target metering unit is a preset metering unit and the target operand value falls within the allowable operation range, determining whether the target metering unit is matched with a previously stored metering unit category;

when the target metering unit is matched with the previously stored metering unit category, if the operation type represents the operation of inputting the quantity of the food materials, the target display numerical value is the target operand value;

when the target metering unit is matched with the type of the metering unit stored in advance, if the operation type represents the operation of modifying the quantity of the food materials stored in advance, determining a target display numerical value according to the target operand value and the quantity of the food materials stored in advance;

2. The refrigerator as claimed in claim 1, wherein the obtaining the operation type for operating the food material amount by parsing the voice password comprises:

and when the operation type is not analyzed from the voice password, determining the operation type of the operation representing the quantity of the input food materials.

3. The refrigerator of claim 1, wherein, when the operation type characterizes an operation of modifying a quantity of a previously stored food material, the controller is further configured to determine whether the target metering unit matches a category of a previously stored metering unit by:

judging whether the target metering unit and the previously stored metering unit are both weight units, single metering units or complex metering units;

determining that the target metric unit and the previously stored metric unit match in category if the target metric unit and the previously stored metric unit are both weight units, single metric units, or plural metric units.

4. The refrigerator of claim 3, wherein the operation of modifying the number of previously stored food materials comprises an increase operation and a decrease operation; the controller is further configured to determine the target display value by:

when the operation type represents the increasing operation, determining the sum of the previously stored food material quantity value and the target operand value as the target display value;

and when the operation type represents the reduction operation, determining the difference value between the previously stored food material quantity value and the target operand value as the target display numerical value.

5. The refrigerator of claim 4, wherein the controller determines the target display value when the target measurement unit and the previously stored measurement unit are both weight units, further comprising:

judging whether the target metering unit is consistent with a previously stored metering unit;

when the target metering unit is inconsistent with the previously stored metering unit, converting the previously stored food material quantity into an intermediate numerical value metered by the target metering unit;

and determining the target display numerical value according to the target operand value and the intermediate numerical value.

6. The refrigerator of claim 1, wherein the controller is further configured to:

and when the operation type represents the operation of modifying the quantity of the food materials stored in advance, if the target metering unit is not matched with the type of the metering unit stored in advance, displaying preset prompt information to prompt a user that the quality guarantee period of the food materials cannot be operated according to the input voice command.

7. The refrigerator of claim 1, wherein the controller is further configured to: and updating the previously stored food material quantity value and the metering unit by using the target display numerical value and the target metering unit.

8. The refrigerator as claimed in claim 1, wherein the obtaining of the target operation data for operating the food material amount by parsing the voice password comprises:

and analyzing a target metering unit and a target operand value from the voice password.

9. The voice control method is characterized by being applied to a refrigerator, wherein the refrigerator comprises a display screen, the display screen is used for displaying a food material editing interface, input items corresponding to the number of food materials are displayed on the food material editing interface, and the input items comprise numerical values and measuring units; the method comprises the following steps:

when a food material editing interface is displayed, receiving a voice password input by a user, wherein the voice password is used for operating the number of food materials and comprises an input operation and a modification operation;