WO2022095553A1 - 显示设备及食材信息编辑方法 - Google Patents

显示设备及食材信息编辑方法 Download PDF

Info

Publication number
WO2022095553A1
WO2022095553A1 PCT/CN2021/114091 CN2021114091W WO2022095553A1 WO 2022095553 A1 WO2022095553 A1 WO 2022095553A1 CN 2021114091 W CN2021114091 W CN 2021114091W WO 2022095553 A1 WO2022095553 A1 WO 2022095553A1
Authority
WO
WIPO (PCT)
Prior art keywords
value
ingredient
target
display
user
Prior art date
Application number
PCT/CN2021/114091
Other languages
English (en)
French (fr)
Inventor
孔祥键
卢可敬
刘洋
穆聪聪
Original Assignee
海信视像科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202011218085.2A external-priority patent/CN112344619A/zh
Priority claimed from CN202110418594.8A external-priority patent/CN114322441B/zh
Priority claimed from CN202110433466.0A external-priority patent/CN114294898B/zh
Application filed by 海信视像科技股份有限公司 filed Critical 海信视像科技股份有限公司
Priority to CN202180066170.8A priority Critical patent/CN116235013A/zh
Publication of WO2022095553A1 publication Critical patent/WO2022095553A1/zh
Priority to US18/185,459 priority patent/US20230221066A1/en

Links

Images

Classifications

    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00Arrangement or mounting of control or safety devices
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00Arrangement or mounting of control or safety devices
    • F25D29/005Mounting of control devices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2400/00General features of, or devices for refrigerators, cold rooms, ice-boxes, or for cooling or freezing apparatus not covered by any other subclass
    • F25D2400/36Visual displays
    • F25D2400/361Interactive visual displays
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2500/00Problems to be solved
    • F25D2500/06Stock management
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2700/00Means for sensing or measuring; Sensors therefor
    • F25D2700/04Sensors detecting the presence of a person
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2700/00Means for sensing or measuring; Sensors therefor
    • F25D2700/08Sensors using Radio Frequency Identification [RFID]

Definitions

  • the present application relates to the field of display technology, and in particular, to a display device and a method for editing food material information.
  • the way for family members to obtain the ingredients in the refrigerator is generally by opening the refrigerator door and intuitively obtaining it with the naked eye.
  • the refrigerator can be equipped with a radio frequency identification (RFID) device, or a camera, so that the user can obtain the information by installing a display on the refrigerator without opening the refrigerator door.
  • RFID radio frequency identification
  • the display can be made touch-sensitive, or voice-controllable.
  • Some refrigerators support user voice input of ingredient information.
  • ingredient information When inputting ingredient information through voice control, if the user's expression is not standard, it will affect the accuracy of the ingredient information received by the refrigerator. Based on this, when the user's expression is not standard, how to process the user's voice data is a technical problem to be solved urgently.
  • the present application provides a display device and an ingredient editing method to improve user experience.
  • the present application provides a display device, including:
  • a sound collector used to receive the voice password input by the user
  • a controller connected to the display screen and the sound collector is configured to:
  • an ingredient editing interface is displayed on the display, and the input items corresponding to the shelf life of the ingredients are displayed on the ingredient editing interface;
  • the second operation data includes a second operation value and a second time unit, and the second time unit is a preset time unit;
  • the input content corresponding to the shelf life of the ingredient is displayed in the ingredient editing interface.
  • the present application provides a display device, comprising:
  • a display where the user presents the user interface
  • a sound collector used to receive the voice password input by the user
  • a controller connected to the display screen and the sound collector is configured to:
  • an ingredient editing interface is displayed on the display, and the input items corresponding to the shelf life of the ingredients are displayed on the ingredient editing interface;
  • a target display value measured in the target measurement unit is determined, wherein, when the operation type represents an operation of inputting the quantity of ingredients, the target display value is the target operation a value, where the operation type represents an operation that modifies a previously stored ingredient quantity, the target display value is based on the target operation value if the target unit of measure matches a previously stored unit of measure category and the quantity of the previously stored ingredients;
  • the target display value and the target measurement unit are used as the input content corresponding to the quantity of the ingredient, and displayed in the ingredient editing interface.
  • the present application provides a voice control method, which is applied to a display device, where the display device includes a display, and the display user presents a user interface; the method includes:
  • an ingredient editing interface is displayed on the display, and the input items corresponding to the shelf life of the ingredients are displayed on the ingredient editing interface;
  • the second operation data includes a second operation value and a second time unit, and the second time unit is a preset time unit;
  • the input content corresponding to the shelf life of the ingredient is displayed in the ingredient editing interface.
  • the application provides a method for editing food information, the method comprising:
  • a user interface including an ingredient editing interface and a voice recognition interface is displayed, and the input voice content is recognized.
  • the ingredient editing interface is used to display the input ingredient information, and the voice recognition interface Including input prompts and recognized voice content;
  • the input ingredient information is displayed in the ingredient editing interface.
  • the application provides a method for editing food information, the method comprising:
  • a label scanning interface is displayed, and a scanning prompt is displayed in the label scanning interface, and the scanning prompt is used to prompt the user to place the RFID tag to be edited in the label reading area;
  • the ingredient editing interface is displayed according to the voice content contained in the preset voice command;
  • the ingredient editing interface is updated according to the voice content included in the preset voice command.
  • FIG. 1a is an interaction scene of a display device according to an exemplary embodiment of the present application
  • Fig. 1b is a perspective view of a refrigerator according to an exemplary embodiment of the present application.
  • Fig. 1c is a schematic diagram of the appearance of a refrigerator according to an exemplary embodiment of the present application.
  • FIG. 2 is a schematic diagram of the hardware configuration of a refrigerator according to an exemplary embodiment of the present application
  • FIG. 3 is a user interface shown in the present application according to an exemplary embodiment
  • FIG. 4 is another user interface shown in this application according to an exemplary embodiment
  • FIG. 5 is another user interface shown in this application according to an exemplary embodiment
  • FIG. 6 is another user interface shown in this application according to an exemplary embodiment
  • FIG. 7 is another user interface shown in this application according to an exemplary embodiment
  • FIG. 8 is another user interface shown in this application according to an exemplary embodiment
  • FIG. 9 is another user interface shown in this application according to an exemplary embodiment.
  • FIG. 10 is another user interface shown in this application according to an exemplary embodiment
  • FIG. 11 is a flowchart of a method for editing food material information according to an exemplary embodiment of the present application.
  • FIG. 12 is a flowchart of another method for editing food material information according to an exemplary embodiment of the present application.
  • Fig. 13 is an ingredient editing interface shown in the present application according to an exemplary embodiment
  • Fig. 14 is another food material editing interface shown in this application according to an exemplary embodiment
  • Fig. 15 is yet another food material editing interface shown in the present application according to an exemplary embodiment
  • FIG. 16 is yet another food material editing interface shown in the present application according to an exemplary embodiment
  • Fig. 17 is yet another food material editing interface shown in this application according to an exemplary embodiment
  • Fig. 18 is yet another food material editing interface shown in this application according to an exemplary embodiment
  • FIG. 19 is yet another food material editing interface shown in the present application according to an exemplary embodiment
  • Fig. 20 is yet another food material editing interface shown in the present application according to an exemplary embodiment
  • Fig. 21 is yet another food material editing interface shown in this application according to an exemplary embodiment
  • FIG. 22 is a flowchart of a voice control method according to an exemplary embodiment of the present application.
  • FIG. 23 is a flowchart of a voice control method according to an exemplary embodiment of the present application.
  • first and second are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as “first” or “second” may expressly or implicitly include one or more of that feature. In the description of the present invention, unless otherwise specified, "plurality" means two or more.
  • the way for family members to obtain the ingredients in the refrigerator is generally by opening the refrigerator door and intuitively obtaining it with the naked eye.
  • the refrigerator can be equipped with a radio frequency identification (RFID) device, or a camera, so that the user can obtain the information by installing a display on the refrigerator without opening the refrigerator door.
  • RFID radio frequency identification
  • the display can be made touch-sensitive, or voice-controllable.
  • FIG. 1a exemplarily shows a schematic diagram of an operation scenario of a display device according to an embodiment.
  • the display device may be any home or office device with a display screen or display, such as a mobile terminal, a tablet computer, a computer, a laptop, a TV, a refrigerator, an electronic whiteboard, an oven, a washing machine, a video
  • a display screen or display such as a mobile terminal, a tablet computer, a computer, a laptop, a TV, a refrigerator, an electronic whiteboard, an oven, a washing machine, a video
  • the above-mentioned devices are all display devices involved in this application, and are not limited to TVs, refrigerators, and ovens as shown in FIG. 1a.
  • the display device 200 is also in data communication with the server 100 .
  • the display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks.
  • the server 100 may provide various contents and interactions to the display device 200 .
  • the server 100 may be a cluster or multiple clusters, and may include one or more types of servers.
  • the display device may also synchronize and communicate data with other display devices.
  • the display device 200 may be allowed to interact with other devices through a local area network (LAN), a wireless local area network (WLAN).
  • LAN local area network
  • WLAN wireless local area network
  • the devices in the same local area network can communicate with each other.
  • Account management can also be used.
  • data communication can be performed with the device under the same login account.
  • a smart device such as a mobile phone, a tablet, or a control device that can be used by the display device receives the instruction, and can also receive the user's control through touch or gesture.
  • the display device 200 may also be controlled in a manner other than the control apparatus 100 and the smart device 300.
  • the module for acquiring voice commands configured inside the display device 200 may directly receive the user's voice command for control.
  • the user's voice command control can also be received through a voice control device provided outside the display device 200 device.
  • Fig. 1b is a perspective view of a refrigerator according to an exemplary embodiment of the present application.
  • the shape of the refrigerator provided by the embodiment of the present invention is approximately a rectangular parallelepiped.
  • the appearance of the refrigerator is defined by the storage compartment 101 providing a limited storage space and a plurality of box doors 200 provided at the opening of the storage compartment 101 .
  • the storage compartment 101 is a box body 100 with an opening.
  • the storage compartment 101 includes a freezing compartment 101A located below and a refrigerating compartment 101B located above, and the freezing compartment 101A and the refrigerating compartment 101B respectively have one or more an independent storage space.
  • freezer compartment 101A may be selectively covered by freezer drawer door 200A.
  • the refrigerator compartment 101B is partitioned into left and right sides.
  • the refrigerating compartment 101B is selectively opened or closed by a refrigerating compartment door 200B pivotally mounted on the refrigerating compartment 101B.
  • Fig. 1c is a schematic view of the appearance of a refrigerator according to an exemplary embodiment of the present application.
  • a display screen is provided on the refrigerating compartment door 200B, and the display screen is embedded in the door body.
  • the plane on which the screen of the display screen is located is flush with the outer surface of the box door.
  • the refrigerator provided by the embodiment of the present application is provided with at least two storage compartments inside the box, such as a freezing compartment, a refrigerating compartment, a changing room, and/or a fresh-keeping room.
  • Each storage compartment can have multiple independent storage spaces, such as drawer-style compartments.
  • the refrigerator 200 may include a display screen 210, a controller 220, a memory 250 and several user input interfaces.
  • the refrigerator 200 may further include at least one RFID detection module 230 , a detector 240 .
  • the display screen 210, the RFID detection module 230, the detector 240, and the memory 250 are coupled with the controller 220 through a communication interface.
  • the display 210 is used for receiving the image signal output by the controller 220 , performing components for displaying video content and images and a menu manipulation interface, and displaying a user manipulation UI interface for controlling the refrigerator 200 .
  • the controller 220 may include one or more processing units, such as a system on a chip (SoC), a central processing unit (CPU), a microcontroller (MCU), a memory controller, and the like. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • SoC system on a chip
  • CPU central processing unit
  • MCU microcontroller
  • memory controller and the like.
  • different processing units may be independent devices, or may be integrated in one or more processors.
  • the memory 250 may include one or more storage units, for example, may include volatile memory (volatile memory), such as: dynamic random access memory (dynamic random access memory, DRAM), static random access memory (static random access memory) , SRAM), etc.; can also include non-volatile memory (non-volatile memory, NVM), such as: read-only memory (read-only memory, ROM), flash memory (flash memory), etc.
  • volatile memory dynamic random access memory
  • SRAM static random access memory
  • NVM non-volatile memory
  • different storage units may be independent devices, or may be integrated or packaged in one or more processors or communication interfaces, and become part of the processors or communication interfaces.
  • the detector 240 including at least a sound collector, such as a microphone, may be used to receive the user's voice.
  • the voice signal includes a control instruction of the user to control the refrigerator 200 .
  • the user input interface includes at least one of other input interfaces such as a microphone, a touch panel, a sensor, and a button.
  • the user can implement the user command input function through actions such as voice, touch, gesture, pressing, etc.
  • the input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the refrigerator 200.
  • the controller 220 may include a voice recognition module, and the voice recognition module further includes a voice parsing unit and a voice command database, so that the refrigerator can independently complete the voice recognition of the voice data input by the user, and the recognized voice The process of matching content with voice commands in a voice command database.
  • the RFID detection module 230 may be disposed in each storage room for transmitting wireless signals in the corresponding storage room and receiving signals of the RFID tags in the storage room, so as to obtain the food material information in the RFID tags.
  • the refrigerator further includes a tag reading area disposed outside the storage compartment, that is, a sensing area for identifying RFID tags, and an RFID detection module is disposed at the tag reading area for detecting RFID placed in the area. Label.
  • the tag reading area can be set below the display screen, so that the user can place (or take away) the RFID tag in the tag reading area and operate the user interface displayed on the display screen at the same time.
  • the refrigerator may further include an RFID processing module, which is respectively connected to each RFID detection module and used to control the RFID detection module to transmit wireless signals and to receive signals from the RFID tags fed back by the RFID detection module.
  • RFID processing module which is respectively connected to each RFID detection module and used to control the RFID detection module to transmit wireless signals and to receive signals from the RFID tags fed back by the RFID detection module.
  • the RFID detection module may specifically be an antenna.
  • the power of the antennas provided in different storage compartments may be different.
  • the power of the antenna of each storage room can ensure that the antenna can recognize the ingredients included in its own compartment, so as to avoid that the false recognition rate will increase when the power is too high, and the ingredients in its own compartment will not be recognized when the power is too small.
  • the power of the antenna can be determined in advance according to the space size of each storage room, and the power of each antenna is set in the refrigerator. The larger the space, the higher the power.
  • RFID tags are used to identify the ingredients in the storage room.
  • the virtual association between the RFID tag and the food material information is realized by establishing the corresponding relationship between the RFID tag and the food material information.
  • the identification information of the RFID tag may be the tag code of the RFID tag identified by the RFID detection module 230, or may be a code segment in the tag code.
  • the controller 220 may determine the ingredient information corresponding to each RFID tag according to the identification information of each RFID tag and the pre-established correspondence.
  • the pre-established correspondence between the identification information of the RFID tag and the food material information may be shown in the following table:
  • the controller 220 obtains the label code of the RFID label by detecting the signal of the RFID label, and the food information associated with each label can be determined according to the label code.
  • the ingredient information associated with each label is associated with a storage room, and the storage location of the ingredient can be determined according to the storage room associated with the ingredient information. in the refrigerator compartment.
  • an ingredient management interface is displayed on the display screen 210, and the user manages ingredients in the refrigerator by operating the ingredient management interface.
  • the corresponding ingredient control/icon is drawn in the ingredient management interface, so that the ingredients in the refrigerator are displayed in the form of icons, pictures and texts.
  • functional controls such as RFID tag identification controls, ingredient addition controls, etc., may also be drawn in the food material management interface, for the user to operate to trigger the controller 210 to implement corresponding functions.
  • FIG. 3 is a user interface shown in the present application according to an exemplary embodiment, which is specifically an exemplary ingredient management interface.
  • the ingredient management interface includes an RFID tag editing control, a recommended recipe control, and an ingredient display area corresponding to each storage room, such as an ingredient display area 310 corresponding to the refrigerator compartment, and each ingredient display area displays a corresponding ingredient icon and the name of the ingredient, such as the ingredient icon “apple” 311 in the ingredient display area 310 .
  • the tag code of the RFID tag includes at least two code segments, a first code segment and a second code segment, respectively.
  • the first code segment is used to write a first code, and the first code may be a predetermined code or a non-predetermined code.
  • the corresponding ingredient information can be customized by the user, that is, a user-defined tag; In the cloud server or the local ingredients library, it cannot be customized by the user, that is, it is a predefined label.
  • the second code segment is used to write the second code, and the second code is the unique identification information of the RFID tag.
  • the user-defined ingredient name means that the user can associate any ingredient name with the RFID tag according to their needs.
  • the user can also change the defined tag according to the change of needs, so that the same label can be used before and after different ingredients.
  • the name is associated, and the user cannot customize the name of the ingredient, which means that the user cannot change the name of the ingredient associated with the RFID tag.
  • the name of the ingredient associated with the RFID tag is pre-defined and saved in the cloud server or local ingredient library. .
  • the tag is a predefined tag or a self-defined tag can be determined according to the first code included in the tag code. If the first code is a predetermined code, the label is a custom label, and if the first code is not a predetermined code, the label is a predefined label.
  • at least two code segments included in the label code of the RFID tag conform to a preset composition rule, and after acquiring the label code, the controller intercepts the first code segment and/or the second code segment according to the preset composition rule segment etc. to obtain the first code and/or the second code, thereby saving the process of parsing long code information and improving processing efficiency.
  • the predetermined code is unique, such as 00; the non-predetermined code is not unique, and there may be more than one, and one non-predetermined code corresponds to one kind of food item information.
  • a tag coding structure of an RFID tag is as follows:
  • the tag code of the RFID tag obtained by the controller is "01123456789012345678901234"
  • the first code can be intercepted as "01”
  • the second code can be intercepted as "123456789012345678901234".
  • the label code of the RFID tag can also include more code segments, such as the third code segment, which is used to write the manufacturer's identification of the RFID tag, and the fourth code segment, which is used as a label. Encoded reserved bits to improve scalability of RFID tags.
  • the manufacturer's identification of the RFID tag may also be included in the second code segment, which will not be repeated here.
  • the corresponding relationship between the first code (non-predetermined code) and the ingredient information may be as shown in the following table:
  • the user may input an instruction for editing ingredient information by operating the ingredient management interface.
  • the acquired identification information of the RFID tag can also be displayed in the ingredient editing interface, so that the user can intuitively see the identification information of the RFID tag, and the user does not need to manually input the identification information, which improves the user experience.
  • At least one ingredient editing item is displayed in the ingredient editing interface, and each ingredient editing item includes an item name and item content, wherein the item content is the part to be edited, and the user can input each ingredient at the input position by inputting each ingredient. Edit the item content of the item, and enter the ingredient information for associating with the RFID tag. After the input is completed, the controller stores the input ingredient information and the identification information correspondingly, thereby completing and improving the establishment of the correspondence table between the identification information of the RFID tag and the ingredient information.
  • the interface for editing ingredient information may be called an ingredient editing interface, and the ingredient editing items displayed thereon may include ingredient name editing items, ingredient shelf life editing items, ingredient quantity editing items, and the like.
  • the item name of the ingredient name editing item can be "label name”
  • the item content is the name of the ingredient to be input or updated
  • the item name of the ingredient shelf life editing item can be "shelf life”
  • the item content is to be input or updated.
  • the item name of the ingredient quantity editing item can be "quantity”
  • the item content is the quantity to be selected or changed.
  • the user can click on the RFID tag editing control in the interface to input an instruction instructing to edit the ingredient information.
  • the controller controls the RFID detection module to start detecting the signal of the RFID tag on the tag reading area to obtain the identification information of the RFID tag.
  • an ingredient editing interface is presented on the display screen.
  • a label scanning interface is displayed, a scanning prompt is displayed in the label scanning interface, and the user is prompted by displaying the scanning prompt.
  • the controller controls the RFID detection module to start detecting the signal of the RFID tag on the tag reading area to obtain the identification information of the RFID tag.
  • an ingredient editing interface is presented on the display screen.
  • the user can also instruct the instruction to edit the ingredient information by speaking a preset voice password. For example, the user says: “tag edit”.
  • the controller responds to the instruction, displays the label scanning interface, and starts to detect the RFID label on the label reading area.
  • an input preset voice command when an input preset voice command is received, it is first determined whether the RFID tag on the tag reading area is detected. If the RFID tag on the tag reading area is not detected, it means that the user has not The edited RFID tag is placed on the tag reading area, and at this time, a tag scanning interface including a scanning prompt is displayed to prompt the user to place the RFID tag to be edited in the tag reading area.
  • the above-mentioned instruction for instructing to edit food material information is also referred to as an RFID tag editing instruction.
  • FIG. 4 is a user interface shown in some embodiments of the present application, specifically an exemplary label scanning interface.
  • a scanning prompt is displayed on the label scanning interface, the specific content of which is “Please The RFID tag prevents the scanning area under the screen”.
  • the ingredient editing interface shown in FIG. 5 is displayed.
  • the identification information "20200005" of the RFID tag is displayed, so that the user does not need to manually input the identification information, thereby avoiding input errors and saving user operations.
  • a plurality of ingredient editing items are also displayed, namely ingredient name editing item 510 and ingredient shelf life editing item 520, wherein each ingredient editing item corresponds to an input position for inputting the corresponding item content.
  • a "Cancel” control 530 and an "OK” control 540 are displayed.
  • each RFID tag is made to correspond to the food material information input by the user, and the virtual association between the RFID tag and the food material information is realized.
  • the correspondence between the label and the food material information makes the same RFID label correspond to different food material information successively, which improves the flexibility of the RFID label use.
  • the user can edit the food material information corresponding to the RFID tag through a voice command.
  • the user can say: "Define a 2-pound beef label”, and the controller can identify the "beef", "2-pound beef” and other voice content, the item content of the corresponding ingredient editing item is automatically updated without the need for the user to enter text.
  • the user operations be further reduced, making the editing process faster, but also the ubiquity of the function can be improved, so that the elderly or children who cannot type can also complete the editing of the ingredient information.
  • a voice recognition interface is displayed, and starts to receive and recognize the user's voice input, wherein, The input prompt and the recognized voice content can be displayed in the voice recognition interface; according to the recognized voice content, the item content of the ingredient editing item in the interface is updated.
  • FIG. 6 is a user interface shown in some embodiments of the application, specifically a user interface that displays an ingredient editing interface and a voice recognition interface at the same time.
  • the view display area 610 where the voice recognition interface is located is displayed in the On the upper layer of the view display area 620 where the ingredient editing interface is located, an input prompt is displayed on the voice recognition interface, specifically a text prompt with the content "You can say, I want to define 2 pounds of peaches".
  • the voice recognition interface may further display the recognized voice content.
  • the controller receives the voice data input by the user, and sends the voice data to the server; the server recognizes the voice data to obtain corresponding voice content, and generates a voice command according to the voice content.
  • the voice command includes multiple fields, and one field Corresponding to an ingredient editing item, the field name is the item name, and the field value is the item content.
  • the server returns the generated voice instruction to the refrigerator, and the refrigerator updates the item content of the corresponding ingredient editing item according to the field value of each field in the voice instruction.
  • An exemplary voice command format is as follows:
  • the voice command instructs the refrigerator to perform the RFID tag editing operation, wherein the field value "beef” corresponding to the field name "name” is used to update the item content of the item name editing item, and the field name "count” corresponds to The field value of "1000g” is used to update the ingredient quantity edit item.
  • the controller after the controller detects the RFID tag placed on the tag reading area by the user, it determines whether the RFID tag is a custom tag, and if the RFID tag is a custom tag, a first editing interface is displayed,
  • the first editing interface includes a plurality of ingredient editing items, wherein preset default characters are displayed in the item content display area (ie, the input location area) corresponding to each ingredient editing item, and the item content of each ingredient editing item is can be edited. In this way, the user can update the item content of each ingredient editing item by inputting text or inputting voice.
  • the preset ingredient information corresponding to the tag is acquired according to the first code in the tag encoding, and a second editing interface is displayed according to the acquired preset ingredient information. Different from the first editing interface, in the second editing interface, the preset ingredient information, such as the preset ingredient name, etc., is displayed in the item content display area corresponding to each ingredient editing item, and the item content of the ingredient name item is: Uneditable, that is, the user cannot change the currently displayed ingredient name by inputting text or voice.
  • the controller may obtain the corresponding preset ingredient information from the cloud server according to the first code.
  • the controller may acquire corresponding preset ingredient information from a locally preset ingredient library according to the first code.
  • the locally preset food material library may be downloaded from the cloud server in advance for the controller.
  • the RFID tag placed by the user on the tag reading area is a custom tag
  • it is determined whether there is a second code in the local data according to the second code in the tag code that is, the identification information of the RFID tag.
  • the ingredient information is used as the item content of each ingredient editing item, displayed on the first editing interface, and displayed in the first editing interface. In this way, on the one hand, the information about the ingredients currently associated with the RFID tag can be displayed to the user; food information.
  • the preset default character is used as the item content of each ingredient editing item, and displayed in the first editing interface.
  • FIG. 7 is a possible user interface shown in some embodiments of the present application, which is specifically an exemplary first editing interface. As shown in FIG. 7 , in this interface, the items of each ingredient editing item are The content is the default character "undefined”.
  • FIG. 8 is a possible user interface shown in some embodiments of the present application, which is specifically an exemplary second editing interface.
  • the name of the ingredient name editing item 810 The item content is the default character "apple”, the item content of the shelf life editing item 820 is the default character "1”, and the item content of the ingredient quantity editing item 830 is the default character "1".
  • “apple”, “1”, etc. are the preset ingredient information corresponding to the currently detected label.
  • the associated ingredient names are not editable, and for custom tags, the associated ingredient names are editable. Based on this, when the refrigerator controller updates the ingredient editing items according to the voice command returned by the server, if the RFID tag is a custom tag, it will update the content of all ingredient editing items; The item content of the ingredient edit item other than the edit item is updated.
  • the user can edit the food material information corresponding to the RFID tag through voice input.
  • the voice recognition interface is displayed while the ingredient editing interface is displayed, that is, the voice application is automatically switched to the foreground operation, thereby quickly entering the voice detection state.
  • the user's voice input is detected in time, and the user can make the refrigerator automatically complete the information input process by saying the information of the ingredients to be edited, saving user operations, and making the editing process faster and improving user experience.
  • FIG. 9 is a user interface shown in this application according to an exemplary embodiment, which is specifically an exemplary food material library interface.
  • the interface includes names such as "Recently Used", “All”, “Fruit”, “Vegetable”, “Meat”, “Beverage”, “Aquaculture”, “Other” and “Custom”
  • the operating controls 111-119 since the “all” control 112 is selected, the ingredient icon corresponding to each ingredient information in the complete ingredient set is displayed on the interface.
  • the user interface shown in Fig. 9 is displayed, if the user clicks the "customize” control 119, the user interface changes from Fig. 9 to Fig. 10.
  • the information corresponding to each ingredient in the custom ingredient set is displayed. ingredients icon.
  • an operation control 121 for adding custom ingredient information is also displayed.
  • the user can input an instruction for adding a custom ingredient by operating the operation control 121, the controller displays an ingredient definition interface in response to the instruction, and the user can input newly defined ingredient information in the ingredient definition interface.
  • the user can select one or more ingredient icons through a predetermined operation, for example, through an operation of long pressing an icon to select an icon. It is also possible to cancel the selection of an icon through a predetermined operation, such as long pressing an icon in a selected state to cancel the selection of the icon.
  • An embodiment of the present application further provides a method for editing food material information.
  • the method is applied to the refrigerator as shown in FIG. 1a to FIG. 10 , and the execution body of the method includes but is not limited to a controller of the refrigerator.
  • FIG. 11 is a flowchart of a method for editing food information according to an exemplary embodiment of the present application. As shown in FIG. 11 , the method may include:
  • a user interface including an ingredient editing interface and a voice recognition interface is displayed, and the input voice content is recognized, and the ingredient editing interface is used to display the input ingredient information
  • the voice recognition interface includes input prompts and recognized voice content.
  • an input RFID tag editing instruction is received. For example, in the interface shown in FIG. 3, a user clicks an RFID tag editing control to input an RFID tag editing instruction; in response to the input RFID tag editing instruction, the tag is detected. Read the RFID tags on the zone.
  • an input preset voice instruction is received, and the preset voice instruction is used to trigger editing of the food material information corresponding to the RFID tag.
  • the user speaks a preset voice password to input the preset voice instruction , say "tag editing”.
  • the RFID tag on the tag reading area is detected.
  • an input preset voice instruction is received, and in response to the preset voice instruction, a label scanning interface is displayed, and a scanning prompt is displayed in the tag scanning interface, and the scanning prompt is used to prompt the user to place the RFID tag to be edited. in the label reading area. At the same time, the RFID tag on the tag reading area is detected.
  • S011 according to the recognized voice content, display the input ingredient information in the ingredient editing interface.
  • displaying the ingredient editing interface includes: acquiring a tag code obtained by detecting the RFID tag, the tag code including a code for A code segment that characterizes whether the RFID tag is a custom tag; judges whether the RFID tag is a custom tag according to the tag code; if the RFID tag is a custom tag, edit the preset default characters as each ingredient
  • the item content of the item is displayed in the ingredient editing interface. For example, in the ingredient editing interface shown in FIG. 7 , the item content of each ingredient editing item is the default character “undefined”.
  • the preset ingredient information of the RFID tag is obtained according to the tag code, and the preset ingredient information is used as the item content of each ingredient editing item, and displayed in the ingredient editing interface.
  • the item content of the ingredient name editing item is the default character "apple”
  • the item content of the shelf life editing item is the default character "1”
  • the item content of the ingredient quantity editing item is the default character "" 1”.
  • "apple", "1", etc. are the preset ingredient information corresponding to the currently detected label.
  • updating the item content of the ingredient editing item according to the recognized voice content includes: receiving voice data input by a user, and sending the voice data to a server, so that the server can recognize the voice content; receive a voice command returned by the server according to the recognized voice content, the voice command includes a plurality of fields, and one field corresponds to one of the food item editing items; use the field value of the field to update the food material corresponding to the field Edit the item content of the item.
  • the ingredient editing item includes an ingredient name editing item
  • the updating the item content of the ingredient editing item according to the recognized voice content includes: if the RFID tag is a custom tag, according to The voice content updates the item content of all the ingredient editing items; if the RFID tag is not a custom tag, the item content of the ingredient editing items except the ingredient name editing item is updated according to the voice content.
  • the method further includes: judging whether the name of the ingredient included in the voice content is the same as the name of the preset ingredient included in the preset ingredient information; If the name of the ingredient contained in the content is different from the name of the preset ingredient contained in the preset ingredient information, an interface prompt is displayed, or a voice prompt is played, and the interface prompt and the voice prompt are used to prompt the user that the RFID Labels do not support editing ingredient names. For example, if the preset ingredient name corresponding to the currently detected RFID tag is "apple”, and the field value corresponding to the field name "name” in the voice command is "beef", since the two are different, it is necessary to pop up a text prompt or play a voice prompt . If the preset ingredient name corresponding to the currently detected RFID tag is "beef”, since the field value corresponding to the field name "name” in the voice command is also "beef", there is no need to pop up a text prompt or play a voice prompt.
  • the controller is further configured to: receive a confirmation operation for a specified control on the ingredient editing interface; in response to the confirmation operation, generate ingredient information according to the updated item contents of all ingredient editing items;
  • the food material information and the tag code of the RFID tag are stored in local data correspondingly.
  • FIG. 12 is a flowchart of another method for editing food material information according to an exemplary embodiment of the present application. As shown in FIG. 12 , the method may include:
  • a label scanning interface is displayed, and a scanning prompt is displayed in the label scanning interface, and the scanning prompt is used to prompt the user to place the RFID tag to be edited on the label to read area; when detecting the RFID tag placed by the user on the tag reading area, display the ingredient editing interface according to the voice content contained in the preset voice command;
  • the user can first place the RFID tag to be edited on the tag reading area.
  • the controller detects the RFID tag and displays the ingredient editing interface.
  • the user inputs a preset voice command by speaking a preset voice password, and the preset voice command includes the information of the ingredients to be edited by the user, for example, "I want to define 2 pounds of beef".
  • the user before placing the RFID tag to be edited in the tag reading area, the user can speak a preset voice password to input a preset voice command, the preset voice command is used to trigger the editing process, and also Include the information about the ingredients that the user wants to edit, such as "I want to define 2 pounds of beef".
  • the user can edit the ingredient information corresponding to the RFID tag through voice input.
  • the voice recognition interface is displayed while the ingredient editing interface is displayed, that is, the voice application is automatically switched to the foreground operation, thereby quickly entering the voice detection state.
  • the user's voice input is detected in time, and the user can make the refrigerator automatically complete the information input process by saying the information of the ingredients to be edited, saving user operations, and making the editing process faster and improving user experience.
  • Fig. 13 shows an ingredient editing interface according to an exemplary embodiment of the present application.
  • the identification information "20200005" of the RFID tag is displayed, so that the user does not need to manually input the identification information, thereby avoiding input errors and saving user operations.
  • a plurality of input items are also displayed, namely, an ingredient name input item 410, an ingredient shelf life input item 420, and an ingredient quantity input item 430, wherein each ingredient input item corresponds to an input position for inputting corresponding content.
  • a "Cancel” control 440 and an "OK” control 450 are also displayed. After the information input is completed, the user can click the "OK" control to instruct to save the input ingredient information, or click the "Cancel" control to instruct to return to the previous interface.
  • the process of displaying the ingredient editing interface by the controller may include: first, judging whether there is corresponding ingredient information in the ingredient information set according to the identification information of the tag to be edited; if there is corresponding ingredient information in the ingredient information set, according to The ingredient information displays the input content corresponding to the input item in the ingredient editing interface; if there is no corresponding ingredient information in the ingredient information set, the item content corresponding to the editing item is displayed in the ingredient editing interface according to the preset filling information.
  • the ingredient editing interface it is determined whether there is corresponding ingredient information in the ingredient information set according to the identification information of the tag to be edited, specifically: apple, 60 days, 1000g, and the displayed ingredient editing interface is shown in FIG. 14 .
  • the input content corresponding to "label name” is "apple”
  • the input content corresponding to "shelf life” is "60 days”
  • the input content corresponding to "quantity” is "1000g”.
  • the user can learn the ingredient information previously associated with the tag to be edited, and can also input new ingredient information by modifying the displayed input content.
  • the identification information of the tag to be edited it is determined that there is no corresponding ingredient information in the ingredient information set, and the displayed ingredient editing interface is as shown in FIG. 15 .
  • the input contents corresponding to "label name”, "shelf life", and “quantity” are all preset filling characters "undefined”.
  • the user can know that the target tag is a brand new tag, and can input ingredient information for associating with the tag to be edited by entering the content of each editing item.
  • the measurement unit of the shelf life is displayed as “day”, and the measurement unit of the quantity is displayed as “g”.
  • the measurement unit of the expiration date is displayed as "month”
  • the measurement unit of the quantity is displayed as "part”.
  • the measurement unit of the shelf life is displayed as “day”, and the measurement unit of the quantity is displayed as “jin”.
  • the ingredient editing interface is displayed, the user can set the shelf life and/or the measurement unit of the ingredient quantity as required.
  • the ingredient management interface shown in FIG. 13 the user can click the drop-down control next to the measurement unit to control the display of the measurement unit option.
  • the user can click the drop-down control next to the expiration date measurement unit, and the option of the measurement unit to control the expiration date pops up, as shown in Figure 16.
  • the user can click to select the unit of measure to be set.
  • the unit of measure option is collapsed, and the measure displayed in the ingredient editing interface The unit is changed from "day” to "month”.
  • the user can click the drop-down control next to the measurement unit of the ingredient quantity, and the measurement unit option for controlling the quantity of the ingredient pops up, as shown in FIG. 17 .
  • the unit of measure option for the quantity of ingredients pops up
  • the user can click to select the unit of measure to be set.
  • the unit of measure option is collapsed, and the menu item displayed in the ingredient editing interface is displayed. The unit of measurement changed from “g" to "parts”.
  • the user when the ingredient editing interface is displayed, the user can input ingredient information through a voice password.
  • the voice password may include one or more operation instruction information, such as instruction information for operating the name of the ingredient, instruction information for manipulating the shelf life of the ingredient, and instruction information for manipulating the quantity of the ingredient.
  • operation instruction information such as instruction information for operating the name of the ingredient, instruction information for manipulating the shelf life of the ingredient, and instruction information for manipulating the quantity of the ingredient.
  • the controller can input the content corresponding to the corresponding item according to the parsed instruction information, and display the content in the ingredient editing interface without the need for the user to input text. In this way, not only can the user operations be further reduced, making the editing process faster, but also the ubiquity of the function can be improved, so that the elderly or children who cannot type can also complete the editing of the ingredient information.
  • the voice recognition content area is displayed in the ingredient editing interface, and starts to receive and recognize the user's voice password, wherein the voice recognition content
  • the input prompt and recognized voice content can be displayed in the area.
  • the ingredient editing area and the speech recognition content area may be two different view display areas. Different view display areas can be areas belonging to the same layer or areas belonging to different layers.
  • FIG. 18 is an ingredient editing interface including a speech recognition content area shown in some embodiments of the present application.
  • the speech recognition content area 810 is displayed on the top layer of the ingredient editing interface, and does not overlap with the ingredient editing area 820 .
  • An input prompt is displayed in the speech recognition content area 810, specifically a text prompt with the content "You can say, I want to define 2 jins of peaches".
  • the recognized voice content may also be displayed in the voice recognition content area.
  • the controller receives the voice password input by the user, and sends the voice password data to the server; the server parses the voice password data to obtain corresponding voice content, and generates voice command information according to the voice content, and the voice command information includes multiple Field, a field corresponds to an ingredient input item, the field name is the item name, and the field value is the operation type and/or operation data.
  • the server returns the generated voice command information to the controller, and the controller operates the corresponding input item according to the field value of each field in the voice command information, and displays the content of the corresponding input item.
  • the voice instruction information includes first instruction information, the first instruction information is used to operate the shelf life of the food, the first instruction information includes at least first operation data, and the first operation data includes a first operation value and a first time unit, the first operand value that carries the first time unit is the original voice content directly parsed from the voice password. For example, if the voice password entered by the user is "I want to define 2 pounds of beef with a shelf life of 3 months", then The first operand value carrying the first time unit is "3 months".
  • the controller obtains the first instruction information for operating the shelf life of the ingredients by parsing the input voice password, and determines the second instruction information according to the first instruction information, where the second instruction information includes the target operation type and the second instruction information.
  • Operation data the second operation data includes a second operation value and a second time unit, where the second time unit is one of the preset time units. Then, according to the target operation type and the second operation data, the input content corresponding to the shelf life of the ingredient is displayed in the ingredient editing interface.
  • the controller In the process of generating the second instruction information according to the first instruction information, the controller firstly determines whether the first time unit is a preset time unit, and at the same time determines whether the first operand value is an integer. If the first time unit is a preset time unit and the first operand value is an integer, it is not necessary to process the operand value and its unit in the first instruction information, but the first time unit is determined as the second time unit, The first operand value is determined as the second operand value.
  • the operand value and its unit in the first instruction information need to be processed, specifically according to the difference between the first time unit and the preset time unit
  • the conversion relationship is to convert the first operand value into a second operand value in a preset time unit, and it is necessary to ensure that the second operand value is an integer.
  • the preset time unit includes months and days.
  • the first time unit When the first time unit is year or month, convert the first operand value into the second operand value in month or day; when the first time unit is week or day, convert the first operand value into day value The second operand value.
  • the first time unit is a year and the first operand value is an integer, such as 3 years, no processing is required, and the first operand value carrying the first time unit is directly used as the second operand value.
  • the first time unit is a year and the first operand value is not an integer, such as 2.5 years, the first operand value is converted into a second operand value in months, ie, 2.5 ⁇ 12 months.
  • the first time unit is a month and the first operand value is an integer, such as 3 months, no processing is required, and the first operand value carrying the first time unit is directly used as the second operand value. If the first time unit is a month and the first operand value is not an integer, such as 2.5 months, the first operand value is converted into a second operand value in days, that is, 2.5 ⁇ 30 days. If the first time unit is a week (week), since the week is not a preset time unit, regardless of whether the first operand value is an integer or not, the first operand value needs to be converted into the second operand value in days, for example , you need to convert 3 weeks into 3 ⁇ 7 days.
  • first time unit is days and the first operand value is an integer
  • no processing is required. If the first time unit is days and the first operand value is not an integer, round down the first operand value to obtain the second operand value still in days, for example, round down 2.5 days to obtain 2 days, Round down 3.4 days to get 3 days.
  • the input voice password may also include an operation type for operating the shelf life of the food, and the operation type may include an extension operation, a shortening operation, and a setting operation. It should be understood that if the input voice password includes the operation type supported by the refrigerator, the first instruction information obtained by parsing the voice password naturally includes the operation type. If the input voice password does not include the operation type supported by the refrigerator, the first instruction information does not include the operation type.
  • the operation type contained in the voice password is the extension operation; if the user says “shorten the shelf life by 2 months”, the voice The operation type contained in the password is the shortening operation; if the user says “Define the shelf life of 3 months", the operation type contained in the voice password is the setting operation.
  • the operation type is determined as the target operation type, and if the first instruction information does not include operation type, the preset operation type is determined as the target operation type.
  • the preset operation type may be a setting operation. That is, when the operation type is not included in the first instruction information, the set operation is determined as the target operation type.
  • the display data is composed of the display value and the second time unit.
  • the controller takes the display value with the second time unit as the input content corresponding to the shelf life of the ingredient, and displays it in the ingredient editing interface.
  • the time measurement unit displayed in the ingredient editing interface is inconsistent with the measurement unit of the shelf life in the user's voice password, not only can the operation of the shelf life of the ingredients be completed, but also the refrigerator will display the time measurement unit according to the user's voice, so as to improve the user experience. experience.
  • the second operand value is determined as the display value.
  • the target operation type is an extension operation
  • the preset storage time unit can be used as an intermediate measurement unit, and the storage time unit is the unit of the previously stored shelf life value. Exemplarily, the storage time unit is seconds, the previously stored shelf life value is 200000 (seconds), and the second operation value is 3 (days).
  • the second operand value 3 (days) needs to be converted into 3 ⁇ 24 ⁇ 60 ⁇ 60 (seconds), and then added to the previously stored shelf life value 200000 , to get 261200 (seconds). Finally, convert 261200 (seconds) to the displayed value in days and round down to get 5 days.
  • the target operation type is a shortening operation
  • the storage time unit is seconds
  • the previously stored shelf life value is 200000 (seconds)
  • the second operation value is 3 (days).
  • the second operand value 3 (day) needs to be converted into 3 ⁇ 24 ⁇ 60 ⁇ 60 (second), and then This is subtracted from the previously stored shelf life value of 200000, resulting in 59200 (seconds). Finally, convert 59200 (seconds) to the displayed value in days and round down to get 0 days.
  • the conversion relationship between the second time unit and the storage time unit after converting the previously stored value of the shelf life into the value in the second time unit, then subtract the second operand value from it, and finally obtain the value in the second time unit.
  • the displayed value of the unit meter after converting the previously stored value of the shelf life into the value in the second time unit, then subtract the second operand value from it, and finally obtain the value in the second time unit.
  • the ingredient editing interface when the ingredient editing interface is displayed, in response to the user's input of the voice password "I want to define 2 pounds of beef with a shelf life of 3 months", the content corresponding to the label name in the ingredient management interface will be displayed as “beef” and the shelf life of the ingredient. The corresponding content will be displayed as “March”, and the content corresponding to the quantity of ingredients will be displayed as "2 catties", as shown in Figure 19.
  • the user After inputting the content of each input item in the ingredient editing interface, the user can input a confirmation operation by clicking the "Confirm" control on the ingredient editing interface.
  • the controller stores the received ingredient information input by the user and the identification information of the tag to be edited in the ingredient information set.
  • the second operand value is converted into the second intermediate value in terms of the storage time unit. Using the intermediate sum or the intermediate difference in storage time units, the previously stored shelf life value is updated to complete the shortening or extending operation on the shelf life.
  • the target operation type is a setting operation
  • the second operation value (or display value) is converted into a shelf life value in storage time units, and the shelf life value is stored in the ingredient information.
  • the controller cancels the ingredient editing interface, displays the ingredient management interface, and updates the ingredient management interface according to the input ingredient information. For example, an ingredient icon generated according to the input ingredient information is added to the updated ingredient management interface.
  • the target operation type and the first operation data for operating the shelf life of the ingredients can be obtained by parsing the voice password.
  • the data includes a first operand value and a first time unit.
  • the second operation data corresponding to the first operation data is determined, and the second operation data includes a second operation value and a second time unit, and the second time unit is a preset time unit.
  • the shelf life of the ingredients is operated, and the input content corresponding to the shelf life of the ingredients is displayed in the ingredient editing interface. Therefore, even if the time unit in the voice password does not match the preset time unit, the operation on the shelf life of the ingredients can be completed, and the user experience can be improved.
  • the controller receives the voice password input by the user, and sends the voice password data to the server; the server parses the voice password data to obtain corresponding voice content, and generates voice command information according to the voice content, and the voice command information includes multiple Field, a field corresponds to an ingredient input item, the field name is the item name, and the field value is the operation type and/or operation data.
  • the server returns the generated voice command information to the controller, and the controller operates the corresponding input item according to the field value of each field in the voice command information, and displays the content of the corresponding input item.
  • the controller obtains instruction information for operating the quantity of ingredients by parsing the input voice password, the instruction information includes operation type and target operation data, and the target operation data includes target operation value and target measurement unit.
  • the target operand value carrying the target measurement unit is the original voice content directly parsed from the voice password. For example, if the voice password input by the user is "I want to define 2 pounds of beef", the target operand value carrying the target measurement unit is For "2 pounds".
  • the operation on the quantity of ingredients includes an input operation and a modification operation.
  • the input operation is to store the target operation value indicated in the voice password without the quantity of the ingredients previously stored;
  • the modification operation refers to In the case of the number of ingredients stored previously, the operation of increasing or decreasing the number of ingredients previously stored is performed according to the target operation value indicated in the voice password.
  • the controller parses the input voice password through the server, the server parses the voice content from the voice password, and returns the voice content to the refrigerator controller.
  • the refrigerator controller determines the instruction information for operating the quantity of ingredients according to the voice content returned by the server.
  • the controller parses the input voice password through the server, and the server parses the voice content from the voice password, determines the instruction information for manipulating the quantity of ingredients according to the voice content, and returns the instruction information to the refrigerator controller.
  • the voice content includes the target operand value carrying the target measurement unit.
  • the server or the refrigerator controller determines whether the target measurement unit is the preset measurement unit, and whether the target operation value falls within the preset measurement unit of the target measurement unit. Within the allowable operation range; if the target measurement unit is the preset measurement unit, and the target operation value falls within the allowable operation range, the target operation data including the target operation value and the target measurement unit is obtained. If the target measurement unit is not the preset measurement unit, or the target operation value does not fall within the allowable operation range, the process ends.
  • the preset measurement units may be divided into weight measurement units, singular measurement units, and plural measurement units.
  • the unit of measurement of weight may include kilograms, grams, and jin, and the unit of measurement may include handle, portion, piece, block, bar, bottle, root, only, piece, slice, string, plate, can, cup, can, etc.
  • Units of measure may include bags, bags, boxes, and the like.
  • the server can parse the operation type information from it.
  • the server cannot parse the operation type information from it. . If the server fails to parse the operation type information from the voice password, or the parsed operation type is not an operation type supported by the refrigerator controller, the input operation is used as the target operation to determine the operation type representing the input operation.
  • the controller After the controller obtains the instruction information for operating the quantity of ingredients according to the input voice password by the controller, according to the operation type and target operation data in the instruction information, the controller determines the target display value in the target measurement unit, and displays the target value on the display.
  • the numerical value and the target measurement unit are displayed in the ingredient editing interface as the input content corresponding to the quantity of the ingredient.
  • the step of determining the target display value may specifically include:
  • the target operand value in the instruction information is determined as the target display value.
  • the voice password input by the user is "I want to define 2 pounds of beef".
  • the target operation value is 2
  • the target measurement unit is catties.
  • the target display value is the target operand value, which is 2.
  • the operation type characterizes the modification operation, it is first determined whether the target unit of measure matches the category of the previously stored unit of measure.
  • the previously stored measurement unit is the measurement unit of the previously stored quantity of ingredients.
  • the operation type represents an increase operation, the sum of the previously stored ingredient quantity value and the target operation value is determined as the target display value; if the operation type represents the addition operation In the reduction operation, the difference between the previously stored ingredient quantity value and the target operation value is determined as the target display value.
  • the modification operation can be completed only by matching the quantity measurement unit in the user's voice password with the previously stored measurement unit category, without the need for the quantity in the user's voice password.
  • the unit of measure is exactly the same as the previously stored unit of measure.
  • the target measurement unit does not match the previously stored measurement unit category, a predetermined prompt message is displayed on the upper layer of the ingredient editing interface to remind the user that the shelf life of the ingredient cannot be manipulated according to the input voice password.
  • the controller determines whether the target measurement unit and the previously stored measurement unit are both weight units, singular measurement units, or plural measurement units; if both the target measurement unit and the previously stored measurement unit are weight units, singular measurement units unit of measure or plural units of measure, it is determined that the category of the target unit of measure and the previously stored unit of measure match.
  • the input voice password is "I want to define 5 bags of beef”, that is, the target measurement unit is "bag”, and the previously stored measurement unit is "jin”, which belongs to the weight measurement unit.
  • the categories do not match because "bag” is a plural unit of measure and "jin" is a weight unit of measure. Therefore, a prompt message as shown in FIG. 20 needs to be displayed on the ingredient editing interface, specifically, "The current operation cannot be completed because the measurement units do not match.”
  • the step of the controller determining the target display value may specifically include: judging whether the target measurement unit and the previously stored measurement unit are consistent. ; When the target measurement unit is inconsistent with the previously stored measurement unit, convert the previously stored amount of ingredients into an intermediate value measured in the target measurement unit; finally, determine the target display value according to the target operation value and the intermediate value, that is, if the operation If the operation type represents an increase operation, the sum of the intermediate value and the target operand value is determined as the target display value. If the operation type represents a decrease operation, the difference between the intermediate value and the target operand value is determined as the target display value.
  • the ingredient editing interface when the ingredient editing interface is displayed, in response to the user's input of the voice password "I want to define 2 pounds of beef with a shelf life of 3 months", the content corresponding to the label name in the ingredient management interface will be displayed as “beef” and the shelf life of the ingredient. The corresponding content will be displayed as “March”, and the content corresponding to the quantity of ingredients will be displayed as "2 catties”, as shown in Figure 21.
  • the user After inputting the content of each input item in the ingredient editing interface, the user can input a confirmation operation by clicking the "Confirm" control on the ingredient editing interface.
  • the controller stores the received ingredient information input by the user in the ingredient information set corresponding to the identification information of the tag to be edited.
  • the operation on the quantity of the ingredients is an input operation
  • the target display value carrying the target measurement unit is taken as an item of the ingredient information, and stored in the ingredient information set.
  • the operation on the quantity of ingredients is a modification operation, the previously stored ingredient quantity value and measurement unit are updated using the target display value and the target measurement unit.
  • the controller cancels the ingredient editing interface, displays the ingredient management interface, and updates the ingredient management interface according to the input ingredient information. For example, an ingredient icon generated according to the input ingredient information is added to the updated ingredient management interface.
  • the user when the ingredient editing interface is displayed, the user can input or modify the quantity of ingredients by inputting a voice password.
  • the input operation can be completed, and the user does not need to input the voice password according to the displayed quantity measurement unit , just say the quantity unit of measure is the default unit of measure.
  • the quantity measurement unit in the user's voice password needs to match the type of the previously stored measurement unit, and the modification operation can be completed, without the need for the quantity measurement unit in the user's voice password.
  • the previously stored unit of measure is exactly the same. In the refrigerator, when the quantity measurement unit spoken by the user is inconsistent with the currently displayed default measurement unit, it will be displayed according to the quantity measurement unit spoken by the user, so as to improve the user experience.
  • the embodiment of the present application also provides a voice control method, and the execution body of the method includes but is not limited to a controller of a refrigerator.
  • the TV can view and edit the ingredients in the refrigerator through the cloud server, such as opening a smart home related application.
  • the TV edits the ingredients, it is also synchronized to the refrigerator through the cloud.
  • Fig. 22 is a flowchart of a voice control method according to an exemplary embodiment of the present application. As shown in Fig. 22, the method may include:
  • S103 Determine second operation data corresponding to the first operation data, where the second operation data includes a second operation value and a second time unit, and the second time unit is a preset time unit.
  • determining the second operation data corresponding to the first operation data includes: when the first time unit is consistent with a preset time unit and the first operation value is an integer, determining the first time unit as In the second time unit, the first operand value is determined as the second operand value; when the first time unit is inconsistent with the preset time unit, or the first operand value is not an integer, the first operand value is converted into a preset time unit The second operand value of the unit meter, the second operand value is an integer.
  • the preset time unit includes months and days; when the first time unit is inconsistent with the preset time unit, or the first operand value is not an integer, the first operand value is converted into a preset time unit
  • the second operand value in units includes: when the first time unit is year or month, converting the first operand value into the second operand value in months or days; when the first time unit is week or day, converting the first operand value into a second operand value in months or days; The first operand value is converted to a second operand value in days.
  • obtaining the target operation type for operating the shelf life of the food material by parsing the voice password includes: when the first instruction information further includes the operation type, determining the operation type as the target operation type; When the instruction information does not include the operation type, the preset operation type is determined as the target operation type.
  • displaying the input content corresponding to the shelf life of the ingredient in the ingredient editing interface according to the target operation type and the second operation value carrying the second time unit includes: determining the display according to the target operation type and the second operation data
  • the display data includes the display value and the second time unit; the display data is used as the input content corresponding to the shelf life of the food material, and is displayed in the food material editing interface.
  • the target operation type includes an extension operation, a shortening operation, and a setting operation
  • determining the display data according to the target operation type and the second operation data includes: when the target operation type is a setting operation, determining the second operation value as Display value; when the target operation type is an extension operation, the displayed value is determined according to the sum of the previously stored shelf life value and the second operand value; when the target operation type is a shortening operation, according to the previously stored shelf life value and the first operation value. The difference between the two operand values determines the displayed value.
  • determining the display value according to the sum of the previously stored shelf life value and the second operand value includes: dividing the previously stored shelf life value and the second operand value respectively Convert to the first intermediate value and the second intermediate value in intermediate time units; add the first intermediate value to the second intermediate value to obtain an intermediate sum in intermediate time units; convert the intermediate sum to the second intermediate value The displayed value of the unit meter.
  • determining the displayed value according to the difference between the previously stored shelf life value and the second operand value including: converting the previously stored shelf life value and the second operand value into an intermediate time unit respectively Calculate the first intermediate value and the second intermediate value; subtract the first intermediate value and the second intermediate value to obtain the intermediate difference in the intermediate time unit; convert the intermediate difference into the display value in the second time unit.
  • the intermediate time unit is consistent with the storage time unit, and when the target operation type is a setting operation, the displayed value is converted into a shelf life value in the storage time unit, and the obtained shelf life value is saved in the ingredient information Medium; when the target operation type is a shortening operation, use the intermediate difference to update the previously stored shelf life value; when the target operation type is an extending operation, use the intermediate sum to update the previously stored shelf life value.
  • the displayed value is converted into a shelf life value in a preset storage time unit; and the converted shelf life value is used to save the food material information.
  • the target operation type and the first operation data for operating the shelf life of the food material can be obtained by parsing the voice password.
  • An operation data includes a first operand value and a first time unit.
  • second operation data corresponding to the first operation data is determined, where the second operation data includes a second operation value and a second time unit, and the second time unit is a preset time unit.
  • the shelf life of the ingredients is operated, and the input content corresponding to the shelf life of the ingredients is displayed in the ingredient editing interface. Therefore, even if the time unit in the voice password does not match the preset time unit, the operation on the shelf life of the ingredients can be completed, and the user experience can be improved.
  • the embodiment of the present application further provides a voice control method, as shown in FIG. 23 , the method may include:
  • the target operation data includes a target operation value and a target measurement unit.
  • the operation type of the operation characterizing the input ingredient quantity is determined.
  • the target measurement unit after parsing the target measurement unit and the target operation value from the voice password, it is determined whether the target measurement unit is a preset measurement unit, and whether the target operation value falls within the target measurement The unit is within the preset allowable operation range; if the target measurement unit is a preset measurement unit, and the target operation value falls within the allowable operation range, determine the target operation including the target operation value and the target measurement unit data.
  • S113 Determine a target display value measured in the target measurement unit according to the operation type and the target operation data, wherein, when the operation type represents an operation of inputting the quantity of ingredients, the target display value is the a target operand value, when the operation type characterizes an operation that modifies a previously stored ingredient quantity, the target display value is, if the target unit of measure matches a previously stored unit of measure category, according to the target The operating value and the quantity of the previously stored ingredients are determined.
  • the operation of modifying the quantity of the previously stored ingredient includes an increase operation and a decrease operation.
  • the target display value is determined according to the following steps: when the operation type represents the increasing operation, the sum of the previously stored ingredient quantity value and the target operation value is determined as the target display value; When the operation type characterizes the reducing operation, a difference between the previously stored ingredient quantity value and the target operation value is determined as the target display value.
  • the step of determining the target display value further includes: judging the target measurement unit and the previously stored measurement unit Whether it is consistent; when the target measurement unit is inconsistent with the previously stored measurement unit, convert the previously stored quantity of ingredients into an intermediate value measured in the target measurement unit; according to the target operation value and the The intermediate value determines the target display value.
  • a predetermined prompt message is displayed to remind the user that the Operate the shelf life of ingredients according to the input voice password.
  • the method provided by the embodiment of the present application further includes: updating the previously stored food ingredient quantity value and measurement unit by using the target display value and the target measurement unit.
  • the user when the ingredient editing interface is displayed, the user can input or modify the quantity of ingredients by inputting a voice password.
  • the input operation can be completed, and the user does not need to input the voice password according to the displayed quantity measurement unit , just say the quantity unit of measure is the default unit of measure.
  • the modification operation can be completed only by matching the quantity measurement unit in the user's voice password with the previously stored measurement unit category, without the need for the quantity measurement unit in the user's voice password to match the type of the previously stored measurement unit.
  • the previously stored unit of measure is exactly the same. In the refrigerator, when the quantity measurement unit spoken by the user is inconsistent with the currently displayed default measurement unit, it will be displayed according to the quantity measurement unit spoken by the user, so as to improve the user experience.
  • the present invention also provides a computer storage medium, wherein the computer storage medium can store a program, and when the program is executed, it can include some or all of the steps in each embodiment of the method for editing food material information provided by the present invention.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (English: read-only memory, abbreviated as: ROM) or a random access memory (English: random access memory, abbreviated as: RAM) and the like.
  • the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform.
  • the technical solutions in the embodiments of the present invention may be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products may be stored in a storage medium, such as ROM/RAM , magnetic disk, optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of the present invention.
  • a computer device which may be a personal computer, a server, or a network device, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Mechanical Engineering (AREA)
  • Thermal Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
  • Digital Computer Display Output (AREA)

Abstract

本申请公开了显示设备及食材信息编辑方法,用户可以通过语音输入,食材信息进行编辑。在显示食材编辑界面的同时,显示语音识别界面,从而快速进入到语音检测状态,及时检测用户的语音输入,用户通过说出想要编辑的食材信息,即可使冰箱自动完成食材信息输入、保存的过程,节省用户操作,且令编辑过程更加快捷,提高用户体验。

Description

显示设备及食材信息编辑方法
相关申请的交叉引用
本申请要求在2020年11月04日提交的申请号为202011218085.2、发明名称为“冰箱及食材信息编辑方法”的中国专利申请的优先权,在2021年04月19日提交的申请号为202110418594.8、发明名称为“冰箱及语音控制方法”的中国专利申请的优先权,在2021年04月19日提交的申请号为202110433466.0、发明名称为“冰箱及语音控制方法”的中国专利申请的优先权,上述申请的全部内容通过引用结合在本申请中。
技术领域
本申请涉及显示技术领域,尤其涉及显示设备及食材信息编辑方法。
背景技术
目前家庭成员获取冰箱内食材的方式一般是通过打开冰箱门,用肉眼的直观获取。
为提高用户体验,可通过为冰箱配置无线设备识别(radio frequency identification,RFID)装置,或者摄像头,使得用户在不打开冰箱门的情况下,通过在冰箱上设备有一显示器而获取。该显示器可以做成可触控的,或者可语音控制的。
一些冰箱支持用户语音输入食材信息。在通过语音控制输入食材信息时,如果用户的表达方式不标准,将会影响冰箱接收食材信息的准确性。基于此,在用户的表达方式不标准时,如何对用户的语音数据进行处理,是亟待解决的技术问题。
发明内容
本申请提供显示设备及是食材编辑方法,以提高用户体验。
第一方面,本申请提供一种显示设备,包括:
显示器,用于呈现用户界面;
声音采集器,用于接收用户输入的语音口令;
与所述显示屏和所述声音采集器连接的控制器,被配置为:
接收到用户用于进行食材编辑的指令,在显示器上呈现食材编辑界面,所述食材编辑界面上显示有食材保质期对应的输入项目;
通过所述声音采集器接收用户输入的语音口令;
解析所述语音口令,得到用于操作所述食材保质期的目标操作类型和第一操作数据,所述第一操作数据包括第一操作数值和第一时间单位;
确定所述第一操作数据对应的第二操作数据,所述第二操作数据包括第二操作数值和第二时间单位,所述第二时间单位为预设时间单位;
根据所述目标操作类型和所述第二操作数据,在所述食材编辑界面中显示所述食材保质期对应的输入内容。
第二方面,本申请提供一种显示设备,包括:
显示器,用户呈现用户界面;
声音采集器,用于接收用户输入的语音口令;
与所述显示屏和所述声音采集器连接的控制器,被配置为:
接收到用户用于进行食材编辑的指令,在显示器上呈现食材编辑界面,所述食材编辑界面上显示有食材保质期对应的输入项目;
通过声音采集器接收用户输入的语音口令;
解析所述语音口令,得到用于操作所述食材数量的操作类型和目标操作数据,所述目标操作数据包括目标操作数值和目标计量单位;
根据所述操作类型和所述目标操作数据,确定以所述目标计量单位计量的目标显示数值,其中,在所述操作类型表征输入食材数量的操作时,所述目标显示数值为所述目标操作数值,在所述操作类型表征修改在先存储的食材数量的操作时,所述目标显示数值是在所述目标计量单位与在先存储的计量单位类别匹配的情况下,根据所述目标操作数值和在先存储的食材数量确定的;
将所述目标显示数值和所述目标计量单位作为所述食材数量对应的输入内容,显示在所述食材编辑界面中。
第三方面,本申请提供一种语音控制方法,应用于显示设备,所述显示设备包括显示器,所述显示器用户呈现用户界面;所述方法包括:
接收到用户用于进行食材编辑的指令,在显示器上呈现食材编辑界面,所述食材编辑界面上显示有食材保质期对应的输入项目;
接收用户输入的语音口令;
解析所述语音口令,得到用于操作所述食材保质期的目标操作类型和第一操作数据,所述第一操作数据包括第一操作数值和第一时间单位;
确定所述第一操作数据对应的第二操作数据,所述第二操作数据包括第二操作数值和第二时间单位,所述第二时间单位为预设时间单位;
根据所述目标操作类型和所述第二操作数据,在所述食材编辑界面中显示所述食材保质期对应的输入内容。
第四方面,本申请提供一种食材信息编辑方法,所述方法包括:
当检测到标签读取区上的RFID标签时,显示包括食材编辑界面和语音识别界面的用户界面,并识别输入的语音内容所述食材编辑界面用于显示输入的食材信息,所述语音识别界面包括输入提示和识别出的语音内容;
根据识别出的所述语音内容,在所述食材编辑界面中显示输入的食材信息。
第五方面,本申请提供一种食材信息编辑方法,所述方法包括:
响应于输入的预设语音指令,判断当前显示的用户界面是否是食材编辑界面,所述食材编辑界面用于显示输入的食材信息;
若当前显示的用户界面不是食材编辑界面,则显示标签扫描界面,所述标签扫描界面中显示扫描提示,所述扫描提示用于提示用户将待编辑的RFID标签放置在所述标签读取区;当检测到用户放置在标签读取区上的RFID标签时,根据所述预设语音指令包含的语音内容显示所述食材编辑界面;
若当前显示的用户界面是食材编辑界面,根据所述预设语音指令包含的语音内容更新所述食材编辑界面。
附图说明
为了更清楚地说明本申请的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,对于本领域普通技术人员而言,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1a为本申请根据一示例性实施例示出的显示设备的交互场景;
图1b为本申请根据一示例性实施例示出的冰箱立体图;
图1c为本申请根据示例性实施例示出的冰箱外观示意图;
图2为本申请根据示例性实施例示出的冰箱硬件配置示意图;
图3为本申请根据示例性实施例示出的一种用户界面;
图4为本申请根据示例性实施例示出的另一种用户界面;
图5为本申请根据示例性实施例示出的另一种用户界面;
图6为本申请根据示例性实施例示出的另一种用户界面;
图7为本申请根据示例性实施例示出的另一种用户界面;
图8为本申请根据示例性实施例示出的另一种用户界面;
图9为本申请根据示例性实施例示出的另一种用户界面;
图10为本申请根据示例性实施例示出的另一种用户界面;
图11为本申请根据示例性实施例示出的一种食材信息编辑方法流程图;
图12为本申请根据示例性实施例示出的另一种食材信息编辑方法流程图;
图13为本申请根据示例性实施例示出的一种食材编辑界面;
图14为本申请根据示例性实施例示出的另一种食材编辑界面;
图15为本申请根据示例性实施例示出的又一种食材编辑界面;
图16为本申请根据示例性实施例示出的又一种食材编辑界面;
图17为本申请根据示例性实施例示出的又一种食材编辑界面;
图18为本申请根据示例性实施例示出的又一种食材编辑界面;
图19为本申请根据示例性实施例示出的又一种食材编辑界面;
图20为本申请根据示例性实施例示出的又一种食材编辑界面;
图21为本申请根据示例性实施例示出的又一种食材编辑界面;
图22为本申请根据示例性实施例示出的一种语音控制方法流程图;
图23为本申请根据示例性实施例示出的一种语音控制方法流程图。
具体实施方式
为了使本技术领域的人员更好地理解本申请中的技术方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本申请保护的范围。
在本发明的描述中,需要理解的是,术语“中心”、“上”、“下”、“前”、“后”、“左”、“右”、“竖直”、“水平”、“顶”、“底”、“内”、“外”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本发明和简化描述,而不是指示或暗示所指的装置或元件 必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本发明的限制。
术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本发明的描述中,除非另有说明,“多个”的含义是两个或两个以上。
在本发明的描述中,需要说明的是,除非另有明确的规定和限定,术语“安装”、“相连”、“连接”应做广义理解,例如,可以是固定连接,也可以是可拆卸连接,或一体地连接;可以是直接相连,也可以通过中间媒介间接相连,可以是两个元件内部的连通。对于本领域的普通技术人员而言,可以具体情况理解上述术语在本发明中的具体含义。
目前家庭成员获取冰箱内食材的方式一般是通过打开冰箱门,用肉眼的直观获取。
为提高用户体验,可通过为冰箱配置无线设备识别(radio frequency identification,RFID)装置,或者摄像头,使得用户在不打开冰箱门的情况下,通过在冰箱上设备有一显示器而获取。该显示器可以做成可触控的,或者可语音控制的。
目前,智能家电的互通互联称为当下研究火热的问题,人们希望在还没有回到家的时候,就可以控制家电,或者,在客厅就可以控制冰箱、空调等。
本申请提供的食材编辑为主题的描述中,可以在带有显示器的冰箱上执行,也可以在其他家电、手持设备中执行。
图1a中示例性示出了根据实施例中显示设备操作场景的示意图。
在一些实施例中,显示设备可以是带有显示屏或者显示器的任意家居或者办公设备,例如当如移动终端、平板电脑、计算机、笔记本电脑、电视、冰箱、电子白板、烤箱、洗衣机、可视电话、镜子等可以成为为用户展示UI界面的载体时,上述设备均为本申请所涉及的显示设备,并不限制是图1a所示的电视、冰箱、烤箱。
在一些实施例中,显示设备200还与服务器100进行数据通信。可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。服务器100可以向显示设备200提供各种内容和互动。服务器100可以是一个集群,也可以是多个集群,可以包括一类或多类服务器。
在一些实施例中,显示设备还可以与其他显示设备进行数据同步和通信。可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)与其他设备进行交互。可以通过同一局域网内设备进行互通,当一个显示设备进行的数据更新时,其他设备也一并更新。也可以通过账号管理的方式,当显示设备与其他设备通过账号登录时,可以与其在登录同一账号下的设备进行数据通信。
在一些实施例中,显示设备可以使用的手机、平板等智能设备或控制设备接收指令,也可以通过触摸或者手势接收用户的控制。
在一些实施例中,显示设备200还可以采用除了控制装置100和智能设备300之外的方式进行控制,例如,可以通过显示设备200设备内部配置的获取语音指令的模块直接接收用户的语音指令控制,也可以通过显示设备200设备外部设置的语音控制设备来接收用户的语音指令控制。
下面以冰箱为例,做一示例性的阐述。图1b为本申请根据示例性实施例示出的冰箱立体图,本发明实施例提供的冰箱的形状近似长方体。冰箱的外观由提供有限储存空间的储藏室101和设置在储藏室101开口处的多个箱门200限定。储藏室101为具有开口的箱 体100,在图1b所示示例中,储藏室101被包括位于下方的冷冻室101A以及位于上方的冷藏室101B,冷冻室101A和冷藏室101B分别具有一个或者多个独立的储存空间。
在一些实施例中,冷冻室101A可通过抽屉式冷冻室门200A选择性地覆盖。冷藏室101B被隔成左侧和右侧。冷藏室101B通过可枢转地安装在冷藏室101B上的冷藏室门200B选择性地打开或者关闭。
图1c为本申请根据示例性实施例示出的冰箱外观示意图,如图1b所示,在冷藏室门200B上设有显示屏,显示屏嵌入到门体中。在一些实施例中,显示屏的屏幕所在平面与箱门外表面平齐。
如图1b和图1c所示,本申请实施例提供的冰箱,其箱体内部设有至少两个储藏室,如冷冻室、冷藏室、变温室和/或保鲜室等。每个储藏室中可以具有多个独立的存储空间,如抽屉式间室。
图2为本申请根据示例性实施例示出的冰箱硬件配置示意图,作为示例,冰箱200可以包括显示屏210、控制器220、存储器250和若干用户输入接口。
在一些示例性实施方式中,冰箱200还可以包括至少一个RFID检测模块230、检测器240。显示屏210、RFID检测模块230、检测器240、存储器250通过通信接口与控制器220耦合。其中,显示器210,用于接收控制器220输出的图像信号,进行显示视频内容和图像以及菜单操控界面的组件,以及显示用于控制冰箱200的用户操控UI界面。
控制器220,可以包括一个或者多个处理单元,例如系统芯片(system on a chip,SoC)、中央处理器(central processing unit,CPU)、微控制器(microcontroller,MCU)、存储控制器等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
存储器250,可以包括一个或者多个存储单元,例如可以包括易失性存储器(volatile memory),如:动态随机存取存储器(dynamic random access memory,DRAM)、静态随机存取存储器(static random access memory,SRAM)等;还可以包括非易失性存储器(non-volatile memory,NVM),如:只读存储器(read-only memory,ROM)、闪存(flash memory)等。其中,不同的存储单元可以是独立的器件,也可以集成或者封装在一个或者多个处理器或者通信接口中,成为处理器或者通信接口的一部分。
检测器240,至少包括声音采集器,如麦克风,可以用于接收用户的声音。示例性的,包括用户控制冰箱200的控制指令的语音信号。
用户输入接口,包括麦克风、触摸板、传感器、按键等其他输入接口中至少一者。如:用户可以通过语音、触摸、手势、按压等动作实现用户指令输入功能,输入接口通过将接收的模拟信号转换为数字信号,以及数字信号转换为相应指令信号,发送至冰箱200。
在一些实施例中,控制器220可以包括语音识别模块,语音识别模块进一步包括语音解析单元和语音指令数据库,从而使冰箱可以独立完成对用户输入的语音数据的语音识别,以及将识别出的语音内容与语音指令数据库中的语音指令进行匹配的过程。
在一些示例性实施例中,RFID检测模块230可以设置在每个储藏室内,用于在相应的储藏室发射无线信号并接收该储藏室内的RFID标签的信号,以获取RFID标签中的食材信息。
在一些实施例中,冰箱还包括设置在储藏室外部的标签读取区,即用于识别RFID标签的感应区域,在标签读取区处设置RFID检测模块,用于检测放置在该区域的RFID标签。可选的,标签读取区可以设置在显示屏的下方,以便用户同时放置(或取走)RFID 标签在标签读取区和操作显示屏显示的用户界面。
在一些实施例中,冰箱还可以包括RFID处理模块,RFID处理模块分别与每个RFID检测模块连接,用于控制RFID检测模块发射无线信号以及接收RFID检测模块反馈的RFID标签的信号。
在一些实施例中,RFID检测模块具体可以为天线。不同的储藏室内设置的天线的功率可以不同。且,各个储藏室的天线的功率能够保证天线识别到自身间室包括的食材即可,从而避免功率太大时会增加误识别率,功率太小时会识别不全自身间室的食材。在具体的实现中,可以预先根据各个储藏室的空间大小确定天线的功率,并在冰箱中设置各个天线的功率,空间越大,功率越大。
为了实现对食材的智能管理,使用RFID标签对储藏室中的食材进行标识。
在一些实施例中,通过建立RFID标签与食材信息之间的对应关系,实现RFID标签与食材信息之间的虚拟关联。其中,RFID标签的标识信息可以为RFID检测模块230识别到的RFID标签的标签编码,也可以是标签编码中的一个码段。在这些实施例中,控制器220可以根据每个RFID标签的标识信息和预先建立的对应关系确定每个RFID标签对应的食材信息。
示例性的,预先建立的RFID标签的标识信息与食材信息的对应关系可以如下表所示:
RFID 食材信息
标识1 苹果
标识2 黄瓜
标识3 猪肉
…… ……
在建立RFID标签与食材信息的对应关系后,控制器220通过检测RFID标签的信号获取RFID标签的标签编码,根据标签编码即可确定各标签关联的食材信息。
在一些实施例中,各标签关联的食材信息关联一个储藏室,根据食材信息关联的储藏室即可确定该食材的存放位置,如食材信息“苹果”与“冷藏室”关联,可以确定苹果存放在冷藏室中。
在一些实施例中,在显示屏210上显示食材管理界面,用户通过操作食材管理界面管理冰箱中的食材。比如,根据储藏室内每个RFID标签关联的食材信息在食材管理界面中绘制对应的食材控件/图标,使得冰箱中的食材以图标、图文等形式尽数展示。此外,还可以在食材管理界面中绘制功能控件,如RFID标签识别控件、食材添加控件等等,以供用户操作以触发控制器210实现相应功能。
图3为本申请根据示例性实施例示出的一种用户界面,其具体为一种示例性的食材管理界面。参阅图3,该食材管理界面包括RFID标签编辑控件、推荐菜谱控件和与各个储藏室对应的食材展示区,如冷藏室对应的食材展示区310,每个食材展示区中显示有相应的食材图标和食材名称,如食材展示区310中的食材图标“苹果”311。
在一些实施例中,RFID标签的标签编码包括至少两个码段,分别为第一码段和第二码段。其中,第一码段用于写入第一编码,该第一编码可以是预定编码或者是非预定编码。对于第一编码为预定编码的RFID标签,其对应的食材信息可由用户自定义,即为自定义 标签;对于第一编码为非预定编码的RFID标签,其对应的预设食材信息被预先保存在云端服务器或者额本地食材库中,不可由用户自定义,即为预定义标签。第二码段用于写入第二编码,该第二编码为RFID标签的唯一性标识信息。需要说明的是,用户自定义食材名称是指用户可以根据需求将任意食材名称与RFID标签关联起来,同时,用户也可以根据需求的变化更改定义过的标签,从而使同一标签前后与不同的食材名称相关联,而用户不可以自定义食材名称即是指用户不可以更改与RFID标签关联的食材名称,此类RFID标签关联的食材名称被预先定义,并保存在云端服务器中或者本地食材库中。
当给定一RFID标签后,该标签是为预定义标签,还是为自定义标签,可以根据标签编码所包含的第一编码确定。若第一编码是预定编码,则该标签是自定义标签,若第一编码不是预定编码,则该标签是预定义标签。在一些实施例中,RFID标签的标签编码包括的至少两个码段符合预设组成规则,控制器在获取到标签编码后,根据该预设组成规则截取第一码段和/或第二码段等以获取到第一编码和/或第二编码,从而节省了解析长编码信息的过程,提高处理效率。
在一些实施例中,预定编码具有唯一性,如00;非预定编码不具有唯一性,其可以有多个,一个非预定编码对应于一种食材信息。
示例性的,一种RFID标签的标签编码结构如下:
Figure PCTCN2021114091-appb-000001
例如,控制器获取到RFID标签的标签编码为“01123456789012345678901234”,则根据预设组成规则,可以截取到第一编码为“01”,截取到第二编码为“123456789012345678901234”。
需要说明的是,根据不同的需求,RFID标签的标签编码还可以包括更多码段,如第三码段,用于写入RFID标签的厂家标识,再如第四码段,用于作为标签编码的保留位,以提高RFID标签的可扩展性。在另一些实施例中,RFID标签的厂家标识也可以包含在第二码段中,此处不予赘述。
示例性的,第一编码(非预定编码)与食材信息的对应关系可如下表所示:
RFID第一编码 食材名称
01 萝卜
02 胡萝卜
03 莲藕
…… ……
在一些实施例中,在显示屏上显示食材管理界面时,用户可以通过操作食材管理界面输入指示进行食材信息编辑的指令,例如,用户点击食材管理界面提供的食材信息编辑控件以指示进行食材信息编辑;当控制器接收到该指令后,开始检测放置在标签读取区上的RFID标签的信号以获取RFID标签的标识信息,并显示用于对该RFID标签关联的食材信息进行编辑的界面,即食材编辑界面,在食材编辑界面中输入用于与该RFID标签关联的食材信息。
在一些实施例中,食材编辑界面中还可以显示获取到的RFID标签的标识信息,从而 使用户可以直观看到RFID标签的标识信息,且无需用户手动输入标识信息,提升用户体验。
在一些实施例中,食材编辑界面中显示至少一个食材编辑项目,每个食材编辑项目包括项目名称和项目内容,其中,项目内容即为待编辑的部分,用户可以通过在输入位置处输入各食材编辑项目的项目内容,输入用于与该RFID标签进行关联的食材信息。输入完成后,控制器将输入的食材信息与标识信息对应保存,从而,完成并完善RFID标签的标识信息与食材信息的对应关系表的建立。
在一些实施例中,用于编辑食材信息的界面可以称为食材编辑界面,其上显示的食材编辑项目可以包括食材名称编辑项目、食材保质期编辑项目、食材数量编辑项目,等等。应理解,食材名称编辑项目的项目名称可以为“标签名称”,项目内容即为待输入或更新的食材名称,食材保质期编辑项目的项目名称可以为“保质期”,项目内容即为待输入或更新的保质期,食材数量编辑项目的项目名称可以为“数量”,项目内容即为待选择或更改的数量。
如图3所示,用户可以点击该界面中的RFID标签编辑控件以输入指示进行食材信息编辑的指令。响应于该指令,控制器控制RFID检测模块开始检测标签读取区上RFID标签的信号以获取RFID标签的标识信息。在控制器获取到RFID标签的标识信息后,在显示屏上呈现食材编辑界面。
在一些实施例中,当控制器接收到用户输入的指示进行食材信息编辑的指令后,响应于该指令,显示标签扫描界面,在标签扫描界面中显示扫描提示,通过显示该扫描提示,提示用户将待编辑的RFID标签放置在标签读取区上。同时,控制器控制RFID检测模块开始检测标签读取区上RFID标签的信号以获取RFID标签的标识信息。在控制器获取到RFID标签的标识信息后,在显示屏上呈现食材编辑界面。
在一些实施例中,用户也可以通过说出预设语音口令,以指示进行食材信息编辑的指令。比如,用户说出:“标签编辑”。当接收到用户输入的语音数据且识别出内容为“标签编辑”时,确认接收到输入的用于触发对RFID标签对应的食材信息进行编辑的预设语音指令。此时,控制器响应于该指令,显示标签扫描界面,并开始检测标签读取区上的RFID标签。
在一些实施例中,当接收到输入的预设语音指令时,首先判断是否检测到标签读取区上的RFID标签,若未检测到标签读取区上的RFID标签,说明用户还未将待编辑的RFID标签放置在标签读取区上,此时,再显示包含扫描提示的标签扫描界面,以提示用户将待编辑的RFID标签放置在所述标签读取区。
在一些实施例中,上述用于指示进行食材信息编辑的指令,还被称为RFID标签编辑指令。
图4为本申请在一些实施例中示出的用户界面,具体为一种示例性的标签扫描界面,如图4所示,该标签扫描界面上显示有扫描提示,其具体内容为“请将RFID标签防止在屏幕下方扫描区”。当检测到用户放置在标签读取区上的RFID标签时,显示如图5所示的食材编辑界面。
参阅图5,在该食材编辑界面上,显示有RFID标签的标识信息“20200005”,这样,无需用户手动输入该标识信息,从而避免输入错误,节省用户操作。在该食材编辑界面上,还显示有多个食材编辑项目,分别为食材名称编辑项目510、食材保质期编辑项目520, 其中,每个食材编辑项目对应有用于输入相应项目内容的输入位置。以及,显示有“取消”控件530和“确定”控件540。
这样,令每个RFID标签都与用户输入的食材信息对应起来,实现了RFID标签与食材信息之间的虚拟关联,根据RFID标签的标识信息即可查找到对应的食材信息,且可以通过修改RFID标签与食材信息之间的对应关系,使得同一个RFID标签先后与不同的食材信息相对应,提高RFID标签的使用灵活性。
在一些实施例中,用户可以通过语音指令,编辑RFID标签对应的食材信息,比如,用户可以说:“定义2斤牛肉标签”,控制器即可根据识别出的“牛肉”、“2斤”等语音内容,自动更新相应食材编辑项目的项目内容,而无需用户输入文字。这样,不但可以进一步减少用户操作,令编辑过程更加快捷,还可以提高该功能的普适程度,令不会打字的老人或小孩也可以完成食材信息的编辑。
在一些实施例中,当控制器检测到用户放置在标签读取区上的RFID标签时,在显示上述食材编辑界面的同时,显示语音识别界面,并开始接收、识别用户的语音输入,其中,语音识别界面中可以显示输入提示和识别出的语音内容;根据识别出的语音内容,更新界面中食材编辑项目的项目内容。
图6为本申请在一些实施例中示出的用户界面,具体为一种同时显示食材编辑界面和语音识别界面的用户界面,如图6所示,语音识别界面所在的视图显示区610显示在食材编辑界面所在视图显示区620的上层,语音识别界面中显示有输入提示,具体为内容是“你可以说,我要定义2斤水蜜桃”的文字提示。当接收到用户输入的语音数据并识别出语音内容时,语音识别界面还可以显示识别出的语音内容。
在一些实施例中,控制器接收到用户输入的语音数据,将语音数据发送给服务器;服务器识别该语音数据得到对应的语音内容,根据语音内容生成语音指令,语音指令包括多个字段,一个字段对应一个食材编辑项目,字段名称即为项目名称,字段值即为项目内容。服务器将生成的语音指令返回给冰箱,冰箱根据语音指令中各字段的字段值更新对应食材编辑项目的项目内容。
一种示例性的语音指令格式如下:
字段名称 字段值
cmd RFID-write
name 牛肉
count 1000g
由上述语音指令可以看出,该语音指令指示冰箱执行RFID标签编辑操作,其中,字段名称“name”对应的字段值“牛肉”用于更新食材名称编辑项目的项目内容,字段名称“count”对应的字段值“1000g”用于更新食材数量编辑项目。
在一些实施例中,在控制器检测到用户放置在标签读取区上的RFID标签后,判断该RFID标签是否是自定义标签,若该RFID标签是自定义标签,则显示第一编辑界面,该第一编辑界面中包括多个食材编辑项目,其中,在每个食材编辑项目对应的项目内容显示区域(即输入位置区域)显示预置的默认字符,每个食材编辑项目的项目内容都是可以被编辑的。这样,用户可以通过输入文字或者输入语音的方式,更新每个食材编辑项目的项目内容。而若该RFID标签不是自定义标签,则根据标签编码中的第一编码获取该标签对应的预设食材信息,根据获取到的预设食材信息显示第二编辑界面。与第一编辑界面不同的 是,第二编辑界面中,在每个食材编辑项目对应的项目内容显示区域中显示预设食材信息,如预设食材名称等,并且,食材名称项目的项目内容是不可被编辑的,即用户不可通过输入文字或者输入语音的方式更改当前显示的食材名称。
具体实现中,控制器可以根据第一编码从云端服务器获取对应的预设食材信息。或者,控制器可以根据第一编码从本地预置的食材库中获取对应的预设食材信息。其中,本地预置的食材库可以为控制器预先从云端服务器下载得到。
在一些实施例中,若用户放置在标签读取区上的RFID标签是自定义标签,根据标签编码中的第二编码(即RFID标签的标识信息)判断本地数据中是否存在与第二编码相对应的食材信息,若本地数据中存在与第二编码相对应的食材信息,则将该食材信息作为各食材编辑项目的项目内容,显示在第一编辑界面,显示第一编辑界面中。这样一来,一方面,可以向用户展示该RFID标签当前已关联的食材信息,另一方面,若用户想要修改当前已关联的食材信息,则以通过文字输入操作或者语音输入操作输入新的食材信息即可。除此之外,若用户只想修改部分食材信息,则只需对部分食材信息进行重新输入即可,对于不想修改的另一部分食材信息则无需重新输入。若本地数据中不存在与该RFID标签相关联的食材信息,则将预置的默认字符作为各食材编辑项目的项目内容,显示在第一编辑界面中。
图7为本申请在一些实施例中示出的一种可能的用户界面,其具体为一种示例性的第一编辑界面,如图7所示,在该界面中,各食材编辑项目的项目内容均为默认字符“未定义”。
图8为本申请在一些实施例中示出的一种可能的用户界面,其具体为一种示例性的第二编辑界面,如图8所示,在该界面中,食材名称编辑项目810的项目内容为默认字符“苹果”、保质期编辑项目820的项目内容为默认字符“1”、食材数量编辑项目830的项目内容为默认字符“1”。其中,“苹果”、“1”等即为当前检测到的标签对应的预设食材信息。
如前所述,对于预定义标签,其关联的食材名称是与不可编辑的,对于自定义标签,其关联的食材名称是可以编辑的。基于此,冰箱控制器在根据服务器返回的语音指令更新食材编辑项目时,若RFID标签是自定义标签,则对所有食材编辑项目内容进行更新,若RFID标签不是自定义标签,则对除食材名称编辑项目以外的食材编辑项目的项目内容进行更新。
应当理解,根据预设语音指令包含的语音内容显示或者更新各食材编辑项目的项目内容的过程,可以参见如图1a-图8示出的实施例,比如,在RFID标签是自定义标签时,对所有食材编辑项目进行更新,在RFID标签不是自定义标签时,对除食材名称编辑项目以外的食材编辑项目进行更新,等等,此处不予赘述。
由以上实施例可以看出,基于本申请实施例提供的冰箱,用户可以通过语音输入,对RFID标签对应的食材信息进行编辑。具体的,当检测到用户放置在标签读取区上的RFID标签时,在显示食材编辑界面的同时,显示语音识别界面,即自动将语音应用切换到前台运行,从而快速进入到语音检测状态,及时检测用户的语音输入,用户通过说出想要编辑的食材信息,即可使冰箱自动完成信息输入过程,节省用户操作,且令编辑过程更加快捷,提高用户体验。
图9为本申请根据示例性实施例示出的一种用户界面,其具体为一种示例性的食材库界面。如图9所示,该界面中包括名称为“最近使用”、“全部”、“水果”、“蔬菜”、“肉 类”、“饮品”、“水产”、“其他”和“自定义”的操作控件111-119。在图9中,由于“全部”控件112被选中,因此在该界面中显示食材全集中每个食材信息对应的食材图标。在显示图9所示界面时,若用户点击“自定义”控件119,用户界面由图9变化为图10,在图10所示界面中,显示有自定义食材集合中每个食材信息对应的食材图标。
如图10所示,在显示自定义食材集合的食材库界面中,还显示有用于添加自定义食材信息的操作控件121。用户可以通过操作该操作控件121输入用于添加自定义食材的指令,控制器响应于该指令,显示食材定义界面,用户可以在食材定义界面中输入新定义的食材信息。
在一些实施例中,在图9和图10所示用户界面中,用户可以通过预定操作选中一个或者多个食材图标,比如通过长按图标的操作,选中图标。还可以通过预定操作取消对图标的选中,比如长按处于选中状态的图标,以取消对该图标的选中。
本申请实施例还提供一种食材信息编辑方法,该方法应用于如图1a-图10所示的冰箱,该方法的执行主体包括但不限于冰箱的控制器。图11为本申请根据示例性实施例示出的食材信息编辑方法流程图,如图11所示,该方法可以包括:
S010,当检测到所述标签读取区上的RFID标签时,显示包括食材编辑界面和语音识别界面的用户界面,并识别输入的语音内容,所述食材编辑界面用于显示输入的食材信息,所述语音识别界面包括输入提示和识别出的语音内容。
在一些实施例中,接收输入的RFID标签编辑指令,例如用户在如图3所示界面中,通过点击RFID标签编辑控件,而输入RFID标签编辑指令;响应于输入的RFID标签编辑指令,检测标签读取区上的RFID标签。
在另一些实施例中,接收输入的预设语音指令,该预设语音指令用于触发对RFID标签对应的食材信息进行编辑,比如,用户说出预设语音口令,以输入该预设语音指令,比如说出“标签编辑”。响应于输入的预设语音指令,检测标签读取区上的RFID标签。
在一些实施例中,接收输入的预设语音指令,响应于该预设语音指令,显示标签扫描界面,该标签扫描界面中显示扫描提示,该扫描提示用于提示用户将待编辑的RFID标签放置在标签读取区。同时,检测标签读取区上的RFID标签。
S011,根据识别出的所述语音内容,在所述食材编辑界面中显示输入的食材信息。
在一些实施例中,所述当检测到用户放置在标签读取区上的RFID标签时,显示食材编辑界面,包括:获取通过检测所述RFID标签得到的标签编码,所述标签编码包括用于表征所述RFID标签是否为自定义标签的码段;根据所述标签编码判断所述RFID标签是否是自定义标签;若所述RFID标签是自定义标签,将预置的默认字符作为各食材编辑项目的项目内容,显示在所述食材编辑界面中。例如,在图7所示食材编辑界面中,各食材编辑项目的项目内容均为默认字符“未定义”。若所述RFID标签不是自定义标签,根据标签编码获取所述RFID标签的预设食材信息,将预设食材信息作为各食材编辑项目的项目内容,显示在所述食材编辑界面中。例如,在图8所示食材编辑界面中,食材名称编辑项目的项目内容为默认字符“苹果”、保质期编辑项目的项目内容为默认字符“1”、食材数量编辑项目的项目内容为默认字符“1”。其中,“苹果”、“1”等即为当前检测到的标签对应的预设食材信息。
在一些实施例中,所述根据识别出的所述语音内容,更新所述食材编辑项目的项目内容,包括:接收用户输入的语音数据,将所述语音数据发送给服务器,以使服务器识别语 音内容;接收服务器根据识别出的语音内容返回的语音指令,所述语音指令包括多个字段,一个字段对应于一个所述食材编辑项目;利用所述字段的字段值更新与所述字段对应的食材编辑项目的项目内容。
在一些实施例中,所述食材编辑项目包括食材名称编辑项目,所述根据识别出的所述语音内容,更新所述食材编辑项目的项目内容,包括:若RFID标签是自定义标签,则根据所述语音内容更新所有食材编辑项目的项目内容;若RFID标签不是自定义标签,则根据所述语音内容更新除所述食材名称编辑项目外的食材编辑项目的项目内容。
在一些实施例中,若所述RFID标签不是自定义标签,还包括:判断所述语音内容中包含的食材名称与所述预设食材信息中包含的预设食材名称是否相同;若所述语音内容中包含的食材名称与所述预设食材信息中包含的预设食材名称不相同,则显示界面提示,或者,播放语音提示,所述界面提示和所述语音提示用于提示用户所述RFID标签不支持编辑食材名称。例如,如果当前检测到的RFID标签对应的预设食材名称是“苹果”,语音指令中字段名称“name”对应的字段值“牛肉”,由于二者不同,因此需要弹出文字提示或者播放语音提示。如若当前检测到的RFID标签对应的预设食材名称是“牛肉”,由于语音指令中字段名称“name”对应的字段值也是“牛肉”,因此无需弹出文字提示或者播放语音提示。
在一些实施例中,所述控制器还用于:接收对所述食材编辑界面上指定控件的确认操作;响应于所述确认操作,根据所有食材编辑项目更新后的项目内容生成食材信息;将所述食材信息和所述RFID标签的标签编码对应保存在本地数据中。
图12为本申请根据示例性实施例示出的另一种食材信息编辑方法流程图,如图12所示,该方法可以包括:
S020,响应于输入的预设语音指令,判断当前显示的用户界面是否是食材编辑界面,所述食材编辑界面用于显示输入的食材信息;
S021,若当前显示的用户界面不是食材编辑界面,则显示标签扫描界面,所述标签扫描界面中显示扫描提示,所述扫描提示用于提示用户将待编辑的RFID标签放置在所述标签读取区;当检测到用户放置在标签读取区上的RFID标签时,根据所述预设语音指令包含的语音内容显示所述食材编辑界面;
S022,若当前显示的用户界面是食材编辑界面,根据所述预设语音指令包含的语音内容更新所述食材编辑界面。
在上述实施例中,用户可以先将待编辑的RFID标签放置在标签读取区上,此时,控制器检测到该RFID标签,显示食材编辑界面。然后用户通过说出预设语音口令,以输入预设语音指令,该预设语音指令包含用户要编辑的食材信息,比如说出“我要定义2斤牛肉”。在另一些实施例中,用户可以在将待编辑的RFID标签放置在标签读取区之前,说出预设语音口令,以输入预设语音指令,该预设语音指令用于触发编辑流程,还包括用户要编辑的食材信息,比如说出“我要定义2斤牛肉”。
由以上实施例可以看出,基于本申请实施例提供的食材信息编辑方法,用户可以通过语音输入,对RFID标签对应的食材信息进行编辑。具体的,当检测到用户放置在标签读取区上的RFID标签时,在显示食材编辑界面的同时,显示语音识别界面,即自动将语音应用切换到前台运行,从而快速进入到语音检测状态,及时检测用户的语音输入,用户通过说出想要编辑的食材信息,即可使冰箱自动完成信息输入过程,节省用户操作,且令编 辑过程更加快捷,提高用户体验。
图13为本申请根据示例性实施例示出的一种食材编辑界面,如图13所示,在该食材编辑界面上,显示有RFID标签的标识信息“20200005”,这样,无需用户手动输入该标识信息,从而避免输入错误,节省用户操作。还显示有多个输入项目,分别为食材名称输入项目410、食材保质期输入项目420和食材数量输入项目430,其中,每个食材输入项目对应有用于输入相应内容的输入位置。此外,还显示有“取消”控件440和“确定”控件450。信息输入完成后,用户可以点击“确定”控件,指示保存输入的食材信息,或者点击“取消”控件,指示返回到上一级界面。
在一些实施例中,控制器显示食材编辑界面的过程可以包括:首先根据待编辑标签的标识信息判断食材信息集合中是否存在对应的食材信息;若食材信息集合中存在对应的食材信息,则根据该食材信息在食材编辑界面中显示输入项目对应的输入内容;若食材信息集合中不存在对应的食材信息,则根据预置填充信息在食材编辑界面中显示编辑项目对应的项目内容。
在一个例子中,根据待编辑标签的标识信息判定食材信息集合中是否存在对应的食材信息,具体为:苹果、60天、1000g,显示的食材编辑界面如图14所示。参阅图14,该食材编辑界面中,“标签名称”对应的输入内容为“苹果”、“保质期”对应的输入内容为“60天”“数量”对应的输入内容为“1000g”。通过该食材编辑界面,用户可以获知待编辑标签在先关联的食材信息,还可以通过修改显示的输入内容,以输入新的食材信息。
在另一个例子中,根据待编辑标签的标识信息判定食材信息集合中不存在对应的食材信息,则显示的食材编辑界面如图15所示。参阅图15,该食材编辑界面中,“标签名称”、“保质期”、“数量”对应的输入内容均为预置填充字符“未定义”。通过该食材编辑界面,用户可以获知目标标签为全新标签,可以通过输入各编辑项目的内容,以输入用于与该待编辑标签进行关联的食材信息。
值得注意的是,在图13-图15所示食材编辑界面中,“保质期”和“数量”对应的输入位置处默认显示有计量单位。例如,在图13中,保质期的计量单位显示为“天”、数量的计量单位显示未“g”。在图14中,保质期的计量单位显示为“月”、数量的计量单位显示为“份”。以及在图15中,保质期的计量单位显示为“天”、数量的计量单位显示为“斤”。在显示食材编辑界面时,用户可以根据需求对保质期和/或食材数量的计量单位进行设置。例如,在显示如图13所示的食材管理界面时,用户可以点击计量单位旁的下拉控件,控制显示计量单位选项。
例如,在显示图13所示食材编辑界面时,用户可以点击保质期计量单位旁的下拉控件,控制保质期的计量单位选项弹出,如图16所示。保质期的计量单位选项弹出后,用户可以通过点击操作,选中要设置的计量单位,如在图16所示示例中,用户选中“月”后,计量单位选项收起,食材编辑界面中显示的计量单位由“天”变化为“月”。
例如,在显示图13所示食材编辑界面时,用户可以点击食材数量计量单位旁的下拉控件,控制食材数量的计量单位选项弹出,如图17所示。食材数量的计量单位选项弹出后,用户可以通过点击操作,选中要设置的计量单位,如在图17所示示例中,用户选中“份”后,计量单位选项收起,食材编辑界面中显示的计量单位由“g”变化为“份”。
在一些实施例中,在显示食材编辑界面时,用户可以通过语音口令,输入食材信息。语音口令中可以包括一个或者多个操作指令信息,如操作食材名称的指令信息、操作食材 保质期的指令信息以及操作食材数量的指令信息。一示例性的,在显示食材编辑界面时,如果用户说出:“定义2斤牛肉标签”,控制器则可以从该语音口令中解析出用于操作食材名称的指令信息和操作食材数量的指令信息。另一示例性的,在显示食材编辑界面时,如果用户说出:“定义保质期3个月”,控制器则可以从该语音口令中解析出用于操作食材保质期的指令信息。进而,控制器便可以根据解析出的指令信息输入相应项目对应的内容,显示在食材编辑界面中,而无需用户输入文字。这样,不但可以进一步减少用户操作,令编辑过程更加快捷,还可以提高该功能的普适程度,令不会打字的老人或小孩也可以完成食材信息的编辑。
在一些实施例中,当控制器检测到用户放置在标签读取区上的RFID标签时,在食材编辑界面中显示语音识别内容区,并开始接收、识别用户的语音口令,其中,语音识别内容区中可以显示输入提示和识别出的语音内容。在一些实施例中,食材编辑区域和语音识别内容区可以为两个不同视图显示区。不同的视图显示区可以是属于同一图层的区域,也可以是属于不同图层的区域。
图18为本申请在一些实施例中示出的一种包含语音识别内容区的食材编辑界面。如图18所示,语音识别内容区810显示在食材编辑界面的最上层,且与食材编辑区域820不重合。语音识别内容区810中显示有输入提示,具体为内容是“你可以说,我要定义2斤水蜜桃”的文字提示。当接收到用户输入的语音口令并识别出语音内容时,语音识别内容区中还可以显示识别出的语音内容。
在一些实施例中,控制器接收到用户输入的语音口令,将语音口令数据发送给服务器;服务器解析该语音口令数据得到对应的语音内容,根据语音内容生成语音指令信息,语音指令信息包括多个字段,一个字段对应一个食材输入项目,字段名称即为项目名称,字段值即为操作类型和/或操作数据。服务器将生成的语音指令信息返回给控制器,控制器根据语音指令信息中各字段的字段值对相应的输入项目进行操作,并显示相应输入项目的内容。
在一些实施例中,语音指令信息包括第一指令信息,第一指令信息用于操作食材保质期,第一指令信息中至少包括第一操作数据,第一操作数据包括第一操作数值和第一时间单位,该携带第一时间单位的第一操作数值是从语音口令中直接解析出的原始语音内容,如,如果用户输入的语音口令是“我要定义2斤牛肉,保质期3个月”,则携带第一时间单位的第一操作数值即为“3个月”。
在一些实施例中,控制器通过解析输入的语音口令,得到用于操作食材保质期的第一指令信息后,根据第一指令信息确定第二指令信息,第二指令信息包括目标操作类型和第二操作数据,第二操作数据包括第二操作数值和第二时间单位,该第二时间单位是预设时间单位中的一个。然后根据目标操作类型和第二操作数据,在食材编辑界面中显示食材保质期对应的输入内容。
在控制器在根据第一指令信息生成第二指令信息的过程中,首先判断第一时间单位是否是预设时间单位,同时判断第一操作数值是否为整数。如果第一时间单位是预设时间单位,并且第一操作数值是整数,则无需对第一指令信息中的操作数值及其单位进行处理,而是将第一时间单位确定为第二时间单位,将第一操作数值确定为第二操作数值。如果第一时间单位不是预设时间单位,或者第一操作数值不是整数,则需要对第一指令信息中的操作数值及其单位进行处理,具体是根据第一时间单位与预设时间单位之间的换算关系,将第一操作数值转换成以预设时间单位计的第二操作数值,且需保证第二操作数值为整数。
在一些可能的实现方式中,预设时间单位包括月和天。在第一时间单位为年或者月时,将第一操作数值转换成以月或者天计的第二操作数值;在第一时间单位为周或者天时,将第一操作数值转换成以天计的第二操作数值。具体来说,如果第一时间单位为年且第一操作数值是整数,如3年,则无需对其进行处理,直接以该携带第一时间单位的第一操作数值作为第二操作数值。如果第一时间单位为年且第一操作数值不是整数,如2.5年,则将该第一操作数值转换成以月计的第二操作数值,即2.5×12月。如果第一时间单位为月且第一操作数值是整数,如3个月,则无需对其进行处理,直接以该携带第一时间单位的第一操作数值作为第二操作数值。如果第一时间单位为月且第一操作数值不是整数,如2.5个月,则将该第一操作数值转换成以天计的第二操作数值,即为2.5×30天。如果第一时间单位为周(星期),则由于周并非预设时间单位,因此无论第一操作数值是否为整数,都需要将该第一操作数值转换成以天计的第二操作数值,例如,需要将3周转换成3×7天。如果第一时间单位为天,且第一操作数值是整数,则无需对其进行处理。如果第一时间单位为天,且第一操作数值不是整数,将该第一操作数值向下取整得到仍以天计的第二操作数值,例如,将2.5天向下取整得到2天,将3.4天向下取整得到3天。
另外,值得注意的是,用户语音控制输入食材信息时,输入的语音口令中还可以包括操作食材保质期的操作类型,操作类型可以包括延长操作、缩短操作以及设置操作。应当理解,如果输入的语音口令中包含冰箱支持的操作类型,则通过解析语音口令所得到的第一指令信息中,自然包括操作类型。如果输入的语音口令中不包含冰箱支持的操作类型,则第一指令信息中不包括操作类型。例如,当在显示食材编辑界面时,如果用户说出“延长保质期3个月”时,该语音口令中包含的操作类型即为延长操作;如果用户说出“缩短保质期2个月”,该语音口令中包含的操作类型即为缩短操作;如果用户说出“定义保质期3个月”,该语音口令中包含的操作类型即为设置操作。
基于此,在控制器在根据第一指令信息生成第二指令信息的过程中,如果第一指令信息还包括操作类型,则将该操作类型确定为目标操作类型,如果第一指令信息中不包括操作类型,则将预设操作类型确定为目标操作类型。作为可能的实现方式,预设操作类型可以为设置操作。即,在第一指令信息中不包含操作类型时,将设置操作确定为目标操作类型。
控制器在根据目标操作类型和第二操作数据时,首先根据目标操作类型和第二操作数据确定显示数据,显示数据由显示数值和第二时间单位组成。控制器在得到以第二时间单位计的显示数值后,将携带第二时间单位的显示数值作为食材保质期对应的输入内容,显示在食材编辑界面中。这样,在食材编辑界面中显示的时间计量单位与用户语音口令中保质期的计量单位不一致时,不但可以完成对食材保质期的操作,并且冰箱会按照用户说出的时间计量单位进行显示,以提高用户体验。
具体的,在目标操作类型为设置操作时,将第二操作数值确定为显示数值。
在目标操作类型为延长操作时,将在先存储的保质期数值和第二操作数值分别转换成以中间时间单位计的第一中间值和第二中间值;将第一中间值与第二中间值相加,得到以中间时间单位计的中间和;将中间和转换成以第二时间单位计的显示数值。为节省计算量,可以将预设的存储时间单位作为中间计量单位,存储时间单位即是在先存储的保质期数值的单位。示例性的,存储时间单位为秒,在先存储的保质期数值为200000(秒),第二操作数值为3(天)。按照前述确定显示数值的方式可知,在该示例中,需要将第二操作数 值3(天)转换成3×24×60×60(秒),然后将其与在先存储的保质期数值200000相加,得到261200(秒)。最后,将261200(秒)转换成以天计的显示数值,并向下取整得到5天。
或者,根据第二时间单位与存储时间单位的换算关系,将在先存储的保质期数值转换成以第二时间单位计的数值后,再将其与第二操作数值相加,最后得到以第二时间单位计的显示数值。
在目标操作类型为缩短操作时,将在先存储的保质期数值和第二操作数值分别转换成以中间时间单位计的第一中间值和第二中间值;将第一中间值与第二中间值相减,得到以中间时间单位计的中间差;将中间差转换成以第二时间单位计的显示数值。示例性的,存储时间单位为秒,在先存储的保质期数值为200000(秒),第二操作数值为3(天)。按照前述确定显示数值的方式可知,在以存储时间单位(秒)作为中间时间单位的情况下,需要将第二操作数值3(天)转换成3×24×60×60(秒),然后将其与在先存储的保质期数值200000相减,得到59200(秒)。最后,将59200(秒)转换成以天计的显示数值,并向下取整得到0天。
或者,根据第二时间单位与存储时间单位的换算关系,将在先存储的保质期数值转换成以第二时间单位计的数值后,再将第二操作数值与其相减,最后得到以第二时间单位计的显示数值。
示例性的,在显示食材编辑界面时,响应于用户输入的语音口令“我要定义2斤牛肉,保质期3个月”,食材管理界面中标签名称对应的内容将显示为“牛肉”、食材保质期对应的内容将显示为“3月”、食材数量对应的内容将显示为“2斤”,如图19所示。
在将食材编辑界面中各个输入项目的内容输入完成后,用户可以通过点击食材编辑界面上的“确认”控件,以输入确认操作。控制器响应于接收到用户在食材编辑界面上输入的确认操作,将接收到的用户输入的食材信息与待编辑标签的标识信息对应保存在食材信息集合中。
在上述实施例中,在目标操作类型为缩短操作或者延长操作时,将第二操作数值转换成以存储时间单位计的第二中间值,一方面可以方便计算出显示数值,另一方面可以直接使用以存储时间单位计的中间和或者中间差,更新在先存储的保质期数值,以完成对保质期的缩短操作或者延长操作。而对于目标操作类型为设置操作的情形,则将第二操作数值(或者说显示数值)转换成以存储时间单位计的保质期数值,并将该保质期数值保存在食材信息中。
此外,控制器还响应于该确认操作,撤销食材编辑界面,显示食材管理界面,并根据输入的食材信息更新食材管理界面。例如,更新后的食材管理界面中新增有根据输入的食材信息生成的食材图标。
应理解的是,相比于更新前的食材管理界面,一些更新后的食材管理界面中会显示出新的食材图标,即为新增食材对应的食材图标;一些更新后的食材管理界面中,由于一些食材的保质期被延长或者缩短,因此一些食材图标的新鲜度标识得到更新。
由以上实施例可知,基于本申请实施例提供的冰箱,可以在用户通过语音口令操作食材保质期时,通过解析语音口令,得到用于操作食材保质期的目标操作类型和第一操作数据,第一操作数据包括第一操作数值和第一时间单位。之后确定第一操作数据对应的第二操作数据,第二操作数据包括第二操作数值和第二时间单位,第二时间单位为预设时间单 位。最后根据目标操作类型和第二操作数据,对食材保质期进行操作,以及在食材编辑界面中显示食材保质期对应的输入内容。从而,即使语音口令中的时间单位与预设时间单位不符,也可以完成对食材保质期的操作,提高用户体验。
在一些实施例中,控制器接收到用户输入的语音口令,将语音口令数据发送给服务器;服务器解析该语音口令数据得到对应的语音内容,根据语音内容生成语音指令信息,语音指令信息包括多个字段,一个字段对应一个食材输入项目,字段名称即为项目名称,字段值即为操作类型和/或操作数据。服务器将生成的语音指令信息返回给控制器,控制器根据语音指令信息中各字段的字段值对相应的输入项目进行操作,并显示相应输入项目的内容。
在一些实施例中,控制器通过解析输入的语音口令,得到用于操作食材数量的指令信息,所述指令信息包括操作类型和目标操作数据,目标操作数据包括目标操作数值和目标计量单位。该携带目标计量单位的目标操作数值是从语音口令中直接解析出的原始语音内容,如,如果用户输入的语音口令是“我要定义2斤牛肉”,则携带目标计量单位的目标操作数值即为“2斤”。作为可能的实现方式,对食材数量的操作包括输入操作和修改操作,输入操作是在未在先存储的食材数量的情况下,对语音口令中指示的目标操作数值进行存储;修改操作则是指在先存储的食材数量的情况下,根据语音口令中指示的目标操作数值对在先存储的食材数量进行增加或者减少操作。
值得注意的是,在一些实现方式中,控制器通过服务器解析输入的语音口令,服务器从语音口令中解析出语音内容,将语音内容返回给冰箱控制器。冰箱控制器再根据服务器返回的语音内容,确定用于操作食材数量的指令信息。在另一些实现方式中,控制器通过服务器解析输入的语音口令,服务器从语音口令中解析出语音内容,并根据语音内容确定用于操作食材数量的指令信息,将指令信息返回给冰箱控制器。其中,语音内容包括携带目标计量单位的目标操作数值。
在上述实现方式中,服务器或者冰箱控制器从语音口令中解析出目标计量单位和目标操作数值后,判断目标计量单位是否为预设计量单位,以及目标操作数值是否落在目标计量单位预设的允许操作范围内;如果目标计量单位是预设计量单位,且目标操作数值落在允许操作范围内,则得到包含目标操作数值和目标计量单位的目标操作数据。如果目标计量单位不是预设计量单位,或者目标操作数值未落在允许操作范围内,则结束流程。示例性的,预设计量单位可以分为重量计量单位、单数计量单位和复数计量单位。其中,重量计量单位可以包括千克、克、斤,单位计量单位可以包括把、份、个、块、条、瓶、根、只、颗、片、串、盘、听、杯、罐等,复数计量单位可以包括袋、包、盒等。
需要说明的是,在用户输入的语音口令中包含操作类型信息时,服务器可以从中解析出操作类型信息,在用户输入的语音口令中不包含操作类型信息时,服务器则无法从中解析出操作类型信息。若服务器未能从语音口令中解析出操作类型信息,或者解析出的操作类型不是冰箱控制器支持的操作类型,则将输入操作作为目标操作,以确定表征输入操作的操作类型。
控制器根据控制器通过解析输入的语音口令,得到用于操作食材数量的指令信息后,根据该指令信息中的操作类型和目标操作数据,确定以目标计量单位的目标显示数值,并将目标显示数值和目标计量单位作为食材数量对应的输入内容,显示在食材编辑界面中。其中,确定目标显示数值的步骤具体可以包括:
在操作类型表征输入操作时,将指令信息中的目标操作数值确定为目标显示数值。例 如,用户输入的语音口令为“我要定义2斤牛肉”,根据该语音口令可知,操作类型为输入操作,目标操作数值为2,目标计量单位为斤。在该示例中,目标显示数值为目标操作数值,即2。这样,即使在食材编辑界面中显示的数量计量单位与用户语音口令中的数量计量单位不一致,也可以完成对食材数量的输入操作,用户无需按照显示的数量计量单位输入语音口令,只需说出的数量计量单位是预设计量单位即可。而冰箱则会在用户说出的数量计量单位与当前默认显示的计量单位不一致时,按照用户说出的数量计量单位进行显示,以提高用户体验。
在操作类型表征修改操作时,首先判断目标计量单位与在先存储的计量单位的类别是否匹配。其中,在先存储的计量单位即为在先存储的食材数量的计量单位。在目标计量单位与在先存储的计量单位类别匹配的情况下,如果操作类型表征增加操作,则将在先存储的食材数量值与目标操作数值的加和确定为目标显示数值;如果操作类型表征减少操作,将在先存储的食材数量值与目标操作数值的差值确定为目标显示数值。这样,在用户通过语音控制修改在先存储的食材数量时,只需要用户语音口令中的数量计量单位与在先存储的计量单位类别匹配,即可完成修改操作,而无需用户语音口令中的数量计量单位与在先存储的计量单位完全一致。而冰箱则会在用户说出的数量计量单位与当前默认显示的计量单位不一致时,按照用户说出的数量计量单位进行显示,以提高用户体验。反之,如果目标计量单位与在先存储的计量单位类别不匹配,则在食材编辑界面的上层显示预定提示信息,以提示用户无法根据输入的语音口令操作食材保质期。
在一些实现方式中,控制器判断目标计量单位和在先存储的计量单位是否均为重量单位、单数计量单位或者复数计量单位;若目标计量单位和在先存储的计量单位均为重量单位、单数计量单位或者复数计量单位,则确定目标计量单位和在先存储的计量单位的类别匹配。在一个例子中,输入的语音口令为“我要定义5袋牛肉”,即目标计量单位为“袋”,在先存储的计量单位为“斤”,属于重量计量单位。在该示例中,由于“袋”属于复数计量单位,而“斤”属于重量计量单位,因此二者的类别不匹配。因此,需要在食材编辑界面上显示如图20中示出的提示信息,具体为“由于计量单位不匹配,无法完成当前操作”。
值得注意的是,在目标计量单位和在先存储的计量单位均为重量单位的情形中,控制器确定目标显示数值的步骤,具体可以包括:判断目标计量单位和在先存储的计量单位是否一致;在目标计量单位和在先存储的计量单位不一致时,将在先存储的食材数量转换成以目标计量单位计量的中间数值;最后根据目标操作数值和中间数值确定目标显示数值,即,如果操作类型表征增加操作,则将该中间数值与目标操作数值的加和确定为目标显示数值,如果操作类型表征减少操作,则将该中间数值与目标操作数值的差值确定为目标显示数值。
示例性的,在显示食材编辑界面时,响应于用户输入的语音口令“我要定义2斤牛肉,保质期3个月”,食材管理界面中标签名称对应的内容将显示为“牛肉”、食材保质期对应的内容将显示为“3月”、食材数量对应的内容将显示为“2斤”,如图21所示。
在将食材编辑界面中各个输入项目的内容输入完成后,用户可以通过点击食材编辑界面上的“确认”控件,以输入确认操作。控制器响应于接收到该确认操作,将接收到的用户输入的食材信息与待编辑标签的标识信息对应保存在食材信息集合中。其中,在对食材数量的操作为输入操作时,将携带目标计量单位的目标显示数值作为食材信息中的一项,保存在食材信息集合中。在对食材数量的操作为修改操作时,则使用目标显示数值和目标 计量单位更新在先存储的食材数量值和计量单位。
此外,控制器还响应于该确认操作,撤销食材编辑界面,显示食材管理界面,并根据输入的食材信息更新食材管理界面。例如,更新后的食材管理界面中新增有根据输入的食材信息生成的食材图标。
由以上实施例可知,基于本申请实施例提供的冰箱,在显示食材编辑界面时,用户可以通过输入语音口令,输入或者修改食材数量。其中,在通过语音控制输入食材数量时,即使在食材编辑界面中显示的数量计量单位与用户语音口令中的数量计量单位不一致,也可以完成输入操作,用户无需按照显示的数量计量单位输入语音口令,只需说出的数量计量单位是预设计量单位即可。在通过语音控制修改在先存储的食材数量时,只需要用户语音口令中的数量计量单位与在先存储的计量单位类别匹配,即可完成修改操作,而无需用户语音口令中的数量计量单位与在先存储的计量单位完全一致。而冰箱则会在用户说出的数量计量单位与当前默认显示的计量单位不一致时,按照用户说出的数量计量单位进行显示,以提高用户体验。
本申请实施例还提供一种语音控制方法,该方法的执行主体包括但不限于冰箱的控制器。示例性地,当电视与冰箱通过云端互联时,电视可以通过云端服务器查看和编辑冰箱内的食材,如打开智能家居相关的应用程序。在电视上编辑食材可以通过预先安装的语音助手进行对食材的编辑,也可以是控制器按键或者触控等方式。当电视对食材进行编辑后,也通过云端同步到冰箱上。
图22为本申请根据示例性实施例示出的语音控制方法流程图,如图22所示,该方法可以包括:
S101,在显示食材编辑界面时,接收用户输入的语音口令。
S102,通过解析所述语音口令,得到用于操作所述食材保质期的目标操作类型和第一操作数据,所述第一操作数据包括第一操作数值和第一时间单位。
S103,确定所述第一操作数据对应的第二操作数据,所述第二操作数据包括第二操作数值和第二时间单位,所述第二时间单位为预设时间单位。
在一些实施例中,确定所述第一操作数据对应的第二操作数据,包括:在第一时间单位与预设时间单位一致,且第一操作数值为整数时,将第一时间单位确定为第二时间单位,将第一操作数值确定为第二操作数值;在第一时间单位与预设时间单位不一致,或者第一操作数值不为整数时,将第一操作数值转换成以预设时间单位计的第二操作数值,第二操作数值为整数。
在一些实施例中,预设时间单位包括月和天;在所述第一时间单位与预设时间单位不一致,或者第一操作数值不为整数时,将第一操作数值转换成以预设时间单位计的第二操作数值,包括:在第一时间单位为年或者月时,将第一操作数值转换成以月或者天计的第二操作数值;在第一时间单位为周或者天时,将第一操作数值转换成以天计的第二操作数值。
在一些实施例中,通过解析所述语音口令,得到用于操作所述食材保质期的目标操作类型,包括:在第一指令信息还包括操作类型时,将操作类型确定为目标操作类型;在第一指令信息不包括操作类型时,将预设操作类型确定为目标操作类型。
S104,根据所述目标操作类型和所述第二操作数据,在所述食材编辑界面中显示所述食材保质期对应的输入内容。
在一些实施例中,根据目标操作类型和携带第二时间单位的第二操作数值,在食材编辑界面中显示食材保质期对应的输入内容,包括:根据所述目标操作类型和第二操作数据确定显示数据,所述显示数据包括显示数值和所述第二时间单位;将所述显示数据作为所述食材保质期对应的输入内容,显示在所述食材编辑界面中。
在一些实施例中,目标操作类型包括延长操作、缩短操作以及设置操作,根据目标操作类型和第二操作数据确定显示数据,包括:在目标操作类型为设置操作时,将第二操作数值确定为显示数值;在目标操作类型为延长操作时,根据在先存储的保质期数值与第二操作数值的加和,确定显示数值;在目标操作类型为缩短操作时,根据在先存储的保质期数值与第二操作数值的差值,确定显示数值。
在一些实施例中,在目标操作类型为延长操作时,根据在先存储的保质期数值与第二操作数值的加和,确定显示数值,包括:将在先存储的保质期数值和第二操作数值分别转换成以中间时间单位计的第一中间值和第二中间值;将第一中间值与第二中间值相加,得到以中间时间单位计的中间和;将中间和转换成以第二时间单位计的显示数值。
在目标操作类型为缩短操作时,根据在先存储的保质期数值与第二操作数值的差值,确定显示数值,包括:将在先存储的保质期数值和第二操作数值分别转换成以中间时间单位计的第一中间值和第二中间值;将第一中间值与第二中间值相减,得到以中间时间单位计的中间差;将中间差转换成以第二时间单位计的显示数值。
在一些实施例中,中间时间单位与所述存储时间单位一致,在目标操作类型为设置操作时,将显示数值转换成以存储时间单位计的保质期数值,并将得到的保质期数值保存在食材信息中;在目标操作类型为缩短操作时,使用中间差更新在先存储的保质期数值;在目标操作类型为延长操作时,使用中间和更新在先存储的保质期数值。
在一些实施例中,将显示数值转换成以预设的存储时间单位计的保质期数值;使用转换得到的保质期数值保存在食材信息中。
由以上实施例可知,基于本申请实施例提供的语音控制方法,可以在用户通过语音口令操作食材保质期时,通过解析语音口令,得到用于操作食材保质期的目标操作类型和第一操作数据,第一操作数据包括第一操作数值和第一时间单位。之后确定第一操作数据对应的第二操作数据,第二操作数据包括第二操作数值和第二时间单位,第二时间单位为预设时间单位。最后根据目标操作类型和第二操作数据,对食材保质期进行操作,以及在食材编辑界面中显示食材保质期对应的输入内容。从而,即使语音口令中的时间单位与预设时间单位不符,也可以完成对食材保质期的操作,提高用户体验。
基于本申请实施例提供的冰箱,本申请实施例还提供一种语音控制方法,如图23所示,该方法可以包括:
S111,在显示食材编辑界面时,接收用户输入的语音口令。
S112,通过解析所述语音口令,得到用于操作所述食材数量的操作类型和目标操作数据,所述目标操作数据包括目标操作数值和目标计量单位。
在一些实施例中,当从所述语音口令中未解析出操作类型时,确定表征输入食材数量的操作的操作类型。
在一些实施例中,在从所述语音口令中解析出目标计量单位和目标操作数值后,判断所述目标计量单位是否为预设计量单位,以及所述目标操作数值是否落在所述目标计量单位预设的允许操作范围内;若所述目标计量单位是预设计量单位,且所述目标操作数值落 在所述允许操作范围内,确定包含所述目标操作数值和目标计量单位的目标操作数据。
S113,根据所述操作类型和所述目标操作数据,确定以所述目标计量单位计量的目标显示数值,其中,在所述操作类型表征输入食材数量的操作时,所述目标显示数值为所述目标操作数值,在所述操作类型表征修改在先存储的食材数量的操作时,所述目标显示数值是在所述目标计量单位与在先存储的计量单位类别匹配的情况下,根据所述目标操作数值和在先存储的食材数量确定的。
在一些实施例中,按照下述步骤判断所述目标计量单位与在先存储的计量单位的类别是否匹配:判断所述目标计量单位和在先存储的计量单位是否均为重量单位、单数计量单位或者复数计量单位;若所述目标计量单位和在先存储的计量单位均为重量单位、单数计量单位或者复数计量单位,则确定所述目标计量单位和在先存储的计量单位的类别匹配。
在一些实施例中,所述修改在先存储的食材数量的操作包括增加操作和减少操作。按照下述步骤确定所述目标显示数值:在所述操作类型表征所述增加操作时,将所述在先存储的食材数量值与所述目标操作数值的加和确定为所述目标显示数值;在所述操作类型表征所述减少操作时,将所述在先存储的食材数量值与所述目标操作数值的差值确定为所述目标显示数值。
在一些实施例中,在所述目标计量单位和在先存储的计量单位均为重量单位时,确定所述目标显示数值的步骤,还包括:判断所述目标计量单位和在先存储的计量单位是否一致;在所述目标计量单位和在先存储的计量单位不一致时,将所述在先存储的食材数量转换成以所述目标计量单位计量的中间数值;根据所述目标操作数值和所述中间数值确定所述目标显示数值。
在一些实施例中,在所述操作类型表征修改在先存储的食材数量的操作时,如果所述目标计量单位与在先存储的计量单位类别不匹配,则显示预定提示信息,以提示用户无法根据输入的语音口令操作食材保质期。
S114,将所述目标显示数值和所述目标计量单位作为所述食材数量对应的输入内容,显示在所述食材编辑界面中。
在一些实施例中,本申请实施例提供的方法还包括:使用所述目标显示数值和目标计量单位更新在先存储的食材数量值和计量单位。
由以上实施例可知,基于本申请实施例提供的语音控制方法,在显示食材编辑界面时,用户可以通过输入语音口令,输入或者修改食材数量。其中,在通过语音控制输入食材数量时,即使在食材编辑界面中显示的数量计量单位与用户语音口令中的数量计量单位不一致,也可以完成输入操作,用户无需按照显示的数量计量单位输入语音口令,只需说出的数量计量单位是预设计量单位即可。在通过语音控制修改在先存储的食材数量时,只需要用户语音口令中的数量计量单位与在先存储的计量单位类别匹配,即可完成修改操作,而无需用户语音口令中的数量计量单位与在先存储的计量单位完全一致。而冰箱则会在用户说出的数量计量单位与当前默认显示的计量单位不一致时,按照用户说出的数量计量单位进行显示,以提高用户体验。
具体实现中,本发明还提供一种计算机存储介质,其中,该计算机存储介质可存储有程序,该程序执行时可包括本发明提供的食材信息编辑方法的各实施例中的部分或全部步骤。所述的存储介质可为磁碟、光盘、只读存储记忆体(英文:read-only memory,简称:ROM)或随机存储记忆体(英文:random access memory,简称:RAM)等。
本领域的技术人员可以清楚地了解到本发明实施例中的技术可借助软件加必需的通用硬件平台的方式来实现。基于这样的理解,本发明实施例中的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例或者实施例的某些部分所述的方法。
本说明书中各个实施例之间相同相似的部分互相参见即可。尤其,对于冰箱实施例而言,由于其基本相似于方法实施例,所以描述的比较简单,相关之处参见方法实施例中的说明即可。
以上所述的本发明实施方式并不构成对本发明保护范围的限定。

Claims (20)

  1. 一种显示设备,其特征在于,包括:
    显示器,用于呈现用户界面;
    声音采集器,用于接收用户输入的语音口令;
    与所述显示屏和所述声音采集器连接的控制器,被配置为:
    接收到用户用于进行食材编辑的指令,在显示器上呈现食材编辑界面,所述食材编辑界面上显示有食材保质期对应的输入项目;
    通过所述声音采集器接收用户输入的语音口令;
    解析所述语音口令,得到用于操作所述食材保质期的目标操作类型和第一操作数据,所述第一操作数据包括第一操作数值和第一时间单位;
    确定所述第一操作数据对应的第二操作数据,所述第二操作数据包括第二操作数值和第二时间单位,所述第二时间单位为预设时间单位;
    根据所述目标操作类型和所述第二操作数据,在所述食材编辑界面中显示所述食材保质期对应的输入内容。
  2. 根据权利要求1所述的显示设备,其特征在于,所述确定所述第一操作数据对应的第二操作数据,包括:
    在所述第一时间单位与预设时间单位一致,且所述第一操作数值为整数时,将所述第一时间单位确定为第二时间单位,将所述第一操作数值确定为第二操作数值;
    在所述第一时间单位与预设时间单位不一致,或者所述第一操作数值不为整数时,将所述第一操作数值转换成以所述预设时间单位计的第二操作数值,所述第二操作数值为整数。
  3. 根据权利要求2所述的显示设备,其特征在于,所述预设时间单位包括月和天;所述在所述第一时间单位与预设时间单位不一致,或者所述第一操作数值不为整数时,将所述第一操作数值转换成以所述预设时间单位计的第二操作数值,包括:
    在所述第一时间单位为年或者月时,将所述第一操作数值转换成以月或者天计的第二操作数值;
    在所述第一时间单位为周或者天时,将所述第一操作数值转换成以天计的第二操作数值。
  4. 根据权利要求1所述的显示设备,其特征在于,所述通过解析所述语音口令,得到用于操作所述食材保质期的目标操作类型,包括:
    在所述语音口令中包括操作类型时,将所述操作类型确定为所述目标操作类型;
    在所述语音口令中不包括操作类型时,将预设操作类型确定为所述目标操作类型。
  5. 根据权利要求1所述的显示设备,其特征在于,所述根据所述目标操作类型和所述第二操作数据,在所述食材编辑界面中显示所述食材保质期对应的输入内容,包括:
    根据所述目标操作类型和第二操作数据确定显示数据,所述显示数据包括显示数值和所述第二时间单位;
    将所述显示数据作为所述食材保质期对应的输入内容,显示在所述食材编辑界面中。
  6. 根据权利要求5所述的显示设备,其特征在于,所述目标操作类型包括延长操作、缩短操作以及设置操作,所述根据所述目标操作类型和所述第二操作数据确定显示数据, 包括:
    在所述目标操作类型为所述设置操作时,将所述第二操作数值确定为所述显示数值;
    在所述目标操作类型为所述延长操作时,根据在先存储的保质期数值与所述第二操作数值的加和,确定所述显示数值;
    在所述目标操作类型为所述缩短操作时,根据在先存储的保质期数值与所述第二操作数值的差值,确定所述显示数值。
  7. 根据权利要求6所述的显示设备,其特征在于,所述在所述目标操作类型为所述延长操作时,根据在先存储的保质期数值与所述第二操作数值的加和,确定所述显示数值,包括:
    将所述在先存储的保质期数值和所述第二操作数值分别转换成以中间时间单位计的第一中间值和第二中间值;
    将所述第一中间值与所述第二中间值相加,得到以所述中间时间单位计的中间和;
    将所述中间和转换成以所述第二时间单位计的显示数值;
    在所述目标操作类型为所述缩短操作时,根据在先存储的保质期数值与所述第二操作数值的差值,确定所述显示数值,包括:
    将所述在先存储的保质期数值和所述第二操作数值分别转换成以中间时间单位计的第一中间值和第二中间值;
    将所述第一中间值与所述第二中间值相减,得到以所述中间时间单位计的中间差;
    将所述中间差转换成以所述第二时间单位计的显示数值。
  8. 根据权利要求7所述的显示设备,其特征在于,所述控制器进一步被配置为:
    将所述显示数值转换成以预设的存储时间单位计的保质期数值;
    使用转换得到的所述保质期数值保存在食材信息中。
  9. 根据权利要求7所述的显示设备,其特征在于,所述中间时间单位与所述存储时间单位一致,所述控制器进一步被配置为:
    在所述目标操作类型为所述设置操作时,将所述显示数值转换成以所述存储时间单位计的保质期数值,并将得到的保质期数值保存在食材信息中;
    在所述目标操作类型为所述缩短操作时,使用所述中间差更新所述在先存储的保质期数值;
    在所述目标操作类型为所述延长操作时,使用所述中间和更新所述在先存储的保质期数值。
  10. 一种显示设备,其特征在于,包括:
    显示器,用户呈现用户界面;
    声音采集器,用于接收用户输入的语音口令;
    与所述显示屏和所述声音采集器连接的控制器,被配置为:
    接收到用户用于进行食材编辑的指令,在显示器上呈现食材编辑界面,所述食材编辑界面上显示有食材保质期对应的输入项目;
    通过声音采集器接收用户输入的语音口令;
    解析所述语音口令,得到用于操作所述食材数量的操作类型和目标操作数据,所述目标操作数据包括目标操作数值和目标计量单位;
    根据所述操作类型和所述目标操作数据,确定以所述目标计量单位计量的目标显示数 值,其中,在所述操作类型表征输入食材数量的操作时,所述目标显示数值为所述目标操作数值,在所述操作类型表征修改在先存储的食材数量的操作时,所述目标显示数值是在所述目标计量单位与在先存储的计量单位类别匹配的情况下,根据所述目标操作数值和在先存储的食材数量确定的;
    将所述目标显示数值和所述目标计量单位作为所述食材数量对应的输入内容,显示在所述食材编辑界面中。
  11. 根据权利要求10所述的显示设备,其特征在于,所述通过解析所述语音口令,得到用于操作所述食材数量的操作类型,包括:
    当从所述语音口令中未解析出操作类型时,确定表征输入食材数量的操作的操作类型。
  12. 根据权利要求10所述的显示设备,其特征在于,在所述操作类型表征修改在先存储的食材数量的操作时,所述控制器进一步被配置为,按照下述步骤判断所述目标计量单位与在先存储的计量单位的类别是否匹配:
    判断所述目标计量单位和在先存储的计量单位是否均为重量单位、单数计量单位或者复数计量单位;
    若所述目标计量单位和在先存储的计量单位均为重量单位、单数计量单位或者复数计量单位,则确定所述目标计量单位和在先存储的计量单位的类别匹配。
  13. 根据权利要求12所述的显示设备,其特征在于,所述修改在先存储的食材数量的操作包括增加操作和减少操作;所述控制器进一步被配置为,按照下述步骤确定所述目标显示数值:
    在所述操作类型表征所述增加操作时,将所述在先存储的食材数量值与所述目标操作数值的加和确定为所述目标显示数值;
    在所述操作类型表征所述减少操作时,将所述在先存储的食材数量值与所述目标操作数值的差值确定为所述目标显示数值。
  14. 根据权利要求13所述的显示设备,其特征在于,在所述目标计量单位和在先存储的计量单位均为重量单位时,所述控制器确定所述目标显示数值的步骤,还包括:
    判断所述目标计量单位和在先存储的计量单位是否一致;
    在所述目标计量单位和在先存储的计量单位不一致时,将所述在先存储的食材数量转换成以所述目标计量单位计量的中间数值;
    根据所述目标操作数值和所述中间数值确定所述目标显示数值。
  15. 根据权利要求10所述的显示设备,其特征在于,所述控制器进一步被配置为:
    在所述操作类型表征修改在先存储的食材数量的操作时,如果所述目标计量单位与在先存储的计量单位类别不匹配,则显示预定提示信息,以提示用户无法根据输入的语音口令操作食材保质期。
  16. 根据权利要求10所述的显示设备,其特征在于,所述控制器进一步被配置为:使用所述目标显示数值和目标计量单位更新在先存储的食材数量值和计量单位。
  17. 根据权利要求10所述的显示设备,其特征在于,所述通过解析所述语音口令,得到用于操作所述食材数量的目标操作数据,包括:
    从所述语音口令中解析出目标计量单位和目标操作数值;
    判断所述目标计量单位是否为预设计量单位,以及所述目标操作数值是否落在所述目标计量单位预设的允许操作范围内;
    若所述目标计量单位是预设计量单位,且所述目标操作数值落在所述允许操作范围内,得到包含所述目标操作数值和目标计量单位的目标操作数据。
  18. 一种食材信息编辑方法,其特征在于,应用于显示设备,所述显示设备包括显示器,所述显示器用户呈现用户界面;所述方法包括:
    接收到用户用于进行食材编辑的指令,在显示器上呈现食材编辑界面,所述食材编辑界面上显示有食材保质期对应的输入项目;
    接收用户输入的语音口令;
    解析所述语音口令,得到用于操作所述食材保质期的目标操作类型和第一操作数据,所述第一操作数据包括第一操作数值和第一时间单位;
    确定所述第一操作数据对应的第二操作数据,所述第二操作数据包括第二操作数值和第二时间单位,所述第二时间单位为预设时间单位;
    根据所述目标操作类型和所述第二操作数据,在所述食材编辑界面中显示所述食材保质期对应的输入内容。
  19. 一种食材信息编辑方法,其特征在于,所述方法包括:
    当检测到标签读取区上的RFID标签时,显示包括食材编辑界面和语音识别界面的用户界面,并识别输入的语音内容所述食材编辑界面用于显示输入的食材信息,所述语音识别界面包括输入提示和识别出的语音内容;
    根据识别出的所述语音内容,在所述食材编辑界面中显示输入的食材信息。
  20. 一种食材信息编辑方法,其特征在于,所述方法包括:
    响应于输入的预设语音指令,判断当前显示的用户界面是否是食材编辑界面,所述食材编辑界面用于显示输入的食材信息;
    若当前显示的用户界面不是食材编辑界面,则显示标签扫描界面,所述标签扫描界面中显示扫描提示,所述扫描提示用于提示用户将待编辑的RFID标签放置在所述标签读取区;当检测到用户放置在标签读取区上的RFID标签时,根据所述预设语音指令包含的语音内容显示所述食材编辑界面;
    若当前显示的用户界面是食材编辑界面,根据所述预设语音指令包含的语音内容更新所述食材编辑界面。
PCT/CN2021/114091 2020-11-04 2021-08-23 显示设备及食材信息编辑方法 WO2022095553A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202180066170.8A CN116235013A (zh) 2020-11-04 2021-08-23 显示设备及食材信息编辑方法
US18/185,459 US20230221066A1 (en) 2020-11-04 2023-03-17 Refrigerator and method for editing food information

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
CN202011218085.2 2020-11-04
CN202011218085.2A CN112344619A (zh) 2020-11-04 2020-11-04 冰箱及食材信息编辑方法
CN202110418594.8 2021-04-19
CN202110418594.8A CN114322441B (zh) 2021-04-19 2021-04-19 冰箱及语音控制方法
CN202110433466.0 2021-04-19
CN202110433466.0A CN114294898B (zh) 2021-04-19 2021-04-19 冰箱及语音控制方法

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/185,459 Continuation US20230221066A1 (en) 2020-11-04 2023-03-17 Refrigerator and method for editing food information

Publications (1)

Publication Number Publication Date
WO2022095553A1 true WO2022095553A1 (zh) 2022-05-12

Family

ID=81457506

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/114091 WO2022095553A1 (zh) 2020-11-04 2021-08-23 显示设备及食材信息编辑方法

Country Status (3)

Country Link
US (1) US20230221066A1 (zh)
CN (1) CN116235013A (zh)
WO (1) WO2022095553A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104636856A (zh) * 2014-11-03 2015-05-20 广东奥马电器股份有限公司 智能冰箱的食物数量及品种信息处理方法及系统
CN107477971A (zh) * 2017-08-04 2017-12-15 三星电子(中国)研发中心 一种对冰箱内食物的管理方法和设备
CN108538289A (zh) * 2018-03-06 2018-09-14 深圳市沃特沃德股份有限公司 基于蓝牙实现语音遥控的方法、装置和终端设备
CN111292828A (zh) * 2018-12-07 2020-06-16 海信(山东)冰箱有限公司 智能冰箱及其食材管理方法、装置及存储介质
CN111336747A (zh) * 2020-03-23 2020-06-26 海信(山东)冰箱有限公司 一种冰箱及冰箱的信息管理方法
CN111442604A (zh) * 2020-04-10 2020-07-24 海信集团有限公司 一种冰箱及其控制方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104636856A (zh) * 2014-11-03 2015-05-20 广东奥马电器股份有限公司 智能冰箱的食物数量及品种信息处理方法及系统
CN107477971A (zh) * 2017-08-04 2017-12-15 三星电子(中国)研发中心 一种对冰箱内食物的管理方法和设备
CN108538289A (zh) * 2018-03-06 2018-09-14 深圳市沃特沃德股份有限公司 基于蓝牙实现语音遥控的方法、装置和终端设备
CN111292828A (zh) * 2018-12-07 2020-06-16 海信(山东)冰箱有限公司 智能冰箱及其食材管理方法、装置及存储介质
CN111336747A (zh) * 2020-03-23 2020-06-26 海信(山东)冰箱有限公司 一种冰箱及冰箱的信息管理方法
CN111442604A (zh) * 2020-04-10 2020-07-24 海信集团有限公司 一种冰箱及其控制方法

Also Published As

Publication number Publication date
US20230221066A1 (en) 2023-07-13
CN116235013A (zh) 2023-06-06

Similar Documents

Publication Publication Date Title
CN111860718B (zh) 冰箱及食材管理方法
CN112344619A (zh) 冰箱及食材信息编辑方法
US20150208217A1 (en) Electronic device for sharing data and method for controlling the same
EP3764293B1 (en) Food storage apparatus and control method thereof
US11151641B2 (en) Virtual display device for an interactive merchant sales environment
US9591433B2 (en) Communication method, electronic device, and storage medium
WO2022001768A1 (zh) 一种冰箱
CN112344618A (zh) 冰箱及食材信息的定义方法
CN113011538A (zh) 冰箱及食材标签扫描方法
WO2022095564A1 (zh) 显示设备及界面显示方法
CN111811182B (zh) 一种冰箱及食谱推荐方法
CN108052368A (zh) 一种应用显示界面控制方法及移动终端
KR20170126698A (ko) 콘텐트 제공을 위한 전자 장치 및 방법
CN108401071B (zh) 一种提示信息的设置方法和装置
WO2022095553A1 (zh) 显示设备及食材信息编辑方法
WO2023165227A1 (zh) 食材存储设备及食材库和菜谱的排序方法
CN114294884B (zh) 冰箱及消息提醒方法
CN114820122A (zh) 一种食材存储设备、终端设备以及采购清单生成方法
CN114279137A (zh) 冰箱及信息同步方法
CN115082149A (zh) 一种电子设备、服务器及烹饪设备推荐方法
CN114294883A (zh) 冰箱及食材图标显示方法
CN113590750A (zh) 人机对话方法、装置、电子设备及存储介质
CN114294898B (zh) 冰箱及语音控制方法
CN114322441B (zh) 冰箱及语音控制方法
WO2023202221A9 (zh) 一种电子设备及数据处理方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21888252

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21888252

Country of ref document: EP

Kind code of ref document: A1