WO2022095564A1 - Display device and interface display method - Google Patents

Abstract

Disclosed are a display device and an interface display method. The method comprises: receiving an input food material search instruction, wherein the food material search instruction carries a search word; matching the search word with food materials in a food material library; if there is a target food material, which matches the search word, in the food material library, displaying a search result interface that contains a food material icon of the target food material; if there is no target food material, which matches the search word, in the food material library, displaying a search result interface that contains a self-defined food material adding control, wherein the self-defined food material adding control is used for triggering skipping to a self-defined food material adding interface, and the self-defined food material adding interface is used for receiving a self-defined food material input by a user.

Description

Display device and interface display method

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the priority of the Chinese patent application with the application number 202011216565.5 filed on November 04, 2020 and the invention titled "Method for Defining Refrigerator and Food Material Information", and the application number filed on May 19, 2021 is 202110560982 .X, the priority of the Chinese patent application entitled "Refrigerator and Interface Display Method", filed on April 19, 2021 with the application number of 202110418427.3 and the Chinese patent application entitled "Refrigerator and Food Icon Display Method" , the entire contents of the aforementioned application are incorporated herein by reference.

technical field

The present application relates to the technical field of refrigerators, and in particular, to a display device and an interface display method.

Background technique

At present, the way for family members to obtain the ingredients in the refrigerator is generally by opening the refrigerator door and intuitively obtaining it with the naked eye.

In order to improve the user experience, the refrigerator can be equipped with a radio frequency identification (RFID) device, or a camera, so that the user can obtain the information by installing a display on the refrigerator without opening the refrigerator door. The display can be made touch-sensitive, or voice-controllable.

SUMMARY OF THE INVENTION

The display device and the interface display method provided by the present application are used to solve the problem of complicated operation in the process of user-defined food material information.

In a first aspect, the present application provides a display device, including:

a display for presenting the user interface;

A controller connected to the display, configured to:

receiving an input ingredient search instruction, where the ingredient search instruction carries a search term;

matching the search term with the ingredients in the ingredient library;

If there is a target ingredient matching the search term in the ingredient library, a search result interface containing the ingredient icon of the target ingredient is displayed;

If there is no target ingredient matching the search term in the ingredient library, a search result interface including a custom ingredient adding control is displayed, and the custom ingredient adding control is used to trigger a jump to the custom ingredient adding interface, and the The custom ingredient adding interface is used to receive custom ingredients input by the user.

In a second aspect, the present application also provides an interface display method, the method comprising:

receiving an input ingredient search instruction, where the ingredient search instruction carries a search term;

matching the search term with the ingredients in the ingredient library;

If there is a target ingredient matching the search term in the ingredient library, displaying a search result interface containing an ingredient icon of the target ingredient on the display;

If there is no target ingredient matching the search term in the ingredient library, a search result interface including a custom ingredient adding control is displayed on the display, and the custom ingredient adding control is used to trigger a jump to a custom ingredient An adding interface, where the custom ingredient adding interface is used to receive custom ingredients input by a user.

Description of drawings

In order to illustrate the technical solutions of the present application more clearly, the accompanying drawings that need to be used in the embodiments will be briefly introduced below. Other drawings can also be obtained from these drawings.

FIG. 1a is an interaction scene of a display device according to an exemplary embodiment of the present application;

Fig. 1b is a perspective view of a refrigerator according to an exemplary embodiment of the present application;

Fig. 1c is a schematic diagram of the appearance of a refrigerator according to an exemplary embodiment of the present application;

FIG. 2 is a schematic diagram of the hardware configuration of a refrigerator according to an exemplary embodiment of the present application;

Fig. 3 is an ingredient management interface shown in the present application according to an exemplary embodiment;

FIG. 4 is an interface of an ingredient library according to an exemplary embodiment of the present application;

FIG. 5 is another food material library interface shown in the present application according to an exemplary embodiment;

FIG. 6 is another food material library interface shown in the present application according to an exemplary embodiment;

FIG. 7 is a custom ingredient adding interface shown in the present application according to an exemplary embodiment;

FIG. 8 is a food material information confirmation interface shown in the present application according to an exemplary embodiment;

FIG. 9 is another food material library interface shown in this application according to an exemplary embodiment;

FIG. 10 is a search interface shown in this application according to an exemplary embodiment;

FIG. 11 is a search result interface shown in this application according to an exemplary embodiment;

FIG. 12 is another search result interface shown in this application according to an exemplary embodiment;

FIG. 13 is another search result interface shown in this application according to an exemplary embodiment;

Fig. 14 is an interface for adding custom ingredients according to an exemplary embodiment of the present application;

15 is a flowchart of an interface display method according to an exemplary embodiment of the present application;

Fig. 16 is an ingredient management interface shown in the present application according to an exemplary embodiment;

FIG. 17 is another food material management interface shown in this application according to an exemplary embodiment;

Fig. 18 is a flow chart of a method for displaying an ingredient icon according to an exemplary embodiment of the present application.

Detailed ways

In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described The embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the scope of protection of the present application.

In the description of the present invention, it should be understood that the terms "center", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", The orientation or positional relationship indicated by "top", "bottom", "inner", "outer", etc. is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying The device or element referred to must have a particular orientation, be constructed and operate in a particular orientation, and therefore should not be construed as limiting the invention.

The terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may expressly or implicitly include one or more of that feature. In the description of the present invention, unless otherwise specified, "plurality" means two or more.

In the description of the present invention, it should be noted that the terms "installed", "connected" and "connected" should be understood in a broad sense, unless otherwise expressly specified and limited, for example, it may be a fixed connection or a detachable connection Connection, or integral connection; it can be directly connected, or indirectly connected through an intermediate medium, and it can be the internal communication of two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood in specific situations.

At present, the way for family members to obtain the ingredients in the refrigerator is generally by opening the refrigerator door and intuitively obtaining it with the naked eye.

In order to improve the user experience, the refrigerator can be equipped with a radio frequency identification (RFID) device, or a built-in camera, so that the user can obtain the information by installing a display on the refrigerator without opening the refrigerator door. The display can be made touch-sensitive, or voice-controllable.

At present, the interconnection of smart home appliances is a hot research topic. People hope to control home appliances before they return home, or control refrigerators and air conditioners in the living room.

In the description of the subject of food editing provided in this application, it can be performed on a refrigerator with a display, and can also be performed on other home appliances and handheld devices.

FIG. 1a exemplarily shows a schematic diagram of an operation scenario of a display device according to an embodiment.

In some embodiments, the display device may be any home or office device with a display or display, such as a mobile terminal, a tablet computer, a computer, a laptop, a TV, a refrigerator, an electronic whiteboard, an oven, a washing machine, a video phone , mirror, etc. can be used as carriers for displaying UI interface for users, the above-mentioned devices are all display devices involved in this application, and are not limited to TV 200A, refrigerator 200B, and oven 200C shown in FIG. 1a.

In some embodiments, the display device 200 is also in data communication with the server 100 . The display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks. The server 100 may provide various contents and interactions to the display device 200 . The server 100 may be a cluster or multiple clusters, and may include one or more types of servers.

In some embodiments, the display device may also synchronize and communicate data with other display devices. The display device 200 may be allowed to interact with other devices through a local area network (LAN), a wireless local area network (WLAN). The devices in the same local area network can communicate with each other. When the data of one display device is updated, other devices are also updated. Account management can also be used. When the display device and other devices are logged in through an account, data communication can be performed with the device under the same login account.

In some embodiments, a smart device such as a mobile phone, a tablet, or a control device that can be used by the display device receives the instruction, and can also receive the user's control through touch or gesture.

In some embodiments, the display device 200 may also be controlled in a manner other than the control device. For example, the module for acquiring voice commands configured inside the display device 200 may directly receive the user's voice command for control, or it may be controlled by the user's voice command. The display device 200 is a voice control device provided outside the device to receive the user's voice command control.

The following takes a refrigerator as an example to make an exemplary illustration.

Fig. 1b is a perspective view of a refrigerator according to an exemplary embodiment of the present application. The shape of the refrigerator provided by the embodiment of the present invention is approximately a rectangular parallelepiped. The appearance of the refrigerator is defined by the storage compartment 101 providing a limited storage space and a plurality of box doors 200 provided at the opening of the storage compartment 101 . The storage compartment 101 is a box body 100 with an opening. In the example shown in FIG. 1b, the storage compartment 101 includes a freezing compartment 101A located below and a refrigerating compartment 101B located above, and the freezing compartment 101A and the refrigerating compartment 101B respectively have one or more an independent storage space.

In some embodiments, freezer compartment 101A may be selectively covered by freezer drawer door 200A. The refrigerator compartment 101B is partitioned into left and right sides. The refrigerating compartment 101B is selectively opened or closed by a refrigerating compartment door 200B pivotally mounted on the refrigerating compartment 101B.

Fig. 1c is a schematic view of the appearance of a refrigerator according to an exemplary embodiment of the present application. As shown in Fig. 1b, a display is provided on the refrigerating compartment door 200B, and the display is embedded in the door body. In some embodiments, the plane of the screen of the display is flush with the outer surface of the door.

As shown in FIG. 1b and FIG. 1c, the refrigerator provided by the embodiment of the present application is provided with at least two storage compartments inside the box, such as a freezing compartment, a refrigerating compartment, a changing room, and/or a fresh-keeping room. Each storage compartment can have multiple independent storage spaces, such as drawer-style compartments.

FIG. 2 is a schematic diagram of a hardware configuration of a refrigerator according to an exemplary embodiment of the present application. As an example, the refrigerator 200 may include a display 210, a controller 220, a memory 250 and several user input interfaces.

In some exemplary embodiments, the refrigerator 200 may further include at least one RFID detection module 230 , a detector 240 . The display 210, the RFID detection module 230, the detector 240, and the memory 250 are coupled with the controller 220 through a communication interface. The display 210 is used for receiving the image signal output by the controller 220 , performing components for displaying video content and images and a menu manipulation interface, and displaying a user manipulation UI interface for controlling the refrigerator 200 .

The controller 220 may include one or more processing units, such as a system on a chip (SoC), a central processing unit (CPU), a microcontroller (MCU), a memory controller, and the like. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

The memory 250 may include one or more storage units, for example, may include volatile memory (volatile memory), such as: dynamic random access memory (dynamic random access memory, DRAM), static random access memory (static random access memory) , SRAM), etc.; can also include non-volatile memory (non-volatile memory, NVM), such as: read-only memory (read-only memory, ROM), flash memory (flash memory), etc. Wherein, different storage units may be independent devices, or may be integrated or packaged in one or more processors or communication interfaces, and become part of the processors or communication interfaces.

The memory 250 stores program instructions and applications such as voice applications. The controller 220 may call program instructions in the memory 250 or run an application program, so that the refrigerator executes a related method, such as the method for editing food information provided by the embodiments of the present application.

The detector 240, including at least a sound collector, such as a microphone, may be used to receive the user's voice. Exemplarily, the voice signal includes a control instruction of the user to control the refrigerator 200 .

The user input interface includes at least one of other input interfaces such as a microphone, a touch panel, a sensor, and a button. For example, the user can implement the user command input function through actions such as voice, touch, gesture, pressing, etc. The input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the refrigerator 200.

In some embodiments, the controller 220 may include a voice recognition module, and the voice recognition module further includes a voice parsing unit and a voice command database, so that the refrigerator can independently complete the voice recognition of the voice data input by the user, and the recognized voice The process of matching content with voice commands in a voice command database.

The RFID detection module 230 can be disposed in each storage room, and is used for transmitting wireless signals in the corresponding storage room and receiving the signal of the RFID tag in the storage room, so as to obtain the food item code of the RFID tag.

In some embodiments, the refrigerator further includes a tag reading area disposed outside the storage compartment, that is, a sensing area for identifying RFID tags, and an RFID detection module is disposed at the tag reading area for detecting RFID placed in the area. Label. Optionally, the tag reading area can be set below the display, so that the user can place (or take away) the RFID tag in the tag reading area and operate the user interface displayed on the display at the same time.

In some embodiments, the refrigerator may further include an RFID processing module, which is respectively connected to each RFID detection module and used to control the RFID detection module to transmit wireless signals and to receive the RFID tag signal fed back by the RFID detection module.

In some embodiments, the RFID detection module may specifically be an antenna. The power of the antennas provided in different storage compartments may be different. In addition, the power of the antenna of each storage room can ensure that the antenna can recognize the ingredients included in its own compartment, so as to avoid that the false recognition rate will increase when the power is too high, and the ingredients in its own compartment will not be recognized when the power is too small. In a specific implementation, the power of the antenna can be determined in advance according to the space size of each storage room, and the power of each antenna is set in the refrigerator. The larger the space, the higher the power.

In order to realize the intelligent management of ingredients, RFID tags are used to identify the ingredients in the storage room.

In some embodiments, the virtual association between the RFID tag and the food material information is realized by establishing the corresponding relationship between the RFID tag and the food material information, and the corresponding relationship between the RFID tag and the food material information can be modified so that the same RFID tag Corresponding to different ingredient information successively, improving the flexibility of using RFID tags. For example, the corresponding relationship between the identification information of the RFID tag and the food material information is established to realize the virtual association between the RFID tag and the food material. The identification information of the RFID tag may be the tag code of the RFID tag identified by the RFID detection module 230, or may be a code segment in the tag code. In these embodiments, the controller 220 may determine the ingredient information corresponding to each RFID tag according to the identification information of each RFID tag and the pre-established correspondence.

Exemplarily, the pre-established correspondence between the identification information of the RFID tag and the food material information may be shown in the following table:

RFID	food information
Logo 1	apple
Logo 2	cucumber
Logo 3	pork
...	...

After the corresponding relationship between the RFID tag and the food information is established, the controller 220 obtains the label code of the RFID label by detecting the signal of the RFID label, and the food information associated with each label can be determined according to the label code.

In some embodiments, the ingredient information associated with each label is associated with a storage room, and the storage location of the ingredient can be determined according to the storage room associated with the ingredient information. in the refrigerator compartment.

In some embodiments, an ingredient management interface is displayed on the display 210, and the user manages ingredients in the refrigerator by operating the ingredient management interface. For example, according to the ingredient information associated with each RFID tag in the storage room, the corresponding ingredient control/icon is drawn in the ingredient management interface, so that the ingredients in the refrigerator are displayed in the form of icons, pictures and texts. In addition, functional controls, such as an RFID tag identification control, an ingredient adding control, etc., can also be drawn in the ingredient management interface, for the user to operate to trigger the controller 220 to implement corresponding functions.

In some embodiments, the ingredient management interface may include multiple ingredient display areas, one ingredient display area may correspond to one storage room, and the ingredient information associated with each storage room is displayed in the ingredient display area corresponding to each storage room, that is, in the ingredient display area. In the management interface, the ingredients in the refrigerator are displayed by partition. For example, the food item information associated with the refrigerating chamber is displayed in the food item display area corresponding to the refrigerating chamber. The ingredient information displayed in the ingredient management interface includes, but is not limited to, ingredient icons, ingredient names, and ingredient freshness signs. The ingredient icons can be generated according to the pictograms of the ingredients, and the ingredient freshness identifiers are used to indicate the time when the ingredients are put in. , any one or more of the remaining time until expiration and expiration time. It should be understood that the name of the ingredient, the freshness identifier of the ingredient, etc. may be part of the ingredient icon, that is, included in the ingredient icon.

FIG. 3 is a user interface shown in the present application according to an exemplary embodiment, which is specifically an exemplary ingredient management interface. Referring to FIG. 3 , the ingredient management interface includes a label editing control 301, a recommended recipe control 302, and an ingredient adding control 306, and also includes partitions corresponding to each storage room, such as the partition 303 corresponding to the refrigerating room, the partition 304 corresponding to the changing room, and the cooling room. The greenhouse corresponds to the partition 305 . Each partition displays ingredient icons corresponding to the ingredients in the storage room, such as ingredient 1, ingredient 2, ingredient 3, ingredient 4, and ingredient 5 in partition 303, ingredient icon 6-ingredient icon 11 in partition 304, and partition 304. Ingredient icon 12 and ingredient icon 13 in 305 . In addition, each partition has a scrollable scroll bar, such as the scroll bar 3030 in the partition 303 that can be scrolled up and down, the scroll bar 3040 in the partition 304 that can be scrolled up and down, and the scroll bar 3050 in the partition 305. The view displayed in the section is scrolled up or down by operating the scroll bar to display ingredients icons that are not all shown on the user interface.

Continuing to refer to FIG. 3 , each ingredient icon includes an ingredient picture, an ingredient name and a freshness indicator of the ingredient. Taking ingredient 3 [3031] as an example, it includes an ingredient picture 30311, an ingredient name "ingredient 1" (30312), and a freshness identifier 30313. It is worth noting that in Fig. 3, since the ingredient 1 has expired, the seal with the word "expired" is used as the freshness identifier of the ingredient 1 and displayed on the image of the ingredient, so that the user can quickly notice what is in the refrigerator Food that has expired.

In some embodiments, when the remaining days until the expiration date of the food item is less than the preset number of days, the specific remaining days are displayed explicitly through the freshness indicator. For example, in the ingredient management interface shown in FIG. 3, since the remaining days until expiration of ingredient 6 [3041] is less than the preset number of days, the freshness identifier [304111] of ingredient 4 includes a text prompt of "2 days remaining", Allows users to quickly obtain the remaining days of the ingredients that are about to expire.

In specific implementation, the ingredient management interface may be an interface of an ingredient management-related application run by the controller 220, and the user may trigger the ingredient management-related application to display the ingredient management interface. When an application related to ingredient management receives a user operation that triggers display of the ingredient management interface, it reads the ingredient information set from the memory, and displays the corresponding ingredient icon in the ingredient management interface according to the ingredient information in the ingredient information set. Wherein, the food material information set is a collection composed of food material information corresponding to all RFID tags in the current storage room.

In some embodiments, the tag encoding of an RFID tag may include one or more code segments.

In some embodiments, the multiple code segments included in the label code of the RFID tag conform to a preset composition rule. After acquiring the label code, the controller intercepts the code segment corresponding to the tag identifier according to the preset composition rule to obtain the unique code of the tag. Sexual identification, that is, label identification. Using a code segment in the tag encoding as the tag identification of the RFID tag can improve the efficiency of the identification comparison process because the identification length is shortened.

In some embodiments, RFID tags can be divided into custom tags and predefined tags, wherein a custom tag refers to a tag whose associated ingredient name can be customized by a user, and a predefined tag refers to an associated ingredient name that cannot be customized by the user. defined label. Custom tags and predefined tags can be distinguished based on tag encoding.

In some embodiments, the tag code of the RFID tag includes at least two code segments, a first code segment and a second code segment, respectively. The first code segment is used to write a first code, and the first code may be a predetermined code or a non-predetermined code. For an RFID tag whose first code is a predetermined code, the corresponding ingredient information can be customized by the user, that is, a user-defined tag; In the cloud server or the local ingredients library, it cannot be customized by the user, that is, it is a predefined label. The second code segment is used to write the second code, and the second code is the unique identification information of the RFID tag. It should be noted that the user-defined ingredient name means that the user can associate any ingredient name with the RFID tag according to their needs. At the same time, the user can also change the defined tag according to the change of needs, so that the same label can be used before and after different ingredients. The name is associated, and the user cannot customize the name of the ingredient, which means that the user cannot change the name of the ingredient associated with the RFID tag. The name of the ingredient associated with the RFID tag is pre-defined and saved in the cloud server or local ingredient library. .

When an RFID tag is given, whether the tag is a predefined tag or a self-defined tag can be determined according to the first code included in the tag code. If the first code is a predetermined code, the label is a custom label, and if the first code is not a predetermined code, the label is a predefined label. In some embodiments, at least two code segments included in the label code of the RFID tag conform to a preset composition rule, and after acquiring the label code, the controller intercepts the first code segment and/or the second code segment according to the preset composition rule segment etc. to obtain the first code and/or the second code, thereby saving the process of parsing long code information and improving processing efficiency.

In some embodiments, the predetermined code is unique, such as 00; the non-predetermined code is not unique, and there may be multiple ones, and one non-predetermined code corresponds to one kind of food item information.

Exemplarily, a tag coding structure of an RFID tag is as follows:

For example, if the tag code of the RFID tag obtained by the controller is "01123456789012345678901234", then according to the preset composition rule, the first code can be intercepted as "01", and the second code can be intercepted as "123456789012345678901234".

It should be noted that, according to different requirements, the label code of the RFID tag can also include more code segments, such as the third code segment, which is used to write the manufacturer's identification of the RFID tag, and the fourth code segment, which is used as a label. Encoded reserved bits to improve scalability of RFID tags. In other embodiments, the manufacturer's identification of the RFID tag may also be included in the second code segment, which will not be repeated here.

Exemplarily, the corresponding relationship between the first code (non-predetermined code) and the ingredient information may be as shown in the following table:

RFID first code	food name
01	radish
02	carrot
03	lotus root
...	...

In some embodiments, when the ingredient management interface is displayed on the display, the user may input an instruction for editing ingredient information by operating the ingredient management interface. For example, the user clicks an ingredient information editing control provided on the ingredient management interface to instruct ingredient information editing. ; When the controller receives the instruction, it starts to detect the signal of the RFID tag placed on the tag reading area to obtain the identification information of the RFID tag, and displays the interface for editing the food material information associated with the RFID tag, that is, In the ingredient editing interface, the ingredient information used to associate with the RFID tag is input in the ingredient editing interface.

In some embodiments, the acquired identification information of the RFID tag can also be displayed in the ingredient editing interface, so that the user can intuitively see the identification information of the RFID tag, and the user does not need to manually input the identification information, thereby improving user experience.

In some embodiments, at least one ingredient editing item is displayed in the ingredient editing interface, and each ingredient editing item includes an item name and item content, wherein the item content is the part to be edited, and the user can input each ingredient at the input position by inputting each ingredient. Edit the item content of the item, and enter the ingredient information for associating with the RFID tag. After the input is completed, the controller stores the input ingredient information and the identification information correspondingly, thereby completing and improving the establishment of the correspondence table between the identification information of the RFID tag and the ingredient information.

In some embodiments, the interface for editing ingredient information may be called an ingredient editing interface, and the ingredient editing items displayed thereon may include ingredient name editing items, ingredient shelf life editing items, ingredient quantity editing items, and the like. It should be understood that the item name of the ingredient name editing item can be "label name", the item content is the name of the ingredient to be input or updated, the item name of the ingredient shelf life editing item can be "shelf life", and the item content is the item to be input or updated. , the item name of the ingredient quantity editing item can be "quantity", and the item content is the quantity to be selected or changed.

As shown in FIG. 3 , the user can click on the RFID tag editing control in the interface to input an instruction instructing to edit the ingredient information. In response to the instruction, the controller controls the RFID detection module to start detecting the signal of the RFID tag on the tag reading area to obtain the identification information of the RFID tag. After the controller acquires the identification information of the RFID tag, an ingredient editing interface is presented on the display.

In some embodiments, after the controller receives an instruction input by the user to instruct to edit the ingredient information, in response to the instruction, a label scanning interface is displayed, a scanning prompt is displayed in the label scanning interface, and the user is prompted by displaying the scanning prompt. Place the RFID tag to be edited on the tag reading area. At the same time, the controller controls the RFID detection module to start detecting the signal of the RFID tag on the tag reading area to obtain the identification information of the RFID tag. After the controller acquires the identification information of the RFID tag, an ingredient editing interface is presented on the display.

In some embodiments, the user can also instruct the instruction to edit the ingredient information by speaking a preset voice password. For example, the user says: "tag edit". When the voice data input by the user is received and the content is identified as "tag editing", it is confirmed that the input preset voice instruction for triggering the editing of the ingredient information corresponding to the RFID tag is received. At this time, the controller responds to the instruction, displays the label scanning interface, and starts to detect the RFID label on the label reading area.

In some embodiments, when an input preset voice command is received, it is first determined whether the RFID tag on the tag reading area is detected. If the RFID tag on the tag reading area is not detected, it means that the user has not The edited RFID tag is placed on the tag reading area, and at this time, a tag scanning interface including a scanning prompt is displayed to prompt the user to place the RFID tag to be edited in the tag reading area.

In some embodiments, the above-mentioned instruction for instructing to edit food material information is also referred to as an RFID tag editing instruction.

In some embodiments, the database includes an ingredient library, and the ingredient library includes a large amount of ingredient information, such as preset ingredient information corresponding to each predefined tag, ingredient information associated with each custom tag, and each ingredient information is associated with a storage room, In addition, the preset ingredient information corresponding to each predefined tag is also associated with the tag code of the predefined tag, so that the corresponding preset ingredient information can be found in the ingredient library according to the tag code of the predefined tag, and each custom tag corresponds to The ingredient information is also associated with the tag code of the custom tag, so that the associated ingredient information can be found in the ingredient library according to the tag code of the custom tag.

In some embodiments, the user can also independently define information about ingredients that do not exist in the cloud server to expand the ingredient library.

In some embodiments, the ingredient information preset in the ingredient library can be classified and stored in the ingredient library. For example, the ingredient information of fruit ingredients is stored in a fruit ingredient collection, and the ingredient information of vegetable ingredients is stored in another vegetable ingredient. A collection of similar ingredients, the user-defined ingredient information is stored in the user-defined ingredient collection, and all ingredient information in the ingredient library constitutes a complete collection of ingredients. All kinds of ingredient information are displayed in categories in the ingredient library. For example, an operation control corresponding to each ingredient category can be set in the ingredient library interface. When the user clicks the fruit control, the ingredient icon corresponding to each ingredient information in the fruit ingredient collection is displayed, and when the user clicks the vegetable control, the vegetable category is displayed. The ingredient icon corresponding to each ingredient information in the ingredient collection, when the user clicks the custom ingredient control, the ingredient icon corresponding to each ingredient information in the custom ingredient collection is displayed.

In some embodiments, by displaying the ingredient icons corresponding to some or all of the ingredient information in the ingredient library in the user interface, the ingredient library is intuitively displayed to the user, which is convenient for the user to view.

FIG. 4 is a food material library interface shown in some exemplary embodiments of the present application. As shown in FIG. 4 , the ingredient library interface includes a tab switch bar 410 and a content area 420. The tab switch bar 410 includes a plurality of tab controls, namely "All" 411, "Fruit" 412, "Vegetable" 413, " "Meat" 414, "Beverages" 415, "Aquaculture" 416, "Others" 417, and "Custom Ingredients" 418, where the focus falls on "All" 411, that is, "All" 411 is selected, so the content An ingredient icon with "All" is displayed in area 420. It should be understood that when the label control "All" 411 is selected, all optional ingredient icons in the ingredient library are displayed in the content area, and these ingredient icons may be displayed in categories or not in categories.

Fig. 5 is another food material library interface shown in some exemplary embodiments of the present application, which is specifically the food material library interface displayed when the label control "fruit" is in a selected state. As shown in Figure 5, the label control "Fruit" is selected, and the ingredient icons of various fruits are displayed in the content area, namely "Apple", "Orange", "Banana", "Watermelon", "Mango", "Durian" ”, “Peach”, “Pineapple”….

FIG. 6 is another ingredient library interface shown in some exemplary embodiments of the present application, which is specifically an ingredient library interface displayed when the label control "custom ingredient" is in a selected state. As shown in Figure 6, the label control "Custom Ingredients" is selected, and a variety of custom ingredients icons are displayed in the content area, namely "Wahaha", "Salted Duck Egg", "Bangduer", and "Chili Sauce". In addition, in the ingredient library interface corresponding to the label control "custom ingredients", a custom ingredient add control "+ add custom ingredients" is also displayed. The user can input the custom ingredient adding instruction by clicking the custom ingredient adding control, and the ingredient management application will display the custom ingredient adding interface in response to the input custom ingredient adding instruction. In the custom ingredient adding interface, the user can enter a new The ingredient information of the custom ingredient.

On the ingredient library interface shown in FIG. 4 to FIG. 6, a return control "<" is also displayed, and the user can control to return to the ingredient management interface by operating the return control.

Fig. 7 is a custom ingredient adding interface shown in some exemplary embodiments of the present application, which is specifically a custom ingredient adding box displayed on the ingredient library interface when the label control "custom ingredient" is selected. As shown in FIG. 7 , the custom ingredient adding box includes multiple definition items, such as ingredient name definition item 701, shelf life definition item 702, storage location definition item 703, and each definition item corresponds to at least one input position or operation position, The user can enter the corresponding information at the input position, such as inputting "duck neck" at the input position corresponding to the name of the ingredient, inputting "2" at the input position corresponding to the shelf life, and clicking from the three operation positions corresponding to the storage position. Operation position in front of "Fridge compartment" to select "Fridge compartment". After the input is completed, the user can click the "Confirm" control 704 in the interface to submit the input information, and the ingredient management application receives the user's operation on the "Confirm" control 704, and sends the ingredient information of the custom ingredient "Duck Neck" entered by the user. Save the ingredients in the library. The user can click the "Cancel" control 705 in the interface to cancel the adding operation.

In some embodiments, the user can select an ingredient icon in the ingredient library interface through a single-click or long-press operation.

In some embodiments, the ingredient management application displays an ingredient information confirmation box on the current ingredient library interface, and displays the ingredient information corresponding to the ingredient icon in the ingredient information confirmation box, in response to a user's selection of an ingredient icon in the ingredient library interface. On the one hand, the user can view the ingredient information corresponding to the ingredient icon through the ingredient information confirmation box, and on the other hand, the user can modify the ingredient information corresponding to the ingredient icon in the ingredient information confirmation box.

FIG. 8 is an interface of an ingredient library shown in some exemplary embodiments of the present application, which is specifically an interface displayed after a user clicks “apple” in the interface of the ingredient library shown in FIG. 5 . As shown in FIG. 8 , an ingredient information confirmation box 810 is displayed on the ingredient library interface. The ingredient information confirmation box 810 displays various ingredient information corresponding to the ingredient icon “apple”, a “confirm addition” control, and a “cancel addition” control. . The user can delete one or more items of ingredient information displayed in the ingredient information confirmation box 810 and input new ingredient information to modify the ingredient information. When the user clicks the "Add Confirmation" control, the ingredient management application, in response to the user's operation, adds the ingredient information currently displayed in the ingredient information confirmation box 810 to the local ingredient information set, marks it as a storage state, and cancels the ingredient at the same time Display of message confirmation box 810 . The ingredient information currently displayed in the ingredient information confirmation box 810 includes the information initially displayed and/or the information modified by the user. When the user clicks the "Cancel Add" control, the ingredient management application cancels the display of the ingredient information confirmation box 810 in response to the user operation.

In other embodiments, in response to the user's selection operation on the ingredient icon in the ingredient library interface, the ingredient management application directly adds the ingredient information corresponding to the ingredient icon selected by the user into the local ingredient information set, and marks it as a storage state, while The ingredient information confirmation box as shown in FIG. 8 is not displayed.

In combination with the above embodiments, in other embodiments, the ingredient library interface further includes a search bar, and the search bar includes a search term input box and a search control. The user can enter a search term, such as the name of an ingredient, in the search term input box. After entering the search term, the user can click the search control to enter an ingredient search instruction carrying the search term, and the ingredient search instruction instructs the ingredient management application to search from the ingredient library. The ingredients that match the entered search term are displayed, and the ingredients icons of the matching ingredients are displayed. In this way, the user does not have to browse a large number of optional ingredient icons to find the icon of the ingredient to be selected, which saves the user's time and improves the user experience.

The ingredient management application, in response to the input ingredient search instruction, matches the search term carried in the instruction with the ingredient in the ingredient library. If there is a target ingredient matching the search term in the ingredient library, a search result interface containing the ingredient icon of the target ingredient will be displayed; if there is no target ingredient matching the search term in the ingredient library, a custom ingredient adding control will pop up. The custom ingredient adding control is used to trigger a jump to the custom ingredient adding interface, and the custom ingredient adding interface is used to receive custom ingredients input by the user.

Compared with the traditional ingredient search method, the ingredient management application integrates the ingredient search function and the custom ingredient addition function. If there is a target ingredient that matches the search term in the ingredient library, the search for the ingredient icon containing the target ingredient will be displayed directly. Results interface. If there is no target ingredient matching the search term in the ingredient library, the user does not need to exit the ingredient search interface and then enter the custom ingredient addition interface, except for a prompt that there is no corresponding ingredient. Instead, when there is no target ingredient matching the search term in the ingredient library, a custom ingredient adding control can pop up directly on the interface to guide the user to add unsearched ingredients to the ingredient library.

FIG. 9 is another food material library interface shown in some exemplary embodiments of the present application. As shown in FIG. 9 , based on the ingredient library interface shown in FIG. 4 , in the ingredient library interface, a search bar 910 is displayed above the label switching bar, including a search term input box 911 and a search control 912 . In some implementations, the user activates the initial input position by clicking on the search word input box, the ingredient management application activates the initial input position in response to the user's click on the search word input box, and displays the input at the upper part of the lower part of the ingredient library interface French keyboard. In this way, the user can enter search terms based on the input method keyboard. After the input is completed, the user inputs an ingredient search instruction carrying the input search term by clicking on the search control. In other implementations, the user may input the search term by speaking a voice password, for example, the user speaks "search for apple". The ingredient management application receives the voice password input by the user through the detector (microphone), and recognizes the ingredient search instruction carrying the search word through semantic analysis.

It should be noted that the user can also input an ingredient search instruction by operating corresponding controls on the other interface when other interfaces are displayed, or input an ingredient search instruction based on the voice control function by speaking a voice password when other interfaces are displayed. For example, in some embodiments, an ingredient search control is displayed in the ingredient management interface. When the user clicks on the ingredient search control, the ingredient management application displays a search interface in response to the user's operation on the control, the search interface at least includes a search bar, and the search bar includes a search term input box and a search control. The user can enter a search term, such as the name of an ingredient, in the search term input box. After entering the search term, the user can click the search control to enter an ingredient search instruction that carries the search term. The search interface can also include historical search terms.

FIG. 10 is a search interface shown in some exemplary embodiments of this application. As shown in FIG. 10 , the search interface has a search bar 110 and a content area 120 . The search bar 110 includes a search term input box 111 and a search control 112, and a plurality of historical search terms are displayed in the content area 120.

In some implementations, the ingredient management application traverses the ingredient information corresponding to each ingredient in the ingredient library in response to the input ingredient search instruction that carries the search term, and uses preset text matching rules to traverse the ingredients in the traversed ingredient information. The name matches the search term. The preset text matching rules include regular expression-based matching rules, semantic similarity-based text matching rules, etc., which are not limited in this application. For example, if an ingredient name includes a search term, the ingredient name matches the search term. For another example, if the semantic similarity between the name of the ingredient and the search term is greater than the preset threshold, the name of the ingredient matches the search term. If at least one ingredient name matching the search term is traversed, the ingredient corresponding to the ingredient name is determined as the target ingredient; if no ingredient name matching the search term is traversed, it is determined that there is no target matching the search term in the ingredient library Ingredients.

In some implementations, the local data corresponding to the ingredient management application includes search result variables. During the traversal and matching process, each time a target ingredient that matches the search term is traversed, the ingredient information corresponding to the target ingredient is added to the search result variable; after the matching is completed, the target ingredient is displayed according to the ingredient information in the search result variable. The search results interface of the ingredient icon.

FIG. 11 is a search result interface shown in some exemplary embodiments of the present application, which may specifically be an interface displayed after a user searches for “apple” in the ingredient library interface shown in FIG. 9 . As shown in FIG. 11 , the search result interface displays ingredients icons matching "apple", including "apple", "applesauce", "apple juice", "apple candy" and "apple cider vinegar". It can be seen that, based on the search function introduced in the foregoing embodiment, the range of selectable ingredients can be greatly reduced, the process of users browsing icons and finding targets in person is avoided, the user time is saved, and the use experience is improved.

FIG. 12 is a search result interface shown in some exemplary embodiments of the present application, which is specifically a search result interface displayed when there is no target ingredient matching the search term in the ingredient library. For example, FIG. 12 may be an interface displayed after the user searches for "tiramisu" in the ingredient library interface when "tiramisu" does not exist in the ingredient library. As shown in FIG. 12 , a custom ingredient adding control “+Add custom ingredient” is displayed in the search result interface. When the user operates the control, the custom ingredient adding interface will be displayed, as shown in Figure 7.

In some embodiments, the ingredient management application, in response to the user's operation on the custom ingredient addition control displayed in the search interface, first returns to the ingredient library interface when the custom category control is selected, and then when the custom category control is selected The custom ingredient add box is displayed on the ingredient library interface of the , and the search term entered by the user is displayed in the input area corresponding to the ingredient name definition item in the custom ingredient add box. Since the search term input by the user represents the ingredient that the user has not searched in the ingredient library, that is, it can also represent the custom ingredient that the user wants to add. Therefore, by displaying the search term in the input area corresponding to the ingredient name definition item, it is possible to save money. The process for the user to manually enter the name of the ingredient, thereby improving the user experience.

Exemplarily, when the user operates the custom ingredient adding control “+Add custom ingredient” in FIG. 12, the user automatically returns to the ingredient library interface when the custom category control is selected as shown in FIG. The upper layer of the library interface displays a custom ingredient add box, and "Tiramisu" is displayed in the input area corresponding to the ingredient name definition item in the custom ingredient add box, as shown in Figure 13. In this way, the user does not need to manually input "tiramisu", which saves user operations and improves user experience.

It is worth noting that when the ingredients that the user wants to add does not exist in the ingredient library, a demand for adding custom ingredients arises. Based on the foregoing embodiment, it can be seen that in the case where there is no target ingredient matching the search term in the ingredient library, the user can trigger the display of custom ingredient addition with one click by setting a custom ingredient addition control in the search result interface. interface, thus avoiding a series of operations that control returning to the ingredient library interface corresponding to the "custom ingredients" tab control, realizing the function of quickly entering the custom ingredient adding interface when there is no search result, and quickly meeting the needs of users to add custom ingredients . By displaying the search term in the input area corresponding to the ingredient name definition item, the process of manually inputting the ingredient name by the user can be saved, thereby improving the user experience.

In specific implementation, a search monitoring service (mSearchListener) is set in the interface including the search bar, so as to monitor the search term input by the user in the search term input box and the operation of the search control through the search monitor service. For example, set the search monitoring service on the ingredient library interface. In the case of no search results, the food management application, in response to the user's operation on the custom food addition control in the search result interface, uses the callback function (addCustumFood) to call back the search words monitored by the search monitoring service to the page corresponding to the food library interface in the parameter. The callback function is also used to switch the corresponding state of the "custom ingredients" control in the ingredients library interface to the selected state, so as to display the ingredients library interface when the "custom ingredients" control is selected, and control the pop-up of custom ingredients to add box, and fill in the search term of the callback in the input area corresponding to the item name definition item.

In some embodiments, when displaying an ingredient library interface or displaying a search result interface containing an ingredient icon of a target ingredient, the user can select an ingredient icon in the interface through a single-point or long-press operation. When the user selects an ingredient icon, The ingredient icon appears selected. Users can select multiple ingredient icons through multiple operations. In response to the user's selection operation on the ingredient icon, the ingredient management application updates the display status of the ingredient icon selected by the user to the selected state. If the selection operation is the selection operation input by the user for the first time, the ingredient icon will not be blocked in the current interface. A preview area is displayed at the location, and the icon of the ingredients selected by the user is displayed in the preview area. The ingredient management application completes the selection operation in response to the input instruction, and saves the ingredient information corresponding to the ingredient icon selected by the user in the local ingredient information set.

For example, when the search result interface shown in FIG. 11 is displayed, the ingredient management application updates the display state of the “apple” icon to the selected state in response to the user’s selection operation on “apple”, and displays it on the lower side of the search result interface. A preview area 141 as shown in FIG. 14 is displayed, in which an "apple" icon is displayed. When the user continues to select “Apple Cider Vinegar”, the “Apple” icon will appear in a selected state, and at the same time, the “Apple Cider Vinegar” icon will also be displayed in the preview area 141 . It can be seen that the preview area 141 also displays a "selected" control. After the user completes the selection, by clicking the "selected" control, input an operation indicating completion of the selection, and the ingredient management application responds to the operation, and saves the ingredient information corresponding to the ingredient icon selected by the user in the local ingredient information collection, and marks it. put into state.

It can be seen from the above embodiments that the embodiments of the present application provide a display device, and the display device may be a refrigerator or other home appliances. It can receive the input food search instruction carrying the search term; match the search term with the ingredients in the ingredient library; if there is a target ingredient matching the search term in the ingredient library, the search result interface containing the ingredient icon of the target ingredient is displayed, This greatly reduces the range of optional ingredients, avoids the process of users browsing icons and finding targets in person, saves user time, and improves user experience.

If there is no target ingredient matching the search term in the ingredient library, the search result interface containing the custom ingredient adding control is displayed. The custom ingredient adding control is used to trigger a jump to the custom ingredient adding interface. The custom ingredient adding The interface is used to receive custom ingredients entered by the user. By setting the custom ingredient adding control in the search result interface, the user can trigger the display of the custom ingredient adding interface with one click, realizing the function of quickly entering the custom ingredient adding interface when there is no search result, and quickly satisfying users to add custom ingredients. requirements to improve user experience.

The embodiment of the present application also provides an interface display method, as shown in FIG. 15 , the method may include:

S151: Receive an input ingredient search instruction, where the ingredient search instruction carries a search term.

In some embodiments, an ingredient management interface is displayed on the display, the ingredient management interface includes an ingredient addition control; in response to an operation on the ingredient addition control, an ingredient library interface is displayed, the ingredient library interface includes a search bar , the search bar includes a search word input box and a search control. By receiving an operation on the search control input by the user after inputting a search term in the search term input box, an ingredient search instruction carrying the search term is received.

S152: Match the search term with the ingredients in the ingredient library.

In some embodiments, the ingredient information corresponding to each ingredient in the ingredient library is traversed, and a preset text matching rule is used to match the name of the ingredient in the traversed ingredient information with the search term; If the name of the ingredient matching the search term is selected, the ingredient corresponding to the name of the ingredient is determined as the target ingredient; if the name of the ingredient that matches the search term is not traversed, it is determined that there is no name of the ingredient in the ingredient library that matches the search term. matching target ingredients.

S153 , if there is a target ingredient matching the search term in the ingredient library, display a search result interface including an ingredient icon of the target ingredient on the display.

In some embodiments, the interface display method provided by the present application further includes: in response to a selection operation of an ingredient icon of the target ingredient, displaying a preview area on the search result interface at a position where the ingredient icon is not blocked, and in the search result interface The ingredient icon selected by the user is displayed in the preview area; the selection operation is completed in response to the input instruction, and the ingredient information corresponding to the ingredient icon selected by the user is stored in the local ingredient information set.

S154, if the target ingredient matching the search term does not exist in the ingredient library, display a search result interface including a custom ingredient adding control on the display, and the custom ingredient adding control is used to trigger a jump to a self-defined ingredient. An ingredient adding interface is defined, and the custom ingredient adding interface is used to receive custom ingredients input by the user.

In some embodiments, in response to an operation on the custom ingredient adding control, displaying the custom ingredient adding interface; receiving ingredient information of the custom ingredient input by the user on the custom ingredient adding interface; The confirmation operation input in the custom ingredient adding interface saves the ingredient information of the custom ingredient in the ingredient library.

In some embodiments, the ingredient library interface further includes a tab switch bar and a content area, the tab switch bar includes a plurality of tab controls, and when different tab controls are selected, the content area displays ingredient icons in different ranges; The label control includes a custom label control, and when the custom label control is selected, an ingredient icon of a custom ingredient is displayed in the content area; the display is displayed in response to an operation of adding a control to the custom ingredient. The custom ingredient adding interface includes: returning to the ingredient library interface when the custom category control is selected; displaying a custom ingredient adding box on the upper layer of the ingredient library interface when the custom category control is selected, The custom ingredient adding box is used to receive the custom ingredient input by the user.

In some embodiments, the custom ingredient adding box includes at least an ingredient name definition item; when the custom category control is selected, a custom ingredient adding box is displayed on the upper layer of the ingredient library interface, including: adding the search The word is displayed in the input area corresponding to the item name definition item.

It can be seen from the above embodiments that the embodiment of the present application provides an interface display method, which includes: receiving an input food search instruction carrying a search term; matching the search term with the food material in the food material library; For the target ingredients that match the search words, the search result interface containing the ingredient icons of the target ingredients will be displayed, thereby greatly narrowing the range of available ingredients, avoiding the process of browsing the icons and finding the target in person, saving users time and improving the user experience. ; If there is no target ingredient matching the search term in the ingredient library, the search result interface containing the custom ingredient addition control is displayed, and the custom ingredient addition control is used to trigger a jump to the custom ingredient addition interface. Add an interface for receiving custom ingredients entered by the user. By setting the custom ingredient adding control in the search result interface, the user can trigger the display of the custom ingredient adding interface with one click, realizing the function of quickly entering the custom ingredient adding interface when there is no search result, and quickly satisfying users to add custom ingredients. requirements to improve user experience.

FIG. 16 is an ingredient management interface shown in some exemplary embodiments of the present application, which is specifically an interface before scrolling the ingredient icon corresponding to the target ingredient information to the top of the partition. As shown in FIG. 16 , in the ingredient management interface, the preset number of display columns in each partition is 3, that is, 3 ingredient icons are displayed in each row. The scroll bar of each partition is at the top position, and the first 3 ingredient icons in each partition are displayed in the first row at the top of each partition. The ingredient 5 displayed in the partition 303 corresponds to one target ingredient information, which is displayed in the third row of the partition 303 , and the ingredient 8 displayed in the partition 304 corresponds to another target ingredient information, which is displayed in the second row of the partition 304 .

FIG. 17 is an ingredient management interface shown in some exemplary embodiments of the present application, which is specifically an interface after scrolling the ingredient icon corresponding to the target ingredient information in FIG. 16 to the top of the partition. As shown in FIG. 17 , compared with the interface shown in FIG. 16 , the scroll bar of partition 303 moves down by two lines, and ingredient 5 scrolls up from the third row to the first row; the scroll bar in partition 304 moves down one row, ingredient 8 Scroll up from the second row to the first row.

Referring to FIGS. 16 and 17, it can be seen that, based on the display device provided by the embodiment of the present application, when the newly added target ingredient information appears in the ingredient information set, it is not necessary for the user to manually operate the scroll bar in the partition to display the corresponding target ingredient information. The ingredient icon automatically scrolls to the top of the partition where it is located, making it easier for users to view the newly added ingredients and improving user experience.

In some embodiments, in order to display the ingredient icon corresponding to the newly added ingredient information at the top of the ingredient display area, when a change in the ingredient information set is monitored, the set can be paired according to the time when the ingredient included in each ingredient information is put into the set. The ingredient information in the set is sorted in descending order, so that the ingredient information that is put in later is arranged at the front in the ingredient information set. Then, according to the arrangement order of the ingredient information in the collection, the ingredient icon corresponding to each ingredient information is displayed in the ingredient display area, so that the ingredient icons are arranged in the ingredient display area in descending order according to the time when the ingredients were put in, that is, the ingredients that were put in later. The icon can be displayed in the front of the ingredient display area, so as to ensure that the ingredient icon corresponding to the newly added ingredient information is displayed at the top of the ingredient display area, which is convenient for users to view and improves user experience.

In these embodiments, in order to display the ingredients in different storage compartments in the ingredient management interface, after reading the latest ingredient information collection, according to the storage compartment identifier in the ingredient information, the ingredient information in the collection is It is divided into different sub-collections, so that the ingredient information containing the same storage room identifier is divided into the same sub-collection. Then, according to the time when the ingredients are put in, the information of the ingredients in each sub-collection is arranged in descending order, so that the information of the ingredients that are put in later is arranged at the front in the sub-collection. Then, according to the ingredient information and arrangement order in each sub-collection, the corresponding ingredient icons are displayed in the corresponding partitions, so that the ingredient icons in each partition are arranged in descending order according to the time when the ingredients were put in, that is, they were put in later. The icon of the ingredient can be displayed in the front of the partition, so as to ensure that the icon of the ingredient corresponding to the newly added ingredient information is displayed at the top of the area where it is located, which is convenient for users to view and improves the user experience.

The embodiment of the present application also provides a method for displaying an ingredient icon. As shown in FIG. 18 , the method may include:

S181. Monitor whether the information in the ingredient information collection changes, where the collection includes ingredient information corresponding to the ingredients in the storage room, and the ingredient information includes the time when the ingredients are put in.

S182, when the information in the set changes, determine the newly added target ingredient information according to the time when the ingredient was put in.

In some possible implementations, the time difference corresponding to each ingredient information is determined according to the time when the ingredient is put in and the current time contained in each ingredient information in the set; the ingredient information whose time difference is less than a preset time difference is determined as The latest added target ingredient information.

In some other possible implementation manners, the newly added ingredient information of the set after the change relative to the set before the change is determined; the newly added ingredient information is determined according to the ingredient insertion time and the current time included in the newly added ingredient information The corresponding time difference; the newly added ingredient information whose time difference is less than the preset time difference is determined as the newly added target ingredient information.

S183, when displaying the corresponding ingredient icon in the ingredient display area according to the ingredient information in the changed set, display the ingredient icon corresponding to the target ingredient information on the top of the ingredient display area.

In some embodiments, the ingredient display area includes a partition corresponding to the storage compartment, and the ingredient information further includes a storage compartment identifier; the ingredient display area displays the corresponding ingredient information according to the ingredient information in the changed set. The ingredient icon includes: according to the storage room identifier in the ingredient information, in the partition corresponding to the storage room identifier, displaying the ingredient icon corresponding to the ingredient information, and displaying the ingredient icon corresponding to the target ingredient information on the top of the partition.

In some embodiments, according to the storage room identifier in the ingredient information, in the partition corresponding to the storage room identifier, the ingredient icon corresponding to the ingredient information is displayed, and the ingredient icon corresponding to the target ingredient information is displayed in the The top of the partition includes: dividing the ingredient information in the collection into different sub-collections according to the storage room identifier; displaying the corresponding ingredient icon in the corresponding partition according to the ingredient information in each sub-collection; The ingredient icon corresponding to the target ingredient information is scrolled up to the top of the partition where it is located.

In some embodiments, scrolling the ingredient icon corresponding to the target ingredient information to the top of the partition where it is located includes: determining the target ingredient information according to the index position of the target ingredient information in the sub-collection and the number of display columns preset in the partition. the actual display row of the ingredient icon corresponding to the target ingredient information in the partition; determine the interval distance between the actual display row and the first row; scroll up the interval distance in the view in the partition to display the The ingredient icon corresponding to the target ingredient information is scrolled to the first row at the top of the partition.

It can be seen from the above embodiments that, based on the method for displaying icons of refrigerators and ingredients provided by the embodiments of the present application, when the newly added target ingredient information appears in the ingredient information set, the target ingredient information can be displayed without the user manually operating the scroll bar in the partition. The corresponding ingredient icons are automatically scrolled to the top of the partition where they are located, so as to facilitate users to view the newly added ingredients and improve user experience.

In a specific implementation, the present invention also provides a computer storage medium, wherein the computer storage medium can store a program, and when the program is executed, it can include some or all of the steps in the various embodiments of the interface display method provided by the present invention. The storage medium may be a magnetic disk, an optical disk, a read-only memory (English: read-only memory, abbreviated as: ROM) or a random access memory (English: random access memory, abbreviated as: RAM) and the like.

Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products may be stored in a storage medium, such as ROM/RAM , magnetic disk, optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of the present invention.

It is sufficient to refer to each other for the same and similar parts among the various embodiments in this specification. Especially, for the refrigerator embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for the relevant part, please refer to the description in the method embodiment.

The embodiments of the present invention described above do not limit the protection scope of the present invention.

Claims (10)

1. A display device, comprising:

   a display for presenting the user interface;

   A controller connected to the display, configured to:

   receiving an input ingredient search instruction, where the ingredient search instruction carries a search term;

   matching the search term with the ingredients in the ingredient library;

   If there is a target ingredient matching the search term in the ingredient library, a search result interface containing the ingredient icon of the target ingredient is displayed;

   If there is no target ingredient matching the search term in the ingredient library, a search result interface including a custom ingredient adding control is displayed, and the custom ingredient adding control is used to trigger a jump to the custom ingredient adding interface, and the The custom ingredient adding interface is used to receive custom ingredients input by the user.
2. The display device of claim 1, wherein the controller is further configured to:

   In response to an operation on the custom ingredient adding control, displaying the custom ingredient adding interface;

   receiving the ingredient information of the custom ingredient input by the user in the custom ingredient adding interface;

   In response to the confirmation operation input in the custom ingredient adding interface, the ingredient information of the custom ingredient is saved in the ingredient library.
3. The display device of claim 2, wherein the controller is further configured to:

   In response to the operation on the custom ingredient adding control, while the custom ingredient adding interface is displayed, the search term is displayed in the input area corresponding to the ingredient name definition item in the custom ingredient adding interface.
4. The display device according to claim 2, wherein the receiving an input food ingredient search instruction comprises:

   displaying an ingredient library interface on the display, the ingredient library interface including a search bar including a search word input box and a search control;

   By receiving an operation on the search control input by the user after inputting a search term in the search term input box, an ingredient search instruction carrying the search term is received.
5. The display device according to claim 4, wherein the ingredient library interface further includes a tab switch bar and a content area, the tab switch bar includes a plurality of tab controls, and when different tab controls are selected, the content The icon of ingredients in different ranges is displayed in the area; the label control includes a custom label control, and when the custom label control is selected, the icon of the food material of the custom ingredient is displayed in the content area;

   The displaying a custom ingredient adding interface in response to an operation on the custom ingredient adding control, including:

   Return to the ingredient library interface when the custom category control is selected;

   When the custom category control is selected, a custom ingredient add box is displayed on the upper layer of the ingredient library interface, and the search term is displayed in the input area corresponding to the ingredient name definition item in the custom ingredient add box.
6. The display device of claim 1, wherein the controller is further configured to:

   displaying an ingredient management interface on the display, the ingredient management interface including an ingredient addition control;

   The ingredient library interface is displayed in response to manipulation of the ingredient addition controls.
7. The display device according to claim 1, wherein the matching the search term with the ingredients in the ingredient library comprises:

   Traverse the ingredient information corresponding to each ingredient in the ingredient library, and use the preset text matching rules to match the ingredient name in the traversed ingredient information with the search term;

   If at least one ingredient name matching the search term is traversed, determining the ingredient corresponding to the ingredient name as the target ingredient;

   If the name of the ingredient matching the search term is not traversed, it is determined that there is no target ingredient matching the search term in the ingredient library.
8. The display device of claim 7, wherein the controller is further configured to:

   During the traversal and matching process, the ingredient information corresponding to the target ingredient is added to the search result variable;

   After the matching is completed, a search result interface containing the ingredient icon of the target ingredient is displayed according to the ingredient information in the search result variable.
9. The display device of claim 1, wherein the controller is further configured to:

   In response to the selection operation of the ingredient icon of the target ingredient, a preview area is displayed on the search result interface at a position that does not block the ingredient icon, and the ingredient icon selected by the user is displayed in the preview area;

   In response to the input instruction to complete the selection operation, the ingredient information corresponding to the ingredient icon selected by the user is stored in the local ingredient information set.
10. An interface display method, characterized in that the method comprises:

    receiving an input ingredient search instruction, where the ingredient search instruction carries a search term;

    matching the search term with the ingredients in the ingredient library;

    If there is a target ingredient that matches the search term in the ingredient library, displaying a search result interface containing an ingredient icon of the target ingredient on the display;

    If there is no target ingredient matching the search term in the ingredient library, a search result interface including a custom ingredient adding control is displayed on the display, and the custom ingredient adding control is used to trigger a jump to a custom ingredient An adding interface, where the custom ingredient adding interface is used to receive custom ingredients input by a user.

Images