CN110448250B - Tableware storing and taking method and system - Google Patents
Tableware storing and taking method and system Download PDFInfo
- Publication number
- CN110448250B CN110448250B CN201910715757.1A CN201910715757A CN110448250B CN 110448250 B CN110448250 B CN 110448250B CN 201910715757 A CN201910715757 A CN 201910715757A CN 110448250 B CN110448250 B CN 110448250B
- Authority
- CN
- China
- Prior art keywords
- tableware
- storage
- dishwasher
- household appliance
- intelligent household
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L15/00—Washing or rinsing machines for crockery or tableware
- A47L15/0018—Controlling processes, i.e. processes to control the operation of the machine characterised by the purpose or target of the control
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L15/00—Washing or rinsing machines for crockery or tableware
- A47L15/42—Details
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L15/00—Washing or rinsing machines for crockery or tableware
- A47L15/42—Details
- A47L15/4295—Arrangements for detecting or measuring the condition of the crockery or tableware, e.g. nature or quantity
Landscapes
- Washing And Drying Of Tableware (AREA)
Abstract
The invention is suitable for the technical field of intelligent household appliances, and provides a tableware storing and taking method and a tableware storing and taking system, wherein the tableware storing and taking method comprises the following steps: the dishwasher collects environmental images of all storage areas in a cavity and generates a tableware storage schematic diagram of the dishwasher according to the environmental images; the intelligent household appliance outputs the tableware storage schematic diagram in a local display module and receives an area selection instruction fed back by a user based on the tableware storage schematic diagram; the dishwasher ejects a storage area corresponding to the area selection instruction through a transmission module so that the user can perform tableware storing and taking operation in the storage area. The storage area corresponding to each tableware type can be determined without opening the dish-washing machine, so that the problem that a user can determine the area after pulling the tableware one by one is avoided, and the user can also determine the storage area of the tableware when the intelligent household appliance executes other operations, so that the operation is convenient and fast, the storage and taking speed of the user is further improved, and the use experience of the user is improved.
Description
Technical Field
The invention belongs to the technical field of intelligent household appliances, and particularly relates to a tableware storing and taking method and system.
Background
With the continuous development of intellectualization and automation, a dishwasher as one of intelligent household appliances has gradually entered into thousands of households. Along with the increase of family members and the continuous abundance of food types, the types of tableware needed to be accommodated by the dish washing machine and the quantity of the tableware are increased, and the dish washing machine can be divided into different areas in the washing cavity for the convenience of user access, so that the dish washing machine can store the same type of tableware to corresponding positions when the dish washing machine is used and needs to be cleaned by the convenience of users.
However, in the existing dishwasher control technology, a user needs to actively open a cabinet door of the dishwasher and pull out each storage area to determine the type of the tableware corresponding to the storage area, and when the user is cooking or performing other actions and urgently needs to take proper tableware quickly, a large amount of time is needed to be spent on determining the storage area of the target tableware, so that the tableware storage speed is reduced, and the user experience is reduced.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method and a system for storing and taking out dishes, so as to solve the problem that the existing dishwasher control technology needs to spend a lot of time on determining a storage area of a target dish, thereby reducing the speed of storing the dishes and reducing the user experience.
The first aspect of the embodiment of the invention provides a tableware storing and taking method, which is applied to an intelligent household appliance system, wherein the intelligent household appliance system comprises a dish washer and at least one intelligent household appliance;
the tableware access method comprises the following steps:
the dishwasher collects environmental images of all storage areas in a cavity and generates a tableware storage schematic diagram of the dishwasher according to the environmental images;
the intelligent household appliance outputs the tableware storage schematic diagram in a local display module and receives an area selection instruction fed back by a user based on the tableware storage schematic diagram;
the dishwasher ejects a storage area corresponding to the area selection instruction through a transmission module so that the user can perform tableware storing and taking operation in the storage area.
A second aspect of the embodiments of the present invention provides an intelligent household appliance system, including a dishwasher and at least one intelligent household appliance;
the dishwasher is used for acquiring environmental images of all storage areas in the cavity and generating a tableware storage schematic diagram related to the dishwasher according to the environmental images;
the intelligent household appliance is used for outputting the tableware storage schematic diagram in a local display module and receiving an area selection instruction fed back by a user based on the tableware storage schematic diagram;
the dishwasher is used for ejecting the storage area corresponding to the area selection instruction through the transmission module so that the user can carry out tableware storing and taking operation in the storage area.
The embodiment of the invention provides a tableware storing and taking method and a tableware storing and taking system, which have the following beneficial effects:
the embodiment of the invention constructs a dish washing machine and at least one intelligent household appliance into an intelligent household appliance system, obtains environment images of each storage area through a camera module arranged in the dish washing machine, obtains the type of tableware required to be stored in each storage area through the environment images, thereby generating a tableware storage schematic diagram of the dish washing machine, and sends the tableware storage schematic diagram to the intelligent household appliance, the intelligent household appliance can output the tableware storage schematic diagram on a local display module, when the intelligent household appliance is operated, a user can know the tableware information stored in each storage area through the display module, and determine a target area generation area selection instruction, and the dish washing machine can pop up a target storage area through a transmission device, so that the user can carry out tableware access operation. Compared with the prior art of controlling the dish-washing machine, the invention can output the tableware storage schematic diagram through other intelligent household appliances in the same intelligent household appliance system, a user can determine the storage area corresponding to each tableware type without opening the dish-washing machine, the problem that the user can determine the storage area only after pulling the tableware area by area is avoided, and the user can also determine the storage area of the tableware simultaneously when the intelligent household appliances perform other operations, the operation is convenient and fast, the storage and taking speed of the user is further improved, and the use experience of the user is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
FIG. 1 is an interactive flowchart of a method for accessing tableware according to a first embodiment of the present invention;
FIG. 2 is a flowchart illustrating an embodiment of a method S101 for accessing dishes according to a second embodiment of the present invention;
FIG. 3 is a flowchart illustrating an embodiment of a method S1011 for accessing tableware according to a third embodiment of the present invention;
FIG. 4 is a flow chart of a method for accessing tableware according to a fourth embodiment of the present invention;
FIG. 5 is a flowchart illustrating an embodiment of a method S102 for accessing tableware according to a fifth embodiment of the present invention;
fig. 6 is a block diagram of an intelligent home appliance system according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The embodiment of the invention constructs a dish-washing machine and at least one intelligent household appliance into an intelligent household appliance system, obtains the environment image of each storage area through a camera module arranged in the dish-washing machine, obtains the type of tableware required to be stored in each storage area through the environment image, thereby generating a tableware storage schematic diagram of the dish-washing machine, and sends the tableware storage schematic diagram to the intelligent household appliance, the intelligent household appliance can output the tableware storage schematic diagram on a local display module, when the intelligent household appliance is operated, a user can know the tableware information stored in each storage area through the display module and determine a target area generation area selection instruction, the dish-washing machine can pop up the target storage area through a transmission device, so that the user can carry out the tableware access operation, the problem that the existing dish-washing machine control technology needs to spend a large amount of time on determining the storage area of the target tableware is solved, thereby reducing the speed of tableware storage and reducing the problem of user experience.
In the embodiment of the invention, the execution main body of the process is an intelligent household appliance system. This intelligence household electrical appliances system is including dish washer and at least one intelligence household electrical appliances except that the dish washer, dish washer and intelligence household electrical appliances all can have data processing module, handle the information that receives through data processing module, and this data processing module can be microprocessor such as singlechip, and especially, this intelligence household electrical appliances are including display module, can carry out image output through display module. Fig. 1 shows a flow chart of an implementation of a method for accessing tableware according to a first embodiment of the present invention, which is detailed as follows:
in S101, the dishwasher collects environmental images of each storage area in a cavity, and generates a tableware storage schematic diagram about the dishwasher according to the environmental images.
In this embodiment, dish washer and at least one intelligent household electrical appliances except that the dish washer have constituted an intelligent household electrical appliances system, and dish washer and intelligent household electrical appliances can establish communication connection through wireless communication module, and under this condition, dish washer and intelligent household electrical appliances can log in to the wireless local area network of same wireless access equipment transmission, carry out wireless communication through wireless local area network. Of course, if the distance between the dish washer and the intelligent household appliance is short, a wireless communication link between the dish washer and the intelligent household appliance can be established through the Bluetooth module, data is packaged through a Bluetooth protocol, and data interaction is carried out. Optionally, the dishwasher and the intelligent appliance may be configured with a wired communication module, in which case the dishwasher and the intelligent appliance may access the wired link to the bridge or the router, and communicate the two wired links through the bridge and the router, thereby implementing data interaction between the dishwasher and the intelligent appliance.
For example, the intelligent household appliance can be an intelligent household appliance such as an intelligent refrigerator, an intelligent range hood and an intelligent mixer, and a user can determine the storage position of tableware on a display panel of the intelligent household appliance if the storage position of the tableware needs to be determined in the process of using other intelligent household appliances, so that the tableware can be rapidly stored. The intelligent household appliance is taken as an example for explanation, after a user selects food materials in the intelligent refrigerator, the food materials which are taken out need to be contained in tableware, at the moment, if the cabinet door of the refrigerator which is closed by the user is detected, the operations of S101 and S102 can be automatically executed, a tableware storage schematic diagram is output on a display module of the intelligent refrigerator, the user can quickly determine the storage area of the tableware containing the food materials, and an area selection instruction is generated, so that the dish washer can automatically pop up the storage area, and the user can conveniently and quickly store and take the tableware. If the intelligent household appliance is an intelligent range hood, the surface of the intelligent range hood does not comprise a display module, a projection module can be configured on the intelligent range hood, the outputted tableware storage schematic diagram is projected onto a wall through the projection module, therefore, a user can conveniently select a target storage area, each target storage area is associated with a corresponding button, and the user can generate an area selection instruction of the target area by clicking the corresponding button.
In this embodiment, in order to determine the storage area of each tableware, an image capturing module may be configured in the cavity of the dishwasher, and the image capturing module may acquire the environment image of each storage area, and determine the display order of each storage area and the area where each storage area is located in the tableware storage map according to the mutual position relationship of each storage area in the dishwasher, and splice all the environment images, so as to obtain the tableware storage map in the cavity of the dishwasher.
In this embodiment, the dishwasher may trigger S101 the operation when receiving a storage diagram feedback instruction sent by the intelligent appliance. For example, the user may generate a deposit diagram feedback command on the interactive interface of the smart appliance, the smart appliance sends the command to the dishwasher, and the dishwasher performs the operation of S101. Of course, the dishwasher may perform the operation of S101 after detecting that the cabinet door is closed. Because the cabinet door is closed the back, the locating place of each tableware in the cavity is then fixed, only when the user opens the cabinet door once more, just can change, under this condition, the dish washer detects the cabinet door and closes the back at every turn, then carries out S101' S operation to the tableware that will record and obtain deposits the sketch map and stores in the register. Before the next cabinet door is opened, the intelligent household appliance needs to output tableware schematic diagrams, can be extracted from the register, and does not need to shoot repeatedly, so that the energy consumption of the dish-washing machine can be reduced.
In S102, the intelligent appliance outputs the tableware storage diagram in a local display module, and receives a region selection instruction fed back by a user based on the tableware storage diagram.
In this embodiment, the intelligent household appliance can be in communication connection with the dishwasher, so the dishwasher can send the tableware storage schematic diagram to the intelligent household appliance through the communication link, and then the intelligent household appliance can output the tableware storage schematic diagram on the local display module. It should be noted that the intelligent household appliance may actively display the tableware storage diagram, in this case, the intelligent household appliance may be provided with a display trigger condition, for example, when the intelligent household appliance receives the approach of the user, for example, the distance between the intelligent household appliance and the user is obtained by the distance sensor, and if the distance value between the intelligent household appliance and the user is smaller than a preset distance threshold value, the tableware storage diagram is displayed. Preferably, if an operation completion instruction is detected, for example, the intelligent household appliance completes a certain operation, and at this time, the user may use the intelligent household appliance and need to take a bowl from the dishwasher, the tableware storage diagram may be output on the display module of the intelligent household appliance at this time. Of course, the dishwasher may also perform a passive display, for example, when the user inputs a display instruction on the smart appliance, the smart appliance performs the operation of S102.
In this embodiment, the dishwasher may send the tableware map to the intelligent appliance at a preset update period, in which case, the intelligent appliance may directly store the tableware map in the register without re-acquiring the image from the dishwasher, thereby reducing the frequency of data interaction. Or, the intelligent household appliance may send a schematic diagram obtaining instruction to the dishwasher when receiving the display instruction, and the dishwasher may obtain the tableware schematic diagram corresponding to the current time or extract the tableware schematic diagram from the register and send the tableware schematic diagram to the intelligent household appliance, and output the tableware schematic diagram to the user through the display module of the intelligent household appliance.
In this embodiment, a user may determine, at a display module of the smart appliance, information on dishes contained in each storage area in the dishwasher, determine one of the storage areas as a target area according to actual usage requirements, and generate an area selection instruction regarding the target area.
In S103, the dishwasher ejects a storage area corresponding to the area selection command through a transmission module, so that the user performs a dish access operation in the storage area.
In this embodiment, the intelligent household electrical appliance can send the dish washer by the region selection instruction that the user received, and then the dish washer can determine the target area from a plurality of storage areas according to this region selection instruction, and pop out this target area through this transmission module, and the user can directly take required tableware or will treat that the required tableware of washing is placed in this storage area from the storage area who pops out, need not the user and draws each storage area one by one, has reduced the access efficiency of tableware.
It should be noted that the dishwasher may be provided with a single actuator, in which case the actuator may be associated with all storage areas, and ejection of the respective storage areas may be effected by actuating different ejection members in the actuator module. Of course, the dishwasher may also be equipped with separate transmission modules for the different storage areas, in which case the dishwasher may determine the corresponding transmission module and activate the transmission module corresponding thereto according to the area identification of the area selection command. Of course, the dishwasher may also be provided with only one storage area.
Alternatively, the dishwasher may be communicatively coupled to a plurality of different intelligent appliances, thereby forming a system including a plurality of intelligent appliances. The response flows of the multiple intelligent household appliances are consistent with the response flow of the single intelligent household appliance, and the tableware storage schematic diagram is output on the local display module, so the specific implementation process can be referred to the above description, and is not repeated herein.
It can be seen from the above that, in the method for accessing tableware provided by the embodiment of the present invention, the dishwasher and at least one intelligent household appliance are constructed as an intelligent household appliance system, the camera module built in the dishwasher acquires the environment image of each storage area, the type of tableware required to be stored in each storage area is acquired through the environment image, so as to generate a tableware storage diagram of the dishwasher, and the tableware storage diagram is sent to the intelligent household appliance. Compared with the prior art of controlling the dish-washing machine, the invention can output the tableware storage schematic diagram through other intelligent household appliances in the same intelligent household appliance system, a user can determine the storage area corresponding to each tableware type without opening the dish-washing machine, the problem that the user can determine the storage area only after pulling the tableware area by area is avoided, and the user can also determine the storage area of the tableware simultaneously when the intelligent household appliances perform other operations, the operation is convenient and fast, the storage and taking speed of the user is further improved, and the use experience of the user is improved.
Fig. 2 shows a flowchart of a specific implementation of a method S101 for accessing dishes according to a second embodiment of the present invention. Referring to fig. 2, with respect to the embodiment shown in fig. 1, the method S101 for accessing dishes provided by the embodiment includes: s1011 to S1012, detailed description is as follows:
further, the dishwasher collects an environment image of each storage area in the cavity, and generates a tableware storage schematic diagram about the dishwasher according to the environment image, including:
in S1011, the dishwasher acquires contour curves of the environment image, and identifies tableware information included in the environment image based on each contour curve; the tableware information includes a type of tableware and a number of tableware of the type of tableware.
In this embodiment, after obtaining the environment graphics, the dishwasher may extract the contour curve of each object from the environment image through a preset contour extraction algorithm. Specifically, the dishwasher can detect the pixel difference value between each pixel point and the pixel points on the two sides, and if the pixel difference value is greater than a preset pixel threshold value, the pixel point is identified as the pixel point where the contour line is located, and all continuous contour pixel points are identified as a contour curve, so that a plurality of continuous contour curves can be obtained.
Optionally, the dishwasher may pre-process the environmental image, and since the cavity is in a closed state when the environmental image of the storage area is shot, the environmental light is weak at this time, the dishwasher may perform light reinforcement in a manner of flash light or the like when shooting, or the dishwasher may improve the brightness of the environmental image obtained by shooting by extending the exposure time. Preferably, the dishwasher may obtain the ambient light intensity in the cavity, determine an adjustment coefficient based on the ambient light intensity, and perform image optimization on the captured ambient image based on the adjustment coefficient, for example, by improving brightness, contrast, exposure value, and the like, so as to avoid the influence on the image due to too low ambient light intensity. Certainly, the dishwasher can also perform binarization or graying and other processing on the environment image after the light supplement, improve the definition of the contour line through a sharpening algorithm, and extract the contour curve in the environment image after the optimization processing.
In this embodiment, the dishwasher may match the continuous profile curve with the standard curves of the respective types of dishes, select the standard curve having the matching degree exceeding the preset threshold as the matching curve of the profile curve, and use the type of the dish of the matching curve as the type of the dish to which the profile curve belongs. By recognizing the types of dishes of all the objects to be photographed in the environment image, the types of dishes included in the storage area and the number of dishes of each type can be specified, and the dish information on the storage area can be generated.
In S1012, the dishwasher establishes a correspondence between the dish information and the storage areas, and generates the dish storage diagram based on the correspondence of each storage area.
In this embodiment, after acquiring the tableware information of all storage areas, the dishwasher may establish a corresponding relationship between the tableware information and the storage areas, and add the corresponding relationship to a preset storage diagram template, so that a user can determine the type and number of the tableware corresponding to each storage area through the corresponding relationship, and select a corresponding target area for tableware access operation.
For example, the storage schematic diagram module may configure corresponding display areas for different storage areas, and the dishwasher selects a tableware icon matched with the type of tableware according to the type of tableware contained in the storage area, and marks the number of the type of tableware in the areas such as the left side or the upper side of the tableware icon, so that the user can conveniently and quickly determine the storage condition of the tableware cloth in each storage area through the above manner.
In the embodiment of the invention, the contour recognition is carried out on the environment image, the tableware contained in the storage area is recognized according to the contour curve, the type arrangement is carried out on the tableware in the storage area, the tableware information is generated, and the tableware storage schematic diagram is output based on the tableware information.
Fig. 3 is a flowchart illustrating an implementation of the method S1011 for accessing tableware according to a third embodiment of the present invention. Referring to fig. 3, with respect to the embodiment described in fig. 2, the method S1011 for accessing tableware provided by this embodiment includes: s301 to S1032 are specifically detailed as follows:
further, the dishwasher acquires contour curves of the environment image and identifies tableware information contained in the environment image based on each contour curve, including:
in S301, the dishwasher acquires a contour region image corresponding to the contour curve, and determines a pixel feature value of the contour curve based on pixel values of pixel points included in the contour region image.
In this embodiment, after identifying the contour curves of the environment image, the dishwasher needs to determine the type of the dishware of the object to which each contour curve belongs. In this case, the dishwasher may extract, from the environmental curve, a contour region image corresponding to the contour curve according to the coordinate position of the contour line, determine a pixel value corresponding to each pixel point in the contour region image, and obtain a pixel characteristic value corresponding to the contour curve based on an average value of the pixel values of the plurality of pixel points. Because different tableware is made of different materials, the corresponding tableware types are different, and different manufacturing materials can be reflected on the surface color, so that the tableware type of an object to which the contour curve belongs can be determined by acquiring the pixel value of the pixel point, for example, the iron tableware and the ceramic tableware have larger difference in color.
In S302, the dishwasher determines a dish orientation of the dish to be identified based on the contour curve, and acquires a template curve of each candidate dish with respect to the dish orientation.
In this embodiment, the dishwasher determines the dish facing direction corresponding to the dish based on the curve shape of the contour curve and the degree of closure. The length, radian and enclosed area of the contour curve corresponding to different tableware faces are different, the matching degree of the contour curve and each tableware face can be calculated according to the characteristics of different tableware faces, and the tableware face with the highest matching degree is selected as the tableware face corresponding to the contour curve. After determining the dish-facing surface of the contour curve, the dishwasher can acquire the template curve of different candidate dishes facing the dish.
In S303, the dishwasher calculates a degree of matching of the dish orientation with each of the template curves.
In this embodiment, the dishwasher may match the profile curve with the template curves of the candidate dishware, and may first adjust all the curves to a uniform ratio, and count the number of the overlapped pixel points, and use the ratio of the number of the overlapped pixel points to the total number of the pixels of the entire profile curve as the matching degree between the two.
In S304, the dishwasher determines a dish type corresponding to the contour curve based on the matching degree and the pixel characteristic value.
In this embodiment, the dishwasher may determine the tableware shape of the object to which the contour curve belongs using the template curve having the highest matching degree, determine the material information of the object to which the contour curve belongs according to the pixel feature value, and determine the type of the tableware based on the tableware shape and the material information.
In the embodiment of the invention, the material for manufacturing the tableware is determined by identifying the characteristic value of the pixel, and the matching degree between the contour curve and each candidate tableware is calculated by determining the orientation of the tableware, so that the identification accuracy of the type of the tableware can be further improved, and a user can conveniently and accurately obtain the tableware storage information of the dish-washing machine.
Fig. 4 is a flowchart illustrating an implementation of a method for accessing dishes according to a fourth embodiment of the present invention. Referring to fig. 4, in comparison with the embodiments 1 to 3, the method for accessing tableware provided in this embodiment further includes: s401 to S404 are specifically detailed as follows:
further, after the dishwasher collects the environment image of each storage area in the cavity and generates the tableware storage schematic diagram about the dishwasher according to the environment image, the method further comprises the following steps:
in S401, the smart appliance determines information of an object to be stored; the object information includes an object type and an object number.
In this embodiment, the intelligent appliance may generate the area selection instruction according to the selection of the user, and also generate the area selection instruction according to the actual demand of the user, for example, after the user cooks or takes out food from a refrigerator, the intelligent appliance may obtain information of an object to be contained, determine a food type of the food, that is, the object type and the number of objects, and the number of objects may include characteristics of two aspects, namely, a volume and a number of the food.
In S402, the smart appliance determines a type of tableware based on the object type, and calculates the number of tableware needed to be used according to the number of objects.
In this embodiment, the intelligent appliance may select, from the tableware storage diagram, the candidate tableware with the highest matching degree as the type of the tableware containing the object according to the type of the object. For example, if the object type is a fruit type, the corresponding dish type may be a dish, and the object type is a rice type, the corresponding dish type may be a bowl. On the other hand, if the number of the objects is larger, a plurality of dishes of the type need to be placed, so that the rated placing number of the dishes of the type can be obtained, and the required number of the dishes can be calculated based on the rated placing number and the number of the objects.
In S403, the intelligent appliance determines the storage area corresponding to the type of the tableware in the tableware storage diagram, and detects whether the storage number included in the storage area is greater than or equal to the number of the tableware.
In this embodiment, the intelligent appliance may determine the types of the dishes contained in each storage area from the dish storage diagram, select the storage area containing the type of the dishes identified in S402 as a target area, detect the number of the dishes contained in the target area, and determine whether the number of the dishes stored in the target area meets the storage requirement of the user, if so, execute the operation of S404; if the storage number is smaller than the number of the tableware, the insufficient tableware information can be output, and if the plurality of storage areas store the tableware of the type, the plurality of storage areas can be popped out simultaneously.
In S404, if the intelligent household appliance detects that the storage number is greater than or equal to the number of the dishware, the area selection command for the storage area is generated.
In this embodiment, if the number of stored dishes is equal to or greater than the number of dishes, the area selection command for the area can be output.
In the embodiment of the invention, the region selection instruction is automatically generated by identifying the object information of the object to be placed, so that the operation of a user is further reduced, and the operation efficiency of the user is improved.
Fig. 5 shows a flowchart of an implementation of S102 of a method for accessing dishes according to a fourth embodiment of the present invention. Referring to fig. 5, with respect to the embodiments 1-3, the method S102 for accessing dishes provided by the present embodiment includes: s1021 to S1022 are specifically described as follows:
further, the intelligent household appliance outputs the tableware storage schematic diagram in a local display module, and receives a region selection instruction fed back by a user based on the tableware storage schematic diagram, and the method comprises the following steps:
in S1021, the intelligent appliance receives a touch instruction triggered by the user in the display module.
In this embodiment, the display module of the intelligent home appliance is a touch module, and a user can trigger a touch instruction on the display module by clicking, sliding and other modes.
In S1032, the intelligent appliance determines the target area selected by the user based on the touch instruction, and generates the area selection instruction regarding the target area.
In this embodiment, the intelligent household appliance may determine, according to the coordinate position corresponding to the touch instruction, the storage area associated with the coordinate position, identify the associated storage area as a target area, and generate an area selection instruction about the target area.
In the embodiment of the invention, the touch instruction is created on the touch module, so that the user can select the target area conveniently, and the operation efficiency of the user is improved.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
Fig. 6 shows a block diagram of a dishwasher according to an embodiment of the present invention, which includes units for performing the steps of the embodiment of fig. 1. Please refer to fig. 1 and fig. 1 for the corresponding description of the embodiment. For convenience of explanation, only the portions related to the present embodiment are shown.
Referring to fig. 6, the intelligent appliance system includes a dishwasher 61 and at least one intelligent appliance 62;
the dishwasher 61 is used for acquiring an environment image of each storage area in the cavity and generating a tableware storage schematic diagram related to the dishwasher according to the environment image;
the intelligent household appliance 62 is configured to output the tableware storage diagram in a local display module, and receive a region selection instruction fed back by a user based on the tableware storage diagram;
the dishwasher 61 is configured to eject the storage area corresponding to the area selection command through the transmission module, so that the user performs a tableware accessing operation in the storage area.
Optionally, the dishwasher 61 is configured to collect an environmental image of each storage area in the cavity, and generate a schematic diagram of the dishwasher for storing dishes according to the environmental image, and includes:
the dishwasher 61 is used for acquiring contour curves of the environment images and identifying tableware information contained in the environment images based on the contour curves; the tableware information comprises tableware types and the number of the tableware types;
the dishwasher 61 is configured to establish a corresponding relationship between the tableware information and the storage areas, and generate the tableware storage diagram based on the corresponding relationship of each storage area.
Optionally, the dishwasher 61 is configured to obtain contour curves of the environment image, and identify tableware information included in the environment image based on each contour curve, and includes:
the dishwasher 61 is configured to obtain a contour region image corresponding to the contour curve, and determine a pixel characteristic value of the contour curve based on a pixel value of a pixel point included in the contour region image;
the dishwasher 61 is used for determining the tableware orientation of the tableware to be identified based on the contour curve and acquiring a template curve of each candidate tableware relative to the tableware orientation;
the dishwasher 61 is used for calculating the matching degree of the tableware orientation and each template curve;
and the dishwasher is used for determining the type of the tableware corresponding to the contour curve based on the matching degree and the pixel characteristic value.
Optionally, the smart appliance is further configured to:
the intelligent household appliance 62 is used for determining information of objects to be contained; the object information comprises an object type and an object number;
the intelligent household appliance 62 is used for determining the type of the tableware based on the object type and calculating the number of the tableware required to be used according to the number of the objects;
the intelligent household appliance 62 is configured to determine the storage area corresponding to the type of the tableware in the tableware storage schematic diagram, and detect whether the storage number included in the storage area is greater than or equal to the number of the tableware;
the intelligent appliance 62 is configured to generate the area selection instruction about the storage area if it is detected that the storage number is greater than the number of the tableware.
Optionally, the intelligent appliance 62 is configured to output the tableware storage map in a local display module, and receive a region selection instruction fed back by a user based on the tableware storage map, where the region selection instruction includes:
the intelligent household appliance 62 is configured to receive a touch instruction triggered by the user in the display module;
the smart appliance 62 is configured to determine a target area selected by the user based on the touch instruction, and generate the area selection instruction regarding the target area.
Therefore, the dish washing machine provided by the embodiment of the invention can output the storage schematic diagram of the tableware through other intelligent household appliances in the same intelligent household appliance system, a user can determine the storage area corresponding to each tableware type without opening the dish washing machine, the situation that the user can determine the area after pulling the tableware area by area is avoided, and the user can also determine the storage area of the tableware simultaneously when the intelligent household appliance performs other operations, the operation is convenient and fast, the access speed of the user is further improved, and the use experience of the user is improved
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present invention, and are intended to be included within the scope of the present invention.
Claims (10)
1. A tableware storing and taking method is applied to an intelligent household appliance system and is characterized in that the intelligent household appliance system comprises a dish washing machine and at least one intelligent household appliance;
the tableware access method comprises the following steps:
the dishwasher collects environmental images of all storage areas in a cavity and generates a tableware storage schematic diagram of the dishwasher according to the environmental images;
the intelligent household appliance outputs the tableware storage schematic diagram in a local display module, so that a user can know tableware information stored in each storage area through the display module when the intelligent household appliance operates, and an area selection instruction fed back by the user based on the tableware storage schematic diagram is received; the intelligent household appliance comprises: the intelligent household appliance comprises an intelligent refrigerator, an intelligent range hood, an intelligent stirrer and a household appliance which is in communication connection with the dish washing machine through a wireless communication module;
the dishwasher ejects a storage area corresponding to the area selection instruction through a transmission module so that the user can perform tableware storing and taking operation in the storage area.
2. The method of claim 1, wherein the dishwasher collects an environmental image of each storage area within the cavity and generates a schematic representation of the storage of the dishware in relation to the dishwasher based on the environmental image, comprising:
the dishwasher acquires contour curves of the environment image and identifies tableware information contained in the environment image based on each contour curve; the tableware information comprises tableware types and the number of the tableware types;
the dishwasher establishes a corresponding relationship between the tableware information and the storage areas, and generates the tableware storage schematic diagram based on the corresponding relationship of each storage area.
3. The method of claim 2, wherein the dishwasher acquires contour curves of the environmental image and identifies dishware information contained in the environmental image based on each contour curve, comprising:
the dishwasher acquires a contour region image corresponding to the contour curve, and determines a pixel characteristic value of the contour curve based on pixel values of pixel points contained in the contour region image;
the dishwasher determines the tableware orientation of the tableware to be identified based on the contour curve, and acquires template curves of various candidate tableware relative to the tableware orientation;
the dishwasher calculates the matching degree of the tableware orientation and each template curve;
and the dishwasher determines the type of the tableware corresponding to the profile curve based on the matching degree and the pixel characteristic value.
4. The method according to any one of claims 1-3, further comprising:
the intelligent household appliance determines information of objects to be contained; the object information comprises an object type and an object number;
the intelligent household appliance determines the type of tableware based on the object type, and calculates the number of the tableware required to be used according to the number of the objects;
the intelligent household appliance determines the storage area corresponding to the type of the tableware in the tableware storage schematic diagram and detects whether the storage number contained in the storage area is greater than or equal to the number of the tableware;
and if the intelligent household appliance detects that the storage number is greater than or equal to the tableware number, generating the area selection instruction related to the storage area.
5. The method according to any one of claims 1 to 3, wherein the intelligent household appliance outputs the tableware deposit diagram in a local display module and receives a region selection instruction fed back by a user based on the tableware deposit diagram, and the method comprises the following steps:
the intelligent household appliance receives a touch instruction triggered by the user in the display module;
the intelligent appliance determines a target area selected by the user based on the touch instruction and generates the area selection instruction regarding the target area.
6. The tableware storing and taking system is characterized by comprising a dishwasher and at least one intelligent household appliance;
the dishwasher is used for acquiring environmental images of all storage areas in the cavity and generating a tableware storage schematic diagram related to the dishwasher according to the environmental images;
the intelligent household appliance is used for outputting the tableware storage schematic diagram in a local display module, so that a user can know tableware information stored in each storage area through the display module when the intelligent household appliance is operated, and an area selection instruction fed back by the user based on the tableware storage schematic diagram is received; the intelligent household appliance comprises: the intelligent household appliance comprises an intelligent refrigerator, an intelligent range hood, an intelligent stirrer and a household appliance which is in communication connection with the dish washing machine through a wireless communication module;
the dishwasher is used for ejecting the storage area corresponding to the area selection instruction through the transmission module so that the user can carry out tableware storing and taking operation in the storage area.
7. The system for accessing dishes according to claim 6, wherein the dish washing machine is configured to collect an environmental image of each storage area in the cavity and generate a dish storage diagram for the dish washing machine according to the environmental image, and the system comprises:
the dishwasher is used for acquiring contour curves of the environment images and identifying tableware information contained in the environment images based on the contour curves; the tableware information comprises tableware types and the number of the tableware types;
the dishwasher is used for establishing the corresponding relation between the tableware information and the storage areas and generating the tableware storage schematic diagram based on the corresponding relation of the storage areas.
8. The system for accessing dishes according to claim 7, wherein the dish washer is configured to obtain contour curves of the environment image and identify the dish information contained in the environment image based on each contour curve, and the system comprises:
the dishwasher is used for acquiring a contour region image corresponding to the contour curve and determining a pixel characteristic value of the contour curve based on pixel values of pixel points contained in the contour region image;
the dishwasher is used for determining the tableware orientation of the tableware to be identified based on the contour curve and acquiring a template curve of each candidate tableware relative to the tableware orientation;
the dishwasher is used for calculating the matching degree of the tableware orientation and each template curve;
and the dishwasher is used for determining the type of the tableware corresponding to the contour curve based on the matching degree and the pixel characteristic value.
9. The system for accessing tableware according to any one of claims 6 to 8, wherein said smart appliance is further configured to:
the intelligent household appliance is used for determining the information of the objects to be contained; the object information comprises an object type and an object number;
the intelligent household appliance is used for determining the type of the tableware based on the object type and calculating the number of the tableware required to be used according to the number of the objects;
the intelligent household appliance is used for determining the storage area corresponding to the type of the tableware in the tableware storage schematic diagram and detecting whether the storage number contained in the storage area is greater than or equal to the number of the tableware;
the intelligent household appliance is used for generating the area selection instruction related to the storage area if detecting whether the storage number is larger than or equal to the number of the tableware.
10. The system for accessing tableware according to any one of claims 6 to 8, wherein said intelligent appliance for outputting said tableware deposit diagram in a local display module and receiving a region selection command fed back by a user based on said tableware deposit diagram comprises:
the intelligent household appliance is used for receiving a touch instruction triggered by the user in the display module;
the intelligent household appliance is used for determining the target area selected by the user based on the touch instruction and generating the area selection instruction related to the target area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910715757.1A CN110448250B (en) | 2019-08-05 | 2019-08-05 | Tableware storing and taking method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910715757.1A CN110448250B (en) | 2019-08-05 | 2019-08-05 | Tableware storing and taking method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110448250A CN110448250A (en) | 2019-11-15 |
| CN110448250B true CN110448250B (en) | 2021-03-23 |
Family
ID=68484734
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910715757.1A Active CN110448250B (en) | 2019-08-05 | 2019-08-05 | Tableware storing and taking method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110448250B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112053479A (en) * | 2019-11-26 | 2020-12-08 | 高艳云 | Multifunctional electric control platform and method based on target state data analysis |
| CN111311446A (en) * | 2020-04-21 | 2020-06-19 | 上海明略人工智能(集团)有限公司 | Tableware obtaining method and system and storage medium |
| CN112894908B (en) * | 2021-01-19 | 2022-09-20 | 佛山市顺德区美的洗涤电器制造有限公司 | Control method for dish washing machine, control system and processor |
| CN112890728A (en) * | 2021-01-19 | 2021-06-04 | 佛山市顺德区美的洗涤电器制造有限公司 | Light supplementing method and device for dish washing machine and dish washing machine |
| CN112991011B (en) * | 2021-03-12 | 2024-04-12 | 广东来个碗网络科技有限公司 | Tableware acquisition control method and device based on intelligent leasing cabinet |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE10048085A1 (en) * | 2000-09-28 | 2002-04-18 | Miele & Cie | Method for recognizing the loading of a program-controlled dishwasher with dishes and a dishwasher for carrying out the method |
| DE102004035847A1 (en) * | 2004-07-23 | 2006-03-23 | BSH Bosch und Siemens Hausgeräte GmbH | Method for detecting the load of items to be washed and dishwashing machine |
| CN105116734A (en) * | 2015-06-26 | 2015-12-02 | 青岛海信移动通信技术股份有限公司 | Control device and device for intelligent household electrical appliance and control terminal |
| CN107862313B (en) * | 2017-10-20 | 2020-06-16 | 珠海格力电器股份有限公司 | Dish washing machine and control method and device thereof |
| CN109998437B (en) * | 2019-03-28 | 2021-06-11 | 佛山市百斯特电器科技有限公司 | Method for determining cleaning mode and dish-washing machine |
-
2019
- 2019-08-05 CN CN201910715757.1A patent/CN110448250B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN110448250A (en) | 2019-11-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110448250B (en) | Tableware storing and taking method and system | |
| CN109998437B (en) | Method for determining cleaning mode and dish-washing machine | |
| CN109620078A (en) | Dish-washing machine intelligent control method, dish-washing machine and the device with store function | |
| CN107991939A (en) | Cooking control method and culinary art control device, storage medium and cooking equipment | |
| CN106292368B (en) | A kind of sink and its intelligent control method | |
| US20190284743A1 (en) | Washing machine and cloud server setting function based on object sensing using artificial intelligence, and method for setting function | |
| CN108107762A (en) | Cooking control method and culinary art control device, storage medium and cooking equipment | |
| CN110811460B (en) | Method and system for determining cleaning mode | |
| CN105404201B (en) | The intelligent control method of the intelligence control system of refrigerator | |
| CN114600167A (en) | Adjusting machine settings through multi-channel training of target detection models | |
| CN108833222A (en) | Appliances equipment control method, device, remote controler, terminal, server and medium | |
| CN108700306B (en) | System for making at least one food item and method for operating a related system | |
| US20220022724A1 (en) | System having a water-bearing domestic appliance and method for operating a water-bearing domestic appliance | |
| CN107682236A (en) | Smart home interactive system and method based on computer picture recognition | |
| CN112426060A (en) | Control method, cooking appliance, server and readable storage medium | |
| CN109316144B (en) | Washing equipment and washing control method and device | |
| CN112631282A (en) | Intelligent path planning method, device, system and medium for sweeping robot | |
| CN111158246A (en) | Intelligent household appliance control system, device, method, medium and equipment | |
| CN111241921B (en) | Message reminding method and device of Internet of things operating system | |
| KR20150005800A (en) | Remote controlled home appliances and mobile communication terminal and system for managing of home appliances therefor | |
| CN106464555A (en) | Water-carrying household appliance | |
| CN112089374A (en) | Control method for dish-washing machine and dish-washing machine control system | |
| CN109764371A (en) | The treating method and apparatus of running parameter, micro-wave oven | |
| CN113116271A (en) | Cleaning control method and device and cleaning machine | |
| US11957292B2 (en) | Dishwasher coverage alert system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A method and system for accessing tableware Effective date of registration: 20211217 Granted publication date: 20210323 Pledgee: Beijiao sub branch of Guangdong Shunde Rural Commercial Bank Co., Ltd Pledgor: FOSHAN BEST ELECTRICAL APPLIANCE TECHNOLOGY Co.,Ltd. Registration number: Y2021980015490 |