CN114968016A - Tableware placement guiding method and device, storage medium and mobile terminal - Google Patents
Tableware placement guiding method and device, storage medium and mobile terminal Download PDFInfo
- Publication number
- CN114968016A CN114968016A CN202210604156.5A CN202210604156A CN114968016A CN 114968016 A CN114968016 A CN 114968016A CN 202210604156 A CN202210604156 A CN 202210604156A CN 114968016 A CN114968016 A CN 114968016A
- Authority
- CN
- China
- Prior art keywords
- tableware
- dish washing
- size information
- image
- dishes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 238000004851 dishwashing Methods 0.000 claims abstract description 55
- 238000010586 diagram Methods 0.000 claims abstract description 43
- 238000005259 measurement Methods 0.000 claims description 7
- 230000001174 ascending effect Effects 0.000 claims description 4
- 238000004590 computer program Methods 0.000 claims description 4
- 239000011521 glass Substances 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 4
- 238000005406 washing Methods 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 8
- 238000004891 communication Methods 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000003993 interaction Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47L—DOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
- A47L15/00—Washing or rinsing machines for crockery or tableware
- A47L15/42—Details
- A47L15/50—Racks ; Baskets
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Geometry (AREA)
- Human Computer Interaction (AREA)
- Cash Registers Or Receiving Machines (AREA)
Abstract
The embodiment of the application discloses a tableware placement guiding method and device, a storage medium and a mobile terminal, and relates to the field of smart home. The method of the present application comprises: determining size information of each of a plurality of dishes to be washed; determining the size information of the dish washing rack; displaying a tableware placing guide interface through a display unit; the tableware placing and guiding interface comprises tableware icons of all tableware and dish washing rack schematic diagrams of dish washing racks; generating position information of each tableware in the dish washing rack according to a preset space planning rule; according to positional information, place each tableware icon and obtain the overall layout picture in the frame schematic diagram that washes the dishes, realize putting the tableware and effectively guide, improve the efficiency that the tableware was put and promote the effect of washing the dishes of dish washer.
Description
Technical Field
The application relates to the field of smart homes, in particular to a tableware placement guiding method and device, a storage medium and a mobile terminal.
Background
Along with the promotion of living standard, more and more families purchase the dish washer, and the user only needs to put tableware in the dish washing frame that carries out the dish washer, then clicks the automatic operation that washes the dishes that accomplishes of start button, greatly saves the user time of washing the dishes. Because the sizes of the tableware to be washed are different, the situation that the tableware cannot be placed in the process of placing the tableware on the dish washing rack by a user can exist, so that the user needs to spend a large amount of time on adjusting the position of the tableware, or the position of the tableware is not placed in a standard manner, so that the dish washing machine cannot be washed cleanly, and the dish washing effect is poor.
Disclosure of Invention
The embodiment of the application provides a tableware placing guide method, a tableware placing guide device, a storage medium and a mobile terminal, and can solve the problems of low placing efficiency and irregularity of tableware in a dish washing rack. The technical scheme is as follows:
determining size information of each of a plurality of dishes to be washed;
determining the size information of the dish washing rack;
displaying a tableware placing guide interface through a display unit; the tableware placing and guiding interface comprises tableware icons of all tableware and dish washing rack schematic diagrams of the dish washing racks;
generating position information of each tableware in the dish washing rack according to a preset space planning rule;
and according to the position information, placing each tableware icon in the dish washing rack schematic diagram to obtain an overall layout diagram.
In a second aspect, the present application provides a tableware placement guiding device, which includes:
a determining unit for determining size information of each of a plurality of dishes to be washed;
the determining unit is also used for determining the size information of the dish washing rack;
the guide unit is used for displaying a tableware placing guide interface through the display unit; the tableware placing and guiding interface comprises tableware icons of all tableware and dish washing rack schematic diagrams of the dish washing racks;
the planning unit is used for generating position information of each tableware in the dish washing rack according to a preset space planning rule;
and the layout unit is used for placing each tableware icon in the dish washing rack schematic diagram according to the position information to obtain an overall layout diagram.
In a third aspect, embodiments of the present application provide a computer storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the above-mentioned method steps.
In a fourth aspect, an embodiment of the present application provides a mobile terminal, which may include: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the above-mentioned method steps.
The beneficial effects brought by the technical scheme provided by some embodiments of the application at least comprise:
generating a tableware placing and guiding interface through a plurality of tableware to be cleaned and dish washing racks, then performing simulated placing according to the dimension information of the tableware and the dimension information of the dish washing racks to obtain the position information of the tableware, and finally displaying an overall layout drawing representing the tableware layout mode on the tableware placing and guiding interface, wherein a user can place the tableware according to the tableware layout mode shown in the overall layout drawing; effectual solution user puts or puts the problem of irregularity to the repetition that dish washer space planning is unclear, tableware size misjudgement leads to, puts to the tableware and effectively guides, improves the efficiency that the tableware was put and promotes dish washing effect of dish washer.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a schematic flow chart of a tableware placement guiding method according to an embodiment of the present disclosure;
FIG. 2 is a schematic diagram of a photographing interface provided in an embodiment of the present application;
FIG. 3 is a schematic diagram of an upload interface provided by an embodiment of the present application;
FIG. 4 is a schematic diagram of a configuration interface provided by an embodiment of the present application;
FIG. 5 is a schematic view of a measurement interface provided by an embodiment of the present application;
FIG. 6 is a schematic diagram of a preview interface provided by an embodiment of the present application;
FIG. 7 is a schematic diagram of a backup interface provided by an embodiment of the application;
FIG. 8 is a schematic diagram of a recommendation interface provided by an embodiment of the present application;
FIG. 9 is a schematic view of a cutlery placement guidance interface provided in embodiments of the present application;
FIG. 10 is a schematic diagram of a layout interface provided by an embodiment of the present application;
FIG. 11 is a schematic structural view of a guiding device for placing tableware according to the present application;
fig. 12 is a schematic structural diagram of a mobile terminal provided in the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
It should be noted that the tableware placement guiding method provided by the present application is generally executed by a mobile terminal, and accordingly, the tableware placement guiding device is generally disposed in the mobile terminal.
Various communication client applications can be installed on the mobile terminal of the present application, for example: video recording application, video playing application, voice interaction application, search application, instant messaging tool, mailbox client, social platform software, etc.
The mobile terminal may be hardware or software. When the mobile terminal is hardware, it may be various mobile terminals having a display screen, including but not limited to a smart phone, a tablet computer, a laptop portable computer, a desktop computer, and the like. When the mobile terminal is software, the software may be installed in the mobile terminal listed above. Which may be implemented as multiple software or software modules (e.g., to provide distributed services) or as a single software or software module, and is not particularly limited herein.
When the mobile terminal is hardware, the mobile terminal can be also provided with a display unit and a camera, the display of the display unit can be various devices capable of realizing the display function, and the camera is used for collecting video streams; for example: the display unit may be a cathode ray tube (CR) display, a light-emitting diode (LED) display, an electronic ink screen, a Liquid Crystal Display (LCD), a Plasma Display Panel (PDP), or the like. The user can utilize the display unit on the mobile terminal to view information such as displayed characters, pictures, videos and the like.
The following describes in detail a method for guiding placement of dishes according to an embodiment of the present application with reference to fig. 1. The tableware placement guiding device in the embodiment of the present application may be a mobile terminal shown in fig. 1.
Referring to fig. 1, a flow chart of a method for guiding placement of tableware is provided in an embodiment of the present application. As shown in fig. 1, the method of the embodiment of the present application may include the steps of:
s101, determining the size information of each tableware in a plurality of tableware to be cleaned.
Wherein, the types of the plurality of tableware to be cleaned can be the same or different, and the tableware types comprise bowls, plates, cups and the like. In the embodiment, the tableware is regarded as a cuboid, and the size information of the tableware represents the length, height and width of the tableware. The mobile terminal stores the size information of all tableware owned by a user in advance, and can determine the size information of each tableware to be cleaned in an image acquisition or interface interaction mode.
In one possible embodiment, the mobile terminal collects an image of tableware, which belongs to one of all tableware owned by a user, through the camera, the mobile terminal stores template images of all tableware of the user and size information associated with each template image, similarity between the collected image and all template images is calculated respectively, the template image with the highest similarity is determined, and the size information associated with the template image is used as the size information of the tableware.
For example, referring to the schematic diagram of the photographing interface shown in fig. 2, the photographing interface is provided with a photographing button and an adding button, and the mobile terminal acquires images of tableware through the camera. Mobile terminal is at the collection image in-process, the tableware is placed on the horizontal plane, mobile terminal guarantees through attitude sensor that the lens glass of its camera is perpendicular to the horizontal plane all the time, mobile terminal prestore has acquiescence vertical distance, measure the vertical distance between the tableware and show the numerical value of vertical distance in real time on the interface of shooing through built-in distance sensor, when measured vertical distance equals acquiescence vertical distance, mobile terminal shows the prompt information of shooing on the interface of shooing, for example: the numerical value of the vertical distance is displayed in red, the user clicks a photographing button to trigger the collection of the image of the tableware, and the image is displayed in a preview area of a photographing interface. According to the method and the device, the images acquired each time are guaranteed to have the same scale through distance prompt, and the accuracy of the subsequent calculation process is improved.
Referring to a schematic diagram of an uploading interface shown in fig. 3, the uploading interface is provided with an uploading button, after the mobile terminal finishes the collection of images of a plurality of tableware to be cleaned, thumbnails of all the tableware are displayed in a preview area, a user triggers all the tableware images to be uploaded to a size information calculation service through the uploading button, then the mobile terminal runs the size information calculation service, a pixel area where the tableware is located in the image is detected, the similarity between the pixel area and each template image is calculated according to a cosine similarity calculation method, the template image with the maximum similarity is determined, and the size information associated with the target image is used as the size information of the tableware.
In another possible embodiment, the mobile terminal displays a tableware set through the display unit, the tableware set comprises a plurality of tableware icons, each tableware icon corresponds to a tableware with the same size information, the tableware corresponding to the tableware set is all tableware owned by the user, the user selects the plurality of tableware icons in the tableware set through a selection instruction, the mobile terminal takes the tableware corresponding to the selected tableware icon as the plurality of tableware to be washed, and the mobile terminal determines the size information of the plurality of tableware to be washed according to the pre-stored size information.
In one or more possible embodiments, S101 further includes, before:
acquiring a first image of a reference object through a camera, and displaying the image of the reference object on a configuration interface through a display unit;
measuring the first image through a ruler on the configuration interface to obtain the size information of the reference object;
acquiring a second image of the reference object and the tableware to be measured by a camera;
calculating the size information of the tableware to be measured and storing the size information of the tableware to be measured according to the pixel ratio of the reference object and the tableware to be measured in the second image and the size information of the reference object;
and after the measurement of all the tableware of the user is completed, counting the total quantity of the tableware.
For example, the configuration interface shown in fig. 4 is provided with a reference object setting button, a user clicks the reference object setting button and then invokes a camera to capture a first image of a reference object, the reference object is generally tableware, and may be any one of tableware owned by the user, the mobile terminal displays the captured first image in the measurement interface shown in fig. 5, the configuration interface is provided with a scale, the user measures the length, height and width of a reference object region in the first image by moving the scale, then the measured length, height and width are input in a numerical frame of the configuration interface, and the mobile terminal obtains size information of the reference object according to a numerical value input by the user. Then, the mobile terminal measures the size information of all tableware of the user, and the measuring method comprises the following steps: the tableware to be measured and the reference object are placed on the same horizontal plane, the mobile terminal collects a second image of the reference object and the tableware to be measured through the camera, the mobile terminal guarantees that lens glass of the camera is always perpendicular to and parallel to the horizontal plane through the attitude sensor, the mobile terminal prestores default vertical distance, the vertical distance between the tableware is measured through the built-in distance sensor, the numerical value of the vertical distance is displayed on a photographing interface in real time, when the measured vertical distance is equal to the default vertical distance, the mobile terminal displays photographing prompt information on the photographing interface, the photographing prompt information is a red origin point shown in figure 7, a user clicks a photographing button to collect a second image, and then the second image is displayed on a preview interface shown in figure 6. Further, in order to improve the accuracy of the measurement of the size information, the mobile terminal may take a plurality of second images of different angles, for example: as shown in fig. 7, the backup interface, 3 second images of the reference object and the dishware to be measured photographed by the mobile terminal, for example: the method comprises a top view, a side view and a top view with an angle of 45 degrees, wherein a backup button is arranged on a backup interface, after a user clicks the backup button, the mobile terminal determines the length pixel proportion, the width similar proportion and the height similar proportion of a reference object and tableware in a second image, the pixel proportion and the size information of the reference object are multiplied according to the measured size information to obtain the length, the width and the height of the tableware to be measured, and the size information of all the tableware of the user can be measured in advance according to the measuring method. After the measurement is completed, the mobile terminal displays that the number of all dishes of the user is 13 on the backup interface.
Furthermore, after the mobile terminal obtains the size information of all the tableware of the user, the tableware use scheme is recommended based on the number of family people input by the user, and the user can directly select the existing tableware use scheme when selecting a plurality of tableware to be cleaned, so that the operation efficiency of the user is improved.
For example, referring to the recommendation interface shown in fig. 8, the recommendation interface includes tableware icons of all tableware of the user, each tableware icon is provided with a quantity, and after the user inputs the number of family members in the numerical value input box, the mobile terminal generates the corresponding quantity of each tableware in the lower area.
S102, determining the size information of the dish washing rack.
The dish washing rack is a device for placing tableware in the dish washing machine, and the method for determining the size information of the dish washing rack by the mobile terminal comprises the following steps: after consulting the specification of the dish washer, the user inputs the length, the height and the height of the dish washing rack through a user interface of the mobile terminal, and the mobile terminal obtains the size information of the dish washing rack according to the numerical value input by the user; or the mobile terminal prestores the mapping relation between the models of the dish washers and the size information of the dish washing racks, a user obtains the models of the dish washers through user input, and then inquires the size information corresponding to the models according to the mapping relation, so that the size information of the dish washing racks is obtained.
And S103, displaying a tableware placing guide interface through a display unit.
Wherein, the tableware is put and is guided the tableware icon that the interface includes each tableware and the dish rack schematic diagram of dish rack, and the size of tableware icon and the size of tableware are the direct proportional relation, and the size of dish rack schematic diagram and the size of dish rack are positive correlation, and tableware icon and dish rack schematic diagram have the same scale, can demonstrate the relative size relation between tableware and the dish rack directly perceived like this. Further, tableware icon and dish rack sketch map can be the 3D image, and the 3D image can be more audio-visual show tableware icon in the position of dish rack sketch map, be convenient for better guide user put.
For example, referring to the tableware placement guidance interface shown in fig. 9, the interface is provided with a bowl placement start button and an overall layout diagram button, two tableware icons, the number of tableware corresponding to the tableware icons, and a dish rack schematic diagram.
And S104, generating the position information of each tableware in the dish washing rack according to a preset space planning rule.
Wherein, mobile terminal has preconfigured the space planning rule for plan the position of tableware in the frame that washes the dishes, make frame space utilization that washes the dishes reach the maximize, mobile terminal regards as a cuboid with tableware and the frame that washes the dishes according to size information, then place the tableware in the frame that washes the dishes in proper order, place and finish until all tableware, obtain the positional information of each tableware in the frame that washes the dishes after placing, positional information and the positional information of tableware icon in the frame schematic diagram that washes the dishes have the corresponding relation.
In one or more possible embodiments, the generating the position information of the respective dishes in the dish rack according to the preset rule comprises:
calculating the volume of each tableware according to the size information; the volume of the tableware is calculated by multiplying the length, the height and the width to obtain the volume;
arranging a plurality of tableware to be cleaned in an ascending order according to the volume;
for the sorted tableware, selecting a tableware to be placed from the beginning; furthermore, the tableware can be arranged in an ascending order according to the volume, and then one tableware is selected from the tail to the head when the tableware to be placed is selected.
Traversing the free space meeting the space requirement of the tableware to be placed in the dish washing rack; wherein the number of the free spaces is one or more;
placing the tableware to be placed in an idle space with the minimum volume until all the tableware are placed; the maximization of the space utilization of the dish rack is realized by preferentially placing small-sized tableware;
coordinates of all tableware in the dish washing rack are obtained to obtain position information of all tableware.
And S105, placing the tableware icons in the dish washing rack schematic diagram according to the position information to obtain an overall layout diagram.
And placing the tableware icons in the dish-washing rack schematic diagram to generate an overall layout diagram according to the position information of each tableware in the dish-washing rack calculated in the step S104.
For example, referring to the tableware placement guidance interface described in fig. 9, after the user clicks the start placing button, the mobile terminal places the tableware icons of 2 large dishes and 2 large bowls in the dish rack schematic diagram according to the position information, and the tableware icons placed in the dish rack schematic diagram are highlighted, for example: the cutlery icon is displayed in red. Further, referring to the layout interface shown in fig. 10, after the user clicks the overall layout button in fig. 9, the mobile terminal displays the overall layout with the tableware icons in the layout interface in a full screen manner, so that the user can put the tableware into the dish rack of the dishwasher with reference to the overall layout.
According to the embodiment of the application, before tableware is placed, a tableware placing guide interface is generated through a plurality of tableware to be cleaned and dish racks, then simulated placing is carried out according to the size information of the tableware and the size information of the dish racks to obtain the position information of the tableware, finally, an overall layout diagram representing the tableware layout mode is displayed on the tableware placing guide interface, and a user can place the tableware according to the tableware layout mode shown in the overall layout diagram; effectual solution user puts or puts the problem of irregularity to the repetition that dish washer space planning is unclear, tableware size misjudgement leads to, puts to the tableware and effectively guides, improves the efficiency that the tableware was put and promotes dish washing effect of dish washer.
The following are embodiments of the apparatus of the present application that may be used to perform embodiments of the method of the present application. For details which are not disclosed in the embodiments of the apparatus of the present application, reference is made to the embodiments of the method of the present application.
Referring to fig. 11, a schematic structural diagram of a guiding apparatus for placing tableware according to an exemplary embodiment of the present application is shown, which is hereinafter referred to as the apparatus 11. The apparatus 11 may be implemented as all or part of a mobile terminal through software, hardware, or a combination of both. The apparatus 11 comprises: a determination unit 1101, a guidance unit 1102, a planning unit 1103, and a layout unit 1104.
A determining unit 1101 for determining size information of each of a plurality of dishes to be washed;
the determining unit 1101 is further configured to determine size information of the dish washing rack;
the guide unit 1102 is used for displaying a tableware placing guide interface through the display unit; the tableware placing and guiding interface comprises a tableware icon of each tableware and a dish washing rack schematic diagram of the dish washing rack;
a planning unit 1103, configured to generate position information of each tableware in the dish rack according to a preset space planning rule;
and the layout unit 1104 is used for placing each tableware icon in the dish rack schematic diagram according to the position information to obtain an overall layout diagram.
In one or more possible embodiments, the determining the size information of each of the plurality of dishes to be washed includes:
collecting images including tableware through a camera;
calculating the similarity between the acquired image and a plurality of pre-stored template images;
determining a template image with the maximum similarity;
and using the size information related to the determined template image as the size information of the tableware.
In one or more possible embodiments, the lens glass is controlled to be parallel to the horizontal plane by the attitude sensor and the vertical distance between the dishes is controlled to be maintained as a default vertical distance by the distance sensor during the process of capturing the images.
In one or more possible embodiments, the determining the size information of each of the plurality of dishes to be washed includes:
displaying the tableware set through the display unit; wherein the tableware set comprises a plurality of tableware icons, each tableware icon corresponding to a tableware;
selecting a plurality of tableware icons in the tableware collection based on a selection instruction of a user;
and inquiring size information associated with the selected plurality of tableware icons.
In one or more possible embodiments, the method further comprises:
the measuring unit is used for acquiring a first image of the reference object through the camera and displaying the image of the reference object on the configuration interface through the display unit;
measuring the first image through a ruler on the configuration interface to obtain the size information of the reference object;
acquiring a second image of the reference object and the tableware to be measured by a camera;
calculating the size information of the tableware to be measured and storing the size information of the tableware to be measured according to the pixel ratio of the reference object and the tableware to be measured in the second image and the size information of the reference object;
and after the measurement of all the tableware of the user is completed, counting the total quantity of the tableware.
In one or more possible embodiments, the first captured image is captured at a plurality of different capture angles.
In one or more possible embodiments, the generating the position information of the dishes in the dish washing rack according to the preset space planning rule comprises:
calculating the volume of each tableware according to the size information;
arranging a plurality of tableware to be cleaned in an ascending order according to the volume;
for the sorted tableware, selecting a tableware to be placed from the beginning;
traversing the free space meeting the space requirement of the tableware to be placed in the dish washing rack; wherein the number of the free spaces is one or more;
placing the tableware to be placed in an idle space with the minimum volume until all the tableware are placed;
and acquiring the coordinates of each tableware in the dish washing rack to obtain the position information of each tableware.
It should be noted that, when the device 11 provided in the above embodiment executes the method for guiding placement of tableware, the division of the above functional modules is merely used as an example, and in practical applications, the above functions may be distributed to different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above functions. In addition, the guiding device for placing tableware provided by the above embodiment and the embodiment of the method for placing tableware are of the same concept, and details of the implementation process are found in the embodiment of the method, which is not described herein again.
The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.
An embodiment of the present application further provides a computer storage medium, where the computer storage medium may store a plurality of instructions, where the instructions are suitable for being loaded by a processor and executing the method steps in the embodiment shown in fig. 2, and a specific execution process may refer to a specific description of the embodiment shown in fig. 2, which is not described herein again.
The present application further provides a computer program product storing at least one instruction, which is loaded and executed by the processor to implement the method for guiding the placement of dishes according to the above embodiments.
Please refer to fig. 12, which provides a schematic structural diagram of a mobile terminal according to an embodiment of the present application. As shown in fig. 5, the mobile terminal 1200 may include: at least one processor 1201, at least one network interface 1204, a user interface 1203, memory 1205, at least one communication bus 1202.
Wherein a communication bus 1202 is used to enable connective communication between these components.
The user interface 1203 may include a Display screen (Display) and a Camera (Camera), and the optional user interface 1203 may also include a standard wired interface and a wireless interface.
The network interface 1204 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface), among others.
The Memory 1205 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). Optionally, the memory 1205 includes a non-transitory computer-readable medium (non-transitory computer-readable storage medium). The memory 1205 may be used to store an instruction, a program, code, a set of codes, or a set of instructions. The memory 1205 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the various method embodiments described above, and the like; the storage data area may store data and the like referred to in the above respective method embodiments. The memory 1205 may also optionally be at least one storage device located remotely from the processor 1201 described previously. As shown in fig. 5, the memory 1205, which is a computer storage medium, may include an operating system, a network communication module, a user interface module, and an application program.
In the mobile terminal 1200 shown in fig. 5, the user interface 1203 is mainly used for providing an input interface for a user, and acquiring data input by the user; the processor 1201 may be configured to call an application program stored in the memory 1205 and specifically execute the method shown in fig. 1, and the specific process may refer to fig. 1 and is not described herein again.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory or a random access memory.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present application and should not be taken as limiting the scope of the present application, so that the present application will be covered by the appended claims.
Claims (10)
1. A tableware placing guide method is characterized by comprising the following steps:
determining size information of each of a plurality of dishes to be washed;
determining the size information of the dish washing rack;
displaying a tableware placing guide interface through a display unit; the tableware placing and guiding interface comprises tableware icons of all tableware and dish washing rack schematic diagrams of the dish washing racks;
generating position information of each tableware in the dish washing rack according to a preset space planning rule;
and according to the position information, placing each tableware icon in the dish washing rack schematic diagram to obtain an overall layout diagram.
2. The method of claim 1, wherein determining dimensional information for each of a plurality of dishes to be washed comprises:
collecting images including tableware through a camera;
calculating the similarity between the acquired image and a plurality of pre-stored template images;
determining a template image with the maximum similarity;
and using the size information related to the determined template image as the size information of the tableware.
3. The method of claim 2, wherein the lens glass is controlled to be parallel to the horizontal plane by the attitude sensor and the vertical distance between the dishes is controlled to be maintained as a default vertical distance by the distance sensor during the capturing of the image.
4. The method of claim 1, wherein determining dimensional information for each of a plurality of dishes to be washed comprises:
displaying the tableware set through the display unit; wherein the tableware set comprises a plurality of tableware icons, each tableware icon corresponding to a tableware;
selecting a plurality of tableware icons in the tableware set based on a selection instruction of a user;
and inquiring size information associated with the selected plurality of tableware icons.
5. The method of claim 1, 2, 3, or 4, wherein prior to determining the dimensional information for each of the plurality of dishes to be washed, further comprising:
acquiring a first image of a reference object through a camera, and displaying the image of the reference object on a configuration interface through a display unit;
measuring the first image through a ruler on the configuration interface to obtain the size information of the reference object;
acquiring a second image of the reference object and the tableware to be measured by a camera;
calculating the size information of the tableware to be measured and storing the size information of the tableware to be measured according to the pixel ratio of the reference object and the tableware to be measured in the second image and the size information of the reference object;
and after the measurement of all the tableware of the user is completed, counting the total quantity of the tableware.
6. The method of claim 5, wherein the first captured image is captured at a plurality of different capture angles.
7. The method according to claim 6, wherein the generating of the position information of the dishes in the dish rack according to the preset space planning rule comprises:
calculating the volume of each tableware according to the size information;
arranging a plurality of tableware to be cleaned in an ascending order according to the volume;
for the plurality of sorted tableware, selecting one tableware to be placed from the beginning;
traversing the free space meeting the space requirement of the tableware to be placed in the dish washing rack; wherein the number of the free spaces is one or more;
placing the tableware to be placed in an idle space with the minimum volume until all the tableware are placed;
and acquiring the coordinates of each tableware in the dish washing rack to obtain the position information of each tableware.
8. The utility model provides a guiding device that tableware was put which characterized in that includes:
a determining unit for determining size information of each of a plurality of dishes to be washed;
the determining unit is also used for determining the size information of the dish washing rack;
the guide unit is used for displaying a tableware placing guide interface through the display unit; the tableware placing and guiding interface comprises tableware icons of all tableware and dish washing rack schematic diagrams of the dish washing racks;
the planning unit is used for generating position information of each tableware in the dish washing rack according to a preset space planning rule;
and the layout unit is used for placing each tableware icon in the dish washing rack schematic diagram according to the position information to obtain an overall layout diagram.
9. A computer storage medium, characterized in that it stores a plurality of instructions adapted to be loaded by a processor and to carry out the method steps according to any one of claims 1 to 7.
10. A mobile terminal, comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the method steps of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210604156.5A CN114968016A (en) | 2022-05-30 | 2022-05-30 | Tableware placement guiding method and device, storage medium and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210604156.5A CN114968016A (en) | 2022-05-30 | 2022-05-30 | Tableware placement guiding method and device, storage medium and mobile terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114968016A true CN114968016A (en) | 2022-08-30 |
Family
ID=82958076
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210604156.5A Pending CN114968016A (en) | 2022-05-30 | 2022-05-30 | Tableware placement guiding method and device, storage medium and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114968016A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115497087A (en) * | 2022-11-18 | 2022-12-20 | 广州煌牌自动设备有限公司 | Tableware posture recognition system and method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105043271A (en) * | 2015-08-06 | 2015-11-11 | 宁波市北仑海伯精密机械制造有限公司 | Method and device for length measurement |
| CN109998437A (en) * | 2019-03-28 | 2019-07-12 | 佛山市百斯特电器科技有限公司 | A kind of the determination method and dish-washing machine of cleaning model |
| CN109998438A (en) * | 2019-04-15 | 2019-07-12 | 佛山市顺德区美的洗涤电器制造有限公司 | The instruction device and method of dish-washing machine, dish-washing machine |
| CN110840349A (en) * | 2019-10-30 | 2020-02-28 | 佛山市百斯特电器科技有限公司 | Method and system for generating placement schematic diagram |
| CN114158998A (en) * | 2020-09-10 | 2022-03-11 | 青岛海尔智能技术研发有限公司 | Method and device for determining placement position of tableware, server and terminal equipment |
| KR20220043610A (en) * | 2020-09-29 | 2022-04-05 | 엘지전자 주식회사 | Dishwasher and method for recognizing dishes thereof |
-
2022
- 2022-05-30 CN CN202210604156.5A patent/CN114968016A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105043271A (en) * | 2015-08-06 | 2015-11-11 | 宁波市北仑海伯精密机械制造有限公司 | Method and device for length measurement |
| CN109998437A (en) * | 2019-03-28 | 2019-07-12 | 佛山市百斯特电器科技有限公司 | A kind of the determination method and dish-washing machine of cleaning model |
| CN109998438A (en) * | 2019-04-15 | 2019-07-12 | 佛山市顺德区美的洗涤电器制造有限公司 | The instruction device and method of dish-washing machine, dish-washing machine |
| CN110840349A (en) * | 2019-10-30 | 2020-02-28 | 佛山市百斯特电器科技有限公司 | Method and system for generating placement schematic diagram |
| CN114158998A (en) * | 2020-09-10 | 2022-03-11 | 青岛海尔智能技术研发有限公司 | Method and device for determining placement position of tableware, server and terminal equipment |
| KR20220043610A (en) * | 2020-09-29 | 2022-04-05 | 엘지전자 주식회사 | Dishwasher and method for recognizing dishes thereof |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115497087A (en) * | 2022-11-18 | 2022-12-20 | 广州煌牌自动设备有限公司 | Tableware posture recognition system and method |
| CN115497087B (en) * | 2022-11-18 | 2024-04-19 | 广州煌牌自动设备有限公司 | Tableware gesture recognition system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10726571B2 (en) | Augmented reality digital content search and sizing techniques | |
| US9443353B2 (en) | Methods and systems for capturing and moving 3D models and true-scale metadata of real world objects | |
| TWI628614B (en) | Method for browsing house interactively in 3d virtual reality and system for the same | |
| WO2021031731A1 (en) | Remote assistance method, apparatus and system | |
| CN110619807B (en) | Method and device for generating global thermodynamic diagram | |
| CN113282981B (en) | Method and device for rapidly acquiring house type structure | |
| CN109582122A (en) | Augmented reality information providing method, device and electronic equipment | |
| US20240078703A1 (en) | Personalized scene image processing method, apparatus and storage medium | |
| CN112989776A (en) | Method and device for adjusting table columns, storage medium and terminal equipment | |
| CN108846899B (en) | Method and system for improving area perception of user for each function in house source | |
| CN114968016A (en) | Tableware placement guiding method and device, storage medium and mobile terminal | |
| CN107590469A (en) | A kind of method for detecting human face and mobile terminal | |
| CN110858814A (en) | Control method and device for intelligent household equipment | |
| CN211979611U (en) | Integrated 3D projection touch self-service ordering device | |
| CN110865911B (en) | Image testing method, device, storage medium, image acquisition card and upper computer | |
| CN116994122A (en) | Building pickup method, device, equipment and storage medium | |
| CN113283493A (en) | Sample acquisition method, device, terminal and storage medium | |
| CN111784797A (en) | Robot networking interaction method, device and medium based on AR | |
| CN112486993A (en) | Air quality visual display method and air quality visual display system | |
| CN110377192A (en) | A kind of method, apparatus that realizing interaction effect, medium and electronic equipment | |
| CN109472873A (en) | Generation method, device, the hardware device of threedimensional model | |
| CN115040033B (en) | Robot cleaning record display method, device, equipment and medium | |
| EP4432153A1 (en) | Method and system for space design | |
| CN112565864B (en) | Graphic code presentation method and device, computer equipment and storage medium | |
| WO2023179398A1 (en) | Map display method, apparatus, storage medium and electronic apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |