CN112001770A - Food APP management system and management method - Google Patents

Food APP management system and management method Download PDF

Info

Publication number
CN112001770A
CN112001770A CN202010757551.8A CN202010757551A CN112001770A CN 112001770 A CN112001770 A CN 112001770A CN 202010757551 A CN202010757551 A CN 202010757551A CN 112001770 A CN112001770 A CN 112001770A
Authority
CN
China
Prior art keywords
food
server
equipment
app
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010757551.8A
Other languages
Chinese (zh)
Other versions
CN112001770B (en
Inventor
张元本
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Weilin Software Co ltd
Original Assignee
Guangzhou Weilin Software Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Weilin Software Co ltd filed Critical Guangzhou Weilin Software Co ltd
Priority to CN202010757551.8A priority Critical patent/CN112001770B/en
Publication of CN112001770A publication Critical patent/CN112001770A/en
Application granted granted Critical
Publication of CN112001770B publication Critical patent/CN112001770B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0633Lists, e.g. purchase orders, compilation or processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9535Search customisation based on user profiles and personalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/955Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
    • G06F16/9554Retrieval from the web using information identifiers, e.g. uniform resource locators [URL] by using bar codes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0639Item locations

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Accounting & Taxation (AREA)
  • General Engineering & Computer Science (AREA)
  • Finance (AREA)
  • Data Mining & Analysis (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention discloses a food APP management system and a management method, which are used for managing food data information provided by a cabinet-based server and comprise an equipment binding module, a partition classification management module, a food management module, a shop commodity module, a menu recipe module and a data processing module; the food APP management system and the management method are high in intelligence degree and capable of carrying out back-end support.

Description

Food APP management system and management method
Technical Field
The invention particularly relates to a food APP management system and a management method.
Background
The smart home (home automation) is characterized in that a home is used as a platform, facilities related to home life are integrated by utilizing a comprehensive wiring technology, a network communication technology, a safety precaution technology, an automatic control technology and an audio and video technology, an efficient management system of home facilities and home schedule affairs is constructed, home safety, convenience, comfort and artistry are improved, and an environment-friendly and energy-saving living environment is realized.
In recent years, with the popularization of smart homes, more and more household devices are changed intelligently, and a refrigerator, a food cabinet or a storage cabinet for storing food in the existing smart home only has partial functions at the front end, lacks the support of the intellectualization at the rear end, and has the problems of insufficient intellectualization and less functions.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to provide a food APP management system and a food APP management method which have higher intelligent degree and can carry out back-end support.
The technical scheme adopted by the invention for solving the technical problems is as follows:
a food APP management system manages food data information provided by a service end of a cabinet, and comprises an equipment binding module, a partition classification management module, a food management module, a store commodity module, a menu recipe module and a data processing module; wherein:
the device binding module is used for binding devices by a user to bind the APP with the corresponding cabinet;
the partition classification management module is used for partitioning and classifying the cabinets under different devices by a user;
the food management module is used for managing food in the lower cabinets of different equipment by a user;
the shop commodity module is used for a user to purchase food;
and the data processing module is used for assisting the server side to perform identification analysis.
Preferably, the system also comprises a menu recipe module used for the user to share the recipe and learn the recipe;
furthermore, the cabinet is one of a refrigerator, a freezer, a food cabinet and a storage cabinet.
Another technical problem to be solved by the present invention is to provide a food APP management method, which applies the food APP management system described above, and includes the following steps:
1) binding an APP in intelligent equipment carried by a user with a cabinet, and acquiring an equipment number and a partition number/classification number corresponding to the cabinet from a server;
2) adding, deleting and modifying the information content of the partitions and the classifications according to the equipment number and the partition number/classification number, and sending the information to a server for storage after the operation is finished;
3) accessing a server, acquiring all food information under the equipment according to the equipment number and maintaining the food information;
4) the intelligent equipment is used for positioning, the position information is sent to the server side, the information of nearby shops is screened out through the server side, and shops and food are selected according to the shop information.
Preferably, in step 1), the method for binding the APP to the cabinet includes the following steps:
a01: judging whether the login account in the app has equipment for selecting and displaying the content, judging whether the equipment number stored in SharePreferences exists after the app is logged in, if so, selecting to execute other processes, and if not, performing A02;
a02: judging whether the secondary account has bound equipment or not, inquiring whether the content number of the list of the equipment bound by the secondary account is 0 or not by the access server, if not, executing A03, and if so, executing 04 and 05;
a03: selecting equipment to be displayed, entering a binding equipment list page, acquiring all bound equipment corresponding to the account returned by the server, clicking the equipment to be selected, storing the equipment into SharePreferences, and refreshing a main page;
a04: the auxiliary equipment is connected with a network, generates a two-dimensional code according to wifi information connected with the current mobile phone, and scans the two-dimensional code after the equipment is reset to complete networking operation of the equipment;
a05: binding a new device, acquiring parameters for initializing the device by the server through a scanning function in the app, connecting the app with the device after the acquisition is successful, then performing initialization setting on the device, uploading a device number to the server for association binding with an account after the initialization is successful, and simultaneously storing the device in SharePreferences to refresh a main page.
Preferably, in step 2), the operation of adding, deleting and changing the partitioned and classified information content includes the following steps:
b01: acquiring partition and classification information, and acquiring the number, name and picture of partitions and classifications from a server according to a device number (deviceId);
b02: the partition and the classification information management are carried out, a creating partition is clicked or a popup window for creating a classification popup compiling partition and classification contents is created, after the contents are edited, the creation of the upper right corner is clicked, and the data are sent to a server side for storage; clicking a certain partition and classifying the content to pop up a popup window for editing the content, clicking an editing button after the editing is finished, sending the content to a server, and modifying the content of a corresponding item by id and foodtype Id; when a certain classification and partition is deleted, a deletion symbol at the upper right corner of an entry is clicked, the click is determined in a popup window, a request is sent to a server, and the deletion can be performed if the request is agreed.
Preferably, in step 3), the method for acquiring and maintaining food information includes the following steps:
c01: acquiring food list information, accessing a server, acquiring all food information under the equipment according to the equipment number, and acquiring food information under a certain classification according to the equipment number and the classification number;
c02: the food information management comprises clicking a popup window for popping up the created food to compile the food content, clicking the creation of the upper right corner after the content is edited to send the data to the server for storage; clicking a certain piece of food content to pop up a popup window for editing the piece of content, clicking an upper right-corner editing button after the editing is finished, and sending the content to a server for modification; when a certain food record is deleted, clicking a deletion symbol at the upper right corner of an item, clicking in a popup window for confirmation, sending a request to a server, and deleting if the request is agreed; in the creating/editing popup, editing can be performed by clicking the selection category and clicking the time of putting into the refrigerator.
Preferably, in step 4), the method of purchasing food via a store comprises the steps of:
d01: obtaining the shop position of a nearby merchant using equipment, after logging in/opening an app, obtaining the position information of the current mobile phone according to a positioning API (application programming interface) of the dependent map software, sending the information to a server, judging and screening by the server, and returning to a nearby shop information list;
d02: selecting a shop, and requesting shop data information near the position of the mobile phone from a server after entering a shop list, wherein the information is displayed on an interface in a list form by the effect of increasing the distance; a user enters a corresponding shop according to different numbers of the shop to select and purchase required things;
d03: selecting commodities, and after entering a shop, a user can click a bottom adding shopping cart to add food according to needs to perform unified management;
d04: and (4) settlement, namely after the commodity to be purchased is selected from the shopping cart, the payment can be carried out by clicking a settlement button and then selecting a payment mode.
Preferably, the method also comprises menu interaction management, and adopts the following method:
e01: compiling a menu, clicking a menu plate to enter a menu compiling interface, compiling the content by using a richText frame on the interface, and uploading the content to a server after the compiling is finished;
e02: after the interface is opened, the access server returns a corresponding menu record list according to different users, and meanwhile, each record is maintained;
e03: sharing the menu, selecting the menu to be shared in a list page of the menu record, and clicking a sharing button to select a sharing mode;
e04: recommending the menu, automatically matching the corresponding menu according to the food left in the refrigerator by the server side, sending a notification to the app, obtaining a notification message after the app receives the notification message, clicking the message, and jumping to a detailed page of the menu to view the content.
Further, when the sharing mode of the analysis recipe is external sharing, the mob sharing platform is used for sharing the content, and when the sharing mode is internal sharing, the recipe is dropped into excellent recipe recommendation.
The invention has the beneficial effects that:
the intelligent server of the cabinet can provide the data of the putting time and the taking time of each food in the cabinet, based on the data, APP software is adopted to bind with the data, and intelligent management of the food is carried out, the management mode comprises a refrigerator partition, food classification and food quantity and state confirmation, a merchant platform is provided based on the food quantity and state, data information for purchasing new food is provided through the merchant platform, and the merchant platform carries out delivery and door-to-door or self-service after receiving orders, so that the cabinet is supplemented, and intelligent rear-end service is realized.
Drawings
FIG. 1 is a flow chart of a binding device in a food APP management system and method of the present invention;
FIG. 2 is a flow chart of a partition and classification management module in the food APP management system and method of the present invention;
FIG. 3 is a flow chart of a food management module in the food APP management system and management method of the present invention;
FIG. 4 is a flow chart of store modules in a food APP management system and method of the present invention;
FIG. 5 is a flow chart of a recipe module in the food APP management system and method of the present invention;
fig. 6 is a schematic diagram of a functional structure in a food APP management system and a management method according to the present invention.
Detailed Description
The present invention is further described with reference to the following drawings and specific examples so that those skilled in the art can better understand the present invention and can practice the present invention, but the examples are not intended to limit the present invention.
Examples
FIG. 1 is a flow chart of binding devices in software according to an example embodiment of the present invention, the method including:
a01: and judging whether the login account in the app has a device for displaying the content (a camera of the refrigerator is observed) or not.
This example serves to determine that the refrigerator can be used for subsequent display, updating, and uploading.
The method comprises the following specific steps: after logging in the app, it is determined whether there is a device number (deviceId) stored in the sharepreneces (one of app data local storage modes), and if so, the rest of processes can be selected to be executed. If not, A02 is carried out.
A02: and judging whether the secondary account number is bound with equipment (observing a camera of the refrigerator).
The purpose of this example is to determine whether there is a selectable device for this account ("watch" the refrigerator camera).
The method comprises the following specific steps: the access server inquires whether the content number of the list of the account binding device is 0, and if not, A03 is executed. If 0, 04, 05 are executed.
A03: the device that is to present the content is selected ("watch" the camera of the refrigerator).
This example serves to provide functionality for switching presentation devices ("watching" the camera of the refrigerator) for this account number
The method comprises the following specific steps: and entering a 'bound equipment' list page, and acquiring all bound equipment (observing a camera of the refrigerator) corresponding to the account returned by the server. Clicking on the device to be selected stores in SharePreferences (a type of local storage of app data). The main page is refreshed.
A04: the auxiliary device is connected to the network.
The role of this example is to connect a network for devices ("watching" the camera of the refrigerator).
The method comprises the following specific steps: and generating a two-dimensional code according to wifi information connected with the current mobile phone, resetting the equipment, and scanning the two-dimensional code to complete networking operation of the equipment (observing a camera of the refrigerator).
A05: binding a new device
The role of this example is to bind a new device for the user (the "watch" the refrigerator camera)
The method comprises the following specific steps: parameters (such as alarm addresses and the like) initialized by the server side for the equipment are obtained through a scanning function in the app. After the acquisition is successful, the app is connected with the equipment (for observing a camera of the refrigerator), then initialization setting (such as setting a time zone, setting mobile detection and the like) of the equipment is carried out, and after the initialization is successful, the equipment number is uploaded to the server side to be associated and bound with the account number. And storing the device into SharePreferences (one of the app data local storage modes). The main page is refreshed.
FIG. 2 is a flow diagram of a partition, class management module in software according to an embodiment of the present invention. The method comprises the following steps:
b01: obtaining partition and classification information
The function of the example is to acquire the partition and classification information under the equipment
The method comprises the following specific steps: and acquiring the number and name of partitions and classifications, pictures and the like from the server according to the equipment number (deviceId). For operation of B02. The method comprises the following steps: and directly accessing the server to obtain data and display the data after entering the page.
B02: partition, classification information management
The function of the example is to maintain the partition and classification under the equipment
The method comprises the following specific steps: and adding, deleting and changing the partition and classified information content according to the equipment number (deviceId) and the partition number (id)/classification number (foodtype Id), and sending the information to the server for storage after the operation is finished. The method comprises the following steps: clicking the 'creating partition' or 'creating classification' pops up a popup window of the writing partition and the classified content, and clicking the creation of the upper right corner after the content is edited to send the data to the server for storage; clicking a certain partition and classifying the content to pop up a popup window for editing the content, clicking an upper right-corner editing button after editing is finished, sending the content to a server, and modifying the content of a corresponding item by id and foodtype Id; when a certain classification and partition is deleted, a deletion symbol at the upper right corner of an entry is clicked, the click determination is carried out in a popup window, a request is sent to a server, and the deletion can be carried out if the request is agreed.
FIG. 3 is a flow diagram of a food management module in example software of the present invention. The method comprises the following steps:
c01: obtaining food listing information
The function of this example is to obtain the list information of food and the information of individual food (such as shelf life, classification, name, etc.)
The method comprises the following specific steps: accessing a server, and acquiring all food information under the equipment according to the equipment number (deviceId); food information under a certain classification can also be acquired from the device number (deviceId) and the classification number (foodtype id). The method comprises the following steps: and directly accessing the server to obtain data and display the data after entering the page.
C02: food information management
The function of this example is to maintain a certain food under the equipment
The method comprises the following specific steps: the information content of the food can be added, deleted and changed according to the equipment number (deviceId) and the classification number (foodtype Id), and the information is sent to the server side for storage after the operation is completed. Maintenance of "overdue reminders" may also be performed for shelf life maintenance. The method comprises the following steps: clicking 'create food' can pop up a popup window for compiling food contents, and clicking creation at the upper right corner to send data to a server for storage after the contents are edited; clicking a certain piece of food content to pop up a popup window for editing the piece of content, clicking an upper right-corner editing button after the editing is finished, and sending the content to a server for modification; when a certain food record is deleted, the key point clicks the deletion symbol at the upper right corner of the item, the click is determined in the pop-up window, the request is sent to the server, and the deletion can be performed if the request is agreed. In the create/edit popup, click on the selectable category in the upper left corner and click on the time selectable for refrigerator insertion directly above.
FIG. 4: is a flow chart of a store module in the software of the embodiment of the invention
D01: obtaining nearby merchant store locations using equipment
The function of the example is to obtain the position information of the nearby shop, thereby facilitating the selection of the user
The method comprises the following specific steps: after logging in/opening the app, acquiring the position information of the current mobile phone according to the positioning API of the dependent Baidu map/Gaode map, sending the information to the server, judging and screening by the server, and returning to a nearby shop information list.
D02: selecting a store
The function of the example is that the user can judge how to select the shop according to the shop information returned by the service terminal
The method comprises the following specific steps: after entering the shop list, the shop data information near the position of the mobile phone is requested from the server, and the information can be displayed on the interface in a list form with the effect of increasing the distance. The user can enter the corresponding shop to select and purchase needed things according to the different numbers (storeId) of the shop.
D03: selecting merchandise
The embodiment has the function of facilitating the unified management of the goods purchase of the user
The method comprises the following specific steps: after entering the shop, the user can click the bottom to add the food into the shopping cart according to the requirement, and the unified management is carried out (such as the modification of the quantity, the deletion of the food, the calculation of the price, and the like)
D04: settlement of accounts
The effect of this example is to trade items in a user's shopping cart
The method comprises the following specific steps: after selecting the commodity to be purchased in the shopping cart, clicking a lower settlement button and selecting a payment mode (such as WeChat payment-calling a WeChat payment API and the like).
FIG. 5: is a flow chart of a menu module in the software of the embodiment of the invention
E01: making menu
The effect of this example is that the user can write his own menu
The method comprises the following specific steps: clicking 'i want to write menu' in the menu plate to enter a menu compiling interface. The interface utilizes a richText frame to write the content, and the content is uploaded to a server after the writing of the content is completed.
E02: menu recording
The function of the example is to record all the menus released by the user
The method comprises the following specific steps: after the interface is opened, the access server returns a corresponding menu record list according to different users, and meanwhile, each record can be maintained (added, deleted and changed).
E03: sharing menu
The effect of this example is that the user can send his own menu to friends through WeChat, qq, etc. This recipe can also be disclosed.
The method comprises the following specific steps: in a list page of the menu records, selecting a menu to be shared, and then clicking a sharing button at the upper right corner to select a sharing mode (such as QQ, WeChat, eye and the like).
If the sharing mode is QQ, WeChat and the like, the mob sharing platform is used for sharing the content. The received user clicks the content to see the corresponding content.
If the sharing mode is ice-eye sharing, the menu can be put into 'three beautiful meals' (excellent menu)
E04: show excellent menu
The purpose of this example is to show all the recipes that the user has disclosed.
E05: recommending menu
The effect of this example is that the user recommends the appropriate recipe using the existing food
The method comprises the following specific steps: the server automatically matches a corresponding menu according to the food left in the refrigerator and sends a notification to the app, the app receives the notification and obtains a notification message, and after clicking the message, the server jumps to a detail page of the menu and can view the content.
FIG. 6: is a schematic diagram of the functional structure in the example software of the present invention. A device binding module S01; a partitioning, classification management module S02; a food management module S03; store merchandise module S04; menu, recipe module S05; a data processing module S06.
The device binding module S01: for user binding of devices.
For the user side, only after the device is bound and the operable device is selected, the corresponding refrigerator and the internal food can be operated.
Partition, sort management module S02: the method is used for managing the refrigerator subareas and food classifications under different equipment by a user.
The maintenance operation can be carried out on partitions and classifications under different devices. The app usage is made more user-specific.
Food management module S03: for managing food in refrigerator under different equipment by user
All food under the user device can be maintained.
Store merchandise module S04: for the user to purchase the food.
According to the practical situation, the user can purchase the commodity with the closest distance to supplement the refrigerator.
Menu, recipe module S05: the food display device is used for displaying food and learning food making by a user.
The method is used for recording and displaying the self-meal of the user and recommending the reference menu.
The data processing module S06: the method is used for assisting the server side to perform identification analysis.
In order to reduce the pressure of the server, after the user agrees, the app executes the identification analysis operation of the received picture of the server, and returns the result to the server.
In this example, the refrigerator is only used as a cabinet for storing food, including but not limited to a cabinet, a refrigerator, a food cabinet, and a storage cabinet, and the practical application is as follows:
when food is put into the refrigerator, the camera arranged on the refrigerator can capture the food picture and send the food picture to the server for visual identification, and the food feature picture is transmitted to the APP of a user, so that the user can define the shelf life of the food picture according to the food picture; when the food is taken away, the user APP automatically deletes the food picture, and when the shelf life is left for 24 hours, information is sent to the user APP to remind the user of using the food; if the user finds that the APP and the refrigerator lack a certain food, the food can be selected and purchased through a food selling module of the user APP; if the user is keen in cooking, the user can share the menu module in the APP or learn cooking methods of other users. A method for storing and guaranteeing the quality of refrigerator food through visual identification and a food transaction system are also designed, wherein a management operation system for a camera, a user, food transaction, a menu and APP advertisement is also designed, the camera and the APP can be associated with the user through the management of the camera, and the video stream is captured and sent to a server; the management of multiple persons for food in the same refrigerator can be realized through the management of the user, and the basic information and the account of the user can be managed; the merchant audit of the sale in the APP can be audited through the management of the food transaction, and the transaction behavior of the user and the merchant is supervised; the menu can be checked and released by the user through the management of the menu, so that the illegal and illegal information is prevented from being spread on the APP; through the management to the APP advertisement, can carry out advertisement putting according to certain page on the APP of trade company or third party advertising agency.
The specific process of video identification is as follows:
1. acquiring video data of a camera:
when detecting that an article in front of a lens reaches a trigger condition, a camera sends a signal to a video receiver, such as timing trigger, event (article movement) trigger and server soft trigger, the video receiver establishes socket connection with the camera after receiving the signal, the camera sends video data to the video receiver after the connection is successfully established, the sent data comprises video bytes, camera id (camera id), and unique id of each video (requestId: is used for distinguishing videos of the same camera in different time periods).
2. Decoding processing of video data
The video receiver sends the acquired video data to the video segmentation processor, and because the video data sent by the camera each time is jerky and the data received each time is not enough to synthesize one picture, the video segmentation processor is required to process the original data. The video segmentation processor starts a new thread after receiving a section of data, continuously monitors original video data acquired in the next minute by taking a camera id (camera id) as an identifier, performs h264 decoding on the accumulated data every 3 seconds, captures pictures, captures 10 frames (left and right) of pictures every second, creates a new video picture processor after each video (distinguished by requestId) captures the pictures successfully for the first time, and places the processor into a queue in a scheduling thread of the video picture processor. Each captured picture is placed in a container in the video picture processor, and the video picture processor is identified as being captured after the whole video is captured.
3. Processing video pictures
When the server is started, a video picture processor scheduling thread is started, the thread returns to continuously take out the video picture processors in the queue of the thread, when the video picture processors are taken out, a picture identification interface caller is used, the caller provides a function for calling the picture identification interface, pictures can be identified, picture processing results (including the actions of taking out or storing and guessing the items such as food and the number of the items such as food) can be returned, and then the results are assigned to a picture identification result processor.
4. Picture recognition result processing
The picture recognition result processor can carry out cloud storage on the obtained results, for example, 1 apple is put into a refrigerator a, 3 watermelons are put into the refrigerator a, and 2 beef boxes are taken out.
The video picture identification and judgment system comprises the following steps:
the whole system comprises an imaging module, a labeling module, a training module, an identification module, a trajectory tracking module and a behavior judgment module. The imaging module is placed at a fixed position through an external network camera, and shoots and captures a moving target in a visual field range.
And the marking module is used for providing training data for the training module and is divided into three parts, wherein the first part is used for marking the palm, the second part is used for marking hand-held articles, and the third part is used for marking different types of articles.
And the training module can select different models for training the labeled images. Such as the rcnn series model using a two-step process or the yolo series using a one-step process. The training categories include 3 categories, one being the palm-held item, one being the item. The first two types are fixed, and the last type of article is selected according to actual needs, and can be one article or multiple articles.
And the recognition module is used for recognizing the picture by using the trained model, wherein the objects comprise a palm A, a palm-handheld object B and a handheld object C, and the recognized target position box, the category class and the score are given. The reason for identifying the three is that the hand-held object is easily shielded and the identification rate is low. The palm is high in recognition rate, and the palm is used as an auxiliary judgment condition, so that the misjudgment rate is reduced more easily.
The track tracking module comprises the following specific steps:
1. and judging the object type and the position. And judging whether the class returned by the identification module contains the class palm class _ A or not, if not, considering that the frame has no target, and waiting for the detection of the next frame. If class _ A is included, save the data of box _ A, score _ A and proceed to check class _ B, class _ C. If the related data exists, the related data of class, box and score are saved.
2. A combination of targets. Due to the multi-target detection. There may be multiple class _ a, class _ B, class _ C. IOU can be controlled by different intersection ratios of class _ A and class _ C targetsA_CTo determine which objects are unitary. Thus, the wrong target is eliminated. The formula is as follows:
Figure BDA0002612092520000111
multiple IOU groupsA_CForm set E (IOU)A_C) Set E (IOU)A_C) Internally push IOUA_CThe values are sorted incrementally.
3. And (4) removing the weight. Due to aggregation
Figure BDA0002612092520000113
And a set E of a plurality of class _ B (class _ B) represent all palm-handheld objects, and therefore, there is a possibility that duplication occurs, and that an duplicated object in both sets is removed by suppressing nms by a non-maximum value. nms is generally the culling of overlapping boxes by score, where there is a score _ B for class B in set E (class _ B) of planes, but inside set E (class _ B) is
IOUA_CCannot be compared with score _ B, can set
Figure BDA0002612092520000112
And then the comparison is carried out.
And the behavior judging module confirms the track in the continuous frames. The track has three states, namely, taking, placing and uncertainty. The status is determined by trend, i.e. depending on the current target boxnowCenter point and target box for comparison with previous framepreThe position difference of (a). Assuming that the suspected target set of the current frame is e (object) and the current track set is e (track), the specific determination steps are as follows:
1. trend determination, if boxnow.x>boxpre.x and boxnow.y>boxpre.y:take
if boxnow.x<boxpre.x and boxnow.y<boxpre.y:put
if(boxnow.x-boxpre.x)*(boxnow.y-boxpre.y)<0:unsure
2. And updating the track, and if the moving trend of the first object obj in the E (object) is consistent with a track _ x in the E (track), considering that the object belongs to the track, and updating the track. If not, then the target is selected in order in E (object) to compare with the track of E (track). If there is no match, then add the current E (object) as a suspected track to E (track).
3. And (4) track elimination, namely determining the behavior when multiple continuous frames in the E (track) are all trend, and deleting the track.
The invention has the beneficial effects that:
the intelligent server of the cabinet can provide the data of the putting time and the taking time of each food in the cabinet, based on the data, APP software is adopted to bind with the data, and intelligent management of the food is carried out, the management mode comprises a refrigerator partition, food classification and food quantity and state confirmation, a merchant platform is provided based on the food quantity and state, data information for purchasing new food is provided through the merchant platform, and the merchant platform carries out delivery and door-to-door or self-service after receiving orders, so that the cabinet is supplemented, and intelligent rear-end service is realized.
The above-described embodiments of the present invention are not intended to limit the scope of the present invention, and the embodiments of the present invention are not limited thereto, and various other modifications, substitutions and alterations can be made to the above-described structure of the present invention without departing from the basic technical concept of the present invention as described above, according to the common technical knowledge and conventional means in the field of the present invention.

Claims (10)

1. A food APP management system manages food data information provided by a service end based on a cabinet, and is characterized by comprising an equipment binding module, a partition classification management module, a food management module, a store commodity module, a menu recipe module and a data processing module; wherein:
the device binding module is used for binding devices by a user to bind the APP with the corresponding cabinet;
the partition classification management module is used for partitioning and classifying the cabinets under different devices by a user;
the food management module is used for managing food in the lower cabinets of different equipment by a user;
the shop commodity module is used for a user to purchase food;
and the data processing module is used for assisting the server side to perform identification analysis.
2. The food APP management system of claim 1, wherein: the system also comprises a menu recipe module used for the user to share the recipe and learn the recipe.
3. The food APP management system of claim 1 or 2, wherein: the cabinet is one of a refrigerator, a freezer, a food cabinet and a storage cabinet.
4. A food APP management method, characterized in that applying the food APP management system of claim 1, comprises the steps of:
1) binding an APP in intelligent equipment carried by a user with a cabinet, and acquiring an equipment number and a partition number/classification number corresponding to the cabinet from a server;
2) adding, deleting and modifying the information content of the partitions and the classifications according to the equipment number and the partition number/classification number, and sending the information to a server for storage after the operation is finished;
3) accessing a server, acquiring all food information under the equipment according to the equipment number and maintaining the food information;
4) the intelligent equipment is used for positioning, the position information is sent to the server side, the information of nearby shops is screened out through the server side, and shops and food are selected according to the shop information.
5. The food APP management method of claim 4, wherein in step 1), the method for binding APP with bins comprises the following steps:
a01: judging whether the login account in the app has equipment for selecting and displaying the content, judging whether the equipment number stored in SharePreferences exists after the app is logged in, if so, selecting to execute other processes, and if not, performing A02;
a02: judging whether the secondary account has bound equipment or not, inquiring whether the content number of the list of the equipment bound by the secondary account is 0 or not by the access server, if not, executing A03, and if so, executing 04 and 05;
a03: selecting equipment to be displayed, entering a binding equipment list page, acquiring all bound equipment corresponding to the account returned by the server, clicking the equipment to be selected, storing the equipment into SharePreferences, and refreshing a main page;
a04: the auxiliary equipment is connected with a network, generates a two-dimensional code according to wifi information connected with the current mobile phone, and scans the two-dimensional code after the equipment is reset to complete networking operation of the equipment;
a05: binding a new device, acquiring parameters for initializing the device by the server through a scanning function in the app, connecting the app with the device after the acquisition is successful, then performing initialization setting on the device, uploading a device number to the server for association binding with an account after the initialization is successful, and simultaneously storing the device in SharePreferences to refresh a main page.
6. The food APP management method of claim 4, wherein in step 2), adding, deleting and modifying the partitioned and classified information content comprises the following steps:
b01: acquiring partition and classification information, and acquiring the number, name and picture of partitions and classification from a server according to the device number deviceId;
b02: the partition and the classification information management are carried out, a creating partition is clicked or a popup window for creating a classification popup compiling partition and classification contents is created, after the contents are edited, the creation of the upper right corner is clicked, and the data are sent to a server side for storage; clicking a certain partition and classifying the content to pop up a popup window for editing the content, clicking an editing button after the editing is finished, sending the content to a server, and modifying the content of a corresponding item by id and foodtype Id; when a certain classification and partition is deleted, a deletion symbol at the upper right corner of an entry is clicked, the click is determined in a popup window, a request is sent to a server, and the deletion can be performed if the request is agreed.
7. The food APP management method of claim 4, wherein in step 3), the method for obtaining and maintaining food information comprises the following steps:
c01: acquiring food list information, accessing a server, acquiring all food information under the equipment according to the equipment number, and acquiring food information under a certain classification according to the equipment number and the classification number;
c02: the food information management comprises clicking a popup window for popping up the created food to compile the food content, clicking the creation of the upper right corner after the content is edited to send the data to the server for storage; clicking a certain piece of food content to pop up a popup window for editing the piece of content, clicking an upper right-corner editing button after the editing is finished, and sending the content to a server for modification; when a certain food record is deleted, clicking a deletion symbol at the upper right corner of an item, clicking in a popup window for confirmation, sending a request to a server, and deleting if the request is agreed; in the creating/editing popup, editing can be performed by clicking the selection category and clicking the time of putting into the refrigerator.
8. The food APP management method of claim 4, wherein in step 4), the method for purchasing food via the store comprises the following steps:
d01: obtaining the shop position of a nearby merchant using equipment, after logging in/opening an app, obtaining the position information of the current mobile phone according to a positioning API (application programming interface) of the dependent map software, sending the information to a server, judging and screening by the server, and returning to a nearby shop information list;
d02: selecting a shop, and requesting shop data information near the position of the mobile phone from a server after entering a shop list, wherein the information is displayed on an interface in a list form by the effect of increasing the distance; a user enters a corresponding shop according to different numbers of the shop to select and purchase required things;
d03: selecting commodities, and after entering a shop, a user can click a bottom adding shopping cart to add food according to needs to perform unified management;
d04: and (4) settlement, namely after the commodity to be purchased is selected from the shopping cart, the payment can be carried out by clicking a settlement button and then selecting a payment mode.
9. The food APP management method of any one of claims 4-8, further comprising menu interaction management, using the following method:
e01: compiling a menu, clicking a menu plate to enter a menu compiling interface, compiling the content by using a richText frame on the interface, and uploading the content to a server after the compiling is finished;
e02: after the interface is opened, the access server returns a corresponding menu record list according to different users, and meanwhile, each record is maintained;
e03: sharing the menu, selecting the menu to be shared in a list page of the menu record, and clicking a sharing button to select a sharing mode;
e04: recommending the menu, automatically matching the corresponding menu according to the food left in the refrigerator by the server side, sending a notification to the app, obtaining a notification message after the app receives the notification message, clicking the message, and jumping to a detailed page of the menu to view the content.
10. The food APP management method of claim 9, wherein when the sharing mode of analyzing recipes is external sharing, content sharing is performed by using a mob sharing platform, and when the sharing mode is internal sharing, the recipes are dropped into excellent recipe recommendations.
CN202010757551.8A 2020-07-31 2020-07-31 Food APP management system and management method Active CN112001770B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010757551.8A CN112001770B (en) 2020-07-31 2020-07-31 Food APP management system and management method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010757551.8A CN112001770B (en) 2020-07-31 2020-07-31 Food APP management system and management method

Publications (2)

Publication Number Publication Date
CN112001770A true CN112001770A (en) 2020-11-27
CN112001770B CN112001770B (en) 2024-05-03

Family

ID=73463531

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010757551.8A Active CN112001770B (en) 2020-07-31 2020-07-31 Food APP management system and management method

Country Status (1)

Country Link
CN (1) CN112001770B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107403249A (en) * 2016-05-19 2017-11-28 阿里巴巴集团控股有限公司 Article control method, device, intelligent storage equipment and operating system
CN107806729A (en) * 2017-11-29 2018-03-16 常州机电职业技术学院 A kind of intelligent refrigerator under big data background
CN110426964A (en) * 2019-08-13 2019-11-08 合肥美的电冰箱有限公司 Domestic electric appliances controller, smart machine, household electrical appliances, appliance control system and method
CN111105862A (en) * 2019-11-22 2020-05-05 青岛海信智慧家居系统股份有限公司 Recipe recommendation method and device based on existing food materials of refrigerator and refrigerator
CN111415461A (en) * 2019-01-08 2020-07-14 虹软科技股份有限公司 Article identification method and system and electronic equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107403249A (en) * 2016-05-19 2017-11-28 阿里巴巴集团控股有限公司 Article control method, device, intelligent storage equipment and operating system
CN107806729A (en) * 2017-11-29 2018-03-16 常州机电职业技术学院 A kind of intelligent refrigerator under big data background
CN111415461A (en) * 2019-01-08 2020-07-14 虹软科技股份有限公司 Article identification method and system and electronic equipment
CN110426964A (en) * 2019-08-13 2019-11-08 合肥美的电冰箱有限公司 Domestic electric appliances controller, smart machine, household electrical appliances, appliance control system and method
CN111105862A (en) * 2019-11-22 2020-05-05 青岛海信智慧家居系统股份有限公司 Recipe recommendation method and device based on existing food materials of refrigerator and refrigerator

Also Published As

Publication number Publication date
CN112001770B (en) 2024-05-03

Similar Documents

Publication Publication Date Title
CN112242940B (en) Intelligent management system and management method for food in bins
CN108922026B (en) Replenishment management method and device for vending machine and user terminal
CN108846621B (en) Inventory management system based on strategy module
US10062257B2 (en) Intelligent display system and method
US20130117153A1 (en) Fully interactive, wireless, retail video display tag, integrated with content distribution, data management, feedback data collection, inventory and product price search capabilities
US20240022785A1 (en) Online live video sales management system
US10380546B2 (en) Intelligent display and self-serve experience system and method
CN108462889A (en) Information recommendation method during live streaming and device
US20150161712A1 (en) Unifying shopping experience system
US20170352078A1 (en) Real-time internet capable device information interchange for coordinated queuing at locations
CN105184975A (en) Management system and management method for vending machine
CN106779940B (en) Method and device for confirming display commodity
CN110895768B (en) Data processing method, device, system and storage medium
CN109241883B (en) Goods returning control method and device based on vending machine
CN211149511U (en) Unmanned cafeteria system
CN109147174A (en) A kind of self-service method, server and self-service cabinet
US20100030668A1 (en) System and method for retail inventory management
US20200065757A1 (en) Food inventory system and method
CN106097040A (en) Information-pushing method, device and terminal unit
JP2023507043A (en) DATA PROCESSING METHOD, DEVICE, DEVICE, STORAGE MEDIUM AND COMPUTER PROGRAM
CN108171286B (en) Unmanned selling method and system
CN109284951A (en) Address information processing method and device
WO2020007141A1 (en) Offline commodity information query method, apparatus, device and system
CN112001770B (en) Food APP management system and management method
US20170262795A1 (en) Image in-stock checker

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant