WO2019019499A1 - 物品信息录入方法、系统和冰箱 - Google Patents

物品信息录入方法、系统和冰箱 Download PDF

Info

Publication number
WO2019019499A1
WO2019019499A1 PCT/CN2017/113174 CN2017113174W WO2019019499A1 WO 2019019499 A1 WO2019019499 A1 WO 2019019499A1 CN 2017113174 W CN2017113174 W CN 2017113174W WO 2019019499 A1 WO2019019499 A1 WO 2019019499A1
Authority
WO
WIPO (PCT)
Prior art keywords
item
information
signal
prompt
image
Prior art date
Application number
PCT/CN2017/113174
Other languages
English (en)
French (fr)
Inventor
姚育
季涛
戴江
Original Assignee
合肥美的智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 合肥美的智能科技有限公司 filed Critical 合肥美的智能科技有限公司
Publication of WO2019019499A1 publication Critical patent/WO2019019499A1/zh

Links

Images

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00—Arrangement or mounting of control or safety devices
    • F25D29/003—Arrangement or mounting of control or safety devices for movable devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the invention relates to the technical field of refrigerator food management, in particular to an item information input method, an item information input system and a refrigerator.
  • the refrigerator food input mainly includes three ways: text, voice and camera. Among them, the way the user actually uses the higher rate is the camera input mode.
  • the camera input mode is to take a photo collection and item information entry by shooting a user's article in the refrigerator through a camera installed in a fixed position of the refrigerator, and the following technical defects exist:
  • the present invention aims to solve at least one of the technical problems existing in the prior art or related art.
  • Another object of the present invention is to provide an item information entry system.
  • the technical solution of the first aspect of the present invention provides an item information input method, including: collecting an item when detecting that a distance between a real-time position of the item and a specified position is less than or equal to a preset distance threshold Image information; parsing feature information in image information Information to determine the category information corresponding to the item.
  • the accuracy of the image information collection of the item is improved, which is beneficial to improve.
  • the accuracy and efficiency of the item information corresponding to the item are reduced, and the occurrence of the item cannot be recognized due to the occlusion and the bag problem.
  • the item information corresponding to the item is determined, and the item information is realized. The entry is beneficial to the user to manage the items in the refrigerator and improve the user experience.
  • the category information corresponding to the item is determined by parsing the feature information in the image information, and matching the feature information in a preset information base, where the association information and the corresponding category are stored in the preset information base.
  • the information and the category information include the name of the item and the type of the item, and may also include the freshness period of the item and the eating method of the item. After the category information is determined, the category information may be pushed to the user and added to the user's item list, which is beneficial to the information. The user manages the item.
  • the preset distance threshold may be set to 30 cm to 40 cm.
  • the method before collecting the image information of the item, the method further includes: recording the duration, and detecting the state of the item in real time; if the state of the item is detected to be static and the duration exceeds the preset duration, the collection is started.
  • the image information of the item is generated, and the first prompt signal is generated; if the state of the item is detected to be dynamic, the second prompt signal is generated, and the duration is re-recorded, wherein the first prompt signal is used to prompt the user that the image collection is in progress, The second prompt signal is used to prompt the user to prepare for image acquisition.
  • the image information of the item is started to be collected, and the image collection is being performed to the user.
  • the first prompt signal in the first detection signal is sent to the user to send a second prompt signal for preparing the image collection, which is beneficial for the user to adjust the shooting angle of the article and the stability of the article, thereby facilitating the shooting.
  • Accurate image information improves the recognition effect of image information, thereby improving the accuracy of item information entry, and reducing the problem of poor image image collection due to occlusion problems and the problem that items cannot be placed.
  • the preset duration can be set to 2s, that is, when the stationary time of the item exceeds 2s, the image information of the item is collected.
  • the method before collecting the image information of the item, the method further includes: acquiring a focus signal; when the focus signal is in focus, starting to collect image information of the item, and generating a first prompt signal; When the focus signal is not completed, the second prompt signal is generated, and the focus signal is re-acquired.
  • the first prompt signal is used to prompt the user that the image capture is in progress, and the second prompt signal is used to prompt the user to prepare the image acquisition.
  • the image information of the item is started to be collected, and the first prompt signal that the image acquisition is in progress is sent to the user, when the focus signal is in focus,
  • the second prompt signal for preparing the image collection is sent to the user, which is beneficial for the user to adjust the shooting angle of the article and the stability of the article, thereby facilitating the shooting of more accurate image information, improving the recognition effect of the image information, and thereby improving the information entry of the article.
  • the accuracy of the image information collection is reduced due to occlusion problems and the problem that the item cannot be placed.
  • the item information input method further comprises: when receiving the image information of the item, generating a third prompt signal, wherein the third prompt signal is used to prompt the user that the image collection has been completed.
  • the third prompt signal is generated, and the user is prompted to complete the image collection, which is beneficial for the user to know the image collection information and the corresponding category information of the item in time, which is beneficial to realize
  • the management of the item enhances the user's interactive experience.
  • the issuance of the first prompt signal, the second prompt signal, and the third prompt signal is implemented by a buzzer or a signal light.
  • the method before collecting the image information of the item, the method further comprises: detecting the distance between the real-time position of the item and the designated position when the item information input signal is received.
  • the triggering operation of the image collecting process is realized, and the accuracy and efficiency of the item information input are further improved. This further enhances the user experience.
  • the item information input signal may be an opening signal of the refrigerator door body, or an item information input signal sent by the user manually through the switch button, or may be detected that the user has an item. Incoming signal.
  • the technical solution of the second aspect of the present invention provides an item information entry system, comprising: an acquisition unit, configured to collect an item when detecting that a distance between a real-time position of the item and the specified position is less than or equal to a preset distance threshold The image information; the parsing unit is configured to parse the feature information in the image information to determine the category information corresponding to the item.
  • the accuracy of the image information collection of the item is improved, which is beneficial to improve.
  • the accuracy and efficiency of the item information corresponding to the item are reduced, and the occurrence of the item cannot be recognized due to the occlusion and the bag problem.
  • the item information corresponding to the item is determined, and the item information is realized. The entry is beneficial to the user to manage the items in the refrigerator and improve the user experience.
  • the category information corresponding to the item is determined by parsing the feature information in the image information, and matching the feature information in a preset information base, where the association information and the corresponding category are stored in the preset information base.
  • the information and the category information include the name of the item and the type of the item, and may also include the freshness period of the item and the eating method of the item. After the category information is determined, the category information may be pushed to the user and added to the user's item list, which is beneficial to the information. The user manages the item.
  • the preset distance threshold may be set to 30 cm to 40 cm.
  • the item information entry system further includes: a recording unit configured to record the duration and detect the state of the item in real time; the collecting unit is further configured to: when the state of the detected item is continuously static, and the duration exceeds When the preset duration is long, the image information of the item is started to be collected, and a first prompt signal is generated; the prompting unit is configured to generate a second prompt signal when the state of the detected item is dynamic, and re-record the duration, wherein the first The prompt signal is used to prompt the user that image acquisition is in progress, and the second prompt signal is used to prompt the user to prepare image acquisition.
  • a recording unit configured to record the duration and detect the state of the item in real time
  • the collecting unit is further configured to: when the state of the detected item is continuously static, and the duration exceeds When the preset duration is long, the image information of the item is started to be collected, and a first prompt signal is generated
  • the prompting unit is configured to generate a second prompt signal when the state of the detected item is dynamic, and re-re
  • the image information of the item is started to be collected, and the image collection is being performed to the user.
  • the first prompt signal in the middle is beneficial to the user to adjust the shooting angle of the article and the stability of the article when the state of the article is detected to be dynamic, thereby facilitating the shooting of more accurate image information and improving the recognition effect of the image information. Further improve the item The accuracy of information entry reduces the problem of poor image information collection due to occlusion problems and the inability of the item to rest.
  • the preset duration can be set to 2s, that is, when the stationary time of the item exceeds 2s, the image information of the item is collected.
  • the item information entry system further includes: an acquisition unit, configured to acquire a focus signal; and the acquisition unit is further configured to: start collecting image information of the item when the focus signal is in focus, and Generating a first prompt signal; the prompting unit is further configured to: when the focus signal is in focus, generate a second prompt signal, and re-acquire the focus signal, wherein the first prompt signal is used to prompt the user that the image capture is in progress, The second prompt signal is used to prompt the user to prepare for image acquisition.
  • the image information of the item is started to be collected, and the first prompt signal that the image acquisition is in progress is sent to the user, when the focus signal is in focus,
  • the second prompt signal for preparing the image collection is sent to the user, which is beneficial for the user to adjust the shooting angle of the article and the stability of the article, thereby facilitating the shooting of more accurate image information, improving the recognition effect of the image information, and thereby improving the information entry of the article.
  • the accuracy of the image information collection is reduced due to occlusion problems and the problem that the item cannot be placed.
  • the prompting unit is further configured to: when receiving the image information of the item, generate a third prompting signal, wherein the third prompting signal is used to prompt the user that the image capturing is completed.
  • the third prompt signal is generated, and the user is prompted to complete the image collection, which is beneficial for the user to know the image collection information and the corresponding category information of the item in time, which is beneficial to realize
  • the management of the item enhances the user's interactive experience.
  • the issuance of the first prompt signal, the second prompt signal, and the third prompt signal is implemented by a buzzer or a signal light.
  • the item information entry system further includes: a detecting unit configured to detect a distance between the real-time position of the item and the designated position when the item information input signal is received.
  • the triggering operation of the image collecting process is realized, and the accuracy and efficiency of the item information input are further improved. This further enhances the user experience.
  • the item information input signal may be an opening signal of the refrigerator door body, an item information input signal sent by the user manually through the switch button, or a signal that the user has detected the entry of the item.
  • the technical solution of the third aspect of the present invention provides a refrigerator, comprising: the item information input system according to any one of the technical solutions of the second aspect of the present invention; the image collector is disposed in the refrigerator, and the article The information entry system is electrically connected to collect image information of the item under the control of the item information entry system; the distance sensor is disposed on the image collector and electrically connected with the item information entry system for collecting the real-time position and the designated position of the item. The distance between them.
  • the refrigerator includes the article information entry system according to any one of the above aspects of the second aspect of the present invention, and thus has the article of any one of the above aspects of the second aspect of the present invention.
  • the entire beneficial effects of the information entry system will not be described here.
  • the image collector installed in the refrigerator is electrically connected with the item information entry system, and the image information of the collected items under the control of the item information entry system is realized.
  • the distance sensor on the image collector is electrically connected with the item information input system, thereby realizing the collection of the distance between the real-time position and the designated position of the item, realizing the entry of the item information, and improving the accuracy and efficiency of the item information entry. , thereby improving the user experience.
  • FIG. 1 shows a schematic flow chart of an item information entry method according to an embodiment of the present invention
  • FIG. 2 shows a schematic block diagram of an item information entry system in accordance with one embodiment of the present invention
  • Figure 3 shows a schematic block diagram of a refrigerator in accordance with one embodiment of the present invention
  • FIG. 4 is a schematic flow chart showing an item information entry method according to another embodiment of the present invention.
  • FIG. 5 is a schematic flow chart showing an item information entry method according to still another embodiment of the present invention.
  • FIG. 6 is a schematic flow chart showing an item information entry method according to still another embodiment of the present invention.
  • FIG. 7A and 7B show schematic block diagrams of a refrigerator in accordance with another embodiment of the present invention.
  • FIG. 1 shows a schematic flow chart of an item information method in accordance with one embodiment of the present invention.
  • step S102 collecting an image of an item when detecting that a distance between a real-time position of the item and the specified position is less than or equal to a preset distance threshold Information; step S104, parsing the feature information in the image information to determine the category information corresponding to the item.
  • the accuracy of the image information collection of the item is improved, which is beneficial to improve.
  • the accuracy and efficiency of the item information corresponding to the item are reduced, and the occurrence of the item cannot be recognized due to the occlusion and the bag problem.
  • the item information corresponding to the item is determined, and the item information is realized. The entry is beneficial to the user to manage the items in the refrigerator and improve the user experience.
  • the category information corresponding to the item is obtained by parsing the feature information in the image information, and
  • the feature information is determined by matching in the preset information base, and the preset information library stores the feature information and the corresponding category information, and the category information includes the name of the item and the type of the item, and may also include the preservation of the item.
  • the item information can be pushed to the user and added to the user's item list, which is beneficial to the user to manage the item.
  • the preset distance threshold may be set to 30 cm to 40 cm.
  • the method before collecting the image information of the item, the method further includes: recording the duration, and detecting the state of the item in real time; if the state of the item is detected to be static and the duration exceeds the preset duration, the collection is started.
  • the image information of the item is generated, and the first prompt signal is generated; if the state of the item is detected to be dynamic, the second prompt signal is generated, and the duration is re-recorded, wherein the first prompt signal is used to prompt the user that the image collection is in progress, The second prompt signal is used to prompt the user to prepare for image acquisition.
  • the image information of the item is started to be collected, and the image collection is being performed to the user.
  • the first prompt signal in the first detection signal is sent to the user to send a second prompt signal for preparing the image collection, which is beneficial for the user to adjust the shooting angle of the article and the stability of the article, thereby facilitating the shooting.
  • Accurate image information improves the recognition effect of image information, thereby improving the accuracy of item information entry, and reducing the problem of poor image image collection due to occlusion problems and the problem that items cannot be placed.
  • the preset duration can be set to 2s, that is, when the stationary time of the item exceeds 2s, the image information of the item is collected.
  • the method before collecting the image information of the item, the method further includes: acquiring a focus signal; when the focus signal is in focus, starting to collect image information of the item, and generating a first prompt signal; When the focus signal is not completed, the second prompt signal is generated, and the focus signal is re-acquired.
  • the first prompt signal is used to prompt the user that the image capture is in progress, and the second prompt signal is used to prompt the user to prepare the image acquisition.
  • the image information of the item is started to be collected, and the first prompt signal that the image acquisition is in progress is sent to the user, when the focus signal is in focus, Send a second prompt message to the user to prepare for image acquisition No.
  • the item information input method further comprises: when receiving the image information of the item, generating a third prompt signal, wherein the third prompt signal is used to prompt the user that the image collection has been completed.
  • the third prompt signal is generated, and the user is prompted to complete the image collection, which is beneficial for the user to know the image collection information and the corresponding category information of the item in time, which is beneficial to realize
  • the management of the item enhances the user's interactive experience.
  • the issuance of the first prompt signal, the second prompt signal, and the third prompt signal is implemented by a buzzer or a signal light.
  • the method before collecting the image information of the item, the method further comprises: detecting the distance between the real-time position of the item and the designated position when the item information input signal is received.
  • the triggering operation of the image collecting process is realized, and the accuracy and efficiency of the item information input are further improved. This further enhances the user experience.
  • the item information input signal may be an opening signal of the refrigerator door body, an item information input signal sent by the user manually through the switch button, or a signal that the user has detected the entry of the item.
  • FIG. 2 shows a schematic block diagram of an item information system in accordance with one embodiment of the present invention.
  • FIG. 2 illustrates an item information system 200 according to an embodiment of the present invention, including: an acquisition unit 202, configured to, when detecting that a distance between a real-time location of an item and a specified location is less than or equal to a preset distance threshold, The image information of the item is collected; the parsing unit 204 is configured to parse the feature information in the image information to determine the category information corresponding to the item.
  • the category information corresponding to the item is determined by parsing the feature information in the image information, and matching the feature information in a preset information base, where the association information and the corresponding category are stored in the preset information base.
  • the information and the category information include the name of the item and the type of the item, and may also include the freshness period of the item and the eating method of the item. After the category information is determined, the category information may be pushed to the user and added to the user's item list, which is beneficial to the information. The user manages the item.
  • the preset distance threshold may be set to 30 cm to 40 cm.
  • the item information entry system 200 further includes: a recording unit 206 for recording the duration and detecting the status of the item in real time; the collecting unit 202 is further configured to: continue to detect the status of the item When it is static, and the duration exceeds the preset duration, the image information of the item is started to be collected, and a first prompt signal is generated; the prompting unit 208 is configured to generate a second prompt signal when the state of the detected item is dynamic, and Recording duration,
  • the first prompt signal is used to prompt the user that image acquisition is in progress
  • the second prompt signal is used to prompt the user to prepare image acquisition.
  • the image information of the item is started to be collected, and the image collection is being performed to the user.
  • the first prompt signal in the middle is beneficial to the user to adjust the shooting angle of the article and the stability of the article when the state of the article is detected to be dynamic, thereby facilitating the shooting of more accurate image information and improving the recognition effect of the image information.
  • the accuracy of item information entry is improved, and the problem of poor image information collection due to occlusion problems and the inability of the item to be placed is reduced.
  • the preset duration can be set to 2s, that is, when the stationary time of the item exceeds 2s, the image information of the item is collected.
  • the item information entry system 200 further includes: The obtaining unit 210 is configured to: acquire the focus signal; the collecting unit 202 is further configured to: start collecting image information of the item when the focus signal is in focus, and generate a first prompt signal; the prompting unit 208 is further configured to: When the focus is not completed, the second prompt signal is generated, and the focus signal is re-acquired, wherein the first prompt signal is used to prompt the user that the image acquisition is in progress, and the second prompt signal is used to prompt the user to prepare the image acquisition.
  • the image information of the item is started to be collected, and the first prompt signal that the image acquisition is in progress is sent to the user, when the focus signal is in focus,
  • the second prompt signal for preparing the image collection is sent to the user, which is beneficial for the user to adjust the shooting angle of the article and the stability of the article, thereby facilitating the shooting of more accurate image information, improving the recognition effect of the image information, and thereby improving the information entry of the article.
  • the accuracy of the image information collection is reduced due to occlusion problems and the problem that the item cannot be placed.
  • the prompting unit 208 is further configured to: when receiving the image information of the item, generate a third prompting signal, wherein the third prompting signal is used to prompt the user that the image capturing is completed.
  • the third prompt signal is generated, and the user is prompted to complete the image collection, which is beneficial for the user to know the image collection information and the corresponding category information of the item in time, which is beneficial to realize
  • the management of the item enhances the user's interactive experience.
  • the issuance of the first prompt signal, the second prompt signal, and the third prompt signal is implemented by a buzzer or a signal light.
  • the item information entry system 200 further includes: a detecting unit 212, configured to detect a distance between the real-time position of the item and the specified position when the item information input signal is received.
  • the triggering operation of the image collecting process is realized, and the accuracy and efficiency of the item information input are further improved. This further enhances the user experience.
  • the item information input signal may be an opening signal of the refrigerator door body, or an item information input signal sent by the user manually through the switch button, or may be detected that the user has an item. Incoming signal.
  • Figure 3 shows a schematic block diagram of a refrigerator in accordance with one embodiment of the present invention.
  • FIG. 3 shows a refrigerator 300 according to an embodiment of the present invention, comprising: the article information entry system 200 according to any one of the technical solutions of the second aspect of the present invention; the image collector 302 is disposed in the refrigerator. 300 is electrically connected to the item information entry system 200 to collect image information of the item under the control of the item information entry system 200.
  • the distance sensor 304 is disposed on the image collector 302 and electrically connected to the item information entry system 200. The distance between the real-time location of the item and the specified location.
  • the refrigerator 300 includes the article information entry system 200 according to any one of the above aspects of the second aspect of the present invention, and thus has any one of the technical solutions of the second aspect of the present invention described above.
  • the full benefit of the item information entry system 200 is not described here.
  • the image collector 302 provided in the refrigerator 300 is electrically connected to the item information entry system 200, and the items are collected under the control of the item information entry system 200.
  • the image information is electrically connected to the item information input system 200 through the distance sensor 304 disposed on the image collector 302, thereby realizing the collection of the distance between the real-time position and the designated position of the item, thereby realizing the entry of the item information and promotion.
  • the accuracy and efficiency of item information entry enhances the user experience.
  • FIG. 4 shows a schematic flow chart of an item information entry method in accordance with another embodiment of the present invention.
  • the item information input method includes: in step S402, the refrigerator opens the door, and the image collector is powered on; and in step S404, it is detected whether the distance between the item and the image collector is valid in the image collection.
  • step S406 image acquisition, generate image information, and if it is determined otherwise, proceed to step S404, and re-detect whether the distance between the article and the image collector is within the image collection effective range; in step S408, the refrigerator closes The image collector is powered off; in step 410, the Wi-Fi module sends the image information to the cloud server; in step 412, the cloud server parses the feature information of the image information, generates corresponding item category information, and sends the information to the APP, thereby realizing the item information entry. And the accuracy of the entry is high.
  • the image information can be sent to the cloud server in the Wi-Fi module, and the server will analyze the feature information of the image information, generate the corresponding item category information and send it to the APP, and then perform the operation of turning off the refrigerator and powering off the image collector.
  • FIG. 5 shows a schematic flow chart of an item information entry method according to still another embodiment of the present invention.
  • step S406, image acquisition, and generating image information specifically includes: step S502, detecting that the user holds the item; and step S504, whether the item is still t seconds If the determination is yes, proceed to step S506, the image collector feeds back the signal to the Wi-Fi module; at the same time, step S512 is performed, and the feedback signal is sent to the user; if the determination is no, the process proceeds to step S504, and it is determined whether the item is stationary for t seconds; S508, the Wi-Fi module sends a confirmation image acquisition instruction to the image collector; in step S510, the image acquisition process is completed; in step S512, the feedback signal is sent to the user, and image acquisition is performed on the object, and image information is generated, in the process,
  • the interaction with the user prompts the user to adjust the shooting angle of the article and the stability of the article, thereby facilitating the shooting of more accurate image information, thereby improving the accuracy of the entry of the article information.
  • FIG. 6 shows a schematic flow chart of an item information entry method according to still another embodiment of the present invention.
  • step S406, image acquisition, and image information generation specifically includes: step S602, detecting that the user holds the item; and step S604, detecting the image collector to focus If yes, go to step S606, the Wi-Fi module sends a confirmation image acquisition instruction to the image collector; at the same time, step S610 is performed to feed back the signal to the user; if the determination is no, the process proceeds to step S604 to re-detect the image collection. Whether the focus is completed or not; in step S608, the image acquisition process is completed; in step S610, the feedback signal is sent to the user, and image acquisition is performed on the item, and image information is generated. In the process, the user is promptly presented to the user through interaction with the user. Adjusting the shooting angle of the article and the stability of the article, thereby facilitating the shooting of more accurate image information, thereby improving the accuracy of the entry of the article information.
  • the refrigerator main board forms an item information entry when the switch is closed.
  • the Wi-Fi sends a detection signal to the distance sensor.
  • the distance sensor detects the real-time position of the item, and the distance L1 from the specified position (that is, the image collector position), L1 is through FIG. 7B. Determined by the distance L2 and the angle ⁇ between the distance sensor and the item, the value of L1 is transmitted to Wi-Fi, and the Wi-Fi controls the camera to take a picture when it is determined that the value of L1 is less than or equal to the preset distance threshold.
  • the refrigerator main board will control the signal indicator to feed back the picture according to the prompt signal generated by Wi-Fi.
  • the signal indicator can be a buzzer or a signal light.
  • Wi-Fi will The image information is uploaded to the cloud server, and the cloud server parses the feature information in the image information, and compares with the preset information database to determine the category information corresponding to the item, and the cloud server sends the category information to the user's APP, and the user can This information is used to manage items.
  • the present invention provides an item information input method, system and refrigerator, by detecting that the distance between the real-time position of the item and the designated position is less than or equal to the preset distance threshold.
  • the image information of the article is collected, and the feature information in the image information is analyzed, thereby realizing the determination of the category information corresponding to the article, improving the clarity and validity of the image information collection, and reducing the articles caused by the occlusion and the bag problem.
  • the occurrence of unrecognizable situations improves the accuracy and efficiency of item information entry, thereby improving the user experience.
  • the units in the apparatus of the present invention can be combined, divided, and deleted according to actual needs.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • PROM Programmable Read-Only Memory
  • EPROM Erasable Programmable Read Only Memory
  • OTPROM One-Time Programmable Read-Only Memory
  • EEPROM Electronically-Erasable Programmable Read-Only Memory
  • CD-ROM Compact Disc Read-Only Memory

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Thermal Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Chemical & Material Sciences (AREA)
  • Mechanical Engineering (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Combustion & Propulsion (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

一种物品信息录入方法、系统和冰箱，其中，物品信息录入方法包括：当检测到物品的实时位置与指定位置之间的距离小于或等于预设距离阀值时，采集物品的图像信息；解析图像信息中的特征信息以确定物品对应的品类信息。该方法提高了图像信息的采集清晰度和有效性，提升了物品信息录入的准确性和效率。

Description

物品信息录入方法、系统和冰箱
本申请要求于2017年7月26日提交中国专利局、申请号为201710617137.5、发明名称为“物品信息录入方法、系统和冰箱”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及冰箱食品管理技术领域，具体而言，涉及一种物品信息录入方法、一种物品信息录入系统和一种冰箱。
背景技术
冰箱食材录入主要有文字、语音、摄像头三种方式，其中，用户实际使用率较高的方式为摄像头录入方式。
相关技术中，摄像头录入方式为通过安装在冰箱固定位置的摄像头拍摄冰箱内用户的物品的进行照片采集及物品信息录入，存在以下技术缺陷：
由于物品在冰箱内容易受到遮挡，而且大多数物品自带包装，导致冰箱固定位置的摄像头难以拍摄到合适的图片，进而导致物品信息录入的准确性差或难以实现，严重影响用户体验。
发明内容
本发明旨在至少解决现有技术或相关技术中存在的技术问题之一。
为此，本发明的一个目的在于提供一种物品信息录入方法。
本发明的另一个目的在于提供一种物品信息录入系统。
本发明的再一个目的在于提供一种冰箱。
为了实现上述目的，本发明的第一方面的技术方案提供了一种物品信息录入方法，包括：当检测到物品的实时位置与指定位置之间的距离小于或等于预设距离阈值时，采集物品的图像信息；解析图像信息中的特征信 息，以确定物品对应的品类信息。
在该技术方案中，通过在检测到物品的实时位置与指定位置之间的距离小于或等于预设距离阈值时，采集物品的图像信息，提高了物品的图像信息采集的准确性，有利于提高物品对应的品类信息的确定准确度和效率，减少了因遮挡和包装袋问题导致物品不能被识别的情况的发生，通过解析图像信息中的特征信息，确定物品对应的品类信息，实现了物品信息的录入，有利于用户对冰箱内的物品进行管理，提升了用户的使用体验。
具体地，物品对应的品类信息是通过解析图像信息中的特征信息，并将特征信息在预设的信息库中进行匹配来确定的，预设的信息库中关联存储有特征信息和对应的品类信息，品类信息包括物品的名称和物品的种类，还可以包括物品的保鲜期和物品的食用方法，在品类信息确定后，可以把品类信息推送给用户，添加到用户的物品清单中，有利于用户对物品进行管理。
其中，预设距离阈值可以设置为30cm～40cm。
在上述技术方案中，优选地，在采集物品的图像信息之前，还包括：记录时长，并实时检测物品的状态；若检测到物品的状态持续为静态，且时长超出预设时长，则开始采集物品的图像信息，并生成第一提示信号；若检测到物品的状态为动态，则生成第二提示信号，并重新记录时长，其中，第一提示信号用于向用户提示图像采集正在进行中，第二提示信号用于向用户提示准备图像采集。
在该技术方案中，通过记录时长，并实时检测物品的状态，在检测到物品的状态持续为静态，且时长超出预设时长时，开始采集物品的图像信息，并向用户发出图像采集正在进行中的第一提示信号，在检测到物品的状态为动态时，向用户发出准备图像采集的第二提示信号，有利于用户调整好物品的拍摄角度和物品的稳定度，进而有利于拍出较准确的图像信息，提高图像信息的识别效果，进而提高物品信息录入的准确性，减少了因遮挡问题和物品不能静置问题导致的图像信息采集有效性差的问题。
其中，预设时长可以设置为2s，即物品的静止时长超过2s时，开始采集物品的图像信息。
在上述任一项技术方案中，优选地，在采集物品的图像信息之前，还包括：获取对焦信号；当对焦信号为对焦完成时，开始采集物品的图像信息，并生成第一提示信号；当对焦信号为对焦未完成时，生成第二提示信号，并重新获取对焦信号，其中，第一提示信号用于向用户提示图像采集正在进行中，第二提示信号用于向用户提示准备图像采集。
在该技术方案中，通过获取对焦信号，在对焦信号为对焦完成时，开始采集物品的图像信息，并向用户发出图像采集正在进行中的第一提示信号，在对焦信号为对焦未完成时，向用户发出准备图像采集的第二提示信号，有利于用户调整好物品的拍摄角度和物品的稳定度，进而有利于拍出较准确的图像信息，提高图像信息的识别效果，进而提高物品信息录入的准确性，减少了因遮挡问题和物品不能静置问题导致的图像信息采集有效性差的问题。
在上述任一项技术方案中，优选地，物品信息录入方法还包括：在接收到物品的图像信息时，生成第三提示信号，其中，第三提示信号用于向用户提示图像采集已完成。
在该技术方案中，通过在接收到物品的图像信息时，生成第三提示信号，提示给用户已经完成了图像采集，有利于用户及时获知物品的图像采集信息和对应的品类信息，有利于实现对物品的管理，提升了用户的交互体验。
另外，第一提示信号、第二提示信号和第三提示信号的发出由蜂鸣器或信号灯来实现。
在上述任一项技术方案中，优选地，在采集物品的图像信息之前，还包括：在接收到物品信息录入信号时，检测物品的实时位置与指定位置之间的距离。
在该技术方案中，通过在接收到物品信息录入信号时，检测物品的实时位置与指定位置之间的距离，实现了图像采集过程的触发操作，进一步提高了物品信息录入的准确度和效率，进而提升了用户的使用体验。
物品信息录入信号，可以是冰箱门体的打开信号，也可以是用户手动通过开关按钮来发出的物品信息录入信号，还可以是检测到用户有物品进 入的信号。
本发明的第二方面的技术方案提出了一种物品信息录入系统，包括：采集单元，用于在检测到物品的实时位置与指定位置之间的距离小于或等于预设距离阈值时，采集物品的图像信息；解析单元，用于解析图像信息中的特征信息，以确定物品对应的品类信息。
在该技术方案中，通过在检测到物品的实时位置与指定位置之间的距离小于或等于预设距离阈值时，采集物品的图像信息，提高了物品的图像信息采集的准确性，有利于提高物品对应的品类信息的确定准确度和效率，减少了因遮挡和包装袋问题导致物品不能被识别的情况的发生，通过解析图像信息中的特征信息，确定物品对应的品类信息，实现了物品信息的录入，有利于用户对冰箱内的物品进行管理，提升了用户的使用体验。
具体地，物品对应的品类信息是通过解析图像信息中的特征信息，并将特征信息在预设的信息库中进行匹配来确定的，预设的信息库中关联存储有特征信息和对应的品类信息，品类信息包括物品的名称和物品的种类，还可以包括物品的保鲜期和物品的食用方法，在品类信息确定后，可以把品类信息推送给用户，添加到用户的物品清单中，有利于用户对物品进行管理。
其中，预设距离阈值可以设置为30cm～40cm。
在上述技术方案中，优选地，物品信息录入系统还包括：记录单元，用于记录时长，并实时检测物品的状态；采集单元还用于：在检测到物品的状态持续为静态，且时长超出预设时长时，开始采集物品的图像信息，并生成第一提示信号；提示单元，用于在检测到物品的状态为动态时，则生成第二提示信号，并重新记录时长，其中，第一提示信号用于向用户提示图像采集正在进行中，第二提示信号用于向用户提示准备图像采集。
在该技术方案中，通过记录时长，并实时检测物品的状态，在检测到物品的状态持续为静态，且时长超出预设时长时，开始采集物品的图像信息，并向用户发出图像采集正在进行中的第一提示信号，在检测到物品的状态为动态时，有利于用户调整好物品的拍摄角度和物品的稳定度，进而有利于拍出较准确的图像信息，提高图像信息的识别效果，进而提高物品 信息录入的准确性，减少了因遮挡问题和物品不能静置问题导致的图像信息采集有效性差的问题。
其中，预设时长可以设置为2s，即物品的静止时长超过2s时，开始采集物品的图像信息。
在上述任一项技术方案中，优选地，物品信息录入系统还包括：获取单元，用于获取对焦信号；采集单元还用于：在对焦信号为对焦完成时，开始采集物品的图像信息，并生成第一提示信号；提示单元还用于：在对焦信号为对焦未完成时，生成第二提示信号，并重新获取对焦信号，其中，第一提示信号用于向用户提示图像采集正在进行中，第二提示信号用于向用户提示准备图像采集。
在该技术方案中，通过获取对焦信号，在对焦信号为对焦完成时，开始采集物品的图像信息，并向用户发出图像采集正在进行中的第一提示信号，在对焦信号为对焦未完成时，向用户发出准备图像采集的第二提示信号，有利于用户调整好物品的拍摄角度和物品的稳定度，进而有利于拍出较准确的图像信息，提高图像信息的识别效果，进而提高物品信息录入的准确性，减少了因遮挡问题和物品不能静置问题导致的图像信息采集有效性差的问题。
在上述任一项技术方案中，优选地，提示单元还用于：在接收到物品的图像信息时，生成第三提示信号，其中，第三提示信号用于向用户提示图像采集已完成。
在该技术方案中，通过在接收到物品的图像信息时，生成第三提示信号，提示给用户已经完成了图像采集，有利于用户及时获知物品的图像采集信息和对应的品类信息，有利于实现对物品的管理，提升了用户的交互体验。
另外，第一提示信号、第二提示信号和第三提示信号的发出由蜂鸣器或信号灯来实现。
在上述任一项技术方案中，优选地，物品信息录入系统还包括：检测单元，用于在接收到物品信息录入信号时，检测物品的实时位置与指定位置之间的距离。
在该技术方案中，通过在接收到物品信息录入信号时，检测物品的实时位置与指定位置之间的距离，实现了图像采集过程的触发操作，进一步提高了物品信息录入的准确度和效率，进而提升了用户的使用体验。
物品信息录入信号，可以是冰箱门体的打开信号，也可以是用户手动通过开关按钮来发出的物品信息录入信号，还可以是检测到用户有物品进入的信号。
本发明的第三方面的技术方案提出了一种冰箱，包括：如上述本发明的第二方面的技术方案提出的任一项的物品信息录入系统；图像采集器，设于冰箱内，与物品信息录入系统电连接，以在物品信息录入系统的控制下采集物品的图像信息；距离传感器，设于图像采集器上，与物品信息录入系统电连接，用于采集物品的实时位置与指定位置之间的距离。
在该技术方案中，冰箱包括如上述本发明的第二方面的技术方案提出的任一项的物品信息录入系统，因此具有如上述本发明的第二方面的技术方案提出的任一项的物品信息录入系统的全部有益效果，在此不再赘述，通过设于冰箱内的图像采集器，与物品信息录入系统电连接，实现了在物品信息录入系统的控制下采集物品的图像信息，通过设于图像采集器上的距离传感器，与物品信息录入系统电连接，实现了对物品的实时位置与指定位置之间的距离的采集，实现了物品信息录入，提升了物品信息录入的准确性和效率，进而提升了用户的使用体验。
本发明的附加方面和优点将在下面的描述部分中给出，部分将从下面的描述中变得明显，或通过本发明的实践了解到。
附图说明
本发明的上述和/或附加的方面和优点从结合下面附图对实施例的描述中将变得明显和容易理解，其中：
图1示出了根据本发明的一个实施例的物品信息录入方法的示意流程图；
图2示出了根据本发明的一个实施例的物品信息录入系统的示意框图；
图3示出了根据本发明的一个实施例的冰箱的示意框图；
图4示出了根据本发明的另一个实施例的物品信息录入方法的示意流程图；
图5示出了根据本发明的再一个实施例的物品信息录入方法的示意流程图；
图6示出了根据本发明的又一个实施例的物品信息录入方法的示意流程图；
图7A和图7B示出了根据本发明的另一个实施例的冰箱的示意框图。
具体实施方式
为了能够更清楚地理解本发明的上述目的、特征和优点，下面结合附图和具体实施方式对本发明进行进一步的详细描述。需要说明的是，在不冲突的情况下，本申请的实施例及实施例中的特征可以相互组合。
在下面的描述中阐述了很多具体细节以便于充分理解本发明，但是，本发明还可以采用其他不同于在此描述的其他方式来实施，因此，本发明的保护范围并不受下面公开的具体实施例的限制。
实施例1：
图1示出了根据本发明的一个实施例的物品信息方法的示意流程图。
如图1示出了根据本发明的一个实施例的物品信息方法，包括：步骤S102，当检测到物品的实时位置与指定位置之间的距离小于或等于预设距离阈值时，采集物品的图像信息；步骤S104，解析图像信息中的特征信息，以确定物品对应的品类信息。
在该技术方案中，通过在检测到物品的实时位置与指定位置之间的距离小于或等于预设距离阈值时，采集物品的图像信息，提高了物品的图像信息采集的准确性，有利于提高物品对应的品类信息的确定准确度和效率，减少了因遮挡和包装袋问题导致物品不能被识别的情况的发生，通过解析图像信息中的特征信息，确定物品对应的品类信息，实现了物品信息的录入，有利于用户对冰箱内的物品进行管理，提升了用户的使用体验。
具体地，物品对应的品类信息是通过解析图像信息中的特征信息，并 将特征信息在预设的信息库中进行匹配来确定的，预设的信息库中关联存储有特征信息和对应的品类信息，品类信息包括物品的名称和物品的种类，还可以包括物品的保鲜期和物品的食用方法，在品类信息确定后，可以把品类信息推送给用户，添加到用户的物品清单中，有利于用户对物品进行管理。
其中，预设距离阈值可以设置为30cm～40cm。
在上述技术方案中，优选地，在采集物品的图像信息之前，还包括：记录时长，并实时检测物品的状态；若检测到物品的状态持续为静态，且时长超出预设时长，则开始采集物品的图像信息，并生成第一提示信号；若检测到物品的状态为动态，则生成第二提示信号，并重新记录时长，其中，第一提示信号用于向用户提示图像采集正在进行中，第二提示信号用于向用户提示准备图像采集。
在该技术方案中，通过记录时长，并实时检测物品的状态，在检测到物品的状态持续为静态，且时长超出预设时长时，开始采集物品的图像信息，并向用户发出图像采集正在进行中的第一提示信号，在检测到物品的状态为动态时，向用户发出准备图像采集的第二提示信号，有利于用户调整好物品的拍摄角度和物品的稳定度，进而有利于拍出较准确的图像信息，提高图像信息的识别效果，进而提高物品信息录入的准确性，减少了因遮挡问题和物品不能静置问题导致的图像信息采集有效性差的问题。
其中，预设时长可以设置为2s，即物品的静止时长超过2s时，开始采集物品的图像信息。
在上述任一项技术方案中，优选地，在采集物品的图像信息之前，还包括：获取对焦信号；当对焦信号为对焦完成时，开始采集物品的图像信息，并生成第一提示信号；当对焦信号为对焦未完成时，生成第二提示信号，并重新获取对焦信号，其中，第一提示信号用于向用户提示图像采集正在进行中，第二提示信号用于向用户提示准备图像采集。
在该技术方案中，通过获取对焦信号，在对焦信号为对焦完成时，开始采集物品的图像信息，并向用户发出图像采集正在进行中的第一提示信号，在对焦信号为对焦未完成时，向用户发出准备图像采集的第二提示信 号，有利于用户调整好物品的拍摄角度和物品的稳定度，进而有利于拍出较准确的图像信息，提高图像信息的识别效果，进而提高物品信息录入的准确性，减少了因遮挡问题和物品不能静置问题导致的图像信息采集有效性差的问题。
在上述任一项技术方案中，优选地，物品信息录入方法还包括：在接收到物品的图像信息时，生成第三提示信号，其中，第三提示信号用于向用户提示图像采集已完成。
在该技术方案中，通过在接收到物品的图像信息时，生成第三提示信号，提示给用户已经完成了图像采集，有利于用户及时获知物品的图像采集信息和对应的品类信息，有利于实现对物品的管理，提升了用户的交互体验。
另外，第一提示信号、第二提示信号和第三提示信号的发出由蜂鸣器或信号灯来实现。
在上述任一项技术方案中，优选地，在采集物品的图像信息之前，还包括：在接收到物品信息录入信号时，检测物品的实时位置与指定位置之间的距离。
在该技术方案中，通过在接收到物品信息录入信号时，检测物品的实时位置与指定位置之间的距离，实现了图像采集过程的触发操作，进一步提高了物品信息录入的准确度和效率，进而提升了用户的使用体验。
物品信息录入信号，可以是冰箱门体的打开信号，也可以是用户手动通过开关按钮来发出的物品信息录入信号，还可以是检测到用户有物品进入的信号。
实施例2：
图2示出了根据本发明的一个实施例的物品信息系统的示意框图。
如图2示出了根据本发明的一个实施例的物品信息系统200，包括：采集单元202，用于在检测到物品的实时位置与指定位置之间的距离小于或等于预设距离阈值时，采集物品的图像信息；解析单元204，用于解析图像信息中的特征信息，以确定物品对应的品类信息。
在该技术方案中，通过在检测到物品的实时位置与指定位置之间的距 离小于或等于预设距离阈值时，采集物品的图像信息，提高了物品的图像信息采集的准确性，有利于提高物品对应的品类信息的确定准确度和效率，减少了因遮挡和包装袋问题导致物品不能被识别的情况的发生，通过解析图像信息中的特征信息，确定物品对应的品类信息，实现了物品信息的录入，有利于用户对冰箱内的物品进行管理，提升了用户的使用体验。
具体地，物品对应的品类信息是通过解析图像信息中的特征信息，并将特征信息在预设的信息库中进行匹配来确定的，预设的信息库中关联存储有特征信息和对应的品类信息，品类信息包括物品的名称和物品的种类，还可以包括物品的保鲜期和物品的食用方法，在品类信息确定后，可以把品类信息推送给用户，添加到用户的物品清单中，有利于用户对物品进行管理。
其中，预设距离阈值可以设置为30cm～40cm。
在上述任一项技术方案中，优选地，物品信息录入系统200还包括：记录单元206，用于记录时长，并实时检测物品的状态；采集单元202还用于：在检测到物品的状态持续为静态，且时长超出预设时长时，开始采集物品的图像信息，并生成第一提示信号；提示单元208，用于在检测到物品的状态为动态时，则生成第二提示信号，并重新记录时长，
其中，第一提示信号用于向用户提示图像采集正在进行中，第二提示信号用于向用户提示准备图像采集。
在该技术方案中，通过记录时长，并实时检测物品的状态，在检测到物品的状态持续为静态，且时长超出预设时长时，开始采集物品的图像信息，并向用户发出图像采集正在进行中的第一提示信号，在检测到物品的状态为动态时，有利于用户调整好物品的拍摄角度和物品的稳定度，进而有利于拍出较准确的图像信息，提高图像信息的识别效果，进而提高物品信息录入的准确性，减少了因遮挡问题和物品不能静置问题导致的图像信息采集有效性差的问题。
其中，预设时长可以设置为2s，即物品的静止时长超过2s时，开始采集物品的图像信息。
在上述任一项技术方案中，优选地，物品信息录入系统200还包括： 获取单元210，用于获取对焦信号；采集单元202还用于：在对焦信号为对焦完成时，开始采集物品的图像信息，并生成第一提示信号；提示单元208还用于：在对焦信号为对焦未完成时，生成第二提示信号，并重新获取对焦信号，其中，第一提示信号用于向用户提示图像采集正在进行中，第二提示信号用于向用户提示准备图像采集。
在该技术方案中，通过获取对焦信号，在对焦信号为对焦完成时，开始采集物品的图像信息，并向用户发出图像采集正在进行中的第一提示信号，在对焦信号为对焦未完成时，向用户发出准备图像采集的第二提示信号，有利于用户调整好物品的拍摄角度和物品的稳定度，进而有利于拍出较准确的图像信息，提高图像信息的识别效果，进而提高物品信息录入的准确性，减少了因遮挡问题和物品不能静置问题导致的图像信息采集有效性差的问题。
在上述任一项技术方案中，优选地，提示单元208还用于：在接收到物品的图像信息时，生成第三提示信号，其中，第三提示信号用于向用户提示图像采集已完成。
在该技术方案中，通过在接收到物品的图像信息时，生成第三提示信号，提示给用户已经完成了图像采集，有利于用户及时获知物品的图像采集信息和对应的品类信息，有利于实现对物品的管理，提升了用户的交互体验。
另外，第一提示信号、第二提示信号和第三提示信号的发出由蜂鸣器或信号灯来实现。
在上述任一项技术方案中，优选地，物品信息录入系统200还包括：检测单元212，用于在接收到物品信息录入信号时，检测物品的实时位置与指定位置之间的距离。
在该技术方案中，通过在接收到物品信息录入信号时，检测物品的实时位置与指定位置之间的距离，实现了图像采集过程的触发操作，进一步提高了物品信息录入的准确度和效率，进而提升了用户的使用体验。
物品信息录入信号，可以是冰箱门体的打开信号，也可以是用户手动通过开关按钮来发出的物品信息录入信号，还可以是检测到用户有物品进 入的信号。
实施例3：
图3示出了根据本发明的一个实施例的冰箱的示意框图。
如图3示出了根据本发明的一个实施例的冰箱300，包括：如上述本发明的第二方面的技术方案提出的任一项的物品信息录入系统200；图像采集器302，设于冰箱300内，与物品信息录入系统200电连接，以在物品信息录入系统200的控制下采集物品的图像信息；距离传感器304，设于图像采集器302上，与物品信息录入系统200电连接，用于采集物品的实时位置与指定位置之间的距离。
在该技术方案中，冰箱300包括如上述本发明的第二方面的技术方案提出的任一项的物品信息录入系统200，因此具有如上述本发明的第二方面的技术方案提出的任一项的物品信息录入系统200的全部有益效果，在此不再赘述，通过设于冰箱300内的图像采集器302，与物品信息录入系统200电连接，实现了物品信息录入系统200的控制下采集物品的图像信息，通过设于图像采集器302上的距离传感器304，与物品信息录入系统200电连接，实现了对物品的实时位置与指定位置之间的距离的采集，实现了物品信息录入，提升了物品信息录入的准确性和效率，进而提升了用户的使用体验。
实施例4：
图4示出了根据本发明的另一个实施例的物品信息录入方法的示意流程图。
如图4所示，根据本发明的另一个实施例的物品信息录入方法，包括：步骤S402，冰箱开门，图像采集器上电；步骤S404，检测物品与图像采集器的距离是否在图像采集有效范围内；若判定为是，则进入步骤S406，图像采集，生成图像信息，若判定为否则进入步骤S404，重新检测物品与图像采集器的距离是否在图像采集有效范围内；步骤S408，冰箱关门，图像采集器下电；步骤410，Wi-Fi模块将图像信息发送到云服务器；步骤412，云服务器将解析图像信息的特征信息，生成对应的物品品类信息发送到APP，实现了物品信息录入，且录入准确性高。
另外，还可以在Wi-Fi模块将图像信息发送到云服务器，服务器将解析图像信息的特征信息，生成对应的物品品类信息发送到APP，之后再进行冰箱关门，图像采集器下电的操作。
实施例5：
图5示出了根据本发明的再一个实施例的物品信息录入方法的示意流程图。
如图5所示，根据本发明的再一个实施例的物品信息录入方法，步骤S406，图像采集，生成图像信息，具体包括：步骤S502，检测用户手拿物品；步骤S504，物品是否静止t秒；若判定为是，进入步骤S506，图像采集器反馈信号给Wi-Fi模块；同时，进行步骤S512，反馈信号给用户；若判定为否，进入步骤S504，重新判断物品是否静止t秒；步骤S508，Wi-Fi模块给图像采集器发送确认图像采集指令；步骤S510，完成图像采集过程；步骤S512，反馈信号给用户，实现了对物品进行图像采集，生成图像信息，在该过程中，通过与用户的交互，及时向用户提示，以调整物品的拍摄角度和物品的稳定度，进而有利于拍出较准确的图像信息，进而提高了物品信息录入的准确度。
实施例6：
图6示出了根据本发明的又一个实施例的物品信息录入方法的示意流程图。
如图6所示，根据本发明的又一个实施例的物品信息录入方法，步骤S406，图像采集，生成图像信息，具体包括：步骤S602，检测用户手拿物品；步骤S604，检测图像采集器对焦是否完成；若判定为是，进入步骤S606，Wi-Fi模块给图像采集器发送确认图像采集指令；同时，进行步骤S610，反馈信号给用户；若判定为否，进入步骤S604，重新检测图像采集器对焦是否完成；步骤S608，完成图像采集过程；步骤S610，反馈信号给用户，实现了对物品进行图像采集，生成图像信息，在该过程中，通过与用户的交互，及时向用户提示，以调整物品的拍摄角度和物品的稳定度，进而有利于拍出较准确的图像信息，进而提高了物品信息录入的准确度。
实施例7
如图7A和图7B所示，冰箱主板在开关闭合时，会形成物品信息录入 信号，Wi-Fi接收到物品信息录入信号后，会给距离传感器发出检测信号，距离传感器检测物品的实时位置，与指定位置(也就是图像采集器位置)的距离L1，L1是通过如图7B中所示距离传感器与物品之间的距离L2和角度α来确定的，L1的值传到Wi-Fi，Wi-Fi在判定L1的值小于或等与预设距离阈值时，控制摄像头拍照，在拍照的过程中，冰箱主板会根据Wi-Fi生成的提示信号，控制信号指示器向用户反馈拍照的情况，信号指示器可以是蜂鸣器或信号灯，在摄像头完成拍照后，Wi-Fi将图像信息上传到云服务器，云服务器解析图像信息中的特征信息，并同预设信息库做对比，确定物品对应的品类信息后，云服务器将这些品类信息发送至用户的APP，用户就可以根据这个信息进行物品的管理。
以上结合附图详细说明了本发明的技术方案，本发明提出了一种物品信息录入方法、系统和冰箱，通过在检测到物品的实时位置与指定位置之间的距离小于或等于预设距离阈值时，采集物品的图像信息，并解析图像信息中的特征信息，实现了对物品对应的品类信息的确定，提高了图像信息的采集清晰度和有效性，减少了因遮挡和包装袋问题导致物品不能被识别的情况的发生，提升了物品信息录入的准确性和效率，进而提升了用户的使用体验。
本发明方法中的步骤可根据实际需要进行顺序调整、合并和删减。
本发明装置中的单元可根据实际需要进行合并、划分和删减。
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成，该程序可以存储于一计算机可读存储介质中，存储介质包括只读存储器(Read-Only Memory，ROM)、随机存储器(Random Access Memory，RAM)、可编程只读存储器(Programmable Read-only Memory，PROM)、可擦除可编程只读存储器(Erasable Programmable Read Only Memory，EPROM)、一次可编程只读存储器(One-time Programmable Read-Only Memory，OTPROM)、电子抹除式可复写只读存储器(Electrically-Erasable Programmable Read-Only Memory，EEPROM)、只读光盘(Compact Disc Read-Only Memory，CD-ROM)或其他光盘存储器、磁盘存储器、磁带存储器、或者能够用于 携带或存储数据的计算机可读的任何其他介质。
以上所述仅为本发明的优选实施例而已，并不用于限制本发明，对于本领域的技术人员来说，本发明可以有各种更改和变化。凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。

Claims (11)

  1. 一种物品信息录入方法，其特征在于，包括：
    当检测到物品的实时位置与指定位置之间的距离小于或等于预设距离阈值时，采集所述物品的图像信息；
    解析所述图像信息中的特征信息，以确定所述物品对应的品类信息。
  2. 根据权利要求1所述的物品信息录入方法，其特征在于，在所述采集所述物品的图像信息之前，还包括：
    记录时长，并实时检测所述物品的状态；
    若检测到所述物品的状态持续为静态，且所述时长超出预设时长，则开始采集所述物品的图像信息，并生成第一提示信号；
    若检测到所述物品的状态为动态，则生成第二提示信号，并重新记录所述时长，
    其中，所述第一提示信号用于向用户提示图像采集正在进行中，所述第二提示信号用于向用户提示准备图像采集。
  3. 根据权利要求1或2所述的物品信息录入方法，其特征在于，在所述采集所述物品的图像信息之前，还包括：
    获取对焦信号；
    当所述对焦信号为对焦完成时，开始采集所述物品的图像信息，并生成所述第一提示信号；
    当所述对焦信号为对焦未完成时，生成所述第二提示信号，并重新获取所述对焦信号，
    其中，所述第一提示信号用于向用户提示图像采集正在进行中，所述第二提示信号用于向用户提示准备图像采集。
  4. 根据权利要求3所述的物品信息录入方法，其特征在于，还包括：
    在接收到所述物品的图像信息时，生成第三提示信号，
    其中，所述第三提示信号用于向用户提示图像采集已完成。
  5. 根据权利要求1所述的物品信息录入方法，其特征在于，在所述采集所述物品的图像信息之前，还包括：
    在接收到物品信息录入信号时，检测所述物品的实时位置与所述指定位置之间的距离。
  6. 一种物品信息录入系统，其特征在于，包括：
    采集单元，用于在检测到物品的实时位置与指定位置之间的距离小于或等于预设距离阈值时，采集所述物品的图像信息；
    解析单元，用于解析所述图像信息中的特征信息，以确定所述物品对应的品类信息。
  7. 根据权利要求6所述的物品信息录入系统，其特征在于，还包括：
    记录单元，用于记录时长，并实时检测所述物品的状态；
    所述采集单元还用于：在检测到所述物品的状态持续为静态，且所述时长超出预设时长时，开始采集所述物品的图像信息，并生成第一提示信号；
    提示单元，用于在检测到所述物品的状态为动态时，则生成第二提示信号，并重新记录所述时长，
    其中，所述第一提示信号用于向用户提示图像采集正在进行中，所述第二提示信号用于向用户提示准备图像采集。
  8. 根据权利要求6或7所述的物品信息录入系统，其特征在于，还包括：
    获取单元，用于获取对焦信号；
    所述采集单元还用于：在所述对焦信号为对焦完成时，开始采集所述物品的图像信息，并生成所述第一提示信号；
    所述提示单元还用于：在所述对焦信号为对焦未完成时，生成所述第二提示信号，并重新获取所述对焦信号，
    其中，所述第一提示信号用于向用户提示图像采集正在进行中，所述第二提示信号用于向用户提示准备图像采集。
  9. 根据权利要求8所述的物品信息录入系统，其特征在于，
    所述提示单元还用于：在接收到所述物品的图像信息时，生成第三提示信号，
    其中，所述第三提示信号用于向用户提示图像采集已完成。
  10. 根据权利要求6所述的物品信息录入系统，其特征在于，还包括：
    检测单元，用于在接收到物品信息录入信号时，检测所述物品的实时位置与所述指定位置之间的距离。
  11. 一种冰箱，其特征在于，包括：
    如权利要求6至10中任一项所述的物品信息录入系统；
    图像采集器，设于所述冰箱内，与所述物品信息录入系统电连接，以在所述物品信息录入系统的控制下采集物品的图像信息；
    距离传感器，设于所述图像采集器上，与所述物品信息录入系统电连接，用于采集所述物品的实时位置与指定位置之间的距离。
PCT/CN2017/113174 2017-07-26 2017-11-27 物品信息录入方法、系统和冰箱 WO2019019499A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710617137.5A CN107525342B (zh) 2017-07-26 2017-07-26 物品信息录入方法、系统和冰箱
CN201710617137.5 2017-07-26

Publications (1)

Publication Number Publication Date
WO2019019499A1 true WO2019019499A1 (zh) 2019-01-31

Family

ID=60680284

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/113174 WO2019019499A1 (zh) 2017-07-26 2017-11-27 物品信息录入方法、系统和冰箱

Country Status (2)

Country Link
CN (1) CN107525342B (zh)
WO (1) WO2019019499A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108224895B (zh) * 2018-01-08 2020-11-10 合肥美的智能科技有限公司 基于深度学习的物品信息录入方法、装置、冰箱和介质
CN108717576B (zh) * 2018-03-09 2022-08-05 天津大学 基于语音识别的工具管理系统
CN109413383A (zh) * 2018-10-11 2019-03-01 海信（山东）冰箱有限公司 一种冰箱内部食材图像的获取方法、冰箱及图像识别系统
CN109902733A (zh) * 2019-02-22 2019-06-18 北京三快在线科技有限公司 录入物品信息的方法、装置及存储介质
CN110769204B (zh) * 2019-11-13 2021-04-30 秒针信息技术有限公司 图像采集的管理方法和装置

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103776232A (zh) * 2013-11-05 2014-05-07 四川长虹电器股份有限公司 一种基于图像识别的光合保鲜冰箱及其实现方法
CN104061749A (zh) * 2013-03-18 2014-09-24 海尔集团公司 一种冰箱内食品存储位置记录方法、装置、终端及冰箱
CN104482715A (zh) * 2014-12-31 2015-04-01 合肥华凌股份有限公司 冰箱中食物的管理方法和冰箱
CN105043005A (zh) * 2015-06-16 2015-11-11 合肥华凌股份有限公司 一种冰箱食品信息管理系统和方法
CN105164481A (zh) * 2013-04-10 2015-12-16 Lg电子株式会社 利用影像识别的冰箱的保管品目管理方法及其冰箱
CN105352260A (zh) * 2015-11-10 2016-02-24 合肥海尔电冰箱有限公司 冰箱内储物信息的更新方法及装置
CN105737477A (zh) * 2016-04-21 2016-07-06 合肥华凌股份有限公司 一种冰箱
CN105758108A (zh) * 2016-03-09 2016-07-13 北京京东尚科信息技术有限公司 用于智能冷藏设备的信息反馈方法和装置
CN105841434A (zh) * 2016-05-25 2016-08-10 海信（山东）冰箱有限公司 一种冰箱及其控制方法
CN106123479A (zh) * 2016-07-06 2016-11-16 辽宁科技学院 冰箱的食材自动录入方法
WO2016196618A1 (en) * 2015-06-05 2016-12-08 Elwha Llc Smart refrigerator
CN106382789A (zh) * 2016-08-30 2017-02-08 青岛海尔股份有限公司 冰箱内储物信息的管理方法与冰箱
EP3128274A1 (en) * 2015-08-05 2017-02-08 Whirlpool Corporation Object recognition system for an appliance and method for managing household inventory of consumables
CN106907890A (zh) * 2017-02-23 2017-06-30 海信（山东）冰箱有限公司 一种智能冰箱的食材管理方法及智能冰箱

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103024178B (zh) * 2012-12-13 2015-07-08 广东欧珀移动通信有限公司 一种拍照的方法及装置
JP6550696B2 (ja) * 2014-07-18 2019-07-31 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 判定装置、および、判定方法
JP6571407B2 (ja) * 2015-06-23 2019-09-04 シャープ株式会社 庫内撮影装置
CN106454137A (zh) * 2016-12-07 2017-02-22 深圳市传奇数码有限公司 一种手机v型手势自动拍照方法
CN106791392B (zh) * 2016-12-20 2020-12-15 美的集团股份有限公司 食物信息的获取方法、获取装置和终端
CN106643503A (zh) * 2017-01-09 2017-05-10 宇龙计算机通信科技(深圳)有限公司 一种物体信息检测方法及其终端

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104061749A (zh) * 2013-03-18 2014-09-24 海尔集团公司 一种冰箱内食品存储位置记录方法、装置、终端及冰箱
CN105164481A (zh) * 2013-04-10 2015-12-16 Lg电子株式会社 利用影像识别的冰箱的保管品目管理方法及其冰箱
CN103776232A (zh) * 2013-11-05 2014-05-07 四川长虹电器股份有限公司 一种基于图像识别的光合保鲜冰箱及其实现方法
CN104482715A (zh) * 2014-12-31 2015-04-01 合肥华凌股份有限公司 冰箱中食物的管理方法和冰箱
WO2016196618A1 (en) * 2015-06-05 2016-12-08 Elwha Llc Smart refrigerator
CN105043005A (zh) * 2015-06-16 2015-11-11 合肥华凌股份有限公司 一种冰箱食品信息管理系统和方法
EP3128274A1 (en) * 2015-08-05 2017-02-08 Whirlpool Corporation Object recognition system for an appliance and method for managing household inventory of consumables
CN105352260A (zh) * 2015-11-10 2016-02-24 合肥海尔电冰箱有限公司 冰箱内储物信息的更新方法及装置
CN105758108A (zh) * 2016-03-09 2016-07-13 北京京东尚科信息技术有限公司 用于智能冷藏设备的信息反馈方法和装置
CN105737477A (zh) * 2016-04-21 2016-07-06 合肥华凌股份有限公司 一种冰箱
CN105841434A (zh) * 2016-05-25 2016-08-10 海信（山东）冰箱有限公司 一种冰箱及其控制方法
CN106123479A (zh) * 2016-07-06 2016-11-16 辽宁科技学院 冰箱的食材自动录入方法
CN106382789A (zh) * 2016-08-30 2017-02-08 青岛海尔股份有限公司 冰箱内储物信息的管理方法与冰箱
CN106907890A (zh) * 2017-02-23 2017-06-30 海信（山东）冰箱有限公司 一种智能冰箱的食材管理方法及智能冰箱

Also Published As

Publication number Publication date
CN107525342A (zh) 2017-12-29
CN107525342B (zh) 2020-04-21

Similar Documents

Publication Publication Date Title
WO2019019499A1 (zh) 物品信息录入方法、系统和冰箱
US9942711B2 (en) Apparatus and method for determining co-location of services using a device that generates an audio signal
US20200380251A1 (en) Methods and apparatus to monitor environments
US10306221B2 (en) Display device on/off detection methods and apparatus
CN104813675B (zh) 使辅助内容与主媒体内容的并行馈送时间同步
US20160057374A1 (en) Display device, remote control device to control display device, method of controlling display device, method of controlling server and method of controlling remote control device
US20130258084A1 (en) Hybrid active and passive people metering for audience measurement
CN110460905A (zh) 基于多设备的视频自动续播方法、装置及存储介质
US20140278933A1 (en) Methods and apparatus to measure audience engagement with media
WO2019149160A1 (zh) 人机交互方法、装置、计算机设备和存储介质
US20130043977A1 (en) Methods and systems for speaker identity verification
CN105488957A (zh) 疲劳驾驶检测方法及装置
CN106653014A (zh) 智能家居的语音控制方法和智能家居的语音控制装置
WO2019153378A1 (zh) 扫地机器人的安防方法及装置
WO2019218656A1 (zh) 一种智能电视、其截屏应用方法及存储介质
WO2019052053A1 (zh) 白板信息读取方法、装置、可读存储介质和电子白板
WO2019237008A1 (en) Remote recording and data reporting systems and methods
CN109314798A (zh) 情境驱动式内容快倒
CN110874554B (zh) 动作识别方法、终端设备、服务器、系统及存储介质
WO2018045839A1 (zh) 用于智能冰箱的购物触发方法、设备和计算机可读存储介质
CN111090412A (zh) 一种音量调节方法、装置及音频设备
JP2012222464A (ja) 自動録画機能を有する映像表示装置および録画装置並びに自動録画方法
KR20200060331A (ko) 음성 인식을 이용한 주문 처리 시스템 및 그 주문 처리 방법
JP2022111162A (ja) 運転状況監視装置、運転状況監視システム、運転状況監視方法、ドライブレコーダ
TWI750843B (zh) 具影像辨識之酒精偵測紀錄系統及其方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17919230

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17919230

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 24/08/2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17919230

Country of ref document: EP

Kind code of ref document: A1