CN108626959A - Approaches to IM, system, intelligent refrigerated equipment and intelligent domestic system - Google Patents

Approaches to IM, system, intelligent refrigerated equipment and intelligent domestic system Download PDF

Info

Publication number
CN108626959A
CN108626959A CN201710158725.7A CN201710158725A CN108626959A CN 108626959 A CN108626959 A CN 108626959A CN 201710158725 A CN201710158725 A CN 201710158725A CN 108626959 A CN108626959 A CN 108626959A
Authority
CN
China
Prior art keywords
article
image
intelligent refrigerated
shelf
refrigerated equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710158725.7A
Other languages
Chinese (zh)
Inventor
关煜
郑磊
曾祥云
何祎鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Original Assignee
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Century Trading Co Ltd, Beijing Jingdong Shangke Information Technology Co Ltd filed Critical Beijing Jingdong Century Trading Co Ltd
Priority to CN201710158725.7A priority Critical patent/CN108626959A/en
Publication of CN108626959A publication Critical patent/CN108626959A/en
Pending legal-status Critical Current

Links

Classifications

    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00Arrangement or mounting of control or safety devices
    • F25D29/003Arrangement or mounting of control or safety devices for movable devices
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2500/00Problems to be solved
    • F25D2500/06Stock management
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25DREFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2700/00Means for sensing or measuring; Sensors therefor
    • F25D2700/02Sensors detecting door opening

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Thermal Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

The invention discloses a kind of approaches to IM of intelligent refrigerated equipment, including:Obtain the image of article in the intelligent refrigerated equipment;The presentation image to be presented to the user is generated based on described image;Receive the selected instruction to the article in the presentation image;It is and in response to the selected instruction, chosen article is associated with the setting information of the article.The invention also discloses a kind of information management systems, a kind of intelligent refrigerated equipment and a kind of intelligent domestic system for intelligent refrigerated equipment.

Description

Approaches to IM, system, intelligent refrigerated equipment and intelligent domestic system
Technical field
The present invention relates to Smart Home technical field more particularly to a kind of approaches to IM of intelligent refrigerated equipment, letters Cease management system, intelligent refrigerated equipment and intelligent domestic system.
Background technology
With the increasingly raising of the progress and people's living standard of science and technology, smart home is dissolved into people more and more Daily life in, provide various facilities and the usage experience of hommization to the user.Refrigerating equipment, such as refrigerator, refrigerator-freezer etc., It is one of most common household electrical appliance.User stores various articles using refrigerating equipment, such as food, drug or other needs are cold The article etc. of Tibetan.In realizing process of the present invention, inventor has found that at least there are the following problems in the prior art:Now not A kind of effective means effectively manage the information of chilled goods.User can only be remembered by oneself or be checked by hand It can just know that the relevant information of article, underaction are convenient.
Invention content
The present invention is proposed to solve at least one above problem in the prior art.
One aspect of the present invention provides a kind of approaches to IM of intelligent refrigerated equipment, including:Obtain the intelligence The image of article in energy refrigerating equipment;The presentation image to be presented to the user is generated based on described image;It receives to the presentation The selected instruction of article in image;And in response to the selected instruction, the setting of chosen article with the article is believed Manner of breathing is associated with.
Another aspect of the present invention provides a kind of information management system of intelligent refrigerated equipment, including:Image obtains Module obtains the image of article in the intelligent refrigerated equipment;Image generation module will be presented to use based on described image generation The presentation image at family;Selected command reception module receives the selected instruction to the article in the presentation image;And association mould Block, it is in response to the selected instruction, chosen article is associated with the setting information of the article.
Another aspect of the present invention provides a kind of information management system of intelligent refrigerated equipment, including:It is at least one Processor;And at least one processor, it is stored with computer-readable instruction, described instruction is when being executed by processor so that Processor executes method as described above.
Another aspect of the present invention provides a kind of intelligent refrigerated equipment, including information management system as described above.
Another aspect of the present invention provides a kind of intelligent domestic system, including intelligent refrigerated equipment, server, and At least one terminal device, wherein:The intelligent refrigerated equipment includes:Taking module is configured to obtain described intelligent refrigerated set The image of standby interior article;And detection module, it is configured to detect enabling or the door-closing operation of the intelligent refrigerated equipment, wherein When detection module detects enabling or the door-closing operation of the intelligent refrigerated equipment, it is cold that the taking module obtains the intelligence Hide the image of the article in equipment;The server includes information management system described above;And the server passes through The intelligent refrigerated equipment and/or the terminal device are interacted with user.
Another aspect of the present invention provides a kind of computer readable storage medium, is stored with computer-readable instruction, Described instruction is when being executed by processor so that processor executes method as described above.
According to an embodiment of the invention, effective intelligence to the article setting information in intelligent refrigerated equipment can be realized Management, greatly facilitates user.
Description of the drawings
For a more complete understanding of the present invention and its advantage, referring now to being described below in conjunction with attached drawing, wherein:
Fig. 1 is the flow diagram for the approaches to IM for showing intelligent refrigerated equipment according to the ... of the embodiment of the present invention;
Fig. 2 is the application scenarios signal for showing intelligent refrigerated equipment information management method according to the ... of the embodiment of the present invention Figure;
Fig. 3 is the structural schematic diagram for the information management system for showing intelligent refrigerated equipment according to the ... of the embodiment of the present invention;
Fig. 4 is the structural schematic diagram for the information system for showing intelligent refrigerated equipment according to the ... of the embodiment of the present invention;
Fig. 5 is the structural schematic diagram for showing intelligent refrigerated equipment according to the ... of the embodiment of the present invention;
Fig. 6 is the structure diagram for showing intelligent domestic system according to the ... of the embodiment of the present invention.
Specific implementation mode
According in conjunction with attached drawing to the described in detail below of exemplary embodiment of the present, other aspects of the invention, advantage Those skilled in the art will become obvious with prominent features.
In the present invention, term " comprising " and " containing " and its derivative mean including and it is unrestricted;Term "or" is packet Containing property, mean and/or.
In the present specification, following various embodiments for describing the principle of the invention only illustrate, should not be with any Mode is construed to the range of limitation invention.With reference to attached drawing the comprehensive understanding described below that is used to help by claim and its equivalent The exemplary embodiment of the present invention that object limits.It is described below to help to understand including a variety of details, but these details are answered Think to be only exemplary.Therefore, it will be appreciated by those of ordinary skill in the art that without departing substantially from scope and spirit of the present invention In the case of, embodiment described herein can be made various changes and modifications.In addition, for clarity and brevity, The description of known function and structure is omitted.In addition, running through attached drawing, same reference numbers are used for identity function and operation.
Shown in the drawings of some block diagrams and/or flow chart.It should be understood that some sides in block diagram and/or flow chart Frame or combinations thereof can be realized by computer program instructions.These computer program instructions can be supplied to all-purpose computer, The processor of special purpose computer or other programmable data processing units, to which these instructions can be with when being executed by the processor Create the device for realizing function/operation illustrated in these block diagrams and/or flow chart.
Therefore, the technology of the disclosure can be realized in the form of hardware and/or software (including firmware, microcode etc.).Separately Outside, the technology of the disclosure can take the form of the computer program product on the computer-readable medium for being stored with instruction, should Computer program product uses for instruction execution system.In the context of the disclosure, computer-readable medium can be energy Enough include, store, transmitting, propagating or transmitting the arbitrary medium of instruction.For example, computer-readable medium can include but is not limited to Electricity, magnetic, optical, electromagnetic, infrared or semiconductor system, device, device or propagation medium.The specific example packet of computer-readable medium It includes:Magnetic memory apparatus, such as tape or hard disk (HDD);Light storage device, such as CD (CD-ROM);Memory, as arbitrary access is deposited Reservoir (RAM) or flash memory;And/or wire/wireless communication link.
Intelligent refrigerated equipment, such as may include that intelligentized control method is carried out to refrigerating equipment and/or intelligence is carried out to article Change refrigerating equipment type of management, such as intelligent refrigerator, intelligent refrigerator-freezer etc., but not limited to this.
A present invention at least embodiment provides a kind of approaches to IM of intelligent refrigerated equipment, and Fig. 1 is to show basis The flow diagram of the approaches to IM of the intelligent refrigerated equipment of the embodiment of the present invention.The approaches to IM can be in intelligence Refrigerating equipment is locally realized, can also be realized at another equipment (such as server) being connected with intelligent refrigerated equipment.
As shown in Figure 1, the approaches to IM for intelligent refrigerated equipment of the present embodiment starts from step S100.
In step S101, the image of article in intelligent refrigerated equipment is obtained;
In step S102, the presentation image to be presented to the user is generated based on described image;
In step S103, the selected instruction to the article in the presentation image is received;
It is in response to the selected instruction, chosen article is associated with the setting information of the article in step S104.
This method terminates in step S105.
The approaches to IM of the intelligent refrigerated equipment of the present embodiment, by the figure for obtaining article in intelligent refrigerated equipment Picture generates the presentation image to be presented to the user based on described image, receives the selected finger to the article in the presentation image It enables, it is in response to selected instruction, chosen article is associated with the setting information of the article, believed with the setting of typing article Breath.Using this programme, the intelligent life application of intelligent refrigerated equipment has been expanded so that between user and intelligent refrigerated equipment The more convenient, hommization of interaction and intelligence, effectively increase the usage experience of user.By intelligent recognition and store associated Article setting information, do not need the excessive manual intervention of user, simplify user's operation, realize the intelligence of Item Information Management.
The above method is described in detail below with reference to Fig. 1.
Specifically, in step S101, the image of article in intelligent refrigerated equipment is obtained.
It according to an embodiment of the invention, can be directly cold from intelligence when this method is when intelligent refrigerated equipment locally executes It hides equipment and locally obtains the image.Alternatively, when this method is when server executes, can be set from intelligent refrigerated by communication network It is standby to obtain the image.
The image of article in intelligent refrigerated equipment can detected intelligent refrigerated equipment enabling or shooting at closing time 's.For example, according to embodiments of the present invention, multiple cameras can be arranged in intelligent refrigerated equipment, be located at intelligent refrigerated set In standby door area and babinet.Intelligent refrigerated equipment can also include detection sensor, the enabling for detecting intelligent refrigerated equipment Or door-closing operation.When the enabling or door-closing operation for detecting intelligent refrigerated equipment, positioned at taking the photograph for the door area of intelligent refrigerated equipment As the image of the article in head shooting babinet, it is located at the image of the camera of the babinet then article in capture gate area.
According to an embodiment of the invention, detection switch can be set at the contact position of door and babinet, when door and babinet Closed state change when detection switch be switched on or switched off, then obtain the image of article in intelligent refrigerated equipment.According to the present invention Embodiment, the direction of relative movement of the door and babinet that can also detect intelligent refrigerated equipment (such as direction of rotation, moves toward one another Direction or back movement direction) and/or amount of relative motion (such as rotation angle or movement travel), when the relative motion side of the two To and/or amount of relative motion reach corresponding predetermined threshold value when, then obtain the image of article in intelligent refrigerated equipment.
According to an embodiment of the invention, user open intelligent refrigerated equipment during carry out Image Acquisition, can and When remind user that will reach the article of shelf-life;Image Acquisition is carried out during user closes intelligent refrigerated equipment, it can The article being newly put into easily typing and setting shelf-life.
In step S102, the presentation image to be presented to the user is generated based on described image.
According to an embodiment of the invention, it may include identification to generate the presentation image to be presented to the user based on described image Article in described image, and label is added to the article identified.Alternatively, to be presented to the user based on described image generation Presentation image may include by the image of described image and single item in the last intelligent refrigerated equipment obtained into Row compares, and recognizes in the upper intelligent refrigerated equipment once obtained already present article in the image of article, and to distinguishing The article recognized adds the label.Alternatively, the presentation image to be presented to the user is generated based on described image, and without institute State identification and/or identification.
In some optional realization methods of the present embodiment, need to be trained in advance before image recognition, training process It can be acquisition training image sample data, then include to sample data:Analog-to-digital conversion, binaryzation, image it is smooth, Transformation enhances, and restores, and the pretreatment operations such as filtering then carry out feature extraction and selection, most to pretreated image data Multiple disaggregated models are trained to the feature extracted afterwards;When carrying out image recognition, first to collected images of items into Row includes:Analog-to-digital conversion, binaryzation, smooth, the transformation of image, enhancing restore, the pretreatment operations such as filtering, then to locating in advance Image data after reason carries out feature extraction and selection, finally carries out each model in the feature and disaggregated model that extract Select the highest disaggregated model of matching degree as recognition result after matching.It should be noted that the technology of above-mentioned image recognition is The known technology studied and applied extensively at present, details are not described herein.
According to an embodiment of the invention, it after the article in identifying and/or recognizing image, can also generate to image Middle identification and/or the article recognized have added tagged image, and send and added tagged image.The mark of the present embodiment Label include but not limited to shooting time, identity number, goods categories or the article shelf-life etc..Reality according to the present invention Example is applied, when this method is when intelligent refrigerated equipment locally executes, can directly send the image to the aobvious of intelligent refrigerated equipment Showing device is to be presented to the user.Alternatively, when this method is when server executes, can be sent the image to by communication network The display device of intelligent refrigerated equipment or the display device of user terminal, to be presented to the user.Added by display tagged Image understands the relevant information of the article in intelligent refrigerated equipment in which can make user's intuitive and convenient.For example, for being associated with The article of shelf-life can make user easily understand its shelf-life.
In step S103, the selected instruction to the article in image is presented is received.
According to embodiments of the present invention, user can be by pre-set for inputting setting for instruction in intelligent refrigerated equipment It is standby, such as keyboard, touch tablet, touch screen etc., input the selected instruction.According to an embodiment of the invention, it receives to described image The selected instruction of middle article may include receiving to click instruction and/or reception to being not added with mark to the article added with label The frame choosing instruction of the article of label.
For example, for the article for identifying and/or recognizing, user can be allowed to be selected by clicking, for not known The article not also being identified out can allow user to pass through frame choosing to select.For direct without identifying and/or recognizing The presentation image of generation can select article therein by frame choosing with user.
It is in response to selected instruction, chosen article is associated with the setting information of the article in step S104, with record Enter the setting information of article.
In embodiments of the present invention, setting information for example may include the shelf-life information of article, can also be arbitrary pre- If information or information input by user, for example, the title of article, eating method, calorie value, etc., but not limited to this.
In embodiments of the present invention, by chosen article it is associated with the setting information of the article may include article Any one of the adjustment of the default shelf-life of the setting of default shelf-life, the determination of the default shelf-life of article and article.
According to embodiments of the present invention, the information input window corresponding to chosen article is provided, receives user to information The information of input window input, and the default shelf-life for the article being selected according to information setting input by user.For example, it is assumed that User selectes article " Yoghourt ", then can send input window, and user inputs the information of the image of corresponding Yoghourt to input window " 3 days ", then the default shelf-life of Yoghourt is to be set as 3 days.
According to an embodiment of the invention, the suggestion shelf-life corresponding to chosen article can also be provided, user is received To the determine instruction for suggesting the shelf-life, and according to the shelf-life information of the chosen article of determine instruction setting.It builds The view shelf-life preset can obtain according to the classification of article and with the category associated shelf-life.For example, it is assumed that user is selected Article " Yoghourt " can then send the suggestion shelf-life " 3 days " corresponding to selected Yoghourt, and user is to suggesting shelf-life information " 3 It " click " confirmation " operation, then the shelf-life information of Yoghourt is to be determined as 3 days.It guarantees the quality alternatively, user can also edit suggestion Phase, such as " 3 days " are changed to " 2 days ".
According to embodiments of the present invention, the range selection window corresponding to the suggestion shelf-life of chosen article can be provided Mouthful, user is received to suggesting the selection instruction of the range of shelf-life, and chosen article is set according to the selection instruction Shelf-life information can then send the range selection window of suggestion shelf-life for example, it is assumed that the selected article " Yoghourt " of user, such as From 2 days to 4 day.Range selection window of the user in the suggestion shelf-life selects the information " 3 days " of the image of Yoghourt, then Yoghourt Shelf-life is determined as 3 days.
According to embodiments of the present invention, which can also include that step reception refers to the elimination of shelf-life information It enables, and is instructed in response to eliminating, eliminate the setting for presetting the shelf-life.
It according to an embodiment of the invention, can be defeated by above- mentioned information when this method is when intelligent refrigerated equipment locally executes Enter window, suggest that shelf-life or range selection window etc. are sent to the display device of intelligent refrigerated equipment, and is set from intelligent refrigerated Standby input unit receives user's input, determine instruction or selection instruction.It, can be with alternatively, when this method is when server executes Above- mentioned information input window, suggestion shelf-life or range selection window etc. are sent to intelligent refrigerated equipment by communication network Or the display device of user terminal, and correspondingly inputted from the input unit or user terminal of intelligent refrigerated equipment reception user, Determine instruction or selection instruction.
According to embodiments of the present invention, the approaches to IM of the present embodiment can also include determining depositing for the article identified Duration is stored up, and judges to store whether duration meets prompting rule, if so, sending prompting message.For example, determining that storage duration can To include searching shooting time for the first time corresponding with the article identified from database, according to shooting time for the first time and this The difference of shooting time or current time determines storage duration.For example, being searched from database corresponding with the apple identified Shooting time for the first time be " 30 divide when 6 days 12 January in 2017 ", this shooting time be " 30 divide when 10 days 4 January in 2017 ", A length of 4 days 0 two hours when storage are calculated.It is 3 days a length of when reminding regular scheduled prompting assuming that the shelf-life is 7 days, It then stores duration and the difference of shelf-life information is less than scheduled prompting duration 3 days, meet and remind rule, then send and remind letter Breath " shelf-life is 3 days remaining ", as shown in Figure 2.
According to embodiments of the present invention, the shooting time for the first time of article can be determined according to the identity number of image, wherein Identity number can be determined based on the recognition result of article and scheduled coding rule, for each identity number, Corresponding shooting time for the first time is recorded in database.
Fig. 3 is the structural representation for the information management system 300 for showing intelligent refrigerated equipment according to the ... of the embodiment of the present invention Figure.As shown in figure 3, the information management system 300 of the intelligent refrigerated equipment of the present embodiment may include image collection module 301, Image generation module 302, selected command reception module 303 and relating module 304.The information management system 300 can be in intelligence Energy refrigerating equipment is locally realized, can also be realized in the server for being communicatively connected to intelligent refrigerated equipment.
In the present embodiment, image collection module 301 obtains the image of article in intelligent refrigerated equipment, such as executes above With reference to the operation for the step S101 that figure 1 describes.
Image generation module 302 generates the presentation image to be presented to the user based on described image, such as executes ginseng above Examine the operation of the step S102 of Fig. 1 descriptions.
Selected command reception module 303 receives the selected instruction of the article to being identified in the presentation image, such as holds Operation of the row above with reference to Fig. 1 step S103 described.
Relating module 304 is associated with the setting information of the article by chosen article in response to the selected instruction, Such as execute operation above with reference to Fig. 1 step S104 described.
In embodiments of the present invention, setting information for example may include the shelf-life information of article, can also be arbitrary pre- If information or information input by user, for example, the title of article, eating method, calorie value, etc., but not limited to this.
According to an embodiment of the invention, by chosen article it is associated with the setting information of the article may include providing Corresponding to the information that the information input window of chosen article, reception user are inputted to described information input window, and according to The shelf-life information of the chosen article of information setting input by user.
According to an embodiment of the invention, by chosen article it is associated with the setting information of the article may include providing Corresponding to the suggestion shelf-life of chosen article, user is received to the determine instruction for suggesting the shelf-life, and according to described The shelf-life information of the chosen article of determine instruction setting.
According to an embodiment of the invention, by chosen article it is associated with the setting information of the article may include providing Corresponding to the range selection window of the suggestion shelf-life of chosen article, selection of the user to the range of suggestion shelf-life is received Instruction, and according to the shelf-life information of the chosen article of selection instruction setting.
It according to an embodiment of the invention, can will when the information management system 300 is when intelligent refrigerated equipment locally executes Above- mentioned information input window suggests that shelf-life or range selection window etc. are sent to the display device of intelligent refrigerated equipment, and from The input unit of intelligent refrigerated equipment receives user's input, determine instruction or selection instruction.Alternatively, working as the information management system 300 when realizing on the server, can by communication network by above- mentioned information input window, suggest that shelf-life or range select Window etc. is sent to intelligent refrigerated equipment or the display device of user terminal, and correspondingly from the input unit of intelligent refrigerated equipment Or user terminal receives user's input, determine instruction or selection instruction.
According to embodiments of the present invention, when information management system 300 intelligent refrigerated equipment locally realize when, can directly by The presentation image is sent to the display device of intelligent refrigerated equipment to be presented to the user.Alternatively, when this method is executed in server When, the presentation image can be sent to the display device of intelligent refrigerated equipment by communication network or the display of user terminal fills It sets, to be presented to the user.Add tagged image by display, understands intelligent refrigerated equipment while user's intuitive and convenient can be made In article relevant information.According to embodiments of the present invention, above-mentioned label may include it is following in it is any one or more:Institute State the shooting time of image, the identity recognition number of the article or the article classification.
According to an embodiment of the invention, information management system 300 can also include determining module 305, what determination identified Or the storage duration and reminding module 306 for the article recognized, judge whether the storage duration meets prompting rule, if It is then to send prompting message.
According to an embodiment of the invention, information management system 300 can also include eliminating command reception module 307, receive It to the elimination instruction of shelf-life information and cancellation module 308, is instructed in response to the elimination, eliminates setting for shelf-life information It is fixed.
According to an embodiment of the invention, information management system 300 can also include searching module 309, be looked into from database Look for shooting time for the first time corresponding with the article identified.Determining module 305 is according to the shooting time for the first time and this bat The difference for taking the photograph the time determines storage duration.
It should be appreciated that the image collection module 301 of the present embodiment, image generation module 302, selected command reception module 303, relating module 304, determining module 305, reminding module 306, eliminate command reception module 307, cancellation module 308 and Searching module 309, which may be incorporated in a module, to be realized or any one module therein can be split into multiple moulds Block.Alternatively, at least partly function of one or more of these modules module can be at least partly function of other modules It is combined, and is realized in a module.According to an embodiment of the invention, image collection module 301, image generation module 302, Selected command reception module 303, relating module 304, determining module 305, reminding module 306, eliminate command reception module 307, At least one in cancellation module 308 and searching module 309 can at least be implemented partly as hardware circuit, such as existing Field programmable gate array (FPGA), programmable logic array (PLA), system on chip, the system on substrate, the system in encapsulation, Application-specific integrated circuit (ASIC), or can be for carrying out the hardware such as any other rational method that is integrated or encapsulating to circuit Or firmware realizes, or realized with software, the appropriately combined of hardware and firmware three kinds of realization methods.Alternatively, image obtains Module 301, image generation module 302, selected command reception module 303, relating module 304, determining module 305, reminding module 306, at least one eliminated in command reception module 307, cancellation module 308 and searching module 309 can be at least by part Ground is embodied as computer program module, when the program is run by computer, can execute the function of corresponding module.
Fig. 4 is the structural schematic diagram for the information management system for showing intelligent refrigerated equipment according to the ... of the embodiment of the present invention. Information management system 400 include processor 410, such as general purpose microprocessor, instruction set processor and/or related chip group and/ Or special microprocessor (for example, application-specific integrated circuit (ASIC)), etc..Processor 410 can also include for caching purposes Onboard storage device.Processor 410 can be performed for the flow according to the method for the embodiment of the present invention described with reference to figure 1 The single-processor of difference action either multiple processors.
Information management system 400 can also include have it is non-volatile or form of volatile memory at least one readable Storage medium 420, such as can be the arbitrary medium can include, store, transmitting, propagating or transmitting instruction.For example, readable deposit Storage media can include but is not limited to electricity, magnetic, optical, electromagnetic, infrared or semiconductor system, device, device or propagation medium.It is readable The specific example of storage medium includes:Magnetic memory apparatus, such as tape or hard disk (HDD);Light storage device, such as CD (CD- ROM);Memory, such as random access memory (RAM) or flash memory;And/or wire/wireless communication link.
Readable storage medium storing program for executing 420 includes computer program 421, which includes code/computer-readable finger It enables, processor 410 is allow to execute for example above in conjunction with method flow described in Fig. 1 when being executed by processor 410 And its any deformation.
Computer program 421 can be configured with such as computer program code including computer program module.Example Such as, in the exemplary embodiment, the code in computer program 421 may include one or more program modules, such as including 421A, module 421B ... module 421F.It should be noted that the dividing mode and number of module are not fixed, this field skill Art personnel can be combined according to actual conditions using suitable program module or program module, when the combination of these program modules is located When managing the execution of device 410 so that processor 410 can execute for example above in conjunction with method flow described in Fig. 1 and its any change Shape.
According to an embodiment of the invention, it is generated in conjunction with the image collection module 301 of above-mentioned embodiment illustrated in fig. 3, image Module 302, relating module 304, determining module 305, reminding module 306, eliminates command reception at selected command reception module 303 Module 307, cancellation module 308 and searching module 309 can be implemented as the computer program module described with reference to figure 4, When being executed by processor 410, corresponding operating described above may be implemented.
Fig. 5 is the structural schematic diagram for showing intelligent refrigerated equipment 500 according to the ... of the embodiment of the present invention.As shown in figure 5, intelligence Can refrigerating equipment 500 include with reference to the information management system 300 that figure 3 describes or the information management system 400 described with reference to figure 4, Further include taking module 510 and detection module 520.Taking module 510 is configured to obtain intelligent refrigerated set for example including camera The image of standby interior article.Detection module 520 is configured to examine for example including pressure sensor, optical sensor or motion sensor Survey enabling or the door-closing operation of intelligent refrigerated equipment.When detection module 520 detects the enabling or shutdown of intelligent refrigerated equipment 500 When operation, taking module 510 obtains the image of the article in intelligent refrigerated equipment 500.Information management system 300 or 400 bases The image of shooting carries out the operation described above with reference to Fig. 1.
For example, the position of taking module 510 can be determined according to the construction inside intelligent refrigerated equipment, to reach comprehensive bat Take the photograph the purpose of article in intelligent refrigerated equipment.For example, camera can be set on intelligent refrigerated equipment inner bin and intelligence On the door of refrigerating equipment, to shoot the image of article in intelligent refrigerated equipment comprehensively;It, can be with when refrigerating equipment is divided into multilayer In every layer of the one or more cameras of top setting.In order to reduce the setting quantity of camera, camera can also use wide (each spherical camera includes the camera at multiple visual angles, to shoot the intelligence of different visual angles for angle camera or spherical camera Article in refrigerating equipment).In order to ensure the article shot image clarity, camera can also configure supplementary lighting module and exist Shooting image carries out light filling when lacking light.
According to the present embodiment, picture shooting, prompting message, which are generated and presented, locally to be completed in intelligent refrigerated equipment, is integrated Degree is high, and user is not required to know the soon article to the shelf-life by other equipment, greatly facilitates user.
Fig. 6 is the structure diagram for showing intelligent domestic system 600 according to the ... of the embodiment of the present invention.As shown in fig. 6, the intelligence Energy house system includes intelligent refrigerated equipment 610, server 620 and three terminal devices 630,640,650.Although shown here as Three terminal devices, it is to be understood that, which can also include more or fewer terminal devices.
According to embodiments of the present invention, intelligent refrigerated equipment 610 can be the intelligent electronic device for having refrigerating function, such as Intelligent refrigerator, intelligent refrigerator-freezer etc..Various client applications can be installed, such as intelligent cold on terminal device 630,640,650 Hide the client application etc. of equipment.Terminal device 630,640,650 can be the various electronic equipments for having display screen, including but It is not limited to smart mobile phone, tablet computer, E-book reader, MP3 player (Moving Picture Experts Group Audio LayerIII, dynamic image expert's compression standard audio level 3), MP4 (Moving Picture Experts Group Audio Layer IV, dynamic image expert's compression standard audio level 4) player, pocket computer on knee and Desktop computer etc..
According to embodiments of the present invention, network 660 is in intelligent refrigerated equipment 610, server 620 and three terminal devices 630, communication link is provided between 640,650.Network 660 may include various connection types, such as wired, wireless communication link Or fiber optic cables etc..User can pass through network 660 and intelligent refrigerated equipment 610 with using terminal equipment 630,640,650 Or server 620 interacts, to receive or send message etc..
It should be understood that the number of the terminal device, network and intelligent refrigerated equipment in Fig. 6 is only schematical.According to It realizes and needs, can have any number of terminal device, network and intelligent refrigerated equipment.
According to embodiments of the present invention, intelligent refrigerated equipment 610 may include the taking module 510 described above with reference to Fig. 5 With detection module 520, but its do not have information management system.Server 620 may include the information management system described with reference to figure 3 System 300 or the information management system 400 described with reference to figure 4, and the operation described with reference to figure 1 is executed, it generates correspondence and has added mark The image of label and the prompting message for having added tagged article.The prompting message can be presented in intelligent refrigerated equipment 610 to user.
In the present embodiment, the function of information transmission system is realized in server 620, can be with simplified intelligent refrigerating equipment Design of hardware and software.Moreover, the processing speed of server 620 is generally very fast, more smooth fast user experience can be provided.
Alternatively, according to an embodiment of the invention, terminal device 630,640,650 can receive the prompting message and to user The prompting message is presented.
In the present embodiment, intelligent refrigerated equipment 610 can need not realize the function of information management system, can not also The presentation function of realization prompting message is needed, and need to only realize the function for upload of taking pictures, the soft and hardware of intelligent refrigerated equipment is wanted It asks relatively low, the cost of intelligent refrigerated equipment 610 can be significantly reduced, keep its price more competitive.Moreover, because soft, hard Part is simpler, and also smaller, after-sales service cost are also lower for the possibility of failure.
Although the present invention, art technology has shown and described with reference to the certain exemplary embodiments of the present invention Personnel it should be understood that in the case of the spirit and scope of the present invention limited without departing substantially from the following claims and their equivalents, A variety of changes in form and details can be carried out to the present invention.Therefore, the scope of the present invention should not necessarily be limited by above-described embodiment, But should be not only determined by appended claims, also it is defined by the equivalent of appended claims.

Claims (23)

1. a kind of approaches to IM of intelligent refrigerated equipment, including:
Obtain the image of article in the intelligent refrigerated equipment;
The presentation image to be presented to the user is generated based on described image;
Receive the selected instruction to the article in the presentation image;And
It is in response to the selected instruction, chosen article is associated with the setting information of the article.
2. according to the method described in claim 1, wherein, the presentation image packet to be presented to the user is generated based on described image It includes:
It identifies the article in described image, and label is added to the article identified;And/or
Described image is compared with the image of single item in the intelligent refrigerated equipment of last time acquisition, is recognized Already present article in the image of article in the intelligent refrigerated equipment that last time obtains, and the article to recognizing adds institute State label;And/or
The presentation image to be presented to the user is generated based on described image, and without the identification and/or identification.
3. according to the method described in claim 2, wherein:
The label include it is following in it is any one or more:The identification of the shooting time of described image, the article Number, shelf-life of the classification of the article or the article.
4. according to the method described in claim 2, wherein, reception includes to the selected instruction of article in described image:
Reception clicks instruction to the article added with label;And/or
The frame for receiving the article to being not added with label selects instruction.
5. according to the method described in claim 1, wherein, the setting information includes any one of following:Article is guaranteed the quality Phase information, presupposed information, and/or information input by user.
6. according to the method described in claim 3, further including:
Determine the storage duration of article identifying or recognizing;And
Judge whether the storage duration meets prompting rule, if so, sending prompting message.
7. according to the method described in claim 6, further including:
Shooting time for the first time corresponding with the article for identifying or recognizing is searched from database,
Wherein it is determined that the storage duration includes the difference according to the shooting time for the first time and this shooting time or current time Value determines storage duration.
8. according to the method described in claim 1, wherein, include by chosen article is associated with the setting information of the article Following any one:
The shelf-life input window for corresponding to chosen article is provided, the guarantor that user inputs to described information input window is received Setting information of the matter phase information as the chosen article;
The suggestion shelf-life for corresponding to chosen article is provided, receives user to the determine instruction for suggesting the shelf-life, and Using the suggestion shelf-life as the setting information of the chosen article;Or
The range selection window for providing the suggestion shelf-life for corresponding to chosen article receives user to the guarantor in the range The selection instruction of matter phase, the shelf-life that user is selected is as the setting information of the chosen article.
9. according to the method described in claim 8, further including:
The elimination to the shelf-life information of chosen article is received to instruct;
It is instructed in response to the elimination, eliminates the setting of the shelf-life information to chosen article.
10. a kind of information management system of intelligent refrigerated equipment, including:
Image collection module obtains the image of article in the intelligent refrigerated equipment;
Image generation module generates the presentation image to be presented to the user based on described image;
Selected command reception module receives the selected instruction to the article in the presentation image;And
Relating module, it is in response to the selected instruction, chosen article is associated with the setting information of the article.
11. system according to claim 10, wherein generate the presentation image packet to be presented to the user based on described image It includes:
It identifies the article in described image, and label is added to the article identified;And/or
Described image is compared with the image of single item in the intelligent refrigerated equipment of last time acquisition, is recognized Already present article in the image of article in the intelligent refrigerated equipment that last time obtains, and the article to recognizing adds institute State label;And/or
The presentation image to be presented to the user is generated based on described image, and without the identification and/or identification.
12. system according to claim 11, wherein:
The label include it is following in it is any one or more:The identification of the shooting time of described image, the article Number, shelf-life of the classification of the article or the article.
13. system according to claim 11, wherein reception include to the selected instruction of article in described image:
Reception clicks instruction to the article added with label;And/or
The frame for receiving the article to being not added with label selects instruction.
14. system according to claim 10, wherein the setting information includes any one of following:The guarantor of article Matter phase information, presupposed information, and/or information input by user.
15. system according to claim 12, further includes:
Determining module determines the storage duration of article identifying or recognizing;And
Reminding module, judges whether the storage duration meets prompting rule, if so, sending prompting message.
16. system according to claim 15, further includes:
Searching module searches shooting time for the first time corresponding with the article for identifying or recognizing from database,
Wherein it is determined that the storage duration includes the difference according to the shooting time for the first time and this shooting time or current time Value determines storage duration.
17. system according to claim 10, wherein by chosen article packet associated with the setting information of the article Include following any one:
The shelf-life input window for corresponding to chosen article is provided, the guarantor that user inputs to described information input window is received Setting information of the matter phase information as the chosen article;
The suggestion shelf-life for corresponding to chosen article is provided, receives user to the determine instruction for suggesting the shelf-life, and Using the suggestion shelf-life as the setting information of the chosen article;Or
The range selection window for providing the suggestion shelf-life for corresponding to chosen article receives user to the guarantor in the range The selection instruction of matter phase, the shelf-life that user is selected is as the setting information of the chosen article.
18. system according to claim 17, further includes:
Command reception module is eliminated, the elimination to the shelf-life information of chosen article is received and instructs;And
Cancellation module is instructed in response to the elimination, eliminates the setting of the shelf-life information to chosen article.
19. a kind of information management system of intelligent refrigerated equipment, including:
At least one processor;And
At least one processor is stored with computer-readable instruction, and described instruction is when being executed by processor so that processor is held Row is method according to claim 1 to 9.
20. a kind of intelligent refrigerated equipment includes the information management system according to any one of claim 10~19.
21. intelligent refrigerated equipment according to claim 20, further includes:
Taking module is configured to obtain the image of the article in the intelligent refrigerated equipment;With
Detection module is configured to detect enabling or the door-closing operation of the intelligent refrigerated equipment,
Wherein, when detection module detects enabling or the door-closing operation of the intelligent refrigerated equipment, the taking module obtains The image of article in the intelligent refrigerated equipment.
22. a kind of intelligent domestic system, including intelligent refrigerated equipment, server and at least one terminal device, wherein:
The intelligent refrigerated equipment includes:
Taking module is configured to obtain the image of the article in the intelligent refrigerated equipment;With
Detection module is configured to detect enabling or the door-closing operation of the intelligent refrigerated equipment,
Wherein, when detection module detects enabling or the door-closing operation of the intelligent refrigerated equipment, the taking module obtains The image of article in the intelligent refrigerated equipment;
The server includes the information management system according to any one of claim 10~19;And
The server is interacted by the intelligent refrigerated equipment and/or the terminal device with user.
23. a kind of computer readable storage medium is stored with computer-readable instruction, described instruction when being executed by processor, So that processor executes method according to claim 1 to 9.
CN201710158725.7A 2017-03-16 2017-03-16 Approaches to IM, system, intelligent refrigerated equipment and intelligent domestic system Pending CN108626959A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710158725.7A CN108626959A (en) 2017-03-16 2017-03-16 Approaches to IM, system, intelligent refrigerated equipment and intelligent domestic system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710158725.7A CN108626959A (en) 2017-03-16 2017-03-16 Approaches to IM, system, intelligent refrigerated equipment and intelligent domestic system

Publications (1)

Publication Number Publication Date
CN108626959A true CN108626959A (en) 2018-10-09

Family

ID=63687406

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710158725.7A Pending CN108626959A (en) 2017-03-16 2017-03-16 Approaches to IM, system, intelligent refrigerated equipment and intelligent domestic system

Country Status (1)

Country Link
CN (1) CN108626959A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109539683A (en) * 2018-10-23 2019-03-29 许秋凤 A kind of refrigerator storing approaches to IM, system and computer readable storage medium
CN110701865A (en) * 2019-11-13 2020-01-17 广州美的华凌冰箱有限公司 Control method and device for cooling beverage and refrigerator

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102261808A (en) * 2011-06-16 2011-11-30 达真贸易(深圳)有限公司 Refrigerator food management system and application method thereof
CN105259112A (en) * 2015-11-09 2016-01-20 小米科技有限责任公司 Method and device for determining shelf life of food
CN105809134A (en) * 2016-03-09 2016-07-27 北京京东尚科信息技术有限公司 Intelligent refrigeration device and method for monitoring intelligent refrigeration device
CN105809135A (en) * 2016-03-09 2016-07-27 北京京东尚科信息技术有限公司 Intelligent refrigeration device and method for monitoring intelligent refrigeration device
CN106225416A (en) * 2016-08-10 2016-12-14 广东格兰仕集团有限公司 The food management method of intelligent refrigerator
CN106247752A (en) * 2016-09-29 2016-12-21 四川长虹电器股份有限公司 Refrigerator items storage system based on Internet of Things

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102261808A (en) * 2011-06-16 2011-11-30 达真贸易(深圳)有限公司 Refrigerator food management system and application method thereof
CN105259112A (en) * 2015-11-09 2016-01-20 小米科技有限责任公司 Method and device for determining shelf life of food
CN105809134A (en) * 2016-03-09 2016-07-27 北京京东尚科信息技术有限公司 Intelligent refrigeration device and method for monitoring intelligent refrigeration device
CN105809135A (en) * 2016-03-09 2016-07-27 北京京东尚科信息技术有限公司 Intelligent refrigeration device and method for monitoring intelligent refrigeration device
CN106225416A (en) * 2016-08-10 2016-12-14 广东格兰仕集团有限公司 The food management method of intelligent refrigerator
CN106247752A (en) * 2016-09-29 2016-12-21 四川长虹电器股份有限公司 Refrigerator items storage system based on Internet of Things

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
杨汉宏等: "《露天矿交通运输安全预警预控原理及实践》", 31 January 2017, 中国矿业大学出版社 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109539683A (en) * 2018-10-23 2019-03-29 许秋凤 A kind of refrigerator storing approaches to IM, system and computer readable storage medium
CN110701865A (en) * 2019-11-13 2020-01-17 广州美的华凌冰箱有限公司 Control method and device for cooling beverage and refrigerator
WO2021093285A1 (en) * 2019-11-13 2021-05-20 广州美的华凌冰箱有限公司 Control method and apparatus for cooling beverage, and refrigerator

Similar Documents

Publication Publication Date Title
US10452921B2 (en) Methods and systems for displaying video streams
US20190066473A1 (en) Methods and devices for presenting video information
US9224044B1 (en) Method and system for video zone monitoring
CN111444880B (en) Food material identification method and refrigerator
CN109299384A (en) Scene recommended method, apparatus and system, storage medium
US20160005281A1 (en) Method and System for Processing Motion Event Notifications
CN110168298A (en) Refrigerator and its information display method
CN112005268B (en) Refrigerator, method of displaying user interface on refrigerator, user terminal, and method of performing function in user terminal
KR102699484B1 (en) How to care for your refrigerator and its contents
CN105809134A (en) Intelligent refrigeration device and method for monitoring intelligent refrigeration device
CN108805123A (en) A kind of device, method and system that the time limit reminds
US20230043011A1 (en) Artificial intelligence refrigerator and operating method therefor
Voulodimos et al. Improving multi-camera activity recognition by employing neural network based readjustment
CN103822429B (en) The method of the suitableeest storage food of a kind of prompting and refrigerator
CN108626959A (en) Approaches to IM, system, intelligent refrigerated equipment and intelligent domestic system
CN103888423B (en) Information processing method and information processing equipment
CN108626960A (en) Information-pushing method, system, intelligent refrigerated equipment and intelligent domestic system
KR101812524B1 (en) Crouding management system of controlling home appliance and driving method thereof for refrigerator having artificial intelligence
CN113239780A (en) Food material determining method and device, electronic equipment, refrigerator and storage medium
CN112199406A (en) Information recommendation method, food material storage device and server
CN105809135A (en) Intelligent refrigeration device and method for monitoring intelligent refrigeration device
CN108151432A (en) Intelligent refrigerated device and method thereof
CN108629232A (en) Information-pushing method, system, intelligent refrigerated equipment and intelligent domestic system
CN108072228A (en) The information processing method and device of intelligent refrigerated equipment
KR102718827B1 (en) Food management system, server, and refrigerator

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20181009